[2024-07-24 18:47:12.410746] Starting SPDK v24.09-pre git sha1 0bb5c21e2 / DPDK 24.03.0 initialization... [2024-07-24 18:47:12.411063] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3502796 ] Set seed to 1721839632403622 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-24 18:47:12.559223] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-24 18:47:12.697165] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-24 18:47:12.697207] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3502796' to capture a snapshot of events at runtime. [2024-07-24 18:47:12.697216] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-24 18:47:12.697226] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-24 18:47:12.697232] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3502796 for offline analysis/debug. [2024-07-24 18:47:12.697295] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 24 18:47:14 2024 CPU: 144 * Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz CPUCache: 55296 KB 2024/07/24-18:47:19 ... thread 0: (1000000,1000000) ops and (192980.2,192980.2) ops/second in (5.181880,5.181880) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 1.23 GB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 178.3 4.58 1.92 11 0.417 0 0 0.0 0.0 L1 4/4 396.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 128.78 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 40/8 2.62 GB 1.9 3.2 2.0 1.2 3.2 2.0 0.0 1.6 134.5 132.6 24.59 14.18 12 2.049 1794K 5015 0.0 0.0 L4 157/20 11.46 GB 1.0 1.9 1.4 0.5 1.8 1.3 0.6 1.3 144.5 140.3 13.30 7.66 9 1.478 374K 1831 0.0 0.0 L5 128/0 9.29 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 346/46 25.11 GB 0.0 5.1 3.4 1.7 5.8 4.1 0.6 7.3 123.1 139.9 42.48 23.76 32 1.327 2169K 6846 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 3.4 1.7 5.8 4.1 0.6 7.3 123.1 139.9 42.48 23.76 32 1.327 2169K 6846 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 3.4 1.7 5.0 3.3 0.0 0.0 138.0 135.3 37.90 21.84 21 1.805 2169K 6846 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 178.3 4.58 1.92 11 0.417 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.3 total, 5.2 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.80 GB write, 1129.41 MB/s write, 5.11 GB read, 993.93 MB/s read, 42.5 seconds Interval compaction: 5.80 GB write, 1146.04 MB/s write, 5.11 GB read, 1008.57 MB/s read, 42.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 109598 Average: 73.8574 StdDev: 607.35 Min: 0 Median: 1.6993 Max: 45041 Percentiles: P50: 1.70 P75: 2.80 P99: 1779.09 P99.9: 5167.60 P99.99: 28902.64 ------------------------------------------------------ [ 0, 1 ] 18274 16.674% 16.674% ### ( 1, 2 ] 52230 47.656% 64.330% ########## ( 2, 3 ] 14553 13.279% 77.608% ### ( 3, 4 ] 8513 7.767% 85.376% ## ( 4, 6 ] 6884 6.281% 91.657% # ( 6, 10 ] 1730 1.578% 93.235% ( 10, 15 ] 122 0.111% 93.347% ( 15, 22 ] 15 0.014% 93.360% ( 22, 34 ] 11 0.010% 93.370% ( 34, 51 ] 11 0.010% 93.380% ( 51, 76 ] 4 0.004% 93.384% ( 76, 110 ] 3 0.003% 93.387% ( 110, 170 ] 71 0.065% 93.452% ( 170, 250 ] 315 0.287% 93.739% ( 250, 380 ] 1114 1.016% 94.755% ( 380, 580 ] 2046 1.867% 96.622% ( 580, 870 ] 1630 1.487% 98.109% ( 870, 1300 ] 671 0.612% 98.722% ( 1300, 1900 ] 382 0.349% 99.070% ( 1900, 2900 ] 517 0.472% 99.542% ( 2900, 4400 ] 361 0.329% 99.871% ( 4400, 6600 ] 90 0.082% 99.953% ( 6600, 9900 ] 22 0.020% 99.974% ( 9900, 14000 ] 5 0.005% 99.978% ( 14000, 22000 ] 3 0.003% 99.981% ( 22000, 33000 ] 16 0.015% 99.995% ( 33000, 50000 ] 8 0.007% 100.003% ** Level 1 read latency histogram (micros): Count: 7739 Average: 67.1012 StdDev: 494.51 Min: 1 Median: 1.5108 Max: 22803 Percentiles: P50: 1.51 P75: 2.40 P99: 1488.86 P99.9: 5595.70 P99.99: 22803.00 ------------------------------------------------------ [ 0, 1 ] 2215 28.621% 28.621% ###### ( 1, 2 ] 3239 41.853% 70.474% ######## ( 2, 3 ] 869 11.229% 81.703% ## ( 3, 4 ] 537 6.939% 88.642% # ( 4, 6 ] 338 4.367% 93.009% # ( 6, 10 ] 42 0.543% 93.552% ( 10, 15 ] 5 0.065% 93.617% ( 22, 34 ] 2 0.026% 93.643% ( 34, 51 ] 4 0.052% 93.694% ( 76, 110 ] 1 0.013% 93.707% ( 110, 170 ] 7 0.090% 93.798% ( 170, 250 ] 23 0.297% 94.095% ( 250, 380 ] 68 0.879% 94.974% ( 380, 580 ] 132 1.706% 96.679% ( 580, 870 ] 131 1.693% 98.372% ( 870, 1300 ] 42 0.543% 98.915% ( 1300, 1900 ] 21 0.271% 99.186% ( 1900, 2900 ] 34 0.439% 99.625% ( 2900, 4400 ] 18 0.233% 99.858% ( 4400, 6600 ] 6 0.078% 99.935% ( 6600, 9900 ] 2 0.026% 99.961% ( 14000, 22000 ] 2 0.026% 99.987% ( 22000, 33000 ] 1 0.013% 100.000% ** Level 2 read latency histogram (micros): Count: 400556 Average: 12.4052 StdDev: 220.80 Min: 0 Median: 1.6798 Max: 25986 Percentiles: P50: 1.68 P75: 2.66 P99: 9.75 P99.9: 2356.74 P99.99: 4289.90 ------------------------------------------------------ [ 0, 1 ] 64418 16.082% 16.082% ### ( 1, 2 ] 199863 49.896% 65.979% ########## ( 2, 3 ] 54875 13.700% 79.678% ### ( 3, 4 ] 38062 9.502% 89.181% ## ( 4, 6 ] 32578 8.133% 97.314% ## ( 6, 10 ] 7203 1.798% 99.112% ( 10, 15 ] 428 0.107% 99.219% ( 15, 22 ] 97 0.024% 99.243% ( 22, 34 ] 103 0.026% 99.269% ( 34, 51 ] 150 0.037% 99.306% ( 51, 76 ] 50 0.012% 99.319% ( 76, 110 ] 30 0.007% 99.326% ( 110, 170 ] 40 0.010% 99.336% ( 170, 250 ] 193 0.048% 99.384% ( 250, 380 ] 460 0.115% 99.499% ( 380, 580 ] 648 0.162% 99.661% ( 580, 870 ] 407 0.102% 99.763% ( 870, 1300 ] 230 0.057% 99.820% ( 1300, 1900 ] 209 0.052% 99.872% ( 1900, 2900 ] 244 0.061% 99.933% ( 2900, 4400 ] 246 0.061% 99.995% ( 4400, 6600 ] 60 0.015% 100.009% ( 6600, 9900 ] 37 0.009% 100.019% ( 9900, 14000 ] 10 0.002% 100.021% ( 14000, 22000 ] 16 0.004% 100.025% ( 22000, 33000 ] 7 0.002% 100.027% ** Level 3 read latency histogram (micros): Count: 663354 Average: 14.4817 StdDev: 307.89 Min: 0 Median: 1.5585 Max: 48978 Percentiles: P50: 1.56 P75: 2.36 P99: 9.99 P99.9: 2341.11 P99.99: 4206.27 ------------------------------------------------------ [ 0, 1 ] 160993 24.270% 24.270% ##### ( 1, 2 ] 305621 46.072% 70.342% ######### ( 2, 3 ] 84725 12.772% 83.114% ### ( 3, 4 ] 58022 8.747% 91.861% ## ( 4, 6 ] 40592 6.119% 97.980% # ( 6, 10 ] 6787 1.023% 99.003% ( 10, 15 ] 456 0.069% 99.072% ( 15, 22 ] 108 0.016% 99.088% ( 22, 34 ] 132 0.020% 99.108% ( 34, 51 ] 217 0.033% 99.141% ( 51, 76 ] 48 0.007% 99.148% ( 76, 110 ] 27 0.004% 99.152% ( 110, 170 ] 73 0.011% 99.163% ( 170, 250 ] 292 0.044% 99.207% ( 250, 380 ] 923 0.139% 99.346% ( 380, 580 ] 1459 0.220% 99.566% ( 580, 870 ] 1134 0.171% 99.737% ( 870, 1300 ] 470 0.071% 99.808% ( 1300, 1900 ] 404 0.061% 99.869% ( 1900, 2900 ] 473 0.071% 99.940% ( 2900, 4400 ] 382 0.058% 99.998% ( 4400, 6600 ] 80 0.012% 100.010% ( 6600, 9900 ] 34 0.005% 100.015% ( 9900, 14000 ] 23 0.003% 100.018% ( 14000, 22000 ] 43 0.006% 100.025% ( 22000, 33000 ] 19 0.003% 100.028% ( 33000, 50000 ] 12 0.002% 100.029% ** Level 4 read latency histogram (micros): Count: 256217 Average: 37.9208 StdDev: 356.64 Min: 0 Median: 1.4749 Max: 48016 Percentiles: P50: 1.47 P75: 2.27 P99: 851.98 P99.9: 3780.28 P99.99: 5702.28 ------------------------------------------------------ [ 0, 1 ] 77769 30.353% 30.353% ###### ( 1, 2 ] 106008 41.374% 71.727% ######## ( 2, 3 ] 30856 12.043% 83.770% ## ( 3, 4 ] 19883 7.760% 91.530% ## ( 4, 6 ] 10652 4.157% 95.688% # ( 6, 10 ] 1376 0.537% 96.225% ( 10, 15 ] 117 0.046% 96.270% ( 15, 22 ] 26 0.010% 96.280% ( 22, 34 ] 54 0.021% 96.302% ( 34, 51 ] 55 0.021% 96.323% ( 51, 76 ] 13 0.005% 96.328% ( 76, 110 ] 15 0.006% 96.334% ( 110, 170 ] 107 0.042% 96.376% ( 170, 250 ] 487 0.190% 96.566% ( 250, 380 ] 1649 0.644% 97.209% ( 380, 580 ] 2608 1.018% 98.227% ( 580, 870 ] 2111 0.824% 99.051% ( 870, 1300 ] 866 0.338% 99.389% ( 1300, 1900 ] 485 0.189% 99.578% ( 1900, 2900 ] 582 0.227% 99.806% ( 2900, 4400 ] 412 0.161% 99.966% ( 4400, 6600 ] 102 0.040% 100.006% ( 6600, 9900 ] 29 0.011% 100.018% ( 9900, 14000 ] 10 0.004% 100.021% ( 14000, 22000 ] 10 0.004% 100.025% ( 22000, 33000 ] 7 0.003% 100.028% ( 33000, 50000 ] 3 0.001% 100.029% ** Level 5 read latency histogram (micros): Count: 6740 Average: 953.7239 StdDev: 1789.98 Min: 101 Median: 545.6786 Max: 47008 Percentiles: P50: 545.68 P75: 867.66 P99: 5774.32 P99.9: 31837.14 P99.99: 47008.00 ------------------------------------------------------ ( 76, 110 ] 6 0.089% 0.089% ( 110, 170 ] 76 1.128% 1.217% ( 170, 250 ] 420 6.231% 7.448% # ( 250, 380 ] 1275 18.917% 26.365% #### ( 380, 580 ] 1923 28.531% 54.896% ###### ( 580, 870 ] 1366 20.267% 75.163% #### ( 870, 1300 ] 574 8.516% 83.680% ## ( 1300, 1900 ] 317 4.703% 88.383% # ( 1900, 2900 ] 396 5.875% 94.258% # ( 2900, 4400 ] 269 3.991% 98.249% # ( 4400, 6600 ] 81 1.202% 99.451% ( 6600, 9900 ] 19 0.282% 99.733% ( 14000, 22000 ] 5 0.074% 99.807% ( 22000, 33000 ] 7 0.104% 99.911% ( 33000, 50000 ] 6 0.089% 100.000% ** DB Stats ** Uptime(secs): 5.3 total, 5.2 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 187.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.043 H:M:S, 19.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 189.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.043 H:M:S, 20.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/24-18:47:27 ... thread 0: (1000000,2000000) ops and (134114.0,158250.1) ops/second in (7.456345,12.638225) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 1.84 GB 25.0 1.1 0.0 1.1 2.9 1.8 0.0 1.6 62.8 167.2 18.02 9.04 31 0.581 1149K 6167 0.0 0.0 L1 1/0 96.57 MB 9.7 0.8 0.4 0.4 0.8 0.4 0.0 1.9 66.5 65.5 12.61 5.27 1 12.605 851K 12K 0.0 0.0 L2 5/3 412.01 MB 1.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/9 1.25 GB 0.8 3.4 2.2 1.3 3.4 2.1 0.3 1.6 137.5 135.5 25.64 14.99 13 1.972 2014K 7501 0.0 0.0 L4 145/0 9.67 GB 1.0 7.0 2.9 4.1 6.2 2.1 0.9 2.2 190.4 168.8 37.68 24.96 26 1.449 1568K 1831 0.0 0.0 L5 168/0 12.14 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 355/26 25.39 GB 0.0 12.4 5.5 6.9 13.4 6.5 4.8 7.2 134.8 145.5 93.94 54.26 71 1.323 5584K 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.4 5.5 6.9 13.4 6.5 4.8 7.2 134.8 145.5 93.94 54.26 71 1.323 5584K 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.4 5.5 6.9 11.5 4.6 0.0 0.0 149.0 138.6 85.01 49.11 44 1.932 5584K 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 211.3 8.93 5.15 27 0.331 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.7 total, 12.6 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.35 GB write, 1074.96 MB/s write, 12.37 GB read, 995.92 MB/s read, 93.9 seconds Interval compaction: 13.35 GB write, 1081.45 MB/s write, 12.37 GB read, 1001.93 MB/s read, 93.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 29, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 29, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 13, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 458823 Average: 69.0788 StdDev: 487.71 Min: 0 Median: 1.5411 Max: 54439 Percentiles: P50: 1.54 P75: 2.74 P99: 833.20 P99.9: 2739.26 P99.99: 3719.04 ------------------------------------------------------ [ 0, 1 ] 126948 27.668% 27.668% ###### ( 1, 2 ] 189353 41.269% 68.937% ######## ( 2, 3 ] 37695 8.216% 77.153% ## ( 3, 4 ] 21255 4.633% 81.786% # ( 4, 6 ] 14594 3.181% 84.966% # ( 6, 10 ] 3946 0.860% 85.826% ( 10, 15 ] 1723 0.376% 86.202% ( 15, 22 ] 109 0.024% 86.226% ( 22, 34 ] 80 0.017% 86.243% ( 34, 51 ] 24 0.005% 86.248% ( 51, 76 ] 5 0.001% 86.249% ( 76, 110 ] 822 0.179% 86.429% ( 110, 170 ] 8505 1.854% 88.282% ( 170, 250 ] 11248 2.451% 90.734% ( 250, 380 ] 18890 4.117% 94.851% # ( 380, 580 ] 13148 2.866% 97.716% # ( 580, 870 ] 6748 1.471% 99.187% ( 870, 1300 ] 1926 0.420% 99.607% ( 1300, 1900 ] 685 0.149% 99.756% ( 1900, 2900 ] 789 0.172% 99.928% ( 2900, 4400 ] 524 0.114% 100.042% ( 4400, 6600 ] 107 0.023% 100.066% ( 6600, 9900 ] 35 0.008% 100.073% ( 9900, 14000 ] 23 0.005% 100.078% ( 14000, 22000 ] 24 0.005% 100.083% ( 22000, 33000 ] 55 0.012% 100.095% ( 33000, 50000 ] 18 0.004% 100.099% ( 50000, 75000 ] 1 0.000% 100.100% ** Level 1 read latency histogram (micros): Count: 102373 Average: 16.1652 StdDev: 257.89 Min: 1 Median: 3.0575 Max: 42950 Percentiles: P50: 3.06 P75: 4.21 P99: 347.50 P99.9: 1519.87 P99.99: 6534.74 ------------------------------------------------------ [ 0, 1 ] 8255 8.064% 8.064% ## ( 1, 2 ] 22931 22.399% 30.463% #### ( 2, 3 ] 18544 18.114% 48.577% #### ( 3, 4 ] 25334 24.747% 73.324% ##### ( 4, 6 ] 16292 15.914% 89.238% ### ( 6, 10 ] 5230 5.109% 94.347% # ( 10, 15 ] 2274 2.221% 96.568% ( 15, 22 ] 946 0.924% 97.493% ( 22, 34 ] 462 0.451% 97.944% ( 34, 51 ] 63 0.062% 98.005% ( 51, 76 ] 8 0.008% 98.013% ( 76, 110 ] 41 0.040% 98.053% ( 110, 170 ] 249 0.243% 98.296% ( 170, 250 ] 325 0.317% 98.614% ( 250, 380 ] 527 0.515% 99.129% ( 380, 580 ] 416 0.406% 99.535% ( 580, 870 ] 273 0.267% 99.802% ( 870, 1300 ] 90 0.088% 99.890% ( 1300, 1900 ] 29 0.028% 99.918% ( 1900, 2900 ] 41 0.040% 99.958% ( 2900, 4400 ] 25 0.024% 99.982% ( 4400, 6600 ] 8 0.008% 99.990% ( 6600, 9900 ] 3 0.003% 99.993% ( 9900, 14000 ] 2 0.002% 99.995% ( 14000, 22000 ] 4 0.004% 99.999% ( 22000, 33000 ] 3 0.003% 100.002% ( 33000, 50000 ] 1 0.001% 100.003% ** Level 2 read latency histogram (micros): Count: 433334 Average: 11.8784 StdDev: 213.96 Min: 0 Median: 1.6717 Max: 25986 Percentiles: P50: 1.67 P75: 2.64 P99: 9.68 P99.9: 2238.80 P99.99: 4283.06 ------------------------------------------------------ [ 0, 1 ] 73690 17.005% 17.005% ### ( 1, 2 ] 212858 49.121% 66.126% ########## ( 2, 3 ] 59761 13.791% 79.917% ### ( 3, 4 ] 41400 9.554% 89.471% ## ( 4, 6 ] 34405 7.940% 97.411% ## ( 6, 10 ] 7493 1.729% 99.140% ( 10, 15 ] 444 0.102% 99.242% ( 15, 22 ] 102 0.024% 99.266% ( 22, 34 ] 110 0.025% 99.291% ( 34, 51 ] 151 0.035% 99.326% ( 51, 76 ] 51 0.012% 99.338% ( 76, 110 ] 30 0.007% 99.345% ( 110, 170 ] 40 0.009% 99.354% ( 170, 250 ] 198 0.046% 99.400% ( 250, 380 ] 492 0.114% 99.513% ( 380, 580 ] 694 0.160% 99.673% ( 580, 870 ] 451 0.104% 99.778% ( 870, 1300 ] 237 0.055% 99.832% ( 1300, 1900 ] 211 0.049% 99.881% ( 1900, 2900 ] 244 0.056% 99.937% ( 2900, 4400 ] 248 0.057% 99.994% ( 4400, 6600 ] 60 0.014% 100.008% ( 6600, 9900 ] 38 0.009% 100.017% ( 9900, 14000 ] 11 0.003% 100.020% ( 14000, 22000 ] 16 0.004% 100.023% ( 22000, 33000 ] 7 0.002% 100.025% ** Level 3 read latency histogram (micros): Count: 963317 Average: 14.7461 StdDev: 304.07 Min: 0 Median: 1.5396 Max: 48978 Percentiles: P50: 1.54 P75: 2.35 P99: 264.68 P99.9: 1906.92 P99.99: 4136.02 ------------------------------------------------------ [ 0, 1 ] 249857 25.937% 25.937% ##### ( 1, 2 ] 429619 44.598% 70.535% ######### ( 2, 3 ] 122858 12.754% 83.289% ### ( 3, 4 ] 84110 8.731% 92.020% ## ( 4, 6 ] 54927 5.702% 97.722% # ( 6, 10 ] 8501 0.882% 98.604% ( 10, 15 ] 596 0.062% 98.666% ( 15, 22 ] 125 0.013% 98.679% ( 22, 34 ] 150 0.016% 98.695% ( 34, 51 ] 238 0.025% 98.719% ( 51, 76 ] 59 0.006% 98.726% ( 76, 110 ] 104 0.011% 98.736% ( 110, 170 ] 898 0.093% 98.830% ( 170, 250 ] 1316 0.137% 98.966% ( 250, 380 ] 2895 0.301% 99.267% ( 380, 580 ] 2960 0.307% 99.574% ( 580, 870 ] 1969 0.204% 99.778% ( 870, 1300 ] 713 0.074% 99.852% ( 1300, 1900 ] 456 0.047% 99.900% ( 1900, 2900 ] 532 0.055% 99.955% ( 2900, 4400 ] 411 0.043% 99.998% ( 4400, 6600 ] 90 0.009% 100.007% ( 6600, 9900 ] 44 0.005% 100.012% ( 9900, 14000 ] 29 0.003% 100.015% ( 14000, 22000 ] 73 0.008% 100.022% ( 22000, 33000 ] 32 0.003% 100.025% ( 33000, 50000 ] 15 0.002% 100.027% ** Level 4 read latency histogram (micros): Count: 1102195 Average: 23.4539 StdDev: 323.56 Min: 0 Median: 1.4634 Max: 80925 Percentiles: P50: 1.46 P75: 2.34 P99: 511.56 P99.9: 1872.56 P99.99: 3408.71 ------------------------------------------------------ [ 0, 1 ] 353234 32.048% 32.048% ###### ( 1, 2 ] 426955 38.737% 70.785% ######## ( 2, 3 ] 136673 12.400% 83.185% ## ( 3, 4 ] 90256 8.189% 91.374% ## ( 4, 6 ] 48624 4.412% 95.785% # ( 6, 10 ] 6324 0.574% 96.359% ( 10, 15 ] 727 0.066% 96.425% ( 15, 22 ] 88 0.008% 96.433% ( 22, 34 ] 136 0.012% 96.445% ( 34, 51 ] 138 0.013% 96.458% ( 51, 76 ] 34 0.003% 96.461% ( 76, 110 ] 477 0.043% 96.504% ( 110, 170 ] 4706 0.427% 96.931% ( 170, 250 ] 6159 0.559% 97.490% ( 250, 380 ] 11129 1.010% 98.500% ( 380, 580 ] 8382 0.760% 99.260% ( 580, 870 ] 4813 0.437% 99.697% ( 870, 1300 ] 1567 0.142% 99.839% ( 1300, 1900 ] 704 0.064% 99.903% ( 1900, 2900 ] 778 0.071% 99.974% ( 2900, 4400 ] 536 0.049% 100.022% ( 4400, 6600 ] 122 0.011% 100.033% ( 6600, 9900 ] 63 0.006% 100.039% ( 9900, 14000 ] 35 0.003% 100.042% ( 14000, 22000 ] 66 0.006% 100.048% ( 22000, 33000 ] 45 0.004% 100.052% ( 33000, 50000 ] 14 0.001% 100.054% ( 50000, 75000 ] 1 0.000% 100.054% ( 75000, 110000 ] 1 0.000% 100.054% ** Level 5 read latency histogram (micros): Count: 26801 Average: 527.8569 StdDev: 1216.53 Min: 82 Median: 335.7088 Max: 47008 Percentiles: P50: 335.71 P75: 524.64 P99: 3882.87 P99.9: 20211.29 P99.99: 41159.81 ------------------------------------------------------ ( 76, 110 ] 310 1.157% 1.157% ( 110, 170 ] 3321 12.391% 13.548% ## ( 170, 250 ] 4565 17.033% 30.581% ### ( 250, 380 ] 7894 29.454% 60.035% ###### ( 380, 580 ] 5546 20.693% 80.728% #### ( 580, 870 ] 2863 10.682% 91.411% ## ( 870, 1300 ] 938 3.500% 94.911% # ( 1300, 1900 ] 415 1.548% 96.459% ( 1900, 2900 ] 470 1.754% 98.213% ( 2900, 4400 ] 322 1.201% 99.414% ( 4400, 6600 ] 87 0.325% 99.739% ( 6600, 9900 ] 23 0.086% 99.825% ( 9900, 14000 ] 7 0.026% 99.851% ( 14000, 22000 ] 17 0.063% 99.914% ( 22000, 33000 ] 16 0.060% 99.974% ( 33000, 50000 ] 9 0.034% 100.007% ** DB Stats ** Uptime(secs): 12.7 total, 7.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 154.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.930 H:M:S, 38.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 131.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.886 H:M:S, 52.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/24-18:47:31 ... thread 0: (1000000,3000000) ops and (216406.2,173820.7) ops/second in (4.620940,17.259165) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 2.75 GB 144.1 2.1 0.0 2.1 4.8 2.8 0.0 1.8 85.8 198.9 24.92 15.37 50 0.498 2171K 11K 0.0 0.0 L1 1/0 96.57 MB 9.7 0.8 0.4 0.4 0.8 0.4 0.0 1.9 66.5 65.5 12.61 5.27 1 12.605 851K 12K 0.0 0.0 L3 17/5 1.25 GB 1.0 5.1 2.6 2.5 5.0 2.5 0.3 2.0 153.7 151.5 33.90 22.52 18 1.884 3712K 31K 0.0 0.0 L4 145/15 9.68 GB 0.9 7.3 3.0 4.4 6.5 2.1 1.2 2.2 192.5 170.0 39.00 26.12 28 1.393 1653K 1831 0.0 0.0 L5 172/0 12.45 GB 0.1 0.0 0.0 0.0 0.0 0.0 3.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 353/30 26.22 GB 0.0 15.3 6.0 9.4 17.1 7.8 4.7 6.2 142.1 158.9 110.43 69.28 97 1.138 8388K 56K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.3 6.0 9.4 17.1 7.8 4.7 6.2 142.1 158.9 110.43 69.28 97 1.138 8388K 56K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.3 6.0 9.4 14.4 5.0 0.0 0.0 159.4 149.5 98.44 61.55 55 1.790 8388K 56K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 236.0 11.99 7.73 42 0.285 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.3 total, 17.3 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.14 GB write, 1012.07 MB/s write, 15.33 GB read, 905.17 MB/s read, 110.4 seconds Interval compaction: 17.14 GB write, 1016.55 MB/s write, 15.33 GB read, 909.17 MB/s read, 110.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 33, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 33, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 33, total-stops: 13, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 745805 Average: 58.4259 StdDev: 429.68 Min: 0 Median: 1.5773 Max: 79992 Percentiles: P50: 1.58 P75: 2.61 P99: 746.67 P99.9: 2194.49 P99.99: 3114.26 ------------------------------------------------------ [ 0, 1 ] 173007 23.197% 23.197% ##### ( 1, 2 ] 346276 46.430% 69.627% ######### ( 2, 3 ] 65694 8.808% 78.436% ## ( 3, 4 ] 34641 4.645% 83.080% # ( 4, 6 ] 21870 2.932% 86.013% # ( 6, 10 ] 5387 0.722% 86.735% ( 10, 15 ] 1967 0.264% 86.999% ( 15, 22 ] 136 0.018% 87.017% ( 22, 34 ] 98 0.013% 87.030% ( 34, 51 ] 31 0.004% 87.034% ( 51, 76 ] 8 0.001% 87.035% ( 76, 110 ] 1193 0.160% 87.195% ( 110, 170 ] 13302 1.784% 88.979% ( 170, 250 ] 20186 2.707% 91.686% # ( 250, 380 ] 30211 4.051% 95.736% # ( 380, 580 ] 19507 2.616% 98.352% # ( 580, 870 ] 8409 1.128% 99.479% ( 870, 1300 ] 2166 0.290% 99.770% ( 1300, 1900 ] 724 0.097% 99.867% ( 1900, 2900 ] 836 0.112% 99.979% ( 2900, 4400 ] 570 0.076% 100.056% ( 4400, 6600 ] 109 0.015% 100.070% ( 6600, 9900 ] 40 0.005% 100.075% ( 9900, 14000 ] 27 0.004% 100.079% ( 14000, 22000 ] 27 0.004% 100.083% ( 22000, 33000 ] 60 0.008% 100.091% ( 33000, 50000 ] 23 0.003% 100.094% ( 50000, 75000 ] 2 0.000% 100.094% ( 75000, 110000 ] 1 0.000% 100.094% ** Level 1 read latency histogram (micros): Count: 208491 Average: 13.2149 StdDev: 243.58 Min: 1 Median: 1.9353 Max: 42950 Percentiles: P50: 1.94 P75: 3.48 P99: 303.68 P99.9: 901.35 P99.99: 4019.49 ------------------------------------------------------ [ 0, 1 ] 24343 11.676% 11.676% ## ( 1, 2 ] 85426 40.973% 52.649% ######## ( 2, 3 ] 31322 15.023% 67.672% ### ( 3, 4 ] 32073 15.383% 83.056% ### ( 4, 6 ] 20937 10.042% 93.098% ## ( 6, 10 ] 6408 3.074% 96.172% # ( 10, 15 ] 2364 1.134% 97.305% ( 15, 22 ] 966 0.463% 97.769% ( 22, 34 ] 465 0.223% 97.992% ( 34, 51 ] 63 0.030% 98.022% ( 51, 76 ] 8 0.004% 98.026% ( 76, 110 ] 71 0.034% 98.060% ( 110, 170 ] 562 0.270% 98.329% ( 170, 250 ] 884 0.424% 98.753% ( 250, 380 ] 1245 0.597% 99.351% ( 380, 580 ] 775 0.372% 99.722% ( 580, 870 ] 363 0.174% 99.896% ( 870, 1300 ] 103 0.049% 99.946% ( 1300, 1900 ] 30 0.014% 99.960% ( 1900, 2900 ] 42 0.020% 99.980% ( 2900, 4400 ] 27 0.013% 99.993% ( 4400, 6600 ] 8 0.004% 99.997% ( 6600, 9900 ] 4 0.002% 99.999% ( 9900, 14000 ] 4 0.002% 100.001% ( 14000, 22000 ] 6 0.003% 100.004% ( 22000, 33000 ] 7 0.003% 100.007% ( 33000, 50000 ] 3 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 433334 Average: 11.8784 StdDev: 213.96 Min: 0 Median: 1.6717 Max: 25986 Percentiles: P50: 1.67 P75: 2.64 P99: 9.68 P99.9: 2238.80 P99.99: 4283.06 ------------------------------------------------------ [ 0, 1 ] 73690 17.005% 17.005% ### ( 1, 2 ] 212858 49.121% 66.126% ########## ( 2, 3 ] 59761 13.791% 79.917% ### ( 3, 4 ] 41400 9.554% 89.471% ## ( 4, 6 ] 34405 7.940% 97.411% ## ( 6, 10 ] 7493 1.729% 99.140% ( 10, 15 ] 444 0.102% 99.242% ( 15, 22 ] 102 0.024% 99.266% ( 22, 34 ] 110 0.025% 99.291% ( 34, 51 ] 151 0.035% 99.326% ( 51, 76 ] 51 0.012% 99.338% ( 76, 110 ] 30 0.007% 99.345% ( 110, 170 ] 40 0.009% 99.354% ( 170, 250 ] 198 0.046% 99.400% ( 250, 380 ] 492 0.114% 99.513% ( 380, 580 ] 694 0.160% 99.673% ( 580, 870 ] 451 0.104% 99.778% ( 870, 1300 ] 237 0.055% 99.832% ( 1300, 1900 ] 211 0.049% 99.881% ( 1900, 2900 ] 244 0.056% 99.937% ( 2900, 4400 ] 248 0.057% 99.994% ( 4400, 6600 ] 60 0.014% 100.008% ( 6600, 9900 ] 38 0.009% 100.017% ( 9900, 14000 ] 11 0.003% 100.020% ( 14000, 22000 ] 16 0.004% 100.023% ( 22000, 33000 ] 7 0.002% 100.025% ** Level 3 read latency histogram (micros): Count: 1351737 Average: 12.7073 StdDev: 277.95 Min: 0 Median: 1.5499 Max: 50973 Percentiles: P50: 1.55 P75: 2.24 P99: 226.75 P99.9: 1347.40 P99.99: 3770.24 ------------------------------------------------------ [ 0, 1 ] 311009 23.008% 23.008% ##### ( 1, 2 ] 663515 49.086% 72.094% ########## ( 2, 3 ] 165573 12.249% 84.343% ## ( 3, 4 ] 108179 8.003% 92.346% ## ( 4, 6 ] 72433 5.359% 97.705% # ( 6, 10 ] 12303 0.910% 98.615% ( 10, 15 ] 813 0.060% 98.675% ( 15, 22 ] 163 0.012% 98.687% ( 22, 34 ] 191 0.014% 98.701% ( 34, 51 ] 288 0.021% 98.722% ( 51, 76 ] 67 0.005% 98.727% ( 76, 110 ] 156 0.012% 98.739% ( 110, 170 ] 1638 0.121% 98.860% ( 170, 250 ] 2668 0.197% 99.057% ( 250, 380 ] 4564 0.338% 99.395% ( 380, 580 ] 3835 0.284% 99.679% ( 580, 870 ] 2200 0.163% 99.842% ( 870, 1300 ] 755 0.056% 99.897% ( 1300, 1900 ] 459 0.034% 99.931% ( 1900, 2900 ] 549 0.041% 99.972% ( 2900, 4400 ] 422 0.031% 100.003% ( 4400, 6600 ] 91 0.007% 100.010% ( 6600, 9900 ] 44 0.003% 100.013% ( 9900, 14000 ] 31 0.002% 100.015% ( 14000, 22000 ] 80 0.006% 100.021% ( 22000, 33000 ] 38 0.003% 100.024% ( 33000, 50000 ] 18 0.001% 100.026% ( 50000, 75000 ] 2 0.000% 100.026% ** Level 4 read latency histogram (micros): Count: 1338273 Average: 25.1881 StdDev: 317.05 Min: 0 Median: 1.5470 Max: 80925 Percentiles: P50: 1.55 P75: 2.55 P99: 511.43 P99.9: 1587.75 P99.99: 2883.32 ------------------------------------------------------ [ 0, 1 ] 376357 28.123% 28.123% ###### ( 1, 2 ] 535222 39.993% 68.116% ######## ( 2, 3 ] 167823 12.540% 80.656% ### ( 3, 4 ] 114420 8.550% 89.206% ## ( 4, 6 ] 71586 5.349% 94.555% # ( 6, 10 ] 11447 0.855% 95.411% ( 10, 15 ] 920 0.069% 95.479% ( 15, 22 ] 136 0.010% 95.490% ( 22, 34 ] 213 0.016% 95.505% ( 34, 51 ] 257 0.019% 95.525% ( 51, 76 ] 60 0.004% 95.529% ( 76, 110 ] 722 0.054% 95.583% ( 110, 170 ] 7715 0.576% 96.160% ( 170, 250 ] 11809 0.882% 97.042% ( 250, 380 ] 18204 1.360% 98.402% ( 380, 580 ] 12177 0.910% 99.312% ( 580, 870 ] 5795 0.433% 99.745% ( 870, 1300 ] 1716 0.128% 99.873% ( 1300, 1900 ] 748 0.056% 99.929% ( 1900, 2900 ] 829 0.062% 99.991% ( 2900, 4400 ] 570 0.043% 100.034% ( 4400, 6600 ] 127 0.009% 100.043% ( 6600, 9900 ] 68 0.005% 100.048% ( 9900, 14000 ] 39 0.003% 100.051% ( 14000, 22000 ] 75 0.006% 100.057% ( 22000, 33000 ] 46 0.003% 100.060% ( 33000, 50000 ] 22 0.002% 100.062% ( 50000, 75000 ] 1 0.000% 100.062% ( 75000, 110000 ] 1 0.000% 100.062% ** Level 5 read latency histogram (micros): Count: 40682 Average: 460.7666 StdDev: 1064.84 Min: 82 Median: 314.7453 Max: 49077 Percentiles: P50: 314.75 P75: 476.86 P99: 3344.59 P99.9: 16661.09 P99.99: 39684.06 ------------------------------------------------------ ( 76, 110 ] 453 1.114% 1.114% ( 110, 170 ] 5370 13.200% 14.313% ### ( 170, 250 ] 8289 20.375% 34.689% #### ( 250, 380 ] 12507 30.743% 65.432% ###### ( 380, 580 ] 8037 19.756% 85.188% #### ( 580, 870 ] 3556 8.741% 93.929% ## ( 870, 1300 ] 1033 2.539% 96.468% # ( 1300, 1900 ] 437 1.074% 97.542% ( 1900, 2900 ] 493 1.212% 98.754% ( 2900, 4400 ] 338 0.831% 99.585% ( 4400, 6600 ] 87 0.214% 99.798% ( 6600, 9900 ] 26 0.064% 99.862% ( 9900, 14000 ] 8 0.020% 99.882% ( 14000, 22000 ] 22 0.054% 99.936% ( 22000, 33000 ] 18 0.044% 99.980% ( 33000, 50000 ] 10 0.025% 100.005% ** DB Stats ** Uptime(secs): 17.3 total, 4.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 170.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.477 H:M:S, 31.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 213.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.547 H:M:S, 11.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 522.339 micros/op 7622 ops/sec 20.335 seconds 154996 operations; 7.4 MB/s (38999 of 38999 found) Microseconds per read: Count: 154996 Average: 522.3659 StdDev: 1284.78 Min: 2 Median: 373.7828 Max: 98229 Percentiles: P50: 373.78 P75: 547.48 P99: 3500.06 P99.9: 19704.00 P99.99: 48819.63 ------------------------------------------------------ ( 1, 2 ] 2 0.001% 0.001% ( 2, 3 ] 20 0.013% 0.014% ( 3, 4 ] 30 0.019% 0.034% ( 4, 6 ] 97 0.063% 0.096% ( 6, 10 ] 215 0.139% 0.235% ( 10, 15 ] 411 0.265% 0.500% ( 15, 22 ] 1092 0.705% 1.205% ( 22, 34 ] 1909 1.232% 2.436% ( 34, 51 ] 1885 1.216% 3.652% ( 51, 76 ] 1357 0.876% 4.528% ( 76, 110 ] 851 0.549% 5.077% ( 110, 170 ] 5742 3.705% 8.782% # ( 170, 250 ] 29423 18.983% 27.765% #### ( 250, 380 ] 36195 23.352% 51.117% ##### ( 380, 580 ] 44206 28.521% 79.638% ###### ( 580, 870 ] 19122 12.337% 91.975% ## ( 870, 1300 ] 6760 4.361% 96.336% # ( 1300, 1900 ] 2117 1.366% 97.702% ( 1900, 2900 ] 1584 1.022% 98.724% ( 2900, 4400 ] 1070 0.690% 99.414% ( 4400, 6600 ] 405 0.261% 99.675% ( 6600, 9900 ] 203 0.131% 99.806% ( 9900, 14000 ] 68 0.044% 99.850% ( 14000, 22000 ] 108 0.070% 99.920% ( 22000, 33000 ] 75 0.048% 99.968% ( 33000, 50000 ] 36 0.023% 99.992% ( 50000, 75000 ] 11 0.007% 99.999% ( 75000, 110000 ] 2 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2711243 rocksdb.bloom.filter.full.positive COUNT : 180752 rocksdb.bloom.filter.full.true.positive COUNT : 154344 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 652 rocksdb.memtable.miss COUNT : 154344 rocksdb.l0.hit COUNT : 15980 rocksdb.l1.hit COUNT : 1745 rocksdb.l2andup.hit COUNT : 136619 rocksdb.compaction.key.drop.new COUNT : 1315136 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3359023 rocksdb.number.keys.read COUNT : 154996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3466511736 rocksdb.bytes.read COUNT : 154996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 589 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 6858762 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 19014924129 rocksdb.compact.write.bytes COUNT : 17656028898 rocksdb.flush.write.bytes COUNT : 3363699004 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 37 rocksdb.number.superversion_acquires COUNT : 733 rocksdb.number.superversion_releases COUNT : 713 rocksdb.number.superversion_cleanups COUNT : 181 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 25 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3341777920 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6073344 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 18849918927 rocksdb.non.last.level.read.count COUNT : 4528254 rocksdb.block.checksum.compute.count COUNT : 4790341 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 370.335458 P95 : 1166.708340 P99 : 3500.056075 P100 : 98229.000000 COUNT : 154996 SUM : 80649188 rocksdb.db.write.micros P50 : 1.649294 P95 : 4.523506 P99 : 8.487853 P100 : 576271.000000 COUNT : 3359023 SUM : 15847623 rocksdb.compaction.times.micros P50 : 1413043.478261 P95 : 4160000.000000 P99 : 11396000.000000 P100 : 12605150.000000 COUNT : 62 SUM : 106166550 rocksdb.compaction.times.cpu_micros P50 : 978260.869565 P95 : 2200000.000000 P99 : 5136000.000000 P100 : 5270264.000000 COUNT : 62 SUM : 68207481 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1049.166667 P95 : 13180.000000 P99 : 55520.000000 P100 : 55520.000000 COUNT : 48 SUM : 175443 rocksdb.compaction.outfile.sync.micros P50 : 1562.500000 P95 : 27830.000000 P99 : 49344.285714 P100 : 75996.000000 COUNT : 227 SUM : 1247081 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 190.000000 P95 : 2275.000000 P99 : 4250.000000 P100 : 8061.000000 COUNT : 130 SUM : 70226 rocksdb.table.open.io.micros P50 : 3366.535433 P95 : 11067.608696 P99 : 19170.909091 P100 : 42607.000000 COUNT : 589 SUM : 2296191 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 2.947317 P95 : 8.626075 P99 : 358.622618 P100 : 80929.000000 COUNT : 4606885 SUM : 77728062 rocksdb.read.block.get.micros P50 : 288.345518 P95 : 841.289818 P99 : 2776.797680 P100 : 62547.000000 COUNT : 183421 SUM : 72420766 rocksdb.write.raw.block.micros P50 : 0.526010 P95 : 0.999418 P99 : 4.261587 P100 : 113156.000000 COUNT : 5103647 SUM : 13500151 rocksdb.numfiles.in.singlecompaction P50 : 3.133333 P95 : 5.953846 P99 : 9.000000 P100 : 9.000000 COUNT : 86 SUM : 322 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567056 P95 : 1105.640804 P99 : 1282.432204 P100 : 576097.000000 COUNT : 43982 SUM : 6864972 rocksdb.sst.read.micros P50 : 1.607554 P95 : 178.938992 P99 : 548.180527 P100 : 80925.000000 COUNT : 4529155 SUM : 137330436 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 154996 SUM : 154996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3359023 SUM : 3466511736 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 235714.285714 P95 : 628000.000000 P99 : 735680.000000 P100 : 735680.000000 COUNT : 48 SUM : 13453844 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 237 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0