[2024-12-06 17:29:56.762803] Starting SPDK v25.01-pre git sha1 a5e6ecf28 / DPDK 23.11.0 initialization... [2024-12-06 17:29:56.763070] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid201402 ] Set seed to 1733502596756098 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-06 17:29:56.895048] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-06 17:29:56.917914] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-06 17:29:56.917959] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 201402' to capture a snapshot of events at runtime. [2024-12-06 17:29:56.917971] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-06 17:29:56.917982] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-06 17:29:56.917990] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid201402 for offline analysis/debug. [2024-12-06 17:29:56.918571] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 6 17:30:01 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/06-17:30:04 ... thread 0: (1000000,1000000) ops and (278848.6,278848.6) ops/second in (3.586175,3.586175) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.36 GB 62.9 0.5 0.0 0.5 1.4 0.9 0.0 1.6 102.2 280.9 4.93 4.41 16 0.308 511K 525 0.0 0.0 L1 11/11 584.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 941.20 MB 0.9 0.2 0.1 0.0 0.2 0.1 0.0 1.2 153.7 153.5 1.02 0.85 1 1.023 0 0 0.0 0.0 L4 140/0 9.75 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 225.2 225.2 0.42 0.40 1 0.421 96K 0 0.0 0.0 L5 1108/0 91.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/25 104.71 GB 0.0 0.7 0.2 0.5 1.6 1.1 0.0 1.9 118.6 256.8 6.38 5.66 18 0.354 608K 525 0.0 0.0 Int 0/0 0.00 KB 0.0 0.7 0.2 0.5 1.6 1.1 0.0 1.9 118.6 256.8 6.38 5.66 18 0.354 608K 525 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.7 0.2 0.5 0.7 0.2 0.0 0.0 225.8 225.6 3.35 3.11 4 0.837 608K 525 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 291.3 3.03 2.56 14 0.216 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.8 total, 3.6 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.60 GB write, 433.62 MB/s write, 0.74 GB read, 200.23 MB/s read, 6.4 seconds Interval compaction: 1.60 GB write, 456.37 MB/s write, 0.74 GB read, 210.74 MB/s read, 6.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 244248 Average: 9.4856 StdDev: 73.27 Min: 0 Median: 1.4951 Max: 7271 Percentiles: P50: 1.50 P75: 1.93 P99: 215.80 P99.9: 665.40 P99.99: 983.14 ------------------------------------------------------ [ 0, 1 ] 51973 21.279% 21.279% #### ( 1, 2 ] 141699 58.014% 79.293% ############ ( 2, 3 ] 26006 10.647% 89.941% ## ( 3, 4 ] 9048 3.704% 93.645% # ( 4, 6 ] 5884 2.409% 96.054% ( 6, 10 ] 2515 1.030% 97.084% ( 10, 15 ] 385 0.158% 97.241% ( 15, 22 ] 119 0.049% 97.290% ( 22, 34 ] 39 0.016% 97.306% ( 34, 51 ] 15 0.006% 97.312% ( 51, 76 ] 4 0.002% 97.314% ( 76, 110 ] 572 0.234% 97.548% ( 110, 170 ] 2698 1.105% 98.653% ( 170, 250 ] 1482 0.607% 99.259% ( 250, 380 ] 855 0.350% 99.609% ( 380, 580 ] 627 0.257% 99.866% ( 580, 870 ] 281 0.115% 99.981% ( 870, 1300 ] 82 0.034% 100.015% ( 1300, 1900 ] 44 0.018% 100.033% ( 1900, 2900 ] 26 0.011% 100.043% ( 2900, 4400 ] 17 0.007% 100.050% ( 4400, 6600 ] 9 0.004% 100.054% ( 6600, 9900 ] 1 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 39984 Average: 7.5944 StdDev: 85.38 Min: 1 Median: 1.7650 Max: 7022 Percentiles: P50: 1.77 P75: 2.71 P99: 127.72 P99.9: 812.13 P99.99: 4401.17 ------------------------------------------------------ [ 0, 1 ] 3826 9.569% 9.569% ## ( 1, 2 ] 21132 52.851% 62.420% ########### ( 2, 3 ] 7063 17.665% 80.085% #### ( 3, 4 ] 2701 6.755% 86.840% # ( 4, 6 ] 2920 7.303% 94.143% # ( 6, 10 ] 1500 3.752% 97.894% # ( 10, 15 ] 215 0.538% 98.432% ( 15, 22 ] 98 0.245% 98.677% ( 22, 34 ] 31 0.078% 98.755% ( 34, 51 ] 6 0.015% 98.770% ( 51, 76 ] 3 0.008% 98.777% ( 76, 110 ] 49 0.123% 98.900% ( 110, 170 ] 136 0.340% 99.240% ( 170, 250 ] 106 0.265% 99.505% ( 250, 380 ] 82 0.205% 99.710% ( 380, 580 ] 48 0.120% 99.830% ( 580, 870 ] 35 0.088% 99.917% ( 870, 1300 ] 13 0.033% 99.950% ( 1300, 1900 ] 7 0.018% 99.967% ( 1900, 2900 ] 2 0.005% 99.972% ( 2900, 4400 ] 7 0.018% 99.990% ( 4400, 6600 ] 3 0.008% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 24398 Average: 6.2440 StdDev: 64.48 Min: 1 Median: 1.5403 Max: 4318 Percentiles: P50: 1.54 P75: 1.95 P99: 114.21 P99.9: 812.05 P99.99: 2812.04 ------------------------------------------------------ [ 0, 1 ] 4090 16.764% 16.764% ### ( 1, 2 ] 15008 61.513% 78.277% ############ ( 2, 3 ] 2740 11.230% 89.507% ## ( 3, 4 ] 1133 4.644% 94.151% # ( 4, 6 ] 878 3.599% 97.750% # ( 6, 10 ] 241 0.988% 98.738% ( 10, 15 ] 21 0.086% 98.824% ( 15, 22 ] 2 0.008% 98.832% ( 22, 34 ] 2 0.008% 98.840% ( 76, 110 ] 32 0.131% 98.971% ( 110, 170 ] 100 0.410% 99.381% ( 170, 250 ] 60 0.246% 99.627% ( 250, 380 ] 30 0.123% 99.750% ( 380, 580 ] 27 0.111% 99.861% ( 580, 870 ] 12 0.049% 99.910% ( 870, 1300 ] 5 0.020% 99.930% ( 1300, 1900 ] 10 0.041% 99.971% ( 1900, 2900 ] 5 0.020% 99.992% ( 2900, 4400 ] 2 0.008% 100.000% ** Level 4 read latency histogram (micros): Count: 2723 Average: 385.7003 StdDev: 540.66 Min: 1 Median: 199.0841 Max: 5227 Percentiles: P50: 199.08 P75: 377.10 P99: 2896.41 P99.9: 4603.13 P99.99: 5227.00 ------------------------------------------------------ [ 0, 1 ] 3 0.110% 0.110% ( 1, 2 ] 3 0.110% 0.220% ( 2, 3 ] 6 0.220% 0.441% ( 3, 4 ] 5 0.184% 0.624% ( 4, 6 ] 8 0.294% 0.918% ( 6, 10 ] 2 0.073% 0.992% ( 10, 15 ] 1 0.037% 1.028% ( 51, 76 ] 2 0.073% 1.102% ( 76, 110 ] 210 7.712% 8.814% ## ( 110, 170 ] 927 34.043% 42.857% ####### ( 170, 250 ] 535 19.647% 62.505% #### ( 250, 380 ] 348 12.780% 75.285% ### ( 380, 580 ] 274 10.062% 85.347% ## ( 580, 870 ] 150 5.509% 90.856% # ( 870, 1300 ] 83 3.048% 93.904% # ( 1300, 1900 ] 76 2.791% 96.695% # ( 1900, 2900 ] 64 2.350% 99.045% ( 2900, 4400 ] 24 0.881% 99.927% ( 4400, 6600 ] 3 0.110% 100.037% ** Level 5 read latency histogram (micros): Count: 23099 Average: 415.0939 StdDev: 633.39 Min: 75 Median: 194.8785 Max: 8188 Percentiles: P50: 194.88 P75: 375.34 P99: 3673.35 P99.9: 5494.81 P99.99: 6583.77 ------------------------------------------------------ ( 51, 76 ] 1 0.004% 0.004% ( 76, 110 ] 2134 9.238% 9.243% ## ( 110, 170 ] 8007 34.664% 43.907% ####### ( 170, 250 ] 4526 19.594% 63.501% #### ( 250, 380 ] 2755 11.927% 75.428% ## ( 380, 580 ] 2259 9.780% 85.207% ## ( 580, 870 ] 1172 5.074% 90.281% # ( 870, 1300 ] 625 2.706% 92.987% # ( 1300, 1900 ] 546 2.364% 95.350% ( 1900, 2900 ] 644 2.788% 98.138% # ( 2900, 4400 ] 386 1.671% 99.810% ( 4400, 6600 ] 42 0.182% 99.991% ( 6600, 9900 ] 2 0.009% 100.000% ** DB Stats ** Uptime(secs): 3.8 total, 3.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 260.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-17:30:10 ... thread 0: (1000000,2000000) ops and (161726.9,204720.1) ops/second in (6.183262,9.769437) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.35 GB 31.5 1.7 0.0 1.7 3.6 1.8 0.0 1.9 134.7 278.9 13.10 12.05 37 0.354 1791K 1739 0.0 0.0 L1 11/11 584.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 941.20 MB 0.9 0.2 0.1 0.0 0.2 0.1 0.0 1.2 153.7 153.5 1.02 0.85 1 1.023 0 0 0.0 0.0 L4 140/0 9.75 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 225.2 225.2 0.42 0.40 1 0.421 96K 0 0.0 0.0 L5 1108/0 91.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/28 105.69 GB 0.0 2.0 0.2 1.8 3.8 2.1 0.0 2.1 138.7 268.5 14.54 13.30 39 0.373 1887K 1739 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.2 1.8 3.8 2.1 0.0 2.1 138.7 268.5 14.54 13.30 39 0.373 1887K 1739 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.2 1.8 2.0 0.2 0.0 0.0 248.1 247.9 8.13 7.77 9 0.903 1887K 1739 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 294.7 6.41 5.53 30 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.0 total, 9.8 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.81 GB write, 392.00 MB/s write, 1.97 GB read, 202.43 MB/s read, 14.5 seconds Interval compaction: 3.81 GB write, 399.56 MB/s write, 1.97 GB read, 206.33 MB/s read, 14.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 0, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 728868 Average: 13.9666 StdDev: 65.91 Min: 0 Median: 1.4436 Max: 7271 Percentiles: P50: 1.44 P75: 1.90 P99: 242.72 P99.9: 572.07 P99.99: 781.99 ------------------------------------------------------ [ 0, 1 ] 187849 25.773% 25.773% ##### ( 1, 2 ] 398079 54.616% 80.389% ########### ( 2, 3 ] 58054 7.965% 88.354% ## ( 3, 4 ] 20772 2.850% 91.204% # ( 4, 6 ] 14294 1.961% 93.165% ( 6, 10 ] 4600 0.631% 93.796% ( 10, 15 ] 732 0.100% 93.896% ( 15, 22 ] 181 0.025% 93.921% ( 22, 34 ] 55 0.008% 93.929% ( 34, 51 ] 19 0.003% 93.931% ( 51, 76 ] 12 0.002% 93.933% ( 76, 110 ] 5709 0.783% 94.716% ( 110, 170 ] 22985 3.154% 97.870% # ( 170, 250 ] 9064 1.244% 99.113% ( 250, 380 ] 3292 0.452% 99.565% ( 380, 580 ] 2544 0.349% 99.914% ( 580, 870 ] 797 0.109% 100.023% ( 870, 1300 ] 159 0.022% 100.045% ( 1300, 1900 ] 63 0.009% 100.054% ( 1900, 2900 ] 48 0.007% 100.060% ( 2900, 4400 ] 25 0.003% 100.064% ( 4400, 6600 ] 9 0.001% 100.065% ( 6600, 9900 ] 1 0.000% 100.065% ** Level 1 read latency histogram (micros): Count: 54342 Average: 11.2043 StdDev: 79.52 Min: 1 Median: 2.2434 Max: 7022 Percentiles: P50: 2.24 P75: 4.40 P99: 206.99 P99.9: 756.55 P99.99: 4092.67 ------------------------------------------------------ [ 0, 1 ] 3838 7.063% 7.063% # ( 1, 2 ] 21422 39.421% 46.483% ######## ( 2, 3 ] 7852 14.449% 60.933% ### ( 3, 4 ] 5692 10.474% 71.407% ## ( 4, 6 ] 9728 17.901% 89.308% #### ( 6, 10 ] 3117 5.736% 95.044% # ( 10, 15 ] 522 0.961% 96.005% ( 15, 22 ] 304 0.559% 96.564% ( 22, 34 ] 56 0.103% 96.667% ( 34, 51 ] 7 0.013% 96.680% ( 51, 76 ] 4 0.007% 96.688% ( 76, 110 ] 233 0.429% 97.116% ( 110, 170 ] 865 1.592% 98.708% ( 170, 250 ] 343 0.631% 99.339% ( 250, 380 ] 163 0.300% 99.639% ( 380, 580 ] 110 0.202% 99.842% ( 580, 870 ] 52 0.096% 99.937% ( 870, 1300 ] 14 0.026% 99.963% ( 1300, 1900 ] 7 0.013% 99.976% ( 1900, 2900 ] 2 0.004% 99.980% ( 2900, 4400 ] 7 0.013% 99.993% ( 4400, 6600 ] 3 0.006% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 25589 Average: 13.8904 StdDev: 78.66 Min: 1 Median: 1.5800 Max: 4318 Percentiles: P50: 1.58 P75: 2.03 P99: 240.50 P99.9: 856.83 P99.99: 3120.55 ------------------------------------------------------ [ 0, 1 ] 4090 15.983% 15.983% ### ( 1, 2 ] 15009 58.654% 74.638% ############ ( 2, 3 ] 2745 10.727% 85.365% ## ( 3, 4 ] 1166 4.557% 89.921% # ( 4, 6 ] 911 3.560% 93.482% # ( 6, 10 ] 248 0.969% 94.451% ( 10, 15 ] 21 0.082% 94.533% ( 15, 22 ] 2 0.008% 94.541% ( 22, 34 ] 2 0.008% 94.548% ( 76, 110 ] 186 0.727% 95.275% ( 110, 170 ] 709 2.771% 98.046% # ( 170, 250 ] 277 1.082% 99.129% ( 250, 380 ] 93 0.363% 99.492% ( 380, 580 ] 71 0.277% 99.769% ( 580, 870 ] 35 0.137% 99.906% ( 870, 1300 ] 6 0.023% 99.930% ( 1300, 1900 ] 10 0.039% 99.969% ( 1900, 2900 ] 5 0.020% 99.988% ( 2900, 4400 ] 3 0.012% 100.000% ** Level 4 read latency histogram (micros): Count: 12392 Average: 224.6434 StdDev: 287.09 Min: 1 Median: 154.2795 Max: 5227 Percentiles: P50: 154.28 P75: 220.13 P99: 1669.85 P99.9: 3813.00 P99.99: 5227.00 ------------------------------------------------------ [ 0, 1 ] 3 0.024% 0.024% ( 1, 2 ] 4 0.032% 0.056% ( 2, 3 ] 9 0.073% 0.129% ( 3, 4 ] 37 0.299% 0.428% ( 4, 6 ] 73 0.589% 1.017% ( 6, 10 ] 8 0.065% 1.081% ( 10, 15 ] 2 0.016% 1.097% ( 51, 76 ] 2 0.016% 1.114% ( 76, 110 ] 1464 11.814% 12.928% ## ( 110, 170 ] 6225 50.234% 63.162% ########## ( 170, 250 ] 2341 18.891% 82.053% #### ( 250, 380 ] 943 7.610% 89.663% ## ( 380, 580 ] 728 5.875% 95.537% # ( 580, 870 ] 285 2.300% 97.837% ( 870, 1300 ] 96 0.775% 98.612% ( 1300, 1900 ] 78 0.629% 99.241% ( 1900, 2900 ] 67 0.541% 99.782% ( 2900, 4400 ] 24 0.194% 99.976% ( 4400, 6600 ] 3 0.024% 100.000% ** Level 5 read latency histogram (micros): Count: 105650 Average: 233.2875 StdDev: 329.51 Min: 73 Median: 154.5661 Max: 8188 Percentiles: P50: 154.57 P75: 220.70 P99: 1969.82 P99.9: 4167.92 P99.99: 6203.74 ------------------------------------------------------ ( 51, 76 ] 3 0.003% 0.003% ( 76, 110 ] 13358 12.644% 12.646% ### ( 110, 170 ] 53131 50.290% 62.936% ########## ( 170, 250 ] 20112 19.036% 81.973% #### ( 250, 380 ] 7862 7.442% 89.414% # ( 380, 580 ] 6414 6.071% 95.485% # ( 580, 870 ] 2295 2.172% 97.657% ( 870, 1300 ] 800 0.757% 98.415% ( 1300, 1900 ] 572 0.541% 98.956% ( 1900, 2900 ] 666 0.630% 99.586% ( 2900, 4400 ] 392 0.371% 99.957% ( 4400, 6600 ] 42 0.040% 99.997% ( 6600, 9900 ] 2 0.002% 99.999% ** DB Stats ** Uptime(secs): 10.0 total, 6.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 197.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.454 H:M:S, 24.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 159.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.454 H:M:S, 39.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-17:30:18 ... thread 0: (1000000,3000000) ops and (133640.7,173891.0) ops/second in (7.482752,17.252189) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 4.26 GB 257.0 4.0 0.0 4.0 6.8 2.8 0.0 2.4 164.1 277.1 24.95 23.37 56 0.446 4156K 13K 0.0 0.0 L1 11/11 584.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 941.20 MB 0.9 0.2 0.1 0.0 0.2 0.1 0.0 1.2 153.7 153.5 1.02 0.85 1 1.023 0 0 0.0 0.0 L4 140/0 9.75 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 225.2 225.2 0.42 0.40 1 0.421 96K 0 0.0 0.0 L5 1108/0 91.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/25 106.60 GB 0.0 4.2 0.2 4.0 7.0 3.0 0.0 2.5 164.6 271.5 26.40 24.61 58 0.455 4252K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.2 0.2 4.0 7.0 3.0 0.0 2.5 164.6 271.5 26.40 24.61 58 0.455 4252K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.2 0.2 4.0 4.2 0.2 0.0 0.0 257.1 256.3 16.90 16.38 13 1.300 4252K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 298.6 9.50 8.23 45 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.4 total, 17.3 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.00 GB write, 410.90 MB/s write, 4.24 GB read, 249.14 MB/s read, 26.4 seconds Interval compaction: 7.00 GB write, 415.38 MB/s write, 4.24 GB read, 251.86 MB/s read, 26.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 0, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1233892 Average: 15.9609 StdDev: 65.95 Min: 0 Median: 1.4213 Max: 7271 Percentiles: P50: 1.42 P75: 1.90 P99: 246.59 P99.9: 570.84 P99.99: 771.06 ------------------------------------------------------ [ 0, 1 ] 343456 27.835% 27.835% ###### ( 1, 2 ] 649135 52.609% 80.444% ########### ( 2, 3 ] 86838 7.038% 87.482% # ( 3, 4 ] 31560 2.558% 90.039% # ( 4, 6 ] 22155 1.796% 91.835% ( 6, 10 ] 6161 0.499% 92.334% ( 10, 15 ] 1004 0.081% 92.416% ( 15, 22 ] 229 0.019% 92.434% ( 22, 34 ] 63 0.005% 92.439% ( 34, 51 ] 21 0.002% 92.441% ( 51, 76 ] 15 0.001% 92.442% ( 76, 110 ] 13257 1.074% 93.517% ( 110, 170 ] 50528 4.095% 97.612% # ( 170, 250 ] 17894 1.450% 99.062% ( 250, 380 ] 5970 0.484% 99.546% ( 380, 580 ] 4582 0.371% 99.917% ( 580, 870 ] 1367 0.111% 100.028% ( 870, 1300 ] 231 0.019% 100.047% ( 1300, 1900 ] 83 0.007% 100.053% ( 1900, 2900 ] 60 0.005% 100.058% ( 2900, 4400 ] 44 0.004% 100.062% ( 4400, 6600 ] 11 0.001% 100.063% ( 6600, 9900 ] 1 0.000% 100.063% ** Level 1 read latency histogram (micros): Count: 72408 Average: 13.6851 StdDev: 75.14 Min: 1 Median: 3.1796 Max: 7022 Percentiles: P50: 3.18 P75: 5.08 P99: 228.01 P99.9: 716.98 P99.99: 3491.26 ------------------------------------------------------ [ 0, 1 ] 3847 5.313% 5.313% # ( 1, 2 ] 21682 29.944% 35.257% ###### ( 2, 3 ] 8898 12.289% 47.546% ## ( 3, 4 ] 9894 13.664% 61.210% ### ( 4, 6 ] 18411 25.427% 86.637% ##### ( 6, 10 ] 4723 6.523% 93.160% # ( 10, 15 ] 829 1.145% 94.304% ( 15, 22 ] 549 0.758% 95.063% ( 22, 34 ] 74 0.102% 95.165% ( 34, 51 ] 9 0.012% 95.177% ( 51, 76 ] 4 0.006% 95.183% ( 76, 110 ] 487 0.673% 95.855% ( 110, 170 ] 1794 2.478% 98.333% ( 170, 250 ] 666 0.920% 99.253% ( 250, 380 ] 259 0.358% 99.611% ( 380, 580 ] 177 0.244% 99.855% ( 580, 870 ] 69 0.095% 99.950% ( 870, 1300 ] 16 0.022% 99.972% ( 1300, 1900 ] 8 0.011% 99.983% ( 1900, 2900 ] 2 0.003% 99.986% ( 2900, 4400 ] 7 0.010% 99.996% ( 4400, 6600 ] 3 0.004% 100.000% ( 6600, 9900 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 27059 Average: 21.9905 StdDev: 86.58 Min: 1 Median: 1.6288 Max: 4318 Percentiles: P50: 1.63 P75: 2.43 P99: 320.54 P99.9: 862.86 P99.99: 3047.05 ------------------------------------------------------ [ 0, 1 ] 4090 15.115% 15.115% ### ( 1, 2 ] 15011 55.475% 70.590% ########### ( 2, 3 ] 2745 10.144% 80.735% ## ( 3, 4 ] 1188 4.390% 85.125% # ( 4, 6 ] 938 3.466% 88.592% # ( 6, 10 ] 250 0.924% 89.516% ( 10, 15 ] 22 0.081% 89.597% ( 15, 22 ] 2 0.007% 89.604% ( 22, 34 ] 2 0.007% 89.612% ( 76, 110 ] 421 1.556% 91.167% ( 110, 170 ] 1496 5.529% 96.696% # ( 170, 250 ] 529 1.955% 98.651% ( 250, 380 ] 174 0.643% 99.294% ( 380, 580 ] 122 0.451% 99.745% ( 580, 870 ] 43 0.159% 99.904% ( 870, 1300 ] 8 0.030% 99.933% ( 1300, 1900 ] 10 0.037% 99.970% ( 1900, 2900 ] 5 0.018% 99.989% ( 2900, 4400 ] 3 0.011% 100.000% ** Level 4 read latency histogram (micros): Count: 24563 Average: 199.1978 StdDev: 221.55 Min: 1 Median: 150.7166 Max: 5227 Percentiles: P50: 150.72 P75: 204.15 P99: 1047.77 P99.9: 3244.84 P99.99: 4798.71 ------------------------------------------------------ [ 0, 1 ] 3 0.012% 0.012% ( 1, 2 ] 4 0.016% 0.028% ( 2, 3 ] 12 0.049% 0.077% ( 3, 4 ] 69 0.281% 0.358% ( 4, 6 ] 129 0.525% 0.883% ( 6, 10 ] 14 0.057% 0.940% ( 10, 15 ] 3 0.012% 0.953% ( 51, 76 ] 2 0.008% 0.961% ( 76, 110 ] 3229 13.146% 14.107% ### ( 110, 170 ] 12992 52.893% 66.999% ########### ( 170, 250 ] 4604 18.744% 85.743% #### ( 250, 380 ] 1598 6.506% 92.249% # ( 380, 580 ] 1207 4.914% 97.162% # ( 580, 870 ] 403 1.641% 98.803% ( 870, 1300 ] 117 0.476% 99.279% ( 1300, 1900 ] 78 0.318% 99.597% ( 1900, 2900 ] 68 0.277% 99.874% ( 2900, 4400 ] 28 0.114% 99.988% ( 4400, 6600 ] 3 0.012% 100.000% ** Level 5 read latency histogram (micros): Count: 208094 Average: 204.6599 StdDev: 249.76 Min: 73 Median: 150.8657 Max: 8188 Percentiles: P50: 150.87 P75: 204.45 P99: 1144.29 P99.9: 3784.65 P99.99: 5614.75 ------------------------------------------------------ ( 51, 76 ] 4 0.002% 0.002% ( 76, 110 ] 28314 13.606% 13.608% ### ( 110, 170 ] 111187 53.431% 67.039% ########### ( 170, 250 ] 38472 18.488% 85.527% #### ( 250, 380 ] 13289 6.386% 91.913% # ( 380, 580 ] 10738 5.160% 97.073% # ( 580, 870 ] 3413 1.640% 98.714% ( 870, 1300 ] 936 0.450% 99.163% ( 1300, 1900 ] 600 0.288% 99.452% ( 1900, 2900 ] 698 0.335% 99.787% ( 2900, 4400 ] 400 0.192% 99.979% ( 4400, 6600 ] 42 0.020% 100.000% ( 6600, 9900 ] 2 0.001% 100.000% ** DB Stats ** Uptime(secs): 17.4 total, 7.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 169.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.143 H:M:S, 35.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 131.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.689 H:M:S, 49.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 222.556 micros/op 17957 ops/sec 60.141 seconds 1079996 operations; 17.4 MB/s (269999 of 269999 found) Microseconds per read: Count: 1079996 Average: 222.5581 StdDev: 324.70 Min: 4 Median: 190.9710 Max: 36897 Percentiles: P50: 190.97 P75: 238.89 P99: 752.31 P99.9: 4907.40 P99.99: 12752.19 ------------------------------------------------------ ( 3, 4 ] 2 0.000% 0.000% ( 4, 6 ] 44 0.004% 0.004% ( 6, 10 ] 270 0.025% 0.029% ( 10, 15 ] 115 0.011% 0.040% ( 15, 22 ] 383 0.035% 0.075% ( 22, 34 ] 13583 1.258% 1.333% ( 34, 51 ] 2580 0.239% 1.572% ( 51, 76 ] 260 0.024% 1.596% ( 76, 110 ] 427 0.040% 1.636% ( 110, 170 ] 404168 37.423% 39.059% ####### ( 170, 250 ] 450779 41.739% 80.798% ######## ( 250, 380 ] 137574 12.738% 93.536% ### ( 380, 580 ] 50514 4.677% 98.213% # ( 580, 870 ] 14301 1.324% 99.537% ( 870, 1300 ] 2932 0.271% 99.809% ( 1300, 1900 ] 324 0.030% 99.839% ( 1900, 2900 ] 281 0.026% 99.865% ( 2900, 4400 ] 254 0.024% 99.888% ( 4400, 6600 ] 542 0.050% 99.939% ( 6600, 9900 ] 491 0.045% 99.984% ( 9900, 14000 ] 92 0.009% 99.993% ( 14000, 22000 ] 37 0.003% 99.996% ( 22000, 33000 ] 39 0.004% 100.000% ( 33000, 50000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 20035159 rocksdb.bloom.filter.full.positive COUNT : 1274486 rocksdb.bloom.filter.full.true.positive COUNT : 1079598 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 398 rocksdb.memtable.miss COUNT : 1079598 rocksdb.l0.hit COUNT : 51620 rocksdb.l1.hit COUNT : 6078 rocksdb.l2andup.hit COUNT : 1021900 rocksdb.compaction.key.drop.new COUNT : 43975 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3992366 rocksdb.number.keys.read COUNT : 1079996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4120121712 rocksdb.bytes.read COUNT : 1079996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1365 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 43909109 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9548009967 rocksdb.compact.write.bytes COUNT : 9510545337 rocksdb.flush.write.bytes COUNT : 4095895810 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 12 rocksdb.number.superversion_acquires COUNT : 577 rocksdb.number.superversion_releases COUNT : 545 rocksdb.number.superversion_cleanups COUNT : 142 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4062547968 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1295360 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 15346321832 rocksdb.non.last.level.read.count COUNT : 3563584 rocksdb.block.checksum.compute.count COUNT : 3600820 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 189.564615 P95 : 440.433580 P99 : 750.945821 P100 : 36894.000000 COUNT : 1079996 SUM : 239029600 rocksdb.db.write.micros P50 : 1.538657 P95 : 5.473149 P99 : 14.940858 P100 : 3224.000000 COUNT : 3992366 SUM : 54440333 rocksdb.compaction.times.micros P50 : 1040625.000000 P95 : 5455000.000000 P99 : 5863572.000000 P100 : 5863572.000000 COUNT : 19 SUM : 27527196 rocksdb.compaction.times.cpu_micros P50 : 1030000.000000 P95 : 5455000.000000 P99 : 5754504.000000 P100 : 5754504.000000 COUNT : 19 SUM : 26797772 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 755.348837 P95 : 1296.090909 P99 : 2071.000000 P100 : 2071.000000 COUNT : 62 SUM : 50560 rocksdb.compaction.outfile.sync.micros P50 : 1004.375000 P95 : 3050.000000 P99 : 4001.000000 P100 : 4001.000000 COUNT : 36 SUM : 44027 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 133.076923 P95 : 525.000000 P99 : 1408.000000 P100 : 1596.000000 COUNT : 82 SUM : 14783 rocksdb.table.open.io.micros P50 : 5072.685888 P95 : 9160.767327 P99 : 11642.500000 P100 : 14277.000000 COUNT : 1365 SUM : 6922495 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.533628 P95 : 151.497823 P99 : 236.297532 P100 : 13434.000000 COUNT : 2314119 SUM : 52832342 rocksdb.read.block.get.micros P50 : 141.502035 P95 : 262.682225 P99 : 561.622206 P100 : 14623.000000 COUNT : 1285346 SUM : 197664671 rocksdb.write.raw.block.micros P50 : 0.573097 P95 : 1.775065 P99 : 4.541989 P100 : 3558.000000 COUNT : 3295040 SUM : 7107761 rocksdb.numfiles.in.singlecompaction P50 : 3.533333 P95 : 10.000000 P99 : 20.600000 P100 : 21.000000 COUNT : 20 SUM : 99 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.574476 P95 : 1272.389022 P99 : 2675.598383 P100 : 2781.000000 COUNT : 238696 SUM : 43938574 rocksdb.sst.read.micros P50 : 2.679004 P95 : 206.907611 P99 : 422.951787 P100 : 8188.000000 COUNT : 3563618 SUM : 237514442 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1079996 SUM : 1079996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3992366 SUM : 4120121712 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211333.333333 P95 : 248533.333333 P99 : 286187.000000 P100 : 286187.000000 COUNT : 62 SUM : 13144184 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 88 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0