[2024-12-11 14:49:30.552991] Starting SPDK v25.01-pre git sha1 4dfeb7f95 / DPDK 24.03.0 initialization... [2024-12-11 14:49:30.553253] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2518559 ] Set seed to 1733924970546256 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-11 14:49:30.680907] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-11 14:49:30.791792] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-11 14:49:30.791843] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2518559' to capture a snapshot of events at runtime. [2024-12-11 14:49:30.791854] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-11 14:49:30.791864] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-11 14:49:30.791888] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2518559 for offline analysis/debug. [2024-12-11 14:49:30.793418] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Dec 11 14:49:36 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/11-14:49:39 ... thread 0: (1000000,1000000) ops and (367845.3,367845.3) ops/second in (2.718534,2.718534) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 691.80 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 361.1 2.26 2.05 12 0.189 0 0 0.0 0.0 L2 2/1 160.18 MB 0.4 0.3 0.1 0.1 0.3 0.1 0.0 2.0 245.7 245.3 1.05 1.01 2 0.525 262K 438 0.0 0.0 L3 9/0 755.92 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 245/9 20.03 GB 0.0 0.3 0.1 0.1 1.1 0.9 0.0 1.3 77.9 324.4 3.32 3.06 14 0.237 262K 438 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.1 0.1 1.1 0.9 0.0 1.3 77.9 324.4 3.32 3.06 14 0.237 262K 438 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.0 0.0 245.7 245.3 1.05 1.01 2 0.525 262K 438 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 361.1 2.26 2.05 12 0.189 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.8 total, 2.7 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.05 GB write, 380.65 MB/s write, 0.25 GB read, 91.40 MB/s read, 3.3 seconds Interval compaction: 1.05 GB write, 395.08 MB/s write, 0.25 GB read, 94.87 MB/s read, 3.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 138512 Average: 2.1870 StdDev: 7.37 Min: 1 Median: 1.4878 Max: 1964 Percentiles: P50: 1.49 P75: 1.88 P99: 5.75 P99.9: 9.94 P99.99: 16.38 ------------------------------------------------------ [ 0, 1 ] 26538 19.159% 19.159% #### ( 1, 2 ] 87583 63.231% 82.391% ############# ( 2, 3 ] 15308 11.052% 93.442% ## ( 3, 4 ] 4377 3.160% 96.602% # ( 4, 6 ] 3802 2.745% 99.347% # ( 6, 10 ] 781 0.564% 99.911% ( 10, 15 ] 109 0.079% 99.990% ( 15, 22 ] 21 0.015% 100.005% ( 22, 34 ] 5 0.004% 100.009% ( 34, 51 ] 2 0.001% 100.010% ( 51, 76 ] 1 0.001% 100.011% ( 110, 170 ] 8 0.006% 100.017% ( 170, 250 ] 4 0.003% 100.019% ( 250, 380 ] 3 0.002% 100.022% ( 380, 580 ] 7 0.005% 100.027% ( 580, 870 ] 2 0.001% 100.028% ( 1900, 2900 ] 1 0.001% 100.029% ** Level 2 read latency histogram (micros): Count: 60001 Average: 2.4770 StdDev: 31.92 Min: 1 Median: 1.4675 Max: 7116 Percentiles: P50: 1.47 P75: 1.87 P99: 6.70 P99.9: 62.25 P99.99: 480.00 ------------------------------------------------------ [ 0, 1 ] 12790 21.316% 21.316% #### ( 1, 2 ] 36816 61.359% 82.675% ############ ( 2, 3 ] 5898 9.830% 92.505% ## ( 3, 4 ] 1890 3.150% 95.655% # ( 4, 6 ] 1914 3.190% 98.845% # ( 6, 10 ] 528 0.880% 99.725% ( 10, 15 ] 76 0.127% 99.852% ( 15, 22 ] 10 0.017% 99.868% ( 34, 51 ] 1 0.002% 99.870% ( 51, 76 ] 40 0.067% 99.937% ( 76, 110 ] 7 0.012% 99.948% ( 110, 170 ] 5 0.008% 99.957% ( 170, 250 ] 8 0.013% 99.970% ( 250, 380 ] 9 0.015% 99.985% ( 380, 580 ] 6 0.010% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1900, 2900 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 45 Average: 2708.4444 StdDev: 2793.59 Min: 170 Median: 652.5000 Max: 9072 Percentiles: P50: 652.50 P75: 5445.00 P99: 9072.00 P99.9: 9072.00 P99.99: 9072.00 ------------------------------------------------------ ( 110, 170 ] 1 2.222% 2.222% ( 170, 250 ] 3 6.667% 8.889% # ( 250, 380 ] 11 24.444% 33.333% ##### ( 380, 580 ] 7 15.556% 48.889% ### ( 580, 870 ] 2 4.444% 53.333% # ( 870, 1300 ] 1 2.222% 55.556% ( 2900, 4400 ] 4 8.889% 64.444% ## ( 4400, 6600 ] 10 22.222% 86.667% #### ( 6600, 9900 ] 6 13.333% 100.000% ### ** Level 4 read latency histogram (micros): Count: 30 Average: 3434.0333 StdDev: 2119.49 Min: 290 Median: 3350.0000 Max: 7428 Percentiles: P50: 3350.00 P75: 4675.00 P99: 7428.00 P99.9: 7428.00 P99.99: 7428.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 580, 870 ] 3 10.000% 13.333% ## ( 870, 1300 ] 1 3.333% 16.667% # ( 1300, 1900 ] 4 13.333% 30.000% ### ( 1900, 2900 ] 3 10.000% 40.000% ## ( 2900, 4400 ] 10 33.333% 73.333% ####### ( 4400, 6600 ] 4 13.333% 86.667% ### ( 6600, 9900 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 2.8 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 348.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.163 H:M:S, 5.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 361.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.163 H:M:S, 6.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/11-14:49:42 ... thread 0: (1000000,2000000) ops and (327405.5,346449.3) ops/second in (3.054316,5.772850) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.35 GB 81.3 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.8 318.7 8.28 7.69 29 0.285 830K 4143 0.0 0.0 L1 1/0 12.47 MB 1.2 0.3 0.3 0.0 0.3 0.3 0.1 1.0 246.7 245.3 1.27 1.24 1 1.274 319K 1764 0.0 0.0 L2 1/1 39.67 MB 0.0 0.3 0.1 0.1 0.3 0.1 0.3 2.0 245.7 245.3 1.05 1.01 2 0.525 262K 438 0.0 0.0 L3 22/9 1.15 GB 0.4 0.6 0.4 0.2 0.6 0.4 0.0 1.4 217.7 216.9 2.66 2.48 4 0.665 588K 1954 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 259/18 21.00 GB 0.0 1.9 0.8 1.1 3.7 2.6 0.4 2.1 148.5 285.4 13.26 12.42 36 0.368 1999K 8299 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 0.8 1.1 3.7 2.6 0.4 2.1 148.5 285.4 13.26 12.42 36 0.368 1999K 8299 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 0.8 1.1 1.9 0.8 0.0 0.0 242.3 241.2 8.13 7.82 10 0.813 1999K 8299 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 355.3 5.13 4.60 26 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.8 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.70 GB write, 643.73 MB/s write, 1.92 GB read, 334.95 MB/s read, 13.3 seconds Interval compaction: 3.70 GB write, 655.23 MB/s write, 1.92 GB read, 340.94 MB/s read, 13.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 376769 Average: 2.4043 StdDev: 6.97 Min: 1 Median: 1.6238 Max: 1964 Percentiles: P50: 1.62 P75: 2.09 P99: 5.95 P99.9: 12.12 P99.99: 15.99 ------------------------------------------------------ [ 0, 1 ] 41727 11.075% 11.075% ## ( 1, 2 ] 235100 62.399% 73.474% ############ ( 2, 3 ] 65759 17.453% 90.927% ### ( 3, 4 ] 16569 4.398% 95.325% # ( 4, 6 ] 14189 3.766% 99.091% # ( 6, 10 ] 2805 0.744% 99.835% ( 10, 15 ] 574 0.152% 99.988% ( 15, 22 ] 59 0.016% 100.003% ( 22, 34 ] 10 0.003% 100.006% ( 34, 51 ] 2 0.001% 100.007% ( 51, 76 ] 3 0.001% 100.007% ( 110, 170 ] 11 0.003% 100.010% ( 170, 250 ] 13 0.003% 100.014% ( 250, 380 ] 6 0.002% 100.015% ( 380, 580 ] 16 0.004% 100.020% ( 580, 870 ] 9 0.002% 100.022% ( 870, 1300 ] 3 0.001% 100.023% ( 1900, 2900 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 76184 Average: 2.9369 StdDev: 10.95 Min: 1 Median: 1.8236 Max: 1342 Percentiles: P50: 1.82 P75: 2.60 P99: 8.31 P99.9: 16.63 P99.99: 356.48 ------------------------------------------------------ [ 0, 1 ] 1976 2.594% 2.594% # ( 1, 2 ] 43854 57.563% 60.157% ############ ( 2, 3 ] 18818 24.701% 84.858% ##### ( 3, 4 ] 5087 6.677% 91.535% # ( 4, 6 ] 5065 6.648% 98.183% # ( 6, 10 ] 1079 1.416% 99.600% ( 10, 15 ] 223 0.293% 99.892% ( 15, 22 ] 25 0.033% 99.925% ( 22, 34 ] 3 0.004% 99.929% ( 51, 76 ] 3 0.004% 99.933% ( 76, 110 ] 2 0.003% 99.936% ( 110, 170 ] 11 0.014% 99.950% ( 170, 250 ] 14 0.018% 99.968% ( 250, 380 ] 20 0.026% 99.995% ( 380, 580 ] 6 0.008% 100.003% ( 580, 870 ] 3 0.004% 100.007% ( 870, 1300 ] 2 0.003% 100.009% ( 1300, 1900 ] 1 0.001% 100.011% ** Level 2 read latency histogram (micros): Count: 65321 Average: 2.7626 StdDev: 32.49 Min: 1 Median: 1.4932 Max: 7116 Percentiles: P50: 1.49 P75: 1.90 P99: 7.08 P99.9: 199.78 P99.99: 765.10 ------------------------------------------------------ [ 0, 1 ] 12998 19.899% 19.899% #### ( 1, 2 ] 39870 61.037% 80.936% ############ ( 2, 3 ] 7252 11.102% 92.038% ## ( 3, 4 ] 2203 3.373% 95.410% # ( 4, 6 ] 2190 3.353% 98.763% # ( 6, 10 ] 574 0.879% 99.642% ( 10, 15 ] 91 0.139% 99.781% ( 15, 22 ] 12 0.018% 99.799% ( 34, 51 ] 1 0.002% 99.801% ( 51, 76 ] 40 0.061% 99.862% ( 76, 110 ] 8 0.012% 99.874% ( 110, 170 ] 7 0.011% 99.885% ( 170, 250 ] 26 0.040% 99.925% ( 250, 380 ] 20 0.031% 99.956% ( 380, 580 ] 18 0.028% 99.983% ( 580, 870 ] 7 0.011% 99.994% ( 870, 1300 ] 2 0.003% 99.997% ( 1900, 2900 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 206669 Average: 3.9444 StdDev: 61.02 Min: 1 Median: 1.7201 Max: 9072 Percentiles: P50: 1.72 P75: 2.40 P99: 9.14 P99.9: 288.89 P99.99: 525.98 ------------------------------------------------------ [ 0, 1 ] 12506 6.051% 6.051% # ( 1, 2 ] 126135 61.032% 67.084% ############ ( 2, 3 ] 41364 20.015% 87.098% #### ( 3, 4 ] 11822 5.720% 92.818% # ( 4, 6 ] 9662 4.675% 97.494% # ( 6, 10 ] 3960 1.916% 99.410% ( 10, 15 ] 478 0.231% 99.641% ( 15, 22 ] 70 0.034% 99.675% ( 22, 34 ] 10 0.005% 99.680% ( 34, 51 ] 1 0.000% 99.680% ( 51, 76 ] 124 0.060% 99.740% ( 76, 110 ] 61 0.030% 99.770% ( 110, 170 ] 88 0.043% 99.812% ( 170, 250 ] 120 0.058% 99.870% ( 250, 380 ] 205 0.099% 99.970% ( 380, 580 ] 58 0.028% 99.998% ( 580, 870 ] 13 0.006% 100.004% ( 870, 1300 ] 3 0.001% 100.005% ( 1300, 1900 ] 11 0.005% 100.011% ( 1900, 2900 ] 3 0.001% 100.012% ( 2900, 4400 ] 4 0.002% 100.014% ( 4400, 6600 ] 10 0.005% 100.019% ( 6600, 9900 ] 6 0.003% 100.022% ** Level 4 read latency histogram (micros): Count: 30 Average: 3434.0333 StdDev: 2119.49 Min: 290 Median: 3350.0000 Max: 7428 Percentiles: P50: 3350.00 P75: 4675.00 P99: 7428.00 P99.9: 7428.00 P99.99: 7428.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 580, 870 ] 3 10.000% 13.333% ## ( 870, 1300 ] 1 3.333% 16.667% # ( 1300, 1900 ] 4 13.333% 30.000% ### ( 1900, 2900 ] 3 10.000% 40.000% ## ( 2900, 4400 ] 10 33.333% 73.333% ####### ( 4400, 6600 ] 4 13.333% 86.667% ### ( 6600, 9900 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 5.9 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 334.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.573 H:M:S, 9.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.410 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/11-14:49:45 ... thread 0: (1000000,3000000) ops and (336774.4,343163.2) ops/second in (2.969347,8.742197) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 2.32 GB 18.9 1.9 0.0 1.9 4.7 2.8 0.0 1.7 126.5 309.5 15.41 14.45 47 0.328 1979K 10K 0.0 0.0 L1 1/1 12.47 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.1 1.0 246.7 245.3 1.27 1.24 1 1.274 319K 1764 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.3 2.0 245.7 245.3 1.05 1.01 2 0.525 262K 438 0.0 0.0 L3 17/0 784.63 MB 0.8 1.3 0.4 0.9 1.3 0.4 0.0 3.0 228.5 227.4 6.02 5.54 5 1.203 1396K 6895 0.0 0.0 L4 121/0 9.70 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 264/11 21.97 GB 0.0 3.8 0.9 2.9 6.6 3.6 1.1 2.4 164.1 282.4 23.75 22.25 55 0.432 3957K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 0.9 2.9 6.6 3.6 1.1 2.4 164.1 282.4 23.75 22.25 55 0.432 3957K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 0.9 2.9 3.8 0.9 0.0 0.0 246.2 244.9 15.83 15.15 15 1.055 3957K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 357.4 7.92 7.09 40 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.8 total, 8.7 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.55 GB write, 758.03 MB/s write, 3.81 GB read, 440.40 MB/s read, 23.7 seconds Interval compaction: 6.55 GB write, 766.98 MB/s write, 3.81 GB read, 445.60 MB/s read, 23.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 627430 Average: 2.3962 StdDev: 8.30 Min: 1 Median: 1.5817 Max: 2416 Percentiles: P50: 1.58 P75: 1.97 P99: 5.88 P99.9: 13.37 P99.99: 163.24 ------------------------------------------------------ [ 0, 1 ] 79686 12.700% 12.700% ### ( 1, 2 ] 402317 64.121% 76.822% ############# ( 2, 3 ] 97525 15.544% 92.365% ### ( 3, 4 ] 23309 3.715% 96.080% # ( 4, 6 ] 19496 3.107% 99.188% # ( 6, 10 ] 3852 0.614% 99.802% ( 10, 15 ] 916 0.146% 99.948% ( 15, 22 ] 89 0.014% 99.962% ( 22, 34 ] 13 0.002% 99.964% ( 34, 51 ] 2 0.000% 99.964% ( 51, 76 ] 24 0.004% 99.968% ( 76, 110 ] 30 0.005% 99.973% ( 110, 170 ] 122 0.019% 99.992% ( 170, 250 ] 96 0.015% 100.007% ( 250, 380 ] 26 0.004% 100.012% ( 380, 580 ] 32 0.005% 100.017% ( 580, 870 ] 17 0.003% 100.019% ( 870, 1300 ] 7 0.001% 100.021% ( 1900, 2900 ] 2 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 76185 Average: 2.9389 StdDev: 10.96 Min: 1 Median: 1.8236 Max: 1342 Percentiles: P50: 1.82 P75: 2.60 P99: 8.31 P99.9: 16.91 P99.99: 356.48 ------------------------------------------------------ [ 0, 1 ] 1976 2.594% 2.594% # ( 1, 2 ] 43854 57.563% 60.156% ############ ( 2, 3 ] 18818 24.700% 84.857% ##### ( 3, 4 ] 5087 6.677% 91.534% # ( 4, 6 ] 5065 6.648% 98.182% # ( 6, 10 ] 1079 1.416% 99.598% ( 10, 15 ] 223 0.293% 99.891% ( 15, 22 ] 25 0.033% 99.924% ( 22, 34 ] 3 0.004% 99.928% ( 51, 76 ] 3 0.004% 99.932% ( 76, 110 ] 2 0.003% 99.934% ( 110, 170 ] 12 0.016% 99.950% ( 170, 250 ] 14 0.018% 99.968% ( 250, 380 ] 20 0.026% 99.995% ( 380, 580 ] 6 0.008% 100.003% ( 580, 870 ] 3 0.004% 100.007% ( 870, 1300 ] 2 0.003% 100.009% ( 1300, 1900 ] 1 0.001% 100.011% ** Level 2 read latency histogram (micros): Count: 74318 Average: 2.7164 StdDev: 30.52 Min: 1 Median: 1.5010 Max: 7116 Percentiles: P50: 1.50 P75: 1.90 P99: 7.33 P99.9: 180.52 P99.99: 727.83 ------------------------------------------------------ [ 0, 1 ] 14086 18.954% 18.954% #### ( 1, 2 ] 46054 61.969% 80.923% ############ ( 2, 3 ] 8380 11.276% 92.198% ## ( 3, 4 ] 2441 3.285% 95.483% # ( 4, 6 ] 2374 3.194% 98.677% # ( 6, 10 ] 721 0.970% 99.647% ( 10, 15 ] 106 0.143% 99.790% ( 15, 22 ] 13 0.017% 99.808% ( 34, 51 ] 2 0.003% 99.810% ( 51, 76 ] 48 0.065% 99.875% ( 76, 110 ] 8 0.011% 99.886% ( 110, 170 ] 7 0.009% 99.895% ( 170, 250 ] 28 0.038% 99.933% ( 250, 380 ] 21 0.028% 99.961% ( 380, 580 ] 18 0.024% 99.985% ( 580, 870 ] 7 0.009% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 232370 Average: 3.8353 StdDev: 57.75 Min: 0 Median: 1.7216 Max: 9072 Percentiles: P50: 1.72 P75: 2.40 P99: 9.07 P99.9: 280.54 P99.99: 541.15 ------------------------------------------------------ [ 0, 1 ] 13602 5.854% 5.854% # ( 1, 2 ] 142168 61.182% 67.035% ############ ( 2, 3 ] 46771 20.128% 87.163% #### ( 3, 4 ] 13235 5.696% 92.859% # ( 4, 6 ] 10835 4.663% 97.522% # ( 6, 10 ] 4469 1.923% 99.445% ( 10, 15 ] 521 0.224% 99.669% ( 15, 22 ] 71 0.031% 99.700% ( 22, 34 ] 10 0.004% 99.704% ( 34, 51 ] 1 0.000% 99.704% ( 51, 76 ] 125 0.054% 99.758% ( 76, 110 ] 61 0.026% 99.784% ( 110, 170 ] 88 0.038% 99.822% ( 170, 250 ] 132 0.057% 99.879% ( 250, 380 ] 207 0.089% 99.968% ( 380, 580 ] 63 0.027% 99.995% ( 580, 870 ] 18 0.008% 100.003% ( 870, 1300 ] 4 0.002% 100.005% ( 1300, 1900 ] 11 0.005% 100.009% ( 1900, 2900 ] 3 0.001% 100.011% ( 2900, 4400 ] 4 0.002% 100.012% ( 4400, 6600 ] 10 0.004% 100.017% ( 6600, 9900 ] 6 0.003% 100.019% ** Level 4 read latency histogram (micros): Count: 30 Average: 3434.0333 StdDev: 2119.49 Min: 290 Median: 3350.0000 Max: 7428 Percentiles: P50: 3350.00 P75: 4675.00 P99: 7428.00 P99.9: 7428.00 P99.99: 7428.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 580, 870 ] 3 10.000% 13.333% ## ( 870, 1300 ] 1 3.333% 16.667% # ( 1300, 1900 ] 4 13.333% 30.000% ### ( 1900, 2900 ] 3 10.000% 40.000% ## ( 2900, 4400 ] 10 33.333% 73.333% ####### ( 4400, 6600 ] 4 13.333% 86.667% ### ( 6600, 9900 ] 4 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 677.0000 StdDev: 709.26 Min: 58 Median: 315.0000 Max: 2413 Percentiles: P50: 315.00 P75: 1300.00 P99: 2413.00 P99.9: 2413.00 P99.99: 2413.00 ------------------------------------------------------ ( 51, 76 ] 3 15.000% 15.000% ### ( 76, 110 ] 2 10.000% 25.000% ## ( 110, 170 ] 2 10.000% 35.000% ## ( 170, 250 ] 1 5.000% 40.000% # ( 250, 380 ] 4 20.000% 60.000% #### ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 4 20.000% 95.000% #### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.8 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 333.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.971 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/11-14:49:48 ... thread 0: (1000000,4000000) ops and (287054.7,327175.5) ops/second in (3.483657,12.225854) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.30 GB 93.8 2.8 0.0 2.8 6.5 3.7 0.0 1.7 130.5 306.8 21.68 20.36 64 0.339 2873K 15K 0.0 0.0 L1 1/1 12.47 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.1 1.0 246.7 245.3 1.27 1.24 1 1.274 319K 1764 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.3 2.0 245.7 245.3 1.05 1.01 2 0.525 262K 438 0.0 0.0 L3 17/0 784.63 MB 0.8 1.3 0.4 0.9 1.3 0.4 0.0 3.0 228.5 227.4 6.02 5.54 5 1.203 1396K 6895 0.0 0.0 L4 121/0 9.70 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 269/15 22.95 GB 0.0 4.7 0.9 3.8 8.4 4.6 1.1 2.2 159.1 286.1 30.02 28.15 72 0.417 4851K 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 0.9 3.8 8.4 4.6 1.1 2.2 159.1 286.1 30.02 28.15 72 0.417 4851K 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 0.9 3.8 4.6 0.9 0.0 0.0 248.4 247.2 19.23 18.47 18 1.068 4851K 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 355.5 10.79 9.68 54 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.2 interval Flush(GB): cumulative 3.746, interval 3.746 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.39 GB write, 696.46 MB/s write, 4.67 GB read, 387.38 MB/s read, 30.0 seconds Interval compaction: 8.39 GB write, 702.34 MB/s write, 4.67 GB read, 390.65 MB/s read, 30.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 20, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1088802 Average: 2.4665 StdDev: 8.64 Min: 1 Median: 1.6109 Max: 2416 Percentiles: P50: 1.61 P75: 2.00 P99: 5.95 P99.9: 13.34 P99.99: 147.83 ------------------------------------------------------ [ 0, 1 ] 115889 10.644% 10.644% ## ( 1, 2 ] 701450 64.424% 75.068% ############# ( 2, 3 ] 189400 17.395% 92.463% ### ( 3, 4 ] 39299 3.609% 96.072% # ( 4, 6 ] 32643 2.998% 99.070% # ( 6, 10 ] 7992 0.734% 99.804% ( 10, 15 ] 1563 0.144% 99.948% ( 15, 22 ] 139 0.013% 99.961% ( 22, 34 ] 18 0.002% 99.962% ( 34, 51 ] 3 0.000% 99.963% ( 51, 76 ] 94 0.009% 99.971% ( 76, 110 ] 63 0.006% 99.977% ( 110, 170 ] 227 0.021% 99.998% ( 170, 250 ] 212 0.019% 100.017% ( 250, 380 ] 96 0.009% 100.026% ( 380, 580 ] 61 0.006% 100.032% ( 580, 870 ] 31 0.003% 100.035% ( 870, 1300 ] 17 0.002% 100.036% ( 1900, 2900 ] 2 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 76185 Average: 2.9389 StdDev: 10.96 Min: 1 Median: 1.8236 Max: 1342 Percentiles: P50: 1.82 P75: 2.60 P99: 8.31 P99.9: 16.91 P99.99: 356.48 ------------------------------------------------------ [ 0, 1 ] 1976 2.594% 2.594% # ( 1, 2 ] 43854 57.563% 60.156% ############ ( 2, 3 ] 18818 24.700% 84.857% ##### ( 3, 4 ] 5087 6.677% 91.534% # ( 4, 6 ] 5065 6.648% 98.182% # ( 6, 10 ] 1079 1.416% 99.598% ( 10, 15 ] 223 0.293% 99.891% ( 15, 22 ] 25 0.033% 99.924% ( 22, 34 ] 3 0.004% 99.928% ( 51, 76 ] 3 0.004% 99.932% ( 76, 110 ] 2 0.003% 99.934% ( 110, 170 ] 12 0.016% 99.950% ( 170, 250 ] 14 0.018% 99.968% ( 250, 380 ] 20 0.026% 99.995% ( 380, 580 ] 6 0.008% 100.003% ( 580, 870 ] 3 0.004% 100.007% ( 870, 1300 ] 2 0.003% 100.009% ( 1300, 1900 ] 1 0.001% 100.011% ** Level 2 read latency histogram (micros): Count: 74318 Average: 2.7164 StdDev: 30.52 Min: 1 Median: 1.5010 Max: 7116 Percentiles: P50: 1.50 P75: 1.90 P99: 7.33 P99.9: 180.52 P99.99: 727.83 ------------------------------------------------------ [ 0, 1 ] 14086 18.954% 18.954% #### ( 1, 2 ] 46054 61.969% 80.923% ############ ( 2, 3 ] 8380 11.276% 92.198% ## ( 3, 4 ] 2441 3.285% 95.483% # ( 4, 6 ] 2374 3.194% 98.677% # ( 6, 10 ] 721 0.970% 99.647% ( 10, 15 ] 106 0.143% 99.790% ( 15, 22 ] 13 0.017% 99.808% ( 34, 51 ] 2 0.003% 99.810% ( 51, 76 ] 48 0.065% 99.875% ( 76, 110 ] 8 0.011% 99.886% ( 110, 170 ] 7 0.009% 99.895% ( 170, 250 ] 28 0.038% 99.933% ( 250, 380 ] 21 0.028% 99.961% ( 380, 580 ] 18 0.024% 99.985% ( 580, 870 ] 7 0.009% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 232370 Average: 3.8353 StdDev: 57.75 Min: 0 Median: 1.7216 Max: 9072 Percentiles: P50: 1.72 P75: 2.40 P99: 9.07 P99.9: 280.54 P99.99: 541.15 ------------------------------------------------------ [ 0, 1 ] 13602 5.854% 5.854% # ( 1, 2 ] 142168 61.182% 67.035% ############ ( 2, 3 ] 46771 20.128% 87.163% #### ( 3, 4 ] 13235 5.696% 92.859% # ( 4, 6 ] 10835 4.663% 97.522% # ( 6, 10 ] 4469 1.923% 99.445% ( 10, 15 ] 521 0.224% 99.669% ( 15, 22 ] 71 0.031% 99.700% ( 22, 34 ] 10 0.004% 99.704% ( 34, 51 ] 1 0.000% 99.704% ( 51, 76 ] 125 0.054% 99.758% ( 76, 110 ] 61 0.026% 99.784% ( 110, 170 ] 88 0.038% 99.822% ( 170, 250 ] 132 0.057% 99.879% ( 250, 380 ] 207 0.089% 99.968% ( 380, 580 ] 63 0.027% 99.995% ( 580, 870 ] 18 0.008% 100.003% ( 870, 1300 ] 4 0.002% 100.005% ( 1300, 1900 ] 11 0.005% 100.009% ( 1900, 2900 ] 3 0.001% 100.011% ( 2900, 4400 ] 4 0.002% 100.012% ( 4400, 6600 ] 10 0.004% 100.017% ( 6600, 9900 ] 6 0.003% 100.019% ** Level 4 read latency histogram (micros): Count: 30 Average: 3434.0333 StdDev: 2119.49 Min: 290 Median: 3350.0000 Max: 7428 Percentiles: P50: 3350.00 P75: 4675.00 P99: 7428.00 P99.9: 7428.00 P99.99: 7428.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 580, 870 ] 3 10.000% 13.333% ## ( 870, 1300 ] 1 3.333% 16.667% # ( 1300, 1900 ] 4 13.333% 30.000% ### ( 1900, 2900 ] 3 10.000% 40.000% ## ( 2900, 4400 ] 10 33.333% 73.333% ####### ( 4400, 6600 ] 4 13.333% 86.667% ### ( 6600, 9900 ] 4 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 677.0000 StdDev: 709.26 Min: 58 Median: 315.0000 Max: 2413 Percentiles: P50: 315.00 P75: 1300.00 P99: 2413.00 P99.9: 2413.00 P99.99: 2413.00 ------------------------------------------------------ ( 51, 76 ] 3 15.000% 15.000% ### ( 76, 110 ] 2 10.000% 25.000% ## ( 110, 170 ] 2 10.000% 35.000% ## ( 170, 250 ] 1 5.000% 40.000% # ( 250, 380 ] 4 20.000% 60.000% #### ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 4 20.000% 95.000% #### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.3 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 319.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.814 H:M:S, 14.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 282.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.843 H:M:S, 24.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/11-14:49:55 ... thread 0: (1000000,5000000) ops and (156950.6,268856.4) ops/second in (6.371431,18.597285) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/5 2.08 GB 106.4 3.7 0.0 3.7 8.4 4.6 0.0 1.8 136.0 304.8 28.20 26.53 83 0.340 3896K 20K 0.0 0.0 L1 8/0 688.61 MB 68.9 2.5 2.4 0.0 2.4 2.3 0.1 1.0 224.9 215.3 11.20 10.54 2 5.598 2556K 108K 0.0 0.0 L2 6/5 636.50 MB 1.3 0.3 0.1 0.1 0.3 0.1 1.7 2.0 245.7 245.3 1.05 1.01 2 0.525 262K 438 0.0 0.0 L3 15/3 1.02 GB 0.9 1.3 0.4 0.9 1.3 0.4 0.8 3.0 228.5 227.4 6.02 5.54 5 1.203 1396K 6895 0.0 0.0 L4 121/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 120/0 9.84 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 281/13 23.76 GB 0.0 7.8 3.0 4.8 12.3 7.6 4.4 2.6 171.9 271.9 46.47 43.63 92 0.505 8111K 135K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.8 3.0 4.8 12.3 7.6 4.4 2.6 171.9 271.9 46.47 43.63 92 0.505 8111K 135K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.8 3.0 4.8 7.7 2.9 0.0 0.0 242.3 238.2 32.96 31.53 23 1.433 8111K 135K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.0 13.50 12.10 69 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.7 total, 18.6 interval Flush(GB): cumulative 4.668, interval 4.668 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.34 GB write, 675.38 MB/s write, 7.80 GB read, 427.04 MB/s read, 46.5 seconds Interval compaction: 12.34 GB write, 679.13 MB/s write, 7.80 GB read, 429.41 MB/s read, 46.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 20, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1784192 Average: 2.6369 StdDev: 10.50 Min: 1 Median: 1.6115 Max: 2540 Percentiles: P50: 1.61 P75: 2.00 P99: 6.95 P99.9: 107.85 P99.99: 228.31 ------------------------------------------------------ [ 0, 1 ] 184454 10.338% 10.338% ## ( 1, 2 ] 1157146 64.855% 75.194% ############# ( 2, 3 ] 311587 17.464% 92.657% ### ( 3, 4 ] 59674 3.345% 96.002% # ( 4, 6 ] 49685 2.785% 98.787% # ( 6, 10 ] 16017 0.898% 99.685% ( 10, 15 ] 2654 0.149% 99.833% ( 15, 22 ] 246 0.014% 99.847% ( 22, 34 ] 28 0.002% 99.849% ( 34, 51 ] 7 0.000% 99.849% ( 51, 76 ] 566 0.032% 99.881% ( 76, 110 ] 367 0.021% 99.901% ( 110, 170 ] 990 0.055% 99.957% ( 170, 250 ] 813 0.046% 100.002% ( 250, 380 ] 329 0.018% 100.021% ( 380, 580 ] 137 0.008% 100.028% ( 580, 870 ] 56 0.003% 100.032% ( 870, 1300 ] 23 0.001% 100.033% ( 1300, 1900 ] 2 0.000% 100.033% ( 1900, 2900 ] 4 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 106235 Average: 3.8318 StdDev: 28.21 Min: 1 Median: 1.8656 Max: 2217 Percentiles: P50: 1.87 P75: 2.68 P99: 9.21 P99.9: 249.74 P99.99: 550.17 ------------------------------------------------------ [ 0, 1 ] 2506 2.359% 2.359% ( 1, 2 ] 58467 55.036% 57.394% ########### ( 2, 3 ] 27432 25.822% 83.216% ##### ( 3, 4 ] 7548 7.105% 90.321% # ( 4, 6 ] 7827 7.368% 97.689% # ( 6, 10 ] 1737 1.635% 99.324% ( 10, 15 ] 344 0.324% 99.648% ( 15, 22 ] 41 0.039% 99.687% ( 22, 34 ] 4 0.004% 99.690% ( 34, 51 ] 2 0.002% 99.692% ( 51, 76 ] 39 0.037% 99.729% ( 76, 110 ] 34 0.032% 99.761% ( 110, 170 ] 76 0.072% 99.832% ( 170, 250 ] 73 0.069% 99.901% ( 250, 380 ] 69 0.065% 99.966% ( 380, 580 ] 31 0.029% 99.995% ( 580, 870 ] 17 0.016% 100.011% ( 870, 1300 ] 16 0.015% 100.026% ( 1300, 1900 ] 2 0.002% 100.028% ( 1900, 2900 ] 9 0.008% 100.037% ** Level 2 read latency histogram (micros): Count: 74318 Average: 2.7164 StdDev: 30.52 Min: 1 Median: 1.5010 Max: 7116 Percentiles: P50: 1.50 P75: 1.90 P99: 7.33 P99.9: 180.52 P99.99: 727.83 ------------------------------------------------------ [ 0, 1 ] 14086 18.954% 18.954% #### ( 1, 2 ] 46054 61.969% 80.923% ############ ( 2, 3 ] 8380 11.276% 92.198% ## ( 3, 4 ] 2441 3.285% 95.483% # ( 4, 6 ] 2374 3.194% 98.677% # ( 6, 10 ] 721 0.970% 99.647% ( 10, 15 ] 106 0.143% 99.790% ( 15, 22 ] 13 0.017% 99.808% ( 34, 51 ] 2 0.003% 99.810% ( 51, 76 ] 48 0.065% 99.875% ( 76, 110 ] 8 0.011% 99.886% ( 110, 170 ] 7 0.009% 99.895% ( 170, 250 ] 28 0.038% 99.933% ( 250, 380 ] 21 0.028% 99.961% ( 380, 580 ] 18 0.024% 99.985% ( 580, 870 ] 7 0.009% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 241686 Average: 4.0575 StdDev: 57.63 Min: 0 Median: 1.7326 Max: 9072 Percentiles: P50: 1.73 P75: 2.43 P99: 9.25 P99.9: 318.23 P99.99: 651.14 ------------------------------------------------------ [ 0, 1 ] 13703 5.670% 5.670% # ( 1, 2 ] 146247 60.511% 66.181% ############ ( 2, 3 ] 49494 20.479% 86.660% #### ( 3, 4 ] 14151 5.855% 92.515% # ( 4, 6 ] 11811 4.887% 97.402% # ( 6, 10 ] 4756 1.968% 99.369% ( 10, 15 ] 555 0.230% 99.599% ( 15, 22 ] 80 0.033% 99.632% ( 22, 34 ] 10 0.004% 99.636% ( 34, 51 ] 2 0.001% 99.637% ( 51, 76 ] 129 0.053% 99.691% ( 76, 110 ] 70 0.029% 99.719% ( 110, 170 ] 115 0.048% 99.767% ( 170, 250 ] 188 0.078% 99.845% ( 250, 380 ] 254 0.105% 99.950% ( 380, 580 ] 88 0.036% 99.986% ( 580, 870 ] 36 0.015% 100.001% ( 870, 1300 ] 10 0.004% 100.005% ( 1300, 1900 ] 11 0.005% 100.010% ( 1900, 2900 ] 3 0.001% 100.011% ( 2900, 4400 ] 4 0.002% 100.013% ( 4400, 6600 ] 10 0.004% 100.017% ( 6600, 9900 ] 6 0.002% 100.019% ** Level 4 read latency histogram (micros): Count: 30 Average: 3434.0333 StdDev: 2119.49 Min: 290 Median: 3350.0000 Max: 7428 Percentiles: P50: 3350.00 P75: 4675.00 P99: 7428.00 P99.9: 7428.00 P99.99: 7428.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 580, 870 ] 3 10.000% 13.333% ## ( 870, 1300 ] 1 3.333% 16.667% # ( 1300, 1900 ] 4 13.333% 30.000% ### ( 1900, 2900 ] 3 10.000% 40.000% ## ( 2900, 4400 ] 10 33.333% 73.333% ####### ( 4400, 6600 ] 4 13.333% 86.667% ### ( 6600, 9900 ] 4 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 60 Average: 674.9000 StdDev: 669.95 Min: 58 Median: 380.0000 Max: 2716 Percentiles: P50: 380.00 P75: 1042.00 P99: 2716.00 P99.9: 2716.00 P99.99: 2716.00 ------------------------------------------------------ ( 51, 76 ] 6 10.000% 10.000% ## ( 76, 110 ] 4 6.667% 16.667% # ( 110, 170 ] 7 11.667% 28.333% ## ( 170, 250 ] 3 5.000% 33.333% # ( 250, 380 ] 10 16.667% 50.000% ### ( 380, 580 ] 7 11.667% 61.667% ## ( 580, 870 ] 6 10.000% 71.667% ## ( 870, 1300 ] 5 8.333% 80.000% ## ( 1300, 1900 ] 8 13.333% 93.333% ### ( 1900, 2900 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 18.7 total, 6.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 263.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.384 H:M:S, 28.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 154.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.570 H:M:S, 56.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.731 micros/op 268013 ops/sec 20.059 seconds 5375999 operations; 259.7 MB/s Microseconds per write: Count: 5375999 Average: 3.7311 StdDev: 264.45 Min: 0 Median: 1.7151 Max: 326080 Percentiles: P50: 1.72 P75: 2.65 P99: 7.88 P99.9: 103.29 P99.99: 2071.57 ------------------------------------------------------ [ 0, 1 ] 783021 14.565% 14.565% ### ( 1, 2 ] 2664023 49.554% 64.119% ########## ( 2, 3 ] 894542 16.640% 80.759% ### ( 3, 4 ] 707011 13.151% 93.910% ### ( 4, 6 ] 251142 4.672% 98.581% # ( 6, 10 ] 47788 0.889% 99.470% ( 10, 15 ] 14524 0.270% 99.741% ( 15, 22 ] 4474 0.083% 99.824% ( 22, 34 ] 706 0.013% 99.837% ( 34, 51 ] 104 0.002% 99.839% ( 51, 76 ] 21 0.000% 99.839% ( 76, 110 ] 4070 0.076% 99.915% ( 110, 170 ] 1182 0.022% 99.937% ( 170, 250 ] 140 0.003% 99.940% ( 250, 380 ] 58 0.001% 99.941% ( 380, 580 ] 9 0.000% 99.941% ( 580, 870 ] 8 0.000% 99.941% ( 870, 1300 ] 2529 0.047% 99.988% ( 1300, 1900 ] 2 0.000% 99.988% ( 1900, 2900 ] 626 0.012% 100.000% ( 2900, 4400 ] 5 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 6 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 172931 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5375999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5548030968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 190 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5737895 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10713247467 rocksdb.compact.write.bytes COUNT : 10534543955 rocksdb.flush.write.bytes COUNT : 5473664694 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 22 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 89 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5438571520 rocksdb.memtable.garbage.bytes.at.flush COUNT : 10421248 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 10762505710 rocksdb.non.last.level.read.count COUNT : 2598084 rocksdb.block.checksum.compute.count COUNT : 2597726 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.346418 P95 : 3.791792 P99 : 5.970275 P100 : 326076.000000 COUNT : 5375999 SUM : 17591746 rocksdb.compaction.times.micros P50 : 1003846.153846 P95 : 3810000.000000 P99 : 9922560.000000 P100 : 9922560.000000 COUNT : 27 SUM : 36204149 rocksdb.compaction.times.cpu_micros P50 : 993571.428571 P95 : 3810000.000000 P99 : 8909000.000000 P100 : 9300840.000000 COUNT : 27 SUM : 34448869 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 742.058824 P95 : 1690.000000 P99 : 4950.000000 P100 : 5426.000000 COUNT : 75 SUM : 64783 rocksdb.compaction.outfile.sync.micros P50 : 760.444444 P95 : 5280.000000 P99 : 34360.000000 P100 : 37100.000000 COUNT : 92 SUM : 172227 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 93.386364 P95 : 324.388889 P99 : 458.000000 P100 : 458.000000 COUNT : 117 SUM : 14143 rocksdb.table.open.io.micros P50 : 1166.760563 P95 : 14400.000000 P99 : 20480.000000 P100 : 20496.000000 COUNT : 190 SUM : 502576 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.688724 P95 : 7.554166 P99 : 10.533543 P100 : 8985.000000 COUNT : 2598176 SUM : 12864704 rocksdb.read.block.get.micros P50 : 502.666667 P95 : 4212.500000 P99 : 7392.000000 P100 : 9202.000000 COUNT : 380 SUM : 353414 rocksdb.write.raw.block.micros P50 : 0.513919 P95 : 0.976447 P99 : 2.975827 P100 : 7821.000000 COUNT : 3881030 SUM : 7417052 rocksdb.numfiles.in.singlecompaction P50 : 3.333333 P95 : 7.200000 P99 : 11.000000 P100 : 11.000000 COUNT : 48 SUM : 179 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560661 P95 : 1155.314947 P99 : 2438.578431 P100 : 325821.000000 COUNT : 29539 SUM : 5741197 rocksdb.sst.read.micros P50 : 1.681946 P95 : 4.529178 P99 : 8.313558 P100 : 9072.000000 COUNT : 2599592 SUM : 7915552 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5375999 SUM : 5548030968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 208545.454545 P95 : 347500.000000 P99 : 498750.000000 P100 : 552143.000000 COUNT : 75 SUM : 15022849 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 114 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0