[2024-12-09 10:58:56.317180] Starting SPDK v25.01-pre git sha1 04ba75cf7 / DPDK 24.03.0 initialization... [2024-12-09 10:58:56.317350] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3866907 ] Set seed to 1733738336313764 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-09 10:58:56.456782] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-09 10:58:56.563200] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-09 10:58:56.563257] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3866907' to capture a snapshot of events at runtime. [2024-12-09 10:58:56.563274] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-09 10:58:56.563288] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-09 10:58:56.563297] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3866907 for offline analysis/debug. [2024-12-09 10:58:56.564699] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 9 10:58:59 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/09-10:59:02 ... thread 0: (1000000,1000000) ops and (329136.3,329136.3) ops/second in (3.038255,3.038255) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 628.88 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 345.3 2.55 2.38 13 0.196 0 0 0.0 0.0 L1 3/3 188.13 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 239.6 238.9 0.79 0.75 1 0.788 191K 587 0.0 0.0 L2 1/1 100.45 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.0 2.5 248.2 247.7 0.65 0.63 1 0.648 163K 348 0.0 0.0 L3 17/10 878.85 MB 0.1 0.1 0.1 0.0 0.1 0.1 0.0 1.0 203.0 203.0 0.30 0.28 1 0.295 60K 0 0.0 0.0 L4 120/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 112/0 8.74 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 262/22 20.09 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 95.7 301.1 4.28 4.04 16 0.268 415K 935 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 95.7 301.1 4.28 4.04 16 0.268 415K 935 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 236.6 236.1 1.73 1.66 3 0.577 415K 935 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 345.3 2.55 2.38 13 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.26 GB write, 412.99 MB/s write, 0.40 GB read, 131.19 MB/s read, 4.3 seconds Interval compaction: 1.26 GB write, 424.00 MB/s write, 0.40 GB read, 134.68 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 133119 Average: 2.1458 StdDev: 6.38 Min: 1 Median: 1.4430 Max: 1780 Percentiles: P50: 1.44 P75: 1.86 P99: 5.96 P99.9: 13.31 P99.99: 59.60 ------------------------------------------------------ [ 0, 1 ] 30974 23.268% 23.268% ##### ( 1, 2 ] 80327 60.342% 83.610% ############ ( 2, 3 ] 12653 9.505% 93.115% ## ( 3, 4 ] 4534 3.406% 96.521% # ( 4, 6 ] 3377 2.537% 99.058% # ( 6, 10 ] 974 0.732% 99.790% ( 10, 15 ] 228 0.171% 99.961% ( 15, 22 ] 34 0.026% 99.986% ( 22, 34 ] 6 0.005% 99.991% ( 34, 51 ] 2 0.002% 99.992% ( 51, 76 ] 2 0.002% 99.994% ( 76, 110 ] 1 0.001% 99.995% ( 170, 250 ] 12 0.009% 100.004% ( 250, 380 ] 9 0.007% 100.011% ( 380, 580 ] 4 0.003% 100.014% ( 1300, 1900 ] 1 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 27920 Average: 2.2027 StdDev: 5.89 Min: 0 Median: 1.4915 Max: 658 Percentiles: P50: 1.49 P75: 1.90 P99: 5.78 P99.9: 9.85 P99.99: 400.80 ------------------------------------------------------ [ 0, 1 ] 5530 19.807% 19.807% #### ( 1, 2 ] 17152 61.433% 81.239% ############ ( 2, 3 ] 3062 10.967% 92.206% ## ( 3, 4 ] 1095 3.922% 96.128% # ( 4, 6 ] 900 3.223% 99.352% # ( 6, 10 ] 160 0.573% 99.925% ( 10, 15 ] 16 0.057% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 76, 110 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 380, 580 ] 2 0.007% 100.000% ( 580, 870 ] 1 0.004% 100.004% ** Level 2 read latency histogram (micros): Count: 40190 Average: 2.5647 StdDev: 14.59 Min: 1 Median: 1.4770 Max: 1843 Percentiles: P50: 1.48 P75: 1.89 P99: 9.42 P99.9: 126.35 P99.99: 379.18 ------------------------------------------------------ [ 0, 1 ] 8627 21.466% 21.466% #### ( 1, 2 ] 24043 59.823% 81.289% ############ ( 2, 3 ] 3683 9.164% 90.453% ## ( 3, 4 ] 1627 4.048% 94.501% # ( 4, 6 ] 1330 3.309% 97.810% # ( 6, 10 ] 559 1.391% 99.201% ( 10, 15 ] 209 0.520% 99.721% ( 15, 22 ] 31 0.077% 99.798% ( 22, 34 ] 6 0.015% 99.813% ( 34, 51 ] 1 0.002% 99.816% ( 76, 110 ] 24 0.060% 99.876% ( 110, 170 ] 36 0.090% 99.965% ( 170, 250 ] 7 0.017% 99.983% ( 250, 380 ] 3 0.007% 99.990% ( 380, 580 ] 2 0.005% 99.995% ( 1300, 1900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 31070 Average: 8.3403 StdDev: 171.19 Min: 0 Median: 1.7340 Max: 8939 Percentiles: P50: 1.73 P75: 2.49 P99: 12.82 P99.9: 1444.75 P99.99: 8760.77 ------------------------------------------------------ [ 0, 1 ] 1359 4.374% 4.374% # ( 1, 2 ] 19313 62.160% 66.534% ############ ( 2, 3 ] 5397 17.370% 83.904% ### ( 3, 4 ] 2164 6.965% 90.869% # ( 4, 6 ] 1738 5.594% 96.463% # ( 6, 10 ] 655 2.108% 98.571% ( 10, 15 ] 236 0.760% 99.331% ( 15, 22 ] 24 0.077% 99.408% ( 22, 34 ] 2 0.006% 99.414% ( 34, 51 ] 24 0.077% 99.491% ( 51, 76 ] 29 0.093% 99.585% ( 76, 110 ] 9 0.029% 99.614% ( 110, 170 ] 63 0.203% 99.817% ( 170, 250 ] 4 0.013% 99.829% ( 250, 380 ] 5 0.016% 99.846% ( 380, 580 ] 1 0.003% 99.849% ( 580, 870 ] 8 0.026% 99.874% ( 870, 1300 ] 6 0.019% 99.894% ( 1300, 1900 ] 8 0.026% 99.920% ( 1900, 2900 ] 4 0.013% 99.932% ( 2900, 4400 ] 5 0.016% 99.949% ( 4400, 6600 ] 7 0.023% 99.971% ( 6600, 9900 ] 9 0.029% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2998.5200 StdDev: 2661.71 Min: 692 Median: 1600.0000 Max: 8842 Percentiles: P50: 1600.00 P75: 4950.00 P99: 8842.00 P99.9: 8842.00 P99.99: 8842.00 ------------------------------------------------------ ( 580, 870 ] 2 8.000% 8.000% ## ( 870, 1300 ] 7 28.000% 36.000% ###### ( 1300, 1900 ] 7 28.000% 64.000% ###### ( 1900, 2900 ] 2 8.000% 72.000% ## ( 4400, 6600 ] 3 12.000% 84.000% ## ( 6600, 9900 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 315.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.175 H:M:S, 5.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.175 H:M:S, 5.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/09-10:59:05 ... thread 0: (1000000,2000000) ops and (340965.4,334946.4) ops/second in (2.932849,5.971104) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.29 GB 106.5 0.7 0.0 0.7 2.5 1.8 0.0 1.4 91.8 313.2 8.22 7.77 31 0.265 766K 3748 0.0 0.0 L1 1/0 49.84 MB 5.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 235.7 234.1 2.67 2.60 2 1.333 638K 4199 0.0 0.0 L2 2/2 229.23 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.5 248.2 247.7 0.65 0.63 1 0.648 163K 348 0.0 0.0 L3 19/12 1.11 GB 0.3 0.4 0.3 0.1 0.4 0.3 0.0 1.2 211.3 210.8 1.78 1.71 3 0.593 381K 845 0.0 0.0 L4 120/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 112/0 8.74 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 265/18 21.00 GB 0.0 1.9 0.8 1.1 3.6 2.6 0.4 2.0 144.2 280.5 13.31 12.70 37 0.360 1949K 9140 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 0.8 1.1 3.6 2.6 0.4 2.0 144.2 280.5 13.31 12.70 37 0.360 1949K 9140 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 0.8 1.1 1.9 0.8 0.0 0.0 236.6 235.5 8.12 7.89 9 0.902 1949K 9140 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.8 5.20 4.81 28 0.186 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 6.0 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.65 GB write, 616.94 MB/s write, 1.88 GB read, 317.15 MB/s read, 13.3 seconds Interval compaction: 3.65 GB write, 625.30 MB/s write, 1.88 GB read, 321.45 MB/s read, 13.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 365310 Average: 2.4632 StdDev: 6.45 Min: 1 Median: 1.6372 Max: 1780 Percentiles: P50: 1.64 P75: 2.18 P99: 7.34 P99.9: 13.79 P99.99: 20.38 ------------------------------------------------------ [ 0, 1 ] 42189 11.549% 11.549% ## ( 1, 2 ] 220434 60.342% 71.890% ############ ( 2, 3 ] 62845 17.203% 89.094% ### ( 3, 4 ] 19380 5.305% 94.399% # ( 4, 6 ] 15546 4.256% 98.654% # ( 6, 10 ] 3777 1.034% 99.688% ( 10, 15 ] 1022 0.280% 99.968% ( 15, 22 ] 106 0.029% 99.997% ( 22, 34 ] 14 0.004% 100.001% ( 34, 51 ] 3 0.001% 100.002% ( 51, 76 ] 4 0.001% 100.003% ( 76, 110 ] 1 0.000% 100.003% ( 170, 250 ] 27 0.007% 100.010% ( 250, 380 ] 12 0.003% 100.014% ( 380, 580 ] 16 0.004% 100.018% ( 580, 870 ] 1 0.000% 100.018% ( 870, 1300 ] 5 0.001% 100.020% ( 1300, 1900 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 145660 Average: 2.8689 StdDev: 7.56 Min: 0 Median: 1.7961 Max: 974 Percentiles: P50: 1.80 P75: 2.58 P99: 9.06 P99.9: 19.49 P99.99: 164.02 ------------------------------------------------------ [ 0, 1 ] 7982 5.480% 5.480% # ( 1, 2 ] 81452 55.919% 61.399% ########### ( 2, 3 ] 33886 23.264% 84.663% ##### ( 3, 4 ] 9911 6.804% 91.467% # ( 4, 6 ] 9127 6.266% 97.733% # ( 6, 10 ] 2410 1.655% 99.388% ( 10, 15 ] 677 0.465% 99.852% ( 15, 22 ] 108 0.074% 99.927% ( 22, 34 ] 8 0.005% 99.932% ( 34, 51 ] 3 0.002% 99.934% ( 76, 110 ] 4 0.003% 99.937% ( 110, 170 ] 86 0.059% 99.996% ( 170, 250 ] 29 0.020% 100.016% ( 250, 380 ] 10 0.007% 100.023% ( 380, 580 ] 8 0.005% 100.028% ( 580, 870 ] 3 0.002% 100.030% ( 870, 1300 ] 1 0.001% 100.031% ** Level 2 read latency histogram (micros): Count: 46818 Average: 2.8496 StdDev: 15.78 Min: 1 Median: 1.5162 Max: 1843 Percentiles: P50: 1.52 P75: 1.93 P99: 9.60 P99.9: 164.89 P99.99: 495.91 ------------------------------------------------------ [ 0, 1 ] 8891 18.991% 18.991% #### ( 1, 2 ] 28124 60.071% 79.061% ############ ( 2, 3 ] 5081 10.853% 89.914% ## ( 3, 4 ] 1991 4.253% 94.167% # ( 4, 6 ] 1634 3.490% 97.657% # ( 6, 10 ] 699 1.493% 99.150% ( 10, 15 ] 217 0.463% 99.613% ( 15, 22 ] 31 0.066% 99.680% ( 22, 34 ] 6 0.013% 99.692% ( 34, 51 ] 1 0.002% 99.695% ( 76, 110 ] 24 0.051% 99.746% ( 110, 170 ] 80 0.171% 99.917% ( 170, 250 ] 20 0.043% 99.959% ( 250, 380 ] 13 0.028% 99.987% ( 380, 580 ] 4 0.009% 99.996% ( 580, 870 ] 1 0.002% 99.998% ( 1300, 1900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 232147 Average: 3.7552 StdDev: 63.30 Min: 0 Median: 1.7288 Max: 8939 Percentiles: P50: 1.73 P75: 2.44 P99: 9.72 P99.9: 159.01 P99.99: 412.46 ------------------------------------------------------ [ 0, 1 ] 11953 5.149% 5.149% # ( 1, 2 ] 142857 61.537% 66.686% ############ ( 2, 3 ] 44301 19.083% 85.769% #### ( 3, 4 ] 14682 6.324% 92.094% # ( 4, 6 ] 11420 4.919% 97.013% # ( 6, 10 ] 4962 2.137% 99.151% ( 10, 15 ] 1060 0.457% 99.607% ( 15, 22 ] 94 0.040% 99.648% ( 22, 34 ] 8 0.003% 99.651% ( 34, 51 ] 156 0.067% 99.718% ( 51, 76 ] 98 0.042% 99.760% ( 76, 110 ] 60 0.026% 99.786% ( 110, 170 ] 323 0.139% 99.925% ( 170, 250 ] 104 0.045% 99.970% ( 250, 380 ] 44 0.019% 99.989% ( 380, 580 ] 11 0.005% 99.994% ( 580, 870 ] 16 0.007% 100.001% ( 870, 1300 ] 6 0.003% 100.003% ( 1300, 1900 ] 8 0.003% 100.007% ( 1900, 2900 ] 4 0.002% 100.009% ( 2900, 4400 ] 5 0.002% 100.011% ( 4400, 6600 ] 7 0.003% 100.014% ( 6600, 9900 ] 9 0.004% 100.018% ** Level 4 read latency histogram (micros): Count: 25 Average: 2998.5200 StdDev: 2661.71 Min: 692 Median: 1600.0000 Max: 8842 Percentiles: P50: 1600.00 P75: 4950.00 P99: 8842.00 P99.9: 8842.00 P99.99: 8842.00 ------------------------------------------------------ ( 580, 870 ] 2 8.000% 8.000% ## ( 870, 1300 ] 7 28.000% 36.000% ###### ( 1300, 1900 ] 7 28.000% 64.000% ###### ( 1900, 2900 ] 2 8.000% 72.000% ## ( 4400, 6600 ] 3 12.000% 84.000% ## ( 6600, 9900 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 6.1 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 325.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.175 H:M:S, 2.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/09-10:59:08 ... thread 0: (1000000,3000000) ops and (327642.3,332475.8) ops/second in (3.052109,9.023213) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.27 GB 18.9 1.5 0.0 1.5 4.2 2.8 0.0 1.5 108.1 310.2 13.97 13.24 49 0.285 1533K 7379 0.0 0.0 L1 1/1 49.84 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 235.7 234.1 2.67 2.60 2 1.333 638K 4199 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.5 248.2 247.7 0.65 0.63 1 0.648 163K 348 0.0 0.0 L3 20/0 877.80 MB 0.9 1.4 0.5 0.9 1.4 0.5 0.0 2.7 232.5 231.9 6.33 6.06 5 1.266 1494K 3912 0.0 0.0 L4 126/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 224.0 224.0 1.01 0.96 1 1.011 229K 0 0.0 0.0 L5 116/0 9.04 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 280/15 21.98 GB 0.0 3.9 1.2 2.7 6.7 4.0 1.0 2.4 162.3 276.6 24.62 23.49 58 0.425 4059K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.2 2.7 6.7 4.0 1.0 2.4 162.3 276.6 24.62 23.49 58 0.425 4059K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.2 2.7 3.9 1.2 0.0 0.0 240.7 239.7 16.61 16.08 15 1.107 4059K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 353.1 8.02 7.41 43 0.186 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 9.0 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.65 GB write, 748.01 MB/s write, 3.90 GB read, 438.92 MB/s read, 24.6 seconds Interval compaction: 6.65 GB write, 754.73 MB/s write, 3.90 GB read, 442.86 MB/s read, 24.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 624123 Average: 2.4617 StdDev: 7.40 Min: 1 Median: 1.5991 Max: 1780 Percentiles: P50: 1.60 P75: 2.00 P99: 7.00 P99.9: 14.51 P99.99: 162.16 ------------------------------------------------------ [ 0, 1 ] 76766 12.300% 12.300% ## ( 1, 2 ] 392756 62.929% 75.229% ############# ( 2, 3 ] 97857 15.679% 90.908% ### ( 3, 4 ] 28193 4.517% 95.425% # ( 4, 6 ] 20869 3.344% 98.769% # ( 6, 10 ] 5774 0.925% 99.694% ( 10, 15 ] 1425 0.228% 99.923% ( 15, 22 ] 133 0.021% 99.944% ( 22, 34 ] 21 0.003% 99.947% ( 34, 51 ] 5 0.001% 99.948% ( 51, 76 ] 7 0.001% 99.949% ( 76, 110 ] 1 0.000% 99.949% ( 110, 170 ] 294 0.047% 99.996% ( 170, 250 ] 73 0.012% 100.008% ( 250, 380 ] 34 0.005% 100.014% ( 380, 580 ] 28 0.004% 100.018% ( 580, 870 ] 4 0.001% 100.019% ( 870, 1300 ] 11 0.002% 100.021% ( 1300, 1900 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 145840 Average: 2.8700 StdDev: 7.57 Min: 0 Median: 1.7962 Max: 974 Percentiles: P50: 1.80 P75: 2.58 P99: 9.07 P99.9: 19.55 P99.99: 164.71 ------------------------------------------------------ [ 0, 1 ] 7984 5.474% 5.474% # ( 1, 2 ] 81560 55.924% 61.399% ########### ( 2, 3 ] 33924 23.261% 84.660% ##### ( 3, 4 ] 9924 6.805% 91.465% # ( 4, 6 ] 9139 6.266% 97.731% # ( 6, 10 ] 2414 1.655% 99.386% ( 10, 15 ] 679 0.466% 99.852% ( 15, 22 ] 108 0.074% 99.926% ( 22, 34 ] 8 0.005% 99.931% ( 34, 51 ] 3 0.002% 99.933% ( 76, 110 ] 4 0.003% 99.936% ( 110, 170 ] 86 0.059% 99.995% ( 170, 250 ] 30 0.021% 100.016% ( 250, 380 ] 10 0.007% 100.023% ( 380, 580 ] 8 0.005% 100.028% ( 580, 870 ] 3 0.002% 100.030% ( 870, 1300 ] 1 0.001% 100.031% ** Level 2 read latency histogram (micros): Count: 65600 Average: 2.7631 StdDev: 13.34 Min: 1 Median: 1.5770 Max: 1843 Percentiles: P50: 1.58 P75: 1.99 P99: 9.17 P99.9: 150.80 P99.99: 402.00 ------------------------------------------------------ [ 0, 1 ] 9651 14.712% 14.712% ### ( 1, 2 ] 40117 61.154% 75.866% ############ ( 2, 3 ] 8785 13.392% 89.258% ### ( 3, 4 ] 3125 4.764% 94.021% # ( 4, 6 ] 2414 3.680% 97.701% # ( 6, 10 ] 1076 1.640% 99.341% ( 10, 15 ] 246 0.375% 99.716% ( 15, 22 ] 35 0.053% 99.770% ( 22, 34 ] 6 0.009% 99.779% ( 34, 51 ] 1 0.002% 99.780% ( 76, 110 ] 24 0.037% 99.817% ( 110, 170 ] 80 0.122% 99.939% ( 170, 250 ] 20 0.030% 99.970% ( 250, 380 ] 13 0.020% 99.989% ( 380, 580 ] 4 0.006% 99.995% ( 580, 870 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 292459 Average: 3.5913 StdDev: 56.81 Min: 0 Median: 1.7212 Max: 8939 Percentiles: P50: 1.72 P75: 2.39 P99: 9.54 P99.9: 162.62 P99.99: 491.94 ------------------------------------------------------ [ 0, 1 ] 15163 5.185% 5.185% # ( 1, 2 ] 181727 62.138% 67.322% ############ ( 2, 3 ] 56876 19.448% 86.770% #### ( 3, 4 ] 17291 5.912% 92.682% # ( 4, 6 ] 13396 4.580% 97.263% # ( 6, 10 ] 5735 1.961% 99.223% ( 10, 15 ] 1228 0.420% 99.643% ( 15, 22 ] 116 0.040% 99.683% ( 22, 34 ] 14 0.005% 99.688% ( 34, 51 ] 156 0.053% 99.741% ( 51, 76 ] 98 0.034% 99.775% ( 76, 110 ] 64 0.022% 99.797% ( 110, 170 ] 345 0.118% 99.915% ( 170, 250 ] 134 0.046% 99.960% ( 250, 380 ] 75 0.026% 99.986% ( 380, 580 ] 21 0.007% 99.993% ( 580, 870 ] 17 0.006% 99.999% ( 870, 1300 ] 11 0.004% 100.003% ( 1300, 1900 ] 8 0.003% 100.005% ( 1900, 2900 ] 4 0.001% 100.007% ( 2900, 4400 ] 5 0.002% 100.009% ( 4400, 6600 ] 7 0.002% 100.011% ( 6600, 9900 ] 9 0.003% 100.014% ** Level 4 read latency histogram (micros): Count: 55 Average: 1401.8545 StdDev: 2312.90 Min: 0 Median: 236.6667 Max: 8842 Percentiles: P50: 236.67 P75: 1492.86 P99: 8842.00 P99.9: 8842.00 P99.99: 8842.00 ------------------------------------------------------ [ 0, 1 ] 10 18.182% 18.182% #### ( 1, 2 ] 5 9.091% 27.273% ## ( 2, 3 ] 2 3.636% 30.909% # ( 6, 10 ] 1 1.818% 32.727% ( 34, 51 ] 1 1.818% 34.545% ( 110, 170 ] 6 10.909% 45.455% ## ( 170, 250 ] 3 5.455% 50.909% # ( 250, 380 ] 2 3.636% 54.545% # ( 580, 870 ] 2 3.636% 58.182% # ( 870, 1300 ] 7 12.727% 70.909% ### ( 1300, 1900 ] 7 12.727% 83.636% ### ( 1900, 2900 ] 2 3.636% 87.273% # ( 4400, 6600 ] 3 5.455% 92.727% # ( 6600, 9900 ] 4 7.273% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 482.6500 StdDev: 519.32 Min: 105 Median: 250.0000 Max: 2085 Percentiles: P50: 250.00 P75: 580.00 P99: 2085.00 P99.9: 2085.00 P99.99: 2085.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 6 30.000% 35.000% ###### ( 170, 250 ] 3 15.000% 50.000% ### ( 250, 380 ] 4 20.000% 70.000% #### ( 380, 580 ] 1 5.000% 75.000% # ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 2 10.000% 90.000% ## ( 1300, 1900 ] 1 5.000% 95.000% # ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.360 H:M:S, 4.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.185 H:M:S, 6.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/09-10:59:12 ... thread 0: (1000000,4000000) ops and (264825.3,312517.4) ops/second in (3.776074,12.799287) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.24 GB 144.1 2.7 0.0 2.7 6.4 3.7 0.0 1.7 127.7 304.2 21.67 20.63 70 0.310 2811K 13K 0.0 0.0 L1 1/1 49.84 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 235.7 234.1 2.67 2.60 2 1.333 638K 4199 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.5 248.2 247.7 0.65 0.63 1 0.648 163K 348 0.0 0.0 L3 20/0 877.80 MB 0.9 1.4 0.5 0.9 1.4 0.5 0.0 2.7 232.5 231.9 6.33 6.06 5 1.266 1494K 3912 0.0 0.0 L4 126/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 224.0 224.0 1.01 0.96 1 1.011 229K 0 0.0 0.0 L5 116/0 9.04 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 281/11 22.95 GB 0.0 5.1 1.2 3.9 8.9 5.0 1.0 2.4 162.6 280.6 32.32 30.88 79 0.409 5337K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 1.2 3.9 8.9 5.0 1.0 2.4 162.6 280.6 32.32 30.88 79 0.409 5337K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 1.2 3.9 5.1 1.2 0.0 0.0 244.6 243.6 21.48 20.86 20 1.074 5337K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 354.0 10.84 10.02 59 0.184 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.9 total, 12.8 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.86 GB write, 704.10 MB/s write, 5.13 GB read, 407.95 MB/s read, 32.3 seconds Interval compaction: 8.86 GB write, 708.56 MB/s write, 5.13 GB read, 410.53 MB/s read, 32.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 3, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1115496 Average: 2.4736 StdDev: 7.58 Min: 1 Median: 1.6041 Max: 1822 Percentiles: P50: 1.60 P75: 1.99 P99: 6.99 P99.9: 14.20 P99.99: 148.25 ------------------------------------------------------ [ 0, 1 ] 124091 11.124% 11.124% ## ( 1, 2 ] 717913 64.358% 75.482% ############# ( 2, 3 ] 179687 16.108% 91.591% ### ( 3, 4 ] 46347 4.155% 95.746% # ( 4, 6 ] 33602 3.012% 98.758% # ( 6, 10 ] 10883 0.976% 99.733% ( 10, 15 ] 2213 0.198% 99.932% ( 15, 22 ] 184 0.016% 99.948% ( 22, 34 ] 29 0.003% 99.951% ( 34, 51 ] 6 0.001% 99.952% ( 51, 76 ] 9 0.001% 99.952% ( 76, 110 ] 53 0.005% 99.957% ( 110, 170 ] 578 0.052% 100.009% ( 170, 250 ] 135 0.012% 100.021% ( 250, 380 ] 65 0.006% 100.027% ( 380, 580 ] 50 0.004% 100.031% ( 580, 870 ] 13 0.001% 100.032% ( 870, 1300 ] 17 0.002% 100.034% ( 1300, 1900 ] 2 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 145840 Average: 2.8700 StdDev: 7.57 Min: 0 Median: 1.7962 Max: 974 Percentiles: P50: 1.80 P75: 2.58 P99: 9.07 P99.9: 19.55 P99.99: 164.71 ------------------------------------------------------ [ 0, 1 ] 7984 5.474% 5.474% # ( 1, 2 ] 81560 55.924% 61.399% ########### ( 2, 3 ] 33924 23.261% 84.660% ##### ( 3, 4 ] 9924 6.805% 91.465% # ( 4, 6 ] 9139 6.266% 97.731% # ( 6, 10 ] 2414 1.655% 99.386% ( 10, 15 ] 679 0.466% 99.852% ( 15, 22 ] 108 0.074% 99.926% ( 22, 34 ] 8 0.005% 99.931% ( 34, 51 ] 3 0.002% 99.933% ( 76, 110 ] 4 0.003% 99.936% ( 110, 170 ] 86 0.059% 99.995% ( 170, 250 ] 30 0.021% 100.016% ( 250, 380 ] 10 0.007% 100.023% ( 380, 580 ] 8 0.005% 100.028% ( 580, 870 ] 3 0.002% 100.030% ( 870, 1300 ] 1 0.001% 100.031% ** Level 2 read latency histogram (micros): Count: 65600 Average: 2.7631 StdDev: 13.34 Min: 1 Median: 1.5770 Max: 1843 Percentiles: P50: 1.58 P75: 1.99 P99: 9.17 P99.9: 150.80 P99.99: 402.00 ------------------------------------------------------ [ 0, 1 ] 9651 14.712% 14.712% ### ( 1, 2 ] 40117 61.154% 75.866% ############ ( 2, 3 ] 8785 13.392% 89.258% ### ( 3, 4 ] 3125 4.764% 94.021% # ( 4, 6 ] 2414 3.680% 97.701% # ( 6, 10 ] 1076 1.640% 99.341% ( 10, 15 ] 246 0.375% 99.716% ( 15, 22 ] 35 0.053% 99.770% ( 22, 34 ] 6 0.009% 99.779% ( 34, 51 ] 1 0.002% 99.780% ( 76, 110 ] 24 0.037% 99.817% ( 110, 170 ] 80 0.122% 99.939% ( 170, 250 ] 20 0.030% 99.970% ( 250, 380 ] 13 0.020% 99.989% ( 380, 580 ] 4 0.006% 99.995% ( 580, 870 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 292459 Average: 3.5913 StdDev: 56.81 Min: 0 Median: 1.7212 Max: 8939 Percentiles: P50: 1.72 P75: 2.39 P99: 9.54 P99.9: 162.62 P99.99: 491.94 ------------------------------------------------------ [ 0, 1 ] 15163 5.185% 5.185% # ( 1, 2 ] 181727 62.138% 67.322% ############ ( 2, 3 ] 56876 19.448% 86.770% #### ( 3, 4 ] 17291 5.912% 92.682% # ( 4, 6 ] 13396 4.580% 97.263% # ( 6, 10 ] 5735 1.961% 99.223% ( 10, 15 ] 1228 0.420% 99.643% ( 15, 22 ] 116 0.040% 99.683% ( 22, 34 ] 14 0.005% 99.688% ( 34, 51 ] 156 0.053% 99.741% ( 51, 76 ] 98 0.034% 99.775% ( 76, 110 ] 64 0.022% 99.797% ( 110, 170 ] 345 0.118% 99.915% ( 170, 250 ] 134 0.046% 99.960% ( 250, 380 ] 75 0.026% 99.986% ( 380, 580 ] 21 0.007% 99.993% ( 580, 870 ] 17 0.006% 99.999% ( 870, 1300 ] 11 0.004% 100.003% ( 1300, 1900 ] 8 0.003% 100.005% ( 1900, 2900 ] 4 0.001% 100.007% ( 2900, 4400 ] 5 0.002% 100.009% ( 4400, 6600 ] 7 0.002% 100.011% ( 6600, 9900 ] 9 0.003% 100.014% ** Level 4 read latency histogram (micros): Count: 55 Average: 1401.8545 StdDev: 2312.90 Min: 0 Median: 236.6667 Max: 8842 Percentiles: P50: 236.67 P75: 1492.86 P99: 8842.00 P99.9: 8842.00 P99.99: 8842.00 ------------------------------------------------------ [ 0, 1 ] 10 18.182% 18.182% #### ( 1, 2 ] 5 9.091% 27.273% ## ( 2, 3 ] 2 3.636% 30.909% # ( 6, 10 ] 1 1.818% 32.727% ( 34, 51 ] 1 1.818% 34.545% ( 110, 170 ] 6 10.909% 45.455% ## ( 170, 250 ] 3 5.455% 50.909% # ( 250, 380 ] 2 3.636% 54.545% # ( 580, 870 ] 2 3.636% 58.182% # ( 870, 1300 ] 7 12.727% 70.909% ### ( 1300, 1900 ] 7 12.727% 83.636% ### ( 1900, 2900 ] 2 3.636% 87.273% # ( 4400, 6600 ] 3 5.455% 92.727% # ( 6600, 9900 ] 4 7.273% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 482.6500 StdDev: 519.32 Min: 105 Median: 250.0000 Max: 2085 Percentiles: P50: 250.00 P75: 580.00 P99: 2085.00 P99.9: 2085.00 P99.99: 2085.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 6 30.000% 35.000% ###### ( 170, 250 ] 3 15.000% 50.000% ### ( 250, 380 ] 4 20.000% 70.000% #### ( 380, 580 ] 1 5.000% 75.000% # ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 2 10.000% 90.000% ## ( 1300, 1900 ] 1 5.000% 95.000% # ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.9 total, 3.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 305.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.193 H:M:S, 9.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 260.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.833 H:M:S, 22.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/09-10:59:18 ... thread 0: (1000000,5000000) ops and (175421.2,270272.4) ops/second in (5.700564,18.499851) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.39 GB 62.7 3.4 0.0 3.4 8.2 4.7 0.0 1.7 126.1 298.9 27.94 26.23 88 0.317 3577K 17K 0.0 0.0 L1 2/0 102.82 MB 10.3 2.5 2.3 0.2 2.4 2.2 0.1 1.1 226.0 218.4 11.32 10.87 3 3.772 2597K 87K 0.0 0.0 L2 2/1 257.57 MB 1.3 0.2 0.1 0.1 0.2 0.1 2.1 2.5 248.2 247.7 0.65 0.63 1 0.648 163K 348 0.0 0.0 L3 21/5 1.43 GB 1.0 2.3 1.2 1.2 2.3 1.2 0.8 2.0 213.3 211.7 11.26 10.46 11 1.023 2438K 17K 0.0 0.0 L4 129/6 9.70 GB 1.0 0.4 0.3 0.0 0.4 0.3 1.0 1.1 194.4 192.8 2.02 1.74 2 1.012 399K 3375 0.0 0.0 L5 128/0 9.97 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 296/23 23.84 GB 0.0 8.8 3.9 5.0 13.4 8.5 5.2 2.8 169.9 258.6 53.18 49.93 105 0.506 9176K 125K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.8 3.9 5.0 13.4 8.5 5.2 2.8 169.9 258.6 53.18 49.93 105 0.506 9176K 125K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.8 3.9 5.0 8.7 3.7 0.0 0.0 231.3 228.1 39.07 37.22 31 1.260 9176K 125K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 343.3 14.11 12.70 74 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.6 total, 18.5 interval Flush(GB): cumulative 4.730, interval 4.730 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.43 GB write, 740.14 MB/s write, 8.82 GB read, 486.23 MB/s read, 53.2 seconds Interval compaction: 13.43 GB write, 743.38 MB/s write, 8.82 GB read, 488.36 MB/s read, 53.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 7, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1718424 Average: 2.7629 StdDev: 17.19 Min: 0 Median: 1.6352 Max: 5007 Percentiles: P50: 1.64 P75: 2.13 P99: 8.01 P99.9: 121.58 P99.99: 201.52 ------------------------------------------------------ [ 0, 1 ] 176913 10.295% 10.295% ## ( 1, 2 ] 1074095 62.505% 72.800% ############# ( 2, 3 ] 294574 17.142% 89.942% ### ( 3, 4 ] 79488 4.626% 94.567% # ( 4, 6 ] 65492 3.811% 98.379% # ( 6, 10 ] 21229 1.235% 99.614% ( 10, 15 ] 3894 0.227% 99.841% ( 15, 22 ] 376 0.022% 99.862% ( 22, 34 ] 49 0.003% 99.865% ( 34, 51 ] 11 0.001% 99.866% ( 51, 76 ] 11 0.001% 99.867% ( 76, 110 ] 256 0.015% 99.882% ( 110, 170 ] 1650 0.096% 99.978% ( 170, 250 ] 546 0.032% 100.009% ( 250, 380 ] 228 0.013% 100.023% ( 380, 580 ] 132 0.008% 100.030% ( 580, 870 ] 31 0.002% 100.032% ( 870, 1300 ] 25 0.001% 100.034% ( 1300, 1900 ] 6 0.000% 100.034% ( 1900, 2900 ] 12 0.001% 100.035% ( 2900, 4400 ] 17 0.001% 100.036% ( 4400, 6600 ] 2 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 420334 Average: 3.8690 StdDev: 40.61 Min: 0 Median: 2.0331 Max: 5745 Percentiles: P50: 2.03 P75: 2.91 P99: 9.38 P99.9: 15.63 P99.99: 119.31 ------------------------------------------------------ [ 0, 1 ] 10519 2.503% 2.503% # ( 1, 2 ] 195665 46.550% 49.052% ######### ( 2, 3 ] 120497 28.667% 77.719% ###### ( 3, 4 ] 39239 9.335% 87.055% ## ( 4, 6 ] 41872 9.962% 97.016% ## ( 6, 10 ] 9883 2.351% 99.367% ( 10, 15 ] 2214 0.527% 99.894% ( 15, 22 ] 286 0.068% 99.962% ( 22, 34 ] 20 0.005% 99.967% ( 34, 51 ] 6 0.001% 99.968% ( 51, 76 ] 3 0.001% 99.969% ( 76, 110 ] 41 0.010% 99.979% ( 110, 170 ] 309 0.074% 100.052% ( 170, 250 ] 200 0.048% 100.100% ( 250, 380 ] 102 0.024% 100.124% ( 380, 580 ] 46 0.011% 100.135% ( 580, 870 ] 41 0.010% 100.145% ( 870, 1300 ] 11 0.003% 100.148% ( 1300, 1900 ] 8 0.002% 100.149% ( 1900, 2900 ] 36 0.009% 100.158% ( 2900, 4400 ] 19 0.005% 100.162% ( 4400, 6600 ] 5 0.001% 100.164% ** Level 2 read latency histogram (micros): Count: 65600 Average: 2.7631 StdDev: 13.34 Min: 1 Median: 1.5770 Max: 1843 Percentiles: P50: 1.58 P75: 1.99 P99: 9.17 P99.9: 150.80 P99.99: 402.00 ------------------------------------------------------ [ 0, 1 ] 9651 14.712% 14.712% ### ( 1, 2 ] 40117 61.154% 75.866% ############ ( 2, 3 ] 8785 13.392% 89.258% ### ( 3, 4 ] 3125 4.764% 94.021% # ( 4, 6 ] 2414 3.680% 97.701% # ( 6, 10 ] 1076 1.640% 99.341% ( 10, 15 ] 246 0.375% 99.716% ( 15, 22 ] 35 0.053% 99.770% ( 22, 34 ] 6 0.009% 99.779% ( 34, 51 ] 1 0.002% 99.780% ( 76, 110 ] 24 0.037% 99.817% ( 110, 170 ] 80 0.122% 99.939% ( 170, 250 ] 20 0.030% 99.970% ( 250, 380 ] 13 0.020% 99.989% ( 380, 580 ] 4 0.006% 99.995% ( 580, 870 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 382754 Average: 4.1077 StdDev: 56.11 Min: 0 Median: 1.8092 Max: 8939 Percentiles: P50: 1.81 P75: 2.63 P99: 9.79 P99.9: 237.33 P99.99: 555.69 ------------------------------------------------------ [ 0, 1 ] 15647 4.088% 4.088% # ( 1, 2 ] 217166 56.738% 60.826% ########### ( 2, 3 ] 86377 22.567% 83.393% ##### ( 3, 4 ] 27326 7.139% 90.532% # ( 4, 6 ] 24477 6.395% 96.927% # ( 6, 10 ] 8377 2.189% 99.116% ( 10, 15 ] 1768 0.462% 99.578% ( 15, 22 ] 193 0.050% 99.628% ( 22, 34 ] 27 0.007% 99.635% ( 34, 51 ] 157 0.041% 99.676% ( 51, 76 ] 98 0.026% 99.702% ( 76, 110 ] 70 0.018% 99.720% ( 110, 170 ] 462 0.121% 99.841% ( 170, 250 ] 270 0.071% 99.911% ( 250, 380 ] 213 0.056% 99.967% ( 380, 580 ] 101 0.026% 99.993% ( 580, 870 ] 50 0.013% 100.007% ( 870, 1300 ] 25 0.007% 100.013% ( 1300, 1900 ] 16 0.004% 100.017% ( 1900, 2900 ] 19 0.005% 100.022% ( 2900, 4400 ] 12 0.003% 100.025% ( 4400, 6600 ] 7 0.002% 100.027% ( 6600, 9900 ] 9 0.002% 100.030% ** Level 4 read latency histogram (micros): Count: 34181 Average: 12.9446 StdDev: 164.14 Min: 0 Median: 2.4281 Max: 8842 Percentiles: P50: 2.43 P75: 3.49 P99: 140.97 P99.9: 2238.03 P99.99: 3745.44 ------------------------------------------------------ [ 0, 1 ] 124 0.363% 0.363% ( 1, 2 ] 12046 35.242% 35.605% ####### ( 2, 3 ] 11495 33.630% 69.234% ####### ( 3, 4 ] 4015 11.746% 80.981% ## ( 4, 6 ] 4663 13.642% 94.623% ### ( 6, 10 ] 1198 3.505% 98.128% # ( 10, 15 ] 227 0.664% 98.792% ( 15, 22 ] 34 0.099% 98.891% ( 34, 51 ] 3 0.009% 98.900% ( 110, 170 ] 72 0.211% 99.111% ( 170, 250 ] 91 0.266% 99.377% ( 250, 380 ] 71 0.208% 99.585% ( 380, 580 ] 47 0.138% 99.722% ( 580, 870 ] 25 0.073% 99.795% ( 870, 1300 ] 13 0.038% 99.833% ( 1300, 1900 ] 15 0.044% 99.877% ( 1900, 2900 ] 32 0.094% 99.971% ( 2900, 4400 ] 17 0.050% 100.020% ( 4400, 6600 ] 5 0.015% 100.035% ( 6600, 9900 ] 4 0.012% 100.047% ** Level 5 read latency histogram (micros): Count: 80 Average: 540.1000 StdDev: 506.38 Min: 86 Median: 315.0000 Max: 2114 Percentiles: P50: 315.00 P75: 870.00 P99: 2114.00 P99.9: 2114.00 P99.99: 2114.00 ------------------------------------------------------ ( 76, 110 ] 6 7.500% 7.500% ## ( 110, 170 ] 20 25.000% 32.500% ##### ( 170, 250 ] 11 13.750% 46.250% ### ( 250, 380 ] 6 7.500% 53.750% ## ( 380, 580 ] 9 11.250% 65.000% ## ( 580, 870 ] 8 10.000% 75.000% ## ( 870, 1300 ] 13 16.250% 91.250% ### ( 1300, 1900 ] 4 5.000% 96.250% # ( 1900, 2900 ] 3 3.750% 100.000% # ** DB Stats ** Uptime(secs): 18.6 total, 5.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 264.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.724 H:M:S, 20.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 172.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.530 H:M:S, 44.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.710 micros/op 269570 ops/sec 20.006 seconds 5392999 operations; 261.2 MB/s Microseconds per write: Count: 5392999 Average: 3.7091 StdDev: 186.84 Min: 1 Median: 1.8136 Max: 245452 Percentiles: P50: 1.81 P75: 3.09 P99: 8.45 P99.9: 140.48 P99.99: 1936.24 ------------------------------------------------------ [ 0, 1 ] 602799 11.177% 11.177% ## ( 1, 2 ] 2573404 47.717% 58.895% ########## ( 2, 3 ] 799290 14.821% 73.716% ### ( 3, 4 ] 737561 13.676% 87.392% ### ( 4, 6 ] 583548 10.820% 98.213% ## ( 6, 10 ] 69414 1.287% 99.500% ( 10, 15 ] 13555 0.251% 99.751% ( 15, 22 ] 3825 0.071% 99.822% ( 22, 34 ] 1432 0.027% 99.848% ( 34, 51 ] 175 0.003% 99.852% ( 51, 76 ] 36 0.001% 99.852% ( 76, 110 ] 23 0.000% 99.853% ( 110, 170 ] 5008 0.093% 99.946% ( 170, 250 ] 382 0.007% 99.953% ( 250, 380 ] 87 0.002% 99.954% ( 380, 580 ] 16 0.000% 99.955% ( 580, 870 ] 16 0.000% 99.955% ( 870, 1300 ] 1863 0.035% 99.990% ( 1300, 1900 ] 7 0.000% 99.990% ( 1900, 2900 ] 516 0.010% 99.999% ( 2900, 4400 ] 31 0.001% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 170000, 250000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 209813 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5392999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5565574968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 236 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3990866 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 12380477458 rocksdb.compact.write.bytes COUNT : 12158522397 rocksdb.flush.write.bytes COUNT : 5474576081 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 32 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 96 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5438563328 rocksdb.memtable.garbage.bytes.at.flush COUNT : 9563136 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 12157305445 rocksdb.non.last.level.read.count COUNT : 2935038 rocksdb.block.checksum.compute.count COUNT : 3001457 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.477007 P95 : 4.832300 P99 : 6.956826 P100 : 245451.000000 COUNT : 5392999 SUM : 17471823 rocksdb.compaction.times.micros P50 : 1020555.555556 P95 : 3110000.000000 P99 : 8579000.000000 P100 : 8649969.000000 COUNT : 37 SUM : 46820031 rocksdb.compaction.times.cpu_micros P50 : 970869.565217 P95 : 3110000.000000 P99 : 8275373.000000 P100 : 8275373.000000 COUNT : 37 SUM : 43702345 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 594.500000 P95 : 1284.870370 P99 : 4862.000000 P100 : 4886.000000 COUNT : 79 SUM : 59870 rocksdb.compaction.outfile.sync.micros P50 : 727.500000 P95 : 2275.000000 P99 : 6416.666667 P100 : 7921.000000 COUNT : 125 SUM : 120314 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 87.936170 P95 : 259.750000 P99 : 373.283333 P100 : 656.000000 COUNT : 131 SUM : 14488 rocksdb.table.open.io.micros P50 : 834.766355 P95 : 14738.461538 P99 : 20457.000000 P100 : 20457.000000 COUNT : 236 SUM : 520730 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.867456 P95 : 8.505899 P99 : 12.845783 P100 : 16419.000000 COUNT : 3001084 SUM : 17045347 rocksdb.read.block.get.micros P50 : 372.142857 P95 : 2862.500000 P99 : 8701.846154 P100 : 9022.000000 COUNT : 472 SUM : 390136 rocksdb.write.raw.block.micros P50 : 0.516479 P95 : 0.981310 P99 : 3.339074 P100 : 38748.000000 COUNT : 4274917 SUM : 9271753 rocksdb.numfiles.in.singlecompaction P50 : 3.225806 P95 : 8.666667 P99 : 11.000000 P100 : 11.000000 COUNT : 60 SUM : 229 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560861 P95 : 1162.554809 P99 : 2475.745098 P100 : 245244.000000 COUNT : 22237 SUM : 3992997 rocksdb.sst.read.micros P50 : 1.742436 P95 : 5.067739 P99 : 9.063846 P100 : 8939.000000 COUNT : 2935480 SUM : 10408608 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5392999 SUM : 5565574968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 198085.106383 P95 : 359416.666667 P99 : 519966.666667 P100 : 532724.000000 COUNT : 79 SUM : 15502343 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 145 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0