[2024-07-26 13:22:44.195796] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... [2024-07-26 13:22:44.196104] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3436761 ] Set seed to 1721992964188651 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-26 13:22:44.333112] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-26 13:22:44.367448] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-26 13:22:44.367502] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3436761' to capture a snapshot of events at runtime. [2024-07-26 13:22:44.367517] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3436761 for offline analysis/debug. [2024-07-26 13:22:44.367547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 26 13:22:45 2024 CPU: 144 * Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz CPUCache: 55296 KB 2024/07/26-13:22:48 ... thread 0: (1000000,1000000) ops and (338361.7,338361.7) ops/second in (2.955417,2.955417) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 441.03 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 485.5 1.82 1.66 14 0.130 0 0 0.0 0.0 L1 4/0 314.58 MB 31.5 0.4 0.3 0.1 0.4 0.3 0.1 1.4 263.7 263.4 1.67 1.64 2 0.836 447K 403 0.0 0.0 L2 1/0 1.17 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 257.1 257.0 0.49 0.48 1 0.490 127K 40 0.0 0.0 L3 19/0 1.03 GB 1.1 0.1 0.1 0.0 0.1 0.1 0.1 1.0 233.2 233.2 0.54 0.51 1 0.535 126K 0 0.0 0.0 L4 116/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1116/0 85.51 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/5 97.00 GB 0.0 0.7 0.5 0.2 1.5 1.4 0.4 1.8 153.2 348.5 4.51 4.29 18 0.251 702K 443 0.0 0.0 Int 0/0 0.00 KB 0.0 0.7 0.5 0.2 1.5 1.4 0.4 1.8 153.2 348.5 4.51 4.29 18 0.251 702K 443 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.7 0.5 0.2 0.7 0.5 0.0 0.0 256.4 256.2 2.70 2.63 4 0.674 702K 443 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 485.5 1.82 1.66 14 0.130 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.54 GB write, 494.52 MB/s write, 0.68 GB read, 217.43 MB/s read, 4.5 seconds Interval compaction: 1.54 GB write, 531.97 MB/s write, 0.68 GB read, 233.90 MB/s read, 4.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 151937 Average: 1.9226 StdDev: 2.84 Min: 0 Median: 1.3613 Max: 333 Percentiles: P50: 1.36 P75: 1.75 P99: 4.81 P99.9: 9.28 P99.99: 113.46 ------------------------------------------------------ [ 0, 1 ] 40888 26.911% 26.911% ##### ( 1, 2 ] 97086 63.899% 90.810% ############# ( 2, 3 ] 8566 5.638% 96.448% # ( 3, 4 ] 3188 2.098% 98.546% ( 4, 6 ] 1695 1.116% 99.662% ( 6, 10 ] 443 0.292% 99.953% ( 10, 15 ] 43 0.028% 99.982% ( 15, 22 ] 10 0.007% 99.988% ( 22, 34 ] 1 0.001% 99.989% ( 34, 51 ] 1 0.001% 99.989% ( 76, 110 ] 1 0.001% 99.990% ( 110, 170 ] 14 0.009% 99.999% ( 170, 250 ] 9 0.006% 100.005% ( 250, 380 ] 5 0.003% 100.009% ** Level 1 read latency histogram (micros): Count: 32009 Average: 2.0237 StdDev: 10.89 Min: 1 Median: 1.3426 Max: 1299 Percentiles: P50: 1.34 P75: 1.73 P99: 4.11 P99.9: 8.40 P99.99: 459.91 ------------------------------------------------------ [ 0, 1 ] 8920 27.867% 27.867% ###### ( 1, 2 ] 20678 64.601% 92.468% ############# ( 2, 3 ] 1445 4.514% 96.982% # ( 3, 4 ] 631 1.971% 98.953% ( 4, 6 ] 279 0.872% 99.825% ( 6, 10 ] 40 0.125% 99.950% ( 10, 15 ] 1 0.003% 99.953% ( 22, 34 ] 1 0.003% 99.956% ( 110, 170 ] 2 0.006% 99.963% ( 170, 250 ] 2 0.006% 99.969% ( 250, 380 ] 6 0.019% 99.988% ( 380, 580 ] 2 0.006% 99.994% ( 870, 1300 ] 2 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 31688 Average: 2.1829 StdDev: 2.98 Min: 1 Median: 1.5033 Max: 359 Percentiles: P50: 1.50 P75: 1.89 P99: 5.80 P99.9: 9.93 P99.99: 41.07 ------------------------------------------------------ [ 0, 1 ] 5511 17.391% 17.391% ### ( 1, 2 ] 20532 64.794% 82.186% ############# ( 2, 3 ] 2892 9.126% 91.312% ## ( 3, 4 ] 1663 5.248% 96.560% # ( 4, 6 ] 859 2.711% 99.271% # ( 6, 10 ] 203 0.641% 99.912% ( 10, 15 ] 17 0.054% 99.965% ( 15, 22 ] 5 0.016% 99.981% ( 22, 34 ] 2 0.006% 99.987% ( 34, 51 ] 2 0.006% 99.994% ( 250, 380 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 521.0444 StdDev: 643.34 Min: 1 Median: 268.5714 Max: 2431 Percentiles: P50: 268.57 P75: 962.14 P99: 2431.00 P99.9: 2431.00 P99.99: 2431.00 ------------------------------------------------------ [ 0, 1 ] 25 27.778% 27.778% ###### ( 1, 2 ] 6 6.667% 34.444% # ( 2, 3 ] 2 2.222% 36.667% ( 3, 4 ] 3 3.333% 40.000% # ( 4, 6 ] 2 2.222% 42.222% ( 110, 170 ] 5 5.556% 47.778% # ( 170, 250 ] 1 1.111% 48.889% ( 250, 380 ] 7 7.778% 56.667% ## ( 380, 580 ] 9 10.000% 66.667% ## ( 580, 870 ] 6 6.667% 73.333% # ( 870, 1300 ] 7 7.778% 81.111% ## ( 1300, 1900 ] 14 15.556% 96.667% ### ( 1900, 2900 ] 3 3.333% 100.000% # ** Level 4 read latency histogram (micros): Count: 25 Average: 1001.2000 StdDev: 716.32 Min: 167 Median: 749.1667 Max: 2663 Percentiles: P50: 749.17 P75: 1630.00 P99: 2663.00 P99.9: 2663.00 P99.99: 2663.00 ------------------------------------------------------ ( 110, 170 ] 1 4.000% 4.000% # ( 250, 380 ] 5 20.000% 24.000% #### ( 380, 580 ] 3 12.000% 36.000% ## ( 580, 870 ] 6 24.000% 60.000% ##### ( 870, 1300 ] 1 4.000% 64.000% # ( 1300, 1900 ] 5 20.000% 84.000% #### ( 1900, 2900 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 309.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/26-13:22:51 ... thread 0: (1000000,2000000) ops and (399279.9,366305.3) ops/second in (2.504509,5.459926) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.35 GB 6.3 0.8 0.0 0.8 2.6 1.8 0.0 1.4 119.9 387.3 6.83 6.38 31 0.220 831K 927 0.0 0.0 L1 1/1 3.04 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.1 1.4 263.7 263.4 1.67 1.64 2 0.836 447K 403 0.0 0.0 L2 2/1 55.19 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 257.1 257.0 0.49 0.48 1 0.490 127K 40 0.0 0.0 L3 20/11 1.17 GB 0.3 0.1 0.1 0.0 0.1 0.1 0.4 1.0 233.2 233.2 0.54 0.51 1 0.535 126K 0 0.0 0.0 L4 169/0 9.52 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 162.9 162.9 0.69 0.57 1 0.690 114K 0 0.0 0.0 L5 1120/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1323/23 97.92 GB 0.0 1.6 0.6 1.0 3.4 2.4 1.3 1.9 158.9 337.5 10.22 9.58 36 0.284 1648K 1370 0.0 0.0 Int 0/0 0.00 KB 0.0 1.6 0.6 1.0 3.4 2.4 1.3 1.9 158.9 337.5 10.22 9.58 36 0.284 1648K 1370 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.6 0.6 1.0 1.6 0.6 0.0 0.0 264.5 264.3 6.14 5.89 8 0.767 1648K 1370 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 447.6 4.08 3.69 28 0.146 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.7 total, 5.5 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.37 GB write, 606.53 MB/s write, 1.59 GB read, 285.46 MB/s read, 10.2 seconds Interval compaction: 3.37 GB write, 631.40 MB/s write, 1.59 GB read, 297.17 MB/s read, 10.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389504 Average: 1.9965 StdDev: 4.49 Min: 0 Median: 1.3909 Max: 1510 Percentiles: P50: 1.39 P75: 1.80 P99: 5.18 P99.9: 9.21 P99.99: 13.92 ------------------------------------------------------ [ 0, 1 ] 101536 26.068% 26.068% ##### ( 1, 2 ] 238468 61.224% 87.292% ############ ( 2, 3 ] 29921 7.682% 94.973% ## ( 3, 4 ] 12167 3.124% 98.097% # ( 4, 6 ] 5938 1.525% 99.622% ( 6, 10 ] 1352 0.347% 99.969% ( 10, 15 ] 106 0.027% 99.996% ( 15, 22 ] 19 0.005% 100.001% ( 22, 34 ] 6 0.002% 100.002% ( 34, 51 ] 2 0.001% 100.003% ( 51, 76 ] 3 0.001% 100.004% ( 76, 110 ] 2 0.001% 100.004% ( 110, 170 ] 28 0.007% 100.011% ( 170, 250 ] 13 0.003% 100.015% ( 250, 380 ] 14 0.004% 100.018% ( 380, 580 ] 4 0.001% 100.019% ( 580, 870 ] 1 0.000% 100.020% ( 870, 1300 ] 2 0.001% 100.020% ( 1300, 1900 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 32010 Average: 2.0238 StdDev: 10.89 Min: 1 Median: 1.3426 Max: 1299 Percentiles: P50: 1.34 P75: 1.73 P99: 4.11 P99.9: 8.40 P99.99: 459.90 ------------------------------------------------------ [ 0, 1 ] 8920 27.866% 27.866% ###### ( 1, 2 ] 20678 64.599% 92.465% ############# ( 2, 3 ] 1445 4.514% 96.979% # ( 3, 4 ] 632 1.974% 98.953% ( 4, 6 ] 279 0.872% 99.825% ( 6, 10 ] 40 0.125% 99.950% ( 10, 15 ] 1 0.003% 99.953% ( 22, 34 ] 1 0.003% 99.956% ( 110, 170 ] 2 0.006% 99.963% ( 170, 250 ] 2 0.006% 99.969% ( 250, 380 ] 6 0.019% 99.988% ( 380, 580 ] 2 0.006% 99.994% ( 870, 1300 ] 2 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 31917 Average: 2.1857 StdDev: 3.00 Min: 1 Median: 1.5040 Max: 359 Percentiles: P50: 1.50 P75: 1.89 P99: 5.80 P99.9: 9.94 P99.99: 49.37 ------------------------------------------------------ [ 0, 1 ] 5529 17.323% 17.323% ### ( 1, 2 ] 20694 64.837% 82.160% ############# ( 2, 3 ] 2926 9.168% 91.328% ## ( 3, 4 ] 1673 5.242% 96.569% # ( 4, 6 ] 863 2.704% 99.273% # ( 6, 10 ] 203 0.636% 99.909% ( 10, 15 ] 17 0.053% 99.962% ( 15, 22 ] 5 0.016% 99.978% ( 22, 34 ] 2 0.006% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 250, 380 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 207806 Average: 2.6813 StdDev: 19.40 Min: 1 Median: 1.4167 Max: 2431 Percentiles: P50: 1.42 P75: 1.88 P99: 7.58 P99.9: 180.97 P99.99: 644.36 ------------------------------------------------------ [ 0, 1 ] 57598 27.717% 27.717% ###### ( 1, 2 ] 111136 53.481% 81.198% ########### ( 2, 3 ] 22459 10.808% 92.006% ## ( 3, 4 ] 8253 3.971% 95.977% # ( 4, 6 ] 5515 2.654% 98.631% # ( 6, 10 ] 1947 0.937% 99.568% ( 10, 15 ] 171 0.082% 99.650% ( 15, 22 ] 67 0.032% 99.682% ( 22, 34 ] 27 0.013% 99.695% ( 34, 51 ] 127 0.061% 99.757% ( 51, 76 ] 70 0.034% 99.790% ( 76, 110 ] 60 0.029% 99.819% ( 110, 170 ] 150 0.072% 99.891% ( 170, 250 ] 140 0.067% 99.959% ( 250, 380 ] 47 0.023% 99.981% ( 380, 580 ] 17 0.008% 99.989% ( 580, 870 ] 10 0.005% 99.994% ( 870, 1300 ] 7 0.003% 99.998% ( 1300, 1900 ] 14 0.007% 100.004% ( 1900, 2900 ] 3 0.001% 100.006% ** Level 4 read latency histogram (micros): Count: 310 Average: 83.5645 StdDev: 339.64 Min: 1 Median: 1.2778 Max: 2663 Percentiles: P50: 1.28 P75: 2.50 P99: 2125.00 P99.9: 2663.00 P99.99: 2663.00 ------------------------------------------------------ [ 0, 1 ] 130 41.935% 41.935% ######## ( 1, 2 ] 90 29.032% 70.968% ###### ( 2, 3 ] 25 8.065% 79.032% ## ( 3, 4 ] 13 4.194% 83.226% # ( 4, 6 ] 15 4.839% 88.065% # ( 6, 10 ] 8 2.581% 90.645% # ( 10, 15 ] 1 0.323% 90.968% ( 15, 22 ] 1 0.323% 91.290% ( 110, 170 ] 3 0.968% 92.258% ( 250, 380 ] 5 1.613% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 6 1.935% 96.774% ( 870, 1300 ] 1 0.323% 97.097% ( 1300, 1900 ] 5 1.613% 98.710% ( 1900, 2900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 346.0000 StdDev: 229.98 Min: 106 Median: 236.6667 Max: 855 Percentiles: P50: 236.67 P75: 530.00 P99: 855.00 P99.9: 855.00 P99.99: 855.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 6 30.000% 55.000% ###### ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 4 20.000% 80.000% #### ( 580, 870 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 5.7 total, 2.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 346.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.192 H:M:S, 3.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 392.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.192 H:M:S, 7.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/26-13:22:53 ... thread 0: (1000000,3000000) ops and (395532.9,375555.8) ops/second in (2.528235,7.988161) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 2.34 GB 100.7 1.6 0.0 1.6 4.4 2.8 0.0 1.6 142.3 388.4 11.51 10.80 48 0.240 1663K 1821 0.0 0.0 L1 1/1 3.04 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.1 1.4 263.7 263.4 1.67 1.64 2 0.836 447K 403 0.0 0.0 L2 1/0 54.01 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 257.1 257.0 0.49 0.48 1 0.490 127K 40 0.0 0.0 L3 20/0 942.52 MB 0.9 1.0 0.1 0.9 1.0 0.1 0.4 8.4 290.4 290.1 3.64 3.45 2 1.818 1072K 1188 0.0 0.0 L4 169/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 162.9 162.9 0.69 0.57 1 0.690 114K 0 0.0 0.0 L5 1124/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1331/11 98.90 GB 0.0 3.3 0.6 2.7 6.1 3.4 1.8 2.2 187.4 344.7 18.00 16.94 54 0.333 3425K 3452 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 0.6 2.7 6.1 3.4 1.8 2.2 187.4 344.7 18.00 16.94 54 0.333 3425K 3452 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 0.6 2.7 3.3 0.6 0.0 0.0 288.8 288.5 11.68 11.22 12 0.973 3425K 3452 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 448.5 6.32 5.71 42 0.150 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.2 total, 8.0 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.06 GB write, 755.37 MB/s write, 3.29 GB read, 410.68 MB/s read, 18.0 seconds Interval compaction: 6.06 GB write, 776.55 MB/s write, 3.29 GB read, 422.19 MB/s read, 18.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 798818 Average: 1.9451 StdDev: 5.21 Min: 0 Median: 1.3377 Max: 1633 Percentiles: P50: 1.34 P75: 1.77 P99: 4.72 P99.9: 8.37 P99.99: 9.80 ------------------------------------------------------ [ 0, 1 ] 243770 30.516% 30.516% ###### ( 1, 2 ] 460884 57.696% 88.212% ############ ( 2, 3 ] 59771 7.482% 95.695% # ( 3, 4 ] 23053 2.886% 98.580% # ( 4, 6 ] 9349 1.170% 99.751% ( 6, 10 ] 2015 0.252% 100.003% ( 10, 15 ] 166 0.021% 100.024% ( 15, 22 ] 27 0.003% 100.027% ( 22, 34 ] 8 0.001% 100.028% ( 34, 51 ] 5 0.001% 100.029% ( 51, 76 ] 3 0.000% 100.029% ( 76, 110 ] 16 0.002% 100.031% ( 110, 170 ] 52 0.007% 100.038% ( 170, 250 ] 74 0.009% 100.047% ( 250, 380 ] 35 0.004% 100.051% ( 380, 580 ] 9 0.001% 100.052% ( 580, 870 ] 6 0.001% 100.053% ( 870, 1300 ] 2 0.000% 100.053% ( 1300, 1900 ] 3 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 60251 Average: 1.9961 StdDev: 10.02 Min: 0 Median: 1.1877 Max: 1299 Percentiles: P50: 1.19 P75: 1.68 P99: 4.87 P99.9: 48.24 P99.99: 419.00 ------------------------------------------------------ [ 0, 1 ] 24438 40.560% 40.560% ######## ( 1, 2 ] 30305 50.298% 90.858% ########## ( 2, 3 ] 3337 5.538% 96.397% # ( 3, 4 ] 1248 2.071% 98.468% ( 4, 6 ] 740 1.228% 99.696% ( 6, 10 ] 101 0.168% 99.864% ( 10, 15 ] 3 0.005% 99.869% ( 22, 34 ] 2 0.003% 99.872% ( 34, 51 ] 20 0.033% 99.905% ( 51, 76 ] 3 0.005% 99.910% ( 110, 170 ] 14 0.023% 99.934% ( 170, 250 ] 24 0.040% 99.973% ( 250, 380 ] 9 0.015% 99.988% ( 380, 580 ] 5 0.008% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.1850 StdDev: 3.00 Min: 1 Median: 1.5037 Max: 359 Percentiles: P50: 1.50 P75: 1.89 P99: 5.80 P99.9: 9.94 P99.99: 49.31 ------------------------------------------------------ [ 0, 1 ] 5549 17.349% 17.349% ### ( 1, 2 ] 20734 64.824% 82.173% ############# ( 2, 3 ] 2933 9.170% 91.343% ## ( 3, 4 ] 1673 5.231% 96.573% # ( 4, 6 ] 864 2.701% 99.275% # ( 6, 10 ] 203 0.635% 99.909% ( 10, 15 ] 17 0.053% 99.962% ( 15, 22 ] 5 0.016% 99.978% ( 22, 34 ] 2 0.006% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 250, 380 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 236631 Average: 2.6166 StdDev: 18.63 Min: 0 Median: 1.3666 Max: 2431 Percentiles: P50: 1.37 P75: 1.86 P99: 7.23 P99.9: 186.37 P99.99: 588.88 ------------------------------------------------------ [ 0, 1 ] 74152 31.337% 31.337% ###### ( 1, 2 ] 120471 50.911% 82.247% ########## ( 2, 3 ] 24274 10.258% 92.506% ## ( 3, 4 ] 8738 3.693% 96.198% # ( 4, 6 ] 6019 2.544% 98.742% # ( 6, 10 ] 1982 0.838% 99.580% ( 10, 15 ] 172 0.073% 99.652% ( 15, 22 ] 67 0.028% 99.681% ( 22, 34 ] 27 0.011% 99.692% ( 34, 51 ] 150 0.063% 99.755% ( 51, 76 ] 70 0.030% 99.785% ( 76, 110 ] 63 0.027% 99.812% ( 110, 170 ] 175 0.074% 99.885% ( 170, 250 ] 168 0.071% 99.956% ( 250, 380 ] 57 0.024% 99.981% ( 380, 580 ] 22 0.009% 99.990% ( 580, 870 ] 11 0.005% 99.995% ( 870, 1300 ] 7 0.003% 99.997% ( 1300, 1900 ] 14 0.006% 100.003% ( 1900, 2900 ] 3 0.001% 100.005% ** Level 4 read latency histogram (micros): Count: 310 Average: 83.5645 StdDev: 339.64 Min: 1 Median: 1.2778 Max: 2663 Percentiles: P50: 1.28 P75: 2.50 P99: 2125.00 P99.9: 2663.00 P99.99: 2663.00 ------------------------------------------------------ [ 0, 1 ] 130 41.935% 41.935% ######## ( 1, 2 ] 90 29.032% 70.968% ###### ( 2, 3 ] 25 8.065% 79.032% ## ( 3, 4 ] 13 4.194% 83.226% # ( 4, 6 ] 15 4.839% 88.065% # ( 6, 10 ] 8 2.581% 90.645% # ( 10, 15 ] 1 0.323% 90.968% ( 15, 22 ] 1 0.323% 91.290% ( 110, 170 ] 3 0.968% 92.258% ( 250, 380 ] 5 1.613% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 6 1.935% 96.774% ( 870, 1300 ] 1 0.323% 97.097% ( 1300, 1900 ] 5 1.613% 98.710% ( 1900, 2900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 351.4750 StdDev: 277.97 Min: 106 Median: 236.6667 Max: 1159 Percentiles: P50: 236.67 P75: 513.33 P99: 1159.00 P99.9: 1159.00 P99.99: 1159.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 14 35.000% 37.500% ####### ( 170, 250 ] 6 15.000% 52.500% ### ( 250, 380 ] 5 12.500% 65.000% ### ( 380, 580 ] 6 15.000% 80.000% ### ( 580, 870 ] 5 12.500% 92.500% ### ( 870, 1300 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 8.2 total, 2.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 359.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.486 H:M:S, 5.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 389.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.294 H:M:S, 11.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-13:22:56 ... thread 0: (1000000,4000000) ops and (427881.3,387399.5) ops/second in (2.337097,10.325258) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 2.27 GB 25.2 2.4 0.0 2.4 6.1 3.8 0.0 1.6 152.9 391.9 16.07 15.07 67 0.240 2494K 2686 0.0 0.0 L1 6/6 553.17 MB 0.0 1.5 1.4 0.1 1.5 1.3 0.1 1.1 269.9 269.0 5.61 5.47 3 1.870 1537K 5021 0.0 0.0 L2 1/1 128.77 MB 0.0 0.1 0.1 0.1 0.1 0.1 1.0 2.0 257.1 257.0 0.49 0.48 1 0.490 127K 40 0.0 0.0 L3 22/2 1.10 GB 0.9 1.6 0.6 1.0 1.6 0.6 0.4 2.9 289.4 288.9 5.66 5.28 4 1.415 1663K 2474 0.0 0.0 L4 173/0 9.72 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 162.9 162.9 0.69 0.57 1 0.690 114K 0 0.0 0.0 L5 1124/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1343/25 99.88 GB 0.0 5.7 2.1 3.6 9.5 5.8 2.6 2.5 205.0 339.4 28.52 26.86 76 0.375 5937K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 2.1 3.6 9.5 5.8 2.6 2.5 205.0 339.4 28.52 26.86 76 0.375 5937K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 2.1 3.6 5.7 2.1 0.0 0.0 290.8 290.3 20.10 19.29 18 1.117 5937K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 456.8 8.41 7.57 58 0.145 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.6 total, 10.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.45 GB write, 917.36 MB/s write, 5.71 GB read, 554.15 MB/s read, 28.5 seconds Interval compaction: 9.45 GB write, 937.26 MB/s write, 5.71 GB read, 566.16 MB/s read, 28.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 4, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1151200 Average: 1.9749 StdDev: 5.89 Min: 0 Median: 1.3451 Max: 1633 Percentiles: P50: 1.35 P75: 1.78 P99: 4.74 P99.9: 8.25 P99.99: 9.64 ------------------------------------------------------ [ 0, 1 ] 348744 30.294% 30.294% ###### ( 1, 2 ] 657321 57.099% 87.393% ########### ( 2, 3 ] 92602 8.044% 95.437% ## ( 3, 4 ] 35965 3.124% 98.561% # ( 4, 6 ] 13725 1.192% 99.753% ( 6, 10 ] 3001 0.261% 100.014% ( 10, 15 ] 282 0.024% 100.038% ( 15, 22 ] 36 0.003% 100.041% ( 22, 34 ] 11 0.001% 100.042% ( 34, 51 ] 12 0.001% 100.043% ( 51, 76 ] 5 0.000% 100.044% ( 76, 110 ] 26 0.002% 100.046% ( 110, 170 ] 87 0.008% 100.054% ( 170, 250 ] 127 0.011% 100.065% ( 250, 380 ] 67 0.006% 100.070% ( 380, 580 ] 20 0.002% 100.072% ( 580, 870 ] 9 0.001% 100.073% ( 870, 1300 ] 4 0.000% 100.073% ( 1300, 1900 ] 6 0.001% 100.074% ** Level 1 read latency histogram (micros): Count: 206194 Average: 2.1548 StdDev: 11.32 Min: 0 Median: 1.1006 Max: 1299 Percentiles: P50: 1.10 P75: 1.67 P99: 5.38 P99.9: 194.46 P99.99: 415.04 ------------------------------------------------------ [ 0, 1 ] 94035 45.605% 45.605% ######### ( 1, 2 ] 90076 43.685% 89.290% ######### ( 2, 3 ] 13122 6.364% 95.654% # ( 3, 4 ] 4680 2.270% 97.924% ( 4, 6 ] 3209 1.556% 99.480% ( 6, 10 ] 584 0.283% 99.763% ( 10, 15 ] 66 0.032% 99.795% ( 15, 22 ] 12 0.006% 99.801% ( 22, 34 ] 4 0.002% 99.803% ( 34, 51 ] 20 0.010% 99.813% ( 51, 76 ] 4 0.002% 99.815% ( 76, 110 ] 39 0.019% 99.834% ( 110, 170 ] 94 0.046% 99.879% ( 170, 250 ] 140 0.068% 99.947% ( 250, 380 ] 84 0.041% 99.988% ( 380, 580 ] 25 0.012% 100.000% ( 580, 870 ] 3 0.001% 100.001% ( 870, 1300 ] 3 0.001% 100.003% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.1850 StdDev: 3.00 Min: 1 Median: 1.5037 Max: 359 Percentiles: P50: 1.50 P75: 1.89 P99: 5.80 P99.9: 9.94 P99.99: 49.31 ------------------------------------------------------ [ 0, 1 ] 5549 17.349% 17.349% ### ( 1, 2 ] 20734 64.824% 82.173% ############# ( 2, 3 ] 2933 9.170% 91.343% ## ( 3, 4 ] 1673 5.231% 96.573% # ( 4, 6 ] 864 2.701% 99.275% # ( 6, 10 ] 203 0.635% 99.909% ( 10, 15 ] 17 0.053% 99.962% ( 15, 22 ] 5 0.016% 99.978% ( 22, 34 ] 2 0.006% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 250, 380 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 249836 Average: 2.9753 StdDev: 20.96 Min: 0 Median: 1.3587 Max: 2431 Percentiles: P50: 1.36 P75: 1.85 P99: 7.95 P99.9: 243.06 P99.99: 687.09 ------------------------------------------------------ [ 0, 1 ] 79614 31.867% 31.867% ###### ( 1, 2 ] 126310 50.557% 82.424% ########## ( 2, 3 ] 25258 10.110% 92.534% ## ( 3, 4 ] 9053 3.624% 96.157% # ( 4, 6 ] 6124 2.451% 98.608% ( 6, 10 ] 2012 0.805% 99.414% ( 10, 15 ] 174 0.070% 99.483% ( 15, 22 ] 71 0.028% 99.512% ( 22, 34 ] 27 0.011% 99.522% ( 34, 51 ] 150 0.060% 99.583% ( 51, 76 ] 70 0.028% 99.611% ( 76, 110 ] 106 0.042% 99.653% ( 110, 170 ] 304 0.122% 99.775% ( 170, 250 ] 344 0.138% 99.912% ( 250, 380 ] 133 0.053% 99.966% ( 380, 580 ] 55 0.022% 99.988% ( 580, 870 ] 19 0.008% 99.995% ( 870, 1300 ] 7 0.003% 99.998% ( 1300, 1900 ] 14 0.006% 100.004% ( 1900, 2900 ] 3 0.001% 100.005% ** Level 4 read latency histogram (micros): Count: 310 Average: 83.5645 StdDev: 339.64 Min: 1 Median: 1.2778 Max: 2663 Percentiles: P50: 1.28 P75: 2.50 P99: 2125.00 P99.9: 2663.00 P99.99: 2663.00 ------------------------------------------------------ [ 0, 1 ] 130 41.935% 41.935% ######## ( 1, 2 ] 90 29.032% 70.968% ###### ( 2, 3 ] 25 8.065% 79.032% ## ( 3, 4 ] 13 4.194% 83.226% # ( 4, 6 ] 15 4.839% 88.065% # ( 6, 10 ] 8 2.581% 90.645% # ( 10, 15 ] 1 0.323% 90.968% ( 15, 22 ] 1 0.323% 91.290% ( 110, 170 ] 3 0.968% 92.258% ( 250, 380 ] 5 1.613% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 6 1.935% 96.774% ( 870, 1300 ] 1 0.323% 97.097% ( 1300, 1900 ] 5 1.613% 98.710% ( 1900, 2900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 351.4750 StdDev: 277.97 Min: 106 Median: 236.6667 Max: 1159 Percentiles: P50: 236.67 P75: 513.33 P99: 1159.00 P99.9: 1159.00 P99.99: 1159.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 14 35.000% 37.500% ####### ( 170, 250 ] 6 15.000% 52.500% ### ( 250, 380 ] 5 12.500% 65.000% ### ( 380, 580 ] 6 15.000% 80.000% ### ( 580, 870 ] 5 12.500% 92.500% ### ( 870, 1300 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 10.6 total, 2.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 373.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.589 H:M:S, 5.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 421.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.103 H:M:S, 4.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/26-13:22:58 ... thread 0: (1000000,5000000) ops and (393409.9,388586.9) ops/second in (2.541878,12.867136) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.26 GB 151.0 3.6 0.0 3.6 8.4 4.7 0.0 1.8 170.0 391.6 21.87 20.57 88 0.248 3774K 3880 0.0 0.0 L1 6/6 553.17 MB 0.0 1.5 1.4 0.1 1.5 1.3 0.1 1.1 269.9 269.0 5.61 5.47 3 1.870 1537K 5021 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 1.0 2.0 257.1 257.0 0.49 0.48 1 0.490 127K 40 0.0 0.0 L3 21/0 994.77 MB 1.0 1.9 0.7 1.2 1.9 0.7 0.4 2.8 293.1 292.6 6.65 6.22 5 1.330 1979K 2883 0.0 0.0 L4 173/0 9.60 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 162.9 162.9 0.69 0.57 1 0.690 114K 0 0.0 0.0 L5 1128/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1346/18 100.86 GB 0.0 7.2 2.2 5.0 12.0 6.9 3.2 2.5 210.1 347.2 35.31 33.31 98 0.360 7532K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.2 2.2 5.0 12.0 6.9 3.2 2.5 210.1 347.2 35.31 33.31 98 0.360 7532K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.2 2.2 5.0 7.2 2.2 0.0 0.0 299.2 298.7 24.79 23.87 24 1.033 7532K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 461.5 10.51 9.44 74 0.142 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.1 total, 12.9 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.97 GB write, 936.14 MB/s write, 7.24 GB read, 566.58 MB/s read, 35.3 seconds Interval compaction: 11.97 GB write, 952.43 MB/s write, 7.24 GB read, 576.44 MB/s read, 35.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 4, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1579752 Average: 1.9651 StdDev: 6.29 Min: 0 Median: 1.3174 Max: 1633 Percentiles: P50: 1.32 P75: 1.77 P99: 4.71 P99.9: 8.26 P99.99: 9.60 ------------------------------------------------------ [ 0, 1 ] 513575 32.510% 32.510% ####### ( 1, 2 ] 870417 55.098% 87.608% ########### ( 2, 3 ] 124904 7.907% 95.515% ## ( 3, 4 ] 48541 3.073% 98.587% # ( 4, 6 ] 18351 1.162% 99.749% ( 6, 10 ] 4224 0.267% 100.016% ( 10, 15 ] 424 0.027% 100.043% ( 15, 22 ] 63 0.004% 100.047% ( 22, 34 ] 16 0.001% 100.048% ( 34, 51 ] 19 0.001% 100.050% ( 51, 76 ] 6 0.000% 100.050% ( 76, 110 ] 38 0.002% 100.052% ( 110, 170 ] 155 0.010% 100.062% ( 170, 250 ] 192 0.012% 100.074% ( 250, 380 ] 110 0.007% 100.081% ( 380, 580 ] 40 0.003% 100.084% ( 580, 870 ] 18 0.001% 100.085% ( 870, 1300 ] 7 0.000% 100.085% ( 1300, 1900 ] 7 0.000% 100.086% ** Level 1 read latency histogram (micros): Count: 303662 Average: 2.1427 StdDev: 11.26 Min: 0 Median: 1.0820 Max: 1364 Percentiles: P50: 1.08 P75: 1.67 P99: 5.36 P99.9: 191.56 P99.99: 432.07 ------------------------------------------------------ [ 0, 1 ] 141190 46.496% 46.496% ######### ( 1, 2 ] 129736 42.724% 89.220% ######### ( 2, 3 ] 19693 6.485% 95.705% # ( 3, 4 ] 6815 2.244% 97.949% ( 4, 6 ] 4699 1.547% 99.496% ( 6, 10 ] 823 0.271% 99.768% ( 10, 15 ] 79 0.026% 99.794% ( 15, 22 ] 14 0.005% 99.798% ( 22, 34 ] 5 0.002% 99.800% ( 34, 51 ] 21 0.007% 99.807% ( 51, 76 ] 4 0.001% 99.808% ( 76, 110 ] 74 0.024% 99.832% ( 110, 170 ] 149 0.049% 99.881% ( 170, 250 ] 209 0.069% 99.950% ( 250, 380 ] 111 0.037% 99.987% ( 380, 580 ] 37 0.012% 99.999% ( 580, 870 ] 5 0.002% 100.001% ( 870, 1300 ] 3 0.001% 100.002% ( 1300, 1900 ] 1 0.000% 100.002% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.1850 StdDev: 3.00 Min: 1 Median: 1.5037 Max: 359 Percentiles: P50: 1.50 P75: 1.89 P99: 5.80 P99.9: 9.94 P99.99: 49.31 ------------------------------------------------------ [ 0, 1 ] 5549 17.349% 17.349% ### ( 1, 2 ] 20734 64.824% 82.173% ############# ( 2, 3 ] 2933 9.170% 91.343% ## ( 3, 4 ] 1673 5.231% 96.573% # ( 4, 6 ] 864 2.701% 99.275% # ( 6, 10 ] 203 0.635% 99.909% ( 10, 15 ] 17 0.053% 99.962% ( 15, 22 ] 5 0.016% 99.978% ( 22, 34 ] 2 0.006% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 250, 380 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 253544 Average: 2.9685 StdDev: 20.89 Min: 0 Median: 1.3570 Max: 2431 Percentiles: P50: 1.36 P75: 1.85 P99: 7.90 P99.9: 243.36 P99.99: 681.43 ------------------------------------------------------ [ 0, 1 ] 81067 31.974% 31.974% ###### ( 1, 2 ] 128028 50.495% 82.469% ########## ( 2, 3 ] 25630 10.109% 92.578% ## ( 3, 4 ] 9179 3.620% 96.198% # ( 4, 6 ] 6149 2.425% 98.623% ( 6, 10 ] 2015 0.795% 99.418% ( 10, 15 ] 174 0.069% 99.486% ( 15, 22 ] 71 0.028% 99.514% ( 22, 34 ] 27 0.011% 99.525% ( 34, 51 ] 150 0.059% 99.584% ( 51, 76 ] 70 0.028% 99.612% ( 76, 110 ] 106 0.042% 99.654% ( 110, 170 ] 309 0.122% 99.776% ( 170, 250 ] 344 0.136% 99.911% ( 250, 380 ] 136 0.054% 99.965% ( 380, 580 ] 57 0.022% 99.987% ( 580, 870 ] 19 0.007% 99.995% ( 870, 1300 ] 7 0.003% 99.998% ( 1300, 1900 ] 14 0.006% 100.003% ( 1900, 2900 ] 3 0.001% 100.004% ** Level 4 read latency histogram (micros): Count: 310 Average: 83.5645 StdDev: 339.64 Min: 1 Median: 1.2778 Max: 2663 Percentiles: P50: 1.28 P75: 2.50 P99: 2125.00 P99.9: 2663.00 P99.99: 2663.00 ------------------------------------------------------ [ 0, 1 ] 130 41.935% 41.935% ######## ( 1, 2 ] 90 29.032% 70.968% ###### ( 2, 3 ] 25 8.065% 79.032% ## ( 3, 4 ] 13 4.194% 83.226% # ( 4, 6 ] 15 4.839% 88.065% # ( 6, 10 ] 8 2.581% 90.645% # ( 10, 15 ] 1 0.323% 90.968% ( 15, 22 ] 1 0.323% 91.290% ( 110, 170 ] 3 0.968% 92.258% ( 250, 380 ] 5 1.613% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 6 1.935% 96.774% ( 870, 1300 ] 1 0.323% 97.097% ( 1300, 1900 ] 5 1.613% 98.710% ( 1900, 2900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 362.4500 StdDev: 267.87 Min: 106 Median: 243.8462 Max: 1159 Percentiles: P50: 243.85 P75: 530.00 P99: 1159.00 P99.9: 1159.00 P99.99: 1159.00 ------------------------------------------------------ ( 76, 110 ] 1 1.667% 1.667% ( 110, 170 ] 17 28.333% 30.000% ###### ( 170, 250 ] 13 21.667% 51.667% #### ( 250, 380 ] 8 13.333% 65.000% ### ( 380, 580 ] 8 13.333% 78.333% ### ( 580, 870 ] 9 15.000% 93.333% ### ( 870, 1300 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 13.1 total, 2.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 375.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.881 H:M:S, 6.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 387.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.292 H:M:S, 11.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-13:23:03 ... thread 0: (1000000,6000000) ops and (209248.8,340017.8) ops/second in (4.779000,17.646136) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.64 GB 81.8 4.4 0.0 4.4 10.0 5.7 0.0 1.8 165.8 380.5 26.98 24.84 105 0.257 4541K 4586 0.0 0.0 L1 4/0 346.20 MB 34.6 3.6 2.9 0.7 3.5 2.9 0.1 1.2 278.3 276.4 13.08 12.70 4 3.271 3696K 24K 0.0 0.0 L2 11/6 1.09 GB 3.7 0.1 0.1 0.1 0.1 0.1 2.7 2.0 257.1 257.0 0.49 0.48 1 0.490 127K 40 0.0 0.0 L3 34/9 1.44 GB 1.0 2.9 1.3 1.6 2.9 1.3 0.4 2.2 256.7 256.0 11.46 9.79 9 1.273 2986K 7762 0.0 0.0 L4 176/1 9.75 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.9 1.0 162.9 162.9 0.69 0.57 1 0.690 114K 0 0.0 0.0 L5 1128/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1368/27 101.76 GB 0.0 11.0 4.4 6.7 16.7 10.0 5.1 2.9 214.3 323.6 52.70 48.38 120 0.439 11M 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.0 4.4 6.7 16.7 10.0 5.1 2.9 214.3 323.6 52.70 48.38 120 0.439 11M 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.0 4.4 6.7 11.0 4.3 0.0 0.0 285.9 285.0 39.50 37.04 32 1.234 11M 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 439.1 13.20 11.33 88 0.150 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.9 total, 17.6 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.65 GB write, 954.03 MB/s write, 11.03 GB read, 631.83 MB/s read, 52.7 seconds Interval compaction: 16.65 GB write, 966.14 MB/s write, 11.03 GB read, 639.85 MB/s read, 52.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 6, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2067562 Average: 2.0072 StdDev: 17.58 Min: 0 Median: 1.2941 Max: 13269 Percentiles: P50: 1.29 P75: 1.76 P99: 4.77 P99.9: 8.39 P99.99: 9.82 ------------------------------------------------------ [ 0, 1 ] 707512 34.220% 34.220% ####### ( 1, 2 ] 1109243 53.650% 87.869% ########### ( 2, 3 ] 157497 7.618% 95.487% ## ( 3, 4 ] 62880 3.041% 98.528% # ( 4, 6 ] 25235 1.221% 99.749% ( 6, 10 ] 5227 0.253% 100.002% ( 10, 15 ] 477 0.023% 100.025% ( 15, 22 ] 72 0.003% 100.028% ( 22, 34 ] 18 0.001% 100.029% ( 34, 51 ] 22 0.001% 100.030% ( 51, 76 ] 7 0.000% 100.030% ( 76, 110 ] 73 0.004% 100.034% ( 110, 170 ] 262 0.013% 100.047% ( 170, 250 ] 240 0.012% 100.058% ( 250, 380 ] 165 0.008% 100.066% ( 380, 580 ] 84 0.004% 100.070% ( 580, 870 ] 33 0.002% 100.072% ( 870, 1300 ] 9 0.000% 100.072% ( 1300, 1900 ] 15 0.001% 100.073% ( 1900, 2900 ] 8 0.000% 100.073% ( 2900, 4400 ] 8 0.000% 100.074% ( 4400, 6600 ] 2 0.000% 100.074% ( 9900, 14000 ] 2 0.000% 100.074% ** Level 1 read latency histogram (micros): Count: 699224 Average: 3.0568 StdDev: 66.38 Min: 0 Median: 1.2253 Max: 16832 Percentiles: P50: 1.23 P75: 1.81 P99: 5.67 P99.9: 160.24 P99.99: 378.38 ------------------------------------------------------ [ 0, 1 ] 281739 40.293% 40.293% ######## ( 1, 2 ] 301229 43.080% 83.374% ######### ( 2, 3 ] 63829 9.129% 92.502% ## ( 3, 4 ] 31435 4.496% 96.998% # ( 4, 6 ] 16771 2.399% 99.396% ( 6, 10 ] 2817 0.403% 99.799% ( 10, 15 ] 206 0.029% 99.829% ( 15, 22 ] 37 0.005% 99.834% ( 22, 34 ] 12 0.002% 99.836% ( 34, 51 ] 28 0.004% 99.840% ( 51, 76 ] 10 0.001% 99.841% ( 76, 110 ] 215 0.031% 99.872% ( 110, 170 ] 235 0.034% 99.905% ( 170, 250 ] 359 0.051% 99.957% ( 250, 380 ] 235 0.034% 99.990% ( 380, 580 ] 121 0.017% 100.008% ( 580, 870 ] 40 0.006% 100.013% ( 870, 1300 ] 23 0.003% 100.017% ( 1300, 1900 ] 26 0.004% 100.020% ( 1900, 2900 ] 36 0.005% 100.026% ( 2900, 4400 ] 46 0.007% 100.032% ( 4400, 6600 ] 13 0.002% 100.034% ( 6600, 9900 ] 10 0.001% 100.035% ( 9900, 14000 ] 3 0.000% 100.036% ( 14000, 22000 ] 3 0.000% 100.036% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.1850 StdDev: 3.00 Min: 1 Median: 1.5037 Max: 359 Percentiles: P50: 1.50 P75: 1.89 P99: 5.80 P99.9: 9.94 P99.99: 49.31 ------------------------------------------------------ [ 0, 1 ] 5549 17.349% 17.349% ### ( 1, 2 ] 20734 64.824% 82.173% ############# ( 2, 3 ] 2933 9.170% 91.343% ## ( 3, 4 ] 1673 5.231% 96.573% # ( 4, 6 ] 864 2.701% 99.275% # ( 6, 10 ] 203 0.635% 99.909% ( 10, 15 ] 17 0.053% 99.962% ( 15, 22 ] 5 0.016% 99.978% ( 22, 34 ] 2 0.006% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 250, 380 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 428638 Average: 4.6734 StdDev: 91.71 Min: 0 Median: 1.4152 Max: 15151 Percentiles: P50: 1.42 P75: 1.93 P99: 8.16 P99.9: 419.80 P99.99: 2482.53 ------------------------------------------------------ [ 0, 1 ] 128076 29.880% 29.880% ###### ( 1, 2 ] 207700 48.456% 78.336% ########## ( 2, 3 ] 50088 11.685% 90.021% ## ( 3, 4 ] 23398 5.459% 95.480% # ( 4, 6 ] 13081 3.052% 98.531% # ( 6, 10 ] 3714 0.866% 99.398% ( 10, 15 ] 304 0.071% 99.469% ( 15, 22 ] 96 0.022% 99.491% ( 22, 34 ] 36 0.008% 99.500% ( 34, 51 ] 159 0.037% 99.537% ( 51, 76 ] 77 0.018% 99.555% ( 76, 110 ] 112 0.026% 99.581% ( 110, 170 ] 397 0.093% 99.673% ( 170, 250 ] 539 0.126% 99.799% ( 250, 380 ] 385 0.090% 99.889% ( 380, 580 ] 243 0.057% 99.946% ( 580, 870 ] 93 0.022% 99.967% ( 870, 1300 ] 37 0.009% 99.976% ( 1300, 1900 ] 39 0.009% 99.985% ( 1900, 2900 ] 38 0.009% 99.994% ( 2900, 4400 ] 54 0.013% 100.007% ( 4400, 6600 ] 11 0.003% 100.009% ( 6600, 9900 ] 11 0.003% 100.012% ( 9900, 14000 ] 3 0.001% 100.012% ( 14000, 22000 ] 5 0.001% 100.014% ** Level 4 read latency histogram (micros): Count: 358 Average: 194.3939 StdDev: 556.83 Min: 1 Median: 1.5444 Max: 4151 Percentiles: P50: 1.54 P75: 5.40 P99: 3057.50 P99.9: 4151.00 P99.99: 4151.00 ------------------------------------------------------ [ 0, 1 ] 130 36.313% 36.313% ####### ( 1, 2 ] 90 25.140% 61.453% ##### ( 2, 3 ] 25 6.983% 68.436% # ( 3, 4 ] 13 3.631% 72.067% # ( 4, 6 ] 15 4.190% 76.257% # ( 6, 10 ] 8 2.235% 78.492% ( 10, 15 ] 1 0.279% 78.771% ( 15, 22 ] 1 0.279% 79.050% ( 110, 170 ] 5 1.397% 80.447% ( 170, 250 ] 7 1.955% 82.402% ( 250, 380 ] 17 4.749% 87.151% # ( 380, 580 ] 10 2.793% 89.944% # ( 580, 870 ] 14 3.911% 93.855% # ( 870, 1300 ] 2 0.559% 94.413% ( 1300, 1900 ] 9 2.514% 96.927% # ( 1900, 2900 ] 7 1.955% 98.883% ( 2900, 4400 ] 4 1.117% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 362.4500 StdDev: 267.87 Min: 106 Median: 243.8462 Max: 1159 Percentiles: P50: 243.85 P75: 530.00 P99: 1159.00 P99.9: 1159.00 P99.99: 1159.00 ------------------------------------------------------ ( 76, 110 ] 1 1.667% 1.667% ( 110, 170 ] 17 28.333% 30.000% ###### ( 170, 250 ] 13 21.667% 51.667% #### ( 250, 380 ] 8 13.333% 65.000% ### ( 380, 580 ] 8 13.333% 78.333% ### ( 580, 870 ] 9 15.000% 93.333% ### ( 870, 1300 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 17.9 total, 4.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 330.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.951 H:M:S, 16.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 205.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.070 H:M:S, 43.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/26-13:23:07 ... thread 0: (1000000,7000000) ops and (257297.1,325087.1) ops/second in (3.886558,21.532694) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 3.62 GB 6.3 7.0 0.0 7.0 13.6 6.6 0.0 2.1 182.0 354.1 39.45 35.01 124 0.318 7290K 16K 0.0 0.0 L1 4/4 346.20 MB 0.0 3.6 2.9 0.7 3.5 2.9 0.1 1.2 278.3 276.4 13.08 12.70 4 3.271 3696K 24K 0.0 0.0 L2 1/0 60.60 MB 0.6 0.1 0.1 0.1 0.1 0.1 2.7 2.0 257.1 257.0 0.49 0.48 1 0.490 127K 40 0.0 0.0 L3 25/0 993.10 MB 1.0 4.7 2.3 2.4 4.7 2.3 0.4 2.0 227.5 226.8 21.34 16.63 17 1.255 4932K 15K 0.0 0.0 L4 189/0 9.65 GB 1.0 1.7 1.6 0.1 1.7 1.6 0.9 1.0 164.4 164.3 10.39 6.08 34 0.306 1697K 810 0.0 0.0 L5 1148/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1378/14 102.72 GB 0.0 17.1 6.9 10.2 23.7 13.5 6.7 3.6 206.6 286.2 84.76 70.89 180 0.471 17M 57K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.1 6.9 10.2 23.7 13.5 6.7 3.6 206.6 286.2 84.76 70.89 180 0.471 17M 57K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.1 6.9 10.2 17.0 6.8 0.0 0.0 256.2 255.3 68.36 57.61 78 0.876 17M 57K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 414.9 16.40 13.28 102 0.161 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.8 total, 21.5 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.69 GB write, 1114.83 MB/s write, 17.10 GB read, 804.87 MB/s read, 84.8 seconds Interval compaction: 23.69 GB write, 1126.42 MB/s write, 17.10 GB read, 813.24 MB/s read, 84.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 33, interval: 47 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2604699 Average: 2.1183 StdDev: 21.56 Min: 0 Median: 1.3016 Max: 13269 Percentiles: P50: 1.30 P75: 1.78 P99: 5.00 P99.9: 8.66 P99.99: 10.21 ------------------------------------------------------ [ 0, 1 ] 889668 34.156% 34.156% ####### ( 1, 2 ] 1368391 52.535% 86.692% ########### ( 2, 3 ] 211142 8.106% 94.798% ## ( 3, 4 ] 90533 3.476% 98.274% # ( 4, 6 ] 37750 1.449% 99.723% ( 6, 10 ] 6930 0.266% 99.989% ( 10, 15 ] 591 0.023% 100.012% ( 15, 22 ] 91 0.003% 100.015% ( 22, 34 ] 23 0.001% 100.016% ( 34, 51 ] 33 0.001% 100.017% ( 51, 76 ] 9 0.000% 100.018% ( 76, 110 ] 118 0.005% 100.022% ( 110, 170 ] 424 0.016% 100.039% ( 170, 250 ] 404 0.016% 100.054% ( 250, 380 ] 270 0.010% 100.064% ( 380, 580 ] 138 0.005% 100.070% ( 580, 870 ] 65 0.002% 100.072% ( 870, 1300 ] 30 0.001% 100.073% ( 1300, 1900 ] 36 0.001% 100.075% ( 1900, 2900 ] 22 0.001% 100.076% ( 2900, 4400 ] 24 0.001% 100.077% ( 4400, 6600 ] 7 0.000% 100.077% ( 9900, 14000 ] 2 0.000% 100.077% ** Level 1 read latency histogram (micros): Count: 842888 Average: 3.8360 StdDev: 82.19 Min: 0 Median: 1.2699 Max: 16832 Percentiles: P50: 1.27 P75: 1.85 P99: 5.81 P99.9: 234.17 P99.99: 1080.08 ------------------------------------------------------ [ 0, 1 ] 322849 38.303% 38.303% ######## ( 1, 2 ] 365244 43.332% 81.635% ######### ( 2, 3 ] 83165 9.867% 91.502% ## ( 3, 4 ] 42916 5.092% 96.593% # ( 4, 6 ] 22354 2.652% 99.245% # ( 6, 10 ] 4279 0.508% 99.753% ( 10, 15 ] 332 0.039% 99.792% ( 15, 22 ] 62 0.007% 99.800% ( 22, 34 ] 15 0.002% 99.802% ( 34, 51 ] 28 0.003% 99.805% ( 51, 76 ] 10 0.001% 99.806% ( 76, 110 ] 216 0.026% 99.832% ( 110, 170 ] 239 0.028% 99.860% ( 170, 250 ] 419 0.050% 99.910% ( 250, 380 ] 332 0.039% 99.949% ( 380, 580 ] 220 0.026% 99.975% ( 580, 870 ] 90 0.011% 99.986% ( 870, 1300 ] 69 0.008% 99.994% ( 1300, 1900 ] 74 0.009% 100.003% ( 1900, 2900 ] 90 0.011% 100.014% ( 2900, 4400 ] 109 0.013% 100.027% ( 4400, 6600 ] 28 0.003% 100.030% ( 6600, 9900 ] 20 0.002% 100.032% ( 9900, 14000 ] 5 0.001% 100.033% ( 14000, 22000 ] 3 0.000% 100.033% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.1850 StdDev: 3.00 Min: 1 Median: 1.5037 Max: 359 Percentiles: P50: 1.50 P75: 1.89 P99: 5.80 P99.9: 9.94 P99.99: 49.31 ------------------------------------------------------ [ 0, 1 ] 5549 17.349% 17.349% ### ( 1, 2 ] 20734 64.824% 82.173% ############# ( 2, 3 ] 2933 9.170% 91.343% ## ( 3, 4 ] 1673 5.231% 96.573% # ( 4, 6 ] 864 2.701% 99.275% # ( 6, 10 ] 203 0.635% 99.909% ( 10, 15 ] 17 0.053% 99.962% ( 15, 22 ] 5 0.016% 99.978% ( 22, 34 ] 2 0.006% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 250, 380 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 949060 Average: 3.6562 StdDev: 70.73 Min: 0 Median: 1.4605 Max: 15151 Percentiles: P50: 1.46 P75: 1.99 P99: 5.93 P99.9: 233.96 P99.99: 719.04 ------------------------------------------------------ [ 0, 1 ] 266910 28.124% 28.124% ###### ( 1, 2 ] 450845 47.504% 75.628% ########## ( 2, 3 ] 124327 13.100% 88.728% ### ( 3, 4 ] 67933 7.158% 95.886% # ( 4, 6 ] 30611 3.225% 99.111% # ( 6, 10 ] 5656 0.596% 99.707% ( 10, 15 ] 408 0.043% 99.750% ( 15, 22 ] 113 0.012% 99.762% ( 22, 34 ] 47 0.005% 99.767% ( 34, 51 ] 164 0.017% 99.784% ( 51, 76 ] 78 0.008% 99.793% ( 76, 110 ] 119 0.013% 99.805% ( 110, 170 ] 453 0.048% 99.853% ( 170, 250 ] 559 0.059% 99.912% ( 250, 380 ] 411 0.043% 99.955% ( 380, 580 ] 275 0.029% 99.984% ( 580, 870 ] 117 0.012% 99.996% ( 870, 1300 ] 58 0.006% 100.003% ( 1300, 1900 ] 59 0.006% 100.009% ( 1900, 2900 ] 55 0.006% 100.015% ( 2900, 4400 ] 89 0.009% 100.024% ( 4400, 6600 ] 17 0.002% 100.026% ( 6600, 9900 ] 13 0.001% 100.027% ( 9900, 14000 ] 4 0.000% 100.028% ( 14000, 22000 ] 5 0.001% 100.028% ** Level 4 read latency histogram (micros): Count: 17303 Average: 133.0595 StdDev: 526.71 Min: 0 Median: 1.5680 Max: 12510 Percentiles: P50: 1.57 P75: 2.63 P99: 2850.74 P99.9: 6015.24 P99.99: 8669.00 ------------------------------------------------------ [ 0, 1 ] 4858 28.076% 28.076% ###### ( 1, 2 ] 6679 38.600% 66.676% ######## ( 2, 3 ] 2283 13.194% 79.871% ### ( 3, 4 ] 797 4.606% 84.477% # ( 4, 6 ] 309 1.786% 86.262% ( 6, 10 ] 161 0.930% 87.193% ( 10, 15 ] 11 0.064% 87.257% ( 15, 22 ] 2 0.012% 87.268% ( 22, 34 ] 1 0.006% 87.274% ( 76, 110 ] 19 0.110% 87.384% ( 110, 170 ] 118 0.682% 88.066% ( 170, 250 ] 150 0.867% 88.933% ( 250, 380 ] 289 1.670% 90.603% ( 380, 580 ] 436 2.520% 93.123% # ( 580, 870 ] 418 2.416% 95.538% ( 870, 1300 ] 286 1.653% 97.191% ( 1300, 1900 ] 158 0.913% 98.104% ( 1900, 2900 ] 163 0.942% 99.046% ( 2900, 4400 ] 122 0.705% 99.751% ( 4400, 6600 ] 35 0.202% 99.954% ( 6600, 9900 ] 10 0.058% 100.012% ( 9900, 14000 ] 1 0.006% 100.017% ** Level 5 read latency histogram (micros): Count: 160 Average: 687.2125 StdDev: 679.80 Min: 106 Median: 463.3333 Max: 3839 Percentiles: P50: 463.33 P75: 859.26 P99: 3600.00 P99.9: 3839.00 P99.99: 3839.00 ------------------------------------------------------ ( 76, 110 ] 1 0.625% 0.625% ( 110, 170 ] 20 12.500% 13.125% ### ( 170, 250 ] 23 14.375% 27.500% ### ( 250, 380 ] 26 16.250% 43.750% ### ( 380, 580 ] 24 15.000% 58.750% ### ( 580, 870 ] 27 16.875% 75.625% ### ( 870, 1300 ] 19 11.875% 87.500% ## ( 1300, 1900 ] 8 5.000% 92.500% # ( 1900, 2900 ] 9 5.625% 98.125% # ( 2900, 4400 ] 3 1.875% 100.000% ** DB Stats ** Uptime(secs): 21.8 total, 3.9 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 316.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.360 H:M:S, 20.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.409 H:M:S, 36.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/26-13:23:09 ... thread 0: (1000000,8000000) ops and (429437.8,335270.6) ops/second in (2.328626,23.861320) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 4.60 GB 81.8 7.8 0.0 7.8 15.4 7.6 0.0 2.0 182.0 360.7 43.61 38.90 143 0.305 8058K 17K 0.0 0.0 L1 4/4 346.20 MB 0.0 3.6 2.9 0.7 3.5 2.9 0.1 1.2 278.3 276.4 13.08 12.70 4 3.271 3696K 24K 0.0 0.0 L2 1/0 60.60 MB 0.6 0.1 0.1 0.1 0.1 0.1 2.7 2.0 257.1 257.0 0.49 0.48 1 0.490 127K 40 0.0 0.0 L3 25/0 993.10 MB 1.0 4.7 2.3 2.4 4.7 2.3 0.4 2.0 227.5 226.8 21.34 16.63 17 1.255 4932K 15K 0.0 0.0 L4 189/0 9.65 GB 1.0 1.7 1.6 0.1 1.7 1.6 0.9 1.0 164.4 164.3 10.39 6.08 34 0.306 1697K 810 0.0 0.0 L5 1148/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1385/18 103.71 GB 0.0 17.8 6.9 10.9 25.4 14.5 6.7 3.3 205.4 292.6 88.92 74.78 199 0.447 18M 58K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.8 6.9 10.9 25.4 14.5 6.7 3.3 205.4 292.6 88.92 74.78 199 0.447 18M 58K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.8 6.9 10.9 17.8 6.8 0.0 0.0 259.2 258.4 70.48 59.67 81 0.870 18M 58K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 423.5 18.45 15.11 118 0.156 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.1 total, 23.9 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.41 GB write, 1080.25 MB/s write, 17.84 GB read, 758.44 MB/s read, 88.9 seconds Interval compaction: 25.41 GB write, 1090.39 MB/s write, 17.84 GB read, 765.56 MB/s read, 88.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 33, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3001542 Average: 2.0659 StdDev: 20.15 Min: 0 Median: 1.2735 Max: 13269 Percentiles: P50: 1.27 P75: 1.76 P99: 4.93 P99.9: 8.57 P99.99: 10.12 ------------------------------------------------------ [ 0, 1 ] 1078227 35.922% 35.922% ####### ( 1, 2 ] 1544769 51.466% 87.388% ########## ( 2, 3 ] 231888 7.726% 95.114% ## ( 3, 4 ] 97457 3.247% 98.361% # ( 4, 6 ] 41386 1.379% 99.740% ( 6, 10 ] 7498 0.250% 99.989% ( 10, 15 ] 720 0.024% 100.013% ( 15, 22 ] 110 0.004% 100.017% ( 22, 34 ] 29 0.001% 100.018% ( 34, 51 ] 40 0.001% 100.019% ( 51, 76 ] 9 0.000% 100.020% ( 76, 110 ] 119 0.004% 100.024% ( 110, 170 ] 498 0.017% 100.040% ( 170, 250 ] 431 0.014% 100.055% ( 250, 380 ] 295 0.010% 100.064% ( 380, 580 ] 141 0.005% 100.069% ( 580, 870 ] 67 0.002% 100.071% ( 870, 1300 ] 31 0.001% 100.072% ( 1300, 1900 ] 36 0.001% 100.074% ( 1900, 2900 ] 22 0.001% 100.074% ( 2900, 4400 ] 24 0.001% 100.075% ( 4400, 6600 ] 7 0.000% 100.075% ( 9900, 14000 ] 2 0.000% 100.075% ** Level 1 read latency histogram (micros): Count: 842888 Average: 3.8360 StdDev: 82.19 Min: 0 Median: 1.2699 Max: 16832 Percentiles: P50: 1.27 P75: 1.85 P99: 5.81 P99.9: 234.17 P99.99: 1080.08 ------------------------------------------------------ [ 0, 1 ] 322849 38.303% 38.303% ######## ( 1, 2 ] 365244 43.332% 81.635% ######### ( 2, 3 ] 83165 9.867% 91.502% ## ( 3, 4 ] 42916 5.092% 96.593% # ( 4, 6 ] 22354 2.652% 99.245% # ( 6, 10 ] 4279 0.508% 99.753% ( 10, 15 ] 332 0.039% 99.792% ( 15, 22 ] 62 0.007% 99.800% ( 22, 34 ] 15 0.002% 99.802% ( 34, 51 ] 28 0.003% 99.805% ( 51, 76 ] 10 0.001% 99.806% ( 76, 110 ] 216 0.026% 99.832% ( 110, 170 ] 239 0.028% 99.860% ( 170, 250 ] 419 0.050% 99.910% ( 250, 380 ] 332 0.039% 99.949% ( 380, 580 ] 220 0.026% 99.975% ( 580, 870 ] 90 0.011% 99.986% ( 870, 1300 ] 69 0.008% 99.994% ( 1300, 1900 ] 74 0.009% 100.003% ( 1900, 2900 ] 90 0.011% 100.014% ( 2900, 4400 ] 109 0.013% 100.027% ( 4400, 6600 ] 28 0.003% 100.030% ( 6600, 9900 ] 20 0.002% 100.032% ( 9900, 14000 ] 5 0.001% 100.033% ( 14000, 22000 ] 3 0.000% 100.033% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.1850 StdDev: 3.00 Min: 1 Median: 1.5037 Max: 359 Percentiles: P50: 1.50 P75: 1.89 P99: 5.80 P99.9: 9.94 P99.99: 49.31 ------------------------------------------------------ [ 0, 1 ] 5549 17.349% 17.349% ### ( 1, 2 ] 20734 64.824% 82.173% ############# ( 2, 3 ] 2933 9.170% 91.343% ## ( 3, 4 ] 1673 5.231% 96.573% # ( 4, 6 ] 864 2.701% 99.275% # ( 6, 10 ] 203 0.635% 99.909% ( 10, 15 ] 17 0.053% 99.962% ( 15, 22 ] 5 0.016% 99.978% ( 22, 34 ] 2 0.006% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 250, 380 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 949060 Average: 3.6562 StdDev: 70.73 Min: 0 Median: 1.4605 Max: 15151 Percentiles: P50: 1.46 P75: 1.99 P99: 5.93 P99.9: 233.96 P99.99: 719.04 ------------------------------------------------------ [ 0, 1 ] 266910 28.124% 28.124% ###### ( 1, 2 ] 450845 47.504% 75.628% ########## ( 2, 3 ] 124327 13.100% 88.728% ### ( 3, 4 ] 67933 7.158% 95.886% # ( 4, 6 ] 30611 3.225% 99.111% # ( 6, 10 ] 5656 0.596% 99.707% ( 10, 15 ] 408 0.043% 99.750% ( 15, 22 ] 113 0.012% 99.762% ( 22, 34 ] 47 0.005% 99.767% ( 34, 51 ] 164 0.017% 99.784% ( 51, 76 ] 78 0.008% 99.793% ( 76, 110 ] 119 0.013% 99.805% ( 110, 170 ] 453 0.048% 99.853% ( 170, 250 ] 559 0.059% 99.912% ( 250, 380 ] 411 0.043% 99.955% ( 380, 580 ] 275 0.029% 99.984% ( 580, 870 ] 117 0.012% 99.996% ( 870, 1300 ] 58 0.006% 100.003% ( 1300, 1900 ] 59 0.006% 100.009% ( 1900, 2900 ] 55 0.006% 100.015% ( 2900, 4400 ] 89 0.009% 100.024% ( 4400, 6600 ] 17 0.002% 100.026% ( 6600, 9900 ] 13 0.001% 100.027% ( 9900, 14000 ] 4 0.000% 100.028% ( 14000, 22000 ] 5 0.001% 100.028% ** Level 4 read latency histogram (micros): Count: 17303 Average: 133.0595 StdDev: 526.71 Min: 0 Median: 1.5680 Max: 12510 Percentiles: P50: 1.57 P75: 2.63 P99: 2850.74 P99.9: 6015.24 P99.99: 8669.00 ------------------------------------------------------ [ 0, 1 ] 4858 28.076% 28.076% ###### ( 1, 2 ] 6679 38.600% 66.676% ######## ( 2, 3 ] 2283 13.194% 79.871% ### ( 3, 4 ] 797 4.606% 84.477% # ( 4, 6 ] 309 1.786% 86.262% ( 6, 10 ] 161 0.930% 87.193% ( 10, 15 ] 11 0.064% 87.257% ( 15, 22 ] 2 0.012% 87.268% ( 22, 34 ] 1 0.006% 87.274% ( 76, 110 ] 19 0.110% 87.384% ( 110, 170 ] 118 0.682% 88.066% ( 170, 250 ] 150 0.867% 88.933% ( 250, 380 ] 289 1.670% 90.603% ( 380, 580 ] 436 2.520% 93.123% # ( 580, 870 ] 418 2.416% 95.538% ( 870, 1300 ] 286 1.653% 97.191% ( 1300, 1900 ] 158 0.913% 98.104% ( 1900, 2900 ] 163 0.942% 99.046% ( 2900, 4400 ] 122 0.705% 99.751% ( 4400, 6600 ] 35 0.202% 99.954% ( 6600, 9900 ] 10 0.058% 100.012% ( 9900, 14000 ] 1 0.006% 100.017% ** Level 5 read latency histogram (micros): Count: 160 Average: 687.2125 StdDev: 679.80 Min: 106 Median: 463.3333 Max: 3839 Percentiles: P50: 463.33 P75: 859.26 P99: 3600.00 P99.9: 3839.00 P99.99: 3839.00 ------------------------------------------------------ ( 76, 110 ] 1 0.625% 0.625% ( 110, 170 ] 20 12.500% 13.125% ### ( 170, 250 ] 23 14.375% 27.500% ### ( 250, 380 ] 26 16.250% 43.750% ### ( 380, 580 ] 24 15.000% 58.750% ### ( 580, 870 ] 27 16.875% 75.625% ### ( 870, 1300 ] 19 11.875% 87.500% ## ( 1300, 1900 ] 8 5.000% 92.500% # ( 1900, 2900 ] 9 5.625% 98.125% # ( 2900, 4400 ] 3 1.875% 100.000% ** DB Stats ** Uptime(secs): 24.1 total, 2.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 326.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.499 H:M:S, 18.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 422.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.139 H:M:S, 6.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-13:23:24 ... thread 0: (1000000,9000000) ops and (66377.6,231204.1) ops/second in (15.065325,38.926645) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/2 1.90 GB 63.0 9.8 0.0 9.8 18.2 8.5 0.0 2.1 183.7 342.7 54.51 47.26 158 0.345 10M 24K 0.0 0.0 L1 11/11 1.26 GB 0.0 7.4 6.4 1.0 7.4 6.4 0.1 1.1 289.1 285.6 26.38 25.15 5 5.276 7744K 90K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 5.3 2.0 257.1 257.0 0.49 0.48 1 0.490 127K 40 0.0 0.0 L3 27/9 1.71 GB 1.0 7.3 4.0 3.3 7.2 3.9 1.4 1.8 198.8 197.9 37.36 26.52 29 1.288 7543K 34K 0.0 0.0 L4 205/23 11.51 GB 1.1 4.0 3.5 0.5 4.0 3.5 0.9 1.1 154.6 154.1 26.36 14.96 60 0.439 4067K 9962 0.0 0.0 L5 1148/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1397/45 104.47 GB 0.0 28.6 13.9 14.6 36.9 22.3 10.2 4.3 201.7 260.5 145.11 114.37 253 0.574 29M 159K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.6 13.9 14.6 36.9 22.3 10.2 4.3 201.7 260.5 145.11 114.37 253 0.574 29M 159K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.6 13.9 14.6 28.4 13.8 0.0 0.0 238.8 237.5 122.56 97.40 124 0.988 29M 159K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 385.6 22.54 16.97 129 0.175 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.2 total, 38.9 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.91 GB write, 965.45 MB/s write, 28.58 GB read, 747.60 MB/s read, 145.1 seconds Interval compaction: 36.91 GB write, 971.01 MB/s write, 28.58 GB read, 751.90 MB/s read, 145.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 58, interval: 80 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4397153 Average: 2.3970 StdDev: 34.78 Min: 0 Median: 1.2521 Max: 13269 Percentiles: P50: 1.25 P75: 1.75 P99: 5.25 P99.9: 14.72 P99.99: 166.76 ------------------------------------------------------ [ 0, 1 ] 1638467 37.262% 37.262% ####### ( 1, 2 ] 2221819 50.529% 87.791% ########## ( 2, 3 ] 311346 7.081% 94.871% # ( 3, 4 ] 138252 3.144% 98.015% # ( 4, 6 ] 69111 1.572% 99.587% ( 6, 10 ] 12626 0.287% 99.874% ( 10, 15 ] 1201 0.027% 99.902% ( 15, 22 ] 251 0.006% 99.907% ( 22, 34 ] 63 0.001% 99.909% ( 34, 51 ] 68 0.002% 99.910% ( 51, 76 ] 14 0.000% 99.911% ( 76, 110 ] 1345 0.031% 99.941% ( 110, 170 ] 2273 0.052% 99.993% ( 170, 250 ] 1711 0.039% 100.032% ( 250, 380 ] 747 0.017% 100.049% ( 380, 580 ] 231 0.005% 100.054% ( 580, 870 ] 118 0.003% 100.057% ( 870, 1300 ] 62 0.001% 100.058% ( 1300, 1900 ] 86 0.002% 100.060% ( 1900, 2900 ] 105 0.002% 100.062% ( 2900, 4400 ] 133 0.003% 100.065% ( 4400, 6600 ] 44 0.001% 100.066% ( 6600, 9900 ] 12 0.000% 100.067% ( 9900, 14000 ] 4 0.000% 100.067% ** Level 1 read latency histogram (micros): Count: 1357012 Average: 5.1600 StdDev: 104.75 Min: 0 Median: 1.3674 Max: 19922 Percentiles: P50: 1.37 P75: 1.93 P99: 6.39 P99.9: 351.57 P99.99: 2458.39 ------------------------------------------------------ [ 0, 1 ] 457313 33.700% 33.700% ####### ( 1, 2 ] 602061 44.367% 78.067% ######### ( 2, 3 ] 147351 10.858% 88.925% ## ( 3, 4 ] 85470 6.298% 95.224% # ( 4, 6 ] 50290 3.706% 98.929% # ( 6, 10 ] 9736 0.717% 99.647% ( 10, 15 ] 734 0.054% 99.701% ( 15, 22 ] 212 0.016% 99.717% ( 22, 34 ] 42 0.003% 99.720% ( 34, 51 ] 54 0.004% 99.724% ( 51, 76 ] 19 0.001% 99.725% ( 76, 110 ] 469 0.035% 99.760% ( 110, 170 ] 638 0.047% 99.807% ( 170, 250 ] 798 0.059% 99.866% ( 250, 380 ] 599 0.044% 99.910% ( 380, 580 ] 412 0.030% 99.940% ( 580, 870 ] 215 0.016% 99.956% ( 870, 1300 ] 144 0.011% 99.966% ( 1300, 1900 ] 173 0.013% 99.979% ( 1900, 2900 ] 262 0.019% 99.999% ( 2900, 4400 ] 345 0.025% 100.024% ( 4400, 6600 ] 105 0.008% 100.032% ( 6600, 9900 ] 52 0.004% 100.036% ( 9900, 14000 ] 8 0.001% 100.036% ( 14000, 22000 ] 4 0.000% 100.036% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.1850 StdDev: 3.00 Min: 1 Median: 1.5037 Max: 359 Percentiles: P50: 1.50 P75: 1.89 P99: 5.80 P99.9: 9.94 P99.99: 49.31 ------------------------------------------------------ [ 0, 1 ] 5549 17.349% 17.349% ### ( 1, 2 ] 20734 64.824% 82.173% ############# ( 2, 3 ] 2933 9.170% 91.343% ## ( 3, 4 ] 1673 5.231% 96.573% # ( 4, 6 ] 864 2.701% 99.275% # ( 6, 10 ] 203 0.635% 99.909% ( 10, 15 ] 17 0.053% 99.962% ( 15, 22 ] 5 0.016% 99.978% ( 22, 34 ] 2 0.006% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 250, 380 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 1718125 Average: 5.0631 StdDev: 94.62 Min: 0 Median: 1.5332 Max: 15151 Percentiles: P50: 1.53 P75: 2.18 P99: 6.56 P99.9: 386.73 P99.99: 2074.77 ------------------------------------------------------ [ 0, 1 ] 416438 24.238% 24.238% ##### ( 1, 2 ] 830113 48.315% 72.553% ########## ( 2, 3 ] 236987 13.793% 86.346% ### ( 3, 4 ] 141558 8.239% 94.585% ## ( 4, 6 ] 73935 4.303% 98.889% # ( 6, 10 ] 13576 0.790% 99.679% ( 10, 15 ] 821 0.048% 99.727% ( 15, 22 ] 218 0.013% 99.739% ( 22, 34 ] 104 0.006% 99.745% ( 34, 51 ] 198 0.012% 99.757% ( 51, 76 ] 93 0.005% 99.762% ( 76, 110 ] 127 0.007% 99.770% ( 110, 170 ] 549 0.032% 99.802% ( 170, 250 ] 819 0.048% 99.849% ( 250, 380 ] 848 0.049% 99.899% ( 380, 580 ] 710 0.041% 99.940% ( 580, 870 ] 394 0.023% 99.963% ( 870, 1300 ] 212 0.012% 99.975% ( 1300, 1900 ] 207 0.012% 99.987% ( 1900, 2900 ] 270 0.016% 100.003% ( 2900, 4400 ] 427 0.025% 100.028% ( 4400, 6600 ] 108 0.006% 100.034% ( 6600, 9900 ] 37 0.002% 100.036% ( 9900, 14000 ] 6 0.000% 100.037% ( 14000, 22000 ] 5 0.000% 100.037% ** Level 4 read latency histogram (micros): Count: 179400 Average: 39.9676 StdDev: 317.57 Min: 0 Median: 1.5675 Max: 17952 Percentiles: P50: 1.57 P75: 2.36 P99: 1095.51 P99.9: 4272.29 P99.99: 6157.93 ------------------------------------------------------ [ 0, 1 ] 42660 23.779% 23.779% ##### ( 1, 2 ] 82897 46.208% 69.987% ######### ( 2, 3 ] 24918 13.890% 83.877% ### ( 3, 4 ] 14129 7.876% 91.753% ## ( 4, 6 ] 7131 3.975% 95.727% # ( 6, 10 ] 1909 1.064% 96.792% ( 10, 15 ] 118 0.066% 96.857% ( 15, 22 ] 26 0.014% 96.872% ( 22, 34 ] 15 0.008% 96.880% ( 34, 51 ] 5 0.003% 96.883% ( 51, 76 ] 1 0.001% 96.884% ( 76, 110 ] 30 0.017% 96.900% ( 110, 170 ] 204 0.114% 97.014% ( 170, 250 ] 475 0.265% 97.279% ( 250, 380 ] 811 0.452% 97.731% ( 380, 580 ] 1056 0.589% 98.319% ( 580, 870 ] 913 0.509% 98.828% ( 870, 1300 ] 593 0.331% 99.159% ( 1300, 1900 ] 379 0.211% 99.370% ( 1900, 2900 ] 498 0.278% 99.648% ( 2900, 4400 ] 498 0.278% 99.925% ( 4400, 6600 ] 149 0.083% 100.008% ( 6600, 9900 ] 33 0.018% 100.027% ( 9900, 14000 ] 4 0.002% 100.029% ( 14000, 22000 ] 1 0.001% 100.030% ** Level 5 read latency histogram (micros): Count: 160 Average: 687.2125 StdDev: 679.80 Min: 106 Median: 463.3333 Max: 3839 Percentiles: P50: 463.33 P75: 859.26 P99: 3600.00 P99.9: 3839.00 P99.99: 3839.00 ------------------------------------------------------ ( 76, 110 ] 1 0.625% 0.625% ( 110, 170 ] 20 12.500% 13.125% ### ( 170, 250 ] 23 14.375% 27.500% ### ( 250, 380 ] 26 16.250% 43.750% ### ( 380, 580 ] 24 15.000% 58.750% ### ( 580, 870 ] 27 16.875% 75.625% ### ( 870, 1300 ] 19 11.875% 87.500% ## ( 1300, 1900 ] 8 5.000% 92.500% # ( 1900, 2900 ] 9 5.625% 98.125% # ( 2900, 4400 ] 3 1.875% 100.000% ** DB Stats ** Uptime(secs): 39.2 total, 15.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 226.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.725 H:M:S, 40.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 65.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.226 H:M:S, 74.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/26-13:23:27 ... thread 0: (1000000,10000000) ops and (364352.1,239973.6) ops/second in (2.744598,41.671243) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/6 2.88 GB 138.4 10.6 0.0 10.6 20.1 9.4 0.0 2.1 182.5 344.5 59.72 51.71 176 0.339 11M 25K 0.0 0.0 L1 11/11 1.26 GB 0.0 7.4 6.4 1.0 7.4 6.4 0.1 1.1 289.1 285.6 26.38 25.15 5 5.276 7744K 90K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 5.3 2.0 257.1 257.0 0.49 0.48 1 0.490 127K 40 0.0 0.0 L3 16/0 949.00 MB 0.9 7.3 4.0 3.3 7.2 3.9 1.4 1.8 198.8 197.9 37.36 26.52 29 1.288 7543K 34K 0.0 0.0 L4 178/0 9.49 GB 1.0 5.5 4.2 1.3 5.5 4.2 0.9 1.3 161.5 160.4 35.05 20.63 70 0.501 5675K 34K 0.0 0.0 L5 1180/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1397/17 105.43 GB 0.0 31.0 14.7 16.3 40.3 24.0 13.0 4.3 199.6 259.4 159.00 124.48 281 0.566 32M 185K 0.0 0.0 Int 0/0 0.00 KB 0.0 31.0 14.7 16.3 40.3 24.0 13.0 4.3 199.6 259.4 159.00 124.48 281 0.566 32M 185K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 31.0 14.7 16.3 30.8 14.5 0.0 0.0 237.0 235.6 133.88 105.55 137 0.977 32M 185K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 386.2 25.12 18.93 144 0.174 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.9 total, 41.7 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.28 GB write, 984.49 MB/s write, 30.99 GB read, 757.46 MB/s read, 159.0 seconds Interval compaction: 40.28 GB write, 989.78 MB/s write, 30.99 GB read, 761.53 MB/s read, 159.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 63, interval: 85 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4764476 Average: 2.3876 StdDev: 34.45 Min: 0 Median: 1.2457 Max: 13269 Percentiles: P50: 1.25 P75: 1.74 P99: 5.23 P99.9: 13.35 P99.99: 165.06 ------------------------------------------------------ [ 0, 1 ] 1795507 37.685% 37.685% ######## ( 1, 2 ] 2387878 50.118% 87.804% ########## ( 2, 3 ] 338316 7.101% 94.904% # ( 3, 4 ] 149309 3.134% 98.038% # ( 4, 6 ] 74313 1.560% 99.598% ( 6, 10 ] 13528 0.284% 99.882% ( 10, 15 ] 1289 0.027% 99.909% ( 15, 22 ] 262 0.005% 99.914% ( 22, 34 ] 66 0.001% 99.916% ( 34, 51 ] 73 0.002% 99.917% ( 51, 76 ] 14 0.000% 99.918% ( 76, 110 ] 1346 0.028% 99.946% ( 110, 170 ] 2289 0.048% 99.994% ( 170, 250 ] 1727 0.036% 100.030% ( 250, 380 ] 798 0.017% 100.047% ( 380, 580 ] 272 0.006% 100.053% ( 580, 870 ] 149 0.003% 100.056% ( 870, 1300 ] 70 0.001% 100.057% ( 1300, 1900 ] 109 0.002% 100.060% ( 1900, 2900 ] 124 0.003% 100.062% ( 2900, 4400 ] 142 0.003% 100.065% ( 4400, 6600 ] 45 0.001% 100.066% ( 6600, 9900 ] 12 0.000% 100.066% ( 9900, 14000 ] 4 0.000% 100.066% ** Level 1 read latency histogram (micros): Count: 1533174 Average: 4.9973 StdDev: 101.48 Min: 0 Median: 1.3676 Max: 19922 Percentiles: P50: 1.37 P75: 1.93 P99: 6.30 P99.9: 338.61 P99.99: 2318.22 ------------------------------------------------------ [ 0, 1 ] 515951 33.652% 33.652% ####### ( 1, 2 ] 681784 44.469% 78.121% ######### ( 2, 3 ] 167735 10.940% 89.062% ## ( 3, 4 ] 95937 6.257% 95.319% # ( 4, 6 ] 55618 3.628% 98.947% # ( 6, 10 ] 11023 0.719% 99.666% ( 10, 15 ] 802 0.052% 99.718% ( 15, 22 ] 224 0.015% 99.733% ( 22, 34 ] 44 0.003% 99.735% ( 34, 51 ] 54 0.004% 99.739% ( 51, 76 ] 19 0.001% 99.740% ( 76, 110 ] 496 0.032% 99.773% ( 110, 170 ] 666 0.043% 99.816% ( 170, 250 ] 840 0.055% 99.871% ( 250, 380 ] 657 0.043% 99.914% ( 380, 580 ] 468 0.031% 99.944% ( 580, 870 ] 249 0.016% 99.960% ( 870, 1300 ] 155 0.010% 99.971% ( 1300, 1900 ] 182 0.012% 99.982% ( 1900, 2900 ] 279 0.018% 100.001% ( 2900, 4400 ] 365 0.024% 100.024% ( 4400, 6600 ] 115 0.008% 100.032% ( 6600, 9900 ] 55 0.004% 100.035% ( 9900, 14000 ] 8 0.001% 100.036% ( 14000, 22000 ] 4 0.000% 100.036% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.1850 StdDev: 3.00 Min: 1 Median: 1.5037 Max: 359 Percentiles: P50: 1.50 P75: 1.89 P99: 5.80 P99.9: 9.94 P99.99: 49.31 ------------------------------------------------------ [ 0, 1 ] 5549 17.349% 17.349% ### ( 1, 2 ] 20734 64.824% 82.173% ############# ( 2, 3 ] 2933 9.170% 91.343% ## ( 3, 4 ] 1673 5.231% 96.573% # ( 4, 6 ] 864 2.701% 99.275% # ( 6, 10 ] 203 0.635% 99.909% ( 10, 15 ] 17 0.053% 99.962% ( 15, 22 ] 5 0.016% 99.978% ( 22, 34 ] 2 0.006% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 250, 380 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 1769889 Average: 5.0387 StdDev: 94.21 Min: 0 Median: 1.5327 Max: 15151 Percentiles: P50: 1.53 P75: 2.18 P99: 6.57 P99.9: 387.16 P99.99: 2114.59 ------------------------------------------------------ [ 0, 1 ] 429243 24.253% 24.253% ##### ( 1, 2 ] 855398 48.331% 72.583% ########## ( 2, 3 ] 244107 13.792% 86.375% ### ( 3, 4 ] 145565 8.225% 94.600% ## ( 4, 6 ] 75865 4.286% 98.886% # ( 6, 10 ] 14059 0.794% 99.681% ( 10, 15 ] 852 0.048% 99.729% ( 15, 22 ] 225 0.013% 99.742% ( 22, 34 ] 110 0.006% 99.748% ( 34, 51 ] 201 0.011% 99.759% ( 51, 76 ] 93 0.005% 99.764% ( 76, 110 ] 127 0.007% 99.772% ( 110, 170 ] 550 0.031% 99.803% ( 170, 250 ] 822 0.046% 99.849% ( 250, 380 ] 876 0.049% 99.899% ( 380, 580 ] 729 0.041% 99.940% ( 580, 870 ] 407 0.023% 99.963% ( 870, 1300 ] 215 0.012% 99.975% ( 1300, 1900 ] 209 0.012% 99.987% ( 1900, 2900 ] 275 0.016% 100.002% ( 2900, 4400 ] 434 0.025% 100.027% ( 4400, 6600 ] 113 0.006% 100.033% ( 6600, 9900 ] 38 0.002% 100.035% ( 9900, 14000 ] 6 0.000% 100.036% ( 14000, 22000 ] 5 0.000% 100.036% ** Level 4 read latency histogram (micros): Count: 333586 Average: 24.7890 StdDev: 241.89 Min: 0 Median: 1.5280 Max: 17952 Percentiles: P50: 1.53 P75: 2.20 P99: 575.98 P99.9: 3775.23 P99.99: 5501.98 ------------------------------------------------------ [ 0, 1 ] 83561 25.049% 25.049% ##### ( 1, 2 ] 157642 47.257% 72.306% ######### ( 2, 3 ] 44852 13.445% 85.752% ### ( 3, 4 ] 24888 7.461% 93.212% # ( 4, 6 ] 12356 3.704% 96.916% # ( 6, 10 ] 3307 0.991% 97.908% ( 10, 15 ] 194 0.058% 97.966% ( 15, 22 ] 45 0.013% 97.979% ( 22, 34 ] 23 0.007% 97.986% ( 34, 51 ] 6 0.002% 97.988% ( 51, 76 ] 2 0.001% 97.989% ( 76, 110 ] 37 0.011% 98.000% ( 110, 170 ] 236 0.071% 98.070% ( 170, 250 ] 618 0.185% 98.256% ( 250, 380 ] 1125 0.337% 98.593% ( 380, 580 ] 1386 0.415% 99.008% ( 580, 870 ] 1099 0.329% 99.338% ( 870, 1300 ] 622 0.186% 99.524% ( 1300, 1900 ] 398 0.119% 99.644% ( 1900, 2900 ] 545 0.163% 99.807% ( 2900, 4400 ] 532 0.159% 99.966% ( 4400, 6600 ] 157 0.047% 100.013% ( 6600, 9900 ] 35 0.010% 100.024% ( 9900, 14000 ] 4 0.001% 100.025% ( 14000, 22000 ] 1 0.000% 100.025% ** Level 5 read latency histogram (micros): Count: 320 Average: 794.2531 StdDev: 949.00 Min: 98 Median: 462.6087 Max: 5513 Percentiles: P50: 462.61 P75: 913.00 P99: 5192.00 P99.9: 5513.00 P99.99: 5513.00 ------------------------------------------------------ ( 76, 110 ] 2 0.625% 0.625% ( 110, 170 ] 26 8.125% 8.750% ## ( 170, 250 ] 51 15.938% 24.688% ### ( 250, 380 ] 62 19.375% 44.062% #### ( 380, 580 ] 46 14.375% 58.438% ### ( 580, 870 ] 49 15.312% 73.750% ### ( 870, 1300 ] 40 12.500% 86.250% ### ( 1300, 1900 ] 13 4.062% 90.312% # ( 1900, 2900 ] 14 4.375% 94.688% # ( 2900, 4400 ] 12 3.750% 98.438% # ( 4400, 6600 ] 5 1.562% 100.000% ** DB Stats ** Uptime(secs): 41.9 total, 2.7 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 234.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.057 H:M:S, 38.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 358.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.332 H:M:S, 12.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-13:23:29 ... thread 0: (1000000,11000000) ops and (458486.4,250841.8) ops/second in (2.181090,43.852333) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/6 3.87 GB 239.1 11.6 0.0 11.6 22.1 10.4 0.0 2.1 183.7 348.5 64.81 56.52 196 0.331 12M 26K 0.0 0.0 L1 11/11 1.26 GB 0.0 7.4 6.4 1.0 7.4 6.4 0.1 1.1 289.1 285.6 26.38 25.15 5 5.276 7744K 90K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 5.3 2.0 257.1 257.0 0.49 0.48 1 0.490 127K 40 0.0 0.0 L3 16/0 949.00 MB 0.9 7.3 4.0 3.3 7.2 3.9 1.4 1.8 198.8 197.9 37.36 26.52 29 1.288 7543K 34K 0.0 0.0 L4 178/0 9.49 GB 1.0 5.5 4.2 1.3 5.5 4.2 0.9 1.3 161.5 160.4 35.05 20.63 70 0.501 5675K 34K 0.0 0.0 L5 1180/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1401/17 106.41 GB 0.0 32.0 14.7 17.3 42.2 25.0 13.0 4.0 199.5 263.6 164.10 129.29 301 0.545 33M 186K 0.0 0.0 Int 0/0 0.00 KB 0.0 32.0 14.7 17.3 42.2 25.0 13.0 4.0 199.5 263.6 164.10 129.29 301 0.545 33M 186K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 32.0 14.7 17.3 31.8 14.5 0.0 0.0 239.2 237.8 136.90 108.50 141 0.971 33M 186K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 393.7 27.20 20.79 160 0.170 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.1 total, 43.9 interval Flush(GB): cumulative 10.459, interval 10.459 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 42.25 GB write, 981.49 MB/s write, 31.98 GB read, 742.85 MB/s read, 164.1 seconds Interval compaction: 42.25 GB write, 986.50 MB/s write, 31.98 GB read, 746.64 MB/s read, 164.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 63, interval: 85 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5051547 Average: 2.3550 StdDev: 33.49 Min: 0 Median: 1.2405 Max: 13269 Percentiles: P50: 1.24 P75: 1.74 P99: 5.20 P99.9: 12.13 P99.99: 161.00 ------------------------------------------------------ [ 0, 1 ] 1918697 37.982% 37.982% ######## ( 1, 2 ] 2523832 49.962% 87.944% ########## ( 2, 3 ] 356538 7.058% 95.002% # ( 3, 4 ] 156065 3.089% 98.091% # ( 4, 6 ] 76788 1.520% 99.611% ( 6, 10 ] 13986 0.277% 99.888% ( 10, 15 ] 1386 0.027% 99.916% ( 15, 22 ] 275 0.005% 99.921% ( 22, 34 ] 69 0.001% 99.923% ( 34, 51 ] 77 0.002% 99.924% ( 51, 76 ] 16 0.000% 99.924% ( 76, 110 ] 1346 0.027% 99.951% ( 110, 170 ] 2315 0.046% 99.997% ( 170, 250 ] 1749 0.035% 100.032% ( 250, 380 ] 821 0.016% 100.048% ( 380, 580 ] 281 0.006% 100.053% ( 580, 870 ] 156 0.003% 100.056% ( 870, 1300 ] 70 0.001% 100.058% ( 1300, 1900 ] 110 0.002% 100.060% ( 1900, 2900 ] 124 0.002% 100.062% ( 2900, 4400 ] 142 0.003% 100.065% ( 4400, 6600 ] 45 0.001% 100.066% ( 6600, 9900 ] 12 0.000% 100.066% ( 9900, 14000 ] 4 0.000% 100.066% ** Level 1 read latency histogram (micros): Count: 1674181 Average: 4.7414 StdDev: 97.16 Min: 0 Median: 1.3337 Max: 19922 Percentiles: P50: 1.33 P75: 1.90 P99: 6.00 P99.9: 316.45 P99.99: 2267.68 ------------------------------------------------------ [ 0, 1 ] 591581 35.336% 35.336% ####### ( 1, 2 ] 735812 43.951% 79.286% ######### ( 2, 3 ] 174391 10.416% 89.703% ## ( 3, 4 ] 97819 5.843% 95.545% # ( 4, 6 ] 57847 3.455% 99.001% # ( 6, 10 ] 11328 0.677% 99.677% ( 10, 15 ] 820 0.049% 99.726% ( 15, 22 ] 226 0.013% 99.740% ( 22, 34 ] 44 0.003% 99.742% ( 34, 51 ] 55 0.003% 99.746% ( 51, 76 ] 20 0.001% 99.747% ( 76, 110 ] 554 0.033% 99.780% ( 110, 170 ] 713 0.043% 99.823% ( 170, 250 ] 940 0.056% 99.879% ( 250, 380 ] 700 0.042% 99.920% ( 380, 580 ] 474 0.028% 99.949% ( 580, 870 ] 251 0.015% 99.964% ( 870, 1300 ] 155 0.009% 99.973% ( 1300, 1900 ] 182 0.011% 99.984% ( 1900, 2900 ] 279 0.017% 100.001% ( 2900, 4400 ] 365 0.022% 100.022% ( 4400, 6600 ] 115 0.007% 100.029% ( 6600, 9900 ] 55 0.003% 100.033% ( 9900, 14000 ] 8 0.000% 100.033% ( 14000, 22000 ] 4 0.000% 100.033% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.1850 StdDev: 3.00 Min: 1 Median: 1.5037 Max: 359 Percentiles: P50: 1.50 P75: 1.89 P99: 5.80 P99.9: 9.94 P99.99: 49.31 ------------------------------------------------------ [ 0, 1 ] 5549 17.349% 17.349% ### ( 1, 2 ] 20734 64.824% 82.173% ############# ( 2, 3 ] 2933 9.170% 91.343% ## ( 3, 4 ] 1673 5.231% 96.573% # ( 4, 6 ] 864 2.701% 99.275% # ( 6, 10 ] 203 0.635% 99.909% ( 10, 15 ] 17 0.053% 99.962% ( 15, 22 ] 5 0.016% 99.978% ( 22, 34 ] 2 0.006% 99.984% ( 34, 51 ] 2 0.006% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 250, 380 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 1769889 Average: 5.0387 StdDev: 94.21 Min: 0 Median: 1.5327 Max: 15151 Percentiles: P50: 1.53 P75: 2.18 P99: 6.57 P99.9: 387.16 P99.99: 2114.59 ------------------------------------------------------ [ 0, 1 ] 429243 24.253% 24.253% ##### ( 1, 2 ] 855398 48.331% 72.583% ########## ( 2, 3 ] 244107 13.792% 86.375% ### ( 3, 4 ] 145565 8.225% 94.600% ## ( 4, 6 ] 75865 4.286% 98.886% # ( 6, 10 ] 14059 0.794% 99.681% ( 10, 15 ] 852 0.048% 99.729% ( 15, 22 ] 225 0.013% 99.742% ( 22, 34 ] 110 0.006% 99.748% ( 34, 51 ] 201 0.011% 99.759% ( 51, 76 ] 93 0.005% 99.764% ( 76, 110 ] 127 0.007% 99.772% ( 110, 170 ] 550 0.031% 99.803% ( 170, 250 ] 822 0.046% 99.849% ( 250, 380 ] 876 0.049% 99.899% ( 380, 580 ] 729 0.041% 99.940% ( 580, 870 ] 407 0.023% 99.963% ( 870, 1300 ] 215 0.012% 99.975% ( 1300, 1900 ] 209 0.012% 99.987% ( 1900, 2900 ] 275 0.016% 100.002% ( 2900, 4400 ] 434 0.025% 100.027% ( 4400, 6600 ] 113 0.006% 100.033% ( 6600, 9900 ] 38 0.002% 100.035% ( 9900, 14000 ] 6 0.000% 100.036% ( 14000, 22000 ] 5 0.000% 100.036% ** Level 4 read latency histogram (micros): Count: 333586 Average: 24.7890 StdDev: 241.89 Min: 0 Median: 1.5280 Max: 17952 Percentiles: P50: 1.53 P75: 2.20 P99: 575.98 P99.9: 3775.23 P99.99: 5501.98 ------------------------------------------------------ [ 0, 1 ] 83561 25.049% 25.049% ##### ( 1, 2 ] 157642 47.257% 72.306% ######### ( 2, 3 ] 44852 13.445% 85.752% ### ( 3, 4 ] 24888 7.461% 93.212% # ( 4, 6 ] 12356 3.704% 96.916% # ( 6, 10 ] 3307 0.991% 97.908% ( 10, 15 ] 194 0.058% 97.966% ( 15, 22 ] 45 0.013% 97.979% ( 22, 34 ] 23 0.007% 97.986% ( 34, 51 ] 6 0.002% 97.988% ( 51, 76 ] 2 0.001% 97.989% ( 76, 110 ] 37 0.011% 98.000% ( 110, 170 ] 236 0.071% 98.070% ( 170, 250 ] 618 0.185% 98.256% ( 250, 380 ] 1125 0.337% 98.593% ( 380, 580 ] 1386 0.415% 99.008% ( 580, 870 ] 1099 0.329% 99.338% ( 870, 1300 ] 622 0.186% 99.524% ( 1300, 1900 ] 398 0.119% 99.644% ( 1900, 2900 ] 545 0.163% 99.807% ( 2900, 4400 ] 532 0.159% 99.966% ( 4400, 6600 ] 157 0.047% 100.013% ( 6600, 9900 ] 35 0.010% 100.024% ( 9900, 14000 ] 4 0.001% 100.025% ( 14000, 22000 ] 1 0.000% 100.025% ** Level 5 read latency histogram (micros): Count: 320 Average: 794.2531 StdDev: 949.00 Min: 98 Median: 462.6087 Max: 5513 Percentiles: P50: 462.61 P75: 913.00 P99: 5192.00 P99.9: 5513.00 P99.99: 5513.00 ------------------------------------------------------ ( 76, 110 ] 2 0.625% 0.625% ( 110, 170 ] 26 8.125% 8.750% ## ( 170, 250 ] 51 15.938% 24.688% ### ( 250, 380 ] 62 19.375% 44.062% #### ( 380, 580 ] 46 14.375% 58.438% ### ( 580, 870 ] 49 15.312% 73.750% ### ( 870, 1300 ] 40 12.500% 86.250% ### ( 1300, 1900 ] 13 4.062% 90.312% # ( 1900, 2900 ] 14 4.375% 94.688% # ( 2900, 4400 ] 12 3.750% 98.438% # ( 4400, 6600 ] 5 1.562% 100.000% ** DB Stats ** Uptime(secs): 44.1 total, 2.2 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 245.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.057 H:M:S, 36.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 451.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.085 micros/op 196645 ops/sec 60.083 seconds 11814999 operations; 190.5 MB/s Microseconds per write: Count: 11814999 Average: 5.0853 StdDev: 357.61 Min: 0 Median: 1.6013 Max: 566560 Percentiles: P50: 1.60 P75: 2.38 P99: 10.33 P99.9: 1088.22 P99.99: 2301.09 ------------------------------------------------------ [ 0, 1 ] 2802649 23.721% 23.721% ##### ( 1, 2 ] 5163861 43.706% 67.427% ######### ( 2, 3 ] 2349579 19.886% 87.313% #### ( 3, 4 ] 918699 7.776% 95.089% ## ( 4, 6 ] 321875 2.724% 97.813% # ( 6, 10 ] 137285 1.162% 98.975% ( 10, 15 ] 44608 0.378% 99.353% ( 15, 22 ] 26792 0.227% 99.580% ( 22, 34 ] 12786 0.108% 99.688% ( 34, 51 ] 2550 0.022% 99.710% ( 51, 76 ] 2563 0.022% 99.731% ( 76, 110 ] 8005 0.068% 99.799% ( 110, 170 ] 1170 0.010% 99.809% ( 170, 250 ] 245 0.002% 99.811% ( 250, 380 ] 251 0.002% 99.813% ( 380, 580 ] 68 0.001% 99.814% ( 580, 870 ] 33 0.000% 99.814% ( 870, 1300 ] 20030 0.170% 99.983% ( 1300, 1900 ] 67 0.001% 99.984% ( 1900, 2900 ] 1749 0.015% 99.999% ( 2900, 4400 ] 98 0.001% 100.000% ( 4400, 6600 ] 13 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 3 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 5 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 293306 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11814999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 12193078968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 753 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29325878 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 41969655686 rocksdb.compact.write.bytes COUNT : 41683205533 rocksdb.flush.write.bytes COUNT : 12154959097 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 73 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 493 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 12056493056 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4284416 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 42084233065 rocksdb.non.last.level.read.count COUNT : 10171160 rocksdb.block.checksum.compute.count COUNT : 10169727 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.224942 P95 : 3.674725 P99 : 9.098752 P100 : 566549.000000 COUNT : 11814999 SUM : 55315814 rocksdb.compaction.times.micros P50 : 711777.777778 P95 : 2750000.000000 P99 : 10934000.000000 P100 : 13298344.000000 COUNT : 146 SUM : 150234049 rocksdb.compaction.times.cpu_micros P50 : 603720.930233 P95 : 1830000.000000 P99 : 9041000.000000 P100 : 12447116.000000 COUNT : 146 SUM : 119592928 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 572.405063 P95 : 2333.333333 P99 : 7458.000000 P100 : 14042.000000 COUNT : 174 SUM : 154738 rocksdb.compaction.outfile.sync.micros P50 : 975.895522 P95 : 12579.642857 P99 : 32418.571429 P100 : 54903.000000 COUNT : 537 SUM : 1708462 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 155.555556 P95 : 2240.000000 P99 : 4146.666667 P100 : 5341.000000 COUNT : 352 SUM : 142490 rocksdb.table.open.io.micros P50 : 844.577922 P95 : 4852.692308 P99 : 9204.250000 P100 : 16948.000000 COUNT : 753 SUM : 1035394 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 2.588715 P95 : 5.465972 P99 : 9.062131 P100 : 19927.000000 COUNT : 10167621 SUM : 55268753 rocksdb.read.block.get.micros P50 : 272.211055 P95 : 1915.555556 P99 : 3986.818182 P100 : 10605.000000 COUNT : 1506 SUM : 781425 rocksdb.write.raw.block.micros P50 : 0.510608 P95 : 0.970156 P99 : 2.216210 P100 : 29181.000000 COUNT : 13039702 SUM : 22005935 rocksdb.numfiles.in.singlecompaction P50 : 2.895833 P95 : 5.483333 P99 : 13.862500 P100 : 48.000000 COUNT : 191 SUM : 680 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.604135 P95 : 1141.025391 P99 : 1298.109907 P100 : 566342.000000 COUNT : 182903 SUM : 29371460 rocksdb.sst.read.micros P50 : 1.286732 P95 : 3.574304 P99 : 5.850614 P100 : 19922.000000 COUNT : 10171518 SUM : 40947824 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11814999 SUM : 12193078968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 145033.557047 P95 : 421166.666667 P99 : 733850.000000 P100 : 759315.000000 COUNT : 174 SUM : 29065555 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 513 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0