[2024-12-15 13:42:19.074299] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-12-15 13:42:19.074562] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid698118 ] Set seed to 1734266539067596 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 13:42:19.172411] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 13:42:19.212475] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 13:42:19.212525] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 698118' to capture a snapshot of events at runtime. [2024-12-15 13:42:19.212537] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid698118 for offline analysis/debug. [2024-12-15 13:42:19.212562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 13:42:23 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-13:42:26 ... thread 0: (1000000,1000000) ops and (327536.1,327536.1) ops/second in (3.053099,3.053099) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 692.99 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 342.4 2.58 2.34 12 0.215 0 0 0.0 0.0 L2 3/2 236.80 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 253.2 253.0 1.37 1.31 2 0.687 353K 169 0.0 0.0 L3 10/0 881.90 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1183/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 88.1 311.3 3.95 3.65 14 0.282 353K 169 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 88.1 311.3 3.95 3.65 14 0.282 353K 169 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 253.2 253.0 1.37 1.31 2 0.687 353K 169 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 342.4 2.58 2.34 12 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 380.33 MB/s write, 0.34 GB read, 107.62 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 402.61 MB/s write, 0.34 GB read, 113.93 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 153290 Average: 1.9892 StdDev: 13.68 Min: 1 Median: 1.3332 Max: 4381 Percentiles: P50: 1.33 P75: 1.76 P99: 5.38 P99.9: 9.78 P99.99: 14.80 ------------------------------------------------------ [ 0, 1 ] 46488 30.327% 30.327% ###### ( 1, 2 ] 90509 59.044% 89.371% ############ ( 2, 3 ] 8537 5.569% 94.940% # ( 3, 4 ] 4345 2.834% 97.775% # ( 4, 6 ] 2718 1.773% 99.548% ( 6, 10 ] 572 0.373% 99.921% ( 10, 15 ] 111 0.072% 99.993% ( 15, 22 ] 11 0.007% 100.001% ( 22, 34 ] 3 0.002% 100.003% ( 51, 76 ] 1 0.001% 100.003% ( 110, 170 ] 7 0.005% 100.008% ( 170, 250 ] 4 0.003% 100.010% ( 250, 380 ] 7 0.005% 100.015% ( 580, 870 ] 3 0.002% 100.017% ( 1300, 1900 ] 1 0.001% 100.018% ( 1900, 2900 ] 1 0.001% 100.018% ( 2900, 4400 ] 1 0.001% 100.019% ** Level 2 read latency histogram (micros): Count: 83168 Average: 2.2263 StdDev: 20.84 Min: 0 Median: 1.3303 Max: 3416 Percentiles: P50: 1.33 P75: 1.76 P99: 5.79 P99.9: 43.23 P99.99: 646.04 ------------------------------------------------------ [ 0, 1 ] 25559 30.732% 30.732% ###### ( 1, 2 ] 48522 58.342% 89.074% ############ ( 2, 3 ] 4573 5.499% 94.572% # ( 3, 4 ] 2406 2.893% 97.465% # ( 4, 6 ] 1429 1.718% 99.184% ( 6, 10 ] 474 0.570% 99.754% ( 10, 15 ] 94 0.113% 99.867% ( 15, 22 ] 9 0.011% 99.877% ( 22, 34 ] 2 0.002% 99.880% ( 34, 51 ] 31 0.037% 99.917% ( 51, 76 ] 21 0.025% 99.942% ( 76, 110 ] 4 0.005% 99.947% ( 110, 170 ] 9 0.011% 99.958% ( 170, 250 ] 13 0.016% 99.974% ( 250, 380 ] 7 0.008% 99.982% ( 380, 580 ] 6 0.007% 99.989% ( 580, 870 ] 3 0.004% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.996% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 50 Average: 1550.2000 StdDev: 1268.25 Min: 190 Median: 783.0000 Max: 4737 Percentiles: P50: 783.00 P75: 2581.82 P99: 4737.00 P99.9: 4737.00 P99.99: 4737.00 ------------------------------------------------------ ( 170, 250 ] 1 2.000% 2.000% ( 250, 380 ] 7 14.000% 16.000% ### ( 380, 580 ] 10 20.000% 36.000% #### ( 580, 870 ] 10 20.000% 56.000% #### ( 1300, 1900 ] 2 4.000% 60.000% # ( 1900, 2900 ] 11 22.000% 82.000% #### ( 2900, 4400 ] 8 16.000% 98.000% ### ( 4400, 6600 ] 1 2.000% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 1638.3200 StdDev: 729.29 Min: 310 Median: 1938.4615 Max: 2896 Percentiles: P50: 1938.46 P75: 2419.23 P99: 2880.77 P99.9: 2896.00 P99.99: 2896.00 ------------------------------------------------------ ( 250, 380 ] 2 8.000% 8.000% ## ( 580, 870 ] 2 8.000% 16.000% ## ( 870, 1300 ] 6 24.000% 40.000% ##### ( 1300, 1900 ] 2 8.000% 48.000% ## ( 1900, 2900 ] 13 52.000% 100.000% ########## ** DB Stats ** Uptime(secs): 3.2 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 304.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.434 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.434 H:M:S, 14.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-13:42:29 ... thread 0: (1000000,2000000) ops and (353927.6,340220.8) ops/second in (2.825437,5.878536) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 1.29 GB 6.3 0.2 0.0 0.2 2.0 1.8 0.0 1.1 40.6 334.9 6.21 5.68 27 0.230 255K 215 0.0 0.0 L1 4/4 314.57 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 242.6 242.3 1.30 1.25 1 1.299 319K 403 0.0 0.0 L2 1/0 49.64 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 253.2 253.0 1.37 1.31 2 0.687 353K 169 0.0 0.0 L3 17/0 900.46 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 226.0 226.1 0.83 0.77 1 0.828 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 136.5 136.5 1.24 0.86 1 1.236 171K 0 0.0 0.0 L5 1044/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/19 97.92 GB 0.0 1.2 0.8 0.4 3.0 2.6 0.2 1.7 116.1 283.0 10.94 9.88 32 0.342 1290K 787 0.0 0.0 Int 0/0 0.00 KB 0.0 1.2 0.8 0.4 3.0 2.6 0.2 1.7 116.1 283.0 10.94 9.88 32 0.342 1290K 787 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.2 0.8 0.4 1.2 0.8 0.0 0.0 222.6 222.5 5.71 5.15 6 0.951 1290K 787 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.0 5.24 4.73 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.02 GB write, 511.14 MB/s write, 1.24 GB read, 209.74 MB/s read, 10.9 seconds Interval compaction: 3.02 GB write, 526.69 MB/s write, 1.24 GB read, 216.12 MB/s read, 10.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 352739 Average: 2.0456 StdDev: 11.52 Min: 1 Median: 1.3917 Max: 4381 Percentiles: P50: 1.39 P75: 1.80 P99: 5.42 P99.9: 9.61 P99.99: 14.05 ------------------------------------------------------ [ 0, 1 ] 90968 25.789% 25.789% ##### ( 1, 2 ] 218016 61.807% 87.596% ############ ( 2, 3 ] 24891 7.056% 94.652% # ( 3, 4 ] 10789 3.059% 97.711% # ( 4, 6 ] 6424 1.821% 99.532% ( 6, 10 ] 1441 0.409% 99.940% ( 10, 15 ] 217 0.062% 100.002% ( 15, 22 ] 27 0.008% 100.010% ( 22, 34 ] 7 0.002% 100.012% ( 51, 76 ] 1 0.000% 100.012% ( 110, 170 ] 17 0.005% 100.017% ( 170, 250 ] 8 0.002% 100.019% ( 250, 380 ] 14 0.004% 100.023% ( 380, 580 ] 3 0.001% 100.024% ( 580, 870 ] 5 0.001% 100.025% ( 870, 1300 ] 1 0.000% 100.026% ( 1300, 1900 ] 2 0.001% 100.026% ( 1900, 2900 ] 3 0.001% 100.027% ( 2900, 4400 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 35609 Average: 2.0912 StdDev: 9.70 Min: 1 Median: 1.4316 Max: 1676 Percentiles: P50: 1.43 P75: 1.81 P99: 5.35 P99.9: 9.53 P99.99: 329.27 ------------------------------------------------------ [ 0, 1 ] 7742 21.742% 21.742% #### ( 1, 2 ] 23317 65.481% 87.222% ############# ( 2, 3 ] 2736 7.683% 94.906% ## ( 3, 4 ] 1068 2.999% 97.905% # ( 4, 6 ] 579 1.626% 99.531% ( 6, 10 ] 149 0.418% 99.949% ( 10, 15 ] 10 0.028% 99.978% ( 15, 22 ] 1 0.003% 99.980% ( 22, 34 ] 1 0.003% 99.983% ( 250, 380 ] 4 0.011% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 87926 Average: 2.2405 StdDev: 20.27 Min: 0 Median: 1.3519 Max: 3416 Percentiles: P50: 1.35 P75: 1.78 P99: 5.82 P99.9: 40.62 P99.99: 600.05 ------------------------------------------------------ [ 0, 1 ] 25835 29.383% 29.383% ###### ( 1, 2 ] 51514 58.588% 87.971% ############ ( 2, 3 ] 5495 6.250% 94.220% # ( 3, 4 ] 2681 3.049% 97.269% # ( 4, 6 ] 1671 1.900% 99.170% ( 6, 10 ] 516 0.587% 99.757% ( 10, 15 ] 101 0.115% 99.871% ( 15, 22 ] 10 0.011% 99.883% ( 22, 34 ] 3 0.003% 99.886% ( 34, 51 ] 31 0.035% 99.922% ( 51, 76 ] 21 0.024% 99.945% ( 76, 110 ] 4 0.005% 99.950% ( 110, 170 ] 9 0.010% 99.960% ( 170, 250 ] 13 0.015% 99.975% ( 250, 380 ] 7 0.008% 99.983% ( 380, 580 ] 6 0.007% 99.990% ( 580, 870 ] 3 0.003% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42899 Average: 3.8872 StdDev: 68.47 Min: 1 Median: 1.4657 Max: 4737 Percentiles: P50: 1.47 P75: 1.83 P99: 5.63 P99.9: 400.02 P99.99: 3783.14 ------------------------------------------------------ [ 0, 1 ] 7852 18.303% 18.303% #### ( 1, 2 ] 29201 68.069% 86.373% ############## ( 2, 3 ] 3897 9.084% 95.457% ## ( 3, 4 ] 961 2.240% 97.697% ( 4, 6 ] 685 1.597% 99.294% ( 6, 10 ] 210 0.490% 99.783% ( 10, 15 ] 35 0.082% 99.865% ( 15, 22 ] 2 0.005% 99.869% ( 22, 34 ] 1 0.002% 99.872% ( 34, 51 ] 1 0.002% 99.874% ( 110, 170 ] 1 0.002% 99.876% ( 170, 250 ] 2 0.005% 99.881% ( 250, 380 ] 7 0.016% 99.897% ( 380, 580 ] 11 0.026% 99.923% ( 580, 870 ] 11 0.026% 99.949% ( 1300, 1900 ] 2 0.005% 99.953% ( 1900, 2900 ] 11 0.026% 99.979% ( 2900, 4400 ] 8 0.019% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 315 Average: 134.5111 StdDev: 488.07 Min: 0 Median: 1.5219 Max: 2896 Percentiles: P50: 1.52 P75: 4.69 P99: 2657.69 P99.9: 2875.77 P99.99: 2896.00 ------------------------------------------------------ [ 0, 1 ] 98 31.111% 31.111% ###### ( 1, 2 ] 114 36.190% 67.302% ####### ( 2, 3 ] 18 5.714% 73.016% # ( 4, 6 ] 18 5.714% 78.730% # ( 6, 10 ] 37 11.746% 90.476% ## ( 10, 15 ] 4 1.270% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 1 0.317% 92.698% ( 580, 870 ] 2 0.635% 93.333% ( 870, 1300 ] 6 1.905% 95.238% ( 1300, 1900 ] 2 0.635% 95.873% ( 1900, 2900 ] 13 4.127% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.631 H:M:S, 10.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.197 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-13:42:32 ... thread 0: (1000000,3000000) ops and (327712.9,335946.7) ops/second in (3.051451,8.929987) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 1.54 GB 18.9 1.4 0.0 1.4 4.1 2.7 0.0 1.5 105.0 314.8 13.20 12.29 44 0.300 1407K 1457 0.0 0.0 L1 9/9 1003.04 MB 0.0 1.3 1.0 0.3 1.3 1.0 0.2 1.3 231.2 230.4 5.72 5.56 2 2.860 1342K 4555 0.0 0.0 L2 1/0 49.64 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 253.2 253.0 1.37 1.31 2 0.687 353K 169 0.0 0.0 L3 17/0 900.46 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 226.0 226.1 0.83 0.77 1 0.828 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 136.5 136.5 1.24 0.86 1 1.236 171K 0 0.0 0.0 L5 1044/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/16 98.84 GB 0.0 3.3 1.5 1.8 6.0 4.2 0.2 2.2 152.6 276.3 22.36 20.79 50 0.447 3464K 6181 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 1.5 1.8 6.0 4.2 0.2 2.2 152.6 276.3 22.36 20.79 50 0.447 3464K 6181 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 1.5 1.8 3.3 1.5 0.0 0.0 235.9 235.5 14.46 13.68 11 1.315 3464K 6181 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 351.0 7.90 7.12 39 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.03 GB write, 678.08 MB/s write, 3.33 GB read, 374.53 MB/s read, 22.4 seconds Interval compaction: 6.03 GB write, 691.66 MB/s write, 3.33 GB read, 382.03 MB/s read, 22.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 674497 Average: 2.0776 StdDev: 10.23 Min: 0 Median: 1.4259 Max: 4381 Percentiles: P50: 1.43 P75: 1.81 P99: 5.42 P99.9: 9.59 P99.99: 13.27 ------------------------------------------------------ [ 0, 1 ] 152237 22.570% 22.570% ##### ( 1, 2 ] 434364 64.398% 86.969% ############# ( 2, 3 ] 49927 7.402% 94.371% # ( 3, 4 ] 22340 3.312% 97.683% # ( 4, 6 ] 12552 1.861% 99.544% ( 6, 10 ] 2676 0.397% 99.941% ( 10, 15 ] 510 0.076% 100.016% ( 15, 22 ] 42 0.006% 100.022% ( 22, 34 ] 13 0.002% 100.024% ( 34, 51 ] 2 0.000% 100.025% ( 51, 76 ] 3 0.000% 100.025% ( 110, 170 ] 21 0.003% 100.028% ( 170, 250 ] 15 0.002% 100.030% ( 250, 380 ] 21 0.003% 100.034% ( 380, 580 ] 7 0.001% 100.035% ( 580, 870 ] 9 0.001% 100.036% ( 870, 1300 ] 7 0.001% 100.037% ( 1300, 1900 ] 3 0.000% 100.037% ( 1900, 2900 ] 3 0.000% 100.038% ( 2900, 4400 ] 2 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 94021 Average: 2.1618 StdDev: 12.79 Min: 1 Median: 1.4327 Max: 1687 Percentiles: P50: 1.43 P75: 1.81 P99: 5.33 P99.9: 9.58 P99.99: 523.92 ------------------------------------------------------ [ 0, 1 ] 20150 21.431% 21.431% #### ( 1, 2 ] 62076 66.024% 87.455% ############# ( 2, 3 ] 6795 7.227% 94.682% # ( 3, 4 ] 2999 3.190% 97.872% # ( 4, 6 ] 1601 1.703% 99.575% ( 6, 10 ] 342 0.364% 99.938% ( 10, 15 ] 29 0.031% 99.969% ( 15, 22 ] 5 0.005% 99.974% ( 22, 34 ] 1 0.001% 99.976% ( 51, 76 ] 1 0.001% 99.977% ( 250, 380 ] 9 0.010% 99.986% ( 380, 580 ] 5 0.005% 99.991% ( 870, 1300 ] 5 0.005% 99.997% ( 1300, 1900 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 87926 Average: 2.2405 StdDev: 20.27 Min: 0 Median: 1.3519 Max: 3416 Percentiles: P50: 1.35 P75: 1.78 P99: 5.82 P99.9: 40.62 P99.99: 600.05 ------------------------------------------------------ [ 0, 1 ] 25835 29.383% 29.383% ###### ( 1, 2 ] 51514 58.588% 87.971% ############ ( 2, 3 ] 5495 6.250% 94.220% # ( 3, 4 ] 2681 3.049% 97.269% # ( 4, 6 ] 1671 1.900% 99.170% ( 6, 10 ] 516 0.587% 99.757% ( 10, 15 ] 101 0.115% 99.871% ( 15, 22 ] 10 0.011% 99.883% ( 22, 34 ] 3 0.003% 99.886% ( 34, 51 ] 31 0.035% 99.922% ( 51, 76 ] 21 0.024% 99.945% ( 76, 110 ] 4 0.005% 99.950% ( 110, 170 ] 9 0.010% 99.960% ( 170, 250 ] 13 0.015% 99.975% ( 250, 380 ] 7 0.008% 99.983% ( 380, 580 ] 6 0.007% 99.990% ( 580, 870 ] 3 0.003% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42899 Average: 3.8872 StdDev: 68.47 Min: 1 Median: 1.4657 Max: 4737 Percentiles: P50: 1.47 P75: 1.83 P99: 5.63 P99.9: 400.02 P99.99: 3783.14 ------------------------------------------------------ [ 0, 1 ] 7852 18.303% 18.303% #### ( 1, 2 ] 29201 68.069% 86.373% ############## ( 2, 3 ] 3897 9.084% 95.457% ## ( 3, 4 ] 961 2.240% 97.697% ( 4, 6 ] 685 1.597% 99.294% ( 6, 10 ] 210 0.490% 99.783% ( 10, 15 ] 35 0.082% 99.865% ( 15, 22 ] 2 0.005% 99.869% ( 22, 34 ] 1 0.002% 99.872% ( 34, 51 ] 1 0.002% 99.874% ( 110, 170 ] 1 0.002% 99.876% ( 170, 250 ] 2 0.005% 99.881% ( 250, 380 ] 7 0.016% 99.897% ( 380, 580 ] 11 0.026% 99.923% ( 580, 870 ] 11 0.026% 99.949% ( 1300, 1900 ] 2 0.005% 99.953% ( 1900, 2900 ] 11 0.026% 99.979% ( 2900, 4400 ] 8 0.019% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 315 Average: 134.5111 StdDev: 488.07 Min: 0 Median: 1.5219 Max: 2896 Percentiles: P50: 1.52 P75: 4.69 P99: 2657.69 P99.9: 2875.77 P99.99: 2896.00 ------------------------------------------------------ [ 0, 1 ] 98 31.111% 31.111% ###### ( 1, 2 ] 114 36.190% 67.302% ####### ( 2, 3 ] 18 5.714% 73.016% # ( 4, 6 ] 18 5.714% 78.730% # ( 6, 10 ] 37 11.746% 90.476% ## ( 10, 15 ] 4 1.270% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 1 0.317% 92.698% ( 580, 870 ] 2 0.635% 93.333% ( 870, 1300 ] 6 1.905% 95.238% ( 1300, 1900 ] 2 0.635% 95.873% ( 1900, 2900 ] 13 4.127% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.036 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-13:42:35 ... thread 0: (1000000,4000000) ops and (328906.4,334158.5) ops/second in (3.040379,11.970366) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 2.52 GB 62.9 1.8 0.0 1.8 5.5 3.7 0.0 1.5 105.5 316.3 17.92 16.68 60 0.299 1918K 1946 0.0 0.0 L1 9/9 1003.04 MB 0.0 1.3 1.0 0.3 1.3 1.0 0.2 1.3 231.2 230.4 5.72 5.56 2 2.860 1342K 4555 0.0 0.0 L2 1/0 49.64 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 253.2 253.0 1.37 1.31 2 0.687 353K 169 0.0 0.0 L3 17/0 900.46 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 226.0 226.1 0.83 0.77 1 0.828 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 136.5 136.5 1.24 0.86 1 1.236 171K 0 0.0 0.0 L5 1044/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/24 99.82 GB 0.0 3.8 1.5 2.3 7.5 5.2 0.2 2.0 144.6 284.0 27.08 25.19 66 0.410 3976K 6670 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 1.5 2.3 7.5 5.2 0.2 2.0 144.6 284.0 27.08 25.19 66 0.410 3976K 6670 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 1.5 2.3 3.8 1.5 0.0 0.0 240.0 239.6 16.32 15.50 13 1.255 3976K 6670 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 351.3 10.76 9.69 53 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.51 GB write, 632.79 MB/s write, 3.82 GB read, 322.29 MB/s read, 27.1 seconds Interval compaction: 7.51 GB write, 642.25 MB/s write, 3.82 GB read, 327.11 MB/s read, 27.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 970817 Average: 2.0894 StdDev: 9.90 Min: 0 Median: 1.4334 Max: 4381 Percentiles: P50: 1.43 P75: 1.82 P99: 5.38 P99.9: 9.62 P99.99: 13.65 ------------------------------------------------------ [ 0, 1 ] 210584 21.691% 21.691% #### ( 1, 2 ] 634111 65.317% 87.009% ############# ( 2, 3 ] 73171 7.537% 94.546% ## ( 3, 4 ] 31161 3.210% 97.755% # ( 4, 6 ] 17553 1.808% 99.564% ( 6, 10 ] 3613 0.372% 99.936% ( 10, 15 ] 724 0.075% 100.010% ( 15, 22 ] 52 0.005% 100.016% ( 22, 34 ] 14 0.001% 100.017% ( 34, 51 ] 3 0.000% 100.017% ( 51, 76 ] 5 0.001% 100.018% ( 76, 110 ] 22 0.002% 100.020% ( 110, 170 ] 39 0.004% 100.024% ( 170, 250 ] 26 0.003% 100.027% ( 250, 380 ] 31 0.003% 100.030% ( 380, 580 ] 11 0.001% 100.031% ( 580, 870 ] 15 0.002% 100.033% ( 870, 1300 ] 11 0.001% 100.034% ( 1300, 1900 ] 6 0.001% 100.035% ( 1900, 2900 ] 5 0.001% 100.035% ( 2900, 4400 ] 2 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 168352 Average: 2.1743 StdDev: 10.56 Min: 1 Median: 1.4513 Max: 1687 Percentiles: P50: 1.45 P75: 1.82 P99: 5.46 P99.9: 9.90 P99.99: 385.49 ------------------------------------------------------ [ 0, 1 ] 33036 19.623% 19.623% #### ( 1, 2 ] 113321 67.312% 86.935% ############# ( 2, 3 ] 13034 7.742% 94.677% ## ( 3, 4 ] 5187 3.081% 97.758% # ( 4, 6 ] 2871 1.705% 99.464% ( 6, 10 ] 754 0.448% 99.911% ( 10, 15 ] 74 0.044% 99.955% ( 15, 22 ] 8 0.005% 99.960% ( 22, 34 ] 2 0.001% 99.961% ( 34, 51 ] 1 0.001% 99.962% ( 51, 76 ] 1 0.001% 99.963% ( 110, 170 ] 19 0.011% 99.974% ( 170, 250 ] 13 0.008% 99.982% ( 250, 380 ] 14 0.008% 99.990% ( 380, 580 ] 6 0.004% 99.993% ( 580, 870 ] 2 0.001% 99.995% ( 870, 1300 ] 6 0.004% 99.998% ( 1300, 1900 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 87926 Average: 2.2405 StdDev: 20.27 Min: 0 Median: 1.3519 Max: 3416 Percentiles: P50: 1.35 P75: 1.78 P99: 5.82 P99.9: 40.62 P99.99: 600.05 ------------------------------------------------------ [ 0, 1 ] 25835 29.383% 29.383% ###### ( 1, 2 ] 51514 58.588% 87.971% ############ ( 2, 3 ] 5495 6.250% 94.220% # ( 3, 4 ] 2681 3.049% 97.269% # ( 4, 6 ] 1671 1.900% 99.170% ( 6, 10 ] 516 0.587% 99.757% ( 10, 15 ] 101 0.115% 99.871% ( 15, 22 ] 10 0.011% 99.883% ( 22, 34 ] 3 0.003% 99.886% ( 34, 51 ] 31 0.035% 99.922% ( 51, 76 ] 21 0.024% 99.945% ( 76, 110 ] 4 0.005% 99.950% ( 110, 170 ] 9 0.010% 99.960% ( 170, 250 ] 13 0.015% 99.975% ( 250, 380 ] 7 0.008% 99.983% ( 380, 580 ] 6 0.007% 99.990% ( 580, 870 ] 3 0.003% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42899 Average: 3.8872 StdDev: 68.47 Min: 1 Median: 1.4657 Max: 4737 Percentiles: P50: 1.47 P75: 1.83 P99: 5.63 P99.9: 400.02 P99.99: 3783.14 ------------------------------------------------------ [ 0, 1 ] 7852 18.303% 18.303% #### ( 1, 2 ] 29201 68.069% 86.373% ############## ( 2, 3 ] 3897 9.084% 95.457% ## ( 3, 4 ] 961 2.240% 97.697% ( 4, 6 ] 685 1.597% 99.294% ( 6, 10 ] 210 0.490% 99.783% ( 10, 15 ] 35 0.082% 99.865% ( 15, 22 ] 2 0.005% 99.869% ( 22, 34 ] 1 0.002% 99.872% ( 34, 51 ] 1 0.002% 99.874% ( 110, 170 ] 1 0.002% 99.876% ( 170, 250 ] 2 0.005% 99.881% ( 250, 380 ] 7 0.016% 99.897% ( 380, 580 ] 11 0.026% 99.923% ( 580, 870 ] 11 0.026% 99.949% ( 1300, 1900 ] 2 0.005% 99.953% ( 1900, 2900 ] 11 0.026% 99.979% ( 2900, 4400 ] 8 0.019% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 315 Average: 134.5111 StdDev: 488.07 Min: 0 Median: 1.5219 Max: 2896 Percentiles: P50: 1.52 P75: 4.69 P99: 2657.69 P99.9: 2875.77 P99.99: 2896.00 ------------------------------------------------------ [ 0, 1 ] 98 31.111% 31.111% ###### ( 1, 2 ] 114 36.190% 67.302% ####### ( 2, 3 ] 18 5.714% 73.016% # ( 4, 6 ] 18 5.714% 78.730% # ( 6, 10 ] 37 11.746% 90.476% ## ( 10, 15 ] 4 1.270% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 1 0.317% 92.698% ( 580, 870 ] 2 0.635% 93.333% ( 870, 1300 ] 6 1.905% 95.238% ( 1300, 1900 ] 2 0.635% 95.873% ( 1900, 2900 ] 13 4.127% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.448 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.412 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-13:42:39 ... thread 0: (1000000,5000000) ops and (248247.0,312527.1) ops/second in (4.028246,15.998612) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/7 3.56 GB 226.6 3.2 0.0 3.2 7.9 4.7 0.0 1.7 125.0 309.9 26.21 24.57 80 0.328 3326K 3415 0.0 0.0 L1 9/9 1003.04 MB 0.0 1.3 1.0 0.3 1.3 1.0 0.2 1.3 231.2 230.4 5.72 5.56 2 2.860 1342K 4555 0.0 0.0 L2 1/0 49.64 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 253.2 253.0 1.37 1.31 2 0.687 353K 169 0.0 0.0 L3 17/0 900.46 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 226.0 226.1 0.83 0.77 1 0.828 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 136.5 136.5 1.24 0.86 1 1.236 171K 0 0.0 0.0 L5 1044/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/16 100.87 GB 0.0 5.2 1.5 3.7 9.9 6.2 0.2 2.1 149.9 286.8 35.37 33.07 86 0.411 5383K 8139 0.0 0.0 Int 0/0 0.00 KB 0.0 5.2 1.5 3.7 9.9 6.2 0.2 2.1 149.9 286.8 35.37 33.07 86 0.411 5383K 8139 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.2 1.5 3.7 5.2 1.5 0.0 0.0 245.8 245.4 21.57 20.66 18 1.198 5383K 8139 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 351.4 13.80 12.41 68 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.2 total, 16.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.91 GB write, 627.00 MB/s write, 5.18 GB read, 327.71 MB/s read, 35.4 seconds Interval compaction: 9.91 GB write, 634.01 MB/s write, 5.18 GB read, 331.38 MB/s read, 35.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 17, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1388586 Average: 2.1465 StdDev: 10.79 Min: 0 Median: 1.4434 Max: 4381 Percentiles: P50: 1.44 P75: 1.82 P99: 5.47 P99.9: 9.76 P99.99: 14.64 ------------------------------------------------------ [ 0, 1 ] 288798 20.798% 20.798% #### ( 1, 2 ] 914460 65.855% 86.653% ############# ( 2, 3 ] 106881 7.697% 94.351% ## ( 3, 4 ] 45519 3.278% 97.629% # ( 4, 6 ] 25935 1.868% 99.496% ( 6, 10 ] 5956 0.429% 99.925% ( 10, 15 ] 968 0.070% 99.995% ( 15, 22 ] 76 0.005% 100.001% ( 22, 34 ] 17 0.001% 100.002% ( 34, 51 ] 3 0.000% 100.002% ( 51, 76 ] 10 0.001% 100.003% ( 76, 110 ] 67 0.005% 100.007% ( 110, 170 ] 131 0.009% 100.017% ( 170, 250 ] 79 0.006% 100.023% ( 250, 380 ] 72 0.005% 100.028% ( 380, 580 ] 48 0.003% 100.031% ( 580, 870 ] 35 0.003% 100.034% ( 870, 1300 ] 18 0.001% 100.035% ( 1300, 1900 ] 7 0.001% 100.036% ( 1900, 2900 ] 7 0.001% 100.036% ( 2900, 4400 ] 3 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 264367 Average: 2.3072 StdDev: 10.80 Min: 1 Median: 1.4658 Max: 1687 Percentiles: P50: 1.47 P75: 1.84 P99: 6.07 P99.9: 20.62 P99.99: 515.33 ------------------------------------------------------ [ 0, 1 ] 49506 18.726% 18.726% #### ( 1, 2 ] 177511 67.146% 85.872% ############# ( 2, 3 ] 21435 8.108% 93.980% ## ( 3, 4 ] 8292 3.137% 97.117% # ( 4, 6 ] 4940 1.869% 98.985% ( 6, 10 ] 2250 0.851% 99.836% ( 10, 15 ] 159 0.060% 99.896% ( 15, 22 ] 12 0.005% 99.901% ( 22, 34 ] 3 0.001% 99.902% ( 34, 51 ] 1 0.000% 99.902% ( 51, 76 ] 3 0.001% 99.904% ( 76, 110 ] 51 0.019% 99.923% ( 110, 170 ] 106 0.040% 99.963% ( 170, 250 ] 28 0.011% 99.974% ( 250, 380 ] 28 0.011% 99.984% ( 380, 580 ] 23 0.009% 99.993% ( 580, 870 ] 9 0.003% 99.996% ( 870, 1300 ] 7 0.003% 99.999% ( 1300, 1900 ] 3 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 87926 Average: 2.2405 StdDev: 20.27 Min: 0 Median: 1.3519 Max: 3416 Percentiles: P50: 1.35 P75: 1.78 P99: 5.82 P99.9: 40.62 P99.99: 600.05 ------------------------------------------------------ [ 0, 1 ] 25835 29.383% 29.383% ###### ( 1, 2 ] 51514 58.588% 87.971% ############ ( 2, 3 ] 5495 6.250% 94.220% # ( 3, 4 ] 2681 3.049% 97.269% # ( 4, 6 ] 1671 1.900% 99.170% ( 6, 10 ] 516 0.587% 99.757% ( 10, 15 ] 101 0.115% 99.871% ( 15, 22 ] 10 0.011% 99.883% ( 22, 34 ] 3 0.003% 99.886% ( 34, 51 ] 31 0.035% 99.922% ( 51, 76 ] 21 0.024% 99.945% ( 76, 110 ] 4 0.005% 99.950% ( 110, 170 ] 9 0.010% 99.960% ( 170, 250 ] 13 0.015% 99.975% ( 250, 380 ] 7 0.008% 99.983% ( 380, 580 ] 6 0.007% 99.990% ( 580, 870 ] 3 0.003% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42899 Average: 3.8872 StdDev: 68.47 Min: 1 Median: 1.4657 Max: 4737 Percentiles: P50: 1.47 P75: 1.83 P99: 5.63 P99.9: 400.02 P99.99: 3783.14 ------------------------------------------------------ [ 0, 1 ] 7852 18.303% 18.303% #### ( 1, 2 ] 29201 68.069% 86.373% ############## ( 2, 3 ] 3897 9.084% 95.457% ## ( 3, 4 ] 961 2.240% 97.697% ( 4, 6 ] 685 1.597% 99.294% ( 6, 10 ] 210 0.490% 99.783% ( 10, 15 ] 35 0.082% 99.865% ( 15, 22 ] 2 0.005% 99.869% ( 22, 34 ] 1 0.002% 99.872% ( 34, 51 ] 1 0.002% 99.874% ( 110, 170 ] 1 0.002% 99.876% ( 170, 250 ] 2 0.005% 99.881% ( 250, 380 ] 7 0.016% 99.897% ( 380, 580 ] 11 0.026% 99.923% ( 580, 870 ] 11 0.026% 99.949% ( 1300, 1900 ] 2 0.005% 99.953% ( 1900, 2900 ] 11 0.026% 99.979% ( 2900, 4400 ] 8 0.019% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 315 Average: 134.5111 StdDev: 488.07 Min: 0 Median: 1.5219 Max: 2896 Percentiles: P50: 1.52 P75: 4.69 P99: 2657.69 P99.9: 2875.77 P99.99: 2896.00 ------------------------------------------------------ [ 0, 1 ] 98 31.111% 31.111% ###### ( 1, 2 ] 114 36.190% 67.302% ####### ( 2, 3 ] 18 5.714% 73.016% # ( 4, 6 ] 18 5.714% 78.730% # ( 6, 10 ] 37 11.746% 90.476% ## ( 10, 15 ] 4 1.270% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 1 0.317% 92.698% ( 580, 870 ] 2 0.635% 93.333% ( 870, 1300 ] 6 1.905% 95.238% ( 1300, 1900 ] 2 0.635% 95.873% ( 1900, 2900 ] 13 4.127% 100.000% # ** DB Stats ** Uptime(secs): 16.2 total, 4.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 304.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.760 H:M:S, 17.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 244.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.311 H:M:S, 32.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-13:42:44 ... thread 0: (1000000,6000000) ops and (203013.9,286746.8) ops/second in (4.925770,20.924382) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/4 3.13 GB 295.6 4.4 0.0 4.4 10.0 5.7 0.0 1.8 134.1 307.7 33.35 31.34 97 0.344 4540K 5655 0.0 0.0 L1 11/0 1.30 GB 133.5 3.6 2.3 1.3 3.6 2.3 0.2 1.5 228.1 226.4 16.27 15.74 3 5.422 3767K 26K 0.0 0.0 L2 1/0 49.64 MB 0.5 0.3 0.2 0.2 0.3 0.2 1.0 1.8 253.2 253.0 1.37 1.31 2 0.687 353K 169 0.0 0.0 L3 14/0 920.01 MB 0.9 0.2 0.2 0.0 0.2 0.2 1.0 1.0 226.0 226.1 0.83 0.77 1 0.828 190K 0 0.0 0.0 L4 172/0 9.70 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.9 1.0 153.7 153.6 2.01 1.51 2 1.005 313K 232 0.0 0.0 L5 1056/0 86.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/4 101.76 GB 0.0 8.8 3.0 5.8 14.4 8.6 4.0 2.6 167.7 274.7 53.83 50.67 105 0.513 9165K 32K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.8 3.0 5.8 14.4 8.6 4.0 2.6 167.7 274.7 53.83 50.67 105 0.513 9165K 32K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.8 3.0 5.8 8.8 3.0 0.0 0.0 241.6 240.7 37.36 35.89 23 1.624 9165K 32K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 351.8 16.47 14.78 82 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.1 total, 20.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.44 GB write, 700.72 MB/s write, 8.81 GB read, 427.69 MB/s read, 53.8 seconds Interval compaction: 14.44 GB write, 706.71 MB/s write, 8.81 GB read, 431.35 MB/s read, 53.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 19, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1850272 Average: 2.1161 StdDev: 9.91 Min: 0 Median: 1.4344 Max: 4381 Percentiles: P50: 1.43 P75: 1.81 P99: 5.45 P99.9: 9.71 P99.99: 14.64 ------------------------------------------------------ [ 0, 1 ] 396859 21.449% 21.449% #### ( 1, 2 ] 1216159 65.729% 87.177% ############# ( 2, 3 ] 135935 7.347% 94.524% # ( 3, 4 ] 58948 3.186% 97.710% # ( 4, 6 ] 32903 1.778% 99.488% ( 6, 10 ] 8206 0.444% 99.932% ( 10, 15 ] 1161 0.063% 99.995% ( 15, 22 ] 99 0.005% 100.000% ( 22, 34 ] 19 0.001% 100.001% ( 34, 51 ] 5 0.000% 100.001% ( 51, 76 ] 14 0.001% 100.002% ( 76, 110 ] 95 0.005% 100.007% ( 110, 170 ] 151 0.008% 100.015% ( 170, 250 ] 89 0.005% 100.020% ( 250, 380 ] 84 0.005% 100.025% ( 380, 580 ] 51 0.003% 100.027% ( 580, 870 ] 41 0.002% 100.030% ( 870, 1300 ] 21 0.001% 100.031% ( 1300, 1900 ] 10 0.001% 100.031% ( 1900, 2900 ] 8 0.000% 100.032% ( 2900, 4400 ] 3 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 367408 Average: 2.5048 StdDev: 13.79 Min: 1 Median: 1.4833 Max: 1687 Percentiles: P50: 1.48 P75: 1.86 P99: 7.23 P99.9: 133.01 P99.99: 682.04 ------------------------------------------------------ [ 0, 1 ] 65218 17.751% 17.751% #### ( 1, 2 ] 245150 66.724% 84.475% ############# ( 2, 3 ] 32061 8.726% 93.201% ## ( 3, 4 ] 12426 3.382% 96.583% # ( 4, 6 ] 7667 2.087% 98.670% ( 6, 10 ] 3932 1.070% 99.740% ( 10, 15 ] 336 0.091% 99.832% ( 15, 22 ] 45 0.012% 99.844% ( 22, 34 ] 9 0.002% 99.846% ( 34, 51 ] 1 0.000% 99.847% ( 51, 76 ] 3 0.001% 99.848% ( 76, 110 ] 104 0.028% 99.876% ( 110, 170 ] 231 0.063% 99.939% ( 170, 250 ] 63 0.017% 99.956% ( 250, 380 ] 56 0.015% 99.971% ( 380, 580 ] 58 0.016% 99.987% ( 580, 870 ] 32 0.009% 99.996% ( 870, 1300 ] 10 0.003% 99.998% ( 1300, 1900 ] 6 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 87926 Average: 2.2405 StdDev: 20.27 Min: 0 Median: 1.3519 Max: 3416 Percentiles: P50: 1.35 P75: 1.78 P99: 5.82 P99.9: 40.62 P99.99: 600.05 ------------------------------------------------------ [ 0, 1 ] 25835 29.383% 29.383% ###### ( 1, 2 ] 51514 58.588% 87.971% ############ ( 2, 3 ] 5495 6.250% 94.220% # ( 3, 4 ] 2681 3.049% 97.269% # ( 4, 6 ] 1671 1.900% 99.170% ( 6, 10 ] 516 0.587% 99.757% ( 10, 15 ] 101 0.115% 99.871% ( 15, 22 ] 10 0.011% 99.883% ( 22, 34 ] 3 0.003% 99.886% ( 34, 51 ] 31 0.035% 99.922% ( 51, 76 ] 21 0.024% 99.945% ( 76, 110 ] 4 0.005% 99.950% ( 110, 170 ] 9 0.010% 99.960% ( 170, 250 ] 13 0.015% 99.975% ( 250, 380 ] 7 0.008% 99.983% ( 380, 580 ] 6 0.007% 99.990% ( 580, 870 ] 3 0.003% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42899 Average: 3.8872 StdDev: 68.47 Min: 1 Median: 1.4657 Max: 4737 Percentiles: P50: 1.47 P75: 1.83 P99: 5.63 P99.9: 400.02 P99.99: 3783.14 ------------------------------------------------------ [ 0, 1 ] 7852 18.303% 18.303% #### ( 1, 2 ] 29201 68.069% 86.373% ############## ( 2, 3 ] 3897 9.084% 95.457% ## ( 3, 4 ] 961 2.240% 97.697% ( 4, 6 ] 685 1.597% 99.294% ( 6, 10 ] 210 0.490% 99.783% ( 10, 15 ] 35 0.082% 99.865% ( 15, 22 ] 2 0.005% 99.869% ( 22, 34 ] 1 0.002% 99.872% ( 34, 51 ] 1 0.002% 99.874% ( 110, 170 ] 1 0.002% 99.876% ( 170, 250 ] 2 0.005% 99.881% ( 250, 380 ] 7 0.016% 99.897% ( 380, 580 ] 11 0.026% 99.923% ( 580, 870 ] 11 0.026% 99.949% ( 1300, 1900 ] 2 0.005% 99.953% ( 1900, 2900 ] 11 0.026% 99.979% ( 2900, 4400 ] 8 0.019% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 3257 Average: 39.2782 StdDev: 186.04 Min: 0 Median: 1.6846 Max: 2896 Percentiles: P50: 1.68 P75: 2.62 P99: 802.70 P99.9: 2649.46 P99.99: 2874.95 ------------------------------------------------------ [ 0, 1 ] 440 13.509% 13.509% ### ( 1, 2 ] 1736 53.301% 66.810% ########### ( 2, 3 ] 427 13.110% 79.920% ### ( 3, 4 ] 163 5.005% 84.925% # ( 4, 6 ] 100 3.070% 87.995% # ( 6, 10 ] 85 2.610% 90.605% # ( 10, 15 ] 16 0.491% 91.096% ( 51, 76 ] 1 0.031% 91.127% ( 76, 110 ] 24 0.737% 91.864% ( 110, 170 ] 84 2.579% 94.443% # ( 170, 250 ] 48 1.474% 95.916% ( 250, 380 ] 31 0.952% 96.868% ( 380, 580 ] 51 1.566% 98.434% ( 580, 870 ] 24 0.737% 99.171% ( 870, 1300 ] 12 0.368% 99.539% ( 1300, 1900 ] 2 0.061% 99.601% ( 1900, 2900 ] 13 0.399% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 715.1500 StdDev: 902.84 Min: 80 Median: 190.0000 Max: 3665 Percentiles: P50: 190.00 P75: 1042.00 P99: 3665.00 P99.9: 3665.00 P99.99: 3665.00 ------------------------------------------------------ ( 76, 110 ] 15 25.000% 25.000% ##### ( 110, 170 ] 14 23.333% 48.333% ##### ( 170, 250 ] 4 6.667% 55.000% # ( 250, 380 ] 1 1.667% 56.667% ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 3 5.000% 71.667% # ( 870, 1300 ] 5 8.333% 80.000% ## ( 1300, 1900 ] 3 5.000% 85.000% # ( 1900, 2900 ] 7 11.667% 96.667% ## ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 21.1 total, 4.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 279.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.937 H:M:S, 23.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 199.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.177 H:M:S, 44.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-13:43:06 ... thread 0: (1000000,7000000) ops and (45280.6,162757.0) ops/second in (22.084514,43.008896) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 2/2 941.42 MB 0.0 6.3 0.0 6.3 12.8 6.6 0.0 2.0 148.3 303.6 43.33 40.94 116 0.374 6523K 9499 0.0 0.0 L1 7/7 846.76 MB 0.0 8.1 5.5 2.6 7.9 5.4 0.2 1.5 218.0 214.9 37.86 35.25 4 9.464 8380K 117K 0.0 0.0 L2 10/5 1.26 GB 6.4 0.3 0.2 0.2 0.3 0.2 4.5 1.8 253.2 253.0 1.37 1.31 2 0.687 353K 169 0.0 0.0 L3 33/9 3.21 GB 2.1 0.2 0.2 0.0 0.2 0.2 3.3 1.0 226.0 226.1 0.83 0.77 1 0.828 190K 0 0.0 0.0 L4 172/8 9.70 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.9 1.0 153.7 153.6 2.01 1.51 2 1.005 313K 232 0.0 0.0 L5 1056/0 86.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1280/31 102.59 GB 0.0 15.2 6.1 9.0 21.6 12.6 9.9 3.3 181.7 259.2 85.40 79.78 125 0.683 15M 127K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.2 6.1 9.0 21.6 12.6 9.9 3.3 181.7 259.2 85.40 79.78 125 0.683 15M 127K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.2 6.1 9.0 15.0 6.0 0.0 0.0 234.3 232.4 66.25 62.61 29 2.284 15M 127K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 351.9 19.15 17.17 96 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.2 total, 43.0 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.62 GB write, 512.50 MB/s write, 15.16 GB read, 359.38 MB/s read, 85.4 seconds Interval compaction: 21.62 GB write, 514.63 MB/s write, 15.16 GB read, 360.88 MB/s read, 85.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 21, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3104868 Average: 2.6034 StdDev: 20.13 Min: 0 Median: 1.4117 Max: 11730 Percentiles: P50: 1.41 P75: 1.80 P99: 5.93 P99.9: 140.67 P99.99: 290.45 ------------------------------------------------------ [ 0, 1 ] 721624 23.242% 23.242% ##### ( 1, 2 ] 2017966 64.994% 88.235% ############# ( 2, 3 ] 198211 6.384% 94.619% # ( 3, 4 ] 89516 2.883% 97.502% # ( 4, 6 ] 48207 1.553% 99.055% ( 6, 10 ] 16435 0.529% 99.584% ( 10, 15 ] 1982 0.064% 99.648% ( 15, 22 ] 389 0.013% 99.661% ( 22, 34 ] 30 0.001% 99.662% ( 34, 51 ] 12 0.000% 99.662% ( 51, 76 ] 73 0.002% 99.664% ( 76, 110 ] 5266 0.170% 99.834% ( 110, 170 ] 4014 0.129% 99.963% ( 170, 250 ] 662 0.021% 99.985% ( 250, 380 ] 548 0.018% 100.002% ( 380, 580 ] 501 0.016% 100.018% ( 580, 870 ] 178 0.006% 100.024% ( 870, 1300 ] 45 0.001% 100.025% ( 1300, 1900 ] 17 0.001% 100.026% ( 1900, 2900 ] 26 0.001% 100.027% ( 2900, 4400 ] 20 0.001% 100.028% ( 4400, 6600 ] 3 0.000% 100.028% ( 6600, 9900 ] 2 0.000% 100.028% ( 9900, 14000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 782032 Average: 3.5985 StdDev: 51.20 Min: 1 Median: 1.4167 Max: 8019 Percentiles: P50: 1.42 P75: 1.84 P99: 8.80 P99.9: 165.73 P99.99: 550.86 ------------------------------------------------------ [ 0, 1 ] 196666 25.148% 25.148% ##### ( 1, 2 ] 466432 59.644% 84.792% ############ ( 2, 3 ] 55663 7.118% 91.909% # ( 3, 4 ] 29141 3.726% 95.636% # ( 4, 6 ] 20219 2.585% 98.221% # ( 6, 10 ] 8704 1.113% 99.334% ( 10, 15 ] 1120 0.143% 99.477% ( 15, 22 ] 249 0.032% 99.509% ( 22, 34 ] 25 0.003% 99.512% ( 34, 51 ] 8 0.001% 99.513% ( 51, 76 ] 32 0.004% 99.518% ( 76, 110 ] 1517 0.194% 99.712% ( 110, 170 ] 1590 0.203% 99.915% ( 170, 250 ] 234 0.030% 99.945% ( 250, 380 ] 209 0.027% 99.971% ( 380, 580 ] 173 0.022% 99.994% ( 580, 870 ] 152 0.019% 100.013% ( 870, 1300 ] 71 0.009% 100.022% ( 1300, 1900 ] 40 0.005% 100.027% ( 1900, 2900 ] 35 0.004% 100.032% ( 2900, 4400 ] 51 0.007% 100.038% ( 4400, 6600 ] 21 0.003% 100.041% ( 6600, 9900 ] 4 0.001% 100.041% ** Level 2 read latency histogram (micros): Count: 87926 Average: 2.2405 StdDev: 20.27 Min: 0 Median: 1.3519 Max: 3416 Percentiles: P50: 1.35 P75: 1.78 P99: 5.82 P99.9: 40.62 P99.99: 600.05 ------------------------------------------------------ [ 0, 1 ] 25835 29.383% 29.383% ###### ( 1, 2 ] 51514 58.588% 87.971% ############ ( 2, 3 ] 5495 6.250% 94.220% # ( 3, 4 ] 2681 3.049% 97.269% # ( 4, 6 ] 1671 1.900% 99.170% ( 6, 10 ] 516 0.587% 99.757% ( 10, 15 ] 101 0.115% 99.871% ( 15, 22 ] 10 0.011% 99.883% ( 22, 34 ] 3 0.003% 99.886% ( 34, 51 ] 31 0.035% 99.922% ( 51, 76 ] 21 0.024% 99.945% ( 76, 110 ] 4 0.005% 99.950% ( 110, 170 ] 9 0.010% 99.960% ( 170, 250 ] 13 0.015% 99.975% ( 250, 380 ] 7 0.008% 99.983% ( 380, 580 ] 6 0.007% 99.990% ( 580, 870 ] 3 0.003% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42899 Average: 3.8872 StdDev: 68.47 Min: 1 Median: 1.4657 Max: 4737 Percentiles: P50: 1.47 P75: 1.83 P99: 5.63 P99.9: 400.02 P99.99: 3783.14 ------------------------------------------------------ [ 0, 1 ] 7852 18.303% 18.303% #### ( 1, 2 ] 29201 68.069% 86.373% ############## ( 2, 3 ] 3897 9.084% 95.457% ## ( 3, 4 ] 961 2.240% 97.697% ( 4, 6 ] 685 1.597% 99.294% ( 6, 10 ] 210 0.490% 99.783% ( 10, 15 ] 35 0.082% 99.865% ( 15, 22 ] 2 0.005% 99.869% ( 22, 34 ] 1 0.002% 99.872% ( 34, 51 ] 1 0.002% 99.874% ( 110, 170 ] 1 0.002% 99.876% ( 170, 250 ] 2 0.005% 99.881% ( 250, 380 ] 7 0.016% 99.897% ( 380, 580 ] 11 0.026% 99.923% ( 580, 870 ] 11 0.026% 99.949% ( 1300, 1900 ] 2 0.005% 99.953% ( 1900, 2900 ] 11 0.026% 99.979% ( 2900, 4400 ] 8 0.019% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 5164 Average: 73.5753 StdDev: 384.85 Min: 0 Median: 1.7903 Max: 8548 Percentiles: P50: 1.79 P75: 2.98 P99: 1362.77 P99.9: 5806.53 P99.99: 8548.00 ------------------------------------------------------ [ 0, 1 ] 509 9.857% 9.857% ## ( 1, 2 ] 2623 50.794% 60.651% ########## ( 2, 3 ] 755 14.620% 75.271% ### ( 3, 4 ] 367 7.107% 82.378% # ( 4, 6 ] 230 4.454% 86.832% # ( 6, 10 ] 115 2.227% 89.059% ( 10, 15 ] 29 0.562% 89.620% ( 51, 76 ] 1 0.019% 89.640% ( 76, 110 ] 24 0.465% 90.105% ( 110, 170 ] 90 1.743% 91.847% ( 170, 250 ] 82 1.588% 93.435% ( 250, 380 ] 63 1.220% 94.655% ( 380, 580 ] 103 1.995% 96.650% ( 580, 870 ] 76 1.472% 98.122% ( 870, 1300 ] 44 0.852% 98.974% ( 1300, 1900 ] 13 0.252% 99.225% ( 1900, 2900 ] 19 0.368% 99.593% ( 2900, 4400 ] 12 0.232% 99.826% ( 4400, 6600 ] 6 0.116% 99.942% ( 6600, 9900 ] 4 0.077% 100.019% ** Level 5 read latency histogram (micros): Count: 60 Average: 715.1500 StdDev: 902.84 Min: 80 Median: 190.0000 Max: 3665 Percentiles: P50: 190.00 P75: 1042.00 P99: 3665.00 P99.9: 3665.00 P99.99: 3665.00 ------------------------------------------------------ ( 76, 110 ] 15 25.000% 25.000% ##### ( 110, 170 ] 14 23.333% 48.333% ##### ( 170, 250 ] 4 6.667% 55.000% # ( 250, 380 ] 1 1.667% 56.667% ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 3 5.000% 71.667% # ( 870, 1300 ] 5 8.333% 80.000% ## ( 1300, 1900 ] 3 5.000% 85.000% # ( 1900, 2900 ] 7 11.667% 96.667% ## ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 43.2 total, 22.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 159.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.455 H:M:S, 54.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 44.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:18.519 H:M:S, 83.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/15-13:43:13 ... thread 0: (1000000,8000000) ops and (144338.4,160201.7) ops/second in (6.928162,49.937058) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/6 1.90 GB 62.9 6.6 0.0 6.6 14.2 7.6 0.0 1.9 130.0 277.9 52.32 45.24 128 0.409 6906K 10K 0.0 0.0 L1 7/7 846.76 MB 0.0 8.1 5.5 2.6 7.9 5.4 0.2 1.5 218.0 214.9 37.86 35.25 4 9.464 8380K 117K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.5 1.8 253.2 253.0 1.37 1.31 2 0.687 353K 169 0.0 0.0 L3 16/0 975.34 MB 1.0 2.8 1.4 1.4 2.8 1.4 3.3 1.9 128.4 127.2 22.54 13.28 11 2.049 2938K 26K 0.0 0.0 L4 165/0 9.56 GB 1.0 4.2 3.8 0.4 4.2 3.8 0.9 1.1 123.8 123.6 34.65 20.19 39 0.888 4268K 3932 0.0 0.0 L5 1100/0 90.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/13 103.55 GB 0.0 22.1 10.9 11.2 29.5 18.3 13.5 3.9 151.9 202.9 148.73 115.27 184 0.808 22M 157K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.1 10.9 11.2 29.5 18.3 13.5 3.9 151.9 202.9 148.73 115.27 184 0.808 22M 157K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.1 10.9 11.2 21.9 10.7 0.0 0.0 183.7 182.4 122.92 95.34 77 1.596 22M 157K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 300.2 25.81 19.93 107 0.241 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.1 total, 49.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.47 GB write, 602.05 MB/s write, 22.06 GB read, 450.67 MB/s read, 148.7 seconds Interval compaction: 29.47 GB write, 604.20 MB/s write, 22.06 GB read, 452.29 MB/s read, 148.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 68, interval: 88 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3479001 Average: 3.0883 StdDev: 41.65 Min: 0 Median: 1.4515 Max: 11730 Percentiles: P50: 1.45 P75: 1.84 P99: 6.90 P99.9: 146.85 P99.99: 471.26 ------------------------------------------------------ [ 0, 1 ] 739309 21.251% 21.251% #### ( 1, 2 ] 2215322 63.677% 84.928% ############# ( 2, 3 ] 268099 7.706% 92.634% ## ( 3, 4 ] 127404 3.662% 96.296% # ( 4, 6 ] 88551 2.545% 98.841% # ( 6, 10 ] 24599 0.707% 99.548% ( 10, 15 ] 3758 0.108% 99.656% ( 15, 22 ] 590 0.017% 99.673% ( 22, 34 ] 44 0.001% 99.674% ( 34, 51 ] 22 0.001% 99.675% ( 51, 76 ] 78 0.002% 99.677% ( 76, 110 ] 5272 0.152% 99.829% ( 110, 170 ] 4032 0.116% 99.945% ( 170, 250 ] 700 0.020% 99.965% ( 250, 380 ] 610 0.018% 99.982% ( 380, 580 ] 581 0.017% 99.999% ( 580, 870 ] 303 0.009% 100.008% ( 870, 1300 ] 182 0.005% 100.013% ( 1300, 1900 ] 119 0.003% 100.016% ( 1900, 2900 ] 169 0.005% 100.021% ( 2900, 4400 ] 168 0.005% 100.026% ( 4400, 6600 ] 35 0.001% 100.027% ( 6600, 9900 ] 13 0.000% 100.028% ( 9900, 14000 ] 2 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1681171 Average: 5.5401 StdDev: 86.97 Min: 1 Median: 1.6587 Max: 12048 Percentiles: P50: 1.66 P75: 2.44 P99: 9.32 P99.9: 142.29 P99.99: 366.11 ------------------------------------------------------ [ 0, 1 ] 225735 13.427% 13.427% ### ( 1, 2 ] 933436 55.523% 68.950% ########### ( 2, 3 ] 233718 13.902% 82.852% ### ( 3, 4 ] 124904 7.430% 90.282% # ( 4, 6 ] 119659 7.118% 97.399% # ( 6, 10 ] 32414 1.928% 99.328% ( 10, 15 ] 6194 0.368% 99.696% ( 15, 22 ] 860 0.051% 99.747% ( 22, 34 ] 70 0.004% 99.751% ( 34, 51 ] 38 0.002% 99.754% ( 51, 76 ] 36 0.002% 99.756% ( 76, 110 ] 1541 0.092% 99.847% ( 110, 170 ] 1644 0.098% 99.945% ( 170, 250 ] 360 0.021% 99.967% ( 250, 380 ] 441 0.026% 99.993% ( 380, 580 ] 545 0.032% 100.025% ( 580, 870 ] 590 0.035% 100.060% ( 870, 1300 ] 447 0.027% 100.087% ( 1300, 1900 ] 310 0.018% 100.105% ( 1900, 2900 ] 314 0.019% 100.124% ( 2900, 4400 ] 407 0.024% 100.148% ( 4400, 6600 ] 89 0.005% 100.154% ( 6600, 9900 ] 22 0.001% 100.155% ( 9900, 14000 ] 2 0.000% 100.155% ** Level 2 read latency histogram (micros): Count: 87926 Average: 2.2405 StdDev: 20.27 Min: 0 Median: 1.3519 Max: 3416 Percentiles: P50: 1.35 P75: 1.78 P99: 5.82 P99.9: 40.62 P99.99: 600.05 ------------------------------------------------------ [ 0, 1 ] 25835 29.383% 29.383% ###### ( 1, 2 ] 51514 58.588% 87.971% ############ ( 2, 3 ] 5495 6.250% 94.220% # ( 3, 4 ] 2681 3.049% 97.269% # ( 4, 6 ] 1671 1.900% 99.170% ( 6, 10 ] 516 0.587% 99.757% ( 10, 15 ] 101 0.115% 99.871% ( 15, 22 ] 10 0.011% 99.883% ( 22, 34 ] 3 0.003% 99.886% ( 34, 51 ] 31 0.035% 99.922% ( 51, 76 ] 21 0.024% 99.945% ( 76, 110 ] 4 0.005% 99.950% ( 110, 170 ] 9 0.010% 99.960% ( 170, 250 ] 13 0.015% 99.975% ( 250, 380 ] 7 0.008% 99.983% ( 380, 580 ] 6 0.007% 99.990% ( 580, 870 ] 3 0.003% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 685044 Average: 5.4161 StdDev: 87.99 Min: 1 Median: 1.8977 Max: 11866 Percentiles: P50: 1.90 P75: 2.96 P99: 8.45 P99.9: 13.62 P99.99: 14.99 ------------------------------------------------------ [ 0, 1 ] 21735 3.173% 3.173% # ( 1, 2 ] 357344 52.164% 55.336% ########## ( 2, 3 ] 140192 20.465% 75.801% #### ( 3, 4 ] 75756 11.059% 86.860% ## ( 4, 6 ] 76031 11.099% 97.958% ## ( 6, 10 ] 11669 1.703% 99.662% ( 10, 15 ] 2255 0.329% 99.991% ( 15, 22 ] 262 0.038% 100.029% ( 22, 34 ] 22 0.003% 100.032% ( 34, 51 ] 14 0.002% 100.034% ( 51, 76 ] 3 0.000% 100.035% ( 76, 110 ] 4 0.001% 100.035% ( 110, 170 ] 15 0.002% 100.038% ( 170, 250 ] 40 0.006% 100.044% ( 250, 380 ] 80 0.012% 100.055% ( 380, 580 ] 126 0.018% 100.074% ( 580, 870 ] 153 0.022% 100.096% ( 870, 1300 ] 126 0.018% 100.114% ( 1300, 1900 ] 104 0.015% 100.129% ( 1900, 2900 ] 136 0.020% 100.149% ( 2900, 4400 ] 171 0.025% 100.174% ( 4400, 6600 ] 43 0.006% 100.181% ( 6600, 9900 ] 6 0.001% 100.181% ( 9900, 14000 ] 2 0.000% 100.182% ** Level 4 read latency histogram (micros): Count: 108544 Average: 48.4996 StdDev: 336.24 Min: 0 Median: 1.9258 Max: 8780 Percentiles: P50: 1.93 P75: 3.11 P99: 1494.41 P99.9: 4357.35 P99.99: 6276.44 ------------------------------------------------------ [ 0, 1 ] 3654 3.366% 3.366% # ( 1, 2 ] 54677 50.373% 53.739% ########## ( 2, 3 ] 21792 20.077% 73.816% #### ( 3, 4 ] 11739 10.815% 84.631% ## ( 4, 6 ] 9864 9.088% 93.719% ## ( 6, 10 ] 2339 2.155% 95.874% ( 10, 15 ] 557 0.513% 96.387% ( 15, 22 ] 71 0.065% 96.452% ( 22, 34 ] 13 0.012% 96.464% ( 34, 51 ] 5 0.005% 96.469% ( 51, 76 ] 7 0.006% 96.475% ( 76, 110 ] 51 0.047% 96.522% ( 110, 170 ] 167 0.154% 96.676% ( 170, 250 ] 283 0.261% 96.937% ( 250, 380 ] 313 0.288% 97.225% ( 380, 580 ] 579 0.533% 97.759% ( 580, 870 ] 659 0.607% 98.366% ( 870, 1300 ] 569 0.524% 98.890% ( 1300, 1900 ] 369 0.340% 99.230% ( 1900, 2900 ] 333 0.307% 99.537% ( 2900, 4400 ] 406 0.374% 99.911% ( 4400, 6600 ] 101 0.093% 100.004% ( 6600, 9900 ] 13 0.012% 100.016% ** Level 5 read latency histogram (micros): Count: 280 Average: 1536.8643 StdDev: 1551.94 Min: 80 Median: 885.9259 Max: 9205 Percentiles: P50: 885.93 P75: 2555.17 P99: 6317.14 P99.9: 8976.00 P99.99: 9205.00 ------------------------------------------------------ ( 76, 110 ] 24 8.571% 8.571% ## ( 110, 170 ] 26 9.286% 17.857% ## ( 170, 250 ] 16 5.714% 23.571% # ( 250, 380 ] 13 4.643% 28.214% # ( 380, 580 ] 28 10.000% 38.214% ## ( 580, 870 ] 32 11.429% 49.643% ## ( 870, 1300 ] 27 9.643% 59.286% ## ( 1300, 1900 ] 25 8.929% 68.214% ## ( 1900, 2900 ] 29 10.357% 78.571% ## ( 2900, 4400 ] 45 16.071% 94.643% ### ( 4400, 6600 ] 14 5.000% 99.643% # ( 6600, 9900 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 50.1 total, 6.9 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 157.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.365 H:M:S, 54.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 142.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.909 H:M:S, 56.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-13:43:16 ... thread 0: (1000000,9000000) ops and (322585.5,169692.8) ops/second in (3.099953,53.037011) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/6 2.89 GB 169.9 7.8 0.0 7.8 16.4 8.5 0.0 1.9 133.1 278.7 60.08 52.47 146 0.411 8122K 11K 0.0 0.0 L1 7/7 846.76 MB 0.0 8.1 5.5 2.6 7.9 5.4 0.2 1.5 218.0 214.9 37.86 35.25 4 9.464 8380K 117K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.5 1.8 253.2 253.0 1.37 1.31 2 0.687 353K 169 0.0 0.0 L3 16/0 975.34 MB 1.0 2.8 1.4 1.4 2.8 1.4 3.3 1.9 128.4 127.2 22.54 13.28 11 2.049 2938K 26K 0.0 0.0 L4 165/0 9.56 GB 1.0 4.2 3.8 0.4 4.2 3.8 0.9 1.1 123.8 123.6 34.65 20.19 39 0.888 4268K 3932 0.0 0.0 L5 1100/0 90.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1300/13 104.53 GB 0.0 23.2 10.9 12.4 31.6 19.3 13.5 3.7 152.0 206.9 156.49 122.50 202 0.775 24M 159K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.2 10.9 12.4 31.6 19.3 13.5 3.7 152.0 206.9 156.49 122.50 202 0.775 24M 159K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.2 10.9 12.4 23.1 10.7 0.0 0.0 186.2 184.9 127.73 99.96 81 1.577 24M 159K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 304.5 28.76 22.54 121 0.238 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.2 total, 53.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.62 GB write, 608.38 MB/s write, 23.23 GB read, 446.91 MB/s read, 156.5 seconds Interval compaction: 31.62 GB write, 610.43 MB/s write, 23.23 GB read, 448.42 MB/s read, 156.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 71, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 71, interval: 91 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3732050 Average: 3.0279 StdDev: 40.33 Min: 0 Median: 1.4539 Max: 11730 Percentiles: P50: 1.45 P75: 1.84 P99: 6.68 P99.9: 142.41 P99.99: 441.81 ------------------------------------------------------ [ 0, 1 ] 782691 20.972% 20.972% #### ( 1, 2 ] 2386485 63.946% 84.918% ############# ( 2, 3 ] 289686 7.762% 92.680% ## ( 3, 4 ] 137238 3.677% 96.357% # ( 4, 6 ] 94232 2.525% 98.882% # ( 6, 10 ] 25867 0.693% 99.575% ( 10, 15 ] 3910 0.105% 99.680% ( 15, 22 ] 610 0.016% 99.696% ( 22, 34 ] 45 0.001% 99.698% ( 34, 51 ] 23 0.001% 99.698% ( 51, 76 ] 79 0.002% 99.700% ( 76, 110 ] 5272 0.141% 99.842% ( 110, 170 ] 4037 0.108% 99.950% ( 170, 250 ] 705 0.019% 99.969% ( 250, 380 ] 617 0.017% 99.985% ( 380, 580 ] 585 0.016% 100.001% ( 580, 870 ] 308 0.008% 100.009% ( 870, 1300 ] 189 0.005% 100.014% ( 1300, 1900 ] 121 0.003% 100.017% ( 1900, 2900 ] 169 0.005% 100.022% ( 2900, 4400 ] 169 0.005% 100.026% ( 4400, 6600 ] 35 0.001% 100.027% ( 6600, 9900 ] 13 0.000% 100.028% ( 9900, 14000 ] 2 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1833704 Average: 5.2987 StdDev: 83.37 Min: 1 Median: 1.6447 Max: 12048 Percentiles: P50: 1.64 P75: 2.36 P99: 9.26 P99.9: 142.01 P99.99: 372.12 ------------------------------------------------------ [ 0, 1 ] 246644 13.451% 13.451% ### ( 1, 2 ] 1039513 56.689% 70.140% ########### ( 2, 3 ] 247626 13.504% 83.644% ### ( 3, 4 ] 130129 7.097% 90.740% # ( 4, 6 ] 122931 6.704% 97.444% # ( 6, 10 ] 34976 1.907% 99.352% ( 10, 15 ] 6417 0.350% 99.702% ( 15, 22 ] 874 0.048% 99.749% ( 22, 34 ] 70 0.004% 99.753% ( 34, 51 ] 38 0.002% 99.755% ( 51, 76 ] 40 0.002% 99.758% ( 76, 110 ] 1685 0.092% 99.849% ( 110, 170 ] 1738 0.095% 99.944% ( 170, 250 ] 400 0.022% 99.966% ( 250, 380 ] 468 0.026% 99.992% ( 380, 580 ] 566 0.031% 100.022% ( 580, 870 ] 600 0.033% 100.055% ( 870, 1300 ] 449 0.024% 100.080% ( 1300, 1900 ] 310 0.017% 100.097% ( 1900, 2900 ] 314 0.017% 100.114% ( 2900, 4400 ] 408 0.022% 100.136% ( 4400, 6600 ] 89 0.005% 100.141% ( 6600, 9900 ] 22 0.001% 100.142% ( 9900, 14000 ] 2 0.000% 100.142% ** Level 2 read latency histogram (micros): Count: 87926 Average: 2.2405 StdDev: 20.27 Min: 0 Median: 1.3519 Max: 3416 Percentiles: P50: 1.35 P75: 1.78 P99: 5.82 P99.9: 40.62 P99.99: 600.05 ------------------------------------------------------ [ 0, 1 ] 25835 29.383% 29.383% ###### ( 1, 2 ] 51514 58.588% 87.971% ############ ( 2, 3 ] 5495 6.250% 94.220% # ( 3, 4 ] 2681 3.049% 97.269% # ( 4, 6 ] 1671 1.900% 99.170% ( 6, 10 ] 516 0.587% 99.757% ( 10, 15 ] 101 0.115% 99.871% ( 15, 22 ] 10 0.011% 99.883% ( 22, 34 ] 3 0.003% 99.886% ( 34, 51 ] 31 0.035% 99.922% ( 51, 76 ] 21 0.024% 99.945% ( 76, 110 ] 4 0.005% 99.950% ( 110, 170 ] 9 0.010% 99.960% ( 170, 250 ] 13 0.015% 99.975% ( 250, 380 ] 7 0.008% 99.983% ( 380, 580 ] 6 0.007% 99.990% ( 580, 870 ] 3 0.003% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 685044 Average: 5.4161 StdDev: 87.99 Min: 1 Median: 1.8977 Max: 11866 Percentiles: P50: 1.90 P75: 2.96 P99: 8.45 P99.9: 13.62 P99.99: 14.99 ------------------------------------------------------ [ 0, 1 ] 21735 3.173% 3.173% # ( 1, 2 ] 357344 52.164% 55.336% ########## ( 2, 3 ] 140192 20.465% 75.801% #### ( 3, 4 ] 75756 11.059% 86.860% ## ( 4, 6 ] 76031 11.099% 97.958% ## ( 6, 10 ] 11669 1.703% 99.662% ( 10, 15 ] 2255 0.329% 99.991% ( 15, 22 ] 262 0.038% 100.029% ( 22, 34 ] 22 0.003% 100.032% ( 34, 51 ] 14 0.002% 100.034% ( 51, 76 ] 3 0.000% 100.035% ( 76, 110 ] 4 0.001% 100.035% ( 110, 170 ] 15 0.002% 100.038% ( 170, 250 ] 40 0.006% 100.044% ( 250, 380 ] 80 0.012% 100.055% ( 380, 580 ] 126 0.018% 100.074% ( 580, 870 ] 153 0.022% 100.096% ( 870, 1300 ] 126 0.018% 100.114% ( 1300, 1900 ] 104 0.015% 100.129% ( 1900, 2900 ] 136 0.020% 100.149% ( 2900, 4400 ] 171 0.025% 100.174% ( 4400, 6600 ] 43 0.006% 100.181% ( 6600, 9900 ] 6 0.001% 100.181% ( 9900, 14000 ] 2 0.000% 100.182% ** Level 4 read latency histogram (micros): Count: 108544 Average: 48.4996 StdDev: 336.24 Min: 0 Median: 1.9258 Max: 8780 Percentiles: P50: 1.93 P75: 3.11 P99: 1494.41 P99.9: 4357.35 P99.99: 6276.44 ------------------------------------------------------ [ 0, 1 ] 3654 3.366% 3.366% # ( 1, 2 ] 54677 50.373% 53.739% ########## ( 2, 3 ] 21792 20.077% 73.816% #### ( 3, 4 ] 11739 10.815% 84.631% ## ( 4, 6 ] 9864 9.088% 93.719% ## ( 6, 10 ] 2339 2.155% 95.874% ( 10, 15 ] 557 0.513% 96.387% ( 15, 22 ] 71 0.065% 96.452% ( 22, 34 ] 13 0.012% 96.464% ( 34, 51 ] 5 0.005% 96.469% ( 51, 76 ] 7 0.006% 96.475% ( 76, 110 ] 51 0.047% 96.522% ( 110, 170 ] 167 0.154% 96.676% ( 170, 250 ] 283 0.261% 96.937% ( 250, 380 ] 313 0.288% 97.225% ( 380, 580 ] 579 0.533% 97.759% ( 580, 870 ] 659 0.607% 98.366% ( 870, 1300 ] 569 0.524% 98.890% ( 1300, 1900 ] 369 0.340% 99.230% ( 1900, 2900 ] 333 0.307% 99.537% ( 2900, 4400 ] 406 0.374% 99.911% ( 4400, 6600 ] 101 0.093% 100.004% ( 6600, 9900 ] 13 0.012% 100.016% ** Level 5 read latency histogram (micros): Count: 280 Average: 1536.8643 StdDev: 1551.94 Min: 80 Median: 885.9259 Max: 9205 Percentiles: P50: 885.93 P75: 2555.17 P99: 6317.14 P99.9: 8976.00 P99.99: 9205.00 ------------------------------------------------------ ( 76, 110 ] 24 8.571% 8.571% ## ( 110, 170 ] 26 9.286% 17.857% ## ( 170, 250 ] 16 5.714% 23.571% # ( 250, 380 ] 13 4.643% 28.214% # ( 380, 580 ] 28 10.000% 38.214% ## ( 580, 870 ] 32 11.429% 49.643% ## ( 870, 1300 ] 27 9.643% 59.286% ## ( 1300, 1900 ] 25 8.929% 68.214% ## ( 1900, 2900 ] 29 10.357% 78.571% ## ( 2900, 4400 ] 45 16.071% 94.643% ### ( 4400, 6600 ] 14 5.000% 99.643% # ( 6600, 9900 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 53.2 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 166.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.820 H:M:S, 52.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.455 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-13:43:19 ... thread 0: (1000000,10000000) ops and (325508.0,178224.1) ops/second in (3.072121,56.109132) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.89 GB 12.6 8.7 0.0 8.7 18.1 9.5 0.0 1.9 134.1 280.3 66.25 58.25 162 0.409 9017K 12K 0.0 0.0 L1 17/17 1.48 GB 0.0 9.8 6.4 3.4 9.7 6.3 0.2 1.5 205.8 203.2 48.79 43.17 5 9.758 9336K 117K 0.0 0.0 L2 1/0 77.09 MB 0.8 0.3 0.2 0.2 0.3 0.2 4.8 1.8 253.2 253.0 1.37 1.31 2 0.687 353K 169 0.0 0.0 L3 16/0 905.13 MB 0.9 3.0 1.6 1.5 3.0 1.6 3.4 1.9 131.8 130.7 23.67 14.32 13 1.821 3168K 26K 0.0 0.0 L4 164/0 9.44 GB 1.0 4.6 4.0 0.6 4.6 4.0 0.9 1.1 128.2 128.0 36.65 21.99 41 0.894 4677K 3932 0.0 0.0 L5 1104/0 90.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1316/29 105.44 GB 0.0 26.5 12.2 14.3 35.8 21.5 14.2 3.8 153.3 207.2 176.74 139.05 223 0.793 26M 161K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.5 12.2 14.3 35.8 21.5 14.2 3.8 153.3 207.2 176.74 139.05 223 0.793 26M 161K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.5 12.2 14.3 26.3 12.0 0.0 0.0 186.5 185.3 145.25 114.10 89 1.632 26M 161K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 308.1 31.49 24.95 134 0.235 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.3 total, 56.1 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.76 GB write, 650.49 MB/s write, 26.45 GB read, 481.24 MB/s read, 176.7 seconds Interval compaction: 35.76 GB write, 652.56 MB/s write, 26.45 GB read, 482.78 MB/s read, 176.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 76, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 76, interval: 96 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3975808 Average: 2.9869 StdDev: 39.25 Min: 0 Median: 1.4562 Max: 11730 Percentiles: P50: 1.46 P75: 1.85 P99: 6.52 P99.9: 139.59 P99.99: 427.52 ------------------------------------------------------ [ 0, 1 ] 828445 20.837% 20.837% #### ( 1, 2 ] 2541540 63.925% 84.762% ############# ( 2, 3 ] 311783 7.842% 92.604% ## ( 3, 4 ] 148303 3.730% 96.334% # ( 4, 6 ] 102474 2.577% 98.912% # ( 6, 10 ] 27122 0.682% 99.594% ( 10, 15 ] 4000 0.101% 99.695% ( 15, 22 ] 622 0.016% 99.710% ( 22, 34 ] 48 0.001% 99.711% ( 34, 51 ] 25 0.001% 99.712% ( 51, 76 ] 83 0.002% 99.714% ( 76, 110 ] 5355 0.135% 99.849% ( 110, 170 ] 4123 0.104% 99.953% ( 170, 250 ] 723 0.018% 99.971% ( 250, 380 ] 625 0.016% 99.986% ( 380, 580 ] 591 0.015% 100.001% ( 580, 870 ] 320 0.008% 100.009% ( 870, 1300 ] 196 0.005% 100.014% ( 1300, 1900 ] 121 0.003% 100.017% ( 1900, 2900 ] 169 0.004% 100.022% ( 2900, 4400 ] 172 0.004% 100.026% ( 4400, 6600 ] 35 0.001% 100.027% ( 6600, 9900 ] 13 0.000% 100.027% ( 9900, 14000 ] 2 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1968341 Average: 5.1653 StdDev: 80.72 Min: 0 Median: 1.6477 Max: 12048 Percentiles: P50: 1.65 P75: 2.35 P99: 9.26 P99.9: 143.77 P99.99: 376.43 ------------------------------------------------------ [ 0, 1 ] 254196 12.914% 12.914% ### ( 1, 2 ] 1127003 57.256% 70.171% ########### ( 2, 3 ] 268563 13.644% 83.815% ### ( 3, 4 ] 138231 7.023% 90.838% # ( 4, 6 ] 130040 6.607% 97.444% # ( 6, 10 ] 37523 1.906% 99.350% ( 10, 15 ] 6913 0.351% 99.702% ( 15, 22 ] 902 0.046% 99.748% ( 22, 34 ] 76 0.004% 99.751% ( 34, 51 ] 38 0.002% 99.753% ( 51, 76 ] 46 0.002% 99.756% ( 76, 110 ] 1779 0.090% 99.846% ( 110, 170 ] 1888 0.096% 99.942% ( 170, 250 ] 456 0.023% 99.965% ( 250, 380 ] 504 0.026% 99.991% ( 380, 580 ] 603 0.031% 100.021% ( 580, 870 ] 615 0.031% 100.053% ( 870, 1300 ] 458 0.023% 100.076% ( 1300, 1900 ] 317 0.016% 100.092% ( 1900, 2900 ] 315 0.016% 100.108% ( 2900, 4400 ] 410 0.021% 100.129% ( 4400, 6600 ] 89 0.005% 100.133% ( 6600, 9900 ] 22 0.001% 100.134% ( 9900, 14000 ] 2 0.000% 100.135% ** Level 2 read latency histogram (micros): Count: 87926 Average: 2.2405 StdDev: 20.27 Min: 0 Median: 1.3519 Max: 3416 Percentiles: P50: 1.35 P75: 1.78 P99: 5.82 P99.9: 40.62 P99.99: 600.05 ------------------------------------------------------ [ 0, 1 ] 25835 29.383% 29.383% ###### ( 1, 2 ] 51514 58.588% 87.971% ############ ( 2, 3 ] 5495 6.250% 94.220% # ( 3, 4 ] 2681 3.049% 97.269% # ( 4, 6 ] 1671 1.900% 99.170% ( 6, 10 ] 516 0.587% 99.757% ( 10, 15 ] 101 0.115% 99.871% ( 15, 22 ] 10 0.011% 99.883% ( 22, 34 ] 3 0.003% 99.886% ( 34, 51 ] 31 0.035% 99.922% ( 51, 76 ] 21 0.024% 99.945% ( 76, 110 ] 4 0.005% 99.950% ( 110, 170 ] 9 0.010% 99.960% ( 170, 250 ] 13 0.015% 99.975% ( 250, 380 ] 7 0.008% 99.983% ( 380, 580 ] 6 0.007% 99.990% ( 580, 870 ] 3 0.003% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 703942 Average: 5.3543 StdDev: 86.84 Min: 1 Median: 1.8884 Max: 11866 Percentiles: P50: 1.89 P75: 2.94 P99: 8.45 P99.9: 13.76 P99.99: 16.71 ------------------------------------------------------ [ 0, 1 ] 23131 3.286% 3.286% # ( 1, 2 ] 370156 52.583% 55.869% ########### ( 2, 3 ] 142829 20.290% 76.159% #### ( 3, 4 ] 76692 10.895% 87.054% ## ( 4, 6 ] 76798 10.910% 97.963% ## ( 6, 10 ] 11906 1.691% 99.655% ( 10, 15 ] 2295 0.326% 99.981% ( 15, 22 ] 265 0.038% 100.018% ( 22, 34 ] 22 0.003% 100.022% ( 34, 51 ] 14 0.002% 100.024% ( 51, 76 ] 3 0.000% 100.024% ( 76, 110 ] 22 0.003% 100.027% ( 110, 170 ] 43 0.006% 100.033% ( 170, 250 ] 50 0.007% 100.040% ( 250, 380 ] 89 0.013% 100.053% ( 380, 580 ] 132 0.019% 100.072% ( 580, 870 ] 154 0.022% 100.094% ( 870, 1300 ] 126 0.018% 100.112% ( 1300, 1900 ] 104 0.015% 100.126% ( 1900, 2900 ] 136 0.019% 100.146% ( 2900, 4400 ] 171 0.024% 100.170% ( 4400, 6600 ] 43 0.006% 100.176% ( 6600, 9900 ] 6 0.001% 100.177% ( 9900, 14000 ] 2 0.000% 100.177% ** Level 4 read latency histogram (micros): Count: 146802 Average: 37.2740 StdDev: 290.42 Min: 0 Median: 1.8356 Max: 8780 Percentiles: P50: 1.84 P75: 2.86 P99: 1102.10 P99.9: 4193.83 P99.99: 6062.41 ------------------------------------------------------ [ 0, 1 ] 6084 4.144% 4.144% # ( 1, 2 ] 80561 54.877% 59.022% ########### ( 2, 3 ] 27218 18.541% 77.562% #### ( 3, 4 ] 13666 9.309% 86.871% ## ( 4, 6 ] 11270 7.677% 94.548% ## ( 6, 10 ] 2998 2.042% 96.591% ( 10, 15 ] 679 0.463% 97.053% ( 15, 22 ] 78 0.053% 97.106% ( 22, 34 ] 18 0.012% 97.119% ( 34, 51 ] 5 0.003% 97.122% ( 51, 76 ] 7 0.005% 97.127% ( 76, 110 ] 103 0.070% 97.197% ( 110, 170 ] 292 0.199% 97.396% ( 170, 250 ] 358 0.244% 97.640% ( 250, 380 ] 363 0.247% 97.887% ( 380, 580 ] 632 0.431% 98.317% ( 580, 870 ] 690 0.470% 98.787% ( 870, 1300 ] 578 0.394% 99.181% ( 1300, 1900 ] 371 0.253% 99.434% ( 1900, 2900 ] 334 0.228% 99.661% ( 2900, 4400 ] 406 0.277% 99.938% ( 4400, 6600 ] 101 0.069% 100.007% ( 6600, 9900 ] 13 0.009% 100.016% ** Level 5 read latency histogram (micros): Count: 300 Average: 1492.8700 StdDev: 1535.59 Min: 79 Median: 843.6364 Max: 9205 Percentiles: P50: 843.64 P75: 2480.65 P99: 6285.71 P99.9: 8910.00 P99.99: 9205.00 ------------------------------------------------------ ( 76, 110 ] 29 9.667% 9.667% ## ( 110, 170 ] 31 10.333% 20.000% ## ( 170, 250 ] 16 5.333% 25.333% # ( 250, 380 ] 14 4.667% 30.000% # ( 380, 580 ] 30 10.000% 40.000% ## ( 580, 870 ] 33 11.000% 51.000% ## ( 870, 1300 ] 28 9.333% 60.333% ## ( 1300, 1900 ] 26 8.667% 69.000% ## ( 1900, 2900 ] 31 10.333% 79.333% ## ( 2900, 4400 ] 47 15.667% 95.000% ### ( 4400, 6600 ] 14 4.667% 99.667% # ( 6600, 9900 ] 1 0.333% 100.000% ** DB Stats ** Uptime(secs): 56.3 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 174.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.237 H:M:S, 50.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.418 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.575 micros/op 179357 ops/sec 60.148 seconds 10787999 operations; 173.8 MB/s Microseconds per write: Count: 10787999 Average: 5.5755 StdDev: 548.68 Min: 0 Median: 1.7489 Max: 1009101 Percentiles: P50: 1.75 P75: 2.75 P99: 9.23 P99.9: 1090.78 P99.99: 2587.19 ------------------------------------------------------ [ 0, 1 ] 1339227 12.414% 12.414% ## ( 1, 2 ] 5414143 50.187% 62.601% ########## ( 2, 3 ] 1771887 16.425% 79.025% ### ( 3, 4 ] 1486756 13.782% 92.807% ### ( 4, 6 ] 568810 5.273% 98.080% # ( 6, 10 ] 122906 1.139% 99.219% ( 10, 15 ] 42378 0.393% 99.612% ( 15, 22 ] 9727 0.090% 99.702% ( 22, 34 ] 2145 0.020% 99.722% ( 34, 51 ] 267 0.002% 99.724% ( 51, 76 ] 47 0.000% 99.725% ( 76, 110 ] 7425 0.069% 99.793% ( 110, 170 ] 2975 0.028% 99.821% ( 170, 250 ] 333 0.003% 99.824% ( 250, 380 ] 198 0.002% 99.826% ( 380, 580 ] 24 0.000% 99.826% ( 580, 870 ] 43 0.000% 99.827% ( 870, 1300 ] 15425 0.143% 99.970% ( 1300, 1900 ] 21 0.000% 99.970% ( 1900, 2900 ] 3177 0.029% 99.999% ( 2900, 4400 ] 45 0.000% 100.000% ( 4400, 6600 ] 4 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 188670 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10787999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11133214968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 561 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30171553 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30275195441 rocksdb.compact.write.bytes COUNT : 30082021666 rocksdb.flush.write.bytes COUNT : 11097412695 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 69 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 325 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11008130048 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4458496 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30380894438 rocksdb.non.last.level.read.count COUNT : 7334505 rocksdb.block.checksum.compute.count COUNT : 7333452 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.392306 P95 : 3.901748 P99 : 7.624812 P100 : 1009098.000000 COUNT : 10787999 SUM : 54971765 rocksdb.compaction.times.micros P50 : 1078571.428571 P95 : 3460000.000000 P99 : 14640000.000000 P100 : 21588233.000000 COUNT : 92 SUM : 148379155 rocksdb.compaction.times.cpu_micros P50 : 924324.324324 P95 : 3460000.000000 P99 : 14640000.000000 P100 : 19513040.000000 COUNT : 92 SUM : 117176472 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 692.777778 P95 : 3875.000000 P99 : 349450.000000 P100 : 438756.000000 COUNT : 147 SUM : 1176499 rocksdb.compaction.outfile.sync.micros P50 : 1137.297297 P95 : 208000.000000 P99 : 348020.000000 P100 : 421864.000000 COUNT : 346 SUM : 9572879 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 105.231707 P95 : 1776.250000 P99 : 3751.250000 P100 : 5551.000000 COUNT : 273 SUM : 90821 rocksdb.table.open.io.micros P50 : 1600.000000 P95 : 8730.441176 P99 : 14520.000000 P100 : 19036.000000 COUNT : 561 SUM : 1341523 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.599722 P95 : 7.680197 P99 : 11.355728 P100 : 12069.000000 COUNT : 7331824 SUM : 47860445 rocksdb.read.block.get.micros P50 : 485.172414 P95 : 3710.416667 P99 : 5578.000000 P100 : 9290.000000 COUNT : 1122 SUM : 1067189 rocksdb.write.raw.block.micros P50 : 0.513312 P95 : 0.975294 P99 : 2.801675 P100 : 19298.000000 COUNT : 9973142 SUM : 20824539 rocksdb.numfiles.in.singlecompaction P50 : 3.154930 P95 : 4.800000 P99 : 25.840000 P100 : 29.000000 COUNT : 136 SUM : 508 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.568171 P95 : 1171.850905 P99 : 2417.137429 P100 : 1008885.000000 COUNT : 155888 SUM : 30189242 rocksdb.sst.read.micros P50 : 1.546004 P95 : 4.551924 P99 : 8.512198 P100 : 12048.000000 COUNT : 7334703 SUM : 32975243 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10787999 SUM : 11133214968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214660.194175 P95 : 463916.666667 P99 : 950100.000000 P100 : 1144758.000000 COUNT : 147 SUM : 34016404 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 336 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0