[2024-12-14 23:11:33.024502] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 23.11.0 initialization... [2024-12-14 23:11:33.024769] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid434053 ] Set seed to 1734214293017832 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-14 23:11:33.155160] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-14 23:11:33.178409] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-14 23:11:33.178453] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 434053' to capture a snapshot of events at runtime. [2024-12-14 23:11:33.178463] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-14 23:11:33.178473] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-14 23:11:33.178482] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid434053 for offline analysis/debug. [2024-12-14 23:11:33.179045] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 14 23:11:37 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/14-23:11:40 ... thread 0: (1000000,1000000) ops and (328195.8,328195.8) ops/second in (3.046962,3.046962) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 692.99 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 343.0 2.57 2.30 12 0.214 0 0 0.0 0.0 L2 3/2 237.18 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 239.0 238.8 1.46 1.40 2 0.730 354K 179 0.0 0.0 L3 8/0 629.91 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 86.5 305.3 4.03 3.70 14 0.288 354K 179 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 86.5 305.3 4.03 3.70 14 0.288 354K 179 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 239.0 238.8 1.46 1.40 2 0.730 354K 179 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 343.0 2.57 2.30 12 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 375.66 MB/s write, 0.34 GB read, 106.47 MB/s read, 4.0 seconds Interval compaction: 1.20 GB write, 403.71 MB/s write, 0.34 GB read, 114.42 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 131673 Average: 2.0271 StdDev: 16.63 Min: 1 Median: 1.3460 Max: 3478 Percentiles: P50: 1.35 P75: 1.76 P99: 5.29 P99.9: 10.93 P99.99: 19.14 ------------------------------------------------------ [ 0, 1 ] 38593 29.310% 29.310% ###### ( 1, 2 ] 78740 59.800% 89.109% ############ ( 2, 3 ] 8697 6.605% 95.714% # ( 3, 4 ] 3157 2.398% 98.112% ( 4, 6 ] 1809 1.374% 99.486% ( 6, 10 ] 521 0.396% 99.882% ( 10, 15 ] 131 0.099% 99.981% ( 15, 22 ] 20 0.015% 99.996% ( 22, 34 ] 2 0.002% 99.998% ( 34, 51 ] 1 0.001% 99.998% ( 110, 170 ] 6 0.005% 100.003% ( 170, 250 ] 4 0.003% 100.006% ( 250, 380 ] 7 0.005% 100.011% ( 380, 580 ] 1 0.001% 100.012% ( 580, 870 ] 2 0.002% 100.014% ( 1300, 1900 ] 1 0.001% 100.014% ( 2900, 4400 ] 3 0.002% 100.017% ** Level 1 read latency histogram (micros): Count: 12299 Average: 3.2067 StdDev: 36.26 Min: 1 Median: 1.2944 Max: 2879 Percentiles: P50: 1.29 P75: 1.75 P99: 9.58 P99.9: 305.28 P99.99: 1831.03 ------------------------------------------------------ [ 0, 1 ] 4164 33.856% 33.856% ####### ( 1, 2 ] 6745 54.842% 88.698% ########### ( 2, 3 ] 854 6.944% 95.642% # ( 3, 4 ] 158 1.285% 96.927% ( 4, 6 ] 145 1.179% 98.106% ( 6, 10 ] 123 1.000% 99.106% ( 10, 15 ] 24 0.195% 99.301% ( 15, 22 ] 9 0.073% 99.374% ( 22, 34 ] 2 0.016% 99.390% ( 34, 51 ] 28 0.228% 99.618% ( 51, 76 ] 13 0.106% 99.724% ( 76, 110 ] 8 0.065% 99.789% ( 110, 170 ] 1 0.008% 99.797% ( 170, 250 ] 11 0.089% 99.886% ( 250, 380 ] 4 0.033% 99.919% ( 380, 580 ] 4 0.033% 99.951% ( 580, 870 ] 3 0.024% 99.976% ( 1300, 1900 ] 2 0.016% 99.992% ( 1900, 2900 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 68822 Average: 1.9632 StdDev: 4.52 Min: 1 Median: 1.3619 Max: 765 Percentiles: P50: 1.36 P75: 1.77 P99: 5.36 P99.9: 10.88 P99.99: 173.14 ------------------------------------------------------ [ 0, 1 ] 18991 27.594% 27.594% ###### ( 1, 2 ] 42615 61.921% 89.515% ############ ( 2, 3 ] 4109 5.970% 95.485% # ( 3, 4 ] 1735 2.521% 98.006% # ( 4, 6 ] 1004 1.459% 99.465% ( 6, 10 ] 291 0.423% 99.888% ( 10, 15 ] 52 0.076% 99.964% ( 15, 22 ] 12 0.017% 99.981% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.985% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 3 0.004% 99.996% ( 250, 380 ] 2 0.003% 99.999% ( 580, 870 ] 2 0.003% 100.001% ** Level 3 read latency histogram (micros): Count: 40 Average: 1722.8250 StdDev: 1321.05 Min: 87 Median: 1300.0000 Max: 5080 Percentiles: P50: 1300.00 P75: 2733.33 P99: 5080.00 P99.9: 5080.00 P99.99: 5080.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 3 7.500% 10.000% ## ( 170, 250 ] 1 2.500% 12.500% # ( 250, 380 ] 1 2.500% 15.000% # ( 380, 580 ] 3 7.500% 22.500% ## ( 580, 870 ] 4 10.000% 32.500% ## ( 870, 1300 ] 7 17.500% 50.000% #### ( 1300, 1900 ] 5 12.500% 62.500% ### ( 1900, 2900 ] 6 15.000% 77.500% ### ( 2900, 4400 ] 7 17.500% 95.000% #### ( 4400, 6600 ] 2 5.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1825.5429 StdDev: 1417.21 Min: 116 Median: 1269.2857 Max: 5593 Percentiles: P50: 1269.29 P75: 3134.38 P99: 5593.00 P99.9: 5593.00 P99.99: 5593.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 2 5.714% 8.571% # ( 250, 380 ] 2 5.714% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 3 8.571% 31.429% ## ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 3 8.571% 60.000% ## ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 8 22.857% 94.286% ##### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 3.3 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 300.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.443 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.443 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/14-23:11:43 ... thread 0: (1000000,2000000) ops and (352079.3,339718.3) ops/second in (2.840269,5.887231) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 1.29 GB 18.9 0.8 0.0 0.8 2.6 1.8 0.0 1.4 97.2 313.9 8.43 7.81 29 0.291 831K 838 0.0 0.0 L1 1/1 2.16 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 235.4 235.1 1.34 1.30 1 1.338 319K 432 0.0 0.0 L2 1/0 49.61 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 239.0 238.8 1.46 1.40 2 0.730 354K 179 0.0 0.0 L3 40/0 970.39 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 200.0 199.8 3.44 3.03 3 1.146 698K 644 0.0 0.0 L4 136/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1232/8 97.92 GB 0.0 2.1 1.0 1.1 3.9 2.8 0.7 2.2 148.0 272.5 14.66 13.54 35 0.419 2203K 2093 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 1.0 1.1 3.9 2.8 0.6 2.2 148.0 272.5 14.66 13.54 35 0.419 2203K 2093 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 1.0 1.1 2.1 1.0 0.0 0.0 230.7 230.4 9.41 8.84 9 1.045 2203K 2093 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 347.8 5.25 4.69 26 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.90 GB write, 653.23 MB/s write, 2.12 GB read, 354.86 MB/s read, 14.7 seconds Interval compaction: 3.90 GB write, 678.48 MB/s write, 2.12 GB read, 368.58 MB/s read, 14.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 368714 Average: 2.1255 StdDev: 13.48 Min: 1 Median: 1.4309 Max: 3478 Percentiles: P50: 1.43 P75: 1.83 P99: 5.55 P99.9: 11.11 P99.99: 16.04 ------------------------------------------------------ [ 0, 1 ] 84157 22.824% 22.824% ##### ( 1, 2 ] 232517 63.062% 85.886% ############# ( 2, 3 ] 30471 8.264% 94.150% ## ( 3, 4 ] 12545 3.402% 97.553% # ( 4, 6 ] 6869 1.863% 99.416% ( 6, 10 ] 1695 0.460% 99.875% ( 10, 15 ] 417 0.113% 99.988% ( 15, 22 ] 48 0.013% 100.001% ( 22, 34 ] 7 0.002% 100.003% ( 34, 51 ] 2 0.001% 100.004% ( 51, 76 ] 1 0.000% 100.004% ( 110, 170 ] 13 0.004% 100.008% ( 170, 250 ] 10 0.003% 100.010% ( 250, 380 ] 14 0.004% 100.014% ( 380, 580 ] 3 0.001% 100.015% ( 580, 870 ] 7 0.002% 100.017% ( 870, 1300 ] 3 0.001% 100.018% ( 1300, 1900 ] 2 0.001% 100.018% ( 1900, 2900 ] 2 0.001% 100.019% ( 2900, 4400 ] 4 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 91592 Average: 2.4966 StdDev: 14.57 Min: 1 Median: 1.5833 Max: 2879 Percentiles: P50: 1.58 P75: 1.97 P99: 6.06 P99.9: 15.55 P99.99: 235.61 ------------------------------------------------------ [ 0, 1 ] 11293 12.330% 12.330% ## ( 1, 2 ] 59154 64.584% 76.914% ############# ( 2, 3 ] 12773 13.946% 90.859% ### ( 3, 4 ] 4488 4.900% 95.759% # ( 4, 6 ] 2958 3.230% 98.989% # ( 6, 10 ] 712 0.777% 99.766% ( 10, 15 ] 121 0.132% 99.898% ( 15, 22 ] 18 0.020% 99.918% ( 22, 34 ] 4 0.004% 99.922% ( 34, 51 ] 30 0.033% 99.955% ( 51, 76 ] 13 0.014% 99.969% ( 76, 110 ] 8 0.009% 99.978% ( 110, 170 ] 1 0.001% 99.979% ( 170, 250 ] 12 0.013% 99.992% ( 250, 380 ] 5 0.005% 99.998% ( 380, 580 ] 6 0.007% 100.004% ( 580, 870 ] 4 0.004% 100.009% ( 1300, 1900 ] 3 0.003% 100.012% ( 1900, 2900 ] 1 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 75921 Average: 2.0032 StdDev: 4.32 Min: 1 Median: 1.3910 Max: 765 Percentiles: P50: 1.39 P75: 1.79 P99: 5.48 P99.9: 11.16 P99.99: 158.16 ------------------------------------------------------ [ 0, 1 ] 19418 25.577% 25.577% ##### ( 1, 2 ] 47427 62.469% 88.045% ############ ( 2, 3 ] 5238 6.899% 94.945% # ( 3, 4 ] 2137 2.815% 97.760% # ( 4, 6 ] 1269 1.671% 99.431% ( 6, 10 ] 341 0.449% 99.880% ( 10, 15 ] 65 0.086% 99.966% ( 15, 22 ] 12 0.016% 99.982% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 3 0.004% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 47956 Average: 3.9162 StdDev: 63.58 Min: 0 Median: 1.6031 Max: 5080 Percentiles: P50: 1.60 P75: 1.99 P99: 6.59 P99.9: 127.52 P99.99: 2767.40 ------------------------------------------------------ [ 0, 1 ] 5050 10.530% 10.530% ## ( 1, 2 ] 31386 65.447% 75.978% ############# ( 2, 3 ] 6821 14.223% 90.201% ### ( 3, 4 ] 2527 5.269% 95.471% # ( 4, 6 ] 1639 3.418% 98.889% # ( 6, 10 ] 362 0.755% 99.643% ( 10, 15 ] 67 0.140% 99.783% ( 15, 22 ] 17 0.035% 99.819% ( 22, 34 ] 30 0.063% 99.881% ( 34, 51 ] 5 0.010% 99.892% ( 76, 110 ] 2 0.004% 99.896% ( 110, 170 ] 7 0.015% 99.910% ( 170, 250 ] 4 0.008% 99.919% ( 250, 380 ] 4 0.008% 99.927% ( 380, 580 ] 6 0.013% 99.940% ( 580, 870 ] 5 0.010% 99.950% ( 870, 1300 ] 8 0.017% 99.967% ( 1300, 1900 ] 6 0.013% 99.979% ( 1900, 2900 ] 6 0.013% 99.992% ( 2900, 4400 ] 7 0.015% 100.006% ( 4400, 6600 ] 2 0.004% 100.010% ** Level 4 read latency histogram (micros): Count: 35 Average: 1825.5429 StdDev: 1417.21 Min: 116 Median: 1269.2857 Max: 5593 Percentiles: P50: 1269.29 P75: 3134.38 P99: 5593.00 P99.9: 5593.00 P99.99: 5593.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 2 5.714% 8.571% # ( 250, 380 ] 2 5.714% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 3 8.571% 31.429% ## ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 3 8.571% 60.000% ## ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 8 22.857% 94.286% ##### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.658 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 346.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.215 H:M:S, 7.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-23:11:46 ... thread 0: (1000000,3000000) ops and (329486.3,336237.7) ops/second in (3.035028,8.922259) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.27 GB 94.4 1.6 0.0 1.6 4.4 2.8 0.0 1.6 114.0 311.3 14.36 13.40 46 0.312 1663K 1748 0.0 0.0 L1 1/1 2.16 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 235.4 235.1 1.34 1.30 1 1.338 319K 432 0.0 0.0 L2 1/0 49.61 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 239.0 238.8 1.46 1.40 2 0.730 354K 179 0.0 0.0 L3 40/0 970.39 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 200.0 199.8 3.44 3.03 3 1.146 698K 644 0.0 0.0 L4 136/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1237/12 98.90 GB 0.0 2.9 1.0 1.9 5.7 3.7 0.7 2.1 145.1 282.6 20.60 19.12 52 0.396 3035K 3003 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 1.0 1.9 5.7 3.7 0.6 2.1 145.1 282.6 20.60 19.12 52 0.396 3035K 3003 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 1.0 1.9 2.9 1.0 0.0 0.0 238.4 238.1 12.54 11.91 12 1.045 3035K 3003 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 351.8 8.06 7.21 40 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.68 GB write, 636.11 MB/s write, 2.92 GB read, 326.67 MB/s read, 20.6 seconds Interval compaction: 5.68 GB write, 652.34 MB/s write, 2.92 GB read, 335.00 MB/s read, 20.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 754030 Average: 2.1383 StdDev: 10.86 Min: 1 Median: 1.4659 Max: 3478 Percentiles: P50: 1.47 P75: 1.85 P99: 5.51 P99.9: 9.99 P99.99: 14.24 ------------------------------------------------------ [ 0, 1 ] 146703 19.456% 19.456% #### ( 1, 2 ] 494317 65.557% 85.013% ############# ( 2, 3 ] 69230 9.181% 94.194% ## ( 3, 4 ] 25715 3.410% 97.604% # ( 4, 6 ] 13932 1.848% 99.452% ( 6, 10 ] 3387 0.449% 99.901% ( 10, 15 ] 790 0.105% 100.006% ( 15, 22 ] 89 0.012% 100.018% ( 22, 34 ] 12 0.002% 100.019% ( 34, 51 ] 5 0.001% 100.020% ( 51, 76 ] 5 0.001% 100.021% ( 110, 170 ] 16 0.002% 100.023% ( 170, 250 ] 20 0.003% 100.025% ( 250, 380 ] 20 0.003% 100.028% ( 380, 580 ] 9 0.001% 100.029% ( 580, 870 ] 11 0.001% 100.031% ( 870, 1300 ] 5 0.001% 100.031% ( 1300, 1900 ] 3 0.000% 100.032% ( 1900, 2900 ] 4 0.001% 100.032% ( 2900, 4400 ] 4 0.001% 100.033% ** Level 1 read latency histogram (micros): Count: 91592 Average: 2.4966 StdDev: 14.57 Min: 1 Median: 1.5833 Max: 2879 Percentiles: P50: 1.58 P75: 1.97 P99: 6.06 P99.9: 15.55 P99.99: 235.61 ------------------------------------------------------ [ 0, 1 ] 11293 12.330% 12.330% ## ( 1, 2 ] 59154 64.584% 76.914% ############# ( 2, 3 ] 12773 13.946% 90.859% ### ( 3, 4 ] 4488 4.900% 95.759% # ( 4, 6 ] 2958 3.230% 98.989% # ( 6, 10 ] 712 0.777% 99.766% ( 10, 15 ] 121 0.132% 99.898% ( 15, 22 ] 18 0.020% 99.918% ( 22, 34 ] 4 0.004% 99.922% ( 34, 51 ] 30 0.033% 99.955% ( 51, 76 ] 13 0.014% 99.969% ( 76, 110 ] 8 0.009% 99.978% ( 110, 170 ] 1 0.001% 99.979% ( 170, 250 ] 12 0.013% 99.992% ( 250, 380 ] 5 0.005% 99.998% ( 380, 580 ] 6 0.007% 100.004% ( 580, 870 ] 4 0.004% 100.009% ( 1300, 1900 ] 3 0.003% 100.012% ( 1900, 2900 ] 1 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 75921 Average: 2.0032 StdDev: 4.32 Min: 1 Median: 1.3910 Max: 765 Percentiles: P50: 1.39 P75: 1.79 P99: 5.48 P99.9: 11.16 P99.99: 158.16 ------------------------------------------------------ [ 0, 1 ] 19418 25.577% 25.577% ##### ( 1, 2 ] 47427 62.469% 88.045% ############ ( 2, 3 ] 5238 6.899% 94.945% # ( 3, 4 ] 2137 2.815% 97.760% # ( 4, 6 ] 1269 1.671% 99.431% ( 6, 10 ] 341 0.449% 99.880% ( 10, 15 ] 65 0.086% 99.966% ( 15, 22 ] 12 0.016% 99.982% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 3 0.004% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 47956 Average: 3.9162 StdDev: 63.58 Min: 0 Median: 1.6031 Max: 5080 Percentiles: P50: 1.60 P75: 1.99 P99: 6.59 P99.9: 127.52 P99.99: 2767.40 ------------------------------------------------------ [ 0, 1 ] 5050 10.530% 10.530% ## ( 1, 2 ] 31386 65.447% 75.978% ############# ( 2, 3 ] 6821 14.223% 90.201% ### ( 3, 4 ] 2527 5.269% 95.471% # ( 4, 6 ] 1639 3.418% 98.889% # ( 6, 10 ] 362 0.755% 99.643% ( 10, 15 ] 67 0.140% 99.783% ( 15, 22 ] 17 0.035% 99.819% ( 22, 34 ] 30 0.063% 99.881% ( 34, 51 ] 5 0.010% 99.892% ( 76, 110 ] 2 0.004% 99.896% ( 110, 170 ] 7 0.015% 99.910% ( 170, 250 ] 4 0.008% 99.919% ( 250, 380 ] 4 0.008% 99.927% ( 380, 580 ] 6 0.013% 99.940% ( 580, 870 ] 5 0.010% 99.950% ( 870, 1300 ] 8 0.017% 99.967% ( 1300, 1900 ] 6 0.013% 99.979% ( 1900, 2900 ] 6 0.013% 99.992% ( 2900, 4400 ] 7 0.015% 100.006% ( 4400, 6600 ] 2 0.004% 100.010% ** Level 4 read latency histogram (micros): Count: 35 Average: 1825.5429 StdDev: 1417.21 Min: 116 Median: 1269.2857 Max: 5593 Percentiles: P50: 1269.29 P75: 3134.38 P99: 5593.00 P99.9: 5593.00 P99.99: 5593.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 2 5.714% 8.571% # ( 250, 380 ] 2 5.714% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 3 8.571% 31.429% ## ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 3 8.571% 60.000% ## ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 8 22.857% 94.286% ##### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.056 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-23:11:49 ... thread 0: (1000000,4000000) ops and (332284.3,335240.6) ops/second in (3.009471,11.931730) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 2.09 GB 12.6 2.4 0.0 2.4 6.1 3.7 0.0 1.6 122.3 310.4 20.09 18.80 62 0.324 2494K 2589 0.0 0.0 L1 11/11 1.10 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 227.5 226.6 6.37 6.18 2 3.187 1472K 5734 0.0 0.0 L2 1/0 49.61 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 239.0 238.8 1.46 1.40 2 0.730 354K 179 0.0 0.0 L3 40/0 970.39 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 200.0 199.8 3.44 3.03 3 1.146 698K 644 0.0 0.0 L4 136/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/21 99.82 GB 0.0 4.8 2.1 2.7 8.5 5.8 0.7 2.3 157.6 277.9 31.36 29.41 69 0.454 5019K 9146 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 2.1 2.7 8.5 5.8 0.6 2.3 157.6 277.9 31.36 29.41 69 0.454 5019K 9146 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 2.1 2.7 4.8 2.1 0.0 0.0 239.4 238.9 20.65 19.81 16 1.291 5019K 9146 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 353.1 10.71 9.60 53 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.51 GB write, 716.57 MB/s write, 4.83 GB read, 406.52 MB/s read, 31.4 seconds Interval compaction: 8.51 GB write, 730.24 MB/s write, 4.83 GB read, 414.28 MB/s read, 31.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1051771 Average: 2.1203 StdDev: 11.28 Min: 0 Median: 1.4527 Max: 3902 Percentiles: P50: 1.45 P75: 1.83 P99: 5.39 P99.9: 10.08 P99.99: 14.59 ------------------------------------------------------ [ 0, 1 ] 212387 20.193% 20.193% #### ( 1, 2 ] 692451 65.837% 86.030% ############# ( 2, 3 ] 91480 8.698% 94.728% ## ( 3, 4 ] 33276 3.164% 97.891% # ( 4, 6 ] 16786 1.596% 99.487% ( 6, 10 ] 4322 0.411% 99.898% ( 10, 15 ] 1050 0.100% 99.998% ( 15, 22 ] 104 0.010% 100.008% ( 22, 34 ] 16 0.002% 100.010% ( 34, 51 ] 7 0.001% 100.010% ( 51, 76 ] 5 0.000% 100.011% ( 76, 110 ] 19 0.002% 100.013% ( 110, 170 ] 50 0.005% 100.017% ( 170, 250 ] 35 0.003% 100.021% ( 250, 380 ] 31 0.003% 100.024% ( 380, 580 ] 14 0.001% 100.025% ( 580, 870 ] 17 0.002% 100.027% ( 870, 1300 ] 7 0.001% 100.027% ( 1300, 1900 ] 4 0.000% 100.028% ( 1900, 2900 ] 5 0.000% 100.028% ( 2900, 4400 ] 6 0.001% 100.029% ** Level 1 read latency histogram (micros): Count: 99470 Average: 2.6818 StdDev: 18.74 Min: 0 Median: 1.5629 Max: 2879 Percentiles: P50: 1.56 P75: 1.95 P99: 6.49 P99.9: 88.57 P99.99: 514.04 ------------------------------------------------------ [ 0, 1 ] 13819 13.893% 13.893% ### ( 1, 2 ] 63806 64.146% 78.039% ############# ( 2, 3 ] 13074 13.144% 91.182% ### ( 3, 4 ] 4652 4.677% 95.859% # ( 4, 6 ] 3030 3.046% 98.905% # ( 6, 10 ] 774 0.778% 99.683% ( 10, 15 ] 132 0.133% 99.816% ( 15, 22 ] 21 0.021% 99.837% ( 22, 34 ] 4 0.004% 99.841% ( 34, 51 ] 30 0.030% 99.871% ( 51, 76 ] 13 0.013% 99.884% ( 76, 110 ] 42 0.042% 99.927% ( 110, 170 ] 21 0.021% 99.948% ( 170, 250 ] 21 0.021% 99.969% ( 250, 380 ] 11 0.011% 99.980% ( 380, 580 ] 15 0.015% 99.995% ( 580, 870 ] 6 0.006% 100.001% ( 870, 1300 ] 4 0.004% 100.005% ( 1300, 1900 ] 6 0.006% 100.011% ( 1900, 2900 ] 1 0.001% 100.012% ** Level 2 read latency histogram (micros): Count: 75921 Average: 2.0032 StdDev: 4.32 Min: 1 Median: 1.3910 Max: 765 Percentiles: P50: 1.39 P75: 1.79 P99: 5.48 P99.9: 11.16 P99.99: 158.16 ------------------------------------------------------ [ 0, 1 ] 19418 25.577% 25.577% ##### ( 1, 2 ] 47427 62.469% 88.045% ############ ( 2, 3 ] 5238 6.899% 94.945% # ( 3, 4 ] 2137 2.815% 97.760% # ( 4, 6 ] 1269 1.671% 99.431% ( 6, 10 ] 341 0.449% 99.880% ( 10, 15 ] 65 0.086% 99.966% ( 15, 22 ] 12 0.016% 99.982% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 3 0.004% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 47956 Average: 3.9162 StdDev: 63.58 Min: 0 Median: 1.6031 Max: 5080 Percentiles: P50: 1.60 P75: 1.99 P99: 6.59 P99.9: 127.52 P99.99: 2767.40 ------------------------------------------------------ [ 0, 1 ] 5050 10.530% 10.530% ## ( 1, 2 ] 31386 65.447% 75.978% ############# ( 2, 3 ] 6821 14.223% 90.201% ### ( 3, 4 ] 2527 5.269% 95.471% # ( 4, 6 ] 1639 3.418% 98.889% # ( 6, 10 ] 362 0.755% 99.643% ( 10, 15 ] 67 0.140% 99.783% ( 15, 22 ] 17 0.035% 99.819% ( 22, 34 ] 30 0.063% 99.881% ( 34, 51 ] 5 0.010% 99.892% ( 76, 110 ] 2 0.004% 99.896% ( 110, 170 ] 7 0.015% 99.910% ( 170, 250 ] 4 0.008% 99.919% ( 250, 380 ] 4 0.008% 99.927% ( 380, 580 ] 6 0.013% 99.940% ( 580, 870 ] 5 0.010% 99.950% ( 870, 1300 ] 8 0.017% 99.967% ( 1300, 1900 ] 6 0.013% 99.979% ( 1900, 2900 ] 6 0.013% 99.992% ( 2900, 4400 ] 7 0.015% 100.006% ( 4400, 6600 ] 2 0.004% 100.010% ** Level 4 read latency histogram (micros): Count: 35 Average: 1825.5429 StdDev: 1417.21 Min: 116 Median: 1269.2857 Max: 5593 Percentiles: P50: 1269.29 P75: 3134.38 P99: 5593.00 P99.9: 5593.00 P99.99: 5593.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 2 5.714% 8.571% # ( 250, 380 ] 2 5.714% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 3 8.571% 31.429% ## ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 3 8.571% 60.000% ## ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 8 22.857% 94.286% ##### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.453 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-23:11:52 ... thread 0: (1000000,5000000) ops and (324589.2,333054.7) ops/second in (3.080817,15.012547) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 3.07 GB 113.3 3.2 0.0 3.2 7.9 4.7 0.0 1.7 125.9 309.7 26.03 24.40 79 0.329 3326K 3491 0.0 0.0 L1 11/11 1.10 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 227.5 226.6 6.37 6.18 2 3.187 1472K 5734 0.0 0.0 L2 1/0 49.61 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 239.0 238.8 1.46 1.40 2 0.730 354K 179 0.0 0.0 L3 40/0 970.39 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 200.0 199.8 3.44 3.03 3 1.146 698K 644 0.0 0.0 L4 136/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/21 100.80 GB 0.0 5.6 2.1 3.5 10.3 6.8 0.7 2.2 154.5 282.6 37.30 35.00 86 0.434 5851K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 2.1 3.5 10.3 6.8 0.6 2.2 154.5 282.6 37.30 35.00 86 0.434 5851K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 2.1 3.5 5.6 2.1 0.0 0.0 242.6 242.2 23.75 22.85 19 1.250 5851K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.3 13.55 12.15 67 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.0 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.29 GB write, 691.53 MB/s write, 5.63 GB read, 378.08 MB/s read, 37.3 seconds Interval compaction: 10.29 GB write, 702.01 MB/s write, 5.63 GB read, 383.82 MB/s read, 37.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 15, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1370828 Average: 2.1561 StdDev: 11.56 Min: 0 Median: 1.4642 Max: 3902 Percentiles: P50: 1.46 P75: 1.84 P99: 5.41 P99.9: 10.15 P99.99: 14.91 ------------------------------------------------------ [ 0, 1 ] 262890 19.177% 19.177% #### ( 1, 2 ] 910197 66.398% 85.575% ############# ( 2, 3 ] 124453 9.079% 94.654% ## ( 3, 4 ] 44083 3.216% 97.870% # ( 4, 6 ] 21971 1.603% 99.472% ( 6, 10 ] 5826 0.425% 99.897% ( 10, 15 ] 1296 0.095% 99.992% ( 15, 22 ] 121 0.009% 100.001% ( 22, 34 ] 19 0.001% 100.002% ( 34, 51 ] 9 0.001% 100.003% ( 51, 76 ] 8 0.001% 100.003% ( 76, 110 ] 23 0.002% 100.005% ( 110, 170 ] 124 0.009% 100.014% ( 170, 250 ] 72 0.005% 100.019% ( 250, 380 ] 49 0.004% 100.023% ( 380, 580 ] 29 0.002% 100.025% ( 580, 870 ] 29 0.002% 100.027% ( 870, 1300 ] 11 0.001% 100.028% ( 1300, 1900 ] 6 0.000% 100.028% ( 1900, 2900 ] 7 0.001% 100.029% ( 2900, 4400 ] 7 0.001% 100.029% ** Level 1 read latency histogram (micros): Count: 161851 Average: 2.6256 StdDev: 15.81 Min: 0 Median: 1.5491 Max: 2879 Percentiles: P50: 1.55 P75: 1.93 P99: 7.45 P99.9: 102.03 P99.99: 501.65 ------------------------------------------------------ [ 0, 1 ] 22848 14.117% 14.117% ### ( 1, 2 ] 105770 65.350% 79.467% ############# ( 2, 3 ] 20188 12.473% 91.940% ## ( 3, 4 ] 6572 4.061% 96.001% # ( 4, 6 ] 4236 2.617% 98.618% # ( 6, 10 ] 1707 1.055% 99.673% ( 10, 15 ] 211 0.130% 99.803% ( 15, 22 ] 28 0.017% 99.820% ( 22, 34 ] 5 0.003% 99.823% ( 34, 51 ] 30 0.019% 99.842% ( 51, 76 ] 13 0.008% 99.850% ( 76, 110 ] 106 0.065% 99.915% ( 110, 170 ] 51 0.032% 99.947% ( 170, 250 ] 32 0.020% 99.967% ( 250, 380 ] 22 0.014% 99.980% ( 380, 580 ] 26 0.016% 99.996% ( 580, 870 ] 7 0.004% 100.001% ( 870, 1300 ] 4 0.002% 100.003% ( 1300, 1900 ] 6 0.004% 100.007% ( 1900, 2900 ] 1 0.001% 100.007% ** Level 2 read latency histogram (micros): Count: 75921 Average: 2.0032 StdDev: 4.32 Min: 1 Median: 1.3910 Max: 765 Percentiles: P50: 1.39 P75: 1.79 P99: 5.48 P99.9: 11.16 P99.99: 158.16 ------------------------------------------------------ [ 0, 1 ] 19418 25.577% 25.577% ##### ( 1, 2 ] 47427 62.469% 88.045% ############ ( 2, 3 ] 5238 6.899% 94.945% # ( 3, 4 ] 2137 2.815% 97.760% # ( 4, 6 ] 1269 1.671% 99.431% ( 6, 10 ] 341 0.449% 99.880% ( 10, 15 ] 65 0.086% 99.966% ( 15, 22 ] 12 0.016% 99.982% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 3 0.004% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 47956 Average: 3.9162 StdDev: 63.58 Min: 0 Median: 1.6031 Max: 5080 Percentiles: P50: 1.60 P75: 1.99 P99: 6.59 P99.9: 127.52 P99.99: 2767.40 ------------------------------------------------------ [ 0, 1 ] 5050 10.530% 10.530% ## ( 1, 2 ] 31386 65.447% 75.978% ############# ( 2, 3 ] 6821 14.223% 90.201% ### ( 3, 4 ] 2527 5.269% 95.471% # ( 4, 6 ] 1639 3.418% 98.889% # ( 6, 10 ] 362 0.755% 99.643% ( 10, 15 ] 67 0.140% 99.783% ( 15, 22 ] 17 0.035% 99.819% ( 22, 34 ] 30 0.063% 99.881% ( 34, 51 ] 5 0.010% 99.892% ( 76, 110 ] 2 0.004% 99.896% ( 110, 170 ] 7 0.015% 99.910% ( 170, 250 ] 4 0.008% 99.919% ( 250, 380 ] 4 0.008% 99.927% ( 380, 580 ] 6 0.013% 99.940% ( 580, 870 ] 5 0.010% 99.950% ( 870, 1300 ] 8 0.017% 99.967% ( 1300, 1900 ] 6 0.013% 99.979% ( 1900, 2900 ] 6 0.013% 99.992% ( 2900, 4400 ] 7 0.015% 100.006% ( 4400, 6600 ] 2 0.004% 100.010% ** Level 4 read latency histogram (micros): Count: 35 Average: 1825.5429 StdDev: 1417.21 Min: 116 Median: 1269.2857 Max: 5593 Percentiles: P50: 1269.29 P75: 3134.38 P99: 5593.00 P99.9: 5593.00 P99.99: 5593.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 2 5.714% 8.571% # ( 250, 380 ] 2 5.714% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 3 8.571% 31.429% ## ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 3 8.571% 60.000% ## ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 8 22.857% 94.286% ##### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 15.2 total, 3.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 322.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.906 H:M:S, 12.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.453 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-23:12:02 ... thread 0: (1000000,6000000) ops and (104244.2,243848.9) ops/second in (9.592859,24.605406) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 4.11 GB 219.9 5.1 0.0 5.1 10.8 5.7 0.0 1.9 143.3 303.7 36.48 34.34 101 0.361 5308K 7984 0.0 0.0 L1 11/11 1.10 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 227.5 226.6 6.37 6.18 2 3.187 1472K 5734 0.0 0.0 L2 1/0 49.61 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 239.0 238.8 1.46 1.40 2 0.730 354K 179 0.0 0.0 L3 40/0 970.39 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 200.0 199.8 3.44 3.03 3 1.146 698K 644 0.0 0.0 L4 136/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/21 101.84 GB 0.0 7.5 2.1 5.4 13.2 7.8 0.7 2.3 161.6 283.9 47.75 44.94 108 0.442 7833K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.5 2.1 5.4 13.2 7.8 0.6 2.3 161.6 283.9 47.75 44.94 108 0.442 7833K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.5 2.1 5.4 7.5 2.1 0.0 0.0 247.6 247.1 31.16 30.08 24 1.298 7833K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 353.1 16.59 14.86 84 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.8 total, 24.6 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.24 GB write, 545.95 MB/s write, 7.53 GB read, 310.64 MB/s read, 47.8 seconds Interval compaction: 13.24 GB write, 551.00 MB/s write, 7.53 GB read, 313.51 MB/s read, 47.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 15, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2215698 Average: 2.2210 StdDev: 11.49 Min: 0 Median: 1.4567 Max: 3902 Percentiles: P50: 1.46 P75: 1.83 P99: 5.53 P99.9: 13.10 P99.99: 149.38 ------------------------------------------------------ [ 0, 1 ] 430503 19.430% 19.430% #### ( 1, 2 ] 1483117 66.937% 86.366% ############# ( 2, 3 ] 187852 8.478% 94.845% ## ( 3, 4 ] 67319 3.038% 97.883% # ( 4, 6 ] 32439 1.464% 99.347% ( 6, 10 ] 11109 0.501% 99.848% ( 10, 15 ] 1847 0.083% 99.932% ( 15, 22 ] 187 0.008% 99.940% ( 22, 34 ] 24 0.001% 99.941% ( 34, 51 ] 10 0.000% 99.942% ( 51, 76 ] 18 0.001% 99.943% ( 76, 110 ] 591 0.027% 99.969% ( 110, 170 ] 703 0.032% 100.001% ( 170, 250 ] 191 0.009% 100.010% ( 250, 380 ] 131 0.006% 100.015% ( 380, 580 ] 107 0.005% 100.020% ( 580, 870 ] 67 0.003% 100.023% ( 870, 1300 ] 16 0.001% 100.024% ( 1300, 1900 ] 9 0.000% 100.024% ( 1900, 2900 ] 7 0.000% 100.025% ( 2900, 4400 ] 10 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 357694 Average: 2.5633 StdDev: 14.42 Min: 0 Median: 1.4957 Max: 3296 Percentiles: P50: 1.50 P75: 1.87 P99: 7.55 P99.9: 134.48 P99.99: 515.50 ------------------------------------------------------ [ 0, 1 ] 61456 17.181% 17.181% ### ( 1, 2 ] 236822 66.208% 83.389% ############# ( 2, 3 ] 35320 9.874% 93.264% ## ( 3, 4 ] 11715 3.275% 96.539% # ( 4, 6 ] 7341 2.052% 98.591% ( 6, 10 ] 3787 1.059% 99.650% ( 10, 15 ] 355 0.099% 99.749% ( 15, 22 ] 54 0.015% 99.764% ( 22, 34 ] 6 0.002% 99.766% ( 34, 51 ] 31 0.009% 99.774% ( 51, 76 ] 19 0.005% 99.780% ( 76, 110 ] 312 0.087% 99.867% ( 110, 170 ] 290 0.081% 99.948% ( 170, 250 ] 71 0.020% 99.968% ( 250, 380 ] 44 0.012% 99.980% ( 380, 580 ] 52 0.015% 99.995% ( 580, 870 ] 17 0.005% 99.999% ( 870, 1300 ] 6 0.002% 100.001% ( 1300, 1900 ] 6 0.002% 100.003% ( 1900, 2900 ] 1 0.000% 100.003% ( 2900, 4400 ] 1 0.000% 100.003% ** Level 2 read latency histogram (micros): Count: 75921 Average: 2.0032 StdDev: 4.32 Min: 1 Median: 1.3910 Max: 765 Percentiles: P50: 1.39 P75: 1.79 P99: 5.48 P99.9: 11.16 P99.99: 158.16 ------------------------------------------------------ [ 0, 1 ] 19418 25.577% 25.577% ##### ( 1, 2 ] 47427 62.469% 88.045% ############ ( 2, 3 ] 5238 6.899% 94.945% # ( 3, 4 ] 2137 2.815% 97.760% # ( 4, 6 ] 1269 1.671% 99.431% ( 6, 10 ] 341 0.449% 99.880% ( 10, 15 ] 65 0.086% 99.966% ( 15, 22 ] 12 0.016% 99.982% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 3 0.004% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 47956 Average: 3.9162 StdDev: 63.58 Min: 0 Median: 1.6031 Max: 5080 Percentiles: P50: 1.60 P75: 1.99 P99: 6.59 P99.9: 127.52 P99.99: 2767.40 ------------------------------------------------------ [ 0, 1 ] 5050 10.530% 10.530% ## ( 1, 2 ] 31386 65.447% 75.978% ############# ( 2, 3 ] 6821 14.223% 90.201% ### ( 3, 4 ] 2527 5.269% 95.471% # ( 4, 6 ] 1639 3.418% 98.889% # ( 6, 10 ] 362 0.755% 99.643% ( 10, 15 ] 67 0.140% 99.783% ( 15, 22 ] 17 0.035% 99.819% ( 22, 34 ] 30 0.063% 99.881% ( 34, 51 ] 5 0.010% 99.892% ( 76, 110 ] 2 0.004% 99.896% ( 110, 170 ] 7 0.015% 99.910% ( 170, 250 ] 4 0.008% 99.919% ( 250, 380 ] 4 0.008% 99.927% ( 380, 580 ] 6 0.013% 99.940% ( 580, 870 ] 5 0.010% 99.950% ( 870, 1300 ] 8 0.017% 99.967% ( 1300, 1900 ] 6 0.013% 99.979% ( 1900, 2900 ] 6 0.013% 99.992% ( 2900, 4400 ] 7 0.015% 100.006% ( 4400, 6600 ] 2 0.004% 100.010% ** Level 4 read latency histogram (micros): Count: 35 Average: 1825.5429 StdDev: 1417.21 Min: 116 Median: 1269.2857 Max: 5593 Percentiles: P50: 1269.29 P75: 3134.38 P99: 5593.00 P99.9: 5593.00 P99.99: 5593.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 2 5.714% 8.571% # ( 250, 380 ] 2 5.714% 14.286% # ( 380, 580 ] 3 8.571% 22.857% ## ( 580, 870 ] 3 8.571% 31.429% ## ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 3 8.571% 60.000% ## ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 8 22.857% 94.286% ##### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 24.8 total, 9.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 237.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.539 H:M:S, 34.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 102.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.633 H:M:S, 69.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/14-23:12:06 ... thread 0: (1000000,7000000) ops and (240241.3,243326.9) ops/second in (4.162481,28.767887) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 3.07 GB 62.9 5.6 0.0 5.6 12.2 6.6 0.0 1.8 139.5 304.8 41.10 38.63 116 0.354 5820K 8476 0.0 0.0 L1 17/17 2.02 GB 0.0 4.5 3.4 1.1 4.4 3.3 0.2 1.3 224.6 222.2 20.46 19.68 3 6.819 4665K 47K 0.0 0.0 L2 1/0 49.61 MB 0.5 0.3 0.2 0.2 0.3 0.2 1.4 1.8 239.0 238.8 1.46 1.40 2 0.730 354K 179 0.0 0.0 L3 14/0 902.89 MB 0.9 0.8 0.6 0.2 0.8 0.6 0.9 1.3 202.6 202.4 4.07 3.63 4 1.017 828K 644 0.0 0.0 L4 168/0 9.47 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.9 1.1 179.8 179.5 1.87 1.59 3 0.622 320K 612 0.0 0.0 L5 1060/0 87.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/29 102.72 GB 0.0 11.6 4.5 7.1 18.1 11.1 4.7 2.7 171.6 269.5 68.96 64.93 128 0.539 11M 57K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.6 4.5 7.1 18.1 11.1 4.7 2.7 171.6 269.5 68.96 64.93 128 0.539 11M 57K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.6 4.5 7.1 11.5 4.4 0.0 0.0 238.4 237.2 49.65 47.64 31 1.602 11M 57K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.5 19.30 17.28 97 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.0 total, 28.8 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.15 GB write, 640.79 MB/s write, 11.56 GB read, 408.14 MB/s read, 69.0 seconds Interval compaction: 18.15 GB write, 645.86 MB/s write, 11.56 GB read, 411.37 MB/s read, 69.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 19, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2548041 Average: 2.2793 StdDev: 12.48 Min: 0 Median: 1.4618 Max: 3902 Percentiles: P50: 1.46 P75: 1.84 P99: 5.63 P99.9: 14.29 P99.99: 166.35 ------------------------------------------------------ [ 0, 1 ] 486601 19.097% 19.097% #### ( 1, 2 ] 1705060 66.917% 86.014% ############# ( 2, 3 ] 220384 8.649% 94.663% ## ( 3, 4 ] 78692 3.088% 97.751% # ( 4, 6 ] 38970 1.529% 99.280% ( 6, 10 ] 14016 0.550% 99.831% ( 10, 15 ] 2063 0.081% 99.912% ( 15, 22 ] 222 0.009% 99.920% ( 22, 34 ] 29 0.001% 99.921% ( 34, 51 ] 11 0.000% 99.922% ( 51, 76 ] 25 0.001% 99.923% ( 76, 110 ] 792 0.031% 99.954% ( 110, 170 ] 983 0.039% 99.992% ( 170, 250 ] 281 0.011% 100.003% ( 250, 380 ] 219 0.009% 100.012% ( 380, 580 ] 164 0.006% 100.018% ( 580, 870 ] 96 0.004% 100.022% ( 870, 1300 ] 31 0.001% 100.023% ( 1300, 1900 ] 14 0.001% 100.024% ( 1900, 2900 ] 9 0.000% 100.024% ( 2900, 4400 ] 12 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 444585 Average: 2.6260 StdDev: 15.41 Min: 0 Median: 1.5048 Max: 3296 Percentiles: P50: 1.50 P75: 1.89 P99: 7.56 P99.9: 138.74 P99.99: 631.27 ------------------------------------------------------ [ 0, 1 ] 75561 16.996% 16.996% ### ( 1, 2 ] 290690 65.385% 82.380% ############# ( 2, 3 ] 46348 10.425% 92.805% ## ( 3, 4 ] 15793 3.552% 96.358% # ( 4, 6 ] 9922 2.232% 98.589% ( 6, 10 ] 4670 1.050% 99.640% ( 10, 15 ] 495 0.111% 99.751% ( 15, 22 ] 80 0.018% 99.769% ( 22, 34 ] 8 0.002% 99.771% ( 34, 51 ] 32 0.007% 99.778% ( 51, 76 ] 26 0.006% 99.784% ( 76, 110 ] 365 0.082% 99.866% ( 110, 170 ] 314 0.071% 99.937% ( 170, 250 ] 88 0.020% 99.957% ( 250, 380 ] 69 0.016% 99.972% ( 380, 580 ] 73 0.016% 99.989% ( 580, 870 ] 37 0.008% 99.997% ( 870, 1300 ] 18 0.004% 100.001% ( 1300, 1900 ] 6 0.001% 100.002% ( 1900, 2900 ] 1 0.000% 100.002% ( 2900, 4400 ] 1 0.000% 100.003% ** Level 2 read latency histogram (micros): Count: 75921 Average: 2.0032 StdDev: 4.32 Min: 1 Median: 1.3910 Max: 765 Percentiles: P50: 1.39 P75: 1.79 P99: 5.48 P99.9: 11.16 P99.99: 158.16 ------------------------------------------------------ [ 0, 1 ] 19418 25.577% 25.577% ##### ( 1, 2 ] 47427 62.469% 88.045% ############ ( 2, 3 ] 5238 6.899% 94.945% # ( 3, 4 ] 2137 2.815% 97.760% # ( 4, 6 ] 1269 1.671% 99.431% ( 6, 10 ] 341 0.449% 99.880% ( 10, 15 ] 65 0.086% 99.966% ( 15, 22 ] 12 0.016% 99.982% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 3 0.004% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 102489 Average: 4.4759 StdDev: 49.51 Min: 0 Median: 1.6683 Max: 5080 Percentiles: P50: 1.67 P75: 2.23 P99: 9.59 P99.9: 406.19 P99.99: 1090.14 ------------------------------------------------------ [ 0, 1 ] 7645 7.459% 7.459% # ( 1, 2 ] 65244 63.660% 71.119% ############# ( 2, 3 ] 17391 16.969% 88.088% ### ( 3, 4 ] 6060 5.913% 94.000% # ( 4, 6 ] 3973 3.877% 97.877% # ( 6, 10 ] 1281 1.250% 99.127% ( 10, 15 ] 258 0.252% 99.378% ( 15, 22 ] 45 0.044% 99.422% ( 22, 34 ] 34 0.033% 99.456% ( 34, 51 ] 5 0.005% 99.460% ( 76, 110 ] 77 0.075% 99.536% ( 110, 170 ] 194 0.189% 99.725% ( 170, 250 ] 94 0.092% 99.817% ( 250, 380 ] 77 0.075% 99.892% ( 380, 580 ] 65 0.063% 99.955% ( 580, 870 ] 25 0.024% 99.980% ( 870, 1300 ] 21 0.020% 100.000% ( 1300, 1900 ] 8 0.008% 100.008% ( 1900, 2900 ] 6 0.006% 100.014% ( 2900, 4400 ] 7 0.007% 100.020% ( 4400, 6600 ] 2 0.002% 100.022% ** Level 4 read latency histogram (micros): Count: 150 Average: 460.4267 StdDev: 1026.86 Min: 1 Median: 3.6667 Max: 5593 Percentiles: P50: 3.67 P75: 282.50 P99: 4950.00 P99.9: 5593.00 P99.99: 5593.00 ------------------------------------------------------ [ 0, 1 ] 26 17.333% 17.333% ### ( 1, 2 ] 32 21.333% 38.667% #### ( 2, 3 ] 13 8.667% 47.333% ## ( 3, 4 ] 6 4.000% 51.333% # ( 4, 6 ] 8 5.333% 56.667% # ( 6, 10 ] 4 2.667% 59.333% # ( 10, 15 ] 3 2.000% 61.333% ( 22, 34 ] 12 8.000% 69.333% ## ( 34, 51 ] 1 0.667% 70.000% ( 110, 170 ] 2 1.333% 71.333% ( 170, 250 ] 4 2.667% 74.000% # ( 250, 380 ] 6 4.000% 78.000% # ( 380, 580 ] 3 2.000% 80.000% ( 580, 870 ] 4 2.667% 82.667% # ( 870, 1300 ] 9 6.000% 88.667% # ( 1300, 1900 ] 3 2.000% 90.667% ( 1900, 2900 ] 4 2.667% 93.333% # ( 2900, 4400 ] 8 5.333% 98.667% # ( 4400, 6600 ] 2 1.333% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 933.9625 StdDev: 1095.48 Min: 85 Median: 480.0000 Max: 4602 Percentiles: P50: 480.00 P75: 1400.00 P99: 4602.00 P99.9: 4602.00 P99.99: 4602.00 ------------------------------------------------------ ( 76, 110 ] 10 12.500% 12.500% ### ( 110, 170 ] 15 18.750% 31.250% #### ( 170, 250 ] 7 8.750% 40.000% ## ( 250, 380 ] 4 5.000% 45.000% # ( 380, 580 ] 8 10.000% 55.000% ## ( 580, 870 ] 10 12.500% 67.500% ### ( 870, 1300 ] 5 6.250% 73.750% # ( 1300, 1900 ] 6 7.500% 81.250% ## ( 1900, 2900 ] 8 10.000% 91.250% ## ( 2900, 4400 ] 6 7.500% 98.750% ## ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 29.0 total, 4.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 237.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.968 H:M:S, 34.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 236.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.429 H:M:S, 34.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-23:12:28 ... thread 0: (1000000,8000000) ops and (45239.7,157256.3) ops/second in (22.104476,50.872363) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 1.90 GB 18.9 7.4 0.0 7.4 15.0 7.6 0.0 2.0 140.6 285.7 53.75 48.25 132 0.407 7674K 15K 0.0 0.0 L1 8/8 904.84 MB 0.0 8.7 5.5 3.1 8.5 5.4 0.2 1.5 218.0 215.3 40.66 38.07 4 10.165 8468K 47K 0.0 0.0 L2 1/0 90.63 MB 0.9 0.3 0.2 0.2 0.3 0.2 4.6 1.8 239.0 238.8 1.46 1.40 2 0.730 354K 179 0.0 0.0 L3 23/6 1.57 GB 0.9 2.0 1.1 0.9 2.0 1.1 3.5 1.8 141.4 140.3 14.80 9.59 10 1.480 2117K 16K 0.0 0.0 L4 165/14 9.96 GB 1.0 3.2 2.8 0.4 3.2 2.8 0.9 1.2 118.9 118.4 27.70 16.07 26 1.065 3324K 13K 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/35 103.61 GB 0.0 21.6 9.6 12.0 29.1 17.1 12.6 3.8 160.1 215.4 138.36 113.37 174 0.795 21M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.6 9.6 12.0 29.1 17.1 12.5 3.8 160.1 215.4 138.36 113.37 174 0.795 21M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.6 9.6 12.0 21.5 9.5 0.0 0.0 195.5 194.1 113.36 93.26 64 1.771 21M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 312.5 25.00 20.11 110 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.1 total, 50.9 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.11 GB write, 583.36 MB/s write, 21.64 GB read, 433.61 MB/s read, 138.4 seconds Interval compaction: 29.11 GB write, 585.97 MB/s write, 21.64 GB read, 435.55 MB/s read, 138.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 50, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 50, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3619284 Average: 2.9363 StdDev: 40.74 Min: 0 Median: 1.4767 Max: 14475 Percentiles: P50: 1.48 P75: 1.86 P99: 6.32 P99.9: 140.25 P99.99: 455.37 ------------------------------------------------------ [ 0, 1 ] 679772 18.782% 18.782% #### ( 1, 2 ] 2370124 65.486% 84.268% ############# ( 2, 3 ] 331011 9.146% 93.414% ## ( 3, 4 ] 123574 3.414% 96.828% # ( 4, 6 ] 76709 2.119% 98.947% ( 6, 10 ] 24088 0.666% 99.613% ( 10, 15 ] 3805 0.105% 99.718% ( 15, 22 ] 574 0.016% 99.734% ( 22, 34 ] 44 0.001% 99.735% ( 34, 51 ] 15 0.000% 99.736% ( 51, 76 ] 48 0.001% 99.737% ( 76, 110 ] 4214 0.116% 99.853% ( 110, 170 ] 3350 0.093% 99.946% ( 170, 250 ] 742 0.021% 99.966% ( 250, 380 ] 637 0.018% 99.984% ( 380, 580 ] 576 0.016% 100.000% ( 580, 870 ] 291 0.008% 100.008% ( 870, 1300 ] 132 0.004% 100.012% ( 1300, 1900 ] 72 0.002% 100.014% ( 1900, 2900 ] 102 0.003% 100.016% ( 2900, 4400 ] 150 0.004% 100.021% ( 4400, 6600 ] 33 0.001% 100.022% ( 6600, 9900 ] 16 0.000% 100.022% ( 9900, 14000 ] 4 0.000% 100.022% ( 14000, 22000 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1724412 Average: 5.7407 StdDev: 103.74 Min: 0 Median: 1.6378 Max: 24412 Percentiles: P50: 1.64 P75: 2.30 P99: 9.13 P99.9: 150.51 P99.99: 458.67 ------------------------------------------------------ [ 0, 1 ] 237527 13.774% 13.774% ### ( 1, 2 ] 979495 56.802% 70.576% ########### ( 2, 3 ] 252835 14.662% 85.238% ### ( 3, 4 ] 115865 6.719% 91.957% # ( 4, 6 ] 99662 5.779% 97.737% # ( 6, 10 ] 27821 1.613% 99.350% ( 10, 15 ] 4987 0.289% 99.639% ( 15, 22 ] 743 0.043% 99.682% ( 22, 34 ] 51 0.003% 99.685% ( 34, 51 ] 46 0.003% 99.688% ( 51, 76 ] 124 0.007% 99.695% ( 76, 110 ] 2381 0.138% 99.833% ( 110, 170 ] 1704 0.099% 99.932% ( 170, 250 ] 403 0.023% 99.955% ( 250, 380 ] 415 0.024% 99.980% ( 380, 580 ] 459 0.027% 100.006% ( 580, 870 ] 501 0.029% 100.035% ( 870, 1300 ] 338 0.020% 100.055% ( 1300, 1900 ] 219 0.013% 100.068% ( 1900, 2900 ] 311 0.018% 100.086% ( 2900, 4400 ] 465 0.027% 100.113% ( 4400, 6600 ] 172 0.010% 100.122% ( 6600, 9900 ] 44 0.003% 100.125% ( 9900, 14000 ] 4 0.000% 100.125% ( 14000, 22000 ] 4 0.000% 100.125% ( 22000, 33000 ] 1 0.000% 100.126% ** Level 2 read latency histogram (micros): Count: 75921 Average: 2.0032 StdDev: 4.32 Min: 1 Median: 1.3910 Max: 765 Percentiles: P50: 1.39 P75: 1.79 P99: 5.48 P99.9: 11.16 P99.99: 158.16 ------------------------------------------------------ [ 0, 1 ] 19418 25.577% 25.577% ##### ( 1, 2 ] 47427 62.469% 88.045% ############ ( 2, 3 ] 5238 6.899% 94.945% # ( 3, 4 ] 2137 2.815% 97.760% # ( 4, 6 ] 1269 1.671% 99.431% ( 6, 10 ] 341 0.449% 99.880% ( 10, 15 ] 65 0.086% 99.966% ( 15, 22 ] 12 0.016% 99.982% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 3 0.004% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 444439 Average: 10.3653 StdDev: 168.90 Min: 0 Median: 1.8723 Max: 30913 Percentiles: P50: 1.87 P75: 2.84 P99: 9.82 P99.9: 1122.19 P99.99: 1883.48 ------------------------------------------------------ [ 0, 1 ] 13595 3.059% 3.059% # ( 1, 2 ] 239178 53.816% 56.875% ########### ( 2, 3 ] 96041 21.609% 78.484% #### ( 3, 4 ] 46642 10.495% 88.979% ## ( 4, 6 ] 37848 8.516% 97.495% ## ( 6, 10 ] 6998 1.575% 99.069% ( 10, 15 ] 1355 0.305% 99.374% ( 15, 22 ] 172 0.039% 99.413% ( 22, 34 ] 47 0.011% 99.423% ( 34, 51 ] 8 0.002% 99.425% ( 51, 76 ] 3 0.001% 99.426% ( 76, 110 ] 89 0.020% 99.446% ( 110, 170 ] 246 0.055% 99.501% ( 170, 250 ] 212 0.048% 99.549% ( 250, 380 ] 310 0.070% 99.619% ( 380, 580 ] 438 0.099% 99.717% ( 580, 870 ] 569 0.128% 99.845% ( 870, 1300 ] 417 0.094% 99.939% ( 1300, 1900 ] 234 0.053% 99.992% ( 1900, 2900 ] 193 0.043% 100.035% ( 2900, 4400 ] 198 0.045% 100.080% ( 4400, 6600 ] 50 0.011% 100.091% ( 6600, 9900 ] 13 0.003% 100.094% ( 9900, 14000 ] 7 0.002% 100.095% ( 14000, 22000 ] 5 0.001% 100.097% ( 22000, 33000 ] 3 0.001% 100.097% ** Level 4 read latency histogram (micros): Count: 77133 Average: 23.0264 StdDev: 289.28 Min: 1 Median: 2.0217 Max: 43228 Percentiles: P50: 2.02 P75: 3.11 P99: 512.64 P99.9: 3558.72 P99.99: 4952.45 ------------------------------------------------------ [ 0, 1 ] 1143 1.482% 1.482% ( 1, 2 ] 37020 47.995% 49.477% ########## ( 2, 3 ] 18625 24.147% 73.623% ##### ( 3, 4 ] 9630 12.485% 86.108% ## ( 4, 6 ] 7697 9.979% 96.087% ## ( 6, 10 ] 1504 1.950% 98.037% ( 10, 15 ] 328 0.425% 98.462% ( 15, 22 ] 45 0.058% 98.521% ( 22, 34 ] 17 0.022% 98.543% ( 34, 51 ] 5 0.006% 98.549% ( 51, 76 ] 2 0.003% 98.552% ( 76, 110 ] 6 0.008% 98.560% ( 110, 170 ] 28 0.036% 98.596% ( 170, 250 ] 73 0.095% 98.691% ( 250, 380 ] 112 0.145% 98.836% ( 380, 580 ] 191 0.248% 99.083% ( 580, 870 ] 226 0.293% 99.376% ( 870, 1300 ] 166 0.215% 99.592% ( 1300, 1900 ] 114 0.148% 99.739% ( 1900, 2900 ] 76 0.099% 99.838% ( 2900, 4400 ] 109 0.141% 99.979% ( 4400, 6600 ] 33 0.043% 100.022% ( 6600, 9900 ] 5 0.006% 100.029% ( 9900, 14000 ] 4 0.005% 100.034% ( 14000, 22000 ] 2 0.003% 100.036% ( 33000, 50000 ] 1 0.001% 100.038% ** Level 5 read latency histogram (micros): Count: 200 Average: 1322.8550 StdDev: 1318.37 Min: 85 Median: 757.7419 Max: 5766 Percentiles: P50: 757.74 P75: 2200.00 P99: 5766.00 P99.9: 5766.00 P99.99: 5766.00 ------------------------------------------------------ ( 76, 110 ] 10 5.000% 5.000% # ( 110, 170 ] 19 9.500% 14.500% ## ( 170, 250 ] 16 8.000% 22.500% ## ( 250, 380 ] 12 6.000% 28.500% # ( 380, 580 ] 24 12.000% 40.500% ## ( 580, 870 ] 31 15.500% 56.000% ### ( 870, 1300 ] 18 9.000% 65.000% ## ( 1300, 1900 ] 11 5.500% 70.500% # ( 1900, 2900 ] 30 15.000% 85.500% ### ( 2900, 4400 ] 23 11.500% 97.000% ## ( 4400, 6600 ] 6 3.000% 100.000% # ** DB Stats ** Uptime(secs): 51.1 total, 22.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 154.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.513 H:M:S, 55.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 44.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:18.546 H:M:S, 83.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/12/14-23:12:31 ... thread 0: (1000000,9000000) ops and (316917.3,166581.0) ops/second in (3.155397,54.027760) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/7 2.76 GB 119.5 8.4 0.0 8.4 16.8 8.5 0.0 2.0 140.7 283.3 60.86 54.50 147 0.414 8697K 17K 0.0 0.0 L1 8/8 904.84 MB 0.0 8.7 5.5 3.1 8.5 5.4 0.2 1.5 218.0 215.3 40.66 38.07 4 10.165 8468K 47K 0.0 0.0 L2 1/0 90.63 MB 0.9 0.3 0.2 0.2 0.3 0.2 4.6 1.8 239.0 238.8 1.46 1.40 2 0.730 354K 179 0.0 0.0 L3 17/0 933.02 MB 0.9 2.0 1.1 0.9 2.0 1.1 3.5 1.8 141.4 140.3 14.80 9.59 10 1.480 2117K 16K 0.0 0.0 L4 159/0 9.64 GB 1.0 4.2 3.4 0.8 4.2 3.4 0.9 1.2 123.1 122.6 34.95 20.85 32 1.092 4349K 17K 0.0 0.0 L5 1096/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/15 104.47 GB 0.0 23.6 10.3 13.3 31.9 18.6 13.5 3.8 158.3 214.1 152.73 124.41 195 0.783 23M 98K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.6 10.3 13.3 31.9 18.6 13.5 3.8 158.3 214.1 152.73 124.41 195 0.783 23M 98K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.6 10.3 13.3 23.4 10.1 0.0 0.0 193.4 192.1 125.00 102.04 73 1.712 23M 98K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 313.4 27.74 22.37 122 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.3 total, 54.0 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.94 GB write, 602.78 MB/s write, 23.61 GB read, 445.57 MB/s read, 152.7 seconds Interval compaction: 31.94 GB write, 605.31 MB/s write, 23.61 GB read, 447.45 MB/s read, 152.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 56, interval: 80 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3972916 Average: 2.9351 StdDev: 40.28 Min: 0 Median: 1.4923 Max: 14475 Percentiles: P50: 1.49 P75: 1.87 P99: 6.49 P99.9: 134.23 P99.99: 410.17 ------------------------------------------------------ [ 0, 1 ] 708501 17.833% 17.833% #### ( 1, 2 ] 2596057 65.344% 83.177% ############# ( 2, 3 ] 392160 9.871% 93.048% ## ( 3, 4 ] 142234 3.580% 96.628% # ( 4, 6 ] 90764 2.285% 98.913% ( 6, 10 ] 28478 0.717% 99.629% ( 10, 15 ] 4366 0.110% 99.739% ( 15, 22 ] 646 0.016% 99.756% ( 22, 34 ] 50 0.001% 99.757% ( 34, 51 ] 17 0.000% 99.757% ( 51, 76 ] 54 0.001% 99.759% ( 76, 110 ] 4242 0.107% 99.865% ( 110, 170 ] 3403 0.086% 99.951% ( 170, 250 ] 784 0.020% 99.971% ( 250, 380 ] 671 0.017% 99.988% ( 380, 580 ] 608 0.015% 100.003% ( 580, 870 ] 312 0.008% 100.011% ( 870, 1300 ] 145 0.004% 100.014% ( 1300, 1900 ] 86 0.002% 100.017% ( 1900, 2900 ] 107 0.003% 100.019% ( 2900, 4400 ] 162 0.004% 100.023% ( 4400, 6600 ] 36 0.001% 100.024% ( 6600, 9900 ] 18 0.000% 100.025% ( 9900, 14000 ] 4 0.000% 100.025% ( 14000, 22000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1814787 Average: 5.7085 StdDev: 103.24 Min: 0 Median: 1.6430 Max: 24412 Percentiles: P50: 1.64 P75: 2.31 P99: 9.12 P99.9: 150.08 P99.99: 477.42 ------------------------------------------------------ [ 0, 1 ] 243414 13.413% 13.413% ### ( 1, 2 ] 1032583 56.898% 70.311% ########### ( 2, 3 ] 270234 14.891% 85.202% ### ( 3, 4 ] 122301 6.739% 91.941% # ( 4, 6 ] 104817 5.776% 97.717% # ( 6, 10 ] 29814 1.643% 99.359% ( 10, 15 ] 5250 0.289% 99.649% ( 15, 22 ] 775 0.043% 99.691% ( 22, 34 ] 51 0.003% 99.694% ( 34, 51 ] 47 0.003% 99.697% ( 51, 76 ] 125 0.007% 99.704% ( 76, 110 ] 2399 0.132% 99.836% ( 110, 170 ] 1740 0.096% 99.932% ( 170, 250 ] 411 0.023% 99.954% ( 250, 380 ] 419 0.023% 99.978% ( 380, 580 ] 463 0.026% 100.003% ( 580, 870 ] 508 0.028% 100.031% ( 870, 1300 ] 345 0.019% 100.050% ( 1300, 1900 ] 230 0.013% 100.063% ( 1900, 2900 ] 331 0.018% 100.081% ( 2900, 4400 ] 487 0.027% 100.108% ( 4400, 6600 ] 179 0.010% 100.118% ( 6600, 9900 ] 46 0.003% 100.120% ( 9900, 14000 ] 4 0.000% 100.120% ( 14000, 22000 ] 4 0.000% 100.121% ( 22000, 33000 ] 1 0.000% 100.121% ** Level 2 read latency histogram (micros): Count: 75921 Average: 2.0032 StdDev: 4.32 Min: 1 Median: 1.3910 Max: 765 Percentiles: P50: 1.39 P75: 1.79 P99: 5.48 P99.9: 11.16 P99.99: 158.16 ------------------------------------------------------ [ 0, 1 ] 19418 25.577% 25.577% ##### ( 1, 2 ] 47427 62.469% 88.045% ############ ( 2, 3 ] 5238 6.899% 94.945% # ( 3, 4 ] 2137 2.815% 97.760% # ( 4, 6 ] 1269 1.671% 99.431% ( 6, 10 ] 341 0.449% 99.880% ( 10, 15 ] 65 0.086% 99.966% ( 15, 22 ] 12 0.016% 99.982% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 3 0.004% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 480832 Average: 10.0174 StdDev: 164.42 Min: 0 Median: 1.8736 Max: 30913 Percentiles: P50: 1.87 P75: 2.84 P99: 9.73 P99.9: 1100.31 P99.99: 1887.29 ------------------------------------------------------ [ 0, 1 ] 14304 2.975% 2.975% # ( 1, 2 ] 258838 53.831% 56.806% ########### ( 2, 3 ] 104403 21.713% 78.519% #### ( 3, 4 ] 50446 10.491% 89.011% ## ( 4, 6 ] 41036 8.534% 97.545% ## ( 6, 10 ] 7509 1.562% 99.107% ( 10, 15 ] 1461 0.304% 99.410% ( 15, 22 ] 176 0.037% 99.447% ( 22, 34 ] 47 0.010% 99.457% ( 34, 51 ] 8 0.002% 99.458% ( 51, 76 ] 3 0.001% 99.459% ( 76, 110 ] 89 0.019% 99.478% ( 110, 170 ] 246 0.051% 99.529% ( 170, 250 ] 213 0.044% 99.573% ( 250, 380 ] 316 0.066% 99.639% ( 380, 580 ] 447 0.093% 99.732% ( 580, 870 ] 581 0.121% 99.853% ( 870, 1300 ] 426 0.089% 99.941% ( 1300, 1900 ] 240 0.050% 99.991% ( 1900, 2900 ] 204 0.042% 100.033% ( 2900, 4400 ] 205 0.043% 100.076% ( 4400, 6600 ] 53 0.011% 100.087% ( 6600, 9900 ] 14 0.003% 100.090% ( 9900, 14000 ] 7 0.001% 100.092% ( 14000, 22000 ] 5 0.001% 100.093% ( 22000, 33000 ] 3 0.001% 100.093% ** Level 4 read latency histogram (micros): Count: 125539 Average: 16.3479 StdDev: 232.22 Min: 1 Median: 1.9269 Max: 43228 Percentiles: P50: 1.93 P75: 2.91 P99: 143.95 P99.9: 2990.99 P99.99: 4368.85 ------------------------------------------------------ [ 0, 1 ] 2080 1.657% 1.657% ( 1, 2 ] 65475 52.155% 53.812% ########## ( 2, 3 ] 29119 23.195% 77.007% ##### ( 3, 4 ] 13527 10.775% 87.782% ## ( 4, 6 ] 10959 8.730% 96.512% ## ( 6, 10 ] 2487 1.981% 98.493% ( 10, 15 ] 488 0.389% 98.882% ( 15, 22 ] 64 0.051% 98.933% ( 22, 34 ] 18 0.014% 98.947% ( 34, 51 ] 5 0.004% 98.951% ( 51, 76 ] 2 0.002% 98.953% ( 76, 110 ] 20 0.016% 98.968% ( 110, 170 ] 70 0.056% 99.024% ( 170, 250 ] 112 0.089% 99.113% ( 250, 380 ] 147 0.117% 99.231% ( 380, 580 ] 212 0.169% 99.399% ( 580, 870 ] 243 0.194% 99.593% ( 870, 1300 ] 171 0.136% 99.729% ( 1300, 1900 ] 119 0.095% 99.824% ( 1900, 2900 ] 88 0.070% 99.894% ( 2900, 4400 ] 123 0.098% 99.992% ( 4400, 6600 ] 34 0.027% 100.019% ( 6600, 9900 ] 5 0.004% 100.023% ( 9900, 14000 ] 4 0.003% 100.026% ( 14000, 22000 ] 2 0.002% 100.028% ( 33000, 50000 ] 1 0.001% 100.029% ** Level 5 read latency histogram (micros): Count: 260 Average: 1259.7577 StdDev: 1273.25 Min: 85 Median: 733.5294 Max: 5766 Percentiles: P50: 733.53 P75: 2089.19 P99: 5646.67 P99.9: 5766.00 P99.99: 5766.00 ------------------------------------------------------ ( 76, 110 ] 16 6.154% 6.154% # ( 110, 170 ] 30 11.538% 17.692% ## ( 170, 250 ] 18 6.923% 24.615% # ( 250, 380 ] 18 6.923% 31.538% # ( 380, 580 ] 30 11.538% 43.077% ## ( 580, 870 ] 34 13.077% 56.154% ### ( 870, 1300 ] 26 10.000% 66.154% ## ( 1300, 1900 ] 16 6.154% 72.308% # ( 1900, 2900 ] 37 14.231% 86.538% ### ( 2900, 4400 ] 29 11.154% 97.692% ## ( 4400, 6600 ] 6 2.308% 100.000% ** DB Stats ** Uptime(secs): 54.3 total, 3.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 163.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.954 H:M:S, 53.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 311.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.440 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-23:12:34 ... thread 0: (1000000,10000000) ops and (303832.1,174462.1) ops/second in (3.291292,57.319052) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/7 3.80 GB 226.5 9.2 0.0 9.2 18.7 9.5 0.0 2.0 140.3 285.0 67.34 60.57 164 0.411 9592K 17K 0.0 0.0 L1 8/8 904.84 MB 0.0 8.7 5.5 3.1 8.5 5.4 0.2 1.5 218.0 215.3 40.66 38.07 4 10.165 8468K 47K 0.0 0.0 L2 1/0 90.63 MB 0.9 0.3 0.2 0.2 0.3 0.2 4.6 1.8 239.0 238.8 1.46 1.40 2 0.730 354K 179 0.0 0.0 L3 17/0 933.02 MB 0.9 2.0 1.1 0.9 2.0 1.1 3.5 1.8 141.4 140.3 14.80 9.59 10 1.480 2117K 16K 0.0 0.0 L4 159/0 9.64 GB 1.0 4.2 3.4 0.8 4.2 3.4 0.9 1.2 123.1 122.6 34.95 20.85 32 1.092 4349K 17K 0.0 0.0 L5 1096/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/15 105.51 GB 0.0 24.5 10.3 14.2 33.8 19.7 13.5 3.5 157.4 217.7 159.21 130.48 212 0.751 24M 99K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.5 10.3 14.2 33.8 19.7 13.5 3.5 157.4 217.7 159.21 130.48 212 0.751 24M 99K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.5 10.3 14.2 24.3 10.1 0.0 0.0 195.2 193.9 128.38 105.35 76 1.689 24M 99K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 316.8 30.82 25.12 136 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.5 total, 57.3 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.84 GB write, 602.22 MB/s write, 24.47 GB read, 435.41 MB/s read, 159.2 seconds Interval compaction: 33.84 GB write, 604.61 MB/s write, 24.47 GB read, 437.14 MB/s read, 159.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 62, interval: 86 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4268325 Average: 2.8847 StdDev: 38.91 Min: 0 Median: 1.4945 Max: 14475 Percentiles: P50: 1.49 P75: 1.88 P99: 6.31 P99.9: 128.07 P99.99: 377.93 ------------------------------------------------------ [ 0, 1 ] 750093 17.573% 17.573% #### ( 1, 2 ] 2798962 65.575% 83.149% ############# ( 2, 3 ] 424682 9.950% 93.098% ## ( 3, 4 ] 153362 3.593% 96.691% # ( 4, 6 ] 96190 2.254% 98.945% ( 6, 10 ] 30036 0.704% 99.649% ( 10, 15 ] 4657 0.109% 99.758% ( 15, 22 ] 682 0.016% 99.774% ( 22, 34 ] 53 0.001% 99.775% ( 34, 51 ] 18 0.000% 99.775% ( 51, 76 ] 56 0.001% 99.777% ( 76, 110 ] 4242 0.099% 99.876% ( 110, 170 ] 3403 0.080% 99.956% ( 170, 250 ] 794 0.019% 99.974% ( 250, 380 ] 680 0.016% 99.990% ( 380, 580 ] 612 0.014% 100.005% ( 580, 870 ] 316 0.007% 100.012% ( 870, 1300 ] 150 0.004% 100.016% ( 1300, 1900 ] 87 0.002% 100.018% ( 1900, 2900 ] 108 0.003% 100.020% ( 2900, 4400 ] 162 0.004% 100.024% ( 4400, 6600 ] 36 0.001% 100.025% ( 6600, 9900 ] 18 0.000% 100.025% ( 9900, 14000 ] 4 0.000% 100.025% ( 14000, 22000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1962084 Average: 5.4854 StdDev: 99.39 Min: 0 Median: 1.6366 Max: 24412 Percentiles: P50: 1.64 P75: 2.27 P99: 9.07 P99.9: 150.40 P99.99: 481.77 ------------------------------------------------------ [ 0, 1 ] 257390 13.118% 13.118% ### ( 1, 2 ] 1136719 57.934% 71.052% ############ ( 2, 3 ] 288250 14.691% 85.743% ### ( 3, 4 ] 127616 6.504% 92.248% # ( 4, 6 ] 107775 5.493% 97.740% # ( 6, 10 ] 32214 1.642% 99.382% ( 10, 15 ] 5404 0.275% 99.658% ( 15, 22 ] 787 0.040% 99.698% ( 22, 34 ] 55 0.003% 99.701% ( 34, 51 ] 48 0.002% 99.703% ( 51, 76 ] 125 0.006% 99.709% ( 76, 110 ] 2475 0.126% 99.836% ( 110, 170 ] 1877 0.096% 99.931% ( 170, 250 ] 452 0.023% 99.954% ( 250, 380 ] 454 0.023% 99.977% ( 380, 580 ] 485 0.025% 100.002% ( 580, 870 ] 518 0.026% 100.029% ( 870, 1300 ] 347 0.018% 100.046% ( 1300, 1900 ] 230 0.012% 100.058% ( 1900, 2900 ] 332 0.017% 100.075% ( 2900, 4400 ] 488 0.025% 100.100% ( 4400, 6600 ] 179 0.009% 100.109% ( 6600, 9900 ] 46 0.002% 100.111% ( 9900, 14000 ] 4 0.000% 100.111% ( 14000, 22000 ] 4 0.000% 100.112% ( 22000, 33000 ] 1 0.000% 100.112% ** Level 2 read latency histogram (micros): Count: 75921 Average: 2.0032 StdDev: 4.32 Min: 1 Median: 1.3910 Max: 765 Percentiles: P50: 1.39 P75: 1.79 P99: 5.48 P99.9: 11.16 P99.99: 158.16 ------------------------------------------------------ [ 0, 1 ] 19418 25.577% 25.577% ##### ( 1, 2 ] 47427 62.469% 88.045% ############ ( 2, 3 ] 5238 6.899% 94.945% # ( 3, 4 ] 2137 2.815% 97.760% # ( 4, 6 ] 1269 1.671% 99.431% ( 6, 10 ] 341 0.449% 99.880% ( 10, 15 ] 65 0.086% 99.966% ( 15, 22 ] 12 0.016% 99.982% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 3 0.004% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 480832 Average: 10.0174 StdDev: 164.42 Min: 0 Median: 1.8736 Max: 30913 Percentiles: P50: 1.87 P75: 2.84 P99: 9.73 P99.9: 1100.31 P99.99: 1887.29 ------------------------------------------------------ [ 0, 1 ] 14304 2.975% 2.975% # ( 1, 2 ] 258838 53.831% 56.806% ########### ( 2, 3 ] 104403 21.713% 78.519% #### ( 3, 4 ] 50446 10.491% 89.011% ## ( 4, 6 ] 41036 8.534% 97.545% ## ( 6, 10 ] 7509 1.562% 99.107% ( 10, 15 ] 1461 0.304% 99.410% ( 15, 22 ] 176 0.037% 99.447% ( 22, 34 ] 47 0.010% 99.457% ( 34, 51 ] 8 0.002% 99.458% ( 51, 76 ] 3 0.001% 99.459% ( 76, 110 ] 89 0.019% 99.478% ( 110, 170 ] 246 0.051% 99.529% ( 170, 250 ] 213 0.044% 99.573% ( 250, 380 ] 316 0.066% 99.639% ( 380, 580 ] 447 0.093% 99.732% ( 580, 870 ] 581 0.121% 99.853% ( 870, 1300 ] 426 0.089% 99.941% ( 1300, 1900 ] 240 0.050% 99.991% ( 1900, 2900 ] 204 0.042% 100.033% ( 2900, 4400 ] 205 0.043% 100.076% ( 4400, 6600 ] 53 0.011% 100.087% ( 6600, 9900 ] 14 0.003% 100.090% ( 9900, 14000 ] 7 0.001% 100.092% ( 14000, 22000 ] 5 0.001% 100.093% ( 22000, 33000 ] 3 0.001% 100.093% ** Level 4 read latency histogram (micros): Count: 125539 Average: 16.3479 StdDev: 232.22 Min: 1 Median: 1.9269 Max: 43228 Percentiles: P50: 1.93 P75: 2.91 P99: 143.95 P99.9: 2990.99 P99.99: 4368.85 ------------------------------------------------------ [ 0, 1 ] 2080 1.657% 1.657% ( 1, 2 ] 65475 52.155% 53.812% ########## ( 2, 3 ] 29119 23.195% 77.007% ##### ( 3, 4 ] 13527 10.775% 87.782% ## ( 4, 6 ] 10959 8.730% 96.512% ## ( 6, 10 ] 2487 1.981% 98.493% ( 10, 15 ] 488 0.389% 98.882% ( 15, 22 ] 64 0.051% 98.933% ( 22, 34 ] 18 0.014% 98.947% ( 34, 51 ] 5 0.004% 98.951% ( 51, 76 ] 2 0.002% 98.953% ( 76, 110 ] 20 0.016% 98.968% ( 110, 170 ] 70 0.056% 99.024% ( 170, 250 ] 112 0.089% 99.113% ( 250, 380 ] 147 0.117% 99.231% ( 380, 580 ] 212 0.169% 99.399% ( 580, 870 ] 243 0.194% 99.593% ( 870, 1300 ] 171 0.136% 99.729% ( 1300, 1900 ] 119 0.095% 99.824% ( 1900, 2900 ] 88 0.070% 99.894% ( 2900, 4400 ] 123 0.098% 99.992% ( 4400, 6600 ] 34 0.027% 100.019% ( 6600, 9900 ] 5 0.004% 100.023% ( 9900, 14000 ] 4 0.003% 100.026% ( 14000, 22000 ] 2 0.002% 100.028% ( 33000, 50000 ] 1 0.001% 100.029% ** Level 5 read latency histogram (micros): Count: 260 Average: 1259.7577 StdDev: 1273.25 Min: 85 Median: 733.5294 Max: 5766 Percentiles: P50: 733.53 P75: 2089.19 P99: 5646.67 P99.9: 5766.00 P99.99: 5766.00 ------------------------------------------------------ ( 76, 110 ] 16 6.154% 6.154% # ( 110, 170 ] 30 11.538% 17.692% ## ( 170, 250 ] 18 6.923% 24.615% # ( 250, 380 ] 18 6.923% 31.538% # ( 380, 580 ] 30 11.538% 43.077% ## ( 580, 870 ] 34 13.077% 56.154% ### ( 870, 1300 ] 26 10.000% 66.154% ## ( 1300, 1900 ] 16 6.154% 72.308% # ( 1900, 2900 ] 37 14.231% 86.538% ### ( 2900, 4400 ] 29 11.154% 97.692% ## ( 4400, 6600 ] 6 2.308% 100.000% ** DB Stats ** Uptime(secs): 57.5 total, 3.3 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 171.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.554 H:M:S, 51.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.600 H:M:S, 18.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.747 micros/op 173993 ops/sec 60.060 seconds 10449999 operations; 168.6 MB/s Microseconds per write: Count: 10449999 Average: 5.7473 StdDev: 493.50 Min: 0 Median: 1.7390 Max: 832173 Percentiles: P50: 1.74 P75: 2.76 P99: 9.56 P99.9: 1124.49 P99.99: 2697.22 ------------------------------------------------------ [ 0, 1 ] 1393294 13.333% 13.333% ### ( 1, 2 ] 5185160 49.619% 62.952% ########## ( 2, 3 ] 1663034 15.914% 78.866% ### ( 3, 4 ] 1430970 13.693% 92.559% ### ( 4, 6 ] 553012 5.292% 97.851% # ( 6, 10 ] 134957 1.291% 99.143% ( 10, 15 ] 47374 0.453% 99.596% ( 15, 22 ] 10739 0.103% 99.699% ( 22, 34 ] 1983 0.019% 99.718% ( 34, 51 ] 306 0.003% 99.721% ( 51, 76 ] 45 0.000% 99.721% ( 76, 110 ] 7125 0.068% 99.789% ( 110, 170 ] 2929 0.028% 99.818% ( 170, 250 ] 322 0.003% 99.821% ( 250, 380 ] 205 0.002% 99.823% ( 380, 580 ] 30 0.000% 99.823% ( 580, 870 ] 25 0.000% 99.823% ( 870, 1300 ] 13583 0.130% 99.953% ( 1300, 1900 ] 24 0.000% 99.953% ( 1900, 2900 ] 4813 0.046% 99.999% ( 2900, 4400 ] 27 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 7 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 170000, 250000 ] 19 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 181764 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10449999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10784398968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 539 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31039171 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29665326208 rocksdb.compact.write.bytes COUNT : 29473448827 rocksdb.flush.write.bytes COUNT : 10767300793 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 63 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 327 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10680565760 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4218880 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29765222133 rocksdb.non.last.level.read.count COUNT : 7185448 rocksdb.block.checksum.compute.count COUNT : 7184433 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.380928 P95 : 3.922376 P99 : 8.141903 P100 : 832169.000000 COUNT : 10449999 SUM : 55059121 rocksdb.compaction.times.micros P50 : 1221212.121212 P95 : 5400000.000000 P99 : 18800000.000000 P100 : 20203357.000000 COUNT : 80 SUM : 144333732 rocksdb.compaction.times.cpu_micros P50 : 918285.714286 P95 : 5400000.000000 P99 : 15600000.000000 P100 : 18388573.000000 COUNT : 80 SUM : 118831552 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 696.988636 P95 : 1555.000000 P99 : 42690.000000 P100 : 347956.000000 COUNT : 143 SUM : 522812 rocksdb.compaction.outfile.sync.micros P50 : 1022.763158 P95 : 134000.000000 P99 : 241466.666667 P100 : 332730.000000 COUNT : 328 SUM : 5837258 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 102.971154 P95 : 1354.000000 P99 : 2815.000000 P100 : 4851.000000 COUNT : 251 SUM : 70897 rocksdb.table.open.io.micros P50 : 1576.136364 P95 : 8585.500000 P99 : 12526.733333 P100 : 13900.000000 COUNT : 539 SUM : 1237902 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.606748 P95 : 7.248231 P99 : 10.676895 P100 : 43232.000000 COUNT : 7182985 SUM : 45987565 rocksdb.read.block.get.micros P50 : 503.893805 P95 : 3652.205882 P99 : 5593.176471 P100 : 10698.000000 COUNT : 1078 SUM : 1005730 rocksdb.write.raw.block.micros P50 : 0.513898 P95 : 0.976406 P99 : 2.922712 P100 : 45346.000000 COUNT : 9746029 SUM : 20572515 rocksdb.numfiles.in.singlecompaction P50 : 3.314815 P95 : 5.700000 P99 : 30.520000 P100 : 40.000000 COUNT : 129 SUM : 539 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564370 P95 : 1196.191775 P99 : 2568.959983 P100 : 831934.000000 COUNT : 162333 SUM : 31058207 rocksdb.sst.read.micros P50 : 1.556318 P95 : 4.128900 P99 : 8.205509 P100 : 43228.000000 COUNT : 7185796 SUM : 31248225 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10449999 SUM : 10784398968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213529.411765 P95 : 372131.578947 P99 : 818433.333333 P100 : 1023255.000000 COUNT : 143 SUM : 32265659 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 327 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0