[2024-12-16 23:07:27.900687] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 23.11.0 initialization... [2024-12-16 23:07:27.900963] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid430664 ] Set seed to 1734386847894048 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-16 23:07:28.028249] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-16 23:07:28.051905] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-16 23:07:28.051952] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 430664' to capture a snapshot of events at runtime. [2024-12-16 23:07:28.051964] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-16 23:07:28.051975] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-16 23:07:28.051983] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid430664 for offline analysis/debug. [2024-12-16 23:07:28.052577] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 16 23:07:32 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/16-23:07:35 ... thread 0: (1000000,1000000) ops and (331451.7,331451.7) ops/second in (3.017031,3.017031) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 692.97 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 350.3 2.52 2.28 12 0.210 0 0 0.0 0.0 L2 3/2 237.20 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 L3 10/0 818.92 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1183/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.9 317.0 3.88 3.59 14 0.277 354K 208 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.9 317.0 3.88 3.59 14 0.277 354K 208 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 350.3 2.52 2.28 12 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 378.26 MB/s write, 0.34 GB read, 107.22 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 407.61 MB/s write, 0.34 GB read, 115.55 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 136350 Average: 1.9652 StdDev: 11.54 Min: 1 Median: 1.3158 Max: 2714 Percentiles: P50: 1.32 P75: 1.74 P99: 5.38 P99.9: 11.03 P99.99: 21.74 ------------------------------------------------------ [ 0, 1 ] 43029 31.558% 31.558% ###### ( 1, 2 ] 79639 58.408% 89.966% ############ ( 2, 3 ] 7573 5.554% 95.520% # ( 3, 4 ] 3281 2.406% 97.926% ( 4, 6 ] 2133 1.564% 99.490% ( 6, 10 ] 533 0.391% 99.881% ( 10, 15 ] 134 0.098% 99.979% ( 15, 22 ] 17 0.012% 99.992% ( 22, 34 ] 2 0.001% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 110, 170 ] 6 0.004% 99.999% ( 170, 250 ] 7 0.005% 100.004% ( 250, 380 ] 4 0.003% 100.007% ( 380, 580 ] 3 0.002% 100.009% ( 580, 870 ] 1 0.001% 100.010% ( 1300, 1900 ] 1 0.001% 100.010% ( 1900, 2900 ] 2 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 12308 Average: 2.8217 StdDev: 36.45 Min: 1 Median: 1.2389 Max: 3334 Percentiles: P50: 1.24 P75: 1.72 P99: 9.13 P99.9: 163.84 P99.99: 2669.20 ------------------------------------------------------ [ 0, 1 ] 4641 37.707% 37.707% ######## ( 1, 2 ] 6334 51.462% 89.170% ########## ( 2, 3 ] 816 6.630% 95.799% # ( 3, 4 ] 149 1.211% 97.010% ( 4, 6 ] 158 1.284% 98.294% ( 6, 10 ] 111 0.902% 99.196% ( 10, 15 ] 23 0.187% 99.383% ( 15, 22 ] 5 0.041% 99.423% ( 22, 34 ] 2 0.016% 99.439% ( 34, 51 ] 27 0.219% 99.659% ( 51, 76 ] 16 0.130% 99.789% ( 76, 110 ] 11 0.089% 99.878% ( 110, 170 ] 3 0.024% 99.903% ( 170, 250 ] 4 0.032% 99.935% ( 250, 380 ] 2 0.016% 99.951% ( 380, 580 ] 4 0.032% 99.984% ( 1900, 2900 ] 1 0.008% 99.992% ( 2900, 4400 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 70180 Average: 1.9778 StdDev: 4.33 Min: 1 Median: 1.3617 Max: 709 Percentiles: P50: 1.36 P75: 1.77 P99: 5.57 P99.9: 10.69 P99.99: 196.19 ------------------------------------------------------ [ 0, 1 ] 19646 27.994% 27.994% ###### ( 1, 2 ] 42704 60.849% 88.843% ############ ( 2, 3 ] 4203 5.989% 94.832% # ( 3, 4 ] 1844 2.628% 97.459% # ( 4, 6 ] 1377 1.962% 99.421% ( 6, 10 ] 328 0.467% 99.889% ( 10, 15 ] 57 0.081% 99.970% ( 15, 22 ] 8 0.011% 99.981% ( 22, 34 ] 2 0.003% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 50 Average: 1392.7600 StdDev: 1262.68 Min: 56 Median: 1013.3333 Max: 4912 Percentiles: P50: 1013.33 P75: 2400.00 P99: 4912.00 P99.9: 4912.00 P99.99: 4912.00 ------------------------------------------------------ ( 51, 76 ] 2 4.000% 4.000% # ( 76, 110 ] 3 6.000% 10.000% # ( 110, 170 ] 2 4.000% 14.000% # ( 170, 250 ] 5 10.000% 24.000% ## ( 250, 380 ] 2 4.000% 28.000% # ( 380, 580 ] 4 8.000% 36.000% ## ( 580, 870 ] 6 12.000% 48.000% ## ( 870, 1300 ] 3 6.000% 54.000% # ( 1300, 1900 ] 6 12.000% 66.000% ## ( 1900, 2900 ] 9 18.000% 84.000% #### ( 2900, 4400 ] 6 12.000% 96.000% ## ( 4400, 6600 ] 2 4.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 25 Average: 1786.8800 StdDev: 1235.78 Min: 335 Median: 1375.0000 Max: 5004 Percentiles: P50: 1375.00 P75: 2587.50 P99: 5004.00 P99.9: 5004.00 P99.99: 5004.00 ------------------------------------------------------ ( 250, 380 ] 2 8.000% 8.000% ## ( 380, 580 ] 1 4.000% 12.000% # ( 580, 870 ] 3 12.000% 24.000% ## ( 870, 1300 ] 6 24.000% 48.000% ##### ( 1300, 1900 ] 4 16.000% 64.000% ### ( 1900, 2900 ] 4 16.000% 80.000% ### ( 2900, 4400 ] 4 16.000% 96.000% ### ( 4400, 6600 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 3.3 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 302.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.415 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.415 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/16-23:07:38 ... thread 0: (1000000,2000000) ops and (322663.0,326998.3) ops/second in (3.099209,6.116240) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 1.35 GB 25.2 0.8 0.0 0.8 2.6 1.8 0.0 1.4 94.9 313.8 8.63 8.00 29 0.298 831K 849 0.0 0.0 L1 1/1 2.82 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 241.1 240.8 1.31 1.28 1 1.307 319K 385 0.0 0.0 L2 2/1 146.94 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 L3 19/10 1.03 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 227.0 227.0 0.82 0.75 1 0.825 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 126.4 126.4 1.33 0.92 1 1.333 171K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/19 97.98 GB 0.0 1.8 0.8 1.0 3.6 2.7 0.7 2.0 136.6 277.0 13.46 12.26 34 0.396 1866K 1442 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.8 1.0 3.6 2.7 0.7 2.0 136.6 277.0 13.46 12.26 34 0.396 1866K 1442 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.8 1.0 1.8 0.8 0.0 0.0 229.6 229.4 8.01 7.38 8 1.001 1866K 1442 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 346.9 5.45 4.88 26 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.4 total, 6.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.64 GB write, 586.71 MB/s write, 1.80 GB read, 289.43 MB/s read, 13.5 seconds Interval compaction: 3.64 GB write, 609.18 MB/s write, 1.80 GB read, 300.52 MB/s read, 13.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 384701 Average: 2.1883 StdDev: 11.50 Min: 0 Median: 1.4678 Max: 2714 Percentiles: P50: 1.47 P75: 1.86 P99: 5.74 P99.9: 11.93 P99.99: 18.83 ------------------------------------------------------ [ 0, 1 ] 77944 20.261% 20.261% #### ( 1, 2 ] 244576 63.576% 83.837% ############# ( 2, 3 ] 35943 9.343% 93.180% ## ( 3, 4 ] 13953 3.627% 96.807% # ( 4, 6 ] 9711 2.524% 99.331% # ( 6, 10 ] 1991 0.518% 99.848% ( 10, 15 ] 516 0.134% 99.983% ( 15, 22 ] 54 0.014% 99.997% ( 22, 34 ] 6 0.002% 99.998% ( 34, 51 ] 5 0.001% 99.999% ( 51, 76 ] 3 0.001% 100.000% ( 76, 110 ] 1 0.000% 100.001% ( 110, 170 ] 8 0.002% 100.003% ( 170, 250 ] 18 0.005% 100.007% ( 250, 380 ] 8 0.002% 100.009% ( 380, 580 ] 6 0.002% 100.011% ( 580, 870 ] 7 0.002% 100.013% ( 870, 1300 ] 4 0.001% 100.014% ( 1300, 1900 ] 4 0.001% 100.015% ( 1900, 2900 ] 5 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 12329 Average: 3.0687 StdDev: 39.15 Min: 0 Median: 1.2391 Max: 3334 Percentiles: P50: 1.24 P75: 1.73 P99: 9.35 P99.9: 293.45 P99.99: 2667.10 ------------------------------------------------------ [ 0, 1 ] 4649 37.708% 37.708% ######## ( 1, 2 ] 6339 51.415% 89.123% ########## ( 2, 3 ] 816 6.619% 95.742% # ( 3, 4 ] 150 1.217% 96.958% ( 4, 6 ] 158 1.282% 98.240% ( 6, 10 ] 112 0.908% 99.148% ( 10, 15 ] 23 0.187% 99.335% ( 15, 22 ] 5 0.041% 99.375% ( 22, 34 ] 2 0.016% 99.392% ( 34, 51 ] 27 0.219% 99.611% ( 51, 76 ] 16 0.130% 99.740% ( 76, 110 ] 11 0.089% 99.830% ( 110, 170 ] 3 0.024% 99.854% ( 170, 250 ] 4 0.032% 99.886% ( 250, 380 ] 5 0.041% 99.927% ( 380, 580 ] 6 0.049% 99.976% ( 1300, 1900 ] 1 0.008% 99.984% ( 1900, 2900 ] 1 0.008% 99.992% ( 2900, 4400 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 76142 Average: 2.0229 StdDev: 4.18 Min: 1 Median: 1.3922 Max: 709 Percentiles: P50: 1.39 P75: 1.80 P99: 5.66 P99.9: 11.26 P99.99: 180.29 ------------------------------------------------------ [ 0, 1 ] 19902 26.138% 26.138% ##### ( 1, 2 ] 46329 60.846% 86.984% ############ ( 2, 3 ] 5570 7.315% 94.299% # ( 3, 4 ] 2176 2.858% 97.157% # ( 4, 6 ] 1692 2.222% 99.379% ( 6, 10 ] 379 0.498% 99.877% ( 10, 15 ] 71 0.093% 99.970% ( 15, 22 ] 9 0.012% 99.982% ( 22, 34 ] 3 0.004% 99.986% ( 34, 51 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 201040 Average: 3.3063 StdDev: 33.02 Min: 1 Median: 1.6323 Max: 4912 Percentiles: P50: 1.63 P75: 2.16 P99: 8.98 P99.9: 163.94 P99.99: 450.93 ------------------------------------------------------ [ 0, 1 ] 23415 11.647% 11.647% ## ( 1, 2 ] 121944 60.657% 72.304% ############ ( 2, 3 ] 33202 16.515% 88.819% ### ( 3, 4 ] 9440 4.696% 93.514% # ( 4, 6 ] 8404 4.180% 97.694% # ( 6, 10 ] 3521 1.751% 99.446% ( 10, 15 ] 433 0.215% 99.661% ( 15, 22 ] 110 0.055% 99.716% ( 22, 34 ] 29 0.014% 99.730% ( 34, 51 ] 4 0.002% 99.732% ( 51, 76 ] 23 0.011% 99.744% ( 76, 110 ] 101 0.050% 99.794% ( 110, 170 ] 238 0.118% 99.912% ( 170, 250 ] 91 0.045% 99.958% ( 250, 380 ] 51 0.025% 99.983% ( 380, 580 ] 42 0.021% 100.004% ( 580, 870 ] 18 0.009% 100.013% ( 870, 1300 ] 8 0.004% 100.017% ( 1300, 1900 ] 8 0.004% 100.021% ( 1900, 2900 ] 10 0.005% 100.026% ( 2900, 4400 ] 6 0.003% 100.029% ( 4400, 6600 ] 2 0.001% 100.030% ** Level 4 read latency histogram (micros): Count: 315 Average: 147.0857 StdDev: 594.38 Min: 1 Median: 1.9000 Max: 5004 Percentiles: P50: 1.90 P75: 6.60 P99: 3593.75 P99.9: 5004.00 P99.99: 5004.00 ------------------------------------------------------ [ 0, 1 ] 54 17.143% 17.143% ### ( 1, 2 ] 115 36.508% 53.651% ####### ( 2, 3 ] 49 15.556% 69.206% ### ( 3, 4 ] 11 3.492% 72.698% # ( 4, 6 ] 2 0.635% 73.333% ( 6, 10 ] 35 11.111% 84.444% ## ( 10, 15 ] 16 5.079% 89.524% # ( 15, 22 ] 3 0.952% 90.476% ( 22, 34 ] 1 0.317% 90.794% ( 76, 110 ] 1 0.317% 91.111% ( 110, 170 ] 2 0.635% 91.746% ( 170, 250 ] 1 0.317% 92.063% ( 250, 380 ] 2 0.635% 92.698% ( 380, 580 ] 1 0.317% 93.016% ( 580, 870 ] 3 0.952% 93.968% ( 870, 1300 ] 6 1.905% 95.873% ( 1300, 1900 ] 4 1.270% 97.143% ( 1900, 2900 ] 4 1.270% 98.413% ( 2900, 4400 ] 4 1.270% 99.683% ( 4400, 6600 ] 1 0.317% 100.000% ** DB Stats ** Uptime(secs): 6.4 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 309.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.784 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.370 H:M:S, 11.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-23:07:41 ... thread 0: (1000000,3000000) ops and (346926.6,333381.7) ops/second in (2.882454,8.998694) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 2.21 GB 56.6 1.4 0.0 1.4 4.1 2.7 0.0 1.5 104.0 311.8 13.33 12.39 44 0.303 1407K 1445 0.0 0.0 L1 1/1 2.82 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 241.1 240.8 1.31 1.28 1 1.307 319K 385 0.0 0.0 L2 1/0 96.96 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 L3 19/0 843.28 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 239.0 238.6 4.42 4.08 2 2.210 1072K 1563 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 126.4 126.4 1.33 0.92 1 1.333 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/16 98.84 GB 0.0 3.2 0.9 2.3 5.9 3.6 1.4 2.2 150.5 277.8 21.75 19.97 50 0.435 3325K 3601 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 0.9 2.3 5.9 3.6 1.4 2.2 150.5 277.8 21.75 19.97 50 0.435 3325K 3601 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 0.9 2.3 3.2 0.9 0.0 0.0 237.4 237.1 13.79 12.85 11 1.254 3325K 3601 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 348.2 7.96 7.12 39 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.90 GB write, 654.33 MB/s write, 3.20 GB read, 354.58 MB/s read, 21.8 seconds Interval compaction: 5.90 GB write, 671.37 MB/s write, 3.20 GB read, 363.81 MB/s read, 21.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 778426 Average: 2.2433 StdDev: 10.15 Min: 0 Median: 1.5192 Max: 3430 Percentiles: P50: 1.52 P75: 1.90 P99: 5.75 P99.9: 11.22 P99.99: 14.50 ------------------------------------------------------ [ 0, 1 ] 123443 15.858% 15.858% ### ( 1, 2 ] 511897 65.761% 81.619% ############# ( 2, 3 ] 85413 10.973% 92.591% ## ( 3, 4 ] 31207 4.009% 96.600% # ( 4, 6 ] 21294 2.736% 99.336% # ( 6, 10 ] 4134 0.531% 99.867% ( 10, 15 ] 1070 0.137% 100.004% ( 15, 22 ] 99 0.013% 100.017% ( 22, 34 ] 7 0.001% 100.018% ( 34, 51 ] 5 0.001% 100.018% ( 51, 76 ] 6 0.001% 100.019% ( 76, 110 ] 27 0.003% 100.023% ( 110, 170 ] 16 0.002% 100.025% ( 170, 250 ] 27 0.003% 100.028% ( 250, 380 ] 16 0.002% 100.030% ( 380, 580 ] 10 0.001% 100.031% ( 580, 870 ] 11 0.001% 100.033% ( 870, 1300 ] 7 0.001% 100.034% ( 1300, 1900 ] 5 0.001% 100.034% ( 1900, 2900 ] 6 0.001% 100.035% ( 2900, 4400 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 12329 Average: 3.0687 StdDev: 39.15 Min: 0 Median: 1.2391 Max: 3334 Percentiles: P50: 1.24 P75: 1.73 P99: 9.35 P99.9: 293.45 P99.99: 2667.10 ------------------------------------------------------ [ 0, 1 ] 4649 37.708% 37.708% ######## ( 1, 2 ] 6339 51.415% 89.123% ########## ( 2, 3 ] 816 6.619% 95.742% # ( 3, 4 ] 150 1.217% 96.958% ( 4, 6 ] 158 1.282% 98.240% ( 6, 10 ] 112 0.908% 99.148% ( 10, 15 ] 23 0.187% 99.335% ( 15, 22 ] 5 0.041% 99.375% ( 22, 34 ] 2 0.016% 99.392% ( 34, 51 ] 27 0.219% 99.611% ( 51, 76 ] 16 0.130% 99.740% ( 76, 110 ] 11 0.089% 99.830% ( 110, 170 ] 3 0.024% 99.854% ( 170, 250 ] 4 0.032% 99.886% ( 250, 380 ] 5 0.041% 99.927% ( 380, 580 ] 6 0.049% 99.976% ( 1300, 1900 ] 1 0.008% 99.984% ( 1900, 2900 ] 1 0.008% 99.992% ( 2900, 4400 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 88532 Average: 2.0708 StdDev: 3.90 Min: 1 Median: 1.4268 Max: 709 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 11.56 P99.99: 144.40 ------------------------------------------------------ [ 0, 1 ] 20951 23.665% 23.665% ##### ( 1, 2 ] 54631 61.708% 85.373% ############ ( 2, 3 ] 7202 8.135% 93.507% ## ( 3, 4 ] 2936 3.316% 96.824% # ( 4, 6 ] 2245 2.536% 99.360% # ( 6, 10 ] 450 0.508% 99.868% ( 10, 15 ] 91 0.103% 99.971% ( 15, 22 ] 12 0.014% 99.984% ( 22, 34 ] 3 0.003% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250803 Average: 3.2758 StdDev: 30.74 Min: 1 Median: 1.6201 Max: 4912 Percentiles: P50: 1.62 P75: 2.10 P99: 8.96 P99.9: 177.00 P99.99: 519.73 ------------------------------------------------------ [ 0, 1 ] 29239 11.658% 11.658% ## ( 1, 2 ] 155072 61.830% 73.488% ############ ( 2, 3 ] 38764 15.456% 88.944% ### ( 3, 4 ] 11840 4.721% 93.665% # ( 4, 6 ] 10117 4.034% 97.699% # ( 6, 10 ] 4416 1.761% 99.460% ( 10, 15 ] 502 0.200% 99.660% ( 15, 22 ] 118 0.047% 99.707% ( 22, 34 ] 29 0.012% 99.719% ( 34, 51 ] 4 0.002% 99.720% ( 51, 76 ] 29 0.012% 99.732% ( 76, 110 ] 118 0.047% 99.779% ( 110, 170 ] 293 0.117% 99.896% ( 170, 250 ] 128 0.051% 99.947% ( 250, 380 ] 67 0.027% 99.973% ( 380, 580 ] 60 0.024% 99.997% ( 580, 870 ] 26 0.010% 100.008% ( 870, 1300 ] 14 0.006% 100.013% ( 1300, 1900 ] 8 0.003% 100.016% ( 1900, 2900 ] 10 0.004% 100.020% ( 2900, 4400 ] 6 0.002% 100.023% ( 4400, 6600 ] 2 0.001% 100.024% ** Level 4 read latency histogram (micros): Count: 315 Average: 147.0857 StdDev: 594.38 Min: 1 Median: 1.9000 Max: 5004 Percentiles: P50: 1.90 P75: 6.60 P99: 3593.75 P99.9: 5004.00 P99.99: 5004.00 ------------------------------------------------------ [ 0, 1 ] 54 17.143% 17.143% ### ( 1, 2 ] 115 36.508% 53.651% ####### ( 2, 3 ] 49 15.556% 69.206% ### ( 3, 4 ] 11 3.492% 72.698% # ( 4, 6 ] 2 0.635% 73.333% ( 6, 10 ] 35 11.111% 84.444% ## ( 10, 15 ] 16 5.079% 89.524% # ( 15, 22 ] 3 0.952% 90.476% ( 22, 34 ] 1 0.317% 90.794% ( 76, 110 ] 1 0.317% 91.111% ( 110, 170 ] 2 0.635% 91.746% ( 170, 250 ] 1 0.317% 92.063% ( 250, 380 ] 2 0.635% 92.698% ( 380, 580 ] 1 0.317% 93.016% ( 580, 870 ] 3 0.952% 93.968% ( 870, 1300 ] 6 1.905% 95.873% ( 1300, 1900 ] 4 1.270% 97.143% ( 1900, 2900 ] 4 1.270% 98.413% ( 2900, 4400 ] 4 1.270% 99.683% ( 4400, 6600 ] 1 0.317% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1192.1500 StdDev: 1254.28 Min: 135 Median: 725.0000 Max: 4216 Percentiles: P50: 725.00 P75: 1300.00 P99: 4216.00 P99.9: 4216.00 P99.99: 4216.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 2 10.000% 25.000% ## ( 250, 380 ] 2 10.000% 35.000% ## ( 380, 580 ] 1 5.000% 40.000% # ( 580, 870 ] 4 20.000% 60.000% #### ( 870, 1300 ] 3 15.000% 75.000% ### ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.2 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 319.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.991 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 341.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.207 H:M:S, 7.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/16-23:07:44 ... thread 0: (1000000,4000000) ops and (329911.4,332507.3) ops/second in (3.031117,12.029811) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 2.09 GB 12.6 2.5 0.0 2.5 6.1 3.7 0.0 1.7 123.6 308.8 20.39 19.07 62 0.329 2558K 2664 0.0 0.0 L1 10/10 1.10 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 230.6 229.6 6.29 6.11 2 3.146 1473K 5768 0.0 0.0 L2 1/0 96.96 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 L3 19/0 843.28 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 239.0 238.6 4.42 4.08 2 2.210 1072K 1563 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 126.4 126.4 1.33 0.92 1 1.333 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1264/20 99.82 GB 0.0 5.4 2.0 3.4 9.1 5.7 1.4 2.5 164.0 275.6 33.80 31.50 69 0.490 5629K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 2.0 3.4 9.1 5.7 1.4 2.5 164.0 275.6 33.80 31.50 69 0.490 5629K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 2.0 3.4 5.4 2.0 0.0 0.0 240.6 240.1 23.04 21.88 16 1.440 5629K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 351.5 10.75 9.62 53 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.10 GB write, 759.30 MB/s write, 5.41 GB read, 452.00 MB/s read, 33.8 seconds Interval compaction: 9.10 GB write, 774.08 MB/s write, 5.41 GB read, 460.80 MB/s read, 33.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1073055 Average: 2.2262 StdDev: 12.08 Min: 0 Median: 1.4941 Max: 3430 Percentiles: P50: 1.49 P75: 1.88 P99: 5.70 P99.9: 11.28 P99.99: 14.76 ------------------------------------------------------ [ 0, 1 ] 189201 17.632% 17.632% #### ( 1, 2 ] 702913 65.506% 83.138% ############# ( 2, 3 ] 109460 10.201% 93.339% ## ( 3, 4 ] 38977 3.632% 96.971% # ( 4, 6 ] 25542 2.380% 99.351% ( 6, 10 ] 5536 0.516% 99.867% ( 10, 15 ] 1385 0.129% 99.996% ( 15, 22 ] 118 0.011% 100.007% ( 22, 34 ] 10 0.001% 100.008% ( 34, 51 ] 8 0.001% 100.009% ( 51, 76 ] 11 0.001% 100.010% ( 76, 110 ] 44 0.004% 100.014% ( 110, 170 ] 42 0.004% 100.018% ( 170, 250 ] 41 0.004% 100.022% ( 250, 380 ] 26 0.002% 100.024% ( 380, 580 ] 23 0.002% 100.026% ( 580, 870 ] 19 0.002% 100.028% ( 870, 1300 ] 16 0.001% 100.030% ( 1300, 1900 ] 11 0.001% 100.031% ( 1900, 2900 ] 6 0.001% 100.031% ( 2900, 4400 ] 5 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 23356 Average: 3.8354 StdDev: 39.16 Min: 0 Median: 1.2625 Max: 3334 Percentiles: P50: 1.26 P75: 1.72 P99: 14.78 P99.9: 468.59 P99.99: 1849.66 ------------------------------------------------------ [ 0, 1 ] 8337 35.695% 35.695% ####### ( 1, 2 ] 12729 54.500% 90.195% ########### ( 2, 3 ] 1172 5.018% 95.213% # ( 3, 4 ] 360 1.541% 96.755% ( 4, 6 ] 263 1.126% 97.881% ( 6, 10 ] 227 0.972% 98.853% ( 10, 15 ] 36 0.154% 99.007% ( 15, 22 ] 9 0.039% 99.045% ( 22, 34 ] 2 0.009% 99.054% ( 34, 51 ] 28 0.120% 99.174% ( 51, 76 ] 17 0.073% 99.246% ( 76, 110 ] 81 0.347% 99.593% ( 110, 170 ] 41 0.176% 99.769% ( 170, 250 ] 11 0.047% 99.816% ( 250, 380 ] 13 0.056% 99.872% ( 380, 580 ] 15 0.064% 99.936% ( 580, 870 ] 7 0.030% 99.966% ( 870, 1300 ] 2 0.009% 99.974% ( 1300, 1900 ] 4 0.017% 99.991% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 88532 Average: 2.0708 StdDev: 3.90 Min: 1 Median: 1.4268 Max: 709 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 11.56 P99.99: 144.40 ------------------------------------------------------ [ 0, 1 ] 20951 23.665% 23.665% ##### ( 1, 2 ] 54631 61.708% 85.373% ############ ( 2, 3 ] 7202 8.135% 93.507% ## ( 3, 4 ] 2936 3.316% 96.824% # ( 4, 6 ] 2245 2.536% 99.360% # ( 6, 10 ] 450 0.508% 99.868% ( 10, 15 ] 91 0.103% 99.971% ( 15, 22 ] 12 0.014% 99.984% ( 22, 34 ] 3 0.003% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250803 Average: 3.2758 StdDev: 30.74 Min: 1 Median: 1.6201 Max: 4912 Percentiles: P50: 1.62 P75: 2.10 P99: 8.96 P99.9: 177.00 P99.99: 519.73 ------------------------------------------------------ [ 0, 1 ] 29239 11.658% 11.658% ## ( 1, 2 ] 155072 61.830% 73.488% ############ ( 2, 3 ] 38764 15.456% 88.944% ### ( 3, 4 ] 11840 4.721% 93.665% # ( 4, 6 ] 10117 4.034% 97.699% # ( 6, 10 ] 4416 1.761% 99.460% ( 10, 15 ] 502 0.200% 99.660% ( 15, 22 ] 118 0.047% 99.707% ( 22, 34 ] 29 0.012% 99.719% ( 34, 51 ] 4 0.002% 99.720% ( 51, 76 ] 29 0.012% 99.732% ( 76, 110 ] 118 0.047% 99.779% ( 110, 170 ] 293 0.117% 99.896% ( 170, 250 ] 128 0.051% 99.947% ( 250, 380 ] 67 0.027% 99.973% ( 380, 580 ] 60 0.024% 99.997% ( 580, 870 ] 26 0.010% 100.008% ( 870, 1300 ] 14 0.006% 100.013% ( 1300, 1900 ] 8 0.003% 100.016% ( 1900, 2900 ] 10 0.004% 100.020% ( 2900, 4400 ] 6 0.002% 100.023% ( 4400, 6600 ] 2 0.001% 100.024% ** Level 4 read latency histogram (micros): Count: 315 Average: 147.0857 StdDev: 594.38 Min: 1 Median: 1.9000 Max: 5004 Percentiles: P50: 1.90 P75: 6.60 P99: 3593.75 P99.9: 5004.00 P99.99: 5004.00 ------------------------------------------------------ [ 0, 1 ] 54 17.143% 17.143% ### ( 1, 2 ] 115 36.508% 53.651% ####### ( 2, 3 ] 49 15.556% 69.206% ### ( 3, 4 ] 11 3.492% 72.698% # ( 4, 6 ] 2 0.635% 73.333% ( 6, 10 ] 35 11.111% 84.444% ## ( 10, 15 ] 16 5.079% 89.524% # ( 15, 22 ] 3 0.952% 90.476% ( 22, 34 ] 1 0.317% 90.794% ( 76, 110 ] 1 0.317% 91.111% ( 110, 170 ] 2 0.635% 91.746% ( 170, 250 ] 1 0.317% 92.063% ( 250, 380 ] 2 0.635% 92.698% ( 380, 580 ] 1 0.317% 93.016% ( 580, 870 ] 3 0.952% 93.968% ( 870, 1300 ] 6 1.905% 95.873% ( 1300, 1900 ] 4 1.270% 97.143% ( 1900, 2900 ] 4 1.270% 98.413% ( 2900, 4400 ] 4 1.270% 99.683% ( 4400, 6600 ] 1 0.317% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1192.1500 StdDev: 1254.28 Min: 135 Median: 725.0000 Max: 4216 Percentiles: P50: 725.00 P75: 1300.00 P99: 4216.00 P99.9: 4216.00 P99.99: 4216.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 2 10.000% 25.000% ## ( 250, 380 ] 2 10.000% 35.000% ## ( 380, 580 ] 1 5.000% 40.000% # ( 580, 870 ] 4 20.000% 60.000% #### ( 870, 1300 ] 3 15.000% 75.000% ### ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.3 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 320.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.386 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.394 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/16-23:07:47 ... thread 0: (1000000,5000000) ops and (324738.0,330923.8) ops/second in (3.079406,15.109217) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 3.07 GB 113.3 3.3 0.0 3.3 7.9 4.7 0.0 1.7 126.9 308.6 26.32 24.64 79 0.333 3390K 3591 0.0 0.0 L1 10/10 1.10 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 230.6 229.6 6.29 6.11 2 3.146 1473K 5768 0.0 0.0 L2 1/0 96.96 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 L3 19/0 843.28 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 239.0 238.6 4.42 4.08 2 2.210 1072K 1563 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 126.4 126.4 1.33 0.92 1 1.333 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/20 100.80 GB 0.0 6.2 2.0 4.2 10.9 6.7 1.4 2.3 160.2 280.4 39.73 37.06 86 0.462 6461K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 2.0 4.2 10.9 6.7 1.4 2.3 160.2 280.4 39.73 37.06 86 0.462 6461K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 2.0 4.2 6.2 2.0 0.0 0.0 243.6 243.2 26.12 24.90 19 1.375 6461K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 351.7 13.61 12.17 67 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.1 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.88 GB write, 725.92 MB/s write, 6.21 GB read, 414.67 MB/s read, 39.7 seconds Interval compaction: 10.88 GB write, 737.17 MB/s write, 6.21 GB read, 421.10 MB/s read, 39.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 15, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1392970 Average: 2.2234 StdDev: 11.42 Min: 0 Median: 1.4975 Max: 3430 Percentiles: P50: 1.50 P75: 1.88 P99: 5.70 P99.9: 11.14 P99.99: 14.72 ------------------------------------------------------ [ 0, 1 ] 239203 17.172% 17.172% ### ( 1, 2 ] 919151 65.985% 83.157% ############# ( 2, 3 ] 143151 10.277% 93.434% ## ( 3, 4 ] 49870 3.580% 97.014% # ( 4, 6 ] 32492 2.333% 99.347% ( 6, 10 ] 7313 0.525% 99.871% ( 10, 15 ] 1748 0.125% 99.997% ( 15, 22 ] 151 0.011% 100.008% ( 22, 34 ] 13 0.001% 100.009% ( 34, 51 ] 11 0.001% 100.010% ( 51, 76 ] 13 0.001% 100.010% ( 76, 110 ] 50 0.004% 100.014% ( 110, 170 ] 55 0.004% 100.018% ( 170, 250 ] 56 0.004% 100.022% ( 250, 380 ] 35 0.003% 100.025% ( 380, 580 ] 27 0.002% 100.026% ( 580, 870 ] 24 0.002% 100.028% ( 870, 1300 ] 19 0.001% 100.030% ( 1300, 1900 ] 16 0.001% 100.031% ( 1900, 2900 ] 7 0.001% 100.031% ( 2900, 4400 ] 5 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 86274 Average: 2.9050 StdDev: 22.52 Min: 0 Median: 1.4600 Max: 3334 Percentiles: P50: 1.46 P75: 1.85 P99: 8.67 P99.9: 172.64 P99.99: 923.41 ------------------------------------------------------ [ 0, 1 ] 17924 20.776% 20.776% #### ( 1, 2 ] 54814 63.535% 84.310% ############# ( 2, 3 ] 8009 9.283% 93.594% ## ( 3, 4 ] 2250 2.608% 96.202% # ( 4, 6 ] 1620 1.878% 98.079% ( 6, 10 ] 1192 1.382% 99.461% ( 10, 15 ] 98 0.114% 99.575% ( 15, 22 ] 15 0.017% 99.592% ( 22, 34 ] 3 0.003% 99.595% ( 34, 51 ] 28 0.032% 99.628% ( 51, 76 ] 17 0.020% 99.648% ( 76, 110 ] 123 0.143% 99.790% ( 110, 170 ] 94 0.109% 99.899% ( 170, 250 ] 22 0.026% 99.925% ( 250, 380 ] 21 0.024% 99.949% ( 380, 580 ] 24 0.028% 99.977% ( 580, 870 ] 11 0.013% 99.990% ( 870, 1300 ] 3 0.003% 99.993% ( 1300, 1900 ] 4 0.005% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 88532 Average: 2.0708 StdDev: 3.90 Min: 1 Median: 1.4268 Max: 709 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 11.56 P99.99: 144.40 ------------------------------------------------------ [ 0, 1 ] 20951 23.665% 23.665% ##### ( 1, 2 ] 54631 61.708% 85.373% ############ ( 2, 3 ] 7202 8.135% 93.507% ## ( 3, 4 ] 2936 3.316% 96.824% # ( 4, 6 ] 2245 2.536% 99.360% # ( 6, 10 ] 450 0.508% 99.868% ( 10, 15 ] 91 0.103% 99.971% ( 15, 22 ] 12 0.014% 99.984% ( 22, 34 ] 3 0.003% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250803 Average: 3.2758 StdDev: 30.74 Min: 1 Median: 1.6201 Max: 4912 Percentiles: P50: 1.62 P75: 2.10 P99: 8.96 P99.9: 177.00 P99.99: 519.73 ------------------------------------------------------ [ 0, 1 ] 29239 11.658% 11.658% ## ( 1, 2 ] 155072 61.830% 73.488% ############ ( 2, 3 ] 38764 15.456% 88.944% ### ( 3, 4 ] 11840 4.721% 93.665% # ( 4, 6 ] 10117 4.034% 97.699% # ( 6, 10 ] 4416 1.761% 99.460% ( 10, 15 ] 502 0.200% 99.660% ( 15, 22 ] 118 0.047% 99.707% ( 22, 34 ] 29 0.012% 99.719% ( 34, 51 ] 4 0.002% 99.720% ( 51, 76 ] 29 0.012% 99.732% ( 76, 110 ] 118 0.047% 99.779% ( 110, 170 ] 293 0.117% 99.896% ( 170, 250 ] 128 0.051% 99.947% ( 250, 380 ] 67 0.027% 99.973% ( 380, 580 ] 60 0.024% 99.997% ( 580, 870 ] 26 0.010% 100.008% ( 870, 1300 ] 14 0.006% 100.013% ( 1300, 1900 ] 8 0.003% 100.016% ( 1900, 2900 ] 10 0.004% 100.020% ( 2900, 4400 ] 6 0.002% 100.023% ( 4400, 6600 ] 2 0.001% 100.024% ** Level 4 read latency histogram (micros): Count: 315 Average: 147.0857 StdDev: 594.38 Min: 1 Median: 1.9000 Max: 5004 Percentiles: P50: 1.90 P75: 6.60 P99: 3593.75 P99.9: 5004.00 P99.99: 5004.00 ------------------------------------------------------ [ 0, 1 ] 54 17.143% 17.143% ### ( 1, 2 ] 115 36.508% 53.651% ####### ( 2, 3 ] 49 15.556% 69.206% ### ( 3, 4 ] 11 3.492% 72.698% # ( 4, 6 ] 2 0.635% 73.333% ( 6, 10 ] 35 11.111% 84.444% ## ( 10, 15 ] 16 5.079% 89.524% # ( 15, 22 ] 3 0.952% 90.476% ( 22, 34 ] 1 0.317% 90.794% ( 76, 110 ] 1 0.317% 91.111% ( 110, 170 ] 2 0.635% 91.746% ( 170, 250 ] 1 0.317% 92.063% ( 250, 380 ] 2 0.635% 92.698% ( 380, 580 ] 1 0.317% 93.016% ( 580, 870 ] 3 0.952% 93.968% ( 870, 1300 ] 6 1.905% 95.873% ( 1300, 1900 ] 4 1.270% 97.143% ( 1900, 2900 ] 4 1.270% 98.413% ( 2900, 4400 ] 4 1.270% 99.683% ( 4400, 6600 ] 1 0.317% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1192.1500 StdDev: 1254.28 Min: 135 Median: 725.0000 Max: 4216 Percentiles: P50: 725.00 P75: 1300.00 P99: 4216.00 P99.9: 4216.00 P99.99: 4216.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 2 10.000% 25.000% ## ( 250, 380 ] 2 10.000% 35.000% ## ( 380, 580 ] 1 5.000% 40.000% # ( 580, 870 ] 4 20.000% 60.000% #### ( 870, 1300 ] 3 15.000% 75.000% ### ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 15.3 total, 3.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 320.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.785 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.400 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/16-23:07:58 ... thread 0: (1000000,6000000) ops and (93494.9,232513.1) ops/second in (10.695776,25.804993) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 4.05 GB 187.8 5.5 0.0 5.5 11.2 5.6 0.0 2.0 147.2 297.3 38.51 35.98 98 0.393 5755K 14K 0.0 0.0 L1 10/10 1.10 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 230.6 229.6 6.29 6.11 2 3.146 1473K 5768 0.0 0.0 L2 1/0 96.96 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 L3 19/0 843.28 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 239.0 238.6 4.42 4.08 2 2.210 1072K 1563 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 126.4 126.4 1.33 0.92 1 1.333 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/24 101.77 GB 0.0 8.5 2.0 6.5 14.1 7.6 1.4 2.5 167.4 278.6 51.92 48.40 105 0.494 8826K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.5 2.0 6.5 14.1 7.6 1.4 2.5 167.4 278.6 51.92 48.40 105 0.494 8826K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.5 2.0 6.5 8.5 2.0 0.0 0.0 246.1 245.5 35.32 33.58 23 1.536 8826K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 349.2 16.60 14.81 82 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.0 total, 25.8 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.13 GB write, 555.51 MB/s write, 8.49 GB read, 333.81 MB/s read, 51.9 seconds Interval compaction: 14.13 GB write, 560.55 MB/s write, 8.49 GB read, 336.84 MB/s read, 51.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 17, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2361369 Average: 2.6603 StdDev: 15.61 Min: 0 Median: 1.4880 Max: 4841 Percentiles: P50: 1.49 P75: 1.87 P99: 6.59 P99.9: 139.57 P99.99: 268.97 ------------------------------------------------------ [ 0, 1 ] 417709 17.689% 17.689% #### ( 1, 2 ] 1563416 66.208% 83.897% ############# ( 2, 3 ] 224931 9.525% 93.423% ## ( 3, 4 ] 79959 3.386% 96.809% # ( 4, 6 ] 49404 2.092% 98.901% ( 6, 10 ] 15777 0.668% 99.569% ( 10, 15 ] 2914 0.123% 99.693% ( 15, 22 ] 266 0.011% 99.704% ( 22, 34 ] 20 0.001% 99.705% ( 34, 51 ] 16 0.001% 99.705% ( 51, 76 ] 49 0.002% 99.707% ( 76, 110 ] 3137 0.133% 99.840% ( 110, 170 ] 2860 0.121% 99.961% ( 170, 250 ] 614 0.026% 99.987% ( 250, 380 ] 417 0.018% 100.005% ( 380, 580 ] 318 0.013% 100.019% ( 580, 870 ] 127 0.005% 100.024% ( 870, 1300 ] 42 0.002% 100.026% ( 1300, 1900 ] 21 0.001% 100.027% ( 1900, 2900 ] 15 0.001% 100.027% ( 2900, 4400 ] 9 0.000% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 291226 Average: 2.7985 StdDev: 16.04 Min: 0 Median: 1.4932 Max: 3334 Percentiles: P50: 1.49 P75: 1.87 P99: 8.66 P99.9: 158.16 P99.99: 566.71 ------------------------------------------------------ [ 0, 1 ] 51216 17.586% 17.586% #### ( 1, 2 ] 191396 65.721% 83.307% ############# ( 2, 3 ] 27821 9.553% 92.860% ## ( 3, 4 ] 8924 3.064% 95.924% # ( 4, 6 ] 6352 2.181% 98.106% ( 6, 10 ] 3923 1.347% 99.453% ( 10, 15 ] 353 0.121% 99.574% ( 15, 22 ] 34 0.012% 99.586% ( 22, 34 ] 3 0.001% 99.587% ( 34, 51 ] 29 0.010% 99.597% ( 51, 76 ] 31 0.011% 99.607% ( 76, 110 ] 494 0.170% 99.777% ( 110, 170 ] 447 0.153% 99.930% ( 170, 250 ] 71 0.024% 99.955% ( 250, 380 ] 59 0.020% 99.975% ( 380, 580 ] 47 0.016% 99.991% ( 580, 870 ] 15 0.005% 99.996% ( 870, 1300 ] 4 0.001% 99.998% ( 1300, 1900 ] 4 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 88532 Average: 2.0708 StdDev: 3.90 Min: 1 Median: 1.4268 Max: 709 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 11.56 P99.99: 144.40 ------------------------------------------------------ [ 0, 1 ] 20951 23.665% 23.665% ##### ( 1, 2 ] 54631 61.708% 85.373% ############ ( 2, 3 ] 7202 8.135% 93.507% ## ( 3, 4 ] 2936 3.316% 96.824% # ( 4, 6 ] 2245 2.536% 99.360% # ( 6, 10 ] 450 0.508% 99.868% ( 10, 15 ] 91 0.103% 99.971% ( 15, 22 ] 12 0.014% 99.984% ( 22, 34 ] 3 0.003% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250803 Average: 3.2758 StdDev: 30.74 Min: 1 Median: 1.6201 Max: 4912 Percentiles: P50: 1.62 P75: 2.10 P99: 8.96 P99.9: 177.00 P99.99: 519.73 ------------------------------------------------------ [ 0, 1 ] 29239 11.658% 11.658% ## ( 1, 2 ] 155072 61.830% 73.488% ############ ( 2, 3 ] 38764 15.456% 88.944% ### ( 3, 4 ] 11840 4.721% 93.665% # ( 4, 6 ] 10117 4.034% 97.699% # ( 6, 10 ] 4416 1.761% 99.460% ( 10, 15 ] 502 0.200% 99.660% ( 15, 22 ] 118 0.047% 99.707% ( 22, 34 ] 29 0.012% 99.719% ( 34, 51 ] 4 0.002% 99.720% ( 51, 76 ] 29 0.012% 99.732% ( 76, 110 ] 118 0.047% 99.779% ( 110, 170 ] 293 0.117% 99.896% ( 170, 250 ] 128 0.051% 99.947% ( 250, 380 ] 67 0.027% 99.973% ( 380, 580 ] 60 0.024% 99.997% ( 580, 870 ] 26 0.010% 100.008% ( 870, 1300 ] 14 0.006% 100.013% ( 1300, 1900 ] 8 0.003% 100.016% ( 1900, 2900 ] 10 0.004% 100.020% ( 2900, 4400 ] 6 0.002% 100.023% ( 4400, 6600 ] 2 0.001% 100.024% ** Level 4 read latency histogram (micros): Count: 315 Average: 147.0857 StdDev: 594.38 Min: 1 Median: 1.9000 Max: 5004 Percentiles: P50: 1.90 P75: 6.60 P99: 3593.75 P99.9: 5004.00 P99.99: 5004.00 ------------------------------------------------------ [ 0, 1 ] 54 17.143% 17.143% ### ( 1, 2 ] 115 36.508% 53.651% ####### ( 2, 3 ] 49 15.556% 69.206% ### ( 3, 4 ] 11 3.492% 72.698% # ( 4, 6 ] 2 0.635% 73.333% ( 6, 10 ] 35 11.111% 84.444% ## ( 10, 15 ] 16 5.079% 89.524% # ( 15, 22 ] 3 0.952% 90.476% ( 22, 34 ] 1 0.317% 90.794% ( 76, 110 ] 1 0.317% 91.111% ( 110, 170 ] 2 0.635% 91.746% ( 170, 250 ] 1 0.317% 92.063% ( 250, 380 ] 2 0.635% 92.698% ( 380, 580 ] 1 0.317% 93.016% ( 580, 870 ] 3 0.952% 93.968% ( 870, 1300 ] 6 1.905% 95.873% ( 1300, 1900 ] 4 1.270% 97.143% ( 1900, 2900 ] 4 1.270% 98.413% ( 2900, 4400 ] 4 1.270% 99.683% ( 4400, 6600 ] 1 0.317% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1192.1500 StdDev: 1254.28 Min: 135 Median: 725.0000 Max: 4216 Percentiles: P50: 725.00 P75: 1300.00 P99: 4216.00 P99.9: 4216.00 P99.99: 4216.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 2 10.000% 25.000% ## ( 250, 380 ] 2 10.000% 35.000% ## ( 380, 580 ] 1 5.000% 40.000% # ( 580, 870 ] 4 20.000% 60.000% #### ( 870, 1300 ] 3 15.000% 75.000% ### ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 26.0 total, 10.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 226.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.421 H:M:S, 36.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 92.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.636 H:M:S, 71.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-23:08:03 ... thread 0: (1000000,7000000) ops and (183767.6,224024.0) ops/second in (5.441657,31.246650) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 3.06 GB 56.6 6.5 0.0 6.5 13.1 6.6 0.0 2.0 146.0 294.5 45.72 42.51 117 0.391 6778K 15K 0.0 0.0 L1 14/14 1.52 GB 0.0 4.5 3.4 1.1 4.4 3.3 0.2 1.3 219.0 216.8 20.98 19.74 3 6.993 4666K 46K 0.0 0.0 L2 2/2 257.56 MB 0.0 0.3 0.2 0.2 0.3 0.2 1.9 1.8 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 L3 35/10 1.42 GB 1.0 2.7 1.6 1.1 2.7 1.6 0.2 1.7 218.5 218.1 12.70 11.64 7 1.815 2819K 5710 0.0 0.0 L4 179/4 9.72 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.8 1.0 133.5 133.4 2.55 1.78 4 0.638 346K 310 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/37 102.71 GB 0.0 14.4 5.5 8.9 21.0 12.1 4.1 3.2 176.9 257.7 83.32 76.99 133 0.626 14M 68K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.4 5.5 8.9 21.0 12.1 4.1 3.2 176.9 257.7 83.32 76.99 133 0.626 14M 68K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.4 5.5 8.9 14.3 5.4 0.0 0.0 231.1 230.1 63.76 59.59 36 1.771 14M 68K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 347.7 19.57 17.39 97 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.5 total, 31.2 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.97 GB write, 682.01 MB/s write, 14.39 GB read, 468.10 MB/s read, 83.3 seconds Interval compaction: 20.97 GB write, 687.13 MB/s write, 14.39 GB read, 471.61 MB/s read, 83.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 20, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2836863 Average: 2.6597 StdDev: 15.17 Min: 0 Median: 1.5176 Max: 4841 Percentiles: P50: 1.52 P75: 1.90 P99: 6.94 P99.9: 131.00 P99.99: 249.42 ------------------------------------------------------ [ 0, 1 ] 455260 16.048% 16.048% ### ( 1, 2 ] 1860841 65.595% 81.643% ############# ( 2, 3 ] 301533 10.629% 92.272% ## ( 3, 4 ] 110208 3.885% 96.157% # ( 4, 6 ] 75387 2.657% 98.814% # ( 6, 10 ] 22374 0.789% 99.603% ( 10, 15 ] 3803 0.134% 99.737% ( 15, 22 ] 344 0.012% 99.749% ( 22, 34 ] 26 0.001% 99.750% ( 34, 51 ] 17 0.001% 99.751% ( 51, 76 ] 52 0.002% 99.753% ( 76, 110 ] 3155 0.111% 99.864% ( 110, 170 ] 2932 0.103% 99.967% ( 170, 250 ] 652 0.023% 99.990% ( 250, 380 ] 440 0.016% 100.006% ( 380, 580 ] 348 0.012% 100.018% ( 580, 870 ] 145 0.005% 100.023% ( 870, 1300 ] 48 0.002% 100.025% ( 1300, 1900 ] 25 0.001% 100.026% ( 1900, 2900 ] 18 0.001% 100.026% ( 2900, 4400 ] 11 0.000% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 716313 Average: 3.3067 StdDev: 28.83 Min: 0 Median: 1.6302 Max: 7059 Percentiles: P50: 1.63 P75: 2.09 P99: 8.83 P99.9: 163.89 P99.99: 510.63 ------------------------------------------------------ [ 0, 1 ] 69112 9.648% 9.648% ## ( 1, 2 ] 458667 64.032% 73.680% ############# ( 2, 3 ] 107269 14.975% 88.655% ### ( 3, 4 ] 35878 5.009% 93.664% # ( 4, 6 ] 29664 4.141% 97.805% # ( 6, 10 ] 12094 1.688% 99.493% ( 10, 15 ] 1383 0.193% 99.686% ( 15, 22 ] 184 0.026% 99.712% ( 22, 34 ] 14 0.002% 99.714% ( 34, 51 ] 32 0.004% 99.719% ( 51, 76 ] 36 0.005% 99.724% ( 76, 110 ] 618 0.086% 99.810% ( 110, 170 ] 720 0.101% 99.910% ( 170, 250 ] 237 0.033% 99.943% ( 250, 380 ] 207 0.029% 99.972% ( 380, 580 ] 195 0.027% 100.000% ( 580, 870 ] 118 0.016% 100.016% ( 870, 1300 ] 64 0.009% 100.025% ( 1300, 1900 ] 32 0.004% 100.029% ( 1900, 2900 ] 14 0.002% 100.031% ( 2900, 4400 ] 10 0.001% 100.033% ( 4400, 6600 ] 2 0.000% 100.033% ( 6600, 9900 ] 1 0.000% 100.033% ** Level 2 read latency histogram (micros): Count: 88532 Average: 2.0708 StdDev: 3.90 Min: 1 Median: 1.4268 Max: 709 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 11.56 P99.99: 144.40 ------------------------------------------------------ [ 0, 1 ] 20951 23.665% 23.665% ##### ( 1, 2 ] 54631 61.708% 85.373% ############ ( 2, 3 ] 7202 8.135% 93.507% ## ( 3, 4 ] 2936 3.316% 96.824% # ( 4, 6 ] 2245 2.536% 99.360% # ( 6, 10 ] 450 0.508% 99.868% ( 10, 15 ] 91 0.103% 99.971% ( 15, 22 ] 12 0.014% 99.984% ( 22, 34 ] 3 0.003% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 385011 Average: 3.6230 StdDev: 29.61 Min: 0 Median: 1.7444 Max: 4912 Percentiles: P50: 1.74 P75: 2.57 P99: 9.11 P99.9: 138.54 P99.99: 209.67 ------------------------------------------------------ [ 0, 1 ] 30992 8.050% 8.050% ## ( 1, 2 ] 216971 56.354% 64.404% ########### ( 2, 3 ] 71181 18.488% 82.892% #### ( 3, 4 ] 28438 7.386% 90.278% # ( 4, 6 ] 27619 7.174% 97.452% # ( 6, 10 ] 7661 1.990% 99.442% ( 10, 15 ] 1110 0.288% 99.730% ( 15, 22 ] 191 0.050% 99.780% ( 22, 34 ] 32 0.008% 99.788% ( 34, 51 ] 5 0.001% 99.789% ( 51, 76 ] 41 0.011% 99.800% ( 76, 110 ] 180 0.047% 99.847% ( 110, 170 ] 433 0.112% 99.959% ( 170, 250 ] 241 0.063% 100.022% ( 250, 380 ] 140 0.036% 100.058% ( 380, 580 ] 123 0.032% 100.090% ( 580, 870 ] 63 0.016% 100.106% ( 870, 1300 ] 34 0.009% 100.115% ( 1300, 1900 ] 11 0.003% 100.118% ( 1900, 2900 ] 10 0.003% 100.121% ( 2900, 4400 ] 8 0.002% 100.123% ( 4400, 6600 ] 2 0.001% 100.123% ** Level 4 read latency histogram (micros): Count: 4780 Average: 95.8243 StdDev: 451.28 Min: 1 Median: 2.1525 Max: 5516 Percentiles: P50: 2.15 P75: 3.66 P99: 2715.38 P99.9: 5431.56 P99.99: 5516.00 ------------------------------------------------------ [ 0, 1 ] 134 2.803% 2.803% # ( 1, 2 ] 2104 44.017% 46.820% ######### ( 2, 3 ] 997 20.858% 67.678% #### ( 3, 4 ] 529 11.067% 78.745% ## ( 4, 6 ] 366 7.657% 86.402% ## ( 6, 10 ] 130 2.720% 89.121% # ( 10, 15 ] 28 0.586% 89.707% ( 15, 22 ] 8 0.167% 89.874% ( 22, 34 ] 1 0.021% 89.895% ( 76, 110 ] 42 0.879% 90.774% ( 110, 170 ] 60 1.255% 92.029% ( 170, 250 ] 43 0.900% 92.929% ( 250, 380 ] 56 1.172% 94.100% ( 380, 580 ] 81 1.695% 95.795% ( 580, 870 ] 60 1.255% 97.050% ( 870, 1300 ] 38 0.795% 97.845% ( 1300, 1900 ] 34 0.711% 98.556% ( 1900, 2900 ] 26 0.544% 99.100% ( 2900, 4400 ] 34 0.711% 99.812% ( 4400, 6600 ] 9 0.188% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 898.3500 StdDev: 1095.58 Min: 81 Median: 413.3333 Max: 4216 Percentiles: P50: 413.33 P75: 1156.67 P99: 4216.00 P99.9: 4216.00 P99.99: 4216.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 6 10.000% 30.000% ## ( 170, 250 ] 4 6.667% 36.667% # ( 250, 380 ] 7 11.667% 48.333% ## ( 380, 580 ] 6 10.000% 58.333% ## ( 580, 870 ] 6 10.000% 68.333% ## ( 870, 1300 ] 6 10.000% 78.333% ## ( 1300, 1900 ] 3 5.000% 83.333% # ( 1900, 2900 ] 4 6.667% 90.000% # ( 2900, 4400 ] 6 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 31.5 total, 5.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 218.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.985 H:M:S, 38.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 180.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.564 H:M:S, 47.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/12/16-23:08:06 ... thread 0: (1000000,8000000) ops and (297566.4,231165.5) ops/second in (3.360594,34.607244) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 3.99 GB 119.6 7.1 0.0 7.1 14.6 7.6 0.0 1.9 142.2 294.0 50.94 47.12 132 0.386 7354K 15K 0.0 0.0 L1 14/14 1.52 GB 0.0 4.5 3.4 1.1 4.4 3.3 0.2 1.3 219.0 216.8 20.98 19.74 3 6.993 4666K 46K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 1.9 1.8 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 L3 25/0 966.02 MB 1.0 3.2 1.8 1.4 3.2 1.8 0.2 1.8 214.4 213.9 15.39 13.98 9 1.710 3351K 6575 0.0 0.0 L4 181/0 9.46 GB 1.0 1.1 1.0 0.0 1.1 1.0 0.8 1.0 134.6 134.4 8.34 5.43 18 0.463 1117K 924 0.0 0.0 L5 1068/0 87.72 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/25 103.63 GB 0.0 16.2 6.4 9.8 23.7 13.9 5.1 3.1 171.2 250.3 97.01 87.58 164 0.592 16M 70K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.2 6.4 9.8 23.7 13.9 5.1 3.1 171.2 250.3 97.01 87.58 164 0.592 16M 70K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.2 6.4 9.8 16.1 6.4 0.0 0.0 223.1 222.1 74.45 67.75 54 1.379 16M 70K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 343.4 22.57 19.83 110 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.8 total, 34.6 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.72 GB write, 697.00 MB/s write, 16.22 GB read, 476.68 MB/s read, 97.0 seconds Interval compaction: 23.72 GB write, 701.72 MB/s write, 16.22 GB read, 479.91 MB/s read, 97.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 29, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3151725 Average: 2.6890 StdDev: 17.19 Min: 0 Median: 1.5294 Max: 10023 Percentiles: P50: 1.53 P75: 1.91 P99: 7.11 P99.9: 128.08 P99.99: 254.63 ------------------------------------------------------ [ 0, 1 ] 487172 15.457% 15.457% ### ( 1, 2 ] 2056569 65.252% 80.709% ############# ( 2, 3 ] 349865 11.101% 91.810% ## ( 3, 4 ] 127729 4.053% 95.863% # ( 4, 6 ] 91504 2.903% 98.766% # ( 6, 10 ] 26665 0.846% 99.612% ( 10, 15 ] 4446 0.141% 99.753% ( 15, 22 ] 417 0.013% 99.767% ( 22, 34 ] 28 0.001% 99.767% ( 34, 51 ] 21 0.001% 99.768% ( 51, 76 ] 54 0.002% 99.770% ( 76, 110 ] 3198 0.101% 99.871% ( 110, 170 ] 3007 0.095% 99.967% ( 170, 250 ] 718 0.023% 99.989% ( 250, 380 ] 501 0.016% 100.005% ( 380, 580 ] 399 0.013% 100.018% ( 580, 870 ] 176 0.006% 100.024% ( 870, 1300 ] 61 0.002% 100.026% ( 1300, 1900 ] 35 0.001% 100.027% ( 1900, 2900 ] 23 0.001% 100.027% ( 2900, 4400 ] 17 0.001% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ( 9900, 14000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 805294 Average: 3.2516 StdDev: 27.58 Min: 0 Median: 1.6358 Max: 7059 Percentiles: P50: 1.64 P75: 2.11 P99: 8.81 P99.9: 157.68 P99.99: 483.91 ------------------------------------------------------ [ 0, 1 ] 73978 9.186% 9.186% ## ( 1, 2 ] 516970 64.196% 73.383% ############# ( 2, 3 ] 123296 15.311% 88.694% ### ( 3, 4 ] 40314 5.006% 93.700% # ( 4, 6 ] 33006 4.099% 97.798% # ( 6, 10 ] 13769 1.710% 99.508% ( 10, 15 ] 1574 0.195% 99.704% ( 15, 22 ] 204 0.025% 99.729% ( 22, 34 ] 16 0.002% 99.731% ( 34, 51 ] 32 0.004% 99.735% ( 51, 76 ] 36 0.004% 99.739% ( 76, 110 ] 690 0.086% 99.825% ( 110, 170 ] 761 0.094% 99.920% ( 170, 250 ] 248 0.031% 99.950% ( 250, 380 ] 215 0.027% 99.977% ( 380, 580 ] 203 0.025% 100.002% ( 580, 870 ] 122 0.015% 100.017% ( 870, 1300 ] 65 0.008% 100.025% ( 1300, 1900 ] 33 0.004% 100.030% ( 1900, 2900 ] 15 0.002% 100.031% ( 2900, 4400 ] 10 0.001% 100.033% ( 4400, 6600 ] 2 0.000% 100.033% ( 6600, 9900 ] 1 0.000% 100.033% ** Level 2 read latency histogram (micros): Count: 88532 Average: 2.0708 StdDev: 3.90 Min: 1 Median: 1.4268 Max: 709 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 11.56 P99.99: 144.40 ------------------------------------------------------ [ 0, 1 ] 20951 23.665% 23.665% ##### ( 1, 2 ] 54631 61.708% 85.373% ############ ( 2, 3 ] 7202 8.135% 93.507% ## ( 3, 4 ] 2936 3.316% 96.824% # ( 4, 6 ] 2245 2.536% 99.360% # ( 6, 10 ] 450 0.508% 99.868% ( 10, 15 ] 91 0.103% 99.971% ( 15, 22 ] 12 0.014% 99.984% ( 22, 34 ] 3 0.003% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 577045 Average: 3.5256 StdDev: 30.06 Min: 0 Median: 1.8069 Max: 6049 Percentiles: P50: 1.81 P75: 2.71 P99: 8.79 P99.9: 21.86 P99.99: 141.35 ------------------------------------------------------ [ 0, 1 ] 33561 5.816% 5.816% # ( 1, 2 ] 315994 54.761% 60.577% ########### ( 2, 3 ] 116797 20.241% 80.817% #### ( 3, 4 ] 49052 8.501% 89.318% ## ( 4, 6 ] 48347 8.378% 97.696% ## ( 6, 10 ] 10799 1.871% 99.568% ( 10, 15 ] 1664 0.288% 99.856% ( 15, 22 ] 259 0.045% 99.901% ( 22, 34 ] 35 0.006% 99.907% ( 34, 51 ] 5 0.001% 99.908% ( 51, 76 ] 42 0.007% 99.915% ( 76, 110 ] 194 0.034% 99.949% ( 110, 170 ] 456 0.079% 100.028% ( 170, 250 ] 252 0.044% 100.071% ( 250, 380 ] 161 0.028% 100.099% ( 380, 580 ] 146 0.025% 100.125% ( 580, 870 ] 73 0.013% 100.137% ( 870, 1300 ] 41 0.007% 100.144% ( 1300, 1900 ] 16 0.003% 100.147% ( 1900, 2900 ] 12 0.002% 100.149% ( 2900, 4400 ] 10 0.002% 100.151% ( 4400, 6600 ] 6 0.001% 100.152% ** Level 4 read latency histogram (micros): Count: 13003 Average: 94.9164 StdDev: 477.46 Min: 1 Median: 2.0374 Max: 17273 Percentiles: P50: 2.04 P75: 3.44 P99: 2376.46 P99.9: 5683.06 P99.99: 9404.50 ------------------------------------------------------ [ 0, 1 ] 356 2.738% 2.738% # ( 1, 2 ] 6044 46.482% 49.219% ######### ( 2, 3 ] 2717 20.895% 70.115% #### ( 3, 4 ] 1428 10.982% 81.097% ## ( 4, 6 ] 925 7.114% 88.210% # ( 6, 10 ] 305 2.346% 90.556% ( 10, 15 ] 59 0.454% 91.010% ( 15, 22 ] 13 0.100% 91.110% ( 22, 34 ] 2 0.015% 91.125% ( 76, 110 ] 51 0.392% 91.517% ( 110, 170 ] 91 0.700% 92.217% ( 170, 250 ] 80 0.615% 92.832% ( 250, 380 ] 127 0.977% 93.809% ( 380, 580 ] 190 1.461% 95.270% ( 580, 870 ] 214 1.646% 96.916% ( 870, 1300 ] 137 1.054% 97.970% ( 1300, 1900 ] 103 0.792% 98.762% ( 1900, 2900 ] 65 0.500% 99.262% ( 2900, 4400 ] 69 0.531% 99.792% ( 4400, 6600 ] 24 0.185% 99.977% ( 6600, 9900 ] 2 0.015% 99.992% ( 9900, 14000 ] 1 0.008% 100.000% ( 14000, 22000 ] 1 0.008% 100.008% ** Level 5 read latency histogram (micros): Count: 120 Average: 982.7333 StdDev: 1099.23 Min: 81 Median: 513.3333 Max: 4346 Percentiles: P50: 513.33 P75: 1269.29 P99: 4261.54 P99.9: 4346.00 P99.99: 4346.00 ------------------------------------------------------ ( 76, 110 ] 14 11.667% 11.667% ## ( 110, 170 ] 14 11.667% 23.333% ## ( 170, 250 ] 7 5.833% 29.167% # ( 250, 380 ] 17 14.167% 43.333% ### ( 380, 580 ] 12 10.000% 53.333% ## ( 580, 870 ] 13 10.833% 64.167% ## ( 870, 1300 ] 14 11.667% 75.833% ## ( 1300, 1900 ] 6 5.000% 80.833% # ( 1900, 2900 ] 10 8.333% 89.167% ## ( 2900, 4400 ] 13 10.833% 100.000% ## ** DB Stats ** Uptime(secs): 34.8 total, 3.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 225.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.648 H:M:S, 36.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 292.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.663 H:M:S, 19.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-23:08:23 ... thread 0: (1000000,9000000) ops and (59546.4,175094.3) ops/second in (16.793630,51.400874) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/5 2.45 GB 31.5 9.5 0.0 9.5 18.0 8.5 0.0 2.1 149.9 284.9 64.68 59.29 152 0.426 9847K 24K 0.0 0.0 L1 6/6 735.82 MB 0.0 8.5 5.9 2.6 8.4 5.8 0.2 1.4 220.9 218.1 39.49 37.15 4 9.873 8253K 46K 0.0 0.0 L2 16/14 2.01 GB 2.6 0.3 0.2 0.2 0.3 0.2 5.1 1.8 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 L3 25/2 1.00 GB 0.9 5.4 3.0 2.5 5.4 2.9 0.3 1.8 175.6 174.8 31.74 24.54 20 1.587 5661K 25K 0.0 0.0 L4 179/0 9.63 GB 1.0 2.4 2.2 0.2 2.4 2.2 0.8 1.1 136.9 136.5 17.72 11.51 32 0.554 2427K 2934 0.0 0.0 L5 1080/0 88.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1315/27 104.53 GB 0.0 26.1 11.3 14.9 34.5 19.6 9.4 4.0 172.7 228.1 155.00 133.80 210 0.738 26M 100K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.1 11.3 14.9 34.5 19.6 9.4 4.0 172.7 228.1 155.00 133.80 210 0.738 26M 100K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.1 11.3 14.9 26.0 11.1 0.0 0.0 207.3 206.0 129.12 111.36 85 1.519 26M 100K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 338.4 25.88 22.44 125 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.6 total, 51.4 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.53 GB write, 684.80 MB/s write, 26.14 GB read, 518.42 MB/s read, 155.0 seconds Interval compaction: 34.53 GB write, 687.92 MB/s write, 26.14 GB read, 520.78 MB/s read, 155.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 38, pending-compaction-bytes-stops: 0, total-delays: 51, total-stops: 37, interval: 88 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4079480 Average: 2.8000 StdDev: 19.51 Min: 0 Median: 1.5351 Max: 10023 Percentiles: P50: 1.54 P75: 1.92 P99: 7.62 P99.9: 141.62 P99.99: 338.38 ------------------------------------------------------ [ 0, 1 ] 633716 15.534% 15.534% ### ( 1, 2 ] 2627716 64.413% 79.947% ############# ( 2, 3 ] 453253 11.111% 91.058% ## ( 3, 4 ] 174729 4.283% 95.341% # ( 4, 6 ] 133649 3.276% 98.617% # ( 6, 10 ] 38613 0.947% 99.564% ( 10, 15 ] 6265 0.154% 99.717% ( 15, 22 ] 720 0.018% 99.735% ( 22, 34 ] 37 0.001% 99.736% ( 34, 51 ] 35 0.001% 99.737% ( 51, 76 ] 110 0.003% 99.739% ( 76, 110 ] 4246 0.104% 99.843% ( 110, 170 ] 4386 0.108% 99.951% ( 170, 250 ] 1096 0.027% 99.978% ( 250, 380 ] 737 0.018% 99.996% ( 380, 580 ] 610 0.015% 100.011% ( 580, 870 ] 296 0.007% 100.018% ( 870, 1300 ] 126 0.003% 100.021% ( 1300, 1900 ] 63 0.002% 100.023% ( 1900, 2900 ] 34 0.001% 100.023% ( 2900, 4400 ] 27 0.001% 100.024% ( 4400, 6600 ] 4 0.000% 100.024% ( 6600, 9900 ] 1 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1849954 Average: 4.3983 StdDev: 56.65 Min: 0 Median: 1.6930 Max: 8477 Percentiles: P50: 1.69 P75: 2.46 P99: 9.24 P99.9: 183.91 P99.99: 586.61 ------------------------------------------------------ [ 0, 1 ] 191065 10.328% 10.328% ## ( 1, 2 ] 1059048 57.247% 67.575% ########### ( 2, 3 ] 300764 16.258% 83.833% ### ( 3, 4 ] 125723 6.796% 90.629% # ( 4, 6 ] 123528 6.677% 97.307% # ( 6, 10 ] 38705 2.092% 99.399% ( 10, 15 ] 5661 0.306% 99.705% ( 15, 22 ] 840 0.045% 99.750% ( 22, 34 ] 40 0.002% 99.752% ( 34, 51 ] 49 0.003% 99.755% ( 51, 76 ] 159 0.009% 99.764% ( 76, 110 ] 1147 0.062% 99.826% ( 110, 170 ] 1291 0.070% 99.895% ( 170, 250 ] 489 0.026% 99.922% ( 250, 380 ] 555 0.030% 99.952% ( 380, 580 ] 692 0.037% 99.989% ( 580, 870 ] 614 0.033% 100.022% ( 870, 1300 ] 472 0.026% 100.048% ( 1300, 1900 ] 231 0.012% 100.060% ( 1900, 2900 ] 156 0.008% 100.069% ( 2900, 4400 ] 174 0.009% 100.078% ( 4400, 6600 ] 40 0.002% 100.080% ( 6600, 9900 ] 3 0.000% 100.081% ** Level 2 read latency histogram (micros): Count: 88532 Average: 2.0708 StdDev: 3.90 Min: 1 Median: 1.4268 Max: 709 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 11.56 P99.99: 144.40 ------------------------------------------------------ [ 0, 1 ] 20951 23.665% 23.665% ##### ( 1, 2 ] 54631 61.708% 85.373% ############ ( 2, 3 ] 7202 8.135% 93.507% ## ( 3, 4 ] 2936 3.316% 96.824% # ( 4, 6 ] 2245 2.536% 99.360% # ( 6, 10 ] 450 0.508% 99.868% ( 10, 15 ] 91 0.103% 99.971% ( 15, 22 ] 12 0.014% 99.984% ( 22, 34 ] 3 0.003% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1182917 Average: 4.5150 StdDev: 51.72 Min: 0 Median: 1.9221 Max: 7741 Percentiles: P50: 1.92 P75: 2.95 P99: 9.13 P99.9: 21.14 P99.99: 191.95 ------------------------------------------------------ [ 0, 1 ] 39605 3.348% 3.348% # ( 1, 2 ] 598493 50.595% 53.943% ########## ( 2, 3 ] 260927 22.058% 76.001% #### ( 3, 4 ] 123284 10.422% 86.423% ## ( 4, 6 ] 128066 10.826% 97.249% ## ( 6, 10 ] 26470 2.238% 99.487% ( 10, 15 ] 4384 0.371% 99.857% ( 15, 22 ] 576 0.049% 99.906% ( 22, 34 ] 49 0.004% 99.910% ( 34, 51 ] 14 0.001% 99.911% ( 51, 76 ] 68 0.006% 99.917% ( 76, 110 ] 218 0.018% 99.935% ( 110, 170 ] 544 0.046% 99.981% ( 170, 250 ] 367 0.031% 100.013% ( 250, 380 ] 384 0.032% 100.045% ( 380, 580 ] 467 0.039% 100.084% ( 580, 870 ] 444 0.038% 100.122% ( 870, 1300 ] 272 0.023% 100.145% ( 1300, 1900 ] 110 0.009% 100.154% ( 1900, 2900 ] 74 0.006% 100.161% ( 2900, 4400 ] 84 0.007% 100.168% ( 4400, 6600 ] 25 0.002% 100.170% ( 6600, 9900 ] 1 0.000% 100.170% ** Level 4 read latency histogram (micros): Count: 41608 Average: 71.7098 StdDev: 395.74 Min: 0 Median: 2.0075 Max: 17273 Percentiles: P50: 2.01 P75: 3.34 P99: 1847.22 P99.9: 4784.63 P99.99: 6500.96 ------------------------------------------------------ [ 0, 1 ] 899 2.161% 2.161% ( 1, 2 ] 19838 47.678% 49.839% ########## ( 2, 3 ] 8907 21.407% 71.246% #### ( 3, 4 ] 4641 11.154% 82.400% ## ( 4, 6 ] 3505 8.424% 90.824% ## ( 6, 10 ] 1041 2.502% 93.326% # ( 10, 15 ] 171 0.411% 93.737% ( 15, 22 ] 32 0.077% 93.814% ( 22, 34 ] 4 0.010% 93.823% ( 34, 51 ] 3 0.007% 93.831% ( 51, 76 ] 3 0.007% 93.838% ( 76, 110 ] 58 0.139% 93.977% ( 110, 170 ] 122 0.293% 94.270% ( 170, 250 ] 139 0.334% 94.604% ( 250, 380 ] 244 0.586% 95.191% ( 380, 580 ] 438 1.053% 96.244% ( 580, 870 ] 525 1.262% 97.505% ( 870, 1300 ] 393 0.945% 98.450% ( 1300, 1900 ] 251 0.603% 99.053% ( 1900, 2900 ] 164 0.394% 99.447% ( 2900, 4400 ] 180 0.433% 99.880% ( 4400, 6600 ] 48 0.115% 99.995% ( 6600, 9900 ] 4 0.010% 100.005% ( 9900, 14000 ] 2 0.005% 100.010% ( 14000, 22000 ] 1 0.002% 100.012% ** Level 5 read latency histogram (micros): Count: 180 Average: 1137.0833 StdDev: 1230.28 Min: 81 Median: 571.6667 Max: 5104 Percentiles: P50: 571.67 P75: 1642.86 P99: 5104.00 P99.9: 5104.00 P99.99: 5104.00 ------------------------------------------------------ ( 76, 110 ] 14 7.778% 7.778% ## ( 110, 170 ] 18 10.000% 17.778% ## ( 170, 250 ] 9 5.000% 22.778% # ( 250, 380 ] 26 14.444% 37.222% ### ( 380, 580 ] 24 13.333% 50.556% ### ( 580, 870 ] 18 10.000% 60.556% ## ( 870, 1300 ] 18 10.000% 70.556% ## ( 1300, 1900 ] 14 7.778% 78.333% ## ( 1900, 2900 ] 15 8.333% 86.667% ## ( 2900, 4400 ] 21 11.667% 98.333% ## ( 4400, 6600 ] 3 1.667% 100.000% ** DB Stats ** Uptime(secs): 51.6 total, 16.8 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 171.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.982 H:M:S, 50.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 58.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.334 H:M:S, 79.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/16-23:08:28 ... thread 0: (1000000,10000000) ops and (227870.9,179245.8) ops/second in (4.388450,55.789324) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 3.37 GB 94.4 10.1 0.0 10.1 19.5 9.4 0.0 2.1 144.9 280.6 71.30 64.31 166 0.430 10M 25K 0.0 0.0 L1 6/6 735.82 MB 0.0 8.5 5.9 2.6 8.4 5.8 0.2 1.4 220.9 218.1 39.49 37.15 4 9.873 8253K 46K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 5.1 1.8 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 L3 21/0 985.20 MB 1.0 7.7 5.0 2.7 7.6 5.0 0.3 1.5 169.1 168.4 46.47 34.98 24 1.936 7459K 28K 0.0 0.0 L4 180/0 9.71 GB 1.0 4.5 4.2 0.2 4.5 4.2 0.9 1.1 134.2 133.9 34.07 21.57 55 0.619 4539K 2934 0.0 0.0 L5 1104/0 90.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1326/15 105.44 GB 0.0 31.1 15.3 15.8 40.4 24.6 11.4 4.3 165.2 214.6 192.70 159.32 251 0.768 31M 104K 0.0 0.0 Int 0/0 0.00 KB 0.0 31.1 15.3 15.8 40.4 24.6 11.4 4.3 165.2 214.6 192.70 159.32 251 0.768 31M 104K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 31.1 15.3 15.8 30.9 15.1 0.0 0.0 195.4 194.3 162.90 134.37 114 1.429 31M 104K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 325.6 29.79 24.95 137 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.0 total, 55.8 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.39 GB write, 738.18 MB/s write, 31.09 GB read, 568.17 MB/s read, 192.7 seconds Interval compaction: 40.39 GB write, 741.28 MB/s write, 31.09 GB read, 570.56 MB/s read, 192.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 38, pending-compaction-bytes-stops: 0, total-delays: 51, total-stops: 59, interval: 110 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4491147 Average: 2.9034 StdDev: 26.36 Min: 0 Median: 1.5567 Max: 10023 Percentiles: P50: 1.56 P75: 1.95 P99: 7.81 P99.9: 137.64 P99.99: 340.78 ------------------------------------------------------ [ 0, 1 ] 653324 14.547% 14.547% ### ( 1, 2 ] 2860222 63.686% 78.233% ############# ( 2, 3 ] 536086 11.937% 90.169% ## ( 3, 4 ] 207295 4.616% 94.785% # ( 4, 6 ] 168213 3.745% 98.530% # ( 6, 10 ] 46547 1.036% 99.567% ( 10, 15 ] 7635 0.170% 99.737% ( 15, 22 ] 834 0.019% 99.755% ( 22, 34 ] 52 0.001% 99.756% ( 34, 51 ] 41 0.001% 99.757% ( 51, 76 ] 113 0.003% 99.760% ( 76, 110 ] 4261 0.095% 99.855% ( 110, 170 ] 4415 0.098% 99.953% ( 170, 250 ] 1126 0.025% 99.978% ( 250, 380 ] 766 0.017% 99.995% ( 380, 580 ] 645 0.014% 100.010% ( 580, 870 ] 333 0.007% 100.017% ( 870, 1300 ] 158 0.004% 100.020% ( 1300, 1900 ] 84 0.002% 100.022% ( 1900, 2900 ] 73 0.002% 100.024% ( 2900, 4400 ] 70 0.002% 100.026% ( 4400, 6600 ] 20 0.000% 100.026% ( 6600, 9900 ] 5 0.000% 100.026% ( 9900, 14000 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1983043 Average: 4.6152 StdDev: 63.70 Min: 0 Median: 1.7044 Max: 8477 Percentiles: P50: 1.70 P75: 2.49 P99: 9.26 P99.9: 209.36 P99.99: 681.81 ------------------------------------------------------ [ 0, 1 ] 192990 9.732% 9.732% ## ( 1, 2 ] 1133662 57.168% 66.900% ########### ( 2, 3 ] 330441 16.663% 83.563% ### ( 3, 4 ] 137395 6.928% 90.492% # ( 4, 6 ] 134536 6.784% 97.276% # ( 6, 10 ] 41960 2.116% 99.392% ( 10, 15 ] 6186 0.312% 99.704% ( 15, 22 ] 907 0.046% 99.750% ( 22, 34 ] 41 0.002% 99.752% ( 34, 51 ] 52 0.003% 99.754% ( 51, 76 ] 160 0.008% 99.762% ( 76, 110 ] 1170 0.059% 99.821% ( 110, 170 ] 1312 0.066% 99.887% ( 170, 250 ] 504 0.025% 99.913% ( 250, 380 ] 577 0.029% 99.942% ( 380, 580 ] 720 0.036% 99.978% ( 580, 870 ] 660 0.033% 100.012% ( 870, 1300 ] 514 0.026% 100.038% ( 1300, 1900 ] 278 0.014% 100.052% ( 1900, 2900 ] 203 0.010% 100.062% ( 2900, 4400 ] 222 0.011% 100.073% ( 4400, 6600 ] 64 0.003% 100.076% ( 6600, 9900 ] 9 0.000% 100.077% ** Level 2 read latency histogram (micros): Count: 88532 Average: 2.0708 StdDev: 3.90 Min: 1 Median: 1.4268 Max: 709 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 11.56 P99.99: 144.40 ------------------------------------------------------ [ 0, 1 ] 20951 23.665% 23.665% ##### ( 1, 2 ] 54631 61.708% 85.373% ############ ( 2, 3 ] 7202 8.135% 93.507% ## ( 3, 4 ] 2936 3.316% 96.824% # ( 4, 6 ] 2245 2.536% 99.360% # ( 6, 10 ] 450 0.508% 99.868% ( 10, 15 ] 91 0.103% 99.971% ( 15, 22 ] 12 0.014% 99.984% ( 22, 34 ] 3 0.003% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1740805 Average: 5.4727 StdDev: 77.99 Min: 0 Median: 1.9540 Max: 8866 Percentiles: P50: 1.95 P75: 2.99 P99: 9.12 P99.9: 16.85 P99.99: 169.04 ------------------------------------------------------ [ 0, 1 ] 43604 2.505% 2.505% # ( 1, 2 ] 866691 49.787% 52.292% ########## ( 2, 3 ] 400247 22.992% 75.284% ##### ( 3, 4 ] 188126 10.807% 86.091% ## ( 4, 6 ] 194874 11.194% 97.285% ## ( 6, 10 ] 38247 2.197% 99.482% ( 10, 15 ] 7053 0.405% 99.887% ( 15, 22 ] 843 0.048% 99.936% ( 22, 34 ] 65 0.004% 99.939% ( 34, 51 ] 24 0.001% 99.941% ( 51, 76 ] 70 0.004% 99.945% ( 76, 110 ] 228 0.013% 99.958% ( 110, 170 ] 568 0.033% 99.991% ( 170, 250 ] 425 0.024% 100.015% ( 250, 380 ] 502 0.029% 100.044% ( 380, 580 ] 664 0.038% 100.082% ( 580, 870 ] 672 0.039% 100.121% ( 870, 1300 ] 473 0.027% 100.148% ( 1300, 1900 ] 262 0.015% 100.163% ( 1900, 2900 ] 279 0.016% 100.179% ( 2900, 4400 ] 319 0.018% 100.197% ( 4400, 6600 ] 83 0.005% 100.202% ( 6600, 9900 ] 17 0.001% 100.203% ** Level 4 read latency histogram (micros): Count: 58979 Average: 84.3456 StdDev: 426.76 Min: 0 Median: 2.0400 Max: 17273 Percentiles: P50: 2.04 P75: 3.37 P99: 2236.28 P99.9: 4979.56 P99.99: 6516.11 ------------------------------------------------------ [ 0, 1 ] 1187 2.013% 2.013% ( 1, 2 ] 27790 47.118% 49.131% ######### ( 2, 3 ] 12798 21.699% 70.830% #### ( 3, 4 ] 6573 11.145% 81.975% ## ( 4, 6 ] 4797 8.133% 90.108% ## ( 6, 10 ] 1423 2.413% 92.521% ( 10, 15 ] 234 0.397% 92.918% ( 15, 22 ] 38 0.064% 92.982% ( 22, 34 ] 9 0.015% 92.998% ( 34, 51 ] 4 0.007% 93.004% ( 51, 76 ] 4 0.007% 93.011% ( 76, 110 ] 86 0.146% 93.157% ( 110, 170 ] 193 0.327% 93.484% ( 170, 250 ] 217 0.368% 93.852% ( 250, 380 ] 345 0.585% 94.437% ( 380, 580 ] 640 1.085% 95.522% ( 580, 870 ] 828 1.404% 96.926% ( 870, 1300 ] 661 1.121% 98.047% ( 1300, 1900 ] 462 0.783% 98.830% ( 1900, 2900 ] 298 0.505% 99.335% ( 2900, 4400 ] 313 0.531% 99.866% ( 4400, 6600 ] 76 0.129% 99.995% ( 6600, 9900 ] 7 0.012% 100.007% ( 9900, 14000 ] 2 0.003% 100.010% ( 14000, 22000 ] 1 0.002% 100.012% ** Level 5 read latency histogram (micros): Count: 300 Average: 1295.5800 StdDev: 1372.85 Min: 49 Median: 706.8750 Max: 6597 Percentiles: P50: 706.88 P75: 1996.77 P99: 6000.00 P99.9: 6540.00 P99.99: 6594.00 ------------------------------------------------------ ( 34, 51 ] 1 0.333% 0.333% ( 51, 76 ] 1 0.333% 0.667% ( 76, 110 ] 17 5.667% 6.333% # ( 110, 170 ] 24 8.000% 14.333% ## ( 170, 250 ] 21 7.000% 21.333% # ( 250, 380 ] 36 12.000% 33.333% ## ( 380, 580 ] 36 12.000% 45.333% ## ( 580, 870 ] 32 10.667% 56.000% ## ( 870, 1300 ] 33 11.000% 67.000% ## ( 1300, 1900 ] 21 7.000% 74.000% # ( 1900, 2900 ] 31 10.333% 84.333% ## ( 2900, 4400 ] 36 12.000% 96.333% ## ( 4400, 6600 ] 11 3.667% 100.000% # ** DB Stats ** Uptime(secs): 56.0 total, 4.4 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 175.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.477 H:M:S, 49.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 224.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.495 H:M:S, 34.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-23:08:31 ... thread 0: (1000000,11000000) ops and (295138.0,185881.2) ops/second in (3.388245,59.177569) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 4.42 GB 207.7 11.3 0.0 11.3 21.7 10.5 0.0 2.1 146.0 282.2 78.92 71.51 185 0.427 11M 26K 0.0 0.0 L1 6/6 735.82 MB 0.0 8.5 5.9 2.6 8.4 5.8 0.2 1.4 220.9 218.1 39.49 37.15 4 9.873 8253K 46K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 5.1 1.8 255.8 255.7 1.36 1.31 2 0.682 354K 208 0.0 0.0 L3 21/0 985.20 MB 1.0 7.7 5.0 2.7 7.6 5.0 0.3 1.5 169.1 168.4 46.47 34.98 24 1.936 7459K 28K 0.0 0.0 L4 180/0 9.71 GB 1.0 4.5 4.2 0.2 4.5 4.2 0.9 1.1 134.2 133.9 34.07 21.57 55 0.619 4539K 2934 0.0 0.0 L5 1104/0 90.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1329/15 106.48 GB 0.0 32.3 15.3 17.0 42.6 25.6 11.4 4.0 164.9 217.8 200.32 166.53 270 0.742 32M 105K 0.0 0.0 Int 0/0 0.00 KB 0.0 32.3 15.3 17.0 42.6 25.6 11.4 4.0 164.9 217.8 200.32 166.53 270 0.742 32M 105K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 32.3 15.3 17.0 32.1 15.1 0.0 0.0 197.2 196.1 167.50 138.86 118 1.419 32M 105K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 328.2 32.82 27.66 152 0.216 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.4 total, 59.2 interval Flush(GB): cumulative 10.520, interval 10.520 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 42.60 GB write, 734.23 MB/s write, 32.25 GB read, 555.92 MB/s read, 200.3 seconds Interval compaction: 42.60 GB write, 737.14 MB/s write, 32.25 GB read, 558.12 MB/s read, 200.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 38, pending-compaction-bytes-stops: 0, total-delays: 53, total-stops: 62, interval: 115 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4973720 Average: 2.8466 StdDev: 25.15 Min: 0 Median: 1.5579 Max: 10023 Percentiles: P50: 1.56 P75: 1.95 P99: 7.66 P99.9: 128.79 P99.99: 297.04 ------------------------------------------------------ [ 0, 1 ] 709190 14.259% 14.259% ### ( 1, 2 ] 3186409 64.065% 78.324% ############# ( 2, 3 ] 599475 12.053% 90.376% ## ( 3, 4 ] 226741 4.559% 94.935% # ( 4, 6 ] 181000 3.639% 98.574% # ( 6, 10 ] 50880 1.023% 99.597% ( 10, 15 ] 8284 0.167% 99.764% ( 15, 22 ] 883 0.018% 99.782% ( 22, 34 ] 61 0.001% 99.783% ( 34, 51 ] 45 0.001% 99.784% ( 51, 76 ] 121 0.002% 99.786% ( 76, 110 ] 4273 0.086% 99.872% ( 110, 170 ] 4433 0.089% 99.961% ( 170, 250 ] 1149 0.023% 99.984% ( 250, 380 ] 781 0.016% 100.000% ( 380, 580 ] 659 0.013% 100.013% ( 580, 870 ] 342 0.007% 100.020% ( 870, 1300 ] 164 0.003% 100.024% ( 1300, 1900 ] 84 0.002% 100.025% ( 1900, 2900 ] 73 0.001% 100.027% ( 2900, 4400 ] 71 0.001% 100.028% ( 4400, 6600 ] 20 0.000% 100.029% ( 6600, 9900 ] 5 0.000% 100.029% ( 9900, 14000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 1983043 Average: 4.6152 StdDev: 63.70 Min: 0 Median: 1.7044 Max: 8477 Percentiles: P50: 1.70 P75: 2.49 P99: 9.26 P99.9: 209.36 P99.99: 681.81 ------------------------------------------------------ [ 0, 1 ] 192990 9.732% 9.732% ## ( 1, 2 ] 1133662 57.168% 66.900% ########### ( 2, 3 ] 330441 16.663% 83.563% ### ( 3, 4 ] 137395 6.928% 90.492% # ( 4, 6 ] 134536 6.784% 97.276% # ( 6, 10 ] 41960 2.116% 99.392% ( 10, 15 ] 6186 0.312% 99.704% ( 15, 22 ] 907 0.046% 99.750% ( 22, 34 ] 41 0.002% 99.752% ( 34, 51 ] 52 0.003% 99.754% ( 51, 76 ] 160 0.008% 99.762% ( 76, 110 ] 1170 0.059% 99.821% ( 110, 170 ] 1312 0.066% 99.887% ( 170, 250 ] 504 0.025% 99.913% ( 250, 380 ] 577 0.029% 99.942% ( 380, 580 ] 720 0.036% 99.978% ( 580, 870 ] 660 0.033% 100.012% ( 870, 1300 ] 514 0.026% 100.038% ( 1300, 1900 ] 278 0.014% 100.052% ( 1900, 2900 ] 203 0.010% 100.062% ( 2900, 4400 ] 222 0.011% 100.073% ( 4400, 6600 ] 64 0.003% 100.076% ( 6600, 9900 ] 9 0.000% 100.077% ** Level 2 read latency histogram (micros): Count: 88532 Average: 2.0708 StdDev: 3.90 Min: 1 Median: 1.4268 Max: 709 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 11.56 P99.99: 144.40 ------------------------------------------------------ [ 0, 1 ] 20951 23.665% 23.665% ##### ( 1, 2 ] 54631 61.708% 85.373% ############ ( 2, 3 ] 7202 8.135% 93.507% ## ( 3, 4 ] 2936 3.316% 96.824% # ( 4, 6 ] 2245 2.536% 99.360% # ( 6, 10 ] 450 0.508% 99.868% ( 10, 15 ] 91 0.103% 99.971% ( 15, 22 ] 12 0.014% 99.984% ( 22, 34 ] 3 0.003% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1740805 Average: 5.4727 StdDev: 77.99 Min: 0 Median: 1.9540 Max: 8866 Percentiles: P50: 1.95 P75: 2.99 P99: 9.12 P99.9: 16.85 P99.99: 169.04 ------------------------------------------------------ [ 0, 1 ] 43604 2.505% 2.505% # ( 1, 2 ] 866691 49.787% 52.292% ########## ( 2, 3 ] 400247 22.992% 75.284% ##### ( 3, 4 ] 188126 10.807% 86.091% ## ( 4, 6 ] 194874 11.194% 97.285% ## ( 6, 10 ] 38247 2.197% 99.482% ( 10, 15 ] 7053 0.405% 99.887% ( 15, 22 ] 843 0.048% 99.936% ( 22, 34 ] 65 0.004% 99.939% ( 34, 51 ] 24 0.001% 99.941% ( 51, 76 ] 70 0.004% 99.945% ( 76, 110 ] 228 0.013% 99.958% ( 110, 170 ] 568 0.033% 99.991% ( 170, 250 ] 425 0.024% 100.015% ( 250, 380 ] 502 0.029% 100.044% ( 380, 580 ] 664 0.038% 100.082% ( 580, 870 ] 672 0.039% 100.121% ( 870, 1300 ] 473 0.027% 100.148% ( 1300, 1900 ] 262 0.015% 100.163% ( 1900, 2900 ] 279 0.016% 100.179% ( 2900, 4400 ] 319 0.018% 100.197% ( 4400, 6600 ] 83 0.005% 100.202% ( 6600, 9900 ] 17 0.001% 100.203% ** Level 4 read latency histogram (micros): Count: 58979 Average: 84.3456 StdDev: 426.76 Min: 0 Median: 2.0400 Max: 17273 Percentiles: P50: 2.04 P75: 3.37 P99: 2236.28 P99.9: 4979.56 P99.99: 6516.11 ------------------------------------------------------ [ 0, 1 ] 1187 2.013% 2.013% ( 1, 2 ] 27790 47.118% 49.131% ######### ( 2, 3 ] 12798 21.699% 70.830% #### ( 3, 4 ] 6573 11.145% 81.975% ## ( 4, 6 ] 4797 8.133% 90.108% ## ( 6, 10 ] 1423 2.413% 92.521% ( 10, 15 ] 234 0.397% 92.918% ( 15, 22 ] 38 0.064% 92.982% ( 22, 34 ] 9 0.015% 92.998% ( 34, 51 ] 4 0.007% 93.004% ( 51, 76 ] 4 0.007% 93.011% ( 76, 110 ] 86 0.146% 93.157% ( 110, 170 ] 193 0.327% 93.484% ( 170, 250 ] 217 0.368% 93.852% ( 250, 380 ] 345 0.585% 94.437% ( 380, 580 ] 640 1.085% 95.522% ( 580, 870 ] 828 1.404% 96.926% ( 870, 1300 ] 661 1.121% 98.047% ( 1300, 1900 ] 462 0.783% 98.830% ( 1900, 2900 ] 298 0.505% 99.335% ( 2900, 4400 ] 313 0.531% 99.866% ( 4400, 6600 ] 76 0.129% 99.995% ( 6600, 9900 ] 7 0.012% 100.007% ( 9900, 14000 ] 2 0.003% 100.010% ( 14000, 22000 ] 1 0.002% 100.012% ** Level 5 read latency histogram (micros): Count: 300 Average: 1295.5800 StdDev: 1372.85 Min: 49 Median: 706.8750 Max: 6597 Percentiles: P50: 706.88 P75: 1996.77 P99: 6000.00 P99.9: 6540.00 P99.99: 6594.00 ------------------------------------------------------ ( 34, 51 ] 1 0.333% 0.333% ( 51, 76 ] 1 0.333% 0.667% ( 76, 110 ] 17 5.667% 6.333% # ( 110, 170 ] 24 8.000% 14.333% ## ( 170, 250 ] 21 7.000% 21.333% # ( 250, 380 ] 36 12.000% 33.333% ## ( 380, 580 ] 36 12.000% 45.333% ## ( 580, 870 ] 32 10.667% 56.000% ## ( 870, 1300 ] 33 11.000% 67.000% ## ( 1300, 1900 ] 21 7.000% 74.000% # ( 1900, 2900 ] 31 10.333% 84.333% ## ( 2900, 4400 ] 36 12.000% 96.333% ## ( 4400, 6600 ] 11 3.667% 100.000% # ** DB Stats ** Uptime(secs): 59.4 total, 3.4 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 182.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.144 H:M:S, 47.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 290.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.668 H:M:S, 19.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.323 micros/op 187862 ops/sec 60.001 seconds 11271999 operations; 182.0 MB/s Microseconds per write: Count: 11271999 Average: 5.3231 StdDev: 384.43 Min: 1 Median: 1.7733 Max: 718142 Percentiles: P50: 1.77 P75: 2.82 P99: 9.50 P99.9: 1071.53 P99.99: 2511.53 ------------------------------------------------------ [ 0, 1 ] 1280778 11.362% 11.362% ## ( 1, 2 ] 5631862 49.963% 61.326% ########## ( 2, 3 ] 1873441 16.620% 77.946% ### ( 3, 4 ] 1587549 14.084% 92.030% ### ( 4, 6 ] 655615 5.816% 97.846% # ( 6, 10 ] 148689 1.319% 99.165% ( 10, 15 ] 49616 0.440% 99.606% ( 15, 22 ] 11433 0.101% 99.707% ( 22, 34 ] 2322 0.021% 99.728% ( 34, 51 ] 300 0.003% 99.730% ( 51, 76 ] 29 0.000% 99.731% ( 76, 110 ] 7530 0.067% 99.797% ( 110, 170 ] 3345 0.030% 99.827% ( 170, 250 ] 351 0.003% 99.830% ( 250, 380 ] 219 0.002% 99.832% ( 380, 580 ] 38 0.000% 99.832% ( 580, 870 ] 26 0.000% 99.833% ( 870, 1300 ] 16182 0.144% 99.976% ( 1300, 1900 ] 125 0.001% 99.977% ( 1900, 2900 ] 2325 0.021% 99.998% ( 2900, 4400 ] 145 0.001% 99.999% ( 4400, 6600 ] 45 0.000% 100.000% ( 6600, 9900 ] 8 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 190357 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11271999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11632702968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 647 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 28225479 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 36998697613 rocksdb.compact.write.bytes COUNT : 36807820788 rocksdb.flush.write.bytes COUNT : 11559883777 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 69 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 323 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11466825728 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4606976 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 37107536762 rocksdb.non.last.level.read.count COUNT : 8964797 rocksdb.block.checksum.compute.count COUNT : 8963572 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.408373 P95 : 3.945914 P99 : 8.069724 P100 : 718141.000000 COUNT : 11271999 SUM : 54339669 rocksdb.compaction.times.micros P50 : 959166.666667 P95 : 4762000.000000 P99 : 17240000.000000 P100 : 18513576.000000 COUNT : 119 SUM : 168479278 rocksdb.compaction.times.cpu_micros P50 : 835833.333333 P95 : 4762000.000000 P99 : 13202000.000000 P100 : 17405021.000000 COUNT : 119 SUM : 139824985 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 715.937500 P95 : 1420.000000 P99 : 40480.000000 P100 : 89527.000000 COUNT : 156 SUM : 270894 rocksdb.compaction.outfile.sync.micros P50 : 1156.666667 P95 : 99500.000000 P99 : 265600.000000 P100 : 326298.000000 COUNT : 440 SUM : 7675397 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 104.962963 P95 : 1560.000000 P99 : 3752.857143 P100 : 4150.000000 COUNT : 302 SUM : 93659 rocksdb.table.open.io.micros P50 : 1463.333333 P95 : 7665.000000 P99 : 11709.125000 P100 : 19762.000000 COUNT : 647 SUM : 1432962 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.700547 P95 : 8.212928 P99 : 11.890878 P100 : 17279.000000 COUNT : 8962269 SUM : 56830870 rocksdb.read.block.get.micros P50 : 458.125000 P95 : 3526.000000 P99 : 5333.263158 P100 : 9706.000000 COUNT : 1294 SUM : 1160595 rocksdb.write.raw.block.micros P50 : 0.514170 P95 : 0.976923 P99 : 3.228799 P100 : 20810.000000 COUNT : 11715588 SUM : 23184123 rocksdb.numfiles.in.singlecompaction P50 : 2.894737 P95 : 6.880000 P99 : 16.470000 P100 : 21.000000 COUNT : 158 SUM : 552 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558576 P95 : 1129.862519 P99 : 2205.269978 P100 : 717953.000000 COUNT : 180430 SUM : 28244405 rocksdb.sst.read.micros P50 : 1.655464 P95 : 5.004148 P99 : 8.904346 P100 : 17273.000000 COUNT : 8965798 SUM : 38776544 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11271999 SUM : 11632702968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212393.162393 P95 : 418000.000000 P99 : 778800.000000 P100 : 877015.000000 COUNT : 156 SUM : 33549095 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 412 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0