[2024-12-14 08:54:28.382328] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 22.11.4 initialization... [2024-12-14 08:54:28.382600] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid182424 ] Set seed to 1734162868375560 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-14 08:54:28.497388] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-14 08:54:28.520670] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-14 08:54:28.520717] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 182424' to capture a snapshot of events at runtime. [2024-12-14 08:54:28.520730] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-14 08:54:28.520760] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-14 08:54:28.520768] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid182424 for offline analysis/debug. [2024-12-14 08:54:28.521344] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 14 08:54:32 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/14-08:54:35 ... thread 0: (1000000,1000000) ops and (334419.0,334419.0) ops/second in (2.990261,2.990261) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.92 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 349.2 2.53 2.28 12 0.210 0 0 0.0 0.0 L1 3/3 251.77 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 261.5 261.2 0.96 0.94 1 0.964 255K 196 0.0 0.0 L2 1/0 48.85 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 225.3 225.2 0.49 0.46 1 0.494 113K 30 0.0 0.0 L3 17/0 818.42 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 212.1 212.1 0.29 0.25 1 0.295 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 99.5 305.6 4.28 3.93 15 0.285 432K 226 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 99.5 305.6 4.28 3.93 15 0.285 432K 226 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 242.9 242.8 1.75 1.65 3 0.584 432K 226 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 349.2 2.53 2.28 12 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 406.72 MB/s write, 0.42 GB read, 132.47 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 437.02 MB/s write, 0.42 GB read, 142.34 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 105620 Average: 1.8117 StdDev: 17.12 Min: 1 Median: 1.1301 Max: 3055 Percentiles: P50: 1.13 P75: 1.60 P99: 3.58 P99.9: 10.17 P99.99: 329.23 ------------------------------------------------------ [ 0, 1 ] 45528 43.105% 43.105% ######### ( 1, 2 ] 55968 52.990% 96.095% ########### ( 2, 3 ] 2490 2.358% 98.453% ( 3, 4 ] 1002 0.949% 99.402% ( 4, 6 ] 334 0.316% 99.718% ( 6, 10 ] 190 0.180% 99.898% ( 10, 15 ] 69 0.065% 99.963% ( 15, 22 ] 12 0.011% 99.974% ( 22, 34 ] 2 0.002% 99.976% ( 34, 51 ] 1 0.001% 99.977% ( 110, 170 ] 8 0.008% 99.985% ( 170, 250 ] 3 0.003% 99.988% ( 250, 380 ] 4 0.004% 99.991% ( 580, 870 ] 1 0.001% 99.992% ( 870, 1300 ] 4 0.004% 99.996% ( 1900, 2900 ] 3 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 32844 Average: 2.1706 StdDev: 16.22 Min: 1 Median: 1.1772 Max: 1479 Percentiles: P50: 1.18 P75: 1.64 P99: 5.37 P99.9: 89.10 P99.99: 795.50 ------------------------------------------------------ [ 0, 1 ] 13283 40.443% 40.443% ######## ( 1, 2 ] 17717 53.943% 94.386% ########### ( 2, 3 ] 1065 3.243% 97.628% # ( 3, 4 ] 300 0.913% 98.542% ( 4, 6 ] 220 0.670% 99.211% ( 6, 10 ] 141 0.429% 99.641% ( 10, 15 ] 26 0.079% 99.720% ( 15, 22 ] 11 0.033% 99.753% ( 22, 34 ] 2 0.006% 99.759% ( 34, 51 ] 22 0.067% 99.826% ( 51, 76 ] 23 0.070% 99.896% ( 76, 110 ] 3 0.009% 99.906% ( 110, 170 ] 2 0.006% 99.912% ( 170, 250 ] 13 0.040% 99.951% ( 250, 380 ] 6 0.018% 99.970% ( 380, 580 ] 3 0.009% 99.979% ( 580, 870 ] 5 0.015% 99.994% ( 1300, 1900 ] 2 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 15875 Average: 1.6954 StdDev: 3.44 Min: 1 Median: 1.1501 Max: 295 Percentiles: P50: 1.15 P75: 1.61 P99: 3.28 P99.9: 6.85 P99.99: 226.50 ------------------------------------------------------ [ 0, 1 ] 6653 41.909% 41.909% ######## ( 1, 2 ] 8559 53.915% 95.824% ########### ( 2, 3 ] 471 2.967% 98.791% # ( 3, 4 ] 117 0.737% 99.528% ( 4, 6 ] 57 0.359% 99.887% ( 6, 10 ] 10 0.063% 99.950% ( 10, 15 ] 3 0.019% 99.969% ( 15, 22 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 657.9059 StdDev: 1008.01 Min: 1 Median: 140.0000 Max: 3939 Percentiles: P50: 140.00 P75: 934.50 P99: 3939.00 P99.9: 3939.00 P99.99: 3939.00 ------------------------------------------------------ [ 0, 1 ] 20 23.529% 23.529% ##### ( 1, 2 ] 18 21.176% 44.706% #### ( 51, 76 ] 1 1.176% 45.882% ( 76, 110 ] 2 2.353% 48.235% ( 110, 170 ] 3 3.529% 51.765% # ( 170, 250 ] 3 3.529% 55.294% # ( 250, 380 ] 3 3.529% 58.824% # ( 380, 580 ] 10 11.765% 70.588% ## ( 580, 870 ] 3 3.529% 74.118% # ( 870, 1300 ] 5 5.882% 80.000% # ( 1300, 1900 ] 4 4.706% 84.706% # ( 1900, 2900 ] 8 9.412% 94.118% ## ( 2900, 4400 ] 5 5.882% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1252.5333 StdDev: 870.01 Min: 109 Median: 1192.5000 Max: 3000 Percentiles: P50: 1192.50 P75: 1971.43 P99: 3000.00 P99.9: 3000.00 P99.99: 3000.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 5 16.667% 36.667% ### ( 580, 870 ] 1 3.333% 40.000% # ( 870, 1300 ] 4 13.333% 53.333% ### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 7 23.333% 96.667% ##### ( 2900, 4400 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 306.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.383 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.383 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-08:54:38 ... thread 0: (1000000,2000000) ops and (350375.1,342211.1) ops/second in (2.854084,5.844345) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.17 GB 62.9 0.6 0.0 0.6 2.3 1.8 0.0 1.3 77.4 326.8 7.32 6.74 28 0.262 575K 592 0.0 0.0 L1 2/0 50.34 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 245.9 245.4 3.33 3.24 2 1.665 831K 1469 0.0 0.0 L2 5/4 563.91 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.6 1.8 225.3 225.2 0.49 0.46 1 0.494 113K 30 0.0 0.0 L3 17/10 818.42 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 212.1 212.1 0.29 0.25 1 0.295 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1195/22 97.92 GB 0.0 1.5 0.6 0.9 3.3 2.4 0.7 1.9 136.3 295.8 11.44 10.69 32 0.358 1583K 2091 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.3 2.4 0.7 1.9 136.3 295.8 11.44 10.69 32 0.358 1583K 2091 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 249.0 248.6 6.26 6.05 6 1.044 1583K 2091 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.8 5.18 4.64 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.30 GB write, 557.63 MB/s write, 1.52 GB read, 256.98 MB/s read, 11.4 seconds Interval compaction: 3.30 GB write, 578.89 MB/s write, 1.52 GB read, 266.77 MB/s read, 11.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 387807 Average: 2.1345 StdDev: 11.69 Min: 1 Median: 1.4384 Max: 3055 Percentiles: P50: 1.44 P75: 1.84 P99: 5.63 P99.9: 9.99 P99.99: 14.68 ------------------------------------------------------ [ 0, 1 ] 88164 22.734% 22.734% ##### ( 1, 2 ] 241185 62.192% 84.926% ############ ( 2, 3 ] 34086 8.789% 93.715% ## ( 3, 4 ] 13197 3.403% 97.118% # ( 4, 6 ] 8955 2.309% 99.428% ( 6, 10 ] 1838 0.474% 99.901% ( 10, 15 ] 369 0.095% 99.997% ( 15, 22 ] 45 0.012% 100.008% ( 22, 34 ] 11 0.003% 100.011% ( 34, 51 ] 3 0.001% 100.012% ( 51, 76 ] 3 0.001% 100.013% ( 76, 110 ] 1 0.000% 100.013% ( 110, 170 ] 14 0.004% 100.017% ( 170, 250 ] 13 0.003% 100.020% ( 250, 380 ] 9 0.002% 100.022% ( 380, 580 ] 2 0.001% 100.023% ( 580, 870 ] 5 0.001% 100.024% ( 870, 1300 ] 8 0.002% 100.026% ( 1900, 2900 ] 5 0.001% 100.027% ( 2900, 4400 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 119910 Average: 2.3645 StdDev: 11.79 Min: 1 Median: 1.5193 Max: 1727 Percentiles: P50: 1.52 P75: 1.92 P99: 5.91 P99.9: 14.84 P99.99: 530.45 ------------------------------------------------------ [ 0, 1 ] 21357 17.811% 17.811% #### ( 1, 2 ] 74328 61.986% 79.797% ############ ( 2, 3 ] 14528 12.116% 91.913% ## ( 3, 4 ] 4894 4.081% 95.994% # ( 4, 6 ] 3771 3.145% 99.139% # ( 6, 10 ] 767 0.640% 99.779% ( 10, 15 ] 151 0.126% 99.905% ( 15, 22 ] 21 0.018% 99.922% ( 22, 34 ] 4 0.003% 99.926% ( 34, 51 ] 23 0.019% 99.945% ( 51, 76 ] 23 0.019% 99.964% ( 76, 110 ] 3 0.003% 99.967% ( 110, 170 ] 3 0.003% 99.969% ( 170, 250 ] 13 0.011% 99.980% ( 250, 380 ] 10 0.008% 99.988% ( 380, 580 ] 4 0.003% 99.992% ( 580, 870 ] 6 0.005% 99.997% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 4 0.003% 100.001% ** Level 2 read latency histogram (micros): Count: 15918 Average: 1.6994 StdDev: 3.44 Min: 1 Median: 1.1521 Max: 295 Percentiles: P50: 1.15 P75: 1.62 P99: 3.32 P99.9: 7.23 P99.99: 226.33 ------------------------------------------------------ [ 0, 1 ] 6653 41.795% 41.795% ######## ( 1, 2 ] 8584 53.926% 95.722% ########### ( 2, 3 ] 484 3.041% 98.762% # ( 3, 4 ] 119 0.748% 99.510% ( 4, 6 ] 59 0.371% 99.881% ( 6, 10 ] 10 0.063% 99.943% ( 10, 15 ] 3 0.019% 99.962% ( 15, 22 ] 1 0.006% 99.969% ( 22, 34 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 67302 Average: 4.1846 StdDev: 45.68 Min: 1 Median: 1.7290 Max: 3939 Percentiles: P50: 1.73 P75: 2.47 P99: 9.68 P99.9: 359.72 P99.99: 2058.71 ------------------------------------------------------ [ 0, 1 ] 4674 6.945% 6.945% # ( 1, 2 ] 39751 59.064% 66.008% ############ ( 2, 3 ] 12767 18.970% 84.978% #### ( 3, 4 ] 4144 6.157% 91.135% # ( 4, 6 ] 3996 5.937% 97.073% # ( 6, 10 ] 1409 2.094% 99.166% ( 10, 15 ] 238 0.354% 99.520% ( 15, 22 ] 51 0.076% 99.596% ( 22, 34 ] 13 0.019% 99.615% ( 34, 51 ] 2 0.003% 99.618% ( 51, 76 ] 2 0.003% 99.621% ( 76, 110 ] 32 0.048% 99.669% ( 110, 170 ] 82 0.122% 99.790% ( 170, 250 ] 46 0.068% 99.859% ( 250, 380 ] 34 0.051% 99.909% ( 380, 580 ] 30 0.045% 99.954% ( 580, 870 ] 14 0.021% 99.975% ( 870, 1300 ] 6 0.009% 99.984% ( 1300, 1900 ] 4 0.006% 99.990% ( 1900, 2900 ] 8 0.012% 100.001% ( 2900, 4400 ] 5 0.007% 100.009% ** Level 4 read latency histogram (micros): Count: 30 Average: 1252.5333 StdDev: 870.01 Min: 109 Median: 1192.5000 Max: 3000 Percentiles: P50: 1192.50 P75: 1971.43 P99: 3000.00 P99.9: 3000.00 P99.99: 3000.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 5 16.667% 36.667% ### ( 580, 870 ] 1 3.333% 40.000% # ( 870, 1300 ] 4 13.333% 53.333% ### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 7 23.333% 96.667% ##### ( 2900, 4400 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.572 H:M:S, 9.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 344.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.189 H:M:S, 6.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/14-08:54:41 ... thread 0: (1000000,3000000) ops and (320800.9,334763.8) ops/second in (3.117198,8.961543) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 2.15 GB 25.2 1.4 0.0 1.4 4.1 2.8 0.0 1.5 103.8 316.1 13.35 12.36 45 0.297 1407K 1447 0.0 0.0 L1 2/2 50.34 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 245.9 245.4 3.33 3.24 2 1.665 831K 1469 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 225.3 225.2 0.49 0.46 1 0.494 113K 30 0.0 0.0 L3 24/0 988.28 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.3 213.3 213.2 6.84 6.08 4 1.711 1463K 728 0.0 0.0 L4 152/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/17 98.90 GB 0.0 3.7 1.2 2.5 6.5 3.9 1.4 2.3 157.2 275.1 24.02 22.14 52 0.462 3814K 3674 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.2 2.5 6.5 3.9 1.4 2.3 157.2 275.1 24.02 22.14 52 0.462 3814K 3674 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.2 2.5 3.7 1.2 0.0 0.0 236.1 235.8 15.99 14.99 12 1.333 3814K 3674 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 353.2 8.03 7.14 40 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.45 GB write, 719.20 MB/s write, 3.69 GB read, 411.03 MB/s read, 24.0 seconds Interval compaction: 6.45 GB write, 737.08 MB/s write, 3.69 GB read, 421.25 MB/s read, 24.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 710611 Average: 2.2977 StdDev: 11.80 Min: 1 Median: 1.5278 Max: 3055 Percentiles: P50: 1.53 P75: 1.92 P99: 5.80 P99.9: 10.24 P99.99: 14.73 ------------------------------------------------------ [ 0, 1 ] 118626 16.694% 16.694% ### ( 1, 2 ] 448457 63.109% 79.802% ############# ( 2, 3 ] 84097 11.834% 91.637% ## ( 3, 4 ] 31500 4.433% 96.069% # ( 4, 6 ] 23109 3.252% 99.321% # ( 6, 10 ] 4077 0.574% 99.895% ( 10, 15 ] 713 0.100% 99.995% ( 15, 22 ] 89 0.013% 100.008% ( 22, 34 ] 18 0.003% 100.011% ( 34, 51 ] 5 0.001% 100.011% ( 51, 76 ] 7 0.001% 100.012% ( 76, 110 ] 22 0.003% 100.015% ( 110, 170 ] 37 0.005% 100.021% ( 170, 250 ] 41 0.006% 100.026% ( 250, 380 ] 20 0.003% 100.029% ( 380, 580 ] 12 0.002% 100.031% ( 580, 870 ] 9 0.001% 100.032% ( 870, 1300 ] 11 0.002% 100.034% ( 1300, 1900 ] 5 0.001% 100.034% ( 1900, 2900 ] 7 0.001% 100.035% ( 2900, 4400 ] 2 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 207024 Average: 2.4372 StdDev: 9.00 Min: 1 Median: 1.6098 Max: 1727 Percentiles: P50: 1.61 P75: 2.04 P99: 5.92 P99.9: 13.39 P99.99: 305.87 ------------------------------------------------------ [ 0, 1 ] 24458 11.814% 11.814% ## ( 1, 2 ] 129637 62.619% 74.433% ############# ( 2, 3 ] 31549 15.239% 89.673% ### ( 3, 4 ] 10781 5.208% 94.880% # ( 4, 6 ] 8873 4.286% 99.166% # ( 6, 10 ] 1352 0.653% 99.819% ( 10, 15 ] 246 0.119% 99.938% ( 15, 22 ] 31 0.015% 99.953% ( 22, 34 ] 6 0.003% 99.956% ( 34, 51 ] 23 0.011% 99.967% ( 51, 76 ] 23 0.011% 99.978% ( 76, 110 ] 4 0.002% 99.980% ( 110, 170 ] 3 0.001% 99.982% ( 170, 250 ] 13 0.006% 99.988% ( 250, 380 ] 10 0.005% 99.993% ( 380, 580 ] 4 0.002% 99.995% ( 580, 870 ] 6 0.003% 99.998% ( 870, 1300 ] 1 0.000% 99.998% ( 1300, 1900 ] 4 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 28280 Average: 2.1938 StdDev: 8.76 Min: 1 Median: 1.3974 Max: 1008 Percentiles: P50: 1.40 P75: 1.83 P99: 6.16 P99.9: 13.26 P99.99: 353.09 ------------------------------------------------------ [ 0, 1 ] 7601 26.878% 26.878% ##### ( 1, 2 ] 16455 58.186% 85.064% ############ ( 2, 3 ] 2388 8.444% 93.508% ## ( 3, 4 ] 883 3.122% 96.630% # ( 4, 6 ] 660 2.334% 98.964% ( 6, 10 ] 253 0.895% 99.859% ( 10, 15 ] 18 0.064% 99.922% ( 15, 22 ] 3 0.011% 99.933% ( 22, 34 ] 1 0.004% 99.936% ( 110, 170 ] 3 0.011% 99.947% ( 170, 250 ] 9 0.032% 99.979% ( 250, 380 ] 4 0.014% 99.993% ( 380, 580 ] 1 0.004% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 212027 Average: 3.8218 StdDev: 31.94 Min: 1 Median: 1.6980 Max: 3939 Percentiles: P50: 1.70 P75: 2.39 P99: 9.48 P99.9: 317.70 P99.99: 794.71 ------------------------------------------------------ [ 0, 1 ] 15730 7.419% 7.419% # ( 1, 2 ] 129346 61.004% 68.423% ############ ( 2, 3 ] 36067 17.011% 85.434% ### ( 3, 4 ] 13615 6.421% 91.855% # ( 4, 6 ] 11442 5.396% 97.252% # ( 6, 10 ] 4257 2.008% 99.260% ( 10, 15 ] 570 0.269% 99.528% ( 15, 22 ] 76 0.036% 99.564% ( 22, 34 ] 21 0.010% 99.574% ( 34, 51 ] 21 0.010% 99.584% ( 51, 76 ] 27 0.013% 99.597% ( 76, 110 ] 129 0.061% 99.658% ( 110, 170 ] 289 0.136% 99.794% ( 170, 250 ] 163 0.077% 99.871% ( 250, 380 ] 119 0.056% 99.927% ( 380, 580 ] 99 0.047% 99.974% ( 580, 870 ] 47 0.022% 99.996% ( 870, 1300 ] 21 0.010% 100.006% ( 1300, 1900 ] 6 0.003% 100.008% ( 1900, 2900 ] 8 0.004% 100.012% ( 2900, 4400 ] 6 0.003% 100.015% ** Level 4 read latency histogram (micros): Count: 30 Average: 1252.5333 StdDev: 870.01 Min: 109 Median: 1192.5000 Max: 3000 Percentiles: P50: 1192.50 P75: 1971.43 P99: 3000.00 P99.9: 3000.00 P99.99: 3000.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 5 16.667% 36.667% ### ( 580, 870 ] 1 3.333% 40.000% # ( 870, 1300 ] 4 13.333% 53.333% ### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 7 23.333% 96.667% ##### ( 2900, 4400 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 767.1500 StdDev: 831.75 Min: 106 Median: 430.0000 Max: 3019 Percentiles: P50: 430.00 P75: 1085.00 P99: 3019.00 P99.9: 3019.00 P99.99: 3019.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 2 10.000% 35.000% ## ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 4 20.000% 65.000% #### ( 870, 1300 ] 4 20.000% 85.000% #### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 321.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.986 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.414 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/14-08:54:44 ... thread 0: (1000000,4000000) ops and (321472.5,331339.0) ops/second in (3.110686,12.072229) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.13 GB 157.3 2.5 0.0 2.5 6.2 3.7 0.0 1.7 123.0 310.4 20.49 19.11 63 0.325 2558K 2629 0.0 0.0 L1 2/2 50.34 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 245.9 245.4 3.33 3.24 2 1.665 831K 1469 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 225.3 225.2 0.49 0.46 1 0.494 113K 30 0.0 0.0 L3 24/0 988.28 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.3 213.3 213.2 6.84 6.08 4 1.711 1463K 728 0.0 0.0 L4 152/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/13 99.88 GB 0.0 4.8 1.2 3.6 8.5 4.9 1.4 2.3 157.6 280.7 31.16 28.89 70 0.445 4966K 4856 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 1.2 3.6 8.5 4.9 1.4 2.3 157.6 280.7 31.16 28.89 70 0.445 4966K 4856 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 1.2 3.6 4.8 1.2 0.0 0.0 241.7 241.5 20.31 19.23 16 1.269 4966K 4856 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 354.3 10.85 9.66 54 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.54 GB write, 711.34 MB/s write, 4.79 GB read, 399.27 MB/s read, 31.2 seconds Interval compaction: 8.54 GB write, 724.47 MB/s write, 4.79 GB read, 406.64 MB/s read, 31.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 12, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1164007 Average: 2.3155 StdDev: 11.19 Min: 0 Median: 1.5369 Max: 3055 Percentiles: P50: 1.54 P75: 1.92 P99: 5.85 P99.9: 10.17 P99.99: 14.29 ------------------------------------------------------ [ 0, 1 ] 177332 15.235% 15.235% ### ( 1, 2 ] 753697 64.750% 79.985% ############# ( 2, 3 ] 139095 11.950% 91.934% ## ( 3, 4 ] 49230 4.229% 96.164% # ( 4, 6 ] 35718 3.069% 99.232% # ( 6, 10 ] 7731 0.664% 99.897% ( 10, 15 ] 1269 0.109% 100.006% ( 15, 22 ] 123 0.011% 100.016% ( 22, 34 ] 20 0.002% 100.018% ( 34, 51 ] 7 0.001% 100.018% ( 51, 76 ] 12 0.001% 100.020% ( 76, 110 ] 65 0.006% 100.025% ( 110, 170 ] 95 0.008% 100.033% ( 170, 250 ] 76 0.007% 100.040% ( 250, 380 ] 39 0.003% 100.043% ( 380, 580 ] 30 0.003% 100.046% ( 580, 870 ] 20 0.002% 100.047% ( 870, 1300 ] 15 0.001% 100.049% ( 1300, 1900 ] 8 0.001% 100.049% ( 1900, 2900 ] 8 0.001% 100.050% ( 2900, 4400 ] 4 0.000% 100.050% ** Level 1 read latency histogram (micros): Count: 207024 Average: 2.4372 StdDev: 9.00 Min: 1 Median: 1.6098 Max: 1727 Percentiles: P50: 1.61 P75: 2.04 P99: 5.92 P99.9: 13.39 P99.99: 305.87 ------------------------------------------------------ [ 0, 1 ] 24458 11.814% 11.814% ## ( 1, 2 ] 129637 62.619% 74.433% ############# ( 2, 3 ] 31549 15.239% 89.673% ### ( 3, 4 ] 10781 5.208% 94.880% # ( 4, 6 ] 8873 4.286% 99.166% # ( 6, 10 ] 1352 0.653% 99.819% ( 10, 15 ] 246 0.119% 99.938% ( 15, 22 ] 31 0.015% 99.953% ( 22, 34 ] 6 0.003% 99.956% ( 34, 51 ] 23 0.011% 99.967% ( 51, 76 ] 23 0.011% 99.978% ( 76, 110 ] 4 0.002% 99.980% ( 110, 170 ] 3 0.001% 99.982% ( 170, 250 ] 13 0.006% 99.988% ( 250, 380 ] 10 0.005% 99.993% ( 380, 580 ] 4 0.002% 99.995% ( 580, 870 ] 6 0.003% 99.998% ( 870, 1300 ] 1 0.000% 99.998% ( 1300, 1900 ] 4 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 28280 Average: 2.1938 StdDev: 8.76 Min: 1 Median: 1.3974 Max: 1008 Percentiles: P50: 1.40 P75: 1.83 P99: 6.16 P99.9: 13.26 P99.99: 353.09 ------------------------------------------------------ [ 0, 1 ] 7601 26.878% 26.878% ##### ( 1, 2 ] 16455 58.186% 85.064% ############ ( 2, 3 ] 2388 8.444% 93.508% ## ( 3, 4 ] 883 3.122% 96.630% # ( 4, 6 ] 660 2.334% 98.964% ( 6, 10 ] 253 0.895% 99.859% ( 10, 15 ] 18 0.064% 99.922% ( 15, 22 ] 3 0.011% 99.933% ( 22, 34 ] 1 0.004% 99.936% ( 110, 170 ] 3 0.011% 99.947% ( 170, 250 ] 9 0.032% 99.979% ( 250, 380 ] 4 0.014% 99.993% ( 380, 580 ] 1 0.004% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 212027 Average: 3.8218 StdDev: 31.94 Min: 1 Median: 1.6980 Max: 3939 Percentiles: P50: 1.70 P75: 2.39 P99: 9.48 P99.9: 317.70 P99.99: 794.71 ------------------------------------------------------ [ 0, 1 ] 15730 7.419% 7.419% # ( 1, 2 ] 129346 61.004% 68.423% ############ ( 2, 3 ] 36067 17.011% 85.434% ### ( 3, 4 ] 13615 6.421% 91.855% # ( 4, 6 ] 11442 5.396% 97.252% # ( 6, 10 ] 4257 2.008% 99.260% ( 10, 15 ] 570 0.269% 99.528% ( 15, 22 ] 76 0.036% 99.564% ( 22, 34 ] 21 0.010% 99.574% ( 34, 51 ] 21 0.010% 99.584% ( 51, 76 ] 27 0.013% 99.597% ( 76, 110 ] 129 0.061% 99.658% ( 110, 170 ] 289 0.136% 99.794% ( 170, 250 ] 163 0.077% 99.871% ( 250, 380 ] 119 0.056% 99.927% ( 380, 580 ] 99 0.047% 99.974% ( 580, 870 ] 47 0.022% 99.996% ( 870, 1300 ] 21 0.010% 100.006% ( 1300, 1900 ] 6 0.003% 100.008% ( 1900, 2900 ] 8 0.004% 100.012% ( 2900, 4400 ] 6 0.003% 100.015% ** Level 4 read latency histogram (micros): Count: 30 Average: 1252.5333 StdDev: 870.01 Min: 109 Median: 1192.5000 Max: 3000 Percentiles: P50: 1192.50 P75: 1971.43 P99: 3000.00 P99.9: 3000.00 P99.99: 3000.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 5 16.667% 36.667% ### ( 580, 870 ] 1 3.333% 40.000% # ( 870, 1300 ] 4 13.333% 53.333% ### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 7 23.333% 96.667% ##### ( 2900, 4400 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 767.1500 StdDev: 831.75 Min: 106 Median: 430.0000 Max: 3019 Percentiles: P50: 430.00 P75: 1085.00 P99: 3019.00 P99.9: 3019.00 P99.99: 3019.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 2 10.000% 35.000% ## ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 4 20.000% 65.000% #### ( 870, 1300 ] 4 20.000% 85.000% #### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.3 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 320.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.442 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.456 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-08:54:47 ... thread 0: (1000000,5000000) ops and (335085.2,332081.5) ops/second in (2.984316,15.056545) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/13 2.77 GB 25.2 3.2 0.0 3.2 7.9 4.7 0.0 1.7 125.5 311.2 26.10 24.36 80 0.326 3326K 3404 0.0 0.0 L1 14/14 1.39 GB 0.0 2.2 1.8 0.4 2.2 1.8 0.1 1.2 232.8 231.7 9.68 9.35 3 3.227 2288K 10K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 225.3 225.2 0.49 0.46 1 0.494 113K 30 0.0 0.0 L3 24/0 988.28 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.3 213.3 213.2 6.84 6.08 4 1.711 1463K 728 0.0 0.0 L4 152/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/27 100.86 GB 0.0 6.9 2.5 4.4 11.7 7.2 1.4 2.5 164.7 276.8 43.12 40.26 88 0.490 7190K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.9 2.5 4.4 11.7 7.2 1.4 2.5 164.7 276.8 43.12 40.26 88 0.490 7190K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.9 2.5 4.4 6.9 2.5 0.0 0.0 240.6 240.0 29.52 28.14 20 1.476 7190K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.5 13.61 12.11 68 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.1 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.66 GB write, 781.10 MB/s write, 6.93 GB read, 464.67 MB/s read, 43.1 seconds Interval compaction: 11.66 GB write, 792.66 MB/s write, 6.93 GB read, 471.54 MB/s read, 43.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 16, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1370271 Average: 2.2942 StdDev: 13.12 Min: 0 Median: 1.5081 Max: 5004 Percentiles: P50: 1.51 P75: 1.90 P99: 5.82 P99.9: 10.87 P99.99: 15.87 ------------------------------------------------------ [ 0, 1 ] 237838 17.357% 17.357% ### ( 1, 2 ] 880349 64.246% 81.603% ############# ( 2, 3 ] 150582 10.989% 92.593% ## ( 3, 4 ] 53243 3.886% 96.478% # ( 4, 6 ] 37968 2.771% 99.249% # ( 6, 10 ] 8664 0.632% 99.881% ( 10, 15 ] 1473 0.107% 99.989% ( 15, 22 ] 144 0.011% 99.999% ( 22, 34 ] 22 0.002% 100.001% ( 34, 51 ] 7 0.001% 100.001% ( 51, 76 ] 13 0.001% 100.002% ( 76, 110 ] 115 0.008% 100.011% ( 110, 170 ] 176 0.013% 100.024% ( 170, 250 ] 103 0.008% 100.031% ( 250, 380 ] 58 0.004% 100.035% ( 380, 580 ] 42 0.003% 100.038% ( 580, 870 ] 33 0.002% 100.041% ( 870, 1300 ] 17 0.001% 100.042% ( 1300, 1900 ] 8 0.001% 100.043% ( 1900, 2900 ] 10 0.001% 100.043% ( 2900, 4400 ] 5 0.000% 100.044% ( 4400, 6600 ] 2 0.000% 100.044% ** Level 1 read latency histogram (micros): Count: 235036 Average: 2.5978 StdDev: 14.30 Min: 0 Median: 1.5810 Max: 2536 Percentiles: P50: 1.58 P75: 1.98 P99: 5.99 P99.9: 89.13 P99.99: 664.50 ------------------------------------------------------ [ 0, 1 ] 32498 13.827% 13.827% ### ( 1, 2 ] 146345 62.265% 76.092% ############ ( 2, 3 ] 33099 14.083% 90.174% ### ( 3, 4 ] 11509 4.897% 95.071% # ( 4, 6 ] 9288 3.952% 99.023% # ( 6, 10 ] 1663 0.708% 99.730% ( 10, 15 ] 277 0.118% 99.848% ( 15, 22 ] 41 0.017% 99.866% ( 22, 34 ] 6 0.003% 99.868% ( 34, 51 ] 23 0.010% 99.878% ( 51, 76 ] 23 0.010% 99.888% ( 76, 110 ] 75 0.032% 99.920% ( 110, 170 ] 83 0.035% 99.955% ( 170, 250 ] 30 0.013% 99.968% ( 250, 380 ] 29 0.012% 99.980% ( 380, 580 ] 20 0.009% 99.989% ( 580, 870 ] 12 0.005% 99.994% ( 870, 1300 ] 7 0.003% 99.997% ( 1300, 1900 ] 7 0.003% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28280 Average: 2.1938 StdDev: 8.76 Min: 1 Median: 1.3974 Max: 1008 Percentiles: P50: 1.40 P75: 1.83 P99: 6.16 P99.9: 13.26 P99.99: 353.09 ------------------------------------------------------ [ 0, 1 ] 7601 26.878% 26.878% ##### ( 1, 2 ] 16455 58.186% 85.064% ############ ( 2, 3 ] 2388 8.444% 93.508% ## ( 3, 4 ] 883 3.122% 96.630% # ( 4, 6 ] 660 2.334% 98.964% ( 6, 10 ] 253 0.895% 99.859% ( 10, 15 ] 18 0.064% 99.922% ( 15, 22 ] 3 0.011% 99.933% ( 22, 34 ] 1 0.004% 99.936% ( 110, 170 ] 3 0.011% 99.947% ( 170, 250 ] 9 0.032% 99.979% ( 250, 380 ] 4 0.014% 99.993% ( 380, 580 ] 1 0.004% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 212027 Average: 3.8218 StdDev: 31.94 Min: 1 Median: 1.6980 Max: 3939 Percentiles: P50: 1.70 P75: 2.39 P99: 9.48 P99.9: 317.70 P99.99: 794.71 ------------------------------------------------------ [ 0, 1 ] 15730 7.419% 7.419% # ( 1, 2 ] 129346 61.004% 68.423% ############ ( 2, 3 ] 36067 17.011% 85.434% ### ( 3, 4 ] 13615 6.421% 91.855% # ( 4, 6 ] 11442 5.396% 97.252% # ( 6, 10 ] 4257 2.008% 99.260% ( 10, 15 ] 570 0.269% 99.528% ( 15, 22 ] 76 0.036% 99.564% ( 22, 34 ] 21 0.010% 99.574% ( 34, 51 ] 21 0.010% 99.584% ( 51, 76 ] 27 0.013% 99.597% ( 76, 110 ] 129 0.061% 99.658% ( 110, 170 ] 289 0.136% 99.794% ( 170, 250 ] 163 0.077% 99.871% ( 250, 380 ] 119 0.056% 99.927% ( 380, 580 ] 99 0.047% 99.974% ( 580, 870 ] 47 0.022% 99.996% ( 870, 1300 ] 21 0.010% 100.006% ( 1300, 1900 ] 6 0.003% 100.008% ( 1900, 2900 ] 8 0.004% 100.012% ( 2900, 4400 ] 6 0.003% 100.015% ** Level 4 read latency histogram (micros): Count: 30 Average: 1252.5333 StdDev: 870.01 Min: 109 Median: 1192.5000 Max: 3000 Percentiles: P50: 1192.50 P75: 1971.43 P99: 3000.00 P99.9: 3000.00 P99.99: 3000.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 5 16.667% 36.667% ### ( 580, 870 ] 1 3.333% 40.000% # ( 870, 1300 ] 4 13.333% 53.333% ### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 7 23.333% 96.667% ##### ( 2900, 4400 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 767.1500 StdDev: 831.75 Min: 106 Median: 430.0000 Max: 3019 Percentiles: P50: 430.00 P75: 1085.00 P99: 3019.00 P99.9: 3019.00 P99.99: 3019.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 2 10.000% 35.000% ## ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 4 20.000% 65.000% #### ( 870, 1300 ] 4 20.000% 85.000% #### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.3 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 322.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.818 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.375 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-08:54:52 ... thread 0: (1000000,6000000) ops and (200252.3,299248.2) ops/second in (4.993701,20.050246) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.69 GB 37.8 4.2 0.0 4.2 9.9 5.7 0.0 1.7 132.5 309.0 32.81 30.72 99 0.331 4413K 4485 0.0 0.0 L1 14/14 1.39 GB 0.0 2.2 1.8 0.4 2.2 1.8 0.1 1.2 232.8 231.7 9.68 9.35 3 3.227 2288K 10K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 225.3 225.2 0.49 0.46 1 0.494 113K 30 0.0 0.0 L3 24/0 988.28 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.3 213.3 213.2 6.84 6.08 4 1.711 1463K 728 0.0 0.0 L4 152/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/31 101.78 GB 0.0 8.0 2.5 5.5 13.6 8.2 1.4 2.4 164.0 280.0 49.82 46.61 107 0.466 8278K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.0 2.5 5.5 13.6 8.2 1.4 2.4 164.0 280.0 49.82 46.61 107 0.466 8278K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.0 2.5 5.5 8.0 2.5 0.0 0.0 243.6 243.1 33.54 32.10 24 1.398 8278K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 356.0 16.28 14.51 83 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.3 total, 20.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.62 GB write, 688.09 MB/s write, 7.98 GB read, 403.04 MB/s read, 49.8 seconds Interval compaction: 13.62 GB write, 695.74 MB/s write, 7.98 GB read, 407.52 MB/s read, 49.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 16, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1857406 Average: 2.2716 StdDev: 12.53 Min: 0 Median: 1.5039 Max: 5004 Percentiles: P50: 1.50 P75: 1.89 P99: 5.77 P99.9: 10.55 P99.99: 14.86 ------------------------------------------------------ [ 0, 1 ] 319494 17.201% 17.201% ### ( 1, 2 ] 1209051 65.094% 82.295% ############# ( 2, 3 ] 199711 10.752% 93.047% ## ( 3, 4 ] 69308 3.731% 96.778% # ( 4, 6 ] 46617 2.510% 99.288% # ( 6, 10 ] 11155 0.601% 99.889% ( 10, 15 ] 1939 0.104% 99.993% ( 15, 22 ] 181 0.010% 100.003% ( 22, 34 ] 26 0.001% 100.004% ( 34, 51 ] 9 0.000% 100.005% ( 51, 76 ] 15 0.001% 100.005% ( 76, 110 ] 151 0.008% 100.014% ( 110, 170 ] 234 0.013% 100.026% ( 170, 250 ] 134 0.007% 100.033% ( 250, 380 ] 71 0.004% 100.037% ( 380, 580 ] 54 0.003% 100.040% ( 580, 870 ] 47 0.003% 100.043% ( 870, 1300 ] 22 0.001% 100.044% ( 1300, 1900 ] 10 0.001% 100.044% ( 1900, 2900 ] 11 0.001% 100.045% ( 2900, 4400 ] 7 0.000% 100.045% ( 4400, 6600 ] 2 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 335646 Average: 2.6037 StdDev: 14.39 Min: 0 Median: 1.5561 Max: 3049 Percentiles: P50: 1.56 P75: 1.95 P99: 6.90 P99.9: 116.56 P99.99: 571.77 ------------------------------------------------------ [ 0, 1 ] 49131 14.638% 14.638% ### ( 1, 2 ] 213420 63.585% 78.223% ############# ( 2, 3 ] 43221 12.877% 91.100% ### ( 3, 4 ] 14385 4.286% 95.385% # ( 4, 6 ] 11444 3.410% 98.795% # ( 6, 10 ] 3071 0.915% 99.710% ( 10, 15 ] 344 0.102% 99.812% ( 15, 22 ] 52 0.015% 99.828% ( 22, 34 ] 9 0.003% 99.830% ( 34, 51 ] 23 0.007% 99.837% ( 51, 76 ] 27 0.008% 99.845% ( 76, 110 ] 164 0.049% 99.894% ( 110, 170 ] 177 0.053% 99.947% ( 170, 250 ] 68 0.020% 99.967% ( 250, 380 ] 40 0.012% 99.979% ( 380, 580 ] 38 0.011% 99.990% ( 580, 870 ] 15 0.004% 99.995% ( 870, 1300 ] 8 0.002% 99.997% ( 1300, 1900 ] 7 0.002% 99.999% ( 1900, 2900 ] 1 0.000% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28280 Average: 2.1938 StdDev: 8.76 Min: 1 Median: 1.3974 Max: 1008 Percentiles: P50: 1.40 P75: 1.83 P99: 6.16 P99.9: 13.26 P99.99: 353.09 ------------------------------------------------------ [ 0, 1 ] 7601 26.878% 26.878% ##### ( 1, 2 ] 16455 58.186% 85.064% ############ ( 2, 3 ] 2388 8.444% 93.508% ## ( 3, 4 ] 883 3.122% 96.630% # ( 4, 6 ] 660 2.334% 98.964% ( 6, 10 ] 253 0.895% 99.859% ( 10, 15 ] 18 0.064% 99.922% ( 15, 22 ] 3 0.011% 99.933% ( 22, 34 ] 1 0.004% 99.936% ( 110, 170 ] 3 0.011% 99.947% ( 170, 250 ] 9 0.032% 99.979% ( 250, 380 ] 4 0.014% 99.993% ( 380, 580 ] 1 0.004% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 212027 Average: 3.8218 StdDev: 31.94 Min: 1 Median: 1.6980 Max: 3939 Percentiles: P50: 1.70 P75: 2.39 P99: 9.48 P99.9: 317.70 P99.99: 794.71 ------------------------------------------------------ [ 0, 1 ] 15730 7.419% 7.419% # ( 1, 2 ] 129346 61.004% 68.423% ############ ( 2, 3 ] 36067 17.011% 85.434% ### ( 3, 4 ] 13615 6.421% 91.855% # ( 4, 6 ] 11442 5.396% 97.252% # ( 6, 10 ] 4257 2.008% 99.260% ( 10, 15 ] 570 0.269% 99.528% ( 15, 22 ] 76 0.036% 99.564% ( 22, 34 ] 21 0.010% 99.574% ( 34, 51 ] 21 0.010% 99.584% ( 51, 76 ] 27 0.013% 99.597% ( 76, 110 ] 129 0.061% 99.658% ( 110, 170 ] 289 0.136% 99.794% ( 170, 250 ] 163 0.077% 99.871% ( 250, 380 ] 119 0.056% 99.927% ( 380, 580 ] 99 0.047% 99.974% ( 580, 870 ] 47 0.022% 99.996% ( 870, 1300 ] 21 0.010% 100.006% ( 1300, 1900 ] 6 0.003% 100.008% ( 1900, 2900 ] 8 0.004% 100.012% ( 2900, 4400 ] 6 0.003% 100.015% ** Level 4 read latency histogram (micros): Count: 30 Average: 1252.5333 StdDev: 870.01 Min: 109 Median: 1192.5000 Max: 3000 Percentiles: P50: 1192.50 P75: 1971.43 P99: 3000.00 P99.9: 3000.00 P99.99: 3000.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 5 16.667% 36.667% ### ( 580, 870 ] 1 3.333% 40.000% # ( 870, 1300 ] 4 13.333% 53.333% ### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 7 23.333% 96.667% ##### ( 2900, 4400 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 767.1500 StdDev: 831.75 Min: 106 Median: 430.0000 Max: 3019 Percentiles: P50: 430.00 P75: 1085.00 P99: 3019.00 P99.9: 3019.00 P99.99: 3019.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 2 10.000% 35.000% ## ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 4 20.000% 65.000% #### ( 870, 1300 ] 4 20.000% 85.000% #### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 20.3 total, 5.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 291.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.051 H:M:S, 20.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 197.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.234 H:M:S, 44.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-08:55:06 ... thread 0: (1000000,7000000) ops and (75583.0,210331.9) ops/second in (13.230495,33.280741) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/5 2.09 GB 6.3 6.6 0.0 6.6 13.2 6.6 0.0 2.0 150.4 300.6 44.81 41.97 119 0.377 6842K 10K 0.0 0.0 L1 19/19 1.83 GB 0.0 6.1 4.4 1.7 6.0 4.3 0.1 1.4 222.8 220.0 28.09 26.58 4 7.023 6356K 78K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.6 1.8 225.3 225.2 0.49 0.46 1 0.494 113K 30 0.0 0.0 L3 27/11 2.19 GB 1.2 1.4 0.6 0.8 1.4 0.6 2.0 2.3 213.3 213.2 6.84 6.08 4 1.711 1463K 728 0.0 0.0 L4 165/21 10.40 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/56 102.63 GB 0.0 14.2 5.0 9.2 20.7 11.5 6.2 3.1 181.6 264.5 80.24 75.08 128 0.627 14M 89K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.2 5.0 9.2 20.7 11.5 6.2 3.1 181.6 264.5 80.24 75.08 128 0.627 14M 89K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.2 5.0 9.2 14.1 4.9 0.0 0.0 238.7 237.2 61.03 58.09 30 2.034 14M 89K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 351.0 19.20 17.00 98 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.5 total, 33.3 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.72 GB write, 633.36 MB/s write, 14.23 GB read, 434.87 MB/s read, 80.2 seconds Interval compaction: 20.72 GB write, 637.60 MB/s write, 14.23 GB read, 437.78 MB/s read, 80.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 16, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2883875 Average: 2.6054 StdDev: 20.52 Min: 0 Median: 1.4857 Max: 6051 Percentiles: P50: 1.49 P75: 1.87 P99: 5.95 P99.9: 112.45 P99.99: 213.87 ------------------------------------------------------ [ 0, 1 ] 529676 18.367% 18.367% #### ( 1, 2 ] 1878423 65.135% 83.502% ############# ( 2, 3 ] 283425 9.828% 93.330% ## ( 3, 4 ] 99485 3.450% 96.780% # ( 4, 6 ] 65507 2.271% 99.051% ( 6, 10 ] 18956 0.657% 99.709% ( 10, 15 ] 2837 0.098% 99.807% ( 15, 22 ] 372 0.013% 99.820% ( 22, 34 ] 32 0.001% 99.821% ( 34, 51 ] 33 0.001% 99.822% ( 51, 76 ] 89 0.003% 99.825% ( 76, 110 ] 2063 0.072% 99.897% ( 110, 170 ] 2303 0.080% 99.977% ( 170, 250 ] 705 0.024% 100.001% ( 250, 380 ] 373 0.013% 100.014% ( 380, 580 ] 354 0.012% 100.026% ( 580, 870 ] 219 0.008% 100.034% ( 870, 1300 ] 77 0.003% 100.037% ( 1300, 1900 ] 33 0.001% 100.038% ( 1900, 2900 ] 37 0.001% 100.039% ( 2900, 4400 ] 36 0.001% 100.040% ( 4400, 6600 ] 4 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 660474 Average: 3.1242 StdDev: 34.07 Min: 0 Median: 1.5460 Max: 4716 Percentiles: P50: 1.55 P75: 1.95 P99: 7.63 P99.9: 123.75 P99.99: 345.63 ------------------------------------------------------ [ 0, 1 ] 105155 15.921% 15.921% ### ( 1, 2 ] 412218 62.412% 78.334% ############ ( 2, 3 ] 80337 12.164% 90.497% ## ( 3, 4 ] 29308 4.437% 94.935% # ( 4, 6 ] 24042 3.640% 98.575% # ( 6, 10 ] 6893 1.044% 99.618% ( 10, 15 ] 828 0.125% 99.744% ( 15, 22 ] 133 0.020% 99.764% ( 22, 34 ] 13 0.002% 99.766% ( 34, 51 ] 26 0.004% 99.770% ( 51, 76 ] 83 0.013% 99.782% ( 76, 110 ] 673 0.102% 99.884% ( 110, 170 ] 465 0.070% 99.955% ( 170, 250 ] 144 0.022% 99.976% ( 250, 380 ] 125 0.019% 99.995% ( 380, 580 ] 111 0.017% 100.012% ( 580, 870 ] 81 0.012% 100.024% ( 870, 1300 ] 65 0.010% 100.034% ( 1300, 1900 ] 31 0.005% 100.039% ( 1900, 2900 ] 28 0.004% 100.043% ( 2900, 4400 ] 24 0.004% 100.047% ( 4400, 6600 ] 4 0.001% 100.047% ** Level 2 read latency histogram (micros): Count: 28280 Average: 2.1938 StdDev: 8.76 Min: 1 Median: 1.3974 Max: 1008 Percentiles: P50: 1.40 P75: 1.83 P99: 6.16 P99.9: 13.26 P99.99: 353.09 ------------------------------------------------------ [ 0, 1 ] 7601 26.878% 26.878% ##### ( 1, 2 ] 16455 58.186% 85.064% ############ ( 2, 3 ] 2388 8.444% 93.508% ## ( 3, 4 ] 883 3.122% 96.630% # ( 4, 6 ] 660 2.334% 98.964% ( 6, 10 ] 253 0.895% 99.859% ( 10, 15 ] 18 0.064% 99.922% ( 15, 22 ] 3 0.011% 99.933% ( 22, 34 ] 1 0.004% 99.936% ( 110, 170 ] 3 0.011% 99.947% ( 170, 250 ] 9 0.032% 99.979% ( 250, 380 ] 4 0.014% 99.993% ( 380, 580 ] 1 0.004% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 239124 Average: 6.8680 StdDev: 79.74 Min: 1 Median: 1.7202 Max: 7125 Percentiles: P50: 1.72 P75: 2.47 P99: 12.20 P99.9: 841.74 P99.99: 2201.46 ------------------------------------------------------ [ 0, 1 ] 16584 6.935% 6.935% # ( 1, 2 ] 142978 59.792% 66.728% ############ ( 2, 3 ] 41908 17.526% 84.253% #### ( 3, 4 ] 16754 7.006% 91.260% # ( 4, 6 ] 13251 5.541% 96.801% # ( 6, 10 ] 4947 2.069% 98.870% ( 10, 15 ] 705 0.295% 99.165% ( 15, 22 ] 99 0.041% 99.206% ( 22, 34 ] 23 0.010% 99.216% ( 34, 51 ] 22 0.009% 99.225% ( 51, 76 ] 27 0.011% 99.236% ( 76, 110 ] 136 0.057% 99.293% ( 110, 170 ] 364 0.152% 99.445% ( 170, 250 ] 298 0.125% 99.570% ( 250, 380 ] 324 0.135% 99.706% ( 380, 580 ] 297 0.124% 99.830% ( 580, 870 ] 186 0.078% 99.908% ( 870, 1300 ] 123 0.051% 99.959% ( 1300, 1900 ] 56 0.023% 99.982% ( 1900, 2900 ] 60 0.025% 100.008% ( 2900, 4400 ] 35 0.015% 100.022% ( 4400, 6600 ] 8 0.003% 100.026% ( 6600, 9900 ] 1 0.000% 100.026% ** Level 4 read latency histogram (micros): Count: 30 Average: 1252.5333 StdDev: 870.01 Min: 109 Median: 1192.5000 Max: 3000 Percentiles: P50: 1192.50 P75: 1971.43 P99: 3000.00 P99.9: 3000.00 P99.99: 3000.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 5 16.667% 36.667% ### ( 580, 870 ] 1 3.333% 40.000% # ( 870, 1300 ] 4 13.333% 53.333% ### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 7 23.333% 96.667% ##### ( 2900, 4400 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 767.1500 StdDev: 831.75 Min: 106 Median: 430.0000 Max: 3019 Percentiles: P50: 430.00 P75: 1085.00 P99: 3019.00 P99.9: 3019.00 P99.99: 3019.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 2 10.000% 35.000% ## ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 4 20.000% 65.000% #### ( 870, 1300 ] 4 20.000% 85.000% #### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 33.5 total, 13.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 205.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.039 H:M:S, 41.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 74.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.988 H:M:S, 75.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/14-08:55:13 ... thread 0: (1000000,8000000) ops and (129556.9,195125.0) ops/second in (7.718616,40.999357) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 3.13 GB 81.8 7.2 0.0 7.2 14.8 7.6 0.0 1.9 143.6 295.7 51.31 47.25 135 0.380 7482K 10K 0.0 0.0 L1 19/19 1.83 GB 0.0 6.1 4.4 1.7 6.0 4.3 0.1 1.4 222.8 220.0 28.09 26.58 4 7.023 6356K 78K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.6 1.8 225.3 225.2 0.49 0.46 1 0.494 113K 30 0.0 0.0 L3 12/0 905.79 MB 0.9 1.4 0.6 0.8 1.4 0.6 2.0 2.3 213.3 213.2 6.84 6.08 4 1.711 1463K 728 0.0 0.0 L4 168/0 9.64 GB 1.0 4.4 1.3 3.1 4.4 1.3 1.2 3.3 168.3 167.6 26.71 19.30 12 2.226 2201K 5850 0.0 0.0 L5 1072/0 88.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1285/28 103.66 GB 0.0 19.2 6.3 12.9 26.8 13.9 8.2 3.5 173.6 241.5 113.44 99.66 156 0.727 17M 96K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.2 6.3 12.9 26.8 13.9 8.2 3.5 173.6 241.5 113.44 99.66 156 0.727 17M 96K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.2 6.3 12.9 19.1 6.2 0.0 0.0 218.2 217.0 90.27 79.82 44 2.052 17M 96K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 337.0 23.18 19.84 112 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.2 total, 41.0 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.76 GB write, 664.62 MB/s write, 19.23 GB read, 477.77 MB/s read, 113.4 seconds Interval compaction: 26.76 GB write, 668.24 MB/s write, 19.23 GB read, 480.37 MB/s read, 113.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 29, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3415836 Average: 2.6664 StdDev: 19.98 Min: 0 Median: 1.5231 Max: 6051 Percentiles: P50: 1.52 P75: 1.91 P99: 6.48 P99.9: 108.22 P99.99: 215.88 ------------------------------------------------------ [ 0, 1 ] 557188 16.312% 16.312% ### ( 1, 2 ] 2199676 64.396% 80.708% ############# ( 2, 3 ] 381369 11.165% 91.873% ## ( 3, 4 ] 138679 4.060% 95.933% # ( 4, 6 ] 101393 2.968% 98.901% # ( 6, 10 ] 27852 0.815% 99.717% ( 10, 15 ] 3604 0.106% 99.822% ( 15, 22 ] 468 0.014% 99.836% ( 22, 34 ] 36 0.001% 99.837% ( 34, 51 ] 34 0.001% 99.838% ( 51, 76 ] 91 0.003% 99.841% ( 76, 110 ] 2142 0.063% 99.903% ( 110, 170 ] 2491 0.073% 99.976% ( 170, 250 ] 822 0.024% 100.000% ( 250, 380 ] 484 0.014% 100.014% ( 380, 580 ] 419 0.012% 100.027% ( 580, 870 ] 274 0.008% 100.035% ( 870, 1300 ] 92 0.003% 100.037% ( 1300, 1900 ] 38 0.001% 100.039% ( 1900, 2900 ] 43 0.001% 100.040% ( 2900, 4400 ] 38 0.001% 100.041% ( 4400, 6600 ] 4 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 961613 Average: 3.6395 StdDev: 45.68 Min: 0 Median: 1.6378 Max: 7277 Percentiles: P50: 1.64 P75: 2.22 P99: 8.44 P99.9: 100.62 P99.99: 220.19 ------------------------------------------------------ [ 0, 1 ] 113649 11.819% 11.819% ## ( 1, 2 ] 575628 59.861% 71.679% ############ ( 2, 3 ] 144916 15.070% 86.749% ### ( 3, 4 ] 57488 5.978% 92.728% # ( 4, 6 ] 51226 5.327% 98.055% # ( 6, 10 ] 14878 1.547% 99.602% ( 10, 15 ] 1911 0.199% 99.801% ( 15, 22 ] 284 0.030% 99.830% ( 22, 34 ] 29 0.003% 99.833% ( 34, 51 ] 28 0.003% 99.836% ( 51, 76 ] 85 0.009% 99.845% ( 76, 110 ] 731 0.076% 99.921% ( 110, 170 ] 544 0.057% 99.978% ( 170, 250 ] 191 0.020% 99.997% ( 250, 380 ] 207 0.022% 100.019% ( 380, 580 ] 211 0.022% 100.041% ( 580, 870 ] 172 0.018% 100.059% ( 870, 1300 ] 134 0.014% 100.073% ( 1300, 1900 ] 58 0.006% 100.079% ( 1900, 2900 ] 72 0.007% 100.086% ( 2900, 4400 ] 67 0.007% 100.093% ( 4400, 6600 ] 11 0.001% 100.094% ( 6600, 9900 ] 1 0.000% 100.094% ** Level 2 read latency histogram (micros): Count: 28280 Average: 2.1938 StdDev: 8.76 Min: 1 Median: 1.3974 Max: 1008 Percentiles: P50: 1.40 P75: 1.83 P99: 6.16 P99.9: 13.26 P99.99: 353.09 ------------------------------------------------------ [ 0, 1 ] 7601 26.878% 26.878% ##### ( 1, 2 ] 16455 58.186% 85.064% ############ ( 2, 3 ] 2388 8.444% 93.508% ## ( 3, 4 ] 883 3.122% 96.630% # ( 4, 6 ] 660 2.334% 98.964% ( 6, 10 ] 253 0.895% 99.859% ( 10, 15 ] 18 0.064% 99.922% ( 15, 22 ] 3 0.011% 99.933% ( 22, 34 ] 1 0.004% 99.936% ( 110, 170 ] 3 0.011% 99.947% ( 170, 250 ] 9 0.032% 99.979% ( 250, 380 ] 4 0.014% 99.993% ( 380, 580 ] 1 0.004% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 319508 Average: 8.9241 StdDev: 98.24 Min: 1 Median: 1.7797 Max: 7527 Percentiles: P50: 1.78 P75: 2.66 P99: 16.38 P99.9: 1059.97 P99.99: 1980.80 ------------------------------------------------------ [ 0, 1 ] 18258 5.714% 5.714% # ( 1, 2 ] 181471 56.797% 62.511% ########### ( 2, 3 ] 60722 19.005% 81.516% #### ( 3, 4 ] 26102 8.169% 89.686% ## ( 4, 6 ] 21080 6.598% 96.283% # ( 6, 10 ] 7549 2.363% 98.646% ( 10, 15 ] 1100 0.344% 98.990% ( 15, 22 ] 157 0.049% 99.039% ( 22, 34 ] 34 0.011% 99.050% ( 34, 51 ] 22 0.007% 99.057% ( 51, 76 ] 28 0.009% 99.066% ( 76, 110 ] 164 0.051% 99.117% ( 110, 170 ] 464 0.145% 99.262% ( 170, 250 ] 408 0.128% 99.390% ( 250, 380 ] 510 0.160% 99.550% ( 380, 580 ] 570 0.178% 99.728% ( 580, 870 ] 428 0.134% 99.862% ( 870, 1300 ] 275 0.086% 99.948% ( 1300, 1900 ] 125 0.039% 99.987% ( 1900, 2900 ] 112 0.035% 100.022% ( 2900, 4400 ] 74 0.023% 100.045% ( 4400, 6600 ] 16 0.005% 100.050% ( 6600, 9900 ] 2 0.001% 100.051% ** Level 4 read latency histogram (micros): Count: 36116 Average: 6.5661 StdDev: 73.86 Min: 0 Median: 1.9583 Max: 3795 Percentiles: P50: 1.96 P75: 2.92 P99: 9.35 P99.9: 1072.39 P99.99: 2208.04 ------------------------------------------------------ [ 0, 1 ] 418 1.157% 1.157% ( 1, 2 ] 18407 50.966% 52.124% ########## ( 2, 3 ] 8964 24.820% 76.944% ##### ( 3, 4 ] 3748 10.378% 87.321% ## ( 4, 6 ] 3794 10.505% 97.826% ## ( 6, 10 ] 506 1.401% 99.227% ( 10, 15 ] 74 0.205% 99.432% ( 15, 22 ] 17 0.047% 99.479% ( 22, 34 ] 17 0.047% 99.527% ( 34, 51 ] 2 0.006% 99.532% ( 51, 76 ] 2 0.006% 99.538% ( 76, 110 ] 10 0.028% 99.565% ( 110, 170 ] 11 0.030% 99.596% ( 170, 250 ] 30 0.083% 99.679% ( 250, 380 ] 22 0.061% 99.740% ( 380, 580 ] 32 0.089% 99.828% ( 580, 870 ] 16 0.044% 99.873% ( 870, 1300 ] 21 0.058% 99.931% ( 1300, 1900 ] 18 0.050% 99.981% ( 1900, 2900 ] 11 0.030% 100.011% ( 2900, 4400 ] 4 0.011% 100.022% ** Level 5 read latency histogram (micros): Count: 20 Average: 767.1500 StdDev: 831.75 Min: 106 Median: 430.0000 Max: 3019 Percentiles: P50: 430.00 P75: 1085.00 P99: 3019.00 P99.9: 3019.00 P99.99: 3019.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 2 10.000% 35.000% ## ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 4 20.000% 65.000% #### ( 870, 1300 ] 4 20.000% 85.000% #### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 41.2 total, 7.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 190.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.792 H:M:S, 45.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.753 H:M:S, 61.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-08:55:16 ... thread 0: (1000000,9000000) ops and (330517.1,204429.7) ops/second in (3.025562,44.024919) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 4.05 GB 182.5 8.0 0.0 8.0 16.5 8.5 0.0 1.9 143.1 295.9 57.23 52.75 151 0.379 8314K 11K 0.0 0.0 L1 19/19 1.83 GB 0.0 6.1 4.4 1.7 6.0 4.3 0.1 1.4 222.8 220.0 28.09 26.58 4 7.023 6356K 78K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.6 1.8 225.3 225.2 0.49 0.46 1 0.494 113K 30 0.0 0.0 L3 12/0 905.79 MB 0.9 1.4 0.6 0.8 1.4 0.6 2.0 2.3 213.3 213.2 6.84 6.08 4 1.711 1463K 728 0.0 0.0 L4 168/0 9.64 GB 1.0 4.4 1.3 3.1 4.4 1.3 1.2 3.3 168.3 167.6 26.71 19.30 12 2.226 2201K 5850 0.0 0.0 L5 1072/0 88.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/28 104.58 GB 0.0 20.0 6.3 13.7 28.5 14.8 8.2 3.3 171.9 244.3 119.36 105.17 172 0.694 18M 97K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.0 6.3 13.7 28.5 14.8 8.2 3.3 171.9 244.3 119.36 105.17 172 0.694 18M 97K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.0 6.3 13.7 19.9 6.2 0.0 0.0 219.5 218.3 93.48 82.93 47 1.989 18M 97K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 338.3 25.88 22.24 125 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.2 total, 44.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.48 GB write, 659.02 MB/s write, 20.03 GB read, 463.61 MB/s read, 119.4 seconds Interval compaction: 28.48 GB write, 662.36 MB/s write, 20.03 GB read, 465.96 MB/s read, 119.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 34, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3687504 Average: 2.6400 StdDev: 19.64 Min: 0 Median: 1.5221 Max: 6051 Percentiles: P50: 1.52 P75: 1.91 P99: 6.34 P99.9: 104.87 P99.99: 214.15 ------------------------------------------------------ [ 0, 1 ] 599762 16.265% 16.265% ### ( 1, 2 ] 2382796 64.618% 80.883% ############# ( 2, 3 ] 410510 11.132% 92.015% ## ( 3, 4 ] 147967 4.013% 96.028% # ( 4, 6 ] 107056 2.903% 98.931% # ( 6, 10 ] 29495 0.800% 99.731% ( 10, 15 ] 3743 0.102% 99.833% ( 15, 22 ] 483 0.013% 99.846% ( 22, 34 ] 38 0.001% 99.847% ( 34, 51 ] 34 0.001% 99.848% ( 51, 76 ] 93 0.003% 99.850% ( 76, 110 ] 2166 0.059% 99.909% ( 110, 170 ] 2527 0.069% 99.977% ( 170, 250 ] 843 0.023% 100.000% ( 250, 380 ] 500 0.014% 100.014% ( 380, 580 ] 433 0.012% 100.026% ( 580, 870 ] 284 0.008% 100.033% ( 870, 1300 ] 96 0.003% 100.036% ( 1300, 1900 ] 41 0.001% 100.037% ( 1900, 2900 ] 44 0.001% 100.038% ( 2900, 4400 ] 40 0.001% 100.039% ( 4400, 6600 ] 4 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 1075661 Average: 3.5559 StdDev: 43.58 Min: 0 Median: 1.6281 Max: 7277 Percentiles: P50: 1.63 P75: 2.16 P99: 8.43 P99.9: 105.35 P99.99: 247.02 ------------------------------------------------------ [ 0, 1 ] 127420 11.846% 11.846% ## ( 1, 2 ] 653439 60.748% 72.593% ############ ( 2, 3 ] 159083 14.789% 87.383% ### ( 3, 4 ] 60908 5.662% 93.045% # ( 4, 6 ] 53963 5.017% 98.062% # ( 6, 10 ] 16632 1.546% 99.608% ( 10, 15 ] 1964 0.183% 99.791% ( 15, 22 ] 287 0.027% 99.817% ( 22, 34 ] 30 0.003% 99.820% ( 34, 51 ] 28 0.003% 99.823% ( 51, 76 ] 88 0.008% 99.831% ( 76, 110 ] 861 0.080% 99.911% ( 110, 170 ] 629 0.058% 99.969% ( 170, 250 ] 230 0.021% 99.991% ( 250, 380 ] 240 0.022% 100.013% ( 380, 580 ] 231 0.021% 100.035% ( 580, 870 ] 187 0.017% 100.052% ( 870, 1300 ] 136 0.013% 100.065% ( 1300, 1900 ] 61 0.006% 100.070% ( 1900, 2900 ] 72 0.007% 100.077% ( 2900, 4400 ] 68 0.006% 100.083% ( 4400, 6600 ] 11 0.001% 100.084% ( 6600, 9900 ] 1 0.000% 100.084% ** Level 2 read latency histogram (micros): Count: 28280 Average: 2.1938 StdDev: 8.76 Min: 1 Median: 1.3974 Max: 1008 Percentiles: P50: 1.40 P75: 1.83 P99: 6.16 P99.9: 13.26 P99.99: 353.09 ------------------------------------------------------ [ 0, 1 ] 7601 26.878% 26.878% ##### ( 1, 2 ] 16455 58.186% 85.064% ############ ( 2, 3 ] 2388 8.444% 93.508% ## ( 3, 4 ] 883 3.122% 96.630% # ( 4, 6 ] 660 2.334% 98.964% ( 6, 10 ] 253 0.895% 99.859% ( 10, 15 ] 18 0.064% 99.922% ( 15, 22 ] 3 0.011% 99.933% ( 22, 34 ] 1 0.004% 99.936% ( 110, 170 ] 3 0.011% 99.947% ( 170, 250 ] 9 0.032% 99.979% ( 250, 380 ] 4 0.014% 99.993% ( 380, 580 ] 1 0.004% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 319508 Average: 8.9241 StdDev: 98.24 Min: 1 Median: 1.7797 Max: 7527 Percentiles: P50: 1.78 P75: 2.66 P99: 16.38 P99.9: 1059.97 P99.99: 1980.80 ------------------------------------------------------ [ 0, 1 ] 18258 5.714% 5.714% # ( 1, 2 ] 181471 56.797% 62.511% ########### ( 2, 3 ] 60722 19.005% 81.516% #### ( 3, 4 ] 26102 8.169% 89.686% ## ( 4, 6 ] 21080 6.598% 96.283% # ( 6, 10 ] 7549 2.363% 98.646% ( 10, 15 ] 1100 0.344% 98.990% ( 15, 22 ] 157 0.049% 99.039% ( 22, 34 ] 34 0.011% 99.050% ( 34, 51 ] 22 0.007% 99.057% ( 51, 76 ] 28 0.009% 99.066% ( 76, 110 ] 164 0.051% 99.117% ( 110, 170 ] 464 0.145% 99.262% ( 170, 250 ] 408 0.128% 99.390% ( 250, 380 ] 510 0.160% 99.550% ( 380, 580 ] 570 0.178% 99.728% ( 580, 870 ] 428 0.134% 99.862% ( 870, 1300 ] 275 0.086% 99.948% ( 1300, 1900 ] 125 0.039% 99.987% ( 1900, 2900 ] 112 0.035% 100.022% ( 2900, 4400 ] 74 0.023% 100.045% ( 4400, 6600 ] 16 0.005% 100.050% ( 6600, 9900 ] 2 0.001% 100.051% ** Level 4 read latency histogram (micros): Count: 36116 Average: 6.5661 StdDev: 73.86 Min: 0 Median: 1.9583 Max: 3795 Percentiles: P50: 1.96 P75: 2.92 P99: 9.35 P99.9: 1072.39 P99.99: 2208.04 ------------------------------------------------------ [ 0, 1 ] 418 1.157% 1.157% ( 1, 2 ] 18407 50.966% 52.124% ########## ( 2, 3 ] 8964 24.820% 76.944% ##### ( 3, 4 ] 3748 10.378% 87.321% ## ( 4, 6 ] 3794 10.505% 97.826% ## ( 6, 10 ] 506 1.401% 99.227% ( 10, 15 ] 74 0.205% 99.432% ( 15, 22 ] 17 0.047% 99.479% ( 22, 34 ] 17 0.047% 99.527% ( 34, 51 ] 2 0.006% 99.532% ( 51, 76 ] 2 0.006% 99.538% ( 76, 110 ] 10 0.028% 99.565% ( 110, 170 ] 11 0.030% 99.596% ( 170, 250 ] 30 0.083% 99.679% ( 250, 380 ] 22 0.061% 99.740% ( 380, 580 ] 32 0.089% 99.828% ( 580, 870 ] 16 0.044% 99.873% ( 870, 1300 ] 21 0.058% 99.931% ( 1300, 1900 ] 18 0.050% 99.981% ( 1900, 2900 ] 11 0.030% 100.011% ( 2900, 4400 ] 4 0.011% 100.022% ** Level 5 read latency histogram (micros): Count: 20 Average: 767.1500 StdDev: 831.75 Min: 106 Median: 430.0000 Max: 3019 Percentiles: P50: 430.00 P75: 1085.00 P99: 3019.00 P99.9: 3019.00 P99.99: 3019.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 2 10.000% 35.000% ## ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 4 20.000% 65.000% #### ( 870, 1300 ] 4 20.000% 85.000% #### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 44.2 total, 3.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 200.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.202 H:M:S, 43.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.410 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-08:55:30 ... thread 0: (1000000,10000000) ops and (74347.7,173988.0) ops/second in (13.450313,57.475232) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 2.94 GB 44.1 10.1 0.0 10.1 19.5 9.5 0.0 2.1 149.0 288.6 69.34 63.56 168 0.413 10M 19K 0.0 0.0 L1 14/14 1.73 GB 0.0 10.0 6.4 3.6 9.8 6.3 0.1 1.5 216.3 213.5 47.20 43.51 5 9.440 8906K 78K 0.0 0.0 L2 1/0 68.03 MB 0.7 0.1 0.1 0.0 0.1 0.1 4.6 1.8 225.3 225.2 0.49 0.46 1 0.494 113K 30 0.0 0.0 L3 21/0 952.57 MB 1.0 2.6 1.0 1.6 2.6 1.0 3.6 2.5 176.7 175.5 14.95 11.64 10 1.495 2664K 17K 0.0 0.0 L4 159/0 9.74 GB 1.0 6.8 3.2 3.6 6.8 3.2 1.2 2.1 158.9 158.2 44.14 31.10 31 1.424 4749K 18K 0.0 0.0 L5 1096/0 90.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1303/23 105.41 GB 0.0 29.6 10.7 18.9 38.9 20.0 13.7 4.1 172.1 226.0 176.14 150.26 215 0.819 26M 133K 0.0 0.0 Int 0/0 0.00 KB 0.0 29.6 10.7 18.9 38.9 20.0 13.7 4.1 172.1 226.0 176.14 150.26 215 0.819 26M 133K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 29.6 10.7 18.9 29.4 10.5 0.0 0.0 205.7 204.3 147.34 125.57 77 1.913 26M 133K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 336.9 28.80 24.69 138 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.7 total, 57.5 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.87 GB write, 689.90 MB/s write, 29.60 GB read, 525.24 MB/s read, 176.1 seconds Interval compaction: 38.87 GB write, 692.57 MB/s write, 29.60 GB read, 527.28 MB/s read, 176.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 39, pending-compaction-bytes-stops: 0, total-delays: 57, total-stops: 38, interval: 95 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4599951 Average: 3.0047 StdDev: 26.98 Min: 0 Median: 1.5348 Max: 11908 Percentiles: P50: 1.53 P75: 1.92 P99: 7.60 P99.9: 154.21 P99.99: 347.05 ------------------------------------------------------ [ 0, 1 ] 721905 15.694% 15.694% ### ( 1, 2 ] 2950533 64.143% 79.836% ############# ( 2, 3 ] 530582 11.535% 91.371% ## ( 3, 4 ] 191956 4.173% 95.544% # ( 4, 6 ] 142205 3.091% 98.635% # ( 6, 10 ] 41940 0.912% 99.547% ( 10, 15 ] 5158 0.112% 99.659% ( 15, 22 ] 704 0.015% 99.675% ( 22, 34 ] 48 0.001% 99.676% ( 34, 51 ] 35 0.001% 99.676% ( 51, 76 ] 131 0.003% 99.679% ( 76, 110 ] 5580 0.121% 99.801% ( 110, 170 ] 6211 0.135% 99.936% ( 170, 250 ] 1698 0.037% 99.972% ( 250, 380 ] 1081 0.024% 99.996% ( 380, 580 ] 910 0.020% 100.016% ( 580, 870 ] 472 0.010% 100.026% ( 870, 1300 ] 165 0.004% 100.030% ( 1300, 1900 ] 71 0.002% 100.031% ( 1900, 2900 ] 81 0.002% 100.033% ( 2900, 4400 ] 85 0.002% 100.035% ( 4400, 6600 ] 14 0.000% 100.035% ( 6600, 9900 ] 4 0.000% 100.035% ( 9900, 14000 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 1908980 Average: 4.4959 StdDev: 62.22 Min: 0 Median: 1.7119 Max: 12990 Percentiles: P50: 1.71 P75: 2.50 P99: 8.97 P99.9: 97.40 P99.99: 155.39 ------------------------------------------------------ [ 0, 1 ] 178647 9.358% 9.358% ## ( 1, 2 ] 1089818 57.089% 66.447% ########### ( 2, 3 ] 324324 16.989% 83.437% ### ( 3, 4 ] 137645 7.210% 90.647% # ( 4, 6 ] 131197 6.873% 97.520% # ( 6, 10 ] 38103 1.996% 99.516% ( 10, 15 ] 5188 0.272% 99.787% ( 15, 22 ] 689 0.036% 99.824% ( 22, 34 ] 52 0.003% 99.826% ( 34, 51 ] 30 0.002% 99.828% ( 51, 76 ] 179 0.009% 99.837% ( 76, 110 ] 1905 0.100% 99.937% ( 110, 170 ] 1338 0.070% 100.007% ( 170, 250 ] 610 0.032% 100.039% ( 250, 380 ] 585 0.031% 100.070% ( 380, 580 ] 593 0.031% 100.101% ( 580, 870 ] 585 0.031% 100.131% ( 870, 1300 ] 374 0.020% 100.151% ( 1300, 1900 ] 205 0.011% 100.162% ( 1900, 2900 ] 191 0.010% 100.172% ( 2900, 4400 ] 225 0.012% 100.184% ( 4400, 6600 ] 46 0.002% 100.186% ( 6600, 9900 ] 12 0.001% 100.187% ( 9900, 14000 ] 1 0.000% 100.187% ** Level 2 read latency histogram (micros): Count: 28280 Average: 2.1938 StdDev: 8.76 Min: 1 Median: 1.3974 Max: 1008 Percentiles: P50: 1.40 P75: 1.83 P99: 6.16 P99.9: 13.26 P99.99: 353.09 ------------------------------------------------------ [ 0, 1 ] 7601 26.878% 26.878% ##### ( 1, 2 ] 16455 58.186% 85.064% ############ ( 2, 3 ] 2388 8.444% 93.508% ## ( 3, 4 ] 883 3.122% 96.630% # ( 4, 6 ] 660 2.334% 98.964% ( 6, 10 ] 253 0.895% 99.859% ( 10, 15 ] 18 0.064% 99.922% ( 15, 22 ] 3 0.011% 99.933% ( 22, 34 ] 1 0.004% 99.936% ( 110, 170 ] 3 0.011% 99.947% ( 170, 250 ] 9 0.032% 99.979% ( 250, 380 ] 4 0.014% 99.993% ( 380, 580 ] 1 0.004% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 599113 Average: 7.8081 StdDev: 91.36 Min: 1 Median: 1.8950 Max: 7527 Percentiles: P50: 1.90 P75: 2.91 P99: 9.92 P99.9: 585.43 P99.99: 831.68 ------------------------------------------------------ [ 0, 1 ] 21057 3.515% 3.515% # ( 1, 2 ] 311163 51.937% 55.452% ########## ( 2, 3 ] 128655 21.474% 76.926% #### ( 3, 4 ] 62412 10.417% 87.344% ## ( 4, 6 ] 56958 9.507% 96.851% ## ( 6, 10 ] 13150 2.195% 99.046% ( 10, 15 ] 2167 0.362% 99.407% ( 15, 22 ] 265 0.044% 99.452% ( 22, 34 ] 39 0.007% 99.458% ( 34, 51 ] 23 0.004% 99.462% ( 51, 76 ] 49 0.008% 99.470% ( 76, 110 ] 182 0.030% 99.500% ( 110, 170 ] 505 0.084% 99.585% ( 170, 250 ] 500 0.083% 99.668% ( 250, 380 ] 614 0.102% 99.771% ( 380, 580 ] 763 0.127% 99.898% ( 580, 870 ] 635 0.106% 100.004% ( 870, 1300 ] 472 0.079% 100.083% ( 1300, 1900 ] 208 0.035% 100.118% ( 1900, 2900 ] 137 0.023% 100.140% ( 2900, 4400 ] 128 0.021% 100.162% ( 4400, 6600 ] 30 0.005% 100.167% ( 6600, 9900 ] 4 0.001% 100.167% ** Level 4 read latency histogram (micros): Count: 132981 Average: 12.3241 StdDev: 140.24 Min: 0 Median: 1.9363 Max: 7983 Percentiles: P50: 1.94 P75: 2.93 P99: 31.11 P99.9: 1618.66 P99.99: 3545.43 ------------------------------------------------------ [ 0, 1 ] 2158 1.623% 1.623% ( 1, 2 ] 68708 51.668% 53.290% ########## ( 2, 3 ] 30986 23.301% 76.591% ##### ( 3, 4 ] 13864 10.426% 87.017% ## ( 4, 6 ] 12743 9.583% 96.600% ## ( 6, 10 ] 2679 2.015% 98.614% ( 10, 15 ] 446 0.335% 98.949% ( 15, 22 ] 52 0.039% 98.989% ( 22, 34 ] 20 0.015% 99.004% ( 34, 51 ] 3 0.002% 99.006% ( 51, 76 ] 5 0.004% 99.010% ( 76, 110 ] 53 0.040% 99.049% ( 110, 170 ] 91 0.068% 99.118% ( 170, 250 ] 134 0.101% 99.219% ( 250, 380 ] 162 0.122% 99.341% ( 380, 580 ] 239 0.180% 99.520% ( 580, 870 ] 265 0.199% 99.720% ( 870, 1300 ] 197 0.148% 99.868% ( 1300, 1900 ] 81 0.061% 99.929% ( 1900, 2900 ] 49 0.037% 99.965% ( 2900, 4400 ] 76 0.057% 100.023% ( 4400, 6600 ] 23 0.017% 100.040% ( 6600, 9900 ] 3 0.002% 100.042% ** Level 5 read latency histogram (micros): Count: 95 Average: 1271.1684 StdDev: 1483.22 Min: 96 Median: 556.9231 Max: 7521 Percentiles: P50: 556.92 P75: 2025.00 P99: 6765.00 P99.9: 7521.00 P99.99: 7521.00 ------------------------------------------------------ ( 76, 110 ] 4 4.211% 4.211% # ( 110, 170 ] 12 12.632% 16.842% ### ( 170, 250 ] 7 7.368% 24.211% # ( 250, 380 ] 13 13.684% 37.895% ### ( 380, 580 ] 13 13.684% 51.579% ### ( 580, 870 ] 8 8.421% 60.000% ## ( 870, 1300 ] 8 8.421% 68.421% ## ( 1300, 1900 ] 5 5.263% 73.684% # ( 1900, 2900 ] 10 10.526% 84.211% ## ( 2900, 4400 ] 10 10.526% 94.737% ## ( 4400, 6600 ] 4 4.211% 98.947% # ( 6600, 9900 ] 1 1.053% 100.000% ** DB Stats ** Uptime(secs): 57.7 total, 13.5 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 170.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.478 H:M:S, 51.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 73.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.276 H:M:S, 76.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.786 micros/op 172825 ops/sec 60.037 seconds 10375999 operations; 167.5 MB/s Microseconds per write: Count: 10375999 Average: 5.7862 StdDev: 316.97 Min: 0 Median: 1.7491 Max: 562033 Percentiles: P50: 1.75 P75: 2.79 P99: 9.89 P99.9: 1138.98 P99.99: 2629.26 ------------------------------------------------------ [ 0, 1 ] 1371944 13.222% 13.222% ### ( 1, 2 ] 5093877 49.093% 62.315% ########## ( 2, 3 ] 1657368 15.973% 78.288% ### ( 3, 4 ] 1419323 13.679% 91.967% ### ( 4, 6 ] 581490 5.604% 97.571% # ( 6, 10 ] 152514 1.470% 99.041% ( 10, 15 ] 52564 0.507% 99.548% ( 15, 22 ] 11868 0.114% 99.662% ( 22, 34 ] 2230 0.021% 99.684% ( 34, 51 ] 268 0.003% 99.686% ( 51, 76 ] 51 0.000% 99.687% ( 76, 110 ] 7072 0.068% 99.755% ( 110, 170 ] 2922 0.028% 99.783% ( 170, 250 ] 304 0.003% 99.786% ( 250, 380 ] 230 0.002% 99.788% ( 380, 580 ] 39 0.000% 99.789% ( 580, 870 ] 19 0.000% 99.789% ( 870, 1300 ] 18448 0.178% 99.967% ( 1300, 1900 ] 80 0.001% 99.967% ( 1900, 2900 ] 3223 0.031% 99.998% ( 2900, 4400 ] 106 0.001% 99.999% ( 4400, 6600 ] 29 0.000% 100.000% ( 6600, 9900 ] 9 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 213836 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10375999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10708030968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 582 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30989361 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 34406969994 rocksdb.compact.write.bytes COUNT : 34172502033 rocksdb.flush.write.bytes COUNT : 10701242731 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 62 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 302 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10615019520 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4189184 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31584011552 rocksdb.non.last.level.read.count COUNT : 7628260 rocksdb.block.checksum.compute.count COUNT : 8331205 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.407538 P95 : 3.978363 P99 : 8.679274 P100 : 562023.000000 COUNT : 10375999 SUM : 55137068 rocksdb.compaction.times.micros P50 : 1167096.774194 P95 : 5766666.666667 P99 : 18800000.000000 P100 : 19109169.000000 COUNT : 80 SUM : 150677685 rocksdb.compaction.times.cpu_micros P50 : 964615.384615 P95 : 5400000.000000 P99 : 17226092.000000 P100 : 17226092.000000 COUNT : 80 SUM : 128848998 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 697.115385 P95 : 1294.342105 P99 : 12155.000000 P100 : 17260.000000 COUNT : 145 SUM : 136383 rocksdb.compaction.outfile.sync.micros P50 : 965.555556 P95 : 104400.000000 P99 : 171600.000000 P100 : 207120.000000 COUNT : 392 SUM : 5812374 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 106.868421 P95 : 1011.900000 P99 : 1819.000000 P100 : 5119.000000 COUNT : 254 SUM : 60723 rocksdb.table.open.io.micros P50 : 1590.526316 P95 : 6288.965517 P99 : 9351.913043 P100 : 16222.000000 COUNT : 582 SUM : 1189769 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.663110 P95 : 7.885563 P99 : 11.400416 P100 : 14172.000000 COUNT : 8329953 SUM : 49551247 rocksdb.read.block.get.micros P50 : 503.308271 P95 : 3140.000000 P99 : 4472.000000 P100 : 7539.000000 COUNT : 1164 SUM : 997449 rocksdb.write.raw.block.micros P50 : 0.514045 P95 : 0.976686 P99 : 3.040688 P100 : 16636.000000 COUNT : 10869302 SUM : 20584628 rocksdb.numfiles.in.singlecompaction P50 : 3.380682 P95 : 9.000000 P99 : 25.900000 P100 : 27.000000 COUNT : 135 SUM : 592 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559769 P95 : 1139.313766 P99 : 2305.191291 P100 : 561804.000000 COUNT : 206331 SUM : 31012162 rocksdb.sst.read.micros P50 : 1.607447 P95 : 4.660629 P99 : 8.715055 P100 : 12990.000000 COUNT : 7629037 SUM : 29791896 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10375999 SUM : 10708030968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213928.571429 P95 : 356527.777778 P99 : 541500.000000 P100 : 731315.000000 COUNT : 145 SUM : 30227482 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 383 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0