[2024-12-06 08:34:23.850619] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-06 08:34:23.850721] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2090291 ] Set seed to 1733470463848208 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-06 08:34:23.956243] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-06 08:34:24.160830] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-06 08:34:24.160877] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2090291' to capture a snapshot of events at runtime. [2024-12-06 08:34:24.160887] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2090291 for offline analysis/debug. [2024-12-06 08:34:24.160931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 6 08:34:32 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/06-08:34:35 ... thread 0: (1000000,1000000) ops and (362656.7,362656.7) ops/second in (2.757429,2.757429) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 629.95 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 357.0 2.29 2.04 12 0.191 0 0 0.0 0.0 L1 1/1 63.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 1.28 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 245.4 245.3 0.51 0.50 1 0.513 127K 39 0.0 0.0 L3 16/1 803.06 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.1 1.0 221.6 221.6 0.56 0.50 1 0.563 126K 0 0.0 0.0 L4 116/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1187/10 96.94 GB 0.0 0.2 0.2 0.1 1.0 1.0 1.0 1.3 74.4 317.4 3.37 3.04 14 0.241 254K 39 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.2 0.1 1.0 1.0 0.9 1.3 74.4 317.4 3.37 3.04 14 0.241 254K 39 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.2 0.1 0.2 0.2 0.0 0.0 232.9 232.9 1.08 1.00 2 0.538 254K 39 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 357.0 2.29 2.04 12 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.9 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.04 GB write, 363.55 MB/s write, 0.24 GB read, 85.20 MB/s read, 3.4 seconds Interval compaction: 1.04 GB write, 387.65 MB/s write, 0.24 GB read, 90.85 MB/s read, 3.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 117658 Average: 2.0668 StdDev: 23.15 Min: 1 Median: 1.3288 Max: 4338 Percentiles: P50: 1.33 P75: 1.73 P99: 5.20 P99.9: 9.82 P99.99: 119.26 ------------------------------------------------------ [ 0, 1 ] 34858 29.627% 29.627% ###### ( 1, 2 ] 72913 61.970% 91.597% ############ ( 2, 3 ] 5368 4.562% 96.159% # ( 3, 4 ] 2346 1.994% 98.153% ( 4, 6 ] 1659 1.410% 99.563% ( 6, 10 ] 415 0.353% 99.916% ( 10, 15 ] 63 0.054% 99.969% ( 15, 22 ] 17 0.014% 99.984% ( 22, 34 ] 2 0.002% 99.986% ( 34, 51 ] 2 0.002% 99.987% ( 51, 76 ] 2 0.002% 99.989% ( 110, 170 ] 8 0.007% 99.996% ( 170, 250 ] 1 0.001% 99.997% ( 250, 380 ] 3 0.003% 99.999% ( 380, 580 ] 5 0.004% 100.003% ( 1300, 1900 ] 3 0.003% 100.006% ( 2900, 4400 ] 4 0.003% 100.009% ** Level 2 read latency histogram (micros): Count: 31669 Average: 2.1822 StdDev: 32.85 Min: 1 Median: 1.2305 Max: 4338 Percentiles: P50: 1.23 P75: 1.65 P99: 3.65 P99.9: 9.52 P99.99: 1799.86 ------------------------------------------------------ [ 0, 1 ] 11525 36.392% 36.392% ####### ( 1, 2 ] 18696 59.036% 95.428% ############ ( 2, 3 ] 952 3.006% 98.434% # ( 3, 4 ] 274 0.865% 99.299% ( 4, 6 ] 141 0.445% 99.744% ( 6, 10 ] 56 0.177% 99.921% ( 10, 15 ] 11 0.035% 99.956% ( 15, 22 ] 1 0.003% 99.959% ( 34, 51 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 3 0.009% 99.975% ( 380, 580 ] 1 0.003% 99.978% ( 580, 870 ] 1 0.003% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 2 0.006% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 8145 Average: 21.1051 StdDev: 282.08 Min: 1 Median: 2.0684 Max: 8095 Percentiles: P50: 2.07 P75: 2.96 P99: 12.85 P99.9: 5459.85 P99.99: 8095.00 ------------------------------------------------------ [ 0, 1 ] 204 2.505% 2.505% # ( 1, 2 ] 3712 45.574% 48.079% ######### ( 2, 3 ] 2289 28.103% 76.182% ###### ( 3, 4 ] 764 9.380% 85.562% ## ( 4, 6 ] 817 10.031% 95.592% ## ( 6, 10 ] 254 3.118% 98.711% # ( 10, 15 ] 43 0.528% 99.239% ( 15, 22 ] 9 0.110% 99.349% ( 22, 34 ] 2 0.025% 99.374% ( 170, 250 ] 1 0.012% 99.386% ( 250, 380 ] 3 0.037% 99.423% ( 380, 580 ] 6 0.074% 99.497% ( 580, 870 ] 5 0.061% 99.558% ( 870, 1300 ] 2 0.025% 99.583% ( 1300, 1900 ] 4 0.049% 99.632% ( 1900, 2900 ] 8 0.098% 99.730% ( 2900, 4400 ] 11 0.135% 99.865% ( 4400, 6600 ] 8 0.098% 99.963% ( 6600, 9900 ] 4 0.049% 100.012% ** Level 4 read latency histogram (micros): Count: 20 Average: 3525.2500 StdDev: 2015.44 Min: 440 Median: 2900.0000 Max: 7723 Percentiles: P50: 2900.00 P75: 4950.00 P99: 7723.00 P99.9: 7723.00 P99.99: 7723.00 ------------------------------------------------------ ( 380, 580 ] 2 10.000% 10.000% ## ( 580, 870 ] 1 5.000% 15.000% # ( 1900, 2900 ] 7 35.000% 50.000% ####### ( 2900, 4400 ] 4 20.000% 70.000% #### ( 4400, 6600 ] 4 20.000% 90.000% #### ( 6600, 9900 ] 2 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 711.9000 StdDev: 829.06 Min: 88 Median: 170.0000 Max: 2645 Percentiles: P50: 170.00 P75: 1300.00 P99: 2645.00 P99.9: 2645.00 P99.99: 2645.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 5 25.000% 50.000% ##### ( 170, 250 ] 1 5.000% 55.000% # ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 2.9 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 334.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.184 H:M:S, 6.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 356.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.184 H:M:S, 6.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/06-08:34:38 ... thread 0: (1000000,2000000) ops and (333023.2,347208.8) ops/second in (3.002794,5.760223) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.29 GB 50.4 0.5 0.0 0.5 2.3 1.8 0.0 1.3 71.7 331.6 7.03 6.43 28 0.251 511K 499 0.0 0.0 L1 4/4 377.34 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.2 1.2 247.2 246.8 1.53 1.49 1 1.529 383K 566 0.0 0.0 L2 1/0 1.28 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 245.4 245.3 0.51 0.50 1 0.513 127K 39 0.0 0.0 L3 15/0 690.78 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.1 1.0 221.6 221.6 0.56 0.50 1 0.563 126K 0 0.0 0.0 L4 173/0 9.58 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 109.6 109.7 1.02 0.67 1 1.024 114K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/13 97.92 GB 0.0 1.2 0.6 0.6 3.0 2.4 1.0 1.7 116.8 288.2 10.66 9.59 32 0.333 1264K 1104 0.0 0.0 Int 0/0 0.00 KB 0.0 1.2 0.6 0.6 3.0 2.4 0.9 1.7 116.8 288.2 10.66 9.59 32 0.333 1264K 1104 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.2 0.6 0.6 1.2 0.6 0.0 0.0 225.9 225.6 5.51 5.00 6 0.919 1264K 1104 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 355.1 5.14 4.59 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.00 GB write, 516.53 MB/s write, 1.22 GB read, 209.41 MB/s read, 10.7 seconds Interval compaction: 3.00 GB write, 532.93 MB/s write, 1.22 GB read, 216.06 MB/s read, 10.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 366504 Average: 2.1321 StdDev: 16.82 Min: 1 Median: 1.4290 Max: 4338 Percentiles: P50: 1.43 P75: 1.81 P99: 5.40 P99.9: 9.79 P99.99: 20.05 ------------------------------------------------------ [ 0, 1 ] 79623 21.725% 21.725% #### ( 1, 2 ] 241541 65.904% 87.629% ############# ( 2, 3 ] 27099 7.394% 95.023% # ( 3, 4 ] 10044 2.740% 97.763% # ( 4, 6 ] 6497 1.773% 99.536% ( 6, 10 ] 1409 0.384% 99.921% ( 10, 15 ] 232 0.063% 99.984% ( 15, 22 ] 31 0.008% 99.992% ( 22, 34 ] 8 0.002% 99.995% ( 34, 51 ] 2 0.001% 99.995% ( 51, 76 ] 3 0.001% 99.996% ( 110, 170 ] 15 0.004% 100.000% ( 170, 250 ] 5 0.001% 100.001% ( 250, 380 ] 8 0.002% 100.004% ( 380, 580 ] 8 0.002% 100.006% ( 580, 870 ] 3 0.001% 100.007% ( 870, 1300 ] 4 0.001% 100.008% ( 1300, 1900 ] 5 0.001% 100.009% ( 1900, 2900 ] 4 0.001% 100.010% ( 2900, 4400 ] 4 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 54579 Average: 2.0434 StdDev: 9.23 Min: 1 Median: 1.4215 Max: 1295 Percentiles: P50: 1.42 P75: 1.79 P99: 4.88 P99.9: 9.10 P99.99: 273.49 ------------------------------------------------------ [ 0, 1 ] 11728 21.488% 21.488% #### ( 1, 2 ] 36919 67.643% 89.131% ############## ( 2, 3 ] 3826 7.010% 96.141% # ( 3, 4 ] 1266 2.320% 98.461% ( 4, 6 ] 668 1.224% 99.685% ( 6, 10 ] 153 0.280% 99.965% ( 10, 15 ] 14 0.026% 99.991% ( 250, 380 ] 3 0.005% 99.996% ( 870, 1300 ] 3 0.005% 100.002% ** Level 2 read latency histogram (micros): Count: 31669 Average: 2.1822 StdDev: 32.85 Min: 1 Median: 1.2305 Max: 4338 Percentiles: P50: 1.23 P75: 1.65 P99: 3.65 P99.9: 9.52 P99.99: 1799.86 ------------------------------------------------------ [ 0, 1 ] 11525 36.392% 36.392% ####### ( 1, 2 ] 18696 59.036% 95.428% ############ ( 2, 3 ] 952 3.006% 98.434% # ( 3, 4 ] 274 0.865% 99.299% ( 4, 6 ] 141 0.445% 99.744% ( 6, 10 ] 56 0.177% 99.921% ( 10, 15 ] 11 0.035% 99.956% ( 15, 22 ] 1 0.003% 99.959% ( 34, 51 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 3 0.009% 99.975% ( 380, 580 ] 1 0.003% 99.978% ( 580, 870 ] 1 0.003% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 2 0.006% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28593 Average: 7.8616 StdDev: 150.79 Min: 1 Median: 1.8326 Max: 8095 Percentiles: P50: 1.83 P75: 2.63 P99: 9.00 P99.9: 2200.88 P99.99: 7541.08 ------------------------------------------------------ [ 0, 1 ] 1106 3.868% 3.868% # ( 1, 2 ] 15842 55.405% 59.273% ########### ( 2, 3 ] 7193 25.157% 84.430% ##### ( 3, 4 ] 1782 6.232% 90.662% # ( 4, 6 ] 1995 6.977% 97.639% # ( 6, 10 ] 519 1.815% 99.454% ( 10, 15 ] 86 0.301% 99.755% ( 15, 22 ] 14 0.049% 99.804% ( 22, 34 ] 4 0.014% 99.818% ( 170, 250 ] 1 0.003% 99.822% ( 250, 380 ] 3 0.010% 99.832% ( 380, 580 ] 6 0.021% 99.853% ( 580, 870 ] 5 0.017% 99.871% ( 870, 1300 ] 2 0.007% 99.878% ( 1300, 1900 ] 4 0.014% 99.892% ( 1900, 2900 ] 8 0.028% 99.920% ( 2900, 4400 ] 11 0.038% 99.958% ( 4400, 6600 ] 8 0.028% 99.986% ( 6600, 9900 ] 4 0.014% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 233.8328 StdDev: 1013.22 Min: 1 Median: 1.7992 Max: 7723 Percentiles: P50: 1.80 P75: 2.94 P99: 6022.50 P99.9: 7723.00 P99.99: 7723.00 ------------------------------------------------------ [ 0, 1 ] 47 15.410% 15.410% ### ( 1, 2 ] 132 43.279% 58.689% ######### ( 2, 3 ] 53 17.377% 76.066% ### ( 3, 4 ] 15 4.918% 80.984% # ( 4, 6 ] 13 4.262% 85.246% # ( 6, 10 ] 23 7.541% 92.787% ## ( 10, 15 ] 2 0.656% 93.443% ( 380, 580 ] 2 0.656% 94.098% ( 580, 870 ] 1 0.328% 94.426% ( 1900, 2900 ] 7 2.295% 96.721% ( 2900, 4400 ] 4 1.311% 98.033% ( 4400, 6600 ] 4 1.311% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 711.9000 StdDev: 829.06 Min: 88 Median: 170.0000 Max: 2645 Percentiles: P50: 170.00 P75: 1300.00 P99: 2645.00 P99.9: 2645.00 P99.99: 2645.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 5 25.000% 50.000% ##### ( 170, 250 ] 1 5.000% 55.000% # ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 5.9 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 331.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.584 H:M:S, 9.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.400 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-08:34:41 ... thread 0: (1000000,3000000) ops and (332147.1,342038.7) ops/second in (3.010714,8.770937) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 1.66 GB 138.5 1.3 0.0 1.3 4.0 2.7 0.0 1.5 103.7 320.7 12.76 11.81 44 0.290 1343K 1386 0.0 0.0 L1 9/0 940.57 MB 94.1 1.3 0.9 0.4 1.3 0.9 0.2 1.5 240.6 239.9 5.49 5.36 2 2.747 1342K 3895 0.0 0.0 L2 1/0 1.28 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 245.4 245.3 0.51 0.50 1 0.513 127K 39 0.0 0.0 L3 15/0 690.78 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.1 1.0 221.6 221.6 0.56 0.50 1 0.563 126K 0 0.0 0.0 L4 173/0 9.58 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 109.6 109.7 1.02 0.67 1 1.024 114K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/4 98.84 GB 0.0 2.9 1.2 1.8 5.6 3.9 1.0 2.1 147.8 283.7 20.36 18.84 49 0.415 3054K 5320 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 1.2 1.8 5.6 3.9 0.9 2.1 147.8 283.7 20.36 18.84 49 0.415 3054K 5320 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 1.2 1.8 2.9 1.1 0.0 0.0 239.3 238.8 12.57 11.91 10 1.257 3054K 5320 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 356.1 7.78 6.94 39 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.64 GB write, 644.76 MB/s write, 2.94 GB read, 335.87 MB/s read, 20.4 seconds Interval compaction: 5.64 GB write, 658.21 MB/s write, 2.94 GB read, 342.88 MB/s read, 20.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 659281 Average: 2.1230 StdDev: 14.19 Min: 1 Median: 1.4392 Max: 4338 Percentiles: P50: 1.44 P75: 1.82 P99: 5.42 P99.9: 9.77 P99.99: 15.01 ------------------------------------------------------ [ 0, 1 ] 138028 20.936% 20.936% #### ( 1, 2 ] 436232 66.168% 87.104% ############# ( 2, 3 ] 51198 7.766% 94.870% ## ( 3, 4 ] 18746 2.843% 97.713% # ( 4, 6 ] 11911 1.807% 99.520% ( 6, 10 ] 2659 0.403% 99.923% ( 10, 15 ] 441 0.067% 99.990% ( 15, 22 ] 65 0.010% 100.000% ( 22, 34 ] 15 0.002% 100.002% ( 34, 51 ] 5 0.001% 100.003% ( 51, 76 ] 4 0.001% 100.003% ( 76, 110 ] 1 0.000% 100.004% ( 110, 170 ] 19 0.003% 100.007% ( 170, 250 ] 11 0.002% 100.008% ( 250, 380 ] 11 0.002% 100.010% ( 380, 580 ] 12 0.002% 100.012% ( 580, 870 ] 11 0.002% 100.013% ( 870, 1300 ] 9 0.001% 100.015% ( 1300, 1900 ] 7 0.001% 100.016% ( 1900, 2900 ] 4 0.001% 100.016% ( 2900, 4400 ] 5 0.001% 100.017% ** Level 1 read latency histogram (micros): Count: 95863 Average: 2.2140 StdDev: 12.11 Min: 1 Median: 1.4753 Max: 1301 Percentiles: P50: 1.48 P75: 1.84 P99: 5.26 P99.9: 9.48 P99.99: 784.99 ------------------------------------------------------ [ 0, 1 ] 16674 17.394% 17.394% ### ( 1, 2 ] 65763 68.601% 85.995% ############## ( 2, 3 ] 8674 9.048% 95.043% ## ( 3, 4 ] 2724 2.842% 97.884% # ( 4, 6 ] 1693 1.766% 99.651% ( 6, 10 ] 275 0.287% 99.937% ( 10, 15 ] 35 0.037% 99.974% ( 15, 22 ] 2 0.002% 99.976% ( 51, 76 ] 1 0.001% 99.977% ( 170, 250 ] 1 0.001% 99.978% ( 250, 380 ] 5 0.005% 99.983% ( 380, 580 ] 5 0.005% 99.989% ( 580, 870 ] 2 0.002% 99.991% ( 870, 1300 ] 8 0.008% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31669 Average: 2.1822 StdDev: 32.85 Min: 1 Median: 1.2305 Max: 4338 Percentiles: P50: 1.23 P75: 1.65 P99: 3.65 P99.9: 9.52 P99.99: 1799.86 ------------------------------------------------------ [ 0, 1 ] 11525 36.392% 36.392% ####### ( 1, 2 ] 18696 59.036% 95.428% ############ ( 2, 3 ] 952 3.006% 98.434% # ( 3, 4 ] 274 0.865% 99.299% ( 4, 6 ] 141 0.445% 99.744% ( 6, 10 ] 56 0.177% 99.921% ( 10, 15 ] 11 0.035% 99.956% ( 15, 22 ] 1 0.003% 99.959% ( 34, 51 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 3 0.009% 99.975% ( 380, 580 ] 1 0.003% 99.978% ( 580, 870 ] 1 0.003% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 2 0.006% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28593 Average: 7.8616 StdDev: 150.79 Min: 1 Median: 1.8326 Max: 8095 Percentiles: P50: 1.83 P75: 2.63 P99: 9.00 P99.9: 2200.88 P99.99: 7541.08 ------------------------------------------------------ [ 0, 1 ] 1106 3.868% 3.868% # ( 1, 2 ] 15842 55.405% 59.273% ########### ( 2, 3 ] 7193 25.157% 84.430% ##### ( 3, 4 ] 1782 6.232% 90.662% # ( 4, 6 ] 1995 6.977% 97.639% # ( 6, 10 ] 519 1.815% 99.454% ( 10, 15 ] 86 0.301% 99.755% ( 15, 22 ] 14 0.049% 99.804% ( 22, 34 ] 4 0.014% 99.818% ( 170, 250 ] 1 0.003% 99.822% ( 250, 380 ] 3 0.010% 99.832% ( 380, 580 ] 6 0.021% 99.853% ( 580, 870 ] 5 0.017% 99.871% ( 870, 1300 ] 2 0.007% 99.878% ( 1300, 1900 ] 4 0.014% 99.892% ( 1900, 2900 ] 8 0.028% 99.920% ( 2900, 4400 ] 11 0.038% 99.958% ( 4400, 6600 ] 8 0.028% 99.986% ( 6600, 9900 ] 4 0.014% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 233.8328 StdDev: 1013.22 Min: 1 Median: 1.7992 Max: 7723 Percentiles: P50: 1.80 P75: 2.94 P99: 6022.50 P99.9: 7723.00 P99.99: 7723.00 ------------------------------------------------------ [ 0, 1 ] 47 15.410% 15.410% ### ( 1, 2 ] 132 43.279% 58.689% ######### ( 2, 3 ] 53 17.377% 76.066% ### ( 3, 4 ] 15 4.918% 80.984% # ( 4, 6 ] 13 4.262% 85.246% # ( 6, 10 ] 23 7.541% 92.787% ## ( 10, 15 ] 2 0.656% 93.443% ( 380, 580 ] 2 0.656% 94.098% ( 580, 870 ] 1 0.328% 94.426% ( 1900, 2900 ] 7 2.295% 96.721% ( 2900, 4400 ] 4 1.311% 98.033% ( 4400, 6600 ] 4 1.311% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 711.9000 StdDev: 829.06 Min: 88 Median: 170.0000 Max: 2645 Percentiles: P50: 170.00 P75: 1300.00 P99: 2645.00 P99.9: 2645.00 P99.99: 2645.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 5 25.000% 50.000% ##### ( 170, 250 ] 1 5.000% 55.000% # ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 329.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.994 H:M:S, 11.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.410 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/06-08:34:44 ... thread 0: (1000000,4000000) ops and (332333.7,339559.7) ops/second in (3.009024,11.779961) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.64 GB 12.6 2.4 0.0 2.4 6.1 3.7 0.0 1.6 123.9 314.4 19.83 18.50 62 0.320 2494K 2602 0.0 0.0 L1 9/9 940.57 MB 0.0 1.3 0.9 0.4 1.3 0.9 0.2 1.5 240.6 239.9 5.49 5.36 2 2.747 1342K 3895 0.0 0.0 L2 1/0 1.28 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 245.4 245.3 0.51 0.50 1 0.513 127K 39 0.0 0.0 L3 15/0 690.78 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.1 1.0 221.6 221.6 0.56 0.50 1 0.563 126K 0 0.0 0.0 L4 173/0 9.58 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 109.6 109.7 1.02 0.67 1 1.024 114K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/21 99.82 GB 0.0 4.0 1.2 2.9 7.7 4.8 1.0 2.1 151.0 288.6 27.43 25.53 67 0.409 4205K 6536 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 1.2 2.9 7.7 4.8 0.9 2.1 151.0 288.6 27.43 25.53 67 0.409 4205K 6536 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 1.2 2.9 4.0 1.1 0.0 0.0 246.1 245.6 16.83 16.08 14 1.202 4205K 6536 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 356.9 10.59 9.44 53 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.73 GB write, 661.52 MB/s write, 4.04 GB read, 346.18 MB/s read, 27.4 seconds Interval compaction: 7.73 GB write, 671.79 MB/s write, 4.04 GB read, 351.55 MB/s read, 27.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 19, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 909771 Average: 2.1195 StdDev: 14.01 Min: 1 Median: 1.4232 Max: 4338 Percentiles: P50: 1.42 P75: 1.80 P99: 5.33 P99.9: 9.91 P99.99: 94.05 ------------------------------------------------------ [ 0, 1 ] 200703 22.061% 22.061% #### ( 1, 2 ] 600580 66.014% 88.075% ############# ( 2, 3 ] 65526 7.202% 95.278% # ( 3, 4 ] 24052 2.644% 97.921% # ( 4, 6 ] 14754 1.622% 99.543% ( 6, 10 ] 3321 0.365% 99.908% ( 10, 15 ] 616 0.068% 99.976% ( 15, 22 ] 89 0.010% 99.986% ( 22, 34 ] 18 0.002% 99.988% ( 34, 51 ] 7 0.001% 99.988% ( 51, 76 ] 6 0.001% 99.989% ( 76, 110 ] 17 0.002% 99.991% ( 110, 170 ] 103 0.011% 100.002% ( 170, 250 ] 25 0.003% 100.005% ( 250, 380 ] 21 0.002% 100.007% ( 380, 580 ] 25 0.003% 100.010% ( 580, 870 ] 23 0.003% 100.013% ( 870, 1300 ] 14 0.002% 100.014% ( 1300, 1900 ] 8 0.001% 100.015% ( 1900, 2900 ] 7 0.001% 100.016% ( 2900, 4400 ] 6 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 101220 Average: 2.2896 StdDev: 12.63 Min: 1 Median: 1.4685 Max: 1301 Percentiles: P50: 1.47 P75: 1.83 P99: 5.38 P99.9: 13.39 P99.99: 788.65 ------------------------------------------------------ [ 0, 1 ] 18158 17.939% 17.939% #### ( 1, 2 ] 69272 68.437% 86.376% ############## ( 2, 3 ] 8792 8.686% 95.062% ## ( 3, 4 ] 2800 2.766% 97.828% # ( 4, 6 ] 1715 1.694% 99.523% ( 6, 10 ] 357 0.353% 99.876% ( 10, 15 ] 38 0.038% 99.913% ( 15, 22 ] 2 0.002% 99.915% ( 51, 76 ] 1 0.001% 99.916% ( 76, 110 ] 21 0.021% 99.937% ( 110, 170 ] 34 0.034% 99.970% ( 170, 250 ] 5 0.005% 99.975% ( 250, 380 ] 8 0.008% 99.983% ( 380, 580 ] 5 0.005% 99.988% ( 580, 870 ] 4 0.004% 99.992% ( 870, 1300 ] 8 0.008% 100.000% ( 1300, 1900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 31669 Average: 2.1822 StdDev: 32.85 Min: 1 Median: 1.2305 Max: 4338 Percentiles: P50: 1.23 P75: 1.65 P99: 3.65 P99.9: 9.52 P99.99: 1799.86 ------------------------------------------------------ [ 0, 1 ] 11525 36.392% 36.392% ####### ( 1, 2 ] 18696 59.036% 95.428% ############ ( 2, 3 ] 952 3.006% 98.434% # ( 3, 4 ] 274 0.865% 99.299% ( 4, 6 ] 141 0.445% 99.744% ( 6, 10 ] 56 0.177% 99.921% ( 10, 15 ] 11 0.035% 99.956% ( 15, 22 ] 1 0.003% 99.959% ( 34, 51 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 3 0.009% 99.975% ( 380, 580 ] 1 0.003% 99.978% ( 580, 870 ] 1 0.003% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 2 0.006% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28593 Average: 7.8616 StdDev: 150.79 Min: 1 Median: 1.8326 Max: 8095 Percentiles: P50: 1.83 P75: 2.63 P99: 9.00 P99.9: 2200.88 P99.99: 7541.08 ------------------------------------------------------ [ 0, 1 ] 1106 3.868% 3.868% # ( 1, 2 ] 15842 55.405% 59.273% ########### ( 2, 3 ] 7193 25.157% 84.430% ##### ( 3, 4 ] 1782 6.232% 90.662% # ( 4, 6 ] 1995 6.977% 97.639% # ( 6, 10 ] 519 1.815% 99.454% ( 10, 15 ] 86 0.301% 99.755% ( 15, 22 ] 14 0.049% 99.804% ( 22, 34 ] 4 0.014% 99.818% ( 170, 250 ] 1 0.003% 99.822% ( 250, 380 ] 3 0.010% 99.832% ( 380, 580 ] 6 0.021% 99.853% ( 580, 870 ] 5 0.017% 99.871% ( 870, 1300 ] 2 0.007% 99.878% ( 1300, 1900 ] 4 0.014% 99.892% ( 1900, 2900 ] 8 0.028% 99.920% ( 2900, 4400 ] 11 0.038% 99.958% ( 4400, 6600 ] 8 0.028% 99.986% ( 6600, 9900 ] 4 0.014% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 233.8328 StdDev: 1013.22 Min: 1 Median: 1.7992 Max: 7723 Percentiles: P50: 1.80 P75: 2.94 P99: 6022.50 P99.9: 7723.00 P99.99: 7723.00 ------------------------------------------------------ [ 0, 1 ] 47 15.410% 15.410% ### ( 1, 2 ] 132 43.279% 58.689% ######### ( 2, 3 ] 53 17.377% 76.066% ### ( 3, 4 ] 15 4.918% 80.984% # ( 4, 6 ] 13 4.262% 85.246% # ( 6, 10 ] 23 7.541% 92.787% ## ( 10, 15 ] 2 0.656% 93.443% ( 380, 580 ] 2 0.656% 94.098% ( 580, 870 ] 1 0.328% 94.426% ( 1900, 2900 ] 7 2.295% 96.721% ( 2900, 4400 ] 4 1.311% 98.033% ( 4400, 6600 ] 4 1.311% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 711.9000 StdDev: 829.06 Min: 88 Median: 170.0000 Max: 2645 Percentiles: P50: 170.00 P75: 1300.00 P99: 2645.00 P99.9: 2645.00 P99.99: 2645.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 5 25.000% 50.000% ##### ( 170, 250 ] 1 5.000% 55.000% # ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 329.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.396 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.402 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/06-08:34:48 ... thread 0: (1000000,5000000) ops and (228963.2,309645.9) ops/second in (4.367515,16.147476) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.69 GB 119.6 3.4 0.0 3.4 8.2 4.7 0.0 1.7 131.1 311.1 26.92 25.17 82 0.328 3582K 3665 0.0 0.0 L1 9/9 940.57 MB 0.0 1.3 0.9 0.4 1.3 0.9 0.2 1.5 240.6 239.9 5.49 5.36 2 2.747 1342K 3895 0.0 0.0 L2 1/0 1.28 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 245.4 245.3 0.51 0.50 1 0.513 127K 39 0.0 0.0 L3 15/0 690.78 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.1 1.0 221.6 221.6 0.56 0.50 1 0.563 126K 0 0.0 0.0 L4 173/0 9.58 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 109.6 109.7 1.02 0.67 1 1.024 114K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/21 100.87 GB 0.0 5.1 1.2 3.9 9.8 5.9 1.0 2.1 151.0 291.4 34.51 32.20 87 0.397 5292K 7599 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 1.2 3.9 9.8 5.9 0.9 2.1 151.0 291.4 34.51 32.20 87 0.397 5292K 7599 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 1.2 3.9 5.1 1.1 0.0 0.0 249.2 248.9 20.92 20.09 18 1.162 5292K 7599 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.7 13.60 12.11 69 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.3 total, 16.1 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.82 GB write, 615.70 MB/s write, 5.09 GB read, 319.18 MB/s read, 34.5 seconds Interval compaction: 9.82 GB write, 622.68 MB/s write, 5.09 GB read, 322.80 MB/s read, 34.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 20, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1364460 Average: 2.1566 StdDev: 12.96 Min: 1 Median: 1.4521 Max: 4338 Percentiles: P50: 1.45 P75: 1.83 P99: 5.45 P99.9: 10.04 P99.99: 38.82 ------------------------------------------------------ [ 0, 1 ] 269119 19.723% 19.723% #### ( 1, 2 ] 913757 66.968% 86.692% ############# ( 2, 3 ] 111851 8.197% 94.889% ## ( 3, 4 ] 38421 2.816% 97.705% # ( 4, 6 ] 24298 1.781% 99.486% ( 6, 10 ] 5642 0.413% 99.899% ( 10, 15 ] 1082 0.079% 99.979% ( 15, 22 ] 128 0.009% 99.988% ( 22, 34 ] 24 0.002% 99.990% ( 34, 51 ] 9 0.001% 99.991% ( 51, 76 ] 11 0.001% 99.991% ( 76, 110 ] 38 0.003% 99.994% ( 110, 170 ] 145 0.011% 100.005% ( 170, 250 ] 46 0.003% 100.008% ( 250, 380 ] 32 0.002% 100.010% ( 380, 580 ] 38 0.003% 100.013% ( 580, 870 ] 33 0.002% 100.016% ( 870, 1300 ] 22 0.002% 100.017% ( 1300, 1900 ] 10 0.001% 100.018% ( 1900, 2900 ] 8 0.001% 100.019% ( 2900, 4400 ] 8 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 168024 Average: 2.3815 StdDev: 11.27 Min: 1 Median: 1.4883 Max: 1301 Percentiles: P50: 1.49 P75: 1.85 P99: 6.35 P99.9: 103.91 P99.99: 559.94 ------------------------------------------------------ [ 0, 1 ] 27970 16.646% 16.646% ### ( 1, 2 ] 114777 68.310% 84.956% ############## ( 2, 3 ] 15567 9.265% 94.221% ## ( 3, 4 ] 4786 2.848% 97.069% # ( 4, 6 ] 3115 1.854% 98.923% ( 6, 10 ] 1464 0.871% 99.795% ( 10, 15 ] 120 0.071% 99.866% ( 15, 22 ] 9 0.005% 99.871% ( 51, 76 ] 2 0.001% 99.873% ( 76, 110 ] 56 0.033% 99.906% ( 110, 170 ] 97 0.058% 99.964% ( 170, 250 ] 14 0.008% 99.972% ( 250, 380 ] 23 0.014% 99.986% ( 380, 580 ] 8 0.005% 99.990% ( 580, 870 ] 7 0.004% 99.995% ( 870, 1300 ] 8 0.005% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31669 Average: 2.1822 StdDev: 32.85 Min: 1 Median: 1.2305 Max: 4338 Percentiles: P50: 1.23 P75: 1.65 P99: 3.65 P99.9: 9.52 P99.99: 1799.86 ------------------------------------------------------ [ 0, 1 ] 11525 36.392% 36.392% ####### ( 1, 2 ] 18696 59.036% 95.428% ############ ( 2, 3 ] 952 3.006% 98.434% # ( 3, 4 ] 274 0.865% 99.299% ( 4, 6 ] 141 0.445% 99.744% ( 6, 10 ] 56 0.177% 99.921% ( 10, 15 ] 11 0.035% 99.956% ( 15, 22 ] 1 0.003% 99.959% ( 34, 51 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 3 0.009% 99.975% ( 380, 580 ] 1 0.003% 99.978% ( 580, 870 ] 1 0.003% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 2 0.006% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28593 Average: 7.8616 StdDev: 150.79 Min: 1 Median: 1.8326 Max: 8095 Percentiles: P50: 1.83 P75: 2.63 P99: 9.00 P99.9: 2200.88 P99.99: 7541.08 ------------------------------------------------------ [ 0, 1 ] 1106 3.868% 3.868% # ( 1, 2 ] 15842 55.405% 59.273% ########### ( 2, 3 ] 7193 25.157% 84.430% ##### ( 3, 4 ] 1782 6.232% 90.662% # ( 4, 6 ] 1995 6.977% 97.639% # ( 6, 10 ] 519 1.815% 99.454% ( 10, 15 ] 86 0.301% 99.755% ( 15, 22 ] 14 0.049% 99.804% ( 22, 34 ] 4 0.014% 99.818% ( 170, 250 ] 1 0.003% 99.822% ( 250, 380 ] 3 0.010% 99.832% ( 380, 580 ] 6 0.021% 99.853% ( 580, 870 ] 5 0.017% 99.871% ( 870, 1300 ] 2 0.007% 99.878% ( 1300, 1900 ] 4 0.014% 99.892% ( 1900, 2900 ] 8 0.028% 99.920% ( 2900, 4400 ] 11 0.038% 99.958% ( 4400, 6600 ] 8 0.028% 99.986% ( 6600, 9900 ] 4 0.014% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 233.8328 StdDev: 1013.22 Min: 1 Median: 1.7992 Max: 7723 Percentiles: P50: 1.80 P75: 2.94 P99: 6022.50 P99.9: 7723.00 P99.99: 7723.00 ------------------------------------------------------ [ 0, 1 ] 47 15.410% 15.410% ### ( 1, 2 ] 132 43.279% 58.689% ######### ( 2, 3 ] 53 17.377% 76.066% ### ( 3, 4 ] 15 4.918% 80.984% # ( 4, 6 ] 13 4.262% 85.246% # ( 6, 10 ] 23 7.541% 92.787% ## ( 10, 15 ] 2 0.656% 93.443% ( 380, 580 ] 2 0.656% 94.098% ( 580, 870 ] 1 0.328% 94.426% ( 1900, 2900 ] 7 2.295% 96.721% ( 2900, 4400 ] 4 1.311% 98.033% ( 4400, 6600 ] 4 1.311% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 711.9000 StdDev: 829.06 Min: 88 Median: 170.0000 Max: 2645 Percentiles: P50: 170.00 P75: 1300.00 P99: 2645.00 P99.9: 2645.00 P99.99: 2645.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 5 25.000% 50.000% ##### ( 170, 250 ] 1 5.000% 55.000% # ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 16.3 total, 4.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 301.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.080 H:M:S, 18.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 225.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.684 H:M:S, 38.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/06-08:35:00 ... thread 0: (1000000,6000000) ops and (87760.0,217847.6) ops/second in (11.394709,27.542185) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/6 2.09 GB 0.0 5.2 0.0 5.2 10.9 5.7 0.0 1.9 147.3 306.5 36.36 34.23 102 0.356 5436K 7080 0.0 0.0 L1 16/16 1.88 GB 0.0 4.7 3.4 1.3 4.7 3.3 0.2 1.4 226.6 223.8 21.37 20.30 3 7.124 4917K 59K 0.0 0.0 L2 1/0 1.28 MB 0.0 0.1 0.1 0.1 0.1 0.1 1.6 2.0 245.4 245.3 0.51 0.50 1 0.513 127K 39 0.0 0.0 L3 19/5 1.52 GB 0.9 0.1 0.1 0.0 0.1 0.1 1.6 1.0 221.6 221.6 0.56 0.50 1 0.563 126K 0 0.0 0.0 L4 173/15 9.63 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.0 1.0 109.6 109.7 1.02 0.67 1 1.024 114K 0 0.0 0.0 L5 1052/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/42 101.73 GB 0.0 10.3 3.7 6.6 15.9 9.3 5.3 2.8 176.5 272.2 59.83 56.20 108 0.554 10M 66K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.3 3.7 6.6 15.9 9.3 5.2 2.8 176.5 272.2 59.83 56.20 108 0.554 10M 66K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.3 3.7 6.6 10.2 3.6 0.0 0.0 242.6 241.1 43.52 41.69 24 1.813 10M 66K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 355.3 16.31 14.52 84 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.7 total, 27.5 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.91 GB write, 587.48 MB/s write, 10.31 GB read, 380.86 MB/s read, 59.8 seconds Interval compaction: 15.91 GB write, 591.39 MB/s write, 10.31 GB read, 383.39 MB/s read, 59.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 20, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2285429 Average: 2.3877 StdDev: 15.67 Min: 1 Median: 1.4539 Max: 4338 Percentiles: P50: 1.45 P75: 1.82 P99: 5.75 P99.9: 101.41 P99.99: 261.71 ------------------------------------------------------ [ 0, 1 ] 441323 19.310% 19.310% #### ( 1, 2 ] 1545262 67.614% 86.924% ############## ( 2, 3 ] 180276 7.888% 94.812% ## ( 3, 4 ] 61636 2.697% 97.509% # ( 4, 6 ] 38889 1.702% 99.211% ( 6, 10 ] 12812 0.561% 99.771% ( 10, 15 ] 1666 0.073% 99.844% ( 15, 22 ] 214 0.009% 99.853% ( 22, 34 ] 31 0.001% 99.855% ( 34, 51 ] 12 0.001% 99.855% ( 51, 76 ] 12 0.001% 99.856% ( 76, 110 ] 1352 0.059% 99.915% ( 110, 170 ] 1425 0.062% 99.977% ( 170, 250 ] 271 0.012% 99.989% ( 250, 380 ] 216 0.009% 99.999% ( 380, 580 ] 219 0.010% 100.008% ( 580, 870 ] 117 0.005% 100.013% ( 870, 1300 ] 59 0.003% 100.016% ( 1300, 1900 ] 17 0.001% 100.017% ( 1900, 2900 ] 20 0.001% 100.018% ( 2900, 4400 ] 12 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 357248 Average: 2.7879 StdDev: 19.59 Min: 1 Median: 1.4892 Max: 3291 Percentiles: P50: 1.49 P75: 1.87 P99: 7.95 P99.9: 144.68 P99.99: 487.34 ------------------------------------------------------ [ 0, 1 ] 62367 17.458% 17.458% ### ( 1, 2 ] 237629 66.517% 83.974% ############# ( 2, 3 ] 32462 9.087% 93.061% ## ( 3, 4 ] 10860 3.040% 96.101% # ( 4, 6 ] 8213 2.299% 98.400% ( 6, 10 ] 4397 1.231% 99.631% ( 10, 15 ] 294 0.082% 99.713% ( 15, 22 ] 53 0.015% 99.728% ( 22, 34 ] 5 0.001% 99.729% ( 34, 51 ] 1 0.000% 99.729% ( 51, 76 ] 2 0.001% 99.730% ( 76, 110 ] 379 0.106% 99.836% ( 110, 170 ] 401 0.112% 99.948% ( 170, 250 ] 58 0.016% 99.964% ( 250, 380 ] 61 0.017% 99.982% ( 380, 580 ] 62 0.017% 99.999% ( 580, 870 ] 30 0.008% 100.007% ( 870, 1300 ] 32 0.009% 100.016% ( 1300, 1900 ] 13 0.004% 100.020% ( 1900, 2900 ] 2 0.001% 100.020% ( 2900, 4400 ] 1 0.000% 100.021% ** Level 2 read latency histogram (micros): Count: 31669 Average: 2.1822 StdDev: 32.85 Min: 1 Median: 1.2305 Max: 4338 Percentiles: P50: 1.23 P75: 1.65 P99: 3.65 P99.9: 9.52 P99.99: 1799.86 ------------------------------------------------------ [ 0, 1 ] 11525 36.392% 36.392% ####### ( 1, 2 ] 18696 59.036% 95.428% ############ ( 2, 3 ] 952 3.006% 98.434% # ( 3, 4 ] 274 0.865% 99.299% ( 4, 6 ] 141 0.445% 99.744% ( 6, 10 ] 56 0.177% 99.921% ( 10, 15 ] 11 0.035% 99.956% ( 15, 22 ] 1 0.003% 99.959% ( 34, 51 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 3 0.009% 99.975% ( 380, 580 ] 1 0.003% 99.978% ( 580, 870 ] 1 0.003% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 2 0.006% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28593 Average: 7.8616 StdDev: 150.79 Min: 1 Median: 1.8326 Max: 8095 Percentiles: P50: 1.83 P75: 2.63 P99: 9.00 P99.9: 2200.88 P99.99: 7541.08 ------------------------------------------------------ [ 0, 1 ] 1106 3.868% 3.868% # ( 1, 2 ] 15842 55.405% 59.273% ########### ( 2, 3 ] 7193 25.157% 84.430% ##### ( 3, 4 ] 1782 6.232% 90.662% # ( 4, 6 ] 1995 6.977% 97.639% # ( 6, 10 ] 519 1.815% 99.454% ( 10, 15 ] 86 0.301% 99.755% ( 15, 22 ] 14 0.049% 99.804% ( 22, 34 ] 4 0.014% 99.818% ( 170, 250 ] 1 0.003% 99.822% ( 250, 380 ] 3 0.010% 99.832% ( 380, 580 ] 6 0.021% 99.853% ( 580, 870 ] 5 0.017% 99.871% ( 870, 1300 ] 2 0.007% 99.878% ( 1300, 1900 ] 4 0.014% 99.892% ( 1900, 2900 ] 8 0.028% 99.920% ( 2900, 4400 ] 11 0.038% 99.958% ( 4400, 6600 ] 8 0.028% 99.986% ( 6600, 9900 ] 4 0.014% 100.000% ** Level 4 read latency histogram (micros): Count: 1609 Average: 143.4686 StdDev: 508.27 Min: 1 Median: 2.4525 Max: 7723 Percentiles: P50: 2.45 P75: 6.36 P99: 2255.45 P99.9: 6265.05 P99.99: 7723.00 ------------------------------------------------------ [ 0, 1 ] 70 4.351% 4.351% # ( 1, 2 ] 582 36.172% 40.522% ####### ( 2, 3 ] 337 20.945% 61.467% #### ( 3, 4 ] 104 6.464% 67.930% # ( 4, 6 ] 109 6.774% 74.705% # ( 6, 10 ] 53 3.294% 77.999% # ( 10, 15 ] 14 0.870% 78.869% ( 15, 22 ] 1 0.062% 78.931% ( 76, 110 ] 2 0.124% 79.055% ( 110, 170 ] 23 1.429% 80.485% ( 170, 250 ] 51 3.170% 83.654% # ( 250, 380 ] 85 5.283% 88.937% # ( 380, 580 ] 70 4.351% 93.288% # ( 580, 870 ] 59 3.667% 96.955% # ( 870, 1300 ] 20 1.243% 98.198% ( 1300, 1900 ] 9 0.559% 98.757% ( 1900, 2900 ] 11 0.684% 99.441% ( 2900, 4400 ] 4 0.249% 99.689% ( 4400, 6600 ] 4 0.249% 99.938% ( 6600, 9900 ] 2 0.124% 100.062% ** Level 5 read latency histogram (micros): Count: 60 Average: 1064.8833 StdDev: 1187.28 Min: 88 Median: 616.2500 Max: 4849 Percentiles: P50: 616.25 P75: 1500.00 P99: 4849.00 P99.9: 4849.00 P99.99: 4849.00 ------------------------------------------------------ ( 76, 110 ] 5 8.333% 8.333% ## ( 110, 170 ] 9 15.000% 23.333% ### ( 170, 250 ] 5 8.333% 31.667% ## ( 250, 380 ] 5 8.333% 40.000% ## ( 380, 580 ] 5 8.333% 48.333% ## ( 580, 870 ] 8 13.333% 61.667% ### ( 870, 1300 ] 6 10.000% 71.667% ## ( 1300, 1900 ] 6 10.000% 81.667% ## ( 1900, 2900 ] 5 8.333% 90.000% ## ( 2900, 4400 ] 5 8.333% 98.333% ## ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 27.7 total, 11.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 212.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.412 H:M:S, 41.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 86.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.333 H:M:S, 73.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/06-08:35:03 ... thread 0: (1000000,7000000) ops and (323514.1,228509.9) ops/second in (3.091055,30.633240) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 3.01 GB 62.9 5.8 0.0 5.8 12.4 6.6 0.0 1.9 143.4 306.5 41.29 38.73 117 0.353 6012K 7672 0.0 0.0 L1 16/16 1.88 GB 0.0 4.7 3.4 1.3 4.7 3.3 0.2 1.4 226.6 223.8 21.37 20.30 3 7.124 4917K 59K 0.0 0.0 L2 1/0 1.28 MB 0.0 0.1 0.1 0.1 0.1 0.1 1.6 2.0 245.4 245.3 0.51 0.50 1 0.513 127K 39 0.0 0.0 L3 14/0 913.86 MB 0.9 0.1 0.1 0.0 0.1 0.1 1.6 1.0 221.6 221.6 0.56 0.50 1 0.563 126K 0 0.0 0.0 L4 169/0 9.58 GB 1.0 0.8 0.7 0.0 0.8 0.7 1.0 1.0 156.9 156.8 5.01 3.81 6 0.835 786K 466 0.0 0.0 L5 1060/0 87.29 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/26 102.65 GB 0.0 11.5 4.3 7.2 18.0 10.8 6.0 2.7 171.7 268.7 68.74 63.84 128 0.537 11M 67K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.5 4.3 7.2 18.0 10.8 5.9 2.7 171.7 268.7 68.74 63.84 128 0.537 11M 67K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.5 4.3 7.2 11.5 4.2 0.0 0.0 237.8 236.4 49.63 46.91 31 1.601 11M 67K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.7 19.11 16.92 97 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.8 total, 30.6 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.04 GB write, 599.43 MB/s write, 11.52 GB read, 382.92 MB/s read, 68.7 seconds Interval compaction: 18.04 GB write, 603.01 MB/s write, 11.52 GB read, 385.21 MB/s read, 68.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 24, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2617796 Average: 2.4186 StdDev: 16.93 Min: 1 Median: 1.4682 Max: 4338 Percentiles: P50: 1.47 P75: 1.84 P99: 5.84 P99.9: 94.21 P99.99: 240.51 ------------------------------------------------------ [ 0, 1 ] 481540 18.395% 18.395% #### ( 1, 2 ] 1767008 67.500% 85.895% ############# ( 2, 3 ] 222829 8.512% 94.407% ## ( 3, 4 ] 73882 2.822% 97.229% # ( 4, 6 ] 50308 1.922% 99.151% ( 6, 10 ] 16297 0.623% 99.773% ( 10, 15 ] 2233 0.085% 99.859% ( 15, 22 ] 292 0.011% 99.870% ( 22, 34 ] 33 0.001% 99.871% ( 34, 51 ] 13 0.000% 99.872% ( 51, 76 ] 15 0.001% 99.872% ( 76, 110 ] 1363 0.052% 99.924% ( 110, 170 ] 1450 0.055% 99.980% ( 170, 250 ] 310 0.012% 99.991% ( 250, 380 ] 238 0.009% 100.001% ( 380, 580 ] 254 0.010% 100.010% ( 580, 870 ] 139 0.005% 100.016% ( 870, 1300 ] 67 0.003% 100.018% ( 1300, 1900 ] 21 0.001% 100.019% ( 1900, 2900 ] 34 0.001% 100.020% ( 2900, 4400 ] 17 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 497285 Average: 2.9159 StdDev: 20.41 Min: 1 Median: 1.5894 Max: 4013 Percentiles: P50: 1.59 P75: 1.99 P99: 8.04 P99.9: 95.34 P99.99: 151.35 ------------------------------------------------------ [ 0, 1 ] 65013 13.074% 13.074% ### ( 1, 2 ] 311554 62.651% 75.725% ############# ( 2, 3 ] 66240 13.320% 89.045% ### ( 3, 4 ] 23404 4.706% 93.751% # ( 4, 6 ] 22654 4.556% 98.307% # ( 6, 10 ] 6773 1.362% 99.669% ( 10, 15 ] 819 0.165% 99.833% ( 15, 22 ] 100 0.020% 99.854% ( 22, 34 ] 7 0.001% 99.855% ( 34, 51 ] 4 0.001% 99.856% ( 51, 76 ] 3 0.001% 99.856% ( 76, 110 ] 381 0.077% 99.933% ( 110, 170 ] 411 0.083% 100.016% ( 170, 250 ] 77 0.015% 100.031% ( 250, 380 ] 71 0.014% 100.045% ( 380, 580 ] 80 0.016% 100.062% ( 580, 870 ] 41 0.008% 100.070% ( 870, 1300 ] 39 0.008% 100.078% ( 1300, 1900 ] 15 0.003% 100.081% ( 1900, 2900 ] 5 0.001% 100.082% ( 2900, 4400 ] 3 0.001% 100.082% ** Level 2 read latency histogram (micros): Count: 31669 Average: 2.1822 StdDev: 32.85 Min: 1 Median: 1.2305 Max: 4338 Percentiles: P50: 1.23 P75: 1.65 P99: 3.65 P99.9: 9.52 P99.99: 1799.86 ------------------------------------------------------ [ 0, 1 ] 11525 36.392% 36.392% ####### ( 1, 2 ] 18696 59.036% 95.428% ############ ( 2, 3 ] 952 3.006% 98.434% # ( 3, 4 ] 274 0.865% 99.299% ( 4, 6 ] 141 0.445% 99.744% ( 6, 10 ] 56 0.177% 99.921% ( 10, 15 ] 11 0.035% 99.956% ( 15, 22 ] 1 0.003% 99.959% ( 34, 51 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 3 0.009% 99.975% ( 380, 580 ] 1 0.003% 99.978% ( 580, 870 ] 1 0.003% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 2 0.006% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28593 Average: 7.8616 StdDev: 150.79 Min: 1 Median: 1.8326 Max: 8095 Percentiles: P50: 1.83 P75: 2.63 P99: 9.00 P99.9: 2200.88 P99.99: 7541.08 ------------------------------------------------------ [ 0, 1 ] 1106 3.868% 3.868% # ( 1, 2 ] 15842 55.405% 59.273% ########### ( 2, 3 ] 7193 25.157% 84.430% ##### ( 3, 4 ] 1782 6.232% 90.662% # ( 4, 6 ] 1995 6.977% 97.639% # ( 6, 10 ] 519 1.815% 99.454% ( 10, 15 ] 86 0.301% 99.755% ( 15, 22 ] 14 0.049% 99.804% ( 22, 34 ] 4 0.014% 99.818% ( 170, 250 ] 1 0.003% 99.822% ( 250, 380 ] 3 0.010% 99.832% ( 380, 580 ] 6 0.021% 99.853% ( 580, 870 ] 5 0.017% 99.871% ( 870, 1300 ] 2 0.007% 99.878% ( 1300, 1900 ] 4 0.014% 99.892% ( 1900, 2900 ] 8 0.028% 99.920% ( 2900, 4400 ] 11 0.038% 99.958% ( 4400, 6600 ] 8 0.028% 99.986% ( 6600, 9900 ] 4 0.014% 100.000% ** Level 4 read latency histogram (micros): Count: 7984 Average: 83.3160 StdDev: 346.16 Min: 1 Median: 1.9810 Max: 7723 Percentiles: P50: 1.98 P75: 3.54 P99: 1454.00 P99.9: 4176.20 P99.99: 6932.64 ------------------------------------------------------ [ 0, 1 ] 324 4.058% 4.058% # ( 1, 2 ] 3739 46.831% 50.889% ######### ( 2, 3 ] 1597 20.003% 70.892% #### ( 3, 4 ] 606 7.590% 78.482% ## ( 4, 6 ] 503 6.300% 84.782% # ( 6, 10 ] 163 2.042% 86.824% ( 10, 15 ] 39 0.488% 87.312% ( 15, 22 ] 5 0.063% 87.375% ( 22, 34 ] 1 0.013% 87.387% ( 76, 110 ] 16 0.200% 87.588% ( 110, 170 ] 114 1.428% 89.016% ( 170, 250 ] 140 1.754% 90.769% ( 250, 380 ] 188 2.355% 93.124% ( 380, 580 ] 195 2.442% 95.566% ( 580, 870 ] 191 2.392% 97.958% ( 870, 1300 ] 77 0.964% 98.923% ( 1300, 1900 ] 24 0.301% 99.223% ( 1900, 2900 ] 37 0.463% 99.687% ( 2900, 4400 ] 20 0.251% 99.937% ( 4400, 6600 ] 4 0.050% 99.987% ( 6600, 9900 ] 2 0.025% 100.013% ** Level 5 read latency histogram (micros): Count: 100 Average: 1012.5000 StdDev: 1189.58 Min: 86 Median: 455.0000 Max: 4849 Percentiles: P50: 455.00 P75: 1500.00 P99: 4400.00 P99.9: 4849.00 P99.99: 4849.00 ------------------------------------------------------ ( 76, 110 ] 12 12.000% 12.000% ## ( 110, 170 ] 14 14.000% 26.000% ### ( 170, 250 ] 10 10.000% 36.000% ## ( 250, 380 ] 11 11.000% 47.000% ## ( 380, 580 ] 8 8.000% 55.000% ## ( 580, 870 ] 10 10.000% 65.000% ## ( 870, 1300 ] 7 7.000% 72.000% # ( 1300, 1900 ] 9 9.000% 81.000% ## ( 1900, 2900 ] 8 8.000% 89.000% ## ( 2900, 4400 ] 10 10.000% 99.000% ## ( 4400, 6600 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 30.8 total, 3.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 223.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.842 H:M:S, 38.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.429 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-08:35:22 ... thread 0: (1000000,8000000) ops and (53548.7,162246.0) ops/second in (18.674588,49.307828) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/7 1.90 GB 0.0 8.1 0.0 8.1 15.6 7.5 0.0 2.1 149.5 289.6 55.19 50.10 134 0.412 8377K 17K 0.0 0.0 L1 13/13 1.47 GB 0.0 8.7 5.5 3.2 8.6 5.4 0.2 1.6 224.6 221.5 39.63 37.22 4 9.909 8134K 59K 0.0 0.0 L2 1/0 78.47 MB 0.8 0.1 0.1 0.1 0.1 0.1 4.0 2.0 245.4 245.3 0.51 0.50 1 0.513 127K 39 0.0 0.0 L3 26/7 1.70 GB 0.9 1.3 0.6 0.8 1.3 0.6 3.5 2.3 116.5 115.1 11.77 6.30 7 1.681 1392K 16K 0.0 0.0 L4 172/21 10.13 GB 1.0 2.4 2.3 0.1 2.4 2.3 1.0 1.0 129.9 129.8 18.76 11.63 21 0.893 2434K 1261 0.0 0.0 L5 1072/0 88.28 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/48 103.55 GB 0.0 20.6 8.4 12.2 28.0 15.8 11.3 3.7 167.5 227.8 125.86 105.74 167 0.754 20M 94K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.6 8.4 12.2 28.0 15.8 11.2 3.7 167.5 227.8 125.86 105.74 167 0.754 20M 94K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.6 8.4 12.2 20.4 8.2 0.0 0.0 206.8 205.3 101.94 86.04 57 1.788 20M 94K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 323.8 23.93 19.70 110 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.5 total, 49.3 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.00 GB write, 579.41 MB/s write, 20.59 GB read, 426.01 MB/s read, 125.9 seconds Interval compaction: 28.00 GB write, 581.56 MB/s write, 20.59 GB read, 427.60 MB/s read, 125.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 30, total-stops: 43, interval: 73 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3683821 Average: 2.8118 StdDev: 32.06 Min: 1 Median: 1.4871 Max: 12295 Percentiles: P50: 1.49 P75: 1.86 P99: 6.81 P99.9: 140.42 P99.99: 420.08 ------------------------------------------------------ [ 0, 1 ] 644128 17.485% 17.485% ### ( 1, 2 ] 2459177 66.756% 84.241% ############# ( 2, 3 ] 338974 9.202% 93.443% ## ( 3, 4 ] 110375 2.996% 96.439% # ( 4, 6 ] 88513 2.403% 98.842% ( 6, 10 ] 28839 0.783% 99.625% ( 10, 15 ] 4255 0.116% 99.740% ( 15, 22 ] 571 0.016% 99.756% ( 22, 34 ] 42 0.001% 99.757% ( 34, 51 ] 16 0.000% 99.758% ( 51, 76 ] 20 0.001% 99.758% ( 76, 110 ] 3343 0.091% 99.849% ( 110, 170 ] 3722 0.101% 99.950% ( 170, 250 ] 785 0.021% 99.971% ( 250, 380 ] 589 0.016% 99.987% ( 380, 580 ] 532 0.014% 100.002% ( 580, 870 ] 278 0.008% 100.009% ( 870, 1300 ] 135 0.004% 100.013% ( 1300, 1900 ] 67 0.002% 100.015% ( 1900, 2900 ] 80 0.002% 100.017% ( 2900, 4400 ] 87 0.002% 100.019% ( 4400, 6600 ] 25 0.001% 100.020% ( 6600, 9900 ] 9 0.000% 100.020% ( 9900, 14000 ] 2 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1551450 Average: 4.6602 StdDev: 76.63 Min: 0 Median: 1.6576 Max: 13577 Percentiles: P50: 1.66 P75: 2.35 P99: 9.20 P99.9: 108.78 P99.99: 173.98 ------------------------------------------------------ [ 0, 1 ] 187402 12.079% 12.079% ## ( 1, 2 ] 894684 57.668% 69.747% ############ ( 2, 3 ] 232877 15.010% 84.757% ### ( 3, 4 ] 91293 5.884% 90.641% # ( 4, 6 ] 104662 6.746% 97.387% # ( 6, 10 ] 31278 2.016% 99.404% ( 10, 15 ] 5550 0.358% 99.761% ( 15, 22 ] 836 0.054% 99.815% ( 22, 34 ] 75 0.005% 99.820% ( 34, 51 ] 11 0.001% 99.821% ( 51, 76 ] 11 0.001% 99.821% ( 76, 110 ] 1267 0.082% 99.903% ( 110, 170 ] 1333 0.086% 99.989% ( 170, 250 ] 359 0.023% 100.012% ( 250, 380 ] 381 0.025% 100.037% ( 380, 580 ] 397 0.026% 100.062% ( 580, 870 ] 351 0.023% 100.085% ( 870, 1300 ] 272 0.018% 100.102% ( 1300, 1900 ] 170 0.011% 100.113% ( 1900, 2900 ] 154 0.010% 100.123% ( 2900, 4400 ] 227 0.015% 100.138% ( 4400, 6600 ] 82 0.005% 100.143% ( 6600, 9900 ] 27 0.002% 100.145% ( 9900, 14000 ] 3 0.000% 100.145% ** Level 2 read latency histogram (micros): Count: 31669 Average: 2.1822 StdDev: 32.85 Min: 1 Median: 1.2305 Max: 4338 Percentiles: P50: 1.23 P75: 1.65 P99: 3.65 P99.9: 9.52 P99.99: 1799.86 ------------------------------------------------------ [ 0, 1 ] 11525 36.392% 36.392% ####### ( 1, 2 ] 18696 59.036% 95.428% ############ ( 2, 3 ] 952 3.006% 98.434% # ( 3, 4 ] 274 0.865% 99.299% ( 4, 6 ] 141 0.445% 99.744% ( 6, 10 ] 56 0.177% 99.921% ( 10, 15 ] 11 0.035% 99.956% ( 15, 22 ] 1 0.003% 99.959% ( 34, 51 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 3 0.009% 99.975% ( 380, 580 ] 1 0.003% 99.978% ( 580, 870 ] 1 0.003% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 2 0.006% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 276158 Average: 3.8914 StdDev: 56.58 Min: 1 Median: 2.1078 Max: 8095 Percentiles: P50: 2.11 P75: 3.13 P99: 8.67 P99.9: 12.91 P99.99: 13.94 ------------------------------------------------------ [ 0, 1 ] 3220 1.166% 1.166% ( 1, 2 ] 126986 45.983% 47.149% ######### ( 2, 3 ] 73046 26.451% 73.600% ##### ( 3, 4 ] 30049 10.881% 84.481% ## ( 4, 6 ] 36494 13.215% 97.696% ### ( 6, 10 ] 5388 1.951% 99.647% ( 10, 15 ] 1201 0.435% 100.082% ( 15, 22 ] 155 0.056% 100.138% ( 22, 34 ] 11 0.004% 100.142% ( 34, 51 ] 1 0.000% 100.142% ( 51, 76 ] 2 0.001% 100.143% ( 110, 170 ] 1 0.000% 100.143% ( 170, 250 ] 3 0.001% 100.144% ( 250, 380 ] 10 0.004% 100.148% ( 380, 580 ] 13 0.005% 100.153% ( 580, 870 ] 10 0.004% 100.156% ( 870, 1300 ] 8 0.003% 100.159% ( 1300, 1900 ] 13 0.005% 100.164% ( 1900, 2900 ] 13 0.005% 100.169% ( 2900, 4400 ] 18 0.007% 100.175% ( 4400, 6600 ] 10 0.004% 100.179% ( 6600, 9900 ] 4 0.001% 100.180% ** Level 4 read latency histogram (micros): Count: 78112 Average: 53.3782 StdDev: 336.88 Min: 1 Median: 2.2009 Max: 8812 Percentiles: P50: 2.20 P75: 3.49 P99: 1364.33 P99.9: 3765.82 P99.99: 4146.51 ------------------------------------------------------ [ 0, 1 ] 1126 1.442% 1.442% ( 1, 2 ] 34096 43.650% 45.092% ######### ( 2, 3 ] 19080 24.426% 69.518% ##### ( 3, 4 ] 8706 11.146% 80.664% ## ( 4, 6 ] 9239 11.828% 92.492% ## ( 6, 10 ] 1783 2.283% 94.774% ( 10, 15 ] 657 0.841% 95.615% ( 15, 22 ] 72 0.092% 95.707% ( 22, 34 ] 12 0.015% 95.723% ( 34, 51 ] 2 0.003% 95.725% ( 51, 76 ] 6 0.008% 95.733% ( 76, 110 ] 25 0.032% 95.765% ( 110, 170 ] 162 0.207% 95.972% ( 170, 250 ] 266 0.341% 96.313% ( 250, 380 ] 390 0.499% 96.812% ( 380, 580 ] 551 0.705% 97.518% ( 580, 870 ] 652 0.835% 98.352% ( 870, 1300 ] 475 0.608% 98.960% ( 1300, 1900 ] 288 0.369% 99.329% ( 1900, 2900 ] 286 0.366% 99.695% ( 2900, 4400 ] 277 0.355% 100.050% ( 4400, 6600 ] 68 0.087% 100.137% ( 6600, 9900 ] 8 0.010% 100.147% ** Level 5 read latency histogram (micros): Count: 160 Average: 1404.7125 StdDev: 1462.50 Min: 86 Median: 792.6667 Max: 5858 Percentiles: P50: 792.67 P75: 2233.33 P99: 5858.00 P99.9: 5858.00 P99.99: 5858.00 ------------------------------------------------------ ( 76, 110 ] 12 7.500% 7.500% ## ( 110, 170 ] 14 8.750% 16.250% ## ( 170, 250 ] 14 8.750% 25.000% ## ( 250, 380 ] 17 10.625% 35.625% ## ( 380, 580 ] 12 7.500% 43.125% ## ( 580, 870 ] 15 9.375% 52.500% ## ( 870, 1300 ] 13 8.125% 60.625% ## ( 1300, 1900 ] 17 10.625% 71.250% ## ( 1900, 2900 ] 18 11.250% 82.500% ## ( 2900, 4400 ] 21 13.125% 95.625% ### ( 4400, 6600 ] 7 4.375% 100.000% # ** DB Stats ** Uptime(secs): 49.5 total, 18.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 159.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.184 H:M:S, 54.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 52.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:15.342 H:M:S, 82.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/12/06-08:35:25 ... thread 0: (1000000,9000000) ops and (285284.1,170412.2) ops/second in (3.505278,52.813106) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/7 2.88 GB 113.3 9.0 0.0 9.0 17.6 8.5 0.0 2.1 147.9 287.6 62.58 56.59 150 0.417 9400K 18K 0.0 0.0 L1 13/13 1.47 GB 0.0 8.7 5.5 3.2 8.6 5.4 0.2 1.6 224.6 221.5 39.63 37.22 4 9.909 8134K 59K 0.0 0.0 L2 1/0 78.47 MB 0.8 0.1 0.1 0.1 0.1 0.1 4.0 2.0 245.4 245.3 0.51 0.50 1 0.513 127K 39 0.0 0.0 L3 19/0 875.97 MB 0.9 1.3 0.6 0.8 1.3 0.6 3.5 2.3 116.5 115.1 11.77 6.30 7 1.681 1392K 16K 0.0 0.0 L4 159/0 9.68 GB 1.0 3.6 3.1 0.5 3.6 3.1 1.0 1.2 130.3 130.1 28.28 17.47 28 1.010 3691K 1584 0.0 0.0 L5 1088/0 89.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/20 104.53 GB 0.0 22.8 9.2 13.6 31.2 17.6 12.6 3.6 163.5 223.7 142.77 118.08 190 0.751 22M 96K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.8 9.2 13.6 31.2 17.6 12.5 3.6 163.5 223.7 142.77 118.08 190 0.751 22M 96K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.8 9.2 13.6 22.6 9.1 0.0 0.0 202.0 200.6 115.57 95.77 67 1.725 22M 96K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 321.9 27.20 22.30 123 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.0 total, 52.8 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.19 GB write, 602.62 MB/s write, 22.79 GB read, 440.39 MB/s read, 142.8 seconds Interval compaction: 31.19 GB write, 604.70 MB/s write, 22.79 GB read, 441.92 MB/s read, 142.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 54, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 30, total-stops: 54, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4141357 Average: 2.8453 StdDev: 32.95 Min: 1 Median: 1.5076 Max: 12295 Percentiles: P50: 1.51 P75: 1.88 P99: 6.94 P99.9: 132.69 P99.99: 374.89 ------------------------------------------------------ [ 0, 1 ] 677210 16.352% 16.352% ### ( 1, 2 ] 2745365 66.291% 82.644% ############# ( 2, 3 ] 423057 10.215% 92.859% ## ( 3, 4 ] 133068 3.213% 96.072% # ( 4, 6 ] 113103 2.731% 98.803% # ( 6, 10 ] 34657 0.837% 99.640% ( 10, 15 ] 5271 0.127% 99.768% ( 15, 22 ] 637 0.015% 99.783% ( 22, 34 ] 48 0.001% 99.784% ( 34, 51 ] 18 0.000% 99.785% ( 51, 76 ] 22 0.001% 99.785% ( 76, 110 ] 3347 0.081% 99.866% ( 110, 170 ] 3735 0.090% 99.956% ( 170, 250 ] 815 0.020% 99.976% ( 250, 380 ] 614 0.015% 99.991% ( 380, 580 ] 562 0.014% 100.004% ( 580, 870 ] 312 0.008% 100.012% ( 870, 1300 ] 160 0.004% 100.016% ( 1300, 1900 ] 86 0.002% 100.018% ( 1900, 2900 ] 105 0.003% 100.020% ( 2900, 4400 ] 111 0.003% 100.023% ( 4400, 6600 ] 32 0.001% 100.024% ( 6600, 9900 ] 9 0.000% 100.024% ( 9900, 14000 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1630302 Average: 4.7734 StdDev: 78.33 Min: 0 Median: 1.6714 Max: 13577 Percentiles: P50: 1.67 P75: 2.40 P99: 9.25 P99.9: 110.39 P99.99: 196.31 ------------------------------------------------------ [ 0, 1 ] 188451 11.559% 11.559% ## ( 1, 2 ] 933451 57.256% 68.816% ########### ( 2, 3 ] 252728 15.502% 84.318% ### ( 3, 4 ] 98674 6.052% 90.370% # ( 4, 6 ] 113651 6.971% 97.341% # ( 6, 10 ] 33287 2.042% 99.383% ( 10, 15 ] 6131 0.376% 99.759% ( 15, 22 ] 910 0.056% 99.815% ( 22, 34 ] 77 0.005% 99.820% ( 34, 51 ] 11 0.001% 99.820% ( 51, 76 ] 11 0.001% 99.821% ( 76, 110 ] 1281 0.079% 99.899% ( 110, 170 ] 1351 0.083% 99.982% ( 170, 250 ] 380 0.023% 100.006% ( 250, 380 ] 399 0.024% 100.030% ( 380, 580 ] 412 0.025% 100.055% ( 580, 870 ] 368 0.023% 100.078% ( 870, 1300 ] 287 0.018% 100.096% ( 1300, 1900 ] 191 0.012% 100.107% ( 1900, 2900 ] 189 0.012% 100.119% ( 2900, 4400 ] 258 0.016% 100.135% ( 4400, 6600 ] 89 0.005% 100.140% ( 6600, 9900 ] 27 0.002% 100.142% ( 9900, 14000 ] 3 0.000% 100.142% ** Level 2 read latency histogram (micros): Count: 31669 Average: 2.1822 StdDev: 32.85 Min: 1 Median: 1.2305 Max: 4338 Percentiles: P50: 1.23 P75: 1.65 P99: 3.65 P99.9: 9.52 P99.99: 1799.86 ------------------------------------------------------ [ 0, 1 ] 11525 36.392% 36.392% ####### ( 1, 2 ] 18696 59.036% 95.428% ############ ( 2, 3 ] 952 3.006% 98.434% # ( 3, 4 ] 274 0.865% 99.299% ( 4, 6 ] 141 0.445% 99.744% ( 6, 10 ] 56 0.177% 99.921% ( 10, 15 ] 11 0.035% 99.956% ( 15, 22 ] 1 0.003% 99.959% ( 34, 51 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 3 0.009% 99.975% ( 380, 580 ] 1 0.003% 99.978% ( 580, 870 ] 1 0.003% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 2 0.006% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 317964 Average: 4.3149 StdDev: 63.98 Min: 1 Median: 2.1069 Max: 8095 Percentiles: P50: 2.11 P75: 3.13 P99: 8.83 P99.9: 13.48 P99.99: 14.47 ------------------------------------------------------ [ 0, 1 ] 3529 1.110% 1.110% ( 1, 2 ] 146471 46.065% 47.175% ######### ( 2, 3 ] 83994 26.416% 73.591% ##### ( 3, 4 ] 34348 10.802% 84.394% ## ( 4, 6 ] 41984 13.204% 97.598% ### ( 6, 10 ] 6312 1.985% 99.583% ( 10, 15 ] 1447 0.455% 100.038% ( 15, 22 ] 188 0.059% 100.097% ( 22, 34 ] 11 0.003% 100.101% ( 34, 51 ] 2 0.001% 100.101% ( 51, 76 ] 3 0.001% 100.102% ( 110, 170 ] 2 0.001% 100.103% ( 170, 250 ] 3 0.001% 100.104% ( 250, 380 ] 15 0.005% 100.109% ( 380, 580 ] 25 0.008% 100.116% ( 580, 870 ] 23 0.007% 100.124% ( 870, 1300 ] 22 0.007% 100.131% ( 1300, 1900 ] 25 0.008% 100.138% ( 1900, 2900 ] 36 0.011% 100.150% ( 2900, 4400 ] 36 0.011% 100.161% ( 4400, 6600 ] 10 0.003% 100.164% ( 6600, 9900 ] 4 0.001% 100.165% ** Level 4 read latency histogram (micros): Count: 126361 Average: 36.1093 StdDev: 275.11 Min: 1 Median: 1.9963 Max: 8812 Percentiles: P50: 2.00 P75: 3.10 P99: 972.06 P99.9: 3588.60 P99.99: 4153.46 ------------------------------------------------------ [ 0, 1 ] 1849 1.463% 1.463% ( 1, 2 ] 61557 48.715% 50.178% ########## ( 2, 3 ] 30150 23.860% 74.039% ##### ( 3, 4 ] 12465 9.865% 83.903% ## ( 4, 6 ] 13178 10.429% 94.332% ## ( 6, 10 ] 2693 2.131% 96.463% ( 10, 15 ] 827 0.654% 97.118% ( 15, 22 ] 84 0.066% 97.184% ( 22, 34 ] 16 0.013% 97.197% ( 34, 51 ] 3 0.002% 97.199% ( 51, 76 ] 6 0.005% 97.204% ( 76, 110 ] 26 0.021% 97.225% ( 110, 170 ] 174 0.138% 97.362% ( 170, 250 ] 290 0.230% 97.592% ( 250, 380 ] 406 0.321% 97.913% ( 380, 580 ] 576 0.456% 98.369% ( 580, 870 ] 678 0.537% 98.906% ( 870, 1300 ] 503 0.398% 99.304% ( 1300, 1900 ] 313 0.248% 99.551% ( 1900, 2900 ] 302 0.239% 99.790% ( 2900, 4400 ] 302 0.239% 100.029% ( 4400, 6600 ] 71 0.056% 100.085% ( 6600, 9900 ] 9 0.007% 100.093% ** Level 5 read latency histogram (micros): Count: 240 Average: 1426.1167 StdDev: 1462.10 Min: 85 Median: 839.4737 Max: 7011 Percentiles: P50: 839.47 P75: 2300.00 P99: 6292.00 P99.9: 7011.00 P99.99: 7011.00 ------------------------------------------------------ ( 76, 110 ] 14 5.833% 5.833% # ( 110, 170 ] 19 7.917% 13.750% ## ( 170, 250 ] 21 8.750% 22.500% ## ( 250, 380 ] 28 11.667% 34.167% ## ( 380, 580 ] 21 8.750% 42.917% ## ( 580, 870 ] 19 7.917% 50.833% ## ( 870, 1300 ] 25 10.417% 61.250% ## ( 1300, 1900 ] 21 8.750% 70.000% ## ( 1900, 2900 ] 30 12.500% 82.500% ### ( 2900, 4400 ] 31 12.917% 95.417% ### ( 4400, 6600 ] 10 4.167% 99.583% # ( 6600, 9900 ] 1 0.417% 100.000% ** DB Stats ** Uptime(secs): 53.0 total, 3.5 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 167.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.002 H:M:S, 52.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 280.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.819 H:M:S, 23.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.076 micros/op 164574 ops/sec 60.106 seconds 9891999 operations; 159.5 MB/s Microseconds per write: Count: 9891999 Average: 6.0763 StdDev: 458.71 Min: 0 Median: 1.7290 Max: 911984 Percentiles: P50: 1.73 P75: 2.75 P99: 9.74 P99.9: 1161.10 P99.99: 2677.36 ------------------------------------------------------ [ 0, 1 ] 1397128 14.124% 14.124% ### ( 1, 2 ] 4868221 49.214% 63.338% ########## ( 2, 3 ] 1544709 15.616% 78.953% ### ( 3, 4 ] 1335597 13.502% 92.455% ### ( 4, 6 ] 521047 5.267% 97.722% # ( 6, 10 ] 135190 1.367% 99.089% ( 10, 15 ] 46254 0.468% 99.557% ( 15, 22 ] 10435 0.105% 99.662% ( 22, 34 ] 1585 0.016% 99.678% ( 34, 51 ] 211 0.002% 99.680% ( 51, 76 ] 16 0.000% 99.680% ( 76, 110 ] 7291 0.074% 99.754% ( 110, 170 ] 2269 0.023% 99.777% ( 170, 250 ] 246 0.002% 99.780% ( 250, 380 ] 191 0.002% 99.782% ( 380, 580 ] 29 0.000% 99.782% ( 580, 870 ] 23 0.000% 99.782% ( 870, 1300 ] 17231 0.174% 99.956% ( 1300, 1900 ] 40 0.000% 99.957% ( 1900, 2900 ] 4241 0.043% 100.000% ( 2900, 4400 ] 13 0.000% 100.000% ( 4400, 6600 ] 4 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 188385 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9891999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10208542968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 474 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32825268 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29564495019 rocksdb.compact.write.bytes COUNT : 29380760395 rocksdb.flush.write.bytes COUNT : 10172750777 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 56 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 179 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10090777600 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3964928 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29659003122 rocksdb.non.last.level.read.count COUNT : 7166360 rocksdb.block.checksum.compute.count COUNT : 7165468 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.373472 P95 : 3.940531 P99 : 8.442024 P100 : 911978.000000 COUNT : 9891999 SUM : 55473107 rocksdb.compaction.times.micros P50 : 1105555.555556 P95 : 3915000.000000 P99 : 18263292.000000 P100 : 18263292.000000 COUNT : 71 SUM : 119850666 rocksdb.compaction.times.cpu_micros P50 : 938108.108108 P95 : 3915000.000000 P99 : 16915933.000000 P100 : 16915933.000000 COUNT : 71 SUM : 99981214 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 692.588235 P95 : 2000.000000 P99 : 66000.000000 P100 : 80331.000000 COUNT : 136 SUM : 261694 rocksdb.compaction.outfile.sync.micros P50 : 1011.808511 P95 : 154666.666667 P99 : 318258.000000 P100 : 318258.000000 COUNT : 306 SUM : 6165201 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 102.601852 P95 : 1208.625000 P99 : 3511.250000 P100 : 4299.000000 COUNT : 237 SUM : 65017 rocksdb.table.open.io.micros P50 : 1620.000000 P95 : 10011.818182 P99 : 19083.076923 P100 : 20880.000000 COUNT : 474 SUM : 1226301 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.598491 P95 : 7.466976 P99 : 11.203694 P100 : 13582.000000 COUNT : 7164319 SUM : 42443427 rocksdb.read.block.get.micros P50 : 537.575758 P95 : 4079.310345 P99 : 6405.142857 P100 : 8142.000000 COUNT : 948 SUM : 965789 rocksdb.write.raw.block.micros P50 : 0.511547 P95 : 0.971940 P99 : 2.773735 P100 : 21009.000000 COUNT : 9581702 SUM : 19227098 rocksdb.numfiles.in.singlecompaction P50 : 3.308219 P95 : 4.833333 P99 : 19.316667 P100 : 22.000000 COUNT : 115 SUM : 441 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562766 P95 : 1164.598637 P99 : 2448.183968 P100 : 911796.000000 COUNT : 193973 SUM : 32846718 rocksdb.sst.read.micros P50 : 1.568626 P95 : 4.471071 P99 : 8.412623 P100 : 13577.000000 COUNT : 7166882 SUM : 28204465 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9891999 SUM : 10208542968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211666.666667 P95 : 373500.000000 P99 : 807800.000000 P100 : 1013724.000000 COUNT : 136 SUM : 29914608 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 296 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0