[2024-12-07 11:24:34.927814] Starting SPDK v25.01-pre git sha1 a2f5e1c2d / DPDK 24.03.0 initialization... [2024-12-07 11:24:34.928132] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid337949 ] Set seed to 1733567074920559 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-07 11:24:35.080651] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-07 11:24:35.184872] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-07 11:24:35.184933] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 337949' to capture a snapshot of events at runtime. [2024-12-07 11:24:35.184946] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-07 11:24:35.184960] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-07 11:24:35.184970] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid337949 for offline analysis/debug. [2024-12-07 11:24:35.186304] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 7 11:24:40 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/07-11:24:43 ... thread 0: (1000000,1000000) ops and (338659.3,338659.3) ops/second in (2.952820,2.952820) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 440.99 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 356.7 2.47 2.31 13 0.190 0 0 0.0 0.0 L1 4/0 251.75 MB 25.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 241.6 241.3 1.04 1.02 1 1.043 255K 234 0.0 0.0 L2 3/2 188.88 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 256.7 256.6 0.74 0.72 1 0.736 191K 84 0.0 0.0 L3 9/0 741.30 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1187/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 1.0 1.5 103.7 311.1 4.25 4.05 15 0.283 447K 318 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.6 1.5 103.7 311.1 4.25 4.05 15 0.283 447K 318 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 247.8 247.6 1.78 1.74 2 0.890 447K 318 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 356.7 2.47 2.31 13 0.190 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.29 GB write, 422.39 MB/s write, 0.43 GB read, 140.83 MB/s read, 4.3 seconds Interval compaction: 1.29 GB write, 447.74 MB/s write, 0.43 GB read, 149.28 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 153037 Average: 2.0600 StdDev: 5.62 Min: 1 Median: 1.4064 Max: 1576 Percentiles: P50: 1.41 P75: 1.81 P99: 5.90 P99.9: 13.30 P99.99: 26.18 ------------------------------------------------------ [ 0, 1 ] 38010 24.837% 24.837% ##### ( 1, 2 ] 94765 61.923% 86.760% ############ ( 2, 3 ] 12180 7.959% 94.719% ## ( 3, 4 ] 4237 2.769% 97.488% # ( 4, 6 ] 2433 1.590% 99.077% ( 6, 10 ] 1053 0.688% 99.765% ( 10, 15 ] 314 0.205% 99.971% ( 15, 22 ] 30 0.020% 99.990% ( 22, 34 ] 2 0.001% 99.992% ( 34, 51 ] 1 0.001% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 170, 250 ] 12 0.008% 100.001% ( 250, 380 ] 9 0.006% 100.007% ( 380, 580 ] 4 0.003% 100.009% ( 1300, 1900 ] 1 0.001% 100.010% ** Level 1 read latency histogram (micros): Count: 20 Average: 108.4500 StdDev: 186.01 Min: 1 Median: 1.8333 Max: 670 Percentiles: P50: 1.83 P75: 170.00 P99: 670.00 P99.9: 670.00 P99.99: 670.00 ------------------------------------------------------ [ 0, 1 ] 5 25.000% 25.000% ##### ( 1, 2 ] 6 30.000% 55.000% ###### ( 2, 3 ] 1 5.000% 60.000% # ( 3, 4 ] 1 5.000% 65.000% # ( 4, 6 ] 1 5.000% 70.000% # ( 110, 170 ] 1 5.000% 75.000% # ( 170, 250 ] 1 5.000% 80.000% # ( 250, 380 ] 2 10.000% 90.000% ## ( 380, 580 ] 1 5.000% 95.000% # ( 580, 870 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 38141 Average: 2.8162 StdDev: 31.68 Min: 0 Median: 1.6023 Max: 4157 Percentiles: P50: 1.60 P75: 1.97 P99: 8.41 P99.9: 14.90 P99.99: 1411.54 ------------------------------------------------------ [ 0, 1 ] 3535 9.268% 9.268% ## ( 1, 2 ] 25792 67.623% 76.891% ############## ( 2, 3 ] 4968 13.025% 89.916% ### ( 3, 4 ] 1782 4.672% 94.589% # ( 4, 6 ] 1387 3.637% 98.225% # ( 6, 10 ] 491 1.287% 99.512% ( 10, 15 ] 151 0.396% 99.908% ( 15, 22 ] 14 0.037% 99.945% ( 22, 34 ] 3 0.008% 99.953% ( 34, 51 ] 1 0.003% 99.955% ( 76, 110 ] 2 0.005% 99.961% ( 110, 170 ] 1 0.003% 99.963% ( 170, 250 ] 2 0.005% 99.969% ( 250, 380 ] 2 0.005% 99.974% ( 380, 580 ] 2 0.005% 99.979% ( 580, 870 ] 2 0.005% 99.984% ( 870, 1300 ] 2 0.005% 99.990% ( 1300, 1900 ] 1 0.003% 99.992% ( 1900, 2900 ] 2 0.005% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 2864.2727 StdDev: 2115.52 Min: 205 Median: 2250.0000 Max: 7018 Percentiles: P50: 2250.00 P75: 4650.00 P99: 7018.00 P99.9: 7018.00 P99.99: 7018.00 ------------------------------------------------------ ( 170, 250 ] 2 3.636% 3.636% # ( 250, 380 ] 4 7.273% 10.909% # ( 380, 580 ] 1 1.818% 12.727% ( 580, 870 ] 4 7.273% 20.000% # ( 870, 1300 ] 4 7.273% 27.273% # ( 1300, 1900 ] 9 16.364% 43.636% ### ( 1900, 2900 ] 10 18.182% 61.818% #### ( 2900, 4400 ] 6 10.909% 72.727% ## ( 4400, 6600 ] 11 20.000% 92.727% #### ( 6600, 9900 ] 4 7.273% 100.000% # ** Level 4 read latency histogram (micros): Count: 15 Average: 3743.7333 StdDev: 1944.26 Min: 915 Median: 4557.1429 Max: 6815 Percentiles: P50: 4557.14 P75: 5735.71 P99: 6815.00 P99.9: 6815.00 P99.99: 6815.00 ------------------------------------------------------ ( 870, 1300 ] 1 6.667% 6.667% # ( 1300, 1900 ] 4 26.667% 33.333% ##### ( 1900, 2900 ] 2 13.333% 46.667% ### ( 4400, 6600 ] 7 46.667% 93.333% ######### ( 6600, 9900 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 365.4500 StdDev: 447.37 Min: 95 Median: 106.9091 Max: 1828 Percentiles: P50: 106.91 P75: 380.00 P99: 1780.00 P99.9: 1828.00 P99.99: 1828.00 ------------------------------------------------------ ( 76, 110 ] 11 55.000% 55.000% ########### ( 110, 170 ] 1 5.000% 60.000% # ( 250, 380 ] 3 15.000% 75.000% ### ( 380, 580 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 314.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.205 H:M:S, 6.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.205 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/07-11:24:46 ... thread 0: (1000000,2000000) ops and (351020.9,344729.3) ops/second in (2.848833,5.801653) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 1.0 0.0 1.0 2.8 1.8 0.0 1.6 110.8 311.6 9.09 8.61 32 0.284 1023K 998 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 241.6 241.3 1.04 1.02 1 1.043 255K 234 0.0 0.0 L2 1/0 3.35 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 253.9 253.8 0.76 0.74 2 0.379 195K 87 0.0 0.0 L3 33/0 984.30 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 215.6 215.4 2.90 2.75 3 0.966 634K 486 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1236/4 97.92 GB 0.0 2.0 0.8 1.2 3.8 2.6 1.4 2.1 150.6 282.9 13.79 13.11 38 0.363 2108K 1805 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.2 3.8 2.6 1.0 2.1 150.6 282.9 13.79 13.11 38 0.363 2108K 1805 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.2 2.0 0.8 0.0 0.0 237.7 237.5 8.74 8.43 10 0.874 2108K 1805 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 361.4 5.05 4.68 28 0.181 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.81 GB write, 652.52 MB/s write, 2.03 GB read, 347.33 MB/s read, 13.8 seconds Interval compaction: 3.81 GB write, 672.46 MB/s write, 2.03 GB read, 357.94 MB/s read, 13.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 401266 Average: 2.2005 StdDev: 6.19 Min: 1 Median: 1.4960 Max: 1610 Percentiles: P50: 1.50 P75: 1.89 P99: 5.97 P99.9: 13.32 P99.99: 21.21 ------------------------------------------------------ [ 0, 1 ] 73143 18.228% 18.228% #### ( 1, 2 ] 257033 64.056% 82.284% ############# ( 2, 3 ] 44109 10.992% 93.276% ## ( 3, 4 ] 14635 3.647% 96.923% # ( 4, 6 ] 8450 2.106% 99.029% ( 6, 10 ] 2941 0.733% 99.762% ( 10, 15 ] 835 0.208% 99.970% ( 15, 22 ] 90 0.022% 99.993% ( 22, 34 ] 15 0.004% 99.996% ( 34, 51 ] 6 0.001% 99.998% ( 51, 76 ] 2 0.000% 99.998% ( 76, 110 ] 2 0.000% 99.999% ( 170, 250 ] 26 0.006% 100.005% ( 250, 380 ] 21 0.005% 100.010% ( 380, 580 ] 10 0.002% 100.013% ( 580, 870 ] 1 0.000% 100.013% ( 870, 1300 ] 4 0.001% 100.014% ( 1300, 1900 ] 2 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 63917 Average: 2.4837 StdDev: 3.98 Min: 1 Median: 1.6711 Max: 670 Percentiles: P50: 1.67 P75: 2.21 P99: 7.21 P99.9: 13.62 P99.99: 21.49 ------------------------------------------------------ [ 0, 1 ] 4068 6.365% 6.365% # ( 1, 2 ] 41561 65.023% 71.388% ############# ( 2, 3 ] 11195 17.515% 88.903% #### ( 3, 4 ] 3606 5.642% 94.544% # ( 4, 6 ] 2645 4.138% 98.683% # ( 6, 10 ] 673 1.053% 99.736% ( 10, 15 ] 145 0.227% 99.962% ( 15, 22 ] 19 0.030% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 110, 170 ] 1 0.002% 99.995% ( 170, 250 ] 1 0.002% 99.997% ( 250, 380 ] 2 0.003% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 580, 870 ] 1 0.002% 100.003% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.7270 StdDev: 28.25 Min: 0 Median: 1.6080 Max: 4157 Percentiles: P50: 1.61 P75: 1.98 P99: 8.23 P99.9: 14.66 P99.99: 1128.49 ------------------------------------------------------ [ 0, 1 ] 4399 9.169% 9.169% ## ( 1, 2 ] 32221 67.159% 76.328% ############# ( 2, 3 ] 6535 13.621% 89.949% ### ( 3, 4 ] 2284 4.761% 94.710% # ( 4, 6 ] 1736 3.618% 98.328% # ( 6, 10 ] 577 1.203% 99.531% ( 10, 15 ] 190 0.396% 99.927% ( 15, 22 ] 14 0.029% 99.956% ( 22, 34 ] 3 0.006% 99.962% ( 34, 51 ] 1 0.002% 99.965% ( 76, 110 ] 2 0.004% 99.969% ( 110, 170 ] 1 0.002% 99.971% ( 170, 250 ] 2 0.004% 99.975% ( 250, 380 ] 2 0.004% 99.979% ( 380, 580 ] 2 0.004% 99.983% ( 580, 870 ] 2 0.004% 99.987% ( 870, 1300 ] 2 0.004% 99.992% ( 1300, 1900 ] 1 0.002% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 47931 Average: 5.7779 StdDev: 120.62 Min: 0 Median: 1.6520 Max: 7018 Percentiles: P50: 1.65 P75: 2.14 P99: 7.92 P99.9: 384.60 P99.99: 5641.38 ------------------------------------------------------ [ 0, 1 ] 3634 7.582% 7.582% ## ( 1, 2 ] 31184 65.060% 72.642% ############# ( 2, 3 ] 7898 16.478% 89.120% ### ( 3, 4 ] 2594 5.412% 94.532% # ( 4, 6 ] 1890 3.943% 98.475% # ( 6, 10 ] 524 1.093% 99.568% ( 10, 15 ] 124 0.259% 99.827% ( 15, 22 ] 10 0.021% 99.848% ( 22, 34 ] 10 0.021% 99.869% ( 34, 51 ] 1 0.002% 99.871% ( 51, 76 ] 1 0.002% 99.873% ( 110, 170 ] 1 0.002% 99.875% ( 170, 250 ] 6 0.013% 99.887% ( 250, 380 ] 6 0.013% 99.900% ( 380, 580 ] 3 0.006% 99.906% ( 580, 870 ] 5 0.010% 99.917% ( 870, 1300 ] 4 0.008% 99.925% ( 1300, 1900 ] 9 0.019% 99.944% ( 1900, 2900 ] 10 0.021% 99.965% ( 2900, 4400 ] 6 0.013% 99.977% ( 4400, 6600 ] 11 0.023% 100.000% ( 6600, 9900 ] 4 0.008% 100.008% ** Level 4 read latency histogram (micros): Count: 15 Average: 3743.7333 StdDev: 1944.26 Min: 915 Median: 4557.1429 Max: 6815 Percentiles: P50: 4557.14 P75: 5735.71 P99: 6815.00 P99.9: 6815.00 P99.99: 6815.00 ------------------------------------------------------ ( 870, 1300 ] 1 6.667% 6.667% # ( 1300, 1900 ] 4 26.667% 33.333% ##### ( 1900, 2900 ] 2 13.333% 46.667% ### ( 4400, 6600 ] 7 46.667% 93.333% ######### ( 6600, 9900 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 365.4500 StdDev: 447.37 Min: 95 Median: 106.9091 Max: 1828 Percentiles: P50: 106.91 P75: 380.00 P99: 1780.00 P99.9: 1828.00 P99.99: 1828.00 ------------------------------------------------------ ( 76, 110 ] 11 55.000% 55.000% ########### ( 110, 170 ] 1 5.000% 60.000% # ( 250, 380 ] 3 15.000% 75.000% ### ( 380, 580 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 329.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.205 H:M:S, 3.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 345.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/07-11:24:49 ... thread 0: (1000000,3000000) ops and (341592.2,343677.3) ops/second in (2.927467,8.729120) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 2.34 GB 12.6 2.0 0.0 2.0 4.7 2.8 0.0 1.7 129.0 310.3 15.63 14.85 51 0.306 2046K 1968 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 241.6 241.3 1.04 1.02 1 1.043 255K 234 0.0 0.0 L2 1/0 3.35 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 253.9 253.8 0.76 0.74 2 0.379 195K 87 0.0 0.0 L3 33/0 984.30 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 215.6 215.4 2.90 2.75 3 0.966 634K 486 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1239/11 98.90 GB 0.0 3.0 0.8 2.2 5.8 3.6 1.4 2.1 151.8 291.1 20.33 19.35 57 0.357 3132K 2775 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 0.8 2.2 5.8 3.6 1.0 2.1 151.8 291.1 20.33 19.35 57 0.357 3132K 2775 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 0.8 2.2 3.0 0.8 0.0 0.0 244.7 244.5 12.61 12.20 14 0.900 3132K 2775 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 367.2 7.72 7.15 43 0.180 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.7 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.78 GB write, 664.27 MB/s write, 3.01 GB read, 346.34 MB/s read, 20.3 seconds Interval compaction: 5.78 GB write, 677.76 MB/s write, 3.01 GB read, 353.37 MB/s read, 20.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 641277 Average: 2.1242 StdDev: 6.23 Min: 0 Median: 1.4584 Max: 1647 Percentiles: P50: 1.46 P75: 1.84 P99: 5.75 P99.9: 12.76 P99.99: 21.27 ------------------------------------------------------ [ 0, 1 ] 130085 20.285% 20.285% #### ( 1, 2 ] 415680 64.821% 85.106% ############# ( 2, 3 ] 60644 9.457% 94.563% ## ( 3, 4 ] 19473 3.037% 97.599% # ( 4, 6 ] 10245 1.598% 99.197% ( 6, 10 ] 3916 0.611% 99.808% ( 10, 15 ] 1074 0.167% 99.975% ( 15, 22 ] 107 0.017% 99.992% ( 22, 34 ] 18 0.003% 99.995% ( 34, 51 ] 6 0.001% 99.995% ( 51, 76 ] 5 0.001% 99.996% ( 76, 110 ] 4 0.001% 99.997% ( 170, 250 ] 40 0.006% 100.003% ( 250, 380 ] 30 0.005% 100.008% ( 380, 580 ] 20 0.003% 100.011% ( 580, 870 ] 4 0.001% 100.012% ( 870, 1300 ] 5 0.001% 100.012% ( 1300, 1900 ] 3 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 63917 Average: 2.4837 StdDev: 3.98 Min: 1 Median: 1.6711 Max: 670 Percentiles: P50: 1.67 P75: 2.21 P99: 7.21 P99.9: 13.62 P99.99: 21.49 ------------------------------------------------------ [ 0, 1 ] 4068 6.365% 6.365% # ( 1, 2 ] 41561 65.023% 71.388% ############# ( 2, 3 ] 11195 17.515% 88.903% #### ( 3, 4 ] 3606 5.642% 94.544% # ( 4, 6 ] 2645 4.138% 98.683% # ( 6, 10 ] 673 1.053% 99.736% ( 10, 15 ] 145 0.227% 99.962% ( 15, 22 ] 19 0.030% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 110, 170 ] 1 0.002% 99.995% ( 170, 250 ] 1 0.002% 99.997% ( 250, 380 ] 2 0.003% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 580, 870 ] 1 0.002% 100.003% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.7270 StdDev: 28.25 Min: 0 Median: 1.6080 Max: 4157 Percentiles: P50: 1.61 P75: 1.98 P99: 8.23 P99.9: 14.66 P99.99: 1128.49 ------------------------------------------------------ [ 0, 1 ] 4399 9.169% 9.169% ## ( 1, 2 ] 32221 67.159% 76.328% ############# ( 2, 3 ] 6535 13.621% 89.949% ### ( 3, 4 ] 2284 4.761% 94.710% # ( 4, 6 ] 1736 3.618% 98.328% # ( 6, 10 ] 577 1.203% 99.531% ( 10, 15 ] 190 0.396% 99.927% ( 15, 22 ] 14 0.029% 99.956% ( 22, 34 ] 3 0.006% 99.962% ( 34, 51 ] 1 0.002% 99.965% ( 76, 110 ] 2 0.004% 99.969% ( 110, 170 ] 1 0.002% 99.971% ( 170, 250 ] 2 0.004% 99.975% ( 250, 380 ] 2 0.004% 99.979% ( 380, 580 ] 2 0.004% 99.983% ( 580, 870 ] 2 0.004% 99.987% ( 870, 1300 ] 2 0.004% 99.992% ( 1300, 1900 ] 1 0.002% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 47931 Average: 5.7779 StdDev: 120.62 Min: 0 Median: 1.6520 Max: 7018 Percentiles: P50: 1.65 P75: 2.14 P99: 7.92 P99.9: 384.60 P99.99: 5641.38 ------------------------------------------------------ [ 0, 1 ] 3634 7.582% 7.582% ## ( 1, 2 ] 31184 65.060% 72.642% ############# ( 2, 3 ] 7898 16.478% 89.120% ### ( 3, 4 ] 2594 5.412% 94.532% # ( 4, 6 ] 1890 3.943% 98.475% # ( 6, 10 ] 524 1.093% 99.568% ( 10, 15 ] 124 0.259% 99.827% ( 15, 22 ] 10 0.021% 99.848% ( 22, 34 ] 10 0.021% 99.869% ( 34, 51 ] 1 0.002% 99.871% ( 51, 76 ] 1 0.002% 99.873% ( 110, 170 ] 1 0.002% 99.875% ( 170, 250 ] 6 0.013% 99.887% ( 250, 380 ] 6 0.013% 99.900% ( 380, 580 ] 3 0.006% 99.906% ( 580, 870 ] 5 0.010% 99.917% ( 870, 1300 ] 4 0.008% 99.925% ( 1300, 1900 ] 9 0.019% 99.944% ( 1900, 2900 ] 10 0.021% 99.965% ( 2900, 4400 ] 6 0.013% 99.977% ( 4400, 6600 ] 11 0.023% 100.000% ( 6600, 9900 ] 4 0.008% 100.008% ** Level 4 read latency histogram (micros): Count: 15 Average: 3743.7333 StdDev: 1944.26 Min: 915 Median: 4557.1429 Max: 6815 Percentiles: P50: 4557.14 P75: 5735.71 P99: 6815.00 P99.9: 6815.00 P99.99: 6815.00 ------------------------------------------------------ ( 870, 1300 ] 1 6.667% 6.667% # ( 1300, 1900 ] 4 26.667% 33.333% ##### ( 1900, 2900 ] 2 13.333% 46.667% ### ( 4400, 6600 ] 7 46.667% 93.333% ######### ( 6600, 9900 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 365.4500 StdDev: 447.37 Min: 95 Median: 106.9091 Max: 1828 Percentiles: P50: 106.91 P75: 380.00 P99: 1780.00 P99.9: 1828.00 P99.99: 1828.00 ------------------------------------------------------ ( 76, 110 ] 11 55.000% 55.000% ########### ( 110, 170 ] 1 5.000% 60.000% # ( 250, 380 ] 3 15.000% 75.000% ### ( 380, 580 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.9 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 331.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.359 H:M:S, 4.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 336.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.154 H:M:S, 5.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/07-11:24:52 ... thread 0: (1000000,4000000) ops and (277947.6,324493.0) ops/second in (3.597801,12.326921) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.32 GB 88.1 2.8 0.0 2.8 6.5 3.7 0.0 1.7 131.4 309.4 21.58 20.53 69 0.313 2878K 2845 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 241.6 241.3 1.04 1.02 1 1.043 255K 234 0.0 0.0 L2 1/0 3.35 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 253.9 253.8 0.76 0.74 2 0.379 195K 87 0.0 0.0 L3 33/0 984.30 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 215.6 215.4 2.90 2.75 3 0.966 634K 486 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/15 99.89 GB 0.0 3.8 0.8 3.0 7.6 4.5 1.4 2.0 148.6 294.7 26.27 25.03 75 0.350 3963K 3652 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 0.8 3.0 7.6 4.5 1.0 2.0 148.6 294.7 26.27 25.03 75 0.350 3963K 3652 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 0.8 3.0 3.8 0.8 0.0 0.0 248.1 247.8 15.74 15.27 17 0.926 3963K 3652 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 364.7 10.54 9.76 58 0.182 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.56 GB write, 619.18 MB/s write, 3.81 GB read, 312.19 MB/s read, 26.3 seconds Interval compaction: 7.56 GB write, 628.09 MB/s write, 3.81 GB read, 316.68 MB/s read, 26.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 3, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1113578 Average: 2.1867 StdDev: 5.69 Min: 0 Median: 1.5102 Max: 1647 Percentiles: P50: 1.51 P75: 1.89 P99: 5.73 P99.9: 12.10 P99.99: 16.50 ------------------------------------------------------ [ 0, 1 ] 179917 16.157% 16.157% ### ( 1, 2 ] 738722 66.338% 82.494% ############# ( 2, 3 ] 128421 11.532% 94.027% ## ( 3, 4 ] 38151 3.426% 97.453% # ( 4, 6 ] 19974 1.794% 99.246% ( 6, 10 ] 6581 0.591% 99.837% ( 10, 15 ] 1666 0.150% 99.987% ( 15, 22 ] 166 0.015% 100.002% ( 22, 34 ] 24 0.002% 100.004% ( 34, 51 ] 7 0.001% 100.005% ( 51, 76 ] 8 0.001% 100.005% ( 76, 110 ] 10 0.001% 100.006% ( 110, 170 ] 18 0.002% 100.008% ( 170, 250 ] 56 0.005% 100.013% ( 250, 380 ] 45 0.004% 100.017% ( 380, 580 ] 21 0.002% 100.019% ( 580, 870 ] 8 0.001% 100.019% ( 870, 1300 ] 8 0.001% 100.020% ( 1300, 1900 ] 4 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 63917 Average: 2.4837 StdDev: 3.98 Min: 1 Median: 1.6711 Max: 670 Percentiles: P50: 1.67 P75: 2.21 P99: 7.21 P99.9: 13.62 P99.99: 21.49 ------------------------------------------------------ [ 0, 1 ] 4068 6.365% 6.365% # ( 1, 2 ] 41561 65.023% 71.388% ############# ( 2, 3 ] 11195 17.515% 88.903% #### ( 3, 4 ] 3606 5.642% 94.544% # ( 4, 6 ] 2645 4.138% 98.683% # ( 6, 10 ] 673 1.053% 99.736% ( 10, 15 ] 145 0.227% 99.962% ( 15, 22 ] 19 0.030% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 110, 170 ] 1 0.002% 99.995% ( 170, 250 ] 1 0.002% 99.997% ( 250, 380 ] 2 0.003% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 580, 870 ] 1 0.002% 100.003% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.7270 StdDev: 28.25 Min: 0 Median: 1.6080 Max: 4157 Percentiles: P50: 1.61 P75: 1.98 P99: 8.23 P99.9: 14.66 P99.99: 1128.49 ------------------------------------------------------ [ 0, 1 ] 4399 9.169% 9.169% ## ( 1, 2 ] 32221 67.159% 76.328% ############# ( 2, 3 ] 6535 13.621% 89.949% ### ( 3, 4 ] 2284 4.761% 94.710% # ( 4, 6 ] 1736 3.618% 98.328% # ( 6, 10 ] 577 1.203% 99.531% ( 10, 15 ] 190 0.396% 99.927% ( 15, 22 ] 14 0.029% 99.956% ( 22, 34 ] 3 0.006% 99.962% ( 34, 51 ] 1 0.002% 99.965% ( 76, 110 ] 2 0.004% 99.969% ( 110, 170 ] 1 0.002% 99.971% ( 170, 250 ] 2 0.004% 99.975% ( 250, 380 ] 2 0.004% 99.979% ( 380, 580 ] 2 0.004% 99.983% ( 580, 870 ] 2 0.004% 99.987% ( 870, 1300 ] 2 0.004% 99.992% ( 1300, 1900 ] 1 0.002% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 47931 Average: 5.7779 StdDev: 120.62 Min: 0 Median: 1.6520 Max: 7018 Percentiles: P50: 1.65 P75: 2.14 P99: 7.92 P99.9: 384.60 P99.99: 5641.38 ------------------------------------------------------ [ 0, 1 ] 3634 7.582% 7.582% ## ( 1, 2 ] 31184 65.060% 72.642% ############# ( 2, 3 ] 7898 16.478% 89.120% ### ( 3, 4 ] 2594 5.412% 94.532% # ( 4, 6 ] 1890 3.943% 98.475% # ( 6, 10 ] 524 1.093% 99.568% ( 10, 15 ] 124 0.259% 99.827% ( 15, 22 ] 10 0.021% 99.848% ( 22, 34 ] 10 0.021% 99.869% ( 34, 51 ] 1 0.002% 99.871% ( 51, 76 ] 1 0.002% 99.873% ( 110, 170 ] 1 0.002% 99.875% ( 170, 250 ] 6 0.013% 99.887% ( 250, 380 ] 6 0.013% 99.900% ( 380, 580 ] 3 0.006% 99.906% ( 580, 870 ] 5 0.010% 99.917% ( 870, 1300 ] 4 0.008% 99.925% ( 1300, 1900 ] 9 0.019% 99.944% ( 1900, 2900 ] 10 0.021% 99.965% ( 2900, 4400 ] 6 0.013% 99.977% ( 4400, 6600 ] 11 0.023% 100.000% ( 6600, 9900 ] 4 0.008% 100.008% ** Level 4 read latency histogram (micros): Count: 15 Average: 3743.7333 StdDev: 1944.26 Min: 915 Median: 4557.1429 Max: 6815 Percentiles: P50: 4557.14 P75: 5735.71 P99: 6815.00 P99.9: 6815.00 P99.99: 6815.00 ------------------------------------------------------ ( 870, 1300 ] 1 6.667% 6.667% # ( 1300, 1900 ] 4 26.667% 33.333% ##### ( 1900, 2900 ] 2 13.333% 46.667% ### ( 4400, 6600 ] 7 46.667% 93.333% ######### ( 6600, 9900 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 365.4500 StdDev: 447.37 Min: 95 Median: 106.9091 Max: 1828 Percentiles: P50: 106.91 P75: 380.00 P99: 1780.00 P99.9: 1828.00 P99.99: 1828.00 ------------------------------------------------------ ( 76, 110 ] 11 55.000% 55.000% ########### ( 110, 170 ] 1 5.000% 60.000% # ( 250, 380 ] 3 15.000% 75.000% ### ( 380, 580 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.5 total, 3.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 314.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.125 H:M:S, 9.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 273.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.766 H:M:S, 21.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/07-11:24:59 ... thread 0: (1000000,5000000) ops and (144426.8,259728.9) ops/second in (6.923923,19.250844) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 2.03 GB 0.0 4.3 0.0 4.3 9.0 4.7 0.0 1.9 145.5 303.4 30.29 28.94 88 0.344 4476K 6053 0.0 0.0 L1 7/7 696.68 MB 0.0 2.5 2.5 0.0 2.4 2.4 0.2 1.0 234.6 232.4 10.73 10.53 2 5.365 2556K 23K 0.0 0.0 L2 4/2 389.69 MB 2.6 0.2 0.1 0.1 0.2 0.1 1.8 1.5 253.9 253.8 0.76 0.74 2 0.379 195K 87 0.0 0.0 L3 30/15 1.90 GB 1.0 0.9 0.7 0.2 0.9 0.7 1.0 1.3 210.7 210.4 4.41 4.14 5 0.883 895K 486 0.0 0.0 L4 151/1 9.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/36 100.78 GB 0.0 7.9 3.3 4.6 12.5 7.9 4.4 2.7 174.2 277.2 46.20 44.35 97 0.476 8124K 30K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.9 3.3 4.6 12.5 7.9 3.9 2.7 174.2 277.2 46.20 44.35 97 0.476 8124K 30K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.9 3.3 4.6 7.8 3.2 0.0 0.0 244.3 243.4 32.94 32.11 24 1.373 8124K 30K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 361.3 13.25 12.25 73 0.182 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.4 total, 19.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.51 GB write, 659.09 MB/s write, 7.86 GB read, 414.29 MB/s read, 46.2 seconds Interval compaction: 12.51 GB write, 665.16 MB/s write, 7.86 GB read, 418.10 MB/s read, 46.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 3, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1851261 Average: 2.2531 StdDev: 6.95 Min: 0 Median: 1.5255 Max: 3181 Percentiles: P50: 1.53 P75: 1.90 P99: 5.84 P99.9: 12.41 P99.99: 130.56 ------------------------------------------------------ [ 0, 1 ] 274519 14.829% 14.829% ### ( 1, 2 ] 1238917 66.923% 81.752% ############# ( 2, 3 ] 222462 12.017% 93.768% ## ( 3, 4 ] 63167 3.412% 97.181% # ( 4, 6 ] 36525 1.973% 99.153% ( 6, 10 ] 12736 0.688% 99.841% ( 10, 15 ] 2253 0.122% 99.963% ( 15, 22 ] 258 0.014% 99.977% ( 22, 34 ] 36 0.002% 99.979% ( 34, 51 ] 11 0.001% 99.980% ( 51, 76 ] 12 0.001% 99.980% ( 76, 110 ] 76 0.004% 99.984% ( 110, 170 ] 309 0.017% 100.001% ( 170, 250 ] 133 0.007% 100.008% ( 250, 380 ] 94 0.005% 100.013% ( 380, 580 ] 59 0.003% 100.017% ( 580, 870 ] 19 0.001% 100.018% ( 870, 1300 ] 9 0.000% 100.018% ( 1300, 1900 ] 10 0.001% 100.019% ( 2900, 4400 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 161897 Average: 2.8610 StdDev: 9.26 Min: 1 Median: 1.8371 Max: 833 Percentiles: P50: 1.84 P75: 2.66 P99: 7.97 P99.9: 13.66 P99.99: 14.96 ------------------------------------------------------ [ 0, 1 ] 5006 3.092% 3.092% # ( 1, 2 ] 90721 56.036% 59.128% ########### ( 2, 3 ] 39158 24.187% 83.315% ##### ( 3, 4 ] 12930 7.987% 91.302% ## ( 4, 6 ] 11450 7.072% 98.374% # ( 6, 10 ] 2062 1.274% 99.648% ( 10, 15 ] 558 0.345% 99.993% ( 15, 22 ] 52 0.032% 100.025% ( 22, 34 ] 3 0.002% 100.027% ( 34, 51 ] 1 0.001% 100.027% ( 51, 76 ] 1 0.001% 100.028% ( 76, 110 ] 1 0.001% 100.028% ( 110, 170 ] 2 0.001% 100.030% ( 170, 250 ] 2 0.001% 100.031% ( 250, 380 ] 3 0.002% 100.033% ( 380, 580 ] 13 0.008% 100.041% ( 580, 870 ] 23 0.014% 100.055% ** Level 2 read latency histogram (micros): Count: 48234 Average: 2.9892 StdDev: 29.22 Min: 0 Median: 1.6112 Max: 4157 Percentiles: P50: 1.61 P75: 1.99 P99: 8.68 P99.9: 161.28 P99.99: 1122.97 ------------------------------------------------------ [ 0, 1 ] 4399 9.120% 9.120% ## ( 1, 2 ] 32260 66.882% 76.002% ############# ( 2, 3 ] 6633 13.752% 89.754% ### ( 3, 4 ] 2310 4.789% 94.543% # ( 4, 6 ] 1760 3.649% 98.192% # ( 6, 10 ] 582 1.207% 99.399% ( 10, 15 ] 190 0.394% 99.793% ( 15, 22 ] 15 0.031% 99.824% ( 22, 34 ] 3 0.006% 99.830% ( 34, 51 ] 1 0.002% 99.832% ( 76, 110 ] 2 0.004% 99.836% ( 110, 170 ] 36 0.075% 99.911% ( 170, 250 ] 15 0.031% 99.942% ( 250, 380 ] 16 0.033% 99.975% ( 380, 580 ] 4 0.008% 99.983% ( 580, 870 ] 2 0.004% 99.988% ( 870, 1300 ] 2 0.004% 99.992% ( 1300, 1900 ] 1 0.002% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 159875 Average: 5.0459 StdDev: 68.51 Min: 0 Median: 1.8549 Max: 7018 Percentiles: P50: 1.85 P75: 2.71 P99: 12.37 P99.9: 250.93 P99.99: 370.07 ------------------------------------------------------ [ 0, 1 ] 4921 3.078% 3.078% # ( 1, 2 ] 87745 54.884% 57.962% ########### ( 2, 3 ] 38299 23.956% 81.917% ##### ( 3, 4 ] 13210 8.263% 90.180% ## ( 4, 6 ] 10588 6.623% 96.803% # ( 6, 10 ] 3107 1.943% 98.746% ( 10, 15 ] 861 0.539% 99.284% ( 15, 22 ] 123 0.077% 99.361% ( 22, 34 ] 21 0.013% 99.375% ( 34, 51 ] 18 0.011% 99.386% ( 51, 76 ] 10 0.006% 99.392% ( 76, 110 ] 34 0.021% 99.413% ( 110, 170 ] 518 0.324% 99.737% ( 170, 250 ] 261 0.163% 99.901% ( 250, 380 ] 157 0.098% 99.999% ( 380, 580 ] 45 0.028% 100.027% ( 580, 870 ] 17 0.011% 100.038% ( 870, 1300 ] 4 0.003% 100.040% ( 1300, 1900 ] 11 0.007% 100.047% ( 1900, 2900 ] 10 0.006% 100.053% ( 2900, 4400 ] 6 0.004% 100.057% ( 4400, 6600 ] 11 0.007% 100.064% ( 6600, 9900 ] 4 0.003% 100.066% ** Level 4 read latency histogram (micros): Count: 15 Average: 3743.7333 StdDev: 1944.26 Min: 915 Median: 4557.1429 Max: 6815 Percentiles: P50: 4557.14 P75: 5735.71 P99: 6815.00 P99.9: 6815.00 P99.99: 6815.00 ------------------------------------------------------ ( 870, 1300 ] 1 6.667% 6.667% # ( 1300, 1900 ] 4 26.667% 33.333% ##### ( 1900, 2900 ] 2 13.333% 46.667% ### ( 4400, 6600 ] 7 46.667% 93.333% ######### ( 6600, 9900 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 468.9250 StdDev: 549.70 Min: 95 Median: 170.0000 Max: 2205 Percentiles: P50: 170.00 P75: 580.00 P99: 2205.00 P99.9: 2205.00 P99.99: 2205.00 ------------------------------------------------------ ( 76, 110 ] 11 27.500% 27.500% ###### ( 110, 170 ] 9 22.500% 50.000% ##### ( 170, 250 ] 3 7.500% 57.500% ## ( 250, 380 ] 3 7.500% 65.000% ## ( 380, 580 ] 4 10.000% 75.000% ## ( 580, 870 ] 1 2.500% 77.500% # ( 870, 1300 ] 6 15.000% 92.500% ### ( 1300, 1900 ] 1 2.500% 95.000% # ( 1900, 2900 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 19.4 total, 6.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 253.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.073 H:M:S, 26.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 142.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.948 H:M:S, 57.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/07-11:25:02 ... thread 0: (1000000,6000000) ops and (313477.6,267369.4) ops/second in (3.190021,22.440865) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.95 GB 94.4 5.0 0.0 5.0 10.6 5.6 0.0 1.9 142.5 300.6 36.24 34.48 105 0.345 5244K 6793 0.0 0.0 L1 7/7 696.68 MB 0.0 2.5 2.5 0.0 2.4 2.4 0.2 1.0 234.6 232.4 10.73 10.53 2 5.365 2556K 23K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.8 1.5 253.9 253.8 0.76 0.74 2 0.379 195K 87 0.0 0.0 L3 16/1 1.05 GB 0.9 2.0 0.9 1.1 2.0 0.9 1.1 2.2 209.7 209.2 9.91 9.30 8 1.238 2036K 3955 0.0 0.0 L4 166/4 9.79 GB 1.0 0.5 0.4 0.1 0.5 0.4 1.5 1.2 197.3 196.7 2.49 2.22 4 0.623 492K 1308 0.0 0.0 L5 1064/0 87.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/23 101.70 GB 0.0 10.2 3.9 6.3 15.8 9.5 6.3 2.8 173.7 268.4 60.12 57.27 121 0.497 10M 35K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 3.9 6.3 15.8 9.5 5.9 2.8 173.7 268.4 60.12 57.27 121 0.497 10M 35K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 3.9 6.3 10.2 3.9 0.0 0.0 237.2 236.3 44.04 42.50 34 1.295 10M 35K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 356.4 16.08 14.77 87 0.185 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.6 total, 22.4 interval Flush(GB): cumulative 5.599, interval 5.599 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.76 GB write, 713.53 MB/s write, 10.20 GB read, 461.75 MB/s read, 60.1 seconds Interval compaction: 15.76 GB write, 719.17 MB/s write, 10.20 GB read, 465.40 MB/s read, 60.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 4, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2231349 Average: 2.3577 StdDev: 7.58 Min: 0 Median: 1.5700 Max: 3181 Percentiles: P50: 1.57 P75: 1.95 P99: 6.00 P99.9: 12.72 P99.99: 125.65 ------------------------------------------------------ [ 0, 1 ] 286997 12.862% 12.862% ### ( 1, 2 ] 1453832 65.155% 78.017% ############# ( 2, 3 ] 312725 14.015% 92.032% ### ( 3, 4 ] 92248 4.134% 96.166% # ( 4, 6 ] 63323 2.838% 99.004% # ( 6, 10 ] 18380 0.824% 99.828% ( 10, 15 ] 2970 0.133% 99.961% ( 15, 22 ] 371 0.017% 99.977% ( 22, 34 ] 46 0.002% 99.980% ( 34, 51 ] 17 0.001% 99.980% ( 51, 76 ] 14 0.001% 99.981% ( 76, 110 ] 92 0.004% 99.985% ( 110, 170 ] 429 0.019% 100.004% ( 170, 250 ] 185 0.008% 100.013% ( 250, 380 ] 121 0.005% 100.018% ( 380, 580 ] 80 0.004% 100.022% ( 580, 870 ] 24 0.001% 100.023% ( 870, 1300 ] 14 0.001% 100.023% ( 1300, 1900 ] 13 0.001% 100.024% ( 1900, 2900 ] 1 0.000% 100.024% ( 2900, 4400 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 292122 Average: 3.0472 StdDev: 9.65 Min: 1 Median: 1.8878 Max: 1251 Percentiles: P50: 1.89 P75: 2.74 P99: 8.73 P99.9: 14.89 P99.99: 170.97 ------------------------------------------------------ [ 0, 1 ] 6362 2.178% 2.178% ( 1, 2 ] 157348 53.864% 56.042% ########### ( 2, 3 ] 74511 25.507% 81.548% ##### ( 3, 4 ] 25134 8.604% 90.152% ## ( 4, 6 ] 22302 7.634% 97.787% ## ( 6, 10 ] 5190 1.777% 99.564% ( 10, 15 ] 1005 0.344% 99.908% ( 15, 22 ] 108 0.037% 99.945% ( 22, 34 ] 9 0.003% 99.948% ( 34, 51 ] 2 0.001% 99.948% ( 51, 76 ] 1 0.000% 99.949% ( 76, 110 ] 3 0.001% 99.950% ( 110, 170 ] 117 0.040% 99.990% ( 170, 250 ] 65 0.022% 100.012% ( 250, 380 ] 37 0.013% 100.025% ( 380, 580 ] 28 0.010% 100.034% ( 580, 870 ] 25 0.009% 100.043% ( 870, 1300 ] 1 0.000% 100.043% ** Level 2 read latency histogram (micros): Count: 77114 Average: 2.9918 StdDev: 23.65 Min: 0 Median: 1.6524 Max: 4157 Percentiles: P50: 1.65 P75: 2.13 P99: 8.97 P99.9: 156.19 P99.99: 621.85 ------------------------------------------------------ [ 0, 1 ] 5443 7.058% 7.058% # ( 1, 2 ] 50754 65.817% 72.875% ############# ( 2, 3 ] 12578 16.311% 89.186% ### ( 3, 4 ] 3879 5.030% 94.216% # ( 4, 6 ] 2798 3.628% 97.845% # ( 6, 10 ] 1200 1.556% 99.401% ( 10, 15 ] 229 0.297% 99.698% ( 15, 22 ] 17 0.022% 99.720% ( 22, 34 ] 3 0.004% 99.724% ( 34, 51 ] 37 0.048% 99.772% ( 51, 76 ] 23 0.030% 99.802% ( 76, 110 ] 22 0.029% 99.830% ( 110, 170 ] 70 0.091% 99.921% ( 170, 250 ] 29 0.038% 99.959% ( 250, 380 ] 19 0.025% 99.983% ( 380, 580 ] 5 0.006% 99.990% ( 580, 870 ] 2 0.003% 99.992% ( 870, 1300 ] 2 0.003% 99.995% ( 1300, 1900 ] 1 0.001% 99.996% ( 1900, 2900 ] 2 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 323014 Average: 4.6722 StdDev: 50.74 Min: 0 Median: 1.9036 Max: 7018 Percentiles: P50: 1.90 P75: 2.78 P99: 11.43 P99.9: 256.58 P99.99: 396.87 ------------------------------------------------------ [ 0, 1 ] 7263 2.249% 2.249% ( 1, 2 ] 170690 52.843% 55.091% ########### ( 2, 3 ] 82427 25.518% 80.610% ##### ( 3, 4 ] 28667 8.875% 89.484% ## ( 4, 6 ] 23746 7.351% 96.836% # ( 6, 10 ] 6615 2.048% 98.884% ( 10, 15 ] 1314 0.407% 99.290% ( 15, 22 ] 205 0.063% 99.354% ( 22, 34 ] 30 0.009% 99.363% ( 34, 51 ] 21 0.007% 99.370% ( 51, 76 ] 10 0.003% 99.373% ( 76, 110 ] 87 0.027% 99.400% ( 110, 170 ] 1077 0.333% 99.733% ( 170, 250 ] 524 0.162% 99.895% ( 250, 380 ] 296 0.092% 99.987% ( 380, 580 ] 115 0.036% 100.023% ( 580, 870 ] 41 0.013% 100.035% ( 870, 1300 ] 8 0.002% 100.038% ( 1300, 1900 ] 12 0.004% 100.041% ( 1900, 2900 ] 11 0.003% 100.045% ( 2900, 4400 ] 7 0.002% 100.047% ( 4400, 6600 ] 11 0.003% 100.050% ( 6600, 9900 ] 4 0.001% 100.052% ** Level 4 read latency histogram (micros): Count: 90 Average: 685.9667 StdDev: 1585.47 Min: 1 Median: 2.4286 Max: 6815 Percentiles: P50: 2.43 P75: 289.00 P99: 6815.00 P99.9: 6815.00 P99.99: 6815.00 ------------------------------------------------------ [ 0, 1 ] 15 16.667% 16.667% ### ( 1, 2 ] 27 30.000% 46.667% ###### ( 2, 3 ] 7 7.778% 54.444% ## ( 4, 6 ] 1 1.111% 55.556% ( 15, 22 ] 1 1.111% 56.667% ( 22, 34 ] 1 1.111% 57.778% ( 34, 51 ] 1 1.111% 58.889% ( 110, 170 ] 12 13.333% 72.222% ### ( 170, 250 ] 1 1.111% 73.333% ( 250, 380 ] 5 5.556% 78.889% # ( 380, 580 ] 4 4.444% 83.333% # ( 870, 1300 ] 1 1.111% 84.444% ( 1300, 1900 ] 4 4.444% 88.889% # ( 1900, 2900 ] 2 2.222% 91.111% ( 4400, 6600 ] 7 7.778% 98.889% ## ( 6600, 9900 ] 1 1.111% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 641.8100 StdDev: 795.38 Min: 95 Median: 282.5000 Max: 4147 Percentiles: P50: 282.50 P75: 936.15 P99: 3650.00 P99.9: 4147.00 P99.99: 4147.00 ------------------------------------------------------ ( 76, 110 ] 13 13.000% 13.000% ### ( 110, 170 ] 25 25.000% 38.000% ##### ( 170, 250 ] 9 9.000% 47.000% ## ( 250, 380 ] 12 12.000% 59.000% ## ( 380, 580 ] 11 11.000% 70.000% ## ( 580, 870 ] 3 3.000% 73.000% # ( 870, 1300 ] 13 13.000% 86.000% ### ( 1300, 1900 ] 4 4.000% 90.000% # ( 1900, 2900 ] 8 8.000% 98.000% ## ( 2900, 4400 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 22.6 total, 3.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 261.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.259 H:M:S, 23.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 308.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.186 H:M:S, 5.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/07-11:25:08 ... thread 0: (1000000,7000000) ops and (190114.7,252699.8) ops/second in (5.259983,27.700848) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 4.05 GB 138.5 6.3 0.0 6.3 13.0 6.7 0.0 1.9 145.3 300.4 44.22 42.14 127 0.348 6523K 8023 0.0 0.0 L1 7/7 696.68 MB 0.0 2.5 2.5 0.0 2.4 2.4 0.2 1.0 234.6 232.4 10.73 10.53 2 5.365 2556K 23K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.8 1.5 253.9 253.8 0.76 0.74 2 0.379 195K 87 0.0 0.0 L3 15/0 949.62 MB 0.9 2.0 0.9 1.1 2.0 0.9 1.1 2.2 209.7 209.2 9.91 9.30 8 1.238 2036K 3955 0.0 0.0 L4 163/0 9.60 GB 1.0 0.6 0.5 0.1 0.6 0.5 1.5 1.2 198.5 197.9 3.27 2.91 5 0.653 651K 1885 0.0 0.0 L5 1068/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/19 102.80 GB 0.0 11.6 4.1 7.5 18.3 10.7 6.6 2.7 172.2 271.3 68.88 65.62 144 0.478 11M 37K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.6 4.1 7.5 18.3 10.7 6.2 2.7 172.2 271.3 68.88 65.62 144 0.478 11M 37K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.6 4.1 7.5 11.5 4.0 0.0 0.0 239.0 238.2 49.62 47.92 40 1.241 11M 37K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 356.6 19.25 17.70 104 0.185 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.9 total, 27.7 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.25 GB write, 670.34 MB/s write, 11.58 GB read, 425.45 MB/s read, 68.9 seconds Interval compaction: 18.25 GB write, 674.63 MB/s write, 11.58 GB read, 428.18 MB/s read, 68.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 7, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2721648 Average: 2.3493 StdDev: 7.43 Min: 0 Median: 1.5666 Max: 3181 Percentiles: P50: 1.57 P75: 1.95 P99: 6.01 P99.9: 12.65 P99.99: 129.66 ------------------------------------------------------ [ 0, 1 ] 347078 12.752% 12.752% ### ( 1, 2 ] 1789020 65.733% 78.485% ############# ( 2, 3 ] 377554 13.872% 92.358% ### ( 3, 4 ] 108247 3.977% 96.335% # ( 4, 6 ] 72497 2.664% 98.999% # ( 6, 10 ] 22698 0.834% 99.833% ( 10, 15 ] 3462 0.127% 99.960% ( 15, 22 ] 410 0.015% 99.975% ( 22, 34 ] 56 0.002% 99.977% ( 34, 51 ] 18 0.001% 99.978% ( 51, 76 ] 17 0.001% 99.978% ( 76, 110 ] 119 0.004% 99.983% ( 110, 170 ] 610 0.022% 100.005% ( 170, 250 ] 216 0.008% 100.013% ( 250, 380 ] 138 0.005% 100.018% ( 380, 580 ] 97 0.004% 100.022% ( 580, 870 ] 32 0.001% 100.023% ( 870, 1300 ] 14 0.001% 100.023% ( 1300, 1900 ] 16 0.001% 100.024% ( 1900, 2900 ] 1 0.000% 100.024% ( 2900, 4400 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 397124 Average: 2.9110 StdDev: 9.14 Min: 1 Median: 1.7783 Max: 1251 Percentiles: P50: 1.78 P75: 2.56 P99: 8.59 P99.9: 80.12 P99.99: 194.60 ------------------------------------------------------ [ 0, 1 ] 20550 5.175% 5.175% # ( 1, 2 ] 228732 57.597% 62.772% ############ ( 2, 3 ] 87114 21.936% 84.708% #### ( 3, 4 ] 27967 7.042% 91.750% # ( 4, 6 ] 24384 6.140% 97.891% # ( 6, 10 ] 6795 1.711% 99.602% ( 10, 15 ] 1047 0.264% 99.865% ( 15, 22 ] 115 0.029% 99.894% ( 22, 34 ] 9 0.002% 99.897% ( 34, 51 ] 2 0.001% 99.897% ( 51, 76 ] 4 0.001% 99.898% ( 76, 110 ] 65 0.016% 99.914% ( 110, 170 ] 272 0.068% 99.983% ( 170, 250 ] 92 0.023% 100.006% ( 250, 380 ] 43 0.011% 100.017% ( 380, 580 ] 33 0.008% 100.025% ( 580, 870 ] 25 0.006% 100.031% ( 870, 1300 ] 1 0.000% 100.032% ** Level 2 read latency histogram (micros): Count: 77114 Average: 2.9918 StdDev: 23.65 Min: 0 Median: 1.6524 Max: 4157 Percentiles: P50: 1.65 P75: 2.13 P99: 8.97 P99.9: 156.19 P99.99: 621.85 ------------------------------------------------------ [ 0, 1 ] 5443 7.058% 7.058% # ( 1, 2 ] 50754 65.817% 72.875% ############# ( 2, 3 ] 12578 16.311% 89.186% ### ( 3, 4 ] 3879 5.030% 94.216% # ( 4, 6 ] 2798 3.628% 97.845% # ( 6, 10 ] 1200 1.556% 99.401% ( 10, 15 ] 229 0.297% 99.698% ( 15, 22 ] 17 0.022% 99.720% ( 22, 34 ] 3 0.004% 99.724% ( 34, 51 ] 37 0.048% 99.772% ( 51, 76 ] 23 0.030% 99.802% ( 76, 110 ] 22 0.029% 99.830% ( 110, 170 ] 70 0.091% 99.921% ( 170, 250 ] 29 0.038% 99.959% ( 250, 380 ] 19 0.025% 99.983% ( 380, 580 ] 5 0.006% 99.990% ( 580, 870 ] 2 0.003% 99.992% ( 870, 1300 ] 2 0.003% 99.995% ( 1300, 1900 ] 1 0.001% 99.996% ( 1900, 2900 ] 2 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 323227 Average: 4.6707 StdDev: 50.72 Min: 0 Median: 1.9034 Max: 7018 Percentiles: P50: 1.90 P75: 2.78 P99: 11.42 P99.9: 256.49 P99.99: 396.83 ------------------------------------------------------ [ 0, 1 ] 7268 2.249% 2.249% ( 1, 2 ] 170854 52.859% 55.107% ########### ( 2, 3 ] 82457 25.511% 80.618% ##### ( 3, 4 ] 28671 8.870% 89.488% ## ( 4, 6 ] 23753 7.349% 96.837% # ( 6, 10 ] 6618 2.047% 98.884% ( 10, 15 ] 1314 0.407% 99.291% ( 15, 22 ] 205 0.063% 99.354% ( 22, 34 ] 30 0.009% 99.364% ( 34, 51 ] 21 0.006% 99.370% ( 51, 76 ] 10 0.003% 99.373% ( 76, 110 ] 87 0.027% 99.400% ( 110, 170 ] 1077 0.333% 99.733% ( 170, 250 ] 524 0.162% 99.895% ( 250, 380 ] 296 0.092% 99.987% ( 380, 580 ] 115 0.036% 100.023% ( 580, 870 ] 41 0.013% 100.035% ( 870, 1300 ] 8 0.002% 100.038% ( 1300, 1900 ] 12 0.004% 100.041% ( 1900, 2900 ] 11 0.003% 100.045% ( 2900, 4400 ] 7 0.002% 100.047% ( 4400, 6600 ] 11 0.003% 100.050% ( 6600, 9900 ] 4 0.001% 100.052% ** Level 4 read latency histogram (micros): Count: 115 Average: 548.0870 StdDev: 1427.34 Min: 1 Median: 2.3500 Max: 6815 Percentiles: P50: 2.35 P75: 176.67 P99: 6552.86 P99.9: 6815.00 P99.99: 6815.00 ------------------------------------------------------ [ 0, 1 ] 19 16.522% 16.522% ### ( 1, 2 ] 35 30.435% 46.957% ###### ( 2, 3 ] 10 8.696% 55.652% ## ( 3, 4 ] 1 0.870% 56.522% ( 4, 6 ] 1 0.870% 57.391% ( 10, 15 ] 1 0.870% 58.261% ( 15, 22 ] 2 1.739% 60.000% ( 22, 34 ] 1 0.870% 60.870% ( 34, 51 ] 2 1.739% 62.609% ( 76, 110 ] 1 0.870% 63.478% ( 110, 170 ] 13 11.304% 74.783% ## ( 170, 250 ] 3 2.609% 77.391% # ( 250, 380 ] 7 6.087% 83.478% # ( 380, 580 ] 4 3.478% 86.957% # ( 870, 1300 ] 1 0.870% 87.826% ( 1300, 1900 ] 4 3.478% 91.304% # ( 1900, 2900 ] 2 1.739% 93.043% ( 4400, 6600 ] 7 6.087% 99.130% # ( 6600, 9900 ] 1 0.870% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 603.1667 StdDev: 750.57 Min: 95 Median: 259.2857 Max: 4147 Percentiles: P50: 259.29 P75: 896.88 P99: 3500.00 P99.9: 4147.00 P99.99: 4147.00 ------------------------------------------------------ ( 76, 110 ] 13 10.833% 10.833% ## ( 110, 170 ] 33 27.500% 38.333% ###### ( 170, 250 ] 13 10.833% 49.167% ## ( 250, 380 ] 14 11.667% 60.833% ## ( 380, 580 ] 12 10.000% 70.833% ## ( 580, 870 ] 4 3.333% 74.167% # ( 870, 1300 ] 16 13.333% 87.500% ### ( 1300, 1900 ] 5 4.167% 91.667% # ( 1900, 2900 ] 8 6.667% 98.333% # ( 2900, 4400 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 27.9 total, 5.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 247.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.683 H:M:S, 27.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 187.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.423 H:M:S, 46.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/12/07-11:25:14 ... thread 0: (1000000,8000000) ops and (164387.5,236798.2) ops/second in (6.083186,33.784034) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 3.13 GB 12.6 7.4 0.0 7.4 15.0 7.6 0.0 2.0 143.9 290.0 52.96 49.34 141 0.376 7738K 11K 0.0 0.0 L1 10/10 1.09 GB 0.0 4.9 4.2 0.7 4.9 4.2 0.2 1.1 226.1 223.8 22.28 21.73 3 7.428 5115K 49K 0.0 0.0 L2 1/1 128.78 MB 0.0 0.2 0.1 0.1 0.2 0.1 3.2 1.5 253.9 253.8 0.76 0.74 2 0.379 195K 87 0.0 0.0 L3 24/5 1.19 GB 0.9 3.7 1.8 1.9 3.7 1.8 1.4 2.0 185.1 184.3 20.60 17.59 15 1.373 3798K 15K 0.0 0.0 L4 162/3 9.55 GB 1.0 1.7 1.5 0.2 1.7 1.5 1.5 1.1 169.6 169.0 10.11 8.04 19 0.532 1714K 5419 0.0 0.0 L5 1080/0 88.52 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/33 103.62 GB 0.0 17.9 7.7 10.3 25.4 15.1 9.2 3.4 172.2 244.1 106.71 97.44 180 0.593 18M 82K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.9 7.7 10.3 25.4 15.1 8.8 3.4 172.2 244.1 106.71 97.44 180 0.593 18M 82K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.9 7.7 10.3 17.9 7.6 0.0 0.0 219.3 218.3 83.82 77.28 64 1.310 18M 82K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 338.5 22.89 20.16 116 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.0 total, 33.8 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.43 GB write, 766.82 MB/s write, 17.95 GB read, 541.16 MB/s read, 106.7 seconds Interval compaction: 25.43 GB write, 770.84 MB/s write, 17.95 GB read, 544.00 MB/s read, 106.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 18, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3215400 Average: 2.4759 StdDev: 15.34 Min: 0 Median: 1.5921 Max: 9747 Percentiles: P50: 1.59 P75: 1.98 P99: 6.52 P99.9: 13.34 P99.99: 159.70 ------------------------------------------------------ [ 0, 1 ] 380668 11.839% 11.839% ## ( 1, 2 ] 2072479 64.455% 76.294% ############# ( 2, 3 ] 479579 14.915% 91.209% ### ( 3, 4 ] 142095 4.419% 95.628% # ( 4, 6 ] 104543 3.251% 98.879% # ( 6, 10 ] 29740 0.925% 99.804% ( 10, 15 ] 4611 0.143% 99.948% ( 15, 22 ] 526 0.016% 99.964% ( 22, 34 ] 67 0.002% 99.966% ( 34, 51 ] 20 0.001% 99.967% ( 51, 76 ] 22 0.001% 99.967% ( 76, 110 ] 143 0.004% 99.972% ( 110, 170 ] 708 0.022% 99.994% ( 170, 250 ] 383 0.012% 100.006% ( 250, 380 ] 245 0.008% 100.013% ( 380, 580 ] 181 0.006% 100.019% ( 580, 870 ] 62 0.002% 100.021% ( 870, 1300 ] 30 0.001% 100.022% ( 1300, 1900 ] 25 0.001% 100.023% ( 1900, 2900 ] 10 0.000% 100.023% ( 2900, 4400 ] 17 0.001% 100.023% ( 4400, 6600 ] 2 0.000% 100.024% ( 6600, 9900 ] 3 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 904848 Average: 3.9642 StdDev: 51.90 Min: 0 Median: 1.9231 Max: 7692 Percentiles: P50: 1.92 P75: 2.82 P99: 9.29 P99.9: 79.17 P99.99: 175.24 ------------------------------------------------------ [ 0, 1 ] 28694 3.171% 3.171% # ( 1, 2 ] 459045 50.732% 53.903% ########## ( 2, 3 ] 232036 25.644% 79.547% ##### ( 3, 4 ] 78793 8.708% 88.254% ## ( 4, 6 ] 79547 8.791% 97.046% ## ( 6, 10 ] 21471 2.373% 99.418% ( 10, 15 ] 3774 0.417% 99.836% ( 15, 22 ] 507 0.056% 99.892% ( 22, 34 ] 34 0.004% 99.895% ( 34, 51 ] 14 0.002% 99.897% ( 51, 76 ] 15 0.002% 99.899% ( 76, 110 ] 152 0.017% 99.915% ( 110, 170 ] 652 0.072% 99.987% ( 170, 250 ] 374 0.041% 100.029% ( 250, 380 ] 207 0.023% 100.052% ( 380, 580 ] 126 0.014% 100.066% ( 580, 870 ] 72 0.008% 100.073% ( 870, 1300 ] 23 0.003% 100.076% ( 1300, 1900 ] 18 0.002% 100.078% ( 1900, 2900 ] 63 0.007% 100.085% ( 2900, 4400 ] 76 0.008% 100.093% ( 4400, 6600 ] 23 0.003% 100.096% ( 6600, 9900 ] 5 0.001% 100.096% ** Level 2 read latency histogram (micros): Count: 77114 Average: 2.9918 StdDev: 23.65 Min: 0 Median: 1.6524 Max: 4157 Percentiles: P50: 1.65 P75: 2.13 P99: 8.97 P99.9: 156.19 P99.99: 621.85 ------------------------------------------------------ [ 0, 1 ] 5443 7.058% 7.058% # ( 1, 2 ] 50754 65.817% 72.875% ############# ( 2, 3 ] 12578 16.311% 89.186% ### ( 3, 4 ] 3879 5.030% 94.216% # ( 4, 6 ] 2798 3.628% 97.845% # ( 6, 10 ] 1200 1.556% 99.401% ( 10, 15 ] 229 0.297% 99.698% ( 15, 22 ] 17 0.022% 99.720% ( 22, 34 ] 3 0.004% 99.724% ( 34, 51 ] 37 0.048% 99.772% ( 51, 76 ] 23 0.030% 99.802% ( 76, 110 ] 22 0.029% 99.830% ( 110, 170 ] 70 0.091% 99.921% ( 170, 250 ] 29 0.038% 99.959% ( 250, 380 ] 19 0.025% 99.983% ( 380, 580 ] 5 0.006% 99.990% ( 580, 870 ] 2 0.003% 99.992% ( 870, 1300 ] 2 0.003% 99.995% ( 1300, 1900 ] 1 0.001% 99.996% ( 1900, 2900 ] 2 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 655987 Average: 5.3022 StdDev: 71.85 Min: 0 Median: 2.0031 Max: 9699 Percentiles: P50: 2.00 P75: 2.90 P99: 9.77 P99.9: 242.83 P99.99: 372.29 ------------------------------------------------------ [ 0, 1 ] 9552 1.456% 1.456% ( 1, 2 ] 317865 48.456% 49.912% ########## ( 2, 3 ] 183239 27.933% 77.845% ###### ( 3, 4 ] 65278 9.951% 87.797% ## ( 4, 6 ] 61558 9.384% 97.181% ## ( 6, 10 ] 12671 1.932% 99.112% ( 10, 15 ] 2552 0.389% 99.501% ( 15, 22 ] 348 0.053% 99.554% ( 22, 34 ] 37 0.006% 99.560% ( 34, 51 ] 26 0.004% 99.564% ( 51, 76 ] 17 0.003% 99.566% ( 76, 110 ] 92 0.014% 99.580% ( 110, 170 ] 1355 0.207% 99.787% ( 170, 250 ] 814 0.124% 99.911% ( 250, 380 ] 550 0.084% 99.995% ( 380, 580 ] 325 0.050% 100.045% ( 580, 870 ] 151 0.023% 100.068% ( 870, 1300 ] 57 0.009% 100.076% ( 1300, 1900 ] 37 0.006% 100.082% ( 1900, 2900 ] 51 0.008% 100.090% ( 2900, 4400 ] 73 0.011% 100.101% ( 4400, 6600 ] 30 0.005% 100.105% ( 6600, 9900 ] 16 0.002% 100.108% ** Level 4 read latency histogram (micros): Count: 1911 Average: 96.5924 StdDev: 480.71 Min: 1 Median: 2.5366 Max: 7326 Percentiles: P50: 2.54 P75: 5.02 P99: 2136.25 P99.9: 6746.85 P99.99: 7326.00 ------------------------------------------------------ [ 0, 1 ] 65 3.401% 3.401% # ( 1, 2 ] 612 32.025% 35.426% ###### ( 2, 3 ] 519 27.159% 62.585% ##### ( 3, 4 ] 173 9.053% 71.638% ## ( 4, 6 ] 126 6.593% 78.231% # ( 6, 10 ] 77 4.029% 82.261% # ( 10, 15 ] 45 2.355% 84.615% ( 15, 22 ] 13 0.680% 85.296% ( 22, 34 ] 7 0.366% 85.662% ( 34, 51 ] 5 0.262% 85.924% ( 76, 110 ] 2 0.105% 86.028% ( 110, 170 ] 45 2.355% 88.383% ( 170, 250 ] 59 3.087% 91.470% # ( 250, 380 ] 65 3.401% 94.872% # ( 380, 580 ] 38 1.988% 96.860% ( 580, 870 ] 24 1.256% 98.116% ( 870, 1300 ] 8 0.419% 98.535% ( 1300, 1900 ] 7 0.366% 98.901% ( 1900, 2900 ] 8 0.419% 99.320% ( 2900, 4400 ] 4 0.209% 99.529% ( 4400, 6600 ] 7 0.366% 99.895% ( 6600, 9900 ] 2 0.105% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 584.1611 StdDev: 690.68 Min: 95 Median: 261.3043 Max: 4147 Percentiles: P50: 261.30 P75: 904.40 P99: 3050.00 P99.9: 4147.00 P99.99: 4147.00 ------------------------------------------------------ ( 76, 110 ] 15 8.333% 8.333% ## ( 110, 170 ] 48 26.667% 35.000% ##### ( 170, 250 ] 25 13.889% 48.889% ### ( 250, 380 ] 23 12.778% 61.667% ### ( 380, 580 ] 15 8.333% 70.000% ## ( 580, 870 ] 7 3.889% 73.889% # ( 870, 1300 ] 25 13.889% 87.778% ### ( 1300, 1900 ] 9 5.000% 92.778% # ( 1900, 2900 ] 11 6.111% 98.889% # ( 2900, 4400 ] 2 1.111% 100.000% ** DB Stats ** Uptime(secs): 34.0 total, 6.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 231.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.276 H:M:S, 30.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 161.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.593 H:M:S, 42.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/07-11:25:18 ... thread 0: (1000000,9000000) ops and (258272.9,239006.3) ops/second in (3.871874,37.655908) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 4.11 GB 119.6 8.6 0.0 8.6 17.1 8.5 0.0 2.0 144.2 288.1 60.73 56.59 160 0.380 8889K 13K 0.0 0.0 L1 10/10 1.09 GB 0.0 4.9 4.2 0.7 4.9 4.2 0.2 1.1 226.1 223.8 22.28 21.73 3 7.428 5115K 49K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.2 1.5 253.9 253.8 0.76 0.74 2 0.379 195K 87 0.0 0.0 L3 19/0 982.11 MB 1.0 4.0 1.9 2.1 4.0 1.9 1.4 2.1 186.7 185.9 22.18 19.13 16 1.387 4133K 17K 0.0 0.0 L4 163/0 9.60 GB 1.0 2.1 1.8 0.3 2.1 1.8 1.5 1.1 170.2 169.6 12.59 10.17 24 0.525 2149K 7219 0.0 0.0 L5 1084/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/24 104.60 GB 0.0 19.8 8.1 11.7 28.3 16.6 9.6 3.3 171.0 244.1 118.55 108.36 205 0.578 20M 87K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.8 8.1 11.7 28.3 16.6 9.1 3.3 171.0 244.1 118.55 108.36 205 0.578 20M 87K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.8 8.1 11.7 19.7 8.1 0.0 0.0 219.0 218.0 92.56 85.50 74 1.251 20M 87K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 336.9 25.99 22.86 131 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.8 total, 37.7 interval Flush(GB): cumulative 8.552, interval 8.552 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.26 GB write, 764.83 MB/s write, 19.80 GB read, 535.77 MB/s read, 118.5 seconds Interval compaction: 28.26 GB write, 768.43 MB/s write, 19.80 GB read, 538.30 MB/s read, 118.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 21, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3728416 Average: 2.5124 StdDev: 16.67 Min: 0 Median: 1.6048 Max: 9747 Percentiles: P50: 1.60 P75: 1.99 P99: 6.70 P99.9: 13.42 P99.99: 148.31 ------------------------------------------------------ [ 0, 1 ] 415501 11.144% 11.144% ## ( 1, 2 ] 2395412 64.247% 75.392% ############# ( 2, 3 ] 576581 15.465% 90.856% ### ( 3, 4 ] 170554 4.574% 95.431% # ( 4, 6 ] 126824 3.402% 98.832% # ( 6, 10 ] 35879 0.962% 99.794% ( 10, 15 ] 5753 0.154% 99.949% ( 15, 22 ] 617 0.017% 99.965% ( 22, 34 ] 76 0.002% 99.967% ( 34, 51 ] 23 0.001% 99.968% ( 51, 76 ] 25 0.001% 99.969% ( 76, 110 ] 205 0.005% 99.974% ( 110, 170 ] 932 0.025% 99.999% ( 170, 250 ] 421 0.011% 100.010% ( 250, 380 ] 280 0.008% 100.018% ( 380, 580 ] 196 0.005% 100.023% ( 580, 870 ] 67 0.002% 100.025% ( 870, 1300 ] 36 0.001% 100.026% ( 1300, 1900 ] 31 0.001% 100.027% ( 1900, 2900 ] 16 0.000% 100.027% ( 2900, 4400 ] 25 0.001% 100.028% ( 4400, 6600 ] 5 0.000% 100.028% ( 6600, 9900 ] 3 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 927930 Average: 3.9358 StdDev: 51.25 Min: 0 Median: 1.9219 Max: 7692 Percentiles: P50: 1.92 P75: 2.82 P99: 9.29 P99.9: 59.45 P99.99: 174.54 ------------------------------------------------------ [ 0, 1 ] 29100 3.136% 3.136% # ( 1, 2 ] 471711 50.835% 53.971% ########## ( 2, 3 ] 238025 25.651% 79.622% ##### ( 3, 4 ] 80527 8.678% 88.300% ## ( 4, 6 ] 81157 8.746% 97.046% ## ( 6, 10 ] 22065 2.378% 99.424% ( 10, 15 ] 3847 0.415% 99.839% ( 15, 22 ] 517 0.056% 99.894% ( 22, 34 ] 34 0.004% 99.898% ( 34, 51 ] 14 0.002% 99.899% ( 51, 76 ] 15 0.002% 99.901% ( 76, 110 ] 152 0.016% 99.917% ( 110, 170 ] 652 0.070% 99.988% ( 170, 250 ] 374 0.040% 100.028% ( 250, 380 ] 207 0.022% 100.050% ( 380, 580 ] 126 0.014% 100.064% ( 580, 870 ] 72 0.008% 100.072% ( 870, 1300 ] 23 0.002% 100.074% ( 1300, 1900 ] 18 0.002% 100.076% ( 1900, 2900 ] 63 0.007% 100.083% ( 2900, 4400 ] 76 0.008% 100.091% ( 4400, 6600 ] 23 0.002% 100.094% ( 6600, 9900 ] 5 0.001% 100.094% ** Level 2 read latency histogram (micros): Count: 77114 Average: 2.9918 StdDev: 23.65 Min: 0 Median: 1.6524 Max: 4157 Percentiles: P50: 1.65 P75: 2.13 P99: 8.97 P99.9: 156.19 P99.99: 621.85 ------------------------------------------------------ [ 0, 1 ] 5443 7.058% 7.058% # ( 1, 2 ] 50754 65.817% 72.875% ############# ( 2, 3 ] 12578 16.311% 89.186% ### ( 3, 4 ] 3879 5.030% 94.216% # ( 4, 6 ] 2798 3.628% 97.845% # ( 6, 10 ] 1200 1.556% 99.401% ( 10, 15 ] 229 0.297% 99.698% ( 15, 22 ] 17 0.022% 99.720% ( 22, 34 ] 3 0.004% 99.724% ( 34, 51 ] 37 0.048% 99.772% ( 51, 76 ] 23 0.030% 99.802% ( 76, 110 ] 22 0.029% 99.830% ( 110, 170 ] 70 0.091% 99.921% ( 170, 250 ] 29 0.038% 99.959% ( 250, 380 ] 19 0.025% 99.983% ( 380, 580 ] 5 0.006% 99.990% ( 580, 870 ] 2 0.003% 99.992% ( 870, 1300 ] 2 0.003% 99.995% ( 1300, 1900 ] 1 0.001% 99.996% ( 1900, 2900 ] 2 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 760018 Average: 5.2399 StdDev: 72.82 Min: 0 Median: 2.0040 Max: 9699 Percentiles: P50: 2.00 P75: 2.90 P99: 9.68 P99.9: 237.12 P99.99: 363.25 ------------------------------------------------------ [ 0, 1 ] 10780 1.418% 1.418% ( 1, 2 ] 368381 48.470% 49.888% ########## ( 2, 3 ] 213128 28.042% 77.931% ###### ( 3, 4 ] 75309 9.909% 87.840% ## ( 4, 6 ] 71624 9.424% 97.264% ## ( 6, 10 ] 14354 1.889% 99.152% ( 10, 15 ] 2858 0.376% 99.528% ( 15, 22 ] 383 0.050% 99.579% ( 22, 34 ] 39 0.005% 99.584% ( 34, 51 ] 26 0.003% 99.587% ( 51, 76 ] 18 0.002% 99.590% ( 76, 110 ] 106 0.014% 99.604% ( 110, 170 ] 1507 0.198% 99.802% ( 170, 250 ] 888 0.117% 99.919% ( 250, 380 ] 621 0.082% 100.001% ( 380, 580 ] 348 0.046% 100.046% ( 580, 870 ] 161 0.021% 100.067% ( 870, 1300 ] 60 0.008% 100.075% ( 1300, 1900 ] 42 0.006% 100.081% ( 1900, 2900 ] 61 0.008% 100.089% ( 2900, 4400 ] 81 0.011% 100.100% ( 4400, 6600 ] 34 0.004% 100.104% ( 6600, 9900 ] 21 0.003% 100.107% ** Level 4 read latency histogram (micros): Count: 6014 Average: 36.1415 StdDev: 276.33 Min: 1 Median: 2.2280 Max: 7326 Percentiles: P50: 2.23 P75: 3.39 P99: 611.90 P99.9: 5338.46 P99.99: 7326.00 ------------------------------------------------------ [ 0, 1 ] 149 2.478% 2.478% ( 1, 2 ] 2492 41.437% 43.914% ######## ( 2, 3 ] 1605 26.688% 70.602% ##### ( 3, 4 ] 678 11.274% 81.876% ## ( 4, 6 ] 460 7.649% 89.524% ## ( 6, 10 ] 179 2.976% 92.501% # ( 10, 15 ] 74 1.230% 93.731% ( 15, 22 ] 14 0.233% 93.964% ( 22, 34 ] 7 0.116% 94.080% ( 34, 51 ] 5 0.083% 94.164% ( 76, 110 ] 5 0.083% 94.247% ( 110, 170 ] 74 1.230% 95.477% ( 170, 250 ] 82 1.363% 96.841% ( 250, 380 ] 81 1.347% 98.188% ( 380, 580 ] 46 0.765% 98.952% ( 580, 870 ] 26 0.432% 99.385% ( 870, 1300 ] 9 0.150% 99.534% ( 1300, 1900 ] 7 0.116% 99.651% ( 1900, 2900 ] 8 0.133% 99.784% ( 2900, 4400 ] 4 0.067% 99.850% ( 4400, 6600 ] 7 0.116% 99.967% ( 6600, 9900 ] 2 0.033% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 572.2100 StdDev: 673.05 Min: 95 Median: 255.2000 Max: 4147 Percentiles: P50: 255.20 P75: 899.66 P99: 2900.00 P99.9: 4147.00 P99.99: 4147.00 ------------------------------------------------------ ( 76, 110 ] 18 9.000% 9.000% ## ( 110, 170 ] 53 26.500% 35.500% ##### ( 170, 250 ] 28 14.000% 49.500% ### ( 250, 380 ] 25 12.500% 62.000% ### ( 380, 580 ] 17 8.500% 70.500% ## ( 580, 870 ] 7 3.500% 74.000% # ( 870, 1300 ] 29 14.500% 88.500% ### ( 1300, 1900 ] 10 5.000% 93.500% # ( 1900, 2900 ] 11 5.500% 99.000% # ( 2900, 4400 ] 2 1.000% 100.000% ** DB Stats ** Uptime(secs): 37.8 total, 3.9 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 234.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.182 H:M:S, 29.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 254.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.906 H:M:S, 23.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/07-11:25:35 ... thread 0: (1000000,10000000) ops and (58536.4,182684.1) ops/second in (17.083396,54.739304) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 2.39 GB 25.2 10.3 0.0 10.3 19.9 9.5 0.0 2.1 149.0 286.2 71.04 66.23 180 0.395 10M 16K 0.0 0.0 L1 13/13 1.52 GB 0.0 8.7 6.9 1.8 8.6 6.8 0.2 1.2 224.1 221.3 39.80 38.22 4 9.951 8970K 49K 0.0 0.0 L2 1/1 128.78 MB 0.0 0.2 0.1 0.1 0.2 0.1 5.4 1.5 253.9 253.8 0.76 0.74 2 0.379 195K 87 0.0 0.0 L3 25/3 1.21 GB 1.0 6.7 3.6 3.1 6.7 3.5 1.9 1.9 165.0 164.1 41.50 32.83 28 1.482 6883K 37K 0.0 0.0 L4 167/5 9.72 GB 1.0 4.9 3.6 1.2 4.8 3.6 1.5 1.3 150.5 149.2 33.20 24.20 47 0.706 5047K 43K 0.0 0.0 L5 1104/0 90.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1319/28 105.46 GB 0.0 30.8 14.3 16.5 40.1 23.6 13.9 4.2 169.3 220.6 186.30 162.21 261 0.714 31M 146K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.8 14.3 16.5 40.1 23.6 13.5 4.2 169.3 220.6 186.30 162.21 261 0.714 31M 146K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.8 14.3 16.5 30.6 14.1 0.0 0.0 200.7 199.3 157.17 136.69 115 1.367 31M 146K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 335.2 29.13 25.53 146 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.9 total, 54.7 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.13 GB write, 748.26 MB/s write, 30.80 GB read, 574.33 MB/s read, 186.3 seconds Interval compaction: 40.13 GB write, 750.69 MB/s write, 30.80 GB read, 576.19 MB/s read, 186.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 28, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 28, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 35, pending-compaction-bytes-stops: 0, total-delays: 63, total-stops: 26, interval: 89 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4722166 Average: 2.6748 StdDev: 25.61 Min: 0 Median: 1.6027 Max: 9747 Percentiles: P50: 1.60 P75: 1.99 P99: 7.18 P99.9: 20.66 P99.99: 201.85 ------------------------------------------------------ [ 0, 1 ] 541326 11.464% 11.464% ## ( 1, 2 ] 3019129 63.935% 75.399% ############# ( 2, 3 ] 714897 15.139% 90.538% ### ( 3, 4 ] 215972 4.574% 95.112% # ( 4, 6 ] 169217 3.583% 98.695% # ( 6, 10 ] 48827 1.034% 99.729% ( 10, 15 ] 7384 0.156% 99.885% ( 15, 22 ] 855 0.018% 99.903% ( 22, 34 ] 95 0.002% 99.905% ( 34, 51 ] 44 0.001% 99.906% ( 51, 76 ] 52 0.001% 99.908% ( 76, 110 ] 1353 0.029% 99.936% ( 110, 170 ] 2276 0.048% 99.984% ( 170, 250 ] 670 0.014% 99.999% ( 250, 380 ] 489 0.010% 100.009% ( 380, 580 ] 339 0.007% 100.016% ( 580, 870 ] 141 0.003% 100.019% ( 870, 1300 ] 65 0.001% 100.020% ( 1300, 1900 ] 45 0.001% 100.021% ( 1900, 2900 ] 27 0.001% 100.022% ( 2900, 4400 ] 69 0.001% 100.023% ( 4400, 6600 ] 19 0.000% 100.024% ( 6600, 9900 ] 17 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1785962 Average: 5.2634 StdDev: 93.63 Min: 0 Median: 1.9189 Max: 15564 Percentiles: P50: 1.92 P75: 2.87 P99: 9.49 P99.9: 111.01 P99.99: 225.14 ------------------------------------------------------ [ 0, 1 ] 100417 5.623% 5.623% # ( 1, 2 ] 862468 48.292% 53.914% ########## ( 2, 3 ] 434538 24.331% 78.245% ##### ( 3, 4 ] 158433 8.871% 87.116% ## ( 4, 6 ] 174418 9.766% 96.882% ## ( 6, 10 ] 43368 2.428% 99.310% ( 10, 15 ] 8452 0.473% 99.783% ( 15, 22 ] 1104 0.062% 99.845% ( 22, 34 ] 88 0.005% 99.850% ( 34, 51 ] 41 0.002% 99.852% ( 51, 76 ] 109 0.006% 99.859% ( 76, 110 ] 721 0.040% 99.899% ( 110, 170 ] 1135 0.064% 99.962% ( 170, 250 ] 713 0.040% 100.002% ( 250, 380 ] 578 0.032% 100.035% ( 380, 580 ] 422 0.024% 100.058% ( 580, 870 ] 225 0.013% 100.071% ( 870, 1300 ] 104 0.006% 100.077% ( 1300, 1900 ] 101 0.006% 100.082% ( 1900, 2900 ] 201 0.011% 100.094% ( 2900, 4400 ] 336 0.019% 100.113% ( 4400, 6600 ] 123 0.007% 100.119% ( 6600, 9900 ] 91 0.005% 100.125% ( 9900, 14000 ] 4 0.000% 100.125% ( 14000, 22000 ] 1 0.000% 100.125% ** Level 2 read latency histogram (micros): Count: 77114 Average: 2.9918 StdDev: 23.65 Min: 0 Median: 1.6524 Max: 4157 Percentiles: P50: 1.65 P75: 2.13 P99: 8.97 P99.9: 156.19 P99.99: 621.85 ------------------------------------------------------ [ 0, 1 ] 5443 7.058% 7.058% # ( 1, 2 ] 50754 65.817% 72.875% ############# ( 2, 3 ] 12578 16.311% 89.186% ### ( 3, 4 ] 3879 5.030% 94.216% # ( 4, 6 ] 2798 3.628% 97.845% # ( 6, 10 ] 1200 1.556% 99.401% ( 10, 15 ] 229 0.297% 99.698% ( 15, 22 ] 17 0.022% 99.720% ( 22, 34 ] 3 0.004% 99.724% ( 34, 51 ] 37 0.048% 99.772% ( 51, 76 ] 23 0.030% 99.802% ( 76, 110 ] 22 0.029% 99.830% ( 110, 170 ] 70 0.091% 99.921% ( 170, 250 ] 29 0.038% 99.959% ( 250, 380 ] 19 0.025% 99.983% ( 380, 580 ] 5 0.006% 99.990% ( 580, 870 ] 2 0.003% 99.992% ( 870, 1300 ] 2 0.003% 99.995% ( 1300, 1900 ] 1 0.001% 99.996% ( 1900, 2900 ] 2 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1480141 Average: 6.2013 StdDev: 100.39 Min: 0 Median: 2.1801 Max: 14978 Percentiles: P50: 2.18 P75: 3.09 P99: 9.57 P99.9: 228.95 P99.99: 366.34 ------------------------------------------------------ [ 0, 1 ] 15136 1.023% 1.023% ( 1, 2 ] 646964 43.710% 44.732% ######### ( 2, 3 ] 432817 29.242% 73.974% ###### ( 3, 4 ] 164237 11.096% 85.070% ## ( 4, 6 ] 176614 11.932% 97.002% ## ( 6, 10 ] 33123 2.238% 99.240% ( 10, 15 ] 6079 0.411% 99.651% ( 15, 22 ] 739 0.050% 99.701% ( 22, 34 ] 81 0.005% 99.706% ( 34, 51 ] 63 0.004% 99.710% ( 51, 76 ] 86 0.006% 99.716% ( 76, 110 ] 166 0.011% 99.727% ( 110, 170 ] 1640 0.111% 99.838% ( 170, 250 ] 1243 0.084% 99.922% ( 250, 380 ] 1123 0.076% 99.998% ( 380, 580 ] 750 0.051% 100.049% ( 580, 870 ] 413 0.028% 100.077% ( 870, 1300 ] 178 0.012% 100.089% ( 1300, 1900 ] 108 0.007% 100.096% ( 1900, 2900 ] 165 0.011% 100.107% ( 2900, 4400 ] 325 0.022% 100.129% ( 4400, 6600 ] 92 0.006% 100.135% ( 6600, 9900 ] 87 0.006% 100.141% ( 9900, 14000 ] 5 0.000% 100.141% ( 14000, 22000 ] 1 0.000% 100.141% ** Level 4 read latency histogram (micros): Count: 220157 Average: 11.5595 StdDev: 152.84 Min: 0 Median: 2.3389 Max: 9058 Percentiles: P50: 2.34 P75: 3.43 P99: 14.84 P99.9: 1186.28 P99.99: 3298.44 ------------------------------------------------------ [ 0, 1 ] 1468 0.667% 0.667% ( 1, 2 ] 86164 39.138% 39.804% ######## ( 2, 3 ] 66235 30.085% 69.890% ###### ( 3, 4 ] 25912 11.770% 81.659% ## ( 4, 6 ] 30079 13.663% 95.322% ### ( 6, 10 ] 6836 3.105% 98.427% # ( 10, 15 ] 1305 0.593% 99.020% ( 15, 22 ] 146 0.066% 99.086% ( 22, 34 ] 20 0.009% 99.095% ( 34, 51 ] 20 0.009% 99.104% ( 51, 76 ] 31 0.014% 99.118% ( 76, 110 ] 29 0.013% 99.132% ( 110, 170 ] 184 0.084% 99.215% ( 170, 250 ] 466 0.212% 99.427% ( 250, 380 ] 434 0.197% 99.624% ( 380, 580 ] 364 0.165% 99.789% ( 580, 870 ] 186 0.084% 99.874% ( 870, 1300 ] 80 0.036% 99.910% ( 1300, 1900 ] 51 0.023% 99.933% ( 1900, 2900 ] 88 0.040% 99.973% ( 2900, 4400 ] 143 0.065% 100.038% ( 4400, 6600 ] 46 0.021% 100.059% ( 6600, 9900 ] 19 0.009% 100.068% ** Level 5 read latency histogram (micros): Count: 300 Average: 644.3200 StdDev: 715.34 Min: 86 Median: 330.0000 Max: 4913 Percentiles: P50: 330.00 P75: 994.22 P99: 3400.00 P99.9: 4913.00 P99.99: 4913.00 ------------------------------------------------------ ( 76, 110 ] 25 8.333% 8.333% ## ( 110, 170 ] 59 19.667% 28.000% #### ( 170, 250 ] 42 14.000% 42.000% ### ( 250, 380 ] 39 13.000% 55.000% ### ( 380, 580 ] 28 9.333% 64.333% ## ( 580, 870 ] 19 6.333% 70.667% # ( 870, 1300 ] 45 15.000% 85.667% ### ( 1300, 1900 ] 24 8.000% 93.667% ## ( 1900, 2900 ] 15 5.000% 98.667% # ( 2900, 4400 ] 3 1.000% 99.667% ( 4400, 6600 ] 1 0.333% 100.000% ** DB Stats ** Uptime(secs): 54.9 total, 17.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 179.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.724 H:M:S, 45.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 57.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.542 H:M:S, 79.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/07-11:25:38 ... thread 0: (1000000,11000000) ops and (307817.4,189694.5) ops/second in (3.248679,57.987983) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 3.32 GB 94.4 11.2 0.0 11.2 21.6 10.4 0.0 2.1 147.9 285.8 77.52 72.14 197 0.394 11M 17K 0.0 0.0 L1 13/13 1.52 GB 0.0 8.7 6.9 1.8 8.6 6.8 0.2 1.2 224.1 221.3 39.80 38.22 4 9.951 8970K 49K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 5.4 1.5 253.9 253.8 0.76 0.74 2 0.379 195K 87 0.0 0.0 L3 21/0 968.84 MB 1.0 6.9 3.7 3.2 6.9 3.7 1.9 1.9 165.5 164.6 42.97 34.02 29 1.482 7148K 38K 0.0 0.0 L4 164/0 9.42 GB 1.0 5.6 4.0 1.6 5.5 4.0 1.5 1.4 152.3 150.9 37.62 27.65 52 0.724 5793K 55K 0.0 0.0 L5 1112/0 91.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1324/23 106.37 GB 0.0 32.6 14.8 17.8 42.9 25.0 14.6 4.1 168.2 221.0 198.67 172.77 284 0.700 33M 161K 0.0 0.0 Int 0/0 0.00 KB 0.0 32.6 14.8 17.8 42.9 25.0 14.1 4.1 168.2 221.0 198.67 172.77 284 0.700 33M 161K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 32.6 14.8 17.8 32.4 14.6 0.0 0.0 200.6 199.2 166.59 144.77 124 1.343 33M 161K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 333.8 32.08 27.99 160 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.2 total, 58.0 interval Flush(GB): cumulative 10.459, interval 10.459 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 42.87 GB write, 754.76 MB/s write, 32.64 GB read, 574.53 MB/s read, 198.7 seconds Interval compaction: 42.87 GB write, 757.06 MB/s write, 32.64 GB read, 576.29 MB/s read, 198.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 28, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 28, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 35, pending-compaction-bytes-stops: 0, total-delays: 63, total-stops: 29, interval: 92 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5133268 Average: 2.6676 StdDev: 24.84 Min: 0 Median: 1.6076 Max: 9747 Percentiles: P50: 1.61 P75: 2.00 P99: 7.19 P99.9: 17.79 P99.99: 185.99 ------------------------------------------------------ [ 0, 1 ] 572760 11.158% 11.158% ## ( 1, 2 ] 3281742 63.931% 75.089% ############# ( 2, 3 ] 787997 15.351% 90.439% ### ( 3, 4 ] 237482 4.626% 95.066% # ( 4, 6 ] 185901 3.621% 98.687% # ( 6, 10 ] 53895 1.050% 99.737% ( 10, 15 ] 8003 0.156% 99.893% ( 15, 22 ] 891 0.017% 99.910% ( 22, 34 ] 100 0.002% 99.912% ( 34, 51 ] 47 0.001% 99.913% ( 51, 76 ] 54 0.001% 99.914% ( 76, 110 ] 1362 0.027% 99.941% ( 110, 170 ] 2379 0.046% 99.987% ( 170, 250 ] 709 0.014% 100.001% ( 250, 380 ] 512 0.010% 100.011% ( 380, 580 ] 349 0.007% 100.018% ( 580, 870 ] 143 0.003% 100.021% ( 870, 1300 ] 70 0.001% 100.022% ( 1300, 1900 ] 48 0.001% 100.023% ( 1900, 2900 ] 35 0.001% 100.024% ( 2900, 4400 ] 69 0.001% 100.025% ( 4400, 6600 ] 19 0.000% 100.025% ( 6600, 9900 ] 17 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1785962 Average: 5.2634 StdDev: 93.63 Min: 0 Median: 1.9189 Max: 15564 Percentiles: P50: 1.92 P75: 2.87 P99: 9.49 P99.9: 111.01 P99.99: 225.14 ------------------------------------------------------ [ 0, 1 ] 100417 5.623% 5.623% # ( 1, 2 ] 862468 48.292% 53.914% ########## ( 2, 3 ] 434538 24.331% 78.245% ##### ( 3, 4 ] 158433 8.871% 87.116% ## ( 4, 6 ] 174418 9.766% 96.882% ## ( 6, 10 ] 43368 2.428% 99.310% ( 10, 15 ] 8452 0.473% 99.783% ( 15, 22 ] 1104 0.062% 99.845% ( 22, 34 ] 88 0.005% 99.850% ( 34, 51 ] 41 0.002% 99.852% ( 51, 76 ] 109 0.006% 99.859% ( 76, 110 ] 721 0.040% 99.899% ( 110, 170 ] 1135 0.064% 99.962% ( 170, 250 ] 713 0.040% 100.002% ( 250, 380 ] 578 0.032% 100.035% ( 380, 580 ] 422 0.024% 100.058% ( 580, 870 ] 225 0.013% 100.071% ( 870, 1300 ] 104 0.006% 100.077% ( 1300, 1900 ] 101 0.006% 100.082% ( 1900, 2900 ] 201 0.011% 100.094% ( 2900, 4400 ] 336 0.019% 100.113% ( 4400, 6600 ] 123 0.007% 100.119% ( 6600, 9900 ] 91 0.005% 100.125% ( 9900, 14000 ] 4 0.000% 100.125% ( 14000, 22000 ] 1 0.000% 100.125% ** Level 2 read latency histogram (micros): Count: 77114 Average: 2.9918 StdDev: 23.65 Min: 0 Median: 1.6524 Max: 4157 Percentiles: P50: 1.65 P75: 2.13 P99: 8.97 P99.9: 156.19 P99.99: 621.85 ------------------------------------------------------ [ 0, 1 ] 5443 7.058% 7.058% # ( 1, 2 ] 50754 65.817% 72.875% ############# ( 2, 3 ] 12578 16.311% 89.186% ### ( 3, 4 ] 3879 5.030% 94.216% # ( 4, 6 ] 2798 3.628% 97.845% # ( 6, 10 ] 1200 1.556% 99.401% ( 10, 15 ] 229 0.297% 99.698% ( 15, 22 ] 17 0.022% 99.720% ( 22, 34 ] 3 0.004% 99.724% ( 34, 51 ] 37 0.048% 99.772% ( 51, 76 ] 23 0.030% 99.802% ( 76, 110 ] 22 0.029% 99.830% ( 110, 170 ] 70 0.091% 99.921% ( 170, 250 ] 29 0.038% 99.959% ( 250, 380 ] 19 0.025% 99.983% ( 380, 580 ] 5 0.006% 99.990% ( 580, 870 ] 2 0.003% 99.992% ( 870, 1300 ] 2 0.003% 99.995% ( 1300, 1900 ] 1 0.001% 99.996% ( 1900, 2900 ] 2 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1595173 Average: 6.0357 StdDev: 97.39 Min: 0 Median: 2.1819 Max: 14978 Percentiles: P50: 2.18 P75: 3.09 P99: 9.54 P99.9: 210.86 P99.99: 342.47 ------------------------------------------------------ [ 0, 1 ] 16154 1.013% 1.013% ( 1, 2 ] 696318 43.652% 44.664% ######### ( 2, 3 ] 467994 29.338% 74.002% ###### ( 3, 4 ] 176459 11.062% 85.064% ## ( 4, 6 ] 190328 11.931% 96.996% ## ( 6, 10 ] 36074 2.261% 99.257% ( 10, 15 ] 6690 0.419% 99.677% ( 15, 22 ] 785 0.049% 99.726% ( 22, 34 ] 87 0.005% 99.731% ( 34, 51 ] 65 0.004% 99.736% ( 51, 76 ] 86 0.005% 99.741% ( 76, 110 ] 178 0.011% 99.752% ( 110, 170 ] 1706 0.107% 99.859% ( 170, 250 ] 1280 0.080% 99.939% ( 250, 380 ] 1138 0.071% 100.011% ( 380, 580 ] 757 0.047% 100.058% ( 580, 870 ] 414 0.026% 100.084% ( 870, 1300 ] 180 0.011% 100.095% ( 1300, 1900 ] 110 0.007% 100.102% ( 1900, 2900 ] 173 0.011% 100.113% ( 2900, 4400 ] 336 0.021% 100.134% ( 4400, 6600 ] 92 0.006% 100.140% ( 6600, 9900 ] 87 0.005% 100.145% ( 9900, 14000 ] 5 0.000% 100.146% ( 14000, 22000 ] 1 0.000% 100.146% ** Level 4 read latency histogram (micros): Count: 255184 Average: 10.7202 StdDev: 143.16 Min: 0 Median: 2.3234 Max: 9058 Percentiles: P50: 2.32 P75: 3.40 P99: 14.68 P99.9: 975.20 P99.99: 3163.60 ------------------------------------------------------ [ 0, 1 ] 1736 0.680% 0.680% ( 1, 2 ] 101045 39.597% 40.277% ######## ( 2, 3 ] 76723 30.066% 70.343% ###### ( 3, 4 ] 29613 11.605% 81.948% ## ( 4, 6 ] 34140 13.379% 95.326% ### ( 6, 10 ] 7930 3.108% 98.434% # ( 10, 15 ] 1543 0.605% 99.038% ( 15, 22 ] 163 0.064% 99.102% ( 22, 34 ] 20 0.008% 99.110% ( 34, 51 ] 20 0.008% 99.118% ( 51, 76 ] 31 0.012% 99.130% ( 76, 110 ] 34 0.013% 99.143% ( 110, 170 ] 312 0.122% 99.266% ( 170, 250 ] 560 0.219% 99.485% ( 250, 380 ] 469 0.184% 99.669% ( 380, 580 ] 377 0.148% 99.817% ( 580, 870 ] 193 0.076% 99.892% ( 870, 1300 ] 81 0.032% 99.924% ( 1300, 1900 ] 52 0.020% 99.944% ( 1900, 2900 ] 91 0.036% 99.980% ( 2900, 4400 ] 145 0.057% 100.037% ( 4400, 6600 ] 47 0.018% 100.055% ( 6600, 9900 ] 19 0.007% 100.063% ** Level 5 read latency histogram (micros): Count: 340 Average: 625.5824 StdDev: 694.69 Min: 86 Median: 317.9545 Max: 4913 Percentiles: P50: 317.95 P75: 964.60 P99: 3200.00 P99.9: 4913.00 P99.99: 4913.00 ------------------------------------------------------ ( 76, 110 ] 26 7.647% 7.647% ## ( 110, 170 ] 68 20.000% 27.647% #### ( 170, 250 ] 53 15.588% 43.235% ### ( 250, 380 ] 44 12.941% 56.176% ### ( 380, 580 ] 32 9.412% 65.588% ## ( 580, 870 ] 21 6.176% 71.765% # ( 870, 1300 ] 50 14.706% 86.471% ### ( 1300, 1900 ] 27 7.941% 94.412% ## ( 1900, 2900 ] 15 4.412% 98.824% # ( 2900, 4400 ] 3 0.882% 99.706% ( 4400, 6600 ] 1 0.294% 100.000% ** DB Stats ** Uptime(secs): 58.2 total, 3.2 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 186.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.002 H:M:S, 43.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.278 H:M:S, 8.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.163 micros/op 193680 ops/sec 60.001 seconds 11620999 operations; 187.7 MB/s Microseconds per write: Count: 11620999 Average: 5.1631 StdDev: 227.17 Min: 0 Median: 1.8038 Max: 348528 Percentiles: P50: 1.80 P75: 3.10 P99: 9.21 P99.9: 1056.30 P99.99: 2614.69 ------------------------------------------------------ [ 0, 1 ] 1460587 12.569% 12.569% ### ( 1, 2 ] 5411715 46.568% 59.137% ######### ( 2, 3 ] 1687046 14.517% 73.654% ### ( 3, 4 ] 1595391 13.729% 87.383% ### ( 4, 6 ] 1211669 10.427% 97.809% ## ( 6, 10 ] 172262 1.482% 99.292% ( 10, 15 ] 38465 0.331% 99.623% ( 15, 22 ] 10663 0.092% 99.714% ( 22, 34 ] 2789 0.024% 99.738% ( 34, 51 ] 478 0.004% 99.742% ( 51, 76 ] 95 0.001% 99.743% ( 76, 110 ] 20 0.000% 99.743% ( 110, 170 ] 10695 0.092% 99.835% ( 170, 250 ] 860 0.007% 99.843% ( 250, 380 ] 236 0.002% 99.845% ( 380, 580 ] 40 0.000% 99.845% ( 580, 870 ] 36 0.000% 99.846% ( 870, 1300 ] 14613 0.126% 99.971% ( 1300, 1900 ] 55 0.000% 99.972% ( 1900, 2900 ] 2969 0.026% 99.997% ( 2900, 4400 ] 228 0.002% 99.999% ( 4400, 6600 ] 49 0.000% 100.000% ( 6600, 9900 ] 21 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 9 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 246817 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11620999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11992870968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 679 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 25227509 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 37715609941 rocksdb.compact.write.bytes COUNT : 37466006493 rocksdb.flush.write.bytes COUNT : 11890673167 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 75 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 327 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11794472960 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4310016 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 37830159026 rocksdb.non.last.level.read.count COUNT : 9138302 rocksdb.block.checksum.compute.count COUNT : 9137019 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.457370 P95 : 4.913182 P99 : 8.107342 P100 : 348525.000000 COUNT : 11620999 SUM : 54543039 rocksdb.compaction.times.micros P50 : 979459.459459 P95 : 3145000.000000 P99 : 12908000.000000 P100 : 17521170.000000 COUNT : 126 SUM : 168787224 rocksdb.compaction.times.cpu_micros P50 : 896956.521739 P95 : 3145000.000000 P99 : 12908000.000000 P100 : 16488616.000000 COUNT : 126 SUM : 146930277 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 574.117647 P95 : 1283.875000 P99 : 4055.000000 P100 : 4511.000000 COUNT : 169 SUM : 120336 rocksdb.compaction.outfile.sync.micros P50 : 879.450549 P95 : 6792.500000 P99 : 13251.750000 P100 : 21537.000000 COUNT : 446 SUM : 835125 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 118.117647 P95 : 648.357143 P99 : 3848.750000 P100 : 6511.000000 COUNT : 347 SUM : 95375 rocksdb.table.open.io.micros P50 : 926.437500 P95 : 5381.851852 P99 : 15964.444444 P100 : 20142.000000 COUNT : 679 SUM : 1182725 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.866994 P95 : 8.517218 P99 : 12.382465 P100 : 20307.000000 COUNT : 9135177 SUM : 57061748 rocksdb.read.block.get.micros P50 : 370.312500 P95 : 2569.047619 P99 : 5695.250000 P100 : 7633.000000 COUNT : 1358 SUM : 928139 rocksdb.write.raw.block.micros P50 : 0.518685 P95 : 0.985501 P99 : 3.276164 P100 : 36034.000000 COUNT : 11956533 SUM : 26609495 rocksdb.numfiles.in.singlecompaction P50 : 3.084270 P95 : 5.112500 P99 : 15.315000 P100 : 20.000000 COUNT : 191 SUM : 667 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.557452 P95 : 1137.321133 P99 : 2373.024607 P100 : 348279.000000 COUNT : 173693 SUM : 25243128 rocksdb.sst.read.micros P50 : 1.742721 P95 : 5.125873 P99 : 8.837922 P100 : 15564.000000 COUNT : 9138735 SUM : 36746926 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11620999 SUM : 11992870968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 201926.605505 P95 : 393062.500000 P99 : 553612.500000 P100 : 587234.000000 COUNT : 169 SUM : 33902965 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 442 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0