[2024-11-30 01:02:48.056306] Starting SPDK v25.01-pre git sha1 35cd3e84d / DPDK 24.11.0-rc4 initialization... [2024-11-30 01:02:48.056464] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid957193 ] Set seed to 1732924968052781 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-30 01:02:48.222039] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.11.0-rc4 is used. There is no support for it in SPDK. Enabled only for validation. [2024-11-30 01:02:48.270869] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-30 01:02:48.292337] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-30 01:02:48.292384] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 957193' to capture a snapshot of events at runtime. [2024-11-30 01:02:48.292397] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-30 01:02:48.292406] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-30 01:02:48.292415] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid957193 for offline analysis/debug. [2024-11-30 01:02:48.292945] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Nov 30 01:02:52 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/30-01:02:55 ... thread 0: (1000000,1000000) ops and (337462.4,337462.4) ops/second in (2.963293,2.963293) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.95 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 350.7 2.51 2.28 12 0.210 0 0 0.0 0.0 L1 3/3 251.75 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 261.0 260.8 0.97 0.93 1 0.965 255K 192 0.0 0.0 L2 1/0 48.58 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 235.8 235.7 0.47 0.44 1 0.471 112K 29 0.0 0.0 L3 17/0 818.42 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 205.9 206.0 0.30 0.25 1 0.303 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 100.0 307.3 4.25 3.91 15 0.284 432K 221 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 100.0 307.3 4.25 3.91 15 0.284 432K 221 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 244.6 244.5 1.74 1.63 3 0.580 432K 221 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 350.7 2.51 2.28 12 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 416.26 MB/s write, 0.42 GB read, 135.51 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 440.98 MB/s write, 0.42 GB read, 143.56 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 106181 Average: 1.7570 StdDev: 16.87 Min: 1 Median: 1.1048 Max: 3965 Percentiles: P50: 1.10 P75: 1.58 P99: 3.38 P99.9: 9.68 P99.99: 279.94 ------------------------------------------------------ [ 0, 1 ] 47268 44.516% 44.516% ######### ( 1, 2 ] 55542 52.309% 96.825% ########## ( 2, 3 ] 2012 1.895% 98.720% ( 3, 4 ] 773 0.728% 99.448% ( 4, 6 ] 319 0.300% 99.749% ( 6, 10 ] 175 0.165% 99.913% ( 10, 15 ] 59 0.056% 99.969% ( 15, 22 ] 7 0.007% 99.976% ( 22, 34 ] 1 0.001% 99.976% ( 51, 76 ] 1 0.001% 99.977% ( 110, 170 ] 5 0.005% 99.982% ( 170, 250 ] 7 0.007% 99.989% ( 250, 380 ] 6 0.006% 99.994% ( 580, 870 ] 2 0.002% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 33126 Average: 2.0868 StdDev: 15.62 Min: 0 Median: 1.1484 Max: 1312 Percentiles: P50: 1.15 P75: 1.62 P99: 5.15 P99.9: 73.95 P99.99: 968.51 ------------------------------------------------------ [ 0, 1 ] 13967 42.163% 42.163% ######## ( 1, 2 ] 17500 52.829% 94.992% ########### ( 2, 3 ] 925 2.792% 97.784% # ( 3, 4 ] 284 0.857% 98.642% ( 4, 6 ] 208 0.628% 99.269% ( 6, 10 ] 129 0.389% 99.659% ( 10, 15 ] 31 0.094% 99.752% ( 15, 22 ] 8 0.024% 99.777% ( 22, 34 ] 1 0.003% 99.780% ( 34, 51 ] 17 0.051% 99.831% ( 51, 76 ] 26 0.078% 99.909% ( 76, 110 ] 5 0.015% 99.925% ( 110, 170 ] 5 0.015% 99.940% ( 170, 250 ] 8 0.024% 99.964% ( 250, 380 ] 7 0.021% 99.985% ( 380, 580 ] 1 0.003% 99.988% ( 580, 870 ] 1 0.003% 99.991% ( 870, 1300 ] 3 0.009% 100.000% ( 1300, 1900 ] 1 0.003% 100.003% ** Level 2 read latency histogram (micros): Count: 15874 Average: 1.7223 StdDev: 3.76 Min: 0 Median: 1.1111 Max: 303 Percentiles: P50: 1.11 P75: 1.61 P99: 4.82 P99.9: 9.67 P99.99: 276.82 ------------------------------------------------------ [ 0, 1 ] 7052 44.425% 44.425% ######### ( 1, 2 ] 7969 50.202% 94.626% ########## ( 2, 3 ] 422 2.658% 97.285% # ( 3, 4 ] 210 1.323% 98.608% ( 4, 6 ] 151 0.951% 99.559% ( 6, 10 ] 59 0.372% 99.931% ( 10, 15 ] 6 0.038% 99.969% ( 15, 22 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 871.8353 StdDev: 1288.85 Min: 0 Median: 240.0000 Max: 5724 Percentiles: P50: 240.00 P75: 1282.08 P99: 5665.00 P99.9: 5724.00 P99.99: 5724.00 ------------------------------------------------------ [ 0, 1 ] 25 29.412% 29.412% ###### ( 1, 2 ] 11 12.941% 42.353% ### ( 2, 3 ] 1 1.176% 43.529% ( 3, 4 ] 1 1.176% 44.706% ( 110, 170 ] 1 1.176% 45.882% ( 170, 250 ] 4 4.706% 50.588% # ( 250, 380 ] 4 4.706% 55.294% # ( 380, 580 ] 5 5.882% 61.176% # ( 580, 870 ] 6 7.059% 68.235% # ( 870, 1300 ] 6 7.059% 75.294% # ( 1300, 1900 ] 5 5.882% 81.176% # ( 1900, 2900 ] 7 8.235% 89.412% ## ( 2900, 4400 ] 7 8.235% 97.647% ## ( 4400, 6600 ] 2 2.353% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1663.5333 StdDev: 1348.31 Min: 180 Median: 1228.3333 Max: 5799 Percentiles: P50: 1228.33 P75: 2400.00 P99: 5799.00 P99.9: 5799.00 P99.99: 5799.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 3 10.000% 13.333% ## ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 4 13.333% 33.333% ### ( 870, 1300 ] 6 20.000% 53.333% #### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 6 20.000% 96.667% #### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 313.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.380 H:M:S, 12.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.380 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/30-01:02:58 ... thread 0: (1000000,2000000) ops and (352078.2,344615.4) ops/second in (2.840278,5.803571) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.17 GB 62.9 0.6 0.0 0.6 2.3 1.8 0.0 1.3 78.1 329.5 7.26 6.69 28 0.259 575K 655 0.0 0.0 L1 2/0 50.38 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.0 245.6 3.33 3.23 2 1.664 831K 1420 0.0 0.0 L2 5/4 563.65 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.5 1.8 235.8 235.7 0.47 0.44 1 0.471 112K 29 0.0 0.0 L3 17/10 818.42 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 205.9 206.0 0.30 0.25 1 0.303 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1195/22 97.92 GB 0.0 1.5 0.6 0.9 3.3 2.4 0.7 1.9 137.2 297.7 11.37 10.62 32 0.355 1583K 2104 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.3 2.4 0.6 1.9 137.2 297.7 11.37 10.62 32 0.355 1583K 2104 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 250.5 250.2 6.22 6.01 6 1.037 1583K 2104 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 355.3 5.14 4.61 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.30 GB write, 565.81 MB/s write, 1.52 GB read, 260.72 MB/s read, 11.4 seconds Interval compaction: 3.30 GB write, 582.97 MB/s write, 1.52 GB read, 268.62 MB/s read, 11.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 390398 Average: 2.1075 StdDev: 12.07 Min: 1 Median: 1.4309 Max: 3965 Percentiles: P50: 1.43 P75: 1.83 P99: 5.53 P99.9: 9.94 P99.99: 14.67 ------------------------------------------------------ [ 0, 1 ] 90378 23.150% 23.150% ##### ( 1, 2 ] 243255 62.309% 85.460% ############ ( 2, 3 ] 33839 8.668% 94.128% ## ( 3, 4 ] 13012 3.333% 97.461% # ( 4, 6 ] 7867 2.015% 99.476% ( 6, 10 ] 1682 0.431% 99.907% ( 10, 15 ] 350 0.090% 99.996% ( 15, 22 ] 36 0.009% 100.005% ( 22, 34 ] 12 0.003% 100.008% ( 34, 51 ] 4 0.001% 100.009% ( 51, 76 ] 8 0.002% 100.012% ( 110, 170 ] 9 0.002% 100.014% ( 170, 250 ] 18 0.005% 100.018% ( 250, 380 ] 11 0.003% 100.021% ( 380, 580 ] 4 0.001% 100.022% ( 580, 870 ] 6 0.002% 100.024% ( 870, 1300 ] 2 0.001% 100.024% ( 1300, 1900 ] 2 0.001% 100.025% ( 1900, 2900 ] 1 0.000% 100.025% ( 2900, 4400 ] 3 0.001% 100.026% ** Level 1 read latency histogram (micros): Count: 126419 Average: 2.3436 StdDev: 11.72 Min: 0 Median: 1.5216 Max: 2152 Percentiles: P50: 1.52 P75: 1.93 P99: 5.86 P99.9: 14.56 P99.99: 360.60 ------------------------------------------------------ [ 0, 1 ] 22615 17.889% 17.889% #### ( 1, 2 ] 77820 61.557% 79.446% ############ ( 2, 3 ] 15918 12.591% 92.038% ### ( 3, 4 ] 5159 4.081% 96.118% # ( 4, 6 ] 3915 3.097% 99.215% # ( 6, 10 ] 716 0.566% 99.782% ( 10, 15 ] 164 0.130% 99.911% ( 15, 22 ] 25 0.020% 99.931% ( 22, 34 ] 3 0.002% 99.934% ( 34, 51 ] 17 0.013% 99.947% ( 51, 76 ] 26 0.021% 99.968% ( 76, 110 ] 5 0.004% 99.972% ( 110, 170 ] 6 0.005% 99.976% ( 170, 250 ] 8 0.006% 99.983% ( 250, 380 ] 11 0.009% 99.991% ( 380, 580 ] 2 0.002% 99.993% ( 580, 870 ] 1 0.001% 99.994% ( 870, 1300 ] 5 0.004% 99.998% ( 1300, 1900 ] 2 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15923 Average: 1.7252 StdDev: 3.75 Min: 0 Median: 1.1136 Max: 303 Percentiles: P50: 1.11 P75: 1.61 P99: 4.86 P99.9: 9.67 P99.99: 276.50 ------------------------------------------------------ [ 0, 1 ] 7053 44.294% 44.294% ######### ( 1, 2 ] 7996 50.217% 94.511% ########## ( 2, 3 ] 436 2.738% 97.249% # ( 3, 4 ] 211 1.325% 98.574% ( 4, 6 ] 157 0.986% 99.560% ( 6, 10 ] 59 0.371% 99.931% ( 10, 15 ] 6 0.038% 99.969% ( 15, 22 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 75878 Average: 4.2514 StdDev: 55.37 Min: 0 Median: 1.6796 Max: 5724 Percentiles: P50: 1.68 P75: 2.30 P99: 9.42 P99.9: 352.71 P99.99: 2530.31 ------------------------------------------------------ [ 0, 1 ] 6050 7.973% 7.973% ## ( 1, 2 ] 46924 61.841% 69.815% ############ ( 2, 3 ] 13254 17.468% 87.282% ### ( 3, 4 ] 4428 5.836% 93.118% # ( 4, 6 ] 3284 4.328% 97.446% # ( 6, 10 ] 1381 1.820% 99.266% ( 10, 15 ] 179 0.236% 99.502% ( 15, 22 ] 44 0.058% 99.560% ( 22, 34 ] 6 0.008% 99.568% ( 34, 51 ] 4 0.005% 99.573% ( 51, 76 ] 5 0.007% 99.580% ( 76, 110 ] 70 0.092% 99.672% ( 110, 170 ] 101 0.133% 99.805% ( 170, 250 ] 50 0.066% 99.871% ( 250, 380 ] 28 0.037% 99.908% ( 380, 580 ] 31 0.041% 99.949% ( 580, 870 ] 13 0.017% 99.966% ( 870, 1300 ] 9 0.012% 99.978% ( 1300, 1900 ] 5 0.007% 99.984% ( 1900, 2900 ] 7 0.009% 99.993% ( 2900, 4400 ] 8 0.011% 100.004% ( 4400, 6600 ] 2 0.003% 100.007% ** Level 4 read latency histogram (micros): Count: 30 Average: 1663.5333 StdDev: 1348.31 Min: 180 Median: 1228.3333 Max: 5799 Percentiles: P50: 1228.33 P75: 2400.00 P99: 5799.00 P99.9: 5799.00 P99.99: 5799.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 3 10.000% 13.333% ## ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 4 13.333% 33.333% ### ( 870, 1300 ] 6 20.000% 53.333% #### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 6 20.000% 96.667% #### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 329.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.573 H:M:S, 9.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 346.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.193 H:M:S, 6.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/30-01:03:01 ... thread 0: (1000000,3000000) ops and (329314.3,339359.5) ops/second in (3.036613,8.840184) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.09 GB 44.1 1.4 0.0 1.4 4.1 2.7 0.0 1.5 105.8 317.2 13.10 12.15 44 0.298 1407K 1545 0.0 0.0 L1 2/2 50.38 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.0 245.6 3.33 3.23 2 1.664 831K 1420 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.5 1.8 235.8 235.7 0.47 0.44 1 0.471 112K 29 0.0 0.0 L3 25/0 991.07 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.3 210.9 210.8 6.89 6.07 4 1.723 1462K 737 0.0 0.0 L4 152/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/13 98.84 GB 0.0 3.7 1.2 2.5 6.4 3.9 1.4 2.4 158.4 274.7 23.80 21.89 51 0.467 3814K 3731 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.2 2.5 6.4 3.9 1.3 2.4 158.4 274.7 23.80 21.89 51 0.467 3814K 3731 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.2 2.5 3.7 1.2 0.0 0.0 236.2 236.0 15.96 14.90 12 1.330 3814K 3731 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 353.6 7.84 6.99 39 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.38 GB write, 724.98 MB/s write, 3.68 GB read, 418.03 MB/s read, 23.8 seconds Interval compaction: 6.38 GB write, 739.41 MB/s write, 3.68 GB read, 426.35 MB/s read, 23.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 699027 Average: 2.2421 StdDev: 12.36 Min: 1 Median: 1.5018 Max: 3965 Percentiles: P50: 1.50 P75: 1.89 P99: 5.71 P99.9: 10.56 P99.99: 15.94 ------------------------------------------------------ [ 0, 1 ] 125689 17.981% 17.981% #### ( 1, 2 ] 446008 63.804% 81.785% ############# ( 2, 3 ] 75064 10.738% 92.523% ## ( 3, 4 ] 29420 4.209% 96.732% # ( 4, 6 ] 18600 2.661% 99.393% # ( 6, 10 ] 3470 0.496% 99.889% ( 10, 15 ] 697 0.100% 99.989% ( 15, 22 ] 75 0.011% 99.999% ( 22, 34 ] 15 0.002% 100.002% ( 34, 51 ] 5 0.001% 100.002% ( 51, 76 ] 9 0.001% 100.004% ( 76, 110 ] 6 0.001% 100.004% ( 110, 170 ] 46 0.007% 100.011% ( 170, 250 ] 39 0.006% 100.017% ( 250, 380 ] 22 0.003% 100.020% ( 380, 580 ] 11 0.002% 100.021% ( 580, 870 ] 14 0.002% 100.023% ( 870, 1300 ] 8 0.001% 100.024% ( 1300, 1900 ] 3 0.000% 100.025% ( 1900, 2900 ] 3 0.000% 100.025% ( 2900, 4400 ] 5 0.001% 100.026% ** Level 1 read latency histogram (micros): Count: 206947 Average: 2.4322 StdDev: 9.19 Min: 0 Median: 1.6106 Max: 2152 Percentiles: P50: 1.61 P75: 2.07 P99: 5.95 P99.9: 13.81 P99.99: 265.43 ------------------------------------------------------ [ 0, 1 ] 25725 12.431% 12.431% ## ( 1, 2 ] 127337 61.531% 73.962% ############ ( 2, 3 ] 32597 15.751% 89.713% ### ( 3, 4 ] 10779 5.209% 94.922% # ( 4, 6 ] 8644 4.177% 99.099% # ( 6, 10 ] 1432 0.692% 99.791% ( 10, 15 ] 297 0.144% 99.934% ( 15, 22 ] 47 0.023% 99.957% ( 22, 34 ] 5 0.002% 99.959% ( 34, 51 ] 17 0.008% 99.968% ( 51, 76 ] 26 0.013% 99.980% ( 76, 110 ] 5 0.002% 99.983% ( 110, 170 ] 6 0.003% 99.986% ( 170, 250 ] 8 0.004% 99.989% ( 250, 380 ] 11 0.005% 99.995% ( 380, 580 ] 2 0.001% 99.996% ( 580, 870 ] 1 0.000% 99.996% ( 870, 1300 ] 5 0.002% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28211 Average: 2.2081 StdDev: 9.04 Min: 0 Median: 1.3816 Max: 1142 Percentiles: P50: 1.38 P75: 1.83 P99: 6.81 P99.9: 14.39 P99.99: 340.54 ------------------------------------------------------ [ 0, 1 ] 8097 28.702% 28.702% ###### ( 1, 2 ] 15745 55.812% 84.513% ########### ( 2, 3 ] 2362 8.373% 92.886% ## ( 3, 4 ] 945 3.350% 96.236% # ( 4, 6 ] 719 2.549% 98.784% # ( 6, 10 ] 299 1.060% 99.844% ( 10, 15 ] 18 0.064% 99.908% ( 15, 22 ] 4 0.014% 99.922% ( 76, 110 ] 3 0.011% 99.933% ( 110, 170 ] 3 0.011% 99.943% ( 170, 250 ] 9 0.032% 99.975% ( 250, 380 ] 6 0.021% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 210576 Average: 3.7727 StdDev: 38.07 Min: 0 Median: 1.6516 Max: 5724 Percentiles: P50: 1.65 P75: 2.20 P99: 9.23 P99.9: 303.28 P99.99: 927.51 ------------------------------------------------------ [ 0, 1 ] 18902 8.976% 8.976% ## ( 1, 2 ] 132583 62.962% 71.938% ############# ( 2, 3 ] 32252 15.316% 87.254% ### ( 3, 4 ] 13161 6.250% 93.504% # ( 4, 6 ] 8458 4.017% 97.521% # ( 6, 10 ] 3853 1.830% 99.351% ( 10, 15 ] 379 0.180% 99.531% ( 15, 22 ] 82 0.039% 99.570% ( 22, 34 ] 12 0.006% 99.575% ( 34, 51 ] 13 0.006% 99.582% ( 51, 76 ] 37 0.018% 99.599% ( 76, 110 ] 163 0.077% 99.677% ( 110, 170 ] 292 0.139% 99.815% ( 170, 250 ] 144 0.068% 99.884% ( 250, 380 ] 84 0.040% 99.924% ( 380, 580 ] 86 0.041% 99.964% ( 580, 870 ] 51 0.024% 99.989% ( 870, 1300 ] 22 0.010% 99.999% ( 1300, 1900 ] 9 0.004% 100.003% ( 1900, 2900 ] 8 0.004% 100.007% ( 2900, 4400 ] 8 0.004% 100.011% ( 4400, 6600 ] 2 0.001% 100.012% ** Level 4 read latency histogram (micros): Count: 30 Average: 1663.5333 StdDev: 1348.31 Min: 180 Median: 1228.3333 Max: 5799 Percentiles: P50: 1228.33 P75: 2400.00 P99: 5799.00 P99.9: 5799.00 P99.99: 5799.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 3 10.000% 13.333% ## ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 4 13.333% 33.333% ### ( 870, 1300 ] 6 20.000% 53.333% #### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 6 20.000% 96.667% #### ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 555.5500 StdDev: 659.41 Min: 85 Median: 250.0000 Max: 2544 Percentiles: P50: 250.00 P75: 580.00 P99: 2544.00 P99.9: 2544.00 P99.99: 2544.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 4 20.000% 75.000% #### ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 2 10.000% 95.000% ## ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 327.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.952 H:M:S, 10.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.379 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/30-01:03:04 ... thread 0: (1000000,4000000) ops and (309376.8,331331.9) ops/second in (3.232304,12.072488) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.13 GB 157.3 2.5 0.0 2.5 6.3 3.7 0.0 1.7 125.3 311.7 20.61 19.23 63 0.327 2622K 2848 0.0 0.0 L1 2/2 50.38 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.0 245.6 3.33 3.23 2 1.664 831K 1420 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.5 1.8 235.8 235.7 0.47 0.44 1 0.471 112K 29 0.0 0.0 L3 25/0 991.07 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.3 210.9 210.8 6.89 6.07 4 1.723 1462K 737 0.0 0.0 L4 152/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/13 99.88 GB 0.0 4.8 1.2 3.7 8.6 4.9 1.4 2.3 158.7 281.3 31.30 28.97 70 0.447 5029K 5034 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 1.2 3.7 8.6 4.9 1.3 2.3 158.7 281.3 31.30 28.97 70 0.447 5029K 5034 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 1.2 3.7 4.8 1.2 0.0 0.0 242.8 242.5 20.46 19.31 16 1.278 5029K 5034 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 354.4 10.84 9.66 54 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.60 GB write, 718.70 MB/s write, 4.85 GB read, 405.43 MB/s read, 31.3 seconds Interval compaction: 8.60 GB write, 729.18 MB/s write, 4.85 GB read, 411.34 MB/s read, 31.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 16, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1167518 Average: 2.2725 StdDev: 11.93 Min: 0 Median: 1.5112 Max: 3965 Percentiles: P50: 1.51 P75: 1.89 P99: 5.76 P99.9: 10.00 P99.99: 14.96 ------------------------------------------------------ [ 0, 1 ] 192916 16.524% 16.524% ### ( 1, 2 ] 764517 65.482% 82.006% ############# ( 2, 3 ] 124994 10.706% 92.712% ## ( 3, 4 ] 48012 4.112% 96.824% # ( 4, 6 ] 28950 2.480% 99.304% ( 6, 10 ] 6965 0.597% 99.900% ( 10, 15 ] 1057 0.091% 99.991% ( 15, 22 ] 111 0.010% 100.000% ( 22, 34 ] 22 0.002% 100.002% ( 34, 51 ] 9 0.001% 100.003% ( 51, 76 ] 14 0.001% 100.004% ( 76, 110 ] 71 0.006% 100.010% ( 110, 170 ] 130 0.011% 100.021% ( 170, 250 ] 78 0.007% 100.028% ( 250, 380 ] 53 0.005% 100.033% ( 380, 580 ] 28 0.002% 100.035% ( 580, 870 ] 25 0.002% 100.037% ( 870, 1300 ] 17 0.001% 100.039% ( 1300, 1900 ] 5 0.000% 100.039% ( 1900, 2900 ] 4 0.000% 100.039% ( 2900, 4400 ] 7 0.001% 100.040% ** Level 1 read latency histogram (micros): Count: 208080 Average: 2.4856 StdDev: 9.87 Min: 0 Median: 1.6106 Max: 2152 Percentiles: P50: 1.61 P75: 2.07 P99: 5.97 P99.9: 14.85 P99.99: 335.35 ------------------------------------------------------ [ 0, 1 ] 25862 12.429% 12.429% ## ( 1, 2 ] 128038 61.533% 73.962% ############ ( 2, 3 ] 32718 15.724% 89.686% ### ( 3, 4 ] 10852 5.215% 94.901% # ( 4, 6 ] 8667 4.165% 99.066% # ( 6, 10 ] 1445 0.694% 99.761% ( 10, 15 ] 299 0.144% 99.904% ( 15, 22 ] 47 0.023% 99.927% ( 22, 34 ] 5 0.002% 99.929% ( 34, 51 ] 17 0.008% 99.938% ( 51, 76 ] 26 0.012% 99.950% ( 76, 110 ] 13 0.006% 99.956% ( 110, 170 ] 43 0.021% 99.977% ( 170, 250 ] 18 0.009% 99.986% ( 250, 380 ] 14 0.007% 99.992% ( 380, 580 ] 5 0.002% 99.995% ( 580, 870 ] 3 0.001% 99.996% ( 870, 1300 ] 5 0.002% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28211 Average: 2.2081 StdDev: 9.04 Min: 0 Median: 1.3816 Max: 1142 Percentiles: P50: 1.38 P75: 1.83 P99: 6.81 P99.9: 14.39 P99.99: 340.54 ------------------------------------------------------ [ 0, 1 ] 8097 28.702% 28.702% ###### ( 1, 2 ] 15745 55.812% 84.513% ########### ( 2, 3 ] 2362 8.373% 92.886% ## ( 3, 4 ] 945 3.350% 96.236% # ( 4, 6 ] 719 2.549% 98.784% # ( 6, 10 ] 299 1.060% 99.844% ( 10, 15 ] 18 0.064% 99.908% ( 15, 22 ] 4 0.014% 99.922% ( 76, 110 ] 3 0.011% 99.933% ( 110, 170 ] 3 0.011% 99.943% ( 170, 250 ] 9 0.032% 99.975% ( 250, 380 ] 6 0.021% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 210576 Average: 3.7727 StdDev: 38.07 Min: 0 Median: 1.6516 Max: 5724 Percentiles: P50: 1.65 P75: 2.20 P99: 9.23 P99.9: 303.28 P99.99: 927.51 ------------------------------------------------------ [ 0, 1 ] 18902 8.976% 8.976% ## ( 1, 2 ] 132583 62.962% 71.938% ############# ( 2, 3 ] 32252 15.316% 87.254% ### ( 3, 4 ] 13161 6.250% 93.504% # ( 4, 6 ] 8458 4.017% 97.521% # ( 6, 10 ] 3853 1.830% 99.351% ( 10, 15 ] 379 0.180% 99.531% ( 15, 22 ] 82 0.039% 99.570% ( 22, 34 ] 12 0.006% 99.575% ( 34, 51 ] 13 0.006% 99.582% ( 51, 76 ] 37 0.018% 99.599% ( 76, 110 ] 163 0.077% 99.677% ( 110, 170 ] 292 0.139% 99.815% ( 170, 250 ] 144 0.068% 99.884% ( 250, 380 ] 84 0.040% 99.924% ( 380, 580 ] 86 0.041% 99.964% ( 580, 870 ] 51 0.024% 99.989% ( 870, 1300 ] 22 0.010% 99.999% ( 1300, 1900 ] 9 0.004% 100.003% ( 1900, 2900 ] 8 0.004% 100.007% ( 2900, 4400 ] 8 0.004% 100.011% ( 4400, 6600 ] 2 0.001% 100.012% ** Level 4 read latency histogram (micros): Count: 30 Average: 1663.5333 StdDev: 1348.31 Min: 180 Median: 1228.3333 Max: 5799 Percentiles: P50: 1228.33 P75: 2400.00 P99: 5799.00 P99.9: 5799.00 P99.99: 5799.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 3 10.000% 13.333% ## ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 4 13.333% 33.333% ### ( 870, 1300 ] 6 20.000% 53.333% #### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 6 20.000% 96.667% #### ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 555.5500 StdDev: 659.41 Min: 85 Median: 250.0000 Max: 2544 Percentiles: P50: 250.00 P75: 580.00 P99: 2544.00 P99.9: 2544.00 P99.99: 2544.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 4 20.000% 75.000% #### ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 2 10.000% 95.000% ## ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.510 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 304.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.558 H:M:S, 17.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/30-01:03:07 ... thread 0: (1000000,5000000) ops and (339452.2,332924.7) ops/second in (2.945923,15.018411) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.70 GB 220.2 3.3 0.0 3.3 7.9 4.7 0.0 1.7 128.3 312.0 26.03 24.32 80 0.325 3390K 3569 0.0 0.0 L1 14/0 1.39 GB 142.6 2.2 1.8 0.4 2.2 1.8 0.1 1.2 234.8 233.7 9.60 9.27 3 3.200 2288K 10K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.5 1.8 235.8 235.7 0.47 0.44 1 0.471 112K 29 0.0 0.0 L3 25/0 991.07 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.3 210.9 210.8 6.89 6.07 4 1.723 1462K 737 0.0 0.0 L4 152/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/8 100.80 GB 0.0 7.0 2.5 4.5 11.7 7.2 1.4 2.5 166.5 277.5 43.00 40.10 88 0.489 7254K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.0 2.5 4.5 11.7 7.2 1.3 2.5 166.5 277.5 43.00 40.10 88 0.489 7254K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.0 2.5 4.5 7.0 2.5 0.0 0.0 242.1 241.6 29.56 28.15 20 1.478 7254K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.4 13.43 11.96 68 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.0 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.65 GB write, 785.09 MB/s write, 6.99 GB read, 471.01 MB/s read, 43.0 seconds Interval compaction: 11.65 GB write, 794.29 MB/s write, 6.99 GB read, 476.53 MB/s read, 43.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 17, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1419772 Average: 2.2156 StdDev: 11.64 Min: 0 Median: 1.4810 Max: 3965 Percentiles: P50: 1.48 P75: 1.87 P99: 5.70 P99.9: 10.08 P99.99: 14.95 ------------------------------------------------------ [ 0, 1 ] 268403 18.905% 18.905% #### ( 1, 2 ] 917761 64.641% 83.546% ############# ( 2, 3 ] 139158 9.801% 93.348% ## ( 3, 4 ] 53466 3.766% 97.113% # ( 4, 6 ] 31552 2.222% 99.336% ( 6, 10 ] 7993 0.563% 99.899% ( 10, 15 ] 1311 0.092% 99.991% ( 15, 22 ] 143 0.010% 100.001% ( 22, 34 ] 24 0.002% 100.003% ( 34, 51 ] 10 0.001% 100.003% ( 51, 76 ] 14 0.001% 100.004% ( 76, 110 ] 71 0.005% 100.009% ( 110, 170 ] 136 0.010% 100.019% ( 170, 250 ] 83 0.006% 100.025% ( 250, 380 ] 58 0.004% 100.029% ( 380, 580 ] 32 0.002% 100.031% ( 580, 870 ] 32 0.002% 100.033% ( 870, 1300 ] 20 0.001% 100.035% ( 1300, 1900 ] 7 0.000% 100.035% ( 1900, 2900 ] 6 0.000% 100.036% ( 2900, 4400 ] 7 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 219807 Average: 2.6084 StdDev: 14.35 Min: 0 Median: 1.6065 Max: 2152 Percentiles: P50: 1.61 P75: 2.04 P99: 6.05 P99.9: 55.99 P99.99: 622.23 ------------------------------------------------------ [ 0, 1 ] 27369 12.451% 12.451% ## ( 1, 2 ] 136091 61.914% 74.365% ############ ( 2, 3 ] 33953 15.447% 89.812% ### ( 3, 4 ] 11240 5.114% 94.926% # ( 4, 6 ] 8936 4.065% 98.991% # ( 6, 10 ] 1618 0.736% 99.727% ( 10, 15 ] 304 0.138% 99.865% ( 15, 22 ] 48 0.022% 99.887% ( 22, 34 ] 5 0.002% 99.889% ( 34, 51 ] 18 0.008% 99.898% ( 51, 76 ] 26 0.012% 99.909% ( 76, 110 ] 52 0.024% 99.933% ( 110, 170 ] 58 0.026% 99.960% ( 170, 250 ] 26 0.012% 99.971% ( 250, 380 ] 20 0.009% 99.980% ( 380, 580 ] 20 0.009% 99.990% ( 580, 870 ] 7 0.003% 99.993% ( 870, 1300 ] 8 0.004% 99.996% ( 1300, 1900 ] 6 0.003% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28211 Average: 2.2081 StdDev: 9.04 Min: 0 Median: 1.3816 Max: 1142 Percentiles: P50: 1.38 P75: 1.83 P99: 6.81 P99.9: 14.39 P99.99: 340.54 ------------------------------------------------------ [ 0, 1 ] 8097 28.702% 28.702% ###### ( 1, 2 ] 15745 55.812% 84.513% ########### ( 2, 3 ] 2362 8.373% 92.886% ## ( 3, 4 ] 945 3.350% 96.236% # ( 4, 6 ] 719 2.549% 98.784% # ( 6, 10 ] 299 1.060% 99.844% ( 10, 15 ] 18 0.064% 99.908% ( 15, 22 ] 4 0.014% 99.922% ( 76, 110 ] 3 0.011% 99.933% ( 110, 170 ] 3 0.011% 99.943% ( 170, 250 ] 9 0.032% 99.975% ( 250, 380 ] 6 0.021% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 210576 Average: 3.7727 StdDev: 38.07 Min: 0 Median: 1.6516 Max: 5724 Percentiles: P50: 1.65 P75: 2.20 P99: 9.23 P99.9: 303.28 P99.99: 927.51 ------------------------------------------------------ [ 0, 1 ] 18902 8.976% 8.976% ## ( 1, 2 ] 132583 62.962% 71.938% ############# ( 2, 3 ] 32252 15.316% 87.254% ### ( 3, 4 ] 13161 6.250% 93.504% # ( 4, 6 ] 8458 4.017% 97.521% # ( 6, 10 ] 3853 1.830% 99.351% ( 10, 15 ] 379 0.180% 99.531% ( 15, 22 ] 82 0.039% 99.570% ( 22, 34 ] 12 0.006% 99.575% ( 34, 51 ] 13 0.006% 99.582% ( 51, 76 ] 37 0.018% 99.599% ( 76, 110 ] 163 0.077% 99.677% ( 110, 170 ] 292 0.139% 99.815% ( 170, 250 ] 144 0.068% 99.884% ( 250, 380 ] 84 0.040% 99.924% ( 380, 580 ] 86 0.041% 99.964% ( 580, 870 ] 51 0.024% 99.989% ( 870, 1300 ] 22 0.010% 99.999% ( 1300, 1900 ] 9 0.004% 100.003% ( 1900, 2900 ] 8 0.004% 100.007% ( 2900, 4400 ] 8 0.004% 100.011% ( 4400, 6600 ] 2 0.001% 100.012% ** Level 4 read latency histogram (micros): Count: 30 Average: 1663.5333 StdDev: 1348.31 Min: 180 Median: 1228.3333 Max: 5799 Percentiles: P50: 1228.33 P75: 2400.00 P99: 5799.00 P99.9: 5799.00 P99.99: 5799.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 3 10.000% 13.333% ## ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 4 13.333% 33.333% ### ( 870, 1300 ] 6 20.000% 53.333% #### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 6 20.000% 96.667% #### ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 555.5500 StdDev: 659.41 Min: 85 Median: 250.0000 Max: 2544 Percentiles: P50: 250.00 P75: 580.00 P99: 2544.00 P99.9: 2544.00 P99.99: 2544.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 4 20.000% 75.000% #### ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 2 10.000% 95.000% ## ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.2 total, 2.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 323.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.864 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.354 H:M:S, 12.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/30-01:03:10 ... thread 0: (1000000,6000000) ops and (337447.9,333670.1) ops/second in (2.963420,17.981831) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/4 3.69 GB 346.1 4.4 0.0 4.4 10.0 5.7 0.0 1.8 135.3 310.6 33.05 30.96 98 0.337 4541K 4814 0.0 0.0 L1 14/0 1.39 GB 142.6 2.2 1.8 0.4 2.2 1.8 0.1 1.2 234.8 233.7 9.60 9.27 3 3.200 2288K 10K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.5 1.8 235.8 235.7 0.47 0.44 1 0.471 112K 29 0.0 0.0 L3 25/0 991.07 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.3 210.9 210.8 6.89 6.07 4 1.723 1462K 737 0.0 0.0 L4 152/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/4 101.78 GB 0.0 8.1 2.5 5.6 13.7 8.2 1.4 2.4 165.8 281.4 50.01 46.75 106 0.472 8405K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.1 2.5 5.6 13.7 8.2 1.3 2.4 165.8 281.4 50.01 46.75 106 0.472 8405K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.1 2.5 5.6 8.1 2.5 0.0 0.0 245.2 244.7 33.81 32.32 24 1.409 8405K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 357.8 16.20 14.43 82 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.2 total, 18.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.74 GB write, 774.85 MB/s write, 8.10 GB read, 456.59 MB/s read, 50.0 seconds Interval compaction: 13.74 GB write, 782.43 MB/s write, 8.10 GB read, 461.06 MB/s read, 50.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 20, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1673531 Average: 2.1709 StdDev: 12.34 Min: 0 Median: 1.4542 Max: 4832 Percentiles: P50: 1.45 P75: 1.84 P99: 5.61 P99.9: 10.00 P99.99: 14.98 ------------------------------------------------------ [ 0, 1 ] 350383 20.937% 20.937% #### ( 1, 2 ] 1070796 63.984% 84.921% ############# ( 2, 3 ] 150783 9.010% 93.931% ## ( 3, 4 ] 58000 3.466% 97.397% # ( 4, 6 ] 33340 1.992% 99.389% ( 6, 10 ] 8565 0.512% 99.901% ( 10, 15 ] 1503 0.090% 99.990% ( 15, 22 ] 167 0.010% 100.000% ( 22, 34 ] 28 0.002% 100.002% ( 34, 51 ] 11 0.001% 100.003% ( 51, 76 ] 16 0.001% 100.004% ( 76, 110 ] 71 0.004% 100.008% ( 110, 170 ] 141 0.008% 100.016% ( 170, 250 ] 91 0.005% 100.022% ( 250, 380 ] 63 0.004% 100.026% ( 380, 580 ] 36 0.002% 100.028% ( 580, 870 ] 36 0.002% 100.030% ( 870, 1300 ] 24 0.001% 100.031% ( 1300, 1900 ] 9 0.001% 100.032% ( 1900, 2900 ] 8 0.000% 100.032% ( 2900, 4400 ] 8 0.000% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 219807 Average: 2.6084 StdDev: 14.35 Min: 0 Median: 1.6065 Max: 2152 Percentiles: P50: 1.61 P75: 2.04 P99: 6.05 P99.9: 55.99 P99.99: 622.23 ------------------------------------------------------ [ 0, 1 ] 27369 12.451% 12.451% ## ( 1, 2 ] 136091 61.914% 74.365% ############ ( 2, 3 ] 33953 15.447% 89.812% ### ( 3, 4 ] 11240 5.114% 94.926% # ( 4, 6 ] 8936 4.065% 98.991% # ( 6, 10 ] 1618 0.736% 99.727% ( 10, 15 ] 304 0.138% 99.865% ( 15, 22 ] 48 0.022% 99.887% ( 22, 34 ] 5 0.002% 99.889% ( 34, 51 ] 18 0.008% 99.898% ( 51, 76 ] 26 0.012% 99.909% ( 76, 110 ] 52 0.024% 99.933% ( 110, 170 ] 58 0.026% 99.960% ( 170, 250 ] 26 0.012% 99.971% ( 250, 380 ] 20 0.009% 99.980% ( 380, 580 ] 20 0.009% 99.990% ( 580, 870 ] 7 0.003% 99.993% ( 870, 1300 ] 8 0.004% 99.996% ( 1300, 1900 ] 6 0.003% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28211 Average: 2.2081 StdDev: 9.04 Min: 0 Median: 1.3816 Max: 1142 Percentiles: P50: 1.38 P75: 1.83 P99: 6.81 P99.9: 14.39 P99.99: 340.54 ------------------------------------------------------ [ 0, 1 ] 8097 28.702% 28.702% ###### ( 1, 2 ] 15745 55.812% 84.513% ########### ( 2, 3 ] 2362 8.373% 92.886% ## ( 3, 4 ] 945 3.350% 96.236% # ( 4, 6 ] 719 2.549% 98.784% # ( 6, 10 ] 299 1.060% 99.844% ( 10, 15 ] 18 0.064% 99.908% ( 15, 22 ] 4 0.014% 99.922% ( 76, 110 ] 3 0.011% 99.933% ( 110, 170 ] 3 0.011% 99.943% ( 170, 250 ] 9 0.032% 99.975% ( 250, 380 ] 6 0.021% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 210576 Average: 3.7727 StdDev: 38.07 Min: 0 Median: 1.6516 Max: 5724 Percentiles: P50: 1.65 P75: 2.20 P99: 9.23 P99.9: 303.28 P99.99: 927.51 ------------------------------------------------------ [ 0, 1 ] 18902 8.976% 8.976% ## ( 1, 2 ] 132583 62.962% 71.938% ############# ( 2, 3 ] 32252 15.316% 87.254% ### ( 3, 4 ] 13161 6.250% 93.504% # ( 4, 6 ] 8458 4.017% 97.521% # ( 6, 10 ] 3853 1.830% 99.351% ( 10, 15 ] 379 0.180% 99.531% ( 15, 22 ] 82 0.039% 99.570% ( 22, 34 ] 12 0.006% 99.575% ( 34, 51 ] 13 0.006% 99.582% ( 51, 76 ] 37 0.018% 99.599% ( 76, 110 ] 163 0.077% 99.677% ( 110, 170 ] 292 0.139% 99.815% ( 170, 250 ] 144 0.068% 99.884% ( 250, 380 ] 84 0.040% 99.924% ( 380, 580 ] 86 0.041% 99.964% ( 580, 870 ] 51 0.024% 99.989% ( 870, 1300 ] 22 0.010% 99.999% ( 1300, 1900 ] 9 0.004% 100.003% ( 1900, 2900 ] 8 0.004% 100.007% ( 2900, 4400 ] 8 0.004% 100.011% ( 4400, 6600 ] 2 0.001% 100.012% ** Level 4 read latency histogram (micros): Count: 30 Average: 1663.5333 StdDev: 1348.31 Min: 180 Median: 1228.3333 Max: 5799 Percentiles: P50: 1228.33 P75: 2400.00 P99: 5799.00 P99.9: 5799.00 P99.99: 5799.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 3 10.000% 13.333% ## ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 4 13.333% 33.333% ### ( 870, 1300 ] 6 20.000% 53.333% #### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 6 20.000% 96.667% #### ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 555.5500 StdDev: 659.41 Min: 85 Median: 250.0000 Max: 2544 Percentiles: P50: 250.00 P75: 580.00 P99: 2544.00 P99.9: 2544.00 P99.99: 2544.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 4 20.000% 75.000% #### ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 2 10.000% 95.000% ## ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 18.2 total, 3.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 325.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.230 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.366 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/30-01:03:41 ... thread 0: (1000000,7000000) ops and (31946.0,142032.1) ops/second in (31.302808,49.284639) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/4 440.72 MB 0.0 5.4 0.0 5.4 12.1 6.6 0.0 1.8 139.2 310.0 39.81 37.36 118 0.337 5628K 5895 0.0 0.0 L1 4/4 268.96 MB 0.0 7.8 6.1 1.7 7.7 5.9 0.1 1.3 209.9 205.6 38.22 34.09 4 9.555 8145K 163K 0.0 0.0 L2 17/17 1.85 GB 0.0 0.1 0.1 0.0 0.1 0.1 5.8 1.8 235.8 235.7 0.47 0.44 1 0.471 112K 29 0.0 0.0 L3 52/9 4.34 GB 4.3 1.4 0.6 0.8 1.4 0.6 3.4 2.3 210.9 210.8 6.89 6.07 4 1.723 1462K 737 0.0 0.0 L4 152/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/34 102.62 GB 0.0 14.8 6.8 8.0 21.3 13.2 10.0 3.2 177.2 254.9 85.40 77.96 127 0.672 15M 169K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.8 6.8 8.0 21.3 13.2 9.9 3.2 177.2 254.9 85.40 77.96 127 0.672 15M 169K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.8 6.8 8.0 14.6 6.6 0.0 0.0 227.9 225.4 66.38 61.01 29 2.289 15M 169K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 357.7 19.02 16.95 98 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.5 total, 49.3 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.25 GB write, 440.02 MB/s write, 14.78 GB read, 305.90 MB/s read, 85.4 seconds Interval compaction: 21.25 GB write, 441.59 MB/s write, 14.78 GB read, 306.99 MB/s read, 85.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 20, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3021400 Average: 3.1415 StdDev: 22.18 Min: 0 Median: 1.3750 Max: 7326 Percentiles: P50: 1.38 P75: 1.78 P99: 9.26 P99.9: 165.55 P99.99: 439.70 ------------------------------------------------------ [ 0, 1 ] 817538 27.058% 27.058% ##### ( 1, 2 ] 1848292 61.173% 88.232% ############ ( 2, 3 ] 184904 6.120% 94.351% # ( 3, 4 ] 81103 2.684% 97.036% # ( 4, 6 ] 49690 1.645% 98.680% ( 6, 10 ] 11839 0.392% 99.072% ( 10, 15 ] 3012 0.100% 99.172% ( 15, 22 ] 625 0.021% 99.193% ( 22, 34 ] 40 0.001% 99.194% ( 34, 51 ] 13 0.000% 99.194% ( 51, 76 ] 206 0.007% 99.201% ( 76, 110 ] 13039 0.432% 99.633% ( 110, 170 ] 8724 0.289% 99.921% ( 170, 250 ] 1069 0.035% 99.957% ( 250, 380 ] 800 0.026% 99.983% ( 380, 580 ] 683 0.023% 100.006% ( 580, 870 ] 262 0.009% 100.015% ( 870, 1300 ] 57 0.002% 100.016% ( 1300, 1900 ] 21 0.001% 100.017% ( 1900, 2900 ] 22 0.001% 100.018% ( 2900, 4400 ] 37 0.001% 100.019% ( 4400, 6600 ] 3 0.000% 100.019% ( 6600, 9900 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 642373 Average: 3.0404 StdDev: 22.76 Min: 0 Median: 1.4320 Max: 4111 Percentiles: P50: 1.43 P75: 1.88 P99: 8.40 P99.9: 148.50 P99.99: 244.75 ------------------------------------------------------ [ 0, 1 ] 166206 25.874% 25.874% ##### ( 1, 2 ] 358730 55.845% 81.718% ########### ( 2, 3 ] 57090 8.887% 90.606% ## ( 3, 4 ] 28316 4.408% 95.014% # ( 4, 6 ] 23297 3.627% 98.640% # ( 6, 10 ] 3851 0.599% 99.240% ( 10, 15 ] 1083 0.169% 99.408% ( 15, 22 ] 249 0.039% 99.447% ( 22, 34 ] 11 0.002% 99.449% ( 34, 51 ] 22 0.003% 99.452% ( 51, 76 ] 95 0.015% 99.467% ( 76, 110 ] 1906 0.297% 99.764% ( 110, 170 ] 1366 0.213% 99.976% ( 170, 250 ] 95 0.015% 99.991% ( 250, 380 ] 100 0.016% 100.007% ( 380, 580 ] 80 0.012% 100.019% ( 580, 870 ] 49 0.008% 100.027% ( 870, 1300 ] 40 0.006% 100.033% ( 1300, 1900 ] 25 0.004% 100.037% ( 1900, 2900 ] 7 0.001% 100.038% ( 2900, 4400 ] 7 0.001% 100.039% ** Level 2 read latency histogram (micros): Count: 28211 Average: 2.2081 StdDev: 9.04 Min: 0 Median: 1.3816 Max: 1142 Percentiles: P50: 1.38 P75: 1.83 P99: 6.81 P99.9: 14.39 P99.99: 340.54 ------------------------------------------------------ [ 0, 1 ] 8097 28.702% 28.702% ###### ( 1, 2 ] 15745 55.812% 84.513% ########### ( 2, 3 ] 2362 8.373% 92.886% ## ( 3, 4 ] 945 3.350% 96.236% # ( 4, 6 ] 719 2.549% 98.784% # ( 6, 10 ] 299 1.060% 99.844% ( 10, 15 ] 18 0.064% 99.908% ( 15, 22 ] 4 0.014% 99.922% ( 76, 110 ] 3 0.011% 99.933% ( 110, 170 ] 3 0.011% 99.943% ( 170, 250 ] 9 0.032% 99.975% ( 250, 380 ] 6 0.021% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 216150 Average: 5.2831 StdDev: 74.29 Min: 0 Median: 1.6594 Max: 10862 Percentiles: P50: 1.66 P75: 2.24 P99: 9.78 P99.9: 552.65 P99.99: 2236.05 ------------------------------------------------------ [ 0, 1 ] 19000 8.790% 8.790% ## ( 1, 2 ] 135095 62.501% 71.291% ############# ( 2, 3 ] 33432 15.467% 86.758% ### ( 3, 4 ] 13819 6.393% 93.151% # ( 4, 6 ] 8883 4.110% 97.261% # ( 6, 10 ] 3984 1.843% 99.104% ( 10, 15 ] 413 0.191% 99.295% ( 15, 22 ] 84 0.039% 99.334% ( 22, 34 ] 12 0.006% 99.339% ( 34, 51 ] 13 0.006% 99.345% ( 51, 76 ] 37 0.017% 99.362% ( 76, 110 ] 207 0.096% 99.458% ( 110, 170 ] 399 0.185% 99.643% ( 170, 250 ] 236 0.109% 99.752% ( 250, 380 ] 181 0.084% 99.836% ( 380, 580 ] 162 0.075% 99.911% ( 580, 870 ] 111 0.051% 99.962% ( 870, 1300 ] 39 0.018% 99.980% ( 1300, 1900 ] 16 0.007% 99.988% ( 1900, 2900 ] 19 0.009% 99.996% ( 2900, 4400 ] 25 0.012% 100.008% ( 4400, 6600 ] 8 0.004% 100.012% ( 6600, 9900 ] 4 0.002% 100.013% ( 9900, 14000 ] 1 0.000% 100.014% ** Level 4 read latency histogram (micros): Count: 30 Average: 1663.5333 StdDev: 1348.31 Min: 180 Median: 1228.3333 Max: 5799 Percentiles: P50: 1228.33 P75: 2400.00 P99: 5799.00 P99.9: 5799.00 P99.99: 5799.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 3 10.000% 13.333% ## ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 4 13.333% 33.333% ### ( 870, 1300 ] 6 20.000% 53.333% #### ( 1300, 1900 ] 6 20.000% 73.333% #### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 6 20.000% 96.667% #### ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 555.5500 StdDev: 659.41 Min: 85 Median: 250.0000 Max: 2544 Percentiles: P50: 250.00 P75: 580.00 P99: 2544.00 P99.9: 2544.00 P99.99: 2544.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 4 20.000% 75.000% #### ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 2 10.000% 95.000% ## ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 49.5 total, 31.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 139.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.197 H:M:S, 61.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 31.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:27.967 H:M:S, 89.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/30-01:03:48 ... thread 0: (1000000,8000000) ops and (160760.4,144131.0) ops/second in (6.220438,55.505077) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 944.37 MB 31.5 5.8 0.0 5.8 13.3 7.6 0.0 1.8 123.8 285.7 47.82 41.49 130 0.368 6012K 6400 0.0 0.0 L1 5/5 450.28 MB 0.0 8.5 6.5 2.0 8.4 6.4 0.1 1.3 199.4 195.7 43.78 37.31 5 8.756 8593K 163K 0.0 0.0 L2 11/11 1.37 GB 0.0 0.1 0.1 0.0 0.1 0.1 6.0 1.8 235.8 235.7 0.47 0.44 1 0.471 112K 29 0.0 0.0 L3 15/6 1.04 GB 0.3 2.2 1.3 0.9 2.2 1.3 3.4 1.6 171.0 170.7 13.20 9.78 12 1.100 1893K 1795 0.0 0.0 L4 151/0 9.62 GB 1.0 3.7 2.7 1.0 3.7 2.7 1.7 1.3 111.7 111.2 34.05 17.78 22 1.548 2677K 10K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/26 103.51 GB 0.0 20.3 10.7 9.7 27.7 18.0 15.5 3.7 149.5 203.7 139.33 106.81 170 0.820 19M 182K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.3 10.7 9.7 27.7 18.0 15.4 3.7 149.5 203.7 139.33 106.81 170 0.820 19M 182K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.3 10.7 9.7 20.1 10.5 0.0 0.0 182.1 180.4 114.39 87.26 61 1.875 19M 182K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 310.6 24.94 19.55 109 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.7 total, 55.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.72 GB write, 509.71 MB/s write, 20.34 GB read, 374.02 MB/s read, 139.3 seconds Interval compaction: 27.72 GB write, 511.32 MB/s write, 20.34 GB read, 375.21 MB/s read, 139.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 56, interval: 77 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3269736 Average: 3.3140 StdDev: 31.68 Min: 0 Median: 1.4072 Max: 7828 Percentiles: P50: 1.41 P75: 1.82 P99: 9.24 P99.9: 166.78 P99.99: 526.19 ------------------------------------------------------ [ 0, 1 ] 827035 25.294% 25.294% ##### ( 1, 2 ] 1983791 60.671% 85.965% ############ ( 2, 3 ] 235409 7.200% 93.165% # ( 3, 4 ] 105131 3.215% 96.380% # ( 4, 6 ] 71878 2.198% 98.578% ( 6, 10 ] 17035 0.521% 99.099% ( 10, 15 ] 3877 0.119% 99.218% ( 15, 22 ] 730 0.022% 99.240% ( 22, 34 ] 43 0.001% 99.241% ( 34, 51 ] 17 0.001% 99.242% ( 51, 76 ] 207 0.006% 99.248% ( 76, 110 ] 13041 0.399% 99.647% ( 110, 170 ] 8742 0.267% 99.914% ( 170, 250 ] 1092 0.033% 99.948% ( 250, 380 ] 836 0.026% 99.973% ( 380, 580 ] 747 0.023% 99.996% ( 580, 870 ] 341 0.010% 100.007% ( 870, 1300 ] 124 0.004% 100.010% ( 1300, 1900 ] 61 0.002% 100.012% ( 1900, 2900 ] 77 0.002% 100.015% ( 2900, 4400 ] 84 0.003% 100.017% ( 4400, 6600 ] 16 0.000% 100.018% ( 6600, 9900 ] 7 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 1817641 Average: 7.6261 StdDev: 115.50 Min: 0 Median: 1.7717 Max: 9478 Percentiles: P50: 1.77 P75: 2.69 P99: 9.42 P99.9: 164.05 P99.99: 539.56 ------------------------------------------------------ [ 0, 1 ] 182546 10.043% 10.043% ## ( 1, 2 ] 941142 51.778% 61.821% ########## ( 2, 3 ] 344718 18.965% 80.786% #### ( 3, 4 ] 157749 8.679% 89.465% ## ( 4, 6 ] 145560 8.008% 97.473% ## ( 6, 10 ] 32434 1.784% 99.258% ( 10, 15 ] 7128 0.392% 99.650% ( 15, 22 ] 993 0.055% 99.705% ( 22, 34 ] 63 0.003% 99.708% ( 34, 51 ] 49 0.003% 99.711% ( 51, 76 ] 105 0.006% 99.716% ( 76, 110 ] 1978 0.109% 99.825% ( 110, 170 ] 1509 0.083% 99.908% ( 170, 250 ] 333 0.018% 99.927% ( 250, 380 ] 507 0.028% 99.955% ( 380, 580 ] 810 0.045% 99.999% ( 580, 870 ] 920 0.051% 100.050% ( 870, 1300 ] 720 0.040% 100.089% ( 1300, 1900 ] 473 0.026% 100.115% ( 1900, 2900 ] 726 0.040% 100.155% ( 2900, 4400 ] 837 0.046% 100.201% ( 4400, 6600 ] 205 0.011% 100.213% ( 6600, 9900 ] 29 0.002% 100.214% ** Level 2 read latency histogram (micros): Count: 28211 Average: 2.2081 StdDev: 9.04 Min: 0 Median: 1.3816 Max: 1142 Percentiles: P50: 1.38 P75: 1.83 P99: 6.81 P99.9: 14.39 P99.99: 340.54 ------------------------------------------------------ [ 0, 1 ] 8097 28.702% 28.702% ###### ( 1, 2 ] 15745 55.812% 84.513% ########### ( 2, 3 ] 2362 8.373% 92.886% ## ( 3, 4 ] 945 3.350% 96.236% # ( 4, 6 ] 719 2.549% 98.784% # ( 6, 10 ] 299 1.060% 99.844% ( 10, 15 ] 18 0.064% 99.908% ( 15, 22 ] 4 0.014% 99.922% ( 76, 110 ] 3 0.011% 99.933% ( 110, 170 ] 3 0.011% 99.943% ( 170, 250 ] 9 0.032% 99.975% ( 250, 380 ] 6 0.021% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 334390 Average: 13.0703 StdDev: 161.48 Min: 0 Median: 1.7391 Max: 18012 Percentiles: P50: 1.74 P75: 2.54 P99: 135.09 P99.9: 2312.14 P99.99: 4106.64 ------------------------------------------------------ [ 0, 1 ] 22409 6.701% 6.701% # ( 1, 2 ] 195886 58.580% 65.282% ############ ( 2, 3 ] 59669 17.844% 83.126% #### ( 3, 4 ] 27149 8.119% 91.245% ## ( 4, 6 ] 17585 5.259% 96.503% # ( 6, 10 ] 6773 2.025% 98.529% ( 10, 15 ] 913 0.273% 98.802% ( 15, 22 ] 153 0.046% 98.848% ( 22, 34 ] 22 0.007% 98.854% ( 34, 51 ] 18 0.005% 98.860% ( 51, 76 ] 40 0.012% 98.872% ( 76, 110 ] 225 0.067% 98.939% ( 110, 170 ] 488 0.146% 99.085% ( 170, 250 ] 376 0.112% 99.197% ( 250, 380 ] 426 0.127% 99.325% ( 380, 580 ] 576 0.172% 99.497% ( 580, 870 ] 597 0.179% 99.676% ( 870, 1300 ] 446 0.133% 99.809% ( 1300, 1900 ] 216 0.065% 99.874% ( 1900, 2900 ] 215 0.064% 99.938% ( 2900, 4400 ] 217 0.065% 100.003% ( 4400, 6600 ] 45 0.013% 100.016% ( 6600, 9900 ] 13 0.004% 100.020% ( 9900, 14000 ] 4 0.001% 100.021% ( 14000, 22000 ] 2 0.001% 100.022% ** Level 4 read latency histogram (micros): Count: 164707 Average: 12.4130 StdDev: 159.53 Min: 1 Median: 2.0069 Max: 7742 Percentiles: P50: 2.01 P75: 3.00 P99: 9.89 P99.9: 1486.47 P99.99: 2339.79 ------------------------------------------------------ [ 0, 1 ] 1670 1.014% 1.014% ( 1, 2 ] 80396 48.812% 49.825% ########## ( 2, 3 ] 41445 25.163% 74.988% ##### ( 3, 4 ] 18685 11.344% 86.333% ## ( 4, 6 ] 17600 10.686% 97.018% ## ( 6, 10 ] 3359 2.039% 99.058% ( 10, 15 ] 774 0.470% 99.528% ( 15, 22 ] 93 0.056% 99.584% ( 22, 34 ] 11 0.007% 99.591% ( 34, 51 ] 6 0.004% 99.594% ( 76, 110 ] 8 0.005% 99.599% ( 110, 170 ] 12 0.007% 99.607% ( 170, 250 ] 56 0.034% 99.641% ( 250, 380 ] 41 0.025% 99.665% ( 380, 580 ] 83 0.050% 99.716% ( 580, 870 ] 129 0.078% 99.794% ( 870, 1300 ] 137 0.083% 99.877% ( 1300, 1900 ] 120 0.073% 99.950% ( 1900, 2900 ] 149 0.090% 100.041% ( 2900, 4400 ] 153 0.093% 100.134% ( 4400, 6600 ] 29 0.018% 100.151% ( 6600, 9900 ] 2 0.001% 100.152% ** Level 5 read latency histogram (micros): Count: 260 Average: 1662.2423 StdDev: 1641.54 Min: 85 Median: 964.3902 Max: 8141 Percentiles: P50: 964.39 P75: 2682.61 P99: 7040.00 P99.9: 8141.00 P99.99: 8141.00 ------------------------------------------------------ ( 76, 110 ] 8 3.077% 3.077% # ( 110, 170 ] 12 4.615% 7.692% # ( 170, 250 ] 11 4.231% 11.923% # ( 250, 380 ] 22 8.462% 20.385% ## ( 380, 580 ] 28 10.769% 31.154% ## ( 580, 870 ] 40 15.385% 46.538% ### ( 870, 1300 ] 41 15.769% 62.308% ### ( 1300, 1900 ] 15 5.769% 68.077% # ( 1900, 2900 ] 23 8.846% 76.923% ## ( 2900, 4400 ] 41 15.769% 92.692% ### ( 4400, 6600 ] 16 6.154% 98.846% # ( 6600, 9900 ] 3 1.154% 100.000% ** DB Stats ** Uptime(secs): 55.7 total, 6.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 141.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:33.444 H:M:S, 60.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 158.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.247 H:M:S, 52.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/30-01:03:51 ... thread 0: (1000000,9000000) ops and (294678.3,152805.0) ops/second in (3.393531,58.898608) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 1.84 GB 94.4 6.3 0.0 6.3 14.8 8.5 0.0 1.7 122.7 286.9 52.89 46.14 144 0.367 6588K 6990 0.0 0.0 L1 5/5 450.28 MB 0.0 8.5 6.5 2.0 8.4 6.4 0.1 1.3 199.4 195.7 43.78 37.31 5 8.756 8593K 163K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 6.0 1.8 235.8 235.7 0.47 0.44 1 0.471 112K 29 0.0 0.0 L3 18/0 961.74 MB 1.0 4.3 2.7 1.6 4.3 2.7 3.4 1.6 171.9 171.4 25.77 19.59 15 1.718 3183K 2958 0.0 0.0 L4 155/0 9.48 GB 1.0 3.8 2.8 1.0 3.8 2.8 3.0 1.3 113.2 112.6 34.55 18.25 23 1.502 2784K 11K 0.0 0.0 L5 1116/0 91.72 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1308/13 104.43 GB 0.0 23.1 12.1 11.0 31.4 20.4 18.5 3.7 150.3 204.2 157.46 121.73 188 0.838 21M 184K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.1 12.1 11.0 31.4 20.4 18.4 3.7 150.3 204.2 157.46 121.73 188 0.838 21M 184K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.1 12.1 11.0 22.9 11.9 0.0 0.0 182.6 181.0 129.64 99.69 67 1.935 21M 184K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 312.5 27.82 22.04 121 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.1 total, 58.9 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.41 GB write, 544.37 MB/s write, 23.12 GB read, 400.68 MB/s read, 157.5 seconds Interval compaction: 31.41 GB write, 546.00 MB/s write, 23.12 GB read, 401.88 MB/s read, 157.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 62, interval: 83 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3566423 Average: 3.2531 StdDev: 30.62 Min: 0 Median: 1.4273 Max: 7828 Percentiles: P50: 1.43 P75: 1.84 P99: 8.87 P99.9: 164.77 P99.99: 503.65 ------------------------------------------------------ [ 0, 1 ] 855039 23.975% 23.975% ##### ( 1, 2 ] 2172272 60.909% 84.884% ############ ( 2, 3 ] 280090 7.854% 92.737% ## ( 3, 4 ] 123375 3.459% 96.197% # ( 4, 6 ] 85513 2.398% 98.594% ( 6, 10 ] 20140 0.565% 99.159% ( 10, 15 ] 4316 0.121% 99.280% ( 15, 22 ] 783 0.022% 99.302% ( 22, 34 ] 45 0.001% 99.303% ( 34, 51 ] 19 0.001% 99.304% ( 51, 76 ] 207 0.006% 99.310% ( 76, 110 ] 13043 0.366% 99.675% ( 110, 170 ] 8781 0.246% 99.921% ( 170, 250 ] 1114 0.031% 99.953% ( 250, 380 ] 858 0.024% 99.977% ( 380, 580 ] 764 0.021% 99.998% ( 580, 870 ] 353 0.010% 100.008% ( 870, 1300 ] 127 0.004% 100.012% ( 1300, 1900 ] 64 0.002% 100.013% ( 1900, 2900 ] 80 0.002% 100.016% ( 2900, 4400 ] 85 0.002% 100.018% ( 4400, 6600 ] 16 0.000% 100.019% ( 6600, 9900 ] 7 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 2136040 Average: 7.0162 StdDev: 106.98 Min: 0 Median: 1.7749 Max: 9478 Percentiles: P50: 1.77 P75: 2.68 P99: 9.35 P99.9: 155.11 P99.99: 485.46 ------------------------------------------------------ [ 0, 1 ] 192271 9.001% 9.001% ## ( 1, 2 ] 1130134 52.908% 61.909% ########### ( 2, 3 ] 411072 19.245% 81.154% #### ( 3, 4 ] 182453 8.542% 89.695% ## ( 4, 6 ] 165601 7.753% 97.448% ## ( 6, 10 ] 39629 1.855% 99.303% ( 10, 15 ] 8089 0.379% 99.682% ( 15, 22 ] 1110 0.052% 99.734% ( 22, 34 ] 67 0.003% 99.737% ( 34, 51 ] 51 0.002% 99.740% ( 51, 76 ] 108 0.005% 99.745% ( 76, 110 ] 2098 0.098% 99.843% ( 110, 170 ] 1624 0.076% 99.919% ( 170, 250 ] 416 0.019% 99.938% ( 250, 380 ] 613 0.029% 99.967% ( 380, 580 ] 930 0.044% 100.011% ( 580, 870 ] 1001 0.047% 100.057% ( 870, 1300 ] 760 0.036% 100.093% ( 1300, 1900 ] 490 0.023% 100.116% ( 1900, 2900 ] 728 0.034% 100.150% ( 2900, 4400 ] 838 0.039% 100.189% ( 4400, 6600 ] 205 0.010% 100.199% ( 6600, 9900 ] 29 0.001% 100.200% ** Level 2 read latency histogram (micros): Count: 28211 Average: 2.2081 StdDev: 9.04 Min: 0 Median: 1.3816 Max: 1142 Percentiles: P50: 1.38 P75: 1.83 P99: 6.81 P99.9: 14.39 P99.99: 340.54 ------------------------------------------------------ [ 0, 1 ] 8097 28.702% 28.702% ###### ( 1, 2 ] 15745 55.812% 84.513% ########### ( 2, 3 ] 2362 8.373% 92.886% ## ( 3, 4 ] 945 3.350% 96.236% # ( 4, 6 ] 719 2.549% 98.784% # ( 6, 10 ] 299 1.060% 99.844% ( 10, 15 ] 18 0.064% 99.908% ( 15, 22 ] 4 0.014% 99.922% ( 76, 110 ] 3 0.011% 99.933% ( 110, 170 ] 3 0.011% 99.943% ( 170, 250 ] 9 0.032% 99.975% ( 250, 380 ] 6 0.021% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 371153 Average: 12.2129 StdDev: 153.88 Min: 0 Median: 1.7385 Max: 18012 Percentiles: P50: 1.74 P75: 2.53 P99: 107.37 P99.9: 2144.66 P99.99: 4075.81 ------------------------------------------------------ [ 0, 1 ] 23868 6.431% 6.431% # ( 1, 2 ] 218966 58.996% 65.427% ############ ( 2, 3 ] 66797 17.997% 83.424% #### ( 3, 4 ] 29737 8.012% 91.436% ## ( 4, 6 ] 19479 5.248% 96.684% # ( 6, 10 ] 7157 1.928% 98.613% ( 10, 15 ] 968 0.261% 98.874% ( 15, 22 ] 166 0.045% 98.918% ( 22, 34 ] 24 0.006% 98.925% ( 34, 51 ] 18 0.005% 98.930% ( 51, 76 ] 40 0.011% 98.940% ( 76, 110 ] 240 0.065% 99.005% ( 110, 170 ] 535 0.144% 99.149% ( 170, 250 ] 395 0.106% 99.256% ( 250, 380 ] 449 0.121% 99.377% ( 380, 580 ] 597 0.161% 99.537% ( 580, 870 ] 613 0.165% 99.703% ( 870, 1300 ] 455 0.123% 99.825% ( 1300, 1900 ] 225 0.061% 99.886% ( 1900, 2900 ] 216 0.058% 99.944% ( 2900, 4400 ] 218 0.059% 100.003% ( 4400, 6600 ] 45 0.012% 100.015% ( 6600, 9900 ] 13 0.004% 100.018% ( 9900, 14000 ] 4 0.001% 100.019% ( 14000, 22000 ] 2 0.001% 100.020% ** Level 4 read latency histogram (micros): Count: 164717 Average: 12.4332 StdDev: 159.65 Min: 1 Median: 2.0069 Max: 7742 Percentiles: P50: 2.01 P75: 3.00 P99: 9.89 P99.9: 1491.42 P99.99: 2343.52 ------------------------------------------------------ [ 0, 1 ] 1673 1.016% 1.016% ( 1, 2 ] 80398 48.810% 49.825% ########## ( 2, 3 ] 41446 25.162% 74.987% ##### ( 3, 4 ] 18685 11.344% 86.331% ## ( 4, 6 ] 17600 10.685% 97.016% ## ( 6, 10 ] 3359 2.039% 99.055% ( 10, 15 ] 774 0.470% 99.525% ( 15, 22 ] 93 0.056% 99.582% ( 22, 34 ] 11 0.007% 99.588% ( 34, 51 ] 6 0.004% 99.592% ( 76, 110 ] 8 0.005% 99.597% ( 110, 170 ] 13 0.008% 99.605% ( 170, 250 ] 57 0.035% 99.639% ( 250, 380 ] 41 0.025% 99.664% ( 380, 580 ] 83 0.050% 99.715% ( 580, 870 ] 130 0.079% 99.794% ( 870, 1300 ] 137 0.083% 99.877% ( 1300, 1900 ] 120 0.073% 99.950% ( 1900, 2900 ] 150 0.091% 100.041% ( 2900, 4400 ] 153 0.093% 100.134% ( 4400, 6600 ] 29 0.018% 100.151% ( 6600, 9900 ] 2 0.001% 100.152% ** Level 5 read latency histogram (micros): Count: 360 Average: 1457.1861 StdDev: 1532.92 Min: 49 Median: 827.0370 Max: 8141 Percentiles: P50: 827.04 P75: 2190.32 P99: 6517.50 P99.9: 8141.00 P99.99: 8141.00 ------------------------------------------------------ ( 34, 51 ] 2 0.556% 0.556% ( 76, 110 ] 15 4.167% 4.722% # ( 110, 170 ] 25 6.944% 11.667% # ( 170, 250 ] 22 6.111% 17.778% # ( 250, 380 ] 39 10.833% 28.611% ## ( 380, 580 ] 31 8.611% 37.222% ## ( 580, 870 ] 54 15.000% 52.222% ### ( 870, 1300 ] 48 13.333% 65.556% ### ( 1300, 1900 ] 25 6.944% 72.500% # ( 1900, 2900 ] 31 8.611% 81.111% ## ( 2900, 4400 ] 49 13.611% 94.722% ### ( 4400, 6600 ] 16 4.444% 99.167% # ( 6600, 9900 ] 3 0.833% 100.000% ** DB Stats ** Uptime(secs): 59.1 total, 3.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 149.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:34.104 H:M:S, 57.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 290.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.660 H:M:S, 19.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.421 micros/op 155728 ops/sec 60.002 seconds 9343999 operations; 150.9 MB/s Microseconds per write: Count: 9343999 Average: 6.4214 StdDev: 544.76 Min: 0 Median: 1.7416 Max: 854706 Percentiles: P50: 1.74 P75: 2.75 P99: 8.97 P99.9: 1909.61 P99.99: 2807.20 ------------------------------------------------------ [ 0, 1 ] 1234625 13.213% 13.213% ### ( 1, 2 ] 4635186 49.606% 62.819% ########## ( 2, 3 ] 1518024 16.246% 79.065% ### ( 3, 4 ] 1283005 13.731% 92.796% ### ( 4, 6 ] 507869 5.435% 98.231% # ( 6, 10 ] 96645 1.034% 99.265% ( 10, 15 ] 31434 0.336% 99.602% ( 15, 22 ] 8250 0.088% 99.690% ( 22, 34 ] 1721 0.018% 99.708% ( 34, 51 ] 228 0.002% 99.711% ( 51, 76 ] 55 0.001% 99.712% ( 76, 110 ] 6454 0.069% 99.781% ( 110, 170 ] 2592 0.028% 99.808% ( 170, 250 ] 301 0.003% 99.812% ( 250, 380 ] 141 0.002% 99.813% ( 380, 580 ] 22 0.000% 99.813% ( 580, 870 ] 18 0.000% 99.813% ( 870, 1300 ] 7977 0.085% 99.899% ( 1300, 1900 ] 18 0.000% 99.899% ( 1900, 2900 ] 9369 0.100% 99.999% ( 2900, 4400 ] 31 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 209637 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9343999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9643006968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 539 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34295555 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 26522081874 rocksdb.compact.write.bytes COUNT : 26302007842 rocksdb.flush.write.bytes COUNT : 9512026994 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 82 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 294 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9435476992 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3798016 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 26625368838 rocksdb.non.last.level.read.count COUNT : 6424893 rocksdb.block.checksum.compute.count COUNT : 6423897 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.374986 P95 : 3.897238 P99 : 7.386896 P100 : 854704.000000 COUNT : 9343999 SUM : 55560930 rocksdb.compaction.times.micros P50 : 1192916.666667 P95 : 5436666.666667 P99 : 25410000.000000 P100 : 28622987.000000 COUNT : 69 SUM : 135771616 rocksdb.compaction.times.cpu_micros P50 : 947931.034483 P95 : 4703333.333333 P99 : 24817124.000000 P100 : 24817124.000000 COUNT : 69 SUM : 105529963 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 692.258065 P95 : 5940.000000 P99 : 131329.000000 P100 : 131329.000000 COUNT : 126 SUM : 407591 rocksdb.compaction.outfile.sync.micros P50 : 1090.443038 P95 : 116562.500000 P99 : 165312.500000 P100 : 362818.000000 COUNT : 325 SUM : 6246805 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 102.048387 P95 : 2083.333333 P99 : 4920.666667 P100 : 5329.000000 COUNT : 229 SUM : 91868 rocksdb.table.open.io.micros P50 : 1723.333333 P95 : 9161.625000 P99 : 15840.000000 P100 : 19026.000000 COUNT : 539 SUM : 1439393 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.605320 P95 : 7.920231 P99 : 13.469912 P100 : 18017.000000 COUNT : 6422324 SUM : 47029458 rocksdb.read.block.get.micros P50 : 558.378378 P95 : 3970.625000 P99 : 6047.555556 P100 : 8305.000000 COUNT : 1078 SUM : 1144156 rocksdb.write.raw.block.micros P50 : 0.515155 P95 : 0.978795 P99 : 2.954835 P100 : 25491.000000 COUNT : 8683726 SUM : 19127588 rocksdb.numfiles.in.singlecompaction P50 : 3.306818 P95 : 6.733333 P99 : 19.340000 P100 : 32.000000 COUNT : 138 SUM : 550 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.582507 P95 : 2246.493104 P99 : 2771.779108 P100 : 854499.000000 COUNT : 122825 SUM : 34308283 rocksdb.sst.read.micros P50 : 1.567651 P95 : 4.702950 P99 : 9.631077 P100 : 18012.000000 COUNT : 6425077 SUM : 34324901 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9343999 SUM : 9643006968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210975.609756 P95 : 482600.000000 P99 : 1002346.000000 P100 : 1002346.000000 COUNT : 126 SUM : 28876672 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 307 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0