[2024-07-14 23:14:00.763063] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 24.03.0 initialization... [2024-07-14 23:14:00.763209] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid202091 ] Set seed to 1720991640759681 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-14 23:14:00.871313] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-14 23:14:01.089044] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-14 23:14:01.089093] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 202091' to capture a snapshot of events at runtime. [2024-07-14 23:14:01.089103] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-14 23:14:01.089112] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-14 23:14:01.089119] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid202091 for offline analysis/debug. [2024-07-14 23:14:01.089214] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Jul 14 23:14:10 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/14-23:14:13 ... thread 0: (1000000,1000000) ops and (338989.1,338989.1) ops/second in (2.949947,2.949947) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 692.99 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 353.1 2.50 2.23 12 0.208 0 0 0.0 0.0 L2 3/2 236.88 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 248.3 248.2 1.40 1.34 2 0.701 353K 199 0.0 0.0 L3 10/0 818.92 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1175/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.3 315.4 3.90 3.57 14 0.279 353K 199 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.3 315.4 3.90 3.57 14 0.279 353K 199 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 248.3 248.2 1.40 1.34 2 0.701 353K 199 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 353.1 2.50 2.23 12 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 386.70 MB/s write, 0.34 GB read, 109.47 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 416.70 MB/s write, 0.34 GB read, 117.96 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 130458 Average: 2.0916 StdDev: 13.37 Min: 1 Median: 1.4129 Max: 3148 Percentiles: P50: 1.41 P75: 1.80 P99: 5.27 P99.9: 10.45 P99.99: 21.98 ------------------------------------------------------ [ 0, 1 ] 30361 23.273% 23.273% ##### ( 1, 2 ] 84448 64.732% 88.005% ############# ( 2, 3 ] 10018 7.679% 95.684% ## ( 3, 4 ] 3182 2.439% 98.123% ( 4, 6 ] 1811 1.388% 99.511% ( 6, 10 ] 500 0.383% 99.894% ( 10, 15 ] 106 0.081% 99.975% ( 15, 22 ] 21 0.016% 99.992% ( 22, 34 ] 1 0.001% 99.992% ( 34, 51 ] 1 0.001% 99.993% ( 110, 170 ] 5 0.004% 99.997% ( 170, 250 ] 4 0.003% 100.000% ( 250, 380 ] 3 0.002% 100.002% ( 380, 580 ] 4 0.003% 100.005% ( 580, 870 ] 2 0.002% 100.007% ( 870, 1300 ] 3 0.002% 100.009% ( 1300, 1900 ] 1 0.001% 100.010% ( 1900, 2900 ] 1 0.001% 100.011% ( 2900, 4400 ] 1 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 12226 Average: 4.1791 StdDev: 86.65 Min: 1 Median: 1.2956 Max: 7426 Percentiles: P50: 1.30 P75: 1.71 P99: 9.80 P99.9: 322.12 P99.99: 6110.28 ------------------------------------------------------ [ 0, 1 ] 3941 32.235% 32.235% ###### ( 1, 2 ] 7347 60.093% 92.328% ############ ( 2, 3 ] 490 4.008% 96.336% # ( 3, 4 ] 104 0.851% 97.186% ( 4, 6 ] 102 0.834% 98.021% ( 6, 10 ] 126 1.031% 99.051% ( 10, 15 ] 37 0.303% 99.354% ( 15, 22 ] 6 0.049% 99.403% ( 34, 51 ] 3 0.025% 99.427% ( 51, 76 ] 24 0.196% 99.624% ( 76, 110 ] 11 0.090% 99.714% ( 110, 170 ] 14 0.115% 99.828% ( 170, 250 ] 6 0.049% 99.877% ( 250, 380 ] 5 0.041% 99.918% ( 380, 580 ] 3 0.025% 99.943% ( 870, 1300 ] 3 0.025% 99.967% ( 1900, 2900 ] 2 0.016% 99.984% ( 4400, 6600 ] 1 0.008% 99.992% ( 6600, 9900 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 68397 Average: 2.0563 StdDev: 5.67 Min: 0 Median: 1.4333 Max: 881 Percentiles: P50: 1.43 P75: 1.81 P99: 5.37 P99.9: 10.06 P99.99: 182.82 ------------------------------------------------------ [ 0, 1 ] 14565 21.295% 21.295% #### ( 1, 2 ] 45316 66.254% 87.549% ############# ( 2, 3 ] 5357 7.832% 95.381% ## ( 3, 4 ] 1806 2.640% 98.022% # ( 4, 6 ] 977 1.428% 99.450% ( 6, 10 ] 308 0.450% 99.901% ( 10, 15 ] 54 0.079% 99.980% ( 15, 22 ] 5 0.007% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 380, 580 ] 2 0.003% 99.999% ( 580, 870 ] 1 0.001% 100.000% ( 870, 1300 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 50 Average: 3091.5000 StdDev: 2892.00 Min: 205 Median: 1675.0000 Max: 9650 Percentiles: P50: 1675.00 P75: 5316.67 P99: 9650.00 P99.9: 9650.00 P99.99: 9650.00 ------------------------------------------------------ ( 170, 250 ] 2 4.000% 4.000% # ( 250, 380 ] 1 2.000% 6.000% ( 380, 580 ] 2 4.000% 10.000% # ( 580, 870 ] 13 26.000% 36.000% ##### ( 870, 1300 ] 2 4.000% 40.000% # ( 1300, 1900 ] 8 16.000% 56.000% ### ( 1900, 2900 ] 5 10.000% 66.000% ## ( 2900, 4400 ] 2 4.000% 70.000% # ( 4400, 6600 ] 6 12.000% 82.000% ## ( 6600, 9900 ] 9 18.000% 100.000% #### ** Level 4 read latency histogram (micros): Count: 25 Average: 3554.4800 StdDev: 2825.36 Min: 380 Median: 2525.0000 Max: 9248 Percentiles: P50: 2525.00 P75: 5610.00 P99: 9248.00 P99.9: 9248.00 P99.99: 9248.00 ------------------------------------------------------ ( 250, 380 ] 1 4.000% 4.000% # ( 380, 580 ] 2 8.000% 12.000% ## ( 580, 870 ] 1 4.000% 16.000% # ( 870, 1300 ] 2 8.000% 24.000% ## ( 1300, 1900 ] 4 16.000% 40.000% ### ( 1900, 2900 ] 4 16.000% 56.000% ### ( 2900, 4400 ] 2 8.000% 64.000% ## ( 4400, 6600 ] 5 20.000% 84.000% #### ( 6600, 9900 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 309.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.436 H:M:S, 13.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.436 H:M:S, 14.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/14-23:14:16 ... thread 0: (1000000,2000000) ops and (331117.8,335007.3) ops/second in (3.020073,5.970020) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 0.9 0.0 0.9 2.7 1.8 0.0 1.5 101.2 318.1 8.71 8.04 29 0.300 895K 968 0.0 0.0 L1 1/0 2.71 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 240.3 240.0 1.31 1.27 1 1.311 319K 416 0.0 0.0 L2 2/1 146.45 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 248.3 248.2 1.40 1.34 2 0.701 353K 199 0.0 0.0 L3 19/10 1.03 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 223.9 223.9 0.84 0.77 1 0.836 190K 0 0.0 0.0 L4 169/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 127.3 127.3 1.32 0.90 1 1.322 170K 0 0.0 0.0 L5 1040/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/15 97.98 GB 0.0 1.9 0.8 1.0 3.7 2.7 1.1 2.0 139.9 279.0 13.58 12.32 34 0.399 1929K 1583 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 0.8 1.0 3.7 2.7 1.0 2.0 139.9 279.0 13.58 12.32 34 0.399 1929K 1583 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 0.8 1.0 1.9 0.8 0.0 0.0 230.0 229.8 8.26 7.60 8 1.033 1929K 1583 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 355.3 5.32 4.72 26 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.70 GB write, 611.04 MB/s write, 1.86 GB read, 306.51 MB/s read, 13.6 seconds Interval compaction: 3.70 GB write, 634.48 MB/s write, 1.86 GB read, 318.27 MB/s read, 13.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 404248 Average: 2.3280 StdDev: 11.29 Min: 1 Median: 1.5676 Max: 3279 Percentiles: P50: 1.57 P75: 1.95 P99: 5.80 P99.9: 12.16 P99.99: 15.65 ------------------------------------------------------ [ 0, 1 ] 52703 13.037% 13.037% ### ( 1, 2 ] 263264 65.124% 78.162% ############# ( 2, 3 ] 58147 14.384% 92.546% ### ( 3, 4 ] 15942 3.944% 96.489% # ( 4, 6 ] 11266 2.787% 99.276% # ( 6, 10 ] 2250 0.557% 99.833% ( 10, 15 ] 630 0.156% 99.989% ( 15, 22 ] 60 0.015% 100.003% ( 22, 34 ] 5 0.001% 100.005% ( 34, 51 ] 1 0.000% 100.005% ( 51, 76 ] 5 0.001% 100.006% ( 110, 170 ] 11 0.003% 100.009% ( 170, 250 ] 9 0.002% 100.011% ( 250, 380 ] 8 0.002% 100.013% ( 380, 580 ] 9 0.002% 100.015% ( 580, 870 ] 5 0.001% 100.017% ( 870, 1300 ] 12 0.003% 100.020% ( 1300, 1900 ] 2 0.000% 100.020% ( 1900, 2900 ] 1 0.000% 100.020% ( 2900, 4400 ] 2 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 12246 Average: 4.5374 StdDev: 89.73 Min: 0 Median: 1.2959 Max: 7426 Percentiles: P50: 1.30 P75: 1.71 P99: 9.99 P99.9: 417.70 P99.99: 6105.88 ------------------------------------------------------ [ 0, 1 ] 3947 32.231% 32.231% ###### ( 1, 2 ] 7354 60.052% 92.283% ############ ( 2, 3 ] 490 4.001% 96.285% # ( 3, 4 ] 104 0.849% 97.134% ( 4, 6 ] 102 0.833% 97.967% ( 6, 10 ] 127 1.037% 99.004% ( 10, 15 ] 37 0.302% 99.306% ( 15, 22 ] 6 0.049% 99.355% ( 34, 51 ] 3 0.024% 99.379% ( 51, 76 ] 24 0.196% 99.575% ( 76, 110 ] 11 0.090% 99.665% ( 110, 170 ] 14 0.114% 99.780% ( 170, 250 ] 7 0.057% 99.837% ( 250, 380 ] 7 0.057% 99.894% ( 380, 580 ] 4 0.033% 99.927% ( 580, 870 ] 1 0.008% 99.935% ( 870, 1300 ] 3 0.024% 99.959% ( 1900, 2900 ] 3 0.024% 99.984% ( 4400, 6600 ] 1 0.008% 99.992% ( 6600, 9900 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 76046 Average: 2.1067 StdDev: 5.39 Min: 0 Median: 1.4653 Max: 881 Percentiles: P50: 1.47 P75: 1.85 P99: 5.52 P99.9: 10.24 P99.99: 157.91 ------------------------------------------------------ [ 0, 1 ] 14812 19.478% 19.478% #### ( 1, 2 ] 49880 65.592% 85.070% ############# ( 2, 3 ] 7298 9.597% 94.666% ## ( 3, 4 ] 2321 3.052% 97.718% # ( 4, 6 ] 1286 1.691% 99.410% ( 6, 10 ] 370 0.487% 99.896% ( 10, 15 ] 61 0.080% 99.976% ( 15, 22 ] 6 0.008% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 2 0.003% 99.995% ( 380, 580 ] 2 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 197446 Average: 4.0025 StdDev: 69.55 Min: 1 Median: 1.7114 Max: 9650 Percentiles: P50: 1.71 P75: 2.35 P99: 9.05 P99.9: 206.24 P99.99: 571.69 ------------------------------------------------------ [ 0, 1 ] 12563 6.363% 6.363% # ( 1, 2 ] 121109 61.338% 67.701% ############ ( 2, 3 ] 41313 20.924% 88.624% #### ( 3, 4 ] 9468 4.795% 93.419% # ( 4, 6 ] 8310 4.209% 97.628% # ( 6, 10 ] 3554 1.800% 99.428% ( 10, 15 ] 517 0.262% 99.690% ( 15, 22 ] 71 0.036% 99.726% ( 22, 34 ] 9 0.005% 99.731% ( 34, 51 ] 4 0.002% 99.733% ( 51, 76 ] 1 0.001% 99.733% ( 76, 110 ] 70 0.035% 99.769% ( 110, 170 ] 208 0.105% 99.874% ( 170, 250 ] 116 0.059% 99.933% ( 250, 380 ] 74 0.037% 99.970% ( 380, 580 ] 42 0.021% 99.991% ( 580, 870 ] 43 0.022% 100.013% ( 870, 1300 ] 19 0.010% 100.023% ( 1300, 1900 ] 9 0.005% 100.027% ( 1900, 2900 ] 5 0.003% 100.030% ( 2900, 4400 ] 2 0.001% 100.031% ( 4400, 6600 ] 6 0.003% 100.034% ( 6600, 9900 ] 9 0.005% 100.038% ** Level 4 read latency histogram (micros): Count: 310 Average: 294.5290 StdDev: 1256.01 Min: 1 Median: 1.8070 Max: 9248 Percentiles: P50: 1.81 P75: 6.07 P99: 7342.50 P99.9: 9248.00 P99.99: 9248.00 ------------------------------------------------------ [ 0, 1 ] 63 20.323% 20.323% #### ( 1, 2 ] 114 36.774% 57.097% ####### ( 2, 3 ] 36 11.613% 68.710% ## ( 3, 4 ] 10 3.226% 71.935% # ( 4, 6 ] 9 2.903% 74.839% # ( 6, 10 ] 28 9.032% 83.871% ## ( 10, 15 ] 16 5.161% 89.032% # ( 15, 22 ] 3 0.968% 90.000% ( 51, 76 ] 1 0.323% 90.323% ( 110, 170 ] 1 0.323% 90.645% ( 170, 250 ] 3 0.968% 91.613% ( 250, 380 ] 1 0.323% 91.935% ( 380, 580 ] 3 0.968% 92.903% ( 580, 870 ] 1 0.323% 93.226% ( 870, 1300 ] 2 0.645% 93.871% ( 1300, 1900 ] 4 1.290% 95.161% ( 1900, 2900 ] 4 1.290% 96.452% ( 2900, 4400 ] 2 0.645% 97.097% ( 4400, 6600 ] 5 1.613% 98.710% ( 6600, 9900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 737.3500 StdDev: 877.89 Min: 93 Median: 336.6667 Max: 2925 Percentiles: P50: 336.67 P75: 870.00 P99: 2925.00 P99.9: 2925.00 P99.99: 2925.00 ------------------------------------------------------ ( 76, 110 ] 7 35.000% 35.000% ####### ( 170, 250 ] 1 5.000% 40.000% # ( 250, 380 ] 3 15.000% 55.000% ### ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 2 10.000% 75.000% ## ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 317.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.858 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.423 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-23:14:18 ... thread 0: (1000000,3000000) ops and (363502.3,343995.9) ops/second in (2.751014,8.721034) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 2.21 GB 169.9 1.7 0.0 1.7 4.4 2.7 0.0 1.6 119.0 312.7 14.30 13.30 45 0.318 1727K 1798 0.0 0.0 L1 1/0 2.71 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 240.3 240.0 1.31 1.27 1 1.311 319K 416 0.0 0.0 L2 1/0 96.77 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 248.3 248.2 1.40 1.34 2 0.701 353K 199 0.0 0.0 L3 19/0 843.54 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.5 239.9 239.5 4.40 4.04 2 2.201 1072K 1585 0.0 0.0 L4 169/0 9.40 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 127.3 127.3 1.32 0.90 1 1.322 170K 0 0.0 0.0 L5 1044/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/8 98.84 GB 0.0 3.5 0.9 2.6 6.2 3.6 1.7 2.3 157.8 279.6 22.74 20.85 51 0.446 3643K 3998 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 0.9 2.6 6.2 3.6 1.6 2.3 157.8 279.6 22.74 20.85 51 0.446 3643K 3998 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 0.9 2.6 3.5 0.9 0.0 0.0 239.6 239.3 14.98 13.96 12 1.248 3643K 3998 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 357.4 7.76 6.89 39 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.7 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.21 GB write, 710.04 MB/s write, 3.50 GB read, 400.84 MB/s read, 22.7 seconds Interval compaction: 6.21 GB write, 728.68 MB/s write, 3.50 GB read, 411.37 MB/s read, 22.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 631390 Average: 2.2631 StdDev: 12.51 Min: 1 Median: 1.5299 Max: 4278 Percentiles: P50: 1.53 P75: 1.91 P99: 5.70 P99.9: 11.71 P99.99: 17.59 ------------------------------------------------------ [ 0, 1 ] 95806 15.174% 15.174% ### ( 1, 2 ] 414977 65.724% 80.898% ############# ( 2, 3 ] 80093 12.685% 93.583% ### ( 3, 4 ] 21471 3.401% 96.984% # ( 4, 6 ] 14959 2.369% 99.353% ( 6, 10 ] 3174 0.503% 99.856% ( 10, 15 ] 815 0.129% 99.985% ( 15, 22 ] 86 0.014% 99.999% ( 22, 34 ] 9 0.001% 100.000% ( 34, 51 ] 2 0.000% 100.000% ( 51, 76 ] 6 0.001% 100.001% ( 110, 170 ] 19 0.003% 100.004% ( 170, 250 ] 12 0.002% 100.006% ( 250, 380 ] 11 0.002% 100.008% ( 380, 580 ] 19 0.003% 100.011% ( 580, 870 ] 8 0.001% 100.012% ( 870, 1300 ] 13 0.002% 100.014% ( 1300, 1900 ] 4 0.001% 100.015% ( 1900, 2900 ] 2 0.000% 100.015% ( 2900, 4400 ] 4 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 12246 Average: 4.5374 StdDev: 89.73 Min: 0 Median: 1.2959 Max: 7426 Percentiles: P50: 1.30 P75: 1.71 P99: 9.99 P99.9: 417.70 P99.99: 6105.88 ------------------------------------------------------ [ 0, 1 ] 3947 32.231% 32.231% ###### ( 1, 2 ] 7354 60.052% 92.283% ############ ( 2, 3 ] 490 4.001% 96.285% # ( 3, 4 ] 104 0.849% 97.134% ( 4, 6 ] 102 0.833% 97.967% ( 6, 10 ] 127 1.037% 99.004% ( 10, 15 ] 37 0.302% 99.306% ( 15, 22 ] 6 0.049% 99.355% ( 34, 51 ] 3 0.024% 99.379% ( 51, 76 ] 24 0.196% 99.575% ( 76, 110 ] 11 0.090% 99.665% ( 110, 170 ] 14 0.114% 99.780% ( 170, 250 ] 7 0.057% 99.837% ( 250, 380 ] 7 0.057% 99.894% ( 380, 580 ] 4 0.033% 99.927% ( 580, 870 ] 1 0.008% 99.935% ( 870, 1300 ] 3 0.024% 99.959% ( 1900, 2900 ] 3 0.024% 99.984% ( 4400, 6600 ] 1 0.008% 99.992% ( 6600, 9900 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 88370 Average: 2.1352 StdDev: 5.01 Min: 0 Median: 1.4897 Max: 881 Percentiles: P50: 1.49 P75: 1.87 P99: 5.53 P99.9: 9.94 P99.99: 133.26 ------------------------------------------------------ [ 0, 1 ] 15709 17.776% 17.776% #### ( 1, 2 ] 58148 65.801% 83.577% ############# ( 2, 3 ] 9512 10.764% 94.341% ## ( 3, 4 ] 2825 3.197% 97.538% # ( 4, 6 ] 1686 1.908% 99.446% ( 6, 10 ] 408 0.462% 99.907% ( 10, 15 ] 64 0.072% 99.980% ( 15, 22 ] 6 0.007% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 3 0.003% 99.992% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250704 Average: 3.8246 StdDev: 62.74 Min: 1 Median: 1.6832 Max: 9650 Percentiles: P50: 1.68 P75: 2.26 P99: 8.95 P99.9: 209.04 P99.99: 647.83 ------------------------------------------------------ [ 0, 1 ] 17934 7.153% 7.153% # ( 1, 2 ] 157221 62.712% 69.865% ############# ( 2, 3 ] 49431 19.717% 89.582% #### ( 3, 4 ] 10936 4.362% 93.944% # ( 4, 6 ] 9392 3.746% 97.691% # ( 6, 10 ] 4453 1.776% 99.467% ( 10, 15 ] 545 0.217% 99.684% ( 15, 22 ] 82 0.033% 99.717% ( 22, 34 ] 10 0.004% 99.721% ( 34, 51 ] 6 0.002% 99.723% ( 51, 76 ] 1 0.000% 99.724% ( 76, 110 ] 85 0.034% 99.757% ( 110, 170 ] 288 0.115% 99.872% ( 170, 250 ] 142 0.057% 99.929% ( 250, 380 ] 88 0.035% 99.964% ( 380, 580 ] 53 0.021% 99.985% ( 580, 870 ] 51 0.020% 100.006% ( 870, 1300 ] 25 0.010% 100.016% ( 1300, 1900 ] 13 0.005% 100.021% ( 1900, 2900 ] 6 0.002% 100.023% ( 2900, 4400 ] 2 0.001% 100.024% ( 4400, 6600 ] 6 0.002% 100.026% ( 6600, 9900 ] 9 0.004% 100.030% ** Level 4 read latency histogram (micros): Count: 310 Average: 294.5290 StdDev: 1256.01 Min: 1 Median: 1.8070 Max: 9248 Percentiles: P50: 1.81 P75: 6.07 P99: 7342.50 P99.9: 9248.00 P99.99: 9248.00 ------------------------------------------------------ [ 0, 1 ] 63 20.323% 20.323% #### ( 1, 2 ] 114 36.774% 57.097% ####### ( 2, 3 ] 36 11.613% 68.710% ## ( 3, 4 ] 10 3.226% 71.935% # ( 4, 6 ] 9 2.903% 74.839% # ( 6, 10 ] 28 9.032% 83.871% ## ( 10, 15 ] 16 5.161% 89.032% # ( 15, 22 ] 3 0.968% 90.000% ( 51, 76 ] 1 0.323% 90.323% ( 110, 170 ] 1 0.323% 90.645% ( 170, 250 ] 3 0.968% 91.613% ( 250, 380 ] 1 0.323% 91.935% ( 380, 580 ] 3 0.968% 92.903% ( 580, 870 ] 1 0.323% 93.226% ( 870, 1300 ] 2 0.645% 93.871% ( 1300, 1900 ] 4 1.290% 95.161% ( 1900, 2900 ] 4 1.290% 96.452% ( 2900, 4400 ] 2 0.645% 97.097% ( 4400, 6600 ] 5 1.613% 98.710% ( 6600, 9900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 948.1000 StdDev: 1001.07 Min: 93 Median: 480.0000 Max: 3337 Percentiles: P50: 480.00 P75: 1300.00 P99: 3337.00 P99.9: 3337.00 P99.99: 3337.00 ------------------------------------------------------ ( 76, 110 ] 8 20.000% 20.000% #### ( 110, 170 ] 1 2.500% 22.500% # ( 170, 250 ] 2 5.000% 27.500% # ( 250, 380 ] 6 15.000% 42.500% ### ( 380, 580 ] 6 15.000% 57.500% ### ( 580, 870 ] 3 7.500% 65.000% ## ( 870, 1300 ] 4 10.000% 75.000% ## ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 6 15.000% 92.500% ### ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 9.0 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 329.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.079 H:M:S, 12.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 357.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.221 H:M:S, 8.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-23:14:22 ... thread 0: (1000000,4000000) ops and (295865.9,330552.7) ops/second in (3.379910,12.100944) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 3.26 GB 50.4 2.5 0.0 2.5 6.3 3.7 0.0 1.7 124.7 310.1 20.71 19.29 62 0.334 2622K 2774 0.0 0.0 L1 1/1 2.71 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 240.3 240.0 1.31 1.27 1 1.311 319K 416 0.0 0.0 L2 1/0 96.77 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 248.3 248.2 1.40 1.34 2 0.701 353K 199 0.0 0.0 L3 19/0 843.54 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.5 239.9 239.5 4.40 4.04 2 2.201 1072K 1585 0.0 0.0 L4 169/0 9.40 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 127.3 127.3 1.32 0.90 1 1.322 170K 0 0.0 0.0 L5 1044/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/17 99.88 GB 0.0 4.4 0.9 3.5 8.1 4.6 1.7 2.2 153.3 285.0 29.15 26.84 68 0.429 4539K 4974 0.0 0.0 Int 0/0 0.00 KB 0.0 4.4 0.9 3.5 8.1 4.6 1.6 2.2 153.3 285.0 29.15 26.84 68 0.429 4539K 4974 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.4 0.9 3.5 4.4 0.9 0.0 0.0 243.5 243.2 18.36 17.24 15 1.224 4539K 4974 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 356.1 10.79 9.60 53 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.11 GB write, 673.71 MB/s write, 4.37 GB read, 362.50 MB/s read, 29.2 seconds Interval compaction: 8.11 GB write, 686.46 MB/s write, 4.37 GB read, 369.36 MB/s read, 29.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 15, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 980443 Average: 2.2809 StdDev: 11.63 Min: 1 Median: 1.5328 Max: 4278 Percentiles: P50: 1.53 P75: 1.91 P99: 5.73 P99.9: 12.09 P99.99: 21.41 ------------------------------------------------------ [ 0, 1 ] 145721 14.863% 14.863% ### ( 1, 2 ] 646600 65.950% 80.813% ############# ( 2, 3 ] 126729 12.926% 93.738% ### ( 3, 4 ] 32517 3.317% 97.055% # ( 4, 6 ] 22043 2.248% 99.303% ( 6, 10 ] 5306 0.541% 99.844% ( 10, 15 ] 1310 0.134% 99.978% ( 15, 22 ] 130 0.013% 99.991% ( 22, 34 ] 13 0.001% 99.992% ( 34, 51 ] 5 0.001% 99.993% ( 51, 76 ] 7 0.001% 99.994% ( 76, 110 ] 45 0.005% 99.998% ( 110, 170 ] 86 0.009% 100.007% ( 170, 250 ] 38 0.004% 100.011% ( 250, 380 ] 23 0.002% 100.013% ( 380, 580 ] 37 0.004% 100.017% ( 580, 870 ] 17 0.002% 100.019% ( 870, 1300 ] 19 0.002% 100.021% ( 1300, 1900 ] 5 0.001% 100.021% ( 1900, 2900 ] 4 0.000% 100.022% ( 2900, 4400 ] 4 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 12247 Average: 4.5534 StdDev: 89.74 Min: 0 Median: 1.2960 Max: 7426 Percentiles: P50: 1.30 P75: 1.71 P99: 10.07 P99.9: 417.65 P99.99: 6105.66 ------------------------------------------------------ [ 0, 1 ] 3947 32.228% 32.228% ###### ( 1, 2 ] 7354 60.047% 92.276% ############ ( 2, 3 ] 490 4.001% 96.277% # ( 3, 4 ] 104 0.849% 97.126% ( 4, 6 ] 102 0.833% 97.959% ( 6, 10 ] 127 1.037% 98.996% ( 10, 15 ] 37 0.302% 99.298% ( 15, 22 ] 6 0.049% 99.347% ( 34, 51 ] 3 0.024% 99.371% ( 51, 76 ] 24 0.196% 99.567% ( 76, 110 ] 11 0.090% 99.657% ( 110, 170 ] 14 0.114% 99.771% ( 170, 250 ] 8 0.065% 99.837% ( 250, 380 ] 7 0.057% 99.894% ( 380, 580 ] 4 0.033% 99.927% ( 580, 870 ] 1 0.008% 99.935% ( 870, 1300 ] 3 0.024% 99.959% ( 1900, 2900 ] 3 0.024% 99.984% ( 4400, 6600 ] 1 0.008% 99.992% ( 6600, 9900 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 88370 Average: 2.1352 StdDev: 5.01 Min: 0 Median: 1.4897 Max: 881 Percentiles: P50: 1.49 P75: 1.87 P99: 5.53 P99.9: 9.94 P99.99: 133.26 ------------------------------------------------------ [ 0, 1 ] 15709 17.776% 17.776% #### ( 1, 2 ] 58148 65.801% 83.577% ############# ( 2, 3 ] 9512 10.764% 94.341% ## ( 3, 4 ] 2825 3.197% 97.538% # ( 4, 6 ] 1686 1.908% 99.446% ( 6, 10 ] 408 0.462% 99.907% ( 10, 15 ] 64 0.072% 99.980% ( 15, 22 ] 6 0.007% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 3 0.003% 99.992% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250704 Average: 3.8246 StdDev: 62.74 Min: 1 Median: 1.6832 Max: 9650 Percentiles: P50: 1.68 P75: 2.26 P99: 8.95 P99.9: 209.04 P99.99: 647.83 ------------------------------------------------------ [ 0, 1 ] 17934 7.153% 7.153% # ( 1, 2 ] 157221 62.712% 69.865% ############# ( 2, 3 ] 49431 19.717% 89.582% #### ( 3, 4 ] 10936 4.362% 93.944% # ( 4, 6 ] 9392 3.746% 97.691% # ( 6, 10 ] 4453 1.776% 99.467% ( 10, 15 ] 545 0.217% 99.684% ( 15, 22 ] 82 0.033% 99.717% ( 22, 34 ] 10 0.004% 99.721% ( 34, 51 ] 6 0.002% 99.723% ( 51, 76 ] 1 0.000% 99.724% ( 76, 110 ] 85 0.034% 99.757% ( 110, 170 ] 288 0.115% 99.872% ( 170, 250 ] 142 0.057% 99.929% ( 250, 380 ] 88 0.035% 99.964% ( 380, 580 ] 53 0.021% 99.985% ( 580, 870 ] 51 0.020% 100.006% ( 870, 1300 ] 25 0.010% 100.016% ( 1300, 1900 ] 13 0.005% 100.021% ( 1900, 2900 ] 6 0.002% 100.023% ( 2900, 4400 ] 2 0.001% 100.024% ( 4400, 6600 ] 6 0.002% 100.026% ( 6600, 9900 ] 9 0.004% 100.030% ** Level 4 read latency histogram (micros): Count: 310 Average: 294.5290 StdDev: 1256.01 Min: 1 Median: 1.8070 Max: 9248 Percentiles: P50: 1.81 P75: 6.07 P99: 7342.50 P99.9: 9248.00 P99.99: 9248.00 ------------------------------------------------------ [ 0, 1 ] 63 20.323% 20.323% #### ( 1, 2 ] 114 36.774% 57.097% ####### ( 2, 3 ] 36 11.613% 68.710% ## ( 3, 4 ] 10 3.226% 71.935% # ( 4, 6 ] 9 2.903% 74.839% # ( 6, 10 ] 28 9.032% 83.871% ## ( 10, 15 ] 16 5.161% 89.032% # ( 15, 22 ] 3 0.968% 90.000% ( 51, 76 ] 1 0.323% 90.323% ( 110, 170 ] 1 0.323% 90.645% ( 170, 250 ] 3 0.968% 91.613% ( 250, 380 ] 1 0.323% 91.935% ( 380, 580 ] 3 0.968% 92.903% ( 580, 870 ] 1 0.323% 93.226% ( 870, 1300 ] 2 0.645% 93.871% ( 1300, 1900 ] 4 1.290% 95.161% ( 1900, 2900 ] 4 1.290% 96.452% ( 2900, 4400 ] 2 0.645% 97.097% ( 4400, 6600 ] 5 1.613% 98.710% ( 6600, 9900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 948.1000 StdDev: 1001.07 Min: 93 Median: 480.0000 Max: 3337 Percentiles: P50: 480.00 P75: 1300.00 P99: 3337.00 P99.9: 3337.00 P99.99: 3337.00 ------------------------------------------------------ ( 76, 110 ] 8 20.000% 20.000% #### ( 110, 170 ] 1 2.500% 22.500% # ( 170, 250 ] 2 5.000% 27.500% # ( 250, 380 ] 6 15.000% 42.500% ### ( 380, 580 ] 6 15.000% 57.500% ### ( 580, 870 ] 3 7.500% 65.000% ## ( 870, 1300 ] 4 10.000% 75.000% ## ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 6 15.000% 92.500% ### ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 12.3 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 319.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.875 H:M:S, 15.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 291.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.796 H:M:S, 23.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-23:14:30 ... thread 0: (1000000,5000000) ops and (123356.9,247432.8) ops/second in (8.106559,20.207503) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 4.24 GB 175.8 4.6 0.0 4.6 9.3 4.7 0.0 2.0 149.3 304.3 31.23 29.34 82 0.381 4732K 7892 0.0 0.0 L1 1/1 2.71 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 240.3 240.0 1.31 1.27 1 1.311 319K 416 0.0 0.0 L2 1/0 96.77 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 248.3 248.2 1.40 1.34 2 0.701 353K 199 0.0 0.0 L3 19/0 843.54 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.5 239.9 239.5 4.40 4.04 2 2.201 1072K 1585 0.0 0.0 L4 169/0 9.40 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 127.3 127.3 1.32 0.90 1 1.322 170K 0 0.0 0.0 L5 1044/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/13 100.86 GB 0.0 6.4 0.9 5.5 11.1 5.6 1.7 2.3 165.1 287.1 39.66 36.89 88 0.451 6649K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 0.9 5.5 11.1 5.6 1.6 2.3 165.1 287.1 39.66 36.89 88 0.451 6649K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 0.9 5.5 6.4 0.9 0.0 0.0 251.8 251.4 26.00 24.75 20 1.300 6649K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.0 13.66 12.14 68 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.4 total, 20.2 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.12 GB write, 557.23 MB/s write, 6.39 GB read, 320.39 MB/s read, 39.7 seconds Interval compaction: 11.12 GB write, 563.55 MB/s write, 6.39 GB read, 324.02 MB/s read, 39.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 16, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1925878 Average: 2.2877 StdDev: 10.46 Min: 0 Median: 1.5326 Max: 4278 Percentiles: P50: 1.53 P75: 1.90 P99: 5.79 P99.9: 12.59 P99.99: 117.14 ------------------------------------------------------ [ 0, 1 ] 268959 13.966% 13.966% ### ( 1, 2 ] 1302935 67.654% 81.620% ############## ( 2, 3 ] 243378 12.637% 94.257% ### ( 3, 4 ] 57728 2.997% 97.254% # ( 4, 6 ] 37613 1.953% 99.207% ( 6, 10 ] 12096 0.628% 99.835% ( 10, 15 ] 2406 0.125% 99.960% ( 15, 22 ] 215 0.011% 99.972% ( 22, 34 ] 20 0.001% 99.973% ( 34, 51 ] 10 0.001% 99.973% ( 51, 76 ] 7 0.000% 99.973% ( 76, 110 ] 283 0.015% 99.988% ( 110, 170 ] 306 0.016% 100.004% ( 170, 250 ] 116 0.006% 100.010% ( 250, 380 ] 67 0.003% 100.014% ( 380, 580 ] 84 0.004% 100.018% ( 580, 870 ] 32 0.002% 100.020% ( 870, 1300 ] 25 0.001% 100.021% ( 1300, 1900 ] 6 0.000% 100.021% ( 1900, 2900 ] 6 0.000% 100.021% ( 2900, 4400 ] 7 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 12247 Average: 4.5534 StdDev: 89.74 Min: 0 Median: 1.2960 Max: 7426 Percentiles: P50: 1.30 P75: 1.71 P99: 10.07 P99.9: 417.65 P99.99: 6105.66 ------------------------------------------------------ [ 0, 1 ] 3947 32.228% 32.228% ###### ( 1, 2 ] 7354 60.047% 92.276% ############ ( 2, 3 ] 490 4.001% 96.277% # ( 3, 4 ] 104 0.849% 97.126% ( 4, 6 ] 102 0.833% 97.959% ( 6, 10 ] 127 1.037% 98.996% ( 10, 15 ] 37 0.302% 99.298% ( 15, 22 ] 6 0.049% 99.347% ( 34, 51 ] 3 0.024% 99.371% ( 51, 76 ] 24 0.196% 99.567% ( 76, 110 ] 11 0.090% 99.657% ( 110, 170 ] 14 0.114% 99.771% ( 170, 250 ] 8 0.065% 99.837% ( 250, 380 ] 7 0.057% 99.894% ( 380, 580 ] 4 0.033% 99.927% ( 580, 870 ] 1 0.008% 99.935% ( 870, 1300 ] 3 0.024% 99.959% ( 1900, 2900 ] 3 0.024% 99.984% ( 4400, 6600 ] 1 0.008% 99.992% ( 6600, 9900 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 88370 Average: 2.1352 StdDev: 5.01 Min: 0 Median: 1.4897 Max: 881 Percentiles: P50: 1.49 P75: 1.87 P99: 5.53 P99.9: 9.94 P99.99: 133.26 ------------------------------------------------------ [ 0, 1 ] 15709 17.776% 17.776% #### ( 1, 2 ] 58148 65.801% 83.577% ############# ( 2, 3 ] 9512 10.764% 94.341% ## ( 3, 4 ] 2825 3.197% 97.538% # ( 4, 6 ] 1686 1.908% 99.446% ( 6, 10 ] 408 0.462% 99.907% ( 10, 15 ] 64 0.072% 99.980% ( 15, 22 ] 6 0.007% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 3 0.003% 99.992% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250704 Average: 3.8246 StdDev: 62.74 Min: 1 Median: 1.6832 Max: 9650 Percentiles: P50: 1.68 P75: 2.26 P99: 8.95 P99.9: 209.04 P99.99: 647.83 ------------------------------------------------------ [ 0, 1 ] 17934 7.153% 7.153% # ( 1, 2 ] 157221 62.712% 69.865% ############# ( 2, 3 ] 49431 19.717% 89.582% #### ( 3, 4 ] 10936 4.362% 93.944% # ( 4, 6 ] 9392 3.746% 97.691% # ( 6, 10 ] 4453 1.776% 99.467% ( 10, 15 ] 545 0.217% 99.684% ( 15, 22 ] 82 0.033% 99.717% ( 22, 34 ] 10 0.004% 99.721% ( 34, 51 ] 6 0.002% 99.723% ( 51, 76 ] 1 0.000% 99.724% ( 76, 110 ] 85 0.034% 99.757% ( 110, 170 ] 288 0.115% 99.872% ( 170, 250 ] 142 0.057% 99.929% ( 250, 380 ] 88 0.035% 99.964% ( 380, 580 ] 53 0.021% 99.985% ( 580, 870 ] 51 0.020% 100.006% ( 870, 1300 ] 25 0.010% 100.016% ( 1300, 1900 ] 13 0.005% 100.021% ( 1900, 2900 ] 6 0.002% 100.023% ( 2900, 4400 ] 2 0.001% 100.024% ( 4400, 6600 ] 6 0.002% 100.026% ( 6600, 9900 ] 9 0.004% 100.030% ** Level 4 read latency histogram (micros): Count: 310 Average: 294.5290 StdDev: 1256.01 Min: 1 Median: 1.8070 Max: 9248 Percentiles: P50: 1.81 P75: 6.07 P99: 7342.50 P99.9: 9248.00 P99.99: 9248.00 ------------------------------------------------------ [ 0, 1 ] 63 20.323% 20.323% #### ( 1, 2 ] 114 36.774% 57.097% ####### ( 2, 3 ] 36 11.613% 68.710% ## ( 3, 4 ] 10 3.226% 71.935% # ( 4, 6 ] 9 2.903% 74.839% # ( 6, 10 ] 28 9.032% 83.871% ## ( 10, 15 ] 16 5.161% 89.032% # ( 15, 22 ] 3 0.968% 90.000% ( 51, 76 ] 1 0.323% 90.323% ( 110, 170 ] 1 0.323% 90.645% ( 170, 250 ] 3 0.968% 91.613% ( 250, 380 ] 1 0.323% 91.935% ( 380, 580 ] 3 0.968% 92.903% ( 580, 870 ] 1 0.323% 93.226% ( 870, 1300 ] 2 0.645% 93.871% ( 1300, 1900 ] 4 1.290% 95.161% ( 1900, 2900 ] 4 1.290% 96.452% ( 2900, 4400 ] 2 0.645% 97.097% ( 4400, 6600 ] 5 1.613% 98.710% ( 6600, 9900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 948.1000 StdDev: 1001.07 Min: 93 Median: 480.0000 Max: 3337 Percentiles: P50: 480.00 P75: 1300.00 P99: 3337.00 P99.9: 3337.00 P99.99: 3337.00 ------------------------------------------------------ ( 76, 110 ] 8 20.000% 20.000% #### ( 110, 170 ] 1 2.500% 22.500% # ( 170, 250 ] 2 5.000% 27.500% # ( 250, 380 ] 6 15.000% 42.500% ### ( 380, 580 ] 6 15.000% 57.500% ### ( 580, 870 ] 3 7.500% 65.000% ## ( 870, 1300 ] 4 10.000% 75.000% ## ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 6 15.000% 92.500% ### ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 20.4 total, 8.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 240.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.183 H:M:S, 35.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 121.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.308 H:M:S, 65.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-23:14:33 ... thread 0: (1000000,6000000) ops and (310272.4,256076.7) ops/second in (3.222974,23.430477) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 2.58 GB 31.5 5.0 0.0 5.0 10.6 5.6 0.0 1.9 144.8 305.3 35.67 33.45 97 0.368 5244K 8373 0.0 0.0 L1 13/13 1.49 GB 0.0 2.8 2.8 0.0 2.8 2.8 0.2 1.0 228.1 225.6 12.71 12.30 2 6.353 2942K 31K 0.0 0.0 L2 8/4 1.01 GB 5.2 0.3 0.2 0.2 0.3 0.2 1.4 1.8 248.3 248.2 1.40 1.34 2 0.701 353K 199 0.0 0.0 L3 19/1 940.24 MB 0.8 1.1 0.3 0.8 1.1 0.3 0.2 3.5 228.7 228.4 5.12 4.58 3 1.707 1189K 1647 0.0 0.0 L4 169/0 9.40 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 127.3 127.3 1.32 0.90 1 1.322 170K 0 0.0 0.0 L5 1044/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/29 101.69 GB 0.0 9.5 3.5 6.0 15.1 9.1 2.7 2.7 173.4 274.7 56.22 52.56 105 0.535 9901K 41K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.5 3.5 6.0 15.1 9.1 2.6 2.7 173.4 274.7 56.22 52.56 105 0.535 9901K 41K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.5 3.5 6.0 9.5 3.5 0.0 0.0 243.3 242.3 40.07 38.23 24 1.670 9901K 41K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 354.9 16.15 14.33 81 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.7 total, 23.4 interval Flush(GB): cumulative 5.599, interval 5.599 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.08 GB write, 652.63 MB/s write, 9.52 GB read, 412.11 MB/s read, 56.2 seconds Interval compaction: 15.08 GB write, 659.01 MB/s write, 9.52 GB read, 416.14 MB/s read, 56.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 18, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2234093 Average: 2.3272 StdDev: 11.39 Min: 0 Median: 1.5458 Max: 4278 Percentiles: P50: 1.55 P75: 1.92 P99: 5.83 P99.9: 12.56 P99.99: 119.10 ------------------------------------------------------ [ 0, 1 ] 293458 13.135% 13.135% ### ( 1, 2 ] 1508864 67.538% 80.674% ############## ( 2, 3 ] 296303 13.263% 93.936% ### ( 3, 4 ] 70834 3.171% 97.107% # ( 4, 6 ] 46125 2.065% 99.172% ( 6, 10 ] 14844 0.664% 99.836% ( 10, 15 ] 2796 0.125% 99.961% ( 15, 22 ] 248 0.011% 99.972% ( 22, 34 ] 24 0.001% 99.973% ( 34, 51 ] 13 0.001% 99.974% ( 51, 76 ] 7 0.000% 99.974% ( 76, 110 ] 304 0.014% 99.988% ( 110, 170 ] 327 0.015% 100.002% ( 170, 250 ] 142 0.006% 100.009% ( 250, 380 ] 89 0.004% 100.013% ( 380, 580 ] 118 0.005% 100.018% ( 580, 870 ] 51 0.002% 100.020% ( 870, 1300 ] 33 0.001% 100.022% ( 1300, 1900 ] 11 0.000% 100.022% ( 1900, 2900 ] 8 0.000% 100.023% ( 2900, 4400 ] 9 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 171245 Average: 3.5364 StdDev: 33.09 Min: 0 Median: 1.6891 Max: 7426 Percentiles: P50: 1.69 P75: 2.25 P99: 8.92 P99.9: 254.71 P99.99: 751.06 ------------------------------------------------------ [ 0, 1 ] 10180 5.945% 5.945% # ( 1, 2 ] 109482 63.933% 69.878% ############# ( 2, 3 ] 34970 20.421% 90.299% #### ( 3, 4 ] 7443 4.346% 94.645% # ( 4, 6 ] 5296 3.093% 97.738% # ( 6, 10 ] 2960 1.729% 99.466% ( 10, 15 ] 317 0.185% 99.651% ( 15, 22 ] 28 0.016% 99.668% ( 22, 34 ] 2 0.001% 99.669% ( 34, 51 ] 3 0.002% 99.671% ( 51, 76 ] 24 0.014% 99.685% ( 76, 110 ] 116 0.068% 99.752% ( 110, 170 ] 165 0.096% 99.849% ( 170, 250 ] 85 0.050% 99.898% ( 250, 380 ] 76 0.044% 99.943% ( 380, 580 ] 62 0.036% 99.979% ( 580, 870 ] 32 0.019% 99.998% ( 870, 1300 ] 23 0.013% 100.011% ( 1300, 1900 ] 10 0.006% 100.017% ( 1900, 2900 ] 3 0.002% 100.019% ( 4400, 6600 ] 1 0.001% 100.019% ( 6600, 9900 ] 1 0.001% 100.020% ** Level 2 read latency histogram (micros): Count: 88370 Average: 2.1352 StdDev: 5.01 Min: 0 Median: 1.4897 Max: 881 Percentiles: P50: 1.49 P75: 1.87 P99: 5.53 P99.9: 9.94 P99.99: 133.26 ------------------------------------------------------ [ 0, 1 ] 15709 17.776% 17.776% #### ( 1, 2 ] 58148 65.801% 83.577% ############# ( 2, 3 ] 9512 10.764% 94.341% ## ( 3, 4 ] 2825 3.197% 97.538% # ( 4, 6 ] 1686 1.908% 99.446% ( 6, 10 ] 408 0.462% 99.907% ( 10, 15 ] 64 0.072% 99.980% ( 15, 22 ] 6 0.007% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 3 0.003% 99.992% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255556 Average: 4.2324 StdDev: 63.46 Min: 0 Median: 1.6862 Max: 9650 Percentiles: P50: 1.69 P75: 2.27 P99: 9.34 P99.9: 305.85 P99.99: 742.90 ------------------------------------------------------ [ 0, 1 ] 18174 7.112% 7.112% # ( 1, 2 ] 159716 62.497% 69.609% ############ ( 2, 3 ] 50672 19.828% 89.437% #### ( 3, 4 ] 11111 4.348% 93.785% # ( 4, 6 ] 9530 3.729% 97.514% # ( 6, 10 ] 4549 1.780% 99.294% ( 10, 15 ] 555 0.217% 99.511% ( 15, 22 ] 85 0.033% 99.545% ( 22, 34 ] 11 0.004% 99.549% ( 34, 51 ] 6 0.002% 99.551% ( 51, 76 ] 1 0.000% 99.552% ( 76, 110 ] 178 0.070% 99.621% ( 110, 170 ] 416 0.163% 99.784% ( 170, 250 ] 232 0.091% 99.875% ( 250, 380 ] 150 0.059% 99.933% ( 380, 580 ] 104 0.041% 99.974% ( 580, 870 ] 72 0.028% 100.002% ( 870, 1300 ] 33 0.013% 100.015% ( 1300, 1900 ] 13 0.005% 100.020% ( 1900, 2900 ] 6 0.002% 100.023% ( 2900, 4400 ] 2 0.001% 100.023% ( 4400, 6600 ] 6 0.002% 100.026% ( 6600, 9900 ] 9 0.004% 100.029% ** Level 4 read latency histogram (micros): Count: 310 Average: 294.5290 StdDev: 1256.01 Min: 1 Median: 1.8070 Max: 9248 Percentiles: P50: 1.81 P75: 6.07 P99: 7342.50 P99.9: 9248.00 P99.99: 9248.00 ------------------------------------------------------ [ 0, 1 ] 63 20.323% 20.323% #### ( 1, 2 ] 114 36.774% 57.097% ####### ( 2, 3 ] 36 11.613% 68.710% ## ( 3, 4 ] 10 3.226% 71.935% # ( 4, 6 ] 9 2.903% 74.839% # ( 6, 10 ] 28 9.032% 83.871% ## ( 10, 15 ] 16 5.161% 89.032% # ( 15, 22 ] 3 0.968% 90.000% ( 51, 76 ] 1 0.323% 90.323% ( 110, 170 ] 1 0.323% 90.645% ( 170, 250 ] 3 0.968% 91.613% ( 250, 380 ] 1 0.323% 91.935% ( 380, 580 ] 3 0.968% 92.903% ( 580, 870 ] 1 0.323% 93.226% ( 870, 1300 ] 2 0.645% 93.871% ( 1300, 1900 ] 4 1.290% 95.161% ( 1900, 2900 ] 4 1.290% 96.452% ( 2900, 4400 ] 2 0.645% 97.097% ( 4400, 6600 ] 5 1.613% 98.710% ( 6600, 9900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 948.1000 StdDev: 1001.07 Min: 93 Median: 480.0000 Max: 3337 Percentiles: P50: 480.00 P75: 1300.00 P99: 3337.00 P99.9: 3337.00 P99.99: 3337.00 ------------------------------------------------------ ( 76, 110 ] 8 20.000% 20.000% #### ( 110, 170 ] 1 2.500% 22.500% # ( 170, 250 ] 2 5.000% 27.500% # ( 250, 380 ] 6 15.000% 42.500% ### ( 380, 580 ] 6 15.000% 57.500% ### ( 580, 870 ] 3 7.500% 65.000% ## ( 870, 1300 ] 4 10.000% 75.000% ## ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 6 15.000% 92.500% ### ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 23.7 total, 3.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 249.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.800 H:M:S, 33.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 305.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.617 H:M:S, 19.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/14-23:14:37 ... thread 0: (1000000,7000000) ops and (266783.4,257553.3) ops/second in (3.748359,27.178836) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.56 GB 132.2 5.9 0.0 5.9 12.5 6.6 0.0 1.9 143.5 303.3 42.13 39.44 114 0.370 6139K 9341 0.0 0.0 L1 13/13 1.49 GB 0.0 2.8 2.8 0.0 2.8 2.8 0.2 1.0 228.1 225.6 12.71 12.30 2 6.353 2942K 31K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 1.4 1.8 248.3 248.2 1.40 1.34 2 0.701 353K 199 0.0 0.0 L3 29/3 1.06 GB 1.0 2.5 1.3 1.2 2.5 1.3 0.2 1.9 219.1 218.7 11.74 10.74 7 1.678 2613K 4985 0.0 0.0 L4 177/3 9.64 GB 1.0 0.5 0.5 0.0 0.5 0.5 0.8 1.0 136.1 135.9 3.70 2.49 8 0.462 505K 439 0.0 0.0 L5 1052/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/30 102.67 GB 0.0 12.1 4.8 7.3 18.6 11.4 3.9 2.8 172.6 265.9 71.68 66.31 133 0.539 12M 46K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.1 4.8 7.3 18.6 11.4 3.8 2.8 172.6 265.9 71.68 66.31 133 0.539 12M 46K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.1 4.8 7.3 12.0 4.8 0.0 0.0 235.3 234.5 52.56 49.38 38 1.383 12M 46K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.5 19.12 16.92 95 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.4 total, 27.2 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.62 GB write, 695.53 MB/s write, 12.08 GB read, 451.31 MB/s read, 71.7 seconds Interval compaction: 18.62 GB write, 701.39 MB/s write, 12.08 GB read, 455.11 MB/s read, 71.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 26, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2645119 Average: 2.4042 StdDev: 11.81 Min: 0 Median: 1.5769 Max: 4278 Percentiles: P50: 1.58 P75: 1.95 P99: 5.93 P99.9: 12.73 P99.99: 112.09 ------------------------------------------------------ [ 0, 1 ] 308759 11.673% 11.673% ## ( 1, 2 ] 1757298 66.435% 78.108% ############# ( 2, 3 ] 389081 14.709% 92.818% ### ( 3, 4 ] 97616 3.690% 96.508% # ( 4, 6 ] 68335 2.583% 99.092% # ( 6, 10 ] 19387 0.733% 99.824% ( 10, 15 ] 3659 0.138% 99.963% ( 15, 22 ] 335 0.013% 99.975% ( 22, 34 ] 27 0.001% 99.976% ( 34, 51 ] 14 0.001% 99.977% ( 51, 76 ] 9 0.000% 99.977% ( 76, 110 ] 322 0.012% 99.990% ( 110, 170 ] 387 0.015% 100.004% ( 170, 250 ] 194 0.007% 100.011% ( 250, 380 ] 136 0.005% 100.017% ( 380, 580 ] 158 0.006% 100.023% ( 580, 870 ] 77 0.003% 100.026% ( 870, 1300 ] 45 0.002% 100.027% ( 1300, 1900 ] 16 0.001% 100.028% ( 1900, 2900 ] 10 0.000% 100.028% ( 2900, 4400 ] 10 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 387997 Average: 3.3957 StdDev: 26.99 Min: 0 Median: 1.7771 Max: 7426 Percentiles: P50: 1.78 P75: 2.49 P99: 8.99 P99.9: 164.15 P99.99: 467.92 ------------------------------------------------------ [ 0, 1 ] 13412 3.457% 3.457% # ( 1, 2 ] 232374 59.891% 63.347% ############ ( 2, 3 ] 92222 23.769% 87.116% ##### ( 3, 4 ] 22344 5.759% 92.875% # ( 4, 6 ] 17917 4.618% 97.493% # ( 6, 10 ] 7826 2.017% 99.510% ( 10, 15 ] 911 0.235% 99.745% ( 15, 22 ] 100 0.026% 99.770% ( 22, 34 ] 5 0.001% 99.772% ( 34, 51 ] 5 0.001% 99.773% ( 51, 76 ] 24 0.006% 99.779% ( 76, 110 ] 219 0.056% 99.836% ( 110, 170 ] 277 0.071% 99.907% ( 170, 250 ] 155 0.040% 99.947% ( 250, 380 ] 125 0.032% 99.979% ( 380, 580 ] 96 0.025% 100.004% ( 580, 870 ] 54 0.014% 100.018% ( 870, 1300 ] 32 0.008% 100.026% ( 1300, 1900 ] 14 0.004% 100.030% ( 1900, 2900 ] 8 0.002% 100.032% ( 2900, 4400 ] 1 0.000% 100.032% ( 4400, 6600 ] 1 0.000% 100.032% ( 6600, 9900 ] 1 0.000% 100.032% ** Level 2 read latency histogram (micros): Count: 88370 Average: 2.1352 StdDev: 5.01 Min: 0 Median: 1.4897 Max: 881 Percentiles: P50: 1.49 P75: 1.87 P99: 5.53 P99.9: 9.94 P99.99: 133.26 ------------------------------------------------------ [ 0, 1 ] 15709 17.776% 17.776% #### ( 1, 2 ] 58148 65.801% 83.577% ############# ( 2, 3 ] 9512 10.764% 94.341% ## ( 3, 4 ] 2825 3.197% 97.538% # ( 4, 6 ] 1686 1.908% 99.446% ( 6, 10 ] 408 0.462% 99.907% ( 10, 15 ] 64 0.072% 99.980% ( 15, 22 ] 6 0.007% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 3 0.003% 99.992% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 417293 Average: 4.3783 StdDev: 65.75 Min: 0 Median: 1.8025 Max: 9650 Percentiles: P50: 1.80 P75: 2.58 P99: 9.12 P99.9: 187.34 P99.99: 343.19 ------------------------------------------------------ [ 0, 1 ] 19341 4.635% 4.635% # ( 1, 2 ] 235895 56.530% 61.165% ########### ( 2, 3 ] 98848 23.688% 84.853% ##### ( 3, 4 ] 27625 6.620% 91.473% # ( 4, 6 ] 25590 6.132% 97.605% # ( 6, 10 ] 7476 1.792% 99.397% ( 10, 15 ] 1153 0.276% 99.673% ( 15, 22 ] 147 0.035% 99.708% ( 22, 34 ] 13 0.003% 99.711% ( 34, 51 ] 9 0.002% 99.713% ( 51, 76 ] 2 0.000% 99.714% ( 76, 110 ] 191 0.046% 99.760% ( 110, 170 ] 526 0.126% 99.886% ( 170, 250 ] 280 0.067% 99.953% ( 250, 380 ] 218 0.052% 100.005% ( 380, 580 ] 147 0.035% 100.040% ( 580, 870 ] 105 0.025% 100.065% ( 870, 1300 ] 45 0.011% 100.076% ( 1300, 1900 ] 17 0.004% 100.080% ( 1900, 2900 ] 13 0.003% 100.083% ( 2900, 4400 ] 28 0.007% 100.090% ( 4400, 6600 ] 8 0.002% 100.092% ( 6600, 9900 ] 14 0.003% 100.095% ** Level 4 read latency histogram (micros): Count: 6919 Average: 61.5203 StdDev: 381.28 Min: 1 Median: 2.1527 Max: 9248 Percentiles: P50: 2.15 P75: 3.34 P99: 1088.81 P99.9: 5797.28 P99.99: 8783.35 ------------------------------------------------------ [ 0, 1 ] 137 1.980% 1.980% ( 1, 2 ] 3054 44.139% 46.119% ######### ( 2, 3 ] 1758 25.408% 71.528% ##### ( 3, 4 ] 697 10.074% 81.601% ## ( 4, 6 ] 434 6.273% 87.874% # ( 6, 10 ] 159 2.298% 90.172% ( 10, 15 ] 54 0.780% 90.952% ( 15, 22 ] 6 0.087% 91.039% ( 51, 76 ] 1 0.014% 91.054% ( 76, 110 ] 30 0.434% 91.487% ( 110, 170 ] 108 1.561% 93.048% ( 170, 250 ] 96 1.387% 94.436% ( 250, 380 ] 97 1.402% 95.838% ( 380, 580 ] 126 1.821% 97.659% ( 580, 870 ] 75 1.084% 98.743% ( 870, 1300 ] 35 0.506% 99.248% ( 1300, 1900 ] 13 0.188% 99.436% ( 1900, 2900 ] 10 0.145% 99.581% ( 2900, 4400 ] 17 0.246% 99.827% ( 4400, 6600 ] 8 0.116% 99.942% ( 6600, 9900 ] 5 0.072% 100.014% ** Level 5 read latency histogram (micros): Count: 80 Average: 933.0250 StdDev: 1046.17 Min: 81 Median: 416.3636 Max: 4326 Percentiles: P50: 416.36 P75: 1500.00 P99: 4160.00 P99.9: 4326.00 P99.99: 4326.00 ------------------------------------------------------ ( 76, 110 ] 14 17.500% 17.500% #### ( 110, 170 ] 9 11.250% 28.750% ## ( 170, 250 ] 5 6.250% 35.000% # ( 250, 380 ] 10 12.500% 47.500% ### ( 380, 580 ] 11 13.750% 61.250% ### ( 580, 870 ] 4 5.000% 66.250% # ( 870, 1300 ] 6 7.500% 73.750% ## ( 1300, 1900 ] 3 3.750% 77.500% # ( 1900, 2900 ] 13 16.250% 93.750% ### ( 2900, 4400 ] 5 6.250% 100.000% # ** DB Stats ** Uptime(secs): 27.4 total, 3.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 251.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.760 H:M:S, 32.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 262.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.960 H:M:S, 25.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/07/14-23:14:41 ... thread 0: (1000000,8000000) ops and (231684.2,254008.1) ops/second in (4.316220,31.495056) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/7 4.54 GB 264.3 7.3 0.0 7.3 14.8 7.6 0.0 2.0 147.1 300.2 50.53 47.19 134 0.377 7547K 10K 0.0 0.0 L1 13/13 1.49 GB 0.0 2.8 2.8 0.0 2.8 2.8 0.2 1.0 228.1 225.6 12.71 12.30 2 6.353 2942K 31K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 1.4 1.8 248.3 248.2 1.40 1.34 2 0.701 353K 199 0.0 0.0 L3 26/0 955.05 MB 1.0 2.5 1.3 1.2 2.5 1.3 0.2 1.9 219.1 218.7 11.74 10.74 7 1.678 2613K 4985 0.0 0.0 L4 176/0 9.40 GB 1.0 0.6 0.6 0.0 0.6 0.6 0.8 1.0 131.4 131.3 4.54 2.96 10 0.454 600K 605 0.0 0.0 L5 1056/0 87.29 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/20 103.66 GB 0.0 13.5 4.9 8.6 21.0 12.4 4.3 2.8 171.1 266.3 80.92 74.52 155 0.522 14M 47K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.5 4.9 8.6 21.0 12.4 4.2 2.8 171.1 266.3 80.92 74.52 155 0.522 14M 47K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.5 4.9 8.6 13.5 4.9 0.0 0.0 235.7 234.9 58.76 55.05 45 1.306 14M 47K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 349.6 22.17 19.48 110 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.7 total, 31.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.04 GB write, 679.25 MB/s write, 13.52 GB read, 436.54 MB/s read, 80.9 seconds Interval compaction: 21.04 GB write, 684.19 MB/s write, 13.52 GB read, 439.71 MB/s read, 80.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 28, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3025933 Average: 2.4031 StdDev: 11.87 Min: 0 Median: 1.5765 Max: 4278 Percentiles: P50: 1.58 P75: 1.95 P99: 5.92 P99.9: 12.69 P99.99: 117.07 ------------------------------------------------------ [ 0, 1 ] 352551 11.651% 11.651% ## ( 1, 2 ] 2012814 66.519% 78.170% ############# ( 2, 3 ] 446364 14.751% 92.921% ### ( 3, 4 ] 109540 3.620% 96.541% # ( 4, 6 ] 77537 2.562% 99.104% # ( 6, 10 ] 21920 0.724% 99.828% ( 10, 15 ] 4056 0.134% 99.962% ( 15, 22 ] 362 0.012% 99.974% ( 22, 34 ] 29 0.001% 99.975% ( 34, 51 ] 17 0.001% 99.975% ( 51, 76 ] 10 0.000% 99.976% ( 76, 110 ] 380 0.013% 99.988% ( 110, 170 ] 436 0.014% 100.003% ( 170, 250 ] 224 0.007% 100.010% ( 250, 380 ] 165 0.005% 100.016% ( 380, 580 ] 179 0.006% 100.022% ( 580, 870 ] 93 0.003% 100.025% ( 870, 1300 ] 50 0.002% 100.026% ( 1300, 1900 ] 18 0.001% 100.027% ( 1900, 2900 ] 10 0.000% 100.027% ( 2900, 4400 ] 13 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 523969 Average: 3.2449 StdDev: 24.54 Min: 0 Median: 1.7288 Max: 7426 Percentiles: P50: 1.73 P75: 2.38 P99: 8.86 P99.9: 166.13 P99.99: 481.92 ------------------------------------------------------ [ 0, 1 ] 27704 5.287% 5.287% # ( 1, 2 ] 321461 61.351% 66.638% ############ ( 2, 3 ] 114831 21.916% 88.554% #### ( 3, 4 ] 26051 4.972% 93.526% # ( 4, 6 ] 21581 4.119% 97.645% # ( 6, 10 ] 9944 1.898% 99.543% ( 10, 15 ] 1061 0.202% 99.745% ( 15, 22 ] 120 0.023% 99.768% ( 22, 34 ] 6 0.001% 99.769% ( 34, 51 ] 6 0.001% 99.770% ( 51, 76 ] 26 0.005% 99.775% ( 76, 110 ] 292 0.056% 99.831% ( 110, 170 ] 387 0.074% 99.905% ( 170, 250 ] 217 0.041% 99.946% ( 250, 380 ] 171 0.033% 99.979% ( 380, 580 ] 115 0.022% 100.001% ( 580, 870 ] 62 0.012% 100.013% ( 870, 1300 ] 33 0.006% 100.019% ( 1300, 1900 ] 14 0.003% 100.022% ( 1900, 2900 ] 9 0.002% 100.023% ( 2900, 4400 ] 2 0.000% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ( 6600, 9900 ] 1 0.000% 100.024% ** Level 2 read latency histogram (micros): Count: 88370 Average: 2.1352 StdDev: 5.01 Min: 0 Median: 1.4897 Max: 881 Percentiles: P50: 1.49 P75: 1.87 P99: 5.53 P99.9: 9.94 P99.99: 133.26 ------------------------------------------------------ [ 0, 1 ] 15709 17.776% 17.776% #### ( 1, 2 ] 58148 65.801% 83.577% ############# ( 2, 3 ] 9512 10.764% 94.341% ## ( 3, 4 ] 2825 3.197% 97.538% # ( 4, 6 ] 1686 1.908% 99.446% ( 6, 10 ] 408 0.462% 99.907% ( 10, 15 ] 64 0.072% 99.980% ( 15, 22 ] 6 0.007% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 3 0.003% 99.992% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 418935 Average: 4.3719 StdDev: 65.62 Min: 0 Median: 1.8029 Max: 9650 Percentiles: P50: 1.80 P75: 2.58 P99: 9.11 P99.9: 186.88 P99.99: 343.09 ------------------------------------------------------ [ 0, 1 ] 19357 4.621% 4.621% # ( 1, 2 ] 236789 56.522% 61.142% ########### ( 2, 3 ] 99380 23.722% 84.864% ##### ( 3, 4 ] 27698 6.612% 91.476% # ( 4, 6 ] 25680 6.130% 97.606% # ( 6, 10 ] 7503 1.791% 99.397% ( 10, 15 ] 1161 0.277% 99.674% ( 15, 22 ] 148 0.035% 99.709% ( 22, 34 ] 13 0.003% 99.712% ( 34, 51 ] 9 0.002% 99.714% ( 51, 76 ] 2 0.000% 99.715% ( 76, 110 ] 191 0.046% 99.760% ( 110, 170 ] 526 0.126% 99.886% ( 170, 250 ] 280 0.067% 99.953% ( 250, 380 ] 218 0.052% 100.005% ( 380, 580 ] 147 0.035% 100.040% ( 580, 870 ] 105 0.025% 100.065% ( 870, 1300 ] 45 0.011% 100.076% ( 1300, 1900 ] 17 0.004% 100.080% ( 1900, 2900 ] 13 0.003% 100.083% ( 2900, 4400 ] 28 0.007% 100.090% ( 4400, 6600 ] 8 0.002% 100.091% ( 6600, 9900 ] 14 0.003% 100.095% ** Level 4 read latency histogram (micros): Count: 7041 Average: 60.7351 StdDev: 378.35 Min: 1 Median: 2.1413 Max: 9248 Percentiles: P50: 2.14 P75: 3.32 P99: 1086.11 P99.9: 5763.73 P99.99: 8775.29 ------------------------------------------------------ [ 0, 1 ] 141 2.003% 2.003% ( 1, 2 ] 3127 44.411% 46.414% ######### ( 2, 3 ] 1787 25.380% 71.794% ##### ( 3, 4 ] 702 9.970% 81.764% ## ( 4, 6 ] 437 6.207% 87.970% # ( 6, 10 ] 163 2.315% 90.285% ( 10, 15 ] 54 0.767% 91.052% ( 15, 22 ] 6 0.085% 91.138% ( 22, 34 ] 1 0.014% 91.152% ( 51, 76 ] 1 0.014% 91.166% ( 76, 110 ] 30 0.426% 91.592% ( 110, 170 ] 110 1.562% 93.154% ( 170, 250 ] 96 1.363% 94.518% ( 250, 380 ] 97 1.378% 95.895% ( 380, 580 ] 126 1.790% 97.685% ( 580, 870 ] 75 1.065% 98.750% ( 870, 1300 ] 35 0.497% 99.247% ( 1300, 1900 ] 14 0.199% 99.446% ( 1900, 2900 ] 10 0.142% 99.588% ( 2900, 4400 ] 17 0.241% 99.830% ( 4400, 6600 ] 8 0.114% 99.943% ( 6600, 9900 ] 5 0.071% 100.014% ** Level 5 read latency histogram (micros): Count: 100 Average: 916.4700 StdDev: 1067.39 Min: 78 Median: 380.0000 Max: 4326 Percentiles: P50: 380.00 P75: 1420.00 P99: 4212.50 P99.9: 4326.00 P99.99: 4326.00 ------------------------------------------------------ ( 76, 110 ] 17 17.000% 17.000% ### ( 110, 170 ] 15 15.000% 32.000% ### ( 170, 250 ] 7 7.000% 39.000% # ( 250, 380 ] 11 11.000% 50.000% ## ( 380, 580 ] 12 12.000% 62.000% ## ( 580, 870 ] 6 6.000% 68.000% # ( 870, 1300 ] 6 6.000% 74.000% # ( 1300, 1900 ] 5 5.000% 79.000% # ( 1900, 2900 ] 13 13.000% 92.000% ### ( 2900, 4400 ] 8 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 31.7 total, 4.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 248.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.513 H:M:S, 33.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 228.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.752 H:M:S, 40.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-23:14:57 ... thread 0: (1000000,9000000) ops and (64760.3,191748.0) ops/second in (15.441552,46.936608) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 3.56 GB 25.2 9.0 0.0 9.0 17.6 8.5 0.0 2.1 149.2 290.0 62.06 56.91 151 0.411 9400K 18K 0.0 0.0 L1 10/10 1.14 GB 0.0 6.3 4.8 1.5 6.2 4.7 0.2 1.3 217.1 214.5 29.62 27.79 3 9.873 6492K 39K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 3.6 1.8 248.3 248.2 1.40 1.34 2 0.701 353K 199 0.0 0.0 L3 18/0 937.34 MB 0.9 6.1 3.6 2.5 6.1 3.6 0.2 1.7 192.1 191.3 32.54 27.61 19 1.712 6346K 25K 0.0 0.0 L4 182/0 9.69 GB 1.0 2.9 2.8 0.1 2.9 2.8 0.8 1.0 143.6 143.4 20.92 14.15 40 0.523 2976K 1797 0.0 0.0 L5 1080/0 89.26 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/24 104.56 GB 0.0 24.7 11.4 13.3 33.1 19.8 8.5 3.9 172.6 231.5 146.54 127.80 215 0.682 25M 85K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.7 11.4 13.3 33.1 19.8 8.4 3.9 172.6 231.5 146.54 127.80 215 0.682 25M 85K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.7 11.4 13.3 24.6 11.3 0.0 0.0 209.8 208.8 120.54 105.68 91 1.325 25M 85K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 336.8 26.00 22.12 124 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.2 total, 46.9 interval Flush(GB): cumulative 8.552, interval 8.552 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.13 GB write, 719.15 MB/s write, 24.70 GB read, 536.18 MB/s read, 146.5 seconds Interval compaction: 33.13 GB write, 722.66 MB/s write, 24.70 GB read, 538.80 MB/s read, 146.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 41, pending-compaction-bytes-stops: 0, total-delays: 59, total-stops: 40, interval: 99 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4143620 Average: 2.8637 StdDev: 20.96 Min: 0 Median: 1.6112 Max: 8179 Percentiles: P50: 1.61 P75: 2.00 P99: 7.53 P99.9: 139.46 P99.99: 328.01 ------------------------------------------------------ [ 0, 1 ] 439347 10.603% 10.603% ## ( 1, 2 ] 2671075 64.462% 75.065% ############# ( 2, 3 ] 669752 16.163% 91.229% ### ( 3, 4 ] 167269 4.037% 95.266% # ( 4, 6 ] 138928 3.353% 98.618% # ( 6, 10 ] 41291 0.996% 99.615% ( 10, 15 ] 6744 0.163% 99.778% ( 15, 22 ] 693 0.017% 99.794% ( 22, 34 ] 48 0.001% 99.796% ( 34, 51 ] 22 0.001% 99.796% ( 51, 76 ] 16 0.000% 99.796% ( 76, 110 ] 2069 0.050% 99.846% ( 110, 170 ] 4531 0.109% 99.956% ( 170, 250 ] 1041 0.025% 99.981% ( 250, 380 ] 636 0.015% 99.996% ( 380, 580 ] 615 0.015% 100.011% ( 580, 870 ] 303 0.007% 100.018% ( 870, 1300 ] 162 0.004% 100.022% ( 1300, 1900 ] 51 0.001% 100.023% ( 1900, 2900 ] 37 0.001% 100.024% ( 2900, 4400 ] 43 0.001% 100.025% ( 4400, 6600 ] 10 0.000% 100.026% ( 6600, 9900 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1326985 Average: 4.2712 StdDev: 55.16 Min: 0 Median: 1.8332 Max: 15639 Percentiles: P50: 1.83 P75: 2.66 P99: 9.36 P99.9: 181.85 P99.99: 478.59 ------------------------------------------------------ [ 0, 1 ] 55636 4.193% 4.193% # ( 1, 2 ] 729587 54.981% 59.173% ########### ( 2, 3 ] 317826 23.951% 83.124% ##### ( 3, 4 ] 93232 7.026% 90.150% # ( 4, 6 ] 91868 6.923% 97.073% # ( 6, 10 ] 30409 2.292% 99.365% ( 10, 15 ] 4415 0.333% 99.698% ( 15, 22 ] 568 0.043% 99.740% ( 22, 34 ] 29 0.002% 99.743% ( 34, 51 ] 8 0.001% 99.743% ( 51, 76 ] 35 0.003% 99.746% ( 76, 110 ] 822 0.062% 99.808% ( 110, 170 ] 1147 0.086% 99.894% ( 170, 250 ] 513 0.039% 99.933% ( 250, 380 ] 534 0.040% 99.973% ( 380, 580 ] 453 0.034% 100.007% ( 580, 870 ] 351 0.026% 100.034% ( 870, 1300 ] 233 0.018% 100.051% ( 1300, 1900 ] 106 0.008% 100.059% ( 1900, 2900 ] 80 0.006% 100.065% ( 2900, 4400 ] 71 0.005% 100.071% ( 4400, 6600 ] 19 0.001% 100.072% ( 6600, 9900 ] 12 0.001% 100.073% ( 9900, 14000 ] 2 0.000% 100.073% ( 14000, 22000 ] 1 0.000% 100.073% ** Level 2 read latency histogram (micros): Count: 88370 Average: 2.1352 StdDev: 5.01 Min: 0 Median: 1.4897 Max: 881 Percentiles: P50: 1.49 P75: 1.87 P99: 5.53 P99.9: 9.94 P99.99: 133.26 ------------------------------------------------------ [ 0, 1 ] 15709 17.776% 17.776% #### ( 1, 2 ] 58148 65.801% 83.577% ############# ( 2, 3 ] 9512 10.764% 94.341% ## ( 3, 4 ] 2825 3.197% 97.538% # ( 4, 6 ] 1686 1.908% 99.446% ( 6, 10 ] 408 0.462% 99.907% ( 10, 15 ] 64 0.072% 99.980% ( 15, 22 ] 6 0.007% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 3 0.003% 99.992% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1324597 Average: 4.8353 StdDev: 63.75 Min: 0 Median: 2.0533 Max: 9650 Percentiles: P50: 2.05 P75: 2.94 P99: 9.10 P99.9: 18.30 P99.99: 154.51 ------------------------------------------------------ [ 0, 1 ] 22994 1.736% 1.736% ( 1, 2 ] 619359 46.758% 48.494% ######### ( 2, 3 ] 374487 28.272% 76.766% ###### ( 3, 4 ] 131530 9.930% 86.696% ## ( 4, 6 ] 141050 10.649% 97.344% ## ( 6, 10 ] 28288 2.136% 99.480% ( 10, 15 ] 5263 0.397% 99.877% ( 15, 22 ] 640 0.048% 99.926% ( 22, 34 ] 32 0.002% 99.928% ( 34, 51 ] 15 0.001% 99.929% ( 51, 76 ] 48 0.004% 99.933% ( 76, 110 ] 240 0.018% 99.951% ( 110, 170 ] 699 0.053% 100.004% ( 170, 250 ] 492 0.037% 100.041% ( 250, 380 ] 508 0.038% 100.079% ( 380, 580 ] 508 0.038% 100.117% ( 580, 870 ] 473 0.036% 100.153% ( 870, 1300 ] 283 0.021% 100.175% ( 1300, 1900 ] 132 0.010% 100.185% ( 1900, 2900 ] 97 0.007% 100.192% ( 2900, 4400 ] 127 0.010% 100.201% ( 4400, 6600 ] 32 0.002% 100.204% ( 6600, 9900 ] 19 0.001% 100.205% ** Level 4 read latency histogram (micros): Count: 30684 Average: 69.5030 StdDev: 345.49 Min: 1 Median: 2.2637 Max: 10923 Percentiles: P50: 2.26 P75: 3.46 P99: 1353.57 P99.9: 4283.42 P99.99: 6402.15 ------------------------------------------------------ [ 0, 1 ] 399 1.300% 1.300% ( 1, 2 ] 12770 41.618% 42.918% ######## ( 2, 3 ] 8241 26.858% 69.776% ##### ( 3, 4 ] 3464 11.289% 81.065% ## ( 4, 6 ] 2205 7.186% 88.251% # ( 6, 10 ] 717 2.337% 90.588% ( 10, 15 ] 152 0.495% 91.083% ( 15, 22 ] 23 0.075% 91.158% ( 22, 34 ] 16 0.052% 91.210% ( 34, 51 ] 6 0.020% 91.230% ( 51, 76 ] 10 0.033% 91.263% ( 76, 110 ] 56 0.183% 91.445% ( 110, 170 ] 266 0.867% 92.312% ( 170, 250 ] 309 1.007% 93.319% ( 250, 380 ] 339 1.105% 94.424% ( 380, 580 ] 541 1.763% 96.187% ( 580, 870 ] 553 1.802% 97.989% ( 870, 1300 ] 299 0.974% 98.964% ( 1300, 1900 ] 125 0.407% 99.371% ( 1900, 2900 ] 83 0.270% 99.642% ( 2900, 4400 ] 86 0.280% 99.922% ( 4400, 6600 ] 23 0.075% 99.997% ( 6600, 9900 ] 6 0.020% 100.016% ( 9900, 14000 ] 1 0.003% 100.020% ** Level 5 read latency histogram (micros): Count: 220 Average: 1180.7318 StdDev: 1357.08 Min: 78 Median: 571.6667 Max: 7068 Percentiles: P50: 571.67 P75: 1766.67 P99: 6160.00 P99.9: 7068.00 P99.99: 7068.00 ------------------------------------------------------ ( 76, 110 ] 22 10.000% 10.000% ## ( 110, 170 ] 27 12.273% 22.273% ## ( 170, 250 ] 16 7.273% 29.545% # ( 250, 380 ] 22 10.000% 39.545% ## ( 380, 580 ] 24 10.909% 50.455% ## ( 580, 870 ] 20 9.091% 59.545% ## ( 870, 1300 ] 20 9.091% 68.636% ## ( 1300, 1900 ] 18 8.182% 76.818% ## ( 1900, 2900 ] 24 10.909% 87.727% ## ( 2900, 4400 ] 20 9.091% 96.818% ## ( 4400, 6600 ] 6 2.727% 99.545% # ( 6600, 9900 ] 1 0.455% 100.000% ** DB Stats ** Uptime(secs): 47.2 total, 15.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 187.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.900 H:M:S, 48.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 63.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.388 H:M:S, 80.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/14-23:15:00 ... thread 0: (1000000,10000000) ops and (333176.5,200248.2) ops/second in (3.001412,49.938020) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 4.48 GB 151.0 10.2 0.0 10.2 19.7 9.5 0.0 2.1 150.8 290.5 69.31 63.78 168 0.413 10M 19K 0.0 0.0 L1 10/10 1.14 GB 0.0 6.3 4.8 1.5 6.2 4.7 0.2 1.3 217.1 214.5 29.62 27.79 3 9.873 6492K 39K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 3.6 1.8 248.3 248.2 1.40 1.34 2 0.701 353K 199 0.0 0.0 L3 18/0 937.34 MB 0.9 6.1 3.6 2.5 6.1 3.6 0.2 1.7 192.1 191.3 32.54 27.61 19 1.712 6346K 25K 0.0 0.0 L4 182/0 9.69 GB 1.0 2.9 2.8 0.1 2.9 2.8 0.8 1.0 143.6 143.4 20.92 14.15 40 0.523 2976K 1797 0.0 0.0 L5 1080/0 89.26 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/20 105.49 GB 0.0 25.9 11.4 14.5 35.2 20.7 8.5 3.7 172.2 234.5 153.80 134.67 232 0.663 26M 86K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.9 11.4 14.5 35.2 20.7 8.4 3.7 172.2 234.5 153.80 134.67 232 0.663 26M 86K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.9 11.4 14.5 25.7 11.3 0.0 0.0 211.7 210.7 125.12 110.18 95 1.317 26M 86K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 338.3 28.67 24.49 137 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.2 total, 49.9 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.22 GB write, 718.79 MB/s write, 25.87 GB read, 527.96 MB/s read, 153.8 seconds Interval compaction: 35.22 GB write, 722.09 MB/s write, 25.87 GB read, 530.39 MB/s read, 153.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 41, pending-compaction-bytes-stops: 0, total-delays: 59, total-stops: 45, interval: 104 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4517116 Average: 2.8246 StdDev: 20.23 Min: 0 Median: 1.6121 Max: 8179 Percentiles: P50: 1.61 P75: 2.00 P99: 7.40 P99.9: 133.22 P99.99: 294.34 ------------------------------------------------------ [ 0, 1 ] 470502 10.416% 10.416% ## ( 1, 2 ] 2921133 64.668% 75.084% ############# ( 2, 3 ] 735361 16.279% 91.364% ### ( 3, 4 ] 180831 4.003% 95.367% # ( 4, 6 ] 148614 3.290% 98.657% # ( 6, 10 ] 44371 0.982% 99.639% ( 10, 15 ] 7147 0.158% 99.797% ( 15, 22 ] 717 0.016% 99.813% ( 22, 34 ] 50 0.001% 99.814% ( 34, 51 ] 23 0.001% 99.815% ( 51, 76 ] 20 0.000% 99.815% ( 76, 110 ] 2069 0.046% 99.861% ( 110, 170 ] 4550 0.101% 99.962% ( 170, 250 ] 1057 0.023% 99.985% ( 250, 380 ] 643 0.014% 99.999% ( 380, 580 ] 624 0.014% 100.013% ( 580, 870 ] 313 0.007% 100.020% ( 870, 1300 ] 167 0.004% 100.024% ( 1300, 1900 ] 53 0.001% 100.025% ( 1900, 2900 ] 39 0.001% 100.026% ( 2900, 4400 ] 43 0.001% 100.027% ( 4400, 6600 ] 10 0.000% 100.027% ( 6600, 9900 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1371757 Average: 4.2299 StdDev: 54.32 Min: 0 Median: 1.8258 Max: 15639 Percentiles: P50: 1.83 P75: 2.65 P99: 9.34 P99.9: 182.41 P99.99: 482.92 ------------------------------------------------------ [ 0, 1 ] 58335 4.253% 4.253% # ( 1, 2 ] 759879 55.395% 59.647% ########### ( 2, 3 ] 326102 23.773% 83.420% ##### ( 3, 4 ] 94726 6.905% 90.325% # ( 4, 6 ] 92937 6.775% 97.100% # ( 6, 10 ] 31188 2.274% 99.374% ( 10, 15 ] 4443 0.324% 99.698% ( 15, 22 ] 572 0.042% 99.739% ( 22, 34 ] 30 0.002% 99.742% ( 34, 51 ] 10 0.001% 99.742% ( 51, 76 ] 36 0.003% 99.745% ( 76, 110 ] 858 0.063% 99.807% ( 110, 170 ] 1187 0.087% 99.894% ( 170, 250 ] 530 0.039% 99.933% ( 250, 380 ] 546 0.040% 99.972% ( 380, 580 ] 468 0.034% 100.007% ( 580, 870 ] 358 0.026% 100.033% ( 870, 1300 ] 233 0.017% 100.050% ( 1300, 1900 ] 106 0.008% 100.057% ( 1900, 2900 ] 80 0.006% 100.063% ( 2900, 4400 ] 71 0.005% 100.068% ( 4400, 6600 ] 19 0.001% 100.070% ( 6600, 9900 ] 12 0.001% 100.071% ( 9900, 14000 ] 2 0.000% 100.071% ( 14000, 22000 ] 1 0.000% 100.071% ** Level 2 read latency histogram (micros): Count: 88370 Average: 2.1352 StdDev: 5.01 Min: 0 Median: 1.4897 Max: 881 Percentiles: P50: 1.49 P75: 1.87 P99: 5.53 P99.9: 9.94 P99.99: 133.26 ------------------------------------------------------ [ 0, 1 ] 15709 17.776% 17.776% #### ( 1, 2 ] 58148 65.801% 83.577% ############# ( 2, 3 ] 9512 10.764% 94.341% ## ( 3, 4 ] 2825 3.197% 97.538% # ( 4, 6 ] 1686 1.908% 99.446% ( 6, 10 ] 408 0.462% 99.907% ( 10, 15 ] 64 0.072% 99.980% ( 15, 22 ] 6 0.007% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 3 0.003% 99.992% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1324597 Average: 4.8353 StdDev: 63.75 Min: 0 Median: 2.0533 Max: 9650 Percentiles: P50: 2.05 P75: 2.94 P99: 9.10 P99.9: 18.30 P99.99: 154.51 ------------------------------------------------------ [ 0, 1 ] 22994 1.736% 1.736% ( 1, 2 ] 619359 46.758% 48.494% ######### ( 2, 3 ] 374487 28.272% 76.766% ###### ( 3, 4 ] 131530 9.930% 86.696% ## ( 4, 6 ] 141050 10.649% 97.344% ## ( 6, 10 ] 28288 2.136% 99.480% ( 10, 15 ] 5263 0.397% 99.877% ( 15, 22 ] 640 0.048% 99.926% ( 22, 34 ] 32 0.002% 99.928% ( 34, 51 ] 15 0.001% 99.929% ( 51, 76 ] 48 0.004% 99.933% ( 76, 110 ] 240 0.018% 99.951% ( 110, 170 ] 699 0.053% 100.004% ( 170, 250 ] 492 0.037% 100.041% ( 250, 380 ] 508 0.038% 100.079% ( 380, 580 ] 508 0.038% 100.117% ( 580, 870 ] 473 0.036% 100.153% ( 870, 1300 ] 283 0.021% 100.175% ( 1300, 1900 ] 132 0.010% 100.185% ( 1900, 2900 ] 97 0.007% 100.192% ( 2900, 4400 ] 127 0.010% 100.201% ( 4400, 6600 ] 32 0.002% 100.204% ( 6600, 9900 ] 19 0.001% 100.205% ** Level 4 read latency histogram (micros): Count: 30684 Average: 69.5030 StdDev: 345.49 Min: 1 Median: 2.2637 Max: 10923 Percentiles: P50: 2.26 P75: 3.46 P99: 1353.57 P99.9: 4283.42 P99.99: 6402.15 ------------------------------------------------------ [ 0, 1 ] 399 1.300% 1.300% ( 1, 2 ] 12770 41.618% 42.918% ######## ( 2, 3 ] 8241 26.858% 69.776% ##### ( 3, 4 ] 3464 11.289% 81.065% ## ( 4, 6 ] 2205 7.186% 88.251% # ( 6, 10 ] 717 2.337% 90.588% ( 10, 15 ] 152 0.495% 91.083% ( 15, 22 ] 23 0.075% 91.158% ( 22, 34 ] 16 0.052% 91.210% ( 34, 51 ] 6 0.020% 91.230% ( 51, 76 ] 10 0.033% 91.263% ( 76, 110 ] 56 0.183% 91.445% ( 110, 170 ] 266 0.867% 92.312% ( 170, 250 ] 309 1.007% 93.319% ( 250, 380 ] 339 1.105% 94.424% ( 380, 580 ] 541 1.763% 96.187% ( 580, 870 ] 553 1.802% 97.989% ( 870, 1300 ] 299 0.974% 98.964% ( 1300, 1900 ] 125 0.407% 99.371% ( 1900, 2900 ] 83 0.270% 99.642% ( 2900, 4400 ] 86 0.280% 99.922% ( 4400, 6600 ] 23 0.075% 99.997% ( 6600, 9900 ] 6 0.020% 100.016% ( 9900, 14000 ] 1 0.003% 100.020% ** Level 5 read latency histogram (micros): Count: 220 Average: 1180.7318 StdDev: 1357.08 Min: 78 Median: 571.6667 Max: 7068 Percentiles: P50: 571.67 P75: 1766.67 P99: 6160.00 P99.9: 7068.00 P99.99: 7068.00 ------------------------------------------------------ ( 76, 110 ] 22 10.000% 10.000% ## ( 110, 170 ] 27 12.273% 22.273% ## ( 170, 250 ] 16 7.273% 29.545% # ( 250, 380 ] 22 10.000% 39.545% ## ( 380, 580 ] 24 10.909% 50.455% ## ( 580, 870 ] 20 9.091% 59.545% ## ( 870, 1300 ] 20 9.091% 68.636% ## ( 1300, 1900 ] 18 8.182% 76.818% ## ( 1900, 2900 ] 24 10.909% 87.727% ## ( 2900, 4400 ] 20 9.091% 96.818% ## ( 4400, 6600 ] 6 2.727% 99.545% # ( 6600, 9900 ] 1 0.455% 100.000% ** DB Stats ** Uptime(secs): 50.2 total, 3.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 196.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.331 H:M:S, 46.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.430 H:M:S, 14.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.809 micros/op 172142 ops/sec 60.003 seconds 10328999 operations; 166.8 MB/s Microseconds per write: Count: 10328999 Average: 5.8091 StdDev: 281.19 Min: 0 Median: 1.7242 Max: 380043 Percentiles: P50: 1.72 P75: 2.67 P99: 9.09 P99.9: 1154.77 P99.99: 2698.42 ------------------------------------------------------ [ 0, 1 ] 1518292 14.699% 14.699% ### ( 1, 2 ] 5034743 48.744% 63.443% ########## ( 2, 3 ] 1768550 17.122% 80.565% ### ( 3, 4 ] 1335704 12.932% 93.497% ### ( 4, 6 ] 476539 4.614% 98.110% # ( 6, 10 ] 119068 1.153% 99.263% ( 10, 15 ] 33355 0.323% 99.586% ( 15, 22 ] 8024 0.078% 99.664% ( 22, 34 ] 1454 0.014% 99.678% ( 34, 51 ] 206 0.002% 99.680% ( 51, 76 ] 32 0.000% 99.680% ( 76, 110 ] 7732 0.075% 99.755% ( 110, 170 ] 2333 0.023% 99.778% ( 170, 250 ] 283 0.003% 99.780% ( 250, 380 ] 138 0.001% 99.782% ( 380, 580 ] 26 0.000% 99.782% ( 580, 870 ] 22 0.000% 99.782% ( 870, 1300 ] 18375 0.178% 99.960% ( 1300, 1900 ] 116 0.001% 99.961% ( 1900, 2900 ] 3725 0.036% 99.997% ( 2900, 4400 ] 198 0.002% 99.999% ( 4400, 6600 ] 50 0.000% 100.000% ( 6600, 9900 ] 9 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 5 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 228006 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10328999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10659526968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 647 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32166213 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 36762800075 rocksdb.compact.write.bytes COUNT : 36522281269 rocksdb.flush.write.bytes COUNT : 10503333344 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 57 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 357 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10418527232 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3935232 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 36862193365 rocksdb.non.last.level.read.count COUNT : 8907011 rocksdb.block.checksum.compute.count COUNT : 8905774 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.358973 P95 : 3.836318 P99 : 7.666513 P100 : 380024.000000 COUNT : 10328999 SUM : 55231549 rocksdb.compaction.times.micros P50 : 947428.571429 P95 : 3833333.333333 P99 : 17200000.000000 P100 : 18154304.000000 COUNT : 120 SUM : 166457757 rocksdb.compaction.times.cpu_micros P50 : 815384.615385 P95 : 3600000.000000 P99 : 16734414.000000 P100 : 16734414.000000 COUNT : 120 SUM : 143298252 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 697.171717 P95 : 1080.700000 P99 : 12278.000000 P100 : 16492.000000 COUNT : 142 SUM : 125431 rocksdb.compaction.outfile.sync.micros P50 : 1114.509804 P95 : 92500.000000 P99 : 156000.000000 P100 : 176859.000000 COUNT : 450 SUM : 5734761 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.293578 P95 : 1747.000000 P99 : 4466.000000 P100 : 5550.000000 COUNT : 291 SUM : 102243 rocksdb.table.open.io.micros P50 : 1332.352941 P95 : 8276.052632 P99 : 18302.857143 P100 : 21590.000000 COUNT : 647 SUM : 1450932 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.774258 P95 : 8.278798 P99 : 12.122795 P100 : 15644.000000 COUNT : 8904061 SUM : 55348059 rocksdb.read.block.get.micros P50 : 476.815287 P95 : 3674.489796 P99 : 7527.666667 P100 : 9893.000000 COUNT : 1294 SUM : 1197360 rocksdb.write.raw.block.micros P50 : 0.513441 P95 : 0.975538 P99 : 2.888042 P100 : 17020.000000 COUNT : 11399270 SUM : 21877704 rocksdb.numfiles.in.singlecompaction P50 : 3.007353 P95 : 5.912500 P99 : 19.655000 P100 : 26.000000 COUNT : 167 SUM : 602 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.557272 P95 : 1138.246505 P99 : 2378.346330 P100 : 379796.000000 COUNT : 219903 SUM : 32184858 rocksdb.sst.read.micros P50 : 1.733612 P95 : 5.074737 P99 : 8.990458 P100 : 15639.000000 COUNT : 8907452 SUM : 37439752 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10328999 SUM : 10659526968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 209587.628866 P95 : 351947.368421 P99 : 530100.000000 P100 : 642306.000000 COUNT : 142 SUM : 29585614 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 423 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0