[2024-07-27 03:48:32.791863] Starting SPDK v24.09-pre git sha1 cac68eec0 / DPDK 22.11.4 initialization... [2024-07-27 03:48:32.792140] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3817430 ] Set seed to 1722044912785540 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-27 03:48:32.888468] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-27 03:48:32.926176] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-27 03:48:32.926220] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3817430' to capture a snapshot of events at runtime. [2024-07-27 03:48:32.926232] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-27 03:48:32.926258] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-27 03:48:32.926266] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3817430 for offline analysis/debug. [2024-07-27 03:48:32.926347] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Jul 27 03:48:37 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/27-03:48:40 ... thread 0: (1000000,1000000) ops and (337478.4,337478.4) ops/second in (2.963153,2.963153) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.99 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 348.1 2.53 2.29 12 0.211 0 0 0.0 0.0 L1 3/0 249.57 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 245.6 245.3 1.03 0.99 1 1.026 255K 262 0.0 0.0 L2 3/2 191.00 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 250.0 249.9 0.77 0.74 2 0.386 195K 90 0.0 0.0 L3 10/0 867.26 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1178/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.5 1.5 102.7 306.2 4.33 4.02 15 0.289 451K 352 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 102.7 306.2 4.33 4.02 15 0.289 451K 352 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 247.5 247.3 1.80 1.73 3 0.599 451K 352 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 348.1 2.53 2.29 12 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.30 GB write, 415.50 MB/s write, 0.43 GB read, 139.34 MB/s read, 4.3 seconds Interval compaction: 1.30 GB write, 447.34 MB/s write, 0.43 GB read, 150.01 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 156365 Average: 2.0162 StdDev: 15.08 Min: 1 Median: 1.3407 Max: 3530 Percentiles: P50: 1.34 P75: 1.76 P99: 5.24 P99.9: 9.61 P99.99: 21.74 ------------------------------------------------------ [ 0, 1 ] 46144 29.510% 29.510% ###### ( 1, 2 ] 94029 60.134% 89.645% ############ ( 2, 3 ] 9498 6.074% 95.719% # ( 3, 4 ] 3679 2.353% 98.072% ( 4, 6 ] 2342 1.498% 99.570% ( 6, 10 ] 573 0.366% 99.936% ( 10, 15 ] 69 0.044% 99.980% ( 15, 22 ] 17 0.011% 99.991% ( 22, 34 ] 8 0.005% 99.996% ( 34, 51 ] 1 0.001% 99.997% ( 110, 170 ] 9 0.006% 100.003% ( 170, 250 ] 1 0.001% 100.003% ( 250, 380 ] 3 0.002% 100.005% ( 380, 580 ] 1 0.001% 100.006% ( 580, 870 ] 2 0.001% 100.007% ( 870, 1300 ] 2 0.001% 100.008% ( 1300, 1900 ] 2 0.001% 100.010% ( 1900, 2900 ] 3 0.002% 100.012% ( 2900, 4400 ] 1 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 573 Average: 13.6667 StdDev: 110.58 Min: 1 Median: 1.8311 Max: 1693 Percentiles: P50: 1.83 P75: 2.58 P99: 332.55 P99.9: 1693.00 P99.99: 1693.00 ------------------------------------------------------ [ 0, 1 ] 33 5.759% 5.759% # ( 1, 2 ] 305 53.229% 58.988% ########### ( 2, 3 ] 158 27.574% 86.562% ###### ( 3, 4 ] 32 5.585% 92.147% # ( 4, 6 ] 22 3.839% 95.986% # ( 6, 10 ] 6 1.047% 97.033% ( 10, 15 ] 5 0.873% 97.906% ( 22, 34 ] 1 0.175% 98.080% ( 51, 76 ] 1 0.175% 98.255% ( 76, 110 ] 1 0.175% 98.429% ( 110, 170 ] 1 0.175% 98.604% ( 170, 250 ] 1 0.175% 98.778% ( 250, 380 ] 2 0.349% 99.127% ( 380, 580 ] 2 0.349% 99.476% ( 870, 1300 ] 1 0.175% 99.651% ( 1300, 1900 ] 2 0.349% 100.000% ** Level 2 read latency histogram (micros): Count: 41490 Average: 2.2401 StdDev: 3.90 Min: 0 Median: 1.5399 Max: 562 Percentiles: P50: 1.54 P75: 1.90 P99: 5.82 P99.9: 9.98 P99.99: 72.27 ------------------------------------------------------ [ 0, 1 ] 5204 12.543% 12.543% ### ( 1, 2 ] 28783 69.373% 81.916% ############## ( 2, 3 ] 4243 10.227% 92.143% ## ( 3, 4 ] 1703 4.105% 96.247% # ( 4, 6 ] 1254 3.022% 99.270% # ( 6, 10 ] 265 0.639% 99.908% ( 10, 15 ] 21 0.051% 99.959% ( 15, 22 ] 8 0.019% 99.978% ( 22, 34 ] 3 0.007% 99.986% ( 34, 51 ] 3 0.007% 99.993% ( 51, 76 ] 1 0.002% 99.995% ( 110, 170 ] 1 0.002% 99.998% ( 250, 380 ] 1 0.002% 100.000% ( 380, 580 ] 2 0.005% 100.005% ** Level 3 read latency histogram (micros): Count: 45 Average: 1757.3556 StdDev: 1261.55 Min: 131 Median: 1283.4615 Max: 4584 Percentiles: P50: 1283.46 P75: 2578.57 P99: 4584.00 P99.9: 4584.00 P99.99: 4584.00 ------------------------------------------------------ ( 110, 170 ] 1 2.222% 2.222% ( 250, 380 ] 3 6.667% 8.889% # ( 380, 580 ] 3 6.667% 15.556% # ( 580, 870 ] 3 6.667% 22.222% # ( 870, 1300 ] 13 28.889% 51.111% ###### ( 1300, 1900 ] 6 13.333% 64.444% ### ( 1900, 2900 ] 7 15.556% 80.000% ### ( 2900, 4400 ] 6 13.333% 93.333% ### ( 4400, 6600 ] 3 6.667% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1566.8333 StdDev: 1414.77 Min: 175 Median: 1128.0000 Max: 5358 Percentiles: P50: 1128.00 P75: 1850.00 P99: 5358.00 P99.9: 5358.00 P99.99: 5358.00 ------------------------------------------------------ ( 170, 250 ] 4 13.333% 13.333% ### ( 250, 380 ] 1 3.333% 16.667% # ( 380, 580 ] 4 13.333% 30.000% ### ( 580, 870 ] 3 10.000% 40.000% ## ( 870, 1300 ] 5 16.667% 56.667% ### ( 1300, 1900 ] 6 20.000% 76.667% #### ( 1900, 2900 ] 2 6.667% 83.333% # ( 2900, 4400 ] 3 10.000% 93.333% ## ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 308.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.435 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.435 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/27-03:48:43 ... thread 0: (1000000,2000000) ops and (332703.5,335073.9) ops/second in (3.005679,5.968832) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 1.41 GB 44.1 0.6 0.0 0.6 2.4 1.8 0.0 1.3 75.7 327.7 7.49 6.89 28 0.268 575K 590 0.0 0.0 L1 3/3 249.57 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 245.6 245.3 1.03 0.99 1 1.026 255K 262 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 250.0 249.9 0.77 0.74 2 0.386 195K 90 0.0 0.0 L3 17/0 885.89 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 228.4 228.4 0.82 0.76 1 0.820 190K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 139.3 139.3 1.21 0.84 1 1.210 171K 0 0.0 0.0 L5 1040/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/15 97.98 GB 0.0 1.3 0.7 0.6 3.2 2.6 0.5 1.7 120.8 287.6 11.32 10.21 33 0.343 1388K 942 0.0 0.0 Int 0/0 0.00 KB 0.0 1.3 0.7 0.6 3.2 2.6 0.4 1.7 120.8 287.6 11.32 10.21 33 0.343 1388K 942 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.3 0.7 0.6 1.3 0.7 0.0 0.0 229.4 229.2 5.96 5.40 7 0.852 1388K 942 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.6 5.36 4.81 26 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.18 GB write, 525.41 MB/s write, 1.34 GB read, 220.64 MB/s read, 11.3 seconds Interval compaction: 3.18 GB write, 545.40 MB/s write, 1.34 GB read, 229.04 MB/s read, 11.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 380410 Average: 2.1488 StdDev: 15.48 Min: 0 Median: 1.4450 Max: 3756 Percentiles: P50: 1.45 P75: 1.84 P99: 5.41 P99.9: 9.54 P99.99: 13.98 ------------------------------------------------------ [ 0, 1 ] 82935 21.801% 21.801% #### ( 1, 2 ] 241031 63.361% 85.162% ############# ( 2, 3 ] 36171 9.508% 94.671% ## ( 3, 4 ] 11482 3.018% 97.689% # ( 4, 6 ] 7083 1.862% 99.551% ( 6, 10 ] 1502 0.395% 99.946% ( 10, 15 ] 212 0.056% 100.002% ( 15, 22 ] 26 0.007% 100.008% ( 22, 34 ] 10 0.003% 100.011% ( 34, 51 ] 3 0.001% 100.012% ( 51, 76 ] 2 0.001% 100.012% ( 110, 170 ] 17 0.004% 100.017% ( 170, 250 ] 5 0.001% 100.018% ( 250, 380 ] 9 0.002% 100.021% ( 380, 580 ] 3 0.001% 100.021% ( 580, 870 ] 6 0.002% 100.023% ( 870, 1300 ] 6 0.002% 100.024% ( 1300, 1900 ] 3 0.001% 100.025% ( 1900, 2900 ] 3 0.001% 100.026% ( 2900, 4400 ] 5 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 32800 Average: 2.2759 StdDev: 14.72 Min: 1 Median: 1.4869 Max: 1693 Percentiles: P50: 1.49 P75: 1.87 P99: 5.51 P99.9: 10.27 P99.99: 552.00 ------------------------------------------------------ [ 0, 1 ] 5998 18.287% 18.287% #### ( 1, 2 ] 21362 65.128% 83.415% ############# ( 2, 3 ] 3596 10.963% 94.378% ## ( 3, 4 ] 1023 3.119% 97.497% # ( 4, 6 ] 653 1.991% 99.488% ( 6, 10 ] 134 0.409% 99.896% ( 10, 15 ] 22 0.067% 99.963% ( 22, 34 ] 1 0.003% 99.966% ( 51, 76 ] 1 0.003% 99.970% ( 76, 110 ] 1 0.003% 99.973% ( 110, 170 ] 1 0.003% 99.976% ( 170, 250 ] 1 0.003% 99.979% ( 250, 380 ] 2 0.006% 99.985% ( 380, 580 ] 2 0.006% 99.991% ( 870, 1300 ] 1 0.003% 99.994% ( 1300, 1900 ] 2 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 47960 Average: 2.2227 StdDev: 3.64 Min: 0 Median: 1.5367 Max: 562 Percentiles: P50: 1.54 P75: 1.90 P99: 5.78 P99.9: 9.93 P99.99: 56.10 ------------------------------------------------------ [ 0, 1 ] 6054 12.623% 12.623% ### ( 1, 2 ] 33398 69.637% 82.260% ############## ( 2, 3 ] 4908 10.234% 92.494% ## ( 3, 4 ] 1912 3.987% 96.480% # ( 4, 6 ] 1356 2.827% 99.308% # ( 6, 10 ] 289 0.603% 99.910% ( 10, 15 ] 24 0.050% 99.960% ( 15, 22 ] 8 0.017% 99.977% ( 22, 34 ] 3 0.006% 99.983% ( 34, 51 ] 3 0.006% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 110, 170 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 42879 Average: 3.9444 StdDev: 70.18 Min: 1 Median: 1.4823 Max: 4584 Percentiles: P50: 1.48 P75: 1.85 P99: 5.62 P99.9: 351.43 P99.99: 4078.02 ------------------------------------------------------ [ 0, 1 ] 7489 17.465% 17.465% ### ( 1, 2 ] 28924 67.455% 84.920% ############# ( 2, 3 ] 4563 10.642% 95.562% ## ( 3, 4 ] 931 2.171% 97.733% ( 4, 6 ] 671 1.565% 99.298% ( 6, 10 ] 213 0.497% 99.795% ( 10, 15 ] 33 0.077% 99.872% ( 15, 22 ] 4 0.009% 99.881% ( 22, 34 ] 1 0.002% 99.883% ( 34, 51 ] 1 0.002% 99.886% ( 110, 170 ] 2 0.005% 99.890% ( 170, 250 ] 1 0.002% 99.893% ( 250, 380 ] 4 0.009% 99.902% ( 380, 580 ] 3 0.007% 99.909% ( 580, 870 ] 3 0.007% 99.916% ( 870, 1300 ] 14 0.033% 99.949% ( 1300, 1900 ] 6 0.014% 99.963% ( 1900, 2900 ] 7 0.016% 99.979% ( 2900, 4400 ] 6 0.014% 99.993% ( 4400, 6600 ] 3 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 315 Average: 153.2476 StdDev: 633.42 Min: 0 Median: 1.4505 Max: 5358 Percentiles: P50: 1.45 P75: 5.32 P99: 3825.00 P99.9: 5358.00 P99.99: 5358.00 ------------------------------------------------------ [ 0, 1 ] 112 35.556% 35.556% ####### ( 1, 2 ] 101 32.063% 67.619% ###### ( 2, 3 ] 11 3.492% 71.111% # ( 3, 4 ] 1 0.317% 71.429% ( 4, 6 ] 17 5.397% 76.825% # ( 6, 10 ] 36 11.429% 88.254% ## ( 10, 15 ] 4 1.270% 89.524% ( 110, 170 ] 1 0.317% 89.841% ( 170, 250 ] 6 1.905% 91.746% ( 250, 380 ] 1 0.317% 92.063% ( 380, 580 ] 4 1.270% 93.333% ( 580, 870 ] 3 0.952% 94.286% ( 870, 1300 ] 5 1.587% 95.873% ( 1300, 1900 ] 6 1.905% 97.778% ( 1900, 2900 ] 2 0.635% 98.413% ( 2900, 4400 ] 3 0.952% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 317.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.867 H:M:S, 14.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.431 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/27-03:48:45 ... thread 0: (1000000,3000000) ops and (359854.9,342946.1) ops/second in (2.778898,8.747730) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/8 1.54 GB 100.7 1.0 0.0 1.0 3.8 2.7 0.0 1.4 90.7 325.2 11.81 10.90 43 0.275 1087K 1036 0.0 0.0 L1 5/0 485.74 MB 48.6 1.2 1.0 0.2 1.2 1.0 0.2 1.2 237.0 236.1 5.31 5.15 2 2.653 1276K 4590 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 250.0 249.9 0.77 0.74 2 0.386 195K 90 0.0 0.0 L3 13/0 708.05 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.6 1.0 228.4 228.4 0.82 0.76 1 0.820 190K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 139.3 139.3 1.21 0.84 1 1.210 171K 0 0.0 0.0 L5 1048/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/8 98.84 GB 0.0 2.8 1.5 1.4 5.5 4.2 2.8 2.0 144.4 283.3 19.92 18.39 49 0.407 2921K 5716 0.0 0.0 Int 0/0 0.00 KB 0.0 2.8 1.5 1.4 5.5 4.2 2.7 2.0 144.4 283.3 19.92 18.39 49 0.407 2921K 5716 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.8 1.5 1.4 2.8 1.5 0.0 0.0 237.7 237.2 12.10 11.39 10 1.210 2921K 5716 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 354.6 7.82 7.01 39 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.7 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.51 GB write, 628.60 MB/s write, 2.81 GB read, 320.48 MB/s read, 19.9 seconds Interval compaction: 5.51 GB write, 644.92 MB/s write, 2.81 GB read, 328.80 MB/s read, 19.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 673142 Average: 2.1450 StdDev: 13.91 Min: 0 Median: 1.4620 Max: 3756 Percentiles: P50: 1.46 P75: 1.85 P99: 5.37 P99.9: 9.77 P99.99: 14.44 ------------------------------------------------------ [ 0, 1 ] 133702 19.862% 19.862% #### ( 1, 2 ] 439094 65.231% 85.093% ############# ( 2, 3 ] 66760 9.918% 95.011% ## ( 3, 4 ] 19147 2.844% 97.855% # ( 4, 6 ] 11296 1.678% 99.533% ( 6, 10 ] 2620 0.389% 99.922% ( 10, 15 ] 515 0.077% 99.999% ( 15, 22 ] 40 0.006% 100.005% ( 22, 34 ] 12 0.002% 100.007% ( 34, 51 ] 6 0.001% 100.007% ( 51, 76 ] 3 0.000% 100.008% ( 76, 110 ] 1 0.000% 100.008% ( 110, 170 ] 24 0.004% 100.012% ( 170, 250 ] 11 0.002% 100.013% ( 250, 380 ] 13 0.002% 100.015% ( 380, 580 ] 3 0.000% 100.016% ( 580, 870 ] 11 0.002% 100.017% ( 870, 1300 ] 8 0.001% 100.018% ( 1300, 1900 ] 5 0.001% 100.019% ( 1900, 2900 ] 5 0.001% 100.020% ( 2900, 4400 ] 7 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 63977 Average: 2.4146 StdDev: 21.33 Min: 1 Median: 1.4993 Max: 2702 Percentiles: P50: 1.50 P75: 1.87 P99: 5.40 P99.9: 10.50 P99.99: 1243.00 ------------------------------------------------------ [ 0, 1 ] 10607 16.579% 16.579% ### ( 1, 2 ] 42822 66.933% 83.513% ############# ( 2, 3 ] 7251 11.334% 94.847% ## ( 3, 4 ] 1885 2.946% 97.793% # ( 4, 6 ] 1107 1.730% 99.523% ( 6, 10 ] 237 0.370% 99.894% ( 10, 15 ] 40 0.063% 99.956% ( 22, 34 ] 1 0.002% 99.958% ( 51, 76 ] 1 0.002% 99.959% ( 76, 110 ] 1 0.002% 99.961% ( 110, 170 ] 1 0.002% 99.962% ( 170, 250 ] 1 0.002% 99.964% ( 250, 380 ] 9 0.014% 99.978% ( 380, 580 ] 4 0.006% 99.984% ( 580, 870 ] 1 0.002% 99.986% ( 870, 1300 ] 3 0.005% 99.991% ( 1300, 1900 ] 3 0.005% 99.995% ( 1900, 2900 ] 3 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 47960 Average: 2.2227 StdDev: 3.64 Min: 0 Median: 1.5367 Max: 562 Percentiles: P50: 1.54 P75: 1.90 P99: 5.78 P99.9: 9.93 P99.99: 56.10 ------------------------------------------------------ [ 0, 1 ] 6054 12.623% 12.623% ### ( 1, 2 ] 33398 69.637% 82.260% ############## ( 2, 3 ] 4908 10.234% 92.494% ## ( 3, 4 ] 1912 3.987% 96.480% # ( 4, 6 ] 1356 2.827% 99.308% # ( 6, 10 ] 289 0.603% 99.910% ( 10, 15 ] 24 0.050% 99.960% ( 15, 22 ] 8 0.017% 99.977% ( 22, 34 ] 3 0.006% 99.983% ( 34, 51 ] 3 0.006% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 110, 170 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 42879 Average: 3.9444 StdDev: 70.18 Min: 1 Median: 1.4823 Max: 4584 Percentiles: P50: 1.48 P75: 1.85 P99: 5.62 P99.9: 351.43 P99.99: 4078.02 ------------------------------------------------------ [ 0, 1 ] 7489 17.465% 17.465% ### ( 1, 2 ] 28924 67.455% 84.920% ############# ( 2, 3 ] 4563 10.642% 95.562% ## ( 3, 4 ] 931 2.171% 97.733% ( 4, 6 ] 671 1.565% 99.298% ( 6, 10 ] 213 0.497% 99.795% ( 10, 15 ] 33 0.077% 99.872% ( 15, 22 ] 4 0.009% 99.881% ( 22, 34 ] 1 0.002% 99.883% ( 34, 51 ] 1 0.002% 99.886% ( 110, 170 ] 2 0.005% 99.890% ( 170, 250 ] 1 0.002% 99.893% ( 250, 380 ] 4 0.009% 99.902% ( 380, 580 ] 3 0.007% 99.909% ( 580, 870 ] 3 0.007% 99.916% ( 870, 1300 ] 14 0.033% 99.949% ( 1300, 1900 ] 6 0.014% 99.963% ( 1900, 2900 ] 7 0.016% 99.979% ( 2900, 4400 ] 6 0.014% 99.993% ( 4400, 6600 ] 3 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 315 Average: 153.2476 StdDev: 633.42 Min: 0 Median: 1.4505 Max: 5358 Percentiles: P50: 1.45 P75: 5.32 P99: 3825.00 P99.9: 5358.00 P99.99: 5358.00 ------------------------------------------------------ [ 0, 1 ] 112 35.556% 35.556% ####### ( 1, 2 ] 101 32.063% 67.619% ###### ( 2, 3 ] 11 3.492% 71.111% # ( 3, 4 ] 1 0.317% 71.429% ( 4, 6 ] 17 5.397% 76.825% # ( 6, 10 ] 36 11.429% 88.254% ## ( 10, 15 ] 4 1.270% 89.524% ( 110, 170 ] 1 0.317% 89.841% ( 170, 250 ] 6 1.905% 91.746% ( 250, 380 ] 1 0.317% 92.063% ( 380, 580 ] 4 1.270% 93.333% ( 580, 870 ] 3 0.952% 94.286% ( 870, 1300 ] 5 1.587% 95.873% ( 1300, 1900 ] 6 1.905% 97.778% ( 1900, 2900 ] 2 0.635% 98.413% ( 2900, 4400 ] 3 0.952% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 693.0250 StdDev: 948.71 Min: 75 Median: 164.0000 Max: 3841 Percentiles: P50: 164.00 P75: 1013.33 P99: 3841.00 P99.9: 3841.00 P99.99: 3841.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 10 25.000% 27.500% ##### ( 110, 170 ] 10 25.000% 52.500% ##### ( 170, 250 ] 2 5.000% 57.500% # ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 2 5.000% 67.500% # ( 580, 870 ] 2 5.000% 72.500% # ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 2 5.000% 92.500% # ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 9.0 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 328.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.085 H:M:S, 12.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 354.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.219 H:M:S, 7.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/27-03:48:48 ... thread 0: (1000000,4000000) ops and (335451.8,341041.3) ops/second in (2.981054,11.728784) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 2.52 GB 25.2 1.8 0.0 1.8 5.5 3.7 0.0 1.5 107.3 321.7 17.62 16.37 60 0.294 1919K 1929 0.0 0.0 L1 5/5 485.74 MB 0.0 1.2 1.0 0.2 1.2 1.0 0.2 1.2 237.0 236.1 5.31 5.15 2 2.653 1276K 4590 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 250.0 249.9 0.77 0.74 2 0.386 195K 90 0.0 0.0 L3 13/0 708.05 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.6 1.0 228.4 228.4 0.82 0.76 1 0.820 190K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 139.3 139.3 1.21 0.84 1 1.210 171K 0 0.0 0.0 L5 1048/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/22 99.82 GB 0.0 3.6 1.5 2.2 7.3 5.1 2.8 2.0 143.7 290.3 25.72 23.86 66 0.390 3752K 6609 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 1.5 2.2 7.3 5.1 2.7 2.0 143.7 290.3 25.72 23.86 66 0.390 3752K 6609 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 1.5 2.2 3.6 1.4 0.0 0.0 244.7 244.3 15.10 14.33 13 1.162 3752K 6609 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 355.8 10.62 9.53 53 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.7 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.29 GB write, 624.60 MB/s write, 3.61 GB read, 309.07 MB/s read, 25.7 seconds Interval compaction: 7.29 GB write, 636.69 MB/s write, 3.61 GB read, 315.06 MB/s read, 25.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 990683 Average: 2.1288 StdDev: 12.72 Min: 0 Median: 1.4575 Max: 3756 Percentiles: P50: 1.46 P75: 1.84 P99: 5.27 P99.9: 9.71 P99.99: 14.49 ------------------------------------------------------ [ 0, 1 ] 197145 19.900% 19.900% #### ( 1, 2 ] 651772 65.790% 85.690% ############# ( 2, 3 ] 94856 9.575% 95.265% ## ( 3, 4 ] 27385 2.764% 98.029% # ( 4, 6 ] 15182 1.532% 99.562% ( 6, 10 ] 3611 0.364% 99.926% ( 10, 15 ] 706 0.071% 99.997% ( 15, 22 ] 57 0.006% 100.003% ( 22, 34 ] 16 0.002% 100.005% ( 34, 51 ] 6 0.001% 100.005% ( 51, 76 ] 5 0.001% 100.006% ( 76, 110 ] 4 0.000% 100.006% ( 110, 170 ] 61 0.006% 100.012% ( 170, 250 ] 20 0.002% 100.014% ( 250, 380 ] 22 0.002% 100.017% ( 380, 580 ] 11 0.001% 100.018% ( 580, 870 ] 16 0.002% 100.019% ( 870, 1300 ] 12 0.001% 100.021% ( 1300, 1900 ] 6 0.001% 100.021% ( 1900, 2900 ] 6 0.001% 100.022% ( 2900, 4400 ] 8 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 63978 Average: 2.4146 StdDev: 21.33 Min: 1 Median: 1.4993 Max: 2702 Percentiles: P50: 1.50 P75: 1.87 P99: 5.40 P99.9: 10.50 P99.99: 1242.98 ------------------------------------------------------ [ 0, 1 ] 10607 16.579% 16.579% ### ( 1, 2 ] 42823 66.934% 83.513% ############# ( 2, 3 ] 7251 11.334% 94.847% ## ( 3, 4 ] 1885 2.946% 97.793% # ( 4, 6 ] 1107 1.730% 99.523% ( 6, 10 ] 237 0.370% 99.894% ( 10, 15 ] 40 0.063% 99.956% ( 22, 34 ] 1 0.002% 99.958% ( 51, 76 ] 1 0.002% 99.959% ( 76, 110 ] 1 0.002% 99.961% ( 110, 170 ] 1 0.002% 99.962% ( 170, 250 ] 1 0.002% 99.964% ( 250, 380 ] 9 0.014% 99.978% ( 380, 580 ] 4 0.006% 99.984% ( 580, 870 ] 1 0.002% 99.986% ( 870, 1300 ] 3 0.005% 99.991% ( 1300, 1900 ] 3 0.005% 99.995% ( 1900, 2900 ] 3 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 47960 Average: 2.2227 StdDev: 3.64 Min: 0 Median: 1.5367 Max: 562 Percentiles: P50: 1.54 P75: 1.90 P99: 5.78 P99.9: 9.93 P99.99: 56.10 ------------------------------------------------------ [ 0, 1 ] 6054 12.623% 12.623% ### ( 1, 2 ] 33398 69.637% 82.260% ############## ( 2, 3 ] 4908 10.234% 92.494% ## ( 3, 4 ] 1912 3.987% 96.480% # ( 4, 6 ] 1356 2.827% 99.308% # ( 6, 10 ] 289 0.603% 99.910% ( 10, 15 ] 24 0.050% 99.960% ( 15, 22 ] 8 0.017% 99.977% ( 22, 34 ] 3 0.006% 99.983% ( 34, 51 ] 3 0.006% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 110, 170 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 42879 Average: 3.9444 StdDev: 70.18 Min: 1 Median: 1.4823 Max: 4584 Percentiles: P50: 1.48 P75: 1.85 P99: 5.62 P99.9: 351.43 P99.99: 4078.02 ------------------------------------------------------ [ 0, 1 ] 7489 17.465% 17.465% ### ( 1, 2 ] 28924 67.455% 84.920% ############# ( 2, 3 ] 4563 10.642% 95.562% ## ( 3, 4 ] 931 2.171% 97.733% ( 4, 6 ] 671 1.565% 99.298% ( 6, 10 ] 213 0.497% 99.795% ( 10, 15 ] 33 0.077% 99.872% ( 15, 22 ] 4 0.009% 99.881% ( 22, 34 ] 1 0.002% 99.883% ( 34, 51 ] 1 0.002% 99.886% ( 110, 170 ] 2 0.005% 99.890% ( 170, 250 ] 1 0.002% 99.893% ( 250, 380 ] 4 0.009% 99.902% ( 380, 580 ] 3 0.007% 99.909% ( 580, 870 ] 3 0.007% 99.916% ( 870, 1300 ] 14 0.033% 99.949% ( 1300, 1900 ] 6 0.014% 99.963% ( 1900, 2900 ] 7 0.016% 99.979% ( 2900, 4400 ] 6 0.014% 99.993% ( 4400, 6600 ] 3 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 315 Average: 153.2476 StdDev: 633.42 Min: 0 Median: 1.4505 Max: 5358 Percentiles: P50: 1.45 P75: 5.32 P99: 3825.00 P99.9: 5358.00 P99.99: 5358.00 ------------------------------------------------------ [ 0, 1 ] 112 35.556% 35.556% ####### ( 1, 2 ] 101 32.063% 67.619% ###### ( 2, 3 ] 11 3.492% 71.111% # ( 3, 4 ] 1 0.317% 71.429% ( 4, 6 ] 17 5.397% 76.825% # ( 6, 10 ] 36 11.429% 88.254% ## ( 10, 15 ] 4 1.270% 89.524% ( 110, 170 ] 1 0.317% 89.841% ( 170, 250 ] 6 1.905% 91.746% ( 250, 380 ] 1 0.317% 92.063% ( 380, 580 ] 4 1.270% 93.333% ( 580, 870 ] 3 0.952% 94.286% ( 870, 1300 ] 5 1.587% 95.873% ( 1300, 1900 ] 6 1.905% 97.778% ( 1900, 2900 ] 2 0.635% 98.413% ( 2900, 4400 ] 3 0.952% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 693.0250 StdDev: 948.71 Min: 75 Median: 164.0000 Max: 3841 Percentiles: P50: 164.00 P75: 1013.33 P99: 3841.00 P99.9: 3841.00 P99.99: 3841.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 10 25.000% 27.500% ##### ( 110, 170 ] 10 25.000% 52.500% ##### ( 170, 250 ] 2 5.000% 57.500% # ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 2 5.000% 67.500% # ( 580, 870 ] 2 5.000% 72.500% # ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 2 5.000% 92.500% # ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 329.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.494 H:M:S, 12.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.409 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/27-03:48:53 ... thread 0: (1000000,5000000) ops and (219689.6,307112.8) ops/second in (4.551877,16.280661) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 3.56 GB 188.8 3.2 0.0 3.2 7.9 4.7 0.0 1.7 127.0 314.8 25.80 24.15 80 0.323 3326K 3404 0.0 0.0 L1 5/5 485.74 MB 0.0 1.2 1.0 0.2 1.2 1.0 0.2 1.2 237.0 236.1 5.31 5.15 2 2.653 1276K 4590 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 250.0 249.9 0.77 0.74 2 0.386 195K 90 0.0 0.0 L3 13/0 708.05 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.6 1.0 228.4 228.4 0.82 0.76 1 0.820 190K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 139.3 139.3 1.21 0.84 1 1.210 171K 0 0.0 0.0 L5 1048/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/14 100.87 GB 0.0 5.0 1.5 3.5 9.7 6.2 2.8 2.0 149.9 292.7 33.91 31.64 86 0.394 5159K 8084 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 1.5 3.5 9.7 6.2 2.7 2.0 149.9 292.7 33.91 31.64 86 0.394 5159K 8084 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 1.5 3.5 5.0 1.4 0.0 0.0 250.6 250.1 20.28 19.41 18 1.127 5159K 8084 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.9 13.63 12.23 68 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.5 total, 16.3 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.69 GB write, 601.10 MB/s write, 4.96 GB read, 307.80 MB/s read, 33.9 seconds Interval compaction: 9.69 GB write, 609.49 MB/s write, 4.96 GB read, 312.10 MB/s read, 33.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 19, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1481222 Average: 2.1611 StdDev: 11.90 Min: 0 Median: 1.4720 Max: 3756 Percentiles: P50: 1.47 P75: 1.85 P99: 5.33 P99.9: 9.83 P99.99: 15.21 ------------------------------------------------------ [ 0, 1 ] 273968 18.496% 18.496% #### ( 1, 2 ] 988559 66.739% 85.236% ############# ( 2, 3 ] 146369 9.882% 95.117% ## ( 3, 4 ] 42467 2.867% 97.984% # ( 4, 6 ] 22684 1.531% 99.516% ( 6, 10 ] 5947 0.401% 99.917% ( 10, 15 ] 1077 0.073% 99.990% ( 15, 22 ] 97 0.007% 99.996% ( 22, 34 ] 21 0.001% 99.998% ( 34, 51 ] 10 0.001% 99.998% ( 51, 76 ] 6 0.000% 99.999% ( 76, 110 ] 74 0.005% 100.004% ( 110, 170 ] 127 0.009% 100.012% ( 170, 250 ] 42 0.003% 100.015% ( 250, 380 ] 44 0.003% 100.018% ( 380, 580 ] 29 0.002% 100.020% ( 580, 870 ] 36 0.002% 100.023% ( 870, 1300 ] 16 0.001% 100.024% ( 1300, 1900 ] 8 0.001% 100.024% ( 1900, 2900 ] 8 0.001% 100.025% ( 2900, 4400 ] 9 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 130584 Average: 2.4178 StdDev: 16.14 Min: 1 Median: 1.4982 Max: 2702 Percentiles: P50: 1.50 P75: 1.87 P99: 5.91 P99.9: 101.40 P99.99: 634.61 ------------------------------------------------------ [ 0, 1 ] 21253 16.275% 16.275% ### ( 1, 2 ] 88401 67.697% 83.972% ############## ( 2, 3 ] 13895 10.641% 94.613% ## ( 3, 4 ] 3669 2.810% 97.422% # ( 4, 6 ] 2156 1.651% 99.073% ( 6, 10 ] 945 0.724% 99.797% ( 10, 15 ] 90 0.069% 99.866% ( 15, 22 ] 6 0.005% 99.871% ( 22, 34 ] 2 0.002% 99.872% ( 34, 51 ] 1 0.001% 99.873% ( 51, 76 ] 13 0.010% 99.883% ( 76, 110 ] 30 0.023% 99.906% ( 110, 170 ] 79 0.060% 99.966% ( 170, 250 ] 10 0.008% 99.974% ( 250, 380 ] 15 0.011% 99.985% ( 380, 580 ] 5 0.004% 99.989% ( 580, 870 ] 5 0.004% 99.993% ( 870, 1300 ] 3 0.002% 99.995% ( 1300, 1900 ] 3 0.002% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47960 Average: 2.2227 StdDev: 3.64 Min: 0 Median: 1.5367 Max: 562 Percentiles: P50: 1.54 P75: 1.90 P99: 5.78 P99.9: 9.93 P99.99: 56.10 ------------------------------------------------------ [ 0, 1 ] 6054 12.623% 12.623% ### ( 1, 2 ] 33398 69.637% 82.260% ############## ( 2, 3 ] 4908 10.234% 92.494% ## ( 3, 4 ] 1912 3.987% 96.480% # ( 4, 6 ] 1356 2.827% 99.308% # ( 6, 10 ] 289 0.603% 99.910% ( 10, 15 ] 24 0.050% 99.960% ( 15, 22 ] 8 0.017% 99.977% ( 22, 34 ] 3 0.006% 99.983% ( 34, 51 ] 3 0.006% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 110, 170 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 42879 Average: 3.9444 StdDev: 70.18 Min: 1 Median: 1.4823 Max: 4584 Percentiles: P50: 1.48 P75: 1.85 P99: 5.62 P99.9: 351.43 P99.99: 4078.02 ------------------------------------------------------ [ 0, 1 ] 7489 17.465% 17.465% ### ( 1, 2 ] 28924 67.455% 84.920% ############# ( 2, 3 ] 4563 10.642% 95.562% ## ( 3, 4 ] 931 2.171% 97.733% ( 4, 6 ] 671 1.565% 99.298% ( 6, 10 ] 213 0.497% 99.795% ( 10, 15 ] 33 0.077% 99.872% ( 15, 22 ] 4 0.009% 99.881% ( 22, 34 ] 1 0.002% 99.883% ( 34, 51 ] 1 0.002% 99.886% ( 110, 170 ] 2 0.005% 99.890% ( 170, 250 ] 1 0.002% 99.893% ( 250, 380 ] 4 0.009% 99.902% ( 380, 580 ] 3 0.007% 99.909% ( 580, 870 ] 3 0.007% 99.916% ( 870, 1300 ] 14 0.033% 99.949% ( 1300, 1900 ] 6 0.014% 99.963% ( 1900, 2900 ] 7 0.016% 99.979% ( 2900, 4400 ] 6 0.014% 99.993% ( 4400, 6600 ] 3 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 315 Average: 153.2476 StdDev: 633.42 Min: 0 Median: 1.4505 Max: 5358 Percentiles: P50: 1.45 P75: 5.32 P99: 3825.00 P99.9: 5358.00 P99.99: 5358.00 ------------------------------------------------------ [ 0, 1 ] 112 35.556% 35.556% ####### ( 1, 2 ] 101 32.063% 67.619% ###### ( 2, 3 ] 11 3.492% 71.111% # ( 3, 4 ] 1 0.317% 71.429% ( 4, 6 ] 17 5.397% 76.825% # ( 6, 10 ] 36 11.429% 88.254% ## ( 10, 15 ] 4 1.270% 89.524% ( 110, 170 ] 1 0.317% 89.841% ( 170, 250 ] 6 1.905% 91.746% ( 250, 380 ] 1 0.317% 92.063% ( 380, 580 ] 4 1.270% 93.333% ( 580, 870 ] 3 0.952% 94.286% ( 870, 1300 ] 5 1.587% 95.873% ( 1300, 1900 ] 6 1.905% 97.778% ( 1900, 2900 ] 2 0.635% 98.413% ( 2900, 4400 ] 3 0.952% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 693.0250 StdDev: 948.71 Min: 75 Median: 164.0000 Max: 3841 Percentiles: P50: 164.00 P75: 1013.33 P99: 3841.00 P99.9: 3841.00 P99.99: 3841.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 10 25.000% 27.500% ##### ( 110, 170 ] 10 25.000% 52.500% ##### ( 170, 250 ] 2 5.000% 57.500% # ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 2 5.000% 67.500% # ( 580, 870 ] 2 5.000% 72.500% # ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 2 5.000% 92.500% # ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 16.5 total, 4.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 298.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.371 H:M:S, 20.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 216.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.877 H:M:S, 41.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/27-03:48:58 ... thread 0: (1000000,6000000) ops and (215068.9,286665.3) ops/second in (4.649673,20.930334) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 2.77 GB 56.7 3.9 0.0 3.9 9.6 5.7 0.0 1.7 128.2 312.3 31.45 29.38 97 0.324 4093K 4122 0.0 0.0 L1 14/14 1.67 GB 0.0 3.4 2.7 0.7 3.4 2.7 0.2 1.3 235.4 233.5 14.89 14.45 3 4.965 3559K 27K 0.0 0.0 L2 2/2 257.55 MB 0.0 0.2 0.1 0.1 0.2 0.1 1.2 1.5 250.0 249.9 0.77 0.74 2 0.386 195K 90 0.0 0.0 L3 22/5 966.04 MB 0.6 0.9 0.4 0.4 0.9 0.4 0.6 2.0 218.6 217.8 4.03 3.72 4 1.007 894K 3418 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 139.3 139.3 1.21 0.84 1 1.210 171K 0 0.0 0.0 L5 1048/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/30 101.76 GB 0.0 8.6 3.4 5.1 14.2 9.1 3.3 2.5 167.7 277.7 52.35 49.14 107 0.489 8914K 34K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.6 3.4 5.1 14.2 9.1 3.2 2.5 167.7 277.7 52.35 49.14 107 0.489 8914K 34K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.6 3.4 5.1 8.5 3.4 0.0 0.0 244.2 243.2 35.95 34.49 25 1.438 8914K 34K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 353.4 16.40 14.64 82 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.2 total, 20.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.20 GB write, 687.14 MB/s write, 8.57 GB read, 414.91 MB/s read, 52.4 seconds Interval compaction: 14.20 GB write, 694.60 MB/s write, 8.57 GB read, 419.41 MB/s read, 52.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 22, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1860347 Average: 2.2841 StdDev: 14.31 Min: 0 Median: 1.4918 Max: 4166 Percentiles: P50: 1.49 P75: 1.87 P99: 5.60 P99.9: 11.05 P99.99: 141.01 ------------------------------------------------------ [ 0, 1 ] 323947 17.413% 17.413% ### ( 1, 2 ] 1232634 66.258% 83.672% ############# ( 2, 3 ] 196700 10.573% 94.245% ## ( 3, 4 ] 59788 3.214% 97.459% # ( 4, 6 ] 35759 1.922% 99.381% ( 6, 10 ] 9333 0.502% 99.882% ( 10, 15 ] 1562 0.084% 99.966% ( 15, 22 ] 167 0.009% 99.975% ( 22, 34 ] 30 0.002% 99.977% ( 34, 51 ] 10 0.001% 99.978% ( 51, 76 ] 8 0.000% 99.978% ( 76, 110 ] 102 0.005% 99.983% ( 110, 170 ] 236 0.013% 99.996% ( 170, 250 ] 137 0.007% 100.004% ( 250, 380 ] 116 0.006% 100.010% ( 380, 580 ] 94 0.005% 100.015% ( 580, 870 ] 82 0.004% 100.019% ( 870, 1300 ] 42 0.002% 100.022% ( 1300, 1900 ] 20 0.001% 100.023% ( 1900, 2900 ] 12 0.001% 100.023% ( 2900, 4400 ] 12 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 390414 Average: 2.9382 StdDev: 17.35 Min: 0 Median: 1.6333 Max: 2702 Percentiles: P50: 1.63 P75: 2.11 P99: 8.28 P99.9: 139.08 P99.99: 320.52 ------------------------------------------------------ [ 0, 1 ] 38924 9.970% 9.970% ## ( 1, 2 ] 246794 63.213% 73.183% ############# ( 2, 3 ] 62942 16.122% 89.305% ### ( 3, 4 ] 19205 4.919% 94.224% # ( 4, 6 ] 15420 3.950% 98.174% # ( 6, 10 ] 5669 1.452% 99.626% ( 10, 15 ] 649 0.166% 99.792% ( 15, 22 ] 98 0.025% 99.817% ( 22, 34 ] 4 0.001% 99.818% ( 34, 51 ] 4 0.001% 99.819% ( 51, 76 ] 14 0.004% 99.823% ( 76, 110 ] 130 0.033% 99.856% ( 110, 170 ] 352 0.090% 99.946% ( 170, 250 ] 113 0.029% 99.975% ( 250, 380 ] 105 0.027% 100.002% ( 380, 580 ] 65 0.017% 100.019% ( 580, 870 ] 34 0.009% 100.028% ( 870, 1300 ] 21 0.005% 100.033% ( 1300, 1900 ] 8 0.002% 100.035% ( 1900, 2900 ] 4 0.001% 100.036% ** Level 2 read latency histogram (micros): Count: 48932 Average: 2.5013 StdDev: 9.63 Min: 0 Median: 1.5449 Max: 841 Percentiles: P50: 1.54 P75: 1.91 P99: 5.91 P99.9: 118.00 P99.99: 509.21 ------------------------------------------------------ [ 0, 1 ] 6059 12.382% 12.382% ## ( 1, 2 ] 33779 69.033% 81.415% ############## ( 2, 3 ] 5300 10.831% 92.246% ## ( 3, 4 ] 1957 3.999% 96.246% # ( 4, 6 ] 1409 2.880% 99.125% # ( 6, 10 ] 317 0.648% 99.773% ( 10, 15 ] 28 0.057% 99.830% ( 15, 22 ] 8 0.016% 99.847% ( 22, 34 ] 3 0.006% 99.853% ( 34, 51 ] 3 0.006% 99.859% ( 51, 76 ] 1 0.002% 99.861% ( 76, 110 ] 16 0.033% 99.894% ( 110, 170 ] 23 0.047% 99.941% ( 170, 250 ] 10 0.020% 99.961% ( 250, 380 ] 7 0.014% 99.975% ( 380, 580 ] 11 0.022% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 90847 Average: 3.6386 StdDev: 50.52 Min: 0 Median: 1.6461 Max: 4584 Percentiles: P50: 1.65 P75: 2.16 P99: 7.12 P99.9: 217.68 P99.99: 2602.17 ------------------------------------------------------ [ 0, 1 ] 8695 9.571% 9.571% ## ( 1, 2 ] 56850 62.578% 72.149% ############# ( 2, 3 ] 16141 17.767% 89.916% #### ( 3, 4 ] 4504 4.958% 94.874% # ( 4, 6 ] 3521 3.876% 98.750% # ( 6, 10 ] 819 0.902% 99.651% ( 10, 15 ] 135 0.149% 99.800% ( 15, 22 ] 30 0.033% 99.833% ( 22, 34 ] 2 0.002% 99.835% ( 34, 51 ] 2 0.002% 99.837% ( 76, 110 ] 2 0.002% 99.839% ( 110, 170 ] 49 0.054% 99.893% ( 170, 250 ] 12 0.013% 99.906% ( 250, 380 ] 22 0.024% 99.931% ( 380, 580 ] 10 0.011% 99.942% ( 580, 870 ] 10 0.011% 99.953% ( 870, 1300 ] 22 0.024% 99.977% ( 1300, 1900 ] 8 0.009% 99.986% ( 1900, 2900 ] 7 0.008% 99.993% ( 2900, 4400 ] 6 0.007% 100.000% ( 4400, 6600 ] 3 0.003% 100.003% ** Level 4 read latency histogram (micros): Count: 315 Average: 153.2476 StdDev: 633.42 Min: 0 Median: 1.4505 Max: 5358 Percentiles: P50: 1.45 P75: 5.32 P99: 3825.00 P99.9: 5358.00 P99.99: 5358.00 ------------------------------------------------------ [ 0, 1 ] 112 35.556% 35.556% ####### ( 1, 2 ] 101 32.063% 67.619% ###### ( 2, 3 ] 11 3.492% 71.111% # ( 3, 4 ] 1 0.317% 71.429% ( 4, 6 ] 17 5.397% 76.825% # ( 6, 10 ] 36 11.429% 88.254% ## ( 10, 15 ] 4 1.270% 89.524% ( 110, 170 ] 1 0.317% 89.841% ( 170, 250 ] 6 1.905% 91.746% ( 250, 380 ] 1 0.317% 92.063% ( 380, 580 ] 4 1.270% 93.333% ( 580, 870 ] 3 0.952% 94.286% ( 870, 1300 ] 5 1.587% 95.873% ( 1300, 1900 ] 6 1.905% 97.778% ( 1900, 2900 ] 2 0.635% 98.413% ( 2900, 4400 ] 3 0.952% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 693.0250 StdDev: 948.71 Min: 75 Median: 164.0000 Max: 3841 Percentiles: P50: 164.00 P75: 1013.33 P99: 3841.00 P99.9: 3841.00 P99.99: 3841.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 10 25.000% 27.500% ##### ( 110, 170 ] 10 25.000% 52.500% ##### ( 170, 250 ] 2 5.000% 57.500% # ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 2 5.000% 67.500% # ( 580, 870 ] 2 5.000% 72.500% # ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 2 5.000% 92.500% # ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 21.2 total, 4.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 279.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.316 H:M:S, 25.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 211.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.945 H:M:S, 41.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/27-03:49:01 ... thread 0: (1000000,7000000) ops and (268055.6,283850.1) ops/second in (3.730569,24.660903) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.75 GB 132.2 4.7 0.0 4.7 11.4 6.6 0.0 1.7 129.2 310.2 37.55 34.98 114 0.329 4925K 4950 0.0 0.0 L1 14/14 1.67 GB 0.0 3.4 2.7 0.7 3.4 2.7 0.2 1.3 235.4 233.5 14.89 14.45 3 4.965 3559K 27K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.2 1.5 250.0 249.9 0.77 0.74 2 0.386 195K 90 0.0 0.0 L3 25/0 960.09 MB 1.0 1.5 0.7 0.8 1.4 0.7 0.6 2.1 216.3 215.4 6.87 6.35 6 1.145 1508K 6105 0.0 0.0 L4 173/0 9.65 GB 1.0 0.4 0.4 0.0 0.4 0.4 0.7 1.0 150.7 150.5 2.62 1.90 6 0.437 401K 377 0.0 0.0 L5 1052/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/27 102.74 GB 0.0 10.2 3.9 6.3 16.8 10.5 3.7 2.5 166.3 274.2 62.71 58.42 131 0.479 10M 38K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 3.9 6.3 16.8 10.5 3.6 2.5 166.3 274.2 62.71 58.42 131 0.479 10M 38K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 3.9 6.3 10.1 3.9 0.0 0.0 240.4 239.5 43.38 41.25 35 1.239 10M 38K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 351.9 19.33 17.18 96 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.9 total, 24.7 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.79 GB write, 690.81 MB/s write, 10.19 GB read, 419.04 MB/s read, 62.7 seconds Interval compaction: 16.79 GB write, 697.17 MB/s write, 10.19 GB read, 422.90 MB/s read, 62.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 24, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2224576 Average: 2.3339 StdDev: 16.28 Min: 0 Median: 1.5058 Max: 6711 Percentiles: P50: 1.51 P75: 1.88 P99: 5.70 P99.9: 11.48 P99.99: 142.81 ------------------------------------------------------ [ 0, 1 ] 368602 16.570% 16.570% ### ( 1, 2 ] 1470378 66.097% 82.667% ############# ( 2, 3 ] 246332 11.073% 93.740% ## ( 3, 4 ] 76125 3.422% 97.162% # ( 4, 6 ] 48001 2.158% 99.320% ( 6, 10 ] 12332 0.554% 99.874% ( 10, 15 ] 1969 0.089% 99.962% ( 15, 22 ] 199 0.009% 99.971% ( 22, 34 ] 35 0.002% 99.973% ( 34, 51 ] 14 0.001% 99.974% ( 51, 76 ] 9 0.000% 99.974% ( 76, 110 ] 177 0.008% 99.982% ( 110, 170 ] 332 0.015% 99.997% ( 170, 250 ] 184 0.008% 100.005% ( 250, 380 ] 153 0.007% 100.012% ( 380, 580 ] 120 0.005% 100.017% ( 580, 870 ] 97 0.004% 100.022% ( 870, 1300 ] 48 0.002% 100.024% ( 1300, 1900 ] 20 0.001% 100.025% ( 1900, 2900 ] 17 0.001% 100.026% ( 2900, 4400 ] 19 0.001% 100.026% ( 6600, 9900 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 500105 Average: 2.8682 StdDev: 15.95 Min: 0 Median: 1.6314 Max: 2702 Percentiles: P50: 1.63 P75: 2.10 P99: 8.22 P99.9: 130.04 P99.99: 321.60 ------------------------------------------------------ [ 0, 1 ] 49541 9.906% 9.906% ## ( 1, 2 ] 317563 63.499% 73.405% ############# ( 2, 3 ] 80141 16.025% 89.430% ### ( 3, 4 ] 24379 4.875% 94.305% # ( 4, 6 ] 19335 3.866% 98.171% # ( 6, 10 ] 7475 1.495% 99.666% ( 10, 15 ] 732 0.146% 99.812% ( 15, 22 ] 105 0.021% 99.833% ( 22, 34 ] 4 0.001% 99.834% ( 34, 51 ] 5 0.001% 99.835% ( 51, 76 ] 14 0.003% 99.838% ( 76, 110 ] 184 0.037% 99.875% ( 110, 170 ] 383 0.077% 99.951% ( 170, 250 ] 130 0.026% 99.977% ( 250, 380 ] 118 0.024% 100.001% ( 380, 580 ] 75 0.015% 100.016% ( 580, 870 ] 41 0.008% 100.024% ( 870, 1300 ] 22 0.004% 100.028% ( 1300, 1900 ] 8 0.002% 100.030% ( 1900, 2900 ] 4 0.001% 100.031% ** Level 2 read latency histogram (micros): Count: 48932 Average: 2.5013 StdDev: 9.63 Min: 0 Median: 1.5449 Max: 841 Percentiles: P50: 1.54 P75: 1.91 P99: 5.91 P99.9: 118.00 P99.99: 509.21 ------------------------------------------------------ [ 0, 1 ] 6059 12.382% 12.382% ## ( 1, 2 ] 33779 69.033% 81.415% ############## ( 2, 3 ] 5300 10.831% 92.246% ## ( 3, 4 ] 1957 3.999% 96.246% # ( 4, 6 ] 1409 2.880% 99.125% # ( 6, 10 ] 317 0.648% 99.773% ( 10, 15 ] 28 0.057% 99.830% ( 15, 22 ] 8 0.016% 99.847% ( 22, 34 ] 3 0.006% 99.853% ( 34, 51 ] 3 0.006% 99.859% ( 51, 76 ] 1 0.002% 99.861% ( 76, 110 ] 16 0.033% 99.894% ( 110, 170 ] 23 0.047% 99.941% ( 170, 250 ] 10 0.020% 99.961% ( 250, 380 ] 7 0.014% 99.975% ( 380, 580 ] 11 0.022% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 168182 Average: 3.4092 StdDev: 39.65 Min: 0 Median: 1.7747 Max: 4584 Percentiles: P50: 1.77 P75: 2.56 P99: 7.43 P99.9: 14.34 P99.99: 160.34 ------------------------------------------------------ [ 0, 1 ] 9639 5.731% 5.731% # ( 1, 2 ] 96110 57.146% 62.878% ########### ( 2, 3 ] 36370 21.625% 84.503% #### ( 3, 4 ] 12436 7.394% 91.897% # ( 4, 6 ] 11275 6.704% 98.602% # ( 6, 10 ] 1880 1.118% 99.719% ( 10, 15 ] 350 0.208% 99.927% ( 15, 22 ] 45 0.027% 99.954% ( 22, 34 ] 3 0.002% 99.956% ( 34, 51 ] 3 0.002% 99.958% ( 76, 110 ] 3 0.002% 99.960% ( 110, 170 ] 61 0.036% 99.996% ( 170, 250 ] 14 0.008% 100.004% ( 250, 380 ] 22 0.013% 100.017% ( 380, 580 ] 18 0.011% 100.028% ( 580, 870 ] 10 0.006% 100.034% ( 870, 1300 ] 27 0.016% 100.050% ( 1300, 1900 ] 8 0.005% 100.055% ( 1900, 2900 ] 9 0.005% 100.060% ( 2900, 4400 ] 7 0.004% 100.064% ( 4400, 6600 ] 3 0.002% 100.066% ** Level 4 read latency histogram (micros): Count: 3985 Average: 50.4391 StdDev: 249.43 Min: 0 Median: 1.9653 Max: 5358 Percentiles: P50: 1.97 P75: 3.36 P99: 852.41 P99.9: 3653.75 P99.99: 5061.65 ------------------------------------------------------ [ 0, 1 ] 196 4.918% 4.918% # ( 1, 2 ] 1861 46.700% 51.619% ######### ( 2, 3 ] 792 19.875% 71.493% #### ( 3, 4 ] 389 9.762% 81.255% ## ( 4, 6 ] 251 6.299% 87.553% # ( 6, 10 ] 114 2.861% 90.414% # ( 10, 15 ] 18 0.452% 90.866% ( 22, 34 ] 1 0.025% 90.891% ( 76, 110 ] 17 0.427% 91.317% ( 110, 170 ] 47 1.179% 92.497% ( 170, 250 ] 61 1.531% 94.028% ( 250, 380 ] 71 1.782% 95.809% ( 380, 580 ] 83 2.083% 97.892% ( 580, 870 ] 47 1.179% 99.072% ( 870, 1300 ] 16 0.402% 99.473% ( 1300, 1900 ] 9 0.226% 99.699% ( 1900, 2900 ] 5 0.125% 99.824% ( 2900, 4400 ] 6 0.151% 99.975% ( 4400, 6600 ] 2 0.050% 100.025% ** Level 5 read latency histogram (micros): Count: 60 Average: 707.2333 StdDev: 924.35 Min: 75 Median: 250.0000 Max: 3841 Percentiles: P50: 250.00 P75: 1085.00 P99: 3841.00 P99.9: 3841.00 P99.99: 3841.00 ------------------------------------------------------ ( 51, 76 ] 1 1.667% 1.667% ( 76, 110 ] 12 20.000% 21.667% #### ( 110, 170 ] 14 23.333% 45.000% ##### ( 170, 250 ] 3 5.000% 50.000% # ( 250, 380 ] 7 11.667% 61.667% ## ( 380, 580 ] 4 6.667% 68.333% # ( 580, 870 ] 2 3.333% 71.667% # ( 870, 1300 ] 4 6.667% 78.333% # ( 1300, 1900 ] 6 10.000% 88.333% ## ( 1900, 2900 ] 3 5.000% 93.333% # ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 24.9 total, 3.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 276.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.405 H:M:S, 25.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 263.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.090 H:M:S, 29.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/27-03:49:20 ... thread 0: (1000000,8000000) ops and (54580.4,186122.2) ops/second in (18.321602,42.982505) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 2.45 GB 31.5 7.7 0.0 7.7 15.3 7.6 0.0 2.0 146.2 288.8 54.25 48.89 132 0.411 8055K 15K 0.0 0.0 L1 6/6 584.64 MB 0.0 7.3 4.9 2.4 7.2 4.8 0.2 1.5 222.8 220.1 33.58 31.57 4 8.394 7597K 89K 0.0 0.0 L2 2/1 166.07 MB 0.4 0.2 0.1 0.1 0.2 0.1 4.4 1.5 250.0 249.9 0.77 0.74 2 0.386 195K 90 0.0 0.0 L3 25/8 1.76 GB 1.1 4.0 2.0 2.0 4.0 2.0 2.4 2.0 156.6 155.6 26.28 18.47 17 1.546 4180K 25K 0.0 0.0 L4 196/18 11.89 GB 1.1 2.8 2.6 0.1 2.8 2.6 0.7 1.1 129.0 128.8 21.93 13.14 31 0.707 2796K 1766 0.0 0.0 L5 1052/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/38 103.57 GB 0.0 22.0 9.7 12.3 29.5 17.1 8.7 3.9 164.8 220.5 136.81 112.82 186 0.736 22M 133K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.0 9.7 12.3 29.5 17.1 8.6 3.9 164.8 220.5 136.81 112.82 186 0.736 22M 133K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.0 9.7 12.3 21.9 9.5 0.0 0.0 198.9 197.7 113.36 93.18 77 1.472 22M 133K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 330.5 23.45 19.64 109 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.2 total, 43.0 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.46 GB write, 698.05 MB/s write, 22.02 GB read, 521.88 MB/s read, 136.8 seconds Interval compaction: 29.46 GB write, 701.74 MB/s write, 22.02 GB read, 524.64 MB/s read, 136.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 33, total-stops: 48, interval: 81 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3403042 Average: 2.8980 StdDev: 29.88 Min: 0 Median: 1.5169 Max: 10980 Percentiles: P50: 1.52 P75: 1.90 P99: 6.80 P99.9: 147.76 P99.99: 447.16 ------------------------------------------------------ [ 0, 1 ] 557509 16.383% 16.383% ### ( 1, 2 ] 2213405 65.042% 81.425% ############# ( 2, 3 ] 379806 11.161% 92.585% ## ( 3, 4 ] 123785 3.637% 96.223% # ( 4, 6 ] 89368 2.626% 98.849% # ( 6, 10 ] 25826 0.759% 99.608% ( 10, 15 ] 3705 0.109% 99.717% ( 15, 22 ] 564 0.017% 99.733% ( 22, 34 ] 45 0.001% 99.735% ( 34, 51 ] 70 0.002% 99.737% ( 51, 76 ] 150 0.004% 99.741% ( 76, 110 ] 3225 0.095% 99.836% ( 110, 170 ] 3467 0.102% 99.938% ( 170, 250 ] 940 0.028% 99.965% ( 250, 380 ] 653 0.019% 99.985% ( 380, 580 ] 550 0.016% 100.001% ( 580, 870 ] 318 0.009% 100.010% ( 870, 1300 ] 163 0.005% 100.015% ( 1300, 1900 ] 84 0.002% 100.017% ( 1900, 2900 ] 72 0.002% 100.019% ( 2900, 4400 ] 79 0.002% 100.022% ( 4400, 6600 ] 11 0.000% 100.022% ( 6600, 9900 ] 4 0.000% 100.022% ( 9900, 14000 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1543665 Average: 5.6430 StdDev: 85.45 Min: 0 Median: 1.7536 Max: 10515 Percentiles: P50: 1.75 P75: 2.61 P99: 9.22 P99.9: 260.74 P99.99: 765.65 ------------------------------------------------------ [ 0, 1 ] 129808 8.409% 8.409% ## ( 1, 2 ] 851899 55.187% 63.596% ########### ( 2, 3 ] 286950 18.589% 82.185% #### ( 3, 4 ] 117167 7.590% 89.775% ## ( 4, 6 ] 116673 7.558% 97.333% ## ( 6, 10 ] 31999 2.073% 99.406% ( 10, 15 ] 4542 0.294% 99.700% ( 15, 22 ] 654 0.042% 99.743% ( 22, 34 ] 38 0.002% 99.745% ( 34, 51 ] 24 0.002% 99.747% ( 51, 76 ] 55 0.004% 99.750% ( 76, 110 ] 945 0.061% 99.811% ( 110, 170 ] 984 0.064% 99.875% ( 170, 250 ] 345 0.022% 99.898% ( 250, 380 ] 464 0.030% 99.928% ( 380, 580 ] 552 0.036% 99.963% ( 580, 870 ] 643 0.042% 100.005% ( 870, 1300 ] 530 0.034% 100.039% ( 1300, 1900 ] 320 0.021% 100.060% ( 1900, 2900 ] 276 0.018% 100.078% ( 2900, 4400 ] 309 0.020% 100.098% ( 4400, 6600 ] 99 0.006% 100.104% ( 6600, 9900 ] 16 0.001% 100.105% ( 9900, 14000 ] 3 0.000% 100.106% ** Level 2 read latency histogram (micros): Count: 48932 Average: 2.5013 StdDev: 9.63 Min: 0 Median: 1.5449 Max: 841 Percentiles: P50: 1.54 P75: 1.91 P99: 5.91 P99.9: 118.00 P99.99: 509.21 ------------------------------------------------------ [ 0, 1 ] 6059 12.382% 12.382% ## ( 1, 2 ] 33779 69.033% 81.415% ############## ( 2, 3 ] 5300 10.831% 92.246% ## ( 3, 4 ] 1957 3.999% 96.246% # ( 4, 6 ] 1409 2.880% 99.125% # ( 6, 10 ] 317 0.648% 99.773% ( 10, 15 ] 28 0.057% 99.830% ( 15, 22 ] 8 0.016% 99.847% ( 22, 34 ] 3 0.006% 99.853% ( 34, 51 ] 3 0.006% 99.859% ( 51, 76 ] 1 0.002% 99.861% ( 76, 110 ] 16 0.033% 99.894% ( 110, 170 ] 23 0.047% 99.941% ( 170, 250 ] 10 0.020% 99.961% ( 250, 380 ] 7 0.014% 99.975% ( 380, 580 ] 11 0.022% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 851780 Average: 5.7920 StdDev: 83.34 Min: 0 Median: 2.0202 Max: 8015 Percentiles: P50: 2.02 P75: 3.02 P99: 8.88 P99.9: 19.23 P99.99: 442.59 ------------------------------------------------------ [ 0, 1 ] 14336 1.683% 1.683% ( 1, 2 ] 407216 47.808% 49.491% ########## ( 2, 3 ] 214973 25.238% 74.729% ##### ( 3, 4 ] 96207 11.295% 86.024% ## ( 4, 6 ] 98676 11.585% 97.608% ## ( 6, 10 ] 16464 1.933% 99.541% ( 10, 15 ] 2871 0.337% 99.878% ( 15, 22 ] 308 0.036% 99.914% ( 22, 34 ] 27 0.003% 99.918% ( 34, 51 ] 16 0.002% 99.919% ( 51, 76 ] 11 0.001% 99.921% ( 76, 110 ] 17 0.002% 99.923% ( 110, 170 ] 120 0.014% 99.937% ( 170, 250 ] 135 0.016% 99.953% ( 250, 380 ] 224 0.026% 99.979% ( 380, 580 ] 303 0.036% 100.015% ( 580, 870 ] 391 0.046% 100.060% ( 870, 1300 ] 326 0.038% 100.099% ( 1300, 1900 ] 150 0.018% 100.116% ( 1900, 2900 ] 147 0.017% 100.134% ( 2900, 4400 ] 166 0.019% 100.153% ( 4400, 6600 ] 53 0.006% 100.159% ( 6600, 9900 ] 8 0.001% 100.160% ** Level 4 read latency histogram (micros): Count: 51495 Average: 76.4824 StdDev: 409.16 Min: 0 Median: 2.1451 Max: 7500 Percentiles: P50: 2.15 P75: 3.35 P99: 2230.93 P99.9: 5073.30 P99.99: 6595.09 ------------------------------------------------------ [ 0, 1 ] 751 1.458% 1.458% ( 1, 2 ] 23176 45.006% 46.465% ######### ( 2, 3 ] 12543 24.358% 70.822% ##### ( 3, 4 ] 6190 12.021% 82.843% ## ( 4, 6 ] 4607 8.946% 91.789% ## ( 6, 10 ] 1047 2.033% 93.823% ( 10, 15 ] 174 0.338% 94.161% ( 15, 22 ] 23 0.045% 94.205% ( 22, 34 ] 16 0.031% 94.236% ( 34, 51 ] 2 0.004% 94.240% ( 51, 76 ] 6 0.012% 94.252% ( 76, 110 ] 21 0.041% 94.293% ( 110, 170 ] 78 0.151% 94.444% ( 170, 250 ] 172 0.334% 94.778% ( 250, 380 ] 253 0.491% 95.269% ( 380, 580 ] 389 0.755% 96.025% ( 580, 870 ] 599 1.163% 97.188% ( 870, 1300 ] 493 0.957% 98.145% ( 1300, 1900 ] 355 0.689% 98.835% ( 1900, 2900 ] 257 0.499% 99.334% ( 2900, 4400 ] 271 0.526% 99.860% ( 4400, 6600 ] 67 0.130% 99.990% ( 6600, 9900 ] 9 0.017% 100.008% ** Level 5 read latency histogram (micros): Count: 63 Average: 818.4762 StdDev: 1165.05 Min: 75 Median: 277.8571 Max: 6532 Percentiles: P50: 277.86 P75: 1219.38 P99: 5214.00 P99.9: 6461.40 P99.99: 6532.00 ------------------------------------------------------ ( 51, 76 ] 1 1.587% 1.587% ( 76, 110 ] 12 19.048% 20.635% #### ( 110, 170 ] 14 22.222% 42.857% #### ( 170, 250 ] 3 4.762% 47.619% # ( 250, 380 ] 7 11.111% 58.730% ## ( 380, 580 ] 4 6.349% 65.079% # ( 580, 870 ] 3 4.762% 69.841% # ( 870, 1300 ] 4 6.349% 76.190% # ( 1300, 1900 ] 7 11.111% 87.302% ## ( 1900, 2900 ] 3 4.762% 92.063% # ( 2900, 4400 ] 4 6.349% 98.413% # ( 4400, 6600 ] 1 1.587% 100.000% ** DB Stats ** Uptime(secs): 43.2 total, 18.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 182.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.593 H:M:S, 50.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 53.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:15.187 H:M:S, 82.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/27-03:49:23 ... thread 0: (1000000,9000000) ops and (279122.3,193277.5) ops/second in (3.582659,46.565164) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 3.43 GB 107.0 8.4 0.0 8.4 16.9 8.5 0.0 2.0 142.7 288.3 60.03 53.87 147 0.408 8694K 16K 0.0 0.0 L1 6/6 584.64 MB 0.0 7.3 4.9 2.4 7.2 4.8 0.2 1.5 222.8 220.1 33.58 31.57 4 8.394 7597K 89K 0.0 0.0 L2 1/0 37.29 MB 0.4 0.2 0.1 0.1 0.2 0.1 4.4 1.5 250.0 249.9 0.77 0.74 2 0.386 195K 90 0.0 0.0 L3 14/0 995.28 MB 1.0 4.2 2.1 2.1 4.2 2.1 2.4 2.0 156.3 155.3 27.81 19.53 18 1.545 4414K 27K 0.0 0.0 L4 165/0 9.48 GB 1.0 3.9 3.5 0.3 3.9 3.5 0.7 1.1 132.8 132.5 29.83 18.28 41 0.728 3925K 4434 0.0 0.0 L5 1092/0 90.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/15 104.55 GB 0.0 24.0 10.7 13.3 32.4 19.1 12.0 3.8 161.5 218.1 152.02 123.99 212 0.717 24M 137K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.0 10.7 13.3 32.4 19.1 11.9 3.8 161.5 218.1 152.02 123.99 212 0.717 24M 137K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.0 10.7 13.3 23.8 10.6 0.0 0.0 196.0 194.9 125.21 101.72 90 1.391 24M 137K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 326.6 26.81 22.27 122 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.8 total, 46.6 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.38 GB write, 708.59 MB/s write, 23.97 GB read, 524.51 MB/s read, 152.0 seconds Interval compaction: 32.38 GB write, 712.05 MB/s write, 23.97 GB read, 527.06 MB/s read, 152.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 33, total-stops: 59, interval: 92 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3805056 Average: 2.8867 StdDev: 29.67 Min: 0 Median: 1.5302 Max: 10980 Percentiles: P50: 1.53 P75: 1.92 P99: 6.89 P99.9: 141.65 P99.99: 420.38 ------------------------------------------------------ [ 0, 1 ] 595133 15.641% 15.641% ### ( 1, 2 ] 2465895 64.806% 80.446% ############# ( 2, 3 ] 448522 11.788% 92.234% ## ( 3, 4 ] 143158 3.762% 95.996% # ( 4, 6 ] 107450 2.824% 98.820% # ( 6, 10 ] 30838 0.810% 99.630% ( 10, 15 ] 4261 0.112% 99.742% ( 15, 22 ] 607 0.016% 99.758% ( 22, 34 ] 47 0.001% 99.760% ( 34, 51 ] 72 0.002% 99.762% ( 51, 76 ] 153 0.004% 99.766% ( 76, 110 ] 3267 0.086% 99.851% ( 110, 170 ] 3505 0.092% 99.944% ( 170, 250 ] 971 0.026% 99.969% ( 250, 380 ] 681 0.018% 99.987% ( 380, 580 ] 577 0.015% 100.002% ( 580, 870 ] 340 0.009% 100.011% ( 870, 1300 ] 180 0.005% 100.016% ( 1300, 1900 ] 96 0.003% 100.018% ( 1900, 2900 ] 83 0.002% 100.020% ( 2900, 4400 ] 85 0.002% 100.023% ( 4400, 6600 ] 14 0.000% 100.023% ( 6600, 9900 ] 4 0.000% 100.023% ( 9900, 14000 ] 2 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1613060 Average: 5.6094 StdDev: 84.67 Min: 0 Median: 1.7642 Max: 10515 Percentiles: P50: 1.76 P75: 2.64 P99: 9.22 P99.9: 252.46 P99.99: 763.74 ------------------------------------------------------ [ 0, 1 ] 130216 8.073% 8.073% ## ( 1, 2 ] 884953 54.862% 62.934% ########### ( 2, 3 ] 305558 18.943% 81.877% #### ( 3, 4 ] 124581 7.723% 89.600% ## ( 4, 6 ] 124335 7.708% 97.308% ## ( 6, 10 ] 33856 2.099% 99.407% ( 10, 15 ] 4833 0.300% 99.707% ( 15, 22 ] 698 0.043% 99.750% ( 22, 34 ] 40 0.002% 99.753% ( 34, 51 ] 24 0.001% 99.754% ( 51, 76 ] 56 0.003% 99.758% ( 76, 110 ] 947 0.059% 99.816% ( 110, 170 ] 987 0.061% 99.877% ( 170, 250 ] 354 0.022% 99.899% ( 250, 380 ] 472 0.029% 99.929% ( 380, 580 ] 568 0.035% 99.964% ( 580, 870 ] 664 0.041% 100.005% ( 870, 1300 ] 542 0.034% 100.039% ( 1300, 1900 ] 330 0.020% 100.059% ( 1900, 2900 ] 289 0.018% 100.077% ( 2900, 4400 ] 317 0.020% 100.097% ( 4400, 6600 ] 101 0.006% 100.103% ( 6600, 9900 ] 16 0.001% 100.104% ( 9900, 14000 ] 3 0.000% 100.104% ** Level 2 read latency histogram (micros): Count: 48932 Average: 2.5013 StdDev: 9.63 Min: 0 Median: 1.5449 Max: 841 Percentiles: P50: 1.54 P75: 1.91 P99: 5.91 P99.9: 118.00 P99.99: 509.21 ------------------------------------------------------ [ 0, 1 ] 6059 12.382% 12.382% ## ( 1, 2 ] 33779 69.033% 81.415% ############## ( 2, 3 ] 5300 10.831% 92.246% ## ( 3, 4 ] 1957 3.999% 96.246% # ( 4, 6 ] 1409 2.880% 99.125% # ( 6, 10 ] 317 0.648% 99.773% ( 10, 15 ] 28 0.057% 99.830% ( 15, 22 ] 8 0.016% 99.847% ( 22, 34 ] 3 0.006% 99.853% ( 34, 51 ] 3 0.006% 99.859% ( 51, 76 ] 1 0.002% 99.861% ( 76, 110 ] 16 0.033% 99.894% ( 110, 170 ] 23 0.047% 99.941% ( 170, 250 ] 10 0.020% 99.961% ( 250, 380 ] 7 0.014% 99.975% ( 380, 580 ] 11 0.022% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 973897 Average: 5.6396 StdDev: 80.66 Min: 0 Median: 2.0160 Max: 8015 Percentiles: P50: 2.02 P75: 3.01 P99: 8.89 P99.9: 18.57 P99.99: 438.55 ------------------------------------------------------ [ 0, 1 ] 15535 1.595% 1.595% ( 1, 2 ] 467479 48.001% 49.596% ########## ( 2, 3 ] 246258 25.286% 74.882% ##### ( 3, 4 ] 109330 11.226% 86.108% ## ( 4, 6 ] 111833 11.483% 97.591% ## ( 6, 10 ] 19004 1.951% 99.542% ( 10, 15 ] 3302 0.339% 99.881% ( 15, 22 ] 357 0.037% 99.918% ( 22, 34 ] 30 0.003% 99.921% ( 34, 51 ] 17 0.002% 99.923% ( 51, 76 ] 11 0.001% 99.924% ( 76, 110 ] 19 0.002% 99.926% ( 110, 170 ] 126 0.013% 99.939% ( 170, 250 ] 150 0.015% 99.954% ( 250, 380 ] 252 0.026% 99.980% ( 380, 580 ] 330 0.034% 100.014% ( 580, 870 ] 419 0.043% 100.057% ( 870, 1300 ] 348 0.036% 100.093% ( 1300, 1900 ] 169 0.017% 100.110% ( 1900, 2900 ] 164 0.017% 100.127% ( 2900, 4400 ] 180 0.018% 100.145% ( 4400, 6600 ] 55 0.006% 100.151% ( 6600, 9900 ] 8 0.001% 100.152% ** Level 4 read latency histogram (micros): Count: 89669 Average: 53.1895 StdDev: 333.68 Min: 0 Median: 2.0736 Max: 7500 Percentiles: P50: 2.07 P75: 3.23 P99: 1596.04 P99.9: 4294.81 P99.99: 6203.79 ------------------------------------------------------ [ 0, 1 ] 1295 1.444% 1.444% ( 1, 2 ] 41945 46.778% 48.222% ######### ( 2, 3 ] 21662 24.158% 72.380% ##### ( 3, 4 ] 10237 11.416% 83.796% ## ( 4, 6 ] 8518 9.499% 93.295% ## ( 6, 10 ] 1990 2.219% 95.515% ( 10, 15 ] 304 0.339% 95.854% ( 15, 22 ] 42 0.047% 95.900% ( 22, 34 ] 18 0.020% 95.921% ( 34, 51 ] 3 0.003% 95.924% ( 51, 76 ] 11 0.012% 95.936% ( 76, 110 ] 22 0.025% 95.961% ( 110, 170 ] 96 0.107% 96.068% ( 170, 250 ] 215 0.240% 96.308% ( 250, 380 ] 317 0.354% 96.661% ( 380, 580 ] 513 0.572% 97.233% ( 580, 870 ] 755 0.842% 98.075% ( 870, 1300 ] 628 0.700% 98.775% ( 1300, 1900 ] 408 0.455% 99.231% ( 1900, 2900 ] 313 0.349% 99.580% ( 2900, 4400 ] 309 0.345% 99.924% ( 4400, 6600 ] 72 0.080% 100.004% ( 6600, 9900 ] 9 0.010% 100.014% ** Level 5 read latency histogram (micros): Count: 260 Average: 1257.5462 StdDev: 1336.99 Min: 75 Median: 691.5385 Max: 7944 Percentiles: P50: 691.54 P75: 1932.26 P99: 6160.00 P99.9: 7944.00 P99.99: 7944.00 ------------------------------------------------------ ( 51, 76 ] 1 0.385% 0.385% ( 76, 110 ] 18 6.923% 7.308% # ( 110, 170 ] 28 10.769% 18.077% ## ( 170, 250 ] 13 5.000% 23.077% # ( 250, 380 ] 29 11.154% 34.231% ## ( 380, 580 ] 31 11.923% 46.154% ## ( 580, 870 ] 26 10.000% 56.154% ## ( 870, 1300 ] 20 7.692% 63.846% ## ( 1300, 1900 ] 28 10.769% 74.615% ## ( 1900, 2900 ] 31 11.923% 86.538% ## ( 2900, 4400 ] 30 11.538% 98.077% ## ( 4400, 6600 ] 3 1.154% 99.231% ( 6600, 9900 ] 2 0.769% 100.000% ** DB Stats ** Uptime(secs): 46.8 total, 3.6 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 189.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.500 H:M:S, 48.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.907 H:M:S, 25.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/27-03:49:26 ... thread 0: (1000000,10000000) ops and (330626.2,201654.7) ops/second in (3.024564,49.589728) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/5 4.35 GB 226.6 9.5 0.0 9.5 18.9 9.5 0.0 2.0 144.8 289.4 66.97 60.45 164 0.408 9846K 17K 0.0 0.0 L1 6/6 584.64 MB 0.0 7.3 4.9 2.4 7.2 4.8 0.2 1.5 222.8 220.1 33.58 31.57 4 8.394 7597K 89K 0.0 0.0 L2 1/0 37.29 MB 0.4 0.2 0.1 0.1 0.2 0.1 4.4 1.5 250.0 249.9 0.77 0.74 2 0.386 195K 90 0.0 0.0 L3 14/0 995.28 MB 1.0 4.2 2.1 2.1 4.2 2.1 2.4 2.0 156.3 155.3 27.81 19.53 18 1.545 4414K 27K 0.0 0.0 L4 165/0 9.48 GB 1.0 3.9 3.5 0.3 3.9 3.5 0.7 1.1 132.8 132.5 29.83 18.28 41 0.728 3925K 4434 0.0 0.0 L5 1092/0 90.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1294/11 105.47 GB 0.0 25.1 10.7 14.4 34.4 20.0 12.0 3.6 161.5 221.7 158.96 130.58 229 0.694 25M 139K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.1 10.7 14.4 34.4 20.0 11.9 3.6 161.5 221.7 158.96 130.58 229 0.694 25M 139K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.1 10.7 14.4 24.9 10.6 0.0 0.0 198.3 197.2 129.46 105.89 94 1.377 25M 139K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 328.8 29.51 24.68 135 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.8 total, 49.6 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.41 GB write, 707.28 MB/s write, 25.08 GB read, 515.42 MB/s read, 159.0 seconds Interval compaction: 34.41 GB write, 710.52 MB/s write, 25.08 GB read, 517.78 MB/s read, 159.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 34, total-stops: 62, interval: 96 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4224807 Average: 2.8365 StdDev: 28.35 Min: 0 Median: 1.5369 Max: 10980 Percentiles: P50: 1.54 P75: 1.92 P99: 6.76 P99.9: 133.40 P99.99: 371.51 ------------------------------------------------------ [ 0, 1 ] 637937 15.100% 15.100% ### ( 1, 2 ] 2746072 64.999% 80.099% ############# ( 2, 3 ] 514993 12.190% 92.288% ## ( 3, 4 ] 158134 3.743% 96.031% # ( 4, 6 ] 118878 2.814% 98.845% # ( 6, 10 ] 34449 0.815% 99.660% ( 10, 15 ] 4539 0.107% 99.768% ( 15, 22 ] 635 0.015% 99.783% ( 22, 34 ] 50 0.001% 99.784% ( 34, 51 ] 72 0.002% 99.786% ( 51, 76 ] 153 0.004% 99.789% ( 76, 110 ] 3288 0.078% 99.867% ( 110, 170 ] 3544 0.084% 99.951% ( 170, 250 ] 990 0.023% 99.975% ( 250, 380 ] 696 0.016% 99.991% ( 380, 580 ] 593 0.014% 100.005% ( 580, 870 ] 352 0.008% 100.013% ( 870, 1300 ] 187 0.004% 100.018% ( 1300, 1900 ] 97 0.002% 100.020% ( 1900, 2900 ] 84 0.002% 100.022% ( 2900, 4400 ] 86 0.002% 100.024% ( 4400, 6600 ] 14 0.000% 100.025% ( 6600, 9900 ] 4 0.000% 100.025% ( 9900, 14000 ] 2 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1613060 Average: 5.6094 StdDev: 84.67 Min: 0 Median: 1.7642 Max: 10515 Percentiles: P50: 1.76 P75: 2.64 P99: 9.22 P99.9: 252.46 P99.99: 763.74 ------------------------------------------------------ [ 0, 1 ] 130216 8.073% 8.073% ## ( 1, 2 ] 884953 54.862% 62.934% ########### ( 2, 3 ] 305558 18.943% 81.877% #### ( 3, 4 ] 124581 7.723% 89.600% ## ( 4, 6 ] 124335 7.708% 97.308% ## ( 6, 10 ] 33856 2.099% 99.407% ( 10, 15 ] 4833 0.300% 99.707% ( 15, 22 ] 698 0.043% 99.750% ( 22, 34 ] 40 0.002% 99.753% ( 34, 51 ] 24 0.001% 99.754% ( 51, 76 ] 56 0.003% 99.758% ( 76, 110 ] 947 0.059% 99.816% ( 110, 170 ] 987 0.061% 99.877% ( 170, 250 ] 354 0.022% 99.899% ( 250, 380 ] 472 0.029% 99.929% ( 380, 580 ] 568 0.035% 99.964% ( 580, 870 ] 664 0.041% 100.005% ( 870, 1300 ] 542 0.034% 100.039% ( 1300, 1900 ] 330 0.020% 100.059% ( 1900, 2900 ] 289 0.018% 100.077% ( 2900, 4400 ] 317 0.020% 100.097% ( 4400, 6600 ] 101 0.006% 100.103% ( 6600, 9900 ] 16 0.001% 100.104% ( 9900, 14000 ] 3 0.000% 100.104% ** Level 2 read latency histogram (micros): Count: 48932 Average: 2.5013 StdDev: 9.63 Min: 0 Median: 1.5449 Max: 841 Percentiles: P50: 1.54 P75: 1.91 P99: 5.91 P99.9: 118.00 P99.99: 509.21 ------------------------------------------------------ [ 0, 1 ] 6059 12.382% 12.382% ## ( 1, 2 ] 33779 69.033% 81.415% ############## ( 2, 3 ] 5300 10.831% 92.246% ## ( 3, 4 ] 1957 3.999% 96.246% # ( 4, 6 ] 1409 2.880% 99.125% # ( 6, 10 ] 317 0.648% 99.773% ( 10, 15 ] 28 0.057% 99.830% ( 15, 22 ] 8 0.016% 99.847% ( 22, 34 ] 3 0.006% 99.853% ( 34, 51 ] 3 0.006% 99.859% ( 51, 76 ] 1 0.002% 99.861% ( 76, 110 ] 16 0.033% 99.894% ( 110, 170 ] 23 0.047% 99.941% ( 170, 250 ] 10 0.020% 99.961% ( 250, 380 ] 7 0.014% 99.975% ( 380, 580 ] 11 0.022% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 973897 Average: 5.6396 StdDev: 80.66 Min: 0 Median: 2.0160 Max: 8015 Percentiles: P50: 2.02 P75: 3.01 P99: 8.89 P99.9: 18.57 P99.99: 438.55 ------------------------------------------------------ [ 0, 1 ] 15535 1.595% 1.595% ( 1, 2 ] 467479 48.001% 49.596% ########## ( 2, 3 ] 246258 25.286% 74.882% ##### ( 3, 4 ] 109330 11.226% 86.108% ## ( 4, 6 ] 111833 11.483% 97.591% ## ( 6, 10 ] 19004 1.951% 99.542% ( 10, 15 ] 3302 0.339% 99.881% ( 15, 22 ] 357 0.037% 99.918% ( 22, 34 ] 30 0.003% 99.921% ( 34, 51 ] 17 0.002% 99.923% ( 51, 76 ] 11 0.001% 99.924% ( 76, 110 ] 19 0.002% 99.926% ( 110, 170 ] 126 0.013% 99.939% ( 170, 250 ] 150 0.015% 99.954% ( 250, 380 ] 252 0.026% 99.980% ( 380, 580 ] 330 0.034% 100.014% ( 580, 870 ] 419 0.043% 100.057% ( 870, 1300 ] 348 0.036% 100.093% ( 1300, 1900 ] 169 0.017% 100.110% ( 1900, 2900 ] 164 0.017% 100.127% ( 2900, 4400 ] 180 0.018% 100.145% ( 4400, 6600 ] 55 0.006% 100.151% ( 6600, 9900 ] 8 0.001% 100.152% ** Level 4 read latency histogram (micros): Count: 89669 Average: 53.1895 StdDev: 333.68 Min: 0 Median: 2.0736 Max: 7500 Percentiles: P50: 2.07 P75: 3.23 P99: 1596.04 P99.9: 4294.81 P99.99: 6203.79 ------------------------------------------------------ [ 0, 1 ] 1295 1.444% 1.444% ( 1, 2 ] 41945 46.778% 48.222% ######### ( 2, 3 ] 21662 24.158% 72.380% ##### ( 3, 4 ] 10237 11.416% 83.796% ## ( 4, 6 ] 8518 9.499% 93.295% ## ( 6, 10 ] 1990 2.219% 95.515% ( 10, 15 ] 304 0.339% 95.854% ( 15, 22 ] 42 0.047% 95.900% ( 22, 34 ] 18 0.020% 95.921% ( 34, 51 ] 3 0.003% 95.924% ( 51, 76 ] 11 0.012% 95.936% ( 76, 110 ] 22 0.025% 95.961% ( 110, 170 ] 96 0.107% 96.068% ( 170, 250 ] 215 0.240% 96.308% ( 250, 380 ] 317 0.354% 96.661% ( 380, 580 ] 513 0.572% 97.233% ( 580, 870 ] 755 0.842% 98.075% ( 870, 1300 ] 628 0.700% 98.775% ( 1300, 1900 ] 408 0.455% 99.231% ( 1900, 2900 ] 313 0.349% 99.580% ( 2900, 4400 ] 309 0.345% 99.924% ( 4400, 6600 ] 72 0.080% 100.004% ( 6600, 9900 ] 9 0.010% 100.014% ** Level 5 read latency histogram (micros): Count: 260 Average: 1257.5462 StdDev: 1336.99 Min: 75 Median: 691.5385 Max: 7944 Percentiles: P50: 691.54 P75: 1932.26 P99: 6160.00 P99.9: 7944.00 P99.99: 7944.00 ------------------------------------------------------ ( 51, 76 ] 1 0.385% 0.385% ( 76, 110 ] 18 6.923% 7.308% # ( 110, 170 ] 28 10.769% 18.077% ## ( 170, 250 ] 13 5.000% 23.077% # ( 250, 380 ] 29 11.154% 34.231% ## ( 380, 580 ] 31 11.923% 46.154% ## ( 580, 870 ] 26 10.000% 56.154% ## ( 870, 1300 ] 20 7.692% 63.846% ## ( 1300, 1900 ] 28 10.769% 74.615% ## ( 1900, 2900 ] 31 11.923% 86.538% ## ( 2900, 4400 ] 30 11.538% 98.077% ## ( 4400, 6600 ] 3 1.154% 99.231% ( 6600, 9900 ] 2 0.769% 100.000% ** DB Stats ** Uptime(secs): 49.8 total, 3.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 197.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.952 H:M:S, 46.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.452 H:M:S, 15.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/27-03:49:36 ... thread 0: (1000000,11000000) ops and (105930.5,186346.3) ops/second in (9.440153,59.029881) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 3.13 GB 6.3 11.9 0.0 11.9 22.2 10.4 0.0 2.1 146.0 273.5 83.26 72.60 180 0.463 12M 27K 0.0 0.0 L1 9/9 1022.41 MB 0.0 10.0 7.1 3.0 9.9 6.9 0.2 1.4 220.7 218.2 46.49 43.28 5 9.298 9824K 89K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 6.1 1.5 250.0 249.9 0.77 0.74 2 0.386 195K 90 0.0 0.0 L3 24/4 1.33 GB 1.0 6.1 3.3 2.9 6.1 3.2 3.0 1.9 150.3 149.3 41.76 28.53 25 1.671 6376K 43K 0.0 0.0 L4 174/20 10.50 GB 1.0 6.0 4.9 1.2 6.0 4.8 0.7 1.2 129.5 128.9 47.77 28.54 58 0.824 6171K 19K 0.0 0.0 L5 1096/0 90.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1313/42 106.32 GB 0.0 34.2 15.3 18.9 44.4 25.5 14.6 4.3 159.4 206.8 220.06 173.69 270 0.815 34M 181K 0.0 0.0 Int 0/0 0.00 KB 0.0 34.2 15.3 18.9 44.4 25.5 14.5 4.3 159.4 206.8 220.06 173.69 270 0.815 34M 181K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 34.2 15.3 18.9 34.0 15.1 0.0 0.0 189.3 188.1 185.30 146.45 123 1.506 34M 181K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.4 10.4 0.0 0.0 0.0 306.3 34.76 27.24 147 0.236 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.3 total, 59.0 interval Flush(GB): cumulative 10.397, interval 10.397 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 44.43 GB write, 767.82 MB/s write, 34.25 GB read, 591.77 MB/s read, 220.1 seconds Interval compaction: 44.43 GB write, 770.78 MB/s write, 34.25 GB read, 594.05 MB/s read, 220.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 75, pending-compaction-bytes-delays: 26, pending-compaction-bytes-stops: 0, total-delays: 48, total-stops: 75, interval: 123 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4967205 Average: 2.9256 StdDev: 30.50 Min: 0 Median: 1.5563 Max: 10980 Percentiles: P50: 1.56 P75: 1.95 P99: 7.08 P99.9: 131.62 P99.99: 452.61 ------------------------------------------------------ [ 0, 1 ] 706827 14.230% 14.230% ### ( 1, 2 ] 3193876 64.299% 78.529% ############# ( 2, 3 ] 636488 12.814% 91.343% ### ( 3, 4 ] 205100 4.129% 95.472% # ( 4, 6 ] 163131 3.284% 98.756% # ( 6, 10 ] 44993 0.906% 99.662% ( 10, 15 ] 5946 0.120% 99.782% ( 15, 22 ] 864 0.017% 99.799% ( 22, 34 ] 69 0.001% 99.800% ( 34, 51 ] 81 0.002% 99.802% ( 51, 76 ] 156 0.003% 99.805% ( 76, 110 ] 3385 0.068% 99.873% ( 110, 170 ] 3668 0.074% 99.947% ( 170, 250 ] 1057 0.021% 99.969% ( 250, 380 ] 799 0.016% 99.985% ( 380, 580 ] 739 0.015% 99.999% ( 580, 870 ] 499 0.010% 100.010% ( 870, 1300 ] 313 0.006% 100.016% ( 1300, 1900 ] 157 0.003% 100.019% ( 1900, 2900 ] 113 0.002% 100.021% ( 2900, 4400 ] 118 0.002% 100.024% ( 4400, 6600 ] 17 0.000% 100.024% ( 6600, 9900 ] 7 0.000% 100.024% ( 9900, 14000 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 2204755 Average: 5.9428 StdDev: 91.22 Min: 0 Median: 1.8011 Max: 12457 Percentiles: P50: 1.80 P75: 2.71 P99: 9.26 P99.9: 209.67 P99.99: 688.83 ------------------------------------------------------ [ 0, 1 ] 151635 6.878% 6.878% # ( 1, 2 ] 1186839 53.831% 60.709% ########### ( 2, 3 ] 441692 20.034% 80.742% #### ( 3, 4 ] 180328 8.179% 88.921% ## ( 4, 6 ] 182739 8.288% 97.210% ## ( 6, 10 ] 48469 2.198% 99.408% ( 10, 15 ] 7217 0.327% 99.735% ( 15, 22 ] 1005 0.046% 99.781% ( 22, 34 ] 61 0.003% 99.784% ( 34, 51 ] 40 0.002% 99.785% ( 51, 76 ] 75 0.003% 99.789% ( 76, 110 ] 1038 0.047% 99.836% ( 110, 170 ] 1199 0.054% 99.890% ( 170, 250 ] 430 0.020% 99.910% ( 250, 380 ] 617 0.028% 99.938% ( 380, 580 ] 794 0.036% 99.974% ( 580, 870 ] 950 0.043% 100.017% ( 870, 1300 ] 780 0.035% 100.052% ( 1300, 1900 ] 486 0.022% 100.074% ( 1900, 2900 ] 436 0.020% 100.094% ( 2900, 4400 ] 501 0.023% 100.117% ( 4400, 6600 ] 158 0.007% 100.124% ( 6600, 9900 ] 33 0.001% 100.126% ( 9900, 14000 ] 5 0.000% 100.126% ** Level 2 read latency histogram (micros): Count: 48932 Average: 2.5013 StdDev: 9.63 Min: 0 Median: 1.5449 Max: 841 Percentiles: P50: 1.54 P75: 1.91 P99: 5.91 P99.9: 118.00 P99.99: 509.21 ------------------------------------------------------ [ 0, 1 ] 6059 12.382% 12.382% ## ( 1, 2 ] 33779 69.033% 81.415% ############## ( 2, 3 ] 5300 10.831% 92.246% ## ( 3, 4 ] 1957 3.999% 96.246% # ( 4, 6 ] 1409 2.880% 99.125% # ( 6, 10 ] 317 0.648% 99.773% ( 10, 15 ] 28 0.057% 99.830% ( 15, 22 ] 8 0.016% 99.847% ( 22, 34 ] 3 0.006% 99.853% ( 34, 51 ] 3 0.006% 99.859% ( 51, 76 ] 1 0.002% 99.861% ( 76, 110 ] 16 0.033% 99.894% ( 110, 170 ] 23 0.047% 99.941% ( 170, 250 ] 10 0.020% 99.961% ( 250, 380 ] 7 0.014% 99.975% ( 380, 580 ] 11 0.022% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1411105 Average: 5.6303 StdDev: 81.08 Min: 0 Median: 2.0684 Max: 8154 Percentiles: P50: 2.07 P75: 3.09 P99: 8.95 P99.9: 16.34 P99.99: 384.92 ------------------------------------------------------ [ 0, 1 ] 18624 1.320% 1.320% ( 1, 2 ] 662045 46.917% 48.237% ######### ( 2, 3 ] 363595 25.767% 74.003% ##### ( 3, 4 ] 161978 11.479% 85.482% ## ( 4, 6 ] 169669 12.024% 97.506% ## ( 6, 10 ] 28552 2.023% 99.529% ( 10, 15 ] 5127 0.363% 99.893% ( 15, 22 ] 543 0.038% 99.931% ( 22, 34 ] 39 0.003% 99.934% ( 34, 51 ] 36 0.003% 99.936% ( 51, 76 ] 28 0.002% 99.938% ( 76, 110 ] 25 0.002% 99.940% ( 110, 170 ] 152 0.011% 99.951% ( 170, 250 ] 200 0.014% 99.965% ( 250, 380 ] 340 0.024% 99.989% ( 380, 580 ] 443 0.031% 100.021% ( 580, 870 ] 544 0.039% 100.059% ( 870, 1300 ] 469 0.033% 100.092% ( 1300, 1900 ] 232 0.016% 100.109% ( 1900, 2900 ] 239 0.017% 100.126% ( 2900, 4400 ] 279 0.020% 100.146% ( 4400, 6600 ] 79 0.006% 100.151% ( 6600, 9900 ] 11 0.001% 100.152% ** Level 4 read latency histogram (micros): Count: 407273 Average: 24.8228 StdDev: 234.03 Min: 0 Median: 2.0932 Max: 10998 Percentiles: P50: 2.09 P75: 3.19 P99: 600.48 P99.9: 2776.06 P99.99: 3603.18 ------------------------------------------------------ [ 0, 1 ] 5081 1.248% 1.248% ( 1, 2 ] 188990 46.404% 47.651% ######### ( 2, 3 ] 102632 25.200% 72.851% ##### ( 3, 4 ] 45197 11.097% 83.949% ## ( 4, 6 ] 45660 11.211% 95.160% ## ( 6, 10 ] 11225 2.756% 97.916% # ( 10, 15 ] 1894 0.465% 98.381% ( 15, 22 ] 217 0.053% 98.434% ( 22, 34 ] 38 0.009% 98.444% ( 34, 51 ] 18 0.004% 98.448% ( 51, 76 ] 23 0.006% 98.454% ( 76, 110 ] 42 0.010% 98.464% ( 110, 170 ] 163 0.040% 98.504% ( 170, 250 ] 330 0.081% 98.585% ( 250, 380 ] 584 0.143% 98.728% ( 380, 580 ] 1006 0.247% 98.975% ( 580, 870 ] 1434 0.352% 99.327% ( 870, 1300 ] 1167 0.287% 99.614% ( 1300, 1900 ] 669 0.164% 99.778% ( 1900, 2900 ] 567 0.139% 99.918% ( 2900, 4400 ] 632 0.155% 100.073% ( 4400, 6600 ] 176 0.043% 100.116% ( 6600, 9900 ] 39 0.010% 100.125% ( 9900, 14000 ] 2 0.000% 100.126% ** Level 5 read latency histogram (micros): Count: 280 Average: 1267.1286 StdDev: 1334.63 Min: 75 Median: 710.0000 Max: 7944 Percentiles: P50: 710.00 P75: 1900.00 P99: 6013.33 P99.9: 7944.00 P99.99: 7944.00 ------------------------------------------------------ ( 51, 76 ] 1 0.357% 0.357% ( 76, 110 ] 18 6.429% 6.786% # ( 110, 170 ] 28 10.000% 16.786% ## ( 170, 250 ] 15 5.357% 22.143% # ( 250, 380 ] 31 11.071% 33.214% ## ( 380, 580 ] 34 12.143% 45.357% ## ( 580, 870 ] 29 10.357% 55.714% ## ( 870, 1300 ] 22 7.857% 63.571% ## ( 1300, 1900 ] 32 11.429% 75.000% ## ( 1900, 2900 ] 31 11.071% 86.071% ## ( 2900, 4400 ] 34 12.143% 98.214% ## ( 4400, 6600 ] 3 1.071% 99.286% ( 6600, 9900 ] 2 0.714% 100.000% ** DB Stats ** Uptime(secs): 59.3 total, 9.4 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 182.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.477 H:M:S, 49.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 104.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.525 H:M:S, 69.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.327 micros/op 187709 ops/sec 60.002 seconds 11262999 operations; 181.9 MB/s Microseconds per write: Count: 11262999 Average: 5.3274 StdDev: 514.38 Min: 0 Median: 1.7311 Max: 854480 Percentiles: P50: 1.73 P75: 2.67 P99: 7.70 P99.9: 1063.28 P99.99: 2648.90 ------------------------------------------------------ [ 0, 1 ] 1566131 13.905% 13.905% ### ( 1, 2 ] 5560332 49.368% 63.273% ########## ( 2, 3 ] 1971579 17.505% 80.778% #### ( 3, 4 ] 1491811 13.245% 94.023% ### ( 4, 6 ] 521441 4.630% 98.653% # ( 6, 10 ] 92137 0.818% 99.471% ( 10, 15 ] 22085 0.196% 99.667% ( 15, 22 ] 6856 0.061% 99.728% ( 22, 34 ] 1522 0.014% 99.742% ( 34, 51 ] 183 0.002% 99.743% ( 51, 76 ] 41 0.000% 99.744% ( 76, 110 ] 8306 0.074% 99.817% ( 110, 170 ] 2733 0.024% 99.842% ( 170, 250 ] 303 0.003% 99.844% ( 250, 380 ] 95 0.001% 99.845% ( 380, 580 ] 43 0.000% 99.846% ( 580, 870 ] 35 0.000% 99.846% ( 870, 1300 ] 13578 0.121% 99.966% ( 1300, 1900 ] 84 0.001% 99.967% ( 1900, 2900 ] 3442 0.031% 99.998% ( 2900, 4400 ] 184 0.002% 99.999% ( 4400, 6600 ] 28 0.000% 100.000% ( 6600, 9900 ] 11 0.000% 100.000% ( 9900, 14000 ] 6 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 234188 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11262999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11623414968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 654 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29725957 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 38233342302 rocksdb.compact.write.bytes COUNT : 37990422350 rocksdb.flush.write.bytes COUNT : 11493877112 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 70 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 391 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11401350144 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4554752 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 38342416876 rocksdb.non.last.level.read.count COUNT : 9262359 rocksdb.block.checksum.compute.count COUNT : 9261121 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.376654 P95 : 3.776364 P99 : 5.973862 P100 : 854477.000000 COUNT : 11262999 SUM : 54893320 rocksdb.compaction.times.micros P50 : 1061315.789474 P95 : 3425000.000000 P99 : 12950000.000000 P100 : 18681347.000000 COUNT : 125 SUM : 187772154 rocksdb.compaction.times.cpu_micros P50 : 863953.488372 P95 : 3425000.000000 P99 : 12950000.000000 P100 : 17118134.000000 COUNT : 125 SUM : 148224316 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 700.833333 P95 : 7796.250000 P99 : 20640.000000 P100 : 31855.000000 COUNT : 151 SUM : 225511 rocksdb.compaction.outfile.sync.micros P50 : 1257.405660 P95 : 110187.500000 P99 : 212933.333333 P100 : 441238.000000 COUNT : 439 SUM : 8482792 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.926316 P95 : 2371.428571 P99 : 4130.000000 P100 : 5261.000000 COUNT : 308 SUM : 132868 rocksdb.table.open.io.micros P50 : 1654.098361 P95 : 7526.538462 P99 : 12958.600000 P100 : 17943.000000 COUNT : 654 SUM : 1530312 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.764738 P95 : 8.293354 P99 : 11.739054 P100 : 12467.000000 COUNT : 9259886 SUM : 66278490 rocksdb.read.block.get.micros P50 : 508.000000 P95 : 3693.333333 P99 : 5491.200000 P100 : 8842.000000 COUNT : 1308 SUM : 1271995 rocksdb.write.raw.block.micros P50 : 0.513826 P95 : 0.976270 P99 : 2.797931 P100 : 16395.000000 COUNT : 11995488 SUM : 26124470 rocksdb.numfiles.in.singlecompaction P50 : 3.043210 P95 : 5.075000 P99 : 16.610000 P100 : 23.000000 COUNT : 177 SUM : 616 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.556863 P95 : 1147.753888 P99 : 2461.945994 P100 : 854287.000000 COUNT : 169645 SUM : 29738116 rocksdb.sst.read.micros P50 : 1.693564 P95 : 5.064180 P99 : 8.853529 P100 : 12457.000000 COUNT : 9263613 SUM : 47099251 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11262999 SUM : 11623414968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215544.554455 P95 : 511100.000000 P99 : 943300.000000 P100 : 1012319.000000 COUNT : 151 SUM : 35711178 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 438 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0