[2024-07-14 22:12:35.175303] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 23.11.0 initialization... [2024-07-14 22:12:35.175563] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4111267 ] Set seed to 1720987955168965 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-14 22:12:35.285188] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-14 22:12:35.323155] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-14 22:12:35.323200] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 4111267' to capture a snapshot of events at runtime. [2024-07-14 22:12:35.323210] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-14 22:12:35.323236] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-14 22:12:35.323244] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid4111267 for offline analysis/debug. [2024-07-14 22:12:35.323323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Jul 14 22:12:39 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/14-22:12:42 ... thread 0: (1000000,1000000) ops and (338892.2,338892.2) ops/second in (2.950791,2.950791) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 629.95 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 346.9 2.54 2.30 12 0.212 0 0 0.0 0.0 L2 3/2 251.76 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 250.6 250.4 1.51 1.46 2 0.754 383K 197 0.0 0.0 L3 9/0 741.31 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 97.00 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.8 1.4 93.3 311.0 4.05 3.76 14 0.289 383K 197 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.4 1.4 93.3 311.0 4.05 3.76 14 0.289 383K 197 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 250.6 250.4 1.51 1.46 2 0.754 383K 197 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 346.9 2.54 2.30 12 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 399.53 MB/s write, 0.37 GB read, 119.87 MB/s read, 4.1 seconds Interval compaction: 1.23 GB write, 426.63 MB/s write, 0.37 GB read, 128.01 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 111441 Average: 1.9636 StdDev: 15.73 Min: 1 Median: 1.3248 Max: 3166 Percentiles: P50: 1.32 P75: 1.73 P99: 3.89 P99.9: 9.11 P99.99: 287.08 ------------------------------------------------------ [ 0, 1 ] 33132 29.731% 29.731% ###### ( 1, 2 ] 69556 62.415% 92.146% ############ ( 2, 3 ] 6324 5.675% 97.820% # ( 3, 4 ] 1486 1.333% 99.154% ( 4, 6 ] 705 0.633% 99.786% ( 6, 10 ] 164 0.147% 99.934% ( 10, 15 ] 40 0.036% 99.969% ( 15, 22 ] 9 0.008% 99.978% ( 22, 34 ] 1 0.001% 99.978% ( 51, 76 ] 1 0.001% 99.979% ( 110, 170 ] 9 0.008% 99.987% ( 170, 250 ] 3 0.003% 99.990% ( 250, 380 ] 3 0.003% 99.993% ( 380, 580 ] 1 0.001% 99.994% ( 580, 870 ] 4 0.004% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 71114 Average: 2.1280 StdDev: 24.21 Min: 1 Median: 1.3661 Max: 4759 Percentiles: P50: 1.37 P75: 1.75 P99: 4.82 P99.9: 9.47 P99.99: 708.85 ------------------------------------------------------ [ 0, 1 ] 18635 26.204% 26.204% ##### ( 1, 2 ] 46227 65.004% 91.208% ############# ( 2, 3 ] 4067 5.719% 96.927% # ( 3, 4 ] 1171 1.647% 98.574% ( 4, 6 ] 740 1.041% 99.615% ( 6, 10 ] 235 0.330% 99.945% ( 10, 15 ] 21 0.030% 99.975% ( 15, 22 ] 2 0.003% 99.978% ( 76, 110 ] 1 0.001% 99.979% ( 170, 250 ] 1 0.001% 99.980% ( 250, 380 ] 6 0.008% 99.989% ( 380, 580 ] 1 0.001% 99.990% ( 580, 870 ] 2 0.003% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 3 0.004% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ( 4400, 6600 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 55 Average: 1487.6364 StdDev: 1421.18 Min: 70 Median: 923.7500 Max: 4843 Percentiles: P50: 923.75 P75: 2650.00 P99: 4843.00 P99.9: 4843.00 P99.99: 4843.00 ------------------------------------------------------ ( 51, 76 ] 1 1.818% 1.818% ( 76, 110 ] 2 3.636% 5.455% # ( 110, 170 ] 6 10.909% 16.364% ## ( 170, 250 ] 5 9.091% 25.455% ## ( 250, 380 ] 5 9.091% 34.545% ## ( 380, 580 ] 5 9.091% 43.636% ## ( 580, 870 ] 3 5.455% 49.091% # ( 870, 1300 ] 4 7.273% 56.364% # ( 1300, 1900 ] 5 9.091% 65.455% ## ( 1900, 2900 ] 7 12.727% 78.182% ### ( 2900, 4400 ] 8 14.545% 92.727% ### ( 4400, 6600 ] 4 7.273% 100.000% # ** Level 4 read latency histogram (micros): Count: 15 Average: 1498.0000 StdDev: 1249.12 Min: 210 Median: 1085.0000 Max: 4424 Percentiles: P50: 1085.00 P75: 2025.00 P99: 4424.00 P99.9: 4424.00 P99.99: 4424.00 ------------------------------------------------------ ( 170, 250 ] 1 6.667% 6.667% # ( 250, 380 ] 2 13.333% 20.000% ### ( 380, 580 ] 2 13.333% 33.333% ### ( 580, 870 ] 1 6.667% 40.000% # ( 870, 1300 ] 3 20.000% 60.000% #### ( 1300, 1900 ] 2 13.333% 73.333% ### ( 1900, 2900 ] 2 13.333% 86.667% ### ( 2900, 4400 ] 1 6.667% 93.333% # ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 566.1500 StdDev: 685.15 Min: 76 Median: 150.0000 Max: 2129 Percentiles: P50: 150.00 P75: 580.00 P99: 2129.00 P99.9: 2129.00 P99.99: 2129.00 ------------------------------------------------------ ( 51, 76 ] 1 5.000% 5.000% # ( 76, 110 ] 5 25.000% 30.000% ##### ( 110, 170 ] 6 30.000% 60.000% ###### ( 380, 580 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 312.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.436 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.436 H:M:S, 14.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-22:12:45 ... thread 0: (1000000,2000000) ops and (332509.2,335670.3) ops/second in (3.007436,5.958227) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.23 GB 6.3 0.6 0.0 0.6 2.4 1.8 0.0 1.3 74.7 323.5 7.59 7.02 28 0.271 575K 595 0.0 0.0 L1 1/1 2.94 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 235.4 235.0 1.61 1.55 1 1.606 383K 629 0.0 0.0 L2 2/0 54.71 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 250.6 250.4 1.51 1.46 2 0.754 383K 197 0.0 0.0 L3 42/0 996.52 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 203.1 202.8 3.92 3.49 3 1.307 808K 870 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/11 97.98 GB 0.0 2.1 1.1 1.0 3.9 3.0 2.1 2.1 144.9 273.9 14.63 13.52 34 0.430 2151K 2291 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 1.1 1.0 3.9 3.0 1.7 2.1 144.9 273.9 14.63 13.52 34 0.430 2151K 2291 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 1.1 1.0 2.1 1.1 0.0 0.0 228.7 228.4 9.27 8.69 8 1.158 2151K 2291 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.5 5.36 4.83 26 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.91 GB write, 650.39 MB/s write, 2.07 GB read, 343.99 MB/s read, 14.6 seconds Interval compaction: 3.91 GB write, 672.25 MB/s write, 2.07 GB read, 355.56 MB/s read, 14.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 386090 Average: 2.1958 StdDev: 10.30 Min: 1 Median: 1.5021 Max: 3166 Percentiles: P50: 1.50 P75: 1.89 P99: 5.58 P99.9: 9.79 P99.99: 20.67 ------------------------------------------------------ [ 0, 1 ] 67639 17.519% 17.519% #### ( 1, 2 ] 249746 64.686% 82.205% ############# ( 2, 3 ] 44853 11.617% 93.822% ## ( 3, 4 ] 12966 3.358% 97.180% # ( 4, 6 ] 8913 2.309% 99.489% ( 6, 10 ] 1678 0.435% 99.924% ( 10, 15 ] 225 0.058% 99.982% ( 15, 22 ] 40 0.010% 99.992% ( 22, 34 ] 3 0.001% 99.993% ( 34, 51 ] 3 0.001% 99.994% ( 51, 76 ] 4 0.001% 99.995% ( 110, 170 ] 18 0.005% 99.999% ( 170, 250 ] 8 0.002% 100.002% ( 250, 380 ] 11 0.003% 100.004% ( 380, 580 ] 1 0.000% 100.005% ( 580, 870 ] 10 0.003% 100.007% ( 870, 1300 ] 1 0.000% 100.008% ( 1300, 1900 ] 4 0.001% 100.009% ( 1900, 2900 ] 2 0.001% 100.009% ( 2900, 4400 ] 1 0.000% 100.009% ** Level 1 read latency histogram (micros): Count: 81613 Average: 2.5362 StdDev: 7.71 Min: 1 Median: 1.7110 Max: 1750 Percentiles: P50: 1.71 P75: 2.33 P99: 5.95 P99.9: 12.78 P99.99: 16.58 ------------------------------------------------------ [ 0, 1 ] 4309 5.280% 5.280% # ( 1, 2 ] 51336 62.902% 68.182% ############# ( 2, 3 ] 16752 20.526% 88.708% #### ( 3, 4 ] 4632 5.676% 94.383% # ( 4, 6 ] 3872 4.744% 99.128% # ( 6, 10 ] 543 0.665% 99.793% ( 10, 15 ] 157 0.192% 99.985% ( 15, 22 ] 17 0.021% 100.006% ( 22, 34 ] 2 0.002% 100.009% ( 110, 170 ] 1 0.001% 100.010% ( 170, 250 ] 1 0.001% 100.011% ( 250, 380 ] 4 0.005% 100.016% ( 870, 1300 ] 1 0.001% 100.017% ( 1300, 1900 ] 1 0.001% 100.018% ** Level 2 read latency histogram (micros): Count: 95460 Average: 2.1594 StdDev: 20.90 Min: 1 Median: 1.4252 Max: 4759 Percentiles: P50: 1.43 P75: 1.81 P99: 5.21 P99.9: 9.50 P99.99: 368.17 ------------------------------------------------------ [ 0, 1 ] 21036 22.036% 22.036% #### ( 1, 2 ] 62778 65.764% 87.800% ############# ( 2, 3 ] 7627 7.990% 95.790% ## ( 3, 4 ] 2183 2.287% 98.077% ( 4, 6 ] 1451 1.520% 99.597% ( 6, 10 ] 331 0.347% 99.943% ( 10, 15 ] 33 0.035% 99.978% ( 15, 22 ] 4 0.004% 99.982% ( 76, 110 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 6 0.006% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 1 0.001% 99.995% ( 1300, 1900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57431 Average: 4.0124 StdDev: 64.19 Min: 0 Median: 1.7032 Max: 4843 Percentiles: P50: 1.70 P75: 2.32 P99: 6.26 P99.9: 131.41 P99.99: 2793.84 ------------------------------------------------------ [ 0, 1 ] 3386 5.896% 5.896% # ( 1, 2 ] 36022 62.722% 68.618% ############# ( 2, 3 ] 11512 20.045% 88.663% #### ( 3, 4 ] 3238 5.638% 94.301% # ( 4, 6 ] 2674 4.656% 98.957% # ( 6, 10 ] 376 0.655% 99.612% ( 10, 15 ] 111 0.193% 99.805% ( 15, 22 ] 19 0.033% 99.838% ( 22, 34 ] 27 0.047% 99.885% ( 34, 51 ] 2 0.003% 99.889% ( 51, 76 ] 1 0.002% 99.890% ( 76, 110 ] 2 0.003% 99.894% ( 110, 170 ] 10 0.017% 99.911% ( 170, 250 ] 9 0.016% 99.927% ( 250, 380 ] 8 0.014% 99.941% ( 380, 580 ] 7 0.012% 99.953% ( 580, 870 ] 5 0.009% 99.962% ( 870, 1300 ] 4 0.007% 99.969% ( 1300, 1900 ] 6 0.010% 99.979% ( 1900, 2900 ] 7 0.012% 99.991% ( 2900, 4400 ] 8 0.014% 100.005% ( 4400, 6600 ] 4 0.007% 100.012% ** Level 4 read latency histogram (micros): Count: 15 Average: 1498.0000 StdDev: 1249.12 Min: 210 Median: 1085.0000 Max: 4424 Percentiles: P50: 1085.00 P75: 2025.00 P99: 4424.00 P99.9: 4424.00 P99.99: 4424.00 ------------------------------------------------------ ( 170, 250 ] 1 6.667% 6.667% # ( 250, 380 ] 2 13.333% 20.000% ### ( 380, 580 ] 2 13.333% 33.333% ### ( 580, 870 ] 1 6.667% 40.000% # ( 870, 1300 ] 3 20.000% 60.000% #### ( 1300, 1900 ] 2 13.333% 73.333% ### ( 1900, 2900 ] 2 13.333% 86.667% ### ( 2900, 4400 ] 1 6.667% 93.333% # ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 600.5250 StdDev: 681.31 Min: 58 Median: 164.5455 Max: 2339 Percentiles: P50: 164.55 P75: 1156.67 P99: 2339.00 P99.9: 2339.00 P99.99: 2339.00 ------------------------------------------------------ ( 51, 76 ] 2 5.000% 5.000% # ( 76, 110 ] 8 20.000% 25.000% #### ( 110, 170 ] 11 27.500% 52.500% ###### ( 170, 250 ] 2 5.000% 57.500% # ( 250, 380 ] 1 2.500% 60.000% # ( 380, 580 ] 4 10.000% 70.000% ## ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 7 17.500% 95.000% #### ( 1900, 2900 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 319.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.892 H:M:S, 14.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.456 H:M:S, 15.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-22:12:48 ... thread 0: (1000000,3000000) ops and (333050.6,334792.5) ops/second in (3.002547,8.960774) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.29 GB 107.0 1.4 0.0 1.4 4.2 2.8 0.0 1.5 106.3 314.3 13.62 12.72 44 0.310 1471K 1575 0.0 0.0 L1 5/0 452.37 MB 45.2 1.2 1.2 0.0 1.2 1.2 0.2 1.0 236.0 235.2 5.35 5.21 2 2.675 1281K 3739 0.0 0.0 L2 2/0 54.71 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.8 2.0 250.6 250.4 1.51 1.46 2 0.754 383K 197 0.0 0.0 L3 16/0 817.16 MB 0.8 0.8 0.6 0.2 0.8 0.6 0.5 1.4 203.1 202.8 3.92 3.49 3 1.307 808K 870 0.0 0.0 L4 170/0 9.76 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/4 98.90 GB 0.0 3.8 2.0 1.8 6.6 4.7 3.8 2.4 159.2 275.1 24.40 22.87 51 0.478 3945K 6381 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 2.0 1.8 6.6 4.7 3.4 2.4 159.2 275.1 24.40 22.87 51 0.478 3945K 6381 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 2.0 1.8 3.8 2.0 0.0 0.0 237.4 237.0 16.37 15.65 12 1.364 3945K 6381 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.8 8.04 7.23 39 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.56 GB write, 732.68 MB/s write, 3.79 GB read, 424.03 MB/s read, 24.4 seconds Interval compaction: 6.56 GB write, 749.06 MB/s write, 3.79 GB read, 433.50 MB/s read, 24.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 20, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 794787 Average: 2.2232 StdDev: 9.70 Min: 1 Median: 1.5335 Max: 3166 Percentiles: P50: 1.53 P75: 1.91 P99: 5.50 P99.9: 9.43 P99.99: 13.16 ------------------------------------------------------ [ 0, 1 ] 115475 14.529% 14.529% ### ( 1, 2 ] 528448 66.489% 81.018% ############# ( 2, 3 ] 101489 12.769% 93.788% ### ( 3, 4 ] 27922 3.513% 97.301% # ( 4, 6 ] 18030 2.269% 99.569% ( 6, 10 ] 3069 0.386% 99.955% ( 10, 15 ] 434 0.055% 100.010% ( 15, 22 ] 59 0.007% 100.017% ( 22, 34 ] 10 0.001% 100.019% ( 34, 51 ] 8 0.001% 100.020% ( 51, 76 ] 7 0.001% 100.021% ( 110, 170 ] 25 0.003% 100.024% ( 170, 250 ] 11 0.001% 100.025% ( 250, 380 ] 15 0.002% 100.027% ( 380, 580 ] 4 0.001% 100.028% ( 580, 870 ] 15 0.002% 100.029% ( 870, 1300 ] 5 0.001% 100.030% ( 1300, 1900 ] 6 0.001% 100.031% ( 1900, 2900 ] 6 0.001% 100.032% ( 2900, 4400 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 82404 Average: 2.6925 StdDev: 15.39 Min: 1 Median: 1.7105 Max: 1782 Percentiles: P50: 1.71 P75: 2.33 P99: 5.95 P99.9: 13.33 P99.99: 162.79 ------------------------------------------------------ [ 0, 1 ] 4353 5.283% 5.283% # ( 1, 2 ] 51865 62.940% 68.222% ############# ( 2, 3 ] 16896 20.504% 88.726% #### ( 3, 4 ] 4668 5.665% 94.391% # ( 4, 6 ] 3888 4.718% 99.109% # ( 6, 10 ] 547 0.664% 99.773% ( 10, 15 ] 157 0.191% 99.964% ( 15, 22 ] 17 0.021% 99.984% ( 22, 34 ] 2 0.002% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 2 0.002% 99.990% ( 170, 250 ] 2 0.002% 99.993% ( 250, 380 ] 6 0.007% 100.000% ( 380, 580 ] 5 0.006% 100.006% ( 580, 870 ] 2 0.002% 100.008% ( 870, 1300 ] 3 0.004% 100.012% ( 1300, 1900 ] 5 0.006% 100.018% ** Level 2 read latency histogram (micros): Count: 95460 Average: 2.1594 StdDev: 20.90 Min: 1 Median: 1.4252 Max: 4759 Percentiles: P50: 1.43 P75: 1.81 P99: 5.21 P99.9: 9.50 P99.99: 368.17 ------------------------------------------------------ [ 0, 1 ] 21036 22.036% 22.036% #### ( 1, 2 ] 62778 65.764% 87.800% ############# ( 2, 3 ] 7627 7.990% 95.790% ## ( 3, 4 ] 2183 2.287% 98.077% ( 4, 6 ] 1451 1.520% 99.597% ( 6, 10 ] 331 0.347% 99.943% ( 10, 15 ] 33 0.035% 99.978% ( 15, 22 ] 4 0.004% 99.982% ( 76, 110 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 6 0.006% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 1 0.001% 99.995% ( 1300, 1900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57431 Average: 4.0124 StdDev: 64.19 Min: 0 Median: 1.7032 Max: 4843 Percentiles: P50: 1.70 P75: 2.32 P99: 6.26 P99.9: 131.41 P99.99: 2793.84 ------------------------------------------------------ [ 0, 1 ] 3386 5.896% 5.896% # ( 1, 2 ] 36022 62.722% 68.618% ############# ( 2, 3 ] 11512 20.045% 88.663% #### ( 3, 4 ] 3238 5.638% 94.301% # ( 4, 6 ] 2674 4.656% 98.957% # ( 6, 10 ] 376 0.655% 99.612% ( 10, 15 ] 111 0.193% 99.805% ( 15, 22 ] 19 0.033% 99.838% ( 22, 34 ] 27 0.047% 99.885% ( 34, 51 ] 2 0.003% 99.889% ( 51, 76 ] 1 0.002% 99.890% ( 76, 110 ] 2 0.003% 99.894% ( 110, 170 ] 10 0.017% 99.911% ( 170, 250 ] 9 0.016% 99.927% ( 250, 380 ] 8 0.014% 99.941% ( 380, 580 ] 7 0.012% 99.953% ( 580, 870 ] 5 0.009% 99.962% ( 870, 1300 ] 4 0.007% 99.969% ( 1300, 1900 ] 6 0.010% 99.979% ( 1900, 2900 ] 7 0.012% 99.991% ( 2900, 4400 ] 8 0.014% 100.005% ( 4400, 6600 ] 4 0.007% 100.012% ** Level 4 read latency histogram (micros): Count: 15 Average: 1498.0000 StdDev: 1249.12 Min: 210 Median: 1085.0000 Max: 4424 Percentiles: P50: 1085.00 P75: 2025.00 P99: 4424.00 P99.9: 4424.00 P99.99: 4424.00 ------------------------------------------------------ ( 170, 250 ] 1 6.667% 6.667% # ( 250, 380 ] 2 13.333% 20.000% ### ( 380, 580 ] 2 13.333% 33.333% ### ( 580, 870 ] 1 6.667% 40.000% # ( 870, 1300 ] 3 20.000% 60.000% #### ( 1300, 1900 ] 2 13.333% 73.333% ### ( 1900, 2900 ] 2 13.333% 86.667% ### ( 2900, 4400 ] 1 6.667% 93.333% # ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 647.1833 StdDev: 708.66 Min: 58 Median: 276.0000 Max: 2546 Percentiles: P50: 276.00 P75: 1128.00 P99: 2546.00 P99.9: 2546.00 P99.99: 2546.00 ------------------------------------------------------ ( 51, 76 ] 2 3.333% 3.333% # ( 76, 110 ] 10 16.667% 20.000% ### ( 110, 170 ] 14 23.333% 43.333% ##### ( 170, 250 ] 3 5.000% 48.333% # ( 250, 380 ] 5 8.333% 56.667% ## ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 8 13.333% 91.667% ### ( 1900, 2900 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.346 H:M:S, 14.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.454 H:M:S, 15.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-22:12:51 ... thread 0: (1000000,4000000) ops and (335632.6,335002.1) ops/second in (2.979448,11.940222) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 2.27 GB 63.0 1.9 0.0 1.9 5.7 3.8 0.0 1.5 106.1 314.7 18.41 17.16 60 0.307 1982K 2031 0.0 0.0 L1 5/5 452.37 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 236.0 235.2 5.35 5.21 2 2.675 1281K 3739 0.0 0.0 L2 2/0 54.71 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.8 2.0 250.6 250.4 1.51 1.46 2 0.754 383K 197 0.0 0.0 L3 16/0 817.16 MB 0.8 0.8 0.6 0.2 0.8 0.6 0.5 1.4 203.1 202.8 3.92 3.49 3 1.307 808K 870 0.0 0.0 L4 170/0 9.76 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/17 99.88 GB 0.0 4.3 2.0 2.3 8.0 5.7 3.8 2.1 150.4 281.8 29.19 27.32 67 0.436 4456K 6837 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 2.0 2.3 8.0 5.7 3.4 2.1 150.4 281.8 29.19 27.32 67 0.436 4456K 6837 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 2.0 2.3 4.3 2.0 0.0 0.0 239.4 239.0 18.34 17.56 14 1.310 4456K 6837 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 354.1 10.85 9.76 53 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.03 GB write, 677.38 MB/s write, 4.29 GB read, 361.49 MB/s read, 29.2 seconds Interval compaction: 8.03 GB write, 688.74 MB/s write, 4.29 GB read, 367.55 MB/s read, 29.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 24, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1090692 Average: 2.1975 StdDev: 9.37 Min: 1 Median: 1.5208 Max: 3166 Percentiles: P50: 1.52 P75: 1.90 P99: 5.45 P99.9: 9.56 P99.99: 13.80 ------------------------------------------------------ [ 0, 1 ] 166994 15.311% 15.311% ### ( 1, 2 ] 726550 66.614% 81.925% ############# ( 2, 3 ] 134934 12.371% 94.296% ## ( 3, 4 ] 35303 3.237% 97.533% # ( 4, 6 ] 22102 2.026% 99.559% ( 6, 10 ] 4181 0.383% 99.942% ( 10, 15 ] 685 0.063% 100.005% ( 15, 22 ] 82 0.008% 100.013% ( 22, 34 ] 14 0.001% 100.014% ( 34, 51 ] 10 0.001% 100.015% ( 51, 76 ] 8 0.001% 100.016% ( 76, 110 ] 1 0.000% 100.016% ( 110, 170 ] 35 0.003% 100.019% ( 170, 250 ] 16 0.001% 100.020% ( 250, 380 ] 18 0.002% 100.022% ( 380, 580 ] 6 0.001% 100.023% ( 580, 870 ] 20 0.002% 100.024% ( 870, 1300 ] 10 0.001% 100.025% ( 1300, 1900 ] 8 0.001% 100.026% ( 1900, 2900 ] 7 0.001% 100.027% ( 2900, 4400 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 82405 Average: 2.6925 StdDev: 15.39 Min: 1 Median: 1.7105 Max: 1782 Percentiles: P50: 1.71 P75: 2.33 P99: 5.95 P99.9: 13.33 P99.99: 162.78 ------------------------------------------------------ [ 0, 1 ] 4353 5.282% 5.282% # ( 1, 2 ] 51866 62.940% 68.223% ############# ( 2, 3 ] 16896 20.504% 88.726% #### ( 3, 4 ] 4668 5.665% 94.391% # ( 4, 6 ] 3888 4.718% 99.109% # ( 6, 10 ] 547 0.664% 99.773% ( 10, 15 ] 157 0.191% 99.964% ( 15, 22 ] 17 0.021% 99.984% ( 22, 34 ] 2 0.002% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 2 0.002% 99.990% ( 170, 250 ] 2 0.002% 99.993% ( 250, 380 ] 6 0.007% 100.000% ( 380, 580 ] 5 0.006% 100.006% ( 580, 870 ] 2 0.002% 100.008% ( 870, 1300 ] 3 0.004% 100.012% ( 1300, 1900 ] 5 0.006% 100.018% ** Level 2 read latency histogram (micros): Count: 95460 Average: 2.1594 StdDev: 20.90 Min: 1 Median: 1.4252 Max: 4759 Percentiles: P50: 1.43 P75: 1.81 P99: 5.21 P99.9: 9.50 P99.99: 368.17 ------------------------------------------------------ [ 0, 1 ] 21036 22.036% 22.036% #### ( 1, 2 ] 62778 65.764% 87.800% ############# ( 2, 3 ] 7627 7.990% 95.790% ## ( 3, 4 ] 2183 2.287% 98.077% ( 4, 6 ] 1451 1.520% 99.597% ( 6, 10 ] 331 0.347% 99.943% ( 10, 15 ] 33 0.035% 99.978% ( 15, 22 ] 4 0.004% 99.982% ( 76, 110 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 6 0.006% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 1 0.001% 99.995% ( 1300, 1900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57431 Average: 4.0124 StdDev: 64.19 Min: 0 Median: 1.7032 Max: 4843 Percentiles: P50: 1.70 P75: 2.32 P99: 6.26 P99.9: 131.41 P99.99: 2793.84 ------------------------------------------------------ [ 0, 1 ] 3386 5.896% 5.896% # ( 1, 2 ] 36022 62.722% 68.618% ############# ( 2, 3 ] 11512 20.045% 88.663% #### ( 3, 4 ] 3238 5.638% 94.301% # ( 4, 6 ] 2674 4.656% 98.957% # ( 6, 10 ] 376 0.655% 99.612% ( 10, 15 ] 111 0.193% 99.805% ( 15, 22 ] 19 0.033% 99.838% ( 22, 34 ] 27 0.047% 99.885% ( 34, 51 ] 2 0.003% 99.889% ( 51, 76 ] 1 0.002% 99.890% ( 76, 110 ] 2 0.003% 99.894% ( 110, 170 ] 10 0.017% 99.911% ( 170, 250 ] 9 0.016% 99.927% ( 250, 380 ] 8 0.014% 99.941% ( 380, 580 ] 7 0.012% 99.953% ( 580, 870 ] 5 0.009% 99.962% ( 870, 1300 ] 4 0.007% 99.969% ( 1300, 1900 ] 6 0.010% 99.979% ( 1900, 2900 ] 7 0.012% 99.991% ( 2900, 4400 ] 8 0.014% 100.005% ( 4400, 6600 ] 4 0.007% 100.012% ** Level 4 read latency histogram (micros): Count: 15 Average: 1498.0000 StdDev: 1249.12 Min: 210 Median: 1085.0000 Max: 4424 Percentiles: P50: 1085.00 P75: 2025.00 P99: 4424.00 P99.9: 4424.00 P99.99: 4424.00 ------------------------------------------------------ ( 170, 250 ] 1 6.667% 6.667% # ( 250, 380 ] 2 13.333% 20.000% ### ( 380, 580 ] 2 13.333% 33.333% ### ( 580, 870 ] 1 6.667% 40.000% # ( 870, 1300 ] 3 20.000% 60.000% #### ( 1300, 1900 ] 2 13.333% 73.333% ### ( 1900, 2900 ] 2 13.333% 86.667% ### ( 2900, 4400 ] 1 6.667% 93.333% # ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 647.1833 StdDev: 708.66 Min: 58 Median: 276.0000 Max: 2546 Percentiles: P50: 276.00 P75: 1128.00 P99: 2546.00 P99.9: 2546.00 P99.99: 2546.00 ------------------------------------------------------ ( 51, 76 ] 2 3.333% 3.333% # ( 76, 110 ] 10 16.667% 20.000% ### ( 110, 170 ] 14 23.333% 43.333% ##### ( 170, 250 ] 3 5.000% 48.333% # ( 250, 380 ] 5 8.333% 56.667% ## ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 8 13.333% 91.667% ### ( 1900, 2900 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.766 H:M:S, 14.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.420 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-22:12:54 ... thread 0: (1000000,5000000) ops and (304915.9,328519.1) ops/second in (3.279593,15.219815) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.20 GB 157.3 3.0 0.0 3.0 7.7 4.7 0.0 1.6 121.6 310.1 25.38 23.79 78 0.325 3134K 3276 0.0 0.0 L1 5/5 452.37 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 236.0 235.2 5.35 5.21 2 2.675 1281K 3739 0.0 0.0 L2 2/0 54.71 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.8 2.0 250.6 250.4 1.51 1.46 2 0.754 383K 197 0.0 0.0 L3 16/0 817.16 MB 0.8 0.8 0.6 0.2 0.8 0.6 0.5 1.4 203.1 202.8 3.92 3.49 3 1.307 808K 870 0.0 0.0 L4 170/0 9.76 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1264/17 100.80 GB 0.0 5.4 2.0 3.4 10.1 6.6 3.8 2.2 152.7 284.9 36.16 33.95 85 0.425 5608K 8082 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 2.0 3.4 10.1 6.6 3.4 2.2 152.7 284.9 36.16 33.95 85 0.425 5608K 8082 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 2.0 3.4 5.4 2.0 0.0 0.0 244.0 243.6 22.64 21.79 18 1.258 5608K 8082 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.9 13.53 12.16 67 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.2 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.06 GB write, 668.04 MB/s write, 5.39 GB read, 358.14 MB/s read, 36.2 seconds Interval compaction: 10.06 GB write, 676.83 MB/s write, 5.39 GB read, 362.85 MB/s read, 36.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 25, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1471726 Average: 2.2300 StdDev: 8.89 Min: 0 Median: 1.5353 Max: 3166 Percentiles: P50: 1.54 P75: 1.91 P99: 5.48 P99.9: 9.62 P99.99: 14.05 ------------------------------------------------------ [ 0, 1 ] 209310 14.222% 14.222% ### ( 1, 2 ] 983699 66.840% 81.062% ############# ( 2, 3 ] 192271 13.064% 94.126% ### ( 3, 4 ] 49309 3.350% 97.477% # ( 4, 6 ] 30350 2.062% 99.539% ( 6, 10 ] 5876 0.399% 99.938% ( 10, 15 ] 942 0.064% 100.002% ( 15, 22 ] 107 0.007% 100.009% ( 22, 34 ] 14 0.001% 100.010% ( 34, 51 ] 11 0.001% 100.011% ( 51, 76 ] 14 0.001% 100.012% ( 76, 110 ] 20 0.001% 100.013% ( 110, 170 ] 86 0.006% 100.019% ( 170, 250 ] 38 0.003% 100.022% ( 250, 380 ] 37 0.003% 100.024% ( 380, 580 ] 22 0.001% 100.026% ( 580, 870 ] 32 0.002% 100.028% ( 870, 1300 ] 14 0.001% 100.029% ( 1300, 1900 ] 9 0.001% 100.030% ( 1900, 2900 ] 7 0.000% 100.030% ( 2900, 4400 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 145737 Average: 2.5298 StdDev: 11.93 Min: 1 Median: 1.6647 Max: 1782 Percentiles: P50: 1.66 P75: 2.17 P99: 5.95 P99.9: 12.48 P99.99: 101.08 ------------------------------------------------------ [ 0, 1 ] 10072 6.911% 6.911% # ( 1, 2 ] 94478 64.828% 71.739% ############# ( 2, 3 ] 27572 18.919% 90.658% #### ( 3, 4 ] 6995 4.800% 95.458% # ( 4, 6 ] 5298 3.635% 99.093% # ( 6, 10 ] 1078 0.740% 99.833% ( 10, 15 ] 198 0.136% 99.968% ( 15, 22 ] 19 0.013% 99.981% ( 22, 34 ] 2 0.001% 99.983% ( 34, 51 ] 3 0.002% 99.985% ( 51, 76 ] 3 0.002% 99.987% ( 76, 110 ] 6 0.004% 99.991% ( 110, 170 ] 3 0.002% 99.993% ( 170, 250 ] 2 0.001% 99.995% ( 250, 380 ] 6 0.004% 99.999% ( 380, 580 ] 6 0.004% 100.003% ( 580, 870 ] 3 0.002% 100.005% ( 870, 1300 ] 3 0.002% 100.007% ( 1300, 1900 ] 5 0.003% 100.010% ** Level 2 read latency histogram (micros): Count: 95460 Average: 2.1594 StdDev: 20.90 Min: 1 Median: 1.4252 Max: 4759 Percentiles: P50: 1.43 P75: 1.81 P99: 5.21 P99.9: 9.50 P99.99: 368.17 ------------------------------------------------------ [ 0, 1 ] 21036 22.036% 22.036% #### ( 1, 2 ] 62778 65.764% 87.800% ############# ( 2, 3 ] 7627 7.990% 95.790% ## ( 3, 4 ] 2183 2.287% 98.077% ( 4, 6 ] 1451 1.520% 99.597% ( 6, 10 ] 331 0.347% 99.943% ( 10, 15 ] 33 0.035% 99.978% ( 15, 22 ] 4 0.004% 99.982% ( 76, 110 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 6 0.006% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 1 0.001% 99.995% ( 1300, 1900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57431 Average: 4.0124 StdDev: 64.19 Min: 0 Median: 1.7032 Max: 4843 Percentiles: P50: 1.70 P75: 2.32 P99: 6.26 P99.9: 131.41 P99.99: 2793.84 ------------------------------------------------------ [ 0, 1 ] 3386 5.896% 5.896% # ( 1, 2 ] 36022 62.722% 68.618% ############# ( 2, 3 ] 11512 20.045% 88.663% #### ( 3, 4 ] 3238 5.638% 94.301% # ( 4, 6 ] 2674 4.656% 98.957% # ( 6, 10 ] 376 0.655% 99.612% ( 10, 15 ] 111 0.193% 99.805% ( 15, 22 ] 19 0.033% 99.838% ( 22, 34 ] 27 0.047% 99.885% ( 34, 51 ] 2 0.003% 99.889% ( 51, 76 ] 1 0.002% 99.890% ( 76, 110 ] 2 0.003% 99.894% ( 110, 170 ] 10 0.017% 99.911% ( 170, 250 ] 9 0.016% 99.927% ( 250, 380 ] 8 0.014% 99.941% ( 380, 580 ] 7 0.012% 99.953% ( 580, 870 ] 5 0.009% 99.962% ( 870, 1300 ] 4 0.007% 99.969% ( 1300, 1900 ] 6 0.010% 99.979% ( 1900, 2900 ] 7 0.012% 99.991% ( 2900, 4400 ] 8 0.014% 100.005% ( 4400, 6600 ] 4 0.007% 100.012% ** Level 4 read latency histogram (micros): Count: 15 Average: 1498.0000 StdDev: 1249.12 Min: 210 Median: 1085.0000 Max: 4424 Percentiles: P50: 1085.00 P75: 2025.00 P99: 4424.00 P99.9: 4424.00 P99.99: 4424.00 ------------------------------------------------------ ( 170, 250 ] 1 6.667% 6.667% # ( 250, 380 ] 2 13.333% 20.000% ### ( 380, 580 ] 2 13.333% 33.333% ### ( 580, 870 ] 1 6.667% 40.000% # ( 870, 1300 ] 3 20.000% 60.000% #### ( 1300, 1900 ] 2 13.333% 73.333% ### ( 1900, 2900 ] 2 13.333% 86.667% ### ( 2900, 4400 ] 1 6.667% 93.333% # ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 647.1833 StdDev: 708.66 Min: 58 Median: 276.0000 Max: 2546 Percentiles: P50: 276.00 P75: 1128.00 P99: 2546.00 P99.9: 2546.00 P99.99: 2546.00 ------------------------------------------------------ ( 51, 76 ] 2 3.333% 3.333% # ( 76, 110 ] 10 16.667% 20.000% ### ( 110, 170 ] 14 23.333% 43.333% ##### ( 170, 250 ] 3 5.000% 48.333% # ( 250, 380 ] 5 8.333% 56.667% ## ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 8 13.333% 91.667% ### ( 1900, 2900 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 15.4 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 319.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.480 H:M:S, 16.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 300.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.714 H:M:S, 21.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-22:12:58 ... thread 0: (1000000,6000000) ops and (244653.9,310764.6) ops/second in (4.087406,19.307221) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.77 GB 6.3 4.0 0.0 4.0 9.7 5.7 0.0 1.7 128.0 309.1 31.99 30.04 97 0.330 4157K 4236 0.0 0.0 L1 16/16 1.84 GB 0.0 3.1 2.6 0.4 3.1 2.6 0.2 1.2 231.6 230.1 13.65 13.26 3 4.551 3211K 19K 0.0 0.0 L2 2/0 54.71 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.8 2.0 250.6 250.4 1.51 1.46 2 0.754 383K 197 0.0 0.0 L3 16/0 817.16 MB 0.8 0.8 0.6 0.2 0.8 0.6 0.5 1.4 203.1 202.8 3.92 3.49 3 1.307 808K 870 0.0 0.0 L4 170/0 9.76 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/29 101.77 GB 0.0 8.2 3.4 4.8 13.9 9.0 3.8 2.5 165.1 278.1 51.07 48.25 105 0.486 8561K 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.2 3.4 4.8 13.9 9.0 3.4 2.5 165.1 278.1 51.07 48.25 105 0.486 8561K 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.2 3.4 4.8 8.2 3.4 0.0 0.0 242.8 242.1 34.72 33.56 23 1.510 8561K 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.5 16.35 14.69 82 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.5 total, 19.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.87 GB write, 727.95 MB/s write, 8.23 GB read, 432.17 MB/s read, 51.1 seconds Interval compaction: 13.87 GB write, 735.50 MB/s write, 8.23 GB read, 436.65 MB/s read, 51.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 28, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1790115 Average: 2.2202 StdDev: 9.18 Min: 0 Median: 1.5154 Max: 3296 Percentiles: P50: 1.52 P75: 1.89 P99: 5.46 P99.9: 9.78 P99.99: 18.64 ------------------------------------------------------ [ 0, 1 ] 279254 15.600% 15.600% ### ( 1, 2 ] 1194722 66.740% 82.340% ############# ( 2, 3 ] 217544 12.153% 94.492% ## ( 3, 4 ] 56162 3.137% 97.630% # ( 4, 6 ] 33594 1.877% 99.506% ( 6, 10 ] 7465 0.417% 99.923% ( 10, 15 ] 1117 0.062% 99.986% ( 15, 22 ] 150 0.008% 99.994% ( 22, 34 ] 16 0.001% 99.995% ( 34, 51 ] 12 0.001% 99.996% ( 51, 76 ] 14 0.001% 99.996% ( 76, 110 ] 54 0.003% 99.999% ( 110, 170 ] 243 0.014% 100.013% ( 170, 250 ] 69 0.004% 100.017% ( 250, 380 ] 61 0.003% 100.020% ( 380, 580 ] 40 0.002% 100.022% ( 580, 870 ] 44 0.002% 100.025% ( 870, 1300 ] 16 0.001% 100.026% ( 1300, 1900 ] 11 0.001% 100.026% ( 1900, 2900 ] 7 0.000% 100.027% ( 2900, 4400 ] 2 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 197534 Average: 2.7550 StdDev: 16.87 Min: 0 Median: 1.6171 Max: 1826 Percentiles: P50: 1.62 P75: 2.00 P99: 6.96 P99.9: 121.47 P99.99: 544.25 ------------------------------------------------------ [ 0, 1 ] 19208 9.724% 9.724% ## ( 1, 2 ] 128916 65.263% 74.987% ############# ( 2, 3 ] 32700 16.554% 91.541% ### ( 3, 4 ] 8275 4.189% 95.730% # ( 4, 6 ] 6021 3.048% 98.778% # ( 6, 10 ] 1828 0.925% 99.703% ( 10, 15 ] 243 0.123% 99.826% ( 15, 22 ] 28 0.014% 99.841% ( 22, 34 ] 2 0.001% 99.842% ( 34, 51 ] 4 0.002% 99.844% ( 51, 76 ] 4 0.002% 99.846% ( 76, 110 ] 83 0.042% 99.888% ( 110, 170 ] 128 0.065% 99.952% ( 170, 250 ] 26 0.013% 99.966% ( 250, 380 ] 31 0.016% 99.981% ( 380, 580 ] 21 0.011% 99.992% ( 580, 870 ] 12 0.006% 99.998% ( 870, 1300 ] 9 0.005% 100.003% ( 1300, 1900 ] 10 0.005% 100.008% ** Level 2 read latency histogram (micros): Count: 95460 Average: 2.1594 StdDev: 20.90 Min: 1 Median: 1.4252 Max: 4759 Percentiles: P50: 1.43 P75: 1.81 P99: 5.21 P99.9: 9.50 P99.99: 368.17 ------------------------------------------------------ [ 0, 1 ] 21036 22.036% 22.036% #### ( 1, 2 ] 62778 65.764% 87.800% ############# ( 2, 3 ] 7627 7.990% 95.790% ## ( 3, 4 ] 2183 2.287% 98.077% ( 4, 6 ] 1451 1.520% 99.597% ( 6, 10 ] 331 0.347% 99.943% ( 10, 15 ] 33 0.035% 99.978% ( 15, 22 ] 4 0.004% 99.982% ( 76, 110 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 6 0.006% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 1 0.001% 99.995% ( 1300, 1900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57431 Average: 4.0124 StdDev: 64.19 Min: 0 Median: 1.7032 Max: 4843 Percentiles: P50: 1.70 P75: 2.32 P99: 6.26 P99.9: 131.41 P99.99: 2793.84 ------------------------------------------------------ [ 0, 1 ] 3386 5.896% 5.896% # ( 1, 2 ] 36022 62.722% 68.618% ############# ( 2, 3 ] 11512 20.045% 88.663% #### ( 3, 4 ] 3238 5.638% 94.301% # ( 4, 6 ] 2674 4.656% 98.957% # ( 6, 10 ] 376 0.655% 99.612% ( 10, 15 ] 111 0.193% 99.805% ( 15, 22 ] 19 0.033% 99.838% ( 22, 34 ] 27 0.047% 99.885% ( 34, 51 ] 2 0.003% 99.889% ( 51, 76 ] 1 0.002% 99.890% ( 76, 110 ] 2 0.003% 99.894% ( 110, 170 ] 10 0.017% 99.911% ( 170, 250 ] 9 0.016% 99.927% ( 250, 380 ] 8 0.014% 99.941% ( 380, 580 ] 7 0.012% 99.953% ( 580, 870 ] 5 0.009% 99.962% ( 870, 1300 ] 4 0.007% 99.969% ( 1300, 1900 ] 6 0.010% 99.979% ( 1900, 2900 ] 7 0.012% 99.991% ( 2900, 4400 ] 8 0.014% 100.005% ( 4400, 6600 ] 4 0.007% 100.012% ** Level 4 read latency histogram (micros): Count: 15 Average: 1498.0000 StdDev: 1249.12 Min: 210 Median: 1085.0000 Max: 4424 Percentiles: P50: 1085.00 P75: 2025.00 P99: 4424.00 P99.9: 4424.00 P99.99: 4424.00 ------------------------------------------------------ ( 170, 250 ] 1 6.667% 6.667% # ( 250, 380 ] 2 13.333% 20.000% ### ( 380, 580 ] 2 13.333% 33.333% ### ( 580, 870 ] 1 6.667% 40.000% # ( 870, 1300 ] 3 20.000% 60.000% #### ( 1300, 1900 ] 2 13.333% 73.333% ### ( 1900, 2900 ] 2 13.333% 86.667% ### ( 2900, 4400 ] 1 6.667% 93.333% # ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 647.1833 StdDev: 708.66 Min: 58 Median: 276.0000 Max: 2546 Percentiles: P50: 276.00 P75: 1128.00 P99: 2546.00 P99.9: 2546.00 P99.99: 2546.00 ------------------------------------------------------ ( 51, 76 ] 2 3.333% 3.333% # ( 76, 110 ] 10 16.667% 20.000% ### ( 110, 170 ] 14 23.333% 43.333% ##### ( 170, 250 ] 3 5.000% 48.333% # ( 250, 380 ] 5 8.333% 56.667% ## ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 8 13.333% 91.667% ### ( 1900, 2900 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 19.5 total, 4.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 302.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.031 H:M:S, 20.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 240.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.551 H:M:S, 38.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-22:13:23 ... thread 0: (1000000,7000000) ops and (41051.0,160303.5) ops/second in (24.359940,43.667161) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 3/0 1.04 GB 106.7 5.6 0.0 5.6 12.2 6.6 0.0 1.8 133.0 290.7 43.09 38.98 115 0.375 5820K 7904 0.0 0.0 L1 6/6 697.27 MB 0.0 7.6 5.3 2.3 7.5 5.2 0.2 1.4 216.3 213.3 36.13 33.48 4 9.032 7936K 107K 0.0 0.0 L2 17/13 2.06 GB 5.2 0.4 0.2 0.2 0.4 0.2 4.6 1.8 226.0 225.9 1.86 1.66 3 0.619 385K 197 0.0 0.0 L3 21/7 1.75 GB 0.9 0.9 0.6 0.3 0.9 0.6 2.3 1.5 181.7 181.0 5.15 4.09 5 1.030 950K 3706 0.0 0.0 L4 170/11 9.89 GB 1.0 0.6 0.5 0.1 0.6 0.5 1.5 1.1 118.6 117.9 5.01 2.74 4 1.253 603K 3403 0.0 0.0 L5 1060/0 87.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/37 102.66 GB 0.0 15.1 6.7 8.5 21.7 13.2 10.3 3.3 169.9 243.1 91.24 80.96 131 0.696 15M 123K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.1 6.7 8.5 21.7 13.2 9.8 3.3 169.9 243.1 91.24 80.96 131 0.696 15M 123K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.1 6.7 8.5 15.0 6.6 0.0 0.0 218.2 216.5 71.02 63.59 35 2.029 15M 123K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 336.5 20.22 17.37 96 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.9 total, 43.7 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.66 GB write, 505.56 MB/s write, 15.14 GB read, 353.29 MB/s read, 91.2 seconds Interval compaction: 21.66 GB write, 507.88 MB/s write, 15.14 GB read, 354.91 MB/s read, 91.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 40, interval: 61 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2908165 Average: 2.8850 StdDev: 17.75 Min: 0 Median: 1.4871 Max: 4609 Percentiles: P50: 1.49 P75: 1.87 P99: 7.33 P99.9: 161.18 P99.99: 379.50 ------------------------------------------------------ [ 0, 1 ] 524737 18.044% 18.044% #### ( 1, 2 ] 1908009 65.609% 83.652% ############# ( 2, 3 ] 302336 10.396% 94.048% ## ( 3, 4 ] 84414 2.903% 96.951% # ( 4, 6 ] 53249 1.831% 98.782% ( 6, 10 ] 18998 0.653% 99.435% ( 10, 15 ] 2582 0.089% 99.524% ( 15, 22 ] 631 0.022% 99.546% ( 22, 34 ] 41 0.001% 99.547% ( 34, 51 ] 68 0.002% 99.550% ( 51, 76 ] 206 0.007% 99.557% ( 76, 110 ] 5175 0.178% 99.735% ( 110, 170 ] 5640 0.194% 99.929% ( 170, 250 ] 1057 0.036% 99.965% ( 250, 380 ] 734 0.025% 99.990% ( 380, 580 ] 613 0.021% 100.011% ( 580, 870 ] 218 0.007% 100.019% ( 870, 1300 ] 35 0.001% 100.020% ( 1300, 1900 ] 15 0.001% 100.020% ( 1900, 2900 ] 23 0.001% 100.021% ( 2900, 4400 ] 13 0.000% 100.022% ( 4400, 6600 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1107065 Average: 4.7495 StdDev: 81.18 Min: 0 Median: 1.6591 Max: 13596 Percentiles: P50: 1.66 P75: 2.38 P99: 9.12 P99.9: 130.03 P99.99: 207.66 ------------------------------------------------------ [ 0, 1 ] 152431 13.769% 13.769% ### ( 1, 2 ] 608596 54.974% 68.743% ########### ( 2, 3 ] 181961 16.436% 85.179% ### ( 3, 4 ] 69759 6.301% 91.480% # ( 4, 6 ] 69170 6.248% 97.728% # ( 6, 10 ] 18075 1.633% 99.361% ( 10, 15 ] 3378 0.305% 99.666% ( 15, 22 ] 611 0.055% 99.721% ( 22, 34 ] 26 0.002% 99.724% ( 34, 51 ] 16 0.001% 99.725% ( 51, 76 ] 88 0.008% 99.733% ( 76, 110 ] 1410 0.127% 99.861% ( 110, 170 ] 1309 0.118% 99.979% ( 170, 250 ] 264 0.024% 100.003% ( 250, 380 ] 239 0.022% 100.024% ( 380, 580 ] 297 0.027% 100.051% ( 580, 870 ] 263 0.024% 100.075% ( 870, 1300 ] 183 0.017% 100.091% ( 1300, 1900 ] 109 0.010% 100.101% ( 1900, 2900 ] 133 0.012% 100.113% ( 2900, 4400 ] 147 0.013% 100.126% ( 4400, 6600 ] 56 0.005% 100.132% ( 6600, 9900 ] 23 0.002% 100.134% ( 9900, 14000 ] 7 0.001% 100.134% ** Level 2 read latency histogram (micros): Count: 118876 Average: 4.4584 StdDev: 91.62 Min: 1 Median: 1.5228 Max: 10978 Percentiles: P50: 1.52 P75: 1.93 P99: 6.09 P99.9: 349.44 P99.99: 4822.48 ------------------------------------------------------ [ 0, 1 ] 21221 17.851% 17.851% #### ( 1, 2 ] 73100 61.493% 79.344% ############ ( 2, 3 ] 14025 11.798% 91.142% ## ( 3, 4 ] 4871 4.098% 95.240% # ( 4, 6 ] 4453 3.746% 98.985% # ( 6, 10 ] 809 0.681% 99.666% ( 10, 15 ] 176 0.148% 99.814% ( 15, 22 ] 12 0.010% 99.824% ( 22, 34 ] 1 0.001% 99.825% ( 76, 110 ] 4 0.003% 99.828% ( 110, 170 ] 34 0.029% 99.857% ( 170, 250 ] 32 0.027% 99.884% ( 250, 380 ] 25 0.021% 99.905% ( 380, 580 ] 26 0.022% 99.927% ( 580, 870 ] 20 0.017% 99.944% ( 870, 1300 ] 7 0.006% 99.950% ( 1300, 1900 ] 10 0.008% 99.958% ( 1900, 2900 ] 11 0.009% 99.967% ( 2900, 4400 ] 25 0.021% 99.988% ( 4400, 6600 ] 11 0.009% 99.997% ( 6600, 9900 ] 2 0.002% 99.999% ( 9900, 14000 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 95872 Average: 12.8894 StdDev: 148.12 Min: 0 Median: 1.8088 Max: 7780 Percentiles: P50: 1.81 P75: 2.63 P99: 54.50 P99.9: 2069.33 P99.99: 4100.33 ------------------------------------------------------ [ 0, 1 ] 3906 4.074% 4.074% # ( 1, 2 ] 54439 56.783% 60.857% ########### ( 2, 3 ] 21361 22.281% 83.138% #### ( 3, 4 ] 7794 8.130% 91.268% ## ( 4, 6 ] 5933 6.188% 97.456% # ( 6, 10 ] 1104 1.152% 98.608% ( 10, 15 ] 316 0.330% 98.937% ( 15, 22 ] 29 0.030% 98.967% ( 22, 34 ] 28 0.029% 98.997% ( 34, 51 ] 3 0.003% 99.000% ( 51, 76 ] 2 0.002% 99.002% ( 76, 110 ] 16 0.017% 99.018% ( 110, 170 ] 74 0.077% 99.096% ( 170, 250 ] 76 0.079% 99.175% ( 250, 380 ] 97 0.101% 99.276% ( 380, 580 ] 166 0.173% 99.449% ( 580, 870 ] 201 0.210% 99.659% ( 870, 1300 ] 142 0.148% 99.807% ( 1300, 1900 ] 81 0.084% 99.892% ( 1900, 2900 ] 48 0.050% 99.942% ( 2900, 4400 ] 58 0.060% 100.002% ( 4400, 6600 ] 17 0.018% 100.020% ( 6600, 9900 ] 2 0.002% 100.022% ** Level 4 read latency histogram (micros): Count: 19894 Average: 5.1894 StdDev: 74.84 Min: 1 Median: 2.0288 Max: 4424 Percentiles: P50: 2.03 P75: 2.94 P99: 8.11 P99.9: 215.39 P99.99: 1502.12 ------------------------------------------------------ [ 0, 1 ] 134 0.674% 0.674% ( 1, 2 ] 9656 48.537% 49.211% ########## ( 2, 3 ] 5455 27.420% 76.631% ##### ( 3, 4 ] 2174 10.928% 87.559% ## ( 4, 6 ] 2139 10.752% 98.311% ## ( 6, 10 ] 260 1.307% 99.618% ( 10, 15 ] 44 0.221% 99.839% ( 15, 22 ] 3 0.015% 99.854% ( 34, 51 ] 2 0.010% 99.864% ( 76, 110 ] 2 0.010% 99.874% ( 170, 250 ] 9 0.045% 99.920% ( 250, 380 ] 3 0.015% 99.935% ( 380, 580 ] 2 0.010% 99.945% ( 580, 870 ] 2 0.010% 99.955% ( 870, 1300 ] 6 0.030% 99.985% ( 1300, 1900 ] 3 0.015% 100.000% ( 1900, 2900 ] 4 0.020% 100.020% ( 2900, 4400 ] 4 0.020% 100.040% ( 4400, 6600 ] 1 0.005% 100.045% ** Level 5 read latency histogram (micros): Count: 100 Average: 896.4200 StdDev: 951.42 Min: 58 Median: 480.0000 Max: 4225 Percentiles: P50: 480.00 P75: 1400.00 P99: 4025.00 P99.9: 4225.00 P99.99: 4225.00 ------------------------------------------------------ ( 51, 76 ] 2 2.000% 2.000% ( 76, 110 ] 10 10.000% 12.000% ## ( 110, 170 ] 15 15.000% 27.000% ### ( 170, 250 ] 3 3.000% 30.000% # ( 250, 380 ] 13 13.000% 43.000% ### ( 380, 580 ] 14 14.000% 57.000% ### ( 580, 870 ] 7 7.000% 64.000% # ( 870, 1300 ] 9 9.000% 73.000% ## ( 1300, 1900 ] 12 12.000% 85.000% ## ( 1900, 2900 ] 11 11.000% 96.000% ## ( 2900, 4400 ] 4 4.000% 100.000% # ** DB Stats ** Uptime(secs): 43.9 total, 24.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 157.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.090 H:M:S, 57.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 40.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:21.059 H:M:S, 86.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/07/14-22:13:28 ... thread 0: (1000000,8000000) ops and (175154.1,162020.7) ops/second in (5.709258,49.376419) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 1.96 GB 18.9 6.3 0.0 6.3 13.9 7.6 0.0 1.8 125.5 275.2 51.71 44.71 128 0.404 6587K 9078 0.0 0.0 L1 0/0 0.00 KB 0.0 7.6 5.3 2.3 7.5 5.2 0.2 1.4 216.3 213.3 36.13 33.48 4 9.032 7936K 107K 0.0 0.0 L2 2/1 156.29 MB 1.3 1.1 0.9 0.2 1.1 0.9 4.6 1.3 169.1 168.7 6.92 5.10 4 1.730 439K 197 0.0 0.0 L3 26/9 1.92 GB 1.2 4.0 2.9 1.1 4.0 2.9 2.5 1.4 157.7 156.9 25.81 18.50 16 1.613 4134K 21K 0.0 0.0 L4 188/13 11.60 GB 1.2 3.4 2.9 0.5 3.3 2.9 1.5 1.2 125.8 125.1 27.32 15.94 33 0.828 3412K 14K 0.0 0.0 L5 1068/0 87.91 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/28 103.55 GB 0.0 22.4 12.0 10.4 29.9 19.5 11.2 3.9 155.4 206.7 147.88 117.72 185 0.799 22M 153K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.4 12.0 10.4 29.9 19.5 10.8 3.9 155.4 206.7 147.88 117.72 185 0.799 22M 153K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.4 12.0 10.4 22.3 11.9 0.0 0.0 187.4 186.1 122.60 97.75 78 1.572 22M 153K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 306.5 25.28 19.98 107 0.236 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.6 total, 49.4 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.85 GB write, 616.56 MB/s write, 22.44 GB read, 463.51 MB/s read, 147.9 seconds Interval compaction: 29.85 GB write, 619.06 MB/s write, 22.44 GB read, 465.39 MB/s read, 147.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 69, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 69, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3157636 Average: 3.0198 StdDev: 26.72 Min: 0 Median: 1.5167 Max: 11442 Percentiles: P50: 1.52 P75: 1.91 P99: 7.60 P99.9: 161.25 P99.99: 433.45 ------------------------------------------------------ [ 0, 1 ] 529423 16.766% 16.766% ### ( 1, 2 ] 2031099 64.323% 81.090% ############# ( 2, 3 ] 364999 11.559% 92.649% ## ( 3, 4 ] 110414 3.497% 96.146% # ( 4, 6 ] 80804 2.559% 98.705% # ( 6, 10 ] 23284 0.737% 99.442% ( 10, 15 ] 3413 0.108% 99.550% ( 15, 22 ] 708 0.022% 99.573% ( 22, 34 ] 47 0.001% 99.574% ( 34, 51 ] 74 0.002% 99.577% ( 51, 76 ] 208 0.007% 99.583% ( 76, 110 ] 5177 0.164% 99.747% ( 110, 170 ] 5653 0.179% 99.926% ( 170, 250 ] 1079 0.034% 99.960% ( 250, 380 ] 764 0.024% 99.984% ( 380, 580 ] 652 0.021% 100.005% ( 580, 870 ] 280 0.009% 100.014% ( 870, 1300 ] 74 0.002% 100.016% ( 1300, 1900 ] 35 0.001% 100.017% ( 1900, 2900 ] 48 0.002% 100.019% ( 2900, 4400 ] 45 0.001% 100.020% ( 4400, 6600 ] 9 0.000% 100.021% ( 6600, 9900 ] 5 0.000% 100.021% ( 9900, 14000 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1722098 Average: 5.7790 StdDev: 102.98 Min: 0 Median: 1.7818 Max: 20219 Percentiles: P50: 1.78 P75: 2.65 P99: 9.33 P99.9: 121.31 P99.99: 240.59 ------------------------------------------------------ [ 0, 1 ] 157517 9.147% 9.147% ## ( 1, 2 ] 899885 52.255% 61.402% ########## ( 2, 3 ] 358984 20.846% 82.248% #### ( 3, 4 ] 130325 7.568% 89.816% ## ( 4, 6 ] 130281 7.565% 97.381% ## ( 6, 10 ] 33513 1.946% 99.327% ( 10, 15 ] 6938 0.403% 99.730% ( 15, 22 ] 978 0.057% 99.786% ( 22, 34 ] 51 0.003% 99.789% ( 34, 51 ] 31 0.002% 99.791% ( 51, 76 ] 89 0.005% 99.796% ( 76, 110 ] 1508 0.088% 99.884% ( 110, 170 ] 1464 0.085% 99.969% ( 170, 250 ] 410 0.024% 99.993% ( 250, 380 ] 479 0.028% 100.021% ( 380, 580 ] 627 0.036% 100.057% ( 580, 870 ] 603 0.035% 100.092% ( 870, 1300 ] 381 0.022% 100.114% ( 1300, 1900 ] 240 0.014% 100.128% ( 1900, 2900 ] 282 0.016% 100.144% ( 2900, 4400 ] 345 0.020% 100.165% ( 4400, 6600 ] 137 0.008% 100.172% ( 6600, 9900 ] 54 0.003% 100.176% ( 9900, 14000 ] 12 0.001% 100.176% ( 14000, 22000 ] 7 0.000% 100.177% ** Level 2 read latency histogram (micros): Count: 268877 Average: 6.2602 StdDev: 110.32 Min: 1 Median: 1.8229 Max: 10978 Percentiles: P50: 1.82 P75: 2.73 P99: 8.55 P99.9: 255.11 P99.99: 1030.15 ------------------------------------------------------ [ 0, 1 ] 21688 8.066% 8.066% ## ( 1, 2 ] 137024 50.962% 59.028% ########## ( 2, 3 ] 59098 21.980% 81.007% #### ( 3, 4 ] 22816 8.486% 89.493% ## ( 4, 6 ] 23233 8.641% 98.134% ## ( 6, 10 ] 3651 1.358% 99.492% ( 10, 15 ] 906 0.337% 99.829% ( 15, 22 ] 73 0.027% 99.856% ( 22, 34 ] 11 0.004% 99.860% ( 34, 51 ] 3 0.001% 99.861% ( 51, 76 ] 3 0.001% 99.862% ( 76, 110 ] 7 0.003% 99.865% ( 110, 170 ] 42 0.016% 99.880% ( 170, 250 ] 51 0.019% 99.899% ( 250, 380 ] 54 0.020% 99.919% ( 380, 580 ] 81 0.030% 99.949% ( 580, 870 ] 89 0.033% 99.983% ( 870, 1300 ] 54 0.020% 100.003% ( 1300, 1900 ] 40 0.015% 100.017% ( 1900, 2900 ] 58 0.022% 100.039% ( 2900, 4400 ] 92 0.034% 100.073% ( 4400, 6600 ] 30 0.011% 100.084% ( 6600, 9900 ] 9 0.003% 100.088% ( 9900, 14000 ] 1 0.000% 100.088% ** Level 3 read latency histogram (micros): Count: 754806 Average: 11.5255 StdDev: 149.55 Min: 0 Median: 2.1262 Max: 20219 Percentiles: P50: 2.13 P75: 3.05 P99: 9.78 P99.9: 792.76 P99.99: 1075.48 ------------------------------------------------------ [ 0, 1 ] 8013 1.062% 1.062% ( 1, 2 ] 342697 45.402% 46.464% ######### ( 2, 3 ] 211481 28.018% 74.482% ###### ( 3, 4 ] 86629 11.477% 85.959% ## ( 4, 6 ] 85168 11.283% 97.242% ## ( 6, 10 ] 14061 1.863% 99.105% ( 10, 15 ] 3226 0.427% 99.532% ( 15, 22 ] 318 0.042% 99.574% ( 22, 34 ] 53 0.007% 99.581% ( 34, 51 ] 13 0.002% 99.583% ( 51, 76 ] 9 0.001% 99.584% ( 76, 110 ] 37 0.005% 99.589% ( 110, 170 ] 137 0.018% 99.607% ( 170, 250 ] 234 0.031% 99.638% ( 250, 380 ] 437 0.058% 99.696% ( 380, 580 ] 797 0.106% 99.802% ( 580, 870 ] 1013 0.134% 99.936% ( 870, 1300 ] 857 0.114% 100.050% ( 1300, 1900 ] 494 0.065% 100.115% ( 1900, 2900 ] 405 0.054% 100.169% ( 2900, 4400 ] 423 0.056% 100.225% ( 4400, 6600 ] 129 0.017% 100.242% ( 6600, 9900 ] 38 0.005% 100.247% ( 14000, 22000 ] 2 0.000% 100.247% ** Level 4 read latency histogram (micros): Count: 20232 Average: 11.2692 StdDev: 144.43 Min: 1 Median: 2.0351 Max: 7434 Percentiles: P50: 2.04 P75: 2.96 P99: 11.95 P99.9: 1807.66 P99.99: 3397.10 ------------------------------------------------------ [ 0, 1 ] 175 0.865% 0.865% ( 1, 2 ] 9748 48.181% 49.046% ########## ( 2, 3 ] 5493 27.150% 76.196% ##### ( 3, 4 ] 2187 10.810% 87.006% ## ( 4, 6 ] 2141 10.582% 97.588% ## ( 6, 10 ] 267 1.320% 98.908% ( 10, 15 ] 48 0.237% 99.145% ( 15, 22 ] 7 0.035% 99.180% ( 22, 34 ] 5 0.025% 99.204% ( 34, 51 ] 5 0.025% 99.229% ( 51, 76 ] 5 0.025% 99.254% ( 76, 110 ] 14 0.069% 99.323% ( 110, 170 ] 5 0.025% 99.348% ( 170, 250 ] 46 0.227% 99.575% ( 250, 380 ] 6 0.030% 99.605% ( 380, 580 ] 9 0.044% 99.649% ( 580, 870 ] 13 0.064% 99.713% ( 870, 1300 ] 20 0.099% 99.812% ( 1300, 1900 ] 21 0.104% 99.916% ( 1900, 2900 ] 11 0.054% 99.970% ( 2900, 4400 ] 12 0.059% 100.030% ( 4400, 6600 ] 2 0.010% 100.040% ( 6600, 9900 ] 1 0.005% 100.044% ** Level 5 read latency histogram (micros): Count: 140 Average: 1193.6500 StdDev: 1346.23 Min: 58 Median: 600.7143 Max: 6437 Percentiles: P50: 600.71 P75: 1807.69 P99: 5984.00 P99.9: 6437.00 P99.99: 6437.00 ------------------------------------------------------ ( 51, 76 ] 2 1.429% 1.429% ( 76, 110 ] 11 7.857% 9.286% ## ( 110, 170 ] 19 13.571% 22.857% ### ( 170, 250 ] 5 3.571% 26.429% # ( 250, 380 ] 17 12.143% 38.571% ## ( 380, 580 ] 15 10.714% 49.286% ## ( 580, 870 ] 14 10.000% 59.286% ## ( 870, 1300 ] 11 7.857% 67.143% ## ( 1300, 1900 ] 13 9.286% 76.429% ## ( 1900, 2900 ] 18 12.857% 89.286% ### ( 2900, 4400 ] 10 7.143% 96.429% # ( 4400, 6600 ] 5 3.571% 100.000% # ** DB Stats ** Uptime(secs): 49.6 total, 5.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 158.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.851 H:M:S, 56.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 172.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.760 H:M:S, 48.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/14-22:13:32 ... thread 0: (1000000,9000000) ops and (276696.8,169841.8) ops/second in (3.614064,52.990483) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.89 GB 81.8 7.0 0.0 7.0 15.5 8.5 0.0 1.8 124.2 274.5 57.79 49.87 142 0.407 7291K 10K 0.0 0.0 L1 0/0 0.00 KB 0.0 7.6 5.3 2.3 7.5 5.2 0.2 1.4 216.3 213.3 36.13 33.48 4 9.032 7936K 107K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 0.9 0.2 1.1 0.9 4.6 1.3 169.1 168.7 6.92 5.10 4 1.730 439K 197 0.0 0.0 L3 14/0 999.36 MB 1.0 4.2 3.0 1.2 4.2 3.0 2.5 1.4 158.4 157.6 27.39 19.72 18 1.522 4408K 23K 0.0 0.0 L4 164/0 9.74 GB 1.0 4.5 3.8 0.7 4.5 3.8 1.7 1.2 129.8 129.2 35.81 21.51 43 0.833 4634K 19K 0.0 0.0 L5 1104/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/9 104.46 GB 0.0 24.6 13.1 11.4 32.9 21.4 14.4 3.9 153.3 205.3 164.04 129.69 211 0.777 24M 160K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.6 13.1 11.4 32.9 21.4 13.9 3.9 153.3 205.3 164.04 129.69 211 0.777 24M 160K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.6 13.1 11.4 24.4 13.0 0.0 0.0 185.8 184.5 135.42 107.21 92 1.472 24M 160K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 303.8 28.62 22.47 119 0.240 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.2 total, 53.0 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.89 GB write, 633.19 MB/s write, 24.57 GB read, 472.92 MB/s read, 164.0 seconds Interval compaction: 32.89 GB write, 635.58 MB/s write, 24.57 GB read, 474.70 MB/s read, 164.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 85, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 85, interval: 106 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3568488 Average: 2.9874 StdDev: 25.95 Min: 0 Median: 1.5374 Max: 11442 Percentiles: P50: 1.54 P75: 1.93 P99: 7.58 P99.9: 156.19 P99.99: 379.70 ------------------------------------------------------ [ 0, 1 ] 555962 15.580% 15.580% ### ( 1, 2 ] 2285701 64.052% 79.632% ############# ( 2, 3 ] 444946 12.469% 92.101% ## ( 3, 4 ] 134568 3.771% 95.872% # ( 4, 6 ] 100371 2.813% 98.685% # ( 6, 10 ] 28484 0.798% 99.483% ( 10, 15 ] 4179 0.117% 99.600% ( 15, 22 ] 798 0.022% 99.622% ( 22, 34 ] 58 0.002% 99.624% ( 34, 51 ] 77 0.002% 99.626% ( 51, 76 ] 212 0.006% 99.632% ( 76, 110 ] 5190 0.145% 99.777% ( 110, 170 ] 5683 0.159% 99.937% ( 170, 250 ] 1114 0.031% 99.968% ( 250, 380 ] 791 0.022% 99.990% ( 380, 580 ] 679 0.019% 100.009% ( 580, 870 ] 301 0.008% 100.018% ( 870, 1300 ] 85 0.002% 100.020% ( 1300, 1900 ] 43 0.001% 100.021% ( 1900, 2900 ] 53 0.001% 100.023% ( 2900, 4400 ] 47 0.001% 100.024% ( 4400, 6600 ] 9 0.000% 100.024% ( 6600, 9900 ] 6 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1820041 Average: 5.7945 StdDev: 101.75 Min: 0 Median: 1.7943 Max: 20219 Percentiles: P50: 1.79 P75: 2.67 P99: 9.36 P99.9: 125.14 P99.99: 276.67 ------------------------------------------------------ [ 0, 1 ] 158199 8.692% 8.692% ## ( 1, 2 ] 946477 52.003% 60.695% ########## ( 2, 3 ] 387489 21.290% 81.985% #### ( 3, 4 ] 139626 7.672% 89.657% ## ( 4, 6 ] 139715 7.676% 97.333% ## ( 6, 10 ] 36071 1.982% 99.315% ( 10, 15 ] 7527 0.414% 99.729% ( 15, 22 ] 1045 0.057% 99.786% ( 22, 34 ] 62 0.003% 99.790% ( 34, 51 ] 34 0.002% 99.791% ( 51, 76 ] 90 0.005% 99.796% ( 76, 110 ] 1513 0.083% 99.880% ( 110, 170 ] 1478 0.081% 99.961% ( 170, 250 ] 429 0.024% 99.984% ( 250, 380 ] 507 0.028% 100.012% ( 380, 580 ] 683 0.038% 100.050% ( 580, 870 ] 656 0.036% 100.086% ( 870, 1300 ] 420 0.023% 100.109% ( 1300, 1900 ] 265 0.015% 100.123% ( 1900, 2900 ] 309 0.017% 100.140% ( 2900, 4400 ] 364 0.020% 100.160% ( 4400, 6600 ] 138 0.008% 100.168% ( 6600, 9900 ] 54 0.003% 100.171% ( 9900, 14000 ] 12 0.001% 100.172% ( 14000, 22000 ] 7 0.000% 100.172% ** Level 2 read latency histogram (micros): Count: 308158 Average: 6.3844 StdDev: 109.62 Min: 1 Median: 1.8506 Max: 10978 Percentiles: P50: 1.85 P75: 2.76 P99: 8.79 P99.9: 394.40 P99.99: 1338.21 ------------------------------------------------------ [ 0, 1 ] 21851 7.091% 7.091% # ( 1, 2 ] 155453 50.446% 57.537% ########## ( 2, 3 ] 70499 22.878% 80.414% ##### ( 3, 4 ] 26922 8.736% 89.151% ## ( 4, 6 ] 27210 8.830% 97.981% ## ( 6, 10 ] 4510 1.464% 99.444% ( 10, 15 ] 1110 0.360% 99.804% ( 15, 22 ] 95 0.031% 99.835% ( 22, 34 ] 15 0.005% 99.840% ( 34, 51 ] 6 0.002% 99.842% ( 51, 76 ] 3 0.001% 99.843% ( 76, 110 ] 8 0.003% 99.846% ( 110, 170 ] 42 0.014% 99.859% ( 170, 250 ] 57 0.018% 99.878% ( 250, 380 ] 62 0.020% 99.898% ( 380, 580 ] 95 0.031% 99.929% ( 580, 870 ] 111 0.036% 99.965% ( 870, 1300 ] 75 0.024% 99.989% ( 1300, 1900 ] 50 0.016% 100.005% ( 1900, 2900 ] 75 0.024% 100.030% ( 2900, 4400 ] 100 0.032% 100.062% ( 4400, 6600 ] 34 0.011% 100.073% ( 6600, 9900 ] 10 0.003% 100.076% ( 9900, 14000 ] 1 0.000% 100.077% ** Level 3 read latency histogram (micros): Count: 914468 Average: 11.0607 StdDev: 144.36 Min: 0 Median: 2.0930 Max: 20219 Percentiles: P50: 2.09 P75: 2.99 P99: 9.75 P99.9: 796.95 P99.99: 1109.24 ------------------------------------------------------ [ 0, 1 ] 9870 1.079% 1.079% ( 1, 2 ] 423656 46.328% 47.407% ######### ( 2, 3 ] 254943 27.879% 75.286% ###### ( 3, 4 ] 102152 11.171% 86.457% ## ( 4, 6 ] 98985 10.824% 97.281% ## ( 6, 10 ] 16743 1.831% 99.112% ( 10, 15 ] 3882 0.425% 99.537% ( 15, 22 ] 393 0.043% 99.580% ( 22, 34 ] 62 0.007% 99.586% ( 34, 51 ] 17 0.002% 99.588% ( 51, 76 ] 11 0.001% 99.589% ( 76, 110 ] 64 0.007% 99.596% ( 110, 170 ] 175 0.019% 99.616% ( 170, 250 ] 283 0.031% 99.647% ( 250, 380 ] 523 0.057% 99.704% ( 380, 580 ] 920 0.101% 99.804% ( 580, 870 ] 1169 0.128% 99.932% ( 870, 1300 ] 950 0.104% 100.036% ( 1300, 1900 ] 560 0.061% 100.097% ( 1900, 2900 ] 485 0.053% 100.150% ( 2900, 4400 ] 512 0.056% 100.206% ( 4400, 6600 ] 133 0.015% 100.221% ( 6600, 9900 ] 40 0.004% 100.225% ( 14000, 22000 ] 2 0.000% 100.225% ** Level 4 read latency histogram (micros): Count: 56780 Average: 14.3077 StdDev: 181.99 Min: 1 Median: 2.0232 Max: 9816 Percentiles: P50: 2.02 P75: 2.94 P99: 13.97 P99.9: 2882.67 P99.99: 5236.31 ------------------------------------------------------ [ 0, 1 ] 521 0.918% 0.918% ( 1, 2 ] 27510 48.450% 49.368% ########## ( 2, 3 ] 15507 27.311% 76.678% ##### ( 3, 4 ] 5958 10.493% 87.172% ## ( 4, 6 ] 5549 9.773% 96.944% ## ( 6, 10 ] 986 1.737% 98.681% ( 10, 15 ] 228 0.402% 99.082% ( 15, 22 ] 25 0.044% 99.126% ( 22, 34 ] 11 0.019% 99.146% ( 34, 51 ] 8 0.014% 99.160% ( 51, 76 ] 5 0.009% 99.169% ( 76, 110 ] 16 0.028% 99.197% ( 110, 170 ] 10 0.018% 99.215% ( 170, 250 ] 74 0.130% 99.345% ( 250, 380 ] 40 0.070% 99.415% ( 380, 580 ] 47 0.083% 99.498% ( 580, 870 ] 65 0.114% 99.613% ( 870, 1300 ] 65 0.114% 99.727% ( 1300, 1900 ] 54 0.095% 99.822% ( 1900, 2900 ] 45 0.079% 99.901% ( 2900, 4400 ] 45 0.079% 99.981% ( 4400, 6600 ] 14 0.025% 100.005% ( 6600, 9900 ] 6 0.011% 100.016% ** Level 5 read latency histogram (micros): Count: 320 Average: 1442.7250 StdDev: 1481.71 Min: 58 Median: 747.8947 Max: 7108 Percentiles: P50: 747.89 P75: 2335.90 P99: 6277.33 P99.9: 7108.00 P99.99: 7108.00 ------------------------------------------------------ ( 51, 76 ] 2 0.625% 0.625% ( 76, 110 ] 13 4.062% 4.688% # ( 110, 170 ] 28 8.750% 13.438% ## ( 170, 250 ] 19 5.938% 19.375% # ( 250, 380 ] 36 11.250% 30.625% ## ( 380, 580 ] 40 12.500% 43.125% ### ( 580, 870 ] 38 11.875% 55.000% ## ( 870, 1300 ] 19 5.938% 60.938% # ( 1300, 1900 ] 28 8.750% 69.688% ## ( 1900, 2900 ] 39 12.188% 81.875% ## ( 2900, 4400 ] 42 13.125% 95.000% ### ( 4400, 6600 ] 15 4.688% 99.688% # ( 6600, 9900 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 53.2 total, 3.6 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 166.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.786 H:M:S, 54.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 272.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.935 H:M:S, 25.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-22:13:35 ... thread 0: (1000000,10000000) ops and (307195.3,177791.2) ops/second in (3.255258,56.245741) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 3.87 GB 188.8 7.8 0.0 7.8 17.3 9.5 0.0 1.8 124.9 277.1 64.06 55.75 159 0.403 8122K 10K 0.0 0.0 L1 0/0 0.00 KB 0.0 7.6 5.3 2.3 7.5 5.2 0.2 1.4 216.3 213.3 36.13 33.48 4 9.032 7936K 107K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 0.9 0.2 1.1 0.9 4.6 1.3 169.1 168.7 6.92 5.10 4 1.730 439K 197 0.0 0.0 L3 14/0 999.36 MB 1.0 4.2 3.0 1.2 4.2 3.0 2.5 1.4 158.4 157.6 27.39 19.72 18 1.522 4408K 23K 0.0 0.0 L4 164/0 9.74 GB 1.0 4.5 3.8 0.7 4.5 3.8 1.7 1.2 129.8 129.2 35.81 21.51 43 0.833 4634K 19K 0.0 0.0 L5 1104/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/9 105.45 GB 0.0 25.4 13.1 12.2 34.7 22.5 14.4 3.6 152.5 208.9 170.31 135.57 228 0.747 25M 161K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.4 13.1 12.2 34.7 22.5 13.9 3.6 152.5 208.9 170.31 135.57 228 0.747 25M 161K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.4 13.1 12.2 25.2 13.0 0.0 0.0 187.5 186.3 138.54 110.28 95 1.458 25M 161K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 307.4 31.77 25.29 133 0.239 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.4 total, 56.2 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.74 GB write, 630.14 MB/s write, 25.37 GB read, 460.15 MB/s read, 170.3 seconds Interval compaction: 34.74 GB write, 632.38 MB/s write, 25.37 GB read, 461.79 MB/s read, 170.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 92, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 92, interval: 113 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3966989 Average: 2.9185 StdDev: 24.82 Min: 0 Median: 1.5397 Max: 11442 Percentiles: P50: 1.54 P75: 1.93 P99: 7.37 P99.9: 150.97 P99.99: 351.59 ------------------------------------------------------ [ 0, 1 ] 603828 15.221% 15.221% ### ( 1, 2 ] 2556382 64.441% 79.663% ############# ( 2, 3 ] 499949 12.603% 92.265% ### ( 3, 4 ] 148194 3.736% 96.001% # ( 4, 6 ] 107963 2.722% 98.723% # ( 6, 10 ] 32059 0.808% 99.531% ( 10, 15 ] 4362 0.110% 99.641% ( 15, 22 ] 820 0.021% 99.661% ( 22, 34 ] 61 0.002% 99.663% ( 34, 51 ] 78 0.002% 99.665% ( 51, 76 ] 214 0.005% 99.670% ( 76, 110 ] 5213 0.131% 99.802% ( 110, 170 ] 5716 0.144% 99.946% ( 170, 250 ] 1129 0.028% 99.974% ( 250, 380 ] 804 0.020% 99.995% ( 380, 580 ] 690 0.017% 100.012% ( 580, 870 ] 305 0.008% 100.020% ( 870, 1300 ] 89 0.002% 100.022% ( 1300, 1900 ] 45 0.001% 100.023% ( 1900, 2900 ] 55 0.001% 100.024% ( 2900, 4400 ] 48 0.001% 100.026% ( 4400, 6600 ] 9 0.000% 100.026% ( 6600, 9900 ] 6 0.000% 100.026% ( 9900, 14000 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1820041 Average: 5.7945 StdDev: 101.75 Min: 0 Median: 1.7943 Max: 20219 Percentiles: P50: 1.79 P75: 2.67 P99: 9.36 P99.9: 125.14 P99.99: 276.67 ------------------------------------------------------ [ 0, 1 ] 158199 8.692% 8.692% ## ( 1, 2 ] 946477 52.003% 60.695% ########## ( 2, 3 ] 387489 21.290% 81.985% #### ( 3, 4 ] 139626 7.672% 89.657% ## ( 4, 6 ] 139715 7.676% 97.333% ## ( 6, 10 ] 36071 1.982% 99.315% ( 10, 15 ] 7527 0.414% 99.729% ( 15, 22 ] 1045 0.057% 99.786% ( 22, 34 ] 62 0.003% 99.790% ( 34, 51 ] 34 0.002% 99.791% ( 51, 76 ] 90 0.005% 99.796% ( 76, 110 ] 1513 0.083% 99.880% ( 110, 170 ] 1478 0.081% 99.961% ( 170, 250 ] 429 0.024% 99.984% ( 250, 380 ] 507 0.028% 100.012% ( 380, 580 ] 683 0.038% 100.050% ( 580, 870 ] 656 0.036% 100.086% ( 870, 1300 ] 420 0.023% 100.109% ( 1300, 1900 ] 265 0.015% 100.123% ( 1900, 2900 ] 309 0.017% 100.140% ( 2900, 4400 ] 364 0.020% 100.160% ( 4400, 6600 ] 138 0.008% 100.168% ( 6600, 9900 ] 54 0.003% 100.171% ( 9900, 14000 ] 12 0.001% 100.172% ( 14000, 22000 ] 7 0.000% 100.172% ** Level 2 read latency histogram (micros): Count: 308158 Average: 6.3844 StdDev: 109.62 Min: 1 Median: 1.8506 Max: 10978 Percentiles: P50: 1.85 P75: 2.76 P99: 8.79 P99.9: 394.40 P99.99: 1338.21 ------------------------------------------------------ [ 0, 1 ] 21851 7.091% 7.091% # ( 1, 2 ] 155453 50.446% 57.537% ########## ( 2, 3 ] 70499 22.878% 80.414% ##### ( 3, 4 ] 26922 8.736% 89.151% ## ( 4, 6 ] 27210 8.830% 97.981% ## ( 6, 10 ] 4510 1.464% 99.444% ( 10, 15 ] 1110 0.360% 99.804% ( 15, 22 ] 95 0.031% 99.835% ( 22, 34 ] 15 0.005% 99.840% ( 34, 51 ] 6 0.002% 99.842% ( 51, 76 ] 3 0.001% 99.843% ( 76, 110 ] 8 0.003% 99.846% ( 110, 170 ] 42 0.014% 99.859% ( 170, 250 ] 57 0.018% 99.878% ( 250, 380 ] 62 0.020% 99.898% ( 380, 580 ] 95 0.031% 99.929% ( 580, 870 ] 111 0.036% 99.965% ( 870, 1300 ] 75 0.024% 99.989% ( 1300, 1900 ] 50 0.016% 100.005% ( 1900, 2900 ] 75 0.024% 100.030% ( 2900, 4400 ] 100 0.032% 100.062% ( 4400, 6600 ] 34 0.011% 100.073% ( 6600, 9900 ] 10 0.003% 100.076% ( 9900, 14000 ] 1 0.000% 100.077% ** Level 3 read latency histogram (micros): Count: 914468 Average: 11.0607 StdDev: 144.36 Min: 0 Median: 2.0930 Max: 20219 Percentiles: P50: 2.09 P75: 2.99 P99: 9.75 P99.9: 796.95 P99.99: 1109.24 ------------------------------------------------------ [ 0, 1 ] 9870 1.079% 1.079% ( 1, 2 ] 423656 46.328% 47.407% ######### ( 2, 3 ] 254943 27.879% 75.286% ###### ( 3, 4 ] 102152 11.171% 86.457% ## ( 4, 6 ] 98985 10.824% 97.281% ## ( 6, 10 ] 16743 1.831% 99.112% ( 10, 15 ] 3882 0.425% 99.537% ( 15, 22 ] 393 0.043% 99.580% ( 22, 34 ] 62 0.007% 99.586% ( 34, 51 ] 17 0.002% 99.588% ( 51, 76 ] 11 0.001% 99.589% ( 76, 110 ] 64 0.007% 99.596% ( 110, 170 ] 175 0.019% 99.616% ( 170, 250 ] 283 0.031% 99.647% ( 250, 380 ] 523 0.057% 99.704% ( 380, 580 ] 920 0.101% 99.804% ( 580, 870 ] 1169 0.128% 99.932% ( 870, 1300 ] 950 0.104% 100.036% ( 1300, 1900 ] 560 0.061% 100.097% ( 1900, 2900 ] 485 0.053% 100.150% ( 2900, 4400 ] 512 0.056% 100.206% ( 4400, 6600 ] 133 0.015% 100.221% ( 6600, 9900 ] 40 0.004% 100.225% ( 14000, 22000 ] 2 0.000% 100.225% ** Level 4 read latency histogram (micros): Count: 56780 Average: 14.3077 StdDev: 181.99 Min: 1 Median: 2.0232 Max: 9816 Percentiles: P50: 2.02 P75: 2.94 P99: 13.97 P99.9: 2882.67 P99.99: 5236.31 ------------------------------------------------------ [ 0, 1 ] 521 0.918% 0.918% ( 1, 2 ] 27510 48.450% 49.368% ########## ( 2, 3 ] 15507 27.311% 76.678% ##### ( 3, 4 ] 5958 10.493% 87.172% ## ( 4, 6 ] 5549 9.773% 96.944% ## ( 6, 10 ] 986 1.737% 98.681% ( 10, 15 ] 228 0.402% 99.082% ( 15, 22 ] 25 0.044% 99.126% ( 22, 34 ] 11 0.019% 99.146% ( 34, 51 ] 8 0.014% 99.160% ( 51, 76 ] 5 0.009% 99.169% ( 76, 110 ] 16 0.028% 99.197% ( 110, 170 ] 10 0.018% 99.215% ( 170, 250 ] 74 0.130% 99.345% ( 250, 380 ] 40 0.070% 99.415% ( 380, 580 ] 47 0.083% 99.498% ( 580, 870 ] 65 0.114% 99.613% ( 870, 1300 ] 65 0.114% 99.727% ( 1300, 1900 ] 54 0.095% 99.822% ( 1900, 2900 ] 45 0.079% 99.901% ( 2900, 4400 ] 45 0.079% 99.981% ( 4400, 6600 ] 14 0.025% 100.005% ( 6600, 9900 ] 6 0.011% 100.016% ** Level 5 read latency histogram (micros): Count: 320 Average: 1442.7250 StdDev: 1481.71 Min: 58 Median: 747.8947 Max: 7108 Percentiles: P50: 747.89 P75: 2335.90 P99: 6277.33 P99.9: 7108.00 P99.99: 7108.00 ------------------------------------------------------ ( 51, 76 ] 2 0.625% 0.625% ( 76, 110 ] 13 4.062% 4.688% # ( 110, 170 ] 28 8.750% 13.438% ## ( 170, 250 ] 19 5.938% 19.375% # ( 250, 380 ] 36 11.250% 30.625% ## ( 380, 580 ] 40 12.500% 43.125% ### ( 580, 870 ] 38 11.875% 55.000% ## ( 870, 1300 ] 19 5.938% 60.938% # ( 1300, 1900 ] 28 8.750% 69.688% ## ( 1900, 2900 ] 39 12.188% 81.875% ## ( 2900, 4400 ] 42 13.125% 95.000% ### ( 4400, 6600 ] 15 4.688% 99.688% # ( 6600, 9900 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 56.4 total, 3.3 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 174.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.502 H:M:S, 52.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.716 H:M:S, 22.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-22:13:39 ... thread 0: (1000000,11000000) ops and (290132.2,184277.9) ops/second in (3.446705,59.692446) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.13 GB 69.2 8.7 0.0 8.7 19.2 10.5 0.0 1.8 126.3 279.4 70.31 61.64 176 0.399 9018K 11K 0.0 0.0 L1 17/17 1.77 GB 0.0 9.4 7.1 2.3 9.3 7.0 0.2 1.3 215.2 212.6 44.78 41.40 5 8.955 9786K 119K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 0.9 0.2 1.1 0.9 4.6 1.3 169.1 168.7 6.92 5.10 4 1.730 439K 197 0.0 0.0 L3 14/0 999.36 MB 1.0 4.2 3.0 1.2 4.2 3.0 2.5 1.4 158.4 157.6 27.39 19.72 18 1.522 4408K 23K 0.0 0.0 L4 164/0 9.74 GB 1.0 4.5 3.8 0.7 4.5 3.8 1.7 1.2 129.8 129.2 35.81 21.51 43 0.833 4634K 19K 0.0 0.0 L5 1104/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1317/32 106.48 GB 0.0 28.0 14.9 13.1 38.3 25.2 14.4 3.6 154.8 212.0 185.21 149.38 246 0.753 28M 173K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.0 14.9 13.1 38.3 25.2 13.9 3.6 154.8 212.0 185.21 149.38 246 0.753 28M 173K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.0 14.9 13.1 27.8 14.7 0.0 0.0 190.4 189.2 150.60 121.55 99 1.521 28M 173K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 311.3 34.61 27.82 147 0.235 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.9 total, 59.7 interval Flush(GB): cumulative 10.520, interval 10.520 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.35 GB write, 655.64 MB/s write, 28.01 GB read, 478.82 MB/s read, 185.2 seconds Interval compaction: 38.35 GB write, 657.84 MB/s write, 28.01 GB read, 480.42 MB/s read, 185.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 94, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 94, interval: 118 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4294705 Average: 2.8847 StdDev: 24.16 Min: 0 Median: 1.5422 Max: 11442 Percentiles: P50: 1.54 P75: 1.93 P99: 7.16 P99.9: 148.17 P99.99: 339.12 ------------------------------------------------------ [ 0, 1 ] 641655 14.941% 14.941% ### ( 1, 2 ] 2777126 64.664% 79.605% ############# ( 2, 3 ] 547533 12.749% 92.354% ### ( 3, 4 ] 160434 3.736% 96.089% # ( 4, 6 ] 115206 2.683% 98.772% # ( 6, 10 ] 33731 0.785% 99.557% ( 10, 15 ] 4557 0.106% 99.663% ( 15, 22 ] 843 0.020% 99.683% ( 22, 34 ] 63 0.001% 99.684% ( 34, 51 ] 80 0.002% 99.686% ( 51, 76 ] 215 0.005% 99.691% ( 76, 110 ] 5269 0.123% 99.814% ( 110, 170 ] 5814 0.135% 99.949% ( 170, 250 ] 1173 0.027% 99.977% ( 250, 380 ] 841 0.020% 99.996% ( 380, 580 ] 726 0.017% 100.013% ( 580, 870 ] 325 0.008% 100.021% ( 870, 1300 ] 93 0.002% 100.023% ( 1300, 1900 ] 48 0.001% 100.024% ( 1900, 2900 ] 56 0.001% 100.025% ( 2900, 4400 ] 49 0.001% 100.026% ( 4400, 6600 ] 9 0.000% 100.027% ( 6600, 9900 ] 6 0.000% 100.027% ( 9900, 14000 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1893859 Average: 5.7057 StdDev: 99.93 Min: 0 Median: 1.7841 Max: 20219 Percentiles: P50: 1.78 P75: 2.65 P99: 9.35 P99.9: 131.07 P99.99: 296.25 ------------------------------------------------------ [ 0, 1 ] 167055 8.821% 8.821% ## ( 1, 2 ] 994550 52.514% 61.335% ########### ( 2, 3 ] 398356 21.034% 82.369% #### ( 3, 4 ] 142330 7.515% 89.885% ## ( 4, 6 ] 141384 7.465% 97.350% # ( 6, 10 ] 37309 1.970% 99.320% ( 10, 15 ] 7614 0.402% 99.722% ( 15, 22 ] 1060 0.056% 99.778% ( 22, 34 ] 65 0.003% 99.782% ( 34, 51 ] 35 0.002% 99.783% ( 51, 76 ] 91 0.005% 99.788% ( 76, 110 ] 1560 0.082% 99.871% ( 110, 170 ] 1584 0.084% 99.954% ( 170, 250 ] 482 0.025% 99.980% ( 250, 380 ] 547 0.029% 100.009% ( 380, 580 ] 707 0.037% 100.046% ( 580, 870 ] 675 0.036% 100.082% ( 870, 1300 ] 425 0.022% 100.104% ( 1300, 1900 ] 272 0.014% 100.118% ( 1900, 2900 ] 311 0.016% 100.135% ( 2900, 4400 ] 365 0.019% 100.154% ( 4400, 6600 ] 138 0.007% 100.161% ( 6600, 9900 ] 54 0.003% 100.164% ( 9900, 14000 ] 12 0.001% 100.165% ( 14000, 22000 ] 7 0.000% 100.165% ** Level 2 read latency histogram (micros): Count: 308158 Average: 6.3844 StdDev: 109.62 Min: 1 Median: 1.8506 Max: 10978 Percentiles: P50: 1.85 P75: 2.76 P99: 8.79 P99.9: 394.40 P99.99: 1338.21 ------------------------------------------------------ [ 0, 1 ] 21851 7.091% 7.091% # ( 1, 2 ] 155453 50.446% 57.537% ########## ( 2, 3 ] 70499 22.878% 80.414% ##### ( 3, 4 ] 26922 8.736% 89.151% ## ( 4, 6 ] 27210 8.830% 97.981% ## ( 6, 10 ] 4510 1.464% 99.444% ( 10, 15 ] 1110 0.360% 99.804% ( 15, 22 ] 95 0.031% 99.835% ( 22, 34 ] 15 0.005% 99.840% ( 34, 51 ] 6 0.002% 99.842% ( 51, 76 ] 3 0.001% 99.843% ( 76, 110 ] 8 0.003% 99.846% ( 110, 170 ] 42 0.014% 99.859% ( 170, 250 ] 57 0.018% 99.878% ( 250, 380 ] 62 0.020% 99.898% ( 380, 580 ] 95 0.031% 99.929% ( 580, 870 ] 111 0.036% 99.965% ( 870, 1300 ] 75 0.024% 99.989% ( 1300, 1900 ] 50 0.016% 100.005% ( 1900, 2900 ] 75 0.024% 100.030% ( 2900, 4400 ] 100 0.032% 100.062% ( 4400, 6600 ] 34 0.011% 100.073% ( 6600, 9900 ] 10 0.003% 100.076% ( 9900, 14000 ] 1 0.000% 100.077% ** Level 3 read latency histogram (micros): Count: 914468 Average: 11.0607 StdDev: 144.36 Min: 0 Median: 2.0930 Max: 20219 Percentiles: P50: 2.09 P75: 2.99 P99: 9.75 P99.9: 796.95 P99.99: 1109.24 ------------------------------------------------------ [ 0, 1 ] 9870 1.079% 1.079% ( 1, 2 ] 423656 46.328% 47.407% ######### ( 2, 3 ] 254943 27.879% 75.286% ###### ( 3, 4 ] 102152 11.171% 86.457% ## ( 4, 6 ] 98985 10.824% 97.281% ## ( 6, 10 ] 16743 1.831% 99.112% ( 10, 15 ] 3882 0.425% 99.537% ( 15, 22 ] 393 0.043% 99.580% ( 22, 34 ] 62 0.007% 99.586% ( 34, 51 ] 17 0.002% 99.588% ( 51, 76 ] 11 0.001% 99.589% ( 76, 110 ] 64 0.007% 99.596% ( 110, 170 ] 175 0.019% 99.616% ( 170, 250 ] 283 0.031% 99.647% ( 250, 380 ] 523 0.057% 99.704% ( 380, 580 ] 920 0.101% 99.804% ( 580, 870 ] 1169 0.128% 99.932% ( 870, 1300 ] 950 0.104% 100.036% ( 1300, 1900 ] 560 0.061% 100.097% ( 1900, 2900 ] 485 0.053% 100.150% ( 2900, 4400 ] 512 0.056% 100.206% ( 4400, 6600 ] 133 0.015% 100.221% ( 6600, 9900 ] 40 0.004% 100.225% ( 14000, 22000 ] 2 0.000% 100.225% ** Level 4 read latency histogram (micros): Count: 56780 Average: 14.3077 StdDev: 181.99 Min: 1 Median: 2.0232 Max: 9816 Percentiles: P50: 2.02 P75: 2.94 P99: 13.97 P99.9: 2882.67 P99.99: 5236.31 ------------------------------------------------------ [ 0, 1 ] 521 0.918% 0.918% ( 1, 2 ] 27510 48.450% 49.368% ########## ( 2, 3 ] 15507 27.311% 76.678% ##### ( 3, 4 ] 5958 10.493% 87.172% ## ( 4, 6 ] 5549 9.773% 96.944% ## ( 6, 10 ] 986 1.737% 98.681% ( 10, 15 ] 228 0.402% 99.082% ( 15, 22 ] 25 0.044% 99.126% ( 22, 34 ] 11 0.019% 99.146% ( 34, 51 ] 8 0.014% 99.160% ( 51, 76 ] 5 0.009% 99.169% ( 76, 110 ] 16 0.028% 99.197% ( 110, 170 ] 10 0.018% 99.215% ( 170, 250 ] 74 0.130% 99.345% ( 250, 380 ] 40 0.070% 99.415% ( 380, 580 ] 47 0.083% 99.498% ( 580, 870 ] 65 0.114% 99.613% ( 870, 1300 ] 65 0.114% 99.727% ( 1300, 1900 ] 54 0.095% 99.822% ( 1900, 2900 ] 45 0.079% 99.901% ( 2900, 4400 ] 45 0.079% 99.981% ( 4400, 6600 ] 14 0.025% 100.005% ( 6600, 9900 ] 6 0.011% 100.016% ** Level 5 read latency histogram (micros): Count: 320 Average: 1442.7250 StdDev: 1481.71 Min: 58 Median: 747.8947 Max: 7108 Percentiles: P50: 747.89 P75: 2335.90 P99: 6277.33 P99.9: 7108.00 P99.99: 7108.00 ------------------------------------------------------ ( 51, 76 ] 2 0.625% 0.625% ( 76, 110 ] 13 4.062% 4.688% # ( 110, 170 ] 28 8.750% 13.438% ## ( 170, 250 ] 19 5.938% 19.375% # ( 250, 380 ] 36 11.250% 30.625% ## ( 380, 580 ] 40 12.500% 43.125% ### ( 580, 870 ] 38 11.875% 55.000% ## ( 870, 1300 ] 19 5.938% 60.938% # ( 1300, 1900 ] 28 8.750% 69.688% ## ( 1900, 2900 ] 39 12.188% 81.875% ## ( 2900, 4400 ] 42 13.125% 95.000% ### ( 4400, 6600 ] 15 4.688% 99.688% # ( 6600, 9900 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 59.9 total, 3.4 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 180.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.411 H:M:S, 50.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 285.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.909 H:M:S, 26.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.395 micros/op 185359 ops/sec 60.002 seconds 11121999 operations; 179.6 MB/s Microseconds per write: Count: 11121999 Average: 5.3947 StdDev: 527.48 Min: 0 Median: 1.7045 Max: 817466 Percentiles: P50: 1.70 P75: 2.62 P99: 7.97 P99.9: 1064.45 P99.99: 2702.01 ------------------------------------------------------ [ 0, 1 ] 1702418 15.307% 15.307% ### ( 1, 2 ] 5477151 49.246% 64.553% ########## ( 2, 3 ] 1875365 16.862% 81.415% ### ( 3, 4 ] 1433959 12.893% 94.308% ### ( 4, 6 ] 477095 4.290% 98.597% # ( 6, 10 ] 91011 0.818% 99.416% ( 10, 15 ] 27762 0.250% 99.665% ( 15, 22 ] 7680 0.069% 99.734% ( 22, 34 ] 1934 0.017% 99.752% ( 34, 51 ] 244 0.002% 99.754% ( 51, 76 ] 36 0.000% 99.754% ( 76, 110 ] 8100 0.073% 99.827% ( 110, 170 ] 2733 0.025% 99.852% ( 170, 250 ] 308 0.003% 99.854% ( 250, 380 ] 126 0.001% 99.855% ( 380, 580 ] 35 0.000% 99.856% ( 580, 870 ] 41 0.000% 99.856% ( 870, 1300 ] 10789 0.097% 99.953% ( 1300, 1900 ] 24 0.000% 99.953% ( 1900, 2900 ] 5082 0.046% 99.999% ( 2900, 4400 ] 50 0.000% 99.999% ( 4400, 6600 ] 7 0.000% 100.000% ( 6600, 9900 ] 10 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 19 0.000% 100.000% ( 250000, 380000 ] 4 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 193211 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11121999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11477902968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 578 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30411406 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31047392289 rocksdb.compact.write.bytes COUNT : 30847180265 rocksdb.flush.write.bytes COUNT : 11361708334 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 71 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 342 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11270303744 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4553728 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31157509450 rocksdb.non.last.level.read.count COUNT : 7521739 rocksdb.block.checksum.compute.count COUNT : 7520654 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.333276 P95 : 3.756399 P99 : 6.009004 P100 : 817464.000000 COUNT : 11121999 SUM : 54970945 rocksdb.compaction.times.micros P50 : 975357.142857 P95 : 4034000.000000 P99 : 22110000.000000 P100 : 22474066.000000 COUNT : 99 SUM : 150599422 rocksdb.compaction.times.cpu_micros P50 : 767727.272727 P95 : 3845000.000000 P99 : 14080000.000000 P100 : 20222121.000000 COUNT : 99 SUM : 121553778 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 694.567901 P95 : 7260.000000 P99 : 18160.000000 P100 : 61109.000000 COUNT : 148 SUM : 246168 rocksdb.compaction.outfile.sync.micros P50 : 1210.928571 P95 : 76093.750000 P99 : 188000.000000 P100 : 398186.000000 COUNT : 355 SUM : 4930617 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 118.823529 P95 : 2571.428571 P99 : 4502.666667 P100 : 5328.000000 COUNT : 286 SUM : 131295 rocksdb.table.open.io.micros P50 : 1663.829787 P95 : 9146.923077 P99 : 14293.333333 P100 : 19791.000000 COUNT : 578 SUM : 1489461 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.707607 P95 : 7.992513 P99 : 12.189062 P100 : 20242.000000 COUNT : 7519007 SUM : 51865311 rocksdb.read.block.get.micros P50 : 527.572816 P95 : 3982.926829 P99 : 6118.933333 P100 : 9528.000000 COUNT : 1156 SUM : 1216927 rocksdb.write.raw.block.micros P50 : 0.513614 P95 : 0.975867 P99 : 2.711003 P100 : 29487.000000 COUNT : 10231648 SUM : 22157512 rocksdb.numfiles.in.singlecompaction P50 : 3.162651 P95 : 4.983333 P99 : 24.340000 P100 : 29.000000 COUNT : 161 SUM : 586 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.568568 P95 : 1239.898906 P99 : 2647.301838 P100 : 817289.000000 COUNT : 132340 SUM : 30424243 rocksdb.sst.read.micros P50 : 1.661720 P95 : 4.818065 P99 : 8.905887 P100 : 20219.000000 COUNT : 7521979 SUM : 36812174 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11121999 SUM : 11477902968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217843.137255 P95 : 513000.000000 P99 : 948400.000000 P100 : 952847.000000 COUNT : 148 SUM : 34780834 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 352 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0