[2024-07-21 07:12:32.470288] Starting SPDK v24.09-pre git sha1 89fd17309 / DPDK 24.07.0-rc2 initialization... [2024-07-21 07:12:32.470401] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid158400 ] Set seed to 1721538752468029 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-21 07:12:32.524650] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc2 is used. There is no support for it in SPDK. Enabled only for validation. [2024-07-21 07:12:32.566061] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-21 07:12:32.604646] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-21 07:12:32.604692] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 158400' to capture a snapshot of events at runtime. [2024-07-21 07:12:32.604706] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-21 07:12:32.604715] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-21 07:12:32.604725] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid158400 for offline analysis/debug. [2024-07-21 07:12:32.604802] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Jul 21 07:12:36 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/21-07:12:39 ... thread 0: (1000000,1000000) ops and (337204.9,337204.9) ops/second in (2.965556,2.965556) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 692.96 MB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 353.3 2.50 2.25 12 0.208 0 0 0.0 0.0 L2 3/2 237.05 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 L3 8/0 692.91 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/12 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.1 314.7 3.91 3.62 14 0.279 353K 198 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.1 314.7 3.91 3.62 14 0.279 353K 198 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 353.3 2.50 2.25 12 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 385.11 MB/s write, 0.34 GB read, 109.10 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 414.63 MB/s write, 0.34 GB read, 117.46 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 121649 Average: 2.0498 StdDev: 16.58 Min: 1 Median: 1.3556 Max: 3314 Percentiles: P50: 1.36 P75: 1.76 P99: 5.27 P99.9: 11.55 P99.99: 116.26 ------------------------------------------------------ [ 0, 1 ] 34274 28.175% 28.175% ###### ( 1, 2 ] 74661 61.374% 89.549% ############ ( 2, 3 ] 7886 6.483% 96.031% # ( 3, 4 ] 2619 2.153% 98.184% ( 4, 6 ] 1565 1.286% 99.471% ( 6, 10 ] 486 0.400% 99.870% ( 10, 15 ] 127 0.104% 99.975% ( 15, 22 ] 15 0.012% 99.987% ( 22, 34 ] 2 0.002% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 51, 76 ] 3 0.002% 99.992% ( 110, 170 ] 8 0.007% 99.998% ( 170, 250 ] 2 0.002% 100.000% ( 250, 380 ] 6 0.005% 100.005% ( 580, 870 ] 3 0.002% 100.007% ( 1300, 1900 ] 1 0.001% 100.008% ( 1900, 2900 ] 3 0.002% 100.011% ( 2900, 4400 ] 1 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 12271 Average: 3.3435 StdDev: 37.70 Min: 1 Median: 1.3155 Max: 2609 Percentiles: P50: 1.32 P75: 1.76 P99: 9.59 P99.9: 273.69 P99.99: 1763.74 ------------------------------------------------------ [ 0, 1 ] 3971 32.361% 32.361% ###### ( 1, 2 ] 6861 55.912% 88.273% ########### ( 2, 3 ] 913 7.440% 95.713% # ( 3, 4 ] 134 1.092% 96.805% ( 4, 6 ] 157 1.279% 98.085% ( 6, 10 ] 125 1.019% 99.104% ( 10, 15 ] 22 0.179% 99.283% ( 15, 22 ] 9 0.073% 99.356% ( 34, 51 ] 18 0.147% 99.503% ( 51, 76 ] 19 0.155% 99.658% ( 76, 110 ] 18 0.147% 99.804% ( 110, 170 ] 2 0.016% 99.821% ( 170, 250 ] 9 0.073% 99.894% ( 250, 380 ] 4 0.033% 99.927% ( 380, 580 ] 3 0.024% 99.951% ( 580, 870 ] 1 0.008% 99.959% ( 870, 1300 ] 3 0.024% 99.984% ( 1300, 1900 ] 1 0.008% 99.992% ( 1900, 2900 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 71091 Average: 1.9742 StdDev: 6.46 Min: 1 Median: 1.3785 Max: 1219 Percentiles: P50: 1.38 P75: 1.77 P99: 5.14 P99.9: 9.86 P99.99: 147.82 ------------------------------------------------------ [ 0, 1 ] 18435 25.932% 25.932% ##### ( 1, 2 ] 45212 63.597% 89.529% ############# ( 2, 3 ] 4646 6.535% 96.064% # ( 3, 4 ] 1596 2.245% 98.309% ( 4, 6 ] 859 1.208% 99.518% ( 6, 10 ] 282 0.397% 99.914% ( 10, 15 ] 46 0.065% 99.979% ( 15, 22 ] 4 0.006% 99.985% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.992% ( 170, 250 ] 2 0.003% 99.994% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 40 Average: 1403.6500 StdDev: 927.06 Min: 112 Median: 1156.6667 Max: 3354 Percentiles: P50: 1156.67 P75: 2263.64 P99: 3354.00 P99.9: 3354.00 P99.99: 3354.00 ------------------------------------------------------ ( 110, 170 ] 1 2.500% 2.500% # ( 170, 250 ] 1 2.500% 5.000% # ( 250, 380 ] 1 2.500% 7.500% # ( 380, 580 ] 6 15.000% 22.500% ### ( 580, 870 ] 5 12.500% 35.000% ### ( 870, 1300 ] 9 22.500% 57.500% ##### ( 1300, 1900 ] 3 7.500% 65.000% ## ( 1900, 2900 ] 11 27.500% 92.500% ###### ( 2900, 4400 ] 3 7.500% 100.000% ## ** Level 4 read latency histogram (micros): Count: 35 Average: 1558.4571 StdDev: 1083.15 Min: 325 Median: 1337.5000 Max: 4621 Percentiles: P50: 1337.50 P75: 2150.00 P99: 4621.00 P99.9: 4621.00 P99.99: 4621.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 8 22.857% 34.286% ##### ( 870, 1300 ] 5 14.286% 48.571% ### ( 1300, 1900 ] 8 22.857% 71.429% ##### ( 1900, 2900 ] 5 14.286% 85.714% ### ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 308.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.440 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.440 H:M:S, 14.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/21-07:12:42 ... thread 0: (1000000,2000000) ops and (352903.0,344875.4) ops/second in (2.833640,5.799196) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.23 GB 100.7 0.9 0.0 0.9 2.6 1.8 0.0 1.5 103.1 316.4 8.56 7.93 29 0.295 895K 987 0.0 0.0 L1 1/0 2.75 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 242.8 242.4 1.56 1.51 1 1.557 383K 622 0.0 0.0 L2 1/0 49.63 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 L3 28/0 973.09 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 203.8 203.6 3.68 3.25 3 1.226 760K 714 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1231/4 97.92 GB 0.0 2.3 1.1 1.2 4.1 2.9 1.2 2.3 155.1 275.1 15.20 14.06 35 0.434 2394K 2521 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 1.1 1.2 4.1 2.9 1.1 2.3 155.1 275.1 15.20 14.06 35 0.434 2394K 2521 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 1.1 1.2 2.3 1.1 0.0 0.0 235.1 234.8 10.03 9.43 9 1.114 2394K 2521 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.0 5.17 4.63 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.08 GB write, 693.78 MB/s write, 2.30 GB read, 391.15 MB/s read, 15.2 seconds Interval compaction: 4.08 GB write, 720.98 MB/s write, 2.30 GB read, 406.48 MB/s read, 15.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 395092 Average: 2.2289 StdDev: 12.49 Min: 1 Median: 1.4958 Max: 3314 Percentiles: P50: 1.50 P75: 1.89 P99: 5.77 P99.9: 11.66 P99.99: 19.53 ------------------------------------------------------ [ 0, 1 ] 72047 18.235% 18.235% #### ( 1, 2 ] 253118 64.066% 82.301% ############# ( 2, 3 ] 43184 10.930% 93.231% ## ( 3, 4 ] 14063 3.559% 96.791% # ( 4, 6 ] 9873 2.499% 99.290% ( 6, 10 ] 2255 0.571% 99.860% ( 10, 15 ] 473 0.120% 99.980% ( 15, 22 ] 61 0.015% 99.995% ( 22, 34 ] 16 0.004% 99.999% ( 34, 51 ] 4 0.001% 100.001% ( 51, 76 ] 7 0.002% 100.002% ( 76, 110 ] 1 0.000% 100.003% ( 110, 170 ] 14 0.004% 100.006% ( 170, 250 ] 9 0.002% 100.008% ( 250, 380 ] 9 0.002% 100.011% ( 380, 580 ] 5 0.001% 100.012% ( 580, 870 ] 8 0.002% 100.014% ( 870, 1300 ] 3 0.001% 100.015% ( 1300, 1900 ] 4 0.001% 100.016% ( 1900, 2900 ] 5 0.001% 100.017% ( 2900, 4400 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 107356 Average: 2.5868 StdDev: 13.78 Min: 1 Median: 1.6450 Max: 2609 Percentiles: P50: 1.64 P75: 2.16 P99: 6.47 P99.9: 14.97 P99.99: 220.12 ------------------------------------------------------ [ 0, 1 ] 10276 9.572% 9.572% ## ( 1, 2 ] 67294 62.683% 72.255% ############# ( 2, 3 ] 18903 17.608% 89.863% #### ( 3, 4 ] 5269 4.908% 94.771% # ( 4, 6 ] 4440 4.136% 98.906% # ( 6, 10 ] 853 0.795% 99.701% ( 10, 15 ] 215 0.200% 99.901% ( 15, 22 ] 30 0.028% 99.929% ( 22, 34 ] 2 0.002% 99.931% ( 34, 51 ] 18 0.017% 99.948% ( 51, 76 ] 19 0.018% 99.966% ( 76, 110 ] 18 0.017% 99.982% ( 110, 170 ] 2 0.002% 99.984% ( 170, 250 ] 10 0.009% 99.993% ( 250, 380 ] 7 0.007% 100.000% ( 380, 580 ] 5 0.005% 100.005% ( 580, 870 ] 2 0.002% 100.007% ( 870, 1300 ] 4 0.004% 100.010% ( 1300, 1900 ] 1 0.001% 100.011% ( 1900, 2900 ] 1 0.001% 100.012% ** Level 2 read latency histogram (micros): Count: 75852 Average: 2.0203 StdDev: 6.27 Min: 1 Median: 1.4055 Max: 1219 Percentiles: P50: 1.41 P75: 1.80 P99: 5.40 P99.9: 10.18 P99.99: 138.30 ------------------------------------------------------ [ 0, 1 ] 18540 24.442% 24.442% ##### ( 1, 2 ] 47805 63.024% 87.466% ############# ( 2, 3 ] 6036 7.958% 95.424% ## ( 3, 4 ] 1912 2.521% 97.945% # ( 4, 6 ] 1144 1.508% 99.453% ( 6, 10 ] 337 0.444% 99.897% ( 10, 15 ] 60 0.079% 99.976% ( 15, 22 ] 6 0.008% 99.984% ( 22, 34 ] 2 0.003% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 3 0.004% 99.992% ( 170, 250 ] 2 0.003% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 47908 Average: 3.8162 StdDev: 51.00 Min: 0 Median: 1.6654 Max: 3354 Percentiles: P50: 1.67 P75: 2.21 P99: 7.41 P99.9: 49.90 P99.99: 2069.94 ------------------------------------------------------ [ 0, 1 ] 3700 7.723% 7.723% ## ( 1, 2 ] 30438 63.534% 71.257% ############# ( 2, 3 ] 8666 18.089% 89.346% #### ( 3, 4 ] 2509 5.237% 94.583% # ( 4, 6 ] 1975 4.122% 98.706% # ( 6, 10 ] 399 0.833% 99.539% ( 10, 15 ] 108 0.225% 99.764% ( 15, 22 ] 17 0.035% 99.800% ( 22, 34 ] 35 0.073% 99.873% ( 34, 51 ] 14 0.029% 99.902% ( 110, 170 ] 4 0.008% 99.910% ( 170, 250 ] 4 0.008% 99.919% ( 250, 380 ] 2 0.004% 99.923% ( 380, 580 ] 11 0.023% 99.946% ( 580, 870 ] 6 0.013% 99.958% ( 870, 1300 ] 10 0.021% 99.979% ( 1300, 1900 ] 3 0.006% 99.985% ( 1900, 2900 ] 13 0.027% 100.013% ( 2900, 4400 ] 3 0.006% 100.019% ** Level 4 read latency histogram (micros): Count: 35 Average: 1558.4571 StdDev: 1083.15 Min: 325 Median: 1337.5000 Max: 4621 Percentiles: P50: 1337.50 P75: 2150.00 P99: 4621.00 P99.9: 4621.00 P99.99: 4621.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 8 22.857% 34.286% ##### ( 870, 1300 ] 5 14.286% 48.571% ### ( 1300, 1900 ] 8 22.857% 71.429% ##### ( 1900, 2900 ] 5 14.286% 85.714% ### ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 857.2500 StdDev: 1109.03 Min: 78 Median: 210.0000 Max: 4420 Percentiles: P50: 210.00 P75: 1300.00 P99: 4420.00 P99.9: 4420.00 P99.99: 4420.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 5 25.000% 45.000% ##### ( 170, 250 ] 2 10.000% 55.000% ## ( 580, 870 ] 3 15.000% 70.000% ### ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 3 15.000% 95.000% ### ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 326.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.664 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 347.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.224 H:M:S, 7.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/21-07:12:45 ... thread 0: (1000000,3000000) ops and (345192.4,344981.0) ops/second in (2.896935,8.696131) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 188.8 1.7 0.0 1.7 4.4 2.7 0.0 1.6 120.1 315.7 14.16 13.22 45 0.315 1727K 1852 0.0 0.0 L1 1/0 2.75 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 242.8 242.4 1.56 1.51 1 1.557 383K 622 0.0 0.0 L2 1/0 49.63 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 L3 28/0 973.09 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 203.8 203.6 3.68 3.25 3 1.226 760K 714 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1235/4 98.84 GB 0.0 3.1 1.1 2.0 5.8 3.8 1.2 2.1 152.7 285.7 20.81 19.35 51 0.408 3225K 3386 0.0 0.0 Int 0/0 0.00 KB 0.0 3.1 1.1 2.0 5.8 3.8 1.1 2.1 152.7 285.7 20.81 19.35 51 0.408 3225K 3386 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.1 1.1 2.0 3.1 1.1 0.0 0.0 242.9 242.6 13.08 12.43 12 1.090 3225K 3386 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 358.5 7.73 6.91 39 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.7 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.81 GB write, 666.12 MB/s write, 3.10 GB read, 355.95 MB/s read, 20.8 seconds Interval compaction: 5.81 GB write, 683.54 MB/s write, 3.10 GB read, 365.26 MB/s read, 20.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 624983 Average: 2.1100 StdDev: 12.97 Min: 1 Median: 1.4217 Max: 3459 Percentiles: P50: 1.42 P75: 1.82 P99: 5.59 P99.9: 11.46 P99.99: 20.27 ------------------------------------------------------ [ 0, 1 ] 146971 23.516% 23.516% ##### ( 1, 2 ] 392552 62.810% 86.326% ############# ( 2, 3 ] 52566 8.411% 94.737% ## ( 3, 4 ] 17467 2.795% 97.532% # ( 4, 6 ] 11530 1.845% 99.376% ( 6, 10 ] 3068 0.491% 99.867% ( 10, 15 ] 702 0.112% 99.980% ( 15, 22 ] 87 0.014% 99.994% ( 22, 34 ] 20 0.003% 99.997% ( 34, 51 ] 6 0.001% 99.998% ( 51, 76 ] 10 0.002% 99.999% ( 76, 110 ] 1 0.000% 100.000% ( 110, 170 ] 21 0.003% 100.003% ( 170, 250 ] 14 0.002% 100.005% ( 250, 380 ] 14 0.002% 100.007% ( 380, 580 ] 7 0.001% 100.008% ( 580, 870 ] 14 0.002% 100.011% ( 870, 1300 ] 5 0.001% 100.012% ( 1300, 1900 ] 5 0.001% 100.012% ( 1900, 2900 ] 7 0.001% 100.013% ( 2900, 4400 ] 3 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 107356 Average: 2.5868 StdDev: 13.78 Min: 1 Median: 1.6450 Max: 2609 Percentiles: P50: 1.64 P75: 2.16 P99: 6.47 P99.9: 14.97 P99.99: 220.12 ------------------------------------------------------ [ 0, 1 ] 10276 9.572% 9.572% ## ( 1, 2 ] 67294 62.683% 72.255% ############# ( 2, 3 ] 18903 17.608% 89.863% #### ( 3, 4 ] 5269 4.908% 94.771% # ( 4, 6 ] 4440 4.136% 98.906% # ( 6, 10 ] 853 0.795% 99.701% ( 10, 15 ] 215 0.200% 99.901% ( 15, 22 ] 30 0.028% 99.929% ( 22, 34 ] 2 0.002% 99.931% ( 34, 51 ] 18 0.017% 99.948% ( 51, 76 ] 19 0.018% 99.966% ( 76, 110 ] 18 0.017% 99.982% ( 110, 170 ] 2 0.002% 99.984% ( 170, 250 ] 10 0.009% 99.993% ( 250, 380 ] 7 0.007% 100.000% ( 380, 580 ] 5 0.005% 100.005% ( 580, 870 ] 2 0.002% 100.007% ( 870, 1300 ] 4 0.004% 100.010% ( 1300, 1900 ] 1 0.001% 100.011% ( 1900, 2900 ] 1 0.001% 100.012% ** Level 2 read latency histogram (micros): Count: 75852 Average: 2.0203 StdDev: 6.27 Min: 1 Median: 1.4055 Max: 1219 Percentiles: P50: 1.41 P75: 1.80 P99: 5.40 P99.9: 10.18 P99.99: 138.30 ------------------------------------------------------ [ 0, 1 ] 18540 24.442% 24.442% ##### ( 1, 2 ] 47805 63.024% 87.466% ############# ( 2, 3 ] 6036 7.958% 95.424% ## ( 3, 4 ] 1912 2.521% 97.945% # ( 4, 6 ] 1144 1.508% 99.453% ( 6, 10 ] 337 0.444% 99.897% ( 10, 15 ] 60 0.079% 99.976% ( 15, 22 ] 6 0.008% 99.984% ( 22, 34 ] 2 0.003% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 3 0.004% 99.992% ( 170, 250 ] 2 0.003% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 47908 Average: 3.8162 StdDev: 51.00 Min: 0 Median: 1.6654 Max: 3354 Percentiles: P50: 1.67 P75: 2.21 P99: 7.41 P99.9: 49.90 P99.99: 2069.94 ------------------------------------------------------ [ 0, 1 ] 3700 7.723% 7.723% ## ( 1, 2 ] 30438 63.534% 71.257% ############# ( 2, 3 ] 8666 18.089% 89.346% #### ( 3, 4 ] 2509 5.237% 94.583% # ( 4, 6 ] 1975 4.122% 98.706% # ( 6, 10 ] 399 0.833% 99.539% ( 10, 15 ] 108 0.225% 99.764% ( 15, 22 ] 17 0.035% 99.800% ( 22, 34 ] 35 0.073% 99.873% ( 34, 51 ] 14 0.029% 99.902% ( 110, 170 ] 4 0.008% 99.910% ( 170, 250 ] 4 0.008% 99.919% ( 250, 380 ] 2 0.004% 99.923% ( 380, 580 ] 11 0.023% 99.946% ( 580, 870 ] 6 0.013% 99.958% ( 870, 1300 ] 10 0.021% 99.979% ( 1300, 1900 ] 3 0.006% 99.985% ( 1900, 2900 ] 13 0.027% 100.013% ( 2900, 4400 ] 3 0.006% 100.019% ** Level 4 read latency histogram (micros): Count: 35 Average: 1558.4571 StdDev: 1083.15 Min: 325 Median: 1337.5000 Max: 4621 Percentiles: P50: 1337.50 P75: 2150.00 P99: 4621.00 P99.9: 4621.00 P99.99: 4621.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 8 22.857% 34.286% ##### ( 870, 1300 ] 5 14.286% 48.571% ### ( 1300, 1900 ] 8 22.857% 71.429% ##### ( 1900, 2900 ] 5 14.286% 85.714% ### ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 857.2500 StdDev: 1109.03 Min: 78 Median: 210.0000 Max: 4420 Percentiles: P50: 210.00 P75: 1300.00 P99: 4420.00 P99.9: 4420.00 P99.99: 4420.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 5 25.000% 45.000% ##### ( 170, 250 ] 2 10.000% 55.000% ## ( 580, 870 ] 3 15.000% 70.000% ### ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 3 15.000% 95.000% ### ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.9 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 330.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.037 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 339.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.373 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/21-07:12:48 ... thread 0: (1000000,4000000) ops and (299390.8,332329.5) ops/second in (3.340116,12.036247) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 3.20 GB 44.1 2.5 0.0 2.5 6.3 3.7 0.0 1.7 126.7 315.0 20.39 19.11 63 0.324 2622K 2826 0.0 0.0 L1 1/1 2.75 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 242.8 242.4 1.56 1.51 1 1.557 383K 622 0.0 0.0 L2 1/0 49.63 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 L3 28/0 973.09 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 203.8 203.6 3.68 3.25 3 1.226 760K 714 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/17 99.88 GB 0.0 4.0 1.1 2.9 7.7 4.9 1.2 2.1 150.1 292.1 27.04 25.23 69 0.392 4121K 4360 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 1.1 2.9 7.7 4.9 1.1 2.1 150.1 292.1 27.04 25.23 69 0.392 4121K 4360 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 1.1 2.9 4.0 1.1 0.0 0.0 248.1 247.8 16.36 15.65 15 1.091 4121K 4360 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 359.8 10.68 9.58 54 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.71 GB write, 643.87 MB/s write, 3.96 GB read, 330.92 MB/s read, 27.0 seconds Interval compaction: 7.71 GB write, 656.03 MB/s write, 3.96 GB read, 337.18 MB/s read, 27.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 13, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 987858 Average: 2.1359 StdDev: 12.18 Min: 1 Median: 1.4446 Max: 3832 Percentiles: P50: 1.44 P75: 1.83 P99: 5.53 P99.9: 10.89 P99.99: 18.96 ------------------------------------------------------ [ 0, 1 ] 212164 21.477% 21.477% #### ( 1, 2 ] 633681 64.147% 85.624% ############# ( 2, 3 ] 89940 9.105% 94.729% ## ( 3, 4 ] 28761 2.911% 97.640% # ( 4, 6 ] 17574 1.779% 99.419% ( 6, 10 ] 4574 0.463% 99.882% ( 10, 15 ] 996 0.101% 99.983% ( 15, 22 ] 126 0.013% 99.996% ( 22, 34 ] 25 0.003% 99.998% ( 34, 51 ] 8 0.001% 99.999% ( 51, 76 ] 11 0.001% 100.000% ( 76, 110 ] 38 0.004% 100.004% ( 110, 170 ] 58 0.006% 100.010% ( 170, 250 ] 30 0.003% 100.013% ( 250, 380 ] 24 0.002% 100.015% ( 380, 580 ] 16 0.002% 100.017% ( 580, 870 ] 25 0.003% 100.020% ( 870, 1300 ] 9 0.001% 100.020% ( 1300, 1900 ] 6 0.001% 100.021% ( 1900, 2900 ] 7 0.001% 100.022% ( 2900, 4400 ] 5 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 107357 Average: 2.5868 StdDev: 13.78 Min: 1 Median: 1.6450 Max: 2609 Percentiles: P50: 1.64 P75: 2.16 P99: 6.47 P99.9: 14.97 P99.99: 220.11 ------------------------------------------------------ [ 0, 1 ] 10276 9.572% 9.572% ## ( 1, 2 ] 67294 62.682% 72.254% ############# ( 2, 3 ] 18904 17.609% 89.863% #### ( 3, 4 ] 5269 4.908% 94.771% # ( 4, 6 ] 4440 4.136% 98.906% # ( 6, 10 ] 853 0.795% 99.701% ( 10, 15 ] 215 0.200% 99.901% ( 15, 22 ] 30 0.028% 99.929% ( 22, 34 ] 2 0.002% 99.931% ( 34, 51 ] 18 0.017% 99.948% ( 51, 76 ] 19 0.018% 99.966% ( 76, 110 ] 18 0.017% 99.982% ( 110, 170 ] 2 0.002% 99.984% ( 170, 250 ] 10 0.009% 99.993% ( 250, 380 ] 7 0.007% 100.000% ( 380, 580 ] 5 0.005% 100.005% ( 580, 870 ] 2 0.002% 100.007% ( 870, 1300 ] 4 0.004% 100.010% ( 1300, 1900 ] 1 0.001% 100.011% ( 1900, 2900 ] 1 0.001% 100.012% ** Level 2 read latency histogram (micros): Count: 75852 Average: 2.0203 StdDev: 6.27 Min: 1 Median: 1.4055 Max: 1219 Percentiles: P50: 1.41 P75: 1.80 P99: 5.40 P99.9: 10.18 P99.99: 138.30 ------------------------------------------------------ [ 0, 1 ] 18540 24.442% 24.442% ##### ( 1, 2 ] 47805 63.024% 87.466% ############# ( 2, 3 ] 6036 7.958% 95.424% ## ( 3, 4 ] 1912 2.521% 97.945% # ( 4, 6 ] 1144 1.508% 99.453% ( 6, 10 ] 337 0.444% 99.897% ( 10, 15 ] 60 0.079% 99.976% ( 15, 22 ] 6 0.008% 99.984% ( 22, 34 ] 2 0.003% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 3 0.004% 99.992% ( 170, 250 ] 2 0.003% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 47908 Average: 3.8162 StdDev: 51.00 Min: 0 Median: 1.6654 Max: 3354 Percentiles: P50: 1.67 P75: 2.21 P99: 7.41 P99.9: 49.90 P99.99: 2069.94 ------------------------------------------------------ [ 0, 1 ] 3700 7.723% 7.723% ## ( 1, 2 ] 30438 63.534% 71.257% ############# ( 2, 3 ] 8666 18.089% 89.346% #### ( 3, 4 ] 2509 5.237% 94.583% # ( 4, 6 ] 1975 4.122% 98.706% # ( 6, 10 ] 399 0.833% 99.539% ( 10, 15 ] 108 0.225% 99.764% ( 15, 22 ] 17 0.035% 99.800% ( 22, 34 ] 35 0.073% 99.873% ( 34, 51 ] 14 0.029% 99.902% ( 110, 170 ] 4 0.008% 99.910% ( 170, 250 ] 4 0.008% 99.919% ( 250, 380 ] 2 0.004% 99.923% ( 380, 580 ] 11 0.023% 99.946% ( 580, 870 ] 6 0.013% 99.958% ( 870, 1300 ] 10 0.021% 99.979% ( 1300, 1900 ] 3 0.006% 99.985% ( 1900, 2900 ] 13 0.027% 100.013% ( 2900, 4400 ] 3 0.006% 100.019% ** Level 4 read latency histogram (micros): Count: 35 Average: 1558.4571 StdDev: 1083.15 Min: 325 Median: 1337.5000 Max: 4621 Percentiles: P50: 1337.50 P75: 2150.00 P99: 4621.00 P99.9: 4621.00 P99.99: 4621.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 8 22.857% 34.286% ##### ( 870, 1300 ] 5 14.286% 48.571% ### ( 1300, 1900 ] 8 22.857% 71.429% ##### ( 1900, 2900 ] 5 14.286% 85.714% ### ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 857.2500 StdDev: 1109.03 Min: 78 Median: 210.0000 Max: 4420 Percentiles: P50: 210.00 P75: 1300.00 P99: 4420.00 P99.9: 4420.00 P99.99: 4420.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 5 25.000% 45.000% ##### ( 170, 250 ] 2 10.000% 55.000% ## ( 580, 870 ] 3 15.000% 70.000% ### ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 3 15.000% 95.000% ### ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.3 total, 3.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 320.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.808 H:M:S, 14.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 294.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.771 H:M:S, 23.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/21-07:12:57 ... thread 0: (1000000,5000000) ops and (118418.0,244129.8) ops/second in (8.444664,20.480911) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 4.11 GB 138.0 4.6 0.0 4.6 9.2 4.7 0.0 2.0 150.7 305.3 30.92 29.11 83 0.373 4732K 8345 0.0 0.0 L1 1/1 2.75 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 242.8 242.4 1.56 1.51 1 1.557 383K 622 0.0 0.0 L2 1/0 49.63 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 L3 28/0 973.09 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 203.8 203.6 3.68 3.25 3 1.226 760K 714 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1240/17 100.80 GB 0.0 6.0 1.1 4.9 10.7 5.8 1.2 2.3 163.4 290.5 37.57 35.23 89 0.422 6231K 9879 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 1.1 4.9 10.7 5.8 1.1 2.3 163.4 290.5 37.57 35.23 89 0.422 6231K 9879 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 1.1 4.9 6.0 1.1 0.0 0.0 253.2 252.7 24.24 23.31 20 1.212 6231K 9879 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 359.3 13.32 11.92 69 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.7 total, 20.5 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.66 GB write, 527.03 MB/s write, 5.99 GB read, 296.33 MB/s read, 37.6 seconds Interval compaction: 10.66 GB write, 532.88 MB/s write, 5.99 GB read, 299.62 MB/s read, 37.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 13, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1963832 Average: 2.3821 StdDev: 13.84 Min: 1 Median: 1.4678 Max: 4438 Percentiles: P50: 1.47 P75: 1.85 P99: 5.76 P99.9: 101.92 P99.99: 200.32 ------------------------------------------------------ [ 0, 1 ] 375529 19.122% 19.122% #### ( 1, 2 ] 1296144 66.001% 85.123% ############# ( 2, 3 ] 186964 9.520% 94.643% ## ( 3, 4 ] 57133 2.909% 97.553% # ( 4, 6 ] 32368 1.648% 99.201% ( 6, 10 ] 10947 0.557% 99.758% ( 10, 15 ] 1707 0.087% 99.845% ( 15, 22 ] 213 0.011% 99.856% ( 22, 34 ] 30 0.002% 99.858% ( 34, 51 ] 13 0.001% 99.858% ( 51, 76 ] 17 0.001% 99.859% ( 76, 110 ] 1056 0.054% 99.913% ( 110, 170 ] 1412 0.072% 99.985% ( 170, 250 ] 276 0.014% 99.999% ( 250, 380 ] 188 0.010% 100.008% ( 380, 580 ] 136 0.007% 100.015% ( 580, 870 ] 104 0.005% 100.021% ( 870, 1300 ] 29 0.001% 100.022% ( 1300, 1900 ] 9 0.000% 100.023% ( 1900, 2900 ] 10 0.001% 100.023% ( 2900, 4400 ] 8 0.000% 100.023% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 107357 Average: 2.5868 StdDev: 13.78 Min: 1 Median: 1.6450 Max: 2609 Percentiles: P50: 1.64 P75: 2.16 P99: 6.47 P99.9: 14.97 P99.99: 220.11 ------------------------------------------------------ [ 0, 1 ] 10276 9.572% 9.572% ## ( 1, 2 ] 67294 62.682% 72.254% ############# ( 2, 3 ] 18904 17.609% 89.863% #### ( 3, 4 ] 5269 4.908% 94.771% # ( 4, 6 ] 4440 4.136% 98.906% # ( 6, 10 ] 853 0.795% 99.701% ( 10, 15 ] 215 0.200% 99.901% ( 15, 22 ] 30 0.028% 99.929% ( 22, 34 ] 2 0.002% 99.931% ( 34, 51 ] 18 0.017% 99.948% ( 51, 76 ] 19 0.018% 99.966% ( 76, 110 ] 18 0.017% 99.982% ( 110, 170 ] 2 0.002% 99.984% ( 170, 250 ] 10 0.009% 99.993% ( 250, 380 ] 7 0.007% 100.000% ( 380, 580 ] 5 0.005% 100.005% ( 580, 870 ] 2 0.002% 100.007% ( 870, 1300 ] 4 0.004% 100.010% ( 1300, 1900 ] 1 0.001% 100.011% ( 1900, 2900 ] 1 0.001% 100.012% ** Level 2 read latency histogram (micros): Count: 75852 Average: 2.0203 StdDev: 6.27 Min: 1 Median: 1.4055 Max: 1219 Percentiles: P50: 1.41 P75: 1.80 P99: 5.40 P99.9: 10.18 P99.99: 138.30 ------------------------------------------------------ [ 0, 1 ] 18540 24.442% 24.442% ##### ( 1, 2 ] 47805 63.024% 87.466% ############# ( 2, 3 ] 6036 7.958% 95.424% ## ( 3, 4 ] 1912 2.521% 97.945% # ( 4, 6 ] 1144 1.508% 99.453% ( 6, 10 ] 337 0.444% 99.897% ( 10, 15 ] 60 0.079% 99.976% ( 15, 22 ] 6 0.008% 99.984% ( 22, 34 ] 2 0.003% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 3 0.004% 99.992% ( 170, 250 ] 2 0.003% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 47908 Average: 3.8162 StdDev: 51.00 Min: 0 Median: 1.6654 Max: 3354 Percentiles: P50: 1.67 P75: 2.21 P99: 7.41 P99.9: 49.90 P99.99: 2069.94 ------------------------------------------------------ [ 0, 1 ] 3700 7.723% 7.723% ## ( 1, 2 ] 30438 63.534% 71.257% ############# ( 2, 3 ] 8666 18.089% 89.346% #### ( 3, 4 ] 2509 5.237% 94.583% # ( 4, 6 ] 1975 4.122% 98.706% # ( 6, 10 ] 399 0.833% 99.539% ( 10, 15 ] 108 0.225% 99.764% ( 15, 22 ] 17 0.035% 99.800% ( 22, 34 ] 35 0.073% 99.873% ( 34, 51 ] 14 0.029% 99.902% ( 110, 170 ] 4 0.008% 99.910% ( 170, 250 ] 4 0.008% 99.919% ( 250, 380 ] 2 0.004% 99.923% ( 380, 580 ] 11 0.023% 99.946% ( 580, 870 ] 6 0.013% 99.958% ( 870, 1300 ] 10 0.021% 99.979% ( 1300, 1900 ] 3 0.006% 99.985% ( 1900, 2900 ] 13 0.027% 100.013% ( 2900, 4400 ] 3 0.006% 100.019% ** Level 4 read latency histogram (micros): Count: 35 Average: 1558.4571 StdDev: 1083.15 Min: 325 Median: 1337.5000 Max: 4621 Percentiles: P50: 1337.50 P75: 2150.00 P99: 4621.00 P99.9: 4621.00 P99.99: 4621.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 8 22.857% 34.286% ##### ( 870, 1300 ] 5 14.286% 48.571% ### ( 1300, 1900 ] 8 22.857% 71.429% ##### ( 1900, 2900 ] 5 14.286% 85.714% ### ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 857.2500 StdDev: 1109.03 Min: 78 Median: 210.0000 Max: 4420 Percentiles: P50: 210.00 P75: 1300.00 P99: 4420.00 P99.9: 4420.00 P99.99: 4420.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 5 25.000% 45.000% ##### ( 170, 250 ] 2 10.000% 55.000% ## ( 580, 870 ] 3 15.000% 70.000% ### ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 3 15.000% 95.000% ### ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 20.7 total, 8.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 237.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.403 H:M:S, 35.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 116.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.594 H:M:S, 66.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/21-07:13:00 ... thread 0: (1000000,6000000) ops and (285258.8,250140.7) ops/second in (3.505589,23.986500) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.58 GB 25.2 5.0 0.0 5.0 10.7 5.7 0.0 1.9 142.9 303.1 36.14 33.66 99 0.365 5244K 8799 0.0 0.0 L1 9/9 1006.73 MB 0.0 2.9 2.9 0.0 2.9 2.9 0.2 1.0 229.3 226.9 12.91 12.31 2 6.456 3006K 31K 0.0 0.0 L2 1/0 49.63 MB 0.5 0.3 0.2 0.2 0.3 0.2 1.9 1.8 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 L3 14/0 957.55 MB 1.0 0.7 0.5 0.2 0.7 0.5 1.5 1.3 203.8 203.6 3.68 3.25 3 1.226 760K 714 0.0 0.0 L4 164/0 9.67 GB 1.0 0.9 0.7 0.2 0.9 0.7 1.1 1.2 163.6 163.0 5.79 4.37 6 0.965 962K 3733 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/20 101.75 GB 0.0 9.9 4.4 5.6 15.5 10.0 6.3 2.7 169.7 265.7 59.93 54.95 112 0.535 10M 44K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.9 4.4 5.6 15.5 10.0 6.3 2.7 169.7 265.7 59.93 54.95 112 0.535 10M 44K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.9 4.4 5.6 9.9 4.3 0.0 0.0 234.0 233.0 43.47 40.40 29 1.499 10M 44K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 352.0 16.47 14.55 83 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.2 total, 24.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.55 GB write, 657.52 MB/s write, 9.93 GB read, 420.04 MB/s read, 59.9 seconds Interval compaction: 15.55 GB write, 663.75 MB/s write, 9.93 GB read, 424.03 MB/s read, 59.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 22, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2261165 Average: 2.4021 StdDev: 14.62 Min: 1 Median: 1.4813 Max: 4438 Percentiles: P50: 1.48 P75: 1.86 P99: 5.85 P99.9: 95.23 P99.99: 198.24 ------------------------------------------------------ [ 0, 1 ] 415124 18.359% 18.359% #### ( 1, 2 ] 1486562 65.743% 84.102% ############# ( 2, 3 ] 228329 10.098% 94.200% ## ( 3, 4 ] 69831 3.088% 97.288% # ( 4, 6 ] 41930 1.854% 99.143% ( 6, 10 ] 13937 0.616% 99.759% ( 10, 15 ] 2245 0.099% 99.858% ( 15, 22 ] 277 0.012% 99.870% ( 22, 34 ] 37 0.002% 99.872% ( 34, 51 ] 16 0.001% 99.873% ( 51, 76 ] 19 0.001% 99.874% ( 76, 110 ] 1057 0.047% 99.920% ( 110, 170 ] 1464 0.065% 99.985% ( 170, 250 ] 317 0.014% 99.999% ( 250, 380 ] 211 0.009% 100.008% ( 380, 580 ] 149 0.007% 100.015% ( 580, 870 ] 124 0.005% 100.021% ( 870, 1300 ] 33 0.001% 100.022% ( 1300, 1900 ] 11 0.000% 100.022% ( 1900, 2900 ] 16 0.001% 100.023% ( 2900, 4400 ] 11 0.000% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 270958 Average: 3.2589 StdDev: 30.47 Min: 1 Median: 1.8442 Max: 6726 Percentiles: P50: 1.84 P75: 2.72 P99: 8.51 P99.9: 13.95 P99.99: 18.42 ------------------------------------------------------ [ 0, 1 ] 12133 4.478% 4.478% # ( 1, 2 ] 146105 53.922% 58.399% ########### ( 2, 3 ] 62866 23.201% 81.601% ##### ( 3, 4 ] 22303 8.231% 89.832% ## ( 4, 6 ] 21973 8.109% 97.941% ## ( 6, 10 ] 4570 1.687% 99.628% ( 10, 15 ] 932 0.344% 99.972% ( 15, 22 ] 100 0.037% 100.009% ( 22, 34 ] 8 0.003% 100.012% ( 34, 51 ] 18 0.007% 100.018% ( 51, 76 ] 22 0.008% 100.027% ( 76, 110 ] 61 0.023% 100.049% ( 110, 170 ] 40 0.015% 100.064% ( 170, 250 ] 35 0.013% 100.077% ( 250, 380 ] 25 0.009% 100.086% ( 380, 580 ] 32 0.012% 100.098% ( 580, 870 ] 20 0.007% 100.105% ( 870, 1300 ] 14 0.005% 100.110% ( 1300, 1900 ] 8 0.003% 100.113% ( 1900, 2900 ] 8 0.003% 100.116% ( 2900, 4400 ] 5 0.002% 100.118% ( 4400, 6600 ] 2 0.001% 100.119% ( 6600, 9900 ] 1 0.000% 100.119% ** Level 2 read latency histogram (micros): Count: 75852 Average: 2.0203 StdDev: 6.27 Min: 1 Median: 1.4055 Max: 1219 Percentiles: P50: 1.41 P75: 1.80 P99: 5.40 P99.9: 10.18 P99.99: 138.30 ------------------------------------------------------ [ 0, 1 ] 18540 24.442% 24.442% ##### ( 1, 2 ] 47805 63.024% 87.466% ############# ( 2, 3 ] 6036 7.958% 95.424% ## ( 3, 4 ] 1912 2.521% 97.945% # ( 4, 6 ] 1144 1.508% 99.453% ( 6, 10 ] 337 0.444% 99.897% ( 10, 15 ] 60 0.079% 99.976% ( 15, 22 ] 6 0.008% 99.984% ( 22, 34 ] 2 0.003% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 3 0.004% 99.992% ( 170, 250 ] 2 0.003% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 124910 Average: 9.0254 StdDev: 96.60 Min: 0 Median: 1.8233 Max: 8885 Percentiles: P50: 1.82 P75: 2.70 P99: 129.48 P99.9: 916.19 P99.99: 2259.81 ------------------------------------------------------ [ 0, 1 ] 5720 4.579% 4.579% # ( 1, 2 ] 68915 55.172% 59.751% ########### ( 2, 3 ] 27106 21.700% 81.451% #### ( 3, 4 ] 10245 8.202% 89.653% ## ( 4, 6 ] 8185 6.553% 96.206% # ( 6, 10 ] 2670 2.138% 98.344% ( 10, 15 ] 505 0.404% 98.748% ( 15, 22 ] 76 0.061% 98.809% ( 22, 34 ] 39 0.031% 98.840% ( 34, 51 ] 16 0.013% 98.853% ( 76, 110 ] 80 0.064% 98.917% ( 110, 170 ] 320 0.256% 99.173% ( 170, 250 ] 249 0.199% 99.372% ( 250, 380 ] 233 0.187% 99.559% ( 380, 580 ] 247 0.198% 99.757% ( 580, 870 ] 172 0.138% 99.894% ( 870, 1300 ] 66 0.053% 99.947% ( 1300, 1900 ] 33 0.026% 99.974% ( 1900, 2900 ] 57 0.046% 100.019% ( 2900, 4400 ] 28 0.022% 100.042% ( 4400, 6600 ] 1 0.001% 100.042% ( 6600, 9900 ] 2 0.002% 100.044% ** Level 4 read latency histogram (micros): Count: 220 Average: 299.7773 StdDev: 711.32 Min: 1 Median: 2.7368 Max: 4621 Percentiles: P50: 2.74 P75: 170.00 P99: 3950.00 P99.9: 4621.00 P99.99: 4621.00 ------------------------------------------------------ [ 0, 1 ] 38 17.273% 17.273% ### ( 1, 2 ] 58 26.364% 43.636% ##### ( 2, 3 ] 19 8.636% 52.273% ## ( 3, 4 ] 3 1.364% 53.636% ( 4, 6 ] 9 4.091% 57.727% # ( 6, 10 ] 3 1.364% 59.091% ( 10, 15 ] 3 1.364% 60.455% ( 15, 22 ] 7 3.182% 63.636% # ( 22, 34 ] 9 4.091% 67.727% # ( 51, 76 ] 1 0.455% 68.182% ( 76, 110 ] 3 1.364% 69.545% ( 110, 170 ] 12 5.455% 75.000% # ( 170, 250 ] 5 2.273% 77.273% ( 250, 380 ] 5 2.273% 79.545% ( 380, 580 ] 9 4.091% 83.636% # ( 580, 870 ] 12 5.455% 89.091% # ( 870, 1300 ] 6 2.727% 91.818% # ( 1300, 1900 ] 8 3.636% 95.455% # ( 1900, 2900 ] 5 2.273% 97.727% ( 2900, 4400 ] 4 1.818% 99.545% ( 4400, 6600 ] 1 0.455% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 769.0300 StdDev: 982.23 Min: 78 Median: 241.1111 Max: 4420 Percentiles: P50: 241.11 P75: 1042.00 P99: 4400.00 P99.9: 4420.00 P99.99: 4420.00 ------------------------------------------------------ ( 76, 110 ] 21 21.000% 21.000% #### ( 110, 170 ] 21 21.000% 42.000% #### ( 170, 250 ] 9 9.000% 51.000% ## ( 250, 380 ] 7 7.000% 58.000% # ( 380, 580 ] 2 2.000% 60.000% ( 580, 870 ] 13 13.000% 73.000% ### ( 870, 1300 ] 5 5.000% 78.000% # ( 1300, 1900 ] 7 7.000% 85.000% # ( 1900, 2900 ] 8 8.000% 93.000% ## ( 2900, 4400 ] 6 6.000% 99.000% # ( 4400, 6600 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 24.2 total, 3.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 243.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.169 H:M:S, 33.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 280.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.766 H:M:S, 21.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/21-07:13:03 ... thread 0: (1000000,7000000) ops and (337320.5,259730.2) ops/second in (2.964540,26.951040) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/7 3.50 GB 144.8 6.2 0.0 6.2 12.7 6.6 0.0 1.9 146.3 302.6 43.06 40.22 116 0.371 6395K 10K 0.0 0.0 L1 9/9 1006.73 MB 0.0 2.9 2.9 0.0 2.9 2.9 0.2 1.0 229.3 226.9 12.91 12.31 2 6.456 3006K 31K 0.0 0.0 L2 1/0 49.63 MB 0.5 0.3 0.2 0.2 0.3 0.2 1.9 1.8 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 L3 14/0 957.55 MB 1.0 0.7 0.5 0.2 0.7 0.5 1.5 1.3 203.8 203.6 3.68 3.25 3 1.226 760K 714 0.0 0.0 L4 164/0 9.67 GB 1.0 0.9 0.7 0.2 0.9 0.7 1.1 1.2 163.6 163.0 5.79 4.37 6 0.965 962K 3733 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/16 102.67 GB 0.0 11.0 4.4 6.7 17.6 10.9 6.3 2.7 169.1 269.2 66.86 61.51 129 0.518 11M 45K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.0 4.4 6.7 17.6 10.9 6.3 2.7 169.1 269.2 66.86 61.51 129 0.518 11M 45K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.0 4.4 6.7 11.0 4.3 0.0 0.0 237.0 236.0 47.71 44.55 33 1.446 11M 45K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.0 19.15 16.95 96 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.2 total, 27.0 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.58 GB write, 662.24 MB/s write, 11.04 GB read, 415.95 MB/s read, 66.9 seconds Interval compaction: 17.58 GB write, 667.83 MB/s write, 11.04 GB read, 419.46 MB/s read, 66.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 25, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2659107 Average: 2.3966 StdDev: 13.94 Min: 1 Median: 1.4965 Max: 4438 Percentiles: P50: 1.50 P75: 1.88 P99: 5.86 P99.9: 80.69 P99.99: 168.80 ------------------------------------------------------ [ 0, 1 ] 458941 17.259% 17.259% ### ( 1, 2 ] 1753658 65.949% 83.208% ############# ( 2, 3 ] 287459 10.810% 94.019% ## ( 3, 4 ] 84612 3.182% 97.201% # ( 4, 6 ] 51390 1.933% 99.133% ( 6, 10 ] 17091 0.643% 99.776% ( 10, 15 ] 2768 0.104% 99.880% ( 15, 22 ] 303 0.011% 99.892% ( 22, 34 ] 38 0.001% 99.893% ( 34, 51 ] 21 0.001% 99.894% ( 51, 76 ] 21 0.001% 99.895% ( 76, 110 ] 1072 0.040% 99.935% ( 110, 170 ] 1499 0.056% 99.991% ( 170, 250 ] 347 0.013% 100.004% ( 250, 380 ] 227 0.009% 100.013% ( 380, 580 ] 163 0.006% 100.019% ( 580, 870 ] 139 0.005% 100.024% ( 870, 1300 ] 38 0.001% 100.026% ( 1300, 1900 ] 14 0.001% 100.026% ( 1900, 2900 ] 17 0.001% 100.027% ( 2900, 4400 ] 11 0.000% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 270958 Average: 3.2589 StdDev: 30.47 Min: 1 Median: 1.8442 Max: 6726 Percentiles: P50: 1.84 P75: 2.72 P99: 8.51 P99.9: 13.95 P99.99: 18.42 ------------------------------------------------------ [ 0, 1 ] 12133 4.478% 4.478% # ( 1, 2 ] 146105 53.922% 58.399% ########### ( 2, 3 ] 62866 23.201% 81.601% ##### ( 3, 4 ] 22303 8.231% 89.832% ## ( 4, 6 ] 21973 8.109% 97.941% ## ( 6, 10 ] 4570 1.687% 99.628% ( 10, 15 ] 932 0.344% 99.972% ( 15, 22 ] 100 0.037% 100.009% ( 22, 34 ] 8 0.003% 100.012% ( 34, 51 ] 18 0.007% 100.018% ( 51, 76 ] 22 0.008% 100.027% ( 76, 110 ] 61 0.023% 100.049% ( 110, 170 ] 40 0.015% 100.064% ( 170, 250 ] 35 0.013% 100.077% ( 250, 380 ] 25 0.009% 100.086% ( 380, 580 ] 32 0.012% 100.098% ( 580, 870 ] 20 0.007% 100.105% ( 870, 1300 ] 14 0.005% 100.110% ( 1300, 1900 ] 8 0.003% 100.113% ( 1900, 2900 ] 8 0.003% 100.116% ( 2900, 4400 ] 5 0.002% 100.118% ( 4400, 6600 ] 2 0.001% 100.119% ( 6600, 9900 ] 1 0.000% 100.119% ** Level 2 read latency histogram (micros): Count: 75852 Average: 2.0203 StdDev: 6.27 Min: 1 Median: 1.4055 Max: 1219 Percentiles: P50: 1.41 P75: 1.80 P99: 5.40 P99.9: 10.18 P99.99: 138.30 ------------------------------------------------------ [ 0, 1 ] 18540 24.442% 24.442% ##### ( 1, 2 ] 47805 63.024% 87.466% ############# ( 2, 3 ] 6036 7.958% 95.424% ## ( 3, 4 ] 1912 2.521% 97.945% # ( 4, 6 ] 1144 1.508% 99.453% ( 6, 10 ] 337 0.444% 99.897% ( 10, 15 ] 60 0.079% 99.976% ( 15, 22 ] 6 0.008% 99.984% ( 22, 34 ] 2 0.003% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 3 0.004% 99.992% ( 170, 250 ] 2 0.003% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 124910 Average: 9.0254 StdDev: 96.60 Min: 0 Median: 1.8233 Max: 8885 Percentiles: P50: 1.82 P75: 2.70 P99: 129.48 P99.9: 916.19 P99.99: 2259.81 ------------------------------------------------------ [ 0, 1 ] 5720 4.579% 4.579% # ( 1, 2 ] 68915 55.172% 59.751% ########### ( 2, 3 ] 27106 21.700% 81.451% #### ( 3, 4 ] 10245 8.202% 89.653% ## ( 4, 6 ] 8185 6.553% 96.206% # ( 6, 10 ] 2670 2.138% 98.344% ( 10, 15 ] 505 0.404% 98.748% ( 15, 22 ] 76 0.061% 98.809% ( 22, 34 ] 39 0.031% 98.840% ( 34, 51 ] 16 0.013% 98.853% ( 76, 110 ] 80 0.064% 98.917% ( 110, 170 ] 320 0.256% 99.173% ( 170, 250 ] 249 0.199% 99.372% ( 250, 380 ] 233 0.187% 99.559% ( 380, 580 ] 247 0.198% 99.757% ( 580, 870 ] 172 0.138% 99.894% ( 870, 1300 ] 66 0.053% 99.947% ( 1300, 1900 ] 33 0.026% 99.974% ( 1900, 2900 ] 57 0.046% 100.019% ( 2900, 4400 ] 28 0.022% 100.042% ( 4400, 6600 ] 1 0.001% 100.042% ( 6600, 9900 ] 2 0.002% 100.044% ** Level 4 read latency histogram (micros): Count: 220 Average: 299.7773 StdDev: 711.32 Min: 1 Median: 2.7368 Max: 4621 Percentiles: P50: 2.74 P75: 170.00 P99: 3950.00 P99.9: 4621.00 P99.99: 4621.00 ------------------------------------------------------ [ 0, 1 ] 38 17.273% 17.273% ### ( 1, 2 ] 58 26.364% 43.636% ##### ( 2, 3 ] 19 8.636% 52.273% ## ( 3, 4 ] 3 1.364% 53.636% ( 4, 6 ] 9 4.091% 57.727% # ( 6, 10 ] 3 1.364% 59.091% ( 10, 15 ] 3 1.364% 60.455% ( 15, 22 ] 7 3.182% 63.636% # ( 22, 34 ] 9 4.091% 67.727% # ( 51, 76 ] 1 0.455% 68.182% ( 76, 110 ] 3 1.364% 69.545% ( 110, 170 ] 12 5.455% 75.000% # ( 170, 250 ] 5 2.273% 77.273% ( 250, 380 ] 5 2.273% 79.545% ( 380, 580 ] 9 4.091% 83.636% # ( 580, 870 ] 12 5.455% 89.091% # ( 870, 1300 ] 6 2.727% 91.818% # ( 1300, 1900 ] 8 3.636% 95.455% # ( 1900, 2900 ] 5 2.273% 97.727% ( 2900, 4400 ] 4 1.818% 99.545% ( 4400, 6600 ] 1 0.455% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 769.0300 StdDev: 982.23 Min: 78 Median: 241.1111 Max: 4420 Percentiles: P50: 241.11 P75: 1042.00 P99: 4400.00 P99.9: 4420.00 P99.99: 4420.00 ------------------------------------------------------ ( 76, 110 ] 21 21.000% 21.000% #### ( 110, 170 ] 21 21.000% 42.000% #### ( 170, 250 ] 9 9.000% 51.000% ## ( 250, 380 ] 7 7.000% 58.000% # ( 380, 580 ] 2 2.000% 60.000% ( 580, 870 ] 13 13.000% 73.000% ### ( 870, 1300 ] 5 5.000% 78.000% # ( 1300, 1900 ] 7 7.000% 85.000% # ( 1900, 2900 ] 8 8.000% 93.000% ## ( 2900, 4400 ] 6 6.000% 99.000% # ( 4400, 6600 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 27.2 total, 3.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 253.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.561 H:M:S, 31.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.392 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/21-07:13:15 ... thread 0: (1000000,8000000) ops and (88030.8,208819.0) ops/second in (11.359657,38.310697) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 2.46 GB 113.3 7.7 0.0 7.7 15.3 7.6 0.0 2.0 148.7 296.1 52.93 48.71 134 0.395 7994K 12K 0.0 0.0 L1 5/0 528.14 MB 52.8 6.0 5.0 1.0 5.9 4.9 0.2 1.2 227.1 224.5 26.87 25.59 3 8.957 6175K 47K 0.0 0.0 L2 10/8 1.26 GB 2.6 0.3 0.2 0.2 0.3 0.2 4.4 1.8 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 L3 22/8 1.98 GB 1.0 0.7 0.5 0.2 0.7 0.5 2.8 1.3 203.8 203.6 3.68 3.25 3 1.226 760K 714 0.0 0.0 L4 162/3 9.62 GB 1.0 1.2 1.0 0.2 1.2 1.0 1.1 1.2 145.8 145.2 8.54 5.69 8 1.067 1264K 5270 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/23 103.68 GB 0.0 15.9 6.7 9.2 23.5 14.2 10.5 3.1 174.7 257.3 93.43 84.60 150 0.623 16M 66K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.9 6.7 9.2 23.5 14.2 10.4 3.1 174.7 257.3 93.43 84.60 150 0.623 16M 66K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.9 6.7 9.2 15.8 6.6 0.0 0.0 232.5 231.2 70.19 64.86 40 1.755 16M 66K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 336.1 23.24 19.74 110 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.5 total, 38.3 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.48 GB write, 623.82 MB/s write, 15.94 GB read, 423.45 MB/s read, 93.4 seconds Interval compaction: 23.48 GB write, 627.52 MB/s write, 15.94 GB read, 425.96 MB/s read, 93.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 34, interval: 57 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3622114 Average: 2.5378 StdDev: 23.62 Min: 1 Median: 1.5063 Max: 11054 Percentiles: P50: 1.51 P75: 1.89 P99: 6.05 P99.9: 103.20 P99.99: 227.04 ------------------------------------------------------ [ 0, 1 ] 600513 16.579% 16.579% ### ( 1, 2 ] 2390871 66.008% 82.587% ############# ( 2, 3 ] 399540 11.031% 93.617% ## ( 3, 4 ] 119428 3.297% 96.914% # ( 4, 6 ] 75219 2.077% 98.991% ( 6, 10 ] 26399 0.729% 99.720% ( 10, 15 ] 4048 0.112% 99.832% ( 15, 22 ] 707 0.020% 99.851% ( 22, 34 ] 51 0.001% 99.853% ( 34, 51 ] 25 0.001% 99.853% ( 51, 76 ] 58 0.002% 99.855% ( 76, 110 ] 2042 0.056% 99.911% ( 110, 170 ] 2429 0.067% 99.978% ( 170, 250 ] 593 0.016% 99.995% ( 250, 380 ] 430 0.012% 100.007% ( 380, 580 ] 273 0.008% 100.014% ( 580, 870 ] 197 0.005% 100.020% ( 870, 1300 ] 54 0.001% 100.021% ( 1300, 1900 ] 21 0.001% 100.022% ( 1900, 2900 ] 30 0.001% 100.022% ( 2900, 4400 ] 41 0.001% 100.024% ( 4400, 6600 ] 12 0.000% 100.024% ( 6600, 9900 ] 4 0.000% 100.024% ( 9900, 14000 ] 3 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 981544 Average: 5.9394 StdDev: 103.31 Min: 1 Median: 1.8552 Max: 15813 Percentiles: P50: 1.86 P75: 2.79 P99: 9.40 P99.9: 21.38 P99.99: 154.56 ------------------------------------------------------ [ 0, 1 ] 49147 5.007% 5.007% # ( 1, 2 ] 516389 52.610% 57.617% ########### ( 2, 3 ] 217246 22.133% 79.750% #### ( 3, 4 ] 82820 8.438% 88.188% ## ( 4, 6 ] 86181 8.780% 96.968% ## ( 6, 10 ] 23456 2.390% 99.358% ( 10, 15 ] 4788 0.488% 99.845% ( 15, 22 ] 589 0.060% 99.905% ( 22, 34 ] 39 0.004% 99.909% ( 34, 51 ] 25 0.003% 99.912% ( 51, 76 ] 43 0.004% 99.916% ( 76, 110 ] 429 0.044% 99.960% ( 110, 170 ] 397 0.040% 100.001% ( 170, 250 ] 204 0.021% 100.021% ( 250, 380 ] 245 0.025% 100.046% ( 380, 580 ] 318 0.032% 100.079% ( 580, 870 ] 294 0.030% 100.109% ( 870, 1300 ] 212 0.022% 100.130% ( 1300, 1900 ] 152 0.015% 100.146% ( 1900, 2900 ] 156 0.016% 100.162% ( 2900, 4400 ] 237 0.024% 100.186% ( 4400, 6600 ] 90 0.009% 100.195% ( 6600, 9900 ] 39 0.004% 100.199% ( 9900, 14000 ] 8 0.001% 100.200% ( 14000, 22000 ] 1 0.000% 100.200% ** Level 2 read latency histogram (micros): Count: 75852 Average: 2.0203 StdDev: 6.27 Min: 1 Median: 1.4055 Max: 1219 Percentiles: P50: 1.41 P75: 1.80 P99: 5.40 P99.9: 10.18 P99.99: 138.30 ------------------------------------------------------ [ 0, 1 ] 18540 24.442% 24.442% ##### ( 1, 2 ] 47805 63.024% 87.466% ############# ( 2, 3 ] 6036 7.958% 95.424% ## ( 3, 4 ] 1912 2.521% 97.945% # ( 4, 6 ] 1144 1.508% 99.453% ( 6, 10 ] 337 0.444% 99.897% ( 10, 15 ] 60 0.079% 99.976% ( 15, 22 ] 6 0.008% 99.984% ( 22, 34 ] 2 0.003% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 3 0.004% 99.992% ( 170, 250 ] 2 0.003% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 127425 Average: 10.6035 StdDev: 118.75 Min: 0 Median: 1.8265 Max: 8885 Percentiles: P50: 1.83 P75: 2.71 P99: 149.02 P99.9: 1275.61 P99.99: 2747.50 ------------------------------------------------------ [ 0, 1 ] 5760 4.520% 4.520% # ( 1, 2 ] 70115 55.025% 59.545% ########### ( 2, 3 ] 27680 21.723% 81.267% #### ( 3, 4 ] 10535 8.268% 89.535% ## ( 4, 6 ] 8386 6.581% 96.116% # ( 6, 10 ] 2730 2.142% 98.259% ( 10, 15 ] 522 0.410% 98.668% ( 15, 22 ] 78 0.061% 98.729% ( 22, 34 ] 40 0.031% 98.761% ( 34, 51 ] 16 0.013% 98.773% ( 76, 110 ] 80 0.063% 98.836% ( 110, 170 ] 321 0.252% 99.088% ( 170, 250 ] 252 0.198% 99.286% ( 250, 380 ] 242 0.190% 99.476% ( 380, 580 ] 270 0.212% 99.688% ( 580, 870 ] 197 0.155% 99.842% ( 870, 1300 ] 78 0.061% 99.903% ( 1300, 1900 ] 45 0.035% 99.939% ( 1900, 2900 ] 77 0.060% 99.999% ( 2900, 4400 ] 47 0.037% 100.036% ( 4400, 6600 ] 6 0.005% 100.041% ( 6600, 9900 ] 3 0.002% 100.043% ** Level 4 read latency histogram (micros): Count: 10419 Average: 55.0269 StdDev: 373.78 Min: 1 Median: 2.0288 Max: 11678 Percentiles: P50: 2.03 P75: 3.19 P99: 1674.09 P99.9: 5277.01 P99.99: 9761.73 ------------------------------------------------------ [ 0, 1 ] 264 2.534% 2.534% # ( 1, 2 ] 4875 46.790% 49.323% ######### ( 2, 3 ] 2449 23.505% 72.828% ##### ( 3, 4 ] 1192 11.441% 84.269% ## ( 4, 6 ] 847 8.129% 92.399% ## ( 6, 10 ] 301 2.889% 95.287% # ( 10, 15 ] 66 0.633% 95.921% ( 15, 22 ] 12 0.115% 96.036% ( 22, 34 ] 9 0.086% 96.122% ( 34, 51 ] 1 0.010% 96.132% ( 51, 76 ] 1 0.010% 96.142% ( 76, 110 ] 3 0.029% 96.170% ( 110, 170 ] 12 0.115% 96.286% ( 170, 250 ] 25 0.240% 96.526% ( 250, 380 ] 33 0.317% 96.842% ( 380, 580 ] 62 0.595% 97.437% ( 580, 870 ] 70 0.672% 98.109% ( 870, 1300 ] 66 0.633% 98.743% ( 1300, 1900 ] 43 0.413% 99.155% ( 1900, 2900 ] 31 0.298% 99.453% ( 2900, 4400 ] 41 0.394% 99.846% ( 4400, 6600 ] 14 0.134% 99.981% ( 6600, 9900 ] 1 0.010% 99.990% ( 9900, 14000 ] 1 0.010% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 902.8167 StdDev: 1065.98 Min: 78 Median: 413.3333 Max: 4637 Percentiles: P50: 413.33 P75: 1300.00 P99: 4637.00 P99.9: 4637.00 P99.99: 4637.00 ------------------------------------------------------ ( 76, 110 ] 21 17.500% 17.500% #### ( 110, 170 ] 21 17.500% 35.000% #### ( 170, 250 ] 9 7.500% 42.500% ## ( 250, 380 ] 8 6.667% 49.167% # ( 380, 580 ] 6 5.000% 54.167% # ( 580, 870 ] 14 11.667% 65.833% ## ( 870, 1300 ] 11 9.167% 75.000% ## ( 1300, 1900 ] 10 8.333% 83.333% ## ( 1900, 2900 ] 10 8.333% 91.667% ## ( 2900, 4400 ] 8 6.667% 98.333% # ( 4400, 6600 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 38.5 total, 11.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 204.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.136 H:M:S, 44.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 86.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.574 H:M:S, 75.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/07/21-07:13:20 ... thread 0: (1000000,9000000) ops and (202828.6,208136.0) ops/second in (4.930270,43.240967) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/15 3.37 GB 0.0 9.3 0.0 9.3 17.9 8.5 0.0 2.1 146.0 279.3 65.56 57.91 147 0.446 9718K 19K 0.0 0.0 L1 5/5 528.14 MB 0.0 6.0 5.0 1.0 5.9 4.9 0.2 1.2 227.1 224.5 26.87 25.59 3 8.957 6175K 47K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.4 1.8 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 L3 19/0 951.09 MB 1.0 3.0 1.7 1.3 3.0 1.7 2.9 1.8 135.4 134.6 22.51 14.07 11 2.047 3095K 17K 0.0 0.0 L4 162/0 9.62 GB 1.0 4.1 3.3 0.8 4.1 3.3 1.1 1.2 135.6 135.0 30.93 19.26 38 0.814 4224K 19K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/20 104.56 GB 0.0 22.7 10.1 12.6 31.1 18.5 12.9 3.6 158.0 216.5 147.29 118.20 201 0.733 23M 103K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.7 10.1 12.6 31.1 18.5 12.8 3.6 158.0 216.5 147.29 118.20 201 0.733 23M 103K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.7 10.1 12.6 22.6 10.0 0.0 0.0 194.6 193.5 119.56 95.91 80 1.495 23M 103K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 315.8 27.73 22.29 121 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.5 total, 43.2 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.15 GB write, 733.72 MB/s write, 22.72 GB read, 535.21 MB/s read, 147.3 seconds Interval compaction: 31.15 GB write, 737.58 MB/s write, 22.72 GB read, 538.02 MB/s read, 147.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 73, interval: 96 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3960602 Average: 2.7581 StdDev: 34.20 Min: 0 Median: 1.5273 Max: 11385 Percentiles: P50: 1.53 P75: 1.91 P99: 6.66 P99.9: 106.67 P99.99: 317.43 ------------------------------------------------------ [ 0, 1 ] 619928 15.652% 15.652% ### ( 1, 2 ] 2579745 65.135% 80.788% ############# ( 2, 3 ] 469172 11.846% 92.634% ## ( 3, 4 ] 145137 3.665% 96.298% # ( 4, 6 ] 101505 2.563% 98.861% # ( 6, 10 ] 33250 0.840% 99.700% ( 10, 15 ] 5096 0.129% 99.829% ( 15, 22 ] 810 0.020% 99.850% ( 22, 34 ] 54 0.001% 99.851% ( 34, 51 ] 31 0.001% 99.852% ( 51, 76 ] 61 0.002% 99.853% ( 76, 110 ] 2057 0.052% 99.905% ( 110, 170 ] 2465 0.062% 99.967% ( 170, 250 ] 636 0.016% 99.983% ( 250, 380 ] 505 0.013% 99.996% ( 380, 580 ] 384 0.010% 100.006% ( 580, 870 ] 299 0.008% 100.013% ( 870, 1300 ] 137 0.003% 100.017% ( 1300, 1900 ] 64 0.002% 100.019% ( 1900, 2900 ] 77 0.002% 100.020% ( 2900, 4400 ] 102 0.003% 100.023% ( 4400, 6600 ] 24 0.001% 100.024% ( 6600, 9900 ] 12 0.000% 100.024% ( 9900, 14000 ] 6 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1339295 Average: 7.0815 StdDev: 120.61 Min: 1 Median: 1.9144 Max: 15813 Percentiles: P50: 1.91 P75: 2.88 P99: 9.58 P99.9: 102.68 P99.99: 416.28 ------------------------------------------------------ [ 0, 1 ] 51896 3.875% 3.875% # ( 1, 2 ] 675611 50.445% 54.320% ########## ( 2, 3 ] 316205 23.610% 77.930% ##### ( 3, 4 ] 122310 9.132% 87.062% ## ( 4, 6 ] 128051 9.561% 96.623% ## ( 6, 10 ] 35568 2.656% 99.279% # ( 10, 15 ] 6994 0.522% 99.801% ( 15, 22 ] 851 0.064% 99.865% ( 22, 34 ] 49 0.004% 99.869% ( 34, 51 ] 30 0.002% 99.871% ( 51, 76 ] 47 0.004% 99.874% ( 76, 110 ] 438 0.033% 99.907% ( 110, 170 ] 441 0.033% 99.940% ( 170, 250 ] 249 0.019% 99.959% ( 250, 380 ] 330 0.025% 99.983% ( 380, 580 ] 502 0.037% 100.021% ( 580, 870 ] 530 0.040% 100.060% ( 870, 1300 ] 378 0.028% 100.088% ( 1300, 1900 ] 272 0.020% 100.109% ( 1900, 2900 ] 328 0.024% 100.133% ( 2900, 4400 ] 441 0.033% 100.166% ( 4400, 6600 ] 180 0.013% 100.180% ( 6600, 9900 ] 66 0.005% 100.185% ( 9900, 14000 ] 13 0.001% 100.186% ( 14000, 22000 ] 1 0.000% 100.186% ** Level 2 read latency histogram (micros): Count: 75852 Average: 2.0203 StdDev: 6.27 Min: 1 Median: 1.4055 Max: 1219 Percentiles: P50: 1.41 P75: 1.80 P99: 5.40 P99.9: 10.18 P99.99: 138.30 ------------------------------------------------------ [ 0, 1 ] 18540 24.442% 24.442% ##### ( 1, 2 ] 47805 63.024% 87.466% ############# ( 2, 3 ] 6036 7.958% 95.424% ## ( 3, 4 ] 1912 2.521% 97.945% # ( 4, 6 ] 1144 1.508% 99.453% ( 6, 10 ] 337 0.444% 99.897% ( 10, 15 ] 60 0.079% 99.976% ( 15, 22 ] 6 0.008% 99.984% ( 22, 34 ] 2 0.003% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 3 0.004% 99.992% ( 170, 250 ] 2 0.003% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 599672 Average: 8.3941 StdDev: 111.38 Min: 0 Median: 2.0551 Max: 8885 Percentiles: P50: 2.06 P75: 3.04 P99: 9.82 P99.9: 584.68 P99.99: 855.47 ------------------------------------------------------ [ 0, 1 ] 9623 1.605% 1.605% ( 1, 2 ] 281630 46.964% 48.569% ######### ( 2, 3 ] 155644 25.955% 74.524% ##### ( 3, 4 ] 67159 11.199% 85.723% ## ( 4, 6 ] 66712 11.125% 96.848% ## ( 6, 10 ] 13504 2.252% 99.100% ( 10, 15 ] 2709 0.452% 99.551% ( 15, 22 ] 276 0.046% 99.597% ( 22, 34 ] 46 0.008% 99.605% ( 34, 51 ] 19 0.003% 99.608% ( 51, 76 ] 7 0.001% 99.609% ( 76, 110 ] 85 0.014% 99.623% ( 110, 170 ] 363 0.061% 99.684% ( 170, 250 ] 344 0.057% 99.741% ( 250, 380 ] 393 0.066% 99.807% ( 380, 580 ] 549 0.092% 99.898% ( 580, 870 ] 578 0.096% 99.995% ( 870, 1300 ] 396 0.066% 100.061% ( 1300, 1900 ] 225 0.038% 100.098% ( 1900, 2900 ] 194 0.032% 100.131% ( 2900, 4400 ] 189 0.032% 100.162% ( 4400, 6600 ] 55 0.009% 100.171% ( 6600, 9900 ] 20 0.003% 100.175% ** Level 4 read latency histogram (micros): Count: 114235 Average: 19.9432 StdDev: 196.15 Min: 0 Median: 1.9788 Max: 11678 Percentiles: P50: 1.98 P75: 2.93 P99: 514.88 P99.9: 2837.14 P99.99: 4112.52 ------------------------------------------------------ [ 0, 1 ] 1625 1.423% 1.423% ( 1, 2 ] 56695 49.630% 51.053% ########## ( 2, 3 ] 29484 25.810% 76.863% ##### ( 3, 4 ] 11238 9.838% 86.700% ## ( 4, 6 ] 10002 8.756% 95.456% ## ( 6, 10 ] 2920 2.556% 98.012% # ( 10, 15 ] 496 0.434% 98.446% ( 15, 22 ] 61 0.053% 98.500% ( 22, 34 ] 13 0.011% 98.511% ( 34, 51 ] 4 0.004% 98.514% ( 51, 76 ] 14 0.012% 98.527% ( 76, 110 ] 18 0.016% 98.542% ( 110, 170 ] 55 0.048% 98.591% ( 170, 250 ] 132 0.116% 98.706% ( 250, 380 ] 163 0.143% 98.849% ( 380, 580 ] 256 0.224% 99.073% ( 580, 870 ] 355 0.311% 99.384% ( 870, 1300 ] 297 0.260% 99.644% ( 1300, 1900 ] 170 0.149% 99.793% ( 1900, 2900 ] 131 0.115% 99.907% ( 2900, 4400 ] 117 0.102% 100.010% ( 4400, 6600 ] 21 0.018% 100.028% ( 6600, 9900 ] 5 0.004% 100.032% ( 9900, 14000 ] 2 0.002% 100.034% ** Level 5 read latency histogram (micros): Count: 260 Average: 1082.9308 StdDev: 1208.19 Min: 78 Median: 569.4737 Max: 6047 Percentiles: P50: 569.47 P75: 1584.21 P99: 5456.00 P99.9: 6047.00 P99.99: 6047.00 ------------------------------------------------------ ( 76, 110 ] 27 10.385% 10.385% ## ( 110, 170 ] 32 12.308% 22.692% ## ( 170, 250 ] 26 10.000% 32.692% ## ( 250, 380 ] 27 10.385% 43.077% ## ( 380, 580 ] 19 7.308% 50.385% # ( 580, 870 ] 28 10.769% 61.154% ## ( 870, 1300 ] 27 10.385% 71.538% ## ( 1300, 1900 ] 19 7.308% 78.846% # ( 1900, 2900 ] 24 9.231% 88.077% ## ( 2900, 4400 ] 26 10.000% 98.077% ## ( 4400, 6600 ] 5 1.923% 100.000% ** DB Stats ** Uptime(secs): 43.5 total, 4.9 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 203.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.258 H:M:S, 44.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 199.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.122 H:M:S, 43.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/21-07:13:23 ... thread 0: (1000000,10000000) ops and (335250.6,216338.7) ops/second in (2.982843,46.223810) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 4.29 GB 132.1 10.5 0.0 10.5 20.0 9.5 0.0 2.1 148.0 281.0 72.76 64.75 164 0.444 10M 20K 0.0 0.0 L1 5/5 528.14 MB 0.0 6.0 5.0 1.0 5.9 4.9 0.2 1.2 227.1 224.5 26.87 25.59 3 8.957 6175K 47K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.4 1.8 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 L3 19/0 951.09 MB 1.0 3.0 1.7 1.3 3.0 1.7 2.9 1.8 135.4 134.6 22.51 14.07 11 2.047 3095K 17K 0.0 0.0 L4 162/0 9.62 GB 1.0 4.1 3.3 0.8 4.1 3.3 1.1 1.2 135.6 135.0 30.93 19.26 38 0.814 4224K 19K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/16 105.49 GB 0.0 23.9 10.1 13.8 33.2 19.5 12.9 3.5 158.3 220.3 154.49 125.03 218 0.709 24M 105K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.9 10.1 13.8 33.2 19.5 12.8 3.5 158.3 220.3 154.49 125.03 218 0.709 24M 105K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.9 10.1 13.8 23.8 10.0 0.0 0.0 197.1 196.1 124.11 100.38 84 1.477 24M 105K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 319.3 30.38 24.65 134 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.5 total, 46.2 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.24 GB write, 732.69 MB/s write, 23.89 GB read, 526.61 MB/s read, 154.5 seconds Interval compaction: 33.24 GB write, 736.29 MB/s write, 23.89 GB read, 529.20 MB/s read, 154.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 77, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 77, interval: 100 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4366918 Average: 2.7259 StdDev: 32.69 Min: 0 Median: 1.5340 Max: 11385 Percentiles: P50: 1.53 P75: 1.92 P99: 6.61 P99.9: 98.53 P99.99: 261.32 ------------------------------------------------------ [ 0, 1 ] 662865 15.179% 15.179% ### ( 1, 2 ] 2847719 65.211% 80.390% ############# ( 2, 3 ] 532394 12.192% 92.582% ## ( 3, 4 ] 161580 3.700% 96.282% # ( 4, 6 ] 113048 2.589% 98.871% # ( 6, 10 ] 37065 0.849% 99.720% ( 10, 15 ] 5499 0.126% 99.845% ( 15, 22 ] 847 0.019% 99.865% ( 22, 34 ] 61 0.001% 99.866% ( 34, 51 ] 35 0.001% 99.867% ( 51, 76 ] 64 0.001% 99.869% ( 76, 110 ] 2077 0.048% 99.916% ( 110, 170 ] 2518 0.058% 99.974% ( 170, 250 ] 665 0.015% 99.989% ( 250, 380 ] 532 0.012% 100.001% ( 380, 580 ] 394 0.009% 100.010% ( 580, 870 ] 313 0.007% 100.017% ( 870, 1300 ] 143 0.003% 100.021% ( 1300, 1900 ] 65 0.001% 100.022% ( 1900, 2900 ] 79 0.002% 100.024% ( 2900, 4400 ] 102 0.002% 100.026% ( 4400, 6600 ] 24 0.001% 100.027% ( 6600, 9900 ] 12 0.000% 100.027% ( 9900, 14000 ] 6 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1339295 Average: 7.0815 StdDev: 120.61 Min: 1 Median: 1.9144 Max: 15813 Percentiles: P50: 1.91 P75: 2.88 P99: 9.58 P99.9: 102.68 P99.99: 416.28 ------------------------------------------------------ [ 0, 1 ] 51896 3.875% 3.875% # ( 1, 2 ] 675611 50.445% 54.320% ########## ( 2, 3 ] 316205 23.610% 77.930% ##### ( 3, 4 ] 122310 9.132% 87.062% ## ( 4, 6 ] 128051 9.561% 96.623% ## ( 6, 10 ] 35568 2.656% 99.279% # ( 10, 15 ] 6994 0.522% 99.801% ( 15, 22 ] 851 0.064% 99.865% ( 22, 34 ] 49 0.004% 99.869% ( 34, 51 ] 30 0.002% 99.871% ( 51, 76 ] 47 0.004% 99.874% ( 76, 110 ] 438 0.033% 99.907% ( 110, 170 ] 441 0.033% 99.940% ( 170, 250 ] 249 0.019% 99.959% ( 250, 380 ] 330 0.025% 99.983% ( 380, 580 ] 502 0.037% 100.021% ( 580, 870 ] 530 0.040% 100.060% ( 870, 1300 ] 378 0.028% 100.088% ( 1300, 1900 ] 272 0.020% 100.109% ( 1900, 2900 ] 328 0.024% 100.133% ( 2900, 4400 ] 441 0.033% 100.166% ( 4400, 6600 ] 180 0.013% 100.180% ( 6600, 9900 ] 66 0.005% 100.185% ( 9900, 14000 ] 13 0.001% 100.186% ( 14000, 22000 ] 1 0.000% 100.186% ** Level 2 read latency histogram (micros): Count: 75852 Average: 2.0203 StdDev: 6.27 Min: 1 Median: 1.4055 Max: 1219 Percentiles: P50: 1.41 P75: 1.80 P99: 5.40 P99.9: 10.18 P99.99: 138.30 ------------------------------------------------------ [ 0, 1 ] 18540 24.442% 24.442% ##### ( 1, 2 ] 47805 63.024% 87.466% ############# ( 2, 3 ] 6036 7.958% 95.424% ## ( 3, 4 ] 1912 2.521% 97.945% # ( 4, 6 ] 1144 1.508% 99.453% ( 6, 10 ] 337 0.444% 99.897% ( 10, 15 ] 60 0.079% 99.976% ( 15, 22 ] 6 0.008% 99.984% ( 22, 34 ] 2 0.003% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 3 0.004% 99.992% ( 170, 250 ] 2 0.003% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 599672 Average: 8.3941 StdDev: 111.38 Min: 0 Median: 2.0551 Max: 8885 Percentiles: P50: 2.06 P75: 3.04 P99: 9.82 P99.9: 584.68 P99.99: 855.47 ------------------------------------------------------ [ 0, 1 ] 9623 1.605% 1.605% ( 1, 2 ] 281630 46.964% 48.569% ######### ( 2, 3 ] 155644 25.955% 74.524% ##### ( 3, 4 ] 67159 11.199% 85.723% ## ( 4, 6 ] 66712 11.125% 96.848% ## ( 6, 10 ] 13504 2.252% 99.100% ( 10, 15 ] 2709 0.452% 99.551% ( 15, 22 ] 276 0.046% 99.597% ( 22, 34 ] 46 0.008% 99.605% ( 34, 51 ] 19 0.003% 99.608% ( 51, 76 ] 7 0.001% 99.609% ( 76, 110 ] 85 0.014% 99.623% ( 110, 170 ] 363 0.061% 99.684% ( 170, 250 ] 344 0.057% 99.741% ( 250, 380 ] 393 0.066% 99.807% ( 380, 580 ] 549 0.092% 99.898% ( 580, 870 ] 578 0.096% 99.995% ( 870, 1300 ] 396 0.066% 100.061% ( 1300, 1900 ] 225 0.038% 100.098% ( 1900, 2900 ] 194 0.032% 100.131% ( 2900, 4400 ] 189 0.032% 100.162% ( 4400, 6600 ] 55 0.009% 100.171% ( 6600, 9900 ] 20 0.003% 100.175% ** Level 4 read latency histogram (micros): Count: 114235 Average: 19.9432 StdDev: 196.15 Min: 0 Median: 1.9788 Max: 11678 Percentiles: P50: 1.98 P75: 2.93 P99: 514.88 P99.9: 2837.14 P99.99: 4112.52 ------------------------------------------------------ [ 0, 1 ] 1625 1.423% 1.423% ( 1, 2 ] 56695 49.630% 51.053% ########## ( 2, 3 ] 29484 25.810% 76.863% ##### ( 3, 4 ] 11238 9.838% 86.700% ## ( 4, 6 ] 10002 8.756% 95.456% ## ( 6, 10 ] 2920 2.556% 98.012% # ( 10, 15 ] 496 0.434% 98.446% ( 15, 22 ] 61 0.053% 98.500% ( 22, 34 ] 13 0.011% 98.511% ( 34, 51 ] 4 0.004% 98.514% ( 51, 76 ] 14 0.012% 98.527% ( 76, 110 ] 18 0.016% 98.542% ( 110, 170 ] 55 0.048% 98.591% ( 170, 250 ] 132 0.116% 98.706% ( 250, 380 ] 163 0.143% 98.849% ( 380, 580 ] 256 0.224% 99.073% ( 580, 870 ] 355 0.311% 99.384% ( 870, 1300 ] 297 0.260% 99.644% ( 1300, 1900 ] 170 0.149% 99.793% ( 1900, 2900 ] 131 0.115% 99.907% ( 2900, 4400 ] 117 0.102% 100.010% ( 4400, 6600 ] 21 0.018% 100.028% ( 6600, 9900 ] 5 0.004% 100.032% ( 9900, 14000 ] 2 0.002% 100.034% ** Level 5 read latency histogram (micros): Count: 260 Average: 1082.9308 StdDev: 1208.19 Min: 78 Median: 569.4737 Max: 6047 Percentiles: P50: 569.47 P75: 1584.21 P99: 5456.00 P99.9: 6047.00 P99.99: 6047.00 ------------------------------------------------------ ( 76, 110 ] 27 10.385% 10.385% ## ( 110, 170 ] 32 12.308% 22.692% ## ( 170, 250 ] 26 10.000% 32.692% ## ( 250, 380 ] 27 10.385% 43.077% ## ( 380, 580 ] 19 7.308% 50.385% # ( 580, 870 ] 28 10.769% 61.154% ## ( 870, 1300 ] 27 10.385% 71.538% ## ( 1300, 1900 ] 19 7.308% 78.846% # ( 1900, 2900 ] 24 9.231% 88.077% ## ( 2900, 4400 ] 26 10.000% 98.077% ## ( 4400, 6600 ] 5 1.923% 100.000% ** DB Stats ** Uptime(secs): 46.5 total, 3.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 211.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.692 H:M:S, 42.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.434 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/21-07:13:32 ... thread 0: (1000000,11000000) ops and (105958.1,197623.1) ops/second in (9.437696,55.661506) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 5.34 GB 132.1 11.9 0.0 11.9 22.4 10.5 0.0 2.1 150.1 282.9 80.94 72.50 185 0.438 12M 22K 0.0 0.0 L1 5/5 528.14 MB 0.0 6.0 5.0 1.0 5.9 4.9 0.2 1.2 227.1 224.5 26.87 25.59 3 8.957 6175K 47K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.4 1.8 246.6 246.5 1.41 1.36 2 0.707 353K 198 0.0 0.0 L3 19/0 951.09 MB 1.0 3.0 1.7 1.3 3.0 1.7 2.9 1.8 135.4 134.6 22.51 14.07 11 2.047 3095K 17K 0.0 0.0 L4 162/0 9.62 GB 1.0 4.1 3.3 0.8 4.1 3.3 1.1 1.2 135.6 135.0 30.93 19.26 38 0.814 4224K 19K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/17 106.53 GB 0.0 25.2 10.1 15.1 35.6 20.5 12.9 3.4 158.9 224.3 162.67 132.79 239 0.681 26M 106K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.2 10.1 15.1 35.6 20.5 12.8 3.4 158.9 224.3 162.67 132.79 239 0.681 26M 106K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.2 10.1 15.1 25.1 10.0 0.0 0.0 200.0 199.0 129.26 105.44 89 1.452 26M 106K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 322.4 33.41 27.35 150 0.223 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.9 total, 55.7 interval Flush(GB): cumulative 10.520, interval 10.520 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.64 GB write, 652.89 MB/s write, 25.24 GB read, 462.48 MB/s read, 162.7 seconds Interval compaction: 35.64 GB write, 655.56 MB/s write, 25.24 GB read, 464.37 MB/s read, 162.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 34, total-stops: 79, interval: 113 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5370388 Average: 2.7549 StdDev: 30.24 Min: 0 Median: 1.5343 Max: 11385 Percentiles: P50: 1.53 P75: 1.92 P99: 6.87 P99.9: 117.76 P99.99: 270.97 ------------------------------------------------------ [ 0, 1 ] 803116 14.955% 14.955% ### ( 1, 2 ] 3522507 65.591% 80.546% ############# ( 2, 3 ] 654420 12.186% 92.732% ## ( 3, 4 ] 193464 3.602% 96.334% # ( 4, 6 ] 133117 2.479% 98.813% ( 6, 10 ] 46275 0.862% 99.674% ( 10, 15 ] 6435 0.120% 99.794% ( 15, 22 ] 998 0.019% 99.813% ( 22, 34 ] 65 0.001% 99.814% ( 34, 51 ] 42 0.001% 99.815% ( 51, 76 ] 105 0.002% 99.817% ( 76, 110 ] 3926 0.073% 99.890% ( 110, 170 ] 4236 0.079% 99.969% ( 170, 250 ] 1019 0.019% 99.988% ( 250, 380 ] 781 0.015% 100.002% ( 380, 580 ] 564 0.011% 100.013% ( 580, 870 ] 365 0.007% 100.019% ( 870, 1300 ] 158 0.003% 100.022% ( 1300, 1900 ] 71 0.001% 100.024% ( 1900, 2900 ] 83 0.002% 100.025% ( 2900, 4400 ] 105 0.002% 100.027% ( 4400, 6600 ] 24 0.000% 100.028% ( 6600, 9900 ] 12 0.000% 100.028% ( 9900, 14000 ] 6 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1458833 Average: 6.7795 StdDev: 115.69 Min: 1 Median: 1.8814 Max: 15813 Percentiles: P50: 1.88 P75: 2.83 P99: 9.59 P99.9: 129.53 P99.99: 423.77 ------------------------------------------------------ [ 0, 1 ] 64173 4.399% 4.399% # ( 1, 2 ] 754763 51.737% 56.136% ########## ( 2, 3 ] 332507 22.793% 78.929% ##### ( 3, 4 ] 127722 8.755% 87.684% ## ( 4, 6 ] 131461 9.011% 96.696% ## ( 6, 10 ] 37471 2.569% 99.264% # ( 10, 15 ] 7223 0.495% 99.759% ( 15, 22 ] 877 0.060% 99.819% ( 22, 34 ] 51 0.003% 99.823% ( 34, 51 ] 31 0.002% 99.825% ( 51, 76 ] 50 0.003% 99.828% ( 76, 110 ] 803 0.055% 99.883% ( 110, 170 ] 744 0.051% 99.934% ( 170, 250 ] 320 0.022% 99.956% ( 250, 380 ] 376 0.026% 99.982% ( 380, 580 ] 526 0.036% 100.018% ( 580, 870 ] 537 0.037% 100.055% ( 870, 1300 ] 379 0.026% 100.081% ( 1300, 1900 ] 275 0.019% 100.100% ( 1900, 2900 ] 328 0.022% 100.122% ( 2900, 4400 ] 442 0.030% 100.153% ( 4400, 6600 ] 180 0.012% 100.165% ( 6600, 9900 ] 66 0.005% 100.169% ( 9900, 14000 ] 13 0.001% 100.170% ( 14000, 22000 ] 1 0.000% 100.170% ** Level 2 read latency histogram (micros): Count: 75852 Average: 2.0203 StdDev: 6.27 Min: 1 Median: 1.4055 Max: 1219 Percentiles: P50: 1.41 P75: 1.80 P99: 5.40 P99.9: 10.18 P99.99: 138.30 ------------------------------------------------------ [ 0, 1 ] 18540 24.442% 24.442% ##### ( 1, 2 ] 47805 63.024% 87.466% ############# ( 2, 3 ] 6036 7.958% 95.424% ## ( 3, 4 ] 1912 2.521% 97.945% # ( 4, 6 ] 1144 1.508% 99.453% ( 6, 10 ] 337 0.444% 99.897% ( 10, 15 ] 60 0.079% 99.976% ( 15, 22 ] 6 0.008% 99.984% ( 22, 34 ] 2 0.003% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 3 0.004% 99.992% ( 170, 250 ] 2 0.003% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 599672 Average: 8.3941 StdDev: 111.38 Min: 0 Median: 2.0551 Max: 8885 Percentiles: P50: 2.06 P75: 3.04 P99: 9.82 P99.9: 584.68 P99.99: 855.47 ------------------------------------------------------ [ 0, 1 ] 9623 1.605% 1.605% ( 1, 2 ] 281630 46.964% 48.569% ######### ( 2, 3 ] 155644 25.955% 74.524% ##### ( 3, 4 ] 67159 11.199% 85.723% ## ( 4, 6 ] 66712 11.125% 96.848% ## ( 6, 10 ] 13504 2.252% 99.100% ( 10, 15 ] 2709 0.452% 99.551% ( 15, 22 ] 276 0.046% 99.597% ( 22, 34 ] 46 0.008% 99.605% ( 34, 51 ] 19 0.003% 99.608% ( 51, 76 ] 7 0.001% 99.609% ( 76, 110 ] 85 0.014% 99.623% ( 110, 170 ] 363 0.061% 99.684% ( 170, 250 ] 344 0.057% 99.741% ( 250, 380 ] 393 0.066% 99.807% ( 380, 580 ] 549 0.092% 99.898% ( 580, 870 ] 578 0.096% 99.995% ( 870, 1300 ] 396 0.066% 100.061% ( 1300, 1900 ] 225 0.038% 100.098% ( 1900, 2900 ] 194 0.032% 100.131% ( 2900, 4400 ] 189 0.032% 100.162% ( 4400, 6600 ] 55 0.009% 100.171% ( 6600, 9900 ] 20 0.003% 100.175% ** Level 4 read latency histogram (micros): Count: 114235 Average: 19.9432 StdDev: 196.15 Min: 0 Median: 1.9788 Max: 11678 Percentiles: P50: 1.98 P75: 2.93 P99: 514.88 P99.9: 2837.14 P99.99: 4112.52 ------------------------------------------------------ [ 0, 1 ] 1625 1.423% 1.423% ( 1, 2 ] 56695 49.630% 51.053% ########## ( 2, 3 ] 29484 25.810% 76.863% ##### ( 3, 4 ] 11238 9.838% 86.700% ## ( 4, 6 ] 10002 8.756% 95.456% ## ( 6, 10 ] 2920 2.556% 98.012% # ( 10, 15 ] 496 0.434% 98.446% ( 15, 22 ] 61 0.053% 98.500% ( 22, 34 ] 13 0.011% 98.511% ( 34, 51 ] 4 0.004% 98.514% ( 51, 76 ] 14 0.012% 98.527% ( 76, 110 ] 18 0.016% 98.542% ( 110, 170 ] 55 0.048% 98.591% ( 170, 250 ] 132 0.116% 98.706% ( 250, 380 ] 163 0.143% 98.849% ( 380, 580 ] 256 0.224% 99.073% ( 580, 870 ] 355 0.311% 99.384% ( 870, 1300 ] 297 0.260% 99.644% ( 1300, 1900 ] 170 0.149% 99.793% ( 1900, 2900 ] 131 0.115% 99.907% ( 2900, 4400 ] 117 0.102% 100.010% ( 4400, 6600 ] 21 0.018% 100.028% ( 6600, 9900 ] 5 0.004% 100.032% ( 9900, 14000 ] 2 0.002% 100.034% ** Level 5 read latency histogram (micros): Count: 260 Average: 1082.9308 StdDev: 1208.19 Min: 78 Median: 569.4737 Max: 6047 Percentiles: P50: 569.47 P75: 1584.21 P99: 5456.00 P99.9: 6047.00 P99.99: 6047.00 ------------------------------------------------------ ( 76, 110 ] 27 10.385% 10.385% ## ( 110, 170 ] 32 12.308% 22.692% ## ( 170, 250 ] 26 10.000% 32.692% ## ( 250, 380 ] 27 10.385% 43.077% ## ( 380, 580 ] 19 7.308% 50.385% # ( 580, 870 ] 28 10.769% 61.154% ## ( 870, 1300 ] 27 10.385% 71.538% ## ( 1300, 1900 ] 19 7.308% 78.846% # ( 1900, 2900 ] 24 9.231% 88.077% ## ( 2900, 4400 ] 26 10.000% 98.077% ## ( 4400, 6600 ] 5 1.923% 100.000% ** DB Stats ** Uptime(secs): 55.9 total, 9.4 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 193.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.559 H:M:S, 47.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 104.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.867 H:M:S, 72.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.440 micros/op 183822 ops/sec 60.015 seconds 11031999 operations; 178.1 MB/s Microseconds per write: Count: 11031999 Average: 5.4400 StdDev: 480.36 Min: 0 Median: 1.7104 Max: 848241 Percentiles: P50: 1.71 P75: 2.63 P99: 7.69 P99.9: 1093.87 P99.99: 2670.16 ------------------------------------------------------ [ 0, 1 ] 1648883 14.946% 14.946% ### ( 1, 2 ] 5443558 49.343% 64.290% ########## ( 2, 3 ] 1870846 16.958% 81.248% ### ( 3, 4 ] 1443858 13.088% 94.336% ### ( 4, 6 ] 479136 4.343% 98.679% # ( 6, 10 ] 83890 0.760% 99.440% ( 10, 15 ] 22266 0.202% 99.641% ( 15, 22 ] 7264 0.066% 99.707% ( 22, 34 ] 2014 0.018% 99.725% ( 34, 51 ] 240 0.002% 99.728% ( 51, 76 ] 39 0.000% 99.728% ( 76, 110 ] 7948 0.072% 99.800% ( 110, 170 ] 2862 0.026% 99.826% ( 170, 250 ] 321 0.003% 99.829% ( 250, 380 ] 83 0.001% 99.830% ( 380, 580 ] 22 0.000% 99.830% ( 580, 870 ] 24 0.000% 99.830% ( 870, 1300 ] 14815 0.134% 99.964% ( 1300, 1900 ] 55 0.000% 99.965% ( 1900, 2900 ] 3599 0.033% 99.997% ( 2900, 4400 ] 175 0.002% 99.999% ( 4400, 6600 ] 55 0.000% 100.000% ( 6600, 9900 ] 13 0.000% 100.000% ( 9900, 14000 ] 4 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 231839 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11031999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11385022968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 613 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30737318 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 36842718579 rocksdb.compact.write.bytes COUNT : 36597666887 rocksdb.flush.write.bytes COUNT : 11361839301 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 63 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 354 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11270321152 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4458496 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 36949230171 rocksdb.non.last.level.read.count COUNT : 8926075 rocksdb.block.checksum.compute.count COUNT : 8924910 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.342254 P95 : 3.751228 P99 : 5.963091 P100 : 848234.000000 COUNT : 11031999 SUM : 55069878 rocksdb.compaction.times.micros P50 : 1062162.162162 P95 : 3880000.000000 P99 : 13748000.000000 P100 : 15464987.000000 COUNT : 112 SUM : 176444011 rocksdb.compaction.times.cpu_micros P50 : 903589.743590 P95 : 3460000.000000 P99 : 13748000.000000 P100 : 14192015.000000 COUNT : 112 SUM : 141380591 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 696.318681 P95 : 3237.500000 P99 : 68625.000000 P100 : 80019.000000 COUNT : 151 SUM : 351464 rocksdb.compaction.outfile.sync.micros P50 : 1284.859155 P95 : 129500.000000 P99 : 215371.428571 P100 : 520492.000000 COUNT : 403 SUM : 9185158 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 104.950495 P95 : 1681.818182 P99 : 3800.000000 P100 : 6888.000000 COUNT : 300 SUM : 103493 rocksdb.table.open.io.micros P50 : 1586.813187 P95 : 6898.269231 P99 : 10613.400000 P100 : 17173.000000 COUNT : 613 SUM : 1319906 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.737351 P95 : 8.252733 P99 : 12.124655 P100 : 15820.000000 COUNT : 8923335 SUM : 61349587 rocksdb.read.block.get.micros P50 : 475.652174 P95 : 3480.327869 P99 : 5757.052632 P100 : 11032.000000 COUNT : 1228 SUM : 1116183 rocksdb.write.raw.block.micros P50 : 0.513348 P95 : 0.975361 P99 : 2.843544 P100 : 17539.000000 COUNT : 11618139 SUM : 24175695 rocksdb.numfiles.in.singlecompaction P50 : 3.186813 P95 : 5.220000 P99 : 13.700000 P100 : 16.000000 COUNT : 178 SUM : 633 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.555885 P95 : 1141.206417 P99 : 2441.566332 P100 : 848051.000000 COUNT : 186286 SUM : 30749131 rocksdb.sst.read.micros P50 : 1.680032 P95 : 5.072183 P99 : 9.104839 P100 : 15813.000000 COUNT : 8926582 SUM : 42964372 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11031999 SUM : 11385022968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212424.242424 P95 : 435100.000000 P99 : 943300.000000 P100 : 1015516.000000 COUNT : 151 SUM : 33947747 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 404 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0