[2024-11-20 05:12:15.688751] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-20 05:12:15.688897] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid318778 ] Set seed to 1732075935685247 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 05:12:15.800348] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 05:12:16.009531] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 05:12:16.009580] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 318778' to capture a snapshot of events at runtime. [2024-11-20 05:12:16.009590] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid318778 for offline analysis/debug. [2024-11-20 05:12:16.009616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 05:12:24 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-05:12:27 ... thread 0: (1000000,1000000) ops and (365008.3,365008.3) ops/second in (2.739664,2.739664) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.01 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 357.0 2.29 2.07 12 0.191 0 0 0.0 0.0 L2 3/2 251.73 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 208 0.0 0.0 L3 9/0 741.07 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 99.8 316.1 3.79 3.51 14 0.270 383K 208 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 99.8 316.1 3.79 3.51 14 0.270 383K 208 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 253.3 253.1 1.49 1.44 2 0.746 383K 208 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 357.0 2.29 2.07 12 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 402.52 MB/s write, 0.37 GB read, 127.12 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 436.55 MB/s write, 0.37 GB read, 137.86 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 100797 Average: 1.9506 StdDev: 20.36 Min: 1 Median: 1.2632 Max: 3469 Percentiles: P50: 1.26 P75: 1.67 P99: 3.92 P99.9: 9.40 P99.99: 456.81 ------------------------------------------------------ [ 0, 1 ] 34296 34.025% 34.025% ####### ( 1, 2 ] 61192 60.708% 94.733% ############ ( 2, 3 ] 3125 3.100% 97.833% # ( 3, 4 ] 1280 1.270% 99.103% ( 4, 6 ] 617 0.612% 99.715% ( 6, 10 ] 220 0.218% 99.934% ( 10, 15 ] 35 0.035% 99.968% ( 15, 22 ] 7 0.007% 99.975% ( 22, 34 ] 2 0.002% 99.977% ( 51, 76 ] 1 0.001% 99.978% ( 110, 170 ] 8 0.008% 99.986% ( 170, 250 ] 1 0.001% 99.987% ( 250, 380 ] 2 0.002% 99.989% ( 380, 580 ] 5 0.005% 99.994% ( 580, 870 ] 1 0.001% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 3 0.003% 100.002% ** Level 1 read latency histogram (micros): Count: 5 Average: 2514.0000 StdDev: 2307.16 Min: 286 Median: 1085.0000 Max: 5497 Percentiles: P50: 1085.00 P75: 5225.00 P99: 5497.00 P99.9: 5497.00 P99.99: 5497.00 ------------------------------------------------------ ( 250, 380 ] 1 20.000% 20.000% #### ( 580, 870 ] 1 20.000% 40.000% #### ( 870, 1300 ] 1 20.000% 60.000% #### ( 4400, 6600 ] 2 40.000% 100.000% ######## ** Level 2 read latency histogram (micros): Count: 49064 Average: 1.8994 StdDev: 7.09 Min: 0 Median: 1.2967 Max: 1041 Percentiles: P50: 1.30 P75: 1.71 P99: 5.26 P99.9: 10.14 P99.99: 285.54 ------------------------------------------------------ [ 0, 1 ] 15693 31.985% 31.985% ###### ( 1, 2 ] 29791 60.719% 92.703% ############ ( 2, 3 ] 1806 3.681% 96.384% # ( 3, 4 ] 894 1.822% 98.206% ( 4, 6 ] 620 1.264% 99.470% ( 6, 10 ] 210 0.428% 99.898% ( 10, 15 ] 34 0.069% 99.967% ( 15, 22 ] 6 0.012% 99.980% ( 22, 34 ] 2 0.004% 99.984% ( 51, 76 ] 2 0.004% 99.988% ( 250, 380 ] 4 0.008% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 40 Average: 3106.0250 StdDev: 2012.24 Min: 92 Median: 3200.0000 Max: 6857 Percentiles: P50: 3200.00 P75: 4840.00 P99: 6857.00 P99.9: 6857.00 P99.99: 6857.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 1 2.500% 5.000% # ( 380, 580 ] 2 5.000% 10.000% # ( 580, 870 ] 1 2.500% 12.500% # ( 870, 1300 ] 7 17.500% 30.000% #### ( 1300, 1900 ] 4 10.000% 40.000% ## ( 1900, 2900 ] 2 5.000% 45.000% # ( 2900, 4400 ] 10 25.000% 70.000% ##### ( 4400, 6600 ] 10 25.000% 95.000% ##### ( 6600, 9900 ] 2 5.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 4210.3714 StdDev: 1986.30 Min: 660 Median: 3962.5000 Max: 8668 Percentiles: P50: 3962.50 P75: 5683.33 P99: 8668.00 P99.9: 8668.00 P99.99: 8668.00 ------------------------------------------------------ ( 580, 870 ] 2 5.714% 5.714% # ( 1300, 1900 ] 2 5.714% 11.429% # ( 1900, 2900 ] 5 14.286% 25.714% ### ( 2900, 4400 ] 12 34.286% 60.000% ####### ( 4400, 6600 ] 9 25.714% 85.714% ##### ( 6600, 9900 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 331.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.209 H:M:S, 7.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 358.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.209 H:M:S, 7.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-05:12:30 ... thread 0: (1000000,2000000) ops and (329645.8,346426.9) ops/second in (3.033559,5.773223) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.17 GB 62.9 0.6 0.0 0.6 2.3 1.8 0.0 1.3 77.3 326.4 7.33 6.75 28 0.262 575K 633 0.0 0.0 L1 1/0 2.91 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 245.2 244.8 1.54 1.50 1 1.541 383K 661 0.0 0.0 L2 2/0 54.77 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 208 0.0 0.0 L3 42/0 997.01 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.7 201.5 3.95 3.51 3 1.316 808K 818 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/8 97.92 GB 0.0 2.1 1.1 1.0 3.9 2.9 1.5 2.2 148.0 275.5 14.31 13.21 34 0.421 2151K 2320 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 1.1 1.0 3.9 2.9 1.4 2.2 148.0 275.5 14.31 13.21 34 0.421 2151K 2320 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 1.1 1.0 2.1 1.1 0.0 0.0 230.6 230.3 9.19 8.63 8 1.149 2151K 2320 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.6 5.12 4.58 26 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.85 GB write, 656.58 MB/s write, 2.07 GB read, 352.83 MB/s read, 14.3 seconds Interval compaction: 3.85 GB write, 682.93 MB/s write, 2.07 GB read, 366.99 MB/s read, 14.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 390433 Average: 2.2095 StdDev: 12.52 Min: 1 Median: 1.4845 Max: 3469 Percentiles: P50: 1.48 P75: 1.87 P99: 5.73 P99.9: 9.92 P99.99: 16.13 ------------------------------------------------------ [ 0, 1 ] 73038 18.707% 18.707% #### ( 1, 2 ] 252193 64.593% 83.300% ############# ( 2, 3 ] 37549 9.617% 92.917% ## ( 3, 4 ] 14079 3.606% 96.523% # ( 4, 6 ] 11159 2.858% 99.381% # ( 6, 10 ] 2067 0.529% 99.911% ( 10, 15 ] 304 0.078% 99.989% ( 15, 22 ] 37 0.009% 99.998% ( 22, 34 ] 6 0.002% 100.000% ( 34, 51 ] 1 0.000% 100.000% ( 51, 76 ] 2 0.001% 100.001% ( 110, 170 ] 14 0.004% 100.004% ( 170, 250 ] 6 0.002% 100.006% ( 250, 380 ] 5 0.001% 100.007% ( 380, 580 ] 11 0.003% 100.010% ( 580, 870 ] 6 0.002% 100.011% ( 870, 1300 ] 7 0.002% 100.013% ( 1300, 1900 ] 2 0.001% 100.014% ( 1900, 2900 ] 2 0.001% 100.014% ( 2900, 4400 ] 3 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 81615 Average: 2.6765 StdDev: 28.27 Min: 1 Median: 1.6704 Max: 5497 Percentiles: P50: 1.67 P75: 2.22 P99: 6.71 P99.9: 13.44 P99.99: 28.58 ------------------------------------------------------ [ 0, 1 ] 5698 6.982% 6.982% # ( 1, 2 ] 52371 64.168% 71.150% ############# ( 2, 3 ] 13985 17.135% 88.285% ### ( 3, 4 ] 4355 5.336% 93.621% # ( 4, 6 ] 4256 5.215% 98.836% # ( 6, 10 ] 759 0.930% 99.766% ( 10, 15 ] 159 0.195% 99.961% ( 15, 22 ] 20 0.025% 99.985% ( 22, 34 ] 7 0.009% 99.994% ( 34, 51 ] 1 0.001% 99.995% ( 51, 76 ] 2 0.002% 99.998% ( 110, 170 ] 1 0.001% 99.999% ( 170, 250 ] 1 0.001% 100.000% ( 250, 380 ] 3 0.004% 100.004% ( 380, 580 ] 2 0.002% 100.006% ( 580, 870 ] 1 0.001% 100.007% ( 870, 1300 ] 2 0.002% 100.010% ( 1900, 2900 ] 1 0.001% 100.011% ( 4400, 6600 ] 2 0.002% 100.013% ** Level 2 read latency histogram (micros): Count: 95423 Average: 2.0568 StdDev: 5.14 Min: 0 Median: 1.4235 Max: 1041 Percentiles: P50: 1.42 P75: 1.82 P99: 5.66 P99.9: 10.67 P99.99: 30.75 ------------------------------------------------------ [ 0, 1 ] 22092 23.152% 23.152% ##### ( 1, 2 ] 60496 63.398% 86.549% ############# ( 2, 3 ] 7083 7.423% 93.972% # ( 3, 4 ] 2913 3.053% 97.025% # ( 4, 6 ] 2268 2.377% 99.402% ( 6, 10 ] 465 0.487% 99.889% ( 10, 15 ] 79 0.083% 99.972% ( 15, 22 ] 16 0.017% 99.988% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 51, 76 ] 2 0.002% 99.994% ( 250, 380 ] 4 0.004% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57481 Average: 4.7058 StdDev: 97.77 Min: 0 Median: 1.6650 Max: 6857 Percentiles: P50: 1.66 P75: 2.22 P99: 7.60 P99.9: 24.33 P99.99: 4137.78 ------------------------------------------------------ [ 0, 1 ] 4368 7.599% 7.599% ## ( 1, 2 ] 36652 63.764% 71.363% ############# ( 2, 3 ] 9553 16.619% 87.982% ### ( 3, 4 ] 3157 5.492% 93.474% # ( 4, 6 ] 2959 5.148% 98.622% # ( 6, 10 ] 543 0.945% 99.567% ( 10, 15 ] 155 0.270% 99.836% ( 15, 22 ] 34 0.059% 99.896% ( 22, 34 ] 13 0.023% 99.918% ( 34, 51 ] 3 0.005% 99.923% ( 76, 110 ] 1 0.002% 99.925% ( 110, 170 ] 2 0.003% 99.929% ( 170, 250 ] 3 0.005% 99.934% ( 250, 380 ] 3 0.005% 99.939% ( 380, 580 ] 6 0.010% 99.950% ( 580, 870 ] 1 0.002% 99.951% ( 870, 1300 ] 8 0.014% 99.965% ( 1300, 1900 ] 4 0.007% 99.972% ( 1900, 2900 ] 2 0.003% 99.976% ( 2900, 4400 ] 10 0.017% 99.993% ( 4400, 6600 ] 10 0.017% 100.010% ( 6600, 9900 ] 2 0.003% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 4210.3714 StdDev: 1986.30 Min: 660 Median: 3962.5000 Max: 8668 Percentiles: P50: 3962.50 P75: 5683.33 P99: 8668.00 P99.9: 8668.00 P99.99: 8668.00 ------------------------------------------------------ ( 580, 870 ] 2 5.714% 5.714% # ( 1300, 1900 ] 2 5.714% 11.429% # ( 1900, 2900 ] 5 14.286% 25.714% ### ( 2900, 4400 ] 12 34.286% 60.000% ####### ( 4400, 6600 ] 9 25.714% 85.714% ##### ( 6600, 9900 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 767.9500 StdDev: 1013.61 Min: 87 Median: 210.0000 Max: 3819 Percentiles: P50: 210.00 P75: 870.00 P99: 3819.00 P99.9: 3819.00 P99.99: 3819.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 5 25.000% 45.000% ##### ( 170, 250 ] 2 10.000% 55.000% ## ( 380, 580 ] 3 15.000% 70.000% ### ( 580, 870 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 327.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.620 H:M:S, 10.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.410 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-05:12:33 ... thread 0: (1000000,3000000) ops and (337389.0,343361.0) ops/second in (2.963938,8.737161) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 188.8 1.7 0.0 1.7 4.4 2.8 0.0 1.6 118.3 315.3 14.38 13.42 46 0.313 1727K 1883 0.0 0.0 L1 1/0 2.91 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 245.2 244.8 1.54 1.50 1 1.541 383K 661 0.0 0.0 L2 2/0 54.77 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 208 0.0 0.0 L3 42/0 997.01 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.7 201.5 3.95 3.51 3 1.316 808K 818 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/4 98.90 GB 0.0 3.2 1.1 2.1 5.9 3.9 1.5 2.1 152.3 284.8 21.36 19.88 52 0.411 3303K 3570 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.1 2.1 5.9 3.9 1.4 2.1 152.3 284.8 21.36 19.88 52 0.411 3303K 3570 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.1 2.1 3.2 1.1 0.0 0.0 241.6 241.3 13.47 12.83 12 1.122 3303K 3570 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.1 7.90 7.05 40 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.7 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.94 GB write, 678.27 MB/s write, 3.18 GB read, 362.66 MB/s read, 21.4 seconds Interval compaction: 5.94 GB write, 696.25 MB/s write, 3.18 GB read, 372.28 MB/s read, 21.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 630883 Average: 2.1188 StdDev: 12.36 Min: 0 Median: 1.4324 Max: 3469 Percentiles: P50: 1.43 P75: 1.82 P99: 5.56 P99.9: 9.97 P99.99: 17.28 ------------------------------------------------------ [ 0, 1 ] 138577 21.966% 21.966% #### ( 1, 2 ] 408990 64.828% 86.794% ############# ( 2, 3 ] 48332 7.661% 94.455% ## ( 3, 4 ] 18248 2.892% 97.347% # ( 4, 6 ] 13378 2.121% 99.468% ( 6, 10 ] 2750 0.436% 99.904% ( 10, 15 ] 526 0.083% 99.987% ( 15, 22 ] 58 0.009% 99.996% ( 22, 34 ] 7 0.001% 99.997% ( 34, 51 ] 3 0.000% 99.998% ( 51, 76 ] 3 0.000% 99.998% ( 110, 170 ] 21 0.003% 100.002% ( 170, 250 ] 10 0.002% 100.003% ( 250, 380 ] 8 0.001% 100.004% ( 380, 580 ] 14 0.002% 100.007% ( 580, 870 ] 15 0.002% 100.009% ( 870, 1300 ] 13 0.002% 100.011% ( 1300, 1900 ] 3 0.000% 100.012% ( 1900, 2900 ] 4 0.001% 100.012% ( 2900, 4400 ] 4 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 81615 Average: 2.6765 StdDev: 28.27 Min: 1 Median: 1.6704 Max: 5497 Percentiles: P50: 1.67 P75: 2.22 P99: 6.71 P99.9: 13.44 P99.99: 28.58 ------------------------------------------------------ [ 0, 1 ] 5698 6.982% 6.982% # ( 1, 2 ] 52371 64.168% 71.150% ############# ( 2, 3 ] 13985 17.135% 88.285% ### ( 3, 4 ] 4355 5.336% 93.621% # ( 4, 6 ] 4256 5.215% 98.836% # ( 6, 10 ] 759 0.930% 99.766% ( 10, 15 ] 159 0.195% 99.961% ( 15, 22 ] 20 0.025% 99.985% ( 22, 34 ] 7 0.009% 99.994% ( 34, 51 ] 1 0.001% 99.995% ( 51, 76 ] 2 0.002% 99.998% ( 110, 170 ] 1 0.001% 99.999% ( 170, 250 ] 1 0.001% 100.000% ( 250, 380 ] 3 0.004% 100.004% ( 380, 580 ] 2 0.002% 100.006% ( 580, 870 ] 1 0.001% 100.007% ( 870, 1300 ] 2 0.002% 100.010% ( 1900, 2900 ] 1 0.001% 100.011% ( 4400, 6600 ] 2 0.002% 100.013% ** Level 2 read latency histogram (micros): Count: 95423 Average: 2.0568 StdDev: 5.14 Min: 0 Median: 1.4235 Max: 1041 Percentiles: P50: 1.42 P75: 1.82 P99: 5.66 P99.9: 10.67 P99.99: 30.75 ------------------------------------------------------ [ 0, 1 ] 22092 23.152% 23.152% ##### ( 1, 2 ] 60496 63.398% 86.549% ############# ( 2, 3 ] 7083 7.423% 93.972% # ( 3, 4 ] 2913 3.053% 97.025% # ( 4, 6 ] 2268 2.377% 99.402% ( 6, 10 ] 465 0.487% 99.889% ( 10, 15 ] 79 0.083% 99.972% ( 15, 22 ] 16 0.017% 99.988% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 51, 76 ] 2 0.002% 99.994% ( 250, 380 ] 4 0.004% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57481 Average: 4.7058 StdDev: 97.77 Min: 0 Median: 1.6650 Max: 6857 Percentiles: P50: 1.66 P75: 2.22 P99: 7.60 P99.9: 24.33 P99.99: 4137.78 ------------------------------------------------------ [ 0, 1 ] 4368 7.599% 7.599% ## ( 1, 2 ] 36652 63.764% 71.363% ############# ( 2, 3 ] 9553 16.619% 87.982% ### ( 3, 4 ] 3157 5.492% 93.474% # ( 4, 6 ] 2959 5.148% 98.622% # ( 6, 10 ] 543 0.945% 99.567% ( 10, 15 ] 155 0.270% 99.836% ( 15, 22 ] 34 0.059% 99.896% ( 22, 34 ] 13 0.023% 99.918% ( 34, 51 ] 3 0.005% 99.923% ( 76, 110 ] 1 0.002% 99.925% ( 110, 170 ] 2 0.003% 99.929% ( 170, 250 ] 3 0.005% 99.934% ( 250, 380 ] 3 0.005% 99.939% ( 380, 580 ] 6 0.010% 99.950% ( 580, 870 ] 1 0.002% 99.951% ( 870, 1300 ] 8 0.014% 99.965% ( 1300, 1900 ] 4 0.007% 99.972% ( 1900, 2900 ] 2 0.003% 99.976% ( 2900, 4400 ] 10 0.017% 99.993% ( 4400, 6600 ] 10 0.017% 100.010% ( 6600, 9900 ] 2 0.003% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 4210.3714 StdDev: 1986.30 Min: 660 Median: 3962.5000 Max: 8668 Percentiles: P50: 3962.50 P75: 5683.33 P99: 8668.00 P99.9: 8668.00 P99.99: 8668.00 ------------------------------------------------------ ( 580, 870 ] 2 5.714% 5.714% # ( 1300, 1900 ] 2 5.714% 11.429% # ( 1900, 2900 ] 5 14.286% 25.714% ### ( 2900, 4400 ] 12 34.286% 60.000% ####### ( 4400, 6600 ] 9 25.714% 85.714% ##### ( 6600, 9900 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 767.9500 StdDev: 1013.61 Min: 87 Median: 210.0000 Max: 3819 Percentiles: P50: 210.00 P75: 870.00 P99: 3819.00 P99.9: 3819.00 P99.99: 3819.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 5 25.000% 45.000% ##### ( 170, 250 ] 2 10.000% 55.000% ## ( 380, 580 ] 3 15.000% 70.000% ### ( 580, 870 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 329.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.017 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-05:12:36 ... thread 0: (1000000,4000000) ops and (331687.9,340366.4) ops/second in (3.014882,11.752043) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 3.07 GB 0.0 2.8 0.0 2.8 6.5 3.7 0.0 1.7 132.7 309.4 21.37 20.05 63 0.339 2878K 3082 0.0 0.0 L1 1/1 2.91 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 245.2 244.8 1.54 1.50 1 1.541 383K 661 0.0 0.0 L2 2/0 54.77 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 208 0.0 0.0 L3 42/0 997.01 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.7 201.5 3.95 3.51 3 1.316 808K 818 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/15 99.82 GB 0.0 4.3 1.1 3.2 8.0 4.8 1.5 2.2 154.7 287.9 28.35 26.51 69 0.411 4454K 4769 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.1 3.2 8.0 4.8 1.4 2.2 154.7 287.9 28.35 26.51 69 0.411 4454K 4769 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.1 3.2 4.3 1.1 0.0 0.0 246.6 246.3 17.79 17.07 16 1.112 4454K 4769 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 358.0 10.56 9.44 53 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.97 GB write, 681.00 MB/s write, 4.28 GB read, 366.05 MB/s read, 28.4 seconds Interval compaction: 7.97 GB write, 694.43 MB/s write, 4.28 GB read, 373.27 MB/s read, 28.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 885407 Average: 2.1209 StdDev: 13.34 Min: 0 Median: 1.4220 Max: 4923 Percentiles: P50: 1.42 P75: 1.80 P99: 5.47 P99.9: 10.94 P99.99: 123.34 ------------------------------------------------------ [ 0, 1 ] 198497 22.419% 22.419% #### ( 1, 2 ] 578688 65.358% 87.777% ############# ( 2, 3 ] 63869 7.214% 94.991% # ( 3, 4 ] 23446 2.648% 97.639% # ( 4, 6 ] 16382 1.850% 99.489% ( 6, 10 ] 3494 0.395% 99.884% ( 10, 15 ] 779 0.088% 99.972% ( 15, 22 ] 81 0.009% 99.981% ( 22, 34 ] 10 0.001% 99.982% ( 34, 51 ] 8 0.001% 99.983% ( 51, 76 ] 6 0.001% 99.983% ( 76, 110 ] 41 0.005% 99.988% ( 110, 170 ] 83 0.009% 99.997% ( 170, 250 ] 29 0.003% 100.001% ( 250, 380 ] 19 0.002% 100.003% ( 380, 580 ] 25 0.003% 100.006% ( 580, 870 ] 25 0.003% 100.008% ( 870, 1300 ] 17 0.002% 100.010% ( 1300, 1900 ] 4 0.000% 100.011% ( 1900, 2900 ] 5 0.001% 100.011% ( 2900, 4400 ] 5 0.001% 100.012% ( 4400, 6600 ] 1 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 81616 Average: 2.6782 StdDev: 28.28 Min: 1 Median: 1.6704 Max: 5497 Percentiles: P50: 1.67 P75: 2.22 P99: 6.71 P99.9: 13.47 P99.99: 30.29 ------------------------------------------------------ [ 0, 1 ] 5698 6.981% 6.981% # ( 1, 2 ] 52371 64.168% 71.149% ############# ( 2, 3 ] 13985 17.135% 88.284% ### ( 3, 4 ] 4355 5.336% 93.620% # ( 4, 6 ] 4256 5.215% 98.835% # ( 6, 10 ] 759 0.930% 99.765% ( 10, 15 ] 159 0.195% 99.960% ( 15, 22 ] 20 0.025% 99.984% ( 22, 34 ] 7 0.009% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 51, 76 ] 2 0.002% 99.996% ( 110, 170 ] 2 0.002% 99.999% ( 170, 250 ] 1 0.001% 100.000% ( 250, 380 ] 3 0.004% 100.004% ( 380, 580 ] 2 0.002% 100.006% ( 580, 870 ] 1 0.001% 100.007% ( 870, 1300 ] 2 0.002% 100.010% ( 1900, 2900 ] 1 0.001% 100.011% ( 4400, 6600 ] 2 0.002% 100.013% ** Level 2 read latency histogram (micros): Count: 95423 Average: 2.0568 StdDev: 5.14 Min: 0 Median: 1.4235 Max: 1041 Percentiles: P50: 1.42 P75: 1.82 P99: 5.66 P99.9: 10.67 P99.99: 30.75 ------------------------------------------------------ [ 0, 1 ] 22092 23.152% 23.152% ##### ( 1, 2 ] 60496 63.398% 86.549% ############# ( 2, 3 ] 7083 7.423% 93.972% # ( 3, 4 ] 2913 3.053% 97.025% # ( 4, 6 ] 2268 2.377% 99.402% ( 6, 10 ] 465 0.487% 99.889% ( 10, 15 ] 79 0.083% 99.972% ( 15, 22 ] 16 0.017% 99.988% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 51, 76 ] 2 0.002% 99.994% ( 250, 380 ] 4 0.004% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57481 Average: 4.7058 StdDev: 97.77 Min: 0 Median: 1.6650 Max: 6857 Percentiles: P50: 1.66 P75: 2.22 P99: 7.60 P99.9: 24.33 P99.99: 4137.78 ------------------------------------------------------ [ 0, 1 ] 4368 7.599% 7.599% ## ( 1, 2 ] 36652 63.764% 71.363% ############# ( 2, 3 ] 9553 16.619% 87.982% ### ( 3, 4 ] 3157 5.492% 93.474% # ( 4, 6 ] 2959 5.148% 98.622% # ( 6, 10 ] 543 0.945% 99.567% ( 10, 15 ] 155 0.270% 99.836% ( 15, 22 ] 34 0.059% 99.896% ( 22, 34 ] 13 0.023% 99.918% ( 34, 51 ] 3 0.005% 99.923% ( 76, 110 ] 1 0.002% 99.925% ( 110, 170 ] 2 0.003% 99.929% ( 170, 250 ] 3 0.005% 99.934% ( 250, 380 ] 3 0.005% 99.939% ( 380, 580 ] 6 0.010% 99.950% ( 580, 870 ] 1 0.002% 99.951% ( 870, 1300 ] 8 0.014% 99.965% ( 1300, 1900 ] 4 0.007% 99.972% ( 1900, 2900 ] 2 0.003% 99.976% ( 2900, 4400 ] 10 0.017% 99.993% ( 4400, 6600 ] 10 0.017% 100.010% ( 6600, 9900 ] 2 0.003% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 4210.3714 StdDev: 1986.30 Min: 660 Median: 3962.5000 Max: 8668 Percentiles: P50: 3962.50 P75: 5683.33 P99: 8668.00 P99.9: 8668.00 P99.99: 8668.00 ------------------------------------------------------ ( 580, 870 ] 2 5.714% 5.714% # ( 1300, 1900 ] 2 5.714% 11.429% # ( 1900, 2900 ] 5 14.286% 25.714% ### ( 2900, 4400 ] 12 34.286% 60.000% ####### ( 4400, 6600 ] 9 25.714% 85.714% ##### ( 6600, 9900 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 767.9500 StdDev: 1013.61 Min: 87 Median: 210.0000 Max: 3819 Percentiles: P50: 210.00 P75: 870.00 P99: 3819.00 P99.9: 3819.00 P99.99: 3819.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 5 25.000% 45.000% ##### ( 170, 250 ] 2 10.000% 55.000% ## ( 380, 580 ] 3 15.000% 70.000% ### ( 580, 870 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 328.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.471 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.454 H:M:S, 15.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-05:12:42 ... thread 0: (1000000,5000000) ops and (156422.7,275558.3) ops/second in (6.392935,18.144978) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/18 4.12 GB 0.0 3.8 0.0 3.8 8.5 4.7 0.0 1.8 137.3 307.7 28.45 26.71 83 0.343 3965K 4242 0.0 0.0 L1 1/1 2.91 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 245.2 244.8 1.54 1.50 1 1.541 383K 661 0.0 0.0 L2 2/0 54.77 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 208 0.0 0.0 L3 42/0 997.01 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.7 201.5 3.95 3.51 3 1.316 808K 818 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/19 100.87 GB 0.0 5.3 1.1 4.2 10.1 5.8 1.5 2.1 154.1 290.8 35.43 33.17 89 0.398 5542K 5929 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 1.1 4.2 10.1 5.8 1.4 2.1 154.1 290.8 35.43 33.17 89 0.398 5542K 5929 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 1.1 4.2 5.3 1.1 0.0 0.0 250.0 249.8 21.83 21.03 20 1.091 5542K 5929 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.7 13.60 12.14 69 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.4 total, 18.1 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.06 GB write, 560.59 MB/s write, 5.33 GB read, 296.99 MB/s read, 35.4 seconds Interval compaction: 10.06 GB write, 567.75 MB/s write, 5.33 GB read, 300.78 MB/s read, 35.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 16, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1541264 Average: 2.1259 StdDev: 11.21 Min: 0 Median: 1.4414 Max: 4923 Percentiles: P50: 1.44 P75: 1.81 P99: 5.52 P99.9: 11.06 P99.99: 91.34 ------------------------------------------------------ [ 0, 1 ] 314211 20.387% 20.387% #### ( 1, 2 ] 1033978 67.086% 87.473% ############# ( 2, 3 ] 117485 7.623% 95.096% ## ( 3, 4 ] 40043 2.598% 97.694% # ( 4, 6 ] 26575 1.724% 99.418% ( 6, 10 ] 7117 0.462% 99.880% ( 10, 15 ] 1475 0.096% 99.975% ( 15, 22 ] 149 0.010% 99.985% ( 22, 34 ] 17 0.001% 99.986% ( 34, 51 ] 8 0.001% 99.987% ( 51, 76 ] 9 0.001% 99.987% ( 76, 110 ] 95 0.006% 99.993% ( 110, 170 ] 159 0.010% 100.004% ( 170, 250 ] 49 0.003% 100.007% ( 250, 380 ] 31 0.002% 100.009% ( 380, 580 ] 40 0.003% 100.011% ( 580, 870 ] 36 0.002% 100.014% ( 870, 1300 ] 25 0.002% 100.015% ( 1300, 1900 ] 8 0.001% 100.016% ( 1900, 2900 ] 6 0.000% 100.016% ( 2900, 4400 ] 5 0.000% 100.017% ( 4400, 6600 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 81616 Average: 2.6782 StdDev: 28.28 Min: 1 Median: 1.6704 Max: 5497 Percentiles: P50: 1.67 P75: 2.22 P99: 6.71 P99.9: 13.47 P99.99: 30.29 ------------------------------------------------------ [ 0, 1 ] 5698 6.981% 6.981% # ( 1, 2 ] 52371 64.168% 71.149% ############# ( 2, 3 ] 13985 17.135% 88.284% ### ( 3, 4 ] 4355 5.336% 93.620% # ( 4, 6 ] 4256 5.215% 98.835% # ( 6, 10 ] 759 0.930% 99.765% ( 10, 15 ] 159 0.195% 99.960% ( 15, 22 ] 20 0.025% 99.984% ( 22, 34 ] 7 0.009% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 51, 76 ] 2 0.002% 99.996% ( 110, 170 ] 2 0.002% 99.999% ( 170, 250 ] 1 0.001% 100.000% ( 250, 380 ] 3 0.004% 100.004% ( 380, 580 ] 2 0.002% 100.006% ( 580, 870 ] 1 0.001% 100.007% ( 870, 1300 ] 2 0.002% 100.010% ( 1900, 2900 ] 1 0.001% 100.011% ( 4400, 6600 ] 2 0.002% 100.013% ** Level 2 read latency histogram (micros): Count: 95423 Average: 2.0568 StdDev: 5.14 Min: 0 Median: 1.4235 Max: 1041 Percentiles: P50: 1.42 P75: 1.82 P99: 5.66 P99.9: 10.67 P99.99: 30.75 ------------------------------------------------------ [ 0, 1 ] 22092 23.152% 23.152% ##### ( 1, 2 ] 60496 63.398% 86.549% ############# ( 2, 3 ] 7083 7.423% 93.972% # ( 3, 4 ] 2913 3.053% 97.025% # ( 4, 6 ] 2268 2.377% 99.402% ( 6, 10 ] 465 0.487% 99.889% ( 10, 15 ] 79 0.083% 99.972% ( 15, 22 ] 16 0.017% 99.988% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 51, 76 ] 2 0.002% 99.994% ( 250, 380 ] 4 0.004% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57481 Average: 4.7058 StdDev: 97.77 Min: 0 Median: 1.6650 Max: 6857 Percentiles: P50: 1.66 P75: 2.22 P99: 7.60 P99.9: 24.33 P99.99: 4137.78 ------------------------------------------------------ [ 0, 1 ] 4368 7.599% 7.599% ## ( 1, 2 ] 36652 63.764% 71.363% ############# ( 2, 3 ] 9553 16.619% 87.982% ### ( 3, 4 ] 3157 5.492% 93.474% # ( 4, 6 ] 2959 5.148% 98.622% # ( 6, 10 ] 543 0.945% 99.567% ( 10, 15 ] 155 0.270% 99.836% ( 15, 22 ] 34 0.059% 99.896% ( 22, 34 ] 13 0.023% 99.918% ( 34, 51 ] 3 0.005% 99.923% ( 76, 110 ] 1 0.002% 99.925% ( 110, 170 ] 2 0.003% 99.929% ( 170, 250 ] 3 0.005% 99.934% ( 250, 380 ] 3 0.005% 99.939% ( 380, 580 ] 6 0.010% 99.950% ( 580, 870 ] 1 0.002% 99.951% ( 870, 1300 ] 8 0.014% 99.965% ( 1300, 1900 ] 4 0.007% 99.972% ( 1900, 2900 ] 2 0.003% 99.976% ( 2900, 4400 ] 10 0.017% 99.993% ( 4400, 6600 ] 10 0.017% 100.010% ( 6600, 9900 ] 2 0.003% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 4210.3714 StdDev: 1986.30 Min: 660 Median: 3962.5000 Max: 8668 Percentiles: P50: 3962.50 P75: 5683.33 P99: 8668.00 P99.9: 8668.00 P99.99: 8668.00 ------------------------------------------------------ ( 580, 870 ] 2 5.714% 5.714% # ( 1300, 1900 ] 2 5.714% 11.429% # ( 1900, 2900 ] 5 14.286% 25.714% ### ( 2900, 4400 ] 12 34.286% 60.000% ####### ( 4400, 6600 ] 9 25.714% 85.714% ##### ( 6600, 9900 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 767.9500 StdDev: 1013.61 Min: 87 Median: 210.0000 Max: 3819 Percentiles: P50: 210.00 P75: 870.00 P99: 3819.00 P99.9: 3819.00 P99.99: 3819.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 5 25.000% 45.000% ##### ( 170, 250 ] 2 10.000% 55.000% ## ( 380, 580 ] 3 15.000% 70.000% ### ( 580, 870 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 18.4 total, 6.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 267.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.108 H:M:S, 27.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 153.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.637 H:M:S, 56.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-05:12:51 ... thread 0: (1000000,6000000) ops and (115400.2,223793.1) ops/second in (8.665498,26.810476) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/5 1.96 GB 12.6 5.6 0.0 5.6 11.2 5.7 0.0 2.0 149.5 300.5 38.33 35.85 101 0.380 5819K 9281 0.0 0.0 L1 14/14 1.52 GB 0.0 3.4 3.4 0.0 3.4 3.4 0.2 1.0 227.9 224.9 15.48 14.88 2 7.738 3581K 47K 0.0 0.0 L2 2/0 54.77 MB 0.5 0.4 0.2 0.2 0.4 0.2 2.0 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 208 0.0 0.0 L3 14/0 926.29 MB 0.9 0.8 0.6 0.2 0.8 0.6 1.6 1.4 201.7 201.5 3.95 3.51 3 1.316 808K 818 0.0 0.0 L4 167/0 9.76 GB 1.0 0.8 0.6 0.1 0.8 0.6 1.3 1.2 168.6 167.8 4.70 3.67 5 0.939 773K 3371 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/19 101.74 GB 0.0 11.0 4.8 6.1 16.6 10.4 6.8 2.9 175.5 265.2 63.95 59.36 113 0.566 11M 60K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.0 4.8 6.1 16.6 10.4 6.7 2.9 175.5 265.2 63.95 59.36 113 0.566 11M 60K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.0 4.8 6.1 10.9 4.8 0.0 0.0 237.0 235.7 47.36 44.81 30 1.579 11M 60K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 349.4 16.59 14.54 83 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.0 total, 26.8 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.56 GB write, 627.10 MB/s write, 10.96 GB read, 415.08 MB/s read, 63.9 seconds Interval compaction: 16.56 GB write, 632.52 MB/s write, 10.96 GB read, 418.67 MB/s read, 63.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 23, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2435251 Average: 2.3198 StdDev: 13.61 Min: 0 Median: 1.4622 Max: 4923 Percentiles: P50: 1.46 P75: 1.83 P99: 5.89 P99.9: 14.82 P99.99: 214.45 ------------------------------------------------------ [ 0, 1 ] 457888 18.802% 18.802% #### ( 1, 2 ] 1643749 67.498% 86.301% ############# ( 2, 3 ] 199214 8.180% 94.481% ## ( 3, 4 ] 66508 2.731% 97.212% # ( 4, 6 ] 46151 1.895% 99.107% ( 6, 10 ] 16898 0.694% 99.801% ( 10, 15 ] 2496 0.102% 99.904% ( 15, 22 ] 256 0.011% 99.914% ( 22, 34 ] 24 0.001% 99.915% ( 34, 51 ] 8 0.000% 99.915% ( 51, 76 ] 27 0.001% 99.917% ( 76, 110 ] 719 0.030% 99.946% ( 110, 170 ] 925 0.038% 99.984% ( 170, 250 ] 260 0.011% 99.995% ( 250, 380 ] 192 0.008% 100.003% ( 380, 580 ] 180 0.007% 100.010% ( 580, 870 ] 116 0.005% 100.015% ( 870, 1300 ] 64 0.003% 100.017% ( 1300, 1900 ] 20 0.001% 100.018% ( 1900, 2900 ] 14 0.001% 100.019% ( 2900, 4400 ] 7 0.000% 100.019% ( 4400, 6600 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 245014 Average: 3.5343 StdDev: 34.90 Min: 1 Median: 1.8365 Max: 5497 Percentiles: P50: 1.84 P75: 2.74 P99: 8.50 P99.9: 13.55 P99.99: 14.85 ------------------------------------------------------ [ 0, 1 ] 9444 3.854% 3.854% # ( 1, 2 ] 135157 55.163% 59.017% ########### ( 2, 3 ] 52754 21.531% 80.548% #### ( 3, 4 ] 19755 8.063% 88.611% ## ( 4, 6 ] 22782 9.298% 97.910% ## ( 6, 10 ] 4276 1.745% 99.655% ( 10, 15 ] 847 0.346% 100.000% ( 15, 22 ] 110 0.045% 100.045% ( 22, 34 ] 11 0.004% 100.050% ( 34, 51 ] 1 0.000% 100.050% ( 51, 76 ] 3 0.001% 100.051% ( 76, 110 ] 19 0.008% 100.059% ( 110, 170 ] 50 0.020% 100.080% ( 170, 250 ] 33 0.013% 100.093% ( 250, 380 ] 43 0.018% 100.111% ( 380, 580 ] 47 0.019% 100.130% ( 580, 870 ] 31 0.013% 100.142% ( 870, 1300 ] 37 0.015% 100.158% ( 1300, 1900 ] 5 0.002% 100.160% ( 1900, 2900 ] 11 0.004% 100.164% ( 2900, 4400 ] 9 0.004% 100.168% ( 4400, 6600 ] 2 0.001% 100.169% ** Level 2 read latency histogram (micros): Count: 95423 Average: 2.0568 StdDev: 5.14 Min: 0 Median: 1.4235 Max: 1041 Percentiles: P50: 1.42 P75: 1.82 P99: 5.66 P99.9: 10.67 P99.99: 30.75 ------------------------------------------------------ [ 0, 1 ] 22092 23.152% 23.152% ##### ( 1, 2 ] 60496 63.398% 86.549% ############# ( 2, 3 ] 7083 7.423% 93.972% # ( 3, 4 ] 2913 3.053% 97.025% # ( 4, 6 ] 2268 2.377% 99.402% ( 6, 10 ] 465 0.487% 99.889% ( 10, 15 ] 79 0.083% 99.972% ( 15, 22 ] 16 0.017% 99.988% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 51, 76 ] 2 0.002% 99.994% ( 250, 380 ] 4 0.004% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 94974 Average: 8.6722 StdDev: 100.50 Min: 0 Median: 1.7358 Max: 6857 Percentiles: P50: 1.74 P75: 2.52 P99: 116.56 P99.9: 968.93 P99.99: 2136.98 ------------------------------------------------------ [ 0, 1 ] 6256 6.587% 6.587% # ( 1, 2 ] 56035 59.000% 65.587% ############ ( 2, 3 ] 17034 17.935% 83.523% #### ( 3, 4 ] 6939 7.306% 90.829% # ( 4, 6 ] 5792 6.099% 96.928% # ( 6, 10 ] 1437 1.513% 98.441% ( 10, 15 ] 409 0.431% 98.871% ( 15, 22 ] 70 0.074% 98.945% ( 22, 34 ] 18 0.019% 98.964% ( 34, 51 ] 3 0.003% 98.967% ( 76, 110 ] 13 0.014% 98.981% ( 110, 170 ] 167 0.176% 99.157% ( 170, 250 ] 194 0.204% 99.361% ( 250, 380 ] 195 0.205% 99.566% ( 380, 580 ] 186 0.196% 99.762% ( 580, 870 ] 114 0.120% 99.882% ( 870, 1300 ] 74 0.078% 99.960% ( 1300, 1900 ] 24 0.025% 99.985% ( 1900, 2900 ] 19 0.020% 100.005% ( 2900, 4400 ] 16 0.017% 100.022% ( 4400, 6600 ] 10 0.011% 100.033% ( 6600, 9900 ] 2 0.002% 100.035% ** Level 4 read latency histogram (micros): Count: 130 Average: 1260.4846 StdDev: 2090.85 Min: 1 Median: 15.0000 Max: 8668 Percentiles: P50: 15.00 P75: 1800.00 P99: 8668.00 P99.9: 8668.00 P99.99: 8668.00 ------------------------------------------------------ [ 0, 1 ] 16 12.308% 12.308% ## ( 1, 2 ] 25 19.231% 31.538% #### ( 2, 3 ] 12 9.231% 40.769% ## ( 3, 4 ] 7 5.385% 46.154% # ( 4, 6 ] 4 3.077% 49.231% # ( 10, 15 ] 1 0.769% 50.000% ( 15, 22 ] 1 0.769% 50.769% ( 110, 170 ] 4 3.077% 53.846% # ( 170, 250 ] 7 5.385% 59.231% # ( 250, 380 ] 4 3.077% 62.308% # ( 380, 580 ] 3 2.308% 64.615% ( 580, 870 ] 7 5.385% 70.000% # ( 870, 1300 ] 4 3.077% 73.077% # ( 1300, 1900 ] 3 2.308% 75.385% ( 1900, 2900 ] 6 4.615% 80.000% # ( 2900, 4400 ] 12 9.231% 89.231% ## ( 4400, 6600 ] 9 6.923% 96.154% # ( 6600, 9900 ] 5 3.846% 100.000% # ** Level 5 read latency histogram (micros): Count: 100 Average: 894.7300 StdDev: 991.47 Min: 87 Median: 456.9231 Max: 3819 Percentiles: P50: 456.92 P75: 1300.00 P99: 3819.00 P99.9: 3819.00 P99.99: 3819.00 ------------------------------------------------------ ( 76, 110 ] 7 7.000% 7.000% # ( 110, 170 ] 23 23.000% 30.000% ##### ( 170, 250 ] 9 9.000% 39.000% ## ( 250, 380 ] 6 6.000% 45.000% # ( 380, 580 ] 13 13.000% 58.000% ### ( 580, 870 ] 10 10.000% 68.000% ## ( 870, 1300 ] 7 7.000% 75.000% # ( 1300, 1900 ] 6 6.000% 81.000% # ( 1900, 2900 ] 13 13.000% 94.000% ### ( 2900, 4400 ] 6 6.000% 100.000% # ** DB Stats ** Uptime(secs): 27.0 total, 8.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 218.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.830 H:M:S, 40.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 113.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.722 H:M:S, 66.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-05:12:54 ... thread 0: (1000000,7000000) ops and (332266.9,234741.0) ops/second in (3.009629,29.820105) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.88 GB 75.5 6.2 0.0 6.2 12.7 6.6 0.0 1.9 145.8 301.7 43.19 40.39 116 0.372 6395K 9843 0.0 0.0 L1 14/14 1.52 GB 0.0 3.4 3.4 0.0 3.4 3.4 0.2 1.0 227.9 224.9 15.48 14.88 2 7.738 3581K 47K 0.0 0.0 L2 2/0 54.77 MB 0.5 0.4 0.2 0.2 0.4 0.2 2.0 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 208 0.0 0.0 L3 14/0 926.29 MB 0.9 0.8 0.6 0.2 0.8 0.6 1.6 1.4 201.7 201.5 3.95 3.51 3 1.316 808K 818 0.0 0.0 L4 167/0 9.76 GB 1.0 0.8 0.6 0.1 0.8 0.6 1.3 1.2 168.6 167.8 4.70 3.67 5 0.939 773K 3371 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1274/23 102.66 GB 0.0 11.5 4.8 6.7 18.0 11.3 6.8 2.7 171.4 268.4 68.80 63.90 128 0.538 11M 61K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.5 4.8 6.7 18.0 11.3 6.7 2.7 171.4 268.4 68.80 63.90 128 0.538 11M 61K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.5 4.8 6.7 11.5 4.8 0.0 0.0 238.3 237.0 49.48 46.91 32 1.546 11M 61K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 348.9 19.32 16.99 96 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.1 total, 29.8 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.04 GB write, 614.58 MB/s write, 11.52 GB read, 392.38 MB/s read, 68.8 seconds Interval compaction: 18.04 GB write, 619.36 MB/s write, 11.52 GB read, 395.43 MB/s read, 68.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 26, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2778538 Average: 2.3116 StdDev: 13.01 Min: 0 Median: 1.4725 Max: 4923 Percentiles: P50: 1.47 P75: 1.84 P99: 5.90 P99.9: 14.16 P99.99: 176.69 ------------------------------------------------------ [ 0, 1 ] 501159 18.037% 18.037% #### ( 1, 2 ] 1879622 67.648% 85.685% ############## ( 2, 3 ] 241297 8.684% 94.369% ## ( 3, 4 ] 76796 2.764% 97.133% # ( 4, 6 ] 54537 1.963% 99.096% ( 6, 10 ] 19991 0.719% 99.815% ( 10, 15 ] 2836 0.102% 99.917% ( 15, 22 ] 284 0.010% 99.927% ( 22, 34 ] 28 0.001% 99.928% ( 34, 51 ] 9 0.000% 99.929% ( 51, 76 ] 28 0.001% 99.930% ( 76, 110 ] 719 0.026% 99.956% ( 110, 170 ] 932 0.034% 99.989% ( 170, 250 ] 265 0.010% 99.999% ( 250, 380 ] 194 0.007% 100.006% ( 380, 580 ] 187 0.007% 100.012% ( 580, 870 ] 118 0.004% 100.017% ( 870, 1300 ] 68 0.002% 100.019% ( 1300, 1900 ] 24 0.001% 100.020% ( 1900, 2900 ] 14 0.001% 100.021% ( 2900, 4400 ] 7 0.000% 100.021% ( 4400, 6600 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 245014 Average: 3.5343 StdDev: 34.90 Min: 1 Median: 1.8365 Max: 5497 Percentiles: P50: 1.84 P75: 2.74 P99: 8.50 P99.9: 13.55 P99.99: 14.85 ------------------------------------------------------ [ 0, 1 ] 9444 3.854% 3.854% # ( 1, 2 ] 135157 55.163% 59.017% ########### ( 2, 3 ] 52754 21.531% 80.548% #### ( 3, 4 ] 19755 8.063% 88.611% ## ( 4, 6 ] 22782 9.298% 97.910% ## ( 6, 10 ] 4276 1.745% 99.655% ( 10, 15 ] 847 0.346% 100.000% ( 15, 22 ] 110 0.045% 100.045% ( 22, 34 ] 11 0.004% 100.050% ( 34, 51 ] 1 0.000% 100.050% ( 51, 76 ] 3 0.001% 100.051% ( 76, 110 ] 19 0.008% 100.059% ( 110, 170 ] 50 0.020% 100.080% ( 170, 250 ] 33 0.013% 100.093% ( 250, 380 ] 43 0.018% 100.111% ( 380, 580 ] 47 0.019% 100.130% ( 580, 870 ] 31 0.013% 100.142% ( 870, 1300 ] 37 0.015% 100.158% ( 1300, 1900 ] 5 0.002% 100.160% ( 1900, 2900 ] 11 0.004% 100.164% ( 2900, 4400 ] 9 0.004% 100.168% ( 4400, 6600 ] 2 0.001% 100.169% ** Level 2 read latency histogram (micros): Count: 95423 Average: 2.0568 StdDev: 5.14 Min: 0 Median: 1.4235 Max: 1041 Percentiles: P50: 1.42 P75: 1.82 P99: 5.66 P99.9: 10.67 P99.99: 30.75 ------------------------------------------------------ [ 0, 1 ] 22092 23.152% 23.152% ##### ( 1, 2 ] 60496 63.398% 86.549% ############# ( 2, 3 ] 7083 7.423% 93.972% # ( 3, 4 ] 2913 3.053% 97.025% # ( 4, 6 ] 2268 2.377% 99.402% ( 6, 10 ] 465 0.487% 99.889% ( 10, 15 ] 79 0.083% 99.972% ( 15, 22 ] 16 0.017% 99.988% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 51, 76 ] 2 0.002% 99.994% ( 250, 380 ] 4 0.004% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 94974 Average: 8.6722 StdDev: 100.50 Min: 0 Median: 1.7358 Max: 6857 Percentiles: P50: 1.74 P75: 2.52 P99: 116.56 P99.9: 968.93 P99.99: 2136.98 ------------------------------------------------------ [ 0, 1 ] 6256 6.587% 6.587% # ( 1, 2 ] 56035 59.000% 65.587% ############ ( 2, 3 ] 17034 17.935% 83.523% #### ( 3, 4 ] 6939 7.306% 90.829% # ( 4, 6 ] 5792 6.099% 96.928% # ( 6, 10 ] 1437 1.513% 98.441% ( 10, 15 ] 409 0.431% 98.871% ( 15, 22 ] 70 0.074% 98.945% ( 22, 34 ] 18 0.019% 98.964% ( 34, 51 ] 3 0.003% 98.967% ( 76, 110 ] 13 0.014% 98.981% ( 110, 170 ] 167 0.176% 99.157% ( 170, 250 ] 194 0.204% 99.361% ( 250, 380 ] 195 0.205% 99.566% ( 380, 580 ] 186 0.196% 99.762% ( 580, 870 ] 114 0.120% 99.882% ( 870, 1300 ] 74 0.078% 99.960% ( 1300, 1900 ] 24 0.025% 99.985% ( 1900, 2900 ] 19 0.020% 100.005% ( 2900, 4400 ] 16 0.017% 100.022% ( 4400, 6600 ] 10 0.011% 100.033% ( 6600, 9900 ] 2 0.002% 100.035% ** Level 4 read latency histogram (micros): Count: 130 Average: 1260.4846 StdDev: 2090.85 Min: 1 Median: 15.0000 Max: 8668 Percentiles: P50: 15.00 P75: 1800.00 P99: 8668.00 P99.9: 8668.00 P99.99: 8668.00 ------------------------------------------------------ [ 0, 1 ] 16 12.308% 12.308% ## ( 1, 2 ] 25 19.231% 31.538% #### ( 2, 3 ] 12 9.231% 40.769% ## ( 3, 4 ] 7 5.385% 46.154% # ( 4, 6 ] 4 3.077% 49.231% # ( 10, 15 ] 1 0.769% 50.000% ( 15, 22 ] 1 0.769% 50.769% ( 110, 170 ] 4 3.077% 53.846% # ( 170, 250 ] 7 5.385% 59.231% # ( 250, 380 ] 4 3.077% 62.308% # ( 380, 580 ] 3 2.308% 64.615% ( 580, 870 ] 7 5.385% 70.000% # ( 870, 1300 ] 4 3.077% 73.077% # ( 1300, 1900 ] 3 2.308% 75.385% ( 1900, 2900 ] 6 4.615% 80.000% # ( 2900, 4400 ] 12 9.231% 89.231% ## ( 4400, 6600 ] 9 6.923% 96.154% # ( 6600, 9900 ] 5 3.846% 100.000% # ** Level 5 read latency histogram (micros): Count: 100 Average: 894.7300 StdDev: 991.47 Min: 87 Median: 456.9231 Max: 3819 Percentiles: P50: 456.92 P75: 1300.00 P99: 3819.00 P99.9: 3819.00 P99.99: 3819.00 ------------------------------------------------------ ( 76, 110 ] 7 7.000% 7.000% # ( 110, 170 ] 23 23.000% 30.000% ##### ( 170, 250 ] 9 9.000% 39.000% ## ( 250, 380 ] 6 6.000% 45.000% # ( 380, 580 ] 13 13.000% 58.000% ### ( 580, 870 ] 10 10.000% 68.000% ## ( 870, 1300 ] 7 7.000% 75.000% # ( 1300, 1900 ] 6 6.000% 81.000% # ( 1900, 2900 ] 13 13.000% 94.000% ### ( 2900, 4400 ] 6 6.000% 100.000% # ** DB Stats ** Uptime(secs): 30.1 total, 3.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 229.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.265 H:M:S, 37.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.435 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-05:13:08 ... thread 0: (1000000,8000000) ops and (72852.6,183711.9) ops/second in (13.726345,43.546450) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/6 2.09 GB 56.7 7.3 0.0 7.3 14.9 7.6 0.0 2.0 142.9 292.8 52.02 47.60 134 0.388 7546K 11K 0.0 0.0 L1 6/6 688.05 MB 0.0 6.8 5.3 1.5 6.7 5.2 0.2 1.3 227.5 224.6 30.64 29.18 3 10.213 6541K 47K 0.0 0.0 L2 8/5 954.32 MB 3.9 0.4 0.2 0.2 0.4 0.2 4.7 1.8 228.8 228.6 1.83 1.64 3 0.611 385K 208 0.0 0.0 L3 25/9 2.29 GB 1.2 0.8 0.6 0.2 0.8 0.6 3.3 1.4 186.9 186.7 4.49 3.72 4 1.123 852K 818 0.0 0.0 L4 171/11 10.13 GB 1.0 1.2 1.0 0.2 1.2 1.0 1.3 1.2 137.9 137.2 8.97 5.77 8 1.121 1225K 5894 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/37 103.66 GB 0.0 16.5 7.1 9.4 24.0 14.6 11.2 3.1 172.5 251.2 97.95 87.91 152 0.644 16M 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.5 7.1 9.4 24.0 14.6 11.1 3.1 172.5 251.2 97.95 87.91 152 0.644 16M 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.5 7.1 9.4 16.4 7.0 0.0 0.0 227.4 226.0 74.30 68.07 42 1.769 16M 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 330.4 23.64 19.85 110 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.8 total, 43.5 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.02 GB write, 561.92 MB/s write, 16.50 GB read, 385.94 MB/s read, 97.9 seconds Interval compaction: 24.02 GB write, 564.91 MB/s write, 16.50 GB read, 388.00 MB/s read, 97.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 34, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3593534 Average: 2.4768 StdDev: 14.39 Min: 0 Median: 1.4920 Max: 4923 Percentiles: P50: 1.49 P75: 1.86 P99: 6.67 P99.9: 107.66 P99.99: 242.87 ------------------------------------------------------ [ 0, 1 ] 609913 16.973% 16.973% ### ( 1, 2 ] 2412190 67.126% 84.098% ############# ( 2, 3 ] 335383 9.333% 93.431% ## ( 3, 4 ] 109648 3.051% 96.483% # ( 4, 6 ] 85291 2.373% 98.856% ( 6, 10 ] 30833 0.858% 99.714% ( 10, 15 ] 4384 0.122% 99.836% ( 15, 22 ] 546 0.015% 99.851% ( 22, 34 ] 37 0.001% 99.852% ( 34, 51 ] 14 0.000% 99.853% ( 51, 76 ] 46 0.001% 99.854% ( 76, 110 ] 1778 0.049% 99.903% ( 110, 170 ] 2587 0.072% 99.975% ( 170, 250 ] 576 0.016% 99.991% ( 250, 380 ] 383 0.011% 100.002% ( 380, 580 ] 336 0.009% 100.011% ( 580, 870 ] 174 0.005% 100.016% ( 870, 1300 ] 78 0.002% 100.018% ( 1300, 1900 ] 34 0.001% 100.019% ( 1900, 2900 ] 18 0.001% 100.020% ( 2900, 4400 ] 14 0.000% 100.020% ( 4400, 6600 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1076433 Average: 4.8373 StdDev: 78.42 Min: 1 Median: 1.7336 Max: 10851 Percentiles: P50: 1.73 P75: 2.61 P99: 9.24 P99.9: 76.03 P99.99: 147.64 ------------------------------------------------------ [ 0, 1 ] 109499 10.172% 10.172% ## ( 1, 2 ] 584392 54.290% 64.462% ########### ( 2, 3 ] 187049 17.377% 81.839% ### ( 3, 4 ] 76238 7.082% 88.921% # ( 4, 6 ] 89462 8.311% 97.232% ## ( 6, 10 ] 23484 2.182% 99.414% ( 10, 15 ] 4508 0.419% 99.833% ( 15, 22 ] 639 0.059% 99.892% ( 22, 34 ] 66 0.006% 99.898% ( 34, 51 ] 17 0.002% 99.900% ( 51, 76 ] 6 0.001% 99.900% ( 76, 110 ] 561 0.052% 99.952% ( 110, 170 ] 651 0.060% 100.013% ( 170, 250 ] 242 0.022% 100.035% ( 250, 380 ] 292 0.027% 100.063% ( 380, 580 ] 366 0.034% 100.097% ( 580, 870 ] 297 0.028% 100.124% ( 870, 1300 ] 204 0.019% 100.143% ( 1300, 1900 ] 71 0.007% 100.150% ( 1900, 2900 ] 129 0.012% 100.162% ( 2900, 4400 ] 159 0.015% 100.176% ( 4400, 6600 ] 54 0.005% 100.181% ( 6600, 9900 ] 27 0.003% 100.184% ( 9900, 14000 ] 1 0.000% 100.184% ** Level 2 read latency histogram (micros): Count: 106400 Average: 2.4523 StdDev: 16.98 Min: 0 Median: 1.4707 Max: 3276 Percentiles: P50: 1.47 P75: 1.87 P99: 5.90 P99.9: 14.63 P99.99: 782.03 ------------------------------------------------------ [ 0, 1 ] 22224 20.887% 20.887% #### ( 1, 2 ] 65805 61.847% 82.734% ############ ( 2, 3 ] 9855 9.262% 91.996% ## ( 3, 4 ] 3985 3.745% 95.742% # ( 4, 6 ] 3649 3.430% 99.171% # ( 6, 10 ] 659 0.619% 99.790% ( 10, 15 ] 126 0.118% 99.909% ( 15, 22 ] 20 0.019% 99.928% ( 22, 34 ] 2 0.002% 99.930% ( 34, 51 ] 1 0.001% 99.930% ( 51, 76 ] 2 0.002% 99.932% ( 76, 110 ] 1 0.001% 99.933% ( 110, 170 ] 3 0.003% 99.936% ( 170, 250 ] 15 0.014% 99.950% ( 250, 380 ] 18 0.017% 99.967% ( 380, 580 ] 16 0.015% 99.982% ( 580, 870 ] 12 0.011% 99.993% ( 870, 1300 ] 5 0.005% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 117612 Average: 14.6061 StdDev: 146.66 Min: 0 Median: 1.7845 Max: 7672 Percentiles: P50: 1.78 P75: 2.68 P99: 341.56 P99.9: 1808.83 P99.99: 3697.42 ------------------------------------------------------ [ 0, 1 ] 6880 5.850% 5.850% # ( 1, 2 ] 66186 56.275% 62.125% ########### ( 2, 3 ] 22206 18.881% 81.005% #### ( 3, 4 ] 9711 8.257% 89.262% ## ( 4, 6 ] 8050 6.845% 96.107% # ( 6, 10 ] 2083 1.771% 97.878% ( 10, 15 ] 561 0.477% 98.355% ( 15, 22 ] 97 0.082% 98.437% ( 22, 34 ] 18 0.015% 98.453% ( 34, 51 ] 6 0.005% 98.458% ( 76, 110 ] 14 0.012% 98.470% ( 110, 170 ] 179 0.152% 98.622% ( 170, 250 ] 235 0.200% 98.822% ( 250, 380 ] 298 0.253% 99.075% ( 380, 580 ] 367 0.312% 99.387% ( 580, 870 ] 313 0.266% 99.653% ( 870, 1300 ] 220 0.187% 99.840% ( 1300, 1900 ] 83 0.071% 99.911% ( 1900, 2900 ] 64 0.054% 99.965% ( 2900, 4400 ] 55 0.047% 100.012% ( 4400, 6600 ] 20 0.017% 100.029% ( 6600, 9900 ] 4 0.003% 100.032% ** Level 4 read latency histogram (micros): Count: 14439 Average: 15.4059 StdDev: 233.16 Min: 1 Median: 2.3919 Max: 8668 Percentiles: P50: 2.39 P75: 3.68 P99: 9.95 P99.9: 2970.13 P99.99: 4780.38 ------------------------------------------------------ [ 0, 1 ] 120 0.831% 0.831% ( 1, 2 ] 5545 38.403% 39.234% ######## ( 2, 3 ] 3967 27.474% 66.708% ##### ( 3, 4 ] 1769 12.252% 78.960% ## ( 4, 6 ] 2467 17.086% 96.045% ### ( 6, 10 ] 432 2.992% 99.037% # ( 10, 15 ] 61 0.422% 99.460% ( 15, 22 ] 8 0.055% 99.515% ( 76, 110 ] 3 0.021% 99.536% ( 110, 170 ] 4 0.028% 99.564% ( 170, 250 ] 13 0.090% 99.654% ( 250, 380 ] 4 0.028% 99.681% ( 380, 580 ] 3 0.021% 99.702% ( 580, 870 ] 8 0.055% 99.758% ( 870, 1300 ] 8 0.055% 99.813% ( 1300, 1900 ] 5 0.035% 99.848% ( 1900, 2900 ] 7 0.048% 99.896% ( 2900, 4400 ] 12 0.083% 99.979% ( 4400, 6600 ] 9 0.062% 100.042% ( 6600, 9900 ] 5 0.035% 100.076% ** Level 5 read latency histogram (micros): Count: 100 Average: 894.7300 StdDev: 991.47 Min: 87 Median: 456.9231 Max: 3819 Percentiles: P50: 456.92 P75: 1300.00 P99: 3819.00 P99.9: 3819.00 P99.99: 3819.00 ------------------------------------------------------ ( 76, 110 ] 7 7.000% 7.000% # ( 110, 170 ] 23 23.000% 30.000% ##### ( 170, 250 ] 9 9.000% 39.000% ## ( 250, 380 ] 6 6.000% 45.000% # ( 380, 580 ] 13 13.000% 58.000% ### ( 580, 870 ] 10 10.000% 68.000% ## ( 870, 1300 ] 7 7.000% 75.000% # ( 1300, 1900 ] 6 6.000% 81.000% # ( 1900, 2900 ] 13 13.000% 94.000% ### ( 2900, 4400 ] 6 6.000% 100.000% # ** DB Stats ** Uptime(secs): 43.8 total, 13.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 179.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.861 H:M:S, 49.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 71.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.595 H:M:S, 77.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/20-05:13:13 ... thread 0: (1000000,9000000) ops and (171848.6,182313.5) ops/second in (5.819075,49.365525) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.94 GB 6.3 9.2 0.0 9.2 17.6 8.5 0.0 2.1 138.5 266.5 67.76 58.03 146 0.464 9527K 21K 0.0 0.0 L1 0/0 0.00 KB 0.0 6.8 5.3 1.5 6.7 5.2 0.2 1.3 227.5 224.6 30.64 29.18 3 10.213 6541K 47K 0.0 0.0 L2 1/0 34.08 MB 0.3 1.1 0.9 0.2 1.1 0.9 4.7 1.3 148.7 148.3 7.80 5.15 4 1.951 439K 208 0.0 0.0 L3 23/3 1.32 GB 1.0 3.2 1.8 1.4 3.1 1.8 3.7 1.8 136.1 135.3 23.80 14.92 15 1.587 3289K 19K 0.0 0.0 L4 166/12 10.06 GB 1.0 4.3 3.5 0.8 4.2 3.5 1.3 1.2 128.6 127.9 33.92 20.42 37 0.917 4319K 18K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/26 104.47 GB 0.0 24.5 11.4 13.1 32.9 19.8 14.2 3.9 153.2 205.3 163.92 127.72 205 0.800 24M 106K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.5 11.4 13.1 32.9 19.8 14.1 3.9 153.2 205.3 163.92 127.72 205 0.800 24M 106K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.5 11.4 13.1 24.4 11.3 0.0 0.0 185.9 184.8 135.08 105.42 85 1.589 24M 106K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 301.4 28.85 22.30 120 0.240 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.6 total, 49.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.86 GB write, 678.48 MB/s write, 24.53 GB read, 506.34 MB/s read, 163.9 seconds Interval compaction: 32.86 GB write, 681.67 MB/s write, 24.53 GB read, 508.72 MB/s read, 163.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 74, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 74, interval: 98 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3912629 Average: 2.7714 StdDev: 27.75 Min: 0 Median: 1.5207 Max: 7537 Percentiles: P50: 1.52 P75: 1.90 P99: 7.39 P99.9: 116.41 P99.99: 453.38 ------------------------------------------------------ [ 0, 1 ] 618795 15.815% 15.815% ### ( 1, 2 ] 2568638 65.650% 81.465% ############# ( 2, 3 ] 408926 10.451% 91.917% ## ( 3, 4 ] 139699 3.570% 95.487% # ( 4, 6 ] 123758 3.163% 98.650% # ( 6, 10 ] 39478 1.009% 99.659% ( 10, 15 ] 6488 0.166% 99.825% ( 15, 22 ] 761 0.019% 99.844% ( 22, 34 ] 53 0.001% 99.846% ( 34, 51 ] 19 0.000% 99.846% ( 51, 76 ] 47 0.001% 99.847% ( 76, 110 ] 1778 0.045% 99.893% ( 110, 170 ] 2597 0.066% 99.959% ( 170, 250 ] 598 0.015% 99.975% ( 250, 380 ] 439 0.011% 99.986% ( 380, 580 ] 449 0.011% 99.997% ( 580, 870 ] 347 0.009% 100.006% ( 870, 1300 ] 232 0.006% 100.012% ( 1300, 1900 ] 110 0.003% 100.015% ( 1900, 2900 ] 80 0.002% 100.017% ( 2900, 4400 ] 79 0.002% 100.019% ( 4400, 6600 ] 22 0.001% 100.020% ( 6600, 9900 ] 2 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1697591 Average: 6.5243 StdDev: 106.85 Min: 1 Median: 1.8468 Max: 11279 Percentiles: P50: 1.85 P75: 2.83 P99: 9.68 P99.9: 97.04 P99.99: 349.13 ------------------------------------------------------ [ 0, 1 ] 116783 6.879% 6.879% # ( 1, 2 ] 864428 50.921% 57.800% ########## ( 2, 3 ] 349775 20.604% 78.404% #### ( 3, 4 ] 140800 8.294% 86.699% ## ( 4, 6 ] 169585 9.990% 96.688% ## ( 6, 10 ] 42668 2.513% 99.202% # ( 10, 15 ] 10070 0.593% 99.795% ( 15, 22 ] 1260 0.074% 99.869% ( 22, 34 ] 122 0.007% 99.876% ( 34, 51 ] 33 0.002% 99.878% ( 51, 76 ] 17 0.001% 99.879% ( 76, 110 ] 571 0.034% 99.913% ( 110, 170 ] 682 0.040% 99.953% ( 170, 250 ] 295 0.017% 99.970% ( 250, 380 ] 437 0.026% 99.996% ( 380, 580 ] 661 0.039% 100.035% ( 580, 870 ] 668 0.039% 100.074% ( 870, 1300 ] 492 0.029% 100.103% ( 1300, 1900 ] 281 0.017% 100.120% ( 1900, 2900 ] 389 0.023% 100.143% ( 2900, 4400 ] 525 0.031% 100.174% ( 4400, 6600 ] 164 0.010% 100.183% ( 6600, 9900 ] 64 0.004% 100.187% ( 9900, 14000 ] 3 0.000% 100.187% ** Level 2 read latency histogram (micros): Count: 251952 Average: 5.3743 StdDev: 80.94 Min: 0 Median: 1.7733 Max: 7618 Percentiles: P50: 1.77 P75: 2.67 P99: 9.14 P99.9: 297.18 P99.99: 869.46 ------------------------------------------------------ [ 0, 1 ] 23480 9.319% 9.319% ## ( 1, 2 ] 132541 52.606% 61.925% ########### ( 2, 3 ] 48809 19.372% 81.297% #### ( 3, 4 ] 19194 7.618% 88.915% ## ( 4, 6 ] 21933 8.705% 97.621% ## ( 6, 10 ] 4421 1.755% 99.375% ( 10, 15 ] 1094 0.434% 99.809% ( 15, 22 ] 138 0.055% 99.864% ( 22, 34 ] 8 0.003% 99.867% ( 34, 51 ] 6 0.002% 99.870% ( 51, 76 ] 4 0.002% 99.871% ( 76, 110 ] 5 0.002% 99.873% ( 110, 170 ] 10 0.004% 99.877% ( 170, 250 ] 36 0.014% 99.892% ( 250, 380 ] 58 0.023% 99.915% ( 380, 580 ] 85 0.034% 99.948% ( 580, 870 ] 105 0.042% 99.990% ( 870, 1300 ] 70 0.028% 100.018% ( 1300, 1900 ] 48 0.019% 100.037% ( 1900, 2900 ] 59 0.023% 100.060% ( 2900, 4400 ] 53 0.021% 100.081% ( 4400, 6600 ] 7 0.003% 100.084% ( 6600, 9900 ] 3 0.001% 100.085% ** Level 3 read latency histogram (micros): Count: 620103 Average: 10.5206 StdDev: 127.60 Min: 0 Median: 1.9965 Max: 10942 Percentiles: P50: 2.00 P75: 3.04 P99: 11.37 P99.9: 1070.50 P99.99: 1534.48 ------------------------------------------------------ [ 0, 1 ] 14174 2.286% 2.286% ( 1, 2 ] 296911 47.881% 50.167% ########## ( 2, 3 ] 151207 24.384% 74.551% ##### ( 3, 4 ] 64483 10.399% 84.950% ## ( 4, 6 ] 72759 11.733% 96.683% ## ( 6, 10 ] 13565 2.188% 98.871% ( 10, 15 ] 2930 0.473% 99.343% ( 15, 22 ] 349 0.056% 99.399% ( 22, 34 ] 39 0.006% 99.406% ( 34, 51 ] 11 0.002% 99.407% ( 76, 110 ] 18 0.003% 99.410% ( 110, 170 ] 235 0.038% 99.448% ( 170, 250 ] 353 0.057% 99.505% ( 250, 380 ] 518 0.084% 99.589% ( 380, 580 ] 742 0.120% 99.708% ( 580, 870 ] 828 0.134% 99.842% ( 870, 1300 ] 774 0.125% 99.967% ( 1300, 1900 ] 371 0.060% 100.026% ( 1900, 2900 ] 253 0.041% 100.067% ( 2900, 4400 ] 284 0.046% 100.113% ( 4400, 6600 ] 75 0.012% 100.125% ( 6600, 9900 ] 10 0.002% 100.127% ( 9900, 14000 ] 1 0.000% 100.127% ** Level 4 read latency histogram (micros): Count: 117586 Average: 15.1421 StdDev: 170.76 Min: 1 Median: 2.1231 Max: 8668 Percentiles: P50: 2.12 P75: 3.23 P99: 181.02 P99.9: 2310.30 P99.99: 3970.63 ------------------------------------------------------ [ 0, 1 ] 1270 1.080% 1.080% ( 1, 2 ] 53774 45.732% 46.812% ######### ( 2, 3 ] 30456 25.901% 72.713% ##### ( 3, 4 ] 11889 10.111% 82.824% ## ( 4, 6 ] 14657 12.465% 95.289% ## ( 6, 10 ] 3240 2.755% 98.044% # ( 10, 15 ] 851 0.724% 98.768% ( 15, 22 ] 106 0.090% 98.858% ( 22, 34 ] 13 0.011% 98.869% ( 34, 51 ] 6 0.005% 98.874% ( 51, 76 ] 6 0.005% 98.879% ( 76, 110 ] 23 0.020% 98.899% ( 110, 170 ] 97 0.082% 98.981% ( 170, 250 ] 168 0.143% 99.124% ( 250, 380 ] 136 0.116% 99.240% ( 380, 580 ] 232 0.197% 99.437% ( 580, 870 ] 226 0.192% 99.629% ( 870, 1300 ] 181 0.154% 99.783% ( 1300, 1900 ] 106 0.090% 99.873% ( 1900, 2900 ] 79 0.067% 99.940% ( 2900, 4400 ] 83 0.071% 100.011% ( 4400, 6600 ] 29 0.025% 100.036% ( 6600, 9900 ] 8 0.007% 100.043% ** Level 5 read latency histogram (micros): Count: 260 Average: 1729.1038 StdDev: 1812.76 Min: 87 Median: 862.9268 Max: 7651 Percentiles: P50: 862.93 P75: 2666.67 P99: 7651.00 P99.9: 7651.00 P99.99: 7651.00 ------------------------------------------------------ ( 76, 110 ] 7 2.692% 2.692% # ( 110, 170 ] 27 10.385% 13.077% ## ( 170, 250 ] 10 3.846% 16.923% # ( 250, 380 ] 21 8.077% 25.000% ## ( 380, 580 ] 25 9.615% 34.615% ## ( 580, 870 ] 41 15.769% 50.385% ### ( 870, 1300 ] 23 8.846% 59.231% ## ( 1300, 1900 ] 18 6.923% 66.154% # ( 1900, 2900 ] 30 11.538% 77.692% ## ( 2900, 4400 ] 30 11.538% 89.231% ## ( 4400, 6600 ] 24 9.231% 98.462% ## ( 6600, 9900 ] 4 1.538% 100.000% ** DB Stats ** Uptime(secs): 49.6 total, 5.8 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 178.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.744 H:M:S, 49.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 169.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.883 H:M:S, 49.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/20-05:13:17 ... thread 0: (1000000,10000000) ops and (296425.1,189612.8) ops/second in (3.373533,52.739058) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 3.98 GB 125.8 10.1 0.0 10.1 19.7 9.5 0.0 2.1 138.7 268.7 74.93 64.71 163 0.460 10M 23K 0.0 0.0 L1 0/0 0.00 KB 0.0 6.8 5.3 1.5 6.7 5.2 0.2 1.3 227.5 224.6 30.64 29.18 3 10.213 6541K 47K 0.0 0.0 L2 1/0 34.08 MB 0.3 1.1 0.9 0.2 1.1 0.9 4.7 1.3 148.7 148.3 7.80 5.15 4 1.951 439K 208 0.0 0.0 L3 20/0 962.71 MB 1.0 3.2 1.8 1.4 3.1 1.8 3.7 1.8 136.1 135.3 23.80 14.92 15 1.587 3289K 19K 0.0 0.0 L4 161/0 9.76 GB 1.0 5.0 3.9 1.2 5.0 3.8 1.3 1.3 132.9 132.3 38.56 23.98 40 0.964 5095K 20K 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1303/11 105.52 GB 0.0 26.3 11.8 14.4 35.6 21.2 14.9 3.7 153.0 207.7 175.73 137.94 225 0.781 25M 110K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.3 11.8 14.4 35.6 21.2 14.7 3.7 153.0 207.7 175.73 137.94 225 0.781 25M 110K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.3 11.8 14.4 26.1 11.7 0.0 0.0 187.1 186.0 143.68 112.83 91 1.579 25M 110K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 304.6 32.05 25.11 134 0.239 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.0 total, 52.7 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.63 GB write, 688.86 MB/s write, 26.26 GB read, 507.53 MB/s read, 175.7 seconds Interval compaction: 35.63 GB write, 691.88 MB/s write, 26.26 GB read, 509.76 MB/s read, 175.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 86, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 86, interval: 110 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4380080 Average: 2.7533 StdDev: 26.62 Min: 0 Median: 1.5327 Max: 7537 Percentiles: P50: 1.53 P75: 1.91 P99: 7.33 P99.9: 106.79 P99.99: 374.64 ------------------------------------------------------ [ 0, 1 ] 658963 15.045% 15.045% ### ( 1, 2 ] 2874231 65.621% 80.665% ############# ( 2, 3 ] 485747 11.090% 91.755% ## ( 3, 4 ] 159815 3.649% 95.404% # ( 4, 6 ] 142815 3.261% 98.664% # ( 6, 10 ] 44265 1.011% 99.675% ( 10, 15 ] 7267 0.166% 99.841% ( 15, 22 ] 841 0.019% 99.860% ( 22, 34 ] 57 0.001% 99.861% ( 34, 51 ] 21 0.000% 99.862% ( 51, 76 ] 50 0.001% 99.863% ( 76, 110 ] 1799 0.041% 99.904% ( 110, 170 ] 2670 0.061% 99.965% ( 170, 250 ] 637 0.015% 99.979% ( 250, 380 ] 485 0.011% 99.990% ( 380, 580 ] 486 0.011% 100.002% ( 580, 870 ] 374 0.009% 100.010% ( 870, 1300 ] 241 0.006% 100.016% ( 1300, 1900 ] 117 0.003% 100.018% ( 1900, 2900 ] 85 0.002% 100.020% ( 2900, 4400 ] 80 0.002% 100.022% ( 4400, 6600 ] 22 0.001% 100.023% ( 6600, 9900 ] 2 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1707197 Average: 6.5063 StdDev: 106.56 Min: 1 Median: 1.8476 Max: 11279 Percentiles: P50: 1.85 P75: 2.84 P99: 9.68 P99.9: 96.41 P99.99: 348.33 ------------------------------------------------------ [ 0, 1 ] 116894 6.847% 6.847% # ( 1, 2 ] 869146 50.911% 57.758% ########## ( 2, 3 ] 352129 20.626% 78.384% #### ( 3, 4 ] 141811 8.307% 86.691% ## ( 4, 6 ] 170645 9.996% 96.686% ## ( 6, 10 ] 42944 2.515% 99.202% # ( 10, 15 ] 10135 0.594% 99.795% ( 15, 22 ] 1270 0.074% 99.870% ( 22, 34 ] 123 0.007% 99.877% ( 34, 51 ] 33 0.002% 99.879% ( 51, 76 ] 17 0.001% 99.880% ( 76, 110 ] 571 0.033% 99.913% ( 110, 170 ] 682 0.040% 99.953% ( 170, 250 ] 295 0.017% 99.971% ( 250, 380 ] 438 0.026% 99.996% ( 380, 580 ] 662 0.039% 100.035% ( 580, 870 ] 668 0.039% 100.074% ( 870, 1300 ] 492 0.029% 100.103% ( 1300, 1900 ] 282 0.017% 100.119% ( 1900, 2900 ] 389 0.023% 100.142% ( 2900, 4400 ] 525 0.031% 100.173% ( 4400, 6600 ] 164 0.010% 100.183% ( 6600, 9900 ] 64 0.004% 100.186% ( 9900, 14000 ] 3 0.000% 100.187% ** Level 2 read latency histogram (micros): Count: 251952 Average: 5.3743 StdDev: 80.94 Min: 0 Median: 1.7733 Max: 7618 Percentiles: P50: 1.77 P75: 2.67 P99: 9.14 P99.9: 297.18 P99.99: 869.46 ------------------------------------------------------ [ 0, 1 ] 23480 9.319% 9.319% ## ( 1, 2 ] 132541 52.606% 61.925% ########### ( 2, 3 ] 48809 19.372% 81.297% #### ( 3, 4 ] 19194 7.618% 88.915% ## ( 4, 6 ] 21933 8.705% 97.621% ## ( 6, 10 ] 4421 1.755% 99.375% ( 10, 15 ] 1094 0.434% 99.809% ( 15, 22 ] 138 0.055% 99.864% ( 22, 34 ] 8 0.003% 99.867% ( 34, 51 ] 6 0.002% 99.870% ( 51, 76 ] 4 0.002% 99.871% ( 76, 110 ] 5 0.002% 99.873% ( 110, 170 ] 10 0.004% 99.877% ( 170, 250 ] 36 0.014% 99.892% ( 250, 380 ] 58 0.023% 99.915% ( 380, 580 ] 85 0.034% 99.948% ( 580, 870 ] 105 0.042% 99.990% ( 870, 1300 ] 70 0.028% 100.018% ( 1300, 1900 ] 48 0.019% 100.037% ( 1900, 2900 ] 59 0.023% 100.060% ( 2900, 4400 ] 53 0.021% 100.081% ( 4400, 6600 ] 7 0.003% 100.084% ( 6600, 9900 ] 3 0.001% 100.085% ** Level 3 read latency histogram (micros): Count: 621009 Average: 10.5093 StdDev: 127.51 Min: 0 Median: 1.9962 Max: 10942 Percentiles: P50: 2.00 P75: 3.04 P99: 11.36 P99.9: 1070.00 P99.99: 1534.34 ------------------------------------------------------ [ 0, 1 ] 14208 2.288% 2.288% ( 1, 2 ] 297420 47.893% 50.181% ########## ( 2, 3 ] 151398 24.379% 74.560% ##### ( 3, 4 ] 64567 10.397% 84.957% ## ( 4, 6 ] 72817 11.726% 96.683% ## ( 6, 10 ] 13592 2.189% 98.872% ( 10, 15 ] 2933 0.472% 99.344% ( 15, 22 ] 349 0.056% 99.400% ( 22, 34 ] 39 0.006% 99.406% ( 34, 51 ] 11 0.002% 99.408% ( 76, 110 ] 18 0.003% 99.411% ( 110, 170 ] 235 0.038% 99.449% ( 170, 250 ] 353 0.057% 99.506% ( 250, 380 ] 518 0.083% 99.589% ( 380, 580 ] 742 0.119% 99.709% ( 580, 870 ] 828 0.133% 99.842% ( 870, 1300 ] 774 0.125% 99.967% ( 1300, 1900 ] 371 0.060% 100.026% ( 1900, 2900 ] 253 0.041% 100.067% ( 2900, 4400 ] 284 0.046% 100.113% ( 4400, 6600 ] 75 0.012% 100.125% ( 6600, 9900 ] 10 0.002% 100.127% ( 9900, 14000 ] 1 0.000% 100.127% ** Level 4 read latency histogram (micros): Count: 161881 Average: 12.2041 StdDev: 146.79 Min: 1 Median: 2.0327 Max: 8668 Percentiles: P50: 2.03 P75: 3.03 P99: 14.67 P99.9: 1597.94 P99.99: 3059.25 ------------------------------------------------------ [ 0, 1 ] 1889 1.167% 1.167% ( 1, 2 ] 77699 47.998% 49.165% ########## ( 2, 3 ] 41329 25.530% 74.695% ##### ( 3, 4 ] 15503 9.577% 84.272% ## ( 4, 6 ] 18464 11.406% 95.678% ## ( 6, 10 ] 4307 2.661% 98.338% # ( 10, 15 ] 1148 0.709% 99.047% ( 15, 22 ] 125 0.077% 99.125% ( 22, 34 ] 13 0.008% 99.133% ( 34, 51 ] 7 0.004% 99.137% ( 51, 76 ] 6 0.004% 99.141% ( 76, 110 ] 23 0.014% 99.155% ( 110, 170 ] 100 0.062% 99.217% ( 170, 250 ] 193 0.119% 99.336% ( 250, 380 ] 154 0.095% 99.431% ( 380, 580 ] 255 0.158% 99.589% ( 580, 870 ] 258 0.159% 99.748% ( 870, 1300 ] 191 0.118% 99.866% ( 1300, 1900 ] 111 0.069% 99.935% ( 1900, 2900 ] 81 0.050% 99.985% ( 2900, 4400 ] 83 0.051% 100.036% ( 4400, 6600 ] 29 0.018% 100.054% ( 6600, 9900 ] 8 0.005% 100.059% ** Level 5 read latency histogram (micros): Count: 300 Average: 1654.6800 StdDev: 1769.37 Min: 87 Median: 849.2857 Max: 7651 Percentiles: P50: 849.29 P75: 2521.62 P99: 7425.00 P99.9: 7651.00 P99.99: 7651.00 ------------------------------------------------------ ( 76, 110 ] 8 2.667% 2.667% # ( 110, 170 ] 33 11.000% 13.667% ## ( 170, 250 ] 18 6.000% 19.667% # ( 250, 380 ] 23 7.667% 27.333% ## ( 380, 580 ] 29 9.667% 37.000% ## ( 580, 870 ] 42 14.000% 51.000% ### ( 870, 1300 ] 29 9.667% 60.667% ## ( 1300, 1900 ] 20 6.667% 67.333% # ( 1900, 2900 ] 37 12.333% 79.667% ## ( 2900, 4400 ] 31 10.333% 90.000% ## ( 4400, 6600 ] 26 8.667% 98.667% ## ( 6600, 9900 ] 4 1.333% 100.000% ** DB Stats ** Uptime(secs): 53.0 total, 3.4 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 185.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.446 H:M:S, 48.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 291.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.702 H:M:S, 20.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-05:13:20 ... thread 0: (1000000,11000000) ops and (283742.4,195509.0) ops/second in (3.524323,56.263381) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 4.91 GB 220.2 11.3 0.0 11.3 21.7 10.4 0.0 2.1 140.4 270.6 82.09 71.46 181 0.454 11M 24K 0.0 0.0 L1 0/0 0.00 KB 0.0 6.8 5.3 1.5 6.7 5.2 0.2 1.3 227.5 224.6 30.64 29.18 3 10.213 6541K 47K 0.0 0.0 L2 1/0 34.08 MB 0.3 1.1 0.9 0.2 1.1 0.9 4.7 1.3 148.7 148.3 7.80 5.15 4 1.951 439K 208 0.0 0.0 L3 20/0 962.71 MB 1.0 3.2 1.8 1.4 3.1 1.8 3.7 1.8 136.1 135.3 23.80 14.92 15 1.587 3289K 19K 0.0 0.0 L4 161/0 9.76 GB 1.0 5.0 3.9 1.2 5.0 3.8 1.3 1.3 132.9 132.3 38.56 23.98 40 0.964 5095K 20K 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/11 106.44 GB 0.0 27.4 11.8 15.5 37.7 22.1 14.9 3.6 153.2 210.9 182.89 144.69 243 0.753 27M 111K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.4 11.8 15.5 37.7 22.1 14.7 3.6 153.2 210.9 182.89 144.69 243 0.753 27M 111K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.4 11.8 15.5 27.2 11.7 0.0 0.0 189.2 188.1 148.07 117.12 95 1.559 27M 111K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 307.5 34.82 27.57 148 0.235 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.5 total, 56.3 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.66 GB write, 682.66 MB/s write, 27.36 GB read, 495.94 MB/s read, 182.9 seconds Interval compaction: 37.66 GB write, 685.47 MB/s write, 27.36 GB read, 497.98 MB/s read, 182.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 88, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 88, interval: 117 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4848083 Average: 2.7202 StdDev: 25.55 Min: 0 Median: 1.5379 Max: 7537 Percentiles: P50: 1.54 P75: 1.92 P99: 7.25 P99.9: 97.41 P99.99: 321.10 ------------------------------------------------------ [ 0, 1 ] 707273 14.589% 14.589% ### ( 1, 2 ] 3191518 65.831% 80.419% ############# ( 2, 3 ] 552809 11.403% 91.822% ## ( 3, 4 ] 176337 3.637% 95.459% # ( 4, 6 ] 156438 3.227% 98.686% # ( 6, 10 ] 48861 1.008% 99.694% ( 10, 15 ] 7812 0.161% 99.855% ( 15, 22 ] 896 0.018% 99.873% ( 22, 34 ] 60 0.001% 99.875% ( 34, 51 ] 25 0.001% 99.875% ( 51, 76 ] 53 0.001% 99.876% ( 76, 110 ] 1834 0.038% 99.914% ( 110, 170 ] 2735 0.056% 99.970% ( 170, 250 ] 673 0.014% 99.984% ( 250, 380 ] 505 0.010% 99.995% ( 380, 580 ] 503 0.010% 100.005% ( 580, 870 ] 388 0.008% 100.013% ( 870, 1300 ] 246 0.005% 100.018% ( 1300, 1900 ] 118 0.002% 100.021% ( 1900, 2900 ] 88 0.002% 100.022% ( 2900, 4400 ] 81 0.002% 100.024% ( 4400, 6600 ] 22 0.000% 100.025% ( 6600, 9900 ] 2 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1707197 Average: 6.5063 StdDev: 106.56 Min: 1 Median: 1.8476 Max: 11279 Percentiles: P50: 1.85 P75: 2.84 P99: 9.68 P99.9: 96.41 P99.99: 348.33 ------------------------------------------------------ [ 0, 1 ] 116894 6.847% 6.847% # ( 1, 2 ] 869146 50.911% 57.758% ########## ( 2, 3 ] 352129 20.626% 78.384% #### ( 3, 4 ] 141811 8.307% 86.691% ## ( 4, 6 ] 170645 9.996% 96.686% ## ( 6, 10 ] 42944 2.515% 99.202% # ( 10, 15 ] 10135 0.594% 99.795% ( 15, 22 ] 1270 0.074% 99.870% ( 22, 34 ] 123 0.007% 99.877% ( 34, 51 ] 33 0.002% 99.879% ( 51, 76 ] 17 0.001% 99.880% ( 76, 110 ] 571 0.033% 99.913% ( 110, 170 ] 682 0.040% 99.953% ( 170, 250 ] 295 0.017% 99.971% ( 250, 380 ] 438 0.026% 99.996% ( 380, 580 ] 662 0.039% 100.035% ( 580, 870 ] 668 0.039% 100.074% ( 870, 1300 ] 492 0.029% 100.103% ( 1300, 1900 ] 282 0.017% 100.119% ( 1900, 2900 ] 389 0.023% 100.142% ( 2900, 4400 ] 525 0.031% 100.173% ( 4400, 6600 ] 164 0.010% 100.183% ( 6600, 9900 ] 64 0.004% 100.186% ( 9900, 14000 ] 3 0.000% 100.187% ** Level 2 read latency histogram (micros): Count: 251952 Average: 5.3743 StdDev: 80.94 Min: 0 Median: 1.7733 Max: 7618 Percentiles: P50: 1.77 P75: 2.67 P99: 9.14 P99.9: 297.18 P99.99: 869.46 ------------------------------------------------------ [ 0, 1 ] 23480 9.319% 9.319% ## ( 1, 2 ] 132541 52.606% 61.925% ########### ( 2, 3 ] 48809 19.372% 81.297% #### ( 3, 4 ] 19194 7.618% 88.915% ## ( 4, 6 ] 21933 8.705% 97.621% ## ( 6, 10 ] 4421 1.755% 99.375% ( 10, 15 ] 1094 0.434% 99.809% ( 15, 22 ] 138 0.055% 99.864% ( 22, 34 ] 8 0.003% 99.867% ( 34, 51 ] 6 0.002% 99.870% ( 51, 76 ] 4 0.002% 99.871% ( 76, 110 ] 5 0.002% 99.873% ( 110, 170 ] 10 0.004% 99.877% ( 170, 250 ] 36 0.014% 99.892% ( 250, 380 ] 58 0.023% 99.915% ( 380, 580 ] 85 0.034% 99.948% ( 580, 870 ] 105 0.042% 99.990% ( 870, 1300 ] 70 0.028% 100.018% ( 1300, 1900 ] 48 0.019% 100.037% ( 1900, 2900 ] 59 0.023% 100.060% ( 2900, 4400 ] 53 0.021% 100.081% ( 4400, 6600 ] 7 0.003% 100.084% ( 6600, 9900 ] 3 0.001% 100.085% ** Level 3 read latency histogram (micros): Count: 621009 Average: 10.5093 StdDev: 127.51 Min: 0 Median: 1.9962 Max: 10942 Percentiles: P50: 2.00 P75: 3.04 P99: 11.36 P99.9: 1070.00 P99.99: 1534.34 ------------------------------------------------------ [ 0, 1 ] 14208 2.288% 2.288% ( 1, 2 ] 297420 47.893% 50.181% ########## ( 2, 3 ] 151398 24.379% 74.560% ##### ( 3, 4 ] 64567 10.397% 84.957% ## ( 4, 6 ] 72817 11.726% 96.683% ## ( 6, 10 ] 13592 2.189% 98.872% ( 10, 15 ] 2933 0.472% 99.344% ( 15, 22 ] 349 0.056% 99.400% ( 22, 34 ] 39 0.006% 99.406% ( 34, 51 ] 11 0.002% 99.408% ( 76, 110 ] 18 0.003% 99.411% ( 110, 170 ] 235 0.038% 99.449% ( 170, 250 ] 353 0.057% 99.506% ( 250, 380 ] 518 0.083% 99.589% ( 380, 580 ] 742 0.119% 99.709% ( 580, 870 ] 828 0.133% 99.842% ( 870, 1300 ] 774 0.125% 99.967% ( 1300, 1900 ] 371 0.060% 100.026% ( 1900, 2900 ] 253 0.041% 100.067% ( 2900, 4400 ] 284 0.046% 100.113% ( 4400, 6600 ] 75 0.012% 100.125% ( 6600, 9900 ] 10 0.002% 100.127% ( 9900, 14000 ] 1 0.000% 100.127% ** Level 4 read latency histogram (micros): Count: 161881 Average: 12.2041 StdDev: 146.79 Min: 1 Median: 2.0327 Max: 8668 Percentiles: P50: 2.03 P75: 3.03 P99: 14.67 P99.9: 1597.94 P99.99: 3059.25 ------------------------------------------------------ [ 0, 1 ] 1889 1.167% 1.167% ( 1, 2 ] 77699 47.998% 49.165% ########## ( 2, 3 ] 41329 25.530% 74.695% ##### ( 3, 4 ] 15503 9.577% 84.272% ## ( 4, 6 ] 18464 11.406% 95.678% ## ( 6, 10 ] 4307 2.661% 98.338% # ( 10, 15 ] 1148 0.709% 99.047% ( 15, 22 ] 125 0.077% 99.125% ( 22, 34 ] 13 0.008% 99.133% ( 34, 51 ] 7 0.004% 99.137% ( 51, 76 ] 6 0.004% 99.141% ( 76, 110 ] 23 0.014% 99.155% ( 110, 170 ] 100 0.062% 99.217% ( 170, 250 ] 193 0.119% 99.336% ( 250, 380 ] 154 0.095% 99.431% ( 380, 580 ] 255 0.158% 99.589% ( 580, 870 ] 258 0.159% 99.748% ( 870, 1300 ] 191 0.118% 99.866% ( 1300, 1900 ] 111 0.069% 99.935% ( 1900, 2900 ] 81 0.050% 99.985% ( 2900, 4400 ] 83 0.051% 100.036% ( 4400, 6600 ] 29 0.018% 100.054% ( 6600, 9900 ] 8 0.005% 100.059% ** Level 5 read latency histogram (micros): Count: 300 Average: 1654.6800 StdDev: 1769.37 Min: 87 Median: 849.2857 Max: 7651 Percentiles: P50: 849.29 P75: 2521.62 P99: 7425.00 P99.9: 7651.00 P99.99: 7651.00 ------------------------------------------------------ ( 76, 110 ] 8 2.667% 2.667% # ( 110, 170 ] 33 11.000% 13.667% ## ( 170, 250 ] 18 6.000% 19.667% # ( 250, 380 ] 23 7.667% 27.333% ## ( 380, 580 ] 29 9.667% 37.000% ## ( 580, 870 ] 42 14.000% 51.000% ### ( 870, 1300 ] 29 9.667% 60.667% ## ( 1300, 1900 ] 20 6.667% 67.333% # ( 1900, 2900 ] 37 12.333% 79.667% ## ( 2900, 4400 ] 31 10.333% 90.000% ## ( 4400, 6600 ] 26 8.667% 98.667% ## ( 6600, 9900 ] 4 1.333% 100.000% ** DB Stats ** Uptime(secs): 56.5 total, 3.5 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 191.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.305 H:M:S, 46.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 279.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.859 H:M:S, 24.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.428 micros/op 184222 ops/sec 60.014 seconds 11055999 operations; 178.5 MB/s Microseconds per write: Count: 11055999 Average: 5.4282 StdDev: 566.27 Min: 0 Median: 1.7249 Max: 994677 Percentiles: P50: 1.72 P75: 2.72 P99: 9.22 P99.9: 1062.66 P99.99: 2625.55 ------------------------------------------------------ [ 0, 1 ] 1584416 14.331% 14.331% ### ( 1, 2 ] 5440516 49.209% 63.540% ########## ( 2, 3 ] 1770626 16.015% 79.555% ### ( 3, 4 ] 1479598 13.383% 92.937% ### ( 4, 6 ] 563548 5.097% 98.035% # ( 6, 10 ] 132719 1.200% 99.235% ( 10, 15 ] 44186 0.400% 99.635% ( 15, 22 ] 10028 0.091% 99.725% ( 22, 34 ] 1897 0.017% 99.743% ( 34, 51 ] 238 0.002% 99.745% ( 51, 76 ] 26 0.000% 99.745% ( 76, 110 ] 8162 0.074% 99.819% ( 110, 170 ] 2527 0.023% 99.842% ( 170, 250 ] 338 0.003% 99.845% ( 250, 380 ] 204 0.002% 99.847% ( 380, 580 ] 28 0.000% 99.847% ( 580, 870 ] 30 0.000% 99.847% ( 870, 1300 ] 13070 0.118% 99.965% ( 1300, 1900 ] 33 0.000% 99.966% ( 1900, 2900 ] 3726 0.034% 99.999% ( 2900, 4400 ] 39 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 3 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 170000, 250000 ] 18 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 182063 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11055999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11409790968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 582 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29716426 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32418133970 rocksdb.compact.write.bytes COUNT : 32225665984 rocksdb.flush.write.bytes COUNT : 11361701298 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 71 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 354 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11270239232 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4508672 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32525535161 rocksdb.non.last.level.read.count COUNT : 7852019 rocksdb.block.checksum.compute.count COUNT : 7850927 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.367959 P95 : 3.895977 P99 : 7.658363 P100 : 994671.000000 COUNT : 11055999 SUM : 54892155 rocksdb.compaction.times.micros P50 : 1067187.500000 P95 : 4630000.000000 P99 : 14240000.000000 P100 : 15161120.000000 COUNT : 97 SUM : 160960313 rocksdb.compaction.times.cpu_micros P50 : 927105.263158 P95 : 3705000.000000 P99 : 14240000.000000 P100 : 14306858.000000 COUNT : 97 SUM : 129133518 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 714.086022 P95 : 8250.000000 P99 : 41500.000000 P100 : 365719.000000 COUNT : 150 SUM : 596064 rocksdb.compaction.outfile.sync.micros P50 : 1228.333333 P95 : 149272.727273 P99 : 346200.000000 P100 : 1364332.000000 COUNT : 356 SUM : 10227199 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 105.911392 P95 : 2368.750000 P99 : 5243.333333 P100 : 7037.000000 COUNT : 285 SUM : 130343 rocksdb.table.open.io.micros P50 : 1637.500000 P95 : 11564.117647 P99 : 22330.000000 P100 : 23515.000000 COUNT : 582 SUM : 1658773 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.677517 P95 : 8.192074 P99 : 12.178580 P100 : 16893.000000 COUNT : 7849389 SUM : 51005339 rocksdb.read.block.get.micros P50 : 550.802920 P95 : 4792.000000 P99 : 6945.230769 P100 : 8758.000000 COUNT : 1164 SUM : 1305248 rocksdb.write.raw.block.micros P50 : 0.513224 P95 : 0.975125 P99 : 2.864861 P100 : 15620.000000 COUNT : 10556427 SUM : 23136197 rocksdb.numfiles.in.singlecompaction P50 : 3.239130 P95 : 4.800000 P99 : 17.800000 P100 : 35.000000 COUNT : 160 SUM : 594 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561900 P95 : 1170.026241 P99 : 2493.785830 P100 : 994458.000000 COUNT : 154018 SUM : 29734674 rocksdb.sst.read.micros P50 : 1.633908 P95 : 4.978441 P99 : 8.905728 P100 : 11279.000000 COUNT : 7852441 SUM : 35424147 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11055999 SUM : 11409790968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211702.127660 P95 : 502142.857143 P99 : 945000.000000 P100 : 1128463.000000 COUNT : 150 SUM : 35164015 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 354 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0