[2024-12-09 00:08:43.662654] Starting SPDK v25.01-pre git sha1 a2f5e1c2d / DPDK 22.11.4 initialization... [2024-12-09 00:08:43.662771] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2589517 ] Set seed to 1733699323660113 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-09 00:08:43.777329] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-09 00:08:43.802378] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-09 00:08:43.802438] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2589517' to capture a snapshot of events at runtime. [2024-12-09 00:08:43.802451] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-09 00:08:43.802464] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-09 00:08:43.802474] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2589517 for offline analysis/debug. [2024-12-09 00:08:43.803039] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 9 00:08:45 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/09-00:08:48 ... thread 0: (1000000,1000000) ops and (339417.9,339417.9) ops/second in (2.946221,2.946221) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 693.02 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 348.6 2.53 2.36 13 0.195 0 0 0.0 0.0 L2 3/2 237.13 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 244.2 244.0 1.43 1.39 2 0.714 354K 182 0.0 0.0 L3 11/0 944.91 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1197/12 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 88.1 310.9 3.96 3.76 15 0.264 354K 182 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 88.1 310.9 3.96 3.76 15 0.264 354K 182 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 244.2 244.0 1.43 1.39 2 0.714 354K 182 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 348.6 2.53 2.36 13 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 391.14 MB/s write, 0.34 GB read, 110.82 MB/s read, 4.0 seconds Interval compaction: 1.20 GB write, 417.49 MB/s write, 0.34 GB read, 118.29 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 121937 Average: 1.9925 StdDev: 5.30 Min: 1 Median: 1.3606 Max: 1393 Percentiles: P50: 1.36 P75: 1.77 P99: 5.72 P99.9: 13.41 P99.99: 189.23 ------------------------------------------------------ [ 0, 1 ] 34163 28.017% 28.017% ###### ( 1, 2 ] 74346 60.971% 88.988% ############ ( 2, 3 ] 7921 6.496% 95.484% # ( 3, 4 ] 2960 2.427% 97.911% ( 4, 6 ] 1550 1.271% 99.182% ( 6, 10 ] 718 0.589% 99.771% ( 10, 15 ] 233 0.191% 99.962% ( 15, 22 ] 24 0.020% 99.982% ( 22, 34 ] 2 0.002% 99.984% ( 34, 51 ] 3 0.002% 99.986% ( 51, 76 ] 2 0.002% 99.988% ( 170, 250 ] 20 0.016% 100.004% ( 250, 380 ] 4 0.003% 100.007% ( 380, 580 ] 1 0.001% 100.008% ( 1300, 1900 ] 1 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 77381 Average: 2.1393 StdDev: 6.70 Min: 0 Median: 1.3855 Max: 957 Percentiles: P50: 1.39 P75: 1.80 P99: 6.11 P99.9: 77.12 P99.99: 238.41 ------------------------------------------------------ [ 0, 1 ] 20666 26.707% 26.707% ##### ( 1, 2 ] 46763 60.432% 87.139% ############ ( 2, 3 ] 5939 7.675% 94.814% ## ( 3, 4 ] 1997 2.581% 97.395% # ( 4, 6 ] 1227 1.586% 98.980% ( 6, 10 ] 572 0.739% 99.720% ( 10, 15 ] 112 0.145% 99.864% ( 15, 22 ] 17 0.022% 99.886% ( 22, 34 ] 8 0.010% 99.897% ( 34, 51 ] 1 0.001% 99.898% ( 51, 76 ] 1 0.001% 99.899% ( 76, 110 ] 49 0.063% 99.963% ( 110, 170 ] 12 0.016% 99.978% ( 170, 250 ] 12 0.016% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 3 0.004% 99.999% ( 580, 870 ] 1 0.001% 100.000% ( 870, 1300 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 55 Average: 1246.9455 StdDev: 1014.35 Min: 192 Median: 807.8571 Max: 3994 Percentiles: P50: 807.86 P75: 1927.78 P99: 3994.00 P99.9: 3994.00 P99.99: 3994.00 ------------------------------------------------------ ( 170, 250 ] 2 3.636% 3.636% # ( 250, 380 ] 9 16.364% 20.000% ### ( 380, 580 ] 11 20.000% 40.000% #### ( 580, 870 ] 7 12.727% 52.727% ### ( 870, 1300 ] 4 7.273% 60.000% # ( 1300, 1900 ] 8 14.545% 74.545% ### ( 1900, 2900 ] 9 16.364% 90.909% ### ( 2900, 4400 ] 5 9.091% 100.000% ## ** Level 4 read latency histogram (micros): Count: 20 Average: 1316.1000 StdDev: 741.47 Min: 325 Median: 1128.0000 Max: 2668 Percentiles: P50: 1128.00 P75: 1900.00 P99: 2668.00 P99.9: 2668.00 P99.99: 2668.00 ------------------------------------------------------ ( 250, 380 ] 3 15.000% 15.000% ### ( 380, 580 ] 1 5.000% 20.000% # ( 580, 870 ] 3 15.000% 35.000% ### ( 870, 1300 ] 5 25.000% 60.000% ##### ( 1300, 1900 ] 3 15.000% 75.000% ### ( 1900, 2900 ] 5 25.000% 100.000% ##### ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 312.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.204 H:M:S, 6.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.204 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/09-00:08:51 ... thread 0: (1000000,2000000) ops and (326682.1,332928.2) ops/second in (3.061080,6.007301) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.23 GB 94.4 0.7 0.0 0.7 2.5 1.8 0.0 1.4 91.3 311.7 8.28 7.83 30 0.276 767K 763 0.0 0.0 L1 1/0 3.83 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.6 237.2 1.59 1.55 1 1.591 383K 601 0.0 0.0 L2 1/1 50.23 MB 0.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 244.2 244.0 1.43 1.39 2 0.714 354K 182 0.0 0.0 L3 21/11 1.31 GB 0.4 0.3 0.3 0.0 0.3 0.3 0.3 1.1 219.3 219.3 1.47 1.41 2 0.735 327K 82 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 168.1 168.1 1.00 0.89 1 1.001 170K 0 0.0 0.0 L5 1056/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/16 97.92 GB 0.0 1.9 1.0 0.9 3.7 2.8 0.8 2.1 143.3 275.8 13.77 13.08 36 0.383 2003K 1628 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 1.0 0.9 3.7 2.8 0.8 2.1 143.3 275.8 13.77 13.08 36 0.383 2003K 1628 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 1.0 0.9 1.9 1.0 0.0 0.0 229.8 229.6 8.59 8.27 9 0.954 2003K 1628 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.1 5.19 4.80 27 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.71 GB write, 611.98 MB/s write, 1.93 GB read, 317.91 MB/s read, 13.8 seconds Interval compaction: 3.71 GB write, 632.21 MB/s write, 1.93 GB read, 328.42 MB/s read, 13.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 382775 Average: 2.2521 StdDev: 5.33 Min: 1 Median: 1.5334 Max: 1458 Percentiles: P50: 1.53 P75: 1.92 P99: 5.92 P99.9: 12.61 P99.99: 18.87 ------------------------------------------------------ [ 0, 1 ] 59604 15.572% 15.572% ### ( 1, 2 ] 247048 64.541% 80.113% ############# ( 2, 3 ] 45387 11.857% 91.970% ## ( 3, 4 ] 17144 4.479% 96.449% # ( 4, 6 ] 10152 2.652% 99.101% # ( 6, 10 ] 2713 0.709% 99.810% ( 10, 15 ] 660 0.172% 99.982% ( 15, 22 ] 52 0.014% 99.996% ( 22, 34 ] 10 0.003% 99.999% ( 34, 51 ] 10 0.003% 100.001% ( 51, 76 ] 2 0.001% 100.002% ( 76, 110 ] 1 0.000% 100.002% ( 170, 250 ] 42 0.011% 100.013% ( 250, 380 ] 9 0.002% 100.015% ( 380, 580 ] 2 0.001% 100.016% ( 580, 870 ] 3 0.001% 100.017% ( 870, 1300 ] 2 0.001% 100.017% ( 1300, 1900 ] 2 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 29665 Average: 2.6969 StdDev: 7.82 Min: 1 Median: 1.7668 Max: 860 Percentiles: P50: 1.77 P75: 2.51 P99: 6.11 P99.9: 12.41 P99.99: 501.34 ------------------------------------------------------ [ 0, 1 ] 969 3.266% 3.266% # ( 1, 2 ] 18080 60.947% 64.214% ############ ( 2, 3 ] 6251 21.072% 85.286% #### ( 3, 4 ] 2266 7.639% 92.924% ## ( 4, 6 ] 1795 6.051% 98.975% # ( 6, 10 ] 256 0.863% 99.838% ( 10, 15 ] 38 0.128% 99.966% ( 15, 22 ] 3 0.010% 99.976% ( 22, 34 ] 1 0.003% 99.980% ( 380, 580 ] 5 0.017% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 88317 Average: 2.1695 StdDev: 6.28 Min: 0 Median: 1.4199 Max: 957 Percentiles: P50: 1.42 P75: 1.83 P99: 6.12 P99.9: 23.02 P99.99: 231.12 ------------------------------------------------------ [ 0, 1 ] 21459 24.298% 24.298% ##### ( 1, 2 ] 54060 61.211% 85.509% ############ ( 2, 3 ] 7657 8.670% 94.179% ## ( 3, 4 ] 2591 2.934% 97.113% # ( 4, 6 ] 1647 1.865% 98.978% ( 6, 10 ] 668 0.756% 99.734% ( 10, 15 ] 128 0.145% 99.879% ( 15, 22 ] 18 0.020% 99.899% ( 22, 34 ] 8 0.009% 99.908% ( 34, 51 ] 1 0.001% 99.909% ( 51, 76 ] 1 0.001% 99.911% ( 76, 110 ] 49 0.055% 99.966% ( 110, 170 ] 12 0.014% 99.980% ( 170, 250 ] 12 0.014% 99.993% ( 250, 380 ] 1 0.001% 99.994% ( 380, 580 ] 3 0.003% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 202438 Average: 3.0213 StdDev: 27.27 Min: 0 Median: 1.6281 Max: 3994 Percentiles: P50: 1.63 P75: 2.09 P99: 8.88 P99.9: 123.64 P99.99: 510.08 ------------------------------------------------------ [ 0, 1 ] 20209 9.983% 9.983% ## ( 1, 2 ] 128980 63.713% 73.696% ############# ( 2, 3 ] 29361 14.504% 88.200% ### ( 3, 4 ] 11976 5.916% 94.116% # ( 4, 6 ] 7329 3.620% 97.736% # ( 6, 10 ] 3550 1.754% 99.490% ( 10, 15 ] 330 0.163% 99.653% ( 15, 22 ] 60 0.030% 99.682% ( 22, 34 ] 79 0.039% 99.721% ( 34, 51 ] 157 0.078% 99.799% ( 51, 76 ] 48 0.024% 99.823% ( 76, 110 ] 127 0.063% 99.885% ( 110, 170 ] 130 0.064% 99.950% ( 170, 250 ] 46 0.023% 99.972% ( 250, 380 ] 26 0.013% 99.985% ( 380, 580 ] 15 0.007% 99.993% ( 580, 870 ] 8 0.004% 99.997% ( 870, 1300 ] 4 0.002% 99.999% ( 1300, 1900 ] 8 0.004% 100.002% ( 1900, 2900 ] 9 0.004% 100.007% ( 2900, 4400 ] 5 0.002% 100.009% ** Level 4 read latency histogram (micros): Count: 305 Average: 90.0721 StdDev: 376.35 Min: 0 Median: 1.5413 Max: 2668 Percentiles: P50: 1.54 P75: 3.95 P99: 2290.00 P99.9: 2668.00 P99.99: 2668.00 ------------------------------------------------------ [ 0, 1 ] 87 28.525% 28.525% ###### ( 1, 2 ] 121 39.672% 68.197% ######## ( 2, 3 ] 16 5.246% 73.443% # ( 3, 4 ] 5 1.639% 75.082% ( 4, 6 ] 6 1.967% 77.049% ( 6, 10 ] 28 9.180% 86.230% ## ( 10, 15 ] 20 6.557% 92.787% # ( 110, 170 ] 2 0.656% 93.443% ( 250, 380 ] 3 0.984% 94.426% ( 380, 580 ] 1 0.328% 94.754% ( 580, 870 ] 3 0.984% 95.738% ( 870, 1300 ] 5 1.639% 97.377% ( 1300, 1900 ] 3 0.984% 98.361% ( 1900, 2900 ] 5 1.639% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 317.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.379 H:M:S, 6.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.176 H:M:S, 5.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/09-00:08:54 ... thread 0: (1000000,3000000) ops and (332671.0,332842.4) ops/second in (3.005973,9.013274) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.21 GB 195.1 1.8 0.0 1.8 4.6 2.8 0.0 1.6 118.9 303.4 15.36 14.61 49 0.313 1855K 1838 0.0 0.0 L1 1/0 3.83 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.6 237.2 1.59 1.55 1 1.591 383K 601 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 244.2 244.0 1.43 1.39 2 0.714 354K 182 0.0 0.0 L3 18/0 870.23 MB 0.9 1.3 0.3 0.9 1.3 0.3 0.3 3.7 241.8 241.4 5.45 5.23 3 1.816 1338K 1996 0.0 0.0 L4 173/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 168.1 168.1 1.00 0.89 1 1.001 170K 0 0.0 0.0 L5 1064/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/4 98.90 GB 0.0 3.9 1.1 2.9 6.7 3.8 1.9 2.4 162.7 276.7 24.83 23.67 56 0.443 4101K 4617 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.1 2.9 6.7 3.8 1.9 2.4 162.7 276.7 24.83 23.67 56 0.443 4101K 4617 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.1 2.9 3.9 1.1 0.0 0.0 239.5 239.2 16.87 16.30 14 1.205 4101K 4617 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 356.1 7.96 7.37 42 0.190 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.71 GB write, 745.65 MB/s write, 3.94 GB read, 438.45 MB/s read, 24.8 seconds Interval compaction: 6.71 GB write, 762.07 MB/s write, 3.94 GB read, 448.11 MB/s read, 24.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 638899 Average: 2.2202 StdDev: 6.37 Min: 1 Median: 1.5140 Max: 1519 Percentiles: P50: 1.51 P75: 1.90 P99: 5.84 P99.9: 12.14 P99.99: 18.43 ------------------------------------------------------ [ 0, 1 ] 107737 16.863% 16.863% ### ( 1, 2 ] 411869 64.465% 81.328% ############# ( 2, 3 ] 72576 11.360% 92.688% ## ( 3, 4 ] 26476 4.144% 96.832% # ( 4, 6 ] 15036 2.353% 99.185% ( 6, 10 ] 4168 0.652% 99.838% ( 10, 15 ] 928 0.145% 99.983% ( 15, 22 ] 92 0.014% 99.997% ( 22, 34 ] 22 0.003% 100.001% ( 34, 51 ] 16 0.003% 100.003% ( 51, 76 ] 6 0.001% 100.004% ( 76, 110 ] 2 0.000% 100.005% ( 170, 250 ] 58 0.009% 100.014% ( 250, 380 ] 19 0.003% 100.017% ( 380, 580 ] 3 0.000% 100.017% ( 580, 870 ] 6 0.001% 100.018% ( 870, 1300 ] 7 0.001% 100.019% ( 1300, 1900 ] 5 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 29665 Average: 2.6969 StdDev: 7.82 Min: 1 Median: 1.7668 Max: 860 Percentiles: P50: 1.77 P75: 2.51 P99: 6.11 P99.9: 12.41 P99.99: 501.34 ------------------------------------------------------ [ 0, 1 ] 969 3.266% 3.266% # ( 1, 2 ] 18080 60.947% 64.214% ############ ( 2, 3 ] 6251 21.072% 85.286% #### ( 3, 4 ] 2266 7.639% 92.924% ## ( 4, 6 ] 1795 6.051% 98.975% # ( 6, 10 ] 256 0.863% 99.838% ( 10, 15 ] 38 0.128% 99.966% ( 15, 22 ] 3 0.010% 99.976% ( 22, 34 ] 1 0.003% 99.980% ( 380, 580 ] 5 0.017% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 100771 Average: 2.2301 StdDev: 6.67 Min: 0 Median: 1.4313 Max: 957 Percentiles: P50: 1.43 P75: 1.83 P99: 6.73 P99.9: 90.36 P99.99: 244.93 ------------------------------------------------------ [ 0, 1 ] 23358 23.179% 23.179% ##### ( 1, 2 ] 62661 62.182% 85.361% ############ ( 2, 3 ] 8791 8.724% 94.085% ## ( 3, 4 ] 2946 2.923% 97.008% # ( 4, 6 ] 1849 1.835% 98.843% ( 6, 10 ] 863 0.856% 99.699% ( 10, 15 ] 151 0.150% 99.849% ( 15, 22 ] 18 0.018% 99.867% ( 22, 34 ] 8 0.008% 99.875% ( 34, 51 ] 1 0.001% 99.876% ( 51, 76 ] 1 0.001% 99.877% ( 76, 110 ] 55 0.055% 99.932% ( 110, 170 ] 43 0.043% 99.974% ( 170, 250 ] 17 0.017% 99.991% ( 250, 380 ] 4 0.004% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 287587 Average: 2.9292 StdDev: 23.34 Min: 0 Median: 1.6120 Max: 3994 Percentiles: P50: 1.61 P75: 2.00 P99: 8.89 P99.9: 138.14 P99.99: 435.17 ------------------------------------------------------ [ 0, 1 ] 29859 10.383% 10.383% ## ( 1, 2 ] 186179 64.738% 75.121% ############# ( 2, 3 ] 39592 13.767% 88.888% ### ( 3, 4 ] 15994 5.561% 94.449% # ( 4, 6 ] 9430 3.279% 97.728% # ( 6, 10 ] 5068 1.762% 99.491% ( 10, 15 ] 469 0.163% 99.654% ( 15, 22 ] 66 0.023% 99.677% ( 22, 34 ] 80 0.028% 99.704% ( 34, 51 ] 230 0.080% 99.784% ( 51, 76 ] 60 0.021% 99.805% ( 76, 110 ] 165 0.057% 99.863% ( 110, 170 ] 229 0.080% 99.942% ( 170, 250 ] 93 0.032% 99.975% ( 250, 380 ] 39 0.014% 99.988% ( 380, 580 ] 19 0.007% 99.995% ( 580, 870 ] 8 0.003% 99.998% ( 870, 1300 ] 4 0.001% 99.999% ( 1300, 1900 ] 8 0.003% 100.002% ( 1900, 2900 ] 9 0.003% 100.005% ( 2900, 4400 ] 5 0.002% 100.007% ** Level 4 read latency histogram (micros): Count: 305 Average: 90.0721 StdDev: 376.35 Min: 0 Median: 1.5413 Max: 2668 Percentiles: P50: 1.54 P75: 3.95 P99: 2290.00 P99.9: 2668.00 P99.99: 2668.00 ------------------------------------------------------ [ 0, 1 ] 87 28.525% 28.525% ###### ( 1, 2 ] 121 39.672% 68.197% ######## ( 2, 3 ] 16 5.246% 73.443% # ( 3, 4 ] 5 1.639% 75.082% ( 4, 6 ] 6 1.967% 77.049% ( 6, 10 ] 28 9.180% 86.230% ## ( 10, 15 ] 20 6.557% 92.787% # ( 110, 170 ] 2 0.656% 93.443% ( 250, 380 ] 3 0.984% 94.426% ( 380, 580 ] 1 0.328% 94.754% ( 580, 870 ] 3 0.984% 95.738% ( 870, 1300 ] 5 1.639% 97.377% ( 1300, 1900 ] 3 0.984% 98.361% ( 1900, 2900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 338.0500 StdDev: 238.38 Min: 115 Median: 242.7273 Max: 1027 Percentiles: P50: 242.73 P75: 480.00 P99: 1027.00 P99.9: 1027.00 P99.99: 1027.00 ------------------------------------------------------ ( 110, 170 ] 10 25.000% 25.000% ##### ( 170, 250 ] 11 27.500% 52.500% ###### ( 250, 380 ] 7 17.500% 70.000% #### ( 380, 580 ] 4 10.000% 80.000% ## ( 580, 870 ] 6 15.000% 95.000% ### ( 870, 1300 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 320.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.563 H:M:S, 6.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.184 H:M:S, 6.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/09-00:08:57 ... thread 0: (1000000,4000000) ops and (342155.9,335122.9) ops/second in (2.922644,11.935918) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 3.20 GB 6.3 2.8 0.0 2.8 6.6 3.7 0.0 1.8 130.1 302.4 22.28 21.27 68 0.328 2942K 2913 0.0 0.0 L1 1/1 3.83 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.6 237.2 1.59 1.55 1 1.591 383K 601 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 244.2 244.0 1.43 1.39 2 0.714 354K 182 0.0 0.0 L3 18/0 870.23 MB 0.9 1.3 0.3 0.9 1.3 0.3 0.3 3.7 241.8 241.4 5.45 5.23 3 1.816 1338K 1996 0.0 0.0 L4 173/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 168.1 168.1 1.00 0.89 1 1.001 170K 0 0.0 0.0 L5 1064/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/16 99.88 GB 0.0 5.0 1.1 3.9 8.7 4.8 1.9 2.3 161.0 281.8 31.75 30.33 75 0.423 5189K 5692 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 1.1 3.9 8.7 4.8 1.9 2.3 161.0 281.8 31.75 30.33 75 0.423 5189K 5692 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 1.1 3.9 5.0 1.1 0.0 0.0 243.1 242.8 21.02 20.39 18 1.168 5189K 5692 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 358.3 10.73 9.94 57 0.188 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.74 GB write, 737.28 MB/s write, 4.99 GB read, 421.10 MB/s read, 31.7 seconds Interval compaction: 8.74 GB write, 749.54 MB/s write, 4.99 GB read, 428.11 MB/s read, 31.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 886327 Average: 2.1824 StdDev: 6.84 Min: 0 Median: 1.4763 Max: 1519 Percentiles: P50: 1.48 P75: 1.87 P99: 5.74 P99.9: 12.49 P99.99: 128.36 ------------------------------------------------------ [ 0, 1 ] 173105 19.531% 19.531% #### ( 1, 2 ] 566950 63.966% 83.497% ############# ( 2, 3 ] 90173 10.174% 93.671% ## ( 3, 4 ] 32377 3.653% 97.324% # ( 4, 6 ] 17075 1.926% 99.250% ( 6, 10 ] 5218 0.589% 99.839% ( 10, 15 ] 1091 0.123% 99.962% ( 15, 22 ] 115 0.013% 99.975% ( 22, 34 ] 30 0.003% 99.978% ( 34, 51 ] 19 0.002% 99.980% ( 51, 76 ] 8 0.001% 99.981% ( 76, 110 ] 33 0.004% 99.985% ( 110, 170 ] 145 0.016% 100.001% ( 170, 250 ] 92 0.010% 100.012% ( 250, 380 ] 29 0.003% 100.015% ( 380, 580 ] 7 0.001% 100.016% ( 580, 870 ] 10 0.001% 100.017% ( 870, 1300 ] 8 0.001% 100.018% ( 1300, 1900 ] 8 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 29666 Average: 2.7010 StdDev: 7.85 Min: 1 Median: 1.7668 Max: 860 Percentiles: P50: 1.77 P75: 2.51 P99: 6.13 P99.9: 12.54 P99.99: 501.34 ------------------------------------------------------ [ 0, 1 ] 969 3.266% 3.266% # ( 1, 2 ] 18080 60.945% 64.212% ############ ( 2, 3 ] 6251 21.071% 85.283% #### ( 3, 4 ] 2266 7.638% 92.921% ## ( 4, 6 ] 1795 6.051% 98.972% # ( 6, 10 ] 256 0.863% 99.835% ( 10, 15 ] 38 0.128% 99.963% ( 15, 22 ] 3 0.010% 99.973% ( 22, 34 ] 1 0.003% 99.976% ( 110, 170 ] 1 0.003% 99.980% ( 380, 580 ] 5 0.017% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 100771 Average: 2.2301 StdDev: 6.67 Min: 0 Median: 1.4313 Max: 957 Percentiles: P50: 1.43 P75: 1.83 P99: 6.73 P99.9: 90.36 P99.99: 244.93 ------------------------------------------------------ [ 0, 1 ] 23358 23.179% 23.179% ##### ( 1, 2 ] 62661 62.182% 85.361% ############ ( 2, 3 ] 8791 8.724% 94.085% ## ( 3, 4 ] 2946 2.923% 97.008% # ( 4, 6 ] 1849 1.835% 98.843% ( 6, 10 ] 863 0.856% 99.699% ( 10, 15 ] 151 0.150% 99.849% ( 15, 22 ] 18 0.018% 99.867% ( 22, 34 ] 8 0.008% 99.875% ( 34, 51 ] 1 0.001% 99.876% ( 51, 76 ] 1 0.001% 99.877% ( 76, 110 ] 55 0.055% 99.932% ( 110, 170 ] 43 0.043% 99.974% ( 170, 250 ] 17 0.017% 99.991% ( 250, 380 ] 4 0.004% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 287587 Average: 2.9292 StdDev: 23.34 Min: 0 Median: 1.6120 Max: 3994 Percentiles: P50: 1.61 P75: 2.00 P99: 8.89 P99.9: 138.14 P99.99: 435.17 ------------------------------------------------------ [ 0, 1 ] 29859 10.383% 10.383% ## ( 1, 2 ] 186179 64.738% 75.121% ############# ( 2, 3 ] 39592 13.767% 88.888% ### ( 3, 4 ] 15994 5.561% 94.449% # ( 4, 6 ] 9430 3.279% 97.728% # ( 6, 10 ] 5068 1.762% 99.491% ( 10, 15 ] 469 0.163% 99.654% ( 15, 22 ] 66 0.023% 99.677% ( 22, 34 ] 80 0.028% 99.704% ( 34, 51 ] 230 0.080% 99.784% ( 51, 76 ] 60 0.021% 99.805% ( 76, 110 ] 165 0.057% 99.863% ( 110, 170 ] 229 0.080% 99.942% ( 170, 250 ] 93 0.032% 99.975% ( 250, 380 ] 39 0.014% 99.988% ( 380, 580 ] 19 0.007% 99.995% ( 580, 870 ] 8 0.003% 99.998% ( 870, 1300 ] 4 0.001% 99.999% ( 1300, 1900 ] 8 0.003% 100.002% ( 1900, 2900 ] 9 0.003% 100.005% ( 2900, 4400 ] 5 0.002% 100.007% ** Level 4 read latency histogram (micros): Count: 305 Average: 90.0721 StdDev: 376.35 Min: 0 Median: 1.5413 Max: 2668 Percentiles: P50: 1.54 P75: 3.95 P99: 2290.00 P99.9: 2668.00 P99.99: 2668.00 ------------------------------------------------------ [ 0, 1 ] 87 28.525% 28.525% ###### ( 1, 2 ] 121 39.672% 68.197% ######## ( 2, 3 ] 16 5.246% 73.443% # ( 3, 4 ] 5 1.639% 75.082% ( 4, 6 ] 6 1.967% 77.049% ( 6, 10 ] 28 9.180% 86.230% ## ( 10, 15 ] 20 6.557% 92.787% # ( 110, 170 ] 2 0.656% 93.443% ( 250, 380 ] 3 0.984% 94.426% ( 380, 580 ] 1 0.328% 94.754% ( 580, 870 ] 3 0.984% 95.738% ( 870, 1300 ] 5 1.639% 97.377% ( 1300, 1900 ] 3 0.984% 98.361% ( 1900, 2900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 338.0500 StdDev: 238.38 Min: 115 Median: 242.7273 Max: 1027 Percentiles: P50: 242.73 P75: 480.00 P99: 1027.00 P99.9: 1027.00 P99.99: 1027.00 ------------------------------------------------------ ( 110, 170 ] 10 25.000% 25.000% ##### ( 170, 250 ] 11 27.500% 52.500% ###### ( 250, 380 ] 7 17.500% 70.000% #### ( 380, 580 ] 4 10.000% 80.000% ## ( 580, 870 ] 6 15.000% 95.000% ### ( 870, 1300 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.724 H:M:S, 6.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 336.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.161 H:M:S, 5.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/09-00:09:05 ... thread 0: (1000000,5000000) ops and (119776.4,246489.8) ops/second in (8.348893,20.284811) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 4.12 GB 100.5 4.4 0.0 4.4 9.0 4.7 0.0 1.9 145.2 300.4 30.80 29.54 87 0.354 4540K 6127 0.0 0.0 L1 1/1 3.83 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.6 237.2 1.59 1.55 1 1.591 383K 601 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 244.2 244.0 1.43 1.39 2 0.714 354K 182 0.0 0.0 L3 18/0 870.23 MB 0.9 1.3 0.3 0.9 1.3 0.3 0.3 3.7 241.8 241.4 5.45 5.23 3 1.816 1338K 1996 0.0 0.0 L4 173/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 168.1 168.1 1.00 0.89 1 1.001 170K 0 0.0 0.0 L5 1064/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/16 100.80 GB 0.0 6.5 1.1 5.5 11.2 5.7 1.9 2.4 166.0 284.7 40.27 38.61 94 0.428 6787K 8906 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 1.1 5.5 11.2 5.7 1.9 2.4 166.0 284.7 40.27 38.61 94 0.428 6787K 8906 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 1.1 5.5 6.5 1.1 0.0 0.0 248.6 248.2 26.89 26.18 22 1.222 6787K 8906 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.8 13.38 12.43 72 0.186 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.5 total, 20.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.19 GB write, 559.62 MB/s write, 6.53 GB read, 326.33 MB/s read, 40.3 seconds Interval compaction: 11.19 GB write, 565.09 MB/s write, 6.53 GB read, 329.52 MB/s read, 40.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 6, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1769299 Average: 2.1362 StdDev: 6.13 Min: 0 Median: 1.4691 Max: 2959 Percentiles: P50: 1.47 P75: 1.85 P99: 5.61 P99.9: 11.36 P99.99: 93.98 ------------------------------------------------------ [ 0, 1 ] 336118 18.997% 18.997% #### ( 1, 2 ] 1169392 66.094% 85.091% ############# ( 2, 3 ] 168535 9.526% 94.616% ## ( 3, 4 ] 55717 3.149% 97.765% # ( 4, 6 ] 27163 1.535% 99.301% ( 6, 10 ] 10141 0.573% 99.874% ( 10, 15 ] 1704 0.096% 99.970% ( 15, 22 ] 192 0.011% 99.981% ( 22, 34 ] 40 0.002% 99.983% ( 34, 51 ] 26 0.001% 99.985% ( 51, 76 ] 11 0.001% 99.985% ( 76, 110 ] 159 0.009% 99.994% ( 110, 170 ] 235 0.013% 100.008% ( 170, 250 ] 122 0.007% 100.014% ( 250, 380 ] 42 0.002% 100.017% ( 380, 580 ] 12 0.001% 100.018% ( 580, 870 ] 18 0.001% 100.019% ( 870, 1300 ] 10 0.001% 100.019% ( 1300, 1900 ] 9 0.001% 100.020% ( 2900, 4400 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 29666 Average: 2.7010 StdDev: 7.85 Min: 1 Median: 1.7668 Max: 860 Percentiles: P50: 1.77 P75: 2.51 P99: 6.13 P99.9: 12.54 P99.99: 501.34 ------------------------------------------------------ [ 0, 1 ] 969 3.266% 3.266% # ( 1, 2 ] 18080 60.945% 64.212% ############ ( 2, 3 ] 6251 21.071% 85.283% #### ( 3, 4 ] 2266 7.638% 92.921% ## ( 4, 6 ] 1795 6.051% 98.972% # ( 6, 10 ] 256 0.863% 99.835% ( 10, 15 ] 38 0.128% 99.963% ( 15, 22 ] 3 0.010% 99.973% ( 22, 34 ] 1 0.003% 99.976% ( 110, 170 ] 1 0.003% 99.980% ( 380, 580 ] 5 0.017% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 100771 Average: 2.2301 StdDev: 6.67 Min: 0 Median: 1.4313 Max: 957 Percentiles: P50: 1.43 P75: 1.83 P99: 6.73 P99.9: 90.36 P99.99: 244.93 ------------------------------------------------------ [ 0, 1 ] 23358 23.179% 23.179% ##### ( 1, 2 ] 62661 62.182% 85.361% ############ ( 2, 3 ] 8791 8.724% 94.085% ## ( 3, 4 ] 2946 2.923% 97.008% # ( 4, 6 ] 1849 1.835% 98.843% ( 6, 10 ] 863 0.856% 99.699% ( 10, 15 ] 151 0.150% 99.849% ( 15, 22 ] 18 0.018% 99.867% ( 22, 34 ] 8 0.008% 99.875% ( 34, 51 ] 1 0.001% 99.876% ( 51, 76 ] 1 0.001% 99.877% ( 76, 110 ] 55 0.055% 99.932% ( 110, 170 ] 43 0.043% 99.974% ( 170, 250 ] 17 0.017% 99.991% ( 250, 380 ] 4 0.004% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 287587 Average: 2.9292 StdDev: 23.34 Min: 0 Median: 1.6120 Max: 3994 Percentiles: P50: 1.61 P75: 2.00 P99: 8.89 P99.9: 138.14 P99.99: 435.17 ------------------------------------------------------ [ 0, 1 ] 29859 10.383% 10.383% ## ( 1, 2 ] 186179 64.738% 75.121% ############# ( 2, 3 ] 39592 13.767% 88.888% ### ( 3, 4 ] 15994 5.561% 94.449% # ( 4, 6 ] 9430 3.279% 97.728% # ( 6, 10 ] 5068 1.762% 99.491% ( 10, 15 ] 469 0.163% 99.654% ( 15, 22 ] 66 0.023% 99.677% ( 22, 34 ] 80 0.028% 99.704% ( 34, 51 ] 230 0.080% 99.784% ( 51, 76 ] 60 0.021% 99.805% ( 76, 110 ] 165 0.057% 99.863% ( 110, 170 ] 229 0.080% 99.942% ( 170, 250 ] 93 0.032% 99.975% ( 250, 380 ] 39 0.014% 99.988% ( 380, 580 ] 19 0.007% 99.995% ( 580, 870 ] 8 0.003% 99.998% ( 870, 1300 ] 4 0.001% 99.999% ( 1300, 1900 ] 8 0.003% 100.002% ( 1900, 2900 ] 9 0.003% 100.005% ( 2900, 4400 ] 5 0.002% 100.007% ** Level 4 read latency histogram (micros): Count: 305 Average: 90.0721 StdDev: 376.35 Min: 0 Median: 1.5413 Max: 2668 Percentiles: P50: 1.54 P75: 3.95 P99: 2290.00 P99.9: 2668.00 P99.99: 2668.00 ------------------------------------------------------ [ 0, 1 ] 87 28.525% 28.525% ###### ( 1, 2 ] 121 39.672% 68.197% ######## ( 2, 3 ] 16 5.246% 73.443% # ( 3, 4 ] 5 1.639% 75.082% ( 4, 6 ] 6 1.967% 77.049% ( 6, 10 ] 28 9.180% 86.230% ## ( 10, 15 ] 20 6.557% 92.787% # ( 110, 170 ] 2 0.656% 93.443% ( 250, 380 ] 3 0.984% 94.426% ( 380, 580 ] 1 0.328% 94.754% ( 580, 870 ] 3 0.984% 95.738% ( 870, 1300 ] 5 1.639% 97.377% ( 1300, 1900 ] 3 0.984% 98.361% ( 1900, 2900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 338.0500 StdDev: 238.38 Min: 115 Median: 242.7273 Max: 1027 Percentiles: P50: 242.73 P75: 480.00 P99: 1027.00 P99.9: 1027.00 P99.99: 1027.00 ------------------------------------------------------ ( 110, 170 ] 10 25.000% 25.000% ##### ( 170, 250 ] 11 27.500% 52.500% ###### ( 250, 380 ] 7 17.500% 70.000% #### ( 380, 580 ] 4 10.000% 80.000% ## ( 580, 870 ] 6 15.000% 95.000% ### ( 870, 1300 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 20.5 total, 8.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 240.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.266 H:M:S, 30.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 117.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.542 H:M:S, 66.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/09-00:09:13 ... thread 0: (1000000,6000000) ops and (134231.7,216336.1) ops/second in (7.449806,27.734617) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 1.97 GB 0.0 4.9 0.0 4.9 10.5 5.7 0.0 1.9 140.2 303.2 35.50 34.01 105 0.338 5052K 6618 0.0 0.0 L1 14/14 1.16 GB 0.0 3.5 3.5 0.0 3.5 3.5 0.2 1.0 227.2 224.1 15.81 15.44 2 7.903 3646K 49K 0.0 0.0 L2 16/11 1.93 GB 5.6 0.3 0.2 0.2 0.3 0.2 2.3 1.8 244.2 244.0 1.43 1.39 2 0.714 354K 182 0.0 0.0 L3 18/2 870.23 MB 0.6 1.3 0.3 0.9 1.3 0.3 0.3 3.7 241.8 241.4 5.45 5.23 3 1.816 1338K 1996 0.0 0.0 L4 173/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 168.1 168.1 1.00 0.89 1 1.001 170K 0 0.0 0.0 L5 1064/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/41 101.74 GB 0.0 10.2 4.2 6.0 15.8 9.8 3.9 2.8 175.8 272.7 59.19 56.97 113 0.524 10M 57K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 4.2 6.0 15.8 9.8 3.9 2.8 175.8 272.7 59.19 56.97 113 0.524 10M 57K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 4.2 6.0 10.1 4.1 0.0 0.0 242.1 240.8 42.96 41.90 25 1.718 10M 57K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 357.2 16.22 15.06 88 0.184 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.9 total, 27.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.76 GB write, 577.78 MB/s write, 10.16 GB read, 372.38 MB/s read, 59.2 seconds Interval compaction: 15.76 GB write, 581.91 MB/s write, 10.16 GB read, 375.05 MB/s read, 59.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 6, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2362124 Average: 2.2032 StdDev: 6.84 Min: 0 Median: 1.4688 Max: 2959 Percentiles: P50: 1.47 P75: 1.85 P99: 5.80 P99.9: 13.84 P99.99: 152.25 ------------------------------------------------------ [ 0, 1 ] 455129 19.268% 19.268% #### ( 1, 2 ] 1548564 65.558% 84.826% ############# ( 2, 3 ] 222080 9.402% 94.228% ## ( 3, 4 ] 75491 3.196% 97.424% # ( 4, 6 ] 41459 1.755% 99.179% ( 6, 10 ] 15107 0.640% 99.818% ( 10, 15 ] 2519 0.107% 99.925% ( 15, 22 ] 364 0.015% 99.940% ( 22, 34 ] 49 0.002% 99.942% ( 34, 51 ] 30 0.001% 99.944% ( 51, 76 ] 11 0.000% 99.944% ( 76, 110 ] 446 0.019% 99.963% ( 110, 170 ] 910 0.039% 100.001% ( 170, 250 ] 243 0.010% 100.012% ( 250, 380 ] 94 0.004% 100.016% ( 380, 580 ] 33 0.001% 100.017% ( 580, 870 ] 23 0.001% 100.018% ( 870, 1300 ] 11 0.000% 100.019% ( 1300, 1900 ] 11 0.000% 100.019% ( 1900, 2900 ] 1 0.000% 100.019% ( 2900, 4400 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 221426 Average: 2.9203 StdDev: 10.04 Min: 0 Median: 1.7296 Max: 860 Percentiles: P50: 1.73 P75: 2.40 P99: 8.08 P99.9: 121.00 P99.99: 218.09 ------------------------------------------------------ [ 0, 1 ] 7776 3.512% 3.512% # ( 1, 2 ] 141078 63.713% 67.225% ############# ( 2, 3 ] 42581 19.230% 86.456% #### ( 3, 4 ] 15510 7.005% 93.460% # ( 4, 6 ] 10660 4.814% 98.274% # ( 6, 10 ] 3096 1.398% 99.673% ( 10, 15 ] 332 0.150% 99.823% ( 15, 22 ] 29 0.013% 99.836% ( 22, 34 ] 5 0.002% 99.838% ( 34, 51 ] 2 0.001% 99.839% ( 76, 110 ] 100 0.045% 99.884% ( 110, 170 ] 205 0.093% 99.977% ( 170, 250 ] 53 0.024% 100.000% ( 250, 380 ] 20 0.009% 100.009% ( 380, 580 ] 54 0.024% 100.034% ( 580, 870 ] 5 0.002% 100.036% ** Level 2 read latency histogram (micros): Count: 100771 Average: 2.2301 StdDev: 6.67 Min: 0 Median: 1.4313 Max: 957 Percentiles: P50: 1.43 P75: 1.83 P99: 6.73 P99.9: 90.36 P99.99: 244.93 ------------------------------------------------------ [ 0, 1 ] 23358 23.179% 23.179% ##### ( 1, 2 ] 62661 62.182% 85.361% ############ ( 2, 3 ] 8791 8.724% 94.085% ## ( 3, 4 ] 2946 2.923% 97.008% # ( 4, 6 ] 1849 1.835% 98.843% ( 6, 10 ] 863 0.856% 99.699% ( 10, 15 ] 151 0.150% 99.849% ( 15, 22 ] 18 0.018% 99.867% ( 22, 34 ] 8 0.008% 99.875% ( 34, 51 ] 1 0.001% 99.876% ( 51, 76 ] 1 0.001% 99.877% ( 76, 110 ] 55 0.055% 99.932% ( 110, 170 ] 43 0.043% 99.974% ( 170, 250 ] 17 0.017% 99.991% ( 250, 380 ] 4 0.004% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 287587 Average: 2.9292 StdDev: 23.34 Min: 0 Median: 1.6120 Max: 3994 Percentiles: P50: 1.61 P75: 2.00 P99: 8.89 P99.9: 138.14 P99.99: 435.17 ------------------------------------------------------ [ 0, 1 ] 29859 10.383% 10.383% ## ( 1, 2 ] 186179 64.738% 75.121% ############# ( 2, 3 ] 39592 13.767% 88.888% ### ( 3, 4 ] 15994 5.561% 94.449% # ( 4, 6 ] 9430 3.279% 97.728% # ( 6, 10 ] 5068 1.762% 99.491% ( 10, 15 ] 469 0.163% 99.654% ( 15, 22 ] 66 0.023% 99.677% ( 22, 34 ] 80 0.028% 99.704% ( 34, 51 ] 230 0.080% 99.784% ( 51, 76 ] 60 0.021% 99.805% ( 76, 110 ] 165 0.057% 99.863% ( 110, 170 ] 229 0.080% 99.942% ( 170, 250 ] 93 0.032% 99.975% ( 250, 380 ] 39 0.014% 99.988% ( 380, 580 ] 19 0.007% 99.995% ( 580, 870 ] 8 0.003% 99.998% ( 870, 1300 ] 4 0.001% 99.999% ( 1300, 1900 ] 8 0.003% 100.002% ( 1900, 2900 ] 9 0.003% 100.005% ( 2900, 4400 ] 5 0.002% 100.007% ** Level 4 read latency histogram (micros): Count: 305 Average: 90.0721 StdDev: 376.35 Min: 0 Median: 1.5413 Max: 2668 Percentiles: P50: 1.54 P75: 3.95 P99: 2290.00 P99.9: 2668.00 P99.99: 2668.00 ------------------------------------------------------ [ 0, 1 ] 87 28.525% 28.525% ###### ( 1, 2 ] 121 39.672% 68.197% ######## ( 2, 3 ] 16 5.246% 73.443% # ( 3, 4 ] 5 1.639% 75.082% ( 4, 6 ] 6 1.967% 77.049% ( 6, 10 ] 28 9.180% 86.230% ## ( 10, 15 ] 20 6.557% 92.787% # ( 110, 170 ] 2 0.656% 93.443% ( 250, 380 ] 3 0.984% 94.426% ( 380, 580 ] 1 0.328% 94.754% ( 580, 870 ] 3 0.984% 95.738% ( 870, 1300 ] 5 1.639% 97.377% ( 1300, 1900 ] 3 0.984% 98.361% ( 1900, 2900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 338.0500 StdDev: 238.38 Min: 115 Median: 242.7273 Max: 1027 Percentiles: P50: 242.73 P75: 480.00 P99: 1027.00 P99.9: 1027.00 P99.99: 1027.00 ------------------------------------------------------ ( 110, 170 ] 10 25.000% 25.000% ##### ( 170, 250 ] 11 27.500% 52.500% ###### ( 250, 380 ] 7 17.500% 70.000% #### ( 380, 580 ] 4 10.000% 80.000% ## ( 580, 870 ] 6 15.000% 95.000% ### ( 870, 1300 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 27.9 total, 7.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 211.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.784 H:M:S, 38.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 132.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.518 H:M:S, 60.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/09-00:09:16 ... thread 0: (1000000,7000000) ops and (283666.7,223929.2) ops/second in (3.525264,31.259881) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.89 GB 119.6 5.9 0.0 5.9 12.5 6.6 0.0 1.9 141.5 299.0 42.74 40.90 122 0.350 6140K 7655 0.0 0.0 L1 14/14 1.16 GB 0.0 3.5 3.5 0.0 3.5 3.5 0.2 1.0 227.2 224.1 15.81 15.44 2 7.903 3646K 49K 0.0 0.0 L2 4/3 515.12 MB 1.3 0.3 0.2 0.2 0.3 0.2 2.3 1.8 244.2 244.0 1.43 1.39 2 0.714 354K 182 0.0 0.0 L3 35/8 1.65 GB 1.2 3.0 1.8 1.2 3.0 1.8 0.3 1.7 225.8 225.2 13.53 13.01 6 2.255 3102K 7874 0.0 0.0 L4 180/7 9.85 GB 1.0 0.3 0.3 0.0 0.3 0.3 1.0 1.0 156.0 155.9 2.19 1.74 4 0.547 337K 0 0.0 0.0 L5 1068/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1316/42 102.66 GB 0.0 13.1 5.8 7.3 19.6 12.3 4.7 3.0 176.8 265.0 75.69 72.48 136 0.557 13M 64K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.1 5.8 7.3 19.6 12.3 4.7 3.0 176.8 265.0 75.69 72.48 136 0.557 13M 64K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.1 5.8 7.3 13.0 5.7 0.0 0.0 236.3 235.2 56.63 54.84 35 1.618 13M 64K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 353.7 19.06 17.64 101 0.189 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.5 total, 31.3 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.59 GB write, 637.59 MB/s write, 13.07 GB read, 425.41 MB/s read, 75.7 seconds Interval compaction: 19.59 GB write, 641.64 MB/s write, 13.07 GB read, 428.11 MB/s read, 75.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 10, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2780018 Average: 2.3112 StdDev: 7.40 Min: 0 Median: 1.5176 Max: 2959 Percentiles: P50: 1.52 P75: 1.91 P99: 6.05 P99.9: 13.91 P99.99: 141.13 ------------------------------------------------------ [ 0, 1 ] 467379 16.812% 16.812% ### ( 1, 2 ] 1782444 64.116% 80.928% ############# ( 2, 3 ] 314938 11.329% 92.257% ## ( 3, 4 ] 112130 4.033% 96.290% # ( 4, 6 ] 75026 2.699% 98.989% # ( 6, 10 ] 22130 0.796% 99.785% ( 10, 15 ] 4080 0.147% 99.932% ( 15, 22 ] 509 0.018% 99.950% ( 22, 34 ] 63 0.002% 99.953% ( 34, 51 ] 34 0.001% 99.954% ( 51, 76 ] 16 0.001% 99.954% ( 76, 110 ] 467 0.017% 99.971% ( 110, 170 ] 1012 0.036% 100.008% ( 170, 250 ] 298 0.011% 100.018% ( 250, 380 ] 124 0.004% 100.023% ( 380, 580 ] 52 0.002% 100.025% ( 580, 870 ] 26 0.001% 100.026% ( 870, 1300 ] 16 0.001% 100.026% ( 1300, 1900 ] 13 0.000% 100.027% ( 1900, 2900 ] 4 0.000% 100.027% ( 2900, 4400 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 579902 Average: 3.3731 StdDev: 36.63 Min: 0 Median: 1.8218 Max: 9224 Percentiles: P50: 1.82 P75: 2.66 P99: 8.89 P99.9: 131.78 P99.99: 230.85 ------------------------------------------------------ [ 0, 1 ] 12711 2.192% 2.192% ( 1, 2 ] 337345 58.173% 60.365% ############ ( 2, 3 ] 128299 22.124% 82.489% #### ( 3, 4 ] 47605 8.209% 90.698% ## ( 4, 6 ] 39369 6.789% 97.487% # ( 6, 10 ] 12161 2.097% 99.584% ( 10, 15 ] 1359 0.234% 99.818% ( 15, 22 ] 108 0.019% 99.837% ( 22, 34 ] 10 0.002% 99.839% ( 34, 51 ] 6 0.001% 99.840% ( 51, 76 ] 1 0.000% 99.840% ( 76, 110 ] 164 0.028% 99.868% ( 110, 170 ] 510 0.088% 99.956% ( 170, 250 ] 259 0.045% 100.001% ( 250, 380 ] 107 0.018% 100.019% ( 380, 580 ] 86 0.015% 100.034% ( 580, 870 ] 13 0.002% 100.036% ( 870, 1300 ] 5 0.001% 100.037% ( 1300, 1900 ] 3 0.001% 100.038% ( 1900, 2900 ] 10 0.002% 100.039% ( 2900, 4400 ] 15 0.003% 100.042% ( 4400, 6600 ] 4 0.001% 100.043% ( 6600, 9900 ] 6 0.001% 100.044% ** Level 2 read latency histogram (micros): Count: 100771 Average: 2.2301 StdDev: 6.67 Min: 0 Median: 1.4313 Max: 957 Percentiles: P50: 1.43 P75: 1.83 P99: 6.73 P99.9: 90.36 P99.99: 244.93 ------------------------------------------------------ [ 0, 1 ] 23358 23.179% 23.179% ##### ( 1, 2 ] 62661 62.182% 85.361% ############ ( 2, 3 ] 8791 8.724% 94.085% ## ( 3, 4 ] 2946 2.923% 97.008% # ( 4, 6 ] 1849 1.835% 98.843% ( 6, 10 ] 863 0.856% 99.699% ( 10, 15 ] 151 0.150% 99.849% ( 15, 22 ] 18 0.018% 99.867% ( 22, 34 ] 8 0.008% 99.875% ( 34, 51 ] 1 0.001% 99.876% ( 51, 76 ] 1 0.001% 99.877% ( 76, 110 ] 55 0.055% 99.932% ( 110, 170 ] 43 0.043% 99.974% ( 170, 250 ] 17 0.017% 99.991% ( 250, 380 ] 4 0.004% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 387548 Average: 4.0410 StdDev: 59.91 Min: 0 Median: 1.7064 Max: 7804 Percentiles: P50: 1.71 P75: 2.43 P99: 9.12 P99.9: 158.74 P99.99: 358.85 ------------------------------------------------------ [ 0, 1 ] 30563 7.886% 7.886% ## ( 1, 2 ] 231047 59.618% 67.504% ############ ( 2, 3 ] 67729 17.476% 84.980% ### ( 3, 4 ] 27602 7.122% 92.102% # ( 4, 6 ] 21106 5.446% 97.548% # ( 6, 10 ] 7214 1.861% 99.410% ( 10, 15 ] 1000 0.258% 99.668% ( 15, 22 ] 131 0.034% 99.702% ( 22, 34 ] 86 0.022% 99.724% ( 34, 51 ] 230 0.059% 99.783% ( 51, 76 ] 61 0.016% 99.799% ( 76, 110 ] 167 0.043% 99.842% ( 110, 170 ] 280 0.072% 99.914% ( 170, 250 ] 174 0.045% 99.959% ( 250, 380 ] 146 0.038% 99.997% ( 380, 580 ] 82 0.021% 100.018% ( 580, 870 ] 54 0.014% 100.032% ( 870, 1300 ] 17 0.004% 100.036% ( 1300, 1900 ] 23 0.006% 100.042% ( 1900, 2900 ] 23 0.006% 100.048% ( 2900, 4400 ] 42 0.011% 100.059% ( 4400, 6600 ] 9 0.002% 100.061% ( 6600, 9900 ] 6 0.002% 100.063% ** Level 4 read latency histogram (micros): Count: 4680 Average: 75.1085 StdDev: 355.30 Min: 0 Median: 2.2882 Max: 5568 Percentiles: P50: 2.29 P75: 3.69 P99: 1508.00 P99.9: 4980.80 P99.99: 5568.00 ------------------------------------------------------ [ 0, 1 ] 133 2.842% 2.842% # ( 1, 2 ] 1873 40.021% 42.863% ######## ( 2, 3 ] 1159 24.765% 67.628% ##### ( 3, 4 ] 500 10.684% 78.312% ## ( 4, 6 ] 338 7.222% 85.534% # ( 6, 10 ] 146 3.120% 88.654% # ( 10, 15 ] 37 0.791% 89.444% ( 15, 22 ] 2 0.043% 89.487% ( 22, 34 ] 1 0.021% 89.509% ( 76, 110 ] 9 0.192% 89.701% ( 110, 170 ] 73 1.560% 91.261% ( 170, 250 ] 70 1.496% 92.756% ( 250, 380 ] 86 1.838% 94.594% ( 380, 580 ] 85 1.816% 96.410% ( 580, 870 ] 70 1.496% 97.906% ( 870, 1300 ] 46 0.983% 98.889% ( 1300, 1900 ] 15 0.321% 99.209% ( 1900, 2900 ] 11 0.235% 99.444% ( 2900, 4400 ] 20 0.427% 99.872% ( 4400, 6600 ] 5 0.107% 99.979% ** Level 5 read latency histogram (micros): Count: 60 Average: 550.6000 StdDev: 670.44 Min: 115 Median: 245.5556 Max: 2643 Percentiles: P50: 245.56 P75: 652.50 P99: 2643.00 P99.9: 2643.00 P99.99: 2643.00 ------------------------------------------------------ ( 110, 170 ] 13 21.667% 21.667% #### ( 170, 250 ] 18 30.000% 51.667% ###### ( 250, 380 ] 7 11.667% 63.333% ## ( 380, 580 ] 5 8.333% 71.667% ## ( 580, 870 ] 8 13.333% 85.000% ### ( 870, 1300 ] 3 5.000% 90.000% # ( 1300, 1900 ] 1 1.667% 91.667% ( 1900, 2900 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 31.5 total, 3.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 218.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.256 H:M:S, 35.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 279.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.472 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/09-00:09:21 ... thread 0: (1000000,8000000) ops and (215739.8,222871.7) ops/second in (4.635214,35.895095) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/6 3.93 GB 251.7 7.0 0.0 7.0 14.6 7.6 0.0 1.9 139.6 291.3 51.44 48.29 141 0.365 7291K 9028 0.0 0.0 L1 14/14 1.16 GB 0.0 3.5 3.5 0.0 3.5 3.5 0.2 1.0 227.2 224.1 15.81 15.44 2 7.903 3646K 49K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.3 1.8 244.2 244.0 1.43 1.39 2 0.714 354K 182 0.0 0.0 L3 23/0 968.80 MB 1.0 3.7 2.3 1.4 3.7 2.3 0.3 1.6 218.0 217.4 17.21 16.20 8 2.151 3809K 9947 0.0 0.0 L4 186/0 9.75 GB 1.0 1.6 1.5 0.1 1.6 1.5 1.0 1.0 128.3 128.1 12.77 8.13 26 0.491 1641K 1888 0.0 0.0 L5 1084/0 87.91 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1325/20 103.70 GB 0.0 16.1 7.5 8.6 23.7 15.1 6.0 3.1 167.4 245.8 98.65 89.46 179 0.551 16M 70K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.1 7.5 8.6 23.7 15.1 6.0 3.1 167.4 245.8 98.65 89.46 179 0.551 16M 70K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.1 7.5 8.6 16.1 7.4 0.0 0.0 217.9 216.9 75.78 68.99 63 1.203 16M 70K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 341.6 22.87 20.47 116 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.1 total, 35.9 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.68 GB write, 671.88 MB/s write, 16.12 GB read, 457.44 MB/s read, 98.7 seconds Interval compaction: 23.68 GB write, 675.60 MB/s write, 16.12 GB read, 459.97 MB/s read, 98.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 28, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3105751 Average: 2.3698 StdDev: 11.60 Min: 0 Median: 1.5304 Max: 4280 Percentiles: P50: 1.53 P75: 1.92 P99: 6.25 P99.9: 14.06 P99.99: 146.87 ------------------------------------------------------ [ 0, 1 ] 498123 16.039% 16.039% ### ( 1, 2 ] 1988621 64.030% 80.069% ############# ( 2, 3 ] 366419 11.798% 91.867% ## ( 3, 4 ] 130686 4.208% 96.075% # ( 4, 6 ] 89225 2.873% 98.948% # ( 6, 10 ] 25606 0.824% 99.772% ( 10, 15 ] 4888 0.157% 99.930% ( 15, 22 ] 590 0.019% 99.949% ( 22, 34 ] 68 0.002% 99.951% ( 34, 51 ] 37 0.001% 99.952% ( 51, 76 ] 18 0.001% 99.953% ( 76, 110 ] 489 0.016% 99.968% ( 110, 170 ] 1091 0.035% 100.004% ( 170, 250 ] 370 0.012% 100.015% ( 250, 380 ] 163 0.005% 100.021% ( 380, 580 ] 79 0.003% 100.023% ( 580, 870 ] 42 0.001% 100.025% ( 870, 1300 ] 22 0.001% 100.025% ( 1300, 1900 ] 21 0.001% 100.026% ( 1900, 2900 ] 14 0.000% 100.026% ( 2900, 4400 ] 13 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 777352 Average: 3.4797 StdDev: 40.42 Min: 0 Median: 1.7866 Max: 9224 Percentiles: P50: 1.79 P75: 2.59 P99: 8.92 P99.9: 142.03 P99.99: 322.88 ------------------------------------------------------ [ 0, 1 ] 28935 3.722% 3.722% # ( 1, 2 ] 457358 58.835% 62.558% ############ ( 2, 3 ] 163021 20.971% 83.529% #### ( 3, 4 ] 59165 7.611% 91.140% ## ( 4, 6 ] 49287 6.340% 97.480% # ( 6, 10 ] 16180 2.081% 99.562% ( 10, 15 ] 1819 0.234% 99.796% ( 15, 22 ] 167 0.021% 99.817% ( 22, 34 ] 14 0.002% 99.819% ( 34, 51 ] 9 0.001% 99.820% ( 51, 76 ] 2 0.000% 99.821% ( 76, 110 ] 301 0.039% 99.859% ( 110, 170 ] 595 0.077% 99.936% ( 170, 250 ] 332 0.043% 99.979% ( 250, 380 ] 161 0.021% 99.999% ( 380, 580 ] 133 0.017% 100.016% ( 580, 870 ] 29 0.004% 100.020% ( 870, 1300 ] 23 0.003% 100.023% ( 1300, 1900 ] 12 0.002% 100.025% ( 1900, 2900 ] 35 0.005% 100.029% ( 2900, 4400 ] 29 0.004% 100.033% ( 4400, 6600 ] 7 0.001% 100.034% ( 6600, 9900 ] 6 0.001% 100.034% ** Level 2 read latency histogram (micros): Count: 100771 Average: 2.2301 StdDev: 6.67 Min: 0 Median: 1.4313 Max: 957 Percentiles: P50: 1.43 P75: 1.83 P99: 6.73 P99.9: 90.36 P99.99: 244.93 ------------------------------------------------------ [ 0, 1 ] 23358 23.179% 23.179% ##### ( 1, 2 ] 62661 62.182% 85.361% ############ ( 2, 3 ] 8791 8.724% 94.085% ## ( 3, 4 ] 2946 2.923% 97.008% # ( 4, 6 ] 1849 1.835% 98.843% ( 6, 10 ] 863 0.856% 99.699% ( 10, 15 ] 151 0.150% 99.849% ( 15, 22 ] 18 0.018% 99.867% ( 22, 34 ] 8 0.008% 99.875% ( 34, 51 ] 1 0.001% 99.876% ( 51, 76 ] 1 0.001% 99.877% ( 76, 110 ] 55 0.055% 99.932% ( 110, 170 ] 43 0.043% 99.974% ( 170, 250 ] 17 0.017% 99.991% ( 250, 380 ] 4 0.004% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 689647 Average: 5.0250 StdDev: 78.81 Min: 0 Median: 1.8409 Max: 8120 Percentiles: P50: 1.84 P75: 2.75 P99: 9.23 P99.9: 95.44 P99.99: 213.37 ------------------------------------------------------ [ 0, 1 ] 32811 4.758% 4.758% # ( 1, 2 ] 371049 53.803% 58.560% ########### ( 2, 3 ] 150793 21.865% 80.426% #### ( 3, 4 ] 61526 8.921% 89.347% ## ( 4, 6 ] 55199 8.004% 97.351% ## ( 6, 10 ] 14095 2.044% 99.395% ( 10, 15 ] 2561 0.371% 99.766% ( 15, 22 ] 376 0.055% 99.821% ( 22, 34 ] 118 0.017% 99.838% ( 34, 51 ] 242 0.035% 99.873% ( 51, 76 ] 69 0.010% 99.883% ( 76, 110 ] 207 0.030% 99.913% ( 110, 170 ] 377 0.055% 99.968% ( 170, 250 ] 286 0.041% 100.009% ( 250, 380 ] 236 0.034% 100.043% ( 380, 580 ] 183 0.027% 100.070% ( 580, 870 ] 120 0.017% 100.087% ( 870, 1300 ] 70 0.010% 100.097% ( 1300, 1900 ] 74 0.011% 100.108% ( 1900, 2900 ] 91 0.013% 100.121% ( 2900, 4400 ] 143 0.021% 100.142% ( 4400, 6600 ] 28 0.004% 100.146% ( 6600, 9900 ] 12 0.002% 100.148% ** Level 4 read latency histogram (micros): Count: 19434 Average: 73.1785 StdDev: 380.22 Min: 0 Median: 2.1862 Max: 7247 Percentiles: P50: 2.19 P75: 3.46 P99: 2095.47 P99.9: 4572.26 P99.99: 6496.23 ------------------------------------------------------ [ 0, 1 ] 429 2.207% 2.207% ( 1, 2 ] 8404 43.244% 45.451% ######### ( 2, 3 ] 4748 24.431% 69.883% ##### ( 3, 4 ] 2181 11.223% 81.105% ## ( 4, 6 ] 1390 7.152% 88.258% # ( 6, 10 ] 483 2.485% 90.743% ( 10, 15 ] 106 0.545% 91.288% ( 15, 22 ] 10 0.051% 91.340% ( 22, 34 ] 2 0.010% 91.350% ( 34, 51 ] 3 0.015% 91.366% ( 76, 110 ] 38 0.196% 91.561% ( 110, 170 ] 247 1.271% 92.832% ( 170, 250 ] 220 1.132% 93.964% ( 250, 380 ] 279 1.436% 95.400% ( 380, 580 ] 290 1.492% 96.892% ( 580, 870 ] 205 1.055% 97.947% ( 870, 1300 ] 129 0.664% 98.611% ( 1300, 1900 ] 61 0.314% 98.925% ( 1900, 2900 ] 75 0.386% 99.310% ( 2900, 4400 ] 113 0.581% 99.892% ( 4400, 6600 ] 20 0.103% 99.995% ( 6600, 9900 ] 1 0.005% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 679.1500 StdDev: 745.72 Min: 103 Median: 399.0476 Max: 3764 Percentiles: P50: 399.05 P75: 812.00 P99: 3764.00 P99.9: 3764.00 P99.99: 3764.00 ------------------------------------------------------ ( 76, 110 ] 1 0.714% 0.714% ( 110, 170 ] 20 14.286% 15.000% ### ( 170, 250 ] 24 17.143% 32.143% ### ( 250, 380 ] 23 16.429% 48.571% ### ( 380, 580 ] 21 15.000% 63.571% ### ( 580, 870 ] 20 14.286% 77.857% ### ( 870, 1300 ] 13 9.286% 87.143% ## ( 1300, 1900 ] 8 5.714% 92.857% # ( 1900, 2900 ] 6 4.286% 97.143% # ( 2900, 4400 ] 4 2.857% 100.000% # ** DB Stats ** Uptime(secs): 36.1 total, 4.6 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 218.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.797 H:M:S, 35.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 212.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.541 H:M:S, 33.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.761 micros/op 147899 ops/sec 60.136 seconds 8893999 operations; 143.3 MB/s Microseconds per write: Count: 8893999 Average: 6.7613 StdDev: 228.35 Min: 0 Median: 1.7842 Max: 300993 Percentiles: P50: 1.78 P75: 3.11 P99: 10.43 P99.9: 1212.20 P99.99: 2716.45 ------------------------------------------------------ [ 0, 1 ] 1190201 13.382% 13.382% ### ( 1, 2 ] 4153092 46.695% 60.078% ######### ( 2, 3 ] 1194154 13.427% 73.504% ### ( 3, 4 ] 1211762 13.624% 87.129% ### ( 4, 6 ] 906855 10.196% 97.325% ## ( 6, 10 ] 145328 1.634% 98.959% ( 10, 15 ] 42266 0.475% 99.434% ( 15, 22 ] 12564 0.141% 99.575% ( 22, 34 ] 2891 0.033% 99.608% ( 34, 51 ] 437 0.005% 99.613% ( 51, 76 ] 68 0.001% 99.613% ( 76, 110 ] 9 0.000% 99.614% ( 110, 170 ] 8146 0.092% 99.705% ( 170, 250 ] 622 0.007% 99.712% ( 250, 380 ] 244 0.003% 99.715% ( 380, 580 ] 61 0.001% 99.716% ( 580, 870 ] 35 0.000% 99.716% ( 870, 1300 ] 20570 0.231% 99.947% ( 1300, 1900 ] 62 0.001% 99.948% ( 1900, 2900 ] 4584 0.052% 99.999% ( 2900, 4400 ] 29 0.000% 100.000% ( 4400, 6600 ] 3 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 6 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 191224 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8893999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9178606968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 507 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33617017 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28053511245 rocksdb.compact.write.bytes COUNT : 27876219154 rocksdb.flush.write.bytes COUNT : 9116307584 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 44 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 309 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9042368512 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3122176 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28135134667 rocksdb.non.last.level.read.count COUNT : 6800957 rocksdb.block.checksum.compute.count COUNT : 6799987 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.438350 P95 : 5.005757 P99 : 9.491006 P100 : 300990.000000 COUNT : 8893999 SUM : 55964889 rocksdb.compaction.times.micros P50 : 847916.666667 P95 : 3862500.000000 P99 : 14215156.000000 P100 : 14215156.000000 COUNT : 85 SUM : 104740890 rocksdb.compaction.times.cpu_micros P50 : 773000.000000 P95 : 3716666.666667 P99 : 12215000.000000 P100 : 13889163.000000 COUNT : 85 SUM : 96163232 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 540.493827 P95 : 1120.833333 P99 : 3950.000000 P100 : 5500.000000 COUNT : 130 SUM : 87487 rocksdb.compaction.outfile.sync.micros P50 : 694.017094 P95 : 3933.333333 P99 : 8184.000000 P100 : 12340.000000 COUNT : 356 SUM : 380239 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.031579 P95 : 470.000000 P99 : 1666.000000 P100 : 3085.000000 COUNT : 239 SUM : 45295 rocksdb.table.open.io.micros P50 : 760.461957 P95 : 4365.000000 P99 : 8866.846154 P100 : 10544.000000 COUNT : 507 SUM : 635082 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.647826 P95 : 7.538203 P99 : 11.176666 P100 : 14275.000000 COUNT : 6798651 SUM : 35796398 rocksdb.read.block.get.micros P50 : 307.604790 P95 : 1695.217391 P99 : 3460.769231 P100 : 8141.000000 COUNT : 1014 SUM : 470966 rocksdb.write.raw.block.micros P50 : 0.515229 P95 : 0.978934 P99 : 3.344795 P100 : 11913.000000 COUNT : 8959734 SUM : 17777399 rocksdb.numfiles.in.singlecompaction P50 : 3.134615 P95 : 6.800000 P99 : 21.580000 P100 : 29.000000 COUNT : 112 SUM : 429 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565760 P95 : 1169.023901 P99 : 2427.618007 P100 : 300695.000000 COUNT : 218062 SUM : 33638331 rocksdb.sst.read.micros P50 : 1.566890 P95 : 4.307508 P99 : 8.106749 P100 : 9224.000000 COUNT : 6801316 SUM : 21164507 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8893999 SUM : 9178606968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 201818.181818 P95 : 339375.000000 P99 : 508250.000000 P100 : 554320.000000 COUNT : 130 SUM : 25348077 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 319 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0