[2024-12-14 13:37:45.333918] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 24.03.0 initialization... [2024-12-14 13:37:45.334193] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1702586 ] Set seed to 1734179865327275 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-14 13:37:45.462170] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-14 13:37:45.571371] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-14 13:37:45.571420] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1702586' to capture a snapshot of events at runtime. [2024-12-14 13:37:45.571431] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-14 13:37:45.571456] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-14 13:37:45.571465] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1702586 for offline analysis/debug. [2024-12-14 13:37:45.572966] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 14 13:37:53 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/14-13:37:56 ... thread 0: (1000000,1000000) ops and (357971.6,357971.6) ops/second in (2.793518,2.793518) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 504.03 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 352.3 2.32 2.09 12 0.194 0 0 0.0 0.0 L1 3/3 188.87 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 256.4 256.3 0.74 0.70 1 0.737 191K 94 0.0 0.0 L2 2/1 125.97 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 239.0 238.9 0.53 0.51 1 0.527 127K 33 0.0 0.0 L3 10/0 867.33 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 112/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1175/12 96.94 GB 0.0 0.3 0.2 0.1 1.1 1.0 0.4 1.4 87.8 315.9 3.59 3.30 14 0.256 319K 127 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.2 1.4 87.8 315.9 3.59 3.30 14 0.256 319K 127 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 249.2 249.0 1.26 1.22 2 0.632 319K 127 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 352.3 2.32 2.09 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 379.37 MB/s write, 0.31 GB read, 105.39 MB/s read, 3.6 seconds Interval compaction: 1.11 GB write, 405.62 MB/s write, 0.31 GB read, 112.68 MB/s read, 3.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 116352 Average: 2.0188 StdDev: 21.13 Min: 0 Median: 1.3015 Max: 4265 Percentiles: P50: 1.30 P75: 1.71 P99: 4.92 P99.9: 10.00 P99.99: 135.24 ------------------------------------------------------ [ 0, 1 ] 36614 31.468% 31.468% ###### ( 1, 2 ] 71531 61.478% 92.946% ############ ( 2, 3 ] 4388 3.771% 96.718% # ( 3, 4 ] 2126 1.827% 98.545% ( 4, 6 ] 1158 0.995% 99.540% ( 6, 10 ] 421 0.362% 99.902% ( 10, 15 ] 79 0.068% 99.970% ( 15, 22 ] 15 0.013% 99.983% ( 22, 34 ] 4 0.003% 99.986% ( 34, 51 ] 1 0.001% 99.987% ( 51, 76 ] 2 0.002% 99.989% ( 110, 170 ] 8 0.007% 99.996% ( 170, 250 ] 2 0.002% 99.997% ( 250, 380 ] 2 0.002% 99.999% ( 380, 580 ] 4 0.003% 100.003% ( 870, 1300 ] 1 0.001% 100.003% ( 1300, 1900 ] 3 0.003% 100.006% ( 1900, 2900 ] 2 0.002% 100.008% ( 2900, 4400 ] 2 0.002% 100.009% ** Level 1 read latency histogram (micros): Count: 22339 Average: 1.9268 StdDev: 7.76 Min: 1 Median: 1.3318 Max: 973 Percentiles: P50: 1.33 P75: 1.72 P99: 4.26 P99.9: 11.17 P99.99: 456.61 ------------------------------------------------------ [ 0, 1 ] 6393 28.618% 28.618% ###### ( 1, 2 ] 14396 64.443% 93.061% ############# ( 2, 3 ] 938 4.199% 97.260% # ( 3, 4 ] 365 1.634% 98.894% ( 4, 6 ] 185 0.828% 99.722% ( 6, 10 ] 35 0.157% 99.879% ( 10, 15 ] 20 0.090% 99.969% ( 15, 22 ] 1 0.004% 99.973% ( 22, 34 ] 1 0.004% 99.978% ( 51, 76 ] 1 0.004% 99.982% ( 170, 250 ] 1 0.004% 99.987% ( 380, 580 ] 2 0.009% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 6611 Average: 4.2045 StdDev: 58.62 Min: 1 Median: 1.7282 Max: 2883 Percentiles: P50: 1.73 P75: 2.42 P99: 7.82 P99.9: 201.12 P99.99: 2679.63 ------------------------------------------------------ [ 0, 1 ] 405 6.126% 6.126% # ( 1, 2 ] 3983 60.248% 66.374% ############ ( 2, 3 ] 1343 20.315% 86.689% #### ( 3, 4 ] 376 5.687% 92.376% # ( 4, 6 ] 397 6.005% 98.381% # ( 6, 10 ] 92 1.392% 99.773% ( 10, 15 ] 2 0.030% 99.803% ( 15, 22 ] 1 0.015% 99.818% ( 22, 34 ] 1 0.015% 99.834% ( 51, 76 ] 4 0.061% 99.894% ( 110, 170 ] 1 0.015% 99.909% ( 170, 250 ] 1 0.015% 99.924% ( 380, 580 ] 1 0.015% 99.939% ( 580, 870 ] 1 0.015% 99.955% ( 1300, 1900 ] 1 0.015% 99.970% ( 1900, 2900 ] 3 0.045% 100.015% ** Level 3 read latency histogram (micros): Count: 40 Average: 3042.4250 StdDev: 3147.44 Min: 173 Median: 1085.0000 Max: 8914 Percentiles: P50: 1085.00 P75: 6900.00 P99: 8914.00 P99.9: 8914.00 P99.99: 8914.00 ------------------------------------------------------ ( 170, 250 ] 6 15.000% 15.000% ### ( 380, 580 ] 5 12.500% 27.500% ### ( 580, 870 ] 7 17.500% 45.000% #### ( 870, 1300 ] 4 10.000% 55.000% ## ( 1300, 1900 ] 2 5.000% 60.000% # ( 2900, 4400 ] 3 7.500% 67.500% ## ( 4400, 6600 ] 2 5.000% 72.500% # ( 6600, 9900 ] 11 27.500% 100.000% ###### ** Level 4 read latency histogram (micros): Count: 30 Average: 3174.2667 StdDev: 3109.32 Min: 130 Median: 2100.0000 Max: 8856 Percentiles: P50: 2100.00 P75: 5775.00 P99: 8856.00 P99.9: 8856.00 P99.99: 8856.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 2 6.667% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 380, 580 ] 1 3.333% 23.333% # ( 580, 870 ] 6 20.000% 43.333% #### ( 870, 1300 ] 1 3.333% 46.667% # ( 1900, 2900 ] 5 16.667% 63.333% ### ( 2900, 4400 ] 1 3.333% 66.667% # ( 4400, 6600 ] 4 13.333% 80.000% ### ( 6600, 9900 ] 6 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 329.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.178 H:M:S, 6.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 352.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.178 H:M:S, 6.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/14-13:37:59 ... thread 0: (1000000,2000000) ops and (327871.3,342260.9) ops/second in (3.049977,5.843495) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.23 GB 94.4 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.5 318.2 8.31 7.71 29 0.287 831K 847 0.0 0.0 L1 1/0 3.88 MB 0.4 0.6 0.4 0.2 0.6 0.4 0.1 1.4 245.0 244.6 2.57 2.49 2 1.286 639K 878 0.0 0.0 L2 5/3 437.26 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 239.0 238.9 0.53 0.51 1 0.527 127K 33 0.0 0.0 L3 18/1 992.20 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.2 1.0 225.0 225.0 0.56 0.51 1 0.555 126K 0 0.0 0.0 L4 112/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1185/8 97.92 GB 0.0 1.7 0.6 1.0 3.4 2.4 0.8 1.9 142.1 294.6 11.97 11.22 33 0.363 1725K 1758 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.6 1.0 3.4 2.4 0.6 1.9 142.1 294.6 11.97 11.22 33 0.363 1725K 1758 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.6 1.0 1.7 0.6 0.0 0.0 249.6 249.3 6.81 6.62 7 0.973 1725K 1758 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.3 5.16 4.61 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.44 GB write, 583.70 MB/s write, 1.66 GB read, 281.47 MB/s read, 12.0 seconds Interval compaction: 3.44 GB write, 603.02 MB/s write, 1.66 GB read, 290.79 MB/s read, 12.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 383996 Average: 2.2052 StdDev: 13.28 Min: 0 Median: 1.4934 Max: 4265 Percentiles: P50: 1.49 P75: 1.88 P99: 5.62 P99.9: 10.52 P99.99: 16.92 ------------------------------------------------------ [ 0, 1 ] 69560 18.115% 18.115% #### ( 1, 2 ] 248170 64.628% 82.743% ############# ( 2, 3 ] 44063 11.475% 94.218% ## ( 3, 4 ] 11352 2.956% 97.174% # ( 4, 6 ] 8680 2.260% 99.435% ( 6, 10 ] 1749 0.455% 99.890% ( 10, 15 ] 375 0.098% 99.988% ( 15, 22 ] 35 0.009% 99.997% ( 22, 34 ] 9 0.002% 99.999% ( 34, 51 ] 2 0.001% 100.000% ( 51, 76 ] 4 0.001% 100.001% ( 110, 170 ] 15 0.004% 100.005% ( 170, 250 ] 7 0.002% 100.007% ( 250, 380 ] 8 0.002% 100.009% ( 380, 580 ] 13 0.003% 100.012% ( 580, 870 ] 3 0.001% 100.013% ( 870, 1300 ] 4 0.001% 100.014% ( 1300, 1900 ] 3 0.001% 100.015% ( 1900, 2900 ] 3 0.001% 100.015% ( 2900, 4400 ] 2 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 109929 Average: 2.3635 StdDev: 9.44 Min: 1 Median: 1.6192 Max: 1997 Percentiles: P50: 1.62 P75: 2.04 P99: 5.74 P99.9: 9.98 P99.99: 210.28 ------------------------------------------------------ [ 0, 1 ] 11748 10.687% 10.687% ## ( 1, 2 ] 69793 63.489% 74.176% ############# ( 2, 3 ] 20722 18.850% 93.026% #### ( 3, 4 ] 3615 3.288% 96.315% # ( 4, 6 ] 3388 3.082% 99.397% # ( 6, 10 ] 556 0.506% 99.903% ( 10, 15 ] 84 0.076% 99.979% ( 15, 22 ] 6 0.005% 99.985% ( 22, 34 ] 2 0.002% 99.986% ( 34, 51 ] 2 0.002% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 170, 250 ] 2 0.002% 99.991% ( 250, 380 ] 1 0.001% 99.992% ( 380, 580 ] 4 0.004% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31718 Average: 2.8052 StdDev: 26.79 Min: 1 Median: 1.6885 Max: 2883 Percentiles: P50: 1.69 P75: 2.25 P99: 6.05 P99.9: 9.99 P99.99: 1796.92 ------------------------------------------------------ [ 0, 1 ] 1646 5.189% 5.189% # ( 1, 2 ] 20644 65.086% 70.276% ############# ( 2, 3 ] 5908 18.627% 88.902% #### ( 3, 4 ] 1605 5.060% 93.962% # ( 4, 6 ] 1594 5.026% 98.988% # ( 6, 10 ] 290 0.914% 99.902% ( 10, 15 ] 16 0.050% 99.953% ( 15, 22 ] 1 0.003% 99.956% ( 22, 34 ] 2 0.006% 99.962% ( 51, 76 ] 4 0.013% 99.975% ( 110, 170 ] 1 0.003% 99.978% ( 170, 250 ] 1 0.003% 99.981% ( 380, 580 ] 1 0.003% 99.984% ( 580, 870 ] 1 0.003% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 3 0.009% 100.000% ** Level 3 read latency histogram (micros): Count: 17685 Average: 9.3715 StdDev: 208.23 Min: 1 Median: 1.6938 Max: 8914 Percentiles: P50: 1.69 P75: 2.27 P99: 5.98 P99.9: 1394.50 P99.99: 8914.00 ------------------------------------------------------ [ 0, 1 ] 1272 7.193% 7.193% # ( 1, 2 ] 10912 61.702% 68.895% ############ ( 2, 3 ] 4032 22.799% 91.694% ##### ( 3, 4 ] 660 3.732% 95.426% # ( 4, 6 ] 639 3.613% 99.039% # ( 6, 10 ] 114 0.645% 99.683% ( 10, 15 ] 12 0.068% 99.751% ( 22, 34 ] 1 0.006% 99.757% ( 170, 250 ] 7 0.040% 99.796% ( 250, 380 ] 1 0.006% 99.802% ( 380, 580 ] 5 0.028% 99.830% ( 580, 870 ] 7 0.040% 99.870% ( 870, 1300 ] 5 0.028% 99.898% ( 1300, 1900 ] 2 0.011% 99.910% ( 2900, 4400 ] 3 0.017% 99.926% ( 4400, 6600 ] 2 0.011% 99.938% ( 6600, 9900 ] 11 0.062% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3174.2667 StdDev: 3109.32 Min: 130 Median: 2100.0000 Max: 8856 Percentiles: P50: 2100.00 P75: 5775.00 P99: 8856.00 P99.9: 8856.00 P99.99: 8856.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 2 6.667% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 380, 580 ] 1 3.333% 23.333% # ( 580, 870 ] 6 20.000% 43.333% #### ( 870, 1300 ] 1 3.333% 46.667% # ( 1900, 2900 ] 5 16.667% 63.333% ### ( 2900, 4400 ] 1 3.333% 66.667% # ( 4400, 6600 ] 4 13.333% 80.000% ### ( 6600, 9900 ] 6 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 325.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.550 H:M:S, 9.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.372 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-13:38:02 ... thread 0: (1000000,3000000) ops and (326700.9,336912.1) ops/second in (3.060904,8.904399) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 2.21 GB 12.6 1.9 0.0 1.9 4.7 2.8 0.0 1.7 126.2 309.3 15.47 14.47 47 0.329 1982K 2091 0.0 0.0 L1 1/1 3.88 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 245.0 244.6 2.57 2.49 2 1.286 639K 878 0.0 0.0 L2 2/0 50.98 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 239.0 238.9 0.53 0.51 1 0.527 127K 33 0.0 0.0 L3 30/0 988.52 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.2 1.2 196.6 196.4 3.17 2.76 2 1.586 633K 518 0.0 0.0 L4 152/0 9.48 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1240/11 98.90 GB 0.0 3.3 1.0 2.3 6.0 3.8 1.5 2.2 153.3 283.5 21.74 20.23 52 0.418 3383K 3520 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 1.0 2.3 6.0 3.8 1.4 2.2 153.3 283.5 21.74 20.23 52 0.418 3383K 3520 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 1.0 2.3 3.3 1.0 0.0 0.0 241.7 241.5 13.79 13.14 12 1.149 3383K 3520 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 356.3 7.96 7.10 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.02 GB write, 677.33 MB/s write, 3.25 GB read, 366.20 MB/s read, 21.7 seconds Interval compaction: 6.02 GB write, 692.04 MB/s write, 3.25 GB read, 374.16 MB/s read, 21.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 648941 Average: 2.1924 StdDev: 12.99 Min: 0 Median: 1.4875 Max: 4265 Percentiles: P50: 1.49 P75: 1.87 P99: 5.58 P99.9: 10.83 P99.99: 17.17 ------------------------------------------------------ [ 0, 1 ] 117732 18.142% 18.142% #### ( 1, 2 ] 424123 65.356% 83.498% ############# ( 2, 3 ] 71643 11.040% 94.538% ## ( 3, 4 ] 18391 2.834% 97.372% # ( 4, 6 ] 13359 2.059% 99.431% ( 6, 10 ] 2933 0.452% 99.883% ( 10, 15 ] 675 0.104% 99.987% ( 15, 22 ] 68 0.010% 99.997% ( 22, 34 ] 14 0.002% 100.000% ( 34, 51 ] 5 0.001% 100.000% ( 51, 76 ] 4 0.001% 100.001% ( 110, 170 ] 20 0.003% 100.004% ( 170, 250 ] 13 0.002% 100.006% ( 250, 380 ] 12 0.002% 100.008% ( 380, 580 ] 18 0.003% 100.011% ( 580, 870 ] 9 0.001% 100.012% ( 870, 1300 ] 8 0.001% 100.013% ( 1300, 1900 ] 6 0.001% 100.014% ( 1900, 2900 ] 3 0.000% 100.015% ( 2900, 4400 ] 5 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 146061 Average: 2.3774 StdDev: 8.21 Min: 1 Median: 1.6426 Max: 1997 Percentiles: P50: 1.64 P75: 2.12 P99: 5.74 P99.9: 9.92 P99.99: 37.35 ------------------------------------------------------ [ 0, 1 ] 13526 9.261% 9.261% ## ( 1, 2 ] 92606 63.402% 72.663% ############# ( 2, 3 ] 29325 20.077% 92.740% #### ( 3, 4 ] 4997 3.421% 96.161% # ( 4, 6 ] 4753 3.254% 99.415% # ( 6, 10 ] 722 0.494% 99.910% ( 10, 15 ] 104 0.071% 99.981% ( 15, 22 ] 11 0.008% 99.988% ( 22, 34 ] 2 0.001% 99.990% ( 34, 51 ] 2 0.001% 99.991% ( 51, 76 ] 1 0.001% 99.992% ( 170, 250 ] 2 0.001% 99.993% ( 250, 380 ] 1 0.001% 99.994% ( 380, 580 ] 4 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31718 Average: 2.8052 StdDev: 26.79 Min: 1 Median: 1.6885 Max: 2883 Percentiles: P50: 1.69 P75: 2.25 P99: 6.05 P99.9: 9.99 P99.99: 1796.92 ------------------------------------------------------ [ 0, 1 ] 1646 5.189% 5.189% # ( 1, 2 ] 20644 65.086% 70.276% ############# ( 2, 3 ] 5908 18.627% 88.902% #### ( 3, 4 ] 1605 5.060% 93.962% # ( 4, 6 ] 1594 5.026% 98.988% # ( 6, 10 ] 290 0.914% 99.902% ( 10, 15 ] 16 0.050% 99.953% ( 15, 22 ] 1 0.003% 99.956% ( 22, 34 ] 2 0.006% 99.962% ( 51, 76 ] 4 0.013% 99.975% ( 110, 170 ] 1 0.003% 99.978% ( 170, 250 ] 1 0.003% 99.981% ( 380, 580 ] 1 0.003% 99.984% ( 580, 870 ] 1 0.003% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 3 0.009% 100.000% ** Level 3 read latency histogram (micros): Count: 28897 Average: 6.7730 StdDev: 163.00 Min: 0 Median: 1.6962 Max: 8914 Percentiles: P50: 1.70 P75: 2.27 P99: 6.25 P99.9: 625.70 P99.99: 8914.00 ------------------------------------------------------ [ 0, 1 ] 2014 6.970% 6.970% # ( 1, 2 ] 17860 61.806% 68.775% ############ ( 2, 3 ] 6564 22.715% 91.490% ##### ( 3, 4 ] 1076 3.724% 95.214% # ( 4, 6 ] 1083 3.748% 98.962% # ( 6, 10 ] 177 0.613% 99.574% ( 10, 15 ] 38 0.132% 99.706% ( 15, 22 ] 9 0.031% 99.737% ( 22, 34 ] 22 0.076% 99.813% ( 34, 51 ] 2 0.007% 99.820% ( 110, 170 ] 3 0.010% 99.830% ( 170, 250 ] 10 0.035% 99.865% ( 250, 380 ] 3 0.010% 99.875% ( 380, 580 ] 6 0.021% 99.896% ( 580, 870 ] 7 0.024% 99.920% ( 870, 1300 ] 5 0.017% 99.938% ( 1300, 1900 ] 2 0.007% 99.945% ( 2900, 4400 ] 3 0.010% 99.955% ( 4400, 6600 ] 2 0.007% 99.962% ( 6600, 9900 ] 11 0.038% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3174.2667 StdDev: 3109.32 Min: 130 Median: 2100.0000 Max: 8856 Percentiles: P50: 2100.00 P75: 5775.00 P99: 8856.00 P99.9: 8856.00 P99.99: 8856.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 2 6.667% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 380, 580 ] 1 3.333% 23.333% # ( 580, 870 ] 6 20.000% 43.333% #### ( 870, 1300 ] 1 3.333% 46.667% # ( 1900, 2900 ] 5 16.667% 63.333% ### ( 2900, 4400 ] 1 3.333% 66.667% # ( 4400, 6600 ] 4 13.333% 80.000% ### ( 6600, 9900 ] 6 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 879.1500 StdDev: 1230.05 Min: 81 Median: 160.0000 Max: 4370 Percentiles: P50: 160.00 P75: 1300.00 P99: 4250.00 P99.9: 4370.00 P99.99: 4370.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 6 30.000% 55.000% ###### ( 250, 380 ] 1 5.000% 60.000% # ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.1 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.948 H:M:S, 10.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-13:38:06 ... thread 0: (1000000,4000000) ops and (293158.1,324793.2) ops/second in (3.411129,12.315528) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.26 GB 94.4 2.7 0.0 2.7 6.5 3.8 0.0 1.7 128.2 308.6 21.63 20.24 66 0.328 2814K 2964 0.0 0.0 L1 1/1 3.88 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 245.0 244.6 2.57 2.49 2 1.286 639K 878 0.0 0.0 L2 2/0 50.98 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 239.0 238.9 0.53 0.51 1 0.527 127K 33 0.0 0.0 L3 30/0 988.52 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.2 1.2 196.6 196.4 3.17 2.76 2 1.586 633K 518 0.0 0.0 L4 152/0 9.48 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/15 99.95 GB 0.0 4.1 1.0 3.1 7.9 4.8 1.5 2.1 148.8 288.6 27.90 26.01 71 0.393 4215K 4393 0.0 0.0 Int 0/0 0.00 KB 0.0 4.1 1.0 3.1 7.9 4.8 1.4 2.1 148.8 288.6 27.90 26.01 71 0.393 4215K 4393 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.1 1.0 3.1 4.0 1.0 0.0 0.0 245.7 245.5 16.89 16.19 15 1.126 4215K 4393 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 354.9 11.01 9.82 56 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.3 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.86 GB write, 643.65 MB/s write, 4.05 GB read, 331.82 MB/s read, 27.9 seconds Interval compaction: 7.86 GB write, 653.76 MB/s write, 4.05 GB read, 337.03 MB/s read, 27.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 16, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1054355 Average: 2.2583 StdDev: 12.82 Min: 0 Median: 1.5218 Max: 4265 Percentiles: P50: 1.52 P75: 1.90 P99: 5.58 P99.9: 9.99 P99.99: 18.20 ------------------------------------------------------ [ 0, 1 ] 163441 15.502% 15.502% ### ( 1, 2 ] 697026 66.109% 81.611% ############# ( 2, 3 ] 134565 12.763% 94.374% ### ( 3, 4 ] 30643 2.906% 97.280% # ( 4, 6 ] 22987 2.180% 99.460% ( 6, 10 ] 4646 0.441% 99.901% ( 10, 15 ] 899 0.085% 99.986% ( 15, 22 ] 93 0.009% 99.995% ( 22, 34 ] 19 0.002% 99.997% ( 34, 51 ] 8 0.001% 99.997% ( 51, 76 ] 6 0.001% 99.998% ( 76, 110 ] 10 0.001% 99.999% ( 110, 170 ] 100 0.009% 100.008% ( 170, 250 ] 47 0.004% 100.013% ( 250, 380 ] 24 0.002% 100.015% ( 380, 580 ] 38 0.004% 100.019% ( 580, 870 ] 20 0.002% 100.021% ( 870, 1300 ] 15 0.001% 100.022% ( 1300, 1900 ] 10 0.001% 100.023% ( 1900, 2900 ] 4 0.000% 100.023% ( 2900, 4400 ] 7 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 146061 Average: 2.3774 StdDev: 8.21 Min: 1 Median: 1.6426 Max: 1997 Percentiles: P50: 1.64 P75: 2.12 P99: 5.74 P99.9: 9.92 P99.99: 37.35 ------------------------------------------------------ [ 0, 1 ] 13526 9.261% 9.261% ## ( 1, 2 ] 92606 63.402% 72.663% ############# ( 2, 3 ] 29325 20.077% 92.740% #### ( 3, 4 ] 4997 3.421% 96.161% # ( 4, 6 ] 4753 3.254% 99.415% # ( 6, 10 ] 722 0.494% 99.910% ( 10, 15 ] 104 0.071% 99.981% ( 15, 22 ] 11 0.008% 99.988% ( 22, 34 ] 2 0.001% 99.990% ( 34, 51 ] 2 0.001% 99.991% ( 51, 76 ] 1 0.001% 99.992% ( 170, 250 ] 2 0.001% 99.993% ( 250, 380 ] 1 0.001% 99.994% ( 380, 580 ] 4 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31718 Average: 2.8052 StdDev: 26.79 Min: 1 Median: 1.6885 Max: 2883 Percentiles: P50: 1.69 P75: 2.25 P99: 6.05 P99.9: 9.99 P99.99: 1796.92 ------------------------------------------------------ [ 0, 1 ] 1646 5.189% 5.189% # ( 1, 2 ] 20644 65.086% 70.276% ############# ( 2, 3 ] 5908 18.627% 88.902% #### ( 3, 4 ] 1605 5.060% 93.962% # ( 4, 6 ] 1594 5.026% 98.988% # ( 6, 10 ] 290 0.914% 99.902% ( 10, 15 ] 16 0.050% 99.953% ( 15, 22 ] 1 0.003% 99.956% ( 22, 34 ] 2 0.006% 99.962% ( 51, 76 ] 4 0.013% 99.975% ( 110, 170 ] 1 0.003% 99.978% ( 170, 250 ] 1 0.003% 99.981% ( 380, 580 ] 1 0.003% 99.984% ( 580, 870 ] 1 0.003% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 3 0.009% 100.000% ** Level 3 read latency histogram (micros): Count: 28897 Average: 6.7730 StdDev: 163.00 Min: 0 Median: 1.6962 Max: 8914 Percentiles: P50: 1.70 P75: 2.27 P99: 6.25 P99.9: 625.70 P99.99: 8914.00 ------------------------------------------------------ [ 0, 1 ] 2014 6.970% 6.970% # ( 1, 2 ] 17860 61.806% 68.775% ############ ( 2, 3 ] 6564 22.715% 91.490% ##### ( 3, 4 ] 1076 3.724% 95.214% # ( 4, 6 ] 1083 3.748% 98.962% # ( 6, 10 ] 177 0.613% 99.574% ( 10, 15 ] 38 0.132% 99.706% ( 15, 22 ] 9 0.031% 99.737% ( 22, 34 ] 22 0.076% 99.813% ( 34, 51 ] 2 0.007% 99.820% ( 110, 170 ] 3 0.010% 99.830% ( 170, 250 ] 10 0.035% 99.865% ( 250, 380 ] 3 0.010% 99.875% ( 380, 580 ] 6 0.021% 99.896% ( 580, 870 ] 7 0.024% 99.920% ( 870, 1300 ] 5 0.017% 99.938% ( 1300, 1900 ] 2 0.007% 99.945% ( 2900, 4400 ] 3 0.010% 99.955% ( 4400, 6600 ] 2 0.007% 99.962% ( 6600, 9900 ] 11 0.038% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3174.2667 StdDev: 3109.32 Min: 130 Median: 2100.0000 Max: 8856 Percentiles: P50: 2100.00 P75: 5775.00 P99: 8856.00 P99.9: 8856.00 P99.99: 8856.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 2 6.667% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 380, 580 ] 1 3.333% 23.333% # ( 580, 870 ] 6 20.000% 43.333% #### ( 870, 1300 ] 1 3.333% 46.667% # ( 1900, 2900 ] 5 16.667% 63.333% ### ( 2900, 4400 ] 1 3.333% 66.667% # ( 4400, 6600 ] 4 13.333% 80.000% ### ( 6600, 9900 ] 6 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 879.1500 StdDev: 1230.05 Min: 81 Median: 160.0000 Max: 4370 Percentiles: P50: 160.00 P75: 1300.00 P99: 4250.00 P99.9: 4370.00 P99.99: 4370.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 6 30.000% 55.000% ###### ( 250, 380 ] 1 5.000% 60.000% # ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.5 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 314.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.709 H:M:S, 13.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.761 H:M:S, 22.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-13:38:12 ... thread 0: (1000000,5000000) ops and (152306.1,264812.9) ops/second in (6.565724,18.881252) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.03 GB 75.5 3.4 0.0 3.4 8.1 4.7 0.0 1.7 129.7 305.7 27.19 25.29 83 0.328 3582K 3696 0.0 0.0 L1 6/0 577.23 MB 57.7 2.7 2.5 0.2 2.7 2.5 0.1 1.1 232.2 230.4 11.94 11.57 3 3.981 2816K 21K 0.0 0.0 L2 3/1 179.75 MB 0.5 0.1 0.1 0.1 0.1 0.1 2.0 2.0 239.0 238.9 0.53 0.51 1 0.527 127K 33 0.0 0.0 L3 21/7 1.42 GB 0.9 0.6 0.5 0.1 0.6 0.5 1.6 1.2 196.6 196.4 3.17 2.76 2 1.586 633K 518 0.0 0.0 L4 164/18 9.80 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/35 100.79 GB 0.0 6.9 3.1 3.8 11.5 7.7 6.0 2.5 164.6 275.8 42.83 40.13 89 0.481 7159K 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.9 3.1 3.8 11.5 7.7 5.8 2.5 164.6 275.8 42.83 40.13 89 0.481 7159K 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.9 3.1 3.8 6.9 3.1 0.0 0.0 242.1 241.2 29.12 28.07 19 1.533 7159K 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 349.2 13.71 12.06 70 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.1 total, 18.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.54 GB write, 619.20 MB/s write, 6.89 GB read, 369.61 MB/s read, 42.8 seconds Interval compaction: 11.54 GB write, 625.55 MB/s write, 6.89 GB read, 373.40 MB/s read, 42.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 16, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1797905 Average: 2.2919 StdDev: 11.74 Min: 0 Median: 1.5425 Max: 5016 Percentiles: P50: 1.54 P75: 1.92 P99: 5.75 P99.9: 11.15 P99.99: 36.28 ------------------------------------------------------ [ 0, 1 ] 250588 13.938% 13.938% ### ( 1, 2 ] 1195243 66.480% 80.418% ############# ( 2, 3 ] 241419 13.428% 93.845% ### ( 3, 4 ] 55024 3.060% 96.906% # ( 4, 6 ] 43091 2.397% 99.303% ( 6, 10 ] 10368 0.577% 99.879% ( 10, 15 ] 1624 0.090% 99.970% ( 15, 22 ] 334 0.019% 99.988% ( 22, 34 ] 33 0.002% 99.990% ( 34, 51 ] 9 0.001% 99.990% ( 51, 76 ] 7 0.000% 99.991% ( 76, 110 ] 111 0.006% 99.997% ( 110, 170 ] 186 0.010% 100.007% ( 170, 250 ] 89 0.005% 100.012% ( 250, 380 ] 40 0.002% 100.015% ( 380, 580 ] 58 0.003% 100.018% ( 580, 870 ] 40 0.002% 100.020% ( 870, 1300 ] 20 0.001% 100.021% ( 1300, 1900 ] 10 0.001% 100.022% ( 1900, 2900 ] 6 0.000% 100.022% ( 2900, 4400 ] 8 0.000% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 255572 Average: 3.2080 StdDev: 29.21 Min: 1 Median: 1.8141 Max: 3375 Percentiles: P50: 1.81 P75: 2.60 P99: 7.34 P99.9: 13.72 P99.99: 116.94 ------------------------------------------------------ [ 0, 1 ] 14205 5.558% 5.558% # ( 1, 2 ] 139513 54.589% 60.147% ########### ( 2, 3 ] 63688 24.920% 85.066% ##### ( 3, 4 ] 16271 6.367% 91.433% # ( 4, 6 ] 18379 7.191% 98.624% # ( 6, 10 ] 2876 1.125% 99.750% ( 10, 15 ] 520 0.203% 99.953% ( 15, 22 ] 61 0.024% 99.977% ( 22, 34 ] 5 0.002% 99.979% ( 34, 51 ] 4 0.002% 99.980% ( 51, 76 ] 3 0.001% 99.982% ( 76, 110 ] 15 0.006% 99.987% ( 110, 170 ] 73 0.029% 100.016% ( 170, 250 ] 28 0.011% 100.027% ( 250, 380 ] 18 0.007% 100.034% ( 380, 580 ] 26 0.010% 100.044% ( 580, 870 ] 14 0.005% 100.050% ( 870, 1300 ] 17 0.007% 100.056% ( 1300, 1900 ] 19 0.007% 100.064% ( 1900, 2900 ] 18 0.007% 100.071% ( 2900, 4400 ] 3 0.001% 100.072% ** Level 2 read latency histogram (micros): Count: 31718 Average: 2.8052 StdDev: 26.79 Min: 1 Median: 1.6885 Max: 2883 Percentiles: P50: 1.69 P75: 2.25 P99: 6.05 P99.9: 9.99 P99.99: 1796.92 ------------------------------------------------------ [ 0, 1 ] 1646 5.189% 5.189% # ( 1, 2 ] 20644 65.086% 70.276% ############# ( 2, 3 ] 5908 18.627% 88.902% #### ( 3, 4 ] 1605 5.060% 93.962% # ( 4, 6 ] 1594 5.026% 98.988% # ( 6, 10 ] 290 0.914% 99.902% ( 10, 15 ] 16 0.050% 99.953% ( 15, 22 ] 1 0.003% 99.956% ( 22, 34 ] 2 0.006% 99.962% ( 51, 76 ] 4 0.013% 99.975% ( 110, 170 ] 1 0.003% 99.978% ( 170, 250 ] 1 0.003% 99.981% ( 380, 580 ] 1 0.003% 99.984% ( 580, 870 ] 1 0.003% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 3 0.009% 100.000% ** Level 3 read latency histogram (micros): Count: 57658 Average: 14.6774 StdDev: 168.15 Min: 0 Median: 1.8457 Max: 8914 Percentiles: P50: 1.85 P75: 2.69 P99: 296.47 P99.9: 2455.82 P99.99: 5078.81 ------------------------------------------------------ [ 0, 1 ] 2424 4.204% 4.204% # ( 1, 2 ] 31221 54.149% 58.353% ########### ( 2, 3 ] 13976 24.239% 82.592% ##### ( 3, 4 ] 4390 7.614% 90.206% ## ( 4, 6 ] 3479 6.034% 96.240% # ( 6, 10 ] 938 1.627% 97.867% ( 10, 15 ] 176 0.305% 98.172% ( 15, 22 ] 32 0.055% 98.227% ( 22, 34 ] 23 0.040% 98.267% ( 34, 51 ] 2 0.003% 98.271% ( 51, 76 ] 1 0.002% 98.273% ( 76, 110 ] 19 0.033% 98.306% ( 110, 170 ] 166 0.288% 98.593% ( 170, 250 ] 169 0.293% 98.887% ( 250, 380 ] 183 0.317% 99.204% ( 380, 580 ] 177 0.307% 99.511% ( 580, 870 ] 124 0.215% 99.726% ( 870, 1300 ] 56 0.097% 99.823% ( 1300, 1900 ] 26 0.045% 99.868% ( 1900, 2900 ] 33 0.057% 99.925% ( 2900, 4400 ] 36 0.062% 99.988% ( 4400, 6600 ] 4 0.007% 99.995% ( 6600, 9900 ] 11 0.019% 100.014% ** Level 4 read latency histogram (micros): Count: 30 Average: 3174.2667 StdDev: 3109.32 Min: 130 Median: 2100.0000 Max: 8856 Percentiles: P50: 2100.00 P75: 5775.00 P99: 8856.00 P99.9: 8856.00 P99.99: 8856.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 2 6.667% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 380, 580 ] 1 3.333% 23.333% # ( 580, 870 ] 6 20.000% 43.333% #### ( 870, 1300 ] 1 3.333% 46.667% # ( 1900, 2900 ] 5 16.667% 63.333% ### ( 2900, 4400 ] 1 3.333% 66.667% # ( 4400, 6600 ] 4 13.333% 80.000% ### ( 6600, 9900 ] 6 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 60 Average: 932.2833 StdDev: 1177.89 Min: 81 Median: 315.0000 Max: 4370 Percentiles: P50: 315.00 P75: 1450.00 P99: 4271.43 P99.9: 4370.00 P99.99: 4370.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 17 28.333% 38.333% ###### ( 170, 250 ] 4 6.667% 45.000% # ( 250, 380 ] 6 10.000% 55.000% ## ( 380, 580 ] 4 6.667% 61.667% # ( 580, 870 ] 5 8.333% 70.000% ## ( 870, 1300 ] 2 3.333% 73.333% # ( 1300, 1900 ] 4 6.667% 80.000% # ( 1900, 2900 ] 5 8.333% 88.333% ## ( 2900, 4400 ] 7 11.667% 100.000% ## ** DB Stats ** Uptime(secs): 19.1 total, 6.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 257.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.492 H:M:S, 28.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 149.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.783 H:M:S, 57.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/12/14-13:38:15 ... thread 0: (1000000,6000000) ops and (310032.7,271410.7) ops/second in (3.225466,22.106718) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.95 GB 276.5 5.4 0.0 5.4 10.9 5.6 0.0 2.0 145.4 297.3 37.69 35.22 100 0.377 5563K 9248 0.0 0.0 L1 6/0 577.23 MB 57.7 2.7 2.5 0.2 2.7 2.5 0.1 1.1 232.2 230.4 11.94 11.57 3 3.981 2816K 21K 0.0 0.0 L2 2/0 50.98 MB 0.5 0.1 0.1 0.1 0.1 0.1 2.0 2.0 239.0 238.9 0.53 0.51 1 0.527 127K 33 0.0 0.0 L3 15/0 956.28 MB 1.0 0.8 0.6 0.1 0.8 0.6 1.6 1.2 193.3 193.0 4.03 3.48 3 1.344 764K 518 0.0 0.0 L4 162/0 9.73 GB 1.0 0.8 0.6 0.2 0.8 0.6 1.3 1.2 157.5 156.9 5.00 3.61 5 1.000 764K 2183 0.0 0.0 L5 1060/0 87.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/4 101.70 GB 0.0 9.7 3.8 5.9 15.3 9.4 6.6 2.7 168.0 264.3 59.19 54.39 112 0.528 10M 33K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.7 3.8 5.9 15.3 9.4 6.5 2.7 168.0 264.3 59.19 54.39 112 0.528 10M 33K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.7 3.8 5.9 9.7 3.8 0.0 0.0 233.3 232.5 42.63 39.90 29 1.470 10M 33K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 346.2 16.56 14.49 83 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.3 total, 22.1 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.28 GB write, 701.42 MB/s write, 9.71 GB read, 445.96 MB/s read, 59.2 seconds Interval compaction: 15.28 GB write, 707.56 MB/s write, 9.71 GB read, 449.86 MB/s read, 59.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 24, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2111291 Average: 2.3040 StdDev: 11.79 Min: 0 Median: 1.5450 Max: 5016 Percentiles: P50: 1.54 P75: 1.92 P99: 5.76 P99.9: 11.19 P99.99: 32.90 ------------------------------------------------------ [ 0, 1 ] 295892 14.015% 14.015% ### ( 1, 2 ] 1394068 66.029% 80.044% ############# ( 2, 3 ] 285614 13.528% 93.572% ### ( 3, 4 ] 66909 3.169% 96.741% # ( 4, 6 ] 54223 2.568% 99.309% # ( 6, 10 ] 12009 0.569% 99.878% ( 10, 15 ] 1964 0.093% 99.971% ( 15, 22 ] 371 0.018% 99.989% ( 22, 34 ] 34 0.002% 99.990% ( 34, 51 ] 10 0.000% 99.991% ( 51, 76 ] 10 0.000% 99.991% ( 76, 110 ] 133 0.006% 99.997% ( 110, 170 ] 209 0.010% 100.007% ( 170, 250 ] 104 0.005% 100.012% ( 250, 380 ] 55 0.003% 100.015% ( 380, 580 ] 71 0.003% 100.018% ( 580, 870 ] 51 0.002% 100.021% ( 870, 1300 ] 25 0.001% 100.022% ( 1300, 1900 ] 15 0.001% 100.023% ( 1900, 2900 ] 7 0.000% 100.023% ( 2900, 4400 ] 9 0.000% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 310100 Average: 3.3071 StdDev: 33.46 Min: 1 Median: 1.8607 Max: 6444 Percentiles: P50: 1.86 P75: 2.68 P99: 7.73 P99.9: 13.45 P99.99: 25.98 ------------------------------------------------------ [ 0, 1 ] 14499 4.676% 4.676% # ( 1, 2 ] 163290 52.657% 57.333% ########### ( 2, 3 ] 80528 25.968% 83.301% ##### ( 3, 4 ] 21899 7.062% 90.363% # ( 4, 6 ] 24994 8.060% 98.423% ## ( 6, 10 ] 4137 1.334% 99.757% ( 10, 15 ] 642 0.207% 99.964% ( 15, 22 ] 78 0.025% 99.989% ( 22, 34 ] 6 0.002% 99.991% ( 34, 51 ] 5 0.002% 99.993% ( 51, 76 ] 5 0.002% 99.995% ( 76, 110 ] 15 0.005% 99.999% ( 110, 170 ] 74 0.024% 100.023% ( 170, 250 ] 30 0.010% 100.033% ( 250, 380 ] 18 0.006% 100.039% ( 380, 580 ] 26 0.008% 100.047% ( 580, 870 ] 15 0.005% 100.052% ( 870, 1300 ] 17 0.005% 100.057% ( 1300, 1900 ] 23 0.007% 100.065% ( 1900, 2900 ] 22 0.007% 100.072% ( 2900, 4400 ] 6 0.002% 100.074% ( 4400, 6600 ] 2 0.001% 100.074% ** Level 2 read latency histogram (micros): Count: 31718 Average: 2.8052 StdDev: 26.79 Min: 1 Median: 1.6885 Max: 2883 Percentiles: P50: 1.69 P75: 2.25 P99: 6.05 P99.9: 9.99 P99.99: 1796.92 ------------------------------------------------------ [ 0, 1 ] 1646 5.189% 5.189% # ( 1, 2 ] 20644 65.086% 70.276% ############# ( 2, 3 ] 5908 18.627% 88.902% #### ( 3, 4 ] 1605 5.060% 93.962% # ( 4, 6 ] 1594 5.026% 98.988% # ( 6, 10 ] 290 0.914% 99.902% ( 10, 15 ] 16 0.050% 99.953% ( 15, 22 ] 1 0.003% 99.956% ( 22, 34 ] 2 0.006% 99.962% ( 51, 76 ] 4 0.013% 99.975% ( 110, 170 ] 1 0.003% 99.978% ( 170, 250 ] 1 0.003% 99.981% ( 380, 580 ] 1 0.003% 99.984% ( 580, 870 ] 1 0.003% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 3 0.009% 100.000% ** Level 3 read latency histogram (micros): Count: 104785 Average: 12.7685 StdDev: 146.88 Min: 0 Median: 1.9057 Max: 8914 Percentiles: P50: 1.91 P75: 2.76 P99: 223.26 P99.9: 1984.11 P99.99: 3942.26 ------------------------------------------------------ [ 0, 1 ] 2975 2.839% 2.839% # ( 1, 2 ] 54565 52.073% 54.912% ########## ( 2, 3 ] 27551 26.293% 81.205% ##### ( 3, 4 ] 8807 8.405% 89.610% ## ( 4, 6 ] 7495 7.153% 96.763% # ( 6, 10 ] 1646 1.571% 98.334% ( 10, 15 ] 285 0.272% 98.606% ( 15, 22 ] 49 0.047% 98.652% ( 22, 34 ] 23 0.022% 98.674% ( 34, 51 ] 3 0.003% 98.677% ( 51, 76 ] 2 0.002% 98.679% ( 76, 110 ] 19 0.018% 98.697% ( 110, 170 ] 182 0.174% 98.871% ( 170, 250 ] 203 0.194% 99.065% ( 250, 380 ] 239 0.228% 99.293% ( 380, 580 ] 280 0.267% 99.560% ( 580, 870 ] 206 0.197% 99.757% ( 870, 1300 ] 96 0.092% 99.848% ( 1300, 1900 ] 49 0.047% 99.895% ( 1900, 2900 ] 62 0.059% 99.954% ( 2900, 4400 ] 54 0.052% 100.006% ( 4400, 6600 ] 6 0.006% 100.011% ( 6600, 9900 ] 11 0.010% 100.022% ** Level 4 read latency histogram (micros): Count: 150 Average: 713.1933 StdDev: 1869.11 Min: 1 Median: 3.0000 Max: 8856 Percentiles: P50: 3.00 P75: 298.75 P99: 8856.00 P99.9: 8856.00 P99.99: 8856.00 ------------------------------------------------------ [ 0, 1 ] 16 10.667% 10.667% ## ( 1, 2 ] 49 32.667% 43.333% ####### ( 2, 3 ] 10 6.667% 50.000% # ( 3, 4 ] 3 2.000% 52.000% ( 6, 10 ] 1 0.667% 52.667% ( 10, 15 ] 1 0.667% 53.333% ( 15, 22 ] 2 1.333% 54.667% ( 22, 34 ] 1 0.667% 55.333% ( 34, 51 ] 4 2.667% 58.000% # ( 51, 76 ] 1 0.667% 58.667% ( 76, 110 ] 3 2.000% 60.667% ( 110, 170 ] 15 10.000% 70.667% ## ( 170, 250 ] 5 3.333% 74.000% # ( 250, 380 ] 4 2.667% 76.667% # ( 380, 580 ] 7 4.667% 81.333% # ( 580, 870 ] 9 6.000% 87.333% # ( 870, 1300 ] 1 0.667% 88.000% ( 1300, 1900 ] 2 1.333% 89.333% ( 1900, 2900 ] 5 3.333% 92.667% # ( 2900, 4400 ] 1 0.667% 93.333% ( 4400, 6600 ] 4 2.667% 96.000% # ( 6600, 9900 ] 6 4.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 100 Average: 1062.0900 StdDev: 1301.57 Min: 81 Median: 356.3636 Max: 5744 Percentiles: P50: 356.36 P75: 1780.00 P99: 5500.00 P99.9: 5744.00 P99.99: 5744.00 ------------------------------------------------------ ( 76, 110 ] 6 6.000% 6.000% # ( 110, 170 ] 25 25.000% 31.000% ##### ( 170, 250 ] 10 10.000% 41.000% ## ( 250, 380 ] 11 11.000% 52.000% ## ( 380, 580 ] 8 8.000% 60.000% ## ( 580, 870 ] 7 7.000% 67.000% # ( 870, 1300 ] 4 4.000% 71.000% # ( 1300, 1900 ] 5 5.000% 76.000% # ( 1900, 2900 ] 11 11.000% 87.000% ## ( 2900, 4400 ] 11 11.000% 98.000% ## ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 22.3 total, 3.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 264.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.070 H:M:S, 27.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 305.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.578 H:M:S, 17.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-13:38:19 ... thread 0: (1000000,7000000) ops and (329797.6,278453.1) ops/second in (3.032163,25.138881) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.93 GB 345.7 6.2 0.0 6.2 12.7 6.6 0.0 1.9 144.3 298.5 43.65 40.82 117 0.373 6395K 10K 0.0 0.0 L1 6/0 577.23 MB 57.7 2.7 2.5 0.2 2.7 2.5 0.1 1.1 232.2 230.4 11.94 11.57 3 3.981 2816K 21K 0.0 0.0 L2 2/0 50.98 MB 0.5 0.1 0.1 0.1 0.1 0.1 2.0 2.0 239.0 238.9 0.53 0.51 1 0.527 127K 33 0.0 0.0 L3 15/0 956.28 MB 1.0 0.8 0.6 0.1 0.8 0.6 1.6 1.2 193.3 193.0 4.03 3.48 3 1.344 764K 518 0.0 0.0 L4 162/0 9.73 GB 1.0 0.8 0.6 0.2 0.8 0.6 1.3 1.2 157.5 156.9 5.00 3.61 5 1.000 764K 2183 0.0 0.0 L5 1060/0 87.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/8 102.68 GB 0.0 10.5 3.8 6.7 17.1 10.4 6.6 2.6 165.2 268.1 65.15 59.99 129 0.505 10M 34K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.5 3.8 6.7 17.1 10.4 6.5 2.6 165.2 268.1 65.15 59.99 129 0.505 10M 34K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.5 3.8 6.7 10.5 3.8 0.0 0.0 235.0 234.2 45.80 43.02 32 1.431 10M 34K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 348.4 19.35 16.97 97 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.3 total, 25.1 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.06 GB write, 689.55 MB/s write, 10.51 GB read, 424.91 MB/s read, 65.2 seconds Interval compaction: 17.06 GB write, 694.85 MB/s write, 10.51 GB read, 428.18 MB/s read, 65.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 28, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2353103 Average: 2.2753 StdDev: 11.72 Min: 0 Median: 1.5301 Max: 5016 Percentiles: P50: 1.53 P75: 1.91 P99: 5.72 P99.9: 11.11 P99.99: 27.90 ------------------------------------------------------ [ 0, 1 ] 351291 14.929% 14.929% ### ( 1, 2 ] 1556787 66.159% 81.088% ############# ( 2, 3 ] 301330 12.806% 93.893% ### ( 3, 4 ] 71283 3.029% 96.923% # ( 4, 6 ] 56976 2.421% 99.344% ( 6, 10 ] 12601 0.536% 99.880% ( 10, 15 ] 2185 0.093% 99.972% ( 15, 22 ] 398 0.017% 99.989% ( 22, 34 ] 36 0.002% 99.991% ( 34, 51 ] 10 0.000% 99.991% ( 51, 76 ] 13 0.001% 99.992% ( 76, 110 ] 133 0.006% 99.997% ( 110, 170 ] 215 0.009% 100.007% ( 170, 250 ] 110 0.005% 100.011% ( 250, 380 ] 57 0.002% 100.014% ( 380, 580 ] 78 0.003% 100.017% ( 580, 870 ] 58 0.002% 100.019% ( 870, 1300 ] 30 0.001% 100.021% ( 1300, 1900 ] 15 0.001% 100.021% ( 1900, 2900 ] 7 0.000% 100.022% ( 2900, 4400 ] 11 0.000% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 310100 Average: 3.3071 StdDev: 33.46 Min: 1 Median: 1.8607 Max: 6444 Percentiles: P50: 1.86 P75: 2.68 P99: 7.73 P99.9: 13.45 P99.99: 25.98 ------------------------------------------------------ [ 0, 1 ] 14499 4.676% 4.676% # ( 1, 2 ] 163290 52.657% 57.333% ########### ( 2, 3 ] 80528 25.968% 83.301% ##### ( 3, 4 ] 21899 7.062% 90.363% # ( 4, 6 ] 24994 8.060% 98.423% ## ( 6, 10 ] 4137 1.334% 99.757% ( 10, 15 ] 642 0.207% 99.964% ( 15, 22 ] 78 0.025% 99.989% ( 22, 34 ] 6 0.002% 99.991% ( 34, 51 ] 5 0.002% 99.993% ( 51, 76 ] 5 0.002% 99.995% ( 76, 110 ] 15 0.005% 99.999% ( 110, 170 ] 74 0.024% 100.023% ( 170, 250 ] 30 0.010% 100.033% ( 250, 380 ] 18 0.006% 100.039% ( 380, 580 ] 26 0.008% 100.047% ( 580, 870 ] 15 0.005% 100.052% ( 870, 1300 ] 17 0.005% 100.057% ( 1300, 1900 ] 23 0.007% 100.065% ( 1900, 2900 ] 22 0.007% 100.072% ( 2900, 4400 ] 6 0.002% 100.074% ( 4400, 6600 ] 2 0.001% 100.074% ** Level 2 read latency histogram (micros): Count: 31718 Average: 2.8052 StdDev: 26.79 Min: 1 Median: 1.6885 Max: 2883 Percentiles: P50: 1.69 P75: 2.25 P99: 6.05 P99.9: 9.99 P99.99: 1796.92 ------------------------------------------------------ [ 0, 1 ] 1646 5.189% 5.189% # ( 1, 2 ] 20644 65.086% 70.276% ############# ( 2, 3 ] 5908 18.627% 88.902% #### ( 3, 4 ] 1605 5.060% 93.962% # ( 4, 6 ] 1594 5.026% 98.988% # ( 6, 10 ] 290 0.914% 99.902% ( 10, 15 ] 16 0.050% 99.953% ( 15, 22 ] 1 0.003% 99.956% ( 22, 34 ] 2 0.006% 99.962% ( 51, 76 ] 4 0.013% 99.975% ( 110, 170 ] 1 0.003% 99.978% ( 170, 250 ] 1 0.003% 99.981% ( 380, 580 ] 1 0.003% 99.984% ( 580, 870 ] 1 0.003% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 3 0.009% 100.000% ** Level 3 read latency histogram (micros): Count: 104785 Average: 12.7685 StdDev: 146.88 Min: 0 Median: 1.9057 Max: 8914 Percentiles: P50: 1.91 P75: 2.76 P99: 223.26 P99.9: 1984.11 P99.99: 3942.26 ------------------------------------------------------ [ 0, 1 ] 2975 2.839% 2.839% # ( 1, 2 ] 54565 52.073% 54.912% ########## ( 2, 3 ] 27551 26.293% 81.205% ##### ( 3, 4 ] 8807 8.405% 89.610% ## ( 4, 6 ] 7495 7.153% 96.763% # ( 6, 10 ] 1646 1.571% 98.334% ( 10, 15 ] 285 0.272% 98.606% ( 15, 22 ] 49 0.047% 98.652% ( 22, 34 ] 23 0.022% 98.674% ( 34, 51 ] 3 0.003% 98.677% ( 51, 76 ] 2 0.002% 98.679% ( 76, 110 ] 19 0.018% 98.697% ( 110, 170 ] 182 0.174% 98.871% ( 170, 250 ] 203 0.194% 99.065% ( 250, 380 ] 239 0.228% 99.293% ( 380, 580 ] 280 0.267% 99.560% ( 580, 870 ] 206 0.197% 99.757% ( 870, 1300 ] 96 0.092% 99.848% ( 1300, 1900 ] 49 0.047% 99.895% ( 1900, 2900 ] 62 0.059% 99.954% ( 2900, 4400 ] 54 0.052% 100.006% ( 4400, 6600 ] 6 0.006% 100.011% ( 6600, 9900 ] 11 0.010% 100.022% ** Level 4 read latency histogram (micros): Count: 150 Average: 713.1933 StdDev: 1869.11 Min: 1 Median: 3.0000 Max: 8856 Percentiles: P50: 3.00 P75: 298.75 P99: 8856.00 P99.9: 8856.00 P99.99: 8856.00 ------------------------------------------------------ [ 0, 1 ] 16 10.667% 10.667% ## ( 1, 2 ] 49 32.667% 43.333% ####### ( 2, 3 ] 10 6.667% 50.000% # ( 3, 4 ] 3 2.000% 52.000% ( 6, 10 ] 1 0.667% 52.667% ( 10, 15 ] 1 0.667% 53.333% ( 15, 22 ] 2 1.333% 54.667% ( 22, 34 ] 1 0.667% 55.333% ( 34, 51 ] 4 2.667% 58.000% # ( 51, 76 ] 1 0.667% 58.667% ( 76, 110 ] 3 2.000% 60.667% ( 110, 170 ] 15 10.000% 70.667% ## ( 170, 250 ] 5 3.333% 74.000% # ( 250, 380 ] 4 2.667% 76.667% # ( 380, 580 ] 7 4.667% 81.333% # ( 580, 870 ] 9 6.000% 87.333% # ( 870, 1300 ] 1 0.667% 88.000% ( 1300, 1900 ] 2 1.333% 89.333% ( 1900, 2900 ] 5 3.333% 92.667% # ( 2900, 4400 ] 1 0.667% 93.333% ( 4400, 6600 ] 4 2.667% 96.000% # ( 6600, 9900 ] 6 4.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 100 Average: 1062.0900 StdDev: 1301.57 Min: 81 Median: 356.3636 Max: 5744 Percentiles: P50: 356.36 P75: 1780.00 P99: 5500.00 P99.9: 5744.00 P99.99: 5744.00 ------------------------------------------------------ ( 76, 110 ] 6 6.000% 6.000% # ( 110, 170 ] 25 25.000% 31.000% ##### ( 170, 250 ] 10 10.000% 41.000% ## ( 250, 380 ] 11 11.000% 52.000% ## ( 380, 580 ] 8 8.000% 60.000% ## ( 580, 870 ] 7 7.000% 67.000% # ( 870, 1300 ] 4 4.000% 71.000% # ( 1300, 1900 ] 5 5.000% 76.000% # ( 1900, 2900 ] 11 11.000% 87.000% ## ( 2900, 4400 ] 11 11.000% 98.000% ## ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 25.3 total, 3.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 271.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.471 H:M:S, 25.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.401 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-13:38:45 ... thread 0: (1000000,8000000) ops and (37422.8,154259.8) ops/second in (26.721681,51.860562) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 755.73 MB 50.4 7.0 0.0 7.0 14.5 7.6 0.0 1.9 139.7 291.6 50.93 46.63 133 0.383 7227K 10K 0.0 0.0 L1 6/6 705.54 MB 0.0 7.4 6.7 0.8 7.3 6.6 0.1 1.1 216.0 212.3 35.30 32.49 4 8.826 7743K 129K 0.0 0.0 L2 18/12 2.19 GB 7.7 0.2 0.1 0.1 0.2 0.1 5.9 1.5 204.3 204.1 0.91 0.79 2 0.455 129K 33 0.0 0.0 L3 32/9 2.74 GB 1.8 1.2 0.9 0.3 1.2 0.9 3.1 1.3 154.0 153.4 8.23 5.73 6 1.372 1260K 4493 0.0 0.0 L4 163/2 9.73 GB 1.0 0.8 0.6 0.2 0.8 0.6 1.3 1.2 157.5 156.9 5.00 3.61 5 1.000 764K 2183 0.0 0.0 L5 1060/0 87.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/33 103.56 GB 0.0 16.6 8.4 8.2 24.0 15.8 12.0 3.2 169.2 244.9 100.38 89.26 150 0.669 17M 147K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.6 8.4 8.2 24.0 15.8 11.9 3.2 169.2 244.9 100.38 89.26 150 0.669 17M 147K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.6 8.4 8.2 16.4 8.2 0.0 0.0 221.1 219.1 76.82 69.50 40 1.921 17M 147K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 328.9 23.56 19.76 110 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.1 total, 51.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.01 GB write, 472.26 MB/s write, 16.59 GB read, 326.27 MB/s read, 100.4 seconds Interval compaction: 24.01 GB write, 474.02 MB/s write, 16.59 GB read, 327.49 MB/s read, 100.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 36, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3642181 Average: 2.7651 StdDev: 17.79 Min: 0 Median: 1.4903 Max: 7504 Percentiles: P50: 1.49 P75: 1.87 P99: 6.52 P99.9: 152.98 P99.99: 412.02 ------------------------------------------------------ [ 0, 1 ] 631350 17.334% 17.334% ### ( 1, 2 ] 2426374 66.619% 83.953% ############# ( 2, 3 ] 364983 10.021% 93.974% ## ( 3, 4 ] 97732 2.683% 96.657% # ( 4, 6 ] 82595 2.268% 98.925% ( 6, 10 ] 21100 0.579% 99.505% ( 10, 15 ] 3457 0.095% 99.599% ( 15, 22 ] 933 0.026% 99.625% ( 22, 34 ] 45 0.001% 99.626% ( 34, 51 ] 15 0.000% 99.627% ( 51, 76 ] 26 0.001% 99.627% ( 76, 110 ] 5296 0.145% 99.773% ( 110, 170 ] 6468 0.178% 99.950% ( 170, 250 ] 761 0.021% 99.971% ( 250, 380 ] 579 0.016% 99.987% ( 380, 580 ] 642 0.018% 100.005% ( 580, 870 ] 233 0.006% 100.011% ( 870, 1300 ] 70 0.002% 100.013% ( 1300, 1900 ] 27 0.001% 100.014% ( 1900, 2900 ] 20 0.001% 100.014% ( 2900, 4400 ] 23 0.001% 100.015% ( 4400, 6600 ] 3 0.000% 100.015% ( 6600, 9900 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 1071663 Average: 5.8286 StdDev: 89.21 Min: 1 Median: 1.9730 Max: 10558 Percentiles: P50: 1.97 P75: 2.90 P99: 9.37 P99.9: 99.26 P99.99: 141.37 ------------------------------------------------------ [ 0, 1 ] 56779 5.298% 5.298% # ( 1, 2 ] 492324 45.940% 51.238% ######### ( 2, 3 ] 282444 26.356% 77.594% ##### ( 3, 4 ] 98081 9.152% 86.746% ## ( 4, 6 ] 112539 10.501% 97.248% ## ( 6, 10 ] 22267 2.078% 99.325% ( 10, 15 ] 4714 0.440% 99.765% ( 15, 22 ] 583 0.054% 99.820% ( 22, 34 ] 49 0.005% 99.824% ( 34, 51 ] 27 0.003% 99.827% ( 51, 76 ] 24 0.002% 99.829% ( 76, 110 ] 1113 0.104% 99.933% ( 110, 170 ] 1172 0.109% 100.042% ( 170, 250 ] 210 0.020% 100.062% ( 250, 380 ] 279 0.026% 100.088% ( 380, 580 ] 354 0.033% 100.121% ( 580, 870 ] 330 0.031% 100.152% ( 870, 1300 ] 225 0.021% 100.173% ( 1300, 1900 ] 124 0.012% 100.184% ( 1900, 2900 ] 181 0.017% 100.201% ( 2900, 4400 ] 283 0.026% 100.228% ( 4400, 6600 ] 62 0.006% 100.233% ( 6600, 9900 ] 22 0.002% 100.235% ( 9900, 14000 ] 1 0.000% 100.236% ** Level 2 read latency histogram (micros): Count: 47153 Average: 3.6948 StdDev: 46.49 Min: 1 Median: 1.8030 Max: 7174 Percentiles: P50: 1.80 P75: 2.62 P99: 7.66 P99.9: 288.47 P99.99: 1994.90 ------------------------------------------------------ [ 0, 1 ] 1696 3.597% 3.597% # ( 1, 2 ] 27250 57.791% 61.387% ############ ( 2, 3 ] 10432 22.124% 83.511% #### ( 3, 4 ] 3370 7.147% 90.658% # ( 4, 6 ] 3702 7.851% 98.509% ## ( 6, 10 ] 559 1.186% 99.695% ( 10, 15 ] 61 0.129% 99.824% ( 15, 22 ] 3 0.006% 99.830% ( 22, 34 ] 2 0.004% 99.835% ( 51, 76 ] 4 0.008% 99.843% ( 110, 170 ] 7 0.015% 99.858% ( 170, 250 ] 16 0.034% 99.892% ( 250, 380 ] 13 0.028% 99.919% ( 380, 580 ] 16 0.034% 99.953% ( 580, 870 ] 12 0.025% 99.979% ( 870, 1300 ] 4 0.008% 99.987% ( 1300, 1900 ] 1 0.002% 99.989% ( 1900, 2900 ] 3 0.006% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 121330 Average: 14.1420 StdDev: 158.34 Min: 0 Median: 1.9394 Max: 8914 Percentiles: P50: 1.94 P75: 2.82 P99: 250.83 P99.9: 2458.38 P99.99: 4159.10 ------------------------------------------------------ [ 0, 1 ] 3075 2.534% 2.534% # ( 1, 2 ] 61305 50.527% 53.062% ########## ( 2, 3 ] 32485 26.774% 79.836% ##### ( 3, 4 ] 10729 8.843% 88.679% ## ( 4, 6 ] 9516 7.843% 96.522% ## ( 6, 10 ] 2106 1.736% 98.258% ( 10, 15 ] 357 0.294% 98.552% ( 15, 22 ] 58 0.048% 98.600% ( 22, 34 ] 26 0.021% 98.621% ( 34, 51 ] 4 0.003% 98.624% ( 51, 76 ] 5 0.004% 98.629% ( 76, 110 ] 22 0.018% 98.647% ( 110, 170 ] 203 0.167% 98.814% ( 170, 250 ] 225 0.185% 98.999% ( 250, 380 ] 265 0.218% 99.218% ( 380, 580 ] 325 0.268% 99.486% ( 580, 870 ] 256 0.211% 99.697% ( 870, 1300 ] 144 0.119% 99.815% ( 1300, 1900 ] 59 0.049% 99.864% ( 1900, 2900 ] 80 0.066% 99.930% ( 2900, 4400 ] 88 0.073% 100.002% ( 4400, 6600 ] 9 0.007% 100.010% ( 6600, 9900 ] 12 0.010% 100.020% ** Level 4 read latency histogram (micros): Count: 150 Average: 713.1933 StdDev: 1869.11 Min: 1 Median: 3.0000 Max: 8856 Percentiles: P50: 3.00 P75: 298.75 P99: 8856.00 P99.9: 8856.00 P99.99: 8856.00 ------------------------------------------------------ [ 0, 1 ] 16 10.667% 10.667% ## ( 1, 2 ] 49 32.667% 43.333% ####### ( 2, 3 ] 10 6.667% 50.000% # ( 3, 4 ] 3 2.000% 52.000% ( 6, 10 ] 1 0.667% 52.667% ( 10, 15 ] 1 0.667% 53.333% ( 15, 22 ] 2 1.333% 54.667% ( 22, 34 ] 1 0.667% 55.333% ( 34, 51 ] 4 2.667% 58.000% # ( 51, 76 ] 1 0.667% 58.667% ( 76, 110 ] 3 2.000% 60.667% ( 110, 170 ] 15 10.000% 70.667% ## ( 170, 250 ] 5 3.333% 74.000% # ( 250, 380 ] 4 2.667% 76.667% # ( 380, 580 ] 7 4.667% 81.333% # ( 580, 870 ] 9 6.000% 87.333% # ( 870, 1300 ] 1 0.667% 88.000% ( 1300, 1900 ] 2 1.333% 89.333% ( 1900, 2900 ] 5 3.333% 92.667% # ( 2900, 4400 ] 1 0.667% 93.333% ( 4400, 6600 ] 4 2.667% 96.000% # ( 6600, 9900 ] 6 4.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 100 Average: 1062.0900 StdDev: 1301.57 Min: 81 Median: 356.3636 Max: 5744 Percentiles: P50: 356.36 P75: 1780.00 P99: 5500.00 P99.9: 5744.00 P99.99: 5744.00 ------------------------------------------------------ ( 76, 110 ] 6 6.000% 6.000% # ( 110, 170 ] 25 25.000% 31.000% ##### ( 170, 250 ] 10 10.000% 41.000% ## ( 250, 380 ] 11 11.000% 52.000% ## ( 380, 580 ] 8 8.000% 60.000% ## ( 580, 870 ] 7 7.000% 67.000% # ( 870, 1300 ] 4 4.000% 71.000% # ( 1300, 1900 ] 5 5.000% 76.000% # ( 1900, 2900 ] 11 11.000% 87.000% ## ( 2900, 4400 ] 11 11.000% 98.000% ## ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 52.1 total, 26.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 151.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.452 H:M:S, 56.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 36.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:22.980 H:M:S, 86.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/14-13:38:53 ... thread 0: (1000000,9000000) ops and (131896.4,151407.4) ops/second in (7.581706,59.442268) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.66 GB 12.6 7.6 0.0 7.6 16.0 8.5 0.0 1.9 125.1 265.2 61.95 51.91 145 0.427 7866K 11K 0.0 0.0 L1 0/0 0.00 KB 0.0 7.4 6.7 0.8 7.3 6.6 0.1 1.1 216.0 212.3 35.30 32.49 4 8.826 7743K 129K 0.0 0.0 L2 2/1 146.03 MB 0.2 0.9 0.8 0.1 0.9 0.8 5.9 1.1 129.6 129.1 7.26 4.36 3 2.421 179K 33 0.0 0.0 L3 24/6 1.68 GB 1.1 5.4 3.5 1.9 5.4 3.4 3.3 1.5 129.9 128.9 42.55 25.75 23 1.850 5584K 38K 0.0 0.0 L4 188/19 12.41 GB 1.2 5.3 4.4 0.9 5.3 4.3 1.3 1.2 127.0 126.3 42.58 25.30 44 0.968 5421K 27K 0.0 0.0 L5 1072/0 88.52 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/36 104.42 GB 0.0 26.6 15.3 11.3 34.9 23.6 13.3 4.1 143.7 188.4 189.64 139.82 219 0.866 26M 207K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.6 15.3 11.3 34.9 23.6 13.1 4.1 143.7 188.4 189.64 139.82 219 0.866 26M 207K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.6 15.3 11.3 26.4 15.1 0.0 0.0 171.3 170.0 159.06 117.40 99 1.607 26M 207K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 284.3 30.58 22.42 120 0.255 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.6 total, 59.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.89 GB write, 599.06 MB/s write, 26.61 GB read, 456.88 MB/s read, 189.6 seconds Interval compaction: 34.89 GB write, 601.01 MB/s write, 26.61 GB read, 458.37 MB/s read, 189.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 81, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 81, interval: 101 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3933439 Average: 2.9909 StdDev: 28.38 Min: 0 Median: 1.5220 Max: 8653 Percentiles: P50: 1.52 P75: 1.91 P99: 7.30 P99.9: 154.96 P99.99: 524.21 ------------------------------------------------------ [ 0, 1 ] 634622 16.134% 16.134% ### ( 1, 2 ] 2551759 64.873% 81.008% ############# ( 2, 3 ] 450656 11.457% 92.465% ## ( 3, 4 ] 128343 3.263% 95.727% # ( 4, 6 ] 119448 3.037% 98.764% # ( 6, 10 ] 28522 0.725% 99.489% ( 10, 15 ] 4827 0.123% 99.612% ( 15, 22 ] 1084 0.028% 99.640% ( 22, 34 ] 52 0.001% 99.641% ( 34, 51 ] 20 0.001% 99.641% ( 51, 76 ] 26 0.001% 99.642% ( 76, 110 ] 5298 0.135% 99.777% ( 110, 170 ] 6472 0.165% 99.941% ( 170, 250 ] 777 0.020% 99.961% ( 250, 380 ] 615 0.016% 99.977% ( 380, 580 ] 729 0.019% 99.995% ( 580, 870 ] 355 0.009% 100.004% ( 870, 1300 ] 179 0.005% 100.009% ( 1300, 1900 ] 82 0.002% 100.011% ( 1900, 2900 ] 68 0.002% 100.013% ( 2900, 4400 ] 86 0.002% 100.015% ( 4400, 6600 ] 19 0.000% 100.015% ( 6600, 9900 ] 4 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 1722211 Average: 7.9960 StdDev: 120.83 Min: 1 Median: 2.1368 Max: 10838 Percentiles: P50: 2.14 P75: 3.02 P99: 9.73 P99.9: 155.63 P99.99: 547.23 ------------------------------------------------------ [ 0, 1 ] 59064 3.430% 3.430% # ( 1, 2 ] 734434 42.645% 46.074% ######### ( 2, 3 ] 494034 28.686% 74.760% ###### ( 3, 4 ] 172510 10.017% 84.777% ## ( 4, 6 ] 204334 11.865% 96.642% ## ( 6, 10 ] 43545 2.528% 99.170% # ( 10, 15 ] 9274 0.538% 99.709% ( 15, 22 ] 1085 0.063% 99.772% ( 22, 34 ] 90 0.005% 99.777% ( 34, 51 ] 41 0.002% 99.779% ( 51, 76 ] 40 0.002% 99.782% ( 76, 110 ] 1130 0.066% 99.847% ( 110, 170 ] 1195 0.069% 99.917% ( 170, 250 ] 263 0.015% 99.932% ( 250, 380 ] 423 0.025% 99.957% ( 380, 580 ] 691 0.040% 99.997% ( 580, 870 ] 804 0.047% 100.043% ( 870, 1300 ] 673 0.039% 100.082% ( 1300, 1900 ] 454 0.026% 100.109% ( 1900, 2900 ] 603 0.035% 100.144% ( 2900, 4400 ] 789 0.046% 100.190% ( 4400, 6600 ] 211 0.012% 100.202% ( 6600, 9900 ] 56 0.003% 100.205% ( 9900, 14000 ] 3 0.000% 100.205% ** Level 2 read latency histogram (micros): Count: 233219 Average: 9.1724 StdDev: 130.79 Min: 1 Median: 2.2607 Max: 10022 Percentiles: P50: 2.26 P75: 3.16 P99: 9.76 P99.9: 803.73 P99.99: 1702.69 ------------------------------------------------------ [ 0, 1 ] 2047 0.878% 0.878% ( 1, 2 ] 95387 40.900% 41.778% ######## ( 2, 3 ] 73553 31.538% 73.316% ###### ( 3, 4 ] 25238 10.822% 84.138% ## ( 4, 6 ] 29367 12.592% 96.730% ### ( 6, 10 ] 5631 2.414% 99.144% ( 10, 15 ] 1287 0.552% 99.696% ( 15, 22 ] 130 0.056% 99.752% ( 22, 34 ] 10 0.004% 99.756% ( 34, 51 ] 4 0.002% 99.758% ( 51, 76 ] 5 0.002% 99.760% ( 110, 170 ] 9 0.004% 99.764% ( 170, 250 ] 29 0.012% 99.776% ( 250, 380 ] 68 0.029% 99.805% ( 380, 580 ] 112 0.048% 99.853% ( 580, 870 ] 141 0.060% 99.914% ( 870, 1300 ] 126 0.054% 99.968% ( 1300, 1900 ] 77 0.033% 100.001% ( 1900, 2900 ] 115 0.049% 100.050% ( 2900, 4400 ] 151 0.065% 100.115% ( 4400, 6600 ] 29 0.012% 100.127% ( 6600, 9900 ] 4 0.002% 100.129% ( 9900, 14000 ] 1 0.000% 100.129% ** Level 3 read latency histogram (micros): Count: 1157427 Average: 11.3037 StdDev: 151.22 Min: 0 Median: 2.3005 Max: 17305 Percentiles: P50: 2.30 P75: 3.23 P99: 9.86 P99.9: 936.52 P99.99: 1506.37 ------------------------------------------------------ [ 0, 1 ] 6984 0.603% 0.603% ( 1, 2 ] 460282 39.768% 40.371% ######## ( 2, 3 ] 370892 32.045% 72.416% ###### ( 3, 4 ] 132186 11.421% 83.836% ## ( 4, 6 ] 149565 12.922% 96.758% ### ( 6, 10 ] 26854 2.320% 99.079% ( 10, 15 ] 5656 0.489% 99.567% ( 15, 22 ] 591 0.051% 99.618% ( 22, 34 ] 61 0.005% 99.624% ( 34, 51 ] 22 0.002% 99.626% ( 51, 76 ] 24 0.002% 99.628% ( 76, 110 ] 30 0.003% 99.630% ( 110, 170 ] 235 0.020% 99.651% ( 170, 250 ] 315 0.027% 99.678% ( 250, 380 ] 534 0.046% 99.724% ( 380, 580 ] 831 0.072% 99.796% ( 580, 870 ] 1060 0.092% 99.887% ( 870, 1300 ] 954 0.082% 99.970% ( 1300, 1900 ] 684 0.059% 100.029% ( 1900, 2900 ] 737 0.064% 100.092% ( 2900, 4400 ] 803 0.069% 100.162% ( 4400, 6600 ] 185 0.016% 100.178% ( 6600, 9900 ] 51 0.004% 100.182% ( 9900, 14000 ] 2 0.000% 100.182% ( 14000, 22000 ] 3 0.000% 100.183% ** Level 4 read latency histogram (micros): Count: 170475 Average: 15.8805 StdDev: 186.87 Min: 1 Median: 2.3620 Max: 8856 Percentiles: P50: 2.36 P75: 3.37 P99: 13.76 P99.9: 2582.55 P99.99: 3841.64 ------------------------------------------------------ [ 0, 1 ] 728 0.427% 0.427% ( 1, 2 ] 64320 37.730% 38.157% ######## ( 2, 3 ] 55777 32.719% 70.875% ####### ( 3, 4 ] 19050 11.175% 82.050% ## ( 4, 6 ] 23339 13.691% 95.741% ### ( 6, 10 ] 4824 2.830% 98.570% # ( 10, 15 ] 975 0.572% 99.142% ( 15, 22 ] 112 0.066% 99.208% ( 22, 34 ] 11 0.006% 99.215% ( 34, 51 ] 10 0.006% 99.220% ( 51, 76 ] 7 0.004% 99.225% ( 76, 110 ] 7 0.004% 99.229% ( 110, 170 ] 51 0.030% 99.259% ( 170, 250 ] 70 0.041% 99.300% ( 250, 380 ] 78 0.046% 99.345% ( 380, 580 ] 172 0.101% 99.446% ( 580, 870 ] 248 0.145% 99.592% ( 870, 1300 ] 245 0.144% 99.735% ( 1300, 1900 ] 172 0.101% 99.836% ( 1900, 2900 ] 159 0.093% 99.930% ( 2900, 4400 ] 164 0.096% 100.026% ( 4400, 6600 ] 54 0.032% 100.057% ( 6600, 9900 ] 10 0.006% 100.063% ** Level 5 read latency histogram (micros): Count: 200 Average: 1497.7550 StdDev: 1628.63 Min: 81 Median: 638.0000 Max: 9500 Percentiles: P50: 638.00 P75: 2512.90 P99: 6380.00 P99.9: 9240.00 P99.99: 9500.00 ------------------------------------------------------ ( 76, 110 ] 6 3.000% 3.000% # ( 110, 170 ] 27 13.500% 16.500% ### ( 170, 250 ] 16 8.000% 24.500% ## ( 250, 380 ] 24 12.000% 36.500% ## ( 380, 580 ] 24 12.000% 48.500% ## ( 580, 870 ] 15 7.500% 56.000% ## ( 870, 1300 ] 8 4.000% 60.000% # ( 1300, 1900 ] 11 5.500% 65.500% # ( 1900, 2900 ] 31 15.500% 81.000% ### ( 2900, 4400 ] 27 13.500% 94.500% ### ( 4400, 6600 ] 10 5.000% 99.500% # ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 59.6 total, 7.6 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 148.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:34.036 H:M:S, 57.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 129.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.584 H:M:S, 60.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.638 micros/op 150645 ops/sec 60.320 seconds 9086999 operations; 146.0 MB/s Microseconds per write: Count: 9086999 Average: 6.6381 StdDev: 734.66 Min: 1 Median: 1.7724 Max: 956497 Percentiles: P50: 1.77 P75: 2.79 P99: 9.28 P99.9: 1171.54 P99.99: 2711.61 ------------------------------------------------------ [ 0, 1 ] 1010941 11.125% 11.125% ## ( 1, 2 ] 4573515 50.330% 61.455% ########## ( 2, 3 ] 1550328 17.061% 78.516% ### ( 3, 4 ] 1272379 14.002% 92.519% ### ( 4, 6 ] 500731 5.510% 98.029% # ( 6, 10 ] 107691 1.185% 99.214% ( 10, 15 ] 33268 0.366% 99.580% ( 15, 22 ] 7289 0.080% 99.660% ( 22, 34 ] 1179 0.013% 99.673% ( 34, 51 ] 216 0.002% 99.676% ( 51, 76 ] 49 0.001% 99.676% ( 76, 110 ] 6553 0.072% 99.748% ( 110, 170 ] 2256 0.025% 99.773% ( 170, 250 ] 276 0.003% 99.776% ( 250, 380 ] 155 0.002% 99.778% ( 380, 580 ] 23 0.000% 99.778% ( 580, 870 ] 28 0.000% 99.779% ( 870, 1300 ] 15736 0.173% 99.952% ( 1300, 1900 ] 32 0.000% 99.952% ( 1900, 2900 ] 4245 0.047% 99.999% ( 2900, 4400 ] 59 0.001% 99.999% ( 4400, 6600 ] 9 0.000% 100.000% ( 6600, 9900 ] 9 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 4 0.000% 100.000% ( 860000, 1200000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 231713 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9086999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9377782968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 563 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34638020 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30809131418 rocksdb.compact.write.bytes COUNT : 30568782963 rocksdb.flush.write.bytes COUNT : 9313962411 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 78 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 271 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9238964224 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3670016 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30911149471 rocksdb.non.last.level.read.count COUNT : 7464427 rocksdb.block.checksum.compute.count COUNT : 7463379 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.440238 P95 : 3.924203 P99 : 7.852345 P100 : 956486.000000 COUNT : 9086999 SUM : 56025204 rocksdb.compaction.times.micros P50 : 1076363.636364 P95 : 3684000.000000 P99 : 9668000.000000 P100 : 23360885.000000 COUNT : 104 SUM : 167403445 rocksdb.compaction.times.cpu_micros P50 : 783684.210526 P95 : 1891250.000000 P99 : 9668000.000000 P100 : 20921945.000000 COUNT : 104 SUM : 122798773 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 694.098361 P95 : 12872.500000 P99 : 102300.000000 P100 : 214163.000000 COUNT : 122 SUM : 515391 rocksdb.compaction.outfile.sync.micros P50 : 3996.153846 P95 : 196545.454545 P99 : 369112.500000 P100 : 889679.000000 COUNT : 367 SUM : 12172279 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 168.500000 P95 : 3012.500000 P99 : 5390.000000 P100 : 11266.000000 COUNT : 265 SUM : 172398 rocksdb.table.open.io.micros P50 : 2136.000000 P95 : 12025.526316 P99 : 19629.473684 P100 : 19992.000000 COUNT : 563 SUM : 1839116 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.879307 P95 : 8.710448 P99 : 13.189963 P100 : 14283.000000 COUNT : 7462579 SUM : 61495758 rocksdb.read.block.get.micros P50 : 623.283582 P95 : 5249.803922 P99 : 8489.250000 P100 : 17327.000000 COUNT : 1126 SUM : 1530016 rocksdb.write.raw.block.micros P50 : 0.516151 P95 : 0.980687 P99 : 2.882738 P100 : 22405.000000 COUNT : 9661506 SUM : 24155083 rocksdb.numfiles.in.singlecompaction P50 : 3.050000 P95 : 4.657143 P99 : 11.300000 P100 : 21.000000 COUNT : 174 SUM : 579 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.568126 P95 : 1187.941257 P99 : 2511.563835 P100 : 956283.000000 COUNT : 167087 SUM : 34654095 rocksdb.sst.read.micros P50 : 1.755601 P95 : 5.295270 P99 : 9.462301 P100 : 17305.000000 COUNT : 7465821 SUM : 46125951 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9086999 SUM : 9377782968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217407.407407 P95 : 707750.000000 P99 : 1096300.000000 P100 : 1157346.000000 COUNT : 122 SUM : 31614749 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 348 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0