[2024-07-12 10:20:16.483417] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 23.11.0 initialization... [2024-07-12 10:20:16.483686] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1853135 ] Set seed to 1720772416476997 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-12 10:20:16.591958] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-12 10:20:16.633262] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-12 10:20:16.633311] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1853135' to capture a snapshot of events at runtime. [2024-07-12 10:20:16.633321] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-12 10:20:16.633347] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-12 10:20:16.633356] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1853135 for offline analysis/debug. [2024-07-12 10:20:16.633444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 12 10:20:20 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/12-10:20:23 ... thread 0: (1000000,1000000) ops and (360938.9,360938.9) ops/second in (2.770552,2.770552) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.05 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 352.3 2.32 2.09 12 0.194 0 0 0.0 0.0 L2 3/2 251.72 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 258.1 258.0 1.46 1.42 2 0.732 383K 210 0.0 0.0 L3 9/0 804.31 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 99.7 315.9 3.79 3.51 14 0.271 383K 210 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 99.7 315.9 3.79 3.51 14 0.271 383K 210 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 258.1 258.0 1.46 1.42 2 0.732 383K 210 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 352.3 2.32 2.09 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 399.55 MB/s write, 0.37 GB read, 126.17 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 431.75 MB/s write, 0.37 GB read, 136.34 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 103520 Average: 1.8895 StdDev: 22.27 Min: 0 Median: 1.1862 Max: 3282 Percentiles: P50: 1.19 P75: 1.64 P99: 3.69 P99.9: 9.80 P99.99: 303.56 ------------------------------------------------------ [ 0, 1 ] 41043 39.647% 39.647% ######## ( 1, 2 ] 57554 55.597% 95.244% ########### ( 2, 3 ] 3219 3.110% 98.354% # ( 3, 4 ] 967 0.934% 99.288% ( 4, 6 ] 474 0.458% 99.746% ( 6, 10 ] 170 0.164% 99.910% ( 10, 15 ] 54 0.052% 99.962% ( 15, 22 ] 12 0.012% 99.974% ( 22, 34 ] 4 0.004% 99.978% ( 110, 170 ] 10 0.010% 99.987% ( 170, 250 ] 3 0.003% 99.990% ( 250, 380 ] 4 0.004% 99.994% ( 380, 580 ] 2 0.002% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 2900, 4400 ] 5 0.005% 100.002% ** Level 1 read latency histogram (micros): Count: 5 Average: 710.8000 StdDev: 792.25 Min: 45 Median: 210.0000 Max: 2020 Percentiles: P50: 210.00 P75: 1192.50 P99: 2020.00 P99.9: 2020.00 P99.99: 2020.00 ------------------------------------------------------ ( 34, 51 ] 2 40.000% 40.000% ######## ( 170, 250 ] 1 20.000% 60.000% #### ( 870, 1300 ] 1 20.000% 80.000% #### ( 1900, 2900 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 49194 Average: 1.8363 StdDev: 7.00 Min: 1 Median: 1.2218 Max: 818 Percentiles: P50: 1.22 P75: 1.67 P99: 4.98 P99.9: 10.24 P99.99: 396.10 ------------------------------------------------------ [ 0, 1 ] 18538 37.683% 37.683% ######## ( 1, 2 ] 27323 55.541% 93.225% ########### ( 2, 3 ] 1854 3.769% 96.994% # ( 3, 4 ] 754 1.533% 98.526% ( 4, 6 ] 476 0.968% 99.494% ( 6, 10 ] 199 0.405% 99.898% ( 10, 15 ] 37 0.075% 99.974% ( 15, 22 ] 4 0.008% 99.982% ( 22, 34 ] 2 0.004% 99.986% ( 51, 76 ] 1 0.002% 99.988% ( 250, 380 ] 2 0.004% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 580, 870 ] 4 0.008% 100.002% ** Level 3 read latency histogram (micros): Count: 40 Average: 1338.5000 StdDev: 921.37 Min: 95 Median: 1156.6667 Max: 3817 Percentiles: P50: 1156.67 P75: 1750.00 P99: 3817.00 P99.9: 3817.00 P99.99: 3817.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 170, 250 ] 3 7.500% 10.000% ## ( 380, 580 ] 3 7.500% 17.500% ## ( 580, 870 ] 5 12.500% 30.000% ### ( 870, 1300 ] 12 30.000% 60.000% ###### ( 1300, 1900 ] 8 20.000% 80.000% #### ( 1900, 2900 ] 4 10.000% 90.000% ## ( 2900, 4400 ] 4 10.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 35 Average: 1576.4857 StdDev: 901.18 Min: 235 Median: 1400.0000 Max: 3802 Percentiles: P50: 1400.00 P75: 2108.33 P99: 3802.00 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 1 2.857% 8.571% # ( 580, 870 ] 2 5.714% 14.286% # ( 870, 1300 ] 11 31.429% 45.714% ###### ( 1300, 1900 ] 9 25.714% 71.429% ##### ( 1900, 2900 ] 6 17.143% 88.571% ### ( 2900, 4400 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 328.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.205 H:M:S, 6.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 354.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.205 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-10:20:26 ... thread 0: (1000000,2000000) ops and (322673.9,340735.5) ops/second in (3.099104,5.869656) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 1.17 GB 6.3 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.3 317.4 8.33 7.70 29 0.287 831K 807 0.0 0.0 L1 1/1 3.05 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 244.3 243.9 1.55 1.50 1 1.547 383K 615 0.0 0.0 L2 2/1 54.09 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 258.1 258.0 1.46 1.42 2 0.732 383K 210 0.0 0.0 L3 19/9 1.12 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 232.3 232.3 1.08 1.01 1 1.075 253K 0 0.0 0.0 L4 174/0 9.69 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 157.0 157.1 1.43 1.06 1 1.434 228K 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/18 97.92 GB 0.0 2.0 1.0 1.0 3.8 2.8 1.2 2.1 147.9 279.7 13.85 12.70 34 0.407 2081K 1632 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 1.0 1.0 3.8 2.8 1.1 2.1 147.9 279.7 13.85 12.70 34 0.407 2081K 1632 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 1.0 1.0 2.0 1.0 0.0 0.0 237.0 236.8 8.65 8.07 8 1.081 2081K 1632 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.9 5.21 4.63 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.78 GB write, 635.86 MB/s write, 2.00 GB read, 336.36 MB/s read, 13.9 seconds Interval compaction: 3.78 GB write, 660.05 MB/s write, 2.00 GB read, 349.15 MB/s read, 13.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 381271 Average: 2.2043 StdDev: 15.41 Min: 0 Median: 1.4699 Max: 3282 Percentiles: P50: 1.47 P75: 1.86 P99: 5.66 P99.9: 10.38 P99.99: 14.96 ------------------------------------------------------ [ 0, 1 ] 76150 19.973% 19.973% #### ( 1, 2 ] 243629 63.899% 83.872% ############# ( 2, 3 ] 35727 9.371% 93.242% ## ( 3, 4 ] 14484 3.799% 97.041% # ( 4, 6 ] 8980 2.355% 99.396% ( 6, 10 ] 1891 0.496% 99.892% ( 10, 15 ] 375 0.098% 99.991% ( 15, 22 ] 40 0.010% 100.001% ( 22, 34 ] 10 0.003% 100.004% ( 34, 51 ] 1 0.000% 100.004% ( 51, 76 ] 2 0.001% 100.005% ( 110, 170 ] 18 0.005% 100.009% ( 170, 250 ] 11 0.003% 100.012% ( 250, 380 ] 9 0.002% 100.015% ( 380, 580 ] 3 0.001% 100.015% ( 580, 870 ] 3 0.001% 100.016% ( 870, 1300 ] 3 0.001% 100.017% ( 1300, 1900 ] 3 0.001% 100.018% ( 1900, 2900 ] 3 0.001% 100.019% ( 2900, 4400 ] 6 0.002% 100.020% ** Level 1 read latency histogram (micros): Count: 31 Average: 259.5806 StdDev: 501.58 Min: 1 Median: 1.9444 Max: 2020 Percentiles: P50: 1.94 P75: 260.83 P99: 2020.00 P99.9: 2020.00 P99.99: 2020.00 ------------------------------------------------------ [ 0, 1 ] 7 22.581% 22.581% ##### ( 1, 2 ] 9 29.032% 51.613% ###### ( 3, 4 ] 1 3.226% 54.839% # ( 6, 10 ] 1 3.226% 58.065% # ( 34, 51 ] 2 6.452% 64.516% # ( 110, 170 ] 1 3.226% 67.742% # ( 170, 250 ] 2 6.452% 74.194% # ( 250, 380 ] 3 9.677% 83.871% ## ( 580, 870 ] 2 6.452% 90.323% # ( 870, 1300 ] 1 3.226% 93.548% # ( 1300, 1900 ] 1 3.226% 96.774% # ( 1900, 2900 ] 1 3.226% 100.000% # ** Level 2 read latency histogram (micros): Count: 95713 Average: 1.9836 StdDev: 5.06 Min: 1 Median: 1.3778 Max: 818 Percentiles: P50: 1.38 P75: 1.78 P99: 5.43 P99.9: 9.85 P99.99: 24.57 ------------------------------------------------------ [ 0, 1 ] 25575 26.721% 26.721% ##### ( 1, 2 ] 58980 61.622% 88.342% ############ ( 2, 3 ] 6429 6.717% 95.059% # ( 3, 4 ] 2645 2.763% 97.823% # ( 4, 6 ] 1573 1.643% 99.466% ( 6, 10 ] 432 0.451% 99.917% ( 10, 15 ] 64 0.067% 99.984% ( 15, 22 ] 5 0.005% 99.990% ( 22, 34 ] 2 0.002% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 184499 Average: 3.1072 StdDev: 26.77 Min: 1 Median: 1.6136 Max: 3817 Percentiles: P50: 1.61 P75: 2.02 P99: 8.71 P99.9: 148.89 P99.99: 424.41 ------------------------------------------------------ [ 0, 1 ] 19967 10.822% 10.822% ## ( 1, 2 ] 117797 63.847% 74.669% ############# ( 2, 3 ] 27350 14.824% 89.493% ### ( 3, 4 ] 9319 5.051% 94.544% # ( 4, 6 ] 6404 3.471% 98.015% # ( 6, 10 ] 2681 1.453% 99.468% ( 10, 15 ] 484 0.262% 99.731% ( 15, 22 ] 66 0.036% 99.766% ( 22, 34 ] 14 0.008% 99.774% ( 34, 51 ] 6 0.003% 99.777% ( 51, 76 ] 3 0.002% 99.779% ( 76, 110 ] 102 0.055% 99.834% ( 110, 170 ] 189 0.102% 99.937% ( 170, 250 ] 56 0.030% 99.967% ( 250, 380 ] 36 0.020% 99.986% ( 380, 580 ] 34 0.018% 100.005% ( 580, 870 ] 14 0.008% 100.012% ( 870, 1300 ] 15 0.008% 100.021% ( 1300, 1900 ] 9 0.005% 100.025% ( 1900, 2900 ] 4 0.002% 100.028% ( 2900, 4400 ] 4 0.002% 100.030% ** Level 4 read latency histogram (micros): Count: 325 Average: 172.5508 StdDev: 570.40 Min: 0 Median: 1.4866 Max: 3802 Percentiles: P50: 1.49 P75: 6.08 P99: 3181.25 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ [ 0, 1 ] 108 33.231% 33.231% ####### ( 1, 2 ] 112 34.462% 67.692% ####### ( 2, 3 ] 12 3.692% 71.385% # ( 3, 4 ] 1 0.308% 71.692% ( 4, 6 ] 10 3.077% 74.769% # ( 6, 10 ] 36 11.077% 85.846% ## ( 10, 15 ] 11 3.385% 89.231% # ( 170, 250 ] 1 0.308% 89.538% ( 250, 380 ] 1 0.308% 89.846% ( 380, 580 ] 1 0.308% 90.154% ( 580, 870 ] 2 0.615% 90.769% ( 870, 1300 ] 11 3.385% 94.154% # ( 1300, 1900 ] 9 2.769% 96.923% # ( 1900, 2900 ] 6 1.846% 98.769% ( 2900, 4400 ] 4 1.231% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 322.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.621 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.415 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-10:20:29 ... thread 0: (1000000,3000000) ops and (324427.5,335120.3) ops/second in (3.082353,8.952009) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.15 GB 81.8 1.4 0.0 1.4 4.1 2.8 0.0 1.5 104.2 317.2 13.30 12.32 45 0.296 1407K 1440 0.0 0.0 L1 1/1 3.05 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 244.3 243.9 1.55 1.50 1 1.547 383K 615 0.0 0.0 L2 1/0 52.09 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 258.1 258.0 1.46 1.42 2 0.732 383K 210 0.0 0.0 L3 19/0 893.52 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 245.7 245.2 4.30 4.00 2 2.149 1072K 2038 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 157.0 157.1 1.43 1.06 1 1.434 228K 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/12 98.90 GB 0.0 3.3 1.0 2.3 6.1 3.8 1.8 2.2 155.3 283.7 22.04 20.30 51 0.432 3476K 4303 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 1.0 2.3 6.1 3.8 1.7 2.2 155.3 283.7 22.04 20.30 51 0.432 3476K 4303 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 1.0 2.3 3.3 1.0 0.0 0.0 243.9 243.6 14.03 13.18 11 1.276 3476K 4303 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 353.9 8.01 7.13 40 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.11 GB write, 681.48 MB/s write, 3.34 GB read, 373.03 MB/s read, 22.0 seconds Interval compaction: 6.11 GB write, 698.47 MB/s write, 3.34 GB read, 382.33 MB/s read, 22.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 770989 Average: 2.2333 StdDev: 14.37 Min: 0 Median: 1.5039 Max: 5972 Percentiles: P50: 1.50 P75: 1.88 P99: 5.63 P99.9: 10.21 P99.99: 14.58 ------------------------------------------------------ [ 0, 1 ] 127665 16.559% 16.559% ### ( 1, 2 ] 511655 66.363% 82.922% ############# ( 2, 3 ] 79864 10.359% 93.281% ## ( 3, 4 ] 29553 3.833% 97.114% # ( 4, 6 ] 17852 2.315% 99.429% ( 6, 10 ] 3597 0.467% 99.896% ( 10, 15 ] 794 0.103% 99.999% ( 15, 22 ] 73 0.009% 100.008% ( 22, 34 ] 14 0.002% 100.010% ( 34, 51 ] 4 0.001% 100.011% ( 51, 76 ] 6 0.001% 100.011% ( 76, 110 ] 7 0.001% 100.012% ( 110, 170 ] 61 0.008% 100.020% ( 170, 250 ] 27 0.004% 100.024% ( 250, 380 ] 18 0.002% 100.026% ( 380, 580 ] 9 0.001% 100.027% ( 580, 870 ] 8 0.001% 100.028% ( 870, 1300 ] 6 0.001% 100.029% ( 1300, 1900 ] 4 0.001% 100.030% ( 1900, 2900 ] 4 0.001% 100.030% ( 2900, 4400 ] 7 0.001% 100.031% ( 4400, 6600 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 28317 Average: 3.1537 StdDev: 22.62 Min: 1 Median: 1.5996 Max: 2020 Percentiles: P50: 1.60 P75: 1.97 P99: 8.97 P99.9: 236.83 P99.99: 942.37 ------------------------------------------------------ [ 0, 1 ] 2732 9.648% 9.648% ## ( 1, 2 ] 19058 67.302% 76.950% ############# ( 2, 3 ] 3523 12.441% 89.392% ## ( 3, 4 ] 1467 5.181% 94.572% # ( 4, 6 ] 858 3.030% 97.602% # ( 6, 10 ] 534 1.886% 99.488% ( 10, 15 ] 61 0.215% 99.703% ( 15, 22 ] 2 0.007% 99.710% ( 34, 51 ] 2 0.007% 99.717% ( 51, 76 ] 1 0.004% 99.721% ( 76, 110 ] 19 0.067% 99.788% ( 110, 170 ] 25 0.088% 99.876% ( 170, 250 ] 8 0.028% 99.905% ( 250, 380 ] 12 0.042% 99.947% ( 380, 580 ] 8 0.028% 99.975% ( 580, 870 ] 4 0.014% 99.989% ( 870, 1300 ] 1 0.004% 99.993% ( 1300, 1900 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 95898 Average: 1.9847 StdDev: 5.06 Min: 1 Median: 1.3786 Max: 818 Percentiles: P50: 1.38 P75: 1.78 P99: 5.43 P99.9: 9.84 P99.99: 24.46 ------------------------------------------------------ [ 0, 1 ] 25577 26.671% 26.671% ##### ( 1, 2 ] 59086 61.613% 88.284% ############ ( 2, 3 ] 6492 6.770% 95.054% # ( 3, 4 ] 2653 2.766% 97.821% # ( 4, 6 ] 1577 1.644% 99.465% ( 6, 10 ] 434 0.453% 99.918% ( 10, 15 ] 64 0.067% 99.984% ( 15, 22 ] 5 0.005% 99.990% ( 22, 34 ] 2 0.002% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 233167 Average: 3.0789 StdDev: 25.53 Min: 1 Median: 1.5809 Max: 3817 Percentiles: P50: 1.58 P75: 1.97 P99: 8.72 P99.9: 161.35 P99.99: 512.01 ------------------------------------------------------ [ 0, 1 ] 29268 12.552% 12.552% ### ( 1, 2 ] 150303 64.462% 77.014% ############# ( 2, 3 ] 31107 13.341% 90.355% ### ( 3, 4 ] 10690 4.585% 94.940% # ( 4, 6 ] 7085 3.039% 97.978% # ( 6, 10 ] 3503 1.502% 99.481% ( 10, 15 ] 531 0.228% 99.708% ( 15, 22 ] 72 0.031% 99.739% ( 22, 34 ] 14 0.006% 99.745% ( 34, 51 ] 6 0.003% 99.748% ( 51, 76 ] 6 0.003% 99.750% ( 76, 110 ] 146 0.063% 99.813% ( 110, 170 ] 237 0.102% 99.915% ( 170, 250 ] 89 0.038% 99.953% ( 250, 380 ] 55 0.024% 99.976% ( 380, 580 ] 48 0.021% 99.997% ( 580, 870 ] 23 0.010% 100.007% ( 870, 1300 ] 20 0.009% 100.015% ( 1300, 1900 ] 10 0.004% 100.020% ( 1900, 2900 ] 4 0.002% 100.021% ( 2900, 4400 ] 4 0.002% 100.023% ** Level 4 read latency histogram (micros): Count: 325 Average: 172.5508 StdDev: 570.40 Min: 0 Median: 1.4866 Max: 3802 Percentiles: P50: 1.49 P75: 6.08 P99: 3181.25 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ [ 0, 1 ] 108 33.231% 33.231% ####### ( 1, 2 ] 112 34.462% 67.692% ####### ( 2, 3 ] 12 3.692% 71.385% # ( 3, 4 ] 1 0.308% 71.692% ( 4, 6 ] 10 3.077% 74.769% # ( 6, 10 ] 36 11.077% 85.846% ## ( 10, 15 ] 11 3.385% 89.231% # ( 170, 250 ] 1 0.308% 89.538% ( 250, 380 ] 1 0.308% 89.846% ( 380, 580 ] 1 0.308% 90.154% ( 580, 870 ] 2 0.615% 90.769% ( 870, 1300 ] 11 3.385% 94.154% # ( 1300, 1900 ] 9 2.769% 96.923% # ( 1900, 2900 ] 6 1.846% 98.769% ( 2900, 4400 ] 4 1.231% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 980.1000 StdDev: 992.97 Min: 99 Median: 500.0000 Max: 3208 Percentiles: P50: 500.00 P75: 1600.00 P99: 3208.00 P99.9: 3208.00 P99.99: 3208.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 1 5.000% 15.000% # ( 170, 250 ] 2 10.000% 25.000% ## ( 250, 380 ] 2 10.000% 35.000% ## ( 380, 580 ] 5 25.000% 60.000% ##### ( 580, 870 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 321.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.049 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.428 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-10:20:32 ... thread 0: (1000000,4000000) ops and (330389.6,333925.0) ops/second in (3.026730,11.978739) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.03 GB 12.6 2.2 0.0 2.2 5.9 3.8 0.0 1.6 114.8 314.6 19.21 17.86 62 0.310 2238K 2262 0.0 0.0 L1 10/10 1.10 GB 0.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 233.6 232.7 6.48 6.27 2 3.240 1537K 5860 0.0 0.0 L2 1/0 52.09 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 258.1 258.0 1.46 1.42 2 0.732 383K 210 0.0 0.0 L3 19/0 893.52 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 245.7 245.2 4.30 4.00 2 2.149 1072K 2038 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 157.0 157.1 1.43 1.06 1 1.434 228K 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/22 99.88 GB 0.0 5.3 2.1 3.1 9.0 5.9 1.8 2.4 163.5 280.0 32.89 30.61 69 0.477 5461K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 2.1 3.1 9.0 5.9 1.7 2.4 163.5 280.0 32.89 30.61 69 0.477 5461K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 2.1 3.1 5.2 2.1 0.0 0.0 244.2 243.7 22.03 20.95 15 1.468 5461K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 353.7 10.87 9.66 54 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.99 GB write, 754.75 MB/s write, 5.25 GB read, 440.72 MB/s read, 32.9 seconds Interval compaction: 8.99 GB write, 768.82 MB/s write, 5.25 GB read, 448.94 MB/s read, 32.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1080373 Average: 2.2319 StdDev: 15.10 Min: 0 Median: 1.4950 Max: 5972 Percentiles: P50: 1.49 P75: 1.87 P99: 5.61 P99.9: 10.31 P99.99: 14.87 ------------------------------------------------------ [ 0, 1 ] 184098 17.040% 17.040% ### ( 1, 2 ] 719412 66.589% 83.629% ############# ( 2, 3 ] 108087 10.005% 93.634% ## ( 3, 4 ] 39375 3.645% 97.279% # ( 4, 6 ] 23074 2.136% 99.414% ( 6, 10 ] 5182 0.480% 99.894% ( 10, 15 ] 1066 0.099% 99.993% ( 15, 22 ] 116 0.011% 100.003% ( 22, 34 ] 26 0.002% 100.006% ( 34, 51 ] 10 0.001% 100.007% ( 51, 76 ] 13 0.001% 100.008% ( 76, 110 ] 33 0.003% 100.011% ( 110, 170 ] 101 0.009% 100.020% ( 170, 250 ] 37 0.003% 100.024% ( 250, 380 ] 31 0.003% 100.027% ( 380, 580 ] 18 0.002% 100.028% ( 580, 870 ] 14 0.001% 100.030% ( 870, 1300 ] 11 0.001% 100.031% ( 1300, 1900 ] 5 0.000% 100.031% ( 1900, 2900 ] 6 0.001% 100.032% ( 2900, 4400 ] 11 0.001% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 58183 Average: 3.0048 StdDev: 23.03 Min: 1 Median: 1.4778 Max: 2020 Percentiles: P50: 1.48 P75: 1.86 P99: 8.77 P99.9: 259.08 P99.99: 1169.69 ------------------------------------------------------ [ 0, 1 ] 11113 19.100% 19.100% #### ( 1, 2 ] 37627 64.670% 83.770% ############# ( 2, 3 ] 5116 8.793% 92.563% ## ( 3, 4 ] 2055 3.532% 96.095% # ( 4, 6 ] 1084 1.863% 97.958% ( 6, 10 ] 877 1.507% 99.465% ( 10, 15 ] 108 0.186% 99.651% ( 15, 22 ] 10 0.017% 99.668% ( 34, 51 ] 2 0.003% 99.672% ( 51, 76 ] 1 0.002% 99.673% ( 76, 110 ] 70 0.120% 99.794% ( 110, 170 ] 45 0.077% 99.871% ( 170, 250 ] 16 0.027% 99.899% ( 250, 380 ] 26 0.045% 99.943% ( 380, 580 ] 17 0.029% 99.973% ( 580, 870 ] 7 0.012% 99.985% ( 870, 1300 ] 6 0.010% 99.995% ( 1300, 1900 ] 3 0.005% 100.000% ( 1900, 2900 ] 1 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 95898 Average: 1.9847 StdDev: 5.06 Min: 1 Median: 1.3786 Max: 818 Percentiles: P50: 1.38 P75: 1.78 P99: 5.43 P99.9: 9.84 P99.99: 24.46 ------------------------------------------------------ [ 0, 1 ] 25577 26.671% 26.671% ##### ( 1, 2 ] 59086 61.613% 88.284% ############ ( 2, 3 ] 6492 6.770% 95.054% # ( 3, 4 ] 2653 2.766% 97.821% # ( 4, 6 ] 1577 1.644% 99.465% ( 6, 10 ] 434 0.453% 99.918% ( 10, 15 ] 64 0.067% 99.984% ( 15, 22 ] 5 0.005% 99.990% ( 22, 34 ] 2 0.002% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 233167 Average: 3.0789 StdDev: 25.53 Min: 1 Median: 1.5809 Max: 3817 Percentiles: P50: 1.58 P75: 1.97 P99: 8.72 P99.9: 161.35 P99.99: 512.01 ------------------------------------------------------ [ 0, 1 ] 29268 12.552% 12.552% ### ( 1, 2 ] 150303 64.462% 77.014% ############# ( 2, 3 ] 31107 13.341% 90.355% ### ( 3, 4 ] 10690 4.585% 94.940% # ( 4, 6 ] 7085 3.039% 97.978% # ( 6, 10 ] 3503 1.502% 99.481% ( 10, 15 ] 531 0.228% 99.708% ( 15, 22 ] 72 0.031% 99.739% ( 22, 34 ] 14 0.006% 99.745% ( 34, 51 ] 6 0.003% 99.748% ( 51, 76 ] 6 0.003% 99.750% ( 76, 110 ] 146 0.063% 99.813% ( 110, 170 ] 237 0.102% 99.915% ( 170, 250 ] 89 0.038% 99.953% ( 250, 380 ] 55 0.024% 99.976% ( 380, 580 ] 48 0.021% 99.997% ( 580, 870 ] 23 0.010% 100.007% ( 870, 1300 ] 20 0.009% 100.015% ( 1300, 1900 ] 10 0.004% 100.020% ( 1900, 2900 ] 4 0.002% 100.021% ( 2900, 4400 ] 4 0.002% 100.023% ** Level 4 read latency histogram (micros): Count: 325 Average: 172.5508 StdDev: 570.40 Min: 0 Median: 1.4866 Max: 3802 Percentiles: P50: 1.49 P75: 6.08 P99: 3181.25 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ [ 0, 1 ] 108 33.231% 33.231% ####### ( 1, 2 ] 112 34.462% 67.692% ####### ( 2, 3 ] 12 3.692% 71.385% # ( 3, 4 ] 1 0.308% 71.692% ( 4, 6 ] 10 3.077% 74.769% # ( 6, 10 ] 36 11.077% 85.846% ## ( 10, 15 ] 11 3.385% 89.231% # ( 170, 250 ] 1 0.308% 89.538% ( 250, 380 ] 1 0.308% 89.846% ( 380, 580 ] 1 0.308% 90.154% ( 580, 870 ] 2 0.615% 90.769% ( 870, 1300 ] 11 3.385% 94.154% # ( 1300, 1900 ] 9 2.769% 96.923% # ( 1900, 2900 ] 6 1.846% 98.769% ( 2900, 4400 ] 4 1.231% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 980.1000 StdDev: 992.97 Min: 99 Median: 500.0000 Max: 3208 Percentiles: P50: 500.00 P75: 1600.00 P99: 3208.00 P99.9: 3208.00 P99.99: 3208.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 1 5.000% 15.000% # ( 170, 250 ] 2 10.000% 25.000% ## ( 250, 380 ] 2 10.000% 35.000% ## ( 380, 580 ] 5 25.000% 60.000% ##### ( 580, 870 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 322.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.437 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.388 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-10:20:35 ... thread 0: (1000000,5000000) ops and (330287.3,333191.0) ops/second in (3.027667,15.006406) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.01 GB 119.6 3.0 0.0 3.0 7.7 4.7 0.0 1.6 120.6 313.9 25.08 23.37 79 0.317 3070K 3150 0.0 0.0 L1 10/10 1.10 GB 0.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 233.6 232.7 6.48 6.27 2 3.240 1537K 5860 0.0 0.0 L2 1/0 52.09 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 258.1 258.0 1.46 1.42 2 0.732 383K 210 0.0 0.0 L3 19/0 893.52 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 245.7 245.2 4.30 4.00 2 2.149 1072K 2038 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 157.0 157.1 1.43 1.06 1 1.434 228K 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/22 100.86 GB 0.0 6.1 2.1 3.9 10.8 6.9 1.8 2.3 159.9 284.8 38.75 36.13 86 0.451 6292K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 2.1 3.9 10.8 6.9 1.7 2.3 159.9 284.8 38.75 36.13 86 0.451 6292K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 2.1 3.9 6.0 2.1 0.0 0.0 247.0 246.5 25.09 23.96 18 1.394 6292K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.9 13.67 12.17 68 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.78 GB write, 724.60 MB/s write, 6.05 GB read, 406.88 MB/s read, 38.8 seconds Interval compaction: 10.78 GB write, 735.38 MB/s write, 6.05 GB read, 412.94 MB/s read, 38.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1417502 Average: 2.2320 StdDev: 14.56 Min: 0 Median: 1.4943 Max: 5972 Percentiles: P50: 1.49 P75: 1.87 P99: 5.56 P99.9: 9.99 P99.99: 15.49 ------------------------------------------------------ [ 0, 1 ] 238339 16.814% 16.814% ### ( 1, 2 ] 951753 67.143% 83.957% ############# ( 2, 3 ] 140026 9.878% 93.835% ## ( 3, 4 ] 50830 3.586% 97.421% # ( 4, 6 ] 28757 2.029% 99.450% ( 6, 10 ] 6395 0.451% 99.901% ( 10, 15 ] 1252 0.088% 99.989% ( 15, 22 ] 133 0.009% 99.999% ( 22, 34 ] 28 0.002% 100.001% ( 34, 51 ] 17 0.001% 100.002% ( 51, 76 ] 13 0.001% 100.003% ( 76, 110 ] 82 0.006% 100.009% ( 110, 170 ] 158 0.011% 100.020% ( 170, 250 ] 51 0.004% 100.023% ( 250, 380 ] 47 0.003% 100.027% ( 380, 580 ] 28 0.002% 100.029% ( 580, 870 ] 22 0.002% 100.030% ( 870, 1300 ] 16 0.001% 100.031% ( 1300, 1900 ] 7 0.000% 100.032% ( 1900, 2900 ] 8 0.001% 100.032% ( 2900, 4400 ] 13 0.001% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 130932 Average: 2.7975 StdDev: 17.38 Min: 1 Median: 1.5013 Max: 2020 Percentiles: P50: 1.50 P75: 1.87 P99: 8.57 P99.9: 166.93 P99.99: 801.00 ------------------------------------------------------ [ 0, 1 ] 21381 16.330% 16.330% ### ( 1, 2 ] 87946 67.169% 83.499% ############# ( 2, 3 ] 12239 9.348% 92.847% ## ( 3, 4 ] 4322 3.301% 96.148% # ( 4, 6 ] 2411 1.841% 97.989% ( 6, 10 ] 2063 1.576% 99.565% ( 10, 15 ] 171 0.131% 99.695% ( 15, 22 ] 13 0.010% 99.705% ( 34, 51 ] 2 0.002% 99.707% ( 51, 76 ] 13 0.010% 99.717% ( 76, 110 ] 130 0.099% 99.816% ( 110, 170 ] 116 0.089% 99.905% ( 170, 250 ] 34 0.026% 99.930% ( 250, 380 ] 40 0.031% 99.961% ( 380, 580 ] 28 0.021% 99.982% ( 580, 870 ] 13 0.010% 99.992% ( 870, 1300 ] 6 0.005% 99.997% ( 1300, 1900 ] 3 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 95898 Average: 1.9847 StdDev: 5.06 Min: 1 Median: 1.3786 Max: 818 Percentiles: P50: 1.38 P75: 1.78 P99: 5.43 P99.9: 9.84 P99.99: 24.46 ------------------------------------------------------ [ 0, 1 ] 25577 26.671% 26.671% ##### ( 1, 2 ] 59086 61.613% 88.284% ############ ( 2, 3 ] 6492 6.770% 95.054% # ( 3, 4 ] 2653 2.766% 97.821% # ( 4, 6 ] 1577 1.644% 99.465% ( 6, 10 ] 434 0.453% 99.918% ( 10, 15 ] 64 0.067% 99.984% ( 15, 22 ] 5 0.005% 99.990% ( 22, 34 ] 2 0.002% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 233167 Average: 3.0789 StdDev: 25.53 Min: 1 Median: 1.5809 Max: 3817 Percentiles: P50: 1.58 P75: 1.97 P99: 8.72 P99.9: 161.35 P99.99: 512.01 ------------------------------------------------------ [ 0, 1 ] 29268 12.552% 12.552% ### ( 1, 2 ] 150303 64.462% 77.014% ############# ( 2, 3 ] 31107 13.341% 90.355% ### ( 3, 4 ] 10690 4.585% 94.940% # ( 4, 6 ] 7085 3.039% 97.978% # ( 6, 10 ] 3503 1.502% 99.481% ( 10, 15 ] 531 0.228% 99.708% ( 15, 22 ] 72 0.031% 99.739% ( 22, 34 ] 14 0.006% 99.745% ( 34, 51 ] 6 0.003% 99.748% ( 51, 76 ] 6 0.003% 99.750% ( 76, 110 ] 146 0.063% 99.813% ( 110, 170 ] 237 0.102% 99.915% ( 170, 250 ] 89 0.038% 99.953% ( 250, 380 ] 55 0.024% 99.976% ( 380, 580 ] 48 0.021% 99.997% ( 580, 870 ] 23 0.010% 100.007% ( 870, 1300 ] 20 0.009% 100.015% ( 1300, 1900 ] 10 0.004% 100.020% ( 1900, 2900 ] 4 0.002% 100.021% ( 2900, 4400 ] 4 0.002% 100.023% ** Level 4 read latency histogram (micros): Count: 325 Average: 172.5508 StdDev: 570.40 Min: 0 Median: 1.4866 Max: 3802 Percentiles: P50: 1.49 P75: 6.08 P99: 3181.25 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ [ 0, 1 ] 108 33.231% 33.231% ####### ( 1, 2 ] 112 34.462% 67.692% ####### ( 2, 3 ] 12 3.692% 71.385% # ( 3, 4 ] 1 0.308% 71.692% ( 4, 6 ] 10 3.077% 74.769% # ( 6, 10 ] 36 11.077% 85.846% ## ( 10, 15 ] 11 3.385% 89.231% # ( 170, 250 ] 1 0.308% 89.538% ( 250, 380 ] 1 0.308% 89.846% ( 380, 580 ] 1 0.308% 90.154% ( 580, 870 ] 2 0.615% 90.769% ( 870, 1300 ] 11 3.385% 94.154% # ( 1300, 1900 ] 9 2.769% 96.923% # ( 1900, 2900 ] 6 1.846% 98.769% ( 2900, 4400 ] 4 1.231% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 980.1000 StdDev: 992.97 Min: 99 Median: 500.0000 Max: 3208 Percentiles: P50: 500.00 P75: 1600.00 P99: 3208.00 P99.9: 3208.00 P99.99: 3208.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 1 5.000% 15.000% # ( 170, 250 ] 2 10.000% 25.000% ## ( 250, 380 ] 2 10.000% 35.000% ## ( 380, 580 ] 5 25.000% 60.000% ##### ( 580, 870 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.2 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 323.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.834 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.397 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-10:20:40 ... thread 0: (1000000,6000000) ops and (200995.1,300275.5) ops/second in (4.975246,19.981652) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.93 GB 157.3 4.2 0.0 4.2 9.9 5.7 0.0 1.7 133.2 310.6 32.64 30.57 99 0.330 4413K 4514 0.0 0.0 L1 10/10 1.10 GB 0.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 233.6 232.7 6.48 6.27 2 3.240 1537K 5860 0.0 0.0 L2 1/0 52.09 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 258.1 258.0 1.46 1.42 2 0.732 383K 210 0.0 0.0 L3 19/0 893.52 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 245.7 245.2 4.30 4.00 2 2.149 1072K 2038 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 157.0 157.1 1.43 1.06 1 1.434 228K 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/22 101.78 GB 0.0 7.3 2.1 5.2 13.0 7.8 1.8 2.3 162.3 287.2 46.32 43.32 106 0.437 7636K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.3 2.1 5.2 13.0 7.8 1.7 2.3 162.3 287.2 46.32 43.32 106 0.437 7636K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.3 2.1 5.2 7.3 2.1 0.0 0.0 251.2 250.8 29.94 28.71 23 1.302 7636K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 353.7 16.38 14.61 83 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.2 total, 20.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.99 GB write, 658.36 MB/s write, 7.34 GB read, 372.17 MB/s read, 46.3 seconds Interval compaction: 12.99 GB write, 665.71 MB/s write, 7.34 GB read, 376.33 MB/s read, 46.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 13, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1897165 Average: 2.2331 StdDev: 13.82 Min: 0 Median: 1.4856 Max: 5972 Percentiles: P50: 1.49 P75: 1.86 P99: 5.57 P99.9: 10.26 P99.99: 63.94 ------------------------------------------------------ [ 0, 1 ] 328215 17.300% 17.300% ### ( 1, 2 ] 1277561 67.341% 84.641% ############# ( 2, 3 ] 179186 9.445% 94.086% ## ( 3, 4 ] 65467 3.451% 97.537% # ( 4, 6 ] 35469 1.870% 99.406% ( 6, 10 ] 9289 0.490% 99.896% ( 10, 15 ] 1562 0.082% 99.978% ( 15, 22 ] 164 0.009% 99.987% ( 22, 34 ] 35 0.002% 99.989% ( 34, 51 ] 19 0.001% 99.990% ( 51, 76 ] 16 0.001% 99.990% ( 76, 110 ] 165 0.009% 99.999% ( 110, 170 ] 278 0.015% 100.014% ( 170, 250 ] 107 0.006% 100.019% ( 250, 380 ] 79 0.004% 100.024% ( 380, 580 ] 65 0.003% 100.027% ( 580, 870 ] 44 0.002% 100.029% ( 870, 1300 ] 20 0.001% 100.030% ( 1300, 1900 ] 9 0.000% 100.031% ( 1900, 2900 ] 8 0.000% 100.031% ( 2900, 4400 ] 15 0.001% 100.032% ( 4400, 6600 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 249583 Average: 2.6114 StdDev: 14.96 Min: 1 Median: 1.4846 Max: 2327 Percentiles: P50: 1.48 P75: 1.86 P99: 8.26 P99.9: 149.72 P99.99: 635.13 ------------------------------------------------------ [ 0, 1 ] 43257 17.332% 17.332% ### ( 1, 2 ] 168235 67.406% 84.738% ############# ( 2, 3 ] 21639 8.670% 93.408% ## ( 3, 4 ] 7581 3.037% 96.446% # ( 4, 6 ] 4217 1.690% 98.135% ( 6, 10 ] 3814 1.528% 99.663% ( 10, 15 ] 231 0.093% 99.756% ( 15, 22 ] 24 0.010% 99.766% ( 22, 34 ] 3 0.001% 99.767% ( 34, 51 ] 6 0.002% 99.769% ( 51, 76 ] 13 0.005% 99.774% ( 76, 110 ] 183 0.073% 99.848% ( 110, 170 ] 197 0.079% 99.927% ( 170, 250 ] 61 0.024% 99.951% ( 250, 380 ] 55 0.022% 99.973% ( 380, 580 ] 39 0.016% 99.989% ( 580, 870 ] 16 0.006% 99.995% ( 870, 1300 ] 6 0.002% 99.998% ( 1300, 1900 ] 4 0.002% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 95898 Average: 1.9847 StdDev: 5.06 Min: 1 Median: 1.3786 Max: 818 Percentiles: P50: 1.38 P75: 1.78 P99: 5.43 P99.9: 9.84 P99.99: 24.46 ------------------------------------------------------ [ 0, 1 ] 25577 26.671% 26.671% ##### ( 1, 2 ] 59086 61.613% 88.284% ############ ( 2, 3 ] 6492 6.770% 95.054% # ( 3, 4 ] 2653 2.766% 97.821% # ( 4, 6 ] 1577 1.644% 99.465% ( 6, 10 ] 434 0.453% 99.918% ( 10, 15 ] 64 0.067% 99.984% ( 15, 22 ] 5 0.005% 99.990% ( 22, 34 ] 2 0.002% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 233167 Average: 3.0789 StdDev: 25.53 Min: 1 Median: 1.5809 Max: 3817 Percentiles: P50: 1.58 P75: 1.97 P99: 8.72 P99.9: 161.35 P99.99: 512.01 ------------------------------------------------------ [ 0, 1 ] 29268 12.552% 12.552% ### ( 1, 2 ] 150303 64.462% 77.014% ############# ( 2, 3 ] 31107 13.341% 90.355% ### ( 3, 4 ] 10690 4.585% 94.940% # ( 4, 6 ] 7085 3.039% 97.978% # ( 6, 10 ] 3503 1.502% 99.481% ( 10, 15 ] 531 0.228% 99.708% ( 15, 22 ] 72 0.031% 99.739% ( 22, 34 ] 14 0.006% 99.745% ( 34, 51 ] 6 0.003% 99.748% ( 51, 76 ] 6 0.003% 99.750% ( 76, 110 ] 146 0.063% 99.813% ( 110, 170 ] 237 0.102% 99.915% ( 170, 250 ] 89 0.038% 99.953% ( 250, 380 ] 55 0.024% 99.976% ( 380, 580 ] 48 0.021% 99.997% ( 580, 870 ] 23 0.010% 100.007% ( 870, 1300 ] 20 0.009% 100.015% ( 1300, 1900 ] 10 0.004% 100.020% ( 1900, 2900 ] 4 0.002% 100.021% ( 2900, 4400 ] 4 0.002% 100.023% ** Level 4 read latency histogram (micros): Count: 325 Average: 172.5508 StdDev: 570.40 Min: 0 Median: 1.4866 Max: 3802 Percentiles: P50: 1.49 P75: 6.08 P99: 3181.25 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ [ 0, 1 ] 108 33.231% 33.231% ####### ( 1, 2 ] 112 34.462% 67.692% ####### ( 2, 3 ] 12 3.692% 71.385% # ( 3, 4 ] 1 0.308% 71.692% ( 4, 6 ] 10 3.077% 74.769% # ( 6, 10 ] 36 11.077% 85.846% ## ( 10, 15 ] 11 3.385% 89.231% # ( 170, 250 ] 1 0.308% 89.538% ( 250, 380 ] 1 0.308% 89.846% ( 380, 580 ] 1 0.308% 90.154% ( 580, 870 ] 2 0.615% 90.769% ( 870, 1300 ] 11 3.385% 94.154% # ( 1300, 1900 ] 9 2.769% 96.923% # ( 1900, 2900 ] 6 1.846% 98.769% ( 2900, 4400 ] 4 1.231% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 980.1000 StdDev: 992.97 Min: 99 Median: 500.0000 Max: 3208 Percentiles: P50: 500.00 P75: 1600.00 P99: 3208.00 P99.9: 3208.00 P99.99: 3208.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 1 5.000% 15.000% # ( 170, 250 ] 2 10.000% 25.000% ## ( 250, 380 ] 2 10.000% 35.000% ## ( 380, 580 ] 5 25.000% 60.000% ##### ( 580, 870 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 20.2 total, 5.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 292.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.055 H:M:S, 20.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 197.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.221 H:M:S, 44.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-10:20:48 ... thread 0: (1000000,7000000) ops and (128749.6,252264.4) ops/second in (7.767015,27.748667) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 3.32 GB 25.2 5.8 0.0 5.8 12.4 6.6 0.0 1.9 142.8 306.7 41.46 38.81 118 0.351 6012K 7779 0.0 0.0 L1 18/18 2.17 GB 0.0 4.2 3.1 1.1 4.1 3.0 0.2 1.3 229.3 227.4 18.67 17.83 3 6.223 4347K 36K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 258.1 258.0 1.46 1.42 2 0.732 383K 210 0.0 0.0 L3 24/0 943.41 MB 0.9 1.7 0.8 0.9 1.7 0.8 0.4 2.2 227.0 226.4 7.83 7.13 4 1.957 1804K 4217 0.0 0.0 L4 174/0 9.46 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 157.0 157.1 1.43 1.06 1 1.434 228K 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/31 102.73 GB 0.0 12.3 4.3 8.0 18.9 10.9 3.4 2.8 177.6 272.9 70.85 66.25 128 0.554 12M 48K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.3 4.3 8.0 18.9 10.9 3.3 2.8 177.6 272.9 70.85 66.25 128 0.554 12M 48K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.3 4.3 8.0 12.2 4.2 0.0 0.0 243.7 242.7 51.64 49.14 30 1.721 12M 48K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 354.1 19.21 17.10 98 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.0 total, 27.7 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.88 GB write, 691.25 MB/s write, 12.29 GB read, 449.79 MB/s read, 70.9 seconds Interval compaction: 18.88 GB write, 696.82 MB/s write, 12.29 GB read, 453.41 MB/s read, 70.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 16, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2522151 Average: 2.3731 StdDev: 14.84 Min: 0 Median: 1.4789 Max: 5972 Percentiles: P50: 1.48 P75: 1.85 P99: 5.81 P99.9: 80.45 P99.99: 169.38 ------------------------------------------------------ [ 0, 1 ] 448951 17.800% 17.800% #### ( 1, 2 ] 1695748 67.234% 85.035% ############# ( 2, 3 ] 227363 9.015% 94.049% ## ( 3, 4 ] 84569 3.353% 97.402% # ( 4, 6 ] 44624 1.769% 99.172% ( 6, 10 ] 15389 0.610% 99.782% ( 10, 15 ] 2405 0.095% 99.877% ( 15, 22 ] 350 0.014% 99.891% ( 22, 34 ] 50 0.002% 99.893% ( 34, 51 ] 21 0.001% 99.894% ( 51, 76 ] 23 0.001% 99.895% ( 76, 110 ] 1038 0.041% 99.936% ( 110, 170 ] 1382 0.055% 99.991% ( 170, 250 ] 360 0.014% 100.005% ( 250, 380 ] 239 0.009% 100.014% ( 380, 580 ] 176 0.007% 100.021% ( 580, 870 ] 88 0.003% 100.025% ( 870, 1300 ] 29 0.001% 100.026% ( 1300, 1900 ] 14 0.001% 100.026% ( 1900, 2900 ] 13 0.001% 100.027% ( 2900, 4400 ] 19 0.001% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 511498 Average: 2.8493 StdDev: 18.30 Min: 1 Median: 1.5148 Max: 3121 Percentiles: P50: 1.51 P75: 1.89 P99: 8.66 P99.9: 166.72 P99.99: 747.13 ------------------------------------------------------ [ 0, 1 ] 78857 15.417% 15.417% ### ( 1, 2 ] 343602 67.176% 82.593% ############# ( 2, 3 ] 50644 9.901% 92.494% ## ( 3, 4 ] 17184 3.360% 95.853% # ( 4, 6 ] 10587 2.070% 97.923% ( 6, 10 ] 8294 1.622% 99.544% ( 10, 15 ] 721 0.141% 99.685% ( 15, 22 ] 171 0.033% 99.719% ( 22, 34 ] 13 0.003% 99.721% ( 34, 51 ] 6 0.001% 99.723% ( 51, 76 ] 18 0.004% 99.726% ( 76, 110 ] 432 0.084% 99.811% ( 110, 170 ] 484 0.095% 99.905% ( 170, 250 ] 173 0.034% 99.939% ( 250, 380 ] 116 0.023% 99.962% ( 380, 580 ] 112 0.022% 99.984% ( 580, 870 ] 57 0.011% 99.995% ( 870, 1300 ] 36 0.007% 100.002% ( 1300, 1900 ] 13 0.003% 100.004% ( 1900, 2900 ] 2 0.000% 100.005% ( 2900, 4400 ] 1 0.000% 100.005% ** Level 2 read latency histogram (micros): Count: 95898 Average: 1.9847 StdDev: 5.06 Min: 1 Median: 1.3786 Max: 818 Percentiles: P50: 1.38 P75: 1.78 P99: 5.43 P99.9: 9.84 P99.99: 24.46 ------------------------------------------------------ [ 0, 1 ] 25577 26.671% 26.671% ##### ( 1, 2 ] 59086 61.613% 88.284% ############ ( 2, 3 ] 6492 6.770% 95.054% # ( 3, 4 ] 2653 2.766% 97.821% # ( 4, 6 ] 1577 1.644% 99.465% ( 6, 10 ] 434 0.453% 99.918% ( 10, 15 ] 64 0.067% 99.984% ( 15, 22 ] 5 0.005% 99.990% ( 22, 34 ] 2 0.002% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 239505 Average: 3.5819 StdDev: 29.23 Min: 1 Median: 1.5880 Max: 3817 Percentiles: P50: 1.59 P75: 1.98 P99: 9.27 P99.9: 285.22 P99.99: 663.15 ------------------------------------------------------ [ 0, 1 ] 29655 12.382% 12.382% ## ( 1, 2 ] 153232 63.979% 76.360% ############# ( 2, 3 ] 32614 13.617% 89.978% ### ( 3, 4 ] 11260 4.701% 94.679% # ( 4, 6 ] 7393 3.087% 97.766% # ( 6, 10 ] 3617 1.510% 99.276% ( 10, 15 ] 564 0.235% 99.511% ( 15, 22 ] 81 0.034% 99.545% ( 22, 34 ] 15 0.006% 99.552% ( 34, 51 ] 9 0.004% 99.555% ( 51, 76 ] 6 0.003% 99.558% ( 76, 110 ] 200 0.084% 99.641% ( 110, 170 ] 398 0.166% 99.808% ( 170, 250 ] 186 0.078% 99.885% ( 250, 380 ] 131 0.055% 99.940% ( 380, 580 ] 106 0.044% 99.984% ( 580, 870 ] 49 0.020% 100.005% ( 870, 1300 ] 23 0.010% 100.014% ( 1300, 1900 ] 11 0.005% 100.019% ( 1900, 2900 ] 5 0.002% 100.021% ( 2900, 4400 ] 4 0.002% 100.023% ** Level 4 read latency histogram (micros): Count: 325 Average: 172.5508 StdDev: 570.40 Min: 0 Median: 1.4866 Max: 3802 Percentiles: P50: 1.49 P75: 6.08 P99: 3181.25 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ [ 0, 1 ] 108 33.231% 33.231% ####### ( 1, 2 ] 112 34.462% 67.692% ####### ( 2, 3 ] 12 3.692% 71.385% # ( 3, 4 ] 1 0.308% 71.692% ( 4, 6 ] 10 3.077% 74.769% # ( 6, 10 ] 36 11.077% 85.846% ## ( 10, 15 ] 11 3.385% 89.231% # ( 170, 250 ] 1 0.308% 89.538% ( 250, 380 ] 1 0.308% 89.846% ( 380, 580 ] 1 0.308% 90.154% ( 580, 870 ] 2 0.615% 90.769% ( 870, 1300 ] 11 3.385% 94.154% # ( 1300, 1900 ] 9 2.769% 96.923% # ( 1900, 2900 ] 6 1.846% 98.769% ( 2900, 4400 ] 4 1.231% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 849.7500 StdDev: 997.92 Min: 82 Median: 402.2222 Max: 4078 Percentiles: P50: 402.22 P75: 1300.00 P99: 4078.00 P99.9: 4078.00 P99.99: 4078.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 13 21.667% 31.667% #### ( 170, 250 ] 6 10.000% 41.667% ## ( 250, 380 ] 4 6.667% 48.333% # ( 380, 580 ] 9 15.000% 63.333% ### ( 580, 870 ] 5 8.333% 71.667% ## ( 870, 1300 ] 2 3.333% 75.000% # ( 1300, 1900 ] 6 10.000% 85.000% ## ( 1900, 2900 ] 5 8.333% 93.333% ## ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 28.0 total, 7.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 246.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.087 H:M:S, 32.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.032 H:M:S, 64.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-10:21:14 ... thread 0: (1000000,8000000) ops and (38109.4,148178.6) ops/second in (26.240228,53.988895) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/2 1.47 GB 25.2 7.8 0.0 7.8 15.4 7.6 0.0 2.0 152.3 299.6 52.50 48.62 135 0.389 8121K 14K 0.0 0.0 L1 7/7 831.30 MB 0.0 9.1 5.8 3.3 9.0 5.7 0.2 1.5 224.3 221.1 41.60 38.82 4 10.400 9313K 36K 0.0 0.0 L2 16/15 2.01 GB 1.3 0.4 0.2 0.2 0.4 0.2 5.1 2.0 258.1 258.0 1.46 1.42 2 0.732 383K 210 0.0 0.0 L3 25/7 1.56 GB 1.0 4.8 2.8 2.0 4.7 2.8 0.4 1.7 198.0 196.9 24.68 21.00 11 2.243 4962K 27K 0.0 0.0 L4 174/4 9.52 GB 1.0 1.6 1.5 0.1 1.6 1.5 0.8 1.0 125.9 125.6 12.97 7.54 16 0.810 1646K 2709 0.0 0.0 L5 1072/0 88.15 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/35 103.53 GB 0.0 23.7 10.4 13.3 31.1 17.8 8.8 4.1 181.9 238.7 133.21 117.40 168 0.793 24M 80K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.7 10.4 13.3 31.1 17.8 8.7 4.1 181.9 238.7 133.21 117.40 168 0.793 24M 80K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.7 10.4 13.3 23.5 10.2 0.0 0.0 219.4 217.8 110.43 97.87 57 1.937 24M 80K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 340.1 22.78 19.53 111 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.2 total, 54.0 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.05 GB write, 586.49 MB/s write, 23.66 GB read, 446.89 MB/s read, 133.2 seconds Interval compaction: 31.05 GB write, 588.91 MB/s write, 23.66 GB read, 448.73 MB/s read, 133.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 28, pending-compaction-bytes-stops: 0, total-delays: 39, total-stops: 24, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3881926 Average: 2.7540 StdDev: 24.45 Min: 0 Median: 1.4828 Max: 7643 Percentiles: P50: 1.48 P75: 1.87 P99: 7.03 P99.9: 139.27 P99.99: 356.88 ------------------------------------------------------ [ 0, 1 ] 719956 18.546% 18.546% #### ( 1, 2 ] 2529015 65.148% 83.695% ############# ( 2, 3 ] 360108 9.277% 92.971% ## ( 3, 4 ] 137645 3.546% 96.517% # ( 4, 6 ] 88734 2.286% 98.803% ( 6, 10 ] 29676 0.764% 99.567% ( 10, 15 ] 4710 0.121% 99.689% ( 15, 22 ] 932 0.024% 99.713% ( 22, 34 ] 86 0.002% 99.715% ( 34, 51 ] 33 0.001% 99.716% ( 51, 76 ] 260 0.007% 99.723% ( 76, 110 ] 4938 0.127% 99.850% ( 110, 170 ] 3999 0.103% 99.953% ( 170, 250 ] 904 0.023% 99.976% ( 250, 380 ] 659 0.017% 99.993% ( 380, 580 ] 579 0.015% 100.008% ( 580, 870 ] 316 0.008% 100.016% ( 870, 1300 ] 106 0.003% 100.019% ( 1300, 1900 ] 55 0.001% 100.020% ( 1900, 2900 ] 45 0.001% 100.021% ( 2900, 4400 ] 56 0.001% 100.023% ( 4400, 6600 ] 13 0.000% 100.023% ( 6600, 9900 ] 4 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1912774 Average: 3.9428 StdDev: 47.82 Min: 1 Median: 1.6160 Max: 10842 Percentiles: P50: 1.62 P75: 2.17 P99: 9.31 P99.9: 166.74 P99.99: 459.13 ------------------------------------------------------ [ 0, 1 ] 259831 13.584% 13.584% ### ( 1, 2 ] 1130759 59.116% 72.700% ############ ( 2, 3 ] 258097 13.493% 86.194% ### ( 3, 4 ] 120842 6.318% 92.511% # ( 4, 6 ] 94606 4.946% 97.457% # ( 6, 10 ] 35695 1.866% 99.323% ( 10, 15 ] 5255 0.275% 99.598% ( 15, 22 ] 961 0.050% 99.648% ( 22, 34 ] 91 0.005% 99.653% ( 34, 51 ] 23 0.001% 99.654% ( 51, 76 ] 104 0.005% 99.660% ( 76, 110 ] 2583 0.135% 99.795% ( 110, 170 ] 2132 0.111% 99.906% ( 170, 250 ] 675 0.035% 99.941% ( 250, 380 ] 651 0.034% 99.975% ( 380, 580 ] 707 0.037% 100.012% ( 580, 870 ] 561 0.029% 100.042% ( 870, 1300 ] 323 0.017% 100.059% ( 1300, 1900 ] 141 0.007% 100.066% ( 1900, 2900 ] 85 0.004% 100.070% ( 2900, 4400 ] 80 0.004% 100.075% ( 4400, 6600 ] 31 0.002% 100.076% ( 6600, 9900 ] 12 0.001% 100.077% ( 9900, 14000 ] 1 0.000% 100.077% ** Level 2 read latency histogram (micros): Count: 95898 Average: 1.9847 StdDev: 5.06 Min: 1 Median: 1.3786 Max: 818 Percentiles: P50: 1.38 P75: 1.78 P99: 5.43 P99.9: 9.84 P99.99: 24.46 ------------------------------------------------------ [ 0, 1 ] 25577 26.671% 26.671% ##### ( 1, 2 ] 59086 61.613% 88.284% ############ ( 2, 3 ] 6492 6.770% 95.054% # ( 3, 4 ] 2653 2.766% 97.821% # ( 4, 6 ] 1577 1.644% 99.465% ( 6, 10 ] 434 0.453% 99.918% ( 10, 15 ] 64 0.067% 99.984% ( 15, 22 ] 5 0.005% 99.990% ( 22, 34 ] 2 0.002% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 845730 Average: 5.6336 StdDev: 76.11 Min: 1 Median: 1.8220 Max: 10564 Percentiles: P50: 1.82 P75: 2.77 P99: 9.40 P99.9: 314.34 P99.99: 562.62 ------------------------------------------------------ [ 0, 1 ] 39591 4.681% 4.681% # ( 1, 2 ] 466257 55.131% 59.812% ########### ( 2, 3 ] 166798 19.722% 79.534% #### ( 3, 4 ] 80773 9.551% 89.085% ## ( 4, 6 ] 69848 8.259% 97.344% ## ( 6, 10 ] 16498 1.951% 99.295% ( 10, 15 ] 3057 0.361% 99.656% ( 15, 22 ] 385 0.046% 99.702% ( 22, 34 ] 35 0.004% 99.706% ( 34, 51 ] 17 0.002% 99.708% ( 51, 76 ] 17 0.002% 99.710% ( 76, 110 ] 238 0.028% 99.738% ( 110, 170 ] 646 0.076% 99.814% ( 170, 250 ] 461 0.055% 99.869% ( 250, 380 ] 538 0.064% 99.932% ( 380, 580 ] 536 0.063% 99.996% ( 580, 870 ] 473 0.056% 100.052% ( 870, 1300 ] 297 0.035% 100.087% ( 1300, 1900 ] 127 0.015% 100.102% ( 1900, 2900 ] 119 0.014% 100.116% ( 2900, 4400 ] 120 0.014% 100.130% ( 4400, 6600 ] 33 0.004% 100.134% ( 6600, 9900 ] 10 0.001% 100.135% ( 9900, 14000 ] 2 0.000% 100.136% ** Level 4 read latency histogram (micros): Count: 15420 Average: 79.2141 StdDev: 387.18 Min: 0 Median: 1.9692 Max: 11377 Percentiles: P50: 1.97 P75: 3.27 P99: 1661.08 P99.9: 4924.92 P99.99: 8222.21 ------------------------------------------------------ [ 0, 1 ] 481 3.119% 3.119% # ( 1, 2 ] 7459 48.372% 51.492% ########## ( 2, 3 ] 3176 20.597% 72.088% #### ( 3, 4 ] 1656 10.739% 82.827% ## ( 4, 6 ] 956 6.200% 89.027% # ( 6, 10 ] 335 2.173% 91.200% ( 10, 15 ] 83 0.538% 91.738% ( 15, 22 ] 9 0.058% 91.796% ( 22, 34 ] 2 0.013% 91.809% ( 76, 110 ] 14 0.091% 91.900% ( 110, 170 ] 71 0.460% 92.361% ( 170, 250 ] 99 0.642% 93.003% ( 250, 380 ] 139 0.901% 93.904% ( 380, 580 ] 220 1.427% 95.331% ( 580, 870 ] 279 1.809% 97.140% ( 870, 1300 ] 224 1.453% 98.593% ( 1300, 1900 ] 106 0.687% 99.280% ( 1900, 2900 ] 54 0.350% 99.630% ( 2900, 4400 ] 39 0.253% 99.883% ( 4400, 6600 ] 15 0.097% 99.981% ( 6600, 9900 ] 5 0.032% 100.013% ( 9900, 14000 ] 1 0.006% 100.019% ** Level 5 read latency histogram (micros): Count: 140 Average: 1179.1500 StdDev: 1213.72 Min: 82 Median: 708.8889 Max: 7239 Percentiles: P50: 708.89 P75: 1690.00 P99: 6160.00 P99.9: 7239.00 P99.99: 7239.00 ------------------------------------------------------ ( 76, 110 ] 6 4.286% 4.286% # ( 110, 170 ] 16 11.429% 15.714% ## ( 170, 250 ] 13 9.286% 25.000% ## ( 250, 380 ] 7 5.000% 30.000% # ( 380, 580 ] 20 14.286% 44.286% ### ( 580, 870 ] 18 12.857% 57.143% ### ( 870, 1300 ] 12 8.571% 65.714% ## ( 1300, 1900 ] 20 14.286% 80.000% ### ( 1900, 2900 ] 16 11.429% 91.429% ## ( 2900, 4400 ] 9 6.429% 97.857% # ( 4400, 6600 ] 2 1.429% 99.286% ( 6600, 9900 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 54.2 total, 26.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 145.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.067 H:M:S, 59.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 37.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:22.980 H:M:S, 87.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/12-10:21:18 ... thread 0: (1000000,9000000) ops and (294801.2,156846.3) ops/second in (3.392116,57.381011) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 2.39 GB 62.9 8.4 0.0 8.4 16.9 8.5 0.0 2.0 147.9 296.6 58.34 53.51 150 0.389 8761K 15K 0.0 0.0 L1 7/7 831.30 MB 0.0 9.1 5.8 3.3 9.0 5.7 0.2 1.5 224.3 221.1 41.60 38.82 4 10.400 9313K 36K 0.0 0.0 L2 15/14 1.89 GB 1.3 0.4 0.2 0.2 0.4 0.2 5.1 2.0 258.1 258.0 1.46 1.42 2 0.732 383K 210 0.0 0.0 L3 19/1 1.07 GB 1.0 5.0 2.9 2.1 5.0 2.9 0.4 1.7 195.2 194.2 26.46 22.28 12 2.205 5246K 27K 0.0 0.0 L4 173/0 9.46 GB 1.0 2.2 2.2 0.1 2.2 2.2 0.8 1.0 132.4 132.1 17.35 10.65 23 0.755 2302K 3174 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/32 104.45 GB 0.0 25.2 11.1 14.1 33.5 19.4 9.5 3.9 177.7 236.3 145.22 126.67 191 0.760 26M 82K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.2 11.1 14.1 33.5 19.4 9.4 3.9 177.7 236.3 145.22 126.67 191 0.760 26M 82K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.2 11.1 14.1 25.0 10.9 0.0 0.0 216.3 214.7 119.31 104.71 67 1.781 26M 82K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 335.5 25.91 21.96 124 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.6 total, 57.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.51 GB write, 595.64 MB/s write, 25.20 GB read, 447.91 MB/s read, 145.2 seconds Interval compaction: 33.51 GB write, 597.96 MB/s write, 25.20 GB read, 449.65 MB/s read, 145.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 28, pending-compaction-bytes-stops: 0, total-delays: 39, total-stops: 27, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4146325 Average: 2.7949 StdDev: 25.43 Min: 0 Median: 1.4956 Max: 7643 Percentiles: P50: 1.50 P75: 1.88 P99: 7.15 P99.9: 139.09 P99.99: 369.52 ------------------------------------------------------ [ 0, 1 ] 738743 17.817% 17.817% #### ( 1, 2 ] 2692804 64.944% 82.761% ############# ( 2, 3 ] 404412 9.754% 92.515% ## ( 3, 4 ] 155698 3.755% 96.270% # ( 4, 6 ] 103666 2.500% 98.770% # ( 6, 10 ] 33123 0.799% 99.569% ( 10, 15 ] 5422 0.131% 99.700% ( 15, 22 ] 990 0.024% 99.723% ( 22, 34 ] 87 0.002% 99.726% ( 34, 51 ] 36 0.001% 99.726% ( 51, 76 ] 261 0.006% 99.733% ( 76, 110 ] 4957 0.120% 99.852% ( 110, 170 ] 4088 0.099% 99.951% ( 170, 250 ] 968 0.023% 99.974% ( 250, 380 ] 715 0.017% 99.991% ( 380, 580 ] 637 0.015% 100.007% ( 580, 870 ] 371 0.009% 100.016% ( 870, 1300 ] 131 0.003% 100.019% ( 1300, 1900 ] 69 0.002% 100.021% ( 1900, 2900 ] 56 0.001% 100.022% ( 2900, 4400 ] 66 0.002% 100.024% ( 4400, 6600 ] 15 0.000% 100.024% ( 6600, 9900 ] 4 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 2221312 Average: 4.0005 StdDev: 49.74 Min: 1 Median: 1.6372 Max: 10842 Percentiles: P50: 1.64 P75: 2.24 P99: 9.31 P99.9: 169.71 P99.99: 486.63 ------------------------------------------------------ [ 0, 1 ] 269292 12.123% 12.123% ## ( 1, 2 ] 1320455 59.445% 71.568% ############ ( 2, 3 ] 318974 14.360% 85.928% ### ( 3, 4 ] 142683 6.423% 92.351% # ( 4, 6 ] 112748 5.076% 97.427% # ( 6, 10 ] 42211 1.900% 99.327% ( 10, 15 ] 6394 0.288% 99.615% ( 15, 22 ] 1088 0.049% 99.664% ( 22, 34 ] 99 0.004% 99.668% ( 34, 51 ] 23 0.001% 99.669% ( 51, 76 ] 108 0.005% 99.674% ( 76, 110 ] 2673 0.120% 99.795% ( 110, 170 ] 2354 0.106% 99.901% ( 170, 250 ] 794 0.036% 99.936% ( 250, 380 ] 762 0.034% 99.971% ( 380, 580 ] 810 0.036% 100.007% ( 580, 870 ] 642 0.029% 100.036% ( 870, 1300 ] 367 0.017% 100.052% ( 1300, 1900 ] 161 0.007% 100.060% ( 1900, 2900 ] 110 0.005% 100.065% ( 2900, 4400 ] 115 0.005% 100.070% ( 4400, 6600 ] 36 0.002% 100.071% ( 6600, 9900 ] 15 0.001% 100.072% ( 9900, 14000 ] 1 0.000% 100.072% ** Level 2 read latency histogram (micros): Count: 95898 Average: 1.9847 StdDev: 5.06 Min: 1 Median: 1.3786 Max: 818 Percentiles: P50: 1.38 P75: 1.78 P99: 5.43 P99.9: 9.84 P99.99: 24.46 ------------------------------------------------------ [ 0, 1 ] 25577 26.671% 26.671% ##### ( 1, 2 ] 59086 61.613% 88.284% ############ ( 2, 3 ] 6492 6.770% 95.054% # ( 3, 4 ] 2653 2.766% 97.821% # ( 4, 6 ] 1577 1.644% 99.465% ( 6, 10 ] 434 0.453% 99.918% ( 10, 15 ] 64 0.067% 99.984% ( 15, 22 ] 5 0.005% 99.990% ( 22, 34 ] 2 0.002% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 1029305 Average: 5.8289 StdDev: 82.31 Min: 1 Median: 1.8524 Max: 10564 Percentiles: P50: 1.85 P75: 2.82 P99: 9.43 P99.9: 274.49 P99.99: 531.93 ------------------------------------------------------ [ 0, 1 ] 41251 4.008% 4.008% # ( 1, 2 ] 555383 53.957% 57.965% ########### ( 2, 3 ] 213227 20.716% 78.680% #### ( 3, 4 ] 101598 9.871% 88.551% ## ( 4, 6 ] 89524 8.698% 97.248% ## ( 6, 10 ] 20996 2.040% 99.288% ( 10, 15 ] 4206 0.409% 99.697% ( 15, 22 ] 513 0.050% 99.747% ( 22, 34 ] 47 0.005% 99.751% ( 34, 51 ] 22 0.002% 99.753% ( 51, 76 ] 18 0.002% 99.755% ( 76, 110 ] 240 0.023% 99.778% ( 110, 170 ] 661 0.064% 99.843% ( 170, 250 ] 481 0.047% 99.889% ( 250, 380 ] 577 0.056% 99.945% ( 380, 580 ] 603 0.059% 100.004% ( 580, 870 ] 530 0.051% 100.056% ( 870, 1300 ] 343 0.033% 100.089% ( 1300, 1900 ] 156 0.015% 100.104% ( 1900, 2900 ] 170 0.017% 100.121% ( 2900, 4400 ] 190 0.018% 100.139% ( 4400, 6600 ] 50 0.005% 100.144% ( 6600, 9900 ] 15 0.001% 100.145% ( 9900, 14000 ] 2 0.000% 100.146% ** Level 4 read latency histogram (micros): Count: 22305 Average: 62.3605 StdDev: 334.49 Min: 0 Median: 1.9573 Max: 11377 Percentiles: P50: 1.96 P75: 3.15 P99: 1376.67 P99.9: 4246.25 P99.99: 7107.87 ------------------------------------------------------ [ 0, 1 ] 614 2.753% 2.753% # ( 1, 2 ] 11008 49.352% 52.105% ########## ( 2, 3 ] 4738 21.242% 73.347% #### ( 3, 4 ] 2413 10.818% 84.165% ## ( 4, 6 ] 1387 6.218% 90.383% # ( 6, 10 ] 481 2.156% 92.540% ( 10, 15 ] 117 0.525% 93.064% ( 15, 22 ] 18 0.081% 93.145% ( 22, 34 ] 2 0.009% 93.154% ( 76, 110 ] 24 0.108% 93.262% ( 110, 170 ] 107 0.480% 93.741% ( 170, 250 ] 139 0.623% 94.364% ( 250, 380 ] 185 0.829% 95.194% ( 380, 580 ] 270 1.210% 96.404% ( 580, 870 ] 317 1.421% 97.826% ( 870, 1300 ] 247 1.107% 98.933% ( 1300, 1900 ] 117 0.525% 99.458% ( 1900, 2900 ] 61 0.273% 99.731% ( 2900, 4400 ] 42 0.188% 99.919% ( 4400, 6600 ] 15 0.067% 99.987% ( 6600, 9900 ] 5 0.022% 100.009% ( 9900, 14000 ] 1 0.004% 100.013% ** Level 5 read latency histogram (micros): Count: 180 Average: 1160.0889 StdDev: 1203.18 Min: 82 Median: 685.4545 Max: 7239 Percentiles: P50: 685.45 P75: 1700.00 P99: 6013.33 P99.9: 7239.00 P99.99: 7239.00 ------------------------------------------------------ ( 76, 110 ] 6 3.333% 3.333% # ( 110, 170 ] 26 14.444% 17.778% ### ( 170, 250 ] 16 8.889% 26.667% ## ( 250, 380 ] 11 6.111% 32.778% # ( 380, 580 ] 23 12.778% 45.556% ### ( 580, 870 ] 22 12.222% 57.778% ## ( 870, 1300 ] 15 8.333% 66.111% ## ( 1300, 1900 ] 24 13.333% 79.444% ### ( 1900, 2900 ] 21 11.667% 91.111% ## ( 2900, 4400 ] 12 6.667% 97.778% # ( 4400, 6600 ] 3 1.667% 99.444% ( 6600, 9900 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 57.6 total, 3.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 153.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.707 H:M:S, 56.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 290.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.640 H:M:S, 18.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.287 micros/op 159045 ops/sec 60.002 seconds 9542999 operations; 154.1 MB/s Microseconds per write: Count: 9542999 Average: 6.2875 StdDev: 425.75 Min: 1 Median: 1.7617 Max: 732954 Percentiles: P50: 1.76 P75: 2.76 P99: 8.77 P99.9: 1188.11 P99.99: 2725.16 ------------------------------------------------------ [ 0, 1 ] 1134242 11.886% 11.886% ## ( 1, 2 ] 4775109 50.038% 61.923% ########## ( 2, 3 ] 1652604 17.317% 79.241% ### ( 3, 4 ] 1327333 13.909% 93.150% ### ( 4, 6 ] 491162 5.147% 98.297% # ( 6, 10 ] 97055 1.017% 99.314% ( 10, 15 ] 24742 0.259% 99.573% ( 15, 22 ] 6585 0.069% 99.642% ( 22, 34 ] 1768 0.019% 99.660% ( 34, 51 ] 219 0.002% 99.663% ( 51, 76 ] 48 0.001% 99.663% ( 76, 110 ] 6893 0.072% 99.736% ( 110, 170 ] 2419 0.025% 99.761% ( 170, 250 ] 267 0.003% 99.764% ( 250, 380 ] 89 0.001% 99.765% ( 380, 580 ] 17 0.000% 99.765% ( 580, 870 ] 14 0.000% 99.765% ( 870, 1300 ] 17424 0.183% 99.948% ( 1300, 1900 ] 51 0.001% 99.948% ( 1900, 2900 ] 4852 0.051% 99.999% ( 2900, 4400 ] 69 0.001% 100.000% ( 4400, 6600 ] 11 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 206914 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9542999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9848374968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 563 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33782010 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 33851545704 rocksdb.compact.write.bytes COUNT : 33628171100 rocksdb.flush.write.bytes COUNT : 9710381272 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 55 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 286 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9632107520 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3766272 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33942475373 rocksdb.non.last.level.read.count COUNT : 8200204 rocksdb.block.checksum.compute.count COUNT : 8199133 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.427354 P95 : 3.865949 P99 : 7.216903 P100 : 732950.000000 COUNT : 9542999 SUM : 55611073 rocksdb.compaction.times.micros P50 : 983103.448276 P95 : 6115000.000000 P99 : 22931555.000000 P100 : 22931555.000000 COUNT : 87 SUM : 156415196 rocksdb.compaction.times.cpu_micros P50 : 916666.666667 P95 : 5730000.000000 P99 : 15040000.000000 P100 : 20990842.000000 COUNT : 87 SUM : 132527733 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 726.858974 P95 : 8085.000000 P99 : 31295.000000 P100 : 283245.000000 COUNT : 131 SUM : 477130 rocksdb.compaction.outfile.sync.micros P50 : 1069.797980 P95 : 89269.230769 P99 : 149600.000000 P100 : 162510.000000 COUNT : 374 SUM : 4669610 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 115.106383 P95 : 1164.857143 P99 : 2753.333333 P100 : 3498.000000 COUNT : 244 SUM : 67363 rocksdb.table.open.io.micros P50 : 1600.000000 P95 : 7560.882353 P99 : 9742.764706 P100 : 11834.000000 COUNT : 562 SUM : 1250038 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.633982 P95 : 7.845720 P99 : 12.540347 P100 : 14711.000000 COUNT : 8197635 SUM : 51606516 rocksdb.read.block.get.micros P50 : 530.000000 P95 : 3378.846154 P99 : 4550.000000 P100 : 7322.000000 COUNT : 1125 SUM : 1025752 rocksdb.write.raw.block.micros P50 : 0.512915 P95 : 0.974538 P99 : 2.813983 P100 : 16479.000000 COUNT : 10499073 SUM : 20296353 rocksdb.numfiles.in.singlecompaction P50 : 3.127273 P95 : 8.000000 P99 : 26.200000 P100 : 27.000000 COUNT : 130 SUM : 504 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562764 P95 : 1174.077422 P99 : 2500.185912 P100 : 732631.000000 COUNT : 201150 SUM : 33797051 rocksdb.sst.read.micros P50 : 1.601788 P95 : 4.687961 P99 : 8.978895 P100 : 14705.000000 COUNT : 8200586 SUM : 35072461 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9542999 SUM : 9848374968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210879.120879 P95 : 375233.333333 P99 : 770100.000000 P100 : 900129.000000 COUNT : 131 SUM : 28408386 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 345 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0