[2024-12-15 22:50:27.939104] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-12-15 22:50:27.939375] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1446335 ] Set seed to 1734299427932244 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 22:50:28.049167] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 22:50:28.086813] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 22:50:28.086859] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1446335' to capture a snapshot of events at runtime. [2024-12-15 22:50:28.086869] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-15 22:50:28.086879] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-15 22:50:28.086886] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1446335 for offline analysis/debug. [2024-12-15 22:50:28.086972] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 22:50:32 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-22:50:35 ... thread 0: (1000000,1000000) ops and (357243.3,357243.3) ops/second in (2.799213,2.799213) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.01 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 348.7 2.35 2.10 12 0.196 0 0 0.0 0.0 L2 3/2 251.74 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 246.2 246.1 1.53 1.48 2 0.767 383K 186 0.0 0.0 L3 12/0 992.99 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 97.3 308.1 3.88 3.58 14 0.277 383K 186 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 97.3 308.1 3.88 3.58 14 0.277 383K 186 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 246.2 246.1 1.53 1.48 2 0.767 383K 186 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 348.7 2.35 2.10 12 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 401.21 MB/s write, 0.37 GB read, 126.71 MB/s read, 3.9 seconds Interval compaction: 1.17 GB write, 427.21 MB/s write, 0.37 GB read, 134.92 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 99072 Average: 1.8729 StdDev: 21.83 Min: 1 Median: 1.1819 Max: 4190 Percentiles: P50: 1.18 P75: 1.64 P99: 3.81 P99.9: 9.21 P99.99: 307.44 ------------------------------------------------------ [ 0, 1 ] 39664 40.036% 40.036% ######## ( 1, 2 ] 54283 54.791% 94.827% ########### ( 2, 3 ] 3109 3.138% 97.965% # ( 3, 4 ] 1268 1.280% 99.245% ( 4, 6 ] 501 0.506% 99.751% ( 6, 10 ] 187 0.189% 99.939% ( 10, 15 ] 23 0.023% 99.963% ( 15, 22 ] 12 0.012% 99.975% ( 22, 34 ] 1 0.001% 99.976% ( 34, 51 ] 1 0.001% 99.977% ( 51, 76 ] 1 0.001% 99.978% ( 110, 170 ] 8 0.008% 99.986% ( 170, 250 ] 3 0.003% 99.989% ( 250, 380 ] 7 0.007% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ( 2900, 4400 ] 2 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 50212 Average: 2.0686 StdDev: 21.75 Min: 0 Median: 1.2295 Max: 2792 Percentiles: P50: 1.23 P75: 1.67 P99: 4.69 P99.9: 9.73 P99.99: 1080.44 ------------------------------------------------------ [ 0, 1 ] 18570 36.983% 36.983% ####### ( 1, 2 ] 28474 56.708% 93.691% ########### ( 2, 3 ] 1761 3.507% 97.198% # ( 3, 4 ] 756 1.506% 98.703% ( 4, 6 ] 429 0.854% 99.558% ( 6, 10 ] 184 0.366% 99.924% ( 10, 15 ] 16 0.032% 99.956% ( 15, 22 ] 2 0.004% 99.960% ( 22, 34 ] 3 0.006% 99.966% ( 110, 170 ] 1 0.002% 99.968% ( 250, 380 ] 3 0.006% 99.974% ( 380, 580 ] 3 0.006% 99.980% ( 580, 870 ] 4 0.008% 99.988% ( 870, 1300 ] 2 0.004% 99.992% ( 1300, 1900 ] 2 0.004% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 50 Average: 1775.8800 StdDev: 1443.28 Min: 104 Median: 1450.0000 Max: 5138 Percentiles: P50: 1450.00 P75: 3104.55 P99: 5138.00 P99.9: 5138.00 P99.99: 5138.00 ------------------------------------------------------ ( 76, 110 ] 1 2.000% 2.000% ( 110, 170 ] 2 4.000% 6.000% # ( 170, 250 ] 5 10.000% 16.000% ## ( 250, 380 ] 3 6.000% 22.000% # ( 380, 580 ] 4 8.000% 30.000% ## ( 580, 870 ] 3 6.000% 36.000% # ( 870, 1300 ] 4 8.000% 44.000% ## ( 1300, 1900 ] 12 24.000% 68.000% ##### ( 1900, 2900 ] 2 4.000% 72.000% # ( 2900, 4400 ] 11 22.000% 94.000% #### ( 4400, 6600 ] 3 6.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 1939.1500 StdDev: 1367.86 Min: 269 Median: 1660.0000 Max: 4939 Percentiles: P50: 1660.00 P75: 2900.00 P99: 4939.00 P99.9: 4939.00 P99.99: 4939.00 ------------------------------------------------------ ( 250, 380 ] 3 15.000% 15.000% ### ( 380, 580 ] 1 5.000% 20.000% # ( 580, 870 ] 2 10.000% 30.000% ## ( 870, 1300 ] 1 5.000% 35.000% # ( 1300, 1900 ] 5 25.000% 60.000% ##### ( 1900, 2900 ] 3 15.000% 75.000% ### ( 2900, 4400 ] 3 15.000% 90.000% ### ( 4400, 6600 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 329.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.228 H:M:S, 7.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.228 H:M:S, 8.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-22:50:38 ... thread 0: (1000000,2000000) ops and (325106.8,340418.3) ops/second in (3.075912,5.875125) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.17 GB 88.1 0.8 0.0 0.8 2.6 1.8 0.0 1.4 97.9 316.2 8.37 7.75 29 0.288 831K 838 0.0 0.0 L1 1/0 3.82 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 235.7 235.3 1.60 1.55 1 1.604 383K 584 0.0 0.0 L2 2/1 54.26 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 246.2 246.1 1.53 1.48 2 0.767 383K 186 0.0 0.0 L3 18/8 962.12 MB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 235.7 235.8 1.06 0.99 1 1.057 253K 0 0.0 0.0 L4 169/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 152.4 152.5 1.47 1.09 1 1.469 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1246/13 97.92 GB 0.0 2.0 1.0 1.0 3.8 2.8 2.1 2.1 146.0 276.1 14.03 12.86 34 0.413 2079K 1608 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 1.0 1.0 3.8 2.8 2.0 2.1 146.0 276.1 14.03 12.86 34 0.413 2079K 1608 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 1.0 1.0 2.0 1.0 0.0 0.0 230.9 230.7 8.87 8.26 8 1.109 2079K 1608 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.1 5.16 4.60 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.78 GB write, 639.33 MB/s write, 2.00 GB read, 338.06 MB/s read, 14.0 seconds Interval compaction: 3.78 GB write, 659.08 MB/s write, 2.00 GB read, 348.50 MB/s read, 14.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 387210 Average: 2.1874 StdDev: 12.79 Min: 0 Median: 1.4772 Max: 4190 Percentiles: P50: 1.48 P75: 1.87 P99: 5.61 P99.9: 9.78 P99.99: 14.89 ------------------------------------------------------ [ 0, 1 ] 75533 19.507% 19.507% #### ( 1, 2 ] 247425 63.899% 83.406% ############# ( 2, 3 ] 37076 9.575% 92.982% ## ( 3, 4 ] 15617 4.033% 97.015% # ( 4, 6 ] 9531 2.461% 99.476% ( 6, 10 ] 1734 0.448% 99.924% ( 10, 15 ] 261 0.067% 99.991% ( 15, 22 ] 36 0.009% 100.001% ( 22, 34 ] 12 0.003% 100.004% ( 34, 51 ] 3 0.001% 100.005% ( 51, 76 ] 1 0.000% 100.005% ( 110, 170 ] 10 0.003% 100.007% ( 170, 250 ] 14 0.004% 100.011% ( 250, 380 ] 14 0.004% 100.015% ( 380, 580 ] 2 0.001% 100.015% ( 580, 870 ] 7 0.002% 100.017% ( 870, 1300 ] 4 0.001% 100.018% ( 1300, 1900 ] 2 0.001% 100.019% ( 1900, 2900 ] 3 0.001% 100.019% ( 2900, 4400 ] 2 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 25 Average: 162.1600 StdDev: 290.49 Min: 1 Median: 1.7000 Max: 1065 Percentiles: P50: 1.70 P75: 230.00 P99: 1065.00 P99.9: 1065.00 P99.99: 1065.00 ------------------------------------------------------ [ 0, 1 ] 9 36.000% 36.000% ####### ( 1, 2 ] 5 20.000% 56.000% #### ( 2, 3 ] 1 4.000% 60.000% # ( 3, 4 ] 1 4.000% 64.000% # ( 4, 6 ] 1 4.000% 68.000% # ( 110, 170 ] 1 4.000% 72.000% # ( 170, 250 ] 1 4.000% 76.000% # ( 380, 580 ] 4 16.000% 92.000% ### ( 870, 1300 ] 2 8.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 95813 Average: 2.1198 StdDev: 15.76 Min: 0 Median: 1.3895 Max: 2792 Percentiles: P50: 1.39 P75: 1.79 P99: 5.36 P99.9: 9.53 P99.99: 610.36 ------------------------------------------------------ [ 0, 1 ] 24712 25.792% 25.792% ##### ( 1, 2 ] 59554 62.156% 87.948% ############ ( 2, 3 ] 6678 6.970% 94.918% # ( 3, 4 ] 2770 2.891% 97.809% # ( 4, 6 ] 1677 1.750% 99.560% ( 6, 10 ] 370 0.386% 99.946% ( 10, 15 ] 27 0.028% 99.974% ( 15, 22 ] 4 0.004% 99.978% ( 22, 34 ] 3 0.003% 99.981% ( 51, 76 ] 1 0.001% 99.982% ( 110, 170 ] 1 0.001% 99.983% ( 250, 380 ] 3 0.003% 99.986% ( 380, 580 ] 3 0.003% 99.990% ( 580, 870 ] 4 0.004% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 171366 Average: 3.4849 StdDev: 41.09 Min: 0 Median: 1.6909 Max: 5138 Percentiles: P50: 1.69 P75: 2.31 P99: 8.70 P99.9: 148.76 P99.99: 407.27 ------------------------------------------------------ [ 0, 1 ] 12391 7.231% 7.231% # ( 1, 2 ] 106083 61.904% 69.135% ############ ( 2, 3 ] 32053 18.704% 87.839% #### ( 3, 4 ] 9566 5.582% 93.422% # ( 4, 6 ] 7693 4.489% 97.911% # ( 6, 10 ] 2767 1.615% 99.526% ( 10, 15 ] 342 0.200% 99.725% ( 15, 22 ] 73 0.043% 99.768% ( 22, 34 ] 13 0.008% 99.775% ( 34, 51 ] 1 0.001% 99.776% ( 51, 76 ] 15 0.009% 99.785% ( 76, 110 ] 114 0.067% 99.851% ( 110, 170 ] 131 0.076% 99.928% ( 170, 250 ] 54 0.032% 99.959% ( 250, 380 ] 48 0.028% 99.987% ( 380, 580 ] 43 0.025% 100.012% ( 580, 870 ] 13 0.008% 100.020% ( 870, 1300 ] 8 0.005% 100.025% ( 1300, 1900 ] 12 0.007% 100.032% ( 1900, 2900 ] 2 0.001% 100.033% ( 2900, 4400 ] 11 0.006% 100.039% ( 4400, 6600 ] 3 0.002% 100.041% ** Level 4 read latency histogram (micros): Count: 305 Average: 135.6426 StdDev: 593.59 Min: 0 Median: 1.6059 Max: 4939 Percentiles: P50: 1.61 P75: 7.63 P99: 3875.00 P99.9: 4939.00 P99.99: 4939.00 ------------------------------------------------------ [ 0, 1 ] 81 26.557% 26.557% ##### ( 1, 2 ] 118 38.689% 65.246% ######## ( 2, 3 ] 18 5.902% 71.148% # ( 3, 4 ] 3 0.984% 72.131% ( 4, 6 ] 1 0.328% 72.459% ( 6, 10 ] 19 6.230% 78.689% # ( 10, 15 ] 33 10.820% 89.508% ## ( 15, 22 ] 5 1.639% 91.148% ( 22, 34 ] 1 0.328% 91.475% ( 110, 170 ] 1 0.328% 91.803% ( 170, 250 ] 3 0.984% 92.787% ( 250, 380 ] 4 1.311% 94.098% ( 380, 580 ] 2 0.656% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 1 0.328% 95.738% ( 1300, 1900 ] 5 1.639% 97.377% ( 1900, 2900 ] 3 0.984% 98.361% ( 2900, 4400 ] 3 0.984% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 781.6500 StdDev: 926.73 Min: 86 Median: 328.0000 Max: 3994 Percentiles: P50: 328.00 P75: 1214.00 P99: 3994.00 P99.9: 3994.00 P99.99: 3994.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 6 15.000% 30.000% ### ( 170, 250 ] 5 12.500% 42.500% ### ( 250, 380 ] 5 12.500% 55.000% ### ( 380, 580 ] 3 7.500% 62.500% ## ( 580, 870 ] 1 2.500% 65.000% # ( 870, 1300 ] 5 12.500% 77.500% ### ( 1300, 1900 ] 4 10.000% 87.500% ## ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.643 H:M:S, 10.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.414 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-22:50:41 ... thread 0: (1000000,3000000) ops and (335556.7,338782.2) ops/second in (2.980122,8.855247) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 195.1 1.7 0.0 1.7 4.4 2.8 0.0 1.6 117.5 313.2 14.47 13.52 46 0.315 1727K 1764 0.0 0.0 L1 1/0 3.82 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 235.7 235.3 1.60 1.55 1 1.604 383K 584 0.0 0.0 L2 1/0 51.76 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 246.2 246.1 1.53 1.48 2 0.767 383K 186 0.0 0.0 L3 15/0 963.06 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 227.7 227.3 3.81 3.57 2 1.903 880K 1587 0.0 0.0 L4 169/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 152.4 152.5 1.47 1.09 1 1.469 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/4 98.90 GB 0.0 3.5 1.0 2.4 6.2 3.8 2.1 2.2 155.0 278.7 22.89 21.21 52 0.440 3602K 4121 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 1.0 2.4 6.2 3.8 2.0 2.2 155.0 278.7 22.89 21.21 52 0.440 3602K 4121 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 1.0 2.4 3.5 1.0 0.0 0.0 237.0 236.7 14.97 14.12 12 1.247 3602K 4121 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 358.0 7.92 7.09 40 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.23 GB write, 705.67 MB/s write, 3.46 GB read, 392.50 MB/s read, 22.9 seconds Interval compaction: 6.23 GB write, 720.13 MB/s write, 3.46 GB read, 400.54 MB/s read, 22.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 652122 Average: 2.1053 StdDev: 11.63 Min: 0 Median: 1.4335 Max: 4190 Percentiles: P50: 1.43 P75: 1.83 P99: 5.43 P99.9: 9.77 P99.99: 16.14 ------------------------------------------------------ [ 0, 1 ] 146414 22.452% 22.452% #### ( 1, 2 ] 414369 63.542% 85.994% ############# ( 2, 3 ] 53764 8.244% 94.238% ## ( 3, 4 ] 22000 3.374% 97.612% # ( 4, 6 ] 12662 1.942% 99.553% ( 6, 10 ] 2401 0.368% 99.921% ( 10, 15 ] 436 0.067% 99.988% ( 15, 22 ] 66 0.010% 99.998% ( 22, 34 ] 16 0.002% 100.001% ( 34, 51 ] 4 0.001% 100.002% ( 51, 76 ] 2 0.000% 100.002% ( 110, 170 ] 17 0.003% 100.004% ( 170, 250 ] 18 0.003% 100.007% ( 250, 380 ] 21 0.003% 100.010% ( 380, 580 ] 4 0.001% 100.011% ( 580, 870 ] 12 0.002% 100.013% ( 870, 1300 ] 10 0.002% 100.014% ( 1300, 1900 ] 4 0.001% 100.015% ( 1900, 2900 ] 4 0.001% 100.016% ( 2900, 4400 ] 2 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 25 Average: 162.1600 StdDev: 290.49 Min: 1 Median: 1.7000 Max: 1065 Percentiles: P50: 1.70 P75: 230.00 P99: 1065.00 P99.9: 1065.00 P99.99: 1065.00 ------------------------------------------------------ [ 0, 1 ] 9 36.000% 36.000% ####### ( 1, 2 ] 5 20.000% 56.000% #### ( 2, 3 ] 1 4.000% 60.000% # ( 3, 4 ] 1 4.000% 64.000% # ( 4, 6 ] 1 4.000% 68.000% # ( 110, 170 ] 1 4.000% 72.000% # ( 170, 250 ] 1 4.000% 76.000% # ( 380, 580 ] 4 16.000% 92.000% ### ( 870, 1300 ] 2 8.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 124135 Average: 2.3690 StdDev: 15.87 Min: 0 Median: 1.4409 Max: 2792 Percentiles: P50: 1.44 P75: 1.84 P99: 5.83 P99.9: 96.87 P99.99: 637.51 ------------------------------------------------------ [ 0, 1 ] 27481 22.138% 22.138% #### ( 1, 2 ] 78448 63.196% 85.334% ############# ( 2, 3 ] 10614 8.550% 93.884% ## ( 3, 4 ] 4042 3.256% 97.140% # ( 4, 6 ] 2520 2.030% 99.170% ( 6, 10 ] 828 0.667% 99.837% ( 10, 15 ] 45 0.036% 99.874% ( 15, 22 ] 6 0.005% 99.878% ( 22, 34 ] 3 0.002% 99.881% ( 51, 76 ] 3 0.002% 99.883% ( 76, 110 ] 34 0.027% 99.911% ( 110, 170 ] 48 0.039% 99.949% ( 170, 250 ] 20 0.016% 99.965% ( 250, 380 ] 12 0.010% 99.975% ( 380, 580 ] 17 0.014% 99.989% ( 580, 870 ] 8 0.006% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 184819 Average: 3.4475 StdDev: 40.52 Min: 0 Median: 1.6763 Max: 5138 Percentiles: P50: 1.68 P75: 2.26 P99: 8.63 P99.9: 148.72 P99.99: 437.52 ------------------------------------------------------ [ 0, 1 ] 14296 7.735% 7.735% ## ( 1, 2 ] 115495 62.491% 70.226% ############ ( 2, 3 ] 33299 18.017% 88.243% #### ( 3, 4 ] 9986 5.403% 93.646% # ( 4, 6 ] 7948 4.300% 97.947% # ( 6, 10 ] 2957 1.600% 99.547% ( 10, 15 ] 348 0.188% 99.735% ( 15, 22 ] 73 0.039% 99.774% ( 22, 34 ] 13 0.007% 99.781% ( 34, 51 ] 1 0.001% 99.782% ( 51, 76 ] 16 0.009% 99.791% ( 76, 110 ] 117 0.063% 99.854% ( 110, 170 ] 132 0.071% 99.925% ( 170, 250 ] 55 0.030% 99.955% ( 250, 380 ] 51 0.028% 99.983% ( 380, 580 ] 47 0.025% 100.008% ( 580, 870 ] 14 0.008% 100.016% ( 870, 1300 ] 8 0.004% 100.020% ( 1300, 1900 ] 15 0.008% 100.028% ( 1900, 2900 ] 3 0.002% 100.030% ( 2900, 4400 ] 11 0.006% 100.036% ( 4400, 6600 ] 3 0.002% 100.037% ** Level 4 read latency histogram (micros): Count: 305 Average: 135.6426 StdDev: 593.59 Min: 0 Median: 1.6059 Max: 4939 Percentiles: P50: 1.61 P75: 7.63 P99: 3875.00 P99.9: 4939.00 P99.99: 4939.00 ------------------------------------------------------ [ 0, 1 ] 81 26.557% 26.557% ##### ( 1, 2 ] 118 38.689% 65.246% ######## ( 2, 3 ] 18 5.902% 71.148% # ( 3, 4 ] 3 0.984% 72.131% ( 4, 6 ] 1 0.328% 72.459% ( 6, 10 ] 19 6.230% 78.689% # ( 10, 15 ] 33 10.820% 89.508% ## ( 15, 22 ] 5 1.639% 91.148% ( 22, 34 ] 1 0.328% 91.475% ( 110, 170 ] 1 0.328% 91.803% ( 170, 250 ] 3 0.984% 92.787% ( 250, 380 ] 4 1.311% 94.098% ( 380, 580 ] 2 0.656% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 1 0.328% 95.738% ( 1300, 1900 ] 5 1.639% 97.377% ( 1900, 2900 ] 3 0.984% 98.361% ( 2900, 4400 ] 3 0.984% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 781.6500 StdDev: 926.73 Min: 86 Median: 328.0000 Max: 3994 Percentiles: P50: 328.00 P75: 1214.00 P99: 3994.00 P99.9: 3994.00 P99.99: 3994.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 6 15.000% 30.000% ### ( 170, 250 ] 5 12.500% 42.500% ### ( 250, 380 ] 5 12.500% 55.000% ### ( 380, 580 ] 3 7.500% 62.500% ## ( 580, 870 ] 1 2.500% 65.000% # ( 870, 1300 ] 5 12.500% 77.500% ### ( 1300, 1900 ] 4 10.000% 87.500% ## ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.034 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.392 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-22:50:44 ... thread 0: (1000000,4000000) ops and (332299.2,337137.8) ops/second in (3.009336,11.864583) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 3.07 GB 94.4 2.4 0.0 2.4 6.1 3.7 0.0 1.6 122.8 311.6 20.01 18.70 62 0.323 2494K 2486 0.0 0.0 L1 1/1 3.82 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 235.7 235.3 1.60 1.55 1 1.604 383K 584 0.0 0.0 L2 1/0 51.76 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 246.2 246.1 1.53 1.48 2 0.767 383K 186 0.0 0.0 L3 15/0 963.06 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 227.7 227.3 3.81 3.57 2 1.903 880K 1587 0.0 0.0 L4 169/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 152.4 152.5 1.47 1.09 1 1.469 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/11 99.82 GB 0.0 4.2 1.0 3.2 7.9 4.7 2.1 2.1 151.4 284.2 28.42 26.39 68 0.418 4370K 4843 0.0 0.0 Int 0/0 0.00 KB 0.0 4.2 1.0 3.2 7.9 4.7 2.0 2.1 151.4 284.2 28.42 26.39 68 0.418 4370K 4843 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.2 1.0 3.2 4.2 1.0 0.0 0.0 242.2 241.9 17.77 16.87 15 1.184 4370K 4843 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 354.8 10.65 9.52 53 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.89 GB write, 670.53 MB/s write, 4.20 GB read, 357.21 MB/s read, 28.4 seconds Interval compaction: 7.89 GB write, 680.79 MB/s write, 4.20 GB read, 362.68 MB/s read, 28.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 19, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 957551 Average: 2.0982 StdDev: 11.83 Min: 0 Median: 1.4337 Max: 4190 Percentiles: P50: 1.43 P75: 1.82 P99: 5.34 P99.9: 9.68 P99.99: 14.94 ------------------------------------------------------ [ 0, 1 ] 209990 21.930% 21.930% #### ( 1, 2 ] 619776 64.725% 86.655% ############# ( 2, 3 ] 77611 8.105% 94.760% ## ( 3, 4 ] 29750 3.107% 97.867% # ( 4, 6 ] 16160 1.688% 99.555% ( 6, 10 ] 3593 0.375% 99.930% ( 10, 15 ] 583 0.061% 99.991% ( 15, 22 ] 84 0.009% 100.000% ( 22, 34 ] 20 0.002% 100.002% ( 34, 51 ] 5 0.001% 100.002% ( 51, 76 ] 4 0.000% 100.003% ( 110, 170 ] 35 0.004% 100.006% ( 170, 250 ] 25 0.003% 100.009% ( 250, 380 ] 25 0.003% 100.011% ( 380, 580 ] 6 0.001% 100.012% ( 580, 870 ] 16 0.002% 100.014% ( 870, 1300 ] 17 0.002% 100.016% ( 1300, 1900 ] 7 0.001% 100.016% ( 1900, 2900 ] 5 0.001% 100.017% ( 2900, 4400 ] 4 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 26 Average: 156.0769 StdDev: 286.47 Min: 1 Median: 1.8000 Max: 1065 Percentiles: P50: 1.80 P75: 210.00 P99: 1065.00 P99.9: 1065.00 P99.99: 1065.00 ------------------------------------------------------ [ 0, 1 ] 9 34.615% 34.615% ####### ( 1, 2 ] 5 19.231% 53.846% #### ( 2, 3 ] 1 3.846% 57.692% # ( 3, 4 ] 2 7.692% 65.385% ## ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 380, 580 ] 4 15.385% 92.308% ### ( 870, 1300 ] 2 7.692% 100.000% ## ** Level 2 read latency histogram (micros): Count: 124135 Average: 2.3690 StdDev: 15.87 Min: 0 Median: 1.4409 Max: 2792 Percentiles: P50: 1.44 P75: 1.84 P99: 5.83 P99.9: 96.87 P99.99: 637.51 ------------------------------------------------------ [ 0, 1 ] 27481 22.138% 22.138% #### ( 1, 2 ] 78448 63.196% 85.334% ############# ( 2, 3 ] 10614 8.550% 93.884% ## ( 3, 4 ] 4042 3.256% 97.140% # ( 4, 6 ] 2520 2.030% 99.170% ( 6, 10 ] 828 0.667% 99.837% ( 10, 15 ] 45 0.036% 99.874% ( 15, 22 ] 6 0.005% 99.878% ( 22, 34 ] 3 0.002% 99.881% ( 51, 76 ] 3 0.002% 99.883% ( 76, 110 ] 34 0.027% 99.911% ( 110, 170 ] 48 0.039% 99.949% ( 170, 250 ] 20 0.016% 99.965% ( 250, 380 ] 12 0.010% 99.975% ( 380, 580 ] 17 0.014% 99.989% ( 580, 870 ] 8 0.006% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 184819 Average: 3.4475 StdDev: 40.52 Min: 0 Median: 1.6763 Max: 5138 Percentiles: P50: 1.68 P75: 2.26 P99: 8.63 P99.9: 148.72 P99.99: 437.52 ------------------------------------------------------ [ 0, 1 ] 14296 7.735% 7.735% ## ( 1, 2 ] 115495 62.491% 70.226% ############ ( 2, 3 ] 33299 18.017% 88.243% #### ( 3, 4 ] 9986 5.403% 93.646% # ( 4, 6 ] 7948 4.300% 97.947% # ( 6, 10 ] 2957 1.600% 99.547% ( 10, 15 ] 348 0.188% 99.735% ( 15, 22 ] 73 0.039% 99.774% ( 22, 34 ] 13 0.007% 99.781% ( 34, 51 ] 1 0.001% 99.782% ( 51, 76 ] 16 0.009% 99.791% ( 76, 110 ] 117 0.063% 99.854% ( 110, 170 ] 132 0.071% 99.925% ( 170, 250 ] 55 0.030% 99.955% ( 250, 380 ] 51 0.028% 99.983% ( 380, 580 ] 47 0.025% 100.008% ( 580, 870 ] 14 0.008% 100.016% ( 870, 1300 ] 8 0.004% 100.020% ( 1300, 1900 ] 15 0.008% 100.028% ( 1900, 2900 ] 3 0.002% 100.030% ( 2900, 4400 ] 11 0.006% 100.036% ( 4400, 6600 ] 3 0.002% 100.037% ** Level 4 read latency histogram (micros): Count: 305 Average: 135.6426 StdDev: 593.59 Min: 0 Median: 1.6059 Max: 4939 Percentiles: P50: 1.61 P75: 7.63 P99: 3875.00 P99.9: 4939.00 P99.99: 4939.00 ------------------------------------------------------ [ 0, 1 ] 81 26.557% 26.557% ##### ( 1, 2 ] 118 38.689% 65.246% ######## ( 2, 3 ] 18 5.902% 71.148% # ( 3, 4 ] 3 0.984% 72.131% ( 4, 6 ] 1 0.328% 72.459% ( 6, 10 ] 19 6.230% 78.689% # ( 10, 15 ] 33 10.820% 89.508% ## ( 15, 22 ] 5 1.639% 91.148% ( 22, 34 ] 1 0.328% 91.475% ( 110, 170 ] 1 0.328% 91.803% ( 170, 250 ] 3 0.984% 92.787% ( 250, 380 ] 4 1.311% 94.098% ( 380, 580 ] 2 0.656% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 1 0.328% 95.738% ( 1300, 1900 ] 5 1.639% 97.377% ( 1900, 2900 ] 3 0.984% 98.361% ( 2900, 4400 ] 3 0.984% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 781.6500 StdDev: 926.73 Min: 86 Median: 328.0000 Max: 3994 Percentiles: P50: 328.00 P75: 1214.00 P99: 3994.00 P99.9: 3994.00 P99.99: 3994.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 6 15.000% 30.000% ### ( 170, 250 ] 5 12.500% 42.500% ### ( 250, 380 ] 5 12.500% 55.000% ### ( 380, 580 ] 3 7.500% 62.500% ## ( 580, 870 ] 1 2.500% 65.000% # ( 870, 1300 ] 5 12.500% 77.500% ### ( 1300, 1900 ] 4 10.000% 87.500% ## ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 326.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.443 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.408 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-22:50:51 ... thread 0: (1000000,5000000) ops and (138158.5,261743.9) ops/second in (7.238062,19.102645) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.91 GB 69.3 3.2 0.0 3.2 7.9 4.7 0.0 1.7 126.2 310.4 25.97 24.23 80 0.325 3326K 3344 0.0 0.0 L1 4/0 326.66 MB 32.7 2.5 2.5 0.0 2.5 2.5 0.2 1.0 233.4 231.3 11.08 10.75 2 5.538 2624K 22K 0.0 0.0 L2 16/10 1.86 GB 7.0 0.4 0.2 0.2 0.4 0.2 2.2 2.0 246.2 246.1 1.53 1.48 2 0.767 383K 186 0.0 0.0 L3 15/10 963.06 MB 0.6 0.8 0.2 0.6 0.8 0.2 0.4 3.4 227.7 227.3 3.81 3.57 2 1.903 880K 1587 0.0 0.0 L4 169/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 152.4 152.5 1.47 1.09 1 1.469 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/29 100.78 GB 0.0 7.2 3.2 4.0 11.8 7.8 4.0 2.5 167.1 275.7 43.85 41.11 87 0.504 7442K 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.2 3.2 4.0 11.8 7.8 3.8 2.5 167.1 275.7 43.85 41.11 87 0.504 7442K 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.2 3.2 4.0 7.1 3.1 0.0 0.0 241.7 240.8 30.32 29.09 19 1.596 7442K 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.9 13.53 12.02 68 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.3 total, 19.1 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.81 GB write, 626.81 MB/s write, 7.16 GB read, 380.03 MB/s read, 43.9 seconds Interval compaction: 11.81 GB write, 632.77 MB/s write, 7.16 GB read, 383.64 MB/s read, 43.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 20, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1796714 Average: 2.1434 StdDev: 10.53 Min: 0 Median: 1.4538 Max: 4190 Percentiles: P50: 1.45 P75: 1.83 P99: 5.57 P99.9: 10.25 P99.99: 77.43 ------------------------------------------------------ [ 0, 1 ] 363032 20.205% 20.205% #### ( 1, 2 ] 1179730 65.660% 85.866% ############# ( 2, 3 ] 152486 8.487% 94.353% ## ( 3, 4 ] 57442 3.197% 97.550% # ( 4, 6 ] 33295 1.853% 99.403% ( 6, 10 ] 8869 0.494% 99.896% ( 10, 15 ] 1312 0.073% 99.969% ( 15, 22 ] 323 0.018% 99.987% ( 22, 34 ] 27 0.002% 99.989% ( 34, 51 ] 7 0.000% 99.989% ( 51, 76 ] 9 0.001% 99.990% ( 76, 110 ] 127 0.007% 99.997% ( 110, 170 ] 175 0.010% 100.007% ( 170, 250 ] 78 0.004% 100.011% ( 250, 380 ] 50 0.003% 100.014% ( 380, 580 ] 31 0.002% 100.016% ( 580, 870 ] 30 0.002% 100.017% ( 870, 1300 ] 26 0.001% 100.019% ( 1300, 1900 ] 7 0.000% 100.019% ( 1900, 2900 ] 9 0.001% 100.020% ( 2900, 4400 ] 5 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 111763 Average: 3.9366 StdDev: 25.13 Min: 0 Median: 1.9156 Max: 3134 Percentiles: P50: 1.92 P75: 2.91 P99: 9.13 P99.9: 122.14 P99.99: 191.64 ------------------------------------------------------ [ 0, 1 ] 2157 1.930% 1.930% ( 1, 2 ] 58681 52.505% 54.435% ########### ( 2, 3 ] 25282 22.621% 77.056% ##### ( 3, 4 ] 11545 10.330% 87.386% ## ( 4, 6 ] 11175 9.999% 97.385% ## ( 6, 10 ] 2312 2.069% 99.453% ( 10, 15 ] 353 0.316% 99.769% ( 15, 22 ] 68 0.061% 99.830% ( 22, 34 ] 6 0.005% 99.835% ( 34, 51 ] 2 0.002% 99.837% ( 76, 110 ] 51 0.046% 99.883% ( 110, 170 ] 100 0.089% 99.972% ( 170, 250 ] 77 0.069% 100.041% ( 250, 380 ] 50 0.045% 100.086% ( 380, 580 ] 64 0.057% 100.143% ( 580, 870 ] 19 0.017% 100.160% ( 870, 1300 ] 12 0.011% 100.171% ( 1300, 1900 ] 4 0.004% 100.174% ( 1900, 2900 ] 1 0.001% 100.175% ( 2900, 4400 ] 1 0.001% 100.176% ** Level 2 read latency histogram (micros): Count: 124135 Average: 2.3690 StdDev: 15.87 Min: 0 Median: 1.4409 Max: 2792 Percentiles: P50: 1.44 P75: 1.84 P99: 5.83 P99.9: 96.87 P99.99: 637.51 ------------------------------------------------------ [ 0, 1 ] 27481 22.138% 22.138% #### ( 1, 2 ] 78448 63.196% 85.334% ############# ( 2, 3 ] 10614 8.550% 93.884% ## ( 3, 4 ] 4042 3.256% 97.140% # ( 4, 6 ] 2520 2.030% 99.170% ( 6, 10 ] 828 0.667% 99.837% ( 10, 15 ] 45 0.036% 99.874% ( 15, 22 ] 6 0.005% 99.878% ( 22, 34 ] 3 0.002% 99.881% ( 51, 76 ] 3 0.002% 99.883% ( 76, 110 ] 34 0.027% 99.911% ( 110, 170 ] 48 0.039% 99.949% ( 170, 250 ] 20 0.016% 99.965% ( 250, 380 ] 12 0.010% 99.975% ( 380, 580 ] 17 0.014% 99.989% ( 580, 870 ] 8 0.006% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 190431 Average: 4.5496 StdDev: 56.64 Min: 0 Median: 1.6816 Max: 5138 Percentiles: P50: 1.68 P75: 2.29 P99: 9.13 P99.9: 390.03 P99.99: 999.74 ------------------------------------------------------ [ 0, 1 ] 14524 7.627% 7.627% ## ( 1, 2 ] 118389 62.169% 69.796% ############ ( 2, 3 ] 34357 18.042% 87.838% #### ( 3, 4 ] 10554 5.542% 93.380% # ( 4, 6 ] 8307 4.362% 97.742% # ( 6, 10 ] 3064 1.609% 99.351% ( 10, 15 ] 360 0.189% 99.540% ( 15, 22 ] 75 0.039% 99.579% ( 22, 34 ] 13 0.007% 99.586% ( 34, 51 ] 1 0.001% 99.587% ( 51, 76 ] 16 0.008% 99.595% ( 76, 110 ] 154 0.081% 99.676% ( 110, 170 ] 192 0.101% 99.777% ( 170, 250 ] 116 0.061% 99.838% ( 250, 380 ] 113 0.059% 99.897% ( 380, 580 ] 111 0.058% 99.955% ( 580, 870 ] 56 0.029% 99.985% ( 870, 1300 ] 33 0.017% 100.002% ( 1300, 1900 ] 19 0.010% 100.012% ( 1900, 2900 ] 27 0.014% 100.026% ( 2900, 4400 ] 15 0.008% 100.034% ( 4400, 6600 ] 4 0.002% 100.036% ** Level 4 read latency histogram (micros): Count: 305 Average: 135.6426 StdDev: 593.59 Min: 0 Median: 1.6059 Max: 4939 Percentiles: P50: 1.61 P75: 7.63 P99: 3875.00 P99.9: 4939.00 P99.99: 4939.00 ------------------------------------------------------ [ 0, 1 ] 81 26.557% 26.557% ##### ( 1, 2 ] 118 38.689% 65.246% ######## ( 2, 3 ] 18 5.902% 71.148% # ( 3, 4 ] 3 0.984% 72.131% ( 4, 6 ] 1 0.328% 72.459% ( 6, 10 ] 19 6.230% 78.689% # ( 10, 15 ] 33 10.820% 89.508% ## ( 15, 22 ] 5 1.639% 91.148% ( 22, 34 ] 1 0.328% 91.475% ( 110, 170 ] 1 0.328% 91.803% ( 170, 250 ] 3 0.984% 92.787% ( 250, 380 ] 4 1.311% 94.098% ( 380, 580 ] 2 0.656% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 1 0.328% 95.738% ( 1300, 1900 ] 5 1.639% 97.377% ( 1900, 2900 ] 3 0.984% 98.361% ( 2900, 4400 ] 3 0.984% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 781.6500 StdDev: 926.73 Min: 86 Median: 328.0000 Max: 3994 Percentiles: P50: 328.00 P75: 1214.00 P99: 3994.00 P99.9: 3994.00 P99.99: 3994.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 6 15.000% 30.000% ### ( 170, 250 ] 5 12.500% 42.500% ### ( 250, 380 ] 5 12.500% 55.000% ### ( 380, 580 ] 3 7.500% 62.500% ## ( 580, 870 ] 1 2.500% 65.000% # ( 870, 1300 ] 5 12.500% 77.500% ### ( 1300, 1900 ] 4 10.000% 87.500% ## ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 19.3 total, 7.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 255.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.990 H:M:S, 31.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 135.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.547 H:M:S, 62.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/15-22:50:55 ... thread 0: (1000000,6000000) ops and (240537.6,257953.6) ops/second in (4.157355,23.260000) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 2.82 GB 75.5 5.0 0.0 5.0 10.6 5.6 0.0 1.9 138.2 293.3 36.92 33.81 96 0.385 5180K 8176 0.0 0.0 L1 4/4 326.66 MB 0.0 2.5 2.5 0.0 2.5 2.5 0.2 1.0 233.4 231.3 11.08 10.75 2 5.538 2624K 22K 0.0 0.0 L2 2/2 257.55 MB 0.0 0.4 0.2 0.2 0.4 0.2 2.2 2.0 246.2 246.1 1.53 1.48 2 0.767 383K 186 0.0 0.0 L3 39/11 1.41 GB 1.0 3.0 1.9 1.2 3.0 1.9 0.4 1.6 194.1 193.6 15.99 13.69 10 1.599 3152K 7966 0.0 0.0 L4 182/7 9.97 GB 1.0 1.0 0.9 0.1 1.0 0.9 0.8 1.1 119.0 118.8 8.49 4.81 19 0.447 973K 493 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/32 101.69 GB 0.0 11.9 5.5 6.4 17.5 11.0 5.1 3.1 164.6 241.5 74.00 64.54 129 0.574 12M 39K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.9 5.5 6.4 17.5 11.0 5.0 3.1 164.6 241.5 74.00 64.54 129 0.574 12M 39K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.9 5.5 6.4 11.9 5.4 0.0 0.0 213.8 213.1 56.95 50.06 49 1.162 12M 39K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 336.3 17.05 14.48 80 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.4 total, 23.3 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.45 GB write, 762.23 MB/s write, 11.89 GB read, 519.46 MB/s read, 74.0 seconds Interval compaction: 17.45 GB write, 768.17 MB/s write, 11.89 GB read, 523.51 MB/s read, 74.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 37, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2179243 Average: 2.4152 StdDev: 24.78 Min: 0 Median: 1.5115 Max: 12810 Percentiles: P50: 1.51 P75: 1.90 P99: 5.89 P99.9: 12.27 P99.99: 129.86 ------------------------------------------------------ [ 0, 1 ] 376129 17.260% 17.260% ### ( 1, 2 ] 1394841 64.006% 81.265% ############# ( 2, 3 ] 229916 10.550% 91.816% ## ( 3, 4 ] 93070 4.271% 96.086% # ( 4, 6 ] 67173 3.082% 99.169% # ( 6, 10 ] 14898 0.684% 99.852% ( 10, 15 ] 2281 0.105% 99.957% ( 15, 22 ] 430 0.020% 99.977% ( 22, 34 ] 35 0.002% 99.978% ( 34, 51 ] 11 0.001% 99.979% ( 51, 76 ] 13 0.001% 99.980% ( 76, 110 ] 146 0.007% 99.986% ( 110, 170 ] 248 0.011% 99.998% ( 170, 250 ] 144 0.007% 100.004% ( 250, 380 ] 103 0.005% 100.009% ( 380, 580 ] 98 0.004% 100.013% ( 580, 870 ] 87 0.004% 100.017% ( 870, 1300 ] 46 0.002% 100.020% ( 1300, 1900 ] 22 0.001% 100.021% ( 1900, 2900 ] 27 0.001% 100.022% ( 2900, 4400 ] 29 0.001% 100.023% ( 4400, 6600 ] 2 0.000% 100.023% ( 6600, 9900 ] 4 0.000% 100.023% ( 9900, 14000 ] 2 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 534611 Average: 4.4621 StdDev: 68.81 Min: 0 Median: 1.8692 Max: 14424 Percentiles: P50: 1.87 P75: 2.80 P99: 8.99 P99.9: 101.40 P99.99: 293.24 ------------------------------------------------------ [ 0, 1 ] 11229 2.100% 2.100% ( 1, 2 ] 294596 55.105% 57.205% ########### ( 2, 3 ] 119471 22.347% 79.552% #### ( 3, 4 ] 48454 9.063% 88.616% ## ( 4, 6 ] 46685 8.733% 97.348% ## ( 6, 10 ] 11805 2.208% 99.556% ( 10, 15 ] 1496 0.280% 99.836% ( 15, 22 ] 224 0.042% 99.878% ( 22, 34 ] 19 0.004% 99.882% ( 34, 51 ] 4 0.001% 99.883% ( 51, 76 ] 3 0.001% 99.883% ( 76, 110 ] 121 0.023% 99.906% ( 110, 170 ] 204 0.038% 99.944% ( 170, 250 ] 188 0.035% 99.979% ( 250, 380 ] 176 0.033% 100.012% ( 380, 580 ] 199 0.037% 100.049% ( 580, 870 ] 140 0.026% 100.075% ( 870, 1300 ] 83 0.016% 100.091% ( 1300, 1900 ] 42 0.008% 100.099% ( 1900, 2900 ] 28 0.005% 100.104% ( 2900, 4400 ] 28 0.005% 100.109% ( 4400, 6600 ] 21 0.004% 100.113% ( 6600, 9900 ] 10 0.002% 100.115% ( 9900, 14000 ] 2 0.000% 100.115% ( 14000, 22000 ] 1 0.000% 100.116% ** Level 2 read latency histogram (micros): Count: 124135 Average: 2.3690 StdDev: 15.87 Min: 0 Median: 1.4409 Max: 2792 Percentiles: P50: 1.44 P75: 1.84 P99: 5.83 P99.9: 96.87 P99.99: 637.51 ------------------------------------------------------ [ 0, 1 ] 27481 22.138% 22.138% #### ( 1, 2 ] 78448 63.196% 85.334% ############# ( 2, 3 ] 10614 8.550% 93.884% ## ( 3, 4 ] 4042 3.256% 97.140% # ( 4, 6 ] 2520 2.030% 99.170% ( 6, 10 ] 828 0.667% 99.837% ( 10, 15 ] 45 0.036% 99.874% ( 15, 22 ] 6 0.005% 99.878% ( 22, 34 ] 3 0.002% 99.881% ( 51, 76 ] 3 0.002% 99.883% ( 76, 110 ] 34 0.027% 99.911% ( 110, 170 ] 48 0.039% 99.949% ( 170, 250 ] 20 0.016% 99.965% ( 250, 380 ] 12 0.010% 99.975% ( 380, 580 ] 17 0.014% 99.989% ( 580, 870 ] 8 0.006% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 472612 Average: 4.6135 StdDev: 77.52 Min: 0 Median: 1.8555 Max: 26071 Percentiles: P50: 1.86 P75: 2.78 P99: 8.54 P99.9: 95.76 P99.99: 224.09 ------------------------------------------------------ [ 0, 1 ] 17495 3.702% 3.702% # ( 1, 2 ] 255761 54.116% 57.818% ########### ( 2, 3 ] 104057 22.017% 79.836% #### ( 3, 4 ] 44057 9.322% 89.158% ## ( 4, 6 ] 41763 8.837% 97.994% ## ( 6, 10 ] 7487 1.584% 99.579% ( 10, 15 ] 1204 0.255% 99.833% ( 15, 22 ] 162 0.034% 99.868% ( 22, 34 ] 30 0.006% 99.874% ( 34, 51 ] 13 0.003% 99.877% ( 51, 76 ] 18 0.004% 99.880% ( 76, 110 ] 159 0.034% 99.914% ( 110, 170 ] 258 0.055% 99.969% ( 170, 250 ] 149 0.032% 100.000% ( 250, 380 ] 168 0.036% 100.036% ( 380, 580 ] 161 0.034% 100.070% ( 580, 870 ] 106 0.022% 100.092% ( 870, 1300 ] 68 0.014% 100.107% ( 1300, 1900 ] 42 0.009% 100.116% ( 1900, 2900 ] 68 0.014% 100.130% ( 2900, 4400 ] 41 0.009% 100.139% ( 4400, 6600 ] 13 0.003% 100.141% ( 6600, 9900 ] 3 0.001% 100.142% ( 14000, 22000 ] 1 0.000% 100.142% ( 22000, 33000 ] 1 0.000% 100.142% ** Level 4 read latency histogram (micros): Count: 20369 Average: 108.0506 StdDev: 591.73 Min: 0 Median: 1.9655 Max: 29400 Percentiles: P50: 1.97 P75: 3.27 P99: 2770.33 P99.9: 6173.37 P99.99: 11216.24 ------------------------------------------------------ [ 0, 1 ] 601 2.951% 2.951% # ( 1, 2 ] 9926 48.731% 51.681% ########## ( 2, 3 ] 4139 20.320% 72.002% #### ( 3, 4 ] 2226 10.928% 82.930% ## ( 4, 6 ] 1306 6.412% 89.342% # ( 6, 10 ] 468 2.298% 91.639% ( 10, 15 ] 103 0.506% 92.145% ( 15, 22 ] 18 0.088% 92.233% ( 22, 34 ] 4 0.020% 92.253% ( 34, 51 ] 1 0.005% 92.258% ( 51, 76 ] 1 0.005% 92.263% ( 76, 110 ] 9 0.044% 92.307% ( 110, 170 ] 29 0.142% 92.449% ( 170, 250 ] 60 0.295% 92.744% ( 250, 380 ] 162 0.795% 93.539% ( 380, 580 ] 240 1.178% 94.717% ( 580, 870 ] 316 1.551% 96.269% ( 870, 1300 ] 293 1.438% 97.707% ( 1300, 1900 ] 158 0.776% 98.483% ( 1900, 2900 ] 121 0.594% 99.077% ( 2900, 4400 ] 137 0.673% 99.750% ( 4400, 6600 ] 38 0.187% 99.936% ( 6600, 9900 ] 10 0.049% 99.985% ( 9900, 14000 ] 3 0.015% 100.000% ( 14000, 22000 ] 4 0.020% 100.020% ( 22000, 33000 ] 1 0.005% 100.025% ** Level 5 read latency histogram (micros): Count: 80 Average: 1017.5500 StdDev: 1160.22 Min: 86 Median: 520.0000 Max: 4949 Percentiles: P50: 520.00 P75: 1385.71 P99: 4840.00 P99.9: 4949.00 P99.99: 4949.00 ------------------------------------------------------ ( 76, 110 ] 7 8.750% 8.750% ## ( 110, 170 ] 9 11.250% 20.000% ## ( 170, 250 ] 8 10.000% 30.000% ## ( 250, 380 ] 9 11.250% 41.250% ## ( 380, 580 ] 10 12.500% 53.750% ### ( 580, 870 ] 7 8.750% 62.500% ## ( 870, 1300 ] 9 11.250% 73.750% ## ( 1300, 1900 ] 7 8.750% 82.500% ## ( 1900, 2900 ] 5 6.250% 88.750% # ( 2900, 4400 ] 8 10.000% 98.750% ## ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 23.4 total, 4.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 251.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.298 H:M:S, 31.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 236.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.308 H:M:S, 31.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/15-22:50:59 ... thread 0: (1000000,7000000) ops and (263652.9,258752.6) ops/second in (3.792866,27.052866) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.93 GB 163.6 5.8 0.0 5.8 12.5 6.7 0.0 1.9 135.6 291.0 44.12 40.10 115 0.384 6075K 9183 0.0 0.0 L1 4/4 326.66 MB 0.0 2.5 2.5 0.0 2.5 2.5 0.2 1.0 233.4 231.3 11.08 10.75 2 5.538 2624K 22K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.2 2.0 246.2 246.1 1.53 1.48 2 0.767 383K 186 0.0 0.0 L3 27/0 983.59 MB 1.0 3.4 2.1 1.3 3.4 2.1 0.4 1.6 189.8 189.3 18.49 15.54 12 1.541 3563K 9009 0.0 0.0 L4 187/0 9.68 GB 1.0 1.7 1.6 0.1 1.7 1.6 0.8 1.1 123.2 122.9 14.24 8.33 36 0.396 1690K 1204 0.0 0.0 L5 1068/0 87.91 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/16 102.80 GB 0.0 13.9 6.4 7.5 20.5 13.1 6.1 3.1 158.8 235.1 89.46 76.19 167 0.536 14M 42K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 6.4 7.5 20.5 13.1 6.0 3.1 158.8 235.1 89.46 76.19 167 0.536 14M 42K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 6.4 7.5 13.8 6.4 0.0 0.0 206.9 206.2 68.68 58.81 71 0.967 14M 42K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 330.4 20.79 17.39 96 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.2 total, 27.1 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.54 GB write, 772.17 MB/s write, 13.88 GB read, 521.72 MB/s read, 89.5 seconds Interval compaction: 20.54 GB write, 777.35 MB/s write, 13.88 GB read, 525.22 MB/s read, 89.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 50, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 50, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2622302 Average: 2.4694 StdDev: 24.98 Min: 0 Median: 1.5241 Max: 12810 Percentiles: P50: 1.52 P75: 1.91 P99: 5.93 P99.9: 12.21 P99.99: 131.53 ------------------------------------------------------ [ 0, 1 ] 426875 16.279% 16.279% ### ( 1, 2 ] 1687230 64.342% 80.620% ############# ( 2, 3 ] 288540 11.003% 91.624% ## ( 3, 4 ] 114062 4.350% 95.973% # ( 4, 6 ] 82371 3.141% 99.114% # ( 6, 10 ] 19371 0.739% 99.853% ( 10, 15 ] 2782 0.106% 99.959% ( 15, 22 ] 474 0.018% 99.977% ( 22, 34 ] 39 0.001% 99.979% ( 34, 51 ] 11 0.000% 99.979% ( 51, 76 ] 16 0.001% 99.980% ( 76, 110 ] 165 0.006% 99.986% ( 110, 170 ] 292 0.011% 99.997% ( 170, 250 ] 185 0.007% 100.004% ( 250, 380 ] 148 0.006% 100.010% ( 380, 580 ] 148 0.006% 100.016% ( 580, 870 ] 133 0.005% 100.021% ( 870, 1300 ] 82 0.003% 100.024% ( 1300, 1900 ] 35 0.001% 100.025% ( 1900, 2900 ] 34 0.001% 100.026% ( 2900, 4400 ] 35 0.001% 100.028% ( 4400, 6600 ] 5 0.000% 100.028% ( 6600, 9900 ] 4 0.000% 100.028% ( 9900, 14000 ] 2 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 566227 Average: 4.4491 StdDev: 68.34 Min: 0 Median: 1.8685 Max: 14424 Percentiles: P50: 1.87 P75: 2.80 P99: 9.01 P99.9: 102.69 P99.99: 309.23 ------------------------------------------------------ [ 0, 1 ] 12417 2.193% 2.193% ( 1, 2 ] 311689 55.047% 57.240% ########### ( 2, 3 ] 126387 22.321% 79.560% #### ( 3, 4 ] 51222 9.046% 88.607% ## ( 4, 6 ] 49308 8.708% 97.315% ## ( 6, 10 ] 12661 2.236% 99.551% ( 10, 15 ] 1618 0.286% 99.837% ( 15, 22 ] 237 0.042% 99.878% ( 22, 34 ] 19 0.003% 99.882% ( 34, 51 ] 4 0.001% 99.883% ( 51, 76 ] 3 0.001% 99.883% ( 76, 110 ] 122 0.022% 99.905% ( 110, 170 ] 211 0.037% 99.942% ( 170, 250 ] 189 0.033% 99.975% ( 250, 380 ] 183 0.032% 100.008% ( 380, 580 ] 200 0.035% 100.043% ( 580, 870 ] 143 0.025% 100.068% ( 870, 1300 ] 86 0.015% 100.083% ( 1300, 1900 ] 48 0.008% 100.092% ( 1900, 2900 ] 34 0.006% 100.098% ( 2900, 4400 ] 29 0.005% 100.103% ( 4400, 6600 ] 22 0.004% 100.107% ( 6600, 9900 ] 10 0.002% 100.109% ( 9900, 14000 ] 2 0.000% 100.109% ( 14000, 22000 ] 1 0.000% 100.109% ** Level 2 read latency histogram (micros): Count: 124135 Average: 2.3690 StdDev: 15.87 Min: 0 Median: 1.4409 Max: 2792 Percentiles: P50: 1.44 P75: 1.84 P99: 5.83 P99.9: 96.87 P99.99: 637.51 ------------------------------------------------------ [ 0, 1 ] 27481 22.138% 22.138% #### ( 1, 2 ] 78448 63.196% 85.334% ############# ( 2, 3 ] 10614 8.550% 93.884% ## ( 3, 4 ] 4042 3.256% 97.140% # ( 4, 6 ] 2520 2.030% 99.170% ( 6, 10 ] 828 0.667% 99.837% ( 10, 15 ] 45 0.036% 99.874% ( 15, 22 ] 6 0.005% 99.878% ( 22, 34 ] 3 0.002% 99.881% ( 51, 76 ] 3 0.002% 99.883% ( 76, 110 ] 34 0.027% 99.911% ( 110, 170 ] 48 0.039% 99.949% ( 170, 250 ] 20 0.016% 99.965% ( 250, 380 ] 12 0.010% 99.975% ( 380, 580 ] 17 0.014% 99.989% ( 580, 870 ] 8 0.006% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 641149 Average: 4.7835 StdDev: 76.93 Min: 0 Median: 1.8749 Max: 26071 Percentiles: P50: 1.87 P75: 2.82 P99: 8.58 P99.9: 70.81 P99.99: 193.11 ------------------------------------------------------ [ 0, 1 ] 20039 3.125% 3.125% # ( 1, 2 ] 343525 53.580% 56.705% ########### ( 2, 3 ] 143878 22.441% 79.146% #### ( 3, 4 ] 61890 9.653% 88.799% ## ( 4, 6 ] 58592 9.139% 97.937% ## ( 6, 10 ] 10564 1.648% 99.585% ( 10, 15 ] 1723 0.269% 99.854% ( 15, 22 ] 227 0.035% 99.889% ( 22, 34 ] 40 0.006% 99.895% ( 34, 51 ] 14 0.002% 99.898% ( 51, 76 ] 20 0.003% 99.901% ( 76, 110 ] 193 0.030% 99.931% ( 110, 170 ] 325 0.051% 99.981% ( 170, 250 ] 190 0.030% 100.011% ( 250, 380 ] 240 0.037% 100.049% ( 380, 580 ] 225 0.035% 100.084% ( 580, 870 ] 155 0.024% 100.108% ( 870, 1300 ] 104 0.016% 100.124% ( 1300, 1900 ] 70 0.011% 100.135% ( 1900, 2900 ] 100 0.016% 100.151% ( 2900, 4400 ] 64 0.010% 100.160% ( 4400, 6600 ] 20 0.003% 100.164% ( 6600, 9900 ] 5 0.001% 100.164% ( 14000, 22000 ] 1 0.000% 100.165% ( 22000, 33000 ] 1 0.000% 100.165% ** Level 4 read latency histogram (micros): Count: 35307 Average: 77.2604 StdDev: 470.70 Min: 0 Median: 1.9331 Max: 29400 Percentiles: P50: 1.93 P75: 3.16 P99: 1881.23 P99.9: 5116.02 P99.99: 8404.87 ------------------------------------------------------ [ 0, 1 ] 1089 3.084% 3.084% # ( 1, 2 ] 17752 50.279% 53.363% ########## ( 2, 3 ] 7015 19.869% 73.232% #### ( 3, 4 ] 3871 10.964% 84.196% ## ( 4, 6 ] 2276 6.446% 90.642% # ( 6, 10 ] 801 2.269% 92.911% ( 10, 15 ] 141 0.399% 93.310% ( 15, 22 ] 28 0.079% 93.389% ( 22, 34 ] 5 0.014% 93.404% ( 34, 51 ] 2 0.006% 93.409% ( 51, 76 ] 1 0.003% 93.412% ( 76, 110 ] 18 0.051% 93.463% ( 110, 170 ] 122 0.346% 93.809% ( 170, 250 ] 156 0.442% 94.250% ( 250, 380 ] 288 0.816% 95.066% ( 380, 580 ] 394 1.116% 96.182% ( 580, 870 ] 442 1.252% 97.434% ( 870, 1300 ] 365 1.034% 98.468% ( 1300, 1900 ] 194 0.549% 99.017% ( 1900, 2900 ] 147 0.416% 99.434% ( 2900, 4400 ] 152 0.431% 99.864% ( 4400, 6600 ] 39 0.110% 99.975% ( 6600, 9900 ] 10 0.028% 100.003% ( 9900, 14000 ] 3 0.008% 100.011% ( 14000, 22000 ] 4 0.011% 100.023% ( 22000, 33000 ] 1 0.003% 100.025% ** Level 5 read latency histogram (micros): Count: 140 Average: 1085.8429 StdDev: 1140.29 Min: 86 Median: 621.4286 Max: 5516 Percentiles: P50: 621.43 P75: 1550.00 P99: 5060.00 P99.9: 5516.00 P99.99: 5516.00 ------------------------------------------------------ ( 76, 110 ] 8 5.714% 5.714% # ( 110, 170 ] 11 7.857% 13.571% ## ( 170, 250 ] 14 10.000% 23.571% ## ( 250, 380 ] 20 14.286% 37.857% ### ( 380, 580 ] 15 10.714% 48.571% ## ( 580, 870 ] 14 10.000% 58.571% ## ( 870, 1300 ] 18 12.857% 71.429% ### ( 1300, 1900 ] 12 8.571% 80.000% ## ( 1900, 2900 ] 14 10.000% 90.000% ## ( 2900, 4400 ] 12 8.571% 98.571% ## ( 4400, 6600 ] 2 1.429% 100.000% ** DB Stats ** Uptime(secs): 27.2 total, 3.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 252.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.289 H:M:S, 30.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 259.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.991 H:M:S, 26.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/12/15-22:51:05 ... thread 0: (1000000,8000000) ops and (161910.8,240752.8) ops/second in (6.176240,33.229106) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.70 GB 132.1 6.6 0.0 6.6 14.1 7.6 0.0 1.9 134.1 288.1 50.25 45.19 131 0.384 6843K 9877 0.0 0.0 L1 8/0 935.58 MB 93.6 4.9 4.6 0.3 4.9 4.6 0.2 1.1 222.3 220.2 22.70 21.44 3 7.568 5125K 46K 0.0 0.0 L2 2/1 250.79 MB 1.3 0.4 0.2 0.2 0.4 0.2 3.7 2.0 246.2 246.1 1.53 1.48 2 0.767 383K 186 0.0 0.0 L3 39/11 2.10 GB 1.5 4.7 3.0 1.7 4.7 3.0 0.8 1.6 168.9 168.3 28.32 21.47 19 1.490 4857K 16K 0.0 0.0 L4 189/8 9.76 GB 1.0 1.9 1.7 0.1 1.9 1.7 0.8 1.1 121.3 121.1 15.84 9.14 39 0.406 1848K 1204 0.0 0.0 L5 1068/0 87.91 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1321/30 103.63 GB 0.0 18.4 9.5 8.9 25.9 17.0 7.9 3.4 159.0 223.7 118.65 98.71 194 0.612 19M 74K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.4 9.5 8.9 25.9 17.0 7.8 3.4 159.0 223.7 118.65 98.71 194 0.612 19M 74K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.4 9.5 8.9 18.4 9.4 0.0 0.0 199.5 198.7 94.60 79.06 85 1.113 19M 74K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 322.1 24.06 19.65 109 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.4 total, 33.2 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.92 GB write, 794.32 MB/s write, 18.43 GB read, 564.75 MB/s read, 118.7 seconds Interval compaction: 25.92 GB write, 798.66 MB/s write, 18.43 GB read, 567.83 MB/s read, 118.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 56, interval: 76 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3189478 Average: 2.5186 StdDev: 26.64 Min: 0 Median: 1.5282 Max: 12810 Percentiles: P50: 1.53 P75: 1.92 P99: 5.95 P99.9: 12.37 P99.99: 141.56 ------------------------------------------------------ [ 0, 1 ] 512857 16.080% 16.080% ### ( 1, 2 ] 2048058 64.213% 80.293% ############# ( 2, 3 ] 352935 11.066% 91.358% ## ( 3, 4 ] 141811 4.446% 95.804% # ( 4, 6 ] 104600 3.280% 99.084% # ( 6, 10 ] 24382 0.764% 99.848% ( 10, 15 ] 3469 0.109% 99.957% ( 15, 22 ] 566 0.018% 99.975% ( 22, 34 ] 48 0.002% 99.976% ( 34, 51 ] 16 0.001% 99.977% ( 51, 76 ] 35 0.001% 99.978% ( 76, 110 ] 219 0.007% 99.985% ( 110, 170 ] 310 0.010% 99.995% ( 170, 250 ] 208 0.007% 100.001% ( 250, 380 ] 165 0.005% 100.006% ( 380, 580 ] 186 0.006% 100.012% ( 580, 870 ] 180 0.006% 100.018% ( 870, 1300 ] 119 0.004% 100.022% ( 1300, 1900 ] 54 0.002% 100.023% ( 1900, 2900 ] 54 0.002% 100.025% ( 2900, 4400 ] 54 0.002% 100.027% ( 4400, 6600 ] 8 0.000% 100.027% ( 6600, 9900 ] 5 0.000% 100.027% ( 9900, 14000 ] 2 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 871231 Average: 5.3270 StdDev: 85.63 Min: 0 Median: 1.8675 Max: 14424 Percentiles: P50: 1.87 P75: 2.82 P99: 9.17 P99.9: 130.96 P99.99: 385.93 ------------------------------------------------------ [ 0, 1 ] 29457 3.381% 3.381% # ( 1, 2 ] 468175 53.737% 57.118% ########### ( 2, 3 ] 189739 21.778% 78.897% #### ( 3, 4 ] 80155 9.200% 88.097% ## ( 4, 6 ] 79192 9.090% 97.186% ## ( 6, 10 ] 19930 2.288% 99.474% ( 10, 15 ] 2914 0.334% 99.808% ( 15, 22 ] 378 0.043% 99.852% ( 22, 34 ] 28 0.003% 99.855% ( 34, 51 ] 11 0.001% 99.856% ( 51, 76 ] 19 0.002% 99.858% ( 76, 110 ] 243 0.028% 99.886% ( 110, 170 ] 340 0.039% 99.925% ( 170, 250 ] 271 0.031% 99.956% ( 250, 380 ] 282 0.032% 99.989% ( 380, 580 ] 333 0.038% 100.027% ( 580, 870 ] 255 0.029% 100.056% ( 870, 1300 ] 181 0.021% 100.077% ( 1300, 1900 ] 106 0.012% 100.089% ( 1900, 2900 ] 134 0.015% 100.105% ( 2900, 4400 ] 129 0.015% 100.119% ( 4400, 6600 ] 55 0.006% 100.126% ( 6600, 9900 ] 18 0.002% 100.128% ( 9900, 14000 ] 3 0.000% 100.128% ( 14000, 22000 ] 1 0.000% 100.128% ** Level 2 read latency histogram (micros): Count: 124135 Average: 2.3690 StdDev: 15.87 Min: 0 Median: 1.4409 Max: 2792 Percentiles: P50: 1.44 P75: 1.84 P99: 5.83 P99.9: 96.87 P99.99: 637.51 ------------------------------------------------------ [ 0, 1 ] 27481 22.138% 22.138% #### ( 1, 2 ] 78448 63.196% 85.334% ############# ( 2, 3 ] 10614 8.550% 93.884% ## ( 3, 4 ] 4042 3.256% 97.140% # ( 4, 6 ] 2520 2.030% 99.170% ( 6, 10 ] 828 0.667% 99.837% ( 10, 15 ] 45 0.036% 99.874% ( 15, 22 ] 6 0.005% 99.878% ( 22, 34 ] 3 0.002% 99.881% ( 51, 76 ] 3 0.002% 99.883% ( 76, 110 ] 34 0.027% 99.911% ( 110, 170 ] 48 0.039% 99.949% ( 170, 250 ] 20 0.016% 99.965% ( 250, 380 ] 12 0.010% 99.975% ( 380, 580 ] 17 0.014% 99.989% ( 580, 870 ] 8 0.006% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 812409 Average: 6.4109 StdDev: 102.19 Min: 0 Median: 1.9099 Max: 26071 Percentiles: P50: 1.91 P75: 2.88 P99: 9.07 P99.9: 210.51 P99.99: 523.77 ------------------------------------------------------ [ 0, 1 ] 21830 2.687% 2.687% # ( 1, 2 ] 422419 51.996% 54.683% ########## ( 2, 3 ] 187059 23.025% 77.708% ##### ( 3, 4 ] 81515 10.034% 87.742% ## ( 4, 6 ] 79765 9.818% 97.560% ## ( 6, 10 ] 15266 1.879% 99.439% ( 10, 15 ] 2649 0.326% 99.765% ( 15, 22 ] 326 0.040% 99.806% ( 22, 34 ] 51 0.006% 99.812% ( 34, 51 ] 15 0.002% 99.814% ( 51, 76 ] 25 0.003% 99.817% ( 76, 110 ] 207 0.025% 99.842% ( 110, 170 ] 346 0.043% 99.885% ( 170, 250 ] 250 0.031% 99.916% ( 250, 380 ] 331 0.041% 99.956% ( 380, 580 ] 385 0.047% 100.004% ( 580, 870 ] 355 0.044% 100.047% ( 870, 1300 ] 267 0.033% 100.080% ( 1300, 1900 ] 170 0.021% 100.101% ( 1900, 2900 ] 200 0.025% 100.126% ( 2900, 4400 ] 205 0.025% 100.151% ( 4400, 6600 ] 57 0.007% 100.158% ( 6600, 9900 ] 15 0.002% 100.160% ( 9900, 14000 ] 1 0.000% 100.160% ( 14000, 22000 ] 1 0.000% 100.160% ( 22000, 33000 ] 1 0.000% 100.160% ** Level 4 read latency histogram (micros): Count: 39998 Average: 83.7240 StdDev: 472.32 Min: 0 Median: 1.9506 Max: 29400 Percentiles: P50: 1.95 P75: 3.22 P99: 1999.56 P99.9: 5165.31 P99.99: 8400.06 ------------------------------------------------------ [ 0, 1 ] 1165 2.913% 2.913% # ( 1, 2 ] 19812 49.532% 52.445% ########## ( 2, 3 ] 8046 20.116% 72.561% #### ( 3, 4 ] 4363 10.908% 83.469% ## ( 4, 6 ] 2601 6.503% 89.972% # ( 6, 10 ] 924 2.310% 92.282% ( 10, 15 ] 158 0.395% 92.677% ( 15, 22 ] 33 0.083% 92.760% ( 22, 34 ] 6 0.015% 92.775% ( 34, 51 ] 2 0.005% 92.780% ( 51, 76 ] 1 0.003% 92.782% ( 76, 110 ] 22 0.055% 92.837% ( 110, 170 ] 133 0.333% 93.170% ( 170, 250 ] 168 0.420% 93.590% ( 250, 380 ] 328 0.820% 94.410% ( 380, 580 ] 500 1.250% 95.660% ( 580, 870 ] 576 1.440% 97.100% ( 870, 1300 ] 490 1.225% 98.325% ( 1300, 1900 ] 252 0.630% 98.955% ( 1900, 2900 ] 181 0.453% 99.407% ( 2900, 4400 ] 181 0.453% 99.860% ( 4400, 6600 ] 46 0.115% 99.975% ( 6600, 9900 ] 11 0.028% 100.003% ( 9900, 14000 ] 3 0.008% 100.010% ( 14000, 22000 ] 4 0.010% 100.020% ( 22000, 33000 ] 1 0.003% 100.023% ** Level 5 read latency histogram (micros): Count: 140 Average: 1085.8429 StdDev: 1140.29 Min: 86 Median: 621.4286 Max: 5516 Percentiles: P50: 621.43 P75: 1550.00 P99: 5060.00 P99.9: 5516.00 P99.99: 5516.00 ------------------------------------------------------ ( 76, 110 ] 8 5.714% 5.714% # ( 110, 170 ] 11 7.857% 13.571% ## ( 170, 250 ] 14 10.000% 23.571% ## ( 250, 380 ] 20 14.286% 37.857% ### ( 380, 580 ] 15 10.714% 48.571% ## ( 580, 870 ] 14 10.000% 58.571% ## ( 870, 1300 ] 18 12.857% 71.429% ### ( 1300, 1900 ] 12 8.571% 80.000% ## ( 1900, 2900 ] 14 10.000% 90.000% ## ( 2900, 4400 ] 12 8.571% 98.571% ## ( 4400, 6600 ] 2 1.429% 100.000% ** DB Stats ** Uptime(secs): 33.4 total, 6.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 235.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.650 H:M:S, 34.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 159.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.361 H:M:S, 54.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/15-22:51:09 ... thread 0: (1000000,9000000) ops and (248065.2,241543.9) ops/second in (4.031199,37.260305) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 3.62 GB 6.3 8.6 0.0 8.6 17.1 8.5 0.0 2.0 139.4 276.6 63.24 55.82 147 0.430 8953K 16K 0.0 0.0 L1 8/8 935.58 MB 0.0 4.9 4.6 0.3 4.9 4.6 0.2 1.1 222.3 220.2 22.70 21.44 3 7.568 5125K 46K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.7 2.0 246.2 246.1 1.53 1.48 2 0.767 383K 186 0.0 0.0 L3 20/0 973.65 MB 1.0 5.0 3.1 1.9 5.0 3.1 0.9 1.6 167.9 167.3 30.48 22.98 20 1.524 5198K 19K 0.0 0.0 L4 179/0 9.47 GB 1.0 3.7 3.0 0.7 3.7 3.0 0.8 1.2 126.0 125.5 30.28 17.94 59 0.513 3735K 9767 0.0 0.0 L5 1088/0 89.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1308/20 104.53 GB 0.0 22.6 10.9 11.7 31.0 19.3 9.7 3.7 156.4 214.3 148.23 119.66 231 0.642 23M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.6 10.9 11.7 31.0 19.3 9.6 3.7 156.4 214.3 148.23 119.66 231 0.642 23M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.6 10.9 11.7 22.5 10.8 0.0 0.0 192.4 191.6 120.44 97.60 110 1.095 23M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 312.8 27.80 22.05 121 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.4 total, 37.3 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.03 GB write, 848.51 MB/s write, 22.63 GB read, 619.01 MB/s read, 148.2 seconds Interval compaction: 31.03 GB write, 852.64 MB/s write, 22.63 GB read, 622.02 MB/s read, 148.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 77, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 77, interval: 97 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3502243 Average: 2.5670 StdDev: 27.08 Min: 0 Median: 1.5354 Max: 12810 Percentiles: P50: 1.54 P75: 1.93 P99: 5.99 P99.9: 13.06 P99.99: 166.22 ------------------------------------------------------ [ 0, 1 ] 556811 15.899% 15.899% ### ( 1, 2 ] 2230696 63.693% 79.592% ############# ( 2, 3 ] 395006 11.279% 90.871% ## ( 3, 4 ] 162554 4.641% 95.512% # ( 4, 6 ] 122617 3.501% 99.013% # ( 6, 10 ] 28635 0.818% 99.831% ( 10, 15 ] 3963 0.113% 99.944% ( 15, 22 ] 613 0.018% 99.962% ( 22, 34 ] 50 0.001% 99.963% ( 34, 51 ] 16 0.000% 99.963% ( 51, 76 ] 39 0.001% 99.965% ( 76, 110 ] 414 0.012% 99.976% ( 110, 170 ] 512 0.015% 99.991% ( 170, 250 ] 256 0.007% 99.998% ( 250, 380 ] 206 0.006% 100.004% ( 380, 580 ] 228 0.007% 100.011% ( 580, 870 ] 205 0.006% 100.017% ( 870, 1300 ] 136 0.004% 100.020% ( 1300, 1900 ] 67 0.002% 100.022% ( 1900, 2900 ] 60 0.002% 100.024% ( 2900, 4400 ] 63 0.002% 100.026% ( 4400, 6600 ] 10 0.000% 100.026% ( 6600, 9900 ] 5 0.000% 100.026% ( 9900, 14000 ] 2 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 902758 Average: 5.2751 StdDev: 84.78 Min: 0 Median: 1.8697 Max: 14424 Percentiles: P50: 1.87 P75: 2.83 P99: 9.17 P99.9: 127.34 P99.99: 390.58 ------------------------------------------------------ [ 0, 1 ] 29995 3.323% 3.323% # ( 1, 2 ] 484533 53.673% 56.995% ########### ( 2, 3 ] 196833 21.804% 78.799% #### ( 3, 4 ] 83388 9.237% 88.036% ## ( 4, 6 ] 82549 9.144% 97.180% ## ( 6, 10 ] 20753 2.299% 99.479% ( 10, 15 ] 3021 0.335% 99.813% ( 15, 22 ] 384 0.043% 99.856% ( 22, 34 ] 28 0.003% 99.859% ( 34, 51 ] 11 0.001% 99.860% ( 51, 76 ] 19 0.002% 99.862% ( 76, 110 ] 243 0.027% 99.889% ( 110, 170 ] 340 0.038% 99.927% ( 170, 250 ] 271 0.030% 99.957% ( 250, 380 ] 282 0.031% 99.988% ( 380, 580 ] 335 0.037% 100.025% ( 580, 870 ] 255 0.028% 100.053% ( 870, 1300 ] 182 0.020% 100.074% ( 1300, 1900 ] 109 0.012% 100.086% ( 1900, 2900 ] 134 0.015% 100.100% ( 2900, 4400 ] 133 0.015% 100.115% ( 4400, 6600 ] 56 0.006% 100.121% ( 6600, 9900 ] 18 0.002% 100.123% ( 9900, 14000 ] 3 0.000% 100.124% ( 14000, 22000 ] 1 0.000% 100.124% ** Level 2 read latency histogram (micros): Count: 124135 Average: 2.3690 StdDev: 15.87 Min: 0 Median: 1.4409 Max: 2792 Percentiles: P50: 1.44 P75: 1.84 P99: 5.83 P99.9: 96.87 P99.99: 637.51 ------------------------------------------------------ [ 0, 1 ] 27481 22.138% 22.138% #### ( 1, 2 ] 78448 63.196% 85.334% ############# ( 2, 3 ] 10614 8.550% 93.884% ## ( 3, 4 ] 4042 3.256% 97.140% # ( 4, 6 ] 2520 2.030% 99.170% ( 6, 10 ] 828 0.667% 99.837% ( 10, 15 ] 45 0.036% 99.874% ( 15, 22 ] 6 0.005% 99.878% ( 22, 34 ] 3 0.002% 99.881% ( 51, 76 ] 3 0.002% 99.883% ( 76, 110 ] 34 0.027% 99.911% ( 110, 170 ] 48 0.039% 99.949% ( 170, 250 ] 20 0.016% 99.965% ( 250, 380 ] 12 0.010% 99.975% ( 380, 580 ] 17 0.014% 99.989% ( 580, 870 ] 8 0.006% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1174775 Average: 5.9759 StdDev: 94.43 Min: 0 Median: 1.9291 Max: 26071 Percentiles: P50: 1.93 P75: 2.91 P99: 8.87 P99.9: 84.86 P99.99: 329.29 ------------------------------------------------------ [ 0, 1 ] 26409 2.248% 2.248% ( 1, 2 ] 603807 51.398% 53.646% ########## ( 2, 3 ] 275584 23.458% 77.104% ##### ( 3, 4 ] 121604 10.351% 87.455% ## ( 4, 6 ] 119964 10.212% 97.667% ## ( 6, 10 ] 21813 1.857% 99.524% ( 10, 15 ] 3811 0.324% 99.848% ( 15, 22 ] 438 0.037% 99.886% ( 22, 34 ] 58 0.005% 99.890% ( 34, 51 ] 25 0.002% 99.893% ( 51, 76 ] 32 0.003% 99.895% ( 76, 110 ] 212 0.018% 99.913% ( 110, 170 ] 373 0.032% 99.945% ( 170, 250 ] 286 0.024% 99.969% ( 250, 380 ] 396 0.034% 100.003% ( 380, 580 ] 481 0.041% 100.044% ( 580, 870 ] 478 0.041% 100.085% ( 870, 1300 ] 344 0.029% 100.114% ( 1300, 1900 ] 214 0.018% 100.132% ( 1900, 2900 ] 244 0.021% 100.153% ( 2900, 4400 ] 263 0.022% 100.175% ( 4400, 6600 ] 72 0.006% 100.182% ( 6600, 9900 ] 20 0.002% 100.183% ( 9900, 14000 ] 1 0.000% 100.183% ( 14000, 22000 ] 1 0.000% 100.183% ( 22000, 33000 ] 1 0.000% 100.184% ** Level 4 read latency histogram (micros): Count: 177209 Average: 33.0300 StdDev: 272.16 Min: 0 Median: 2.0016 Max: 29400 Percentiles: P50: 2.00 P75: 3.22 P99: 872.53 P99.9: 3259.95 P99.99: 4145.99 ------------------------------------------------------ [ 0, 1 ] 3424 1.932% 1.932% ( 1, 2 ] 85116 48.031% 49.964% ########## ( 2, 3 ] 40040 22.595% 72.558% ##### ( 3, 4 ] 19947 11.256% 83.815% ## ( 4, 6 ] 17729 10.005% 93.819% ## ( 6, 10 ] 5004 2.824% 96.643% # ( 10, 15 ] 796 0.449% 97.092% ( 15, 22 ] 102 0.058% 97.150% ( 22, 34 ] 19 0.011% 97.160% ( 34, 51 ] 6 0.003% 97.164% ( 51, 76 ] 2 0.001% 97.165% ( 76, 110 ] 74 0.042% 97.207% ( 110, 170 ] 248 0.140% 97.347% ( 170, 250 ] 354 0.200% 97.546% ( 250, 380 ] 578 0.326% 97.873% ( 380, 580 ] 938 0.529% 98.402% ( 580, 870 ] 1055 0.595% 98.997% ( 870, 1300 ] 835 0.471% 99.468% ( 1300, 1900 ] 400 0.226% 99.694% ( 1900, 2900 ] 300 0.169% 99.863% ( 2900, 4400 ] 270 0.152% 100.016% ( 4400, 6600 ] 84 0.047% 100.063% ( 6600, 9900 ] 14 0.008% 100.071% ( 9900, 14000 ] 3 0.002% 100.073% ( 14000, 22000 ] 4 0.002% 100.075% ( 22000, 33000 ] 1 0.001% 100.076% ** Level 5 read latency histogram (micros): Count: 240 Average: 1282.9167 StdDev: 1295.98 Min: 86 Median: 730.8000 Max: 5516 Percentiles: P50: 730.80 P75: 1990.91 P99: 5516.00 P99.9: 5516.00 P99.99: 5516.00 ------------------------------------------------------ ( 76, 110 ] 10 4.167% 4.167% # ( 110, 170 ] 17 7.083% 11.250% # ( 170, 250 ] 23 9.583% 20.833% ## ( 250, 380 ] 34 14.167% 35.000% ### ( 380, 580 ] 23 9.583% 44.583% ## ( 580, 870 ] 25 10.417% 55.000% ## ( 870, 1300 ] 28 11.667% 66.667% ## ( 1300, 1900 ] 18 7.500% 74.167% ## ( 1900, 2900 ] 22 9.167% 83.333% ## ( 2900, 4400 ] 34 14.167% 97.500% ### ( 4400, 6600 ] 6 2.500% 100.000% # ** DB Stats ** Uptime(secs): 37.4 total, 4.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 236.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.938 H:M:S, 34.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 244.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.288 H:M:S, 31.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-22:51:13 ... thread 0: (1000000,10000000) ops and (261059.5,243363.2) ops/second in (3.830544,41.090849) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 4.60 GB 81.8 9.4 0.0 9.4 18.9 9.5 0.0 2.0 139.5 279.6 69.11 61.34 165 0.419 9784K 17K 0.0 0.0 L1 8/8 935.58 MB 0.0 4.9 4.6 0.3 4.9 4.6 0.2 1.1 222.3 220.2 22.70 21.44 3 7.568 5125K 46K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.7 2.0 246.2 246.1 1.53 1.48 2 0.767 383K 186 0.0 0.0 L3 20/0 973.65 MB 1.0 5.0 3.1 1.9 5.0 3.1 0.9 1.6 167.9 167.3 30.48 22.98 20 1.524 5198K 19K 0.0 0.0 L4 179/0 9.47 GB 1.0 3.7 3.0 0.7 3.7 3.0 0.8 1.2 126.0 125.5 30.28 17.94 59 0.513 3735K 9767 0.0 0.0 L5 1088/0 89.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1314/24 105.51 GB 0.0 23.4 10.9 12.5 32.8 20.3 9.7 3.5 155.7 218.0 154.10 125.17 249 0.619 24M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.4 10.9 12.5 32.8 20.3 9.6 3.5 155.7 218.0 154.10 125.17 249 0.619 24M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.4 10.9 12.5 23.3 10.8 0.0 0.0 194.3 193.5 123.50 100.61 113 1.093 24M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 317.0 30.60 24.56 136 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.3 total, 41.1 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.81 GB write, 814.00 MB/s write, 23.43 GB read, 581.40 MB/s read, 154.1 seconds Interval compaction: 32.81 GB write, 817.60 MB/s write, 23.43 GB read, 583.97 MB/s read, 154.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 79, interval: 104 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3938529 Average: 2.5227 StdDev: 25.72 Min: 0 Median: 1.5307 Max: 12810 Percentiles: P50: 1.53 P75: 1.92 P99: 5.98 P99.9: 12.69 P99.99: 147.68 ------------------------------------------------------ [ 0, 1 ] 628286 15.952% 15.952% ### ( 1, 2 ] 2526700 64.153% 80.106% ############# ( 2, 3 ] 439251 11.153% 91.258% ## ( 3, 4 ] 175992 4.468% 95.727% # ( 4, 6 ] 130360 3.310% 99.037% # ( 6, 10 ] 31653 0.804% 99.840% ( 10, 15 ] 4373 0.111% 99.951% ( 15, 22 ] 657 0.017% 99.968% ( 22, 34 ] 51 0.001% 99.969% ( 34, 51 ] 20 0.001% 99.970% ( 51, 76 ] 42 0.001% 99.971% ( 76, 110 ] 425 0.011% 99.982% ( 110, 170 ] 521 0.013% 99.995% ( 170, 250 ] 268 0.007% 100.002% ( 250, 380 ] 214 0.005% 100.007% ( 380, 580 ] 228 0.006% 100.013% ( 580, 870 ] 213 0.005% 100.018% ( 870, 1300 ] 139 0.004% 100.022% ( 1300, 1900 ] 68 0.002% 100.024% ( 1900, 2900 ] 61 0.002% 100.025% ( 2900, 4400 ] 65 0.002% 100.027% ( 4400, 6600 ] 10 0.000% 100.027% ( 6600, 9900 ] 5 0.000% 100.027% ( 9900, 14000 ] 2 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 902758 Average: 5.2751 StdDev: 84.78 Min: 0 Median: 1.8697 Max: 14424 Percentiles: P50: 1.87 P75: 2.83 P99: 9.17 P99.9: 127.34 P99.99: 390.58 ------------------------------------------------------ [ 0, 1 ] 29995 3.323% 3.323% # ( 1, 2 ] 484533 53.673% 56.995% ########### ( 2, 3 ] 196833 21.804% 78.799% #### ( 3, 4 ] 83388 9.237% 88.036% ## ( 4, 6 ] 82549 9.144% 97.180% ## ( 6, 10 ] 20753 2.299% 99.479% ( 10, 15 ] 3021 0.335% 99.813% ( 15, 22 ] 384 0.043% 99.856% ( 22, 34 ] 28 0.003% 99.859% ( 34, 51 ] 11 0.001% 99.860% ( 51, 76 ] 19 0.002% 99.862% ( 76, 110 ] 243 0.027% 99.889% ( 110, 170 ] 340 0.038% 99.927% ( 170, 250 ] 271 0.030% 99.957% ( 250, 380 ] 282 0.031% 99.988% ( 380, 580 ] 335 0.037% 100.025% ( 580, 870 ] 255 0.028% 100.053% ( 870, 1300 ] 182 0.020% 100.074% ( 1300, 1900 ] 109 0.012% 100.086% ( 1900, 2900 ] 134 0.015% 100.100% ( 2900, 4400 ] 133 0.015% 100.115% ( 4400, 6600 ] 56 0.006% 100.121% ( 6600, 9900 ] 18 0.002% 100.123% ( 9900, 14000 ] 3 0.000% 100.124% ( 14000, 22000 ] 1 0.000% 100.124% ** Level 2 read latency histogram (micros): Count: 124135 Average: 2.3690 StdDev: 15.87 Min: 0 Median: 1.4409 Max: 2792 Percentiles: P50: 1.44 P75: 1.84 P99: 5.83 P99.9: 96.87 P99.99: 637.51 ------------------------------------------------------ [ 0, 1 ] 27481 22.138% 22.138% #### ( 1, 2 ] 78448 63.196% 85.334% ############# ( 2, 3 ] 10614 8.550% 93.884% ## ( 3, 4 ] 4042 3.256% 97.140% # ( 4, 6 ] 2520 2.030% 99.170% ( 6, 10 ] 828 0.667% 99.837% ( 10, 15 ] 45 0.036% 99.874% ( 15, 22 ] 6 0.005% 99.878% ( 22, 34 ] 3 0.002% 99.881% ( 51, 76 ] 3 0.002% 99.883% ( 76, 110 ] 34 0.027% 99.911% ( 110, 170 ] 48 0.039% 99.949% ( 170, 250 ] 20 0.016% 99.965% ( 250, 380 ] 12 0.010% 99.975% ( 380, 580 ] 17 0.014% 99.989% ( 580, 870 ] 8 0.006% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1174775 Average: 5.9759 StdDev: 94.43 Min: 0 Median: 1.9291 Max: 26071 Percentiles: P50: 1.93 P75: 2.91 P99: 8.87 P99.9: 84.86 P99.99: 329.29 ------------------------------------------------------ [ 0, 1 ] 26409 2.248% 2.248% ( 1, 2 ] 603807 51.398% 53.646% ########## ( 2, 3 ] 275584 23.458% 77.104% ##### ( 3, 4 ] 121604 10.351% 87.455% ## ( 4, 6 ] 119964 10.212% 97.667% ## ( 6, 10 ] 21813 1.857% 99.524% ( 10, 15 ] 3811 0.324% 99.848% ( 15, 22 ] 438 0.037% 99.886% ( 22, 34 ] 58 0.005% 99.890% ( 34, 51 ] 25 0.002% 99.893% ( 51, 76 ] 32 0.003% 99.895% ( 76, 110 ] 212 0.018% 99.913% ( 110, 170 ] 373 0.032% 99.945% ( 170, 250 ] 286 0.024% 99.969% ( 250, 380 ] 396 0.034% 100.003% ( 380, 580 ] 481 0.041% 100.044% ( 580, 870 ] 478 0.041% 100.085% ( 870, 1300 ] 344 0.029% 100.114% ( 1300, 1900 ] 214 0.018% 100.132% ( 1900, 2900 ] 244 0.021% 100.153% ( 2900, 4400 ] 263 0.022% 100.175% ( 4400, 6600 ] 72 0.006% 100.182% ( 6600, 9900 ] 20 0.002% 100.183% ( 9900, 14000 ] 1 0.000% 100.183% ( 14000, 22000 ] 1 0.000% 100.183% ( 22000, 33000 ] 1 0.000% 100.184% ** Level 4 read latency histogram (micros): Count: 177209 Average: 33.0300 StdDev: 272.16 Min: 0 Median: 2.0016 Max: 29400 Percentiles: P50: 2.00 P75: 3.22 P99: 872.53 P99.9: 3259.95 P99.99: 4145.99 ------------------------------------------------------ [ 0, 1 ] 3424 1.932% 1.932% ( 1, 2 ] 85116 48.031% 49.964% ########## ( 2, 3 ] 40040 22.595% 72.558% ##### ( 3, 4 ] 19947 11.256% 83.815% ## ( 4, 6 ] 17729 10.005% 93.819% ## ( 6, 10 ] 5004 2.824% 96.643% # ( 10, 15 ] 796 0.449% 97.092% ( 15, 22 ] 102 0.058% 97.150% ( 22, 34 ] 19 0.011% 97.160% ( 34, 51 ] 6 0.003% 97.164% ( 51, 76 ] 2 0.001% 97.165% ( 76, 110 ] 74 0.042% 97.207% ( 110, 170 ] 248 0.140% 97.347% ( 170, 250 ] 354 0.200% 97.546% ( 250, 380 ] 578 0.326% 97.873% ( 380, 580 ] 938 0.529% 98.402% ( 580, 870 ] 1055 0.595% 98.997% ( 870, 1300 ] 835 0.471% 99.468% ( 1300, 1900 ] 400 0.226% 99.694% ( 1900, 2900 ] 300 0.169% 99.863% ( 2900, 4400 ] 270 0.152% 100.016% ( 4400, 6600 ] 84 0.047% 100.063% ( 6600, 9900 ] 14 0.008% 100.071% ( 9900, 14000 ] 3 0.002% 100.073% ( 14000, 22000 ] 4 0.002% 100.075% ( 22000, 33000 ] 1 0.001% 100.076% ** Level 5 read latency histogram (micros): Count: 240 Average: 1282.9167 StdDev: 1295.98 Min: 86 Median: 730.8000 Max: 5516 Percentiles: P50: 730.80 P75: 1990.91 P99: 5516.00 P99.9: 5516.00 P99.99: 5516.00 ------------------------------------------------------ ( 76, 110 ] 10 4.167% 4.167% # ( 110, 170 ] 17 7.083% 11.250% # ( 170, 250 ] 23 9.583% 20.833% ## ( 250, 380 ] 34 14.167% 35.000% ### ( 380, 580 ] 23 9.583% 44.583% ## ( 580, 870 ] 25 10.417% 55.000% ## ( 870, 1300 ] 28 11.667% 66.667% ## ( 1300, 1900 ] 18 7.500% 74.167% ## ( 1900, 2900 ] 22 9.167% 83.333% ## ( 2900, 4400 ] 34 14.167% 97.500% ### ( 4400, 6600 ] 6 2.500% 100.000% # ** DB Stats ** Uptime(secs): 41.3 total, 3.8 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 238.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.160 H:M:S, 34.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 256.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.223 H:M:S, 31.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.760 micros/op 173597 ops/sec 60.036 seconds 10421999 operations; 168.2 MB/s Microseconds per write: Count: 10421999 Average: 5.7605 StdDev: 465.08 Min: 0 Median: 1.7392 Max: 807939 Percentiles: P50: 1.74 P75: 2.74 P99: 7.99 P99.9: 1147.03 P99.99: 2736.36 ------------------------------------------------------ [ 0, 1 ] 1414525 13.572% 13.572% ### ( 1, 2 ] 5136047 49.281% 62.853% ########## ( 2, 3 ] 1711312 16.420% 79.274% ### ( 3, 4 ] 1447865 13.892% 93.166% ### ( 4, 6 ] 563407 5.406% 98.572% # ( 6, 10 ] 89477 0.859% 99.430% ( 10, 15 ] 21102 0.202% 99.633% ( 15, 22 ] 6612 0.063% 99.696% ( 22, 34 ] 1694 0.016% 99.713% ( 34, 51 ] 241 0.002% 99.715% ( 51, 76 ] 84 0.001% 99.716% ( 76, 110 ] 7084 0.068% 99.784% ( 110, 170 ] 3057 0.029% 99.813% ( 170, 250 ] 367 0.004% 99.816% ( 250, 380 ] 144 0.001% 99.818% ( 380, 580 ] 34 0.000% 99.818% ( 580, 870 ] 35 0.000% 99.819% ( 870, 1300 ] 13178 0.126% 99.945% ( 1300, 1900 ] 45 0.000% 99.945% ( 1900, 2900 ] 5556 0.053% 99.999% ( 2900, 4400 ] 87 0.001% 100.000% ( 4400, 6600 ] 10 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 5 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 211890 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10421999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10755502968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 635 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31580896 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 33204064436 rocksdb.compact.write.bytes COUNT : 32976605741 rocksdb.flush.write.bytes COUNT : 10701354071 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 56 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 390 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10615093248 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4148224 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33307722917 rocksdb.non.last.level.read.count COUNT : 8045320 rocksdb.block.checksum.compute.count COUNT : 8044106 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.381723 P95 : 3.858071 P99 : 6.116263 P100 : 807936.000000 COUNT : 10421999 SUM : 55233314 rocksdb.compaction.times.micros P50 : 895789.473684 P95 : 3273333.333333 P99 : 12992000.000000 P100 : 21662426.000000 COUNT : 124 SUM : 156426459 rocksdb.compaction.times.cpu_micros P50 : 655294.117647 P95 : 3273333.333333 P99 : 12992000.000000 P100 : 19689212.000000 COUNT : 124 SUM : 129217803 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 696.000000 P95 : 11745.000000 P99 : 64000.000000 P100 : 145937.000000 COUNT : 144 SUM : 425651 rocksdb.compaction.outfile.sync.micros P50 : 1323.076923 P95 : 71323.529412 P99 : 144000.000000 P100 : 241963.000000 COUNT : 430 SUM : 5760594 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 106.600000 P95 : 2238.888889 P99 : 5511.000000 P100 : 25846.000000 COUNT : 299 SUM : 157781 rocksdb.table.open.io.micros P50 : 1260.185185 P95 : 7379.166667 P99 : 12885.312500 P100 : 17739.000000 COUNT : 635 SUM : 1262570 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.673599 P95 : 7.953955 P99 : 11.105491 P100 : 29405.000000 COUNT : 8042630 SUM : 52154931 rocksdb.read.block.get.micros P50 : 373.760000 P95 : 3375.352113 P99 : 4737.333333 P100 : 5648.000000 COUNT : 1270 SUM : 1020894 rocksdb.write.raw.block.micros P50 : 0.514303 P95 : 0.977177 P99 : 2.951001 P100 : 29857.000000 COUNT : 10582644 SUM : 22477979 rocksdb.numfiles.in.singlecompaction P50 : 2.266667 P95 : 5.114286 P99 : 15.630000 P100 : 20.000000 COUNT : 182 SUM : 592 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560415 P95 : 1198.179892 P99 : 2598.068841 P100 : 807759.000000 COUNT : 174966 SUM : 31593042 rocksdb.sst.read.micros P50 : 1.618743 P95 : 4.799260 P99 : 8.588087 P100 : 29400.000000 COUNT : 8046013 SUM : 35723696 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10421999 SUM : 10755502968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210851.063830 P95 : 456000.000000 P99 : 796200.000000 P100 : 943317.000000 COUNT : 144 SUM : 32082821 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 404 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0