[2024-07-23 03:12:37.093838] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 23.11.0 initialization... [2024-07-23 03:12:37.094103] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2476307 ] Set seed to 1721697157087452 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-23 03:12:37.202799] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-23 03:12:37.244122] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-23 03:12:37.244174] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2476307' to capture a snapshot of events at runtime. [2024-07-23 03:12:37.244184] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-23 03:12:37.244194] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-23 03:12:37.244202] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2476307 for offline analysis/debug. [2024-07-23 03:12:37.244287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Jul 23 03:12:41 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/23-03:12:44 ... thread 0: (1000000,1000000) ops and (357763.4,357763.4) ops/second in (2.795143,2.795143) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 504.04 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 352.1 2.33 2.10 12 0.194 0 0 0.0 0.0 L1 3/3 188.88 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 258.5 258.4 0.73 0.71 1 0.731 191K 82 0.0 0.0 L2 2/1 125.96 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 9/0 741.41 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/12 96.94 GB 0.0 0.3 0.2 0.1 1.1 1.0 0.9 1.4 87.3 314.3 3.61 3.34 14 0.258 319K 122 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.8 1.4 87.3 314.3 3.61 3.34 14 0.258 319K 122 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 245.8 245.7 1.28 1.23 2 0.641 319K 122 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 352.1 2.33 2.10 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 377.09 MB/s write, 0.31 GB read, 104.75 MB/s read, 3.6 seconds Interval compaction: 1.11 GB write, 405.37 MB/s write, 0.31 GB read, 112.61 MB/s read, 3.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 117718 Average: 1.8658 StdDev: 18.58 Min: 1 Median: 1.1886 Max: 3966 Percentiles: P50: 1.19 P75: 1.64 P99: 4.12 P99.9: 9.79 P99.99: 234.56 ------------------------------------------------------ [ 0, 1 ] 46695 39.667% 39.667% ######## ( 1, 2 ] 64496 54.789% 94.455% ########### ( 2, 3 ] 3729 3.168% 97.623% # ( 3, 4 ] 1571 1.335% 98.958% ( 4, 6 ] 848 0.720% 99.678% ( 6, 10 ] 277 0.235% 99.913% ( 10, 15 ] 64 0.054% 99.968% ( 15, 22 ] 9 0.008% 99.975% ( 22, 34 ] 3 0.003% 99.978% ( 34, 51 ] 1 0.001% 99.979% ( 51, 76 ] 2 0.002% 99.980% ( 110, 170 ] 9 0.008% 99.988% ( 170, 250 ] 4 0.003% 99.992% ( 250, 380 ] 4 0.003% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 3 0.003% 100.002% ** Level 1 read latency histogram (micros): Count: 21998 Average: 1.7976 StdDev: 7.40 Min: 1 Median: 1.2083 Max: 985 Percentiles: P50: 1.21 P75: 1.65 P99: 3.99 P99.9: 10.28 P99.99: 302.01 ------------------------------------------------------ [ 0, 1 ] 8434 38.340% 38.340% ######## ( 1, 2 ] 12316 55.987% 94.327% ########### ( 2, 3 ] 738 3.355% 97.682% # ( 3, 4 ] 295 1.341% 99.023% ( 4, 6 ] 160 0.727% 99.750% ( 6, 10 ] 33 0.150% 99.900% ( 10, 15 ] 18 0.082% 99.982% ( 15, 22 ] 1 0.005% 99.986% ( 110, 170 ] 1 0.005% 99.991% ( 250, 380 ] 2 0.009% 100.000% ( 870, 1300 ] 1 0.005% 100.005% ** Level 2 read latency histogram (micros): Count: 6189 Average: 4.9068 StdDev: 70.60 Min: 1 Median: 1.7323 Max: 4417 Percentiles: P50: 1.73 P75: 2.55 P99: 9.76 P99.9: 697.60 P99.99: 4417.00 ------------------------------------------------------ [ 0, 1 ] 478 7.723% 7.723% ## ( 1, 2 ] 3573 57.731% 65.455% ############ ( 2, 3 ] 1070 17.289% 82.744% ### ( 3, 4 ] 476 7.691% 90.435% ## ( 4, 6 ] 390 6.302% 96.736% # ( 6, 10 ] 149 2.407% 99.144% ( 10, 15 ] 32 0.517% 99.661% ( 15, 22 ] 3 0.048% 99.709% ( 22, 34 ] 4 0.065% 99.774% ( 34, 51 ] 1 0.016% 99.790% ( 51, 76 ] 1 0.016% 99.806% ( 170, 250 ] 1 0.016% 99.822% ( 250, 380 ] 2 0.032% 99.855% ( 380, 580 ] 2 0.032% 99.887% ( 580, 870 ] 2 0.032% 99.919% ( 870, 1300 ] 1 0.016% 99.935% ( 1300, 1900 ] 2 0.032% 99.968% ( 1900, 2900 ] 1 0.016% 99.984% ( 4400, 6600 ] 1 0.016% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1551.6000 StdDev: 1306.96 Min: 147 Median: 1171.0000 Max: 5226 Percentiles: P50: 1171.00 P75: 2556.25 P99: 5226.00 P99.9: 5226.00 P99.99: 5226.00 ------------------------------------------------------ ( 110, 170 ] 1 1.818% 1.818% ( 170, 250 ] 4 7.273% 9.091% # ( 250, 380 ] 7 12.727% 21.818% ### ( 380, 580 ] 9 16.364% 38.182% ### ( 580, 870 ] 3 5.455% 43.636% # ( 870, 1300 ] 5 9.091% 52.727% ## ( 1300, 1900 ] 7 12.727% 65.455% ### ( 1900, 2900 ] 8 14.545% 80.000% ### ( 2900, 4400 ] 9 16.364% 96.364% ### ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 4 read latency histogram (micros): Count: 15 Average: 1655.4667 StdDev: 955.69 Min: 443 Median: 1525.0000 Max: 3802 Percentiles: P50: 1525.00 P75: 2316.67 P99: 3802.00 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ ( 380, 580 ] 1 6.667% 6.667% # ( 580, 870 ] 3 20.000% 26.667% #### ( 870, 1300 ] 2 13.333% 40.000% ### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 2900, 4400 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 612.0500 StdDev: 771.50 Min: 95 Median: 150.0000 Max: 2342 Percentiles: P50: 150.00 P75: 580.00 P99: 2342.00 P99.9: 2342.00 P99.99: 2342.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 6 30.000% 60.000% ###### ( 380, 580 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 327.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.248 H:M:S, 8.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.248 H:M:S, 8.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/23-03:12:47 ... thread 0: (1000000,2000000) ops and (334825.1,345914.4) ops/second in (2.986634,5.781777) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.23 GB 69.2 0.5 0.0 0.5 2.3 1.8 0.0 1.3 71.9 332.4 7.01 6.42 28 0.250 511K 472 0.0 0.0 L1 1/0 3.31 MB 0.3 0.6 0.4 0.2 0.6 0.4 0.1 1.4 245.5 245.2 2.57 2.49 2 1.283 639K 793 0.0 0.0 L2 5/3 437.80 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 17/1 866.41 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.1 1.0 208.4 208.4 0.60 0.56 1 0.600 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1195/12 97.92 GB 0.0 1.4 0.6 0.7 3.1 2.4 1.3 1.8 129.1 299.3 10.73 10.00 32 0.335 1406K 1305 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 0.6 0.7 3.1 2.4 1.2 1.8 129.1 299.3 10.73 10.00 32 0.335 1406K 1305 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 0.6 0.7 1.4 0.6 0.0 0.0 248.8 248.6 5.57 5.39 6 0.928 1406K 1305 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.0 5.16 4.61 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.14 GB write, 535.67 MB/s write, 1.35 GB read, 231.07 MB/s read, 10.7 seconds Interval compaction: 3.14 GB write, 555.11 MB/s write, 1.35 GB read, 239.45 MB/s read, 10.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 355175 Average: 1.9875 StdDev: 13.30 Min: 1 Median: 1.3403 Max: 3966 Percentiles: P50: 1.34 P75: 1.76 P99: 5.12 P99.9: 9.83 P99.99: 147.00 ------------------------------------------------------ [ 0, 1 ] 104770 29.498% 29.498% ###### ( 1, 2 ] 213949 60.238% 89.736% ############ ( 2, 3 ] 22031 6.203% 95.939% # ( 3, 4 ] 8181 2.303% 98.242% ( 4, 6 ] 4817 1.356% 99.598% ( 6, 10 ] 1120 0.315% 99.914% ( 10, 15 ] 225 0.063% 99.977% ( 15, 22 ] 23 0.006% 99.983% ( 22, 34 ] 6 0.002% 99.985% ( 34, 51 ] 5 0.001% 99.986% ( 51, 76 ] 3 0.001% 99.987% ( 110, 170 ] 17 0.005% 99.992% ( 170, 250 ] 8 0.002% 99.994% ( 250, 380 ] 10 0.003% 99.997% ( 380, 580 ] 3 0.001% 99.998% ( 580, 870 ] 6 0.002% 100.000% ( 870, 1300 ] 6 0.002% 100.001% ( 1300, 1900 ] 3 0.001% 100.002% ( 2900, 4400 ] 4 0.001% 100.003% ** Level 1 read latency histogram (micros): Count: 85037 Average: 2.1455 StdDev: 8.05 Min: 0 Median: 1.4755 Max: 1381 Percentiles: P50: 1.48 P75: 1.86 P99: 5.41 P99.9: 11.45 P99.99: 262.90 ------------------------------------------------------ [ 0, 1 ] 16454 19.349% 19.349% #### ( 1, 2 ] 54814 64.459% 83.808% ############# ( 2, 3 ] 9000 10.584% 94.392% ## ( 3, 4 ] 2667 3.136% 97.528% # ( 4, 6 ] 1771 2.083% 99.611% ( 6, 10 ] 221 0.260% 99.871% ( 10, 15 ] 86 0.101% 99.972% ( 15, 22 ] 9 0.011% 99.982% ( 22, 34 ] 2 0.002% 99.985% ( 34, 51 ] 1 0.001% 99.986% ( 110, 170 ] 2 0.002% 99.988% ( 170, 250 ] 1 0.001% 99.989% ( 250, 380 ] 5 0.006% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31749 Average: 2.8193 StdDev: 31.20 Min: 1 Median: 1.6169 Max: 4417 Percentiles: P50: 1.62 P75: 2.00 P99: 7.12 P99.9: 14.29 P99.99: 1547.53 ------------------------------------------------------ [ 0, 1 ] 3048 9.600% 9.600% ## ( 1, 2 ] 20791 65.486% 75.086% ############# ( 2, 3 ] 4170 13.134% 88.220% ### ( 3, 4 ] 1911 6.019% 94.239% # ( 4, 6 ] 1423 4.482% 98.721% # ( 6, 10 ] 315 0.992% 99.713% ( 10, 15 ] 69 0.217% 99.931% ( 15, 22 ] 4 0.013% 99.943% ( 22, 34 ] 4 0.013% 99.956% ( 34, 51 ] 1 0.003% 99.959% ( 51, 76 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 2 0.006% 99.978% ( 580, 870 ] 2 0.006% 99.984% ( 870, 1300 ] 1 0.003% 99.987% ( 1300, 1900 ] 2 0.006% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 10752 Average: 10.2789 StdDev: 145.08 Min: 0 Median: 1.5738 Max: 5226 Percentiles: P50: 1.57 P75: 1.95 P99: 5.96 P99.9: 2941.33 P99.99: 5226.00 ------------------------------------------------------ [ 0, 1 ] 1312 12.202% 12.202% ## ( 1, 2 ] 7082 65.867% 78.069% ############# ( 2, 3 ] 1509 14.035% 92.104% ### ( 3, 4 ] 439 4.083% 96.187% # ( 4, 6 ] 309 2.874% 99.061% # ( 6, 10 ] 33 0.307% 99.368% ( 10, 15 ] 10 0.093% 99.461% ( 110, 170 ] 2 0.019% 99.479% ( 170, 250 ] 4 0.037% 99.516% ( 250, 380 ] 8 0.074% 99.591% ( 380, 580 ] 9 0.084% 99.674% ( 580, 870 ] 3 0.028% 99.702% ( 870, 1300 ] 6 0.056% 99.758% ( 1300, 1900 ] 7 0.065% 99.823% ( 1900, 2900 ] 8 0.074% 99.898% ( 2900, 4400 ] 9 0.084% 99.981% ( 4400, 6600 ] 2 0.019% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1655.4667 StdDev: 955.69 Min: 443 Median: 1525.0000 Max: 3802 Percentiles: P50: 1525.00 P75: 2316.67 P99: 3802.00 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ ( 380, 580 ] 1 6.667% 6.667% # ( 580, 870 ] 3 20.000% 26.667% #### ( 870, 1300 ] 2 13.333% 40.000% ### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 2900, 4400 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 612.0500 StdDev: 771.50 Min: 95 Median: 150.0000 Max: 2342 Percentiles: P50: 150.00 P75: 580.00 P99: 2342.00 P99.9: 2342.00 P99.99: 2342.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 6 30.000% 60.000% ###### ( 380, 580 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 328.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.625 H:M:S, 10.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.377 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/23-03:12:50 ... thread 0: (1000000,3000000) ops and (339274.6,343672.5) ops/second in (2.947465,8.729242) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 2.15 GB 12.6 1.6 0.0 1.6 4.3 2.7 0.0 1.6 117.2 315.5 13.97 12.98 45 0.310 1663K 1680 0.0 0.0 L1 1/1 3.31 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 245.5 245.2 2.57 2.49 2 1.283 639K 793 0.0 0.0 L2 2/0 51.51 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 42/0 969.86 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 191.0 190.8 3.27 2.84 2 1.633 633K 522 0.0 0.0 L4 144/0 9.44 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/12 98.84 GB 0.0 2.9 1.0 2.0 5.7 3.7 2.0 2.1 148.3 284.3 20.35 18.84 50 0.407 3064K 3035 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 1.0 2.0 5.7 3.7 1.9 2.1 148.3 284.3 20.35 18.84 50 0.407 3064K 3035 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 1.0 2.0 2.9 1.0 0.0 0.0 239.8 239.6 12.58 11.90 11 1.144 3064K 3035 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 356.6 7.77 6.94 39 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.7 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.65 GB write, 647.18 MB/s write, 2.95 GB read, 337.51 MB/s read, 20.4 seconds Interval compaction: 5.65 GB write, 662.73 MB/s write, 2.95 GB read, 345.62 MB/s read, 20.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 591247 Average: 2.0099 StdDev: 12.64 Min: 0 Median: 1.3644 Max: 3966 Percentiles: P50: 1.36 P75: 1.77 P99: 5.10 P99.9: 9.79 P99.99: 75.48 ------------------------------------------------------ [ 0, 1 ] 162256 27.443% 27.443% ##### ( 1, 2 ] 365993 61.902% 89.345% ############ ( 2, 3 ] 38397 6.494% 95.839% # ( 3, 4 ] 14373 2.431% 98.270% ( 4, 6 ] 7881 1.333% 99.603% ( 6, 10 ] 1853 0.313% 99.916% ( 10, 15 ] 364 0.062% 99.978% ( 15, 22 ] 49 0.008% 99.986% ( 22, 34 ] 9 0.002% 99.988% ( 34, 51 ] 7 0.001% 99.989% ( 51, 76 ] 6 0.001% 99.990% ( 110, 170 ] 23 0.004% 99.994% ( 170, 250 ] 13 0.002% 99.996% ( 250, 380 ] 14 0.002% 99.998% ( 380, 580 ] 5 0.001% 99.999% ( 580, 870 ] 16 0.003% 100.002% ( 870, 1300 ] 7 0.001% 100.003% ( 1300, 1900 ] 5 0.001% 100.004% ( 1900, 2900 ] 3 0.001% 100.005% ( 2900, 4400 ] 5 0.001% 100.005% ** Level 1 read latency histogram (micros): Count: 146062 Average: 2.1749 StdDev: 6.17 Min: 0 Median: 1.5198 Max: 1381 Percentiles: P50: 1.52 P75: 1.90 P99: 5.44 P99.9: 10.74 P99.99: 24.36 ------------------------------------------------------ [ 0, 1 ] 22542 15.433% 15.433% ### ( 1, 2 ] 97127 66.497% 81.930% ############# ( 2, 3 ] 17802 12.188% 94.118% ## ( 3, 4 ] 4826 3.304% 97.422% # ( 4, 6 ] 3196 2.188% 99.610% ( 6, 10 ] 402 0.275% 99.886% ( 10, 15 ] 141 0.097% 99.982% ( 15, 22 ] 11 0.008% 99.990% ( 22, 34 ] 2 0.001% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 110, 170 ] 2 0.001% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 5 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 2 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31749 Average: 2.8193 StdDev: 31.20 Min: 1 Median: 1.6169 Max: 4417 Percentiles: P50: 1.62 P75: 2.00 P99: 7.12 P99.9: 14.29 P99.99: 1547.53 ------------------------------------------------------ [ 0, 1 ] 3048 9.600% 9.600% ## ( 1, 2 ] 20791 65.486% 75.086% ############# ( 2, 3 ] 4170 13.134% 88.220% ### ( 3, 4 ] 1911 6.019% 94.239% # ( 4, 6 ] 1423 4.482% 98.721% # ( 6, 10 ] 315 0.992% 99.713% ( 10, 15 ] 69 0.217% 99.931% ( 15, 22 ] 4 0.013% 99.943% ( 22, 34 ] 4 0.013% 99.956% ( 34, 51 ] 1 0.003% 99.959% ( 51, 76 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 2 0.006% 99.978% ( 580, 870 ] 2 0.006% 99.984% ( 870, 1300 ] 1 0.003% 99.987% ( 1300, 1900 ] 2 0.006% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28935 Average: 5.3524 StdDev: 88.70 Min: 0 Median: 1.5723 Max: 5226 Percentiles: P50: 1.57 P75: 1.95 P99: 5.91 P99.9: 1089.66 P99.99: 4251.08 ------------------------------------------------------ [ 0, 1 ] 3421 11.823% 11.823% ## ( 1, 2 ] 19302 66.708% 78.531% ############# ( 2, 3 ] 4090 14.135% 92.666% ### ( 3, 4 ] 1094 3.781% 96.447% # ( 4, 6 ] 772 2.668% 99.115% # ( 6, 10 ] 104 0.359% 99.475% ( 10, 15 ] 26 0.090% 99.565% ( 15, 22 ] 6 0.021% 99.585% ( 22, 34 ] 20 0.069% 99.654% ( 34, 51 ] 29 0.100% 99.755% ( 51, 76 ] 5 0.017% 99.772% ( 110, 170 ] 6 0.021% 99.793% ( 170, 250 ] 6 0.021% 99.813% ( 250, 380 ] 8 0.028% 99.841% ( 380, 580 ] 10 0.035% 99.876% ( 580, 870 ] 4 0.014% 99.889% ( 870, 1300 ] 6 0.021% 99.910% ( 1300, 1900 ] 7 0.024% 99.934% ( 1900, 2900 ] 8 0.028% 99.962% ( 2900, 4400 ] 9 0.031% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1655.4667 StdDev: 955.69 Min: 443 Median: 1525.0000 Max: 3802 Percentiles: P50: 1525.00 P75: 2316.67 P99: 3802.00 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ ( 380, 580 ] 1 6.667% 6.667% # ( 580, 870 ] 3 20.000% 26.667% #### ( 870, 1300 ] 2 13.333% 40.000% ### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 2900, 4400 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 685.1250 StdDev: 846.42 Min: 78 Median: 268.5714 Max: 3452 Percentiles: P50: 268.57 P75: 1085.00 P99: 3452.00 P99.9: 3452.00 P99.99: 3452.00 ------------------------------------------------------ ( 76, 110 ] 9 22.500% 22.500% ##### ( 110, 170 ] 6 15.000% 37.500% ### ( 170, 250 ] 4 10.000% 47.500% ## ( 250, 380 ] 7 17.500% 65.000% #### ( 380, 580 ] 3 7.500% 72.500% ## ( 870, 1300 ] 2 5.000% 77.500% # ( 1300, 1900 ] 3 7.500% 85.000% ## ( 1900, 2900 ] 5 12.500% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 8.9 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 330.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.997 H:M:S, 11.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.372 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/23-03:12:54 ... thread 0: (1000000,4000000) ops and (257362.7,317087.6) ops/second in (3.885567,12.614809) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.26 GB 125.9 2.6 0.0 2.6 6.5 3.8 0.0 1.7 127.7 311.6 21.22 19.80 66 0.322 2750K 2762 0.0 0.0 L1 1/1 3.31 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 245.5 245.2 2.57 2.49 2 1.283 639K 793 0.0 0.0 L2 2/0 51.51 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 42/0 969.86 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 191.0 190.8 3.27 2.84 2 1.633 633K 522 0.0 0.0 L4 144/0 9.44 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/12 99.95 GB 0.0 4.0 1.0 3.0 7.8 4.8 2.0 2.0 148.1 289.5 27.60 25.66 71 0.389 4151K 4117 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 1.0 3.0 7.8 4.8 1.9 2.0 148.1 289.5 27.60 25.66 71 0.389 4151K 4117 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 1.0 3.0 4.0 1.0 0.0 0.0 245.6 245.3 16.65 15.89 15 1.110 4151K 4117 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 356.6 10.95 9.77 56 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.8 total, 12.6 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.80 GB write, 622.95 MB/s write, 3.99 GB read, 318.77 MB/s read, 27.6 seconds Interval compaction: 7.80 GB write, 633.31 MB/s write, 3.99 GB read, 324.07 MB/s read, 27.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 17, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1091080 Average: 2.1230 StdDev: 13.17 Min: 0 Median: 1.4341 Max: 5678 Percentiles: P50: 1.43 P75: 1.82 P99: 5.37 P99.9: 10.04 P99.99: 20.10 ------------------------------------------------------ [ 0, 1 ] 240137 22.009% 22.009% #### ( 1, 2 ] 703464 64.474% 86.483% ############# ( 2, 3 ] 93136 8.536% 95.019% ## ( 3, 4 ] 31391 2.877% 97.896% # ( 4, 6 ] 17641 1.617% 99.513% ( 6, 10 ] 4213 0.386% 99.899% ( 10, 15 ] 927 0.085% 99.984% ( 15, 22 ] 85 0.008% 99.992% ( 22, 34 ] 12 0.001% 99.993% ( 34, 51 ] 13 0.001% 99.994% ( 51, 76 ] 10 0.001% 99.995% ( 76, 110 ] 38 0.003% 99.999% ( 110, 170 ] 90 0.008% 100.007% ( 170, 250 ] 31 0.003% 100.010% ( 250, 380 ] 31 0.003% 100.013% ( 380, 580 ] 22 0.002% 100.015% ( 580, 870 ] 25 0.002% 100.017% ( 870, 1300 ] 13 0.001% 100.018% ( 1300, 1900 ] 7 0.001% 100.019% ( 1900, 2900 ] 8 0.001% 100.020% ( 2900, 4400 ] 6 0.001% 100.020% ( 4400, 6600 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 146062 Average: 2.1749 StdDev: 6.17 Min: 0 Median: 1.5198 Max: 1381 Percentiles: P50: 1.52 P75: 1.90 P99: 5.44 P99.9: 10.74 P99.99: 24.36 ------------------------------------------------------ [ 0, 1 ] 22542 15.433% 15.433% ### ( 1, 2 ] 97127 66.497% 81.930% ############# ( 2, 3 ] 17802 12.188% 94.118% ## ( 3, 4 ] 4826 3.304% 97.422% # ( 4, 6 ] 3196 2.188% 99.610% ( 6, 10 ] 402 0.275% 99.886% ( 10, 15 ] 141 0.097% 99.982% ( 15, 22 ] 11 0.008% 99.990% ( 22, 34 ] 2 0.001% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 110, 170 ] 2 0.001% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 5 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 2 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31749 Average: 2.8193 StdDev: 31.20 Min: 1 Median: 1.6169 Max: 4417 Percentiles: P50: 1.62 P75: 2.00 P99: 7.12 P99.9: 14.29 P99.99: 1547.53 ------------------------------------------------------ [ 0, 1 ] 3048 9.600% 9.600% ## ( 1, 2 ] 20791 65.486% 75.086% ############# ( 2, 3 ] 4170 13.134% 88.220% ### ( 3, 4 ] 1911 6.019% 94.239% # ( 4, 6 ] 1423 4.482% 98.721% # ( 6, 10 ] 315 0.992% 99.713% ( 10, 15 ] 69 0.217% 99.931% ( 15, 22 ] 4 0.013% 99.943% ( 22, 34 ] 4 0.013% 99.956% ( 34, 51 ] 1 0.003% 99.959% ( 51, 76 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 2 0.006% 99.978% ( 580, 870 ] 2 0.006% 99.984% ( 870, 1300 ] 1 0.003% 99.987% ( 1300, 1900 ] 2 0.006% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28935 Average: 5.3524 StdDev: 88.70 Min: 0 Median: 1.5723 Max: 5226 Percentiles: P50: 1.57 P75: 1.95 P99: 5.91 P99.9: 1089.66 P99.99: 4251.08 ------------------------------------------------------ [ 0, 1 ] 3421 11.823% 11.823% ## ( 1, 2 ] 19302 66.708% 78.531% ############# ( 2, 3 ] 4090 14.135% 92.666% ### ( 3, 4 ] 1094 3.781% 96.447% # ( 4, 6 ] 772 2.668% 99.115% # ( 6, 10 ] 104 0.359% 99.475% ( 10, 15 ] 26 0.090% 99.565% ( 15, 22 ] 6 0.021% 99.585% ( 22, 34 ] 20 0.069% 99.654% ( 34, 51 ] 29 0.100% 99.755% ( 51, 76 ] 5 0.017% 99.772% ( 110, 170 ] 6 0.021% 99.793% ( 170, 250 ] 6 0.021% 99.813% ( 250, 380 ] 8 0.028% 99.841% ( 380, 580 ] 10 0.035% 99.876% ( 580, 870 ] 4 0.014% 99.889% ( 870, 1300 ] 6 0.021% 99.910% ( 1300, 1900 ] 7 0.024% 99.934% ( 1900, 2900 ] 8 0.028% 99.962% ( 2900, 4400 ] 9 0.031% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1655.4667 StdDev: 955.69 Min: 443 Median: 1525.0000 Max: 3802 Percentiles: P50: 1525.00 P75: 2316.67 P99: 3802.00 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ ( 380, 580 ] 1 6.667% 6.667% # ( 580, 870 ] 3 20.000% 26.667% #### ( 870, 1300 ] 2 13.333% 40.000% ### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 2900, 4400 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 685.1250 StdDev: 846.42 Min: 78 Median: 268.5714 Max: 3452 Percentiles: P50: 268.57 P75: 1085.00 P99: 3452.00 P99.9: 3452.00 P99.99: 3452.00 ------------------------------------------------------ ( 76, 110 ] 9 22.500% 22.500% ##### ( 110, 170 ] 6 15.000% 37.500% ### ( 170, 250 ] 4 10.000% 47.500% ## ( 250, 380 ] 7 17.500% 65.000% #### ( 380, 580 ] 3 7.500% 72.500% ## ( 870, 1300 ] 2 5.000% 77.500% # ( 1300, 1900 ] 3 7.500% 85.000% ## ( 1900, 2900 ] 5 12.500% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.8 total, 3.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 306.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.210 H:M:S, 17.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.213 H:M:S, 31.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/07/23-03:13:00 ... thread 0: (1000000,5000000) ops and (158287.8,264097.3) ops/second in (6.317606,18.932415) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/6 2.09 GB 81.8 3.4 0.0 3.4 8.1 4.7 0.0 1.7 127.7 304.0 27.14 24.96 82 0.331 3518K 3463 0.0 0.0 L1 3/0 257.73 MB 25.8 2.6 2.5 0.2 2.6 2.4 0.1 1.1 233.0 231.2 11.63 11.28 3 3.877 2752K 20K 0.0 0.0 L2 5/5 437.85 MB 0.0 0.1 0.1 0.1 0.1 0.1 2.2 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 32/23 1.91 GB 1.0 1.2 1.0 0.2 1.2 1.0 1.0 1.2 185.2 184.8 6.72 5.65 6 1.120 1169K 692 0.0 0.0 L4 162/2 9.55 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.9 1.3 156.7 156.0 0.52 0.38 1 0.524 83K 368 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/36 100.79 GB 0.0 7.4 3.6 3.9 12.1 8.2 5.3 2.6 163.8 266.1 46.56 42.79 93 0.501 7650K 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.4 3.6 3.9 12.1 8.2 5.2 2.6 163.8 266.1 46.56 42.79 93 0.501 7650K 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.4 3.6 3.9 7.4 3.6 0.0 0.0 233.9 233.0 32.61 30.70 24 1.359 7650K 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 343.3 13.95 12.10 69 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.1 total, 18.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.10 GB write, 647.10 MB/s write, 7.45 GB read, 398.41 MB/s read, 46.6 seconds Interval compaction: 12.10 GB write, 654.27 MB/s write, 7.45 GB read, 402.82 MB/s read, 46.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 23, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1787794 Average: 2.2332 StdDev: 14.75 Min: 0 Median: 1.4772 Max: 6044 Percentiles: P50: 1.48 P75: 1.87 P99: 5.78 P99.9: 11.67 P99.99: 97.48 ------------------------------------------------------ [ 0, 1 ] 346301 19.370% 19.370% #### ( 1, 2 ] 1147572 64.189% 83.560% ############# ( 2, 3 ] 175087 9.793% 93.353% ## ( 3, 4 ] 63153 3.532% 96.885% # ( 4, 6 ] 42563 2.381% 99.266% ( 6, 10 ] 10727 0.600% 99.866% ( 10, 15 ] 1807 0.101% 99.967% ( 15, 22 ] 221 0.012% 99.980% ( 22, 34 ] 22 0.001% 99.981% ( 34, 51 ] 18 0.001% 99.982% ( 51, 76 ] 17 0.001% 99.983% ( 76, 110 ] 203 0.011% 99.994% ( 110, 170 ] 195 0.011% 100.005% ( 170, 250 ] 70 0.004% 100.009% ( 250, 380 ] 62 0.003% 100.013% ( 380, 580 ] 39 0.002% 100.015% ( 580, 870 ] 41 0.002% 100.017% ( 870, 1300 ] 17 0.001% 100.018% ( 1300, 1900 ] 8 0.000% 100.018% ( 1900, 2900 ] 8 0.000% 100.019% ( 2900, 4400 ] 14 0.001% 100.020% ( 4400, 6600 ] 3 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 355645 Average: 2.9573 StdDev: 26.23 Min: 0 Median: 1.7597 Max: 4847 Percentiles: P50: 1.76 P75: 2.60 P99: 7.06 P99.9: 12.64 P99.99: 17.65 ------------------------------------------------------ [ 0, 1 ] 24824 6.980% 6.980% # ( 1, 2 ] 201394 56.628% 63.608% ########### ( 2, 3 ] 67595 19.006% 82.614% #### ( 3, 4 ] 29097 8.181% 90.796% ## ( 4, 6 ] 28152 7.916% 98.711% ## ( 6, 10 ] 3899 1.096% 99.808% ( 10, 15 ] 628 0.177% 99.984% ( 15, 22 ] 62 0.017% 100.002% ( 22, 34 ] 16 0.004% 100.006% ( 34, 51 ] 5 0.001% 100.008% ( 51, 76 ] 1 0.000% 100.008% ( 76, 110 ] 36 0.010% 100.018% ( 110, 170 ] 53 0.015% 100.033% ( 170, 250 ] 14 0.004% 100.037% ( 250, 380 ] 19 0.005% 100.042% ( 380, 580 ] 23 0.006% 100.049% ( 580, 870 ] 14 0.004% 100.053% ( 870, 1300 ] 16 0.004% 100.057% ( 1300, 1900 ] 5 0.001% 100.058% ( 1900, 2900 ] 4 0.001% 100.060% ( 2900, 4400 ] 9 0.003% 100.062% ( 4400, 6600 ] 2 0.001% 100.063% ** Level 2 read latency histogram (micros): Count: 31831 Average: 4.3993 StdDev: 64.05 Min: 1 Median: 1.6188 Max: 4417 Percentiles: P50: 1.62 P75: 2.01 P99: 7.93 P99.9: 536.45 P99.99: 3745.07 ------------------------------------------------------ [ 0, 1 ] 3048 9.576% 9.576% ## ( 1, 2 ] 20794 65.326% 74.902% ############# ( 2, 3 ] 4181 13.135% 88.037% ### ( 3, 4 ] 1912 6.007% 94.044% # ( 4, 6 ] 1425 4.477% 98.520% # ( 6, 10 ] 316 0.993% 99.513% ( 10, 15 ] 69 0.217% 99.730% ( 15, 22 ] 4 0.013% 99.742% ( 22, 34 ] 4 0.013% 99.755% ( 34, 51 ] 1 0.003% 99.758% ( 51, 76 ] 1 0.003% 99.761% ( 76, 110 ] 2 0.006% 99.768% ( 110, 170 ] 8 0.025% 99.793% ( 170, 250 ] 11 0.035% 99.827% ( 250, 380 ] 13 0.041% 99.868% ( 380, 580 ] 13 0.041% 99.909% ( 580, 870 ] 10 0.031% 99.940% ( 870, 1300 ] 5 0.016% 99.956% ( 1300, 1900 ] 3 0.009% 99.965% ( 1900, 2900 ] 5 0.016% 99.981% ( 2900, 4400 ] 5 0.016% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 165355 Average: 9.5648 StdDev: 124.83 Min: 0 Median: 1.8706 Max: 15416 Percentiles: P50: 1.87 P75: 2.89 P99: 14.35 P99.9: 1061.02 P99.99: 2577.16 ------------------------------------------------------ [ 0, 1 ] 6386 3.862% 3.862% # ( 1, 2 ] 87631 52.996% 56.858% ########### ( 2, 3 ] 33694 20.377% 77.234% #### ( 3, 4 ] 16784 10.150% 87.385% ## ( 4, 6 ] 15466 9.353% 96.738% ## ( 6, 10 ] 3120 1.887% 98.625% ( 10, 15 ] 716 0.433% 99.058% ( 15, 22 ] 87 0.053% 99.110% ( 22, 34 ] 35 0.021% 99.132% ( 34, 51 ] 35 0.021% 99.153% ( 51, 76 ] 10 0.006% 99.159% ( 76, 110 ] 72 0.044% 99.202% ( 110, 170 ] 242 0.146% 99.349% ( 170, 250 ] 237 0.143% 99.492% ( 250, 380 ] 223 0.135% 99.627% ( 380, 580 ] 236 0.143% 99.770% ( 580, 870 ] 171 0.103% 99.873% ( 870, 1300 ] 105 0.063% 99.937% ( 1300, 1900 ] 39 0.024% 99.960% ( 1900, 2900 ] 76 0.046% 100.006% ( 2900, 4400 ] 67 0.041% 100.047% ( 4400, 6600 ] 16 0.010% 100.056% ( 6600, 9900 ] 5 0.003% 100.059% ( 14000, 22000 ] 1 0.001% 100.060% ** Level 4 read latency histogram (micros): Count: 30 Average: 896.0000 StdDev: 1040.52 Min: 1 Median: 652.5000 Max: 3802 Percentiles: P50: 652.50 P75: 1525.00 P99: 3802.00 P99.9: 3802.00 P99.99: 3802.00 ------------------------------------------------------ [ 0, 1 ] 3 10.000% 10.000% ## ( 1, 2 ] 5 16.667% 26.667% ### ( 2, 3 ] 1 3.333% 30.000% # ( 3, 4 ] 1 3.333% 33.333% # ( 4, 6 ] 1 3.333% 36.667% # ( 110, 170 ] 2 6.667% 43.333% # ( 380, 580 ] 1 3.333% 46.667% # ( 580, 870 ] 4 13.333% 60.000% ### ( 870, 1300 ] 3 10.000% 70.000% ## ( 1300, 1900 ] 4 13.333% 83.333% ### ( 1900, 2900 ] 3 10.000% 93.333% ## ( 2900, 4400 ] 2 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 887.5000 StdDev: 1038.00 Min: 78 Median: 380.0000 Max: 4320 Percentiles: P50: 380.00 P75: 1420.00 P99: 4220.00 P99.9: 4320.00 P99.99: 4320.00 ------------------------------------------------------ ( 76, 110 ] 9 15.000% 15.000% ### ( 110, 170 ] 6 10.000% 25.000% ## ( 170, 250 ] 8 13.333% 38.333% ### ( 250, 380 ] 7 11.667% 50.000% ## ( 380, 580 ] 5 8.333% 58.333% ## ( 580, 870 ] 7 11.667% 70.000% ## ( 870, 1300 ] 2 3.333% 73.333% # ( 1300, 1900 ] 5 8.333% 81.667% ## ( 1900, 2900 ] 6 10.000% 91.667% ## ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 19.1 total, 6.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 257.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.694 H:M:S, 29.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 155.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.484 H:M:S, 55.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/07/23-03:13:04 ... thread 0: (1000000,6000000) ops and (265311.5,264298.9) ops/second in (3.769154,22.701569) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 3.07 GB 31.5 5.0 0.0 5.0 10.6 5.6 0.0 1.9 136.1 290.4 37.49 34.03 97 0.386 5180K 11K 0.0 0.0 L1 3/3 257.73 MB 0.0 2.6 2.5 0.2 2.6 2.4 0.1 1.1 233.0 231.2 11.63 11.28 3 3.877 2752K 20K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.2 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 14/0 928.41 MB 0.9 2.5 1.4 1.0 2.5 1.4 1.0 1.7 175.2 175.0 14.47 11.17 11 1.316 2481K 1942 0.0 0.0 L4 170/0 9.69 GB 1.0 0.9 0.7 0.2 0.9 0.7 1.7 1.2 137.4 136.9 6.79 4.37 12 0.566 947K 3615 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/15 101.76 GB 0.0 11.1 4.7 6.5 16.8 10.3 7.3 3.0 160.8 242.0 70.93 61.37 124 0.572 11M 37K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.1 4.7 6.5 16.8 10.3 7.2 3.0 160.8 242.0 70.93 61.37 124 0.572 11M 37K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.1 4.7 6.5 11.1 4.6 0.0 0.0 213.2 212.5 53.49 46.63 42 1.274 11M 37K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 332.3 17.44 14.74 82 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.9 total, 22.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.76 GB write, 749.06 MB/s write, 11.14 GB read, 497.83 MB/s read, 70.9 seconds Interval compaction: 16.76 GB write, 755.99 MB/s write, 11.14 GB read, 502.43 MB/s read, 70.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 35, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2142551 Average: 2.3679 StdDev: 18.25 Min: 0 Median: 1.5070 Max: 6044 Percentiles: P50: 1.51 P75: 1.90 P99: 5.93 P99.9: 12.71 P99.99: 133.94 ------------------------------------------------------ [ 0, 1 ] 379258 17.701% 17.701% #### ( 1, 2 ] 1365019 63.710% 81.411% ############# ( 2, 3 ] 232139 10.835% 92.246% ## ( 3, 4 ] 85125 3.973% 96.219% # ( 4, 6 ] 61888 2.889% 99.108% # ( 6, 10 ] 15545 0.726% 99.833% ( 10, 15 ] 2652 0.124% 99.957% ( 15, 22 ] 308 0.014% 99.971% ( 22, 34 ] 27 0.001% 99.972% ( 34, 51 ] 23 0.001% 99.974% ( 51, 76 ] 18 0.001% 99.974% ( 76, 110 ] 232 0.011% 99.985% ( 110, 170 ] 260 0.012% 99.997% ( 170, 250 ] 115 0.005% 100.003% ( 250, 380 ] 93 0.004% 100.007% ( 380, 580 ] 98 0.005% 100.012% ( 580, 870 ] 87 0.004% 100.016% ( 870, 1300 ] 37 0.002% 100.017% ( 1300, 1900 ] 21 0.001% 100.018% ( 1900, 2900 ] 16 0.001% 100.019% ( 2900, 4400 ] 27 0.001% 100.020% ( 4400, 6600 ] 4 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 420815 Average: 3.2265 StdDev: 37.79 Min: 0 Median: 1.7886 Max: 8457 Percentiles: P50: 1.79 P75: 2.67 P99: 7.74 P99.9: 13.70 P99.99: 28.50 ------------------------------------------------------ [ 0, 1 ] 25689 6.105% 6.105% # ( 1, 2 ] 234234 55.662% 61.767% ########### ( 2, 3 ] 83380 19.814% 81.581% #### ( 3, 4 ] 35838 8.516% 90.097% ## ( 4, 6 ] 35118 8.345% 98.442% ## ( 6, 10 ] 5407 1.285% 99.727% ( 10, 15 ] 984 0.234% 99.961% ( 15, 22 ] 111 0.026% 99.987% ( 22, 34 ] 22 0.005% 99.992% ( 34, 51 ] 5 0.001% 99.994% ( 51, 76 ] 2 0.000% 99.994% ( 76, 110 ] 37 0.009% 100.003% ( 110, 170 ] 55 0.013% 100.016% ( 170, 250 ] 19 0.005% 100.020% ( 250, 380 ] 34 0.008% 100.029% ( 380, 580 ] 39 0.009% 100.038% ( 580, 870 ] 32 0.008% 100.045% ( 870, 1300 ] 28 0.007% 100.052% ( 1300, 1900 ] 8 0.002% 100.054% ( 1900, 2900 ] 11 0.003% 100.057% ( 2900, 4400 ] 14 0.003% 100.060% ( 4400, 6600 ] 5 0.001% 100.061% ( 6600, 9900 ] 2 0.000% 100.062% ** Level 2 read latency histogram (micros): Count: 60300 Average: 3.6789 StdDev: 47.76 Min: 1 Median: 1.5604 Max: 4417 Percentiles: P50: 1.56 P75: 1.94 P99: 8.56 P99.9: 318.50 P99.99: 2894.00 ------------------------------------------------------ [ 0, 1 ] 7745 12.844% 12.844% ### ( 1, 2 ] 39983 66.307% 79.151% ############# ( 2, 3 ] 6960 11.542% 90.693% ## ( 3, 4 ] 2736 4.537% 95.231% # ( 4, 6 ] 1789 2.967% 98.197% # ( 6, 10 ] 757 1.255% 99.453% ( 10, 15 ] 100 0.166% 99.619% ( 15, 22 ] 8 0.013% 99.632% ( 22, 34 ] 4 0.007% 99.638% ( 34, 51 ] 1 0.002% 99.640% ( 51, 76 ] 6 0.010% 99.650% ( 76, 110 ] 85 0.141% 99.791% ( 110, 170 ] 30 0.050% 99.841% ( 170, 250 ] 22 0.036% 99.877% ( 250, 380 ] 26 0.043% 99.920% ( 380, 580 ] 17 0.028% 99.949% ( 580, 870 ] 11 0.018% 99.967% ( 870, 1300 ] 5 0.008% 99.975% ( 1300, 1900 ] 4 0.007% 99.982% ( 1900, 2900 ] 5 0.008% 99.990% ( 2900, 4400 ] 5 0.008% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 447179 Average: 9.1812 StdDev: 120.63 Min: 0 Median: 1.9071 Max: 15416 Percentiles: P50: 1.91 P75: 2.94 P99: 10.91 P99.9: 736.23 P99.99: 1076.06 ------------------------------------------------------ [ 0, 1 ] 14610 3.267% 3.267% # ( 1, 2 ] 230378 51.518% 54.785% ########## ( 2, 3 ] 96361 21.549% 76.334% #### ( 3, 4 ] 46730 10.450% 86.784% ## ( 4, 6 ] 45357 10.143% 96.927% ## ( 6, 10 ] 8940 1.999% 98.926% ( 10, 15 ] 1816 0.406% 99.332% ( 15, 22 ] 187 0.042% 99.374% ( 22, 34 ] 45 0.010% 99.384% ( 34, 51 ] 37 0.008% 99.392% ( 51, 76 ] 15 0.003% 99.396% ( 76, 110 ] 125 0.028% 99.423% ( 110, 170 ] 387 0.087% 99.510% ( 170, 250 ] 411 0.092% 99.602% ( 250, 380 ] 484 0.108% 99.710% ( 380, 580 ] 573 0.128% 99.838% ( 580, 870 ] 512 0.114% 99.953% ( 870, 1300 ] 347 0.078% 100.030% ( 1300, 1900 ] 150 0.034% 100.064% ( 1900, 2900 ] 153 0.034% 100.098% ( 2900, 4400 ] 153 0.034% 100.132% ( 4400, 6600 ] 51 0.011% 100.144% ( 6600, 9900 ] 14 0.003% 100.147% ( 9900, 14000 ] 1 0.000% 100.147% ( 14000, 22000 ] 1 0.000% 100.147% ** Level 4 read latency histogram (micros): Count: 180 Average: 291.9222 StdDev: 715.95 Min: 1 Median: 2.2273 Max: 4242 Percentiles: P50: 2.23 P75: 144.29 P99: 3860.00 P99.9: 4242.00 P99.99: 4242.00 ------------------------------------------------------ [ 0, 1 ] 30 16.667% 16.667% ### ( 1, 2 ] 55 30.556% 47.222% ###### ( 2, 3 ] 22 12.222% 59.444% ## ( 3, 4 ] 3 1.667% 61.111% ( 4, 6 ] 4 2.222% 63.333% ( 6, 10 ] 1 0.556% 63.889% ( 10, 15 ] 3 1.667% 65.556% ( 15, 22 ] 1 0.556% 66.111% ( 22, 34 ] 2 1.111% 67.222% ( 76, 110 ] 2 1.111% 68.333% ( 110, 170 ] 21 11.667% 80.000% ## ( 250, 380 ] 3 1.667% 81.667% ( 380, 580 ] 4 2.222% 83.889% ( 580, 870 ] 9 5.000% 88.889% # ( 870, 1300 ] 8 4.444% 93.333% # ( 1300, 1900 ] 4 2.222% 95.556% ( 1900, 2900 ] 3 1.667% 97.222% ( 2900, 4400 ] 5 2.778% 100.000% # ** Level 5 read latency histogram (micros): Count: 140 Average: 1061.8286 StdDev: 1150.42 Min: 78 Median: 612.2222 Max: 4589 Percentiles: P50: 612.22 P75: 1566.67 P99: 4589.00 P99.9: 4589.00 P99.99: 4589.00 ------------------------------------------------------ ( 76, 110 ] 11 7.857% 7.857% ## ( 110, 170 ] 13 9.286% 17.143% ## ( 170, 250 ] 18 12.857% 30.000% ### ( 250, 380 ] 17 12.143% 42.143% ## ( 380, 580 ] 9 6.429% 48.571% # ( 580, 870 ] 18 12.857% 61.429% ### ( 870, 1300 ] 15 10.714% 72.143% ## ( 1300, 1900 ] 9 6.429% 78.571% # ( 1900, 2900 ] 13 9.286% 87.857% ## ( 2900, 4400 ] 15 10.714% 98.571% ## ( 4400, 6600 ] 2 1.429% 100.000% ** DB Stats ** Uptime(secs): 22.9 total, 3.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 257.72 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.763 H:M:S, 29.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 261.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.069 H:M:S, 28.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/23-03:13:07 ... thread 0: (1000000,7000000) ops and (281359.2,266608.3) ops/second in (3.554175,26.255744) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 4.11 GB 170.0 6.0 0.0 6.0 12.7 6.7 0.0 1.9 138.5 292.4 44.55 40.71 115 0.387 6267K 12K 0.0 0.0 L1 3/3 257.73 MB 0.0 2.6 2.5 0.2 2.6 2.4 0.1 1.1 233.0 231.2 11.63 11.28 3 3.877 2752K 20K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.2 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 14/0 928.41 MB 0.9 2.5 1.4 1.0 2.5 1.4 1.0 1.7 175.2 175.0 14.47 11.17 11 1.316 2481K 1942 0.0 0.0 L4 170/0 9.69 GB 1.0 0.9 0.7 0.2 0.9 0.7 1.7 1.2 137.4 136.9 6.79 4.37 12 0.566 947K 3615 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/11 102.80 GB 0.0 12.2 4.7 7.5 18.9 11.3 7.3 2.8 160.0 247.5 78.00 68.05 142 0.549 12M 38K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.2 4.7 7.5 18.9 11.3 7.2 2.8 160.0 247.5 78.00 68.05 142 0.549 12M 38K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.2 4.7 7.5 12.1 4.6 0.0 0.0 216.9 216.2 57.52 50.58 46 1.250 12M 38K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 335.3 20.48 17.47 96 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.5 total, 26.3 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.85 GB write, 729.36 MB/s write, 12.19 GB read, 471.44 MB/s read, 78.0 seconds Interval compaction: 18.85 GB write, 735.18 MB/s write, 12.19 GB read, 475.21 MB/s read, 78.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 38, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2552505 Average: 2.3503 StdDev: 17.24 Min: 0 Median: 1.5080 Max: 6044 Percentiles: P50: 1.51 P75: 1.90 P99: 5.93 P99.9: 12.50 P99.99: 128.54 ------------------------------------------------------ [ 0, 1 ] 441130 17.282% 17.282% ### ( 1, 2 ] 1644042 64.409% 81.691% ############# ( 2, 3 ] 278355 10.905% 92.596% ## ( 3, 4 ] 97331 3.813% 96.410% # ( 4, 6 ] 68593 2.687% 99.097% # ( 6, 10 ] 18981 0.744% 99.840% ( 10, 15 ] 3035 0.119% 99.959% ( 15, 22 ] 336 0.013% 99.972% ( 22, 34 ] 29 0.001% 99.974% ( 34, 51 ] 27 0.001% 99.975% ( 51, 76 ] 19 0.001% 99.975% ( 76, 110 ] 280 0.011% 99.986% ( 110, 170 ] 297 0.012% 99.998% ( 170, 250 ] 129 0.005% 100.003% ( 250, 380 ] 111 0.004% 100.007% ( 380, 580 ] 111 0.004% 100.012% ( 580, 870 ] 105 0.004% 100.016% ( 870, 1300 ] 43 0.002% 100.018% ( 1300, 1900 ] 22 0.001% 100.018% ( 1900, 2900 ] 17 0.001% 100.019% ( 2900, 4400 ] 28 0.001% 100.020% ( 4400, 6600 ] 4 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 420815 Average: 3.2265 StdDev: 37.79 Min: 0 Median: 1.7886 Max: 8457 Percentiles: P50: 1.79 P75: 2.67 P99: 7.74 P99.9: 13.70 P99.99: 28.50 ------------------------------------------------------ [ 0, 1 ] 25689 6.105% 6.105% # ( 1, 2 ] 234234 55.662% 61.767% ########### ( 2, 3 ] 83380 19.814% 81.581% #### ( 3, 4 ] 35838 8.516% 90.097% ## ( 4, 6 ] 35118 8.345% 98.442% ## ( 6, 10 ] 5407 1.285% 99.727% ( 10, 15 ] 984 0.234% 99.961% ( 15, 22 ] 111 0.026% 99.987% ( 22, 34 ] 22 0.005% 99.992% ( 34, 51 ] 5 0.001% 99.994% ( 51, 76 ] 2 0.000% 99.994% ( 76, 110 ] 37 0.009% 100.003% ( 110, 170 ] 55 0.013% 100.016% ( 170, 250 ] 19 0.005% 100.020% ( 250, 380 ] 34 0.008% 100.029% ( 380, 580 ] 39 0.009% 100.038% ( 580, 870 ] 32 0.008% 100.045% ( 870, 1300 ] 28 0.007% 100.052% ( 1300, 1900 ] 8 0.002% 100.054% ( 1900, 2900 ] 11 0.003% 100.057% ( 2900, 4400 ] 14 0.003% 100.060% ( 4400, 6600 ] 5 0.001% 100.061% ( 6600, 9900 ] 2 0.000% 100.062% ** Level 2 read latency histogram (micros): Count: 60300 Average: 3.6789 StdDev: 47.76 Min: 1 Median: 1.5604 Max: 4417 Percentiles: P50: 1.56 P75: 1.94 P99: 8.56 P99.9: 318.50 P99.99: 2894.00 ------------------------------------------------------ [ 0, 1 ] 7745 12.844% 12.844% ### ( 1, 2 ] 39983 66.307% 79.151% ############# ( 2, 3 ] 6960 11.542% 90.693% ## ( 3, 4 ] 2736 4.537% 95.231% # ( 4, 6 ] 1789 2.967% 98.197% # ( 6, 10 ] 757 1.255% 99.453% ( 10, 15 ] 100 0.166% 99.619% ( 15, 22 ] 8 0.013% 99.632% ( 22, 34 ] 4 0.007% 99.638% ( 34, 51 ] 1 0.002% 99.640% ( 51, 76 ] 6 0.010% 99.650% ( 76, 110 ] 85 0.141% 99.791% ( 110, 170 ] 30 0.050% 99.841% ( 170, 250 ] 22 0.036% 99.877% ( 250, 380 ] 26 0.043% 99.920% ( 380, 580 ] 17 0.028% 99.949% ( 580, 870 ] 11 0.018% 99.967% ( 870, 1300 ] 5 0.008% 99.975% ( 1300, 1900 ] 4 0.007% 99.982% ( 1900, 2900 ] 5 0.008% 99.990% ( 2900, 4400 ] 5 0.008% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 447179 Average: 9.1812 StdDev: 120.63 Min: 0 Median: 1.9071 Max: 15416 Percentiles: P50: 1.91 P75: 2.94 P99: 10.91 P99.9: 736.23 P99.99: 1076.06 ------------------------------------------------------ [ 0, 1 ] 14610 3.267% 3.267% # ( 1, 2 ] 230378 51.518% 54.785% ########## ( 2, 3 ] 96361 21.549% 76.334% #### ( 3, 4 ] 46730 10.450% 86.784% ## ( 4, 6 ] 45357 10.143% 96.927% ## ( 6, 10 ] 8940 1.999% 98.926% ( 10, 15 ] 1816 0.406% 99.332% ( 15, 22 ] 187 0.042% 99.374% ( 22, 34 ] 45 0.010% 99.384% ( 34, 51 ] 37 0.008% 99.392% ( 51, 76 ] 15 0.003% 99.396% ( 76, 110 ] 125 0.028% 99.423% ( 110, 170 ] 387 0.087% 99.510% ( 170, 250 ] 411 0.092% 99.602% ( 250, 380 ] 484 0.108% 99.710% ( 380, 580 ] 573 0.128% 99.838% ( 580, 870 ] 512 0.114% 99.953% ( 870, 1300 ] 347 0.078% 100.030% ( 1300, 1900 ] 150 0.034% 100.064% ( 1900, 2900 ] 153 0.034% 100.098% ( 2900, 4400 ] 153 0.034% 100.132% ( 4400, 6600 ] 51 0.011% 100.144% ( 6600, 9900 ] 14 0.003% 100.147% ( 9900, 14000 ] 1 0.000% 100.147% ( 14000, 22000 ] 1 0.000% 100.147% ** Level 4 read latency histogram (micros): Count: 180 Average: 291.9222 StdDev: 715.95 Min: 1 Median: 2.2273 Max: 4242 Percentiles: P50: 2.23 P75: 144.29 P99: 3860.00 P99.9: 4242.00 P99.99: 4242.00 ------------------------------------------------------ [ 0, 1 ] 30 16.667% 16.667% ### ( 1, 2 ] 55 30.556% 47.222% ###### ( 2, 3 ] 22 12.222% 59.444% ## ( 3, 4 ] 3 1.667% 61.111% ( 4, 6 ] 4 2.222% 63.333% ( 6, 10 ] 1 0.556% 63.889% ( 10, 15 ] 3 1.667% 65.556% ( 15, 22 ] 1 0.556% 66.111% ( 22, 34 ] 2 1.111% 67.222% ( 76, 110 ] 2 1.111% 68.333% ( 110, 170 ] 21 11.667% 80.000% ## ( 250, 380 ] 3 1.667% 81.667% ( 380, 580 ] 4 2.222% 83.889% ( 580, 870 ] 9 5.000% 88.889% # ( 870, 1300 ] 8 4.444% 93.333% # ( 1300, 1900 ] 4 2.222% 95.556% ( 1900, 2900 ] 3 1.667% 97.222% ( 2900, 4400 ] 5 2.778% 100.000% # ** Level 5 read latency histogram (micros): Count: 140 Average: 1061.8286 StdDev: 1150.42 Min: 78 Median: 612.2222 Max: 4589 Percentiles: P50: 612.22 P75: 1566.67 P99: 4589.00 P99.9: 4589.00 P99.99: 4589.00 ------------------------------------------------------ ( 76, 110 ] 11 7.857% 7.857% ## ( 110, 170 ] 13 9.286% 17.143% ## ( 170, 250 ] 18 12.857% 30.000% ### ( 250, 380 ] 17 12.143% 42.143% ## ( 380, 580 ] 9 6.429% 48.571% # ( 580, 870 ] 18 12.857% 61.429% ### ( 870, 1300 ] 15 10.714% 72.143% ## ( 1300, 1900 ] 9 6.429% 78.571% # ( 1900, 2900 ] 13 9.286% 87.857% ## ( 2900, 4400 ] 15 10.714% 98.571% ## ( 4400, 6600 ] 2 1.429% 100.000% ** DB Stats ** Uptime(secs): 26.5 total, 3.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 260.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.759 H:M:S, 29.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 276.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.996 H:M:S, 28.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/07/23-03:13:17 ... thread 0: (1000000,8000000) ops and (98677.1,219841.8) ops/second in (10.134060,36.389804) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 2.57 GB 12.6 8.2 0.0 8.2 15.8 7.6 0.0 2.1 140.9 271.9 59.45 51.80 132 0.450 8505K 21K 0.0 0.0 L1 7/7 678.79 MB 0.0 5.3 4.9 0.4 5.3 4.9 0.1 1.1 227.1 225.1 24.12 23.07 4 6.031 5562K 48K 0.0 0.0 L2 3/2 386.34 MB 1.3 0.1 0.1 0.1 0.1 0.1 4.3 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 33/13 1.81 GB 1.3 4.2 2.3 1.9 4.2 2.3 1.7 1.8 150.9 150.3 28.38 19.32 18 1.577 4257K 15K 0.0 0.0 L4 173/7 9.72 GB 1.0 1.8 1.4 0.3 1.7 1.4 1.7 1.2 136.1 135.5 13.19 8.46 23 0.573 1813K 7698 0.0 0.0 L5 1076/0 88.52 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1300/36 103.67 GB 0.0 19.6 8.7 10.9 27.1 16.3 10.8 3.6 159.6 221.0 125.69 103.18 178 0.706 20M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.6 8.7 10.9 27.1 16.3 10.7 3.6 159.6 221.0 125.69 103.18 178 0.706 20M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.6 8.7 10.9 19.5 8.6 0.0 0.0 199.2 198.3 100.69 83.13 69 1.459 20M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 312.4 25.00 20.06 109 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.6 total, 36.4 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.12 GB write, 758.85 MB/s write, 19.59 GB read, 548.04 MB/s read, 125.7 seconds Interval compaction: 27.12 GB write, 763.22 MB/s write, 19.59 GB read, 551.20 MB/s read, 125.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 57, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 57, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3454548 Average: 2.6900 StdDev: 27.20 Min: 0 Median: 1.5221 Max: 10245 Percentiles: P50: 1.52 P75: 1.91 P99: 6.83 P99.9: 98.51 P99.99: 367.20 ------------------------------------------------------ [ 0, 1 ] 566445 16.397% 16.397% ### ( 1, 2 ] 2223466 64.363% 80.761% ############# ( 2, 3 ] 386561 11.190% 91.950% ## ( 3, 4 ] 137698 3.986% 95.936% # ( 4, 6 ] 99426 2.878% 98.815% # ( 6, 10 ] 31012 0.898% 99.712% ( 10, 15 ] 4769 0.138% 99.850% ( 15, 22 ] 548 0.016% 99.866% ( 22, 34 ] 36 0.001% 99.867% ( 34, 51 ] 29 0.001% 99.868% ( 51, 76 ] 44 0.001% 99.869% ( 76, 110 ] 1602 0.046% 99.916% ( 110, 170 ] 1801 0.052% 99.968% ( 170, 250 ] 451 0.013% 99.981% ( 250, 380 ] 350 0.010% 99.991% ( 380, 580 ] 374 0.011% 100.002% ( 580, 870 ] 263 0.008% 100.009% ( 870, 1300 ] 142 0.004% 100.014% ( 1300, 1900 ] 69 0.002% 100.016% ( 1900, 2900 ] 68 0.002% 100.018% ( 2900, 4400 ] 70 0.002% 100.020% ( 4400, 6600 ] 15 0.000% 100.020% ( 6600, 9900 ] 2 0.000% 100.020% ( 9900, 14000 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 923035 Average: 4.9441 StdDev: 76.17 Min: 0 Median: 1.8646 Max: 8457 Percentiles: P50: 1.86 P75: 2.84 P99: 9.23 P99.9: 19.79 P99.99: 189.09 ------------------------------------------------------ [ 0, 1 ] 40182 4.353% 4.353% # ( 1, 2 ] 487313 52.795% 57.148% ########### ( 2, 3 ] 196893 21.331% 78.479% #### ( 3, 4 ] 85612 9.275% 87.754% ## ( 4, 6 ] 88721 9.612% 97.366% ## ( 6, 10 ] 18666 2.022% 99.388% ( 10, 15 ] 4397 0.476% 99.864% ( 15, 22 ] 479 0.052% 99.916% ( 22, 34 ] 45 0.005% 99.921% ( 34, 51 ] 11 0.001% 99.922% ( 51, 76 ] 13 0.001% 99.924% ( 76, 110 ] 243 0.026% 99.950% ( 110, 170 ] 335 0.036% 99.986% ( 170, 250 ] 137 0.015% 100.001% ( 250, 380 ] 217 0.024% 100.025% ( 380, 580 ] 237 0.026% 100.050% ( 580, 870 ] 212 0.023% 100.073% ( 870, 1300 ] 153 0.017% 100.090% ( 1300, 1900 ] 78 0.008% 100.098% ( 1900, 2900 ] 131 0.014% 100.113% ( 2900, 4400 ] 175 0.019% 100.132% ( 4400, 6600 ] 42 0.005% 100.136% ( 6600, 9900 ] 11 0.001% 100.137% ** Level 2 read latency histogram (micros): Count: 60300 Average: 3.6789 StdDev: 47.76 Min: 1 Median: 1.5604 Max: 4417 Percentiles: P50: 1.56 P75: 1.94 P99: 8.56 P99.9: 318.50 P99.99: 2894.00 ------------------------------------------------------ [ 0, 1 ] 7745 12.844% 12.844% ### ( 1, 2 ] 39983 66.307% 79.151% ############# ( 2, 3 ] 6960 11.542% 90.693% ## ( 3, 4 ] 2736 4.537% 95.231% # ( 4, 6 ] 1789 2.967% 98.197% # ( 6, 10 ] 757 1.255% 99.453% ( 10, 15 ] 100 0.166% 99.619% ( 15, 22 ] 8 0.013% 99.632% ( 22, 34 ] 4 0.007% 99.638% ( 34, 51 ] 1 0.002% 99.640% ( 51, 76 ] 6 0.010% 99.650% ( 76, 110 ] 85 0.141% 99.791% ( 110, 170 ] 30 0.050% 99.841% ( 170, 250 ] 22 0.036% 99.877% ( 250, 380 ] 26 0.043% 99.920% ( 380, 580 ] 17 0.028% 99.949% ( 580, 870 ] 11 0.018% 99.967% ( 870, 1300 ] 5 0.008% 99.975% ( 1300, 1900 ] 4 0.007% 99.982% ( 1900, 2900 ] 5 0.008% 99.990% ( 2900, 4400 ] 5 0.008% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 747034 Average: 8.3769 StdDev: 109.62 Min: 0 Median: 1.9638 Max: 15416 Percentiles: P50: 1.96 P75: 3.02 P99: 9.86 P99.9: 546.46 P99.99: 779.16 ------------------------------------------------------ [ 0, 1 ] 17892 2.395% 2.395% ( 1, 2 ] 368994 49.395% 51.790% ########## ( 2, 3 ] 171531 22.962% 74.751% ##### ( 3, 4 ] 83117 11.126% 85.877% ## ( 4, 6 ] 83162 11.132% 97.010% ## ( 6, 10 ] 15394 2.061% 99.070% ( 10, 15 ] 3346 0.448% 99.518% ( 15, 22 ] 366 0.049% 99.567% ( 22, 34 ] 59 0.008% 99.575% ( 34, 51 ] 45 0.006% 99.581% ( 51, 76 ] 21 0.003% 99.584% ( 76, 110 ] 129 0.017% 99.601% ( 110, 170 ] 420 0.056% 99.658% ( 170, 250 ] 487 0.065% 99.723% ( 250, 380 ] 639 0.086% 99.808% ( 380, 580 ] 823 0.110% 99.918% ( 580, 870 ] 778 0.104% 100.023% ( 870, 1300 ] 536 0.072% 100.094% ( 1300, 1900 ] 248 0.033% 100.128% ( 1900, 2900 ] 211 0.028% 100.156% ( 2900, 4400 ] 229 0.031% 100.186% ( 4400, 6600 ] 68 0.009% 100.196% ( 6600, 9900 ] 16 0.002% 100.198% ( 9900, 14000 ] 1 0.000% 100.198% ( 14000, 22000 ] 1 0.000% 100.198% ** Level 4 read latency histogram (micros): Count: 20742 Average: 29.5442 StdDev: 253.43 Min: 1 Median: 2.1116 Max: 7484 Percentiles: P50: 2.11 P75: 3.33 P99: 799.06 P99.9: 4087.79 P99.99: 6583.68 ------------------------------------------------------ [ 0, 1 ] 288 1.388% 1.388% ( 1, 2 ] 9526 45.926% 47.315% ######### ( 2, 3 ] 4990 24.057% 71.372% ##### ( 3, 4 ] 2286 11.021% 82.393% ## ( 4, 6 ] 2408 11.609% 94.003% ## ( 6, 10 ] 525 2.531% 96.534% # ( 10, 15 ] 204 0.984% 97.517% ( 15, 22 ] 22 0.106% 97.623% ( 22, 34 ] 8 0.039% 97.662% ( 51, 76 ] 4 0.019% 97.681% ( 76, 110 ] 5 0.024% 97.705% ( 110, 170 ] 34 0.164% 97.869% ( 170, 250 ] 28 0.135% 98.004% ( 250, 380 ] 48 0.231% 98.235% ( 380, 580 ] 77 0.371% 98.607% ( 580, 870 ] 108 0.521% 99.127% ( 870, 1300 ] 62 0.299% 99.426% ( 1300, 1900 ] 42 0.202% 99.629% ( 1900, 2900 ] 23 0.111% 99.740% ( 2900, 4400 ] 42 0.202% 99.942% ( 4400, 6600 ] 10 0.048% 99.990% ( 6600, 9900 ] 3 0.014% 100.005% ** Level 5 read latency histogram (micros): Count: 180 Average: 1144.7722 StdDev: 1191.01 Min: 78 Median: 680.8696 Max: 4589 Percentiles: P50: 680.87 P75: 1790.91 P99: 4589.00 P99.9: 4589.00 P99.99: 4589.00 ------------------------------------------------------ ( 76, 110 ] 13 7.222% 7.222% # ( 110, 170 ] 15 8.333% 15.556% ## ( 170, 250 ] 21 11.667% 27.222% ## ( 250, 380 ] 18 10.000% 37.222% ## ( 380, 580 ] 15 8.333% 45.556% ## ( 580, 870 ] 23 12.778% 58.333% ### ( 870, 1300 ] 21 11.667% 70.000% ## ( 1300, 1900 ] 11 6.111% 76.111% # ( 1900, 2900 ] 19 10.556% 86.667% ## ( 2900, 4400 ] 22 12.222% 98.889% ## ( 4400, 6600 ] 2 1.111% 100.000% ** DB Stats ** Uptime(secs): 36.6 total, 10.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 215.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.023 H:M:S, 41.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 97.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.264 H:M:S, 71.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/23-03:13:21 ... thread 0: (1000000,9000000) ops and (262311.9,223869.1) ops/second in (3.812255,40.202059) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 3.50 GB 81.8 8.9 0.0 8.9 17.4 8.5 0.0 2.0 138.2 271.2 65.64 56.96 146 0.450 9208K 22K 0.0 0.0 L1 7/7 678.79 MB 0.0 5.3 4.9 0.4 5.3 4.9 0.1 1.1 227.1 225.1 24.12 23.07 4 6.031 5562K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 4.3 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 14/0 989.40 MB 1.0 4.8 2.7 2.1 4.8 2.7 1.7 1.8 152.0 151.4 32.47 22.30 21 1.546 4920K 20K 0.0 0.0 L4 176/0 9.64 GB 1.0 3.4 2.7 0.7 3.4 2.6 1.7 1.3 146.3 145.5 23.64 16.18 42 0.563 3478K 18K 0.0 0.0 L5 1092/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1303/18 104.58 GB 0.0 22.5 10.3 12.2 31.0 18.8 12.1 3.6 157.6 216.6 146.42 119.03 214 0.684 23M 109K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.5 10.3 12.2 31.0 18.8 12.0 3.6 157.6 216.6 146.42 119.03 214 0.684 23M 109K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.5 10.3 12.2 22.4 10.2 0.0 0.0 195.5 194.5 118.02 96.50 93 1.269 23M 109K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 308.3 28.41 22.53 121 0.235 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.4 total, 40.2 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.97 GB write, 784.72 MB/s write, 22.53 GB read, 570.86 MB/s read, 146.4 seconds Interval compaction: 30.97 GB write, 788.82 MB/s write, 22.53 GB read, 573.84 MB/s read, 146.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 68, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3854242 Average: 2.7442 StdDev: 29.09 Min: 0 Median: 1.5416 Max: 10245 Percentiles: P50: 1.54 P75: 1.93 P99: 7.02 P99.9: 91.36 P99.99: 325.33 ------------------------------------------------------ [ 0, 1 ] 592227 15.366% 15.366% ### ( 1, 2 ] 2464817 63.951% 79.316% ############# ( 2, 3 ] 461428 11.972% 91.288% ## ( 3, 4 ] 163229 4.235% 95.523% # ( 4, 6 ] 124661 3.234% 98.758% # ( 6, 10 ] 36629 0.950% 99.708% ( 10, 15 ] 5882 0.153% 99.861% ( 15, 22 ] 650 0.017% 99.878% ( 22, 34 ] 41 0.001% 99.879% ( 34, 51 ] 36 0.001% 99.880% ( 51, 76 ] 47 0.001% 99.881% ( 76, 110 ] 1644 0.043% 99.923% ( 110, 170 ] 1853 0.048% 99.972% ( 170, 250 ] 488 0.013% 99.984% ( 250, 380 ] 391 0.010% 99.994% ( 380, 580 ] 404 0.010% 100.005% ( 580, 870 ] 282 0.007% 100.012% ( 870, 1300 ] 157 0.004% 100.016% ( 1300, 1900 ] 77 0.002% 100.018% ( 1900, 2900 ] 86 0.002% 100.020% ( 2900, 4400 ] 96 0.002% 100.023% ( 4400, 6600 ] 18 0.000% 100.023% ( 6600, 9900 ] 4 0.000% 100.023% ( 9900, 14000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1007409 Average: 5.0858 StdDev: 78.81 Min: 0 Median: 1.8710 Max: 8457 Percentiles: P50: 1.87 P75: 2.85 P99: 9.30 P99.9: 21.93 P99.99: 273.53 ------------------------------------------------------ [ 0, 1 ] 41478 4.117% 4.117% # ( 1, 2 ] 530699 52.680% 56.797% ########### ( 2, 3 ] 216898 21.530% 78.327% #### ( 3, 4 ] 93907 9.322% 87.649% ## ( 4, 6 ] 97278 9.656% 97.305% ## ( 6, 10 ] 20694 2.054% 99.359% ( 10, 15 ] 4926 0.489% 99.848% ( 15, 22 ] 527 0.052% 99.901% ( 22, 34 ] 46 0.005% 99.905% ( 34, 51 ] 11 0.001% 99.906% ( 51, 76 ] 13 0.001% 99.907% ( 76, 110 ] 272 0.027% 99.934% ( 110, 170 ] 358 0.036% 99.970% ( 170, 250 ] 158 0.016% 99.986% ( 250, 380 ] 239 0.024% 100.009% ( 380, 580 ] 270 0.027% 100.036% ( 580, 870 ] 234 0.023% 100.059% ( 870, 1300 ] 186 0.018% 100.078% ( 1300, 1900 ] 91 0.009% 100.087% ( 1900, 2900 ] 158 0.016% 100.103% ( 2900, 4400 ] 201 0.020% 100.123% ( 4400, 6600 ] 48 0.005% 100.127% ( 6600, 9900 ] 12 0.001% 100.129% ** Level 2 read latency histogram (micros): Count: 60300 Average: 3.6789 StdDev: 47.76 Min: 1 Median: 1.5604 Max: 4417 Percentiles: P50: 1.56 P75: 1.94 P99: 8.56 P99.9: 318.50 P99.99: 2894.00 ------------------------------------------------------ [ 0, 1 ] 7745 12.844% 12.844% ### ( 1, 2 ] 39983 66.307% 79.151% ############# ( 2, 3 ] 6960 11.542% 90.693% ## ( 3, 4 ] 2736 4.537% 95.231% # ( 4, 6 ] 1789 2.967% 98.197% # ( 6, 10 ] 757 1.255% 99.453% ( 10, 15 ] 100 0.166% 99.619% ( 15, 22 ] 8 0.013% 99.632% ( 22, 34 ] 4 0.007% 99.638% ( 34, 51 ] 1 0.002% 99.640% ( 51, 76 ] 6 0.010% 99.650% ( 76, 110 ] 85 0.141% 99.791% ( 110, 170 ] 30 0.050% 99.841% ( 170, 250 ] 22 0.036% 99.877% ( 250, 380 ] 26 0.043% 99.920% ( 380, 580 ] 17 0.028% 99.949% ( 580, 870 ] 11 0.018% 99.967% ( 870, 1300 ] 5 0.008% 99.975% ( 1300, 1900 ] 4 0.007% 99.982% ( 1900, 2900 ] 5 0.008% 99.990% ( 2900, 4400 ] 5 0.008% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1087698 Average: 7.4310 StdDev: 100.17 Min: 0 Median: 1.9580 Max: 15416 Percentiles: P50: 1.96 P75: 2.99 P99: 9.56 P99.9: 442.79 P99.99: 676.11 ------------------------------------------------------ [ 0, 1 ] 22681 2.085% 2.085% ( 1, 2 ] 544005 50.014% 52.100% ########## ( 2, 3 ] 252602 23.224% 75.323% ##### ( 3, 4 ] 119258 10.964% 86.287% ## ( 4, 6 ] 119651 11.000% 97.288% ## ( 6, 10 ] 20917 1.923% 99.211% ( 10, 15 ] 4522 0.416% 99.627% ( 15, 22 ] 496 0.046% 99.672% ( 22, 34 ] 67 0.006% 99.678% ( 34, 51 ] 46 0.004% 99.683% ( 51, 76 ] 26 0.002% 99.685% ( 76, 110 ] 158 0.015% 99.699% ( 110, 170 ] 500 0.046% 99.745% ( 170, 250 ] 609 0.056% 99.801% ( 250, 380 ] 764 0.070% 99.872% ( 380, 580 ] 982 0.090% 99.962% ( 580, 870 ] 921 0.085% 100.047% ( 870, 1300 ] 639 0.059% 100.105% ( 1300, 1900 ] 295 0.027% 100.132% ( 1900, 2900 ] 257 0.024% 100.156% ( 2900, 4400 ] 274 0.025% 100.181% ( 4400, 6600 ] 89 0.008% 100.189% ( 6600, 9900 ] 19 0.002% 100.191% ( 9900, 14000 ] 1 0.000% 100.191% ( 14000, 22000 ] 1 0.000% 100.191% ** Level 4 read latency histogram (micros): Count: 85170 Average: 11.6607 StdDev: 151.33 Min: 1 Median: 1.9686 Max: 7594 Percentiles: P50: 1.97 P75: 3.03 P99: 13.43 P99.9: 2158.68 P99.99: 4153.87 ------------------------------------------------------ [ 0, 1 ] 1427 1.675% 1.675% ( 1, 2 ] 42491 49.890% 51.565% ########## ( 2, 3 ] 19727 23.162% 74.727% ##### ( 3, 4 ] 9222 10.828% 85.555% ## ( 4, 6 ] 9326 10.950% 96.505% ## ( 6, 10 ] 1773 2.082% 98.586% ( 10, 15 ] 513 0.602% 99.189% ( 15, 22 ] 50 0.059% 99.247% ( 22, 34 ] 15 0.018% 99.265% ( 34, 51 ] 4 0.005% 99.270% ( 51, 76 ] 12 0.014% 99.284% ( 76, 110 ] 7 0.008% 99.292% ( 110, 170 ] 46 0.054% 99.346% ( 170, 250 ] 60 0.070% 99.416% ( 250, 380 ] 70 0.082% 99.499% ( 380, 580 ] 90 0.106% 99.604% ( 580, 870 ] 125 0.147% 99.751% ( 870, 1300 ] 69 0.081% 99.832% ( 1300, 1900 ] 48 0.056% 99.888% ( 1900, 2900 ] 38 0.045% 99.933% ( 2900, 4400 ] 58 0.068% 100.001% ( 4400, 6600 ] 16 0.019% 100.020% ( 6600, 9900 ] 5 0.006% 100.026% ** Level 5 read latency histogram (micros): Count: 260 Average: 1253.8885 StdDev: 1392.59 Min: 78 Median: 712.5714 Max: 9805 Percentiles: P50: 712.57 P75: 1900.00 P99: 6013.33 P99.9: 9042.00 P99.99: 9805.00 ------------------------------------------------------ ( 76, 110 ] 16 6.154% 6.154% # ( 110, 170 ] 24 9.231% 15.385% ## ( 170, 250 ] 24 9.231% 24.615% ## ( 250, 380 ] 32 12.308% 36.923% ## ( 380, 580 ] 18 6.923% 43.846% # ( 580, 870 ] 35 13.462% 57.308% ### ( 870, 1300 ] 26 10.000% 67.308% ## ( 1300, 1900 ] 20 7.692% 75.000% ## ( 1900, 2900 ] 30 11.538% 86.538% ## ( 2900, 4400 ] 28 10.769% 97.308% ## ( 4400, 6600 ] 6 2.308% 99.615% ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 40.4 total, 3.8 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 219.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.880 H:M:S, 39.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 258.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.857 H:M:S, 22.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/23-03:13:24 ... thread 0: (1000000,10000000) ops and (315114.0,230544.8) ops/second in (3.173455,43.375514) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 4.48 GB 176.2 9.6 0.0 9.6 19.1 9.5 0.0 2.0 137.6 274.1 71.40 62.36 163 0.438 9976K 22K 0.0 0.0 L1 7/7 678.79 MB 0.0 5.3 4.9 0.4 5.3 4.9 0.1 1.1 227.1 225.1 24.12 23.07 4 6.031 5562K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 4.3 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 14/0 989.40 MB 1.0 4.8 2.7 2.1 4.8 2.7 1.7 1.8 152.0 151.4 32.47 22.30 21 1.546 4920K 20K 0.0 0.0 L4 176/0 9.64 GB 1.0 3.4 2.7 0.7 3.4 2.6 1.7 1.3 146.3 145.5 23.64 16.18 42 0.563 3478K 18K 0.0 0.0 L5 1092/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1308/18 105.56 GB 0.0 23.3 10.3 13.0 32.7 19.7 12.1 3.4 156.6 220.0 152.18 124.43 231 0.659 24M 110K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.3 10.3 13.0 32.7 19.7 12.0 3.4 156.6 220.0 152.18 124.43 231 0.659 24M 110K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.3 10.3 13.0 23.2 10.2 0.0 0.0 197.1 196.1 120.89 99.30 96 1.259 24M 110K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 312.0 31.29 25.13 135 0.232 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.6 total, 43.4 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.69 GB write, 768.04 MB/s write, 23.27 GB read, 546.64 MB/s read, 152.2 seconds Interval compaction: 32.69 GB write, 771.75 MB/s write, 23.27 GB read, 549.29 MB/s read, 152.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 71, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 71, interval: 94 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4219733 Average: 2.6994 StdDev: 27.99 Min: 0 Median: 1.5390 Max: 10245 Percentiles: P50: 1.54 P75: 1.93 P99: 6.94 P99.9: 83.63 P99.99: 296.30 ------------------------------------------------------ [ 0, 1 ] 647036 15.334% 15.334% ### ( 1, 2 ] 2714006 64.317% 79.651% ############# ( 2, 3 ] 502529 11.909% 91.560% ## ( 3, 4 ] 174175 4.128% 95.687% # ( 4, 6 ] 130468 3.092% 98.779% # ( 6, 10 ] 39883 0.945% 99.724% ( 10, 15 ] 6243 0.148% 99.872% ( 15, 22 ] 675 0.016% 99.888% ( 22, 34 ] 44 0.001% 99.889% ( 34, 51 ] 38 0.001% 99.890% ( 51, 76 ] 49 0.001% 99.891% ( 76, 110 ] 1645 0.039% 99.930% ( 110, 170 ] 1878 0.045% 99.975% ( 170, 250 ] 503 0.012% 99.987% ( 250, 380 ] 396 0.009% 99.996% ( 380, 580 ] 410 0.010% 100.006% ( 580, 870 ] 287 0.007% 100.013% ( 870, 1300 ] 160 0.004% 100.016% ( 1300, 1900 ] 81 0.002% 100.018% ( 1900, 2900 ] 88 0.002% 100.020% ( 2900, 4400 ] 97 0.002% 100.023% ( 4400, 6600 ] 18 0.000% 100.023% ( 6600, 9900 ] 4 0.000% 100.023% ( 9900, 14000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1007409 Average: 5.0858 StdDev: 78.81 Min: 0 Median: 1.8710 Max: 8457 Percentiles: P50: 1.87 P75: 2.85 P99: 9.30 P99.9: 21.93 P99.99: 273.53 ------------------------------------------------------ [ 0, 1 ] 41478 4.117% 4.117% # ( 1, 2 ] 530699 52.680% 56.797% ########### ( 2, 3 ] 216898 21.530% 78.327% #### ( 3, 4 ] 93907 9.322% 87.649% ## ( 4, 6 ] 97278 9.656% 97.305% ## ( 6, 10 ] 20694 2.054% 99.359% ( 10, 15 ] 4926 0.489% 99.848% ( 15, 22 ] 527 0.052% 99.901% ( 22, 34 ] 46 0.005% 99.905% ( 34, 51 ] 11 0.001% 99.906% ( 51, 76 ] 13 0.001% 99.907% ( 76, 110 ] 272 0.027% 99.934% ( 110, 170 ] 358 0.036% 99.970% ( 170, 250 ] 158 0.016% 99.986% ( 250, 380 ] 239 0.024% 100.009% ( 380, 580 ] 270 0.027% 100.036% ( 580, 870 ] 234 0.023% 100.059% ( 870, 1300 ] 186 0.018% 100.078% ( 1300, 1900 ] 91 0.009% 100.087% ( 1900, 2900 ] 158 0.016% 100.103% ( 2900, 4400 ] 201 0.020% 100.123% ( 4400, 6600 ] 48 0.005% 100.127% ( 6600, 9900 ] 12 0.001% 100.129% ** Level 2 read latency histogram (micros): Count: 60300 Average: 3.6789 StdDev: 47.76 Min: 1 Median: 1.5604 Max: 4417 Percentiles: P50: 1.56 P75: 1.94 P99: 8.56 P99.9: 318.50 P99.99: 2894.00 ------------------------------------------------------ [ 0, 1 ] 7745 12.844% 12.844% ### ( 1, 2 ] 39983 66.307% 79.151% ############# ( 2, 3 ] 6960 11.542% 90.693% ## ( 3, 4 ] 2736 4.537% 95.231% # ( 4, 6 ] 1789 2.967% 98.197% # ( 6, 10 ] 757 1.255% 99.453% ( 10, 15 ] 100 0.166% 99.619% ( 15, 22 ] 8 0.013% 99.632% ( 22, 34 ] 4 0.007% 99.638% ( 34, 51 ] 1 0.002% 99.640% ( 51, 76 ] 6 0.010% 99.650% ( 76, 110 ] 85 0.141% 99.791% ( 110, 170 ] 30 0.050% 99.841% ( 170, 250 ] 22 0.036% 99.877% ( 250, 380 ] 26 0.043% 99.920% ( 380, 580 ] 17 0.028% 99.949% ( 580, 870 ] 11 0.018% 99.967% ( 870, 1300 ] 5 0.008% 99.975% ( 1300, 1900 ] 4 0.007% 99.982% ( 1900, 2900 ] 5 0.008% 99.990% ( 2900, 4400 ] 5 0.008% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1087698 Average: 7.4310 StdDev: 100.17 Min: 0 Median: 1.9580 Max: 15416 Percentiles: P50: 1.96 P75: 2.99 P99: 9.56 P99.9: 442.79 P99.99: 676.11 ------------------------------------------------------ [ 0, 1 ] 22681 2.085% 2.085% ( 1, 2 ] 544005 50.014% 52.100% ########## ( 2, 3 ] 252602 23.224% 75.323% ##### ( 3, 4 ] 119258 10.964% 86.287% ## ( 4, 6 ] 119651 11.000% 97.288% ## ( 6, 10 ] 20917 1.923% 99.211% ( 10, 15 ] 4522 0.416% 99.627% ( 15, 22 ] 496 0.046% 99.672% ( 22, 34 ] 67 0.006% 99.678% ( 34, 51 ] 46 0.004% 99.683% ( 51, 76 ] 26 0.002% 99.685% ( 76, 110 ] 158 0.015% 99.699% ( 110, 170 ] 500 0.046% 99.745% ( 170, 250 ] 609 0.056% 99.801% ( 250, 380 ] 764 0.070% 99.872% ( 380, 580 ] 982 0.090% 99.962% ( 580, 870 ] 921 0.085% 100.047% ( 870, 1300 ] 639 0.059% 100.105% ( 1300, 1900 ] 295 0.027% 100.132% ( 1900, 2900 ] 257 0.024% 100.156% ( 2900, 4400 ] 274 0.025% 100.181% ( 4400, 6600 ] 89 0.008% 100.189% ( 6600, 9900 ] 19 0.002% 100.191% ( 9900, 14000 ] 1 0.000% 100.191% ( 14000, 22000 ] 1 0.000% 100.191% ** Level 4 read latency histogram (micros): Count: 85170 Average: 11.6607 StdDev: 151.33 Min: 1 Median: 1.9686 Max: 7594 Percentiles: P50: 1.97 P75: 3.03 P99: 13.43 P99.9: 2158.68 P99.99: 4153.87 ------------------------------------------------------ [ 0, 1 ] 1427 1.675% 1.675% ( 1, 2 ] 42491 49.890% 51.565% ########## ( 2, 3 ] 19727 23.162% 74.727% ##### ( 3, 4 ] 9222 10.828% 85.555% ## ( 4, 6 ] 9326 10.950% 96.505% ## ( 6, 10 ] 1773 2.082% 98.586% ( 10, 15 ] 513 0.602% 99.189% ( 15, 22 ] 50 0.059% 99.247% ( 22, 34 ] 15 0.018% 99.265% ( 34, 51 ] 4 0.005% 99.270% ( 51, 76 ] 12 0.014% 99.284% ( 76, 110 ] 7 0.008% 99.292% ( 110, 170 ] 46 0.054% 99.346% ( 170, 250 ] 60 0.070% 99.416% ( 250, 380 ] 70 0.082% 99.499% ( 380, 580 ] 90 0.106% 99.604% ( 580, 870 ] 125 0.147% 99.751% ( 870, 1300 ] 69 0.081% 99.832% ( 1300, 1900 ] 48 0.056% 99.888% ( 1900, 2900 ] 38 0.045% 99.933% ( 2900, 4400 ] 58 0.068% 100.001% ( 4400, 6600 ] 16 0.019% 100.020% ( 6600, 9900 ] 5 0.006% 100.026% ** Level 5 read latency histogram (micros): Count: 260 Average: 1253.8885 StdDev: 1392.59 Min: 78 Median: 712.5714 Max: 9805 Percentiles: P50: 712.57 P75: 1900.00 P99: 6013.33 P99.9: 9042.00 P99.99: 9805.00 ------------------------------------------------------ ( 76, 110 ] 16 6.154% 6.154% # ( 110, 170 ] 24 9.231% 15.385% ## ( 170, 250 ] 24 9.231% 24.615% ## ( 250, 380 ] 32 12.308% 36.923% ## ( 380, 580 ] 18 6.923% 43.846% # ( 580, 870 ] 35 13.462% 57.308% ### ( 870, 1300 ] 26 10.000% 67.308% ## ( 1300, 1900 ] 20 7.692% 75.000% ## ( 1900, 2900 ] 30 11.538% 86.538% ## ( 2900, 4400 ] 28 10.769% 97.308% ## ( 4400, 6600 ] 6 2.308% 99.615% ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 43.6 total, 3.2 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 225.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.454 H:M:S, 37.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 310.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.574 H:M:S, 18.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/23-03:13:37 ... thread 0: (1000000,11000000) ops and (77850.1,195657.4) ops/second in (12.845196,56.220710) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 2.94 GB 12.6 12.1 0.0 12.1 22.5 10.4 0.0 2.1 143.8 268.2 85.82 74.61 182 0.472 12M 33K 0.0 0.0 L1 9/9 1.06 GB 0.0 8.5 7.4 1.1 8.4 7.3 0.1 1.1 222.7 220.4 38.92 36.71 5 7.784 8634K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 6.3 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 20/6 1.31 GB 0.9 7.2 4.1 3.2 7.2 4.0 2.4 1.8 155.1 154.3 47.76 33.84 31 1.541 7428K 36K 0.0 0.0 L4 175/16 9.89 GB 0.9 6.5 4.3 2.2 6.4 4.2 1.7 1.5 140.6 139.2 47.19 31.19 65 0.726 6703K 68K 0.0 0.0 L5 1108/0 91.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1321/39 106.37 GB 0.0 34.4 15.8 18.6 44.6 26.0 16.1 4.3 159.7 207.3 220.24 176.88 284 0.775 35M 186K 0.0 0.0 Int 0/0 0.00 KB 0.0 34.4 15.8 18.6 44.6 26.0 16.0 4.3 159.7 207.3 220.24 176.88 284 0.775 35M 186K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 34.4 15.8 18.6 34.1 15.6 0.0 0.0 190.0 188.7 185.17 149.22 135 1.372 35M 186K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 305.4 35.07 27.66 149 0.235 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.4 total, 56.2 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 44.59 GB write, 809.09 MB/s write, 34.35 GB read, 623.36 MB/s read, 220.2 seconds Interval compaction: 44.59 GB write, 812.11 MB/s write, 34.35 GB read, 625.69 MB/s read, 220.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 31, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 31, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 82, pending-compaction-bytes-delays: 31, pending-compaction-bytes-stops: 0, total-delays: 62, total-stops: 82, interval: 144 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5093464 Average: 2.8200 StdDev: 35.66 Min: 0 Median: 1.5473 Max: 32959 Percentiles: P50: 1.55 P75: 1.94 P99: 7.26 P99.9: 91.84 P99.99: 447.86 ------------------------------------------------------ [ 0, 1 ] 759709 14.915% 14.915% ### ( 1, 2 ] 3264957 64.101% 79.016% ############# ( 2, 3 ] 612257 12.020% 91.037% ## ( 3, 4 ] 219967 4.319% 95.355% # ( 4, 6 ] 169246 3.323% 98.678% # ( 6, 10 ] 52137 1.024% 99.702% ( 10, 15 ] 8144 0.160% 99.862% ( 15, 22 ] 881 0.017% 99.879% ( 22, 34 ] 55 0.001% 99.880% ( 34, 51 ] 41 0.001% 99.881% ( 51, 76 ] 59 0.001% 99.882% ( 76, 110 ] 1972 0.039% 99.921% ( 110, 170 ] 2119 0.042% 99.962% ( 170, 250 ] 634 0.012% 99.975% ( 250, 380 ] 570 0.011% 99.986% ( 380, 580 ] 612 0.012% 99.998% ( 580, 870 ] 486 0.010% 100.007% ( 870, 1300 ] 284 0.006% 100.013% ( 1300, 1900 ] 133 0.003% 100.016% ( 1900, 2900 ] 118 0.002% 100.018% ( 2900, 4400 ] 119 0.002% 100.020% ( 4400, 6600 ] 31 0.001% 100.021% ( 6600, 9900 ] 9 0.000% 100.021% ( 9900, 14000 ] 3 0.000% 100.021% ( 14000, 22000 ] 1 0.000% 100.021% ( 22000, 33000 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1733593 Average: 5.2785 StdDev: 78.42 Min: 0 Median: 1.8796 Max: 8560 Percentiles: P50: 1.88 P75: 2.88 P99: 9.51 P99.9: 82.71 P99.99: 369.34 ------------------------------------------------------ [ 0, 1 ] 76446 4.410% 4.410% # ( 1, 2 ] 898552 51.832% 56.241% ########## ( 2, 3 ] 367586 21.204% 77.445% #### ( 3, 4 ] 164005 9.460% 86.906% ## ( 4, 6 ] 173950 10.034% 96.940% ## ( 6, 10 ] 40711 2.348% 99.288% ( 10, 15 ] 9279 0.535% 99.823% ( 15, 22 ] 1031 0.059% 99.883% ( 22, 34 ] 77 0.004% 99.887% ( 34, 51 ] 19 0.001% 99.888% ( 51, 76 ] 112 0.006% 99.895% ( 76, 110 ] 463 0.027% 99.921% ( 110, 170 ] 535 0.031% 99.952% ( 170, 250 ] 280 0.016% 99.968% ( 250, 380 ] 407 0.023% 99.992% ( 380, 580 ] 576 0.033% 100.025% ( 580, 870 ] 609 0.035% 100.060% ( 870, 1300 ] 436 0.025% 100.085% ( 1300, 1900 ] 222 0.013% 100.098% ( 1900, 2900 ] 250 0.014% 100.113% ( 2900, 4400 ] 317 0.018% 100.131% ( 4400, 6600 ] 86 0.005% 100.136% ( 6600, 9900 ] 21 0.001% 100.137% ** Level 2 read latency histogram (micros): Count: 60300 Average: 3.6789 StdDev: 47.76 Min: 1 Median: 1.5604 Max: 4417 Percentiles: P50: 1.56 P75: 1.94 P99: 8.56 P99.9: 318.50 P99.99: 2894.00 ------------------------------------------------------ [ 0, 1 ] 7745 12.844% 12.844% ### ( 1, 2 ] 39983 66.307% 79.151% ############# ( 2, 3 ] 6960 11.542% 90.693% ## ( 3, 4 ] 2736 4.537% 95.231% # ( 4, 6 ] 1789 2.967% 98.197% # ( 6, 10 ] 757 1.255% 99.453% ( 10, 15 ] 100 0.166% 99.619% ( 15, 22 ] 8 0.013% 99.632% ( 22, 34 ] 4 0.007% 99.638% ( 34, 51 ] 1 0.002% 99.640% ( 51, 76 ] 6 0.010% 99.650% ( 76, 110 ] 85 0.141% 99.791% ( 110, 170 ] 30 0.050% 99.841% ( 170, 250 ] 22 0.036% 99.877% ( 250, 380 ] 26 0.043% 99.920% ( 380, 580 ] 17 0.028% 99.949% ( 580, 870 ] 11 0.018% 99.967% ( 870, 1300 ] 5 0.008% 99.975% ( 1300, 1900 ] 4 0.007% 99.982% ( 1900, 2900 ] 5 0.008% 99.990% ( 2900, 4400 ] 5 0.008% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1675905 Average: 6.6274 StdDev: 91.01 Min: 0 Median: 1.9847 Max: 15416 Percentiles: P50: 1.98 P75: 3.06 P99: 9.46 P99.9: 325.42 P99.99: 562.70 ------------------------------------------------------ [ 0, 1 ] 30444 1.817% 1.817% ( 1, 2 ] 820038 48.931% 50.748% ########## ( 2, 3 ] 395173 23.580% 74.327% ##### ( 3, 4 ] 186790 11.146% 85.473% ## ( 4, 6 ] 196520 11.726% 97.199% ## ( 6, 10 ] 34863 2.080% 99.279% ( 10, 15 ] 7458 0.445% 99.724% ( 15, 22 ] 770 0.046% 99.770% ( 22, 34 ] 82 0.005% 99.775% ( 34, 51 ] 59 0.004% 99.779% ( 51, 76 ] 67 0.004% 99.783% ( 76, 110 ] 175 0.010% 99.793% ( 110, 170 ] 542 0.032% 99.826% ( 170, 250 ] 719 0.043% 99.868% ( 250, 380 ] 912 0.054% 99.923% ( 380, 580 ] 1232 0.074% 99.996% ( 580, 870 ] 1188 0.071% 100.067% ( 870, 1300 ] 821 0.049% 100.116% ( 1300, 1900 ] 368 0.022% 100.138% ( 1900, 2900 ] 316 0.019% 100.157% ( 2900, 4400 ] 329 0.020% 100.177% ( 4400, 6600 ] 104 0.006% 100.183% ( 6600, 9900 ] 30 0.002% 100.185% ( 9900, 14000 ] 3 0.000% 100.185% ( 14000, 22000 ] 1 0.000% 100.185% ** Level 4 read latency histogram (micros): Count: 487082 Average: 13.2180 StdDev: 180.60 Min: 1 Median: 2.0577 Max: 27295 Percentiles: P50: 2.06 P75: 3.25 P99: 13.97 P99.9: 1291.31 P99.99: 2463.64 ------------------------------------------------------ [ 0, 1 ] 7577 1.556% 1.556% ( 1, 2 ] 229355 47.088% 48.643% ######### ( 2, 3 ] 114539 23.515% 72.158% ##### ( 3, 4 ] 54773 11.245% 83.404% ## ( 4, 6 ] 59377 12.190% 95.594% ## ( 6, 10 ] 13683 2.809% 98.403% # ( 10, 15 ] 3660 0.751% 99.155% ( 15, 22 ] 331 0.068% 99.223% ( 22, 34 ] 42 0.009% 99.231% ( 34, 51 ] 18 0.004% 99.235% ( 51, 76 ] 43 0.009% 99.244% ( 76, 110 ] 24 0.005% 99.249% ( 110, 170 ] 121 0.025% 99.273% ( 170, 250 ] 245 0.050% 99.324% ( 250, 380 ] 441 0.091% 99.414% ( 380, 580 ] 715 0.147% 99.561% ( 580, 870 ] 968 0.199% 99.760% ( 870, 1300 ] 697 0.143% 99.903% ( 1300, 1900 ] 311 0.064% 99.967% ( 1900, 2900 ] 201 0.041% 100.008% ( 2900, 4400 ] 241 0.049% 100.057% ( 4400, 6600 ] 104 0.021% 100.079% ( 6600, 9900 ] 48 0.010% 100.089% ( 9900, 14000 ] 7 0.001% 100.090% ( 14000, 22000 ] 10 0.002% 100.092% ( 22000, 33000 ] 1 0.000% 100.092% ** Level 5 read latency histogram (micros): Count: 340 Average: 1288.4471 StdDev: 1446.67 Min: 78 Median: 674.2500 Max: 9805 Percentiles: P50: 674.25 P75: 1954.05 P99: 6160.00 P99.9: 8778.00 P99.99: 9787.80 ------------------------------------------------------ ( 76, 110 ] 16 4.706% 4.706% # ( 110, 170 ] 30 8.824% 13.529% ## ( 170, 250 ] 28 8.235% 21.765% ## ( 250, 380 ] 50 14.706% 36.471% ### ( 380, 580 ] 33 9.706% 46.176% ## ( 580, 870 ] 40 11.765% 57.941% ## ( 870, 1300 ] 32 9.412% 67.353% ## ( 1300, 1900 ] 24 7.059% 74.412% # ( 1900, 2900 ] 37 10.882% 85.294% ## ( 2900, 4400 ] 37 10.882% 96.176% ## ( 4400, 6600 ] 12 3.529% 99.706% # ( 6600, 9900 ] 1 0.294% 100.000% ** DB Stats ** Uptime(secs): 56.4 total, 12.8 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 191.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.494 H:M:S, 46.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 76.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.040 H:M:S, 78.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/23-03:13:41 ... thread 0: (1000000,12000000) ops and (296645.4,201370.2) ops/second in (3.371028,59.591738) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 3.92 GB 88.1 12.7 0.0 12.7 24.1 11.4 0.0 2.1 142.2 269.6 91.67 79.86 197 0.465 13M 34K 0.0 0.0 L1 9/9 1.06 GB 0.0 8.5 7.4 1.1 8.4 7.3 0.1 1.1 222.7 220.4 38.92 36.71 5 7.784 8634K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 6.3 2.0 228.8 228.8 0.55 0.53 1 0.551 127K 40 0.0 0.0 L3 14/0 946.34 MB 0.9 7.2 4.1 3.2 7.2 4.0 2.4 1.8 155.1 154.3 47.76 33.84 31 1.541 7428K 36K 0.0 0.0 L4 171/0 9.58 GB 1.0 7.5 4.7 2.9 7.5 4.6 1.7 1.6 141.2 139.6 54.68 36.71 71 0.770 7805K 86K 0.0 0.0 L5 1116/0 91.84 GB 0.9 0.0 0.0 0.0 0.0 0.0 6.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1326/21 107.34 GB 0.0 36.1 16.2 19.9 47.3 27.4 16.8 4.1 158.2 207.3 233.59 187.66 305 0.766 37M 206K 0.0 0.0 Int 0/0 0.00 KB 0.0 36.1 16.2 19.9 47.3 27.4 16.7 4.1 158.2 207.3 233.59 187.66 305 0.766 37M 206K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 36.1 16.2 19.9 35.8 15.9 0.0 0.0 189.2 187.9 195.33 157.36 143 1.366 37M 206K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 11.4 11.4 0.0 0.0 0.0 306.3 38.26 30.29 162 0.236 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.8 total, 59.6 interval Flush(GB): cumulative 11.443, interval 11.443 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 47.29 GB write, 809.74 MB/s write, 36.09 GB read, 617.95 MB/s read, 233.6 seconds Interval compaction: 47.29 GB write, 812.59 MB/s write, 36.09 GB read, 620.12 MB/s read, 233.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 31, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 31, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 94, pending-compaction-bytes-delays: 31, pending-compaction-bytes-stops: 0, total-delays: 62, total-stops: 94, interval: 156 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5501426 Average: 2.7916 StdDev: 34.47 Min: 0 Median: 1.5523 Max: 32959 Percentiles: P50: 1.55 P75: 1.94 P99: 7.23 P99.9: 82.73 P99.99: 377.72 ------------------------------------------------------ [ 0, 1 ] 800949 14.559% 14.559% ### ( 1, 2 ] 3530176 64.168% 78.727% ############# ( 2, 3 ] 675899 12.286% 91.013% ## ( 3, 4 ] 238646 4.338% 95.351% # ( 4, 6 ] 183386 3.333% 98.685% # ( 6, 10 ] 56496 1.027% 99.711% ( 10, 15 ] 8862 0.161% 99.873% ( 15, 22 ] 946 0.017% 99.890% ( 22, 34 ] 66 0.001% 99.891% ( 34, 51 ] 44 0.001% 99.892% ( 51, 76 ] 64 0.001% 99.893% ( 76, 110 ] 1979 0.036% 99.929% ( 110, 170 ] 2146 0.039% 99.968% ( 170, 250 ] 649 0.012% 99.980% ( 250, 380 ] 579 0.011% 99.990% ( 380, 580 ] 618 0.011% 100.001% ( 580, 870 ] 493 0.009% 100.010% ( 870, 1300 ] 289 0.005% 100.016% ( 1300, 1900 ] 133 0.002% 100.018% ( 1900, 2900 ] 119 0.002% 100.020% ( 2900, 4400 ] 122 0.002% 100.022% ( 4400, 6600 ] 31 0.001% 100.023% ( 6600, 9900 ] 9 0.000% 100.023% ( 9900, 14000 ] 3 0.000% 100.023% ( 14000, 22000 ] 1 0.000% 100.023% ( 22000, 33000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1733593 Average: 5.2785 StdDev: 78.42 Min: 0 Median: 1.8796 Max: 8560 Percentiles: P50: 1.88 P75: 2.88 P99: 9.51 P99.9: 82.71 P99.99: 369.34 ------------------------------------------------------ [ 0, 1 ] 76446 4.410% 4.410% # ( 1, 2 ] 898552 51.832% 56.241% ########## ( 2, 3 ] 367586 21.204% 77.445% #### ( 3, 4 ] 164005 9.460% 86.906% ## ( 4, 6 ] 173950 10.034% 96.940% ## ( 6, 10 ] 40711 2.348% 99.288% ( 10, 15 ] 9279 0.535% 99.823% ( 15, 22 ] 1031 0.059% 99.883% ( 22, 34 ] 77 0.004% 99.887% ( 34, 51 ] 19 0.001% 99.888% ( 51, 76 ] 112 0.006% 99.895% ( 76, 110 ] 463 0.027% 99.921% ( 110, 170 ] 535 0.031% 99.952% ( 170, 250 ] 280 0.016% 99.968% ( 250, 380 ] 407 0.023% 99.992% ( 380, 580 ] 576 0.033% 100.025% ( 580, 870 ] 609 0.035% 100.060% ( 870, 1300 ] 436 0.025% 100.085% ( 1300, 1900 ] 222 0.013% 100.098% ( 1900, 2900 ] 250 0.014% 100.113% ( 2900, 4400 ] 317 0.018% 100.131% ( 4400, 6600 ] 86 0.005% 100.136% ( 6600, 9900 ] 21 0.001% 100.137% ** Level 2 read latency histogram (micros): Count: 60300 Average: 3.6789 StdDev: 47.76 Min: 1 Median: 1.5604 Max: 4417 Percentiles: P50: 1.56 P75: 1.94 P99: 8.56 P99.9: 318.50 P99.99: 2894.00 ------------------------------------------------------ [ 0, 1 ] 7745 12.844% 12.844% ### ( 1, 2 ] 39983 66.307% 79.151% ############# ( 2, 3 ] 6960 11.542% 90.693% ## ( 3, 4 ] 2736 4.537% 95.231% # ( 4, 6 ] 1789 2.967% 98.197% # ( 6, 10 ] 757 1.255% 99.453% ( 10, 15 ] 100 0.166% 99.619% ( 15, 22 ] 8 0.013% 99.632% ( 22, 34 ] 4 0.007% 99.638% ( 34, 51 ] 1 0.002% 99.640% ( 51, 76 ] 6 0.010% 99.650% ( 76, 110 ] 85 0.141% 99.791% ( 110, 170 ] 30 0.050% 99.841% ( 170, 250 ] 22 0.036% 99.877% ( 250, 380 ] 26 0.043% 99.920% ( 380, 580 ] 17 0.028% 99.949% ( 580, 870 ] 11 0.018% 99.967% ( 870, 1300 ] 5 0.008% 99.975% ( 1300, 1900 ] 4 0.007% 99.982% ( 1900, 2900 ] 5 0.008% 99.990% ( 2900, 4400 ] 5 0.008% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1735545 Average: 6.5000 StdDev: 89.49 Min: 0 Median: 1.9797 Max: 15416 Percentiles: P50: 1.98 P75: 3.04 P99: 9.43 P99.9: 312.50 P99.99: 556.70 ------------------------------------------------------ [ 0, 1 ] 32218 1.856% 1.856% ( 1, 2 ] 852892 49.143% 50.999% ########## ( 2, 3 ] 408035 23.510% 74.509% ##### ( 3, 4 ] 192253 11.077% 85.587% ## ( 4, 6 ] 202099 11.645% 97.232% ## ( 6, 10 ] 35823 2.064% 99.296% ( 10, 15 ] 7619 0.439% 99.735% ( 15, 22 ] 788 0.045% 99.780% ( 22, 34 ] 82 0.005% 99.785% ( 34, 51 ] 59 0.003% 99.788% ( 51, 76 ] 67 0.004% 99.792% ( 76, 110 ] 175 0.010% 99.802% ( 110, 170 ] 542 0.031% 99.833% ( 170, 250 ] 719 0.041% 99.875% ( 250, 380 ] 912 0.053% 99.927% ( 380, 580 ] 1232 0.071% 99.998% ( 580, 870 ] 1188 0.068% 100.067% ( 870, 1300 ] 821 0.047% 100.114% ( 1300, 1900 ] 368 0.021% 100.135% ( 1900, 2900 ] 319 0.018% 100.154% ( 2900, 4400 ] 329 0.019% 100.173% ( 4400, 6600 ] 104 0.006% 100.179% ( 6600, 9900 ] 30 0.002% 100.180% ( 9900, 14000 ] 3 0.000% 100.180% ( 14000, 22000 ] 1 0.000% 100.181% ** Level 4 read latency histogram (micros): Count: 587263 Average: 11.8364 StdDev: 166.37 Min: 0 Median: 1.9935 Max: 27295 Percentiles: P50: 1.99 P75: 3.15 P99: 13.10 P99.9: 1162.62 P99.99: 1848.65 ------------------------------------------------------ [ 0, 1 ] 10730 1.827% 1.827% ( 1, 2 ] 284749 48.487% 50.315% ########## ( 2, 3 ] 135491 23.072% 73.386% ##### ( 3, 4 ] 63674 10.843% 84.229% ## ( 4, 6 ] 68447 11.655% 95.884% ## ( 6, 10 ] 15749 2.682% 98.566% # ( 10, 15 ] 4109 0.700% 99.265% ( 15, 22 ] 363 0.062% 99.327% ( 22, 34 ] 44 0.007% 99.335% ( 34, 51 ] 19 0.003% 99.338% ( 51, 76 ] 43 0.007% 99.345% ( 76, 110 ] 45 0.008% 99.353% ( 110, 170 ] 143 0.024% 99.377% ( 170, 250 ] 302 0.051% 99.429% ( 250, 380 ] 492 0.084% 99.512% ( 380, 580 ] 760 0.129% 99.642% ( 580, 870 ] 1021 0.174% 99.816% ( 870, 1300 ] 727 0.124% 99.940% ( 1300, 1900 ] 324 0.055% 99.995% ( 1900, 2900 ] 225 0.038% 100.033% ( 2900, 4400 ] 249 0.042% 100.075% ( 4400, 6600 ] 105 0.018% 100.093% ( 6600, 9900 ] 48 0.008% 100.101% ( 9900, 14000 ] 7 0.001% 100.103% ( 14000, 22000 ] 10 0.002% 100.104% ( 22000, 33000 ] 1 0.000% 100.105% ** Level 5 read latency histogram (micros): Count: 380 Average: 1229.7789 StdDev: 1406.95 Min: 78 Median: 620.4651 Max: 9805 Percentiles: P50: 620.47 P75: 1855.56 P99: 6086.67 P99.9: 8646.00 P99.99: 9774.60 ------------------------------------------------------ ( 76, 110 ] 16 4.211% 4.211% # ( 110, 170 ] 44 11.579% 15.789% ## ( 170, 250 ] 33 8.684% 24.474% ## ( 250, 380 ] 55 14.474% 38.947% ### ( 380, 580 ] 36 9.474% 48.421% ## ( 580, 870 ] 43 11.316% 59.737% ## ( 870, 1300 ] 33 8.684% 68.421% ## ( 1300, 1900 ] 27 7.105% 75.526% # ( 1900, 2900 ] 42 11.053% 86.579% ## ( 2900, 4400 ] 38 10.000% 96.579% ## ( 4400, 6600 ] 12 3.158% 99.737% # ( 6600, 9900 ] 1 0.263% 100.000% ** DB Stats ** Uptime(secs): 59.8 total, 3.4 interval Cumulative writes: 0 writes, 12M keys, 0 commit groups, 0.0 writes per commit group, ingest: 11.53 GB, 197.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.245 H:M:S, 45.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 291.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.751 H:M:S, 22.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.936 micros/op 202611 ops/sec 60.001 seconds 12156999 operations; 196.3 MB/s Microseconds per write: Count: 12156999 Average: 4.9355 StdDev: 516.13 Min: 0 Median: 1.7256 Max: 911882 Percentiles: P50: 1.73 P75: 2.65 P99: 7.14 P99.9: 965.76 P99.99: 2625.52 ------------------------------------------------------ [ 0, 1 ] 1700288 13.986% 13.986% ### ( 1, 2 ] 6034184 49.635% 63.622% ########## ( 2, 3 ] 2137086 17.579% 81.201% #### ( 3, 4 ] 1601207 13.171% 94.372% ### ( 4, 6 ] 537639 4.422% 98.794% # ( 6, 10 ] 88055 0.724% 99.518% ( 10, 15 ] 21456 0.176% 99.695% ( 15, 22 ] 7849 0.065% 99.760% ( 22, 34 ] 2001 0.016% 99.776% ( 34, 51 ] 187 0.002% 99.778% ( 51, 76 ] 43 0.000% 99.778% ( 76, 110 ] 8813 0.072% 99.850% ( 110, 170 ] 3133 0.026% 99.876% ( 170, 250 ] 310 0.003% 99.879% ( 250, 380 ] 97 0.001% 99.879% ( 380, 580 ] 26 0.000% 99.880% ( 580, 870 ] 30 0.000% 99.880% ( 870, 1300 ] 10948 0.090% 99.970% ( 1300, 1900 ] 69 0.001% 99.971% ( 1900, 2900 ] 3256 0.027% 99.997% ( 2900, 4400 ] 210 0.002% 99.999% ( 4400, 6600 ] 49 0.000% 99.999% ( 6600, 9900 ] 19 0.000% 100.000% ( 9900, 14000 ] 4 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 5 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 5 0.000% 100.000% ( 170000, 250000 ] 18 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 257578 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 12156999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 12546022968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 735 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 27245485 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 39970267117 rocksdb.compact.write.bytes COUNT : 39703189853 rocksdb.flush.write.bytes COUNT : 12418641342 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 83 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 439 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 12318643200 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4899840 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 40092553907 rocksdb.non.last.level.read.count COUNT : 9682955 rocksdb.block.checksum.compute.count COUNT : 9681569 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.368366 P95 : 3.744727 P99 : 5.877406 P100 : 911879.000000 COUNT : 12156999 SUM : 54495012 rocksdb.compaction.times.micros P50 : 960454.545455 P95 : 3460000.000000 P99 : 12152000.000000 P100 : 14797275.000000 COUNT : 144 SUM : 196287263 rocksdb.compaction.times.cpu_micros P50 : 778800.000000 P95 : 2700000.000000 P99 : 10976000.000000 P100 : 13639693.000000 COUNT : 144 SUM : 158306874 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 726.407767 P95 : 11540.000000 P99 : 81300.000000 P100 : 108225.000000 COUNT : 164 SUM : 479582 rocksdb.compaction.outfile.sync.micros P50 : 1505.263158 P95 : 106062.500000 P99 : 220400.000000 P100 : 662766.000000 COUNT : 485 SUM : 10244723 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 130.769231 P95 : 2342.857143 P99 : 7771.500000 P100 : 11026.000000 COUNT : 358 SUM : 192791 rocksdb.table.open.io.micros P50 : 1524.409449 P95 : 7890.384615 P99 : 12795.625000 P100 : 33568.000000 COUNT : 735 SUM : 1726000 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.762668 P95 : 8.430200 P99 : 12.281848 P100 : 27305.000000 COUNT : 9679563 SUM : 63726144 rocksdb.read.block.get.micros P50 : 465.507246 P95 : 3837.500000 P99 : 6166.470588 P100 : 33008.000000 COUNT : 1470 SUM : 1439516 rocksdb.write.raw.block.micros P50 : 0.513365 P95 : 0.975393 P99 : 2.872875 P100 : 18597.000000 COUNT : 12629153 SUM : 27575847 rocksdb.numfiles.in.singlecompaction P50 : 2.972222 P95 : 5.514286 P99 : 13.100000 P100 : 17.000000 COUNT : 214 SUM : 730 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.555849 P95 : 1153.263483 P99 : 2514.523144 P100 : 911680.000000 COUNT : 144085 SUM : 27254641 rocksdb.sst.read.micros P50 : 1.692673 P95 : 5.130127 P99 : 8.946437 P100 : 32959.000000 COUNT : 9683480 SUM : 43737797 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 12156999 SUM : 12546022968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217719.298246 P95 : 481333.333333 P99 : 921200.000000 P100 : 1093144.000000 COUNT : 164 SUM : 38637852 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 487 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0