[2024-12-13 11:08:46.438580] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-13 11:08:46.438699] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid579525 ] Set seed to 1734084526436001 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-13 11:08:46.566125] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-13 11:08:46.787382] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-13 11:08:46.787433] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 579525' to capture a snapshot of events at runtime. [2024-12-13 11:08:46.787446] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid579525 for offline analysis/debug. [2024-12-13 11:08:46.787482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 13 11:08:53 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/13-11:08:56 ... thread 0: (1000000,1000000) ops and (336821.3,336821.3) ops/second in (2.968933,2.968933) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 692.99 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 355.4 2.48 2.31 13 0.191 0 0 0.0 0.0 L1 1/1 63.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 975.01 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 247.3 247.2 0.51 0.50 1 0.510 127K 31 0.0 0.0 L3 17/0 866.57 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 246.2 246.2 0.51 0.49 1 0.508 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1201/9 97.00 GB 0.0 0.2 0.2 0.1 1.1 1.0 0.5 1.3 71.7 323.8 3.50 3.30 15 0.233 254K 31 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.2 0.1 1.1 1.0 0.4 1.3 71.7 323.8 3.50 3.30 15 0.233 254K 31 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.2 0.1 0.2 0.2 0.0 0.0 246.7 246.7 1.02 0.99 2 0.509 254K 31 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 355.4 2.48 2.31 13 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 355.76 MB/s write, 0.25 GB read, 78.83 MB/s read, 3.5 seconds Interval compaction: 1.11 GB write, 381.51 MB/s write, 0.25 GB read, 84.53 MB/s read, 3.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 143206 Average: 1.9864 StdDev: 8.42 Min: 1 Median: 1.3539 Max: 1629 Percentiles: P50: 1.35 P75: 1.75 P99: 5.47 P99.9: 12.57 P99.99: 64.99 ------------------------------------------------------ [ 0, 1 ] 39642 27.682% 27.682% ###### ( 1, 2 ] 90314 63.066% 90.748% ############# ( 2, 3 ] 7791 5.440% 96.188% # ( 3, 4 ] 2885 2.015% 98.203% ( 4, 6 ] 1553 1.084% 99.287% ( 6, 10 ] 776 0.542% 99.829% ( 10, 15 ] 204 0.142% 99.971% ( 15, 22 ] 20 0.014% 99.985% ( 22, 34 ] 8 0.006% 99.991% ( 51, 76 ] 3 0.002% 99.993% ( 76, 110 ] 1 0.001% 99.994% ( 170, 250 ] 10 0.007% 100.001% ( 250, 380 ] 9 0.006% 100.007% ( 380, 580 ] 4 0.003% 100.010% ( 1300, 1900 ] 3 0.002% 100.012% ** Level 1 read latency histogram (micros): Count: 5 Average: 1017.0000 StdDev: 1042.13 Min: 115 Median: 315.0000 Max: 2499 Percentiles: P50: 315.00 P75: 2275.00 P99: 2499.00 P99.9: 2499.00 P99.99: 2499.00 ------------------------------------------------------ ( 110, 170 ] 2 40.000% 40.000% ######## ( 250, 380 ] 1 20.000% 60.000% #### ( 1900, 2900 ] 2 40.000% 100.000% ######## ** Level 2 read latency histogram (micros): Count: 31749 Average: 1.7541 StdDev: 4.98 Min: 1 Median: 1.2196 Max: 771 Percentiles: P50: 1.22 P75: 1.65 P99: 3.60 P99.9: 10.22 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 11821 37.233% 37.233% ####### ( 1, 2 ] 18459 58.140% 95.373% ############ ( 2, 3 ] 993 3.128% 98.501% # ( 3, 4 ] 263 0.828% 99.329% ( 4, 6 ] 64 0.202% 99.531% ( 6, 10 ] 116 0.365% 99.896% ( 10, 15 ] 29 0.091% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1454.6875 StdDev: 1958.59 Min: 0 Median: 210.0000 Max: 6808 Percentiles: P50: 210.00 P75: 2354.55 P99: 6808.00 P99.9: 6808.00 P99.99: 6808.00 ------------------------------------------------------ [ 0, 1 ] 25 31.250% 31.250% ###### ( 1, 2 ] 7 8.750% 40.000% ## ( 2, 3 ] 3 3.750% 43.750% # ( 4, 6 ] 3 3.750% 47.500% # ( 110, 170 ] 1 1.250% 48.750% ( 170, 250 ] 2 2.500% 51.250% # ( 250, 380 ] 1 1.250% 52.500% ( 380, 580 ] 2 2.500% 55.000% # ( 870, 1300 ] 3 3.750% 58.750% # ( 1300, 1900 ] 8 10.000% 68.750% ## ( 1900, 2900 ] 11 13.750% 82.500% ### ( 2900, 4400 ] 3 3.750% 86.250% # ( 4400, 6600 ] 9 11.250% 97.500% ## ( 6600, 9900 ] 2 2.500% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 3363.7714 StdDev: 2191.08 Min: 102 Median: 2733.3333 Max: 7921 Percentiles: P50: 2733.33 P75: 4858.33 P99: 7921.00 P99.9: 7921.00 P99.99: 7921.00 ------------------------------------------------------ ( 76, 110 ] 1 2.857% 2.857% # ( 110, 170 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 870, 1300 ] 4 11.429% 22.857% ## ( 1300, 1900 ] 2 5.714% 28.571% # ( 1900, 2900 ] 9 25.714% 54.286% ##### ( 2900, 4400 ] 6 17.143% 71.429% ### ( 4400, 6600 ] 6 17.143% 88.571% ### ( 6600, 9900 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 309.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.152 H:M:S, 4.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.152 H:M:S, 5.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-11:08:59 ... thread 0: (1000000,2000000) ops and (342667.1,339719.1) ops/second in (2.918284,5.887217) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.35 GB 113.3 1.0 0.0 1.0 2.8 1.8 0.0 1.6 115.4 312.1 9.28 8.80 32 0.290 1087K 1179 0.0 0.0 L1 1/0 2.33 MB 0.2 0.3 0.2 0.1 0.3 0.2 0.2 1.2 247.4 247.1 1.27 1.25 1 1.273 319K 336 0.0 0.0 L2 2/0 55.70 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.5 2.0 247.3 247.2 0.51 0.50 1 0.510 127K 31 0.0 0.0 L3 53/0 984.51 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 213.2 213.0 2.32 2.18 2 1.162 502K 382 0.0 0.0 L4 136/0 9.73 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/4 97.92 GB 0.0 2.0 0.7 1.3 3.7 2.5 0.9 2.1 149.9 286.2 13.39 12.73 36 0.372 2038K 1928 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.7 1.3 3.7 2.5 0.8 2.1 149.9 286.2 13.39 12.73 36 0.372 2038K 1928 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.7 1.3 2.0 0.7 0.0 0.0 242.0 241.8 8.29 8.02 8 1.037 2038K 1928 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 358.7 5.09 4.71 28 0.182 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.74 GB write, 627.93 MB/s write, 1.96 GB read, 328.89 MB/s read, 13.4 seconds Interval compaction: 3.74 GB write, 650.85 MB/s write, 1.96 GB read, 340.90 MB/s read, 13.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 407814 Average: 2.1307 StdDev: 8.31 Min: 0 Median: 1.4467 Max: 1629 Percentiles: P50: 1.45 P75: 1.83 P99: 5.81 P99.9: 12.38 P99.99: 23.04 ------------------------------------------------------ [ 0, 1 ] 85926 21.070% 21.070% #### ( 1, 2 ] 264145 64.771% 85.841% ############# ( 2, 3 ] 34314 8.414% 94.255% ## ( 3, 4 ] 12701 3.114% 97.369% # ( 4, 6 ] 7360 1.805% 99.174% ( 6, 10 ] 2670 0.655% 99.829% ( 10, 15 ] 611 0.150% 99.979% ( 15, 22 ] 46 0.011% 99.990% ( 22, 34 ] 14 0.003% 99.993% ( 34, 51 ] 3 0.001% 99.994% ( 51, 76 ] 7 0.002% 99.996% ( 76, 110 ] 2 0.000% 99.996% ( 170, 250 ] 20 0.005% 100.001% ( 250, 380 ] 13 0.003% 100.004% ( 380, 580 ] 16 0.004% 100.008% ( 580, 870 ] 5 0.001% 100.010% ( 870, 1300 ] 2 0.000% 100.010% ( 1300, 1900 ] 8 0.002% 100.012% ** Level 1 read latency histogram (micros): Count: 65403 Average: 2.4408 StdDev: 13.65 Min: 1 Median: 1.5966 Max: 2499 Percentiles: P50: 1.60 P75: 1.97 P99: 6.30 P99.9: 13.86 P99.99: 309.76 ------------------------------------------------------ [ 0, 1 ] 6554 10.021% 10.021% ## ( 1, 2 ] 43828 67.012% 77.033% ############# ( 2, 3 ] 8899 13.606% 90.640% ### ( 3, 4 ] 3090 4.725% 95.364% # ( 4, 6 ] 2339 3.576% 98.940% # ( 6, 10 ] 514 0.786% 99.726% ( 10, 15 ] 147 0.225% 99.951% ( 15, 22 ] 19 0.029% 99.980% ( 22, 34 ] 1 0.002% 99.982% ( 34, 51 ] 1 0.002% 99.983% ( 110, 170 ] 2 0.003% 99.986% ( 170, 250 ] 2 0.003% 99.989% ( 250, 380 ] 1 0.002% 99.991% ( 380, 580 ] 2 0.003% 99.994% ( 580, 870 ] 2 0.003% 99.997% ( 1900, 2900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31749 Average: 1.7541 StdDev: 4.98 Min: 1 Median: 1.2196 Max: 771 Percentiles: P50: 1.22 P75: 1.65 P99: 3.60 P99.9: 10.22 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 11821 37.233% 37.233% ####### ( 1, 2 ] 18459 58.140% 95.373% ############ ( 2, 3 ] 993 3.128% 98.501% # ( 3, 4 ] 263 0.828% 99.329% ( 4, 6 ] 64 0.202% 99.531% ( 6, 10 ] 116 0.365% 99.896% ( 10, 15 ] 29 0.091% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28958 Average: 6.3794 StdDev: 128.13 Min: 0 Median: 1.5888 Max: 6808 Percentiles: P50: 1.59 P75: 1.97 P99: 7.79 P99.9: 1603.15 P99.99: 6381.03 ------------------------------------------------------ [ 0, 1 ] 3231 11.158% 11.158% ## ( 1, 2 ] 19102 65.965% 77.122% ############# ( 2, 3 ] 3786 13.074% 90.196% ### ( 3, 4 ] 1452 5.014% 95.210% # ( 4, 6 ] 988 3.412% 98.622% # ( 6, 10 ] 244 0.843% 99.465% ( 10, 15 ] 86 0.297% 99.762% ( 15, 22 ] 9 0.031% 99.793% ( 22, 34 ] 9 0.031% 99.824% ( 34, 51 ] 1 0.003% 99.827% ( 110, 170 ] 8 0.028% 99.855% ( 170, 250 ] 3 0.010% 99.865% ( 250, 380 ] 1 0.003% 99.869% ( 380, 580 ] 2 0.007% 99.876% ( 870, 1300 ] 3 0.010% 99.886% ( 1300, 1900 ] 8 0.028% 99.914% ( 1900, 2900 ] 11 0.038% 99.952% ( 2900, 4400 ] 3 0.010% 99.962% ( 4400, 6600 ] 9 0.031% 99.993% ( 6600, 9900 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3363.7714 StdDev: 2191.08 Min: 102 Median: 2733.3333 Max: 7921 Percentiles: P50: 2733.33 P75: 4858.33 P99: 7921.00 P99.9: 7921.00 P99.99: 7921.00 ------------------------------------------------------ ( 76, 110 ] 1 2.857% 2.857% # ( 110, 170 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 870, 1300 ] 4 11.429% 22.857% ## ( 1300, 1900 ] 2 5.714% 28.571% # ( 1900, 2900 ] 9 25.714% 54.286% ##### ( 2900, 4400 ] 6 17.143% 71.429% ### ( 4400, 6600 ] 6 17.143% 88.571% ### ( 6600, 9900 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 6.1 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 322.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.152 H:M:S, 2.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 337.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/13-11:09:02 ... thread 0: (1000000,3000000) ops and (350571.3,343261.1) ops/second in (2.852487,8.739704) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.34 GB 214.0 2.0 0.0 2.0 4.8 2.8 0.0 1.7 131.4 310.4 15.83 15.06 52 0.304 2111K 2111 0.0 0.0 L1 1/0 2.33 MB 0.2 0.3 0.2 0.1 0.3 0.2 0.2 1.2 247.4 247.1 1.27 1.25 1 1.273 319K 336 0.0 0.0 L2 2/0 55.70 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.5 2.0 247.3 247.2 0.51 0.50 1 0.510 127K 31 0.0 0.0 L3 53/0 984.51 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 213.2 213.0 2.32 2.18 2 1.162 502K 382 0.0 0.0 L4 136/0 9.73 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/4 98.90 GB 0.0 2.9 0.7 2.3 5.7 3.4 0.9 2.1 151.3 293.4 19.93 18.99 56 0.356 3061K 2860 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 0.7 2.3 5.7 3.4 0.8 2.1 151.3 293.4 19.93 18.99 56 0.356 3061K 2860 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 0.7 2.3 2.9 0.7 0.0 0.0 247.8 247.6 12.17 11.81 12 1.014 3061K 2860 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 365.1 7.77 7.18 44 0.176 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.7 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.71 GB write, 652.94 MB/s write, 2.94 GB read, 336.70 MB/s read, 19.9 seconds Interval compaction: 5.71 GB write, 668.99 MB/s write, 2.94 GB read, 344.98 MB/s read, 19.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 655849 Average: 2.0887 StdDev: 7.99 Min: 0 Median: 1.4266 Max: 1629 Percentiles: P50: 1.43 P75: 1.81 P99: 5.70 P99.9: 12.19 P99.99: 26.21 ------------------------------------------------------ [ 0, 1 ] 146245 22.299% 22.299% #### ( 1, 2 ] 425909 64.940% 87.239% ############# ( 2, 3 ] 50573 7.711% 94.950% ## ( 3, 4 ] 18095 2.759% 97.709% # ( 4, 6 ] 9987 1.523% 99.232% ( 6, 10 ] 3984 0.607% 99.839% ( 10, 15 ] 916 0.140% 99.979% ( 15, 22 ] 67 0.010% 99.989% ( 22, 34 ] 24 0.004% 99.993% ( 34, 51 ] 3 0.000% 99.993% ( 51, 76 ] 9 0.001% 99.994% ( 76, 110 ] 3 0.000% 99.995% ( 170, 250 ] 35 0.005% 100.000% ( 250, 380 ] 22 0.003% 100.004% ( 380, 580 ] 26 0.004% 100.007% ( 580, 870 ] 6 0.001% 100.008% ( 870, 1300 ] 4 0.001% 100.009% ( 1300, 1900 ] 11 0.002% 100.011% ** Level 1 read latency histogram (micros): Count: 65403 Average: 2.4408 StdDev: 13.65 Min: 1 Median: 1.5966 Max: 2499 Percentiles: P50: 1.60 P75: 1.97 P99: 6.30 P99.9: 13.86 P99.99: 309.76 ------------------------------------------------------ [ 0, 1 ] 6554 10.021% 10.021% ## ( 1, 2 ] 43828 67.012% 77.033% ############# ( 2, 3 ] 8899 13.606% 90.640% ### ( 3, 4 ] 3090 4.725% 95.364% # ( 4, 6 ] 2339 3.576% 98.940% # ( 6, 10 ] 514 0.786% 99.726% ( 10, 15 ] 147 0.225% 99.951% ( 15, 22 ] 19 0.029% 99.980% ( 22, 34 ] 1 0.002% 99.982% ( 34, 51 ] 1 0.002% 99.983% ( 110, 170 ] 2 0.003% 99.986% ( 170, 250 ] 2 0.003% 99.989% ( 250, 380 ] 1 0.002% 99.991% ( 380, 580 ] 2 0.003% 99.994% ( 580, 870 ] 2 0.003% 99.997% ( 1900, 2900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31749 Average: 1.7541 StdDev: 4.98 Min: 1 Median: 1.2196 Max: 771 Percentiles: P50: 1.22 P75: 1.65 P99: 3.60 P99.9: 10.22 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 11821 37.233% 37.233% ####### ( 1, 2 ] 18459 58.140% 95.373% ############ ( 2, 3 ] 993 3.128% 98.501% # ( 3, 4 ] 263 0.828% 99.329% ( 4, 6 ] 64 0.202% 99.531% ( 6, 10 ] 116 0.365% 99.896% ( 10, 15 ] 29 0.091% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28958 Average: 6.3794 StdDev: 128.13 Min: 0 Median: 1.5888 Max: 6808 Percentiles: P50: 1.59 P75: 1.97 P99: 7.79 P99.9: 1603.15 P99.99: 6381.03 ------------------------------------------------------ [ 0, 1 ] 3231 11.158% 11.158% ## ( 1, 2 ] 19102 65.965% 77.122% ############# ( 2, 3 ] 3786 13.074% 90.196% ### ( 3, 4 ] 1452 5.014% 95.210% # ( 4, 6 ] 988 3.412% 98.622% # ( 6, 10 ] 244 0.843% 99.465% ( 10, 15 ] 86 0.297% 99.762% ( 15, 22 ] 9 0.031% 99.793% ( 22, 34 ] 9 0.031% 99.824% ( 34, 51 ] 1 0.003% 99.827% ( 110, 170 ] 8 0.028% 99.855% ( 170, 250 ] 3 0.010% 99.865% ( 250, 380 ] 1 0.003% 99.869% ( 380, 580 ] 2 0.007% 99.876% ( 870, 1300 ] 3 0.010% 99.886% ( 1300, 1900 ] 8 0.028% 99.914% ( 1900, 2900 ] 11 0.038% 99.952% ( 2900, 4400 ] 3 0.010% 99.962% ( 4400, 6600 ] 9 0.031% 99.993% ( 6600, 9900 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3363.7714 StdDev: 2191.08 Min: 102 Median: 2733.3333 Max: 7921 Percentiles: P50: 2733.33 P75: 4858.33 P99: 7921.00 P99.9: 7921.00 P99.99: 7921.00 ------------------------------------------------------ ( 76, 110 ] 1 2.857% 2.857% # ( 110, 170 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 870, 1300 ] 4 11.429% 22.857% ## ( 1300, 1900 ] 2 5.714% 28.571% # ( 1900, 2900 ] 9 25.714% 54.286% ##### ( 2900, 4400 ] 6 17.143% 71.429% ### ( 4400, 6600 ] 6 17.143% 88.571% ### ( 6600, 9900 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 9.0 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 329.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.152 H:M:S, 1.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 345.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/13-11:09:05 ... thread 0: (1000000,4000000) ops and (348998.0,344677.5) ops/second in (2.865346,11.605050) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 3.26 GB 283.2 2.8 0.0 2.8 6.5 3.7 0.0 1.7 132.6 309.3 21.38 20.34 70 0.305 2878K 2802 0.0 0.0 L1 1/0 2.33 MB 0.2 0.3 0.2 0.1 0.3 0.2 0.2 1.2 247.4 247.1 1.27 1.25 1 1.273 319K 336 0.0 0.0 L2 2/0 55.70 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.5 2.0 247.3 247.2 0.51 0.50 1 0.510 127K 31 0.0 0.0 L3 53/0 984.51 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 213.2 213.0 2.32 2.18 2 1.162 502K 382 0.0 0.0 L4 136/0 9.73 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/8 99.82 GB 0.0 3.7 0.7 3.0 7.4 4.4 0.9 2.0 148.0 296.2 25.48 24.27 74 0.344 3829K 3551 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 0.7 3.0 7.4 4.4 0.8 2.0 148.0 296.2 25.48 24.27 74 0.344 3829K 3551 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 0.7 3.0 3.7 0.7 0.0 0.0 248.9 248.7 15.15 14.74 15 1.010 3829K 3551 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 365.8 10.33 9.53 59 0.175 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.8 total, 11.6 interval Flush(GB): cumulative 3.692, interval 3.692 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.37 GB write, 638.51 MB/s write, 3.68 GB read, 319.04 MB/s read, 25.5 seconds Interval compaction: 7.37 GB write, 650.33 MB/s write, 3.68 GB read, 324.95 MB/s read, 25.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 894165 Average: 2.0691 StdDev: 7.56 Min: 0 Median: 1.4185 Max: 1629 Percentiles: P50: 1.42 P75: 1.80 P99: 5.65 P99.9: 12.13 P99.99: 23.39 ------------------------------------------------------ [ 0, 1 ] 203618 22.772% 22.772% ##### ( 1, 2 ] 581803 65.067% 87.838% ############# ( 2, 3 ] 66303 7.415% 95.254% # ( 3, 4 ] 23274 2.603% 97.856% # ( 4, 6 ] 12389 1.386% 99.242% ( 6, 10 ] 5352 0.599% 99.841% ( 10, 15 ] 1252 0.140% 99.981% ( 15, 22 ] 83 0.009% 99.990% ( 22, 34 ] 31 0.003% 99.993% ( 34, 51 ] 5 0.001% 99.994% ( 51, 76 ] 11 0.001% 99.995% ( 76, 110 ] 4 0.000% 99.996% ( 170, 250 ] 49 0.005% 100.001% ( 250, 380 ] 29 0.003% 100.004% ( 380, 580 ] 36 0.004% 100.008% ( 580, 870 ] 7 0.001% 100.009% ( 870, 1300 ] 7 0.001% 100.010% ( 1300, 1900 ] 12 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 65403 Average: 2.4408 StdDev: 13.65 Min: 1 Median: 1.5966 Max: 2499 Percentiles: P50: 1.60 P75: 1.97 P99: 6.30 P99.9: 13.86 P99.99: 309.76 ------------------------------------------------------ [ 0, 1 ] 6554 10.021% 10.021% ## ( 1, 2 ] 43828 67.012% 77.033% ############# ( 2, 3 ] 8899 13.606% 90.640% ### ( 3, 4 ] 3090 4.725% 95.364% # ( 4, 6 ] 2339 3.576% 98.940% # ( 6, 10 ] 514 0.786% 99.726% ( 10, 15 ] 147 0.225% 99.951% ( 15, 22 ] 19 0.029% 99.980% ( 22, 34 ] 1 0.002% 99.982% ( 34, 51 ] 1 0.002% 99.983% ( 110, 170 ] 2 0.003% 99.986% ( 170, 250 ] 2 0.003% 99.989% ( 250, 380 ] 1 0.002% 99.991% ( 380, 580 ] 2 0.003% 99.994% ( 580, 870 ] 2 0.003% 99.997% ( 1900, 2900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31749 Average: 1.7541 StdDev: 4.98 Min: 1 Median: 1.2196 Max: 771 Percentiles: P50: 1.22 P75: 1.65 P99: 3.60 P99.9: 10.22 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 11821 37.233% 37.233% ####### ( 1, 2 ] 18459 58.140% 95.373% ############ ( 2, 3 ] 993 3.128% 98.501% # ( 3, 4 ] 263 0.828% 99.329% ( 4, 6 ] 64 0.202% 99.531% ( 6, 10 ] 116 0.365% 99.896% ( 10, 15 ] 29 0.091% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 76, 110 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28958 Average: 6.3794 StdDev: 128.13 Min: 0 Median: 1.5888 Max: 6808 Percentiles: P50: 1.59 P75: 1.97 P99: 7.79 P99.9: 1603.15 P99.99: 6381.03 ------------------------------------------------------ [ 0, 1 ] 3231 11.158% 11.158% ## ( 1, 2 ] 19102 65.965% 77.122% ############# ( 2, 3 ] 3786 13.074% 90.196% ### ( 3, 4 ] 1452 5.014% 95.210% # ( 4, 6 ] 988 3.412% 98.622% # ( 6, 10 ] 244 0.843% 99.465% ( 10, 15 ] 86 0.297% 99.762% ( 15, 22 ] 9 0.031% 99.793% ( 22, 34 ] 9 0.031% 99.824% ( 34, 51 ] 1 0.003% 99.827% ( 110, 170 ] 8 0.028% 99.855% ( 170, 250 ] 3 0.010% 99.865% ( 250, 380 ] 1 0.003% 99.869% ( 380, 580 ] 2 0.007% 99.876% ( 870, 1300 ] 3 0.010% 99.886% ( 1300, 1900 ] 8 0.028% 99.914% ( 1900, 2900 ] 11 0.038% 99.952% ( 2900, 4400 ] 3 0.010% 99.962% ( 4400, 6600 ] 9 0.031% 99.993% ( 6600, 9900 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3363.7714 StdDev: 2191.08 Min: 102 Median: 2733.3333 Max: 7921 Percentiles: P50: 2733.33 P75: 4858.33 P99: 7921.00 P99.9: 7921.00 P99.99: 7921.00 ------------------------------------------------------ ( 76, 110 ] 1 2.857% 2.857% # ( 110, 170 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 870, 1300 ] 4 11.429% 22.857% ## ( 1300, 1900 ] 2 5.714% 28.571% # ( 1900, 2900 ] 9 25.714% 54.286% ##### ( 2900, 4400 ] 6 17.143% 71.429% ### ( 4400, 6600 ] 6 17.143% 88.571% ### ( 6600, 9900 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 11.8 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 333.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.152 H:M:S, 1.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 343.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-11:09:23 ... thread 0: (1000000,5000000) ops and (54918.2,167706.8) ops/second in (18.208895,29.813945) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/0 629.43 MB 62.9 4.0 0.0 4.0 8.7 4.7 0.0 1.8 140.6 307.0 29.13 27.82 92 0.317 4158K 4093 0.0 0.0 L1 6/5 676.93 MB 3.3 4.0 3.9 0.1 3.9 3.9 0.2 1.0 231.6 227.7 17.68 16.65 2 8.839 4156K 68K 0.0 0.0 L2 17/9 1.88 GB 10.3 0.1 0.1 0.1 0.1 0.1 3.4 2.0 247.3 247.2 0.51 0.50 1 0.510 127K 31 0.0 0.0 L3 45/30 2.00 GB 1.0 0.5 0.4 0.1 0.5 0.4 1.2 1.3 213.2 213.0 2.32 2.18 2 1.162 502K 382 0.0 0.0 L4 153/3 9.83 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1281/47 100.80 GB 0.0 8.6 4.4 4.2 13.3 9.0 5.1 2.8 177.5 273.7 49.64 47.16 97 0.512 8945K 73K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.6 4.4 4.2 13.3 9.0 5.0 2.8 177.5 273.7 49.64 47.16 97 0.512 8945K 73K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.6 4.4 4.2 8.5 4.3 0.0 0.0 242.5 240.5 36.33 34.85 21 1.730 8945K 73K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 364.6 13.30 12.30 76 0.175 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.0 total, 29.8 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.27 GB write, 452.47 MB/s write, 8.60 GB read, 293.38 MB/s read, 49.6 seconds Interval compaction: 13.27 GB write, 455.74 MB/s write, 8.60 GB read, 295.49 MB/s read, 49.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 4, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2110125 Average: 2.3799 StdDev: 9.89 Min: 0 Median: 1.3696 Max: 1629 Percentiles: P50: 1.37 P75: 1.75 P99: 6.75 P99.9: 149.42 P99.99: 249.08 ------------------------------------------------------ [ 0, 1 ] 547045 25.925% 25.925% ##### ( 1, 2 ] 1374424 65.135% 91.059% ############# ( 2, 3 ] 103782 4.918% 95.978% # ( 3, 4 ] 41709 1.977% 97.954% ( 4, 6 ] 19206 0.910% 98.865% ( 6, 10 ] 15165 0.719% 99.583% ( 10, 15 ] 1901 0.090% 99.673% ( 15, 22 ] 374 0.018% 99.691% ( 22, 34 ] 56 0.003% 99.694% ( 34, 51 ] 7 0.000% 99.694% ( 51, 76 ] 12 0.001% 99.695% ( 76, 110 ] 1521 0.072% 99.767% ( 110, 170 ] 4281 0.203% 99.970% ( 170, 250 ] 436 0.021% 99.990% ( 250, 380 ] 234 0.011% 100.001% ( 380, 580 ] 75 0.004% 100.005% ( 580, 870 ] 21 0.001% 100.006% ( 870, 1300 ] 8 0.000% 100.006% ( 1300, 1900 ] 14 0.001% 100.007% ** Level 1 read latency histogram (micros): Count: 103465 Average: 3.6243 StdDev: 39.23 Min: 0 Median: 1.7406 Max: 4015 Percentiles: P50: 1.74 P75: 2.54 P99: 8.41 P99.9: 22.80 P99.99: 156.96 ------------------------------------------------------ [ 0, 1 ] 7327 7.082% 7.082% # ( 1, 2 ] 59963 57.955% 65.036% ############ ( 2, 3 ] 19171 18.529% 83.565% #### ( 3, 4 ] 7737 7.478% 91.043% # ( 4, 6 ] 7387 7.140% 98.183% # ( 6, 10 ] 1410 1.363% 99.546% ( 10, 15 ] 336 0.325% 99.870% ( 15, 22 ] 34 0.033% 99.903% ( 22, 34 ] 8 0.008% 99.911% ( 34, 51 ] 3 0.003% 99.914% ( 51, 76 ] 2 0.002% 99.916% ( 76, 110 ] 29 0.028% 99.944% ( 110, 170 ] 66 0.064% 100.008% ( 170, 250 ] 25 0.024% 100.032% ( 250, 380 ] 21 0.020% 100.052% ( 380, 580 ] 41 0.040% 100.092% ( 580, 870 ] 29 0.028% 100.120% ( 870, 1300 ] 1 0.001% 100.121% ( 1900, 2900 ] 6 0.006% 100.127% ( 2900, 4400 ] 8 0.008% 100.134% ** Level 2 read latency histogram (micros): Count: 31756 Average: 2.0209 StdDev: 27.83 Min: 1 Median: 1.2198 Max: 3406 Percentiles: P50: 1.22 P75: 1.65 P99: 3.63 P99.9: 11.42 P99.99: 699.54 ------------------------------------------------------ [ 0, 1 ] 11821 37.224% 37.224% ####### ( 1, 2 ] 18459 58.128% 95.352% ############ ( 2, 3 ] 993 3.127% 98.479% # ( 3, 4 ] 263 0.828% 99.307% ( 4, 6 ] 64 0.202% 99.509% ( 6, 10 ] 116 0.365% 99.874% ( 10, 15 ] 29 0.091% 99.965% ( 15, 22 ] 1 0.003% 99.969% ( 76, 110 ] 1 0.003% 99.972% ( 110, 170 ] 1 0.003% 99.975% ( 170, 250 ] 1 0.003% 99.978% ( 250, 380 ] 2 0.006% 99.984% ( 380, 580 ] 1 0.003% 99.987% ( 580, 870 ] 2 0.006% 99.994% ( 2900, 4400 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 39207 Average: 11.1558 StdDev: 139.08 Min: 0 Median: 1.6960 Max: 6808 Percentiles: P50: 1.70 P75: 2.45 P99: 196.64 P99.9: 1834.16 P99.99: 3751.18 ------------------------------------------------------ [ 0, 1 ] 3456 8.815% 8.815% ## ( 1, 2 ] 23199 59.171% 67.985% ############ ( 2, 3 ] 6134 15.645% 83.630% ### ( 3, 4 ] 2776 7.080% 90.711% # ( 4, 6 ] 2239 5.711% 96.422% # ( 6, 10 ] 550 1.403% 97.824% ( 10, 15 ] 206 0.525% 98.350% ( 15, 22 ] 32 0.082% 98.431% ( 22, 34 ] 14 0.036% 98.467% ( 34, 51 ] 1 0.003% 98.470% ( 51, 76 ] 2 0.005% 98.475% ( 76, 110 ] 3 0.008% 98.482% ( 110, 170 ] 135 0.344% 98.827% ( 170, 250 ] 207 0.528% 99.355% ( 250, 380 ] 115 0.293% 99.648% ( 380, 580 ] 67 0.171% 99.819% ( 580, 870 ] 17 0.043% 99.862% ( 870, 1300 ] 6 0.015% 99.878% ( 1300, 1900 ] 11 0.028% 99.906% ( 1900, 2900 ] 25 0.064% 99.969% ( 2900, 4400 ] 16 0.041% 100.010% ( 4400, 6600 ] 9 0.023% 100.033% ( 6600, 9900 ] 2 0.005% 100.038% ** Level 4 read latency histogram (micros): Count: 35 Average: 3363.7714 StdDev: 2191.08 Min: 102 Median: 2733.3333 Max: 7921 Percentiles: P50: 2733.33 P75: 4858.33 P99: 7921.00 P99.9: 7921.00 P99.99: 7921.00 ------------------------------------------------------ ( 76, 110 ] 1 2.857% 2.857% # ( 110, 170 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 870, 1300 ] 4 11.429% 22.857% ## ( 1300, 1900 ] 2 5.714% 28.571% # ( 1900, 2900 ] 9 25.714% 54.286% ##### ( 2900, 4400 ] 6 17.143% 71.429% ### ( 4400, 6600 ] 6 17.143% 88.571% ### ( 6600, 9900 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 30.0 total, 18.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 163.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.221 H:M:S, 50.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 54.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:15.069 H:M:S, 82.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/13-11:09:29 ... thread 0: (1000000,6000000) ops and (159008.4,166191.5) ops/second in (6.288974,36.102919) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 1.54 GB 18.9 4.6 0.0 4.6 10.3 5.7 0.0 1.8 123.4 274.7 38.28 33.37 105 0.365 4797K 4828 0.0 0.0 L1 1/1 33.03 MB 0.0 4.0 3.9 0.1 3.9 3.9 0.2 1.0 231.6 227.7 17.68 16.65 2 8.839 4156K 68K 0.0 0.0 L2 2/0 82.13 MB 0.8 0.8 0.7 0.1 0.8 0.7 3.4 1.2 145.0 144.7 5.69 4.20 2 2.843 183K 31 0.0 0.0 L3 19/2 1.15 GB 1.0 3.6 2.4 1.3 3.6 2.4 1.7 1.5 126.1 125.9 29.57 18.81 22 1.344 3652K 2580 0.0 0.0 L4 175/7 9.77 GB 1.0 2.1 2.0 0.2 2.1 2.0 1.5 1.1 122.8 122.5 17.71 11.45 26 0.681 2209K 5192 0.0 0.0 L5 1096/0 89.14 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/17 101.71 GB 0.0 15.2 9.0 6.2 20.8 14.5 10.1 3.7 142.7 195.2 108.92 84.48 157 0.694 14M 81K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.2 9.0 6.2 20.8 14.5 10.0 3.7 142.7 195.2 108.92 84.48 157 0.694 14M 81K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.2 9.0 6.2 15.1 8.9 0.0 0.0 173.0 172.0 89.88 69.38 70 1.284 14M 81K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 304.4 19.04 15.10 87 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.3 total, 36.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.76 GB write, 585.27 MB/s write, 15.18 GB read, 428.09 MB/s read, 108.9 seconds Interval compaction: 20.76 GB write, 588.75 MB/s write, 15.18 GB read, 430.64 MB/s read, 108.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 52, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 52, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2301007 Average: 2.5809 StdDev: 24.79 Min: 0 Median: 1.4056 Max: 12882 Percentiles: P50: 1.41 P75: 1.80 P99: 7.26 P99.9: 151.83 P99.99: 336.21 ------------------------------------------------------ [ 0, 1 ] 553826 24.069% 24.069% ##### ( 1, 2 ] 1471017 63.929% 87.998% ############# ( 2, 3 ] 146957 6.387% 94.385% # ( 3, 4 ] 59806 2.599% 96.984% # ( 4, 6 ] 40480 1.759% 98.743% ( 6, 10 ] 18703 0.813% 99.556% ( 10, 15 ] 2809 0.122% 99.678% ( 15, 22 ] 444 0.019% 99.697% ( 22, 34 ] 60 0.003% 99.700% ( 34, 51 ] 8 0.000% 99.700% ( 51, 76 ] 13 0.001% 99.701% ( 76, 110 ] 1522 0.066% 99.767% ( 110, 170 ] 4392 0.191% 99.958% ( 170, 250 ] 534 0.023% 99.981% ( 250, 380 ] 312 0.014% 99.995% ( 380, 580 ] 117 0.005% 100.000% ( 580, 870 ] 48 0.002% 100.002% ( 870, 1300 ] 24 0.001% 100.003% ( 1300, 1900 ] 28 0.001% 100.004% ( 1900, 2900 ] 13 0.001% 100.005% ( 2900, 4400 ] 30 0.001% 100.006% ( 4400, 6600 ] 4 0.000% 100.006% ( 6600, 9900 ] 6 0.000% 100.006% ( 9900, 14000 ] 1 0.000% 100.006% ** Level 1 read latency histogram (micros): Count: 869156 Average: 8.9739 StdDev: 187.96 Min: 0 Median: 2.1166 Max: 19780 Percentiles: P50: 2.12 P75: 3.15 P99: 9.57 P99.9: 15.58 P99.99: 137.93 ------------------------------------------------------ [ 0, 1 ] 17168 1.975% 1.975% ( 1, 2 ] 390635 44.944% 46.919% ######### ( 2, 3 ] 229650 26.422% 73.342% ##### ( 3, 4 ] 95793 11.021% 84.363% ## ( 4, 6 ] 110386 12.700% 97.063% ### ( 6, 10 ] 18868 2.171% 99.234% ( 10, 15 ] 5737 0.660% 99.894% ( 15, 22 ] 597 0.069% 99.963% ( 22, 34 ] 64 0.007% 99.970% ( 34, 51 ] 25 0.003% 99.973% ( 51, 76 ] 15 0.002% 99.975% ( 76, 110 ] 38 0.004% 99.979% ( 110, 170 ] 200 0.023% 100.002% ( 170, 250 ] 255 0.029% 100.032% ( 250, 380 ] 185 0.021% 100.053% ( 380, 580 ] 159 0.018% 100.071% ( 580, 870 ] 126 0.014% 100.086% ( 870, 1300 ] 87 0.010% 100.096% ( 1300, 1900 ] 67 0.008% 100.103% ( 1900, 2900 ] 124 0.014% 100.118% ( 2900, 4400 ] 267 0.031% 100.148% ( 4400, 6600 ] 142 0.016% 100.165% ( 6600, 9900 ] 291 0.033% 100.198% ( 9900, 14000 ] 20 0.002% 100.201% ( 14000, 22000 ] 15 0.002% 100.202% ** Level 2 read latency histogram (micros): Count: 175303 Average: 6.2819 StdDev: 104.08 Min: 1 Median: 1.9494 Max: 7892 Percentiles: P50: 1.95 P75: 2.93 P99: 9.37 P99.9: 17.98 P99.99: 193.29 ------------------------------------------------------ [ 0, 1 ] 12746 7.271% 7.271% # ( 1, 2 ] 78897 45.006% 52.277% ######### ( 2, 3 ] 42964 24.508% 76.785% ##### ( 3, 4 ] 16678 9.514% 86.299% ## ( 4, 6 ] 19432 11.085% 97.384% ## ( 6, 10 ] 3362 1.918% 99.302% ( 10, 15 ] 1004 0.573% 99.875% ( 15, 22 ] 105 0.060% 99.934% ( 22, 34 ] 12 0.007% 99.941% ( 34, 51 ] 4 0.002% 99.944% ( 51, 76 ] 2 0.001% 99.945% ( 76, 110 ] 9 0.005% 99.950% ( 110, 170 ] 53 0.030% 99.980% ( 170, 250 ] 60 0.034% 100.014% ( 250, 380 ] 69 0.039% 100.054% ( 380, 580 ] 50 0.029% 100.082% ( 580, 870 ] 37 0.021% 100.103% ( 870, 1300 ] 27 0.015% 100.119% ( 1300, 1900 ] 16 0.009% 100.128% ( 1900, 2900 ] 35 0.020% 100.148% ( 2900, 4400 ] 74 0.042% 100.190% ( 4400, 6600 ] 14 0.008% 100.198% ( 6600, 9900 ] 4 0.002% 100.200% ** Level 3 read latency histogram (micros): Count: 685944 Average: 11.4373 StdDev: 192.65 Min: 0 Median: 2.0731 Max: 28283 Percentiles: P50: 2.07 P75: 3.13 P99: 12.35 P99.9: 565.73 P99.99: 1085.73 ------------------------------------------------------ [ 0, 1 ] 15894 2.317% 2.317% ( 1, 2 ] 314345 45.827% 48.144% ######### ( 2, 3 ] 174107 25.382% 73.526% ##### ( 3, 4 ] 75002 10.934% 84.460% ## ( 4, 6 ] 82898 12.085% 96.545% ## ( 6, 10 ] 14607 2.129% 98.675% ( 10, 15 ] 4739 0.691% 99.366% ( 15, 22 ] 467 0.068% 99.434% ( 22, 34 ] 78 0.011% 99.445% ( 34, 51 ] 37 0.005% 99.450% ( 51, 76 ] 8 0.001% 99.452% ( 76, 110 ] 26 0.004% 99.455% ( 110, 170 ] 690 0.101% 99.556% ( 170, 250 ] 940 0.137% 99.693% ( 250, 380 ] 809 0.118% 99.811% ( 380, 580 ] 658 0.096% 99.907% ( 580, 870 ] 451 0.066% 99.973% ( 870, 1300 ] 238 0.035% 100.007% ( 1300, 1900 ] 153 0.022% 100.030% ( 1900, 2900 ] 280 0.041% 100.070% ( 2900, 4400 ] 397 0.058% 100.128% ( 4400, 6600 ] 117 0.017% 100.145% ( 6600, 9900 ] 124 0.018% 100.163% ( 9900, 14000 ] 21 0.003% 100.166% ( 14000, 22000 ] 10 0.001% 100.168% ( 22000, 33000 ] 3 0.000% 100.168% ** Level 4 read latency histogram (micros): Count: 8536 Average: 22.4359 StdDev: 276.15 Min: 1 Median: 2.0784 Max: 7921 Percentiles: P50: 2.08 P75: 3.07 P99: 214.69 P99.9: 5174.40 P99.99: 7921.00 ------------------------------------------------------ [ 0, 1 ] 157 1.839% 1.839% ( 1, 2 ] 3935 46.099% 47.938% ######### ( 2, 3 ] 2245 26.300% 74.239% ##### ( 3, 4 ] 903 10.579% 84.817% ## ( 4, 6 ] 959 11.235% 96.052% ## ( 6, 10 ] 187 2.191% 98.243% ( 10, 15 ] 30 0.351% 98.594% ( 15, 22 ] 10 0.117% 98.711% ( 22, 34 ] 3 0.035% 98.746% ( 76, 110 ] 2 0.023% 98.770% ( 110, 170 ] 4 0.047% 98.817% ( 170, 250 ] 28 0.328% 99.145% ( 250, 380 ] 13 0.152% 99.297% ( 380, 580 ] 9 0.105% 99.403% ( 580, 870 ] 8 0.094% 99.496% ( 870, 1300 ] 8 0.094% 99.590% ( 1300, 1900 ] 2 0.023% 99.613% ( 1900, 2900 ] 12 0.141% 99.754% ( 2900, 4400 ] 10 0.117% 99.871% ( 4400, 6600 ] 7 0.082% 99.953% ( 6600, 9900 ] 4 0.047% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1236.3000 StdDev: 1347.49 Min: 101 Median: 702.1053 Max: 8796 Percentiles: P50: 702.11 P75: 1750.00 P99: 6233.33 P99.9: 8796.00 P99.99: 8796.00 ------------------------------------------------------ ( 76, 110 ] 2 1.000% 1.000% ( 110, 170 ] 13 6.500% 7.500% # ( 170, 250 ] 27 13.500% 21.000% ### ( 250, 380 ] 21 10.500% 31.500% ## ( 380, 580 ] 29 14.500% 46.000% ### ( 580, 870 ] 19 9.500% 55.500% ## ( 870, 1300 ] 24 12.000% 67.500% ## ( 1300, 1900 ] 20 10.000% 77.500% ## ( 1900, 2900 ] 21 10.500% 88.000% ## ( 2900, 4400 ] 17 8.500% 96.500% ## ( 4400, 6600 ] 6 3.000% 99.500% # ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 36.3 total, 6.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 162.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.631 H:M:S, 48.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 156.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.409 H:M:S, 38.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/13-11:09:32 ... thread 0: (1000000,7000000) ops and (342420.0,179380.0) ops/second in (2.920390,39.023309) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.46 GB 88.1 5.4 0.0 5.4 12.0 6.6 0.0 1.8 125.6 278.1 44.15 38.97 123 0.359 5629K 5634 0.0 0.0 L1 1/1 33.03 MB 0.0 4.0 3.9 0.1 3.9 3.9 0.2 1.0 231.6 227.7 17.68 16.65 2 8.839 4156K 68K 0.0 0.0 L2 2/0 82.13 MB 0.8 0.8 0.7 0.1 0.8 0.7 3.4 1.2 145.0 144.7 5.69 4.20 2 2.843 183K 31 0.0 0.0 L3 17/0 954.98 MB 1.0 3.6 2.4 1.3 3.6 2.4 1.7 1.5 126.1 125.9 29.57 18.81 22 1.344 3652K 2580 0.0 0.0 L4 171/0 9.68 GB 1.0 2.4 2.2 0.2 2.4 2.2 1.5 1.1 128.4 128.1 19.36 12.85 28 0.691 2525K 6162 0.0 0.0 L5 1100/0 89.45 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/12 102.63 GB 0.0 16.3 9.2 7.1 22.8 15.7 10.4 3.5 143.2 200.4 116.44 91.49 177 0.658 16M 82K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.3 9.2 7.1 22.8 15.7 10.3 3.5 143.2 200.4 116.44 91.49 177 0.658 16M 82K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.3 9.2 7.1 16.2 9.1 0.0 0.0 176.1 175.1 94.73 73.93 75 1.263 16M 82K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 310.5 21.71 17.56 102 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.2 total, 39.0 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.78 GB write, 594.55 MB/s write, 16.29 GB read, 425.03 MB/s read, 116.4 seconds Interval compaction: 22.78 GB write, 597.82 MB/s write, 16.29 GB read, 427.37 MB/s read, 116.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 52, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 52, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2695107 Average: 2.5475 StdDev: 23.06 Min: 0 Median: 1.4333 Max: 12882 Percentiles: P50: 1.43 P75: 1.82 P99: 7.08 P99.9: 144.96 P99.99: 262.05 ------------------------------------------------------ [ 0, 1 ] 595380 22.091% 22.091% #### ( 1, 2 ] 1736112 64.417% 86.508% ############# ( 2, 3 ] 201489 7.476% 93.984% # ( 3, 4 ] 76528 2.840% 96.824% # ( 4, 6 ] 52659 1.954% 98.778% ( 6, 10 ] 22204 0.824% 99.602% ( 10, 15 ] 3370 0.125% 99.727% ( 15, 22 ] 485 0.018% 99.745% ( 22, 34 ] 66 0.002% 99.747% ( 34, 51 ] 8 0.000% 99.747% ( 51, 76 ] 17 0.001% 99.748% ( 76, 110 ] 1522 0.056% 99.805% ( 110, 170 ] 4414 0.164% 99.968% ( 170, 250 ] 553 0.021% 99.989% ( 250, 380 ] 329 0.012% 100.001% ( 380, 580 ] 120 0.004% 100.006% ( 580, 870 ] 52 0.002% 100.007% ( 870, 1300 ] 28 0.001% 100.008% ( 1300, 1900 ] 31 0.001% 100.010% ( 1900, 2900 ] 13 0.000% 100.010% ( 2900, 4400 ] 30 0.001% 100.011% ( 4400, 6600 ] 4 0.000% 100.011% ( 6600, 9900 ] 6 0.000% 100.012% ( 9900, 14000 ] 1 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 873876 Average: 8.9391 StdDev: 187.45 Min: 0 Median: 2.1123 Max: 19780 Percentiles: P50: 2.11 P75: 3.14 P99: 9.57 P99.9: 15.55 P99.99: 137.78 ------------------------------------------------------ [ 0, 1 ] 17406 1.992% 1.992% ( 1, 2 ] 393645 45.046% 47.038% ######### ( 2, 3 ] 230595 26.388% 73.425% ##### ( 3, 4 ] 96052 10.991% 84.417% ## ( 4, 6 ] 110546 12.650% 97.067% ### ( 6, 10 ] 18953 2.169% 99.236% ( 10, 15 ] 5758 0.659% 99.895% ( 15, 22 ] 599 0.069% 99.963% ( 22, 34 ] 64 0.007% 99.970% ( 34, 51 ] 25 0.003% 99.973% ( 51, 76 ] 15 0.002% 99.975% ( 76, 110 ] 38 0.004% 99.979% ( 110, 170 ] 200 0.023% 100.002% ( 170, 250 ] 255 0.029% 100.031% ( 250, 380 ] 185 0.021% 100.053% ( 380, 580 ] 159 0.018% 100.071% ( 580, 870 ] 126 0.014% 100.085% ( 870, 1300 ] 87 0.010% 100.095% ( 1300, 1900 ] 67 0.008% 100.103% ( 1900, 2900 ] 124 0.014% 100.117% ( 2900, 4400 ] 267 0.031% 100.148% ( 4400, 6600 ] 142 0.016% 100.164% ( 6600, 9900 ] 291 0.033% 100.197% ( 9900, 14000 ] 20 0.002% 100.199% ( 14000, 22000 ] 15 0.002% 100.201% ** Level 2 read latency histogram (micros): Count: 175303 Average: 6.2819 StdDev: 104.08 Min: 1 Median: 1.9494 Max: 7892 Percentiles: P50: 1.95 P75: 2.93 P99: 9.37 P99.9: 17.98 P99.99: 193.29 ------------------------------------------------------ [ 0, 1 ] 12746 7.271% 7.271% # ( 1, 2 ] 78897 45.006% 52.277% ######### ( 2, 3 ] 42964 24.508% 76.785% ##### ( 3, 4 ] 16678 9.514% 86.299% ## ( 4, 6 ] 19432 11.085% 97.384% ## ( 6, 10 ] 3362 1.918% 99.302% ( 10, 15 ] 1004 0.573% 99.875% ( 15, 22 ] 105 0.060% 99.934% ( 22, 34 ] 12 0.007% 99.941% ( 34, 51 ] 4 0.002% 99.944% ( 51, 76 ] 2 0.001% 99.945% ( 76, 110 ] 9 0.005% 99.950% ( 110, 170 ] 53 0.030% 99.980% ( 170, 250 ] 60 0.034% 100.014% ( 250, 380 ] 69 0.039% 100.054% ( 380, 580 ] 50 0.029% 100.082% ( 580, 870 ] 37 0.021% 100.103% ( 870, 1300 ] 27 0.015% 100.119% ( 1300, 1900 ] 16 0.009% 100.128% ( 1900, 2900 ] 35 0.020% 100.148% ( 2900, 4400 ] 74 0.042% 100.190% ( 4400, 6600 ] 14 0.008% 100.198% ( 6600, 9900 ] 4 0.002% 100.200% ** Level 3 read latency histogram (micros): Count: 691305 Average: 11.3679 StdDev: 191.91 Min: 0 Median: 2.0658 Max: 28283 Percentiles: P50: 2.07 P75: 3.12 P99: 12.31 P99.9: 564.10 P99.99: 1084.76 ------------------------------------------------------ [ 0, 1 ] 16226 2.347% 2.347% ( 1, 2 ] 317915 45.988% 48.335% ######### ( 2, 3 ] 174996 25.314% 73.649% ##### ( 3, 4 ] 75267 10.888% 84.536% ## ( 4, 6 ] 83070 12.016% 96.553% ## ( 6, 10 ] 14719 2.129% 98.682% ( 10, 15 ] 4758 0.688% 99.370% ( 15, 22 ] 469 0.068% 99.438% ( 22, 34 ] 78 0.011% 99.449% ( 34, 51 ] 37 0.005% 99.455% ( 51, 76 ] 8 0.001% 99.456% ( 76, 110 ] 26 0.004% 99.460% ( 110, 170 ] 690 0.100% 99.559% ( 170, 250 ] 940 0.136% 99.695% ( 250, 380 ] 809 0.117% 99.812% ( 380, 580 ] 658 0.095% 99.908% ( 580, 870 ] 451 0.065% 99.973% ( 870, 1300 ] 238 0.034% 100.007% ( 1300, 1900 ] 153 0.022% 100.029% ( 1900, 2900 ] 280 0.041% 100.070% ( 2900, 4400 ] 397 0.057% 100.127% ( 4400, 6600 ] 117 0.017% 100.144% ( 6600, 9900 ] 124 0.018% 100.162% ( 9900, 14000 ] 21 0.003% 100.165% ( 14000, 22000 ] 10 0.001% 100.167% ( 22000, 33000 ] 3 0.000% 100.167% ** Level 4 read latency histogram (micros): Count: 8571 Average: 22.6465 StdDev: 275.69 Min: 0 Median: 2.0777 Max: 7921 Percentiles: P50: 2.08 P75: 3.08 P99: 227.81 P99.9: 5163.40 P99.99: 7921.00 ------------------------------------------------------ [ 0, 1 ] 171 1.995% 1.995% ( 1, 2 ] 3940 45.969% 47.964% ######### ( 2, 3 ] 2247 26.216% 74.180% ##### ( 3, 4 ] 904 10.547% 84.728% ## ( 4, 6 ] 960 11.201% 95.928% ## ( 6, 10 ] 187 2.182% 98.110% ( 10, 15 ] 30 0.350% 98.460% ( 15, 22 ] 10 0.117% 98.577% ( 22, 34 ] 4 0.047% 98.623% ( 76, 110 ] 2 0.023% 98.647% ( 110, 170 ] 5 0.058% 98.705% ( 170, 250 ] 35 0.408% 99.113% ( 250, 380 ] 16 0.187% 99.300% ( 380, 580 ] 9 0.105% 99.405% ( 580, 870 ] 8 0.093% 99.498% ( 870, 1300 ] 8 0.093% 99.592% ( 1300, 1900 ] 2 0.023% 99.615% ( 1900, 2900 ] 12 0.140% 99.755% ( 2900, 4400 ] 10 0.117% 99.872% ( 4400, 6600 ] 7 0.082% 99.953% ( 6600, 9900 ] 4 0.047% 100.000% ** Level 5 read latency histogram (micros): Count: 220 Average: 1164.1136 StdDev: 1313.11 Min: 101 Median: 623.5000 Max: 8796 Percentiles: P50: 623.50 P75: 1630.00 P99: 6160.00 P99.9: 8796.00 P99.99: 8796.00 ------------------------------------------------------ ( 76, 110 ] 3 1.364% 1.364% ( 110, 170 ] 21 9.545% 10.909% ## ( 170, 250 ] 28 12.727% 23.636% ### ( 250, 380 ] 25 11.364% 35.000% ## ( 380, 580 ] 30 13.636% 48.636% ### ( 580, 870 ] 20 9.091% 57.727% ## ( 870, 1300 ] 27 12.273% 70.000% ## ( 1300, 1900 ] 20 9.091% 79.091% ## ( 1900, 2900 ] 22 10.000% 89.091% ## ( 2900, 4400 ] 17 7.727% 96.818% ## ( 4400, 6600 ] 6 2.727% 99.545% # ( 6600, 9900 ] 1 0.455% 100.000% ** DB Stats ** Uptime(secs): 39.2 total, 2.9 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 175.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.631 H:M:S, 44.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 337.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-11:09:35 ... thread 0: (1000000,8000000) ops and (285390.3,188114.5) ops/second in (3.503973,42.527282) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 195.1 6.4 0.0 6.4 14.0 7.6 0.0 1.8 128.4 281.3 51.04 45.56 144 0.354 6652K 6658 0.0 0.0 L1 13/0 1.38 GB 140.9 5.4 5.3 0.1 5.3 5.2 0.2 1.0 227.7 224.5 24.20 22.90 3 8.066 5562K 68K 0.0 0.0 L2 2/0 82.13 MB 0.8 0.8 0.7 0.1 0.8 0.7 3.4 1.2 145.0 144.7 5.69 4.20 2 2.843 183K 31 0.0 0.0 L3 17/0 954.98 MB 1.0 3.6 2.4 1.3 3.6 2.4 1.7 1.5 126.1 125.9 29.57 18.81 22 1.344 3652K 2580 0.0 0.0 L4 171/0 9.68 GB 1.0 2.4 2.2 0.2 2.4 2.2 1.5 1.1 128.4 128.1 19.36 12.85 28 0.691 2525K 6162 0.0 0.0 L5 1100/0 89.45 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1316/4 103.67 GB 0.0 18.7 10.5 8.1 26.2 18.1 10.4 3.4 147.1 206.5 129.86 104.33 199 0.653 18M 83K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.7 10.5 8.1 26.2 18.1 10.3 3.4 147.1 206.5 129.86 104.33 199 0.653 18M 83K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.7 10.5 8.1 18.6 10.5 0.0 0.0 181.6 180.7 105.17 84.02 80 1.315 18M 83K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 316.5 24.68 20.30 119 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.7 total, 42.5 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.19 GB write, 627.38 MB/s write, 18.66 GB read, 446.93 MB/s read, 129.9 seconds Interval compaction: 26.19 GB write, 630.55 MB/s write, 18.66 GB read, 449.19 MB/s read, 129.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 52, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 52, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3131807 Average: 2.5144 StdDev: 21.47 Min: 0 Median: 1.4506 Max: 12882 Percentiles: P50: 1.45 P75: 1.84 P99: 7.00 P99.9: 138.72 P99.99: 235.10 ------------------------------------------------------ [ 0, 1 ] 651006 20.787% 20.787% #### ( 1, 2 ] 2030267 64.827% 85.614% ############# ( 2, 3 ] 256048 8.176% 93.790% ## ( 3, 4 ] 93109 2.973% 96.763% # ( 4, 6 ] 63459 2.026% 98.789% ( 6, 10 ] 26317 0.840% 99.630% ( 10, 15 ] 4122 0.132% 99.761% ( 15, 22 ] 550 0.018% 99.779% ( 22, 34 ] 76 0.002% 99.781% ( 34, 51 ] 8 0.000% 99.781% ( 51, 76 ] 22 0.001% 99.782% ( 76, 110 ] 1539 0.049% 99.831% ( 110, 170 ] 4499 0.144% 99.975% ( 170, 250 ] 581 0.019% 99.993% ( 250, 380 ] 347 0.011% 100.005% ( 380, 580 ] 133 0.004% 100.009% ( 580, 870 ] 54 0.002% 100.011% ( 870, 1300 ] 30 0.001% 100.011% ( 1300, 1900 ] 31 0.001% 100.012% ( 1900, 2900 ] 13 0.000% 100.013% ( 2900, 4400 ] 30 0.001% 100.014% ( 4400, 6600 ] 4 0.000% 100.014% ( 6600, 9900 ] 6 0.000% 100.014% ( 9900, 14000 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 882329 Average: 8.9074 StdDev: 186.61 Min: 0 Median: 2.1041 Max: 19780 Percentiles: P50: 2.10 P75: 3.13 P99: 9.58 P99.9: 16.56 P99.99: 151.99 ------------------------------------------------------ [ 0, 1 ] 17827 2.020% 2.020% ( 1, 2 ] 399169 45.240% 47.261% ######### ( 2, 3 ] 232101 26.305% 73.566% ##### ( 3, 4 ] 96441 10.930% 84.497% ## ( 4, 6 ] 110881 12.567% 97.063% ### ( 6, 10 ] 19104 2.165% 99.229% ( 10, 15 ] 5790 0.656% 99.885% ( 15, 22 ] 601 0.068% 99.953% ( 22, 34 ] 64 0.007% 99.960% ( 34, 51 ] 25 0.003% 99.963% ( 51, 76 ] 15 0.002% 99.965% ( 76, 110 ] 59 0.007% 99.971% ( 110, 170 ] 234 0.027% 99.998% ( 170, 250 ] 265 0.030% 100.028% ( 250, 380 ] 191 0.022% 100.050% ( 380, 580 ] 169 0.019% 100.069% ( 580, 870 ] 136 0.015% 100.084% ( 870, 1300 ] 87 0.010% 100.094% ( 1300, 1900 ] 67 0.008% 100.102% ( 1900, 2900 ] 126 0.014% 100.116% ( 2900, 4400 ] 267 0.030% 100.146% ( 4400, 6600 ] 142 0.016% 100.162% ( 6600, 9900 ] 291 0.033% 100.195% ( 9900, 14000 ] 20 0.002% 100.198% ( 14000, 22000 ] 15 0.002% 100.199% ** Level 2 read latency histogram (micros): Count: 175303 Average: 6.2819 StdDev: 104.08 Min: 1 Median: 1.9494 Max: 7892 Percentiles: P50: 1.95 P75: 2.93 P99: 9.37 P99.9: 17.98 P99.99: 193.29 ------------------------------------------------------ [ 0, 1 ] 12746 7.271% 7.271% # ( 1, 2 ] 78897 45.006% 52.277% ######### ( 2, 3 ] 42964 24.508% 76.785% ##### ( 3, 4 ] 16678 9.514% 86.299% ## ( 4, 6 ] 19432 11.085% 97.384% ## ( 6, 10 ] 3362 1.918% 99.302% ( 10, 15 ] 1004 0.573% 99.875% ( 15, 22 ] 105 0.060% 99.934% ( 22, 34 ] 12 0.007% 99.941% ( 34, 51 ] 4 0.002% 99.944% ( 51, 76 ] 2 0.001% 99.945% ( 76, 110 ] 9 0.005% 99.950% ( 110, 170 ] 53 0.030% 99.980% ( 170, 250 ] 60 0.034% 100.014% ( 250, 380 ] 69 0.039% 100.054% ( 380, 580 ] 50 0.029% 100.082% ( 580, 870 ] 37 0.021% 100.103% ( 870, 1300 ] 27 0.015% 100.119% ( 1300, 1900 ] 16 0.009% 100.128% ( 1900, 2900 ] 35 0.020% 100.148% ( 2900, 4400 ] 74 0.042% 100.190% ( 4400, 6600 ] 14 0.008% 100.198% ( 6600, 9900 ] 4 0.002% 100.200% ** Level 3 read latency histogram (micros): Count: 691305 Average: 11.3679 StdDev: 191.91 Min: 0 Median: 2.0658 Max: 28283 Percentiles: P50: 2.07 P75: 3.12 P99: 12.31 P99.9: 564.10 P99.99: 1084.76 ------------------------------------------------------ [ 0, 1 ] 16226 2.347% 2.347% ( 1, 2 ] 317915 45.988% 48.335% ######### ( 2, 3 ] 174996 25.314% 73.649% ##### ( 3, 4 ] 75267 10.888% 84.536% ## ( 4, 6 ] 83070 12.016% 96.553% ## ( 6, 10 ] 14719 2.129% 98.682% ( 10, 15 ] 4758 0.688% 99.370% ( 15, 22 ] 469 0.068% 99.438% ( 22, 34 ] 78 0.011% 99.449% ( 34, 51 ] 37 0.005% 99.455% ( 51, 76 ] 8 0.001% 99.456% ( 76, 110 ] 26 0.004% 99.460% ( 110, 170 ] 690 0.100% 99.559% ( 170, 250 ] 940 0.136% 99.695% ( 250, 380 ] 809 0.117% 99.812% ( 380, 580 ] 658 0.095% 99.908% ( 580, 870 ] 451 0.065% 99.973% ( 870, 1300 ] 238 0.034% 100.007% ( 1300, 1900 ] 153 0.022% 100.029% ( 1900, 2900 ] 280 0.041% 100.070% ( 2900, 4400 ] 397 0.057% 100.127% ( 4400, 6600 ] 117 0.017% 100.144% ( 6600, 9900 ] 124 0.018% 100.162% ( 9900, 14000 ] 21 0.003% 100.165% ( 14000, 22000 ] 10 0.001% 100.167% ( 22000, 33000 ] 3 0.000% 100.167% ** Level 4 read latency histogram (micros): Count: 8571 Average: 22.6465 StdDev: 275.69 Min: 0 Median: 2.0777 Max: 7921 Percentiles: P50: 2.08 P75: 3.08 P99: 227.81 P99.9: 5163.40 P99.99: 7921.00 ------------------------------------------------------ [ 0, 1 ] 171 1.995% 1.995% ( 1, 2 ] 3940 45.969% 47.964% ######### ( 2, 3 ] 2247 26.216% 74.180% ##### ( 3, 4 ] 904 10.547% 84.728% ## ( 4, 6 ] 960 11.201% 95.928% ## ( 6, 10 ] 187 2.182% 98.110% ( 10, 15 ] 30 0.350% 98.460% ( 15, 22 ] 10 0.117% 98.577% ( 22, 34 ] 4 0.047% 98.623% ( 76, 110 ] 2 0.023% 98.647% ( 110, 170 ] 5 0.058% 98.705% ( 170, 250 ] 35 0.408% 99.113% ( 250, 380 ] 16 0.187% 99.300% ( 380, 580 ] 9 0.105% 99.405% ( 580, 870 ] 8 0.093% 99.498% ( 870, 1300 ] 8 0.093% 99.592% ( 1300, 1900 ] 2 0.023% 99.615% ( 1900, 2900 ] 12 0.140% 99.755% ( 2900, 4400 ] 10 0.117% 99.872% ( 4400, 6600 ] 7 0.082% 99.953% ( 6600, 9900 ] 4 0.047% 100.000% ** Level 5 read latency histogram (micros): Count: 220 Average: 1164.1136 StdDev: 1313.11 Min: 101 Median: 623.5000 Max: 8796 Percentiles: P50: 623.50 P75: 1630.00 P99: 6160.00 P99.9: 8796.00 P99.99: 8796.00 ------------------------------------------------------ ( 76, 110 ] 3 1.364% 1.364% ( 110, 170 ] 21 9.545% 10.909% ## ( 170, 250 ] 28 12.727% 23.636% ### ( 250, 380 ] 25 11.364% 35.000% ## ( 380, 580 ] 30 13.636% 48.636% ### ( 580, 870 ] 20 9.091% 57.727% ## ( 870, 1300 ] 27 12.273% 70.000% ## ( 1300, 1900 ] 20 9.091% 79.091% ## ( 1900, 2900 ] 22 10.000% 89.091% ## ( 2900, 4400 ] 17 7.727% 96.818% ## ( 4400, 6600 ] 6 2.727% 99.545% # ( 6600, 9900 ] 1 0.455% 100.000% ** DB Stats ** Uptime(secs): 42.7 total, 3.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 184.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.174 H:M:S, 42.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 280.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.543 H:M:S, 15.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/13-11:09:39 ... thread 0: (1000000,9000000) ops and (324666.7,197336.6) ops/second in (3.080082,45.607364) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.07 GB 62.9 7.1 0.0 7.1 15.7 8.5 0.0 1.8 129.3 284.0 56.54 50.83 162 0.349 7420K 7418 0.0 0.0 L1 13/13 1.38 GB 0.0 5.4 5.3 0.1 5.3 5.2 0.2 1.0 227.7 224.5 24.20 22.90 3 8.066 5562K 68K 0.0 0.0 L2 2/0 82.13 MB 0.8 0.8 0.7 0.1 0.8 0.7 3.4 1.2 145.0 144.7 5.69 4.20 2 2.843 183K 31 0.0 0.0 L3 17/0 954.98 MB 1.0 3.6 2.4 1.3 3.6 2.4 1.7 1.5 126.1 125.9 29.57 18.81 22 1.344 3652K 2580 0.0 0.0 L4 171/0 9.68 GB 1.0 2.4 2.2 0.2 2.4 2.2 1.5 1.1 128.4 128.1 19.36 12.85 28 0.691 2525K 6162 0.0 0.0 L5 1100/0 89.45 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1322/28 104.59 GB 0.0 19.4 10.5 8.8 27.8 19.0 10.4 3.3 146.7 210.7 135.36 109.59 217 0.624 19M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.4 10.5 8.8 27.8 19.0 10.3 3.3 146.7 210.7 135.36 109.59 217 0.624 19M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.4 10.5 8.8 19.3 10.5 0.0 0.0 183.8 182.9 108.05 86.85 83 1.302 19M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 320.7 27.31 22.74 134 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.8 total, 45.6 interval Flush(GB): cumulative 8.552, interval 8.552 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.85 GB write, 622.31 MB/s write, 19.39 GB read, 433.39 MB/s read, 135.4 seconds Interval compaction: 27.85 GB write, 625.25 MB/s write, 19.39 GB read, 435.43 MB/s read, 135.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 52, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 52, interval: 72 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3411238 Average: 2.4977 StdDev: 20.67 Min: 0 Median: 1.4572 Max: 12882 Percentiles: P50: 1.46 P75: 1.84 P99: 6.86 P99.9: 135.74 P99.99: 227.65 ------------------------------------------------------ [ 0, 1 ] 689565 20.215% 20.215% #### ( 1, 2 ] 2222294 65.146% 85.361% ############# ( 2, 3 ] 287027 8.414% 93.775% ## ( 3, 4 ] 102822 3.014% 96.789% # ( 4, 6 ] 69381 2.034% 98.823% ( 6, 10 ] 27967 0.820% 99.643% ( 10, 15 ] 4512 0.132% 99.775% ( 15, 22 ] 590 0.017% 99.792% ( 22, 34 ] 82 0.002% 99.795% ( 34, 51 ] 10 0.000% 99.795% ( 51, 76 ] 25 0.001% 99.796% ( 76, 110 ] 1579 0.046% 99.842% ( 110, 170 ] 4599 0.135% 99.977% ( 170, 250 ] 616 0.018% 99.995% ( 250, 380 ] 363 0.011% 100.006% ( 380, 580 ] 147 0.004% 100.010% ( 580, 870 ] 58 0.002% 100.012% ( 870, 1300 ] 32 0.001% 100.013% ( 1300, 1900 ] 32 0.001% 100.014% ( 1900, 2900 ] 13 0.000% 100.014% ( 2900, 4400 ] 30 0.001% 100.015% ( 4400, 6600 ] 4 0.000% 100.015% ( 6600, 9900 ] 6 0.000% 100.015% ( 9900, 14000 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 942481 Average: 8.5016 StdDev: 180.57 Min: 0 Median: 2.0203 Max: 19780 Percentiles: P50: 2.02 P75: 3.02 P99: 9.53 P99.9: 17.44 P99.99: 160.24 ------------------------------------------------------ [ 0, 1 ] 26139 2.773% 2.773% # ( 1, 2 ] 440256 46.712% 49.486% ######### ( 2, 3 ] 238486 25.304% 74.790% ##### ( 3, 4 ] 98283 10.428% 85.218% ## ( 4, 6 ] 112068 11.891% 97.109% ## ( 6, 10 ] 20199 2.143% 99.252% ( 10, 15 ] 5895 0.625% 99.877% ( 15, 22 ] 610 0.065% 99.942% ( 22, 34 ] 64 0.007% 99.949% ( 34, 51 ] 26 0.003% 99.952% ( 51, 76 ] 16 0.002% 99.953% ( 76, 110 ] 81 0.009% 99.962% ( 110, 170 ] 315 0.033% 99.995% ( 170, 250 ] 279 0.030% 100.025% ( 250, 380 ] 199 0.021% 100.046% ( 380, 580 ] 172 0.018% 100.064% ( 580, 870 ] 136 0.014% 100.079% ( 870, 1300 ] 87 0.009% 100.088% ( 1300, 1900 ] 67 0.007% 100.095% ( 1900, 2900 ] 126 0.013% 100.109% ( 2900, 4400 ] 267 0.028% 100.137% ( 4400, 6600 ] 142 0.015% 100.152% ( 6600, 9900 ] 291 0.031% 100.183% ( 9900, 14000 ] 20 0.002% 100.185% ( 14000, 22000 ] 15 0.002% 100.187% ** Level 2 read latency histogram (micros): Count: 175303 Average: 6.2819 StdDev: 104.08 Min: 1 Median: 1.9494 Max: 7892 Percentiles: P50: 1.95 P75: 2.93 P99: 9.37 P99.9: 17.98 P99.99: 193.29 ------------------------------------------------------ [ 0, 1 ] 12746 7.271% 7.271% # ( 1, 2 ] 78897 45.006% 52.277% ######### ( 2, 3 ] 42964 24.508% 76.785% ##### ( 3, 4 ] 16678 9.514% 86.299% ## ( 4, 6 ] 19432 11.085% 97.384% ## ( 6, 10 ] 3362 1.918% 99.302% ( 10, 15 ] 1004 0.573% 99.875% ( 15, 22 ] 105 0.060% 99.934% ( 22, 34 ] 12 0.007% 99.941% ( 34, 51 ] 4 0.002% 99.944% ( 51, 76 ] 2 0.001% 99.945% ( 76, 110 ] 9 0.005% 99.950% ( 110, 170 ] 53 0.030% 99.980% ( 170, 250 ] 60 0.034% 100.014% ( 250, 380 ] 69 0.039% 100.054% ( 380, 580 ] 50 0.029% 100.082% ( 580, 870 ] 37 0.021% 100.103% ( 870, 1300 ] 27 0.015% 100.119% ( 1300, 1900 ] 16 0.009% 100.128% ( 1900, 2900 ] 35 0.020% 100.148% ( 2900, 4400 ] 74 0.042% 100.190% ( 4400, 6600 ] 14 0.008% 100.198% ( 6600, 9900 ] 4 0.002% 100.200% ** Level 3 read latency histogram (micros): Count: 691305 Average: 11.3679 StdDev: 191.91 Min: 0 Median: 2.0658 Max: 28283 Percentiles: P50: 2.07 P75: 3.12 P99: 12.31 P99.9: 564.10 P99.99: 1084.76 ------------------------------------------------------ [ 0, 1 ] 16226 2.347% 2.347% ( 1, 2 ] 317915 45.988% 48.335% ######### ( 2, 3 ] 174996 25.314% 73.649% ##### ( 3, 4 ] 75267 10.888% 84.536% ## ( 4, 6 ] 83070 12.016% 96.553% ## ( 6, 10 ] 14719 2.129% 98.682% ( 10, 15 ] 4758 0.688% 99.370% ( 15, 22 ] 469 0.068% 99.438% ( 22, 34 ] 78 0.011% 99.449% ( 34, 51 ] 37 0.005% 99.455% ( 51, 76 ] 8 0.001% 99.456% ( 76, 110 ] 26 0.004% 99.460% ( 110, 170 ] 690 0.100% 99.559% ( 170, 250 ] 940 0.136% 99.695% ( 250, 380 ] 809 0.117% 99.812% ( 380, 580 ] 658 0.095% 99.908% ( 580, 870 ] 451 0.065% 99.973% ( 870, 1300 ] 238 0.034% 100.007% ( 1300, 1900 ] 153 0.022% 100.029% ( 1900, 2900 ] 280 0.041% 100.070% ( 2900, 4400 ] 397 0.057% 100.127% ( 4400, 6600 ] 117 0.017% 100.144% ( 6600, 9900 ] 124 0.018% 100.162% ( 9900, 14000 ] 21 0.003% 100.165% ( 14000, 22000 ] 10 0.001% 100.167% ( 22000, 33000 ] 3 0.000% 100.167% ** Level 4 read latency histogram (micros): Count: 8571 Average: 22.6465 StdDev: 275.69 Min: 0 Median: 2.0777 Max: 7921 Percentiles: P50: 2.08 P75: 3.08 P99: 227.81 P99.9: 5163.40 P99.99: 7921.00 ------------------------------------------------------ [ 0, 1 ] 171 1.995% 1.995% ( 1, 2 ] 3940 45.969% 47.964% ######### ( 2, 3 ] 2247 26.216% 74.180% ##### ( 3, 4 ] 904 10.547% 84.728% ## ( 4, 6 ] 960 11.201% 95.928% ## ( 6, 10 ] 187 2.182% 98.110% ( 10, 15 ] 30 0.350% 98.460% ( 15, 22 ] 10 0.117% 98.577% ( 22, 34 ] 4 0.047% 98.623% ( 76, 110 ] 2 0.023% 98.647% ( 110, 170 ] 5 0.058% 98.705% ( 170, 250 ] 35 0.408% 99.113% ( 250, 380 ] 16 0.187% 99.300% ( 380, 580 ] 9 0.105% 99.405% ( 580, 870 ] 8 0.093% 99.498% ( 870, 1300 ] 8 0.093% 99.592% ( 1300, 1900 ] 2 0.023% 99.615% ( 1900, 2900 ] 12 0.140% 99.755% ( 2900, 4400 ] 10 0.117% 99.872% ( 4400, 6600 ] 7 0.082% 99.953% ( 6600, 9900 ] 4 0.047% 100.000% ** Level 5 read latency histogram (micros): Count: 220 Average: 1164.1136 StdDev: 1313.11 Min: 101 Median: 623.5000 Max: 8796 Percentiles: P50: 623.50 P75: 1630.00 P99: 6160.00 P99.9: 8796.00 P99.99: 8796.00 ------------------------------------------------------ ( 76, 110 ] 3 1.364% 1.364% ( 110, 170 ] 21 9.545% 10.909% ## ( 170, 250 ] 28 12.727% 23.636% ### ( 250, 380 ] 25 11.364% 35.000% ## ( 380, 580 ] 30 13.636% 48.636% ### ( 580, 870 ] 20 9.091% 57.727% ## ( 870, 1300 ] 27 12.273% 70.000% ## ( 1300, 1900 ] 20 9.091% 79.091% ## ( 1900, 2900 ] 22 10.000% 89.091% ## ( 2900, 4400 ] 17 7.727% 96.818% ## ( 4400, 6600 ] 6 2.727% 99.545% # ( 6600, 9900 ] 1 0.455% 100.000% ** DB Stats ** Uptime(secs): 45.8 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 193.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.370 H:M:S, 40.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.196 H:M:S, 6.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.098 micros/op 163976 ops/sec 60.003 seconds 9838999 operations; 158.9 MB/s Microseconds per write: Count: 9838999 Average: 6.0984 StdDev: 382.79 Min: 1 Median: 1.8304 Max: 825225 Percentiles: P50: 1.83 P75: 3.15 P99: 9.54 P99.9: 1172.55 P99.99: 2733.42 ------------------------------------------------------ [ 0, 1 ] 1043989 10.611% 10.611% ## ( 1, 2 ] 4667146 47.435% 58.046% ######### ( 2, 3 ] 1466010 14.900% 72.946% ### ( 3, 4 ] 1341571 13.635% 86.581% ### ( 4, 6 ] 1077569 10.952% 97.533% ## ( 6, 10 ] 162908 1.656% 99.189% ( 10, 15 ] 35109 0.357% 99.546% ( 15, 22 ] 10679 0.109% 99.654% ( 22, 34 ] 2635 0.027% 99.681% ( 34, 51 ] 356 0.004% 99.685% ( 51, 76 ] 65 0.001% 99.685% ( 76, 110 ] 15 0.000% 99.685% ( 110, 170 ] 9145 0.093% 99.778% ( 170, 250 ] 636 0.006% 99.785% ( 250, 380 ] 204 0.002% 99.787% ( 380, 580 ] 30 0.000% 99.787% ( 580, 870 ] 28 0.000% 99.788% ( 870, 1300 ] 15726 0.160% 99.947% ( 1300, 1900 ] 27 0.000% 99.948% ( 1900, 2900 ] 5000 0.051% 99.998% ( 2900, 4400 ] 120 0.001% 100.000% ( 4400, 6600 ] 10 0.000% 100.000% ( 6600, 9900 ] 8 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 2 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 168709 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9838999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10153846968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 533 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29737903 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28021201636 rocksdb.compact.write.bytes COUNT : 27836765839 rocksdb.flush.write.bytes COUNT : 9975259955 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 55 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 331 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9894281216 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3366912 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28117507593 rocksdb.non.last.level.read.count COUNT : 6789141 rocksdb.block.checksum.compute.count COUNT : 6788130 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.478960 P95 : 4.977799 P99 : 8.624067 P100 : 825223.000000 COUNT : 9838999 SUM : 55007587 rocksdb.compaction.times.micros P50 : 1013548.387097 P95 : 5950000.000000 P99 : 16569915.000000 P100 : 16569915.000000 COUNT : 90 SUM : 135491241 rocksdb.compaction.times.cpu_micros P50 : 911000.000000 P95 : 3950000.000000 P99 : 15558137.000000 P100 : 15558137.000000 COUNT : 90 SUM : 112597167 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 533.191489 P95 : 1257.000000 P99 : 7491.000000 P100 : 8887.000000 COUNT : 146 SUM : 118940 rocksdb.compaction.outfile.sync.micros P50 : 870.000000 P95 : 9525.000000 P99 : 25850.000000 P100 : 51669.000000 COUNT : 330 SUM : 884948 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 104.465116 P95 : 1700.000000 P99 : 3950.000000 P100 : 5389.000000 COUNT : 280 SUM : 89552 rocksdb.table.open.io.micros P50 : 867.020548 P95 : 8621.250000 P99 : 19157.333333 P100 : 21422.000000 COUNT : 533 SUM : 1137610 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.660656 P95 : 8.056944 P99 : 12.769894 P100 : 28292.000000 COUNT : 6786767 SUM : 47485785 rocksdb.read.block.get.micros P50 : 393.756614 P95 : 3152.272727 P99 : 6712.200000 P100 : 12974.000000 COUNT : 1066 SUM : 838984 rocksdb.write.raw.block.micros P50 : 0.517885 P95 : 0.983982 P99 : 3.161304 P100 : 33473.000000 COUNT : 9174876 SUM : 22749800 rocksdb.numfiles.in.singlecompaction P50 : 3.141975 P95 : 5.025000 P99 : 19.935000 P100 : 24.000000 COUNT : 159 SUM : 560 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563044 P95 : 1181.925803 P99 : 2526.874494 P100 : 825027.000000 COUNT : 185424 SUM : 29753747 rocksdb.sst.read.micros P50 : 1.594215 P95 : 4.777123 P99 : 9.095782 P100 : 28283.000000 COUNT : 6789581 SUM : 32676830 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9838999 SUM : 10153846968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 190487.804878 P95 : 402166.666667 P99 : 951800.000000 P100 : 1013953.000000 COUNT : 146 SUM : 29438535 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 333 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0