[2024-12-15 12:52:12.445732] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 23.11.0 initialization... [2024-12-15 12:52:12.446002] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid429984 ] Set seed to 1734263532439067 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 12:52:12.573165] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 12:52:12.596433] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 12:52:12.596482] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 429984' to capture a snapshot of events at runtime. [2024-12-15 12:52:12.596492] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-15 12:52:12.596502] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-15 12:52:12.596510] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid429984 for offline analysis/debug. [2024-12-15 12:52:12.597074] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 12:52:16 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-12:52:19 ... thread 0: (1000000,1000000) ops and (354049.9,354049.9) ops/second in (2.824461,2.824461) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 630.02 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 352.0 2.33 2.09 12 0.194 0 0 0.0 0.0 L2 3/2 237.25 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 L3 9/0 755.92 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/12 96.94 GB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 92.5 309.7 3.77 3.47 14 0.269 354K 160 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 92.5 309.7 3.77 3.47 14 0.269 354K 160 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 352.0 2.33 2.09 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.14 GB write, 379.38 MB/s write, 0.34 GB read, 113.35 MB/s read, 3.8 seconds Interval compaction: 1.14 GB write, 413.21 MB/s write, 0.34 GB read, 123.45 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 109662 Average: 1.9785 StdDev: 16.11 Min: 0 Median: 1.2838 Max: 3136 Percentiles: P50: 1.28 P75: 1.72 P99: 5.05 P99.9: 9.59 P99.99: 118.86 ------------------------------------------------------ [ 0, 1 ] 37093 33.825% 33.825% ####### ( 1, 2 ] 62509 57.002% 90.826% ########### ( 2, 3 ] 5913 5.392% 96.218% # ( 3, 4 ] 2345 2.138% 98.357% ( 4, 6 ] 1345 1.226% 99.583% ( 6, 10 ] 389 0.355% 99.938% ( 10, 15 ] 46 0.042% 99.980% ( 15, 22 ] 9 0.008% 99.988% ( 22, 34 ] 1 0.001% 99.989% ( 34, 51 ] 1 0.001% 99.990% ( 51, 76 ] 1 0.001% 99.991% ( 110, 170 ] 7 0.006% 99.997% ( 170, 250 ] 4 0.004% 100.001% ( 250, 380 ] 4 0.004% 100.005% ( 380, 580 ] 1 0.001% 100.005% ( 580, 870 ] 3 0.003% 100.008% ( 1300, 1900 ] 3 0.003% 100.011% ( 1900, 2900 ] 1 0.001% 100.012% ( 2900, 4400 ] 1 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 72747 Average: 2.0604 StdDev: 9.83 Min: 0 Median: 1.3049 Max: 1452 Percentiles: P50: 1.30 P75: 1.73 P99: 5.57 P99.9: 42.08 P99.99: 466.26 ------------------------------------------------------ [ 0, 1 ] 23402 32.169% 32.169% ###### ( 1, 2 ] 42550 58.490% 90.659% ############ ( 2, 3 ] 3791 5.211% 95.871% # ( 3, 4 ] 1548 2.128% 97.999% ( 4, 6 ] 929 1.277% 99.276% ( 6, 10 ] 378 0.520% 99.795% ( 10, 15 ] 47 0.065% 99.860% ( 15, 22 ] 15 0.021% 99.880% ( 22, 34 ] 2 0.003% 99.883% ( 34, 51 ] 30 0.041% 99.924% ( 51, 76 ] 16 0.022% 99.946% ( 76, 110 ] 7 0.010% 99.956% ( 110, 170 ] 7 0.010% 99.966% ( 170, 250 ] 9 0.012% 99.978% ( 250, 380 ] 9 0.012% 99.990% ( 380, 580 ] 4 0.005% 99.996% ( 580, 870 ] 3 0.004% 100.000% ( 870, 1300 ] 1 0.001% 100.001% ( 1300, 1900 ] 1 0.001% 100.003% ** Level 3 read latency histogram (micros): Count: 45 Average: 1474.4444 StdDev: 1594.90 Min: 51 Median: 572.3077 Max: 6733 Percentiles: P50: 572.31 P75: 2368.75 P99: 6733.00 P99.9: 6733.00 P99.99: 6733.00 ------------------------------------------------------ ( 34, 51 ] 1 2.222% 2.222% ( 110, 170 ] 3 6.667% 8.889% # ( 170, 250 ] 4 8.889% 17.778% ## ( 250, 380 ] 2 4.444% 22.222% # ( 380, 580 ] 13 28.889% 51.111% ###### ( 580, 870 ] 3 6.667% 57.778% # ( 870, 1300 ] 1 2.222% 60.000% ( 1300, 1900 ] 3 6.667% 66.667% # ( 1900, 2900 ] 8 17.778% 84.444% #### ( 2900, 4400 ] 4 8.889% 93.333% ## ( 4400, 6600 ] 2 4.444% 97.778% # ( 6600, 9900 ] 1 2.222% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1655.2667 StdDev: 1611.58 Min: 100 Median: 870.0000 Max: 5383 Percentiles: P50: 870.00 P75: 2733.33 P99: 5383.00 P99.9: 5383.00 P99.99: 5383.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 7 23.333% 43.333% ##### ( 580, 870 ] 2 6.667% 50.000% # ( 870, 1300 ] 4 13.333% 63.333% ### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 3 10.000% 76.667% ## ( 2900, 4400 ] 5 16.667% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 319.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.222 H:M:S, 7.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.222 H:M:S, 7.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-12:52:22 ... thread 0: (1000000,2000000) ops and (329060.7,341098.2) ops/second in (3.038953,5.863414) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.23 GB 94.4 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.9 319.4 8.28 7.69 29 0.286 831K 809 0.0 0.0 L1 1/0 3.07 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.8 240.4 1.57 1.53 1 1.570 383K 606 0.0 0.0 L2 1/0 49.91 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 L3 21/0 966.48 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 201.5 201.3 3.72 3.30 3 1.239 760K 739 0.0 0.0 L4 152/0 9.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1232/4 97.92 GB 0.0 2.2 1.1 1.1 4.0 2.9 1.2 2.3 152.9 274.4 15.01 13.91 35 0.429 2330K 2314 0.0 0.0 Int 0/0 0.00 KB 0.0 2.2 1.1 1.1 4.0 2.9 1.2 2.3 152.9 274.4 15.01 13.91 35 0.429 2330K 2314 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.2 1.1 1.1 2.2 1.1 0.0 0.0 232.6 232.4 9.86 9.30 9 1.096 2330K 2314 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.9 5.15 4.61 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.02 GB write, 673.46 MB/s write, 2.24 GB read, 375.18 MB/s read, 15.0 seconds Interval compaction: 4.02 GB write, 702.40 MB/s write, 2.24 GB read, 391.30 MB/s read, 15.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 385127 Average: 2.1308 StdDev: 10.92 Min: 0 Median: 1.4411 Max: 3136 Percentiles: P50: 1.44 P75: 1.84 P99: 5.60 P99.9: 9.70 P99.99: 14.94 ------------------------------------------------------ [ 0, 1 ] 85296 22.147% 22.147% #### ( 1, 2 ] 243170 63.140% 85.288% ############# ( 2, 3 ] 33472 8.691% 93.979% ## ( 3, 4 ] 12715 3.302% 97.280% # ( 4, 6 ] 8304 2.156% 99.437% ( 6, 10 ] 1928 0.501% 99.937% ( 10, 15 ] 206 0.053% 99.991% ( 15, 22 ] 36 0.009% 100.000% ( 22, 34 ] 5 0.001% 100.001% ( 34, 51 ] 4 0.001% 100.002% ( 51, 76 ] 4 0.001% 100.003% ( 76, 110 ] 1 0.000% 100.004% ( 110, 170 ] 11 0.003% 100.006% ( 170, 250 ] 12 0.003% 100.010% ( 250, 380 ] 10 0.003% 100.012% ( 380, 580 ] 3 0.001% 100.013% ( 580, 870 ] 8 0.002% 100.015% ( 870, 1300 ] 8 0.002% 100.017% ( 1300, 1900 ] 3 0.001% 100.018% ( 1900, 2900 ] 2 0.001% 100.018% ( 2900, 4400 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 95001 Average: 2.3782 StdDev: 5.11 Min: 1 Median: 1.6310 Max: 1074 Percentiles: P50: 1.63 P75: 2.03 P99: 5.83 P99.9: 11.27 P99.99: 15.27 ------------------------------------------------------ [ 0, 1 ] 7650 8.053% 8.053% ## ( 1, 2 ] 63153 66.476% 74.529% ############# ( 2, 3 ] 15508 16.324% 90.853% ### ( 3, 4 ] 4583 4.824% 95.677% # ( 4, 6 ] 3456 3.638% 99.315% # ( 6, 10 ] 527 0.555% 99.869% ( 10, 15 ] 114 0.120% 99.989% ( 15, 22 ] 13 0.014% 100.003% ( 22, 34 ] 1 0.001% 100.004% ( 51, 76 ] 2 0.002% 100.006% ( 250, 380 ] 3 0.003% 100.009% ( 380, 580 ] 1 0.001% 100.011% ( 580, 870 ] 1 0.001% 100.012% ( 870, 1300 ] 1 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 88191 Average: 2.1032 StdDev: 8.93 Min: 0 Median: 1.3646 Max: 1452 Percentiles: P50: 1.36 P75: 1.78 P99: 5.64 P99.9: 26.85 P99.99: 389.04 ------------------------------------------------------ [ 0, 1 ] 24697 28.004% 28.004% ###### ( 1, 2 ] 53207 60.332% 88.336% ############ ( 2, 3 ] 5846 6.629% 94.964% # ( 3, 4 ] 2368 2.685% 97.649% # ( 4, 6 ] 1453 1.648% 99.297% ( 6, 10 ] 448 0.508% 99.805% ( 10, 15 ] 64 0.073% 99.878% ( 15, 22 ] 19 0.022% 99.899% ( 22, 34 ] 2 0.002% 99.901% ( 34, 51 ] 30 0.034% 99.935% ( 51, 76 ] 16 0.018% 99.954% ( 76, 110 ] 7 0.008% 99.961% ( 110, 170 ] 7 0.008% 99.969% ( 170, 250 ] 9 0.010% 99.980% ( 250, 380 ] 9 0.010% 99.990% ( 380, 580 ] 4 0.005% 99.994% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47904 Average: 3.8709 StdDev: 67.48 Min: 0 Median: 1.6138 Max: 6733 Percentiles: P50: 1.61 P75: 1.99 P99: 5.96 P99.9: 193.95 P99.99: 2676.20 ------------------------------------------------------ [ 0, 1 ] 4624 9.653% 9.653% ## ( 1, 2 ] 31489 65.734% 75.386% ############# ( 2, 3 ] 7423 15.496% 90.882% ### ( 3, 4 ] 2338 4.881% 95.762% # ( 4, 6 ] 1583 3.305% 99.067% # ( 6, 10 ] 270 0.564% 99.631% ( 10, 15 ] 93 0.194% 99.825% ( 15, 22 ] 8 0.017% 99.841% ( 22, 34 ] 12 0.025% 99.866% ( 34, 51 ] 5 0.010% 99.877% ( 76, 110 ] 1 0.002% 99.879% ( 110, 170 ] 8 0.017% 99.896% ( 170, 250 ] 7 0.015% 99.910% ( 250, 380 ] 5 0.010% 99.921% ( 380, 580 ] 17 0.035% 99.956% ( 580, 870 ] 4 0.008% 99.965% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 5 0.010% 99.977% ( 1900, 2900 ] 8 0.017% 99.994% ( 2900, 4400 ] 4 0.008% 100.002% ( 4400, 6600 ] 2 0.004% 100.006% ( 6600, 9900 ] 1 0.002% 100.008% ** Level 4 read latency histogram (micros): Count: 30 Average: 1655.2667 StdDev: 1611.58 Min: 100 Median: 870.0000 Max: 5383 Percentiles: P50: 870.00 P75: 2733.33 P99: 5383.00 P99.9: 5383.00 P99.99: 5383.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 7 23.333% 43.333% ##### ( 580, 870 ] 2 6.667% 50.000% # ( 870, 1300 ] 4 13.333% 63.333% ### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 3 10.000% 76.667% ## ( 2900, 4400 ] 5 16.667% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 758.8000 StdDev: 909.52 Min: 104 Median: 354.0000 Max: 3430 Percentiles: P50: 354.00 P75: 773.33 P99: 3430.00 P99.9: 3430.00 P99.99: 3430.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 1 5.000% 30.000% # ( 250, 380 ] 5 25.000% 55.000% ##### ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.586 H:M:S, 9.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.364 H:M:S, 12.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-12:52:25 ... thread 0: (1000000,3000000) ops and (335073.9,339066.2) ops/second in (2.984416,8.847830) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 2.21 GB 195.1 1.9 0.0 1.9 4.7 2.8 0.0 1.7 128.1 313.9 15.24 14.29 47 0.324 1982K 2021 0.0 0.0 L1 1/0 3.07 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.8 240.4 1.57 1.53 1 1.570 383K 606 0.0 0.0 L2 1/0 49.91 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 L3 21/0 966.48 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 201.5 201.3 3.72 3.30 3 1.239 760K 739 0.0 0.0 L4 152/0 9.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1234/4 98.90 GB 0.0 3.3 1.1 2.2 6.1 3.9 1.2 2.2 156.0 284.9 21.97 20.51 53 0.415 3481K 3526 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 1.1 2.2 6.1 3.9 1.2 2.2 156.0 284.9 21.97 20.51 53 0.415 3481K 3526 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 1.1 2.2 3.3 1.1 0.0 0.0 243.4 243.1 14.09 13.43 13 1.084 3481K 3526 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.5 7.89 7.08 40 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.11 GB write, 687.83 MB/s write, 3.35 GB read, 376.75 MB/s read, 22.0 seconds Interval compaction: 6.11 GB write, 707.41 MB/s write, 3.35 GB read, 387.47 MB/s read, 22.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 646775 Average: 2.0519 StdDev: 11.25 Min: 0 Median: 1.3910 Max: 3382 Percentiles: P50: 1.39 P75: 1.79 P99: 5.39 P99.9: 9.61 P99.99: 15.04 ------------------------------------------------------ [ 0, 1 ] 166903 25.805% 25.805% ##### ( 1, 2 ] 400227 61.880% 87.686% ############ ( 2, 3 ] 47661 7.369% 95.055% # ( 3, 4 ] 17969 2.778% 97.833% # ( 4, 6 ] 10894 1.684% 99.517% ( 6, 10 ] 2743 0.424% 99.942% ( 10, 15 ] 314 0.049% 99.990% ( 15, 22 ] 62 0.010% 100.000% ( 22, 34 ] 10 0.002% 100.001% ( 34, 51 ] 4 0.001% 100.002% ( 51, 76 ] 7 0.001% 100.003% ( 76, 110 ] 1 0.000% 100.003% ( 110, 170 ] 19 0.003% 100.006% ( 170, 250 ] 18 0.003% 100.009% ( 250, 380 ] 17 0.003% 100.011% ( 380, 580 ] 4 0.001% 100.012% ( 580, 870 ] 14 0.002% 100.014% ( 870, 1300 ] 12 0.002% 100.016% ( 1300, 1900 ] 7 0.001% 100.017% ( 1900, 2900 ] 3 0.000% 100.018% ( 2900, 4400 ] 2 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 95001 Average: 2.3782 StdDev: 5.11 Min: 1 Median: 1.6310 Max: 1074 Percentiles: P50: 1.63 P75: 2.03 P99: 5.83 P99.9: 11.27 P99.99: 15.27 ------------------------------------------------------ [ 0, 1 ] 7650 8.053% 8.053% ## ( 1, 2 ] 63153 66.476% 74.529% ############# ( 2, 3 ] 15508 16.324% 90.853% ### ( 3, 4 ] 4583 4.824% 95.677% # ( 4, 6 ] 3456 3.638% 99.315% # ( 6, 10 ] 527 0.555% 99.869% ( 10, 15 ] 114 0.120% 99.989% ( 15, 22 ] 13 0.014% 100.003% ( 22, 34 ] 1 0.001% 100.004% ( 51, 76 ] 2 0.002% 100.006% ( 250, 380 ] 3 0.003% 100.009% ( 380, 580 ] 1 0.001% 100.011% ( 580, 870 ] 1 0.001% 100.012% ( 870, 1300 ] 1 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 88191 Average: 2.1032 StdDev: 8.93 Min: 0 Median: 1.3646 Max: 1452 Percentiles: P50: 1.36 P75: 1.78 P99: 5.64 P99.9: 26.85 P99.99: 389.04 ------------------------------------------------------ [ 0, 1 ] 24697 28.004% 28.004% ###### ( 1, 2 ] 53207 60.332% 88.336% ############ ( 2, 3 ] 5846 6.629% 94.964% # ( 3, 4 ] 2368 2.685% 97.649% # ( 4, 6 ] 1453 1.648% 99.297% ( 6, 10 ] 448 0.508% 99.805% ( 10, 15 ] 64 0.073% 99.878% ( 15, 22 ] 19 0.022% 99.899% ( 22, 34 ] 2 0.002% 99.901% ( 34, 51 ] 30 0.034% 99.935% ( 51, 76 ] 16 0.018% 99.954% ( 76, 110 ] 7 0.008% 99.961% ( 110, 170 ] 7 0.008% 99.969% ( 170, 250 ] 9 0.010% 99.980% ( 250, 380 ] 9 0.010% 99.990% ( 380, 580 ] 4 0.005% 99.994% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47904 Average: 3.8709 StdDev: 67.48 Min: 0 Median: 1.6138 Max: 6733 Percentiles: P50: 1.61 P75: 1.99 P99: 5.96 P99.9: 193.95 P99.99: 2676.20 ------------------------------------------------------ [ 0, 1 ] 4624 9.653% 9.653% ## ( 1, 2 ] 31489 65.734% 75.386% ############# ( 2, 3 ] 7423 15.496% 90.882% ### ( 3, 4 ] 2338 4.881% 95.762% # ( 4, 6 ] 1583 3.305% 99.067% # ( 6, 10 ] 270 0.564% 99.631% ( 10, 15 ] 93 0.194% 99.825% ( 15, 22 ] 8 0.017% 99.841% ( 22, 34 ] 12 0.025% 99.866% ( 34, 51 ] 5 0.010% 99.877% ( 76, 110 ] 1 0.002% 99.879% ( 110, 170 ] 8 0.017% 99.896% ( 170, 250 ] 7 0.015% 99.910% ( 250, 380 ] 5 0.010% 99.921% ( 380, 580 ] 17 0.035% 99.956% ( 580, 870 ] 4 0.008% 99.965% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 5 0.010% 99.977% ( 1900, 2900 ] 8 0.017% 99.994% ( 2900, 4400 ] 4 0.008% 100.002% ( 4400, 6600 ] 2 0.004% 100.006% ( 6600, 9900 ] 1 0.002% 100.008% ** Level 4 read latency histogram (micros): Count: 30 Average: 1655.2667 StdDev: 1611.58 Min: 100 Median: 870.0000 Max: 5383 Percentiles: P50: 870.00 P75: 2733.33 P99: 5383.00 P99.9: 5383.00 P99.99: 5383.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 7 23.333% 43.333% ##### ( 580, 870 ] 2 6.667% 50.000% # ( 870, 1300 ] 4 13.333% 63.333% ### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 3 10.000% 76.667% ## ( 2900, 4400 ] 5 16.667% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 758.8000 StdDev: 909.52 Min: 104 Median: 354.0000 Max: 3430 Percentiles: P50: 354.00 P75: 773.33 P99: 3430.00 P99.9: 3430.00 P99.99: 3430.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 1 5.000% 30.000% # ( 250, 380 ] 5 25.000% 55.000% ##### ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.963 H:M:S, 10.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.377 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-12:52:28 ... thread 0: (1000000,4000000) ops and (336972.6,338540.4) ops/second in (2.967600,11.815430) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/4 3.20 GB 302.1 2.8 0.0 2.8 6.5 3.7 0.0 1.7 132.9 313.0 21.33 20.00 64 0.333 2878K 3002 0.0 0.0 L1 1/0 3.07 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.8 240.4 1.57 1.53 1 1.570 383K 606 0.0 0.0 L2 1/0 49.91 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 L3 21/0 966.48 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 201.5 201.3 3.72 3.30 3 1.239 760K 739 0.0 0.0 L4 152/0 9.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1239/4 99.88 GB 0.0 4.2 1.1 3.1 8.0 4.9 1.2 2.1 153.7 290.5 28.06 26.22 70 0.401 4377K 4507 0.0 0.0 Int 0/0 0.00 KB 0.0 4.2 1.1 3.1 8.0 4.9 1.2 2.1 153.7 290.5 28.06 26.22 70 0.401 4377K 4507 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.2 1.1 3.1 4.2 1.1 0.0 0.0 247.7 247.5 17.40 16.68 16 1.088 4377K 4507 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 360.7 10.65 9.54 54 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.96 GB write, 675.20 MB/s write, 4.21 GB read, 357.18 MB/s read, 28.1 seconds Interval compaction: 7.96 GB write, 689.60 MB/s write, 4.21 GB read, 364.80 MB/s read, 28.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 907998 Average: 2.0263 StdDev: 13.29 Min: 0 Median: 1.3716 Max: 4410 Percentiles: P50: 1.37 P75: 1.78 P99: 5.22 P99.9: 9.55 P99.99: 15.26 ------------------------------------------------------ [ 0, 1 ] 245754 27.065% 27.065% ##### ( 1, 2 ] 560360 61.714% 88.779% ############ ( 2, 3 ] 61716 6.797% 95.576% # ( 3, 4 ] 23075 2.541% 98.118% # ( 4, 6 ] 13160 1.449% 99.567% ( 6, 10 ] 3408 0.375% 99.942% ( 10, 15 ] 432 0.048% 99.990% ( 15, 22 ] 87 0.010% 99.999% ( 22, 34 ] 12 0.001% 100.001% ( 34, 51 ] 4 0.000% 100.001% ( 51, 76 ] 9 0.001% 100.002% ( 76, 110 ] 2 0.000% 100.002% ( 110, 170 ] 26 0.003% 100.005% ( 170, 250 ] 23 0.003% 100.008% ( 250, 380 ] 22 0.002% 100.010% ( 380, 580 ] 6 0.001% 100.011% ( 580, 870 ] 18 0.002% 100.013% ( 870, 1300 ] 16 0.002% 100.015% ( 1300, 1900 ] 10 0.001% 100.016% ( 1900, 2900 ] 3 0.000% 100.016% ( 2900, 4400 ] 5 0.001% 100.017% ( 4400, 6600 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 95001 Average: 2.3782 StdDev: 5.11 Min: 1 Median: 1.6310 Max: 1074 Percentiles: P50: 1.63 P75: 2.03 P99: 5.83 P99.9: 11.27 P99.99: 15.27 ------------------------------------------------------ [ 0, 1 ] 7650 8.053% 8.053% ## ( 1, 2 ] 63153 66.476% 74.529% ############# ( 2, 3 ] 15508 16.324% 90.853% ### ( 3, 4 ] 4583 4.824% 95.677% # ( 4, 6 ] 3456 3.638% 99.315% # ( 6, 10 ] 527 0.555% 99.869% ( 10, 15 ] 114 0.120% 99.989% ( 15, 22 ] 13 0.014% 100.003% ( 22, 34 ] 1 0.001% 100.004% ( 51, 76 ] 2 0.002% 100.006% ( 250, 380 ] 3 0.003% 100.009% ( 380, 580 ] 1 0.001% 100.011% ( 580, 870 ] 1 0.001% 100.012% ( 870, 1300 ] 1 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 88191 Average: 2.1032 StdDev: 8.93 Min: 0 Median: 1.3646 Max: 1452 Percentiles: P50: 1.36 P75: 1.78 P99: 5.64 P99.9: 26.85 P99.99: 389.04 ------------------------------------------------------ [ 0, 1 ] 24697 28.004% 28.004% ###### ( 1, 2 ] 53207 60.332% 88.336% ############ ( 2, 3 ] 5846 6.629% 94.964% # ( 3, 4 ] 2368 2.685% 97.649% # ( 4, 6 ] 1453 1.648% 99.297% ( 6, 10 ] 448 0.508% 99.805% ( 10, 15 ] 64 0.073% 99.878% ( 15, 22 ] 19 0.022% 99.899% ( 22, 34 ] 2 0.002% 99.901% ( 34, 51 ] 30 0.034% 99.935% ( 51, 76 ] 16 0.018% 99.954% ( 76, 110 ] 7 0.008% 99.961% ( 110, 170 ] 7 0.008% 99.969% ( 170, 250 ] 9 0.010% 99.980% ( 250, 380 ] 9 0.010% 99.990% ( 380, 580 ] 4 0.005% 99.994% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47904 Average: 3.8709 StdDev: 67.48 Min: 0 Median: 1.6138 Max: 6733 Percentiles: P50: 1.61 P75: 1.99 P99: 5.96 P99.9: 193.95 P99.99: 2676.20 ------------------------------------------------------ [ 0, 1 ] 4624 9.653% 9.653% ## ( 1, 2 ] 31489 65.734% 75.386% ############# ( 2, 3 ] 7423 15.496% 90.882% ### ( 3, 4 ] 2338 4.881% 95.762% # ( 4, 6 ] 1583 3.305% 99.067% # ( 6, 10 ] 270 0.564% 99.631% ( 10, 15 ] 93 0.194% 99.825% ( 15, 22 ] 8 0.017% 99.841% ( 22, 34 ] 12 0.025% 99.866% ( 34, 51 ] 5 0.010% 99.877% ( 76, 110 ] 1 0.002% 99.879% ( 110, 170 ] 8 0.017% 99.896% ( 170, 250 ] 7 0.015% 99.910% ( 250, 380 ] 5 0.010% 99.921% ( 380, 580 ] 17 0.035% 99.956% ( 580, 870 ] 4 0.008% 99.965% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 5 0.010% 99.977% ( 1900, 2900 ] 8 0.017% 99.994% ( 2900, 4400 ] 4 0.008% 100.002% ( 4400, 6600 ] 2 0.004% 100.006% ( 6600, 9900 ] 1 0.002% 100.008% ** Level 4 read latency histogram (micros): Count: 30 Average: 1655.2667 StdDev: 1611.58 Min: 100 Median: 870.0000 Max: 5383 Percentiles: P50: 870.00 P75: 2733.33 P99: 5383.00 P99.9: 5383.00 P99.99: 5383.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 7 23.333% 43.333% ##### ( 580, 870 ] 2 6.667% 50.000% # ( 870, 1300 ] 4 13.333% 63.333% ### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 3 10.000% 76.667% ## ( 2900, 4400 ] 5 16.667% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 758.8000 StdDev: 909.52 Min: 104 Median: 354.0000 Max: 3430 Percentiles: P50: 354.00 P75: 773.33 P99: 3430.00 P99.9: 3430.00 P99.99: 3430.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 1 5.000% 30.000% # ( 250, 380 ] 5 25.000% 55.000% ##### ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 326.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.322 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.359 H:M:S, 12.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-12:52:33 ... thread 0: (1000000,5000000) ops and (214359.3,303389.0) ops/second in (4.665064,16.480494) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/18 4.12 GB 6.3 3.8 0.0 3.8 8.4 4.7 0.0 1.8 138.6 311.2 27.72 26.05 83 0.334 3901K 3996 0.0 0.0 L1 1/1 3.07 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.8 240.4 1.57 1.53 1 1.570 383K 606 0.0 0.0 L2 1/0 49.91 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 L3 21/0 966.48 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 201.5 201.3 3.72 3.30 3 1.239 760K 739 0.0 0.0 L4 152/0 9.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/19 100.81 GB 0.0 5.2 1.1 4.1 9.9 5.8 1.2 2.1 154.4 293.2 34.45 32.27 89 0.387 5400K 5501 0.0 0.0 Int 0/0 0.00 KB 0.0 5.2 1.1 4.1 9.9 5.8 1.2 2.1 154.4 293.2 34.45 32.27 89 0.387 5400K 5501 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.2 1.1 4.1 5.2 1.1 0.0 0.0 251.5 251.2 21.15 20.35 20 1.057 5400K 5501 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 360.0 13.30 11.92 69 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.7 total, 16.5 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.86 GB write, 603.62 MB/s write, 5.19 GB read, 317.85 MB/s read, 34.4 seconds Interval compaction: 9.86 GB write, 612.85 MB/s write, 5.19 GB read, 322.71 MB/s read, 34.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 11, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1404741 Average: 2.0611 StdDev: 11.95 Min: 0 Median: 1.3988 Max: 4410 Percentiles: P50: 1.40 P75: 1.79 P99: 5.21 P99.9: 9.64 P99.99: 20.84 ------------------------------------------------------ [ 0, 1 ] 347620 24.746% 24.746% ##### ( 1, 2 ] 889594 63.328% 88.074% ############# ( 2, 3 ] 105161 7.486% 95.560% # ( 3, 4 ] 36405 2.592% 98.152% # ( 4, 6 ] 19629 1.397% 99.549% ( 6, 10 ] 5420 0.386% 99.935% ( 10, 15 ] 655 0.047% 99.982% ( 15, 22 ] 142 0.010% 99.992% ( 22, 34 ] 17 0.001% 99.993% ( 34, 51 ] 5 0.000% 99.993% ( 51, 76 ] 15 0.001% 99.994% ( 76, 110 ] 71 0.005% 100.000% ( 110, 170 ] 119 0.008% 100.008% ( 170, 250 ] 51 0.004% 100.012% ( 250, 380 ] 38 0.003% 100.014% ( 380, 580 ] 19 0.001% 100.016% ( 580, 870 ] 34 0.002% 100.018% ( 870, 1300 ] 17 0.001% 100.019% ( 1300, 1900 ] 13 0.001% 100.020% ( 1900, 2900 ] 4 0.000% 100.021% ( 2900, 4400 ] 6 0.000% 100.021% ( 4400, 6600 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 95002 Average: 2.3803 StdDev: 5.15 Min: 1 Median: 1.6310 Max: 1074 Percentiles: P50: 1.63 P75: 2.03 P99: 5.83 P99.9: 11.32 P99.99: 15.81 ------------------------------------------------------ [ 0, 1 ] 7650 8.052% 8.052% ## ( 1, 2 ] 63153 66.475% 74.528% ############# ( 2, 3 ] 15508 16.324% 90.852% ### ( 3, 4 ] 4583 4.824% 95.676% # ( 4, 6 ] 3456 3.638% 99.314% # ( 6, 10 ] 527 0.555% 99.868% ( 10, 15 ] 114 0.120% 99.988% ( 15, 22 ] 13 0.014% 100.002% ( 22, 34 ] 1 0.001% 100.003% ( 51, 76 ] 2 0.002% 100.005% ( 170, 250 ] 1 0.001% 100.006% ( 250, 380 ] 3 0.003% 100.009% ( 380, 580 ] 1 0.001% 100.011% ( 580, 870 ] 1 0.001% 100.012% ( 870, 1300 ] 1 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 88191 Average: 2.1032 StdDev: 8.93 Min: 0 Median: 1.3646 Max: 1452 Percentiles: P50: 1.36 P75: 1.78 P99: 5.64 P99.9: 26.85 P99.99: 389.04 ------------------------------------------------------ [ 0, 1 ] 24697 28.004% 28.004% ###### ( 1, 2 ] 53207 60.332% 88.336% ############ ( 2, 3 ] 5846 6.629% 94.964% # ( 3, 4 ] 2368 2.685% 97.649% # ( 4, 6 ] 1453 1.648% 99.297% ( 6, 10 ] 448 0.508% 99.805% ( 10, 15 ] 64 0.073% 99.878% ( 15, 22 ] 19 0.022% 99.899% ( 22, 34 ] 2 0.002% 99.901% ( 34, 51 ] 30 0.034% 99.935% ( 51, 76 ] 16 0.018% 99.954% ( 76, 110 ] 7 0.008% 99.961% ( 110, 170 ] 7 0.008% 99.969% ( 170, 250 ] 9 0.010% 99.980% ( 250, 380 ] 9 0.010% 99.990% ( 380, 580 ] 4 0.005% 99.994% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47904 Average: 3.8709 StdDev: 67.48 Min: 0 Median: 1.6138 Max: 6733 Percentiles: P50: 1.61 P75: 1.99 P99: 5.96 P99.9: 193.95 P99.99: 2676.20 ------------------------------------------------------ [ 0, 1 ] 4624 9.653% 9.653% ## ( 1, 2 ] 31489 65.734% 75.386% ############# ( 2, 3 ] 7423 15.496% 90.882% ### ( 3, 4 ] 2338 4.881% 95.762% # ( 4, 6 ] 1583 3.305% 99.067% # ( 6, 10 ] 270 0.564% 99.631% ( 10, 15 ] 93 0.194% 99.825% ( 15, 22 ] 8 0.017% 99.841% ( 22, 34 ] 12 0.025% 99.866% ( 34, 51 ] 5 0.010% 99.877% ( 76, 110 ] 1 0.002% 99.879% ( 110, 170 ] 8 0.017% 99.896% ( 170, 250 ] 7 0.015% 99.910% ( 250, 380 ] 5 0.010% 99.921% ( 380, 580 ] 17 0.035% 99.956% ( 580, 870 ] 4 0.008% 99.965% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 5 0.010% 99.977% ( 1900, 2900 ] 8 0.017% 99.994% ( 2900, 4400 ] 4 0.008% 100.002% ( 4400, 6600 ] 2 0.004% 100.006% ( 6600, 9900 ] 1 0.002% 100.008% ** Level 4 read latency histogram (micros): Count: 30 Average: 1655.2667 StdDev: 1611.58 Min: 100 Median: 870.0000 Max: 5383 Percentiles: P50: 870.00 P75: 2733.33 P99: 5383.00 P99.9: 5383.00 P99.99: 5383.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 7 23.333% 43.333% ##### ( 580, 870 ] 2 6.667% 50.000% # ( 870, 1300 ] 4 13.333% 63.333% ### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 3 10.000% 76.667% ## ( 2900, 4400 ] 5 16.667% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 758.8000 StdDev: 909.52 Min: 104 Median: 354.0000 Max: 3430 Percentiles: P50: 354.00 P75: 773.33 P99: 3430.00 P99.9: 3430.00 P99.99: 3430.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 1 5.000% 30.000% # ( 250, 380 ] 5 25.000% 55.000% ##### ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 16.7 total, 4.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 294.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.280 H:M:S, 19.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 210.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.958 H:M:S, 42.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-12:52:44 ... thread 0: (1000000,6000000) ops and (90882.0,218310.7) ops/second in (11.003277,27.483771) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 1.84 GB 163.2 6.1 0.0 6.1 11.8 5.7 0.0 2.1 156.7 303.7 39.79 37.50 105 0.379 6331K 9716 0.0 0.0 L1 11/0 1.20 GB 122.5 3.6 3.6 0.0 3.6 3.6 0.2 1.0 221.5 218.3 16.78 15.91 2 8.390 3773K 53K 0.0 0.0 L2 2/1 178.69 MB 0.5 0.3 0.2 0.2 0.3 0.2 2.4 1.8 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 L3 27/12 2.09 GB 1.1 0.7 0.5 0.2 0.7 0.5 1.9 1.3 201.5 201.3 3.72 3.30 3 1.239 760K 739 0.0 0.0 L4 161/21 10.31 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/38 101.73 GB 0.0 10.8 4.4 6.4 16.4 10.0 5.8 2.9 179.0 272.9 61.73 58.11 112 0.551 11M 63K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.8 4.4 6.4 16.4 10.0 5.8 2.9 179.0 272.9 61.73 58.11 112 0.551 11M 63K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.8 4.4 6.4 10.7 4.3 0.0 0.0 243.6 242.2 45.36 43.48 26 1.745 11M 63K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 357.9 16.37 14.62 86 0.190 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.7 total, 27.5 interval Flush(GB): cumulative 5.722, interval 5.722 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.45 GB write, 607.29 MB/s write, 10.79 GB read, 398.37 MB/s read, 61.7 seconds Interval compaction: 16.45 GB write, 612.85 MB/s write, 10.79 GB read, 402.02 MB/s read, 61.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 11, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2582142 Average: 2.3521 StdDev: 14.12 Min: 0 Median: 1.4273 Max: 4410 Percentiles: P50: 1.43 P75: 1.81 P99: 5.73 P99.9: 104.36 P99.99: 223.40 ------------------------------------------------------ [ 0, 1 ] 577393 22.361% 22.361% #### ( 1, 2 ] 1670216 64.683% 87.044% ############# ( 2, 3 ] 204428 7.917% 94.961% ## ( 3, 4 ] 70933 2.747% 97.708% # ( 4, 6 ] 38548 1.493% 99.201% ( 6, 10 ] 14785 0.573% 99.774% ( 10, 15 ] 1490 0.058% 99.832% ( 15, 22 ] 260 0.010% 99.842% ( 22, 34 ] 26 0.001% 99.843% ( 34, 51 ] 21 0.001% 99.843% ( 51, 76 ] 46 0.002% 99.845% ( 76, 110 ] 1695 0.066% 99.911% ( 110, 170 ] 1691 0.065% 99.976% ( 170, 250 ] 527 0.020% 99.997% ( 250, 380 ] 334 0.013% 100.010% ( 380, 580 ] 208 0.008% 100.018% ( 580, 870 ] 118 0.005% 100.022% ( 870, 1300 ] 34 0.001% 100.024% ( 1300, 1900 ] 18 0.001% 100.024% ( 1900, 2900 ] 14 0.001% 100.025% ( 2900, 4400 ] 10 0.000% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 97899 Average: 3.3857 StdDev: 34.90 Min: 1 Median: 1.6362 Max: 4098 Percentiles: P50: 1.64 P75: 2.07 P99: 5.95 P99.9: 191.22 P99.99: 1239.64 ------------------------------------------------------ [ 0, 1 ] 8011 8.183% 8.183% ## ( 1, 2 ] 64348 65.729% 73.912% ############# ( 2, 3 ] 16144 16.490% 90.402% ### ( 3, 4 ] 4860 4.964% 95.367% # ( 4, 6 ] 3652 3.730% 99.097% # ( 6, 10 ] 571 0.583% 99.680% ( 10, 15 ] 125 0.128% 99.808% ( 15, 22 ] 14 0.014% 99.822% ( 22, 34 ] 1 0.001% 99.823% ( 51, 76 ] 2 0.002% 99.825% ( 76, 110 ] 30 0.031% 99.856% ( 110, 170 ] 37 0.038% 99.894% ( 170, 250 ] 23 0.023% 99.917% ( 250, 380 ] 11 0.011% 99.928% ( 380, 580 ] 18 0.018% 99.947% ( 580, 870 ] 19 0.019% 99.966% ( 870, 1300 ] 27 0.028% 99.994% ( 1300, 1900 ] 15 0.015% 100.009% ( 1900, 2900 ] 3 0.003% 100.012% ( 2900, 4400 ] 1 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 88191 Average: 2.1032 StdDev: 8.93 Min: 0 Median: 1.3646 Max: 1452 Percentiles: P50: 1.36 P75: 1.78 P99: 5.64 P99.9: 26.85 P99.99: 389.04 ------------------------------------------------------ [ 0, 1 ] 24697 28.004% 28.004% ###### ( 1, 2 ] 53207 60.332% 88.336% ############ ( 2, 3 ] 5846 6.629% 94.964% # ( 3, 4 ] 2368 2.685% 97.649% # ( 4, 6 ] 1453 1.648% 99.297% ( 6, 10 ] 448 0.508% 99.805% ( 10, 15 ] 64 0.073% 99.878% ( 15, 22 ] 19 0.022% 99.899% ( 22, 34 ] 2 0.002% 99.901% ( 34, 51 ] 30 0.034% 99.935% ( 51, 76 ] 16 0.018% 99.954% ( 76, 110 ] 7 0.008% 99.961% ( 110, 170 ] 7 0.008% 99.969% ( 170, 250 ] 9 0.010% 99.980% ( 250, 380 ] 9 0.010% 99.990% ( 380, 580 ] 4 0.005% 99.994% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 48309 Average: 6.4319 StdDev: 78.70 Min: 0 Median: 1.6202 Max: 6733 Percentiles: P50: 1.62 P75: 2.02 P99: 9.87 P99.9: 795.77 P99.99: 2807.67 ------------------------------------------------------ [ 0, 1 ] 4624 9.572% 9.572% ## ( 1, 2 ] 31489 65.182% 74.754% ############# ( 2, 3 ] 7423 15.366% 90.120% ### ( 3, 4 ] 2376 4.918% 95.038% # ( 4, 6 ] 1641 3.397% 98.435% # ( 6, 10 ] 283 0.586% 99.021% ( 10, 15 ] 95 0.197% 99.218% ( 15, 22 ] 9 0.019% 99.236% ( 22, 34 ] 13 0.027% 99.263% ( 34, 51 ] 5 0.010% 99.273% ( 76, 110 ] 6 0.012% 99.286% ( 110, 170 ] 35 0.072% 99.358% ( 170, 250 ] 71 0.147% 99.505% ( 250, 380 ] 71 0.147% 99.652% ( 380, 580 ] 83 0.172% 99.824% ( 580, 870 ] 52 0.108% 99.932% ( 870, 1300 ] 16 0.033% 99.965% ( 1300, 1900 ] 6 0.012% 99.977% ( 1900, 2900 ] 9 0.019% 99.996% ( 2900, 4400 ] 5 0.010% 100.006% ( 4400, 6600 ] 2 0.004% 100.010% ( 6600, 9900 ] 1 0.002% 100.012% ** Level 4 read latency histogram (micros): Count: 30 Average: 1655.2667 StdDev: 1611.58 Min: 100 Median: 870.0000 Max: 5383 Percentiles: P50: 870.00 P75: 2733.33 P99: 5383.00 P99.9: 5383.00 P99.99: 5383.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 110, 170 ] 1 3.333% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 3 10.000% 20.000% ## ( 380, 580 ] 7 23.333% 43.333% ##### ( 580, 870 ] 2 6.667% 50.000% # ( 870, 1300 ] 4 13.333% 63.333% ### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 3 10.000% 76.667% ## ( 2900, 4400 ] 5 16.667% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 758.8000 StdDev: 909.52 Min: 104 Median: 354.0000 Max: 3430 Percentiles: P50: 354.00 P75: 773.33 P99: 3430.00 P99.9: 3430.00 P99.99: 3430.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 1 5.000% 30.000% # ( 250, 380 ] 5 25.000% 55.000% ##### ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 27.7 total, 11.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 212.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.235 H:M:S, 40.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 89.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.955 H:M:S, 72.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/15-12:52:48 ... thread 0: (1000000,7000000) ops and (261505.5,223586.6) ops/second in (3.824012,31.307783) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 2.76 GB 37.8 6.6 0.0 6.6 13.2 6.6 0.0 2.0 147.0 293.8 45.85 41.87 119 0.385 6842K 10K 0.0 0.0 L1 11/11 1.20 GB 0.0 3.6 3.6 0.0 3.6 3.6 0.2 1.0 221.5 218.3 16.78 15.91 2 8.390 3773K 53K 0.0 0.0 L2 1/0 49.91 MB 0.5 0.3 0.2 0.2 0.3 0.2 2.4 1.8 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 L3 14/0 957.71 MB 1.0 0.9 0.7 0.2 0.9 0.7 1.9 1.3 184.7 184.5 4.80 3.94 4 1.200 891K 739 0.0 0.0 L4 161/0 9.62 GB 1.0 1.6 1.3 0.3 1.6 1.3 1.1 1.2 121.1 120.6 13.19 7.48 12 1.099 1552K 5129 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/21 102.65 GB 0.0 13.0 5.8 7.2 19.5 12.3 7.8 3.0 161.9 243.2 82.07 70.59 139 0.590 13M 69K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.0 5.8 7.2 19.5 12.3 7.8 3.0 161.9 243.2 82.07 70.59 139 0.590 13M 69K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.0 5.8 7.2 12.9 5.7 0.0 0.0 213.4 212.2 62.28 53.60 41 1.519 13M 69K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 340.7 19.79 16.99 98 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.6 total, 31.3 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.49 GB write, 632.38 MB/s write, 12.98 GB read, 421.07 MB/s read, 82.1 seconds Interval compaction: 19.49 GB write, 637.47 MB/s write, 12.98 GB read, 424.45 MB/s read, 82.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 23, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2862209 Average: 2.3904 StdDev: 16.79 Min: 0 Median: 1.4419 Max: 10995 Percentiles: P50: 1.44 P75: 1.83 P99: 5.81 P99.9: 100.93 P99.99: 231.63 ------------------------------------------------------ [ 0, 1 ] 612677 21.406% 21.406% #### ( 1, 2 ] 1852195 64.712% 86.118% ############# ( 2, 3 ] 240690 8.409% 94.527% ## ( 3, 4 ] 84219 2.942% 97.470% # ( 4, 6 ] 48297 1.687% 99.157% ( 6, 10 ] 17834 0.623% 99.780% ( 10, 15 ] 1800 0.063% 99.843% ( 15, 22 ] 290 0.010% 99.853% ( 22, 34 ] 28 0.001% 99.854% ( 34, 51 ] 22 0.001% 99.855% ( 51, 76 ] 47 0.002% 99.856% ( 76, 110 ] 1703 0.059% 99.916% ( 110, 170 ] 1705 0.060% 99.975% ( 170, 250 ] 541 0.019% 99.994% ( 250, 380 ] 356 0.012% 100.007% ( 380, 580 ] 241 0.008% 100.015% ( 580, 870 ] 148 0.005% 100.020% ( 870, 1300 ] 54 0.002% 100.022% ( 1300, 1900 ] 27 0.001% 100.023% ( 1900, 2900 ] 19 0.001% 100.024% ( 2900, 4400 ] 16 0.001% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 388549 Average: 4.8612 StdDev: 90.74 Min: 1 Median: 1.8343 Max: 15197 Percentiles: P50: 1.83 P75: 2.75 P99: 8.31 P99.9: 13.57 P99.99: 17.67 ------------------------------------------------------ [ 0, 1 ] 14754 3.797% 3.797% # ( 1, 2 ] 215180 55.380% 59.178% ########### ( 2, 3 ] 82482 21.228% 80.406% #### ( 3, 4 ] 35573 9.155% 89.561% ## ( 4, 6 ] 32932 8.476% 98.037% ## ( 6, 10 ] 6484 1.669% 99.706% ( 10, 15 ] 1059 0.273% 99.978% ( 15, 22 ] 121 0.031% 100.009% ( 22, 34 ] 17 0.004% 100.014% ( 34, 51 ] 6 0.002% 100.015% ( 51, 76 ] 4 0.001% 100.016% ( 76, 110 ] 54 0.014% 100.030% ( 110, 170 ] 79 0.020% 100.050% ( 170, 250 ] 75 0.019% 100.070% ( 250, 380 ] 74 0.019% 100.089% ( 380, 580 ] 87 0.022% 100.111% ( 580, 870 ] 86 0.022% 100.133% ( 870, 1300 ] 64 0.016% 100.150% ( 1300, 1900 ] 38 0.010% 100.160% ( 1900, 2900 ] 35 0.009% 100.169% ( 2900, 4400 ] 52 0.013% 100.182% ( 4400, 6600 ] 23 0.006% 100.188% ( 6600, 9900 ] 12 0.003% 100.191% ( 9900, 14000 ] 2 0.001% 100.191% ( 14000, 22000 ] 2 0.001% 100.192% ** Level 2 read latency histogram (micros): Count: 88191 Average: 2.1032 StdDev: 8.93 Min: 0 Median: 1.3646 Max: 1452 Percentiles: P50: 1.36 P75: 1.78 P99: 5.64 P99.9: 26.85 P99.99: 389.04 ------------------------------------------------------ [ 0, 1 ] 24697 28.004% 28.004% ###### ( 1, 2 ] 53207 60.332% 88.336% ############ ( 2, 3 ] 5846 6.629% 94.964% # ( 3, 4 ] 2368 2.685% 97.649% # ( 4, 6 ] 1453 1.648% 99.297% ( 6, 10 ] 448 0.508% 99.805% ( 10, 15 ] 64 0.073% 99.878% ( 15, 22 ] 19 0.022% 99.899% ( 22, 34 ] 2 0.002% 99.901% ( 34, 51 ] 30 0.034% 99.935% ( 51, 76 ] 16 0.018% 99.954% ( 76, 110 ] 7 0.008% 99.961% ( 110, 170 ] 7 0.008% 99.969% ( 170, 250 ] 9 0.010% 99.980% ( 250, 380 ] 9 0.010% 99.990% ( 380, 580 ] 4 0.005% 99.994% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 179500 Average: 12.0295 StdDev: 149.63 Min: 0 Median: 1.8125 Max: 15668 Percentiles: P50: 1.81 P75: 2.72 P99: 144.97 P99.9: 1241.26 P99.99: 2360.34 ------------------------------------------------------ [ 0, 1 ] 8950 4.986% 4.986% # ( 1, 2 ] 99448 55.403% 60.389% ########### ( 2, 3 ] 36437 20.299% 80.688% #### ( 3, 4 ] 16298 9.080% 89.768% ## ( 4, 6 ] 12470 6.947% 96.715% # ( 6, 10 ] 3198 1.782% 98.496% ( 10, 15 ] 577 0.321% 98.818% ( 15, 22 ] 99 0.055% 98.873% ( 22, 34 ] 21 0.012% 98.885% ( 34, 51 ] 7 0.004% 98.889% ( 76, 110 ] 84 0.047% 98.935% ( 110, 170 ] 199 0.111% 99.046% ( 170, 250 ] 265 0.148% 99.194% ( 250, 380 ] 326 0.182% 99.375% ( 380, 580 ] 401 0.223% 99.599% ( 580, 870 ] 373 0.208% 99.807% ( 870, 1300 ] 194 0.108% 99.915% ( 1300, 1900 ] 95 0.053% 99.968% ( 1900, 2900 ] 87 0.048% 100.016% ( 2900, 4400 ] 78 0.043% 100.060% ( 4400, 6600 ] 17 0.009% 100.069% ( 6600, 9900 ] 6 0.003% 100.072% ( 9900, 14000 ] 4 0.002% 100.075% ( 14000, 22000 ] 2 0.001% 100.076% ** Level 4 read latency histogram (micros): Count: 14854 Average: 8.3540 StdDev: 115.62 Min: 0 Median: 1.8077 Max: 5383 Percentiles: P50: 1.81 P75: 2.61 P99: 9.39 P99.9: 1557.52 P99.99: 4966.06 ------------------------------------------------------ [ 0, 1 ] 389 2.619% 2.619% # ( 1, 2 ] 8714 58.664% 61.283% ############ ( 2, 3 ] 3321 22.358% 83.641% #### ( 3, 4 ] 1174 7.904% 91.544% ## ( 4, 6 ] 972 6.544% 98.088% # ( 6, 10 ] 160 1.077% 99.165% ( 10, 15 ] 16 0.108% 99.273% ( 15, 22 ] 5 0.034% 99.307% ( 22, 34 ] 10 0.067% 99.374% ( 34, 51 ] 5 0.034% 99.408% ( 51, 76 ] 3 0.020% 99.428% ( 76, 110 ] 2 0.013% 99.441% ( 110, 170 ] 4 0.027% 99.468% ( 170, 250 ] 13 0.088% 99.556% ( 250, 380 ] 12 0.081% 99.636% ( 380, 580 ] 16 0.108% 99.744% ( 580, 870 ] 8 0.054% 99.798% ( 870, 1300 ] 13 0.088% 99.886% ( 1300, 1900 ] 5 0.034% 99.919% ( 1900, 2900 ] 4 0.027% 99.946% ( 2900, 4400 ] 6 0.040% 99.987% ( 4400, 6600 ] 2 0.013% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1045.5929 StdDev: 1187.40 Min: 91 Median: 460.0000 Max: 6000 Percentiles: P50: 460.00 P75: 1525.00 P99: 4357.14 P99.9: 6000.00 P99.99: 6000.00 ------------------------------------------------------ ( 76, 110 ] 4 2.857% 2.857% # ( 110, 170 ] 19 13.571% 16.429% ### ( 170, 250 ] 13 9.286% 25.714% ## ( 250, 380 ] 28 20.000% 45.714% #### ( 380, 580 ] 15 10.714% 56.429% ## ( 580, 870 ] 15 10.714% 67.143% ## ( 870, 1300 ] 8 5.714% 72.857% # ( 1300, 1900 ] 8 5.714% 78.571% # ( 1900, 2900 ] 15 10.714% 89.286% ## ( 2900, 4400 ] 14 10.000% 99.286% ## ( 4400, 6600 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 31.6 total, 3.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 218.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.307 H:M:S, 39.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 257.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.073 H:M:S, 28.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-12:52:51 ... thread 0: (1000000,8000000) ops and (307856.6,231507.9) ops/second in (3.248266,34.556049) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.81 GB 151.0 7.4 0.0 7.4 15.1 7.6 0.0 2.0 145.9 295.2 52.23 47.88 136 0.384 7738K 11K 0.0 0.0 L1 11/11 1.20 GB 0.0 3.6 3.6 0.0 3.6 3.6 0.2 1.0 221.5 218.3 16.78 15.91 2 8.390 3773K 53K 0.0 0.0 L2 1/0 49.91 MB 0.5 0.3 0.2 0.2 0.3 0.2 2.4 1.8 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 L3 14/0 957.71 MB 1.0 0.9 0.7 0.2 0.9 0.7 1.9 1.3 184.7 184.5 4.80 3.94 4 1.200 891K 739 0.0 0.0 L4 161/0 9.62 GB 1.0 1.6 1.3 0.3 1.6 1.3 1.1 1.2 121.1 120.6 13.19 7.48 12 1.099 1552K 5129 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/21 103.69 GB 0.0 13.8 5.8 8.1 21.4 13.3 7.8 2.8 160.2 247.7 88.45 76.60 156 0.567 14M 70K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.8 5.8 8.1 21.4 13.3 7.8 2.8 160.2 247.7 88.45 76.60 156 0.567 14M 70K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.8 5.8 8.1 13.8 5.7 0.0 0.0 215.9 214.8 65.64 56.91 44 1.492 14M 70K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 342.5 22.80 19.70 112 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.8 total, 34.6 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.40 GB write, 629.44 MB/s write, 13.84 GB read, 407.11 MB/s read, 88.4 seconds Interval compaction: 21.40 GB write, 634.03 MB/s write, 13.84 GB read, 410.07 MB/s read, 88.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 28, interval: 47 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3301271 Average: 2.3704 StdDev: 15.92 Min: 0 Median: 1.4542 Max: 10995 Percentiles: P50: 1.45 P75: 1.84 P99: 5.82 P99.9: 89.42 P99.99: 201.03 ------------------------------------------------------ [ 0, 1 ] 673080 20.389% 20.389% #### ( 1, 2 ] 2152061 65.189% 85.577% ############# ( 2, 3 ] 290656 8.804% 94.382% ## ( 3, 4 ] 99808 3.023% 97.405% # ( 4, 6 ] 57711 1.748% 99.153% ( 6, 10 ] 21430 0.649% 99.802% ( 10, 15 ] 2132 0.065% 99.867% ( 15, 22 ] 313 0.009% 99.876% ( 22, 34 ] 31 0.001% 99.877% ( 34, 51 ] 24 0.001% 99.878% ( 51, 76 ] 50 0.002% 99.880% ( 76, 110 ] 1710 0.052% 99.931% ( 110, 170 ] 1721 0.052% 99.984% ( 170, 250 ] 554 0.017% 100.000% ( 250, 380 ] 367 0.011% 100.011% ( 380, 580 ] 250 0.008% 100.019% ( 580, 870 ] 151 0.005% 100.024% ( 870, 1300 ] 64 0.002% 100.026% ( 1300, 1900 ] 27 0.001% 100.026% ( 1900, 2900 ] 21 0.001% 100.027% ( 2900, 4400 ] 16 0.000% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ( 9900, 14000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 388549 Average: 4.8612 StdDev: 90.74 Min: 1 Median: 1.8343 Max: 15197 Percentiles: P50: 1.83 P75: 2.75 P99: 8.31 P99.9: 13.57 P99.99: 17.67 ------------------------------------------------------ [ 0, 1 ] 14754 3.797% 3.797% # ( 1, 2 ] 215180 55.380% 59.178% ########### ( 2, 3 ] 82482 21.228% 80.406% #### ( 3, 4 ] 35573 9.155% 89.561% ## ( 4, 6 ] 32932 8.476% 98.037% ## ( 6, 10 ] 6484 1.669% 99.706% ( 10, 15 ] 1059 0.273% 99.978% ( 15, 22 ] 121 0.031% 100.009% ( 22, 34 ] 17 0.004% 100.014% ( 34, 51 ] 6 0.002% 100.015% ( 51, 76 ] 4 0.001% 100.016% ( 76, 110 ] 54 0.014% 100.030% ( 110, 170 ] 79 0.020% 100.050% ( 170, 250 ] 75 0.019% 100.070% ( 250, 380 ] 74 0.019% 100.089% ( 380, 580 ] 87 0.022% 100.111% ( 580, 870 ] 86 0.022% 100.133% ( 870, 1300 ] 64 0.016% 100.150% ( 1300, 1900 ] 38 0.010% 100.160% ( 1900, 2900 ] 35 0.009% 100.169% ( 2900, 4400 ] 52 0.013% 100.182% ( 4400, 6600 ] 23 0.006% 100.188% ( 6600, 9900 ] 12 0.003% 100.191% ( 9900, 14000 ] 2 0.001% 100.191% ( 14000, 22000 ] 2 0.001% 100.192% ** Level 2 read latency histogram (micros): Count: 88191 Average: 2.1032 StdDev: 8.93 Min: 0 Median: 1.3646 Max: 1452 Percentiles: P50: 1.36 P75: 1.78 P99: 5.64 P99.9: 26.85 P99.99: 389.04 ------------------------------------------------------ [ 0, 1 ] 24697 28.004% 28.004% ###### ( 1, 2 ] 53207 60.332% 88.336% ############ ( 2, 3 ] 5846 6.629% 94.964% # ( 3, 4 ] 2368 2.685% 97.649% # ( 4, 6 ] 1453 1.648% 99.297% ( 6, 10 ] 448 0.508% 99.805% ( 10, 15 ] 64 0.073% 99.878% ( 15, 22 ] 19 0.022% 99.899% ( 22, 34 ] 2 0.002% 99.901% ( 34, 51 ] 30 0.034% 99.935% ( 51, 76 ] 16 0.018% 99.954% ( 76, 110 ] 7 0.008% 99.961% ( 110, 170 ] 7 0.008% 99.969% ( 170, 250 ] 9 0.010% 99.980% ( 250, 380 ] 9 0.010% 99.990% ( 380, 580 ] 4 0.005% 99.994% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 179500 Average: 12.0295 StdDev: 149.63 Min: 0 Median: 1.8125 Max: 15668 Percentiles: P50: 1.81 P75: 2.72 P99: 144.97 P99.9: 1241.26 P99.99: 2360.34 ------------------------------------------------------ [ 0, 1 ] 8950 4.986% 4.986% # ( 1, 2 ] 99448 55.403% 60.389% ########### ( 2, 3 ] 36437 20.299% 80.688% #### ( 3, 4 ] 16298 9.080% 89.768% ## ( 4, 6 ] 12470 6.947% 96.715% # ( 6, 10 ] 3198 1.782% 98.496% ( 10, 15 ] 577 0.321% 98.818% ( 15, 22 ] 99 0.055% 98.873% ( 22, 34 ] 21 0.012% 98.885% ( 34, 51 ] 7 0.004% 98.889% ( 76, 110 ] 84 0.047% 98.935% ( 110, 170 ] 199 0.111% 99.046% ( 170, 250 ] 265 0.148% 99.194% ( 250, 380 ] 326 0.182% 99.375% ( 380, 580 ] 401 0.223% 99.599% ( 580, 870 ] 373 0.208% 99.807% ( 870, 1300 ] 194 0.108% 99.915% ( 1300, 1900 ] 95 0.053% 99.968% ( 1900, 2900 ] 87 0.048% 100.016% ( 2900, 4400 ] 78 0.043% 100.060% ( 4400, 6600 ] 17 0.009% 100.069% ( 6600, 9900 ] 6 0.003% 100.072% ( 9900, 14000 ] 4 0.002% 100.075% ( 14000, 22000 ] 2 0.001% 100.076% ** Level 4 read latency histogram (micros): Count: 14854 Average: 8.3540 StdDev: 115.62 Min: 0 Median: 1.8077 Max: 5383 Percentiles: P50: 1.81 P75: 2.61 P99: 9.39 P99.9: 1557.52 P99.99: 4966.06 ------------------------------------------------------ [ 0, 1 ] 389 2.619% 2.619% # ( 1, 2 ] 8714 58.664% 61.283% ############ ( 2, 3 ] 3321 22.358% 83.641% #### ( 3, 4 ] 1174 7.904% 91.544% ## ( 4, 6 ] 972 6.544% 98.088% # ( 6, 10 ] 160 1.077% 99.165% ( 10, 15 ] 16 0.108% 99.273% ( 15, 22 ] 5 0.034% 99.307% ( 22, 34 ] 10 0.067% 99.374% ( 34, 51 ] 5 0.034% 99.408% ( 51, 76 ] 3 0.020% 99.428% ( 76, 110 ] 2 0.013% 99.441% ( 110, 170 ] 4 0.027% 99.468% ( 170, 250 ] 13 0.088% 99.556% ( 250, 380 ] 12 0.081% 99.636% ( 380, 580 ] 16 0.108% 99.744% ( 580, 870 ] 8 0.054% 99.798% ( 870, 1300 ] 13 0.088% 99.886% ( 1300, 1900 ] 5 0.034% 99.919% ( 1900, 2900 ] 4 0.027% 99.946% ( 2900, 4400 ] 6 0.040% 99.987% ( 4400, 6600 ] 2 0.013% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1045.5929 StdDev: 1187.40 Min: 91 Median: 460.0000 Max: 6000 Percentiles: P50: 460.00 P75: 1525.00 P99: 4357.14 P99.9: 6000.00 P99.99: 6000.00 ------------------------------------------------------ ( 76, 110 ] 4 2.857% 2.857% # ( 110, 170 ] 19 13.571% 16.429% ### ( 170, 250 ] 13 9.286% 25.714% ## ( 250, 380 ] 28 20.000% 45.714% #### ( 380, 580 ] 15 10.714% 56.429% ## ( 580, 870 ] 15 10.714% 67.143% ## ( 870, 1300 ] 8 5.714% 72.857% # ( 1300, 1900 ] 8 5.714% 78.571% # ( 1900, 2900 ] 15 10.714% 89.286% ## ( 2900, 4400 ] 14 10.000% 99.286% ## ( 4400, 6600 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 34.8 total, 3.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 226.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.900 H:M:S, 37.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.593 H:M:S, 18.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-12:53:06 ... thread 0: (1000000,9000000) ops and (66505.1,181479.1) ops/second in (15.036430,49.592479) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 2.58 GB 18.9 9.4 0.0 9.4 17.9 8.5 0.0 2.1 146.2 277.9 65.90 58.00 151 0.436 9784K 17K 0.0 0.0 L1 7/7 741.96 MB 0.0 6.9 5.7 1.2 6.8 5.6 0.2 1.2 221.0 218.0 32.03 30.18 3 10.675 6465K 53K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.9 1.8 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 L3 29/8 1.65 GB 1.0 3.2 1.8 1.4 3.2 1.8 3.3 1.8 129.1 128.3 25.39 14.96 13 1.953 3319K 19K 0.0 0.0 L4 161/14 9.77 GB 1.0 3.9 3.1 0.8 3.8 3.1 1.1 1.2 122.2 121.6 32.37 18.41 31 1.044 3922K 15K 0.0 0.0 L5 1092/0 89.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/37 104.48 GB 0.0 23.7 10.8 12.9 32.1 19.1 13.4 3.8 154.6 209.0 157.13 122.94 200 0.786 23M 106K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.7 10.8 12.9 32.1 19.1 13.4 3.8 154.6 209.0 157.13 122.94 200 0.786 23M 106K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.7 10.8 12.9 23.6 10.6 0.0 0.0 188.7 187.5 128.77 100.71 77 1.672 23M 106K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 306.5 28.36 22.23 123 0.231 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.8 total, 49.6 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.07 GB write, 658.75 MB/s write, 23.73 GB read, 487.41 MB/s read, 157.1 seconds Interval compaction: 32.07 GB write, 662.09 MB/s write, 23.73 GB read, 489.89 MB/s read, 157.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 57, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 57, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4256916 Average: 2.7751 StdDev: 28.00 Min: 0 Median: 1.4822 Max: 11504 Percentiles: P50: 1.48 P75: 1.87 P99: 6.74 P99.9: 138.53 P99.99: 349.66 ------------------------------------------------------ [ 0, 1 ] 811503 19.063% 19.063% #### ( 1, 2 ] 2731190 64.159% 83.222% ############# ( 2, 3 ] 413204 9.707% 92.929% ## ( 3, 4 ] 149732 3.517% 96.446% # ( 4, 6 ] 102379 2.405% 98.851% ( 6, 10 ] 34122 0.802% 99.653% ( 10, 15 ] 3724 0.087% 99.740% ( 15, 22 ] 534 0.013% 99.753% ( 22, 34 ] 46 0.001% 99.754% ( 34, 51 ] 28 0.001% 99.754% ( 51, 76 ] 78 0.002% 99.756% ( 76, 110 ] 4182 0.098% 99.854% ( 110, 170 ] 4076 0.096% 99.950% ( 170, 250 ] 1080 0.025% 99.976% ( 250, 380 ] 800 0.019% 99.994% ( 380, 580 ] 574 0.013% 100.008% ( 580, 870 ] 339 0.008% 100.016% ( 870, 1300 ] 169 0.004% 100.020% ( 1300, 1900 ] 86 0.002% 100.022% ( 1900, 2900 ] 87 0.002% 100.024% ( 2900, 4400 ] 73 0.002% 100.026% ( 4400, 6600 ] 13 0.000% 100.026% ( 6600, 9900 ] 6 0.000% 100.026% ( 9900, 14000 ] 2 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1479204 Average: 6.3698 StdDev: 105.92 Min: 1 Median: 1.8174 Max: 15336 Percentiles: P50: 1.82 P75: 2.76 P99: 9.14 P99.9: 91.68 P99.99: 219.52 ------------------------------------------------------ [ 0, 1 ] 91274 6.170% 6.170% # ( 1, 2 ] 793132 53.619% 59.789% ########### ( 2, 3 ] 296900 20.072% 79.861% #### ( 3, 4 ] 131478 8.888% 88.749% ## ( 4, 6 ] 125962 8.516% 97.265% ## ( 6, 10 ] 32683 2.209% 99.474% ( 10, 15 ] 5107 0.345% 99.820% ( 15, 22 ] 656 0.044% 99.864% ( 22, 34 ] 47 0.003% 99.867% ( 34, 51 ] 22 0.001% 99.869% ( 51, 76 ] 94 0.006% 99.875% ( 76, 110 ] 802 0.054% 99.929% ( 110, 170 ] 688 0.047% 99.976% ( 170, 250 ] 341 0.023% 99.999% ( 250, 380 ] 415 0.028% 100.027% ( 380, 580 ] 579 0.039% 100.066% ( 580, 870 ] 585 0.040% 100.106% ( 870, 1300 ] 407 0.028% 100.133% ( 1300, 1900 ] 243 0.016% 100.149% ( 1900, 2900 ] 333 0.023% 100.172% ( 2900, 4400 ] 447 0.030% 100.202% ( 4400, 6600 ] 135 0.009% 100.211% ( 6600, 9900 ] 41 0.003% 100.214% ( 9900, 14000 ] 6 0.000% 100.215% ( 14000, 22000 ] 3 0.000% 100.215% ** Level 2 read latency histogram (micros): Count: 88191 Average: 2.1032 StdDev: 8.93 Min: 0 Median: 1.3646 Max: 1452 Percentiles: P50: 1.36 P75: 1.78 P99: 5.64 P99.9: 26.85 P99.99: 389.04 ------------------------------------------------------ [ 0, 1 ] 24697 28.004% 28.004% ###### ( 1, 2 ] 53207 60.332% 88.336% ############ ( 2, 3 ] 5846 6.629% 94.964% # ( 3, 4 ] 2368 2.685% 97.649% # ( 4, 6 ] 1453 1.648% 99.297% ( 6, 10 ] 448 0.508% 99.805% ( 10, 15 ] 64 0.073% 99.878% ( 15, 22 ] 19 0.022% 99.899% ( 22, 34 ] 2 0.002% 99.901% ( 34, 51 ] 30 0.034% 99.935% ( 51, 76 ] 16 0.018% 99.954% ( 76, 110 ] 7 0.008% 99.961% ( 110, 170 ] 7 0.008% 99.969% ( 170, 250 ] 9 0.010% 99.980% ( 250, 380 ] 9 0.010% 99.990% ( 380, 580 ] 4 0.005% 99.994% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 544070 Average: 9.1374 StdDev: 124.41 Min: 0 Median: 1.9553 Max: 15668 Percentiles: P50: 1.96 P75: 2.98 P99: 9.61 P99.9: 662.22 P99.99: 918.15 ------------------------------------------------------ [ 0, 1 ] 12349 2.270% 2.270% ( 1, 2 ] 271835 49.963% 52.233% ########## ( 2, 3 ] 126639 23.276% 75.509% ##### ( 3, 4 ] 62260 11.443% 86.953% ## ( 4, 6 ] 56699 10.421% 97.374% ## ( 6, 10 ] 9794 1.800% 99.174% ( 10, 15 ] 1824 0.335% 99.509% ( 15, 22 ] 216 0.040% 99.549% ( 22, 34 ] 27 0.005% 99.554% ( 34, 51 ] 10 0.002% 99.556% ( 51, 76 ] 9 0.002% 99.557% ( 76, 110 ] 92 0.017% 99.574% ( 110, 170 ] 224 0.041% 99.615% ( 170, 250 ] 318 0.058% 99.674% ( 250, 380 ] 444 0.082% 99.756% ( 380, 580 ] 612 0.112% 99.868% ( 580, 870 ] 617 0.113% 99.981% ( 870, 1300 ] 425 0.078% 100.060% ( 1300, 1900 ] 236 0.043% 100.103% ( 1900, 2900 ] 188 0.035% 100.137% ( 2900, 4400 ] 212 0.039% 100.176% ( 4400, 6600 ] 45 0.008% 100.185% ( 6600, 9900 ] 14 0.003% 100.187% ( 9900, 14000 ] 5 0.001% 100.188% ( 14000, 22000 ] 2 0.000% 100.189% ** Level 4 read latency histogram (micros): Count: 142586 Average: 19.8298 StdDev: 195.47 Min: 0 Median: 2.0175 Max: 8208 Percentiles: P50: 2.02 P75: 3.09 P99: 481.32 P99.9: 3031.37 P99.99: 4125.07 ------------------------------------------------------ [ 0, 1 ] 1902 1.334% 1.334% ( 1, 2 ] 68781 48.238% 49.572% ########## ( 2, 3 ] 34845 24.438% 74.010% ##### ( 3, 4 ] 16371 11.481% 85.492% ## ( 4, 6 ] 14557 10.209% 95.701% ## ( 6, 10 ] 3508 2.460% 98.161% ( 10, 15 ] 572 0.401% 98.562% ( 15, 22 ] 79 0.055% 98.618% ( 22, 34 ] 20 0.014% 98.632% ( 34, 51 ] 7 0.005% 98.637% ( 51, 76 ] 7 0.005% 98.642% ( 76, 110 ] 27 0.019% 98.660% ( 110, 170 ] 58 0.041% 98.701% ( 170, 250 ] 102 0.072% 98.773% ( 250, 380 ] 161 0.113% 98.886% ( 380, 580 ] 324 0.227% 99.113% ( 580, 870 ] 418 0.293% 99.406% ( 870, 1300 ] 346 0.243% 99.649% ( 1300, 1900 ] 191 0.134% 99.783% ( 1900, 2900 ] 153 0.107% 99.890% ( 2900, 4400 ] 176 0.123% 100.013% ( 4400, 6600 ] 37 0.026% 100.039% ( 6600, 9900 ] 4 0.003% 100.042% ** Level 5 read latency histogram (micros): Count: 240 Average: 1592.8958 StdDev: 1755.91 Min: 91 Median: 770.3125 Max: 9232 Percentiles: P50: 770.31 P75: 2566.67 P99: 8316.00 P99.9: 9232.00 P99.99: 9232.00 ------------------------------------------------------ ( 76, 110 ] 4 1.667% 1.667% ( 110, 170 ] 19 7.917% 9.583% ## ( 170, 250 ] 14 5.833% 15.417% # ( 250, 380 ] 33 13.750% 29.167% ### ( 380, 580 ] 29 12.083% 41.250% ## ( 580, 870 ] 32 13.333% 54.583% ### ( 870, 1300 ] 21 8.750% 63.333% ## ( 1300, 1900 ] 14 5.833% 69.167% # ( 1900, 2900 ] 21 8.750% 77.917% ## ( 2900, 4400 ] 35 14.583% 92.500% ### ( 4400, 6600 ] 13 5.417% 97.917% # ( 6600, 9900 ] 5 2.083% 100.000% ** DB Stats ** Uptime(secs): 49.8 total, 15.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 177.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.652 H:M:S, 49.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 65.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.752 H:M:S, 78.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/15-12:53:09 ... thread 0: (1000000,10000000) ops and (290734.3,188565.2) ops/second in (3.439567,53.032046) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 3.56 GB 100.7 10.4 0.0 10.4 19.8 9.5 0.0 2.1 144.8 276.5 73.50 64.56 168 0.438 10M 19K 0.0 0.0 L1 7/7 741.96 MB 0.0 6.9 5.7 1.2 6.8 5.6 0.2 1.2 221.0 218.0 32.03 30.18 3 10.675 6465K 53K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.9 1.8 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 L3 20/0 957.99 MB 1.0 3.2 1.8 1.4 3.2 1.8 3.3 1.8 129.1 128.3 25.39 14.96 13 1.953 3319K 19K 0.0 0.0 L4 156/0 9.50 GB 1.0 4.9 3.8 1.1 4.9 3.8 1.1 1.3 123.1 122.5 40.85 23.58 40 1.021 5012K 21K 0.0 0.0 L5 1104/0 90.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/19 105.45 GB 0.0 25.8 11.5 14.2 35.1 20.8 14.4 3.7 152.3 207.4 173.21 134.67 226 0.766 25M 113K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.8 11.5 14.2 35.1 20.8 14.4 3.7 152.3 207.4 173.21 134.67 226 0.766 25M 113K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.8 11.5 14.2 25.6 11.4 0.0 0.0 186.4 185.3 141.50 109.83 89 1.590 25M 113K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 306.0 31.71 24.83 137 0.231 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.3 total, 53.0 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.08 GB write, 674.06 MB/s write, 25.76 GB read, 495.01 MB/s read, 173.2 seconds Interval compaction: 35.08 GB write, 677.27 MB/s write, 25.76 GB read, 497.36 MB/s read, 173.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 72, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 72, interval: 99 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4666414 Average: 2.7661 StdDev: 28.18 Min: 0 Median: 1.4945 Max: 11504 Percentiles: P50: 1.49 P75: 1.88 P99: 6.77 P99.9: 130.99 P99.99: 310.25 ------------------------------------------------------ [ 0, 1 ] 850674 18.230% 18.230% #### ( 1, 2 ] 2997962 64.246% 82.475% ############# ( 2, 3 ] 476426 10.210% 92.685% ## ( 3, 4 ] 169078 3.623% 96.308% # ( 4, 6 ] 118116 2.531% 98.839% # ( 6, 10 ] 38850 0.833% 99.672% ( 10, 15 ] 4238 0.091% 99.763% ( 15, 22 ] 587 0.013% 99.775% ( 22, 34 ] 51 0.001% 99.776% ( 34, 51 ] 29 0.001% 99.777% ( 51, 76 ] 83 0.002% 99.779% ( 76, 110 ] 4207 0.090% 99.869% ( 110, 170 ] 4140 0.089% 99.958% ( 170, 250 ] 1126 0.024% 99.982% ( 250, 380 ] 825 0.018% 100.000% ( 380, 580 ] 596 0.013% 100.012% ( 580, 870 ] 355 0.008% 100.020% ( 870, 1300 ] 177 0.004% 100.024% ( 1300, 1900 ] 89 0.002% 100.026% ( 1900, 2900 ] 96 0.002% 100.028% ( 2900, 4400 ] 74 0.002% 100.029% ( 4400, 6600 ] 16 0.000% 100.030% ( 6600, 9900 ] 9 0.000% 100.030% ( 9900, 14000 ] 2 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 1511907 Average: 6.3571 StdDev: 105.49 Min: 1 Median: 1.8172 Max: 15336 Percentiles: P50: 1.82 P75: 2.76 P99: 9.14 P99.9: 94.40 P99.99: 237.41 ------------------------------------------------------ [ 0, 1 ] 92066 6.089% 6.089% # ( 1, 2 ] 812430 53.735% 59.825% ########### ( 2, 3 ] 303684 20.086% 79.911% #### ( 3, 4 ] 134031 8.865% 88.776% ## ( 4, 6 ] 128340 8.489% 97.265% ## ( 6, 10 ] 33411 2.210% 99.475% ( 10, 15 ] 5175 0.342% 99.817% ( 15, 22 ] 659 0.044% 99.860% ( 22, 34 ] 47 0.003% 99.863% ( 34, 51 ] 23 0.002% 99.865% ( 51, 76 ] 95 0.006% 99.871% ( 76, 110 ] 802 0.053% 99.924% ( 110, 170 ] 692 0.046% 99.970% ( 170, 250 ] 357 0.024% 99.994% ( 250, 380 ] 433 0.029% 100.022% ( 380, 580 ] 590 0.039% 100.061% ( 580, 870 ] 598 0.040% 100.101% ( 870, 1300 ] 421 0.028% 100.129% ( 1300, 1900 ] 249 0.016% 100.145% ( 1900, 2900 ] 339 0.022% 100.168% ( 2900, 4400 ] 455 0.030% 100.198% ( 4400, 6600 ] 136 0.009% 100.207% ( 6600, 9900 ] 41 0.003% 100.209% ( 9900, 14000 ] 6 0.000% 100.210% ( 14000, 22000 ] 3 0.000% 100.210% ** Level 2 read latency histogram (micros): Count: 88191 Average: 2.1032 StdDev: 8.93 Min: 0 Median: 1.3646 Max: 1452 Percentiles: P50: 1.36 P75: 1.78 P99: 5.64 P99.9: 26.85 P99.99: 389.04 ------------------------------------------------------ [ 0, 1 ] 24697 28.004% 28.004% ###### ( 1, 2 ] 53207 60.332% 88.336% ############ ( 2, 3 ] 5846 6.629% 94.964% # ( 3, 4 ] 2368 2.685% 97.649% # ( 4, 6 ] 1453 1.648% 99.297% ( 6, 10 ] 448 0.508% 99.805% ( 10, 15 ] 64 0.073% 99.878% ( 15, 22 ] 19 0.022% 99.899% ( 22, 34 ] 2 0.002% 99.901% ( 34, 51 ] 30 0.034% 99.935% ( 51, 76 ] 16 0.018% 99.954% ( 76, 110 ] 7 0.008% 99.961% ( 110, 170 ] 7 0.008% 99.969% ( 170, 250 ] 9 0.010% 99.980% ( 250, 380 ] 9 0.010% 99.990% ( 380, 580 ] 4 0.005% 99.994% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 655026 Average: 8.8438 StdDev: 126.94 Min: 0 Median: 1.9556 Max: 19524 Percentiles: P50: 1.96 P75: 2.97 P99: 9.46 P99.9: 595.27 P99.99: 852.75 ------------------------------------------------------ [ 0, 1 ] 14039 2.143% 2.143% ( 1, 2 ] 328022 50.078% 52.221% ########## ( 2, 3 ] 153425 23.423% 75.644% ##### ( 3, 4 ] 74386 11.356% 87.000% ## ( 4, 6 ] 68348 10.434% 97.434% ## ( 6, 10 ] 11850 1.809% 99.243% ( 10, 15 ] 2172 0.332% 99.575% ( 15, 22 ] 258 0.039% 99.614% ( 22, 34 ] 30 0.005% 99.619% ( 34, 51 ] 11 0.002% 99.621% ( 51, 76 ] 10 0.002% 99.622% ( 76, 110 ] 93 0.014% 99.636% ( 110, 170 ] 235 0.036% 99.672% ( 170, 250 ] 331 0.051% 99.723% ( 250, 380 ] 470 0.072% 99.795% ( 380, 580 ] 656 0.100% 99.895% ( 580, 870 ] 664 0.101% 99.996% ( 870, 1300 ] 484 0.074% 100.070% ( 1300, 1900 ] 267 0.041% 100.111% ( 1900, 2900 ] 206 0.031% 100.142% ( 2900, 4400 ] 241 0.037% 100.179% ( 4400, 6600 ] 61 0.009% 100.188% ( 6600, 9900 ] 23 0.004% 100.192% ( 9900, 14000 ] 6 0.001% 100.193% ( 14000, 22000 ] 3 0.000% 100.193% ** Level 4 read latency histogram (micros): Count: 198052 Average: 17.7485 StdDev: 202.25 Min: 0 Median: 1.9764 Max: 19610 Percentiles: P50: 1.98 P75: 2.99 P99: 256.52 P99.9: 2871.93 P99.99: 4137.11 ------------------------------------------------------ [ 0, 1 ] 2955 1.492% 1.492% ( 1, 2 ] 98395 49.681% 51.173% ########## ( 2, 3 ] 47569 24.018% 75.192% ##### ( 3, 4 ] 21615 10.914% 86.106% ## ( 4, 6 ] 19412 9.801% 95.907% ## ( 6, 10 ] 4901 2.475% 98.382% ( 10, 15 ] 801 0.404% 98.786% ( 15, 22 ] 100 0.050% 98.837% ( 22, 34 ] 26 0.013% 98.850% ( 34, 51 ] 9 0.005% 98.854% ( 51, 76 ] 10 0.005% 98.859% ( 76, 110 ] 54 0.027% 98.887% ( 110, 170 ] 77 0.039% 98.926% ( 170, 250 ] 138 0.070% 98.995% ( 250, 380 ] 189 0.095% 99.091% ( 380, 580 ] 368 0.186% 99.276% ( 580, 870 ] 461 0.233% 99.509% ( 870, 1300 ] 388 0.196% 99.705% ( 1300, 1900 ] 211 0.107% 99.812% ( 1900, 2900 ] 180 0.091% 99.903% ( 2900, 4400 ] 210 0.106% 100.009% ( 4400, 6600 ] 47 0.024% 100.032% ( 6600, 9900 ] 15 0.008% 100.040% ( 14000, 22000 ] 3 0.002% 100.041% ** Level 5 read latency histogram (micros): Count: 300 Average: 1527.1233 StdDev: 1684.84 Min: 91 Median: 752.4324 Max: 9232 Percentiles: P50: 752.43 P75: 2400.00 P99: 7920.00 P99.9: 9232.00 P99.99: 9232.00 ------------------------------------------------------ ( 76, 110 ] 6 2.000% 2.000% ( 110, 170 ] 24 8.000% 10.000% ## ( 170, 250 ] 18 6.000% 16.000% # ( 250, 380 ] 41 13.667% 29.667% ### ( 380, 580 ] 39 13.000% 42.667% ### ( 580, 870 ] 37 12.333% 55.000% ## ( 870, 1300 ] 26 8.667% 63.667% ## ( 1300, 1900 ] 21 7.000% 70.667% # ( 1900, 2900 ] 26 8.667% 79.333% ## ( 2900, 4400 ] 43 14.333% 93.667% ### ( 4400, 6600 ] 14 4.667% 98.333% # ( 6600, 9900 ] 5 1.667% 100.000% ** DB Stats ** Uptime(secs): 53.3 total, 3.4 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 184.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.312 H:M:S, 47.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.660 H:M:S, 19.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-12:53:13 ... thread 0: (1000000,11000000) ops and (306513.4,195400.8) ops/second in (3.262500,56.294546) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 4.54 GB 195.1 11.2 0.0 11.2 21.6 10.4 0.0 2.1 144.2 278.6 79.50 70.20 184 0.432 11M 19K 0.0 0.0 L1 7/7 741.96 MB 0.0 6.9 5.7 1.2 6.8 5.6 0.2 1.2 221.0 218.0 32.03 30.18 3 10.675 6465K 53K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.9 1.8 241.7 241.6 1.44 1.39 2 0.722 354K 160 0.0 0.0 L3 20/0 957.99 MB 1.0 3.2 1.8 1.4 3.2 1.8 3.3 1.8 129.1 128.3 25.39 14.96 13 1.953 3319K 19K 0.0 0.0 L4 156/0 9.50 GB 1.0 4.9 3.8 1.1 4.9 3.8 1.1 1.3 123.1 122.5 40.85 23.58 40 1.021 5012K 21K 0.0 0.0 L5 1104/0 90.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/19 106.44 GB 0.0 26.6 11.5 15.0 36.9 21.8 14.4 3.5 151.8 210.6 179.20 140.30 242 0.741 26M 114K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.6 11.5 15.0 36.9 21.8 14.4 3.5 151.8 210.6 179.20 140.30 242 0.741 26M 114K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.6 11.5 15.0 26.4 11.4 0.0 0.0 188.1 186.9 144.61 112.89 92 1.572 26M 114K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 309.6 34.60 27.42 150 0.231 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.5 total, 56.3 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.86 GB write, 667.47 MB/s write, 26.56 GB read, 480.93 MB/s read, 179.2 seconds Interval compaction: 36.86 GB write, 670.45 MB/s write, 26.56 GB read, 483.08 MB/s read, 179.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 75, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 75, interval: 102 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5006319 Average: 2.7342 StdDev: 27.35 Min: 0 Median: 1.4971 Max: 11504 Percentiles: P50: 1.50 P75: 1.88 P99: 6.64 P99.9: 125.36 P99.99: 288.89 ------------------------------------------------------ [ 0, 1 ] 899263 17.963% 17.963% #### ( 1, 2 ] 3226674 64.452% 82.415% ############# ( 2, 3 ] 516671 10.320% 92.735% ## ( 3, 4 ] 181402 3.623% 96.358% # ( 4, 6 ] 125665 2.510% 98.869% # ( 6, 10 ] 41106 0.821% 99.690% ( 10, 15 ] 4445 0.089% 99.778% ( 15, 22 ] 607 0.012% 99.791% ( 22, 34 ] 53 0.001% 99.792% ( 34, 51 ] 30 0.001% 99.792% ( 51, 76 ] 85 0.002% 99.794% ( 76, 110 ] 4243 0.085% 99.879% ( 110, 170 ] 4178 0.083% 99.962% ( 170, 250 ] 1144 0.023% 99.985% ( 250, 380 ] 847 0.017% 100.002% ( 380, 580 ] 611 0.012% 100.014% ( 580, 870 ] 363 0.007% 100.021% ( 870, 1300 ] 183 0.004% 100.025% ( 1300, 1900 ] 90 0.002% 100.027% ( 1900, 2900 ] 97 0.002% 100.029% ( 2900, 4400 ] 75 0.001% 100.030% ( 4400, 6600 ] 16 0.000% 100.031% ( 6600, 9900 ] 9 0.000% 100.031% ( 9900, 14000 ] 2 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 1586651 Average: 6.1893 StdDev: 103.01 Min: 1 Median: 1.8028 Max: 15336 Percentiles: P50: 1.80 P75: 2.72 P99: 9.12 P99.9: 98.80 P99.99: 244.63 ------------------------------------------------------ [ 0, 1 ] 99956 6.300% 6.300% # ( 1, 2 ] 863678 54.434% 60.734% ########### ( 2, 3 ] 313701 19.771% 80.505% #### ( 3, 4 ] 136594 8.609% 89.114% ## ( 4, 6 ] 129890 8.186% 97.300% ## ( 6, 10 ] 34599 2.181% 99.481% ( 10, 15 ] 5252 0.331% 99.812% ( 15, 22 ] 663 0.042% 99.854% ( 22, 34 ] 47 0.003% 99.857% ( 34, 51 ] 23 0.001% 99.858% ( 51, 76 ] 96 0.006% 99.864% ( 76, 110 ] 843 0.053% 99.917% ( 110, 170 ] 794 0.050% 99.968% ( 170, 250 ] 382 0.024% 99.992% ( 250, 380 ] 448 0.028% 100.020% ( 380, 580 ] 607 0.038% 100.058% ( 580, 870 ] 604 0.038% 100.096% ( 870, 1300 ] 421 0.027% 100.123% ( 1300, 1900 ] 249 0.016% 100.138% ( 1900, 2900 ] 339 0.021% 100.160% ( 2900, 4400 ] 455 0.029% 100.188% ( 4400, 6600 ] 136 0.009% 100.197% ( 6600, 9900 ] 41 0.003% 100.200% ( 9900, 14000 ] 6 0.000% 100.200% ( 14000, 22000 ] 3 0.000% 100.200% ** Level 2 read latency histogram (micros): Count: 88191 Average: 2.1032 StdDev: 8.93 Min: 0 Median: 1.3646 Max: 1452 Percentiles: P50: 1.36 P75: 1.78 P99: 5.64 P99.9: 26.85 P99.99: 389.04 ------------------------------------------------------ [ 0, 1 ] 24697 28.004% 28.004% ###### ( 1, 2 ] 53207 60.332% 88.336% ############ ( 2, 3 ] 5846 6.629% 94.964% # ( 3, 4 ] 2368 2.685% 97.649% # ( 4, 6 ] 1453 1.648% 99.297% ( 6, 10 ] 448 0.508% 99.805% ( 10, 15 ] 64 0.073% 99.878% ( 15, 22 ] 19 0.022% 99.899% ( 22, 34 ] 2 0.002% 99.901% ( 34, 51 ] 30 0.034% 99.935% ( 51, 76 ] 16 0.018% 99.954% ( 76, 110 ] 7 0.008% 99.961% ( 110, 170 ] 7 0.008% 99.969% ( 170, 250 ] 9 0.010% 99.980% ( 250, 380 ] 9 0.010% 99.990% ( 380, 580 ] 4 0.005% 99.994% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 655026 Average: 8.8438 StdDev: 126.94 Min: 0 Median: 1.9556 Max: 19524 Percentiles: P50: 1.96 P75: 2.97 P99: 9.46 P99.9: 595.27 P99.99: 852.75 ------------------------------------------------------ [ 0, 1 ] 14039 2.143% 2.143% ( 1, 2 ] 328022 50.078% 52.221% ########## ( 2, 3 ] 153425 23.423% 75.644% ##### ( 3, 4 ] 74386 11.356% 87.000% ## ( 4, 6 ] 68348 10.434% 97.434% ## ( 6, 10 ] 11850 1.809% 99.243% ( 10, 15 ] 2172 0.332% 99.575% ( 15, 22 ] 258 0.039% 99.614% ( 22, 34 ] 30 0.005% 99.619% ( 34, 51 ] 11 0.002% 99.621% ( 51, 76 ] 10 0.002% 99.622% ( 76, 110 ] 93 0.014% 99.636% ( 110, 170 ] 235 0.036% 99.672% ( 170, 250 ] 331 0.051% 99.723% ( 250, 380 ] 470 0.072% 99.795% ( 380, 580 ] 656 0.100% 99.895% ( 580, 870 ] 664 0.101% 99.996% ( 870, 1300 ] 484 0.074% 100.070% ( 1300, 1900 ] 267 0.041% 100.111% ( 1900, 2900 ] 206 0.031% 100.142% ( 2900, 4400 ] 241 0.037% 100.179% ( 4400, 6600 ] 61 0.009% 100.188% ( 6600, 9900 ] 23 0.004% 100.192% ( 9900, 14000 ] 6 0.001% 100.193% ( 14000, 22000 ] 3 0.000% 100.193% ** Level 4 read latency histogram (micros): Count: 198052 Average: 17.7485 StdDev: 202.25 Min: 0 Median: 1.9764 Max: 19610 Percentiles: P50: 1.98 P75: 2.99 P99: 256.52 P99.9: 2871.93 P99.99: 4137.11 ------------------------------------------------------ [ 0, 1 ] 2955 1.492% 1.492% ( 1, 2 ] 98395 49.681% 51.173% ########## ( 2, 3 ] 47569 24.018% 75.192% ##### ( 3, 4 ] 21615 10.914% 86.106% ## ( 4, 6 ] 19412 9.801% 95.907% ## ( 6, 10 ] 4901 2.475% 98.382% ( 10, 15 ] 801 0.404% 98.786% ( 15, 22 ] 100 0.050% 98.837% ( 22, 34 ] 26 0.013% 98.850% ( 34, 51 ] 9 0.005% 98.854% ( 51, 76 ] 10 0.005% 98.859% ( 76, 110 ] 54 0.027% 98.887% ( 110, 170 ] 77 0.039% 98.926% ( 170, 250 ] 138 0.070% 98.995% ( 250, 380 ] 189 0.095% 99.091% ( 380, 580 ] 368 0.186% 99.276% ( 580, 870 ] 461 0.233% 99.509% ( 870, 1300 ] 388 0.196% 99.705% ( 1300, 1900 ] 211 0.107% 99.812% ( 1900, 2900 ] 180 0.091% 99.903% ( 2900, 4400 ] 210 0.106% 100.009% ( 4400, 6600 ] 47 0.024% 100.032% ( 6600, 9900 ] 15 0.008% 100.040% ( 14000, 22000 ] 3 0.002% 100.041% ** Level 5 read latency histogram (micros): Count: 300 Average: 1527.1233 StdDev: 1684.84 Min: 91 Median: 752.4324 Max: 9232 Percentiles: P50: 752.43 P75: 2400.00 P99: 7920.00 P99.9: 9232.00 P99.99: 9232.00 ------------------------------------------------------ ( 76, 110 ] 6 2.000% 2.000% ( 110, 170 ] 24 8.000% 10.000% ## ( 170, 250 ] 18 6.000% 16.000% # ( 250, 380 ] 41 13.667% 29.667% ### ( 380, 580 ] 39 13.000% 42.667% ### ( 580, 870 ] 37 12.333% 55.000% ## ( 870, 1300 ] 26 8.667% 63.667% ## ( 1300, 1900 ] 21 7.000% 70.667% # ( 1900, 2900 ] 26 8.667% 79.333% ## ( 2900, 4400 ] 43 14.333% 93.667% ### ( 4400, 6600 ] 14 4.667% 98.333% # ( 6600, 9900 ] 5 1.667% 100.000% ** DB Stats ** Uptime(secs): 56.5 total, 3.3 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 191.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.915 H:M:S, 45.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 301.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.603 H:M:S, 18.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.170 micros/op 193410 ops/sec 60.074 seconds 11618999 operations; 187.4 MB/s Microseconds per write: Count: 11618999 Average: 5.1704 StdDev: 559.11 Min: 0 Median: 1.7422 Max: 1028732 Percentiles: P50: 1.74 P75: 2.75 P99: 9.18 P99.9: 1021.76 P99.99: 2575.13 ------------------------------------------------------ [ 0, 1 ] 1526689 13.140% 13.140% ### ( 1, 2 ] 5770561 49.665% 62.804% ########## ( 2, 3 ] 1876940 16.154% 78.959% ### ( 3, 4 ] 1593774 13.717% 92.675% ### ( 4, 6 ] 624724 5.377% 98.052% # ( 6, 10 ] 138572 1.193% 99.245% ( 10, 15 ] 46303 0.399% 99.643% ( 15, 22 ] 10856 0.093% 99.737% ( 22, 34 ] 2335 0.020% 99.757% ( 34, 51 ] 291 0.003% 99.759% ( 51, 76 ] 36 0.000% 99.760% ( 76, 110 ] 7773 0.067% 99.827% ( 110, 170 ] 3430 0.030% 99.856% ( 170, 250 ] 344 0.003% 99.859% ( 250, 380 ] 235 0.002% 99.861% ( 380, 580 ] 40 0.000% 99.861% ( 580, 870 ] 24 0.000% 99.862% ( 870, 1300 ] 12617 0.109% 99.970% ( 1300, 1900 ] 26 0.000% 99.970% ( 1900, 2900 ] 3358 0.029% 99.999% ( 2900, 4400 ] 33 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 195936 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11618999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11990806968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 590 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 27935516 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32857132770 rocksdb.compact.write.bytes COUNT : 32650509947 rocksdb.flush.write.bytes COUNT : 11956341259 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 70 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 361 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11860020224 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4689920 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32967605282 rocksdb.non.last.level.read.count COUNT : 7958494 rocksdb.block.checksum.compute.count COUNT : 7957384 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.374853 P95 : 3.912039 P99 : 7.575741 P100 : 1028730.000000 COUNT : 11618999 SUM : 54495361 rocksdb.compaction.times.micros P50 : 1107714.285714 P95 : 3705000.000000 P99 : 15246465.000000 P100 : 15246465.000000 COUNT : 97 SUM : 163615870 rocksdb.compaction.times.cpu_micros P50 : 931777.777778 P95 : 3705000.000000 P99 : 14378376.000000 P100 : 14378376.000000 COUNT : 97 SUM : 129409130 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 693.415842 P95 : 9735.000000 P99 : 185600.000000 P100 : 241030.000000 COUNT : 161 SUM : 899767 rocksdb.compaction.outfile.sync.micros P50 : 1201.714286 P95 : 206800.000000 P99 : 374150.000000 P100 : 474805.000000 COUNT : 354 SUM : 12526401 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 102.876190 P95 : 1652.500000 P99 : 3470.000000 P100 : 8123.000000 COUNT : 286 SUM : 101850 rocksdb.table.open.io.micros P50 : 1686.206897 P95 : 8738.888889 P99 : 14160.000000 P100 : 23278.000000 COUNT : 590 SUM : 1472341 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.679923 P95 : 7.762834 P99 : 10.825946 P100 : 19616.000000 COUNT : 7955769 SUM : 51308271 rocksdb.read.block.get.micros P50 : 550.588235 P95 : 3900.000000 P99 : 6132.500000 P100 : 9382.000000 COUNT : 1180 SUM : 1184201 rocksdb.write.raw.block.micros P50 : 0.513833 P95 : 0.976283 P99 : 2.938429 P100 : 43200.000000 COUNT : 10803290 SUM : 23243545 rocksdb.numfiles.in.singlecompaction P50 : 3.280220 P95 : 4.775000 P99 : 18.570000 P100 : 43.000000 COUNT : 149 SUM : 583 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561875 P95 : 1166.101784 P99 : 2471.862069 P100 : 1028537.000000 COUNT : 146084 SUM : 27951939 rocksdb.sst.read.micros P50 : 1.593143 P95 : 4.535970 P99 : 8.348796 P100 : 19610.000000 COUNT : 7958830 SUM : 34743606 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11618999 SUM : 11990806968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211090.909091 P95 : 440166.666667 P99 : 1017533.333333 P100 : 1161263.000000 COUNT : 161 SUM : 36618148 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 361 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0