[2024-12-13 23:52:23.696622] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 24.03.0 initialization... [2024-12-13 23:52:23.696720] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1706476 ] Set seed to 1734130343694195 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-13 23:52:23.811951] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-13 23:52:23.920205] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-13 23:52:23.920252] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1706476' to capture a snapshot of events at runtime. [2024-12-13 23:52:23.920263] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-13 23:52:23.920273] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-13 23:52:23.920281] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1706476 for offline analysis/debug. [2024-12-13 23:52:23.921692] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 13 23:52:32 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/13-23:52:34 ... thread 0: (1000000,1000000) ops and (361006.4,361006.4) ops/second in (2.770034,2.770034) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.04 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 356.0 2.30 2.07 12 0.192 0 0 0.0 0.0 L2 3/2 251.79 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 250.8 250.7 1.51 1.46 2 0.753 383K 196 0.0 0.0 L3 12/0 993.29 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 99.3 314.3 3.81 3.53 14 0.272 383K 196 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 99.3 314.3 3.81 3.53 14 0.272 383K 196 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 250.8 250.7 1.51 1.46 2 0.753 383K 196 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 356.0 2.30 2.07 12 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.9 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 405.89 MB/s write, 0.37 GB read, 128.19 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 431.85 MB/s write, 0.37 GB read, 136.39 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 98985 Average: 1.9793 StdDev: 14.84 Min: 1 Median: 1.3180 Max: 2859 Percentiles: P50: 1.32 P75: 1.72 P99: 4.17 P99.9: 10.79 P99.99: 490.14 ------------------------------------------------------ [ 0, 1 ] 29751 30.056% 30.056% ###### ( 1, 2 ] 62086 62.723% 92.779% ############# ( 2, 3 ] 4657 4.705% 97.483% # ( 3, 4 ] 1443 1.458% 98.941% ( 4, 6 ] 714 0.721% 99.663% ( 6, 10 ] 227 0.229% 99.892% ( 10, 15 ] 70 0.071% 99.963% ( 15, 22 ] 12 0.012% 99.975% ( 22, 34 ] 1 0.001% 99.976% ( 34, 51 ] 2 0.002% 99.978% ( 51, 76 ] 1 0.001% 99.979% ( 110, 170 ] 4 0.004% 99.983% ( 170, 250 ] 7 0.007% 99.990% ( 250, 380 ] 2 0.002% 99.992% ( 380, 580 ] 2 0.002% 99.994% ( 580, 870 ] 4 0.004% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 2 0.002% 100.001% ( 1900, 2900 ] 2 0.002% 100.003% ** Level 1 read latency histogram (micros): Count: 5 Average: 2011.0000 StdDev: 1749.56 Min: 427 Median: 1085.0000 Max: 4702 Percentiles: P50: 1085.00 P75: 4025.00 P99: 4702.00 P99.9: 4702.00 P99.99: 4702.00 ------------------------------------------------------ ( 380, 580 ] 2 40.000% 40.000% ######## ( 870, 1300 ] 1 20.000% 60.000% #### ( 2900, 4400 ] 1 20.000% 80.000% #### ( 4400, 6600 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 49043 Average: 1.9888 StdDev: 14.62 Min: 1 Median: 1.3389 Max: 2944 Percentiles: P50: 1.34 P75: 1.73 P99: 5.25 P99.9: 10.77 P99.99: 297.48 ------------------------------------------------------ [ 0, 1 ] 13964 28.473% 28.473% ###### ( 1, 2 ] 31150 63.516% 91.989% ############# ( 2, 3 ] 2247 4.582% 96.570% # ( 3, 4 ] 814 1.660% 98.230% ( 4, 6 ] 607 1.238% 99.468% ( 6, 10 ] 208 0.424% 99.892% ( 10, 15 ] 32 0.065% 99.957% ( 15, 22 ] 13 0.027% 99.984% ( 34, 51 ] 2 0.004% 99.988% ( 51, 76 ] 1 0.002% 99.990% ( 250, 380 ] 3 0.006% 99.996% ( 580, 870 ] 1 0.002% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ( 2900, 4400 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 55 Average: 3271.4182 StdDev: 2046.17 Min: 147 Median: 3358.3333 Max: 9822 Percentiles: P50: 3358.33 P75: 4629.17 P99: 9295.00 P99.9: 9822.00 P99.99: 9822.00 ------------------------------------------------------ ( 110, 170 ] 1 1.818% 1.818% ( 170, 250 ] 1 1.818% 3.636% ( 380, 580 ] 6 10.909% 14.545% ## ( 580, 870 ] 2 3.636% 18.182% # ( 870, 1300 ] 4 7.273% 25.455% # ( 1300, 1900 ] 1 1.818% 27.273% ( 1900, 2900 ] 7 12.727% 40.000% ### ( 2900, 4400 ] 18 32.727% 72.727% ####### ( 4400, 6600 ] 12 21.818% 94.545% #### ( 6600, 9900 ] 3 5.455% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 3803.8500 StdDev: 1762.54 Min: 466 Median: 3650.0000 Max: 7055 Percentiles: P50: 3650.00 P75: 4950.00 P99: 7055.00 P99.9: 7055.00 P99.99: 7055.00 ------------------------------------------------------ ( 380, 580 ] 1 5.000% 5.000% # ( 580, 870 ] 1 5.000% 10.000% # ( 1900, 2900 ] 4 20.000% 30.000% #### ( 2900, 4400 ] 8 40.000% 70.000% ######## ( 4400, 6600 ] 4 20.000% 90.000% #### ( 6600, 9900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 2.9 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 333.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.220 H:M:S, 7.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 355.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.220 H:M:S, 7.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-23:52:37 ... thread 0: (1000000,2000000) ops and (331625.2,345692.7) ops/second in (3.015452,5.785486) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 1.17 GB 18.9 0.2 0.0 0.2 2.0 1.8 0.0 1.1 41.4 341.6 6.09 5.52 27 0.225 255K 242 0.0 0.0 L1 5/5 377.37 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 232.2 231.8 1.63 1.58 1 1.628 383K 619 0.0 0.0 L2 1/0 2.58 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 250.8 250.7 1.51 1.46 2 0.753 383K 196 0.0 0.0 L3 15/0 703.72 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.1 1.0 224.7 224.7 1.11 1.04 1 1.109 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 157.3 157.3 1.42 1.07 1 1.423 227K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/16 97.92 GB 0.0 1.4 1.0 0.4 3.2 2.8 1.2 1.8 126.0 281.4 11.75 10.67 32 0.367 1503K 1057 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 1.0 0.4 3.2 2.8 1.1 1.8 126.0 281.4 11.75 10.67 32 0.367 1503K 1057 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 1.0 0.4 1.4 1.0 0.0 0.0 223.3 223.2 6.63 6.09 6 1.105 1503K 1057 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.7 5.12 4.58 26 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.23 GB write, 554.48 MB/s write, 1.45 GB read, 248.33 MB/s read, 11.8 seconds Interval compaction: 3.23 GB write, 571.47 MB/s write, 1.45 GB read, 255.93 MB/s read, 11.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 318548 Average: 2.2557 StdDev: 11.97 Min: 1 Median: 1.5255 Max: 2859 Percentiles: P50: 1.53 P75: 1.91 P99: 5.62 P99.9: 10.34 P99.99: 18.23 ------------------------------------------------------ [ 0, 1 ] 50445 15.836% 15.836% ### ( 1, 2 ] 207108 65.016% 80.852% ############# ( 2, 3 ] 41632 13.069% 93.921% ### ( 3, 4 ] 10024 3.147% 97.068% # ( 4, 6 ] 7581 2.380% 99.448% ( 6, 10 ] 1421 0.446% 99.894% ( 10, 15 ] 290 0.091% 99.985% ( 15, 22 ] 35 0.011% 99.996% ( 22, 34 ] 2 0.001% 99.997% ( 34, 51 ] 3 0.001% 99.998% ( 51, 76 ] 2 0.001% 99.998% ( 110, 170 ] 9 0.003% 100.001% ( 170, 250 ] 13 0.004% 100.005% ( 250, 380 ] 7 0.002% 100.008% ( 380, 580 ] 5 0.002% 100.009% ( 580, 870 ] 9 0.003% 100.012% ( 870, 1300 ] 3 0.001% 100.013% ( 1300, 1900 ] 4 0.001% 100.014% ( 1900, 2900 ] 4 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 29379 Average: 2.5942 StdDev: 36.62 Min: 0 Median: 1.5126 Max: 4702 Percentiles: P50: 1.51 P75: 1.88 P99: 5.60 P99.9: 9.92 P99.99: 1337.26 ------------------------------------------------------ [ 0, 1 ] 4456 15.167% 15.167% ### ( 1, 2 ] 19965 67.957% 83.124% ############## ( 2, 3 ] 3551 12.087% 95.211% ## ( 3, 4 ] 703 2.393% 97.604% ( 4, 6 ] 512 1.743% 99.346% ( 6, 10 ] 166 0.565% 99.912% ( 10, 15 ] 9 0.031% 99.942% ( 15, 22 ] 3 0.010% 99.952% ( 22, 34 ] 1 0.003% 99.956% ( 110, 170 ] 2 0.007% 99.963% ( 170, 250 ] 1 0.003% 99.966% ( 250, 380 ] 2 0.007% 99.973% ( 380, 580 ] 3 0.010% 99.983% ( 870, 1300 ] 2 0.007% 99.990% ( 1300, 1900 ] 1 0.003% 99.993% ( 2900, 4400 ] 1 0.003% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 10.51 Min: 1 Median: 1.5017 Max: 2944 Percentiles: P50: 1.50 P75: 1.89 P99: 5.73 P99.9: 10.72 P99.99: 21.78 ------------------------------------------------------ [ 0, 1 ] 16759 17.591% 17.591% #### ( 1, 2 ] 61535 64.591% 82.183% ############# ( 2, 3 ] 10737 11.270% 93.453% ## ( 3, 4 ] 3061 3.213% 96.666% # ( 4, 6 ] 2568 2.696% 99.362% # ( 6, 10 ] 501 0.526% 99.888% ( 10, 15 ] 81 0.085% 99.973% ( 15, 22 ] 17 0.018% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 56916 Average: 5.3836 StdDev: 119.99 Min: 1 Median: 1.5517 Max: 9822 Percentiles: P50: 1.55 P75: 1.94 P99: 5.80 P99.9: 260.92 P99.99: 6106.54 ------------------------------------------------------ [ 0, 1 ] 8005 14.065% 14.065% ### ( 1, 2 ] 37071 65.133% 79.197% ############# ( 2, 3 ] 8667 15.228% 94.425% ### ( 3, 4 ] 1445 2.539% 96.964% # ( 4, 6 ] 1290 2.266% 99.230% ( 6, 10 ] 314 0.552% 99.782% ( 10, 15 ] 58 0.102% 99.884% ( 15, 22 ] 5 0.009% 99.893% ( 22, 34 ] 1 0.002% 99.895% ( 51, 76 ] 1 0.002% 99.896% ( 110, 170 ] 1 0.002% 99.898% ( 170, 250 ] 1 0.002% 99.900% ( 250, 380 ] 1 0.002% 99.902% ( 380, 580 ] 7 0.012% 99.914% ( 580, 870 ] 3 0.005% 99.919% ( 870, 1300 ] 5 0.009% 99.928% ( 1300, 1900 ] 1 0.002% 99.930% ( 1900, 2900 ] 7 0.012% 99.942% ( 2900, 4400 ] 18 0.032% 99.974% ( 4400, 6600 ] 12 0.021% 99.995% ( 6600, 9900 ] 3 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 250.8710 StdDev: 1035.11 Min: 0 Median: 1.5846 Max: 7055 Percentiles: P50: 1.58 P75: 5.12 P99: 5995.00 P99.9: 7055.00 P99.99: 7055.00 ------------------------------------------------------ [ 0, 1 ] 79 25.484% 25.484% ##### ( 1, 2 ] 130 41.935% 67.419% ######## ( 2, 3 ] 18 5.806% 73.226% # ( 3, 4 ] 1 0.323% 73.548% ( 4, 6 ] 8 2.581% 76.129% # ( 6, 10 ] 9 2.903% 79.032% # ( 10, 15 ] 38 12.258% 91.290% ## ( 15, 22 ] 3 0.968% 92.258% ( 22, 34 ] 1 0.323% 92.581% ( 110, 170 ] 1 0.323% 92.903% ( 170, 250 ] 1 0.323% 93.226% ( 250, 380 ] 1 0.323% 93.548% ( 380, 580 ] 1 0.323% 93.871% ( 580, 870 ] 1 0.323% 94.194% ( 1900, 2900 ] 4 1.290% 95.484% ( 2900, 4400 ] 8 2.581% 98.065% # ( 4400, 6600 ] 4 1.290% 99.355% ( 6600, 9900 ] 2 0.645% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1023.8000 StdDev: 1270.91 Min: 96 Median: 170.0000 Max: 3456 Percentiles: P50: 170.00 P75: 1900.00 P99: 3456.00 P99.9: 3456.00 P99.99: 3456.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 7 35.000% 50.000% ####### ( 170, 250 ] 1 5.000% 55.000% # ( 250, 380 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 1 5.000% 75.000% # ( 1900, 2900 ] 1 5.000% 80.000% # ( 2900, 4400 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 330.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.614 H:M:S, 10.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.394 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-23:52:41 ... thread 0: (1000000,3000000) ops and (329803.0,340228.7) ops/second in (3.032113,8.817599) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 2.15 GB 94.4 1.1 0.0 1.1 3.9 2.8 0.0 1.4 92.0 321.8 12.33 11.39 44 0.280 1151K 1276 0.0 0.0 L1 5/5 377.37 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 232.2 231.8 1.63 1.58 1 1.628 383K 619 0.0 0.0 L2 1/0 2.58 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 250.8 250.7 1.51 1.46 2 0.753 383K 196 0.0 0.0 L3 15/0 703.72 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.1 1.0 224.7 224.7 1.11 1.04 1 1.109 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 157.3 157.3 1.42 1.07 1 1.423 227K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/20 98.90 GB 0.0 2.3 1.0 1.3 5.1 3.8 1.2 1.8 131.3 288.7 18.00 16.54 49 0.367 2399K 2091 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 1.0 1.3 5.1 3.8 1.1 1.8 131.3 288.7 18.00 16.54 49 0.367 2399K 2091 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 1.0 1.3 2.3 1.0 0.0 0.0 235.3 235.1 10.04 9.43 9 1.116 2399K 2091 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 356.3 7.96 7.10 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.07 GB write, 577.55 MB/s write, 2.31 GB read, 262.66 MB/s read, 18.0 seconds Interval compaction: 5.07 GB write, 589.15 MB/s write, 2.31 GB read, 267.94 MB/s read, 18.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 690720 Average: 2.3083 StdDev: 9.73 Min: 1 Median: 1.5762 Max: 2859 Percentiles: P50: 1.58 P75: 1.96 P99: 5.71 P99.9: 10.35 P99.99: 14.37 ------------------------------------------------------ [ 0, 1 ] 83749 12.125% 12.125% ## ( 1, 2 ] 454053 65.736% 77.861% ############# ( 2, 3 ] 106270 15.385% 93.246% ### ( 3, 4 ] 24340 3.524% 96.770% # ( 4, 6 ] 17998 2.606% 99.376% # ( 6, 10 ] 3566 0.516% 99.892% ( 10, 15 ] 774 0.112% 100.004% ( 15, 22 ] 69 0.010% 100.014% ( 22, 34 ] 6 0.001% 100.015% ( 34, 51 ] 9 0.001% 100.017% ( 51, 76 ] 6 0.001% 100.017% ( 110, 170 ] 11 0.002% 100.019% ( 170, 250 ] 22 0.003% 100.022% ( 250, 380 ] 11 0.002% 100.024% ( 380, 580 ] 10 0.001% 100.025% ( 580, 870 ] 15 0.002% 100.027% ( 870, 1300 ] 9 0.001% 100.029% ( 1300, 1900 ] 5 0.001% 100.029% ( 1900, 2900 ] 5 0.001% 100.030% ** Level 1 read latency histogram (micros): Count: 91439 Average: 2.3994 StdDev: 20.77 Min: 0 Median: 1.5976 Max: 4702 Percentiles: P50: 1.60 P75: 1.97 P99: 5.62 P99.9: 9.66 P99.99: 305.65 ------------------------------------------------------ [ 0, 1 ] 8786 9.609% 9.609% ## ( 1, 2 ] 61807 67.594% 77.202% ############## ( 2, 3 ] 15244 16.671% 93.874% ### ( 3, 4 ] 2897 3.168% 97.042% # ( 4, 6 ] 2216 2.423% 99.465% ( 6, 10 ] 436 0.477% 99.942% ( 10, 15 ] 35 0.038% 99.980% ( 15, 22 ] 3 0.003% 99.984% ( 22, 34 ] 2 0.002% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.002% 99.989% ( 170, 250 ] 1 0.001% 99.990% ( 250, 380 ] 2 0.002% 99.992% ( 380, 580 ] 3 0.003% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ( 4400, 6600 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 10.51 Min: 1 Median: 1.5017 Max: 2944 Percentiles: P50: 1.50 P75: 1.89 P99: 5.73 P99.9: 10.72 P99.99: 21.78 ------------------------------------------------------ [ 0, 1 ] 16759 17.591% 17.591% #### ( 1, 2 ] 61535 64.591% 82.183% ############# ( 2, 3 ] 10737 11.270% 93.453% ## ( 3, 4 ] 3061 3.213% 96.666% # ( 4, 6 ] 2568 2.696% 99.362% # ( 6, 10 ] 501 0.526% 99.888% ( 10, 15 ] 81 0.085% 99.973% ( 15, 22 ] 17 0.018% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 56916 Average: 5.3836 StdDev: 119.99 Min: 1 Median: 1.5517 Max: 9822 Percentiles: P50: 1.55 P75: 1.94 P99: 5.80 P99.9: 260.92 P99.99: 6106.54 ------------------------------------------------------ [ 0, 1 ] 8005 14.065% 14.065% ### ( 1, 2 ] 37071 65.133% 79.197% ############# ( 2, 3 ] 8667 15.228% 94.425% ### ( 3, 4 ] 1445 2.539% 96.964% # ( 4, 6 ] 1290 2.266% 99.230% ( 6, 10 ] 314 0.552% 99.782% ( 10, 15 ] 58 0.102% 99.884% ( 15, 22 ] 5 0.009% 99.893% ( 22, 34 ] 1 0.002% 99.895% ( 51, 76 ] 1 0.002% 99.896% ( 110, 170 ] 1 0.002% 99.898% ( 170, 250 ] 1 0.002% 99.900% ( 250, 380 ] 1 0.002% 99.902% ( 380, 580 ] 7 0.012% 99.914% ( 580, 870 ] 3 0.005% 99.919% ( 870, 1300 ] 5 0.009% 99.928% ( 1300, 1900 ] 1 0.002% 99.930% ( 1900, 2900 ] 7 0.012% 99.942% ( 2900, 4400 ] 18 0.032% 99.974% ( 4400, 6600 ] 12 0.021% 99.995% ( 6600, 9900 ] 3 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 250.8710 StdDev: 1035.11 Min: 0 Median: 1.5846 Max: 7055 Percentiles: P50: 1.58 P75: 5.12 P99: 5995.00 P99.9: 7055.00 P99.99: 7055.00 ------------------------------------------------------ [ 0, 1 ] 79 25.484% 25.484% ##### ( 1, 2 ] 130 41.935% 67.419% ######## ( 2, 3 ] 18 5.806% 73.226% # ( 3, 4 ] 1 0.323% 73.548% ( 4, 6 ] 8 2.581% 76.129% # ( 6, 10 ] 9 2.903% 79.032% # ( 10, 15 ] 38 12.258% 91.290% ## ( 15, 22 ] 3 0.968% 92.258% ( 22, 34 ] 1 0.323% 92.581% ( 110, 170 ] 1 0.323% 92.903% ( 170, 250 ] 1 0.323% 93.226% ( 250, 380 ] 1 0.323% 93.548% ( 380, 580 ] 1 0.323% 93.871% ( 580, 870 ] 1 0.323% 94.194% ( 1900, 2900 ] 4 1.290% 95.484% ( 2900, 4400 ] 8 2.581% 98.065% # ( 4400, 6600 ] 4 1.290% 99.355% ( 6600, 9900 ] 2 0.645% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1023.8000 StdDev: 1270.91 Min: 96 Median: 170.0000 Max: 3456 Percentiles: P50: 170.00 P75: 1900.00 P99: 3456.00 P99.9: 3456.00 P99.99: 3456.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 7 35.000% 50.000% ####### ( 170, 250 ] 1 5.000% 55.000% # ( 250, 380 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 1 5.000% 75.000% # ( 1900, 2900 ] 1 5.000% 80.000% # ( 2900, 4400 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 328.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.022 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.408 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/13-23:52:44 ... thread 0: (1000000,4000000) ops and (334730.3,338837.2) ops/second in (2.987480,11.805079) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 2.40 GB 18.9 2.2 0.0 2.2 5.9 3.7 0.0 1.6 117.5 313.1 19.31 17.98 61 0.317 2302K 2446 0.0 0.0 L1 9/9 1.04 GB 0.0 1.4 1.0 0.4 1.4 1.0 0.2 1.3 230.1 229.2 6.29 6.14 2 3.147 1470K 5310 0.0 0.0 L2 1/0 2.58 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 250.8 250.7 1.51 1.46 2 0.753 383K 196 0.0 0.0 L3 15/0 703.72 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.1 1.0 224.7 224.7 1.11 1.04 1 1.109 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 157.3 157.3 1.42 1.07 1 1.423 227K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/19 99.82 GB 0.0 4.5 1.7 2.8 8.1 5.4 1.2 2.2 154.1 281.3 29.64 27.69 67 0.442 4637K 7952 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 1.7 2.8 8.1 5.4 1.1 2.2 154.1 281.3 29.64 27.69 67 0.442 4637K 7952 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 1.7 2.8 4.5 1.7 0.0 0.0 239.6 239.1 19.06 18.26 14 1.362 4637K 7952 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 357.3 10.58 9.43 53 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.14 GB write, 695.84 MB/s write, 4.46 GB read, 381.11 MB/s read, 29.6 seconds Interval compaction: 8.14 GB write, 706.28 MB/s write, 4.46 GB read, 386.83 MB/s read, 29.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 11, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 931314 Average: 2.2608 StdDev: 10.94 Min: 1 Median: 1.5395 Max: 3794 Percentiles: P50: 1.54 P75: 1.92 P99: 5.63 P99.9: 10.36 P99.99: 14.57 ------------------------------------------------------ [ 0, 1 ] 134543 14.447% 14.447% ### ( 1, 2 ] 613749 65.901% 80.348% ############# ( 2, 3 ] 126595 13.593% 93.941% ### ( 3, 4 ] 29651 3.184% 97.125% # ( 4, 6 ] 21424 2.300% 99.425% ( 6, 10 ] 4350 0.467% 99.892% ( 10, 15 ] 996 0.107% 99.999% ( 15, 22 ] 89 0.010% 100.009% ( 22, 34 ] 8 0.001% 100.010% ( 34, 51 ] 10 0.001% 100.011% ( 51, 76 ] 9 0.001% 100.012% ( 76, 110 ] 9 0.001% 100.013% ( 110, 170 ] 20 0.002% 100.015% ( 170, 250 ] 29 0.003% 100.018% ( 250, 380 ] 14 0.002% 100.020% ( 380, 580 ] 17 0.002% 100.021% ( 580, 870 ] 22 0.002% 100.024% ( 870, 1300 ] 12 0.001% 100.025% ( 1300, 1900 ] 10 0.001% 100.026% ( 1900, 2900 ] 7 0.001% 100.027% ( 2900, 4400 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 105388 Average: 2.6676 StdDev: 26.73 Min: 0 Median: 1.5822 Max: 4702 Percentiles: P50: 1.58 P75: 1.95 P99: 5.75 P99.9: 14.96 P99.99: 1355.34 ------------------------------------------------------ [ 0, 1 ] 11429 10.845% 10.845% ## ( 1, 2 ] 70879 67.255% 78.100% ############# ( 2, 3 ] 16533 15.688% 93.788% ### ( 3, 4 ] 3318 3.148% 96.936% # ( 4, 6 ] 2492 2.365% 99.301% ( 6, 10 ] 579 0.549% 99.850% ( 10, 15 ] 53 0.050% 99.900% ( 15, 22 ] 7 0.007% 99.907% ( 22, 34 ] 2 0.002% 99.909% ( 51, 76 ] 1 0.001% 99.910% ( 110, 170 ] 42 0.040% 99.950% ( 170, 250 ] 18 0.017% 99.967% ( 250, 380 ] 8 0.008% 99.974% ( 380, 580 ] 12 0.011% 99.986% ( 580, 870 ] 1 0.001% 99.987% ( 870, 1300 ] 3 0.003% 99.990% ( 1300, 1900 ] 5 0.005% 99.994% ( 1900, 2900 ] 4 0.004% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 10.51 Min: 1 Median: 1.5017 Max: 2944 Percentiles: P50: 1.50 P75: 1.89 P99: 5.73 P99.9: 10.72 P99.99: 21.78 ------------------------------------------------------ [ 0, 1 ] 16759 17.591% 17.591% #### ( 1, 2 ] 61535 64.591% 82.183% ############# ( 2, 3 ] 10737 11.270% 93.453% ## ( 3, 4 ] 3061 3.213% 96.666% # ( 4, 6 ] 2568 2.696% 99.362% # ( 6, 10 ] 501 0.526% 99.888% ( 10, 15 ] 81 0.085% 99.973% ( 15, 22 ] 17 0.018% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 56916 Average: 5.3836 StdDev: 119.99 Min: 1 Median: 1.5517 Max: 9822 Percentiles: P50: 1.55 P75: 1.94 P99: 5.80 P99.9: 260.92 P99.99: 6106.54 ------------------------------------------------------ [ 0, 1 ] 8005 14.065% 14.065% ### ( 1, 2 ] 37071 65.133% 79.197% ############# ( 2, 3 ] 8667 15.228% 94.425% ### ( 3, 4 ] 1445 2.539% 96.964% # ( 4, 6 ] 1290 2.266% 99.230% ( 6, 10 ] 314 0.552% 99.782% ( 10, 15 ] 58 0.102% 99.884% ( 15, 22 ] 5 0.009% 99.893% ( 22, 34 ] 1 0.002% 99.895% ( 51, 76 ] 1 0.002% 99.896% ( 110, 170 ] 1 0.002% 99.898% ( 170, 250 ] 1 0.002% 99.900% ( 250, 380 ] 1 0.002% 99.902% ( 380, 580 ] 7 0.012% 99.914% ( 580, 870 ] 3 0.005% 99.919% ( 870, 1300 ] 5 0.009% 99.928% ( 1300, 1900 ] 1 0.002% 99.930% ( 1900, 2900 ] 7 0.012% 99.942% ( 2900, 4400 ] 18 0.032% 99.974% ( 4400, 6600 ] 12 0.021% 99.995% ( 6600, 9900 ] 3 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 250.8710 StdDev: 1035.11 Min: 0 Median: 1.5846 Max: 7055 Percentiles: P50: 1.58 P75: 5.12 P99: 5995.00 P99.9: 7055.00 P99.99: 7055.00 ------------------------------------------------------ [ 0, 1 ] 79 25.484% 25.484% ##### ( 1, 2 ] 130 41.935% 67.419% ######## ( 2, 3 ] 18 5.806% 73.226% # ( 3, 4 ] 1 0.323% 73.548% ( 4, 6 ] 8 2.581% 76.129% # ( 6, 10 ] 9 2.903% 79.032% # ( 10, 15 ] 38 12.258% 91.290% ## ( 15, 22 ] 3 0.968% 92.258% ( 22, 34 ] 1 0.323% 92.581% ( 110, 170 ] 1 0.323% 92.903% ( 170, 250 ] 1 0.323% 93.226% ( 250, 380 ] 1 0.323% 93.548% ( 380, 580 ] 1 0.323% 93.871% ( 580, 870 ] 1 0.323% 94.194% ( 1900, 2900 ] 4 1.290% 95.484% ( 2900, 4400 ] 8 2.581% 98.065% # ( 4400, 6600 ] 4 1.290% 99.355% ( 6600, 9900 ] 2 0.645% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1023.8000 StdDev: 1270.91 Min: 96 Median: 170.0000 Max: 3456 Percentiles: P50: 170.00 P75: 1900.00 P99: 3456.00 P99.9: 3456.00 P99.99: 3456.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 7 35.000% 50.000% ####### ( 170, 250 ] 1 5.000% 55.000% # ( 250, 380 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 1 5.000% 75.000% # ( 1900, 2900 ] 1 5.000% 80.000% # ( 2900, 4400 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 328.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.409 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.387 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/13-23:52:47 ... thread 0: (1000000,5000000) ops and (304688.1,331408.4) ops/second in (3.282045,15.087124) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.38 GB 94.4 3.0 0.0 3.0 7.7 4.7 0.0 1.6 122.0 311.1 25.30 23.58 79 0.320 3134K 3328 0.0 0.0 L1 9/9 1.04 GB 0.0 1.4 1.0 0.4 1.4 1.0 0.2 1.3 230.1 229.2 6.29 6.14 2 3.147 1470K 5310 0.0 0.0 L2 1/0 2.58 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 250.8 250.7 1.51 1.46 2 0.753 383K 196 0.0 0.0 L3 15/0 703.72 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.1 1.0 224.7 224.7 1.11 1.04 1 1.109 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 157.3 157.3 1.42 1.07 1 1.423 227K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/23 100.80 GB 0.0 5.3 1.7 3.6 9.9 6.4 1.2 2.1 151.1 285.2 35.64 33.29 85 0.419 5468K 8834 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 1.7 3.6 9.9 6.4 1.1 2.1 151.1 285.2 35.64 33.29 85 0.419 5468K 8834 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 1.7 3.6 5.3 1.7 0.0 0.0 242.6 242.1 22.20 21.34 17 1.306 5468K 8834 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.4 13.43 11.94 68 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.1 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.93 GB write, 665.85 MB/s write, 5.26 GB read, 352.82 MB/s read, 35.6 seconds Interval compaction: 9.93 GB write, 673.67 MB/s write, 5.26 GB read, 356.96 MB/s read, 35.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 13, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1309370 Average: 2.2995 StdDev: 11.65 Min: 1 Median: 1.5585 Max: 3794 Percentiles: P50: 1.56 P75: 1.94 P99: 5.65 P99.9: 10.46 P99.99: 14.62 ------------------------------------------------------ [ 0, 1 ] 170994 13.059% 13.059% ### ( 1, 2 ] 866055 66.143% 79.202% ############# ( 2, 3 ] 191252 14.606% 93.809% ### ( 3, 4 ] 42268 3.228% 97.037% # ( 4, 6 ] 31140 2.378% 99.415% ( 6, 10 ] 6222 0.475% 99.890% ( 10, 15 ] 1417 0.108% 99.998% ( 15, 22 ] 117 0.009% 100.007% ( 22, 34 ] 10 0.001% 100.008% ( 34, 51 ] 10 0.001% 100.009% ( 51, 76 ] 10 0.001% 100.010% ( 76, 110 ] 27 0.002% 100.012% ( 110, 170 ] 46 0.004% 100.015% ( 170, 250 ] 51 0.004% 100.019% ( 250, 380 ] 19 0.001% 100.020% ( 380, 580 ] 33 0.003% 100.023% ( 580, 870 ] 33 0.003% 100.026% ( 870, 1300 ] 16 0.001% 100.027% ( 1300, 1900 ] 12 0.001% 100.028% ( 1900, 2900 ] 11 0.001% 100.028% ( 2900, 4400 ] 3 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 164990 Average: 2.7095 StdDev: 22.22 Min: 0 Median: 1.6044 Max: 4702 Percentiles: P50: 1.60 P75: 1.98 P99: 6.86 P99.9: 129.80 P99.99: 688.82 ------------------------------------------------------ [ 0, 1 ] 16063 9.736% 9.736% ## ( 1, 2 ] 109910 66.616% 76.352% ############# ( 2, 3 ] 27546 16.696% 93.047% ### ( 3, 4 ] 5306 3.216% 96.263% # ( 4, 6 ] 4162 2.523% 98.786% # ( 6, 10 ] 1651 1.001% 99.787% ( 10, 15 ] 112 0.068% 99.855% ( 15, 22 ] 12 0.007% 99.862% ( 22, 34 ] 3 0.002% 99.864% ( 34, 51 ] 1 0.001% 99.864% ( 51, 76 ] 1 0.001% 99.865% ( 76, 110 ] 26 0.016% 99.881% ( 110, 170 ] 97 0.059% 99.939% ( 170, 250 ] 45 0.027% 99.967% ( 250, 380 ] 18 0.011% 99.978% ( 380, 580 ] 19 0.012% 99.989% ( 580, 870 ] 4 0.002% 99.992% ( 870, 1300 ] 3 0.002% 99.993% ( 1300, 1900 ] 5 0.003% 99.996% ( 1900, 2900 ] 4 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 10.51 Min: 1 Median: 1.5017 Max: 2944 Percentiles: P50: 1.50 P75: 1.89 P99: 5.73 P99.9: 10.72 P99.99: 21.78 ------------------------------------------------------ [ 0, 1 ] 16759 17.591% 17.591% #### ( 1, 2 ] 61535 64.591% 82.183% ############# ( 2, 3 ] 10737 11.270% 93.453% ## ( 3, 4 ] 3061 3.213% 96.666% # ( 4, 6 ] 2568 2.696% 99.362% # ( 6, 10 ] 501 0.526% 99.888% ( 10, 15 ] 81 0.085% 99.973% ( 15, 22 ] 17 0.018% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 56916 Average: 5.3836 StdDev: 119.99 Min: 1 Median: 1.5517 Max: 9822 Percentiles: P50: 1.55 P75: 1.94 P99: 5.80 P99.9: 260.92 P99.99: 6106.54 ------------------------------------------------------ [ 0, 1 ] 8005 14.065% 14.065% ### ( 1, 2 ] 37071 65.133% 79.197% ############# ( 2, 3 ] 8667 15.228% 94.425% ### ( 3, 4 ] 1445 2.539% 96.964% # ( 4, 6 ] 1290 2.266% 99.230% ( 6, 10 ] 314 0.552% 99.782% ( 10, 15 ] 58 0.102% 99.884% ( 15, 22 ] 5 0.009% 99.893% ( 22, 34 ] 1 0.002% 99.895% ( 51, 76 ] 1 0.002% 99.896% ( 110, 170 ] 1 0.002% 99.898% ( 170, 250 ] 1 0.002% 99.900% ( 250, 380 ] 1 0.002% 99.902% ( 380, 580 ] 7 0.012% 99.914% ( 580, 870 ] 3 0.005% 99.919% ( 870, 1300 ] 5 0.009% 99.928% ( 1300, 1900 ] 1 0.002% 99.930% ( 1900, 2900 ] 7 0.012% 99.942% ( 2900, 4400 ] 18 0.032% 99.974% ( 4400, 6600 ] 12 0.021% 99.995% ( 6600, 9900 ] 3 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 250.8710 StdDev: 1035.11 Min: 0 Median: 1.5846 Max: 7055 Percentiles: P50: 1.58 P75: 5.12 P99: 5995.00 P99.9: 7055.00 P99.99: 7055.00 ------------------------------------------------------ [ 0, 1 ] 79 25.484% 25.484% ##### ( 1, 2 ] 130 41.935% 67.419% ######## ( 2, 3 ] 18 5.806% 73.226% # ( 3, 4 ] 1 0.323% 73.548% ( 4, 6 ] 8 2.581% 76.129% # ( 6, 10 ] 9 2.903% 79.032% # ( 10, 15 ] 38 12.258% 91.290% ## ( 15, 22 ] 3 0.968% 92.258% ( 22, 34 ] 1 0.323% 92.581% ( 110, 170 ] 1 0.323% 92.903% ( 170, 250 ] 1 0.323% 93.226% ( 250, 380 ] 1 0.323% 93.548% ( 380, 580 ] 1 0.323% 93.871% ( 580, 870 ] 1 0.323% 94.194% ( 1900, 2900 ] 4 1.290% 95.484% ( 2900, 4400 ] 8 2.581% 98.065% # ( 4400, 6600 ] 4 1.290% 99.355% ( 6600, 9900 ] 2 0.645% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1023.8000 StdDev: 1270.91 Min: 96 Median: 170.0000 Max: 3456 Percentiles: P50: 170.00 P75: 1900.00 P99: 3456.00 P99.9: 3456.00 P99.99: 3456.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 7 35.000% 50.000% ####### ( 170, 250 ] 1 5.000% 55.000% # ( 250, 380 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 1 5.000% 75.000% # ( 1900, 2900 ] 1 5.000% 80.000% # ( 2900, 4400 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 15.3 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 322.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.016 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.608 H:M:S, 18.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-23:52:57 ... thread 0: (1000000,6000000) ops and (100990.9,240105.6) ops/second in (9.901882,24.989006) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 4.36 GB 194.4 5.3 0.0 5.3 10.9 5.6 0.0 1.9 144.2 298.3 37.55 34.85 100 0.376 5499K 11K 0.0 0.0 L1 9/9 1.04 GB 0.0 1.4 1.0 0.4 1.4 1.0 0.2 1.3 230.1 229.2 6.29 6.14 2 3.147 1470K 5310 0.0 0.0 L2 1/0 2.58 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 250.8 250.7 1.51 1.46 2 0.753 383K 196 0.0 0.0 L3 15/0 703.72 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.1 1.0 224.7 224.7 1.11 1.04 1 1.109 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 157.3 157.3 1.42 1.07 1 1.423 227K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/23 101.78 GB 0.0 7.5 1.7 5.8 13.2 7.3 1.2 2.3 161.1 281.8 47.88 44.55 106 0.452 7834K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.5 1.7 5.8 13.2 7.3 1.1 2.3 161.1 281.8 47.88 44.55 106 0.452 7834K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.5 1.7 5.8 7.5 1.7 0.0 0.0 244.6 244.1 31.54 30.04 22 1.434 7834K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.6 16.34 14.51 84 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.2 total, 25.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.18 GB write, 536.17 MB/s write, 7.53 GB read, 306.58 MB/s read, 47.9 seconds Interval compaction: 13.18 GB write, 539.97 MB/s write, 7.53 GB read, 308.75 MB/s read, 47.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 13, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2226690 Average: 2.8423 StdDev: 17.29 Min: 1 Median: 1.5542 Max: 3805 Percentiles: P50: 1.55 P75: 1.93 P99: 6.70 P99.9: 153.63 P99.99: 329.39 ------------------------------------------------------ [ 0, 1 ] 287034 12.891% 12.891% ### ( 1, 2 ] 1491013 66.961% 79.852% ############# ( 2, 3 ] 309095 13.881% 93.733% ### ( 3, 4 ] 66404 2.982% 96.715% # ( 4, 6 ] 48248 2.167% 98.882% ( 6, 10 ] 14957 0.672% 99.554% ( 10, 15 ] 2304 0.103% 99.657% ( 15, 22 ] 181 0.008% 99.665% ( 22, 34 ] 15 0.001% 99.666% ( 34, 51 ] 14 0.001% 99.667% ( 51, 76 ] 18 0.001% 99.667% ( 76, 110 ] 2684 0.121% 99.788% ( 110, 170 ] 3434 0.154% 99.942% ( 170, 250 ] 798 0.036% 99.978% ( 250, 380 ] 441 0.020% 99.998% ( 380, 580 ] 373 0.017% 100.015% ( 580, 870 ] 168 0.008% 100.022% ( 870, 1300 ] 36 0.002% 100.024% ( 1300, 1900 ] 17 0.001% 100.024% ( 1900, 2900 ] 26 0.001% 100.026% ( 2900, 4400 ] 9 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 332546 Average: 2.9355 StdDev: 19.36 Min: 0 Median: 1.5898 Max: 4702 Percentiles: P50: 1.59 P75: 1.96 P99: 8.13 P99.9: 164.34 P99.99: 592.72 ------------------------------------------------------ [ 0, 1 ] 35054 10.541% 10.541% ## ( 1, 2 ] 222469 66.899% 77.440% ############# ( 2, 3 ] 51689 15.543% 92.983% ### ( 3, 4 ] 9966 2.997% 95.980% # ( 4, 6 ] 7886 2.371% 98.352% ( 6, 10 ] 4055 1.219% 99.571% ( 10, 15 ] 217 0.065% 99.636% ( 15, 22 ] 24 0.007% 99.643% ( 22, 34 ] 3 0.001% 99.644% ( 34, 51 ] 1 0.000% 99.645% ( 51, 76 ] 1 0.000% 99.645% ( 76, 110 ] 315 0.095% 99.740% ( 110, 170 ] 589 0.177% 99.917% ( 170, 250 ] 129 0.039% 99.955% ( 250, 380 ] 64 0.019% 99.975% ( 380, 580 ] 50 0.015% 99.990% ( 580, 870 ] 17 0.005% 99.995% ( 870, 1300 ] 5 0.002% 99.996% ( 1300, 1900 ] 5 0.002% 99.998% ( 1900, 2900 ] 4 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ( 4400, 6600 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 10.51 Min: 1 Median: 1.5017 Max: 2944 Percentiles: P50: 1.50 P75: 1.89 P99: 5.73 P99.9: 10.72 P99.99: 21.78 ------------------------------------------------------ [ 0, 1 ] 16759 17.591% 17.591% #### ( 1, 2 ] 61535 64.591% 82.183% ############# ( 2, 3 ] 10737 11.270% 93.453% ## ( 3, 4 ] 3061 3.213% 96.666% # ( 4, 6 ] 2568 2.696% 99.362% # ( 6, 10 ] 501 0.526% 99.888% ( 10, 15 ] 81 0.085% 99.973% ( 15, 22 ] 17 0.018% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 56916 Average: 5.3836 StdDev: 119.99 Min: 1 Median: 1.5517 Max: 9822 Percentiles: P50: 1.55 P75: 1.94 P99: 5.80 P99.9: 260.92 P99.99: 6106.54 ------------------------------------------------------ [ 0, 1 ] 8005 14.065% 14.065% ### ( 1, 2 ] 37071 65.133% 79.197% ############# ( 2, 3 ] 8667 15.228% 94.425% ### ( 3, 4 ] 1445 2.539% 96.964% # ( 4, 6 ] 1290 2.266% 99.230% ( 6, 10 ] 314 0.552% 99.782% ( 10, 15 ] 58 0.102% 99.884% ( 15, 22 ] 5 0.009% 99.893% ( 22, 34 ] 1 0.002% 99.895% ( 51, 76 ] 1 0.002% 99.896% ( 110, 170 ] 1 0.002% 99.898% ( 170, 250 ] 1 0.002% 99.900% ( 250, 380 ] 1 0.002% 99.902% ( 380, 580 ] 7 0.012% 99.914% ( 580, 870 ] 3 0.005% 99.919% ( 870, 1300 ] 5 0.009% 99.928% ( 1300, 1900 ] 1 0.002% 99.930% ( 1900, 2900 ] 7 0.012% 99.942% ( 2900, 4400 ] 18 0.032% 99.974% ( 4400, 6600 ] 12 0.021% 99.995% ( 6600, 9900 ] 3 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 250.8710 StdDev: 1035.11 Min: 0 Median: 1.5846 Max: 7055 Percentiles: P50: 1.58 P75: 5.12 P99: 5995.00 P99.9: 7055.00 P99.99: 7055.00 ------------------------------------------------------ [ 0, 1 ] 79 25.484% 25.484% ##### ( 1, 2 ] 130 41.935% 67.419% ######## ( 2, 3 ] 18 5.806% 73.226% # ( 3, 4 ] 1 0.323% 73.548% ( 4, 6 ] 8 2.581% 76.129% # ( 6, 10 ] 9 2.903% 79.032% # ( 10, 15 ] 38 12.258% 91.290% ## ( 15, 22 ] 3 0.968% 92.258% ( 22, 34 ] 1 0.323% 92.581% ( 110, 170 ] 1 0.323% 92.903% ( 170, 250 ] 1 0.323% 93.226% ( 250, 380 ] 1 0.323% 93.548% ( 380, 580 ] 1 0.323% 93.871% ( 580, 870 ] 1 0.323% 94.194% ( 1900, 2900 ] 4 1.290% 95.484% ( 2900, 4400 ] 8 2.581% 98.065% # ( 4400, 6600 ] 4 1.290% 99.355% ( 6600, 9900 ] 2 0.645% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1023.8000 StdDev: 1270.91 Min: 96 Median: 170.0000 Max: 3456 Percentiles: P50: 170.00 P75: 1900.00 P99: 3456.00 P99.9: 3456.00 P99.99: 3456.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 7 35.000% 50.000% ####### ( 170, 250 ] 1 5.000% 55.000% # ( 250, 380 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 1 5.000% 75.000% # ( 1900, 2900 ] 1 5.000% 80.000% # ( 2900, 4400 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 25.2 total, 9.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 234.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.942 H:M:S, 35.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 99.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.926 H:M:S, 69.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-23:53:03 ... thread 0: (1000000,7000000) ops and (155757.0,222864.2) ops/second in (6.420256,31.409262) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 3.19 GB 0.0 6.3 0.0 6.3 13.0 6.7 0.0 1.9 145.1 298.4 44.71 41.54 119 0.376 6587K 12K 0.0 0.0 L1 19/19 2.20 GB 0.0 4.7 3.3 1.4 4.6 3.2 0.2 1.4 219.1 216.6 21.81 20.49 3 7.271 4852K 53K 0.0 0.0 L2 1/0 2.58 MB 0.0 0.4 0.2 0.2 0.4 0.2 1.2 2.0 250.8 250.7 1.51 1.46 2 0.753 383K 196 0.0 0.0 L3 14/0 926.87 MB 0.9 0.2 0.2 0.0 0.2 0.2 1.1 1.0 224.7 224.7 1.11 1.04 1 1.109 253K 0 0.0 0.0 L4 170/0 9.56 GB 1.0 0.4 0.3 0.0 0.4 0.3 1.0 1.0 167.4 167.2 2.18 1.71 2 1.088 369K 371 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/30 102.78 GB 0.0 12.0 4.0 7.9 18.6 10.7 4.9 2.8 171.9 267.2 71.32 66.24 127 0.562 12M 66K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.0 4.0 7.9 18.6 10.7 4.8 2.8 171.9 267.2 71.32 66.24 127 0.562 12M 66K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.0 4.0 7.9 11.9 4.0 0.0 0.0 236.3 235.0 51.87 48.98 28 1.853 12M 66K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 353.1 19.45 17.26 99 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.6 total, 31.4 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.61 GB write, 603.31 MB/s write, 11.97 GB read, 388.05 MB/s read, 71.3 seconds Interval compaction: 18.61 GB write, 606.72 MB/s write, 11.97 GB read, 390.24 MB/s read, 71.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 16, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2791831 Average: 2.7520 StdDev: 16.51 Min: 1 Median: 1.5557 Max: 3805 Percentiles: P50: 1.56 P75: 1.93 P99: 6.54 P99.9: 145.38 P99.99: 312.81 ------------------------------------------------------ [ 0, 1 ] 355312 12.727% 12.727% ### ( 1, 2 ] 1872627 67.075% 79.802% ############# ( 2, 3 ] 391795 14.034% 93.836% ### ( 3, 4 ] 81543 2.921% 96.756% # ( 4, 6 ] 59951 2.147% 98.904% ( 6, 10 ] 19797 0.709% 99.613% ( 10, 15 ] 2972 0.106% 99.719% ( 15, 22 ] 247 0.009% 99.728% ( 22, 34 ] 28 0.001% 99.729% ( 34, 51 ] 14 0.001% 99.730% ( 51, 76 ] 21 0.001% 99.730% ( 76, 110 ] 2685 0.096% 99.827% ( 110, 170 ] 3477 0.125% 99.951% ( 170, 250 ] 851 0.030% 99.982% ( 250, 380 ] 486 0.017% 99.999% ( 380, 580 ] 406 0.015% 100.014% ( 580, 870 ] 200 0.007% 100.021% ( 870, 1300 ] 51 0.002% 100.023% ( 1300, 1900 ] 22 0.001% 100.023% ( 1900, 2900 ] 29 0.001% 100.024% ( 2900, 4400 ] 11 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 440768 Average: 3.0125 StdDev: 22.66 Min: 0 Median: 1.5858 Max: 4702 Percentiles: P50: 1.59 P75: 1.96 P99: 8.21 P99.9: 167.08 P99.99: 1007.03 ------------------------------------------------------ [ 0, 1 ] 48599 11.026% 11.026% ## ( 1, 2 ] 293230 66.527% 77.553% ############# ( 2, 3 ] 68170 15.466% 93.019% ### ( 3, 4 ] 12890 2.924% 95.944% # ( 4, 6 ] 10357 2.350% 98.293% ( 6, 10 ] 5644 1.280% 99.574% ( 10, 15 ] 315 0.071% 99.645% ( 15, 22 ] 45 0.010% 99.656% ( 22, 34 ] 4 0.001% 99.657% ( 34, 51 ] 1 0.000% 99.657% ( 51, 76 ] 1 0.000% 99.657% ( 76, 110 ] 452 0.103% 99.760% ( 110, 170 ] 652 0.148% 99.907% ( 170, 250 ] 160 0.036% 99.944% ( 250, 380 ] 85 0.019% 99.963% ( 380, 580 ] 86 0.020% 99.983% ( 580, 870 ] 25 0.006% 99.988% ( 870, 1300 ] 28 0.006% 99.995% ( 1300, 1900 ] 9 0.002% 99.997% ( 1900, 2900 ] 12 0.003% 99.999% ( 2900, 4400 ] 3 0.001% 100.000% ( 4400, 6600 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 10.51 Min: 1 Median: 1.5017 Max: 2944 Percentiles: P50: 1.50 P75: 1.89 P99: 5.73 P99.9: 10.72 P99.99: 21.78 ------------------------------------------------------ [ 0, 1 ] 16759 17.591% 17.591% #### ( 1, 2 ] 61535 64.591% 82.183% ############# ( 2, 3 ] 10737 11.270% 93.453% ## ( 3, 4 ] 3061 3.213% 96.666% # ( 4, 6 ] 2568 2.696% 99.362% # ( 6, 10 ] 501 0.526% 99.888% ( 10, 15 ] 81 0.085% 99.973% ( 15, 22 ] 17 0.018% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 56916 Average: 5.3836 StdDev: 119.99 Min: 1 Median: 1.5517 Max: 9822 Percentiles: P50: 1.55 P75: 1.94 P99: 5.80 P99.9: 260.92 P99.99: 6106.54 ------------------------------------------------------ [ 0, 1 ] 8005 14.065% 14.065% ### ( 1, 2 ] 37071 65.133% 79.197% ############# ( 2, 3 ] 8667 15.228% 94.425% ### ( 3, 4 ] 1445 2.539% 96.964% # ( 4, 6 ] 1290 2.266% 99.230% ( 6, 10 ] 314 0.552% 99.782% ( 10, 15 ] 58 0.102% 99.884% ( 15, 22 ] 5 0.009% 99.893% ( 22, 34 ] 1 0.002% 99.895% ( 51, 76 ] 1 0.002% 99.896% ( 110, 170 ] 1 0.002% 99.898% ( 170, 250 ] 1 0.002% 99.900% ( 250, 380 ] 1 0.002% 99.902% ( 380, 580 ] 7 0.012% 99.914% ( 580, 870 ] 3 0.005% 99.919% ( 870, 1300 ] 5 0.009% 99.928% ( 1300, 1900 ] 1 0.002% 99.930% ( 1900, 2900 ] 7 0.012% 99.942% ( 2900, 4400 ] 18 0.032% 99.974% ( 4400, 6600 ] 12 0.021% 99.995% ( 6600, 9900 ] 3 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 3260 Average: 43.9012 StdDev: 338.02 Min: 0 Median: 1.6267 Max: 7055 Percentiles: P50: 1.63 P75: 2.20 P99: 677.88 P99.9: 5907.00 P99.99: 7055.00 ------------------------------------------------------ [ 0, 1 ] 411 12.607% 12.607% ### ( 1, 2 ] 1945 59.663% 72.270% ############ ( 2, 3 ] 443 13.589% 85.859% ### ( 3, 4 ] 84 2.577% 88.436% # ( 4, 6 ] 63 1.933% 90.368% ( 6, 10 ] 47 1.442% 91.810% ( 10, 15 ] 40 1.227% 93.037% ( 15, 22 ] 5 0.153% 93.190% ( 22, 34 ] 1 0.031% 93.221% ( 76, 110 ] 11 0.337% 93.558% ( 110, 170 ] 58 1.779% 95.337% ( 170, 250 ] 52 1.595% 96.933% ( 250, 380 ] 27 0.828% 97.761% ( 380, 580 ] 35 1.074% 98.834% ( 580, 870 ] 16 0.491% 99.325% ( 870, 1300 ] 3 0.092% 99.417% ( 1300, 1900 ] 1 0.031% 99.448% ( 1900, 2900 ] 4 0.123% 99.571% ( 2900, 4400 ] 8 0.245% 99.816% ( 4400, 6600 ] 4 0.123% 99.939% ( 6600, 9900 ] 2 0.061% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 1048.3500 StdDev: 1271.24 Min: 88 Median: 380.0000 Max: 4805 Percentiles: P50: 380.00 P75: 1300.00 P99: 4805.00 P99.9: 4805.00 P99.99: 4805.00 ------------------------------------------------------ ( 76, 110 ] 6 7.500% 7.500% ## ( 110, 170 ] 16 20.000% 27.500% #### ( 170, 250 ] 11 13.750% 41.250% ### ( 250, 380 ] 7 8.750% 50.000% ## ( 380, 580 ] 6 7.500% 57.500% ## ( 580, 870 ] 7 8.750% 66.250% ## ( 870, 1300 ] 7 8.750% 75.000% ## ( 1300, 1900 ] 2 2.500% 77.500% # ( 1900, 2900 ] 7 8.750% 86.250% ## ( 2900, 4400 ] 9 11.250% 97.500% ## ( 4400, 6600 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 31.6 total, 6.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 218.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.547 H:M:S, 39.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 153.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.605 H:M:S, 56.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/12/13-23:53:26 ... thread 0: (1000000,8000000) ops and (43348.9,146848.5) ops/second in (23.068652,54.477914) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.78 GB 44.0 7.6 0.0 7.6 15.2 7.6 0.0 2.0 138.7 276.0 56.31 49.02 131 0.430 7929K 16K 0.0 0.0 L1 7/7 689.31 MB 0.0 9.1 5.5 3.6 9.0 5.4 0.2 1.6 217.1 214.2 43.08 39.98 4 10.769 8779K 53K 0.0 0.0 L2 1/0 89.98 MB 0.9 0.4 0.2 0.2 0.4 0.2 4.9 2.0 250.8 250.7 1.51 1.46 2 0.753 383K 196 0.0 0.0 L3 17/1 1.06 GB 1.0 1.5 0.8 0.8 1.5 0.8 4.2 2.0 129.8 128.3 12.06 7.16 7 1.723 1589K 18K 0.0 0.0 L4 162/3 9.69 GB 1.0 4.4 3.8 0.6 4.4 3.8 1.0 1.2 118.4 118.1 38.28 21.57 36 1.063 4090K 3806 0.0 0.0 L5 1096/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/17 103.54 GB 0.0 23.1 10.3 12.8 30.5 17.7 15.0 4.0 156.3 206.4 151.23 119.19 180 0.840 22M 92K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.1 10.3 12.8 30.5 17.7 14.9 4.0 156.3 206.4 151.23 119.19 180 0.840 22M 92K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.1 10.3 12.8 22.9 10.1 0.0 0.0 187.7 186.3 125.96 99.46 71 1.774 22M 92K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 306.6 25.28 19.73 109 0.232 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.7 total, 54.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.49 GB write, 571.15 MB/s write, 23.08 GB read, 432.47 MB/s read, 151.2 seconds Interval compaction: 30.49 GB write, 573.01 MB/s write, 23.08 GB read, 433.88 MB/s read, 151.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 56, interval: 85 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3709252 Average: 3.2843 StdDev: 39.33 Min: 1 Median: 1.5756 Max: 19584 Percentiles: P50: 1.58 P75: 1.96 P99: 7.75 P99.9: 163.79 P99.99: 522.88 ------------------------------------------------------ [ 0, 1 ] 459640 12.392% 12.392% ## ( 1, 2 ] 2423366 65.333% 77.725% ############# ( 2, 3 ] 540632 14.575% 92.300% ### ( 3, 4 ] 126710 3.416% 95.716% # ( 4, 6 ] 108204 2.917% 98.633% # ( 6, 10 ] 31021 0.836% 99.469% ( 10, 15 ] 4944 0.133% 99.603% ( 15, 22 ] 572 0.015% 99.618% ( 22, 34 ] 50 0.001% 99.620% ( 34, 51 ] 18 0.000% 99.620% ( 51, 76 ] 24 0.001% 99.621% ( 76, 110 ] 4869 0.131% 99.752% ( 110, 170 ] 6128 0.165% 99.917% ( 170, 250 ] 1295 0.035% 99.952% ( 250, 380 ] 874 0.024% 99.976% ( 380, 580 ] 749 0.020% 99.996% ( 580, 870 ] 424 0.011% 100.007% ( 870, 1300 ] 150 0.004% 100.011% ( 1300, 1900 ] 113 0.003% 100.014% ( 1900, 2900 ] 121 0.003% 100.018% ( 2900, 4400 ] 121 0.003% 100.021% ( 4400, 6600 ] 42 0.001% 100.022% ( 6600, 9900 ] 9 0.000% 100.022% ( 9900, 14000 ] 1 0.000% 100.022% ( 14000, 22000 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1921678 Average: 6.0078 StdDev: 97.43 Min: 0 Median: 1.7586 Max: 12804 Percentiles: P50: 1.76 P75: 2.58 P99: 9.37 P99.9: 172.10 P99.99: 611.35 ------------------------------------------------------ [ 0, 1 ] 190273 9.901% 9.901% ## ( 1, 2 ] 1015717 52.856% 62.757% ########### ( 2, 3 ] 404347 21.041% 83.798% #### ( 3, 4 ] 124943 6.502% 90.300% # ( 4, 6 ] 135875 7.071% 97.371% # ( 6, 10 ] 37162 1.934% 99.305% ( 10, 15 ] 5987 0.312% 99.616% ( 15, 22 ] 912 0.047% 99.664% ( 22, 34 ] 62 0.003% 99.667% ( 34, 51 ] 22 0.001% 99.668% ( 51, 76 ] 8 0.000% 99.669% ( 76, 110 ] 1948 0.101% 99.770% ( 110, 170 ] 2488 0.129% 99.899% ( 170, 250 ] 469 0.024% 99.924% ( 250, 380 ] 533 0.028% 99.952% ( 380, 580 ] 662 0.034% 99.986% ( 580, 870 ] 720 0.037% 100.023% ( 870, 1300 ] 491 0.026% 100.049% ( 1300, 1900 ] 329 0.017% 100.066% ( 1900, 2900 ] 394 0.021% 100.087% ( 2900, 4400 ] 492 0.026% 100.112% ( 4400, 6600 ] 135 0.007% 100.119% ( 6600, 9900 ] 60 0.003% 100.122% ( 9900, 14000 ] 3 0.000% 100.122% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 10.51 Min: 1 Median: 1.5017 Max: 2944 Percentiles: P50: 1.50 P75: 1.89 P99: 5.73 P99.9: 10.72 P99.99: 21.78 ------------------------------------------------------ [ 0, 1 ] 16759 17.591% 17.591% #### ( 1, 2 ] 61535 64.591% 82.183% ############# ( 2, 3 ] 10737 11.270% 93.453% ## ( 3, 4 ] 3061 3.213% 96.666% # ( 4, 6 ] 2568 2.696% 99.362% # ( 6, 10 ] 501 0.526% 99.888% ( 10, 15 ] 81 0.085% 99.973% ( 15, 22 ] 17 0.018% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 366246 Average: 4.6199 StdDev: 74.69 Min: 1 Median: 2.1297 Max: 9822 Percentiles: P50: 2.13 P75: 2.95 P99: 8.49 P99.9: 13.86 P99.99: 18.23 ------------------------------------------------------ [ 0, 1 ] 8789 2.400% 2.400% ( 1, 2 ] 159887 43.656% 46.055% ######### ( 2, 3 ] 111399 30.416% 76.472% ###### ( 3, 4 ] 37231 10.166% 86.637% ## ( 4, 6 ] 41385 11.300% 97.937% ## ( 6, 10 ] 6256 1.708% 99.645% ( 10, 15 ] 1207 0.330% 99.975% ( 15, 22 ] 120 0.033% 100.008% ( 22, 34 ] 9 0.002% 100.010% ( 34, 51 ] 5 0.001% 100.011% ( 51, 76 ] 8 0.002% 100.014% ( 76, 110 ] 1 0.000% 100.014% ( 110, 170 ] 9 0.002% 100.016% ( 170, 250 ] 7 0.002% 100.018% ( 250, 380 ] 22 0.006% 100.024% ( 380, 580 ] 31 0.008% 100.033% ( 580, 870 ] 34 0.009% 100.042% ( 870, 1300 ] 29 0.008% 100.050% ( 1300, 1900 ] 28 0.008% 100.058% ( 1900, 2900 ] 51 0.014% 100.072% ( 2900, 4400 ] 61 0.017% 100.088% ( 4400, 6600 ] 16 0.004% 100.093% ( 6600, 9900 ] 6 0.002% 100.094% ** Level 4 read latency histogram (micros): Count: 172188 Average: 29.6863 StdDev: 241.39 Min: 0 Median: 2.2762 Max: 10563 Percentiles: P50: 2.28 P75: 3.20 P99: 818.87 P99.9: 3533.91 P99.99: 4262.61 ------------------------------------------------------ [ 0, 1 ] 1251 0.727% 0.727% ( 1, 2 ] 69875 40.581% 41.307% ######## ( 2, 3 ] 54184 31.468% 72.775% ###### ( 3, 4 ] 19035 11.055% 83.830% ## ( 4, 6 ] 18702 10.861% 94.691% ## ( 6, 10 ] 4081 2.370% 97.061% ( 10, 15 ] 859 0.499% 97.560% ( 15, 22 ] 120 0.070% 97.630% ( 22, 34 ] 11 0.006% 97.636% ( 34, 51 ] 4 0.002% 97.639% ( 51, 76 ] 4 0.002% 97.641% ( 76, 110 ] 32 0.019% 97.660% ( 110, 170 ] 161 0.094% 97.753% ( 170, 250 ] 314 0.182% 97.935% ( 250, 380 ] 432 0.251% 98.186% ( 380, 580 ] 715 0.415% 98.602% ( 580, 870 ] 833 0.484% 99.085% ( 870, 1300 ] 635 0.369% 99.454% ( 1300, 1900 ] 348 0.202% 99.656% ( 1900, 2900 ] 285 0.166% 99.822% ( 2900, 4400 ] 319 0.185% 100.007% ( 4400, 6600 ] 64 0.037% 100.044% ( 6600, 9900 ] 11 0.006% 100.051% ( 9900, 14000 ] 1 0.001% 100.051% ** Level 5 read latency histogram (micros): Count: 280 Average: 1630.7929 StdDev: 1587.91 Min: 85 Median: 936.1538 Max: 7771 Percentiles: P50: 936.15 P75: 2660.87 P99: 6402.00 P99.9: 7771.00 P99.99: 7771.00 ------------------------------------------------------ ( 76, 110 ] 10 3.571% 3.571% # ( 110, 170 ] 26 9.286% 12.857% ## ( 170, 250 ] 17 6.071% 18.929% # ( 250, 380 ] 23 8.214% 27.143% ## ( 380, 580 ] 35 12.500% 39.643% ### ( 580, 870 ] 25 8.929% 48.571% ## ( 870, 1300 ] 26 9.286% 57.857% ## ( 1300, 1900 ] 13 4.643% 62.500% # ( 1900, 2900 ] 46 16.429% 78.929% ### ( 2900, 4400 ] 38 13.571% 92.500% ### ( 4400, 6600 ] 20 7.143% 99.643% # ( 6600, 9900 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 54.7 total, 23.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 144.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.925 H:M:S, 58.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 42.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:19.378 H:M:S, 84.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/13-23:53:29 ... thread 0: (1000000,9000000) ops and (320187.1,156247.0) ops/second in (3.123174,57.601088) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/6 2.70 GB 144.7 8.5 0.0 8.5 17.0 8.5 0.0 2.0 138.8 277.4 62.60 54.87 147 0.426 8825K 17K 0.0 0.0 L1 7/7 689.31 MB 0.0 9.1 5.5 3.6 9.0 5.4 0.2 1.6 217.1 214.2 43.08 39.98 4 10.769 8779K 53K 0.0 0.0 L2 1/0 89.98 MB 0.9 0.4 0.2 0.2 0.4 0.2 4.9 2.0 250.8 250.7 1.51 1.46 2 0.753 383K 196 0.0 0.0 L3 16/0 959.41 MB 1.0 1.5 0.8 0.8 1.5 0.8 4.2 2.0 129.8 128.3 12.06 7.16 7 1.723 1589K 18K 0.0 0.0 L4 159/0 9.51 GB 1.0 4.6 3.9 0.7 4.6 3.9 1.0 1.2 119.8 119.5 39.59 22.54 37 1.070 4299K 3806 0.0 0.0 L5 1100/0 90.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/13 104.46 GB 0.0 24.1 10.4 13.7 32.5 18.7 15.3 3.8 155.7 209.4 158.83 126.01 197 0.806 23M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.1 10.4 13.7 32.5 18.7 15.2 3.8 155.7 209.4 158.83 126.01 197 0.806 23M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.1 10.4 13.7 24.0 10.2 0.0 0.0 189.1 187.8 130.74 103.79 75 1.743 23M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 309.5 28.09 22.22 122 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.8 total, 57.6 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.47 GB write, 575.49 MB/s write, 24.15 GB read, 427.98 MB/s read, 158.8 seconds Interval compaction: 32.47 GB write, 577.27 MB/s write, 24.15 GB read, 429.30 MB/s read, 158.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 60, interval: 89 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3975283 Average: 3.2341 StdDev: 38.17 Min: 1 Median: 1.5792 Max: 19584 Percentiles: P50: 1.58 P75: 1.96 P99: 7.61 P99.9: 161.65 P99.99: 510.59 ------------------------------------------------------ [ 0, 1 ] 482172 12.129% 12.129% ## ( 1, 2 ] 2599201 65.384% 77.513% ############# ( 2, 3 ] 588933 14.815% 92.328% ### ( 3, 4 ] 135964 3.420% 95.748% # ( 4, 6 ] 116093 2.920% 98.669% # ( 6, 10 ] 32804 0.825% 99.494% ( 10, 15 ] 5252 0.132% 99.626% ( 15, 22 ] 593 0.015% 99.641% ( 22, 34 ] 56 0.001% 99.642% ( 34, 51 ] 19 0.000% 99.643% ( 51, 76 ] 26 0.001% 99.644% ( 76, 110 ] 4875 0.123% 99.766% ( 110, 170 ] 6181 0.155% 99.922% ( 170, 250 ] 1322 0.033% 99.955% ( 250, 380 ] 894 0.022% 99.977% ( 380, 580 ] 768 0.019% 99.997% ( 580, 870 ] 440 0.011% 100.008% ( 870, 1300 ] 159 0.004% 100.012% ( 1300, 1900 ] 114 0.003% 100.015% ( 1900, 2900 ] 122 0.003% 100.018% ( 2900, 4400 ] 123 0.003% 100.021% ( 4400, 6600 ] 42 0.001% 100.022% ( 6600, 9900 ] 9 0.000% 100.022% ( 9900, 14000 ] 1 0.000% 100.022% ( 14000, 22000 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 2053456 Average: 5.8110 StdDev: 94.34 Min: 0 Median: 1.7519 Max: 12804 Percentiles: P50: 1.75 P75: 2.56 P99: 9.33 P99.9: 169.81 P99.99: 611.60 ------------------------------------------------------ [ 0, 1 ] 200087 9.744% 9.744% ## ( 1, 2 ] 1099418 53.540% 63.284% ########### ( 2, 3 ] 431862 21.031% 84.315% #### ( 3, 4 ] 128971 6.281% 90.595% # ( 4, 6 ] 139710 6.804% 97.399% # ( 6, 10 ] 39519 1.925% 99.324% ( 10, 15 ] 6161 0.300% 99.624% ( 15, 22 ] 927 0.045% 99.669% ( 22, 34 ] 64 0.003% 99.672% ( 34, 51 ] 23 0.001% 99.673% ( 51, 76 ] 9 0.000% 99.673% ( 76, 110 ] 2013 0.098% 99.772% ( 110, 170 ] 2647 0.129% 99.900% ( 170, 250 ] 512 0.025% 99.925% ( 250, 380 ] 561 0.027% 99.953% ( 380, 580 ] 687 0.033% 99.986% ( 580, 870 ] 731 0.036% 100.022% ( 870, 1300 ] 494 0.024% 100.046% ( 1300, 1900 ] 329 0.016% 100.062% ( 1900, 2900 ] 394 0.019% 100.081% ( 2900, 4400 ] 493 0.024% 100.105% ( 4400, 6600 ] 135 0.007% 100.112% ( 6600, 9900 ] 60 0.003% 100.114% ( 9900, 14000 ] 3 0.000% 100.115% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 10.51 Min: 1 Median: 1.5017 Max: 2944 Percentiles: P50: 1.50 P75: 1.89 P99: 5.73 P99.9: 10.72 P99.99: 21.78 ------------------------------------------------------ [ 0, 1 ] 16759 17.591% 17.591% #### ( 1, 2 ] 61535 64.591% 82.183% ############# ( 2, 3 ] 10737 11.270% 93.453% ## ( 3, 4 ] 3061 3.213% 96.666% # ( 4, 6 ] 2568 2.696% 99.362% # ( 6, 10 ] 501 0.526% 99.888% ( 10, 15 ] 81 0.085% 99.973% ( 15, 22 ] 17 0.018% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 366246 Average: 4.6199 StdDev: 74.69 Min: 1 Median: 2.1297 Max: 9822 Percentiles: P50: 2.13 P75: 2.95 P99: 8.49 P99.9: 13.86 P99.99: 18.23 ------------------------------------------------------ [ 0, 1 ] 8789 2.400% 2.400% ( 1, 2 ] 159887 43.656% 46.055% ######### ( 2, 3 ] 111399 30.416% 76.472% ###### ( 3, 4 ] 37231 10.166% 86.637% ## ( 4, 6 ] 41385 11.300% 97.937% ## ( 6, 10 ] 6256 1.708% 99.645% ( 10, 15 ] 1207 0.330% 99.975% ( 15, 22 ] 120 0.033% 100.008% ( 22, 34 ] 9 0.002% 100.010% ( 34, 51 ] 5 0.001% 100.011% ( 51, 76 ] 8 0.002% 100.014% ( 76, 110 ] 1 0.000% 100.014% ( 110, 170 ] 9 0.002% 100.016% ( 170, 250 ] 7 0.002% 100.018% ( 250, 380 ] 22 0.006% 100.024% ( 380, 580 ] 31 0.008% 100.033% ( 580, 870 ] 34 0.009% 100.042% ( 870, 1300 ] 29 0.008% 100.050% ( 1300, 1900 ] 28 0.008% 100.058% ( 1900, 2900 ] 51 0.014% 100.072% ( 2900, 4400 ] 61 0.017% 100.088% ( 4400, 6600 ] 16 0.004% 100.093% ( 6600, 9900 ] 6 0.002% 100.094% ** Level 4 read latency histogram (micros): Count: 183536 Average: 28.0393 StdDev: 233.92 Min: 0 Median: 2.2461 Max: 10563 Percentiles: P50: 2.25 P75: 3.12 P99: 779.68 P99.9: 3480.55 P99.99: 4257.27 ------------------------------------------------------ [ 0, 1 ] 1348 0.734% 0.734% ( 1, 2 ] 76215 41.526% 42.260% ######## ( 2, 3 ] 57724 31.451% 73.711% ###### ( 3, 4 ] 19587 10.672% 84.383% ## ( 4, 6 ] 19274 10.501% 94.885% ## ( 6, 10 ] 4301 2.343% 97.228% ( 10, 15 ] 875 0.477% 97.705% ( 15, 22 ] 120 0.065% 97.770% ( 22, 34 ] 11 0.006% 97.776% ( 34, 51 ] 4 0.002% 97.779% ( 51, 76 ] 4 0.002% 97.781% ( 76, 110 ] 33 0.018% 97.799% ( 110, 170 ] 161 0.088% 97.887% ( 170, 250 ] 318 0.173% 98.060% ( 250, 380 ] 434 0.236% 98.296% ( 380, 580 ] 716 0.390% 98.686% ( 580, 870 ] 836 0.455% 99.142% ( 870, 1300 ] 635 0.346% 99.488% ( 1300, 1900 ] 348 0.190% 99.677% ( 1900, 2900 ] 285 0.155% 99.833% ( 2900, 4400 ] 319 0.174% 100.007% ( 4400, 6600 ] 64 0.035% 100.041% ( 6600, 9900 ] 11 0.006% 100.047% ( 9900, 14000 ] 1 0.001% 100.048% ** Level 5 read latency histogram (micros): Count: 300 Average: 1583.1000 StdDev: 1572.91 Min: 84 Median: 870.0000 Max: 7771 Percentiles: P50: 870.00 P75: 2608.33 P99: 6380.00 P99.9: 7771.00 P99.99: 7771.00 ------------------------------------------------------ ( 76, 110 ] 13 4.333% 4.333% # ( 110, 170 ] 29 9.667% 14.000% ## ( 170, 250 ] 19 6.333% 20.333% # ( 250, 380 ] 26 8.667% 29.000% ## ( 380, 580 ] 36 12.000% 41.000% ## ( 580, 870 ] 27 9.000% 50.000% ## ( 870, 1300 ] 27 9.000% 59.000% ## ( 1300, 1900 ] 14 4.667% 63.667% # ( 1900, 2900 ] 48 16.000% 79.667% ### ( 2900, 4400 ] 40 13.333% 93.000% ### ( 4400, 6600 ] 20 6.667% 99.667% # ( 6600, 9900 ] 1 0.333% 100.000% ** DB Stats ** Uptime(secs): 57.8 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 153.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.379 H:M:S, 56.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.454 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.162 micros/op 162278 ops/sec 60.002 seconds 9736999 operations; 157.2 MB/s Microseconds per write: Count: 9736999 Average: 6.1622 StdDev: 554.31 Min: 0 Median: 1.7359 Max: 866728 Percentiles: P50: 1.74 P75: 2.77 P99: 9.92 P99.9: 1153.28 P99.99: 2648.83 ------------------------------------------------------ [ 0, 1 ] 1336347 13.724% 13.724% ### ( 1, 2 ] 4799992 49.296% 63.021% ########## ( 2, 3 ] 1518647 15.597% 78.618% ### ( 3, 4 ] 1321828 13.575% 92.193% ### ( 4, 6 ] 523158 5.373% 97.566% # ( 6, 10 ] 142528 1.464% 99.029% ( 10, 15 ] 50732 0.521% 99.551% ( 15, 22 ] 10720 0.110% 99.661% ( 22, 34 ] 1514 0.016% 99.676% ( 34, 51 ] 215 0.002% 99.678% ( 51, 76 ] 16 0.000% 99.679% ( 76, 110 ] 6850 0.070% 99.749% ( 110, 170 ] 2519 0.026% 99.775% ( 170, 250 ] 272 0.003% 99.778% ( 250, 380 ] 211 0.002% 99.780% ( 380, 580 ] 29 0.000% 99.780% ( 580, 870 ] 30 0.000% 99.780% ( 870, 1300 ] 17690 0.182% 99.962% ( 1300, 1900 ] 39 0.000% 99.962% ( 1900, 2900 ] 3590 0.037% 99.999% ( 2900, 4400 ] 35 0.000% 100.000% ( 4400, 6600 ] 4 0.000% 100.000% ( 6600, 9900 ] 7 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 179025 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9736999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10048582968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 529 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32815653 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28627840385 rocksdb.compact.write.bytes COUNT : 28438664840 rocksdb.flush.write.bytes COUNT : 9908639048 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 68 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 303 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9828782080 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3847168 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28727462476 rocksdb.non.last.level.read.count COUNT : 6934532 rocksdb.block.checksum.compute.count COUNT : 6933542 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.389257 P95 : 3.970342 P99 : 8.656598 P100 : 866725.000000 COUNT : 9736999 SUM : 55434481 rocksdb.compaction.times.micros P50 : 1242424.242424 P95 : 5510000.000000 P99 : 18880000.000000 P100 : 21264449.000000 COUNT : 78 SUM : 143356203 rocksdb.compaction.times.cpu_micros P50 : 933513.513514 P95 : 5510000.000000 P99 : 18880000.000000 P100 : 19484421.000000 COUNT : 78 SUM : 113784496 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 713.333333 P95 : 10720.000000 P99 : 104400.000000 P100 : 188405.000000 COUNT : 132 SUM : 559989 rocksdb.compaction.outfile.sync.micros P50 : 1128.581081 P95 : 154625.000000 P99 : 308175.000000 P100 : 538960.000000 COUNT : 321 SUM : 8925970 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 113.333333 P95 : 2518.181818 P99 : 3704.000000 P100 : 3704.000000 COUNT : 244 SUM : 120877 rocksdb.table.open.io.micros P50 : 1795.505618 P95 : 11242.750000 P99 : 19607.272727 P100 : 23523.000000 COUNT : 529 SUM : 1533583 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.705368 P95 : 7.764545 P99 : 11.729423 P100 : 19603.000000 COUNT : 6931944 SUM : 46747536 rocksdb.read.block.get.micros P50 : 628.333333 P95 : 4289.375000 P99 : 6403.100000 P100 : 9909.000000 COUNT : 1058 SUM : 1209961 rocksdb.write.raw.block.micros P50 : 0.513376 P95 : 0.975415 P99 : 2.780557 P100 : 23051.000000 COUNT : 9303633 SUM : 19938182 rocksdb.numfiles.in.singlecompaction P50 : 3.207143 P95 : 4.500000 P99 : 20.250000 P100 : 26.000000 COUNT : 125 SUM : 465 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567166 P95 : 1168.240070 P99 : 2403.531713 P100 : 866541.000000 COUNT : 180986 SUM : 32838197 rocksdb.sst.read.micros P50 : 1.653190 P95 : 4.673702 P99 : 8.847001 P100 : 19584.000000 COUNT : 6934589 SUM : 33013170 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9736999 SUM : 10048582968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214166.666667 P95 : 446500.000000 P99 : 996050.000000 P100 : 996050.000000 COUNT : 132 SUM : 30265500 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 307 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0