[2024-11-27 16:16:41.238512] Starting SPDK v25.01-pre git sha1 35cd3e84d / DPDK 23.11.0 initialization... [2024-11-27 16:16:41.238791] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3371132 ] Set seed to 1732720601231731 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-27 16:16:41.359123] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-27 16:16:41.382994] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-27 16:16:41.383037] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3371132' to capture a snapshot of events at runtime. [2024-11-27 16:16:41.383047] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-27 16:16:41.383074] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-27 16:16:41.383082] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3371132 for offline analysis/debug. [2024-11-27 16:16:41.383628] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 27 16:16:45 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/27-16:16:48 ... thread 0: (1000000,1000000) ops and (355669.1,355669.1) ops/second in (2.811602,2.811602) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.04 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 351.2 2.33 2.11 12 0.194 0 0 0.0 0.0 L2 3/2 251.80 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 253.5 253.4 1.49 1.44 2 0.746 383K 166 0.0 0.0 L3 9/0 741.27 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 98.9 313.0 3.82 3.55 14 0.273 383K 166 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 98.9 313.0 3.82 3.55 14 0.273 383K 166 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 253.5 253.4 1.49 1.44 2 0.746 383K 166 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 351.2 2.33 2.11 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 399.58 MB/s write, 0.37 GB read, 126.19 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 425.45 MB/s write, 0.37 GB read, 134.36 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 102967 Average: 1.8614 StdDev: 17.96 Min: 1 Median: 1.1905 Max: 3271 Percentiles: P50: 1.19 P75: 1.64 P99: 3.78 P99.9: 9.42 P99.99: 323.81 ------------------------------------------------------ [ 0, 1 ] 40570 39.401% 39.401% ######## ( 1, 2 ] 57295 55.644% 95.045% ########### ( 2, 3 ] 3270 3.176% 98.221% # ( 3, 4 ] 1024 0.994% 99.215% ( 4, 6 ] 558 0.542% 99.757% ( 6, 10 ] 173 0.168% 99.925% ( 10, 15 ] 43 0.042% 99.967% ( 15, 22 ] 11 0.011% 99.978% ( 110, 170 ] 8 0.008% 99.985% ( 170, 250 ] 4 0.004% 99.989% ( 250, 380 ] 3 0.003% 99.992% ( 380, 580 ] 2 0.002% 99.994% ( 580, 870 ] 1 0.001% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 1 read latency histogram (micros): Count: 5 Average: 2102.2000 StdDev: 1477.94 Min: 522 Median: 2150.0000 Max: 4485 Percentiles: P50: 2150.00 P75: 2775.00 P99: 4485.00 P99.9: 4485.00 P99.99: 4485.00 ------------------------------------------------------ ( 380, 580 ] 2 40.000% 40.000% ######## ( 1900, 2900 ] 2 40.000% 80.000% ######## ( 4400, 6600 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 49775 Average: 1.8762 StdDev: 10.03 Min: 1 Median: 1.2480 Max: 1456 Percentiles: P50: 1.25 P75: 1.68 P99: 5.04 P99.9: 10.91 P99.99: 382.25 ------------------------------------------------------ [ 0, 1 ] 17811 35.783% 35.783% ####### ( 1, 2 ] 28538 57.334% 93.117% ########### ( 2, 3 ] 1902 3.821% 96.938% # ( 3, 4 ] 778 1.563% 98.501% ( 4, 6 ] 478 0.960% 99.462% ( 6, 10 ] 210 0.422% 99.883% ( 10, 15 ] 45 0.090% 99.974% ( 15, 22 ] 5 0.010% 99.984% ( 22, 34 ] 1 0.002% 99.986% ( 51, 76 ] 1 0.002% 99.988% ( 250, 380 ] 1 0.002% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 2 0.004% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 40 Average: 1885.5000 StdDev: 1490.20 Min: 433 Median: 977.5000 Max: 5890 Percentiles: P50: 977.50 P75: 2900.00 P99: 5890.00 P99.9: 5890.00 P99.99: 5890.00 ------------------------------------------------------ ( 380, 580 ] 2 5.000% 5.000% # ( 580, 870 ] 17 42.500% 47.500% ######### ( 870, 1300 ] 4 10.000% 57.500% ## ( 1900, 2900 ] 7 17.500% 75.000% #### ( 2900, 4400 ] 6 15.000% 90.000% ### ( 4400, 6600 ] 4 10.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 35 Average: 1811.0286 StdDev: 1476.09 Min: 179 Median: 1031.2500 Max: 5674 Percentiles: P50: 1031.25 P75: 2775.00 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 4 11.429% 14.286% ## ( 580, 870 ] 11 31.429% 45.714% ###### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 6 17.143% 77.143% ### ( 2900, 4400 ] 5 14.286% 91.429% ### ( 4400, 6600 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 328.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.196 H:M:S, 6.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 349.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.196 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-16:16:51 ... thread 0: (1000000,2000000) ops and (323125.2,338617.0) ops/second in (3.094776,5.906378) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 1.17 GB 25.2 0.2 0.0 0.2 2.0 1.8 0.0 1.1 41.2 339.7 6.12 5.55 27 0.227 255K 262 0.0 0.0 L1 1/1 2.90 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.4 239.9 1.57 1.53 1 1.573 383K 600 0.0 0.0 L2 2/0 53.97 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 253.5 253.4 1.49 1.44 2 0.746 383K 166 0.0 0.0 L3 42/0 999.49 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 202.4 202.1 3.94 3.49 3 1.313 809K 836 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/12 97.92 GB 0.0 1.8 1.1 0.7 3.5 2.9 1.6 2.0 137.6 276.6 13.12 12.00 33 0.398 1832K 1864 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 1.1 0.7 3.5 2.9 1.6 2.0 137.6 276.6 13.12 12.00 33 0.398 1832K 1864 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 1.1 0.7 1.8 1.1 0.0 0.0 227.0 226.7 7.95 7.39 7 1.136 1832K 1864 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.4 5.17 4.62 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.54 GB write, 596.08 MB/s write, 1.76 GB read, 296.39 MB/s read, 13.1 seconds Interval compaction: 3.54 GB write, 614.45 MB/s write, 1.76 GB read, 305.53 MB/s read, 13.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 378922 Average: 2.1715 StdDev: 13.40 Min: 1 Median: 1.4707 Max: 4224 Percentiles: P50: 1.47 P75: 1.86 P99: 5.56 P99.9: 9.99 P99.99: 14.80 ------------------------------------------------------ [ 0, 1 ] 75299 19.872% 19.872% #### ( 1, 2 ] 242553 64.011% 83.883% ############# ( 2, 3 ] 37540 9.907% 93.790% ## ( 3, 4 ] 13138 3.467% 97.257% # ( 4, 6 ] 8473 2.236% 99.494% ( 6, 10 ] 1545 0.408% 99.901% ( 10, 15 ] 351 0.093% 99.994% ( 15, 22 ] 34 0.009% 100.003% ( 22, 34 ] 6 0.002% 100.004% ( 34, 51 ] 1 0.000% 100.005% ( 76, 110 ] 1 0.000% 100.005% ( 110, 170 ] 15 0.004% 100.009% ( 170, 250 ] 11 0.003% 100.012% ( 250, 380 ] 6 0.002% 100.013% ( 380, 580 ] 7 0.002% 100.015% ( 580, 870 ] 6 0.002% 100.017% ( 870, 1300 ] 2 0.001% 100.017% ( 1300, 1900 ] 2 0.001% 100.018% ( 1900, 2900 ] 2 0.001% 100.018% ( 2900, 4400 ] 3 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 81849 Average: 2.4962 StdDev: 21.45 Min: 0 Median: 1.6071 Max: 4485 Percentiles: P50: 1.61 P75: 1.99 P99: 5.89 P99.9: 12.67 P99.99: 21.20 ------------------------------------------------------ [ 0, 1 ] 8251 10.081% 10.081% ## ( 1, 2 ] 53822 65.758% 75.838% ############# ( 2, 3 ] 12553 15.337% 91.175% ### ( 3, 4 ] 3803 4.646% 95.822% # ( 4, 6 ] 2746 3.355% 99.177% # ( 6, 10 ] 527 0.644% 99.820% ( 10, 15 ] 122 0.149% 99.969% ( 15, 22 ] 19 0.023% 99.993% ( 22, 34 ] 2 0.002% 99.995% ( 34, 51 ] 2 0.002% 99.998% ( 51, 76 ] 1 0.001% 99.999% ( 76, 110 ] 1 0.001% 100.000% ( 110, 170 ] 1 0.001% 100.001% ( 170, 250 ] 1 0.001% 100.002% ( 250, 380 ] 2 0.002% 100.005% ( 380, 580 ] 4 0.005% 100.010% ( 870, 1300 ] 1 0.001% 100.011% ( 1300, 1900 ] 1 0.001% 100.012% ( 1900, 2900 ] 2 0.002% 100.015% ( 4400, 6600 ] 1 0.001% 100.016% ** Level 2 read latency histogram (micros): Count: 95453 Average: 2.0781 StdDev: 7.28 Min: 1 Median: 1.4302 Max: 1456 Percentiles: P50: 1.43 P75: 1.83 P99: 5.65 P99.9: 10.52 P99.99: 21.24 ------------------------------------------------------ [ 0, 1 ] 22006 23.054% 23.054% ##### ( 1, 2 ] 59787 62.635% 85.689% ############# ( 2, 3 ] 7943 8.321% 94.011% ## ( 3, 4 ] 3058 3.204% 97.214% # ( 4, 6 ] 2067 2.165% 99.380% ( 6, 10 ] 487 0.510% 99.890% ( 10, 15 ] 91 0.095% 99.985% ( 15, 22 ] 5 0.005% 99.991% ( 22, 34 ] 1 0.001% 99.992% ( 34, 51 ] 1 0.001% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 2 0.002% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57399 Average: 3.7585 StdDev: 63.87 Min: 0 Median: 1.6123 Max: 5890 Percentiles: P50: 1.61 P75: 2.01 P99: 6.67 P99.9: 31.74 P99.99: 2222.87 ------------------------------------------------------ [ 0, 1 ] 6215 10.828% 10.828% ## ( 1, 2 ] 36719 63.971% 74.799% ############# ( 2, 3 ] 9122 15.892% 90.691% ### ( 3, 4 ] 2632 4.585% 95.277% # ( 4, 6 ] 2064 3.596% 98.873% # ( 6, 10 ] 434 0.756% 99.629% ( 10, 15 ] 115 0.200% 99.829% ( 15, 22 ] 13 0.023% 99.852% ( 22, 34 ] 34 0.059% 99.911% ( 34, 51 ] 3 0.005% 99.916% ( 76, 110 ] 1 0.002% 99.918% ( 110, 170 ] 3 0.005% 99.923% ( 170, 250 ] 4 0.007% 99.930% ( 250, 380 ] 4 0.007% 99.937% ( 380, 580 ] 5 0.009% 99.946% ( 580, 870 ] 17 0.030% 99.976% ( 870, 1300 ] 6 0.010% 99.986% ( 1900, 2900 ] 7 0.012% 99.998% ( 2900, 4400 ] 6 0.010% 100.009% ( 4400, 6600 ] 4 0.007% 100.016% ** Level 4 read latency histogram (micros): Count: 35 Average: 1811.0286 StdDev: 1476.09 Min: 179 Median: 1031.2500 Max: 5674 Percentiles: P50: 1031.25 P75: 2775.00 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 4 11.429% 14.286% ## ( 580, 870 ] 11 31.429% 45.714% ###### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 6 17.143% 77.143% ### ( 2900, 4400 ] 5 14.286% 91.429% ### ( 4400, 6600 ] 3 8.571% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 960.1000 StdDev: 1336.80 Min: 85 Median: 380.0000 Max: 4795 Percentiles: P50: 380.00 P75: 870.00 P99: 4795.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 1 5.000% 35.000% # ( 170, 250 ] 1 5.000% 40.000% # ( 250, 380 ] 2 10.000% 50.000% ## ( 380, 580 ] 3 15.000% 65.000% ### ( 580, 870 ] 2 10.000% 75.000% ## ( 870, 1300 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 2 10.000% 95.000% ## ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.584 H:M:S, 9.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.388 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-16:16:54 ... thread 0: (1000000,3000000) ops and (321032.6,332545.3) ops/second in (3.114948,9.021326) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.48 GB 119.6 1.3 0.0 1.3 4.1 2.8 0.0 1.5 101.0 317.3 13.10 12.13 45 0.291 1343K 1325 0.0 0.0 L1 3/0 209.97 MB 21.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 233.8 233.2 4.59 4.47 2 2.296 1090K 2552 0.0 0.0 L2 1/0 1.86 MB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 253.5 253.4 1.49 1.44 2 0.746 383K 166 0.0 0.0 L3 20/0 957.34 MB 1.0 1.2 0.9 0.4 1.2 0.8 0.3 1.4 208.2 207.9 6.05 5.46 6 1.008 1258K 1674 0.0 0.0 L4 158/0 9.42 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/4 98.90 GB 0.0 3.9 2.1 1.9 6.7 4.8 3.5 2.4 159.9 272.0 25.23 23.49 55 0.459 4076K 5717 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 2.1 1.9 6.7 4.8 3.5 2.4 159.9 272.0 25.23 23.49 55 0.459 4076K 5717 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 2.1 1.9 3.9 2.1 0.0 0.0 234.8 234.4 17.18 16.30 15 1.145 4076K 5717 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.3 8.05 7.19 40 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.70 GB write, 745.46 MB/s write, 3.94 GB read, 438.15 MB/s read, 25.2 seconds Interval compaction: 6.70 GB write, 760.51 MB/s write, 3.94 GB read, 447.00 MB/s read, 25.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 678485 Average: 2.1604 StdDev: 12.20 Min: 1 Median: 1.4736 Max: 4474 Percentiles: P50: 1.47 P75: 1.86 P99: 5.53 P99.9: 9.95 P99.99: 14.74 ------------------------------------------------------ [ 0, 1 ] 131457 19.375% 19.375% #### ( 1, 2 ] 438731 64.663% 84.038% ############# ( 2, 3 ] 67045 9.882% 93.920% ## ( 3, 4 ] 23255 3.427% 97.347% # ( 4, 6 ] 14674 2.163% 99.510% ( 6, 10 ] 2680 0.395% 99.905% ( 10, 15 ] 609 0.090% 99.995% ( 15, 22 ] 62 0.009% 100.004% ( 22, 34 ] 9 0.001% 100.005% ( 34, 51 ] 3 0.000% 100.006% ( 51, 76 ] 1 0.000% 100.006% ( 76, 110 ] 1 0.000% 100.006% ( 110, 170 ] 21 0.003% 100.009% ( 170, 250 ] 19 0.003% 100.012% ( 250, 380 ] 14 0.002% 100.014% ( 380, 580 ] 10 0.001% 100.016% ( 580, 870 ] 10 0.001% 100.017% ( 870, 1300 ] 7 0.001% 100.018% ( 1300, 1900 ] 3 0.000% 100.019% ( 1900, 2900 ] 2 0.000% 100.019% ( 2900, 4400 ] 3 0.000% 100.019% ( 4400, 6600 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 158636 Average: 2.5695 StdDev: 17.05 Min: 0 Median: 1.6612 Max: 4485 Percentiles: P50: 1.66 P75: 2.19 P99: 5.98 P99.9: 12.76 P99.99: 17.43 ------------------------------------------------------ [ 0, 1 ] 11729 7.394% 7.394% # ( 1, 2 ] 102217 64.435% 71.829% ############# ( 2, 3 ] 27162 17.122% 88.951% ### ( 3, 4 ] 9042 5.700% 94.651% # ( 4, 6 ] 6972 4.395% 99.046% # ( 6, 10 ] 1195 0.753% 99.799% ( 10, 15 ] 291 0.183% 99.982% ( 15, 22 ] 35 0.022% 100.004% ( 22, 34 ] 7 0.004% 100.009% ( 34, 51 ] 2 0.001% 100.010% ( 51, 76 ] 2 0.001% 100.011% ( 76, 110 ] 1 0.001% 100.012% ( 110, 170 ] 1 0.001% 100.013% ( 170, 250 ] 1 0.001% 100.013% ( 250, 380 ] 5 0.003% 100.016% ( 380, 580 ] 9 0.006% 100.022% ( 580, 870 ] 3 0.002% 100.024% ( 870, 1300 ] 2 0.001% 100.025% ( 1300, 1900 ] 1 0.001% 100.026% ( 1900, 2900 ] 3 0.002% 100.028% ( 4400, 6600 ] 1 0.001% 100.028% ** Level 2 read latency histogram (micros): Count: 95453 Average: 2.0781 StdDev: 7.28 Min: 1 Median: 1.4302 Max: 1456 Percentiles: P50: 1.43 P75: 1.83 P99: 5.65 P99.9: 10.52 P99.99: 21.24 ------------------------------------------------------ [ 0, 1 ] 22006 23.054% 23.054% ##### ( 1, 2 ] 59787 62.635% 85.689% ############# ( 2, 3 ] 7943 8.321% 94.011% ## ( 3, 4 ] 3058 3.204% 97.214% # ( 4, 6 ] 2067 2.165% 99.380% ( 6, 10 ] 487 0.510% 99.890% ( 10, 15 ] 91 0.095% 99.985% ( 15, 22 ] 5 0.005% 99.991% ( 22, 34 ] 1 0.001% 99.992% ( 34, 51 ] 1 0.001% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 2 0.002% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 98559 Average: 3.1869 StdDev: 48.83 Min: 0 Median: 1.6086 Max: 5890 Percentiles: P50: 1.61 P75: 1.99 P99: 6.00 P99.9: 22.15 P99.99: 770.11 ------------------------------------------------------ [ 0, 1 ] 10212 10.361% 10.361% ## ( 1, 2 ] 64194 65.133% 75.494% ############# ( 2, 3 ] 14732 14.947% 90.441% ### ( 3, 4 ] 5211 5.287% 95.728% # ( 4, 6 ] 3224 3.271% 99.000% # ( 6, 10 ] 675 0.685% 99.684% ( 10, 15 ] 188 0.191% 99.875% ( 15, 22 ] 24 0.024% 99.900% ( 22, 34 ] 36 0.037% 99.936% ( 34, 51 ] 3 0.003% 99.939% ( 51, 76 ] 12 0.012% 99.951% ( 76, 110 ] 1 0.001% 99.952% ( 110, 170 ] 4 0.004% 99.956% ( 170, 250 ] 8 0.008% 99.964% ( 250, 380 ] 8 0.008% 99.973% ( 380, 580 ] 6 0.006% 99.979% ( 580, 870 ] 17 0.017% 99.996% ( 870, 1300 ] 6 0.006% 100.002% ( 1900, 2900 ] 7 0.007% 100.009% ( 2900, 4400 ] 6 0.006% 100.015% ( 4400, 6600 ] 4 0.004% 100.019% ** Level 4 read latency histogram (micros): Count: 35 Average: 1811.0286 StdDev: 1476.09 Min: 179 Median: 1031.2500 Max: 5674 Percentiles: P50: 1031.25 P75: 2775.00 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 4 11.429% 14.286% ## ( 580, 870 ] 11 31.429% 45.714% ###### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 6 17.143% 77.143% ### ( 2900, 4400 ] 5 14.286% 91.429% ### ( 4400, 6600 ] 3 8.571% 100.000% ## ** Level 5 read latency histogram (micros): Count: 60 Average: 903.1333 StdDev: 1263.23 Min: 77 Median: 250.0000 Max: 4795 Percentiles: P50: 250.00 P75: 1156.67 P99: 4795.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 16 26.667% 26.667% ##### ( 110, 170 ] 8 13.333% 40.000% ### ( 170, 250 ] 6 10.000% 50.000% ## ( 250, 380 ] 5 8.333% 58.333% ## ( 380, 580 ] 6 10.000% 68.333% ## ( 580, 870 ] 2 3.333% 71.667% # ( 870, 1300 ] 3 5.000% 76.667% # ( 1300, 1900 ] 4 6.667% 83.333% # ( 1900, 2900 ] 2 3.333% 86.667% # ( 2900, 4400 ] 7 11.667% 98.333% ## ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 320.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.989 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-16:16:57 ... thread 0: (1000000,4000000) ops and (329997.7,331904.8) ops/second in (3.030324,12.051650) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.46 GB 226.6 2.2 0.0 2.2 5.9 3.8 0.0 1.6 114.2 313.0 19.32 17.98 62 0.312 2238K 2238 0.0 0.0 L1 3/0 209.97 MB 21.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 233.8 233.2 4.59 4.47 2 2.296 1090K 2552 0.0 0.0 L2 1/0 1.86 MB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 253.5 253.4 1.49 1.44 2 0.746 383K 166 0.0 0.0 L3 20/0 957.34 MB 1.0 1.2 0.9 0.4 1.2 0.8 0.3 1.4 208.2 207.9 6.05 5.46 6 1.008 1258K 1674 0.0 0.0 L4 158/0 9.42 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/4 99.88 GB 0.0 4.8 2.1 2.7 8.5 5.8 3.5 2.3 156.3 278.3 31.44 29.34 72 0.437 4971K 6630 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 2.1 2.7 8.5 5.8 3.5 2.3 156.3 278.3 31.44 29.34 72 0.437 4971K 6630 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 2.1 2.7 4.8 2.1 0.0 0.0 239.2 238.8 20.55 19.61 18 1.142 4971K 6630 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 352.8 10.89 9.73 54 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.55 GB write, 715.22 MB/s write, 4.80 GB read, 401.72 MB/s read, 31.4 seconds Interval compaction: 8.55 GB write, 726.02 MB/s write, 4.80 GB read, 407.79 MB/s read, 31.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 938201 Average: 2.0909 StdDev: 11.25 Min: 1 Median: 1.4332 Max: 4474 Percentiles: P50: 1.43 P75: 1.83 P99: 5.38 P99.9: 9.89 P99.99: 14.80 ------------------------------------------------------ [ 0, 1 ] 210016 22.385% 22.385% #### ( 1, 2 ] 598045 63.744% 86.129% ############# ( 2, 3 ] 80965 8.630% 94.759% ## ( 3, 4 ] 28151 3.001% 97.759% # ( 4, 6 ] 16857 1.797% 99.556% ( 6, 10 ] 3325 0.354% 99.910% ( 10, 15 ] 781 0.083% 99.993% ( 15, 22 ] 80 0.009% 100.002% ( 22, 34 ] 10 0.001% 100.003% ( 34, 51 ] 4 0.000% 100.004% ( 51, 76 ] 3 0.000% 100.004% ( 76, 110 ] 1 0.000% 100.004% ( 110, 170 ] 28 0.003% 100.007% ( 170, 250 ] 25 0.003% 100.010% ( 250, 380 ] 21 0.002% 100.012% ( 380, 580 ] 11 0.001% 100.013% ( 580, 870 ] 15 0.002% 100.015% ( 870, 1300 ] 12 0.001% 100.016% ( 1300, 1900 ] 5 0.001% 100.016% ( 1900, 2900 ] 3 0.000% 100.017% ( 2900, 4400 ] 3 0.000% 100.017% ( 4400, 6600 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 158636 Average: 2.5695 StdDev: 17.05 Min: 0 Median: 1.6612 Max: 4485 Percentiles: P50: 1.66 P75: 2.19 P99: 5.98 P99.9: 12.76 P99.99: 17.43 ------------------------------------------------------ [ 0, 1 ] 11729 7.394% 7.394% # ( 1, 2 ] 102217 64.435% 71.829% ############# ( 2, 3 ] 27162 17.122% 88.951% ### ( 3, 4 ] 9042 5.700% 94.651% # ( 4, 6 ] 6972 4.395% 99.046% # ( 6, 10 ] 1195 0.753% 99.799% ( 10, 15 ] 291 0.183% 99.982% ( 15, 22 ] 35 0.022% 100.004% ( 22, 34 ] 7 0.004% 100.009% ( 34, 51 ] 2 0.001% 100.010% ( 51, 76 ] 2 0.001% 100.011% ( 76, 110 ] 1 0.001% 100.012% ( 110, 170 ] 1 0.001% 100.013% ( 170, 250 ] 1 0.001% 100.013% ( 250, 380 ] 5 0.003% 100.016% ( 380, 580 ] 9 0.006% 100.022% ( 580, 870 ] 3 0.002% 100.024% ( 870, 1300 ] 2 0.001% 100.025% ( 1300, 1900 ] 1 0.001% 100.026% ( 1900, 2900 ] 3 0.002% 100.028% ( 4400, 6600 ] 1 0.001% 100.028% ** Level 2 read latency histogram (micros): Count: 95453 Average: 2.0781 StdDev: 7.28 Min: 1 Median: 1.4302 Max: 1456 Percentiles: P50: 1.43 P75: 1.83 P99: 5.65 P99.9: 10.52 P99.99: 21.24 ------------------------------------------------------ [ 0, 1 ] 22006 23.054% 23.054% ##### ( 1, 2 ] 59787 62.635% 85.689% ############# ( 2, 3 ] 7943 8.321% 94.011% ## ( 3, 4 ] 3058 3.204% 97.214% # ( 4, 6 ] 2067 2.165% 99.380% ( 6, 10 ] 487 0.510% 99.890% ( 10, 15 ] 91 0.095% 99.985% ( 15, 22 ] 5 0.005% 99.991% ( 22, 34 ] 1 0.001% 99.992% ( 34, 51 ] 1 0.001% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 2 0.002% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 98559 Average: 3.1869 StdDev: 48.83 Min: 0 Median: 1.6086 Max: 5890 Percentiles: P50: 1.61 P75: 1.99 P99: 6.00 P99.9: 22.15 P99.99: 770.11 ------------------------------------------------------ [ 0, 1 ] 10212 10.361% 10.361% ## ( 1, 2 ] 64194 65.133% 75.494% ############# ( 2, 3 ] 14732 14.947% 90.441% ### ( 3, 4 ] 5211 5.287% 95.728% # ( 4, 6 ] 3224 3.271% 99.000% # ( 6, 10 ] 675 0.685% 99.684% ( 10, 15 ] 188 0.191% 99.875% ( 15, 22 ] 24 0.024% 99.900% ( 22, 34 ] 36 0.037% 99.936% ( 34, 51 ] 3 0.003% 99.939% ( 51, 76 ] 12 0.012% 99.951% ( 76, 110 ] 1 0.001% 99.952% ( 110, 170 ] 4 0.004% 99.956% ( 170, 250 ] 8 0.008% 99.964% ( 250, 380 ] 8 0.008% 99.973% ( 380, 580 ] 6 0.006% 99.979% ( 580, 870 ] 17 0.017% 99.996% ( 870, 1300 ] 6 0.006% 100.002% ( 1900, 2900 ] 7 0.007% 100.009% ( 2900, 4400 ] 6 0.006% 100.015% ( 4400, 6600 ] 4 0.004% 100.019% ** Level 4 read latency histogram (micros): Count: 35 Average: 1811.0286 StdDev: 1476.09 Min: 179 Median: 1031.2500 Max: 5674 Percentiles: P50: 1031.25 P75: 2775.00 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 4 11.429% 14.286% ## ( 580, 870 ] 11 31.429% 45.714% ###### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 6 17.143% 77.143% ### ( 2900, 4400 ] 5 14.286% 91.429% ### ( 4400, 6600 ] 3 8.571% 100.000% ## ** Level 5 read latency histogram (micros): Count: 60 Average: 903.1333 StdDev: 1263.23 Min: 77 Median: 250.0000 Max: 4795 Percentiles: P50: 250.00 P75: 1156.67 P99: 4795.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 16 26.667% 26.667% ##### ( 110, 170 ] 8 13.333% 40.000% ### ( 170, 250 ] 6 10.000% 50.000% ## ( 250, 380 ] 5 8.333% 58.333% ## ( 380, 580 ] 6 10.000% 68.333% ## ( 580, 870 ] 2 3.333% 71.667% # ( 870, 1300 ] 3 5.000% 76.667% # ( 1300, 1900 ] 4 6.667% 83.333% # ( 1900, 2900 ] 2 3.333% 86.667% # ( 2900, 4400 ] 7 11.667% 98.333% ## ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.386 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.397 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-16:17:01 ... thread 0: (1000000,5000000) ops and (273302.4,318256.4) ops/second in (3.658951,15.710601) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.38 GB 56.6 3.0 0.0 3.0 7.6 4.7 0.0 1.6 121.3 313.2 24.93 23.28 79 0.316 3070K 3110 0.0 0.0 L1 3/3 209.97 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 233.8 233.2 4.59 4.47 2 2.296 1090K 2552 0.0 0.0 L2 1/0 1.86 MB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 253.5 253.4 1.49 1.44 2 0.746 383K 166 0.0 0.0 L3 20/0 957.34 MB 1.0 1.2 0.9 0.4 1.2 0.8 0.3 1.4 208.2 207.9 6.05 5.46 6 1.008 1258K 1674 0.0 0.0 L4 158/0 9.42 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/20 100.80 GB 0.0 5.6 2.1 3.5 10.3 6.7 3.5 2.2 154.7 283.7 37.06 34.64 89 0.416 5803K 7502 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 2.1 3.5 10.3 6.7 3.5 2.2 154.7 283.7 37.06 34.64 89 0.416 5803K 7502 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 2.1 3.5 5.6 2.1 0.0 0.0 243.4 243.1 23.55 22.56 21 1.122 5803K 7502 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.5 13.50 12.08 68 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.9 total, 15.7 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.27 GB write, 661.49 MB/s write, 5.60 GB read, 360.77 MB/s read, 37.1 seconds Interval compaction: 10.27 GB write, 669.16 MB/s write, 5.60 GB read, 364.95 MB/s read, 37.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 17, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1305695 Average: 2.1064 StdDev: 11.89 Min: 0 Median: 1.4366 Max: 4474 Percentiles: P50: 1.44 P75: 1.82 P99: 5.37 P99.9: 10.06 P99.99: 18.79 ------------------------------------------------------ [ 0, 1 ] 285092 21.835% 21.835% #### ( 1, 2 ] 842243 64.505% 86.340% ############# ( 2, 3 ] 113083 8.661% 95.001% ## ( 3, 4 ] 37526 2.874% 97.875% # ( 4, 6 ] 21399 1.639% 99.514% ( 6, 10 ] 5033 0.385% 99.899% ( 10, 15 ] 1125 0.086% 99.985% ( 15, 22 ] 119 0.009% 99.994% ( 22, 34 ] 16 0.001% 99.995% ( 34, 51 ] 8 0.001% 99.996% ( 51, 76 ] 7 0.001% 99.997% ( 76, 110 ] 28 0.002% 99.999% ( 110, 170 ] 67 0.005% 100.004% ( 170, 250 ] 47 0.004% 100.008% ( 250, 380 ] 33 0.003% 100.010% ( 380, 580 ] 24 0.002% 100.012% ( 580, 870 ] 22 0.002% 100.014% ( 870, 1300 ] 14 0.001% 100.015% ( 1300, 1900 ] 7 0.001% 100.015% ( 1900, 2900 ] 7 0.001% 100.016% ( 2900, 4400 ] 5 0.000% 100.016% ( 4400, 6600 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 158637 Average: 2.5695 StdDev: 17.05 Min: 0 Median: 1.6612 Max: 4485 Percentiles: P50: 1.66 P75: 2.19 P99: 5.98 P99.9: 12.76 P99.99: 17.43 ------------------------------------------------------ [ 0, 1 ] 11729 7.394% 7.394% # ( 1, 2 ] 102217 64.435% 71.828% ############# ( 2, 3 ] 27162 17.122% 88.950% ### ( 3, 4 ] 9043 5.700% 94.651% # ( 4, 6 ] 6972 4.395% 99.046% # ( 6, 10 ] 1195 0.753% 99.799% ( 10, 15 ] 291 0.183% 99.982% ( 15, 22 ] 35 0.022% 100.004% ( 22, 34 ] 7 0.004% 100.009% ( 34, 51 ] 2 0.001% 100.010% ( 51, 76 ] 2 0.001% 100.011% ( 76, 110 ] 1 0.001% 100.012% ( 110, 170 ] 1 0.001% 100.013% ( 170, 250 ] 1 0.001% 100.013% ( 250, 380 ] 5 0.003% 100.016% ( 380, 580 ] 9 0.006% 100.022% ( 580, 870 ] 3 0.002% 100.024% ( 870, 1300 ] 2 0.001% 100.025% ( 1300, 1900 ] 1 0.001% 100.026% ( 1900, 2900 ] 3 0.002% 100.028% ( 4400, 6600 ] 1 0.001% 100.028% ** Level 2 read latency histogram (micros): Count: 95453 Average: 2.0781 StdDev: 7.28 Min: 1 Median: 1.4302 Max: 1456 Percentiles: P50: 1.43 P75: 1.83 P99: 5.65 P99.9: 10.52 P99.99: 21.24 ------------------------------------------------------ [ 0, 1 ] 22006 23.054% 23.054% ##### ( 1, 2 ] 59787 62.635% 85.689% ############# ( 2, 3 ] 7943 8.321% 94.011% ## ( 3, 4 ] 3058 3.204% 97.214% # ( 4, 6 ] 2067 2.165% 99.380% ( 6, 10 ] 487 0.510% 99.890% ( 10, 15 ] 91 0.095% 99.985% ( 15, 22 ] 5 0.005% 99.991% ( 22, 34 ] 1 0.001% 99.992% ( 34, 51 ] 1 0.001% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 2 0.002% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 98559 Average: 3.1869 StdDev: 48.83 Min: 0 Median: 1.6086 Max: 5890 Percentiles: P50: 1.61 P75: 1.99 P99: 6.00 P99.9: 22.15 P99.99: 770.11 ------------------------------------------------------ [ 0, 1 ] 10212 10.361% 10.361% ## ( 1, 2 ] 64194 65.133% 75.494% ############# ( 2, 3 ] 14732 14.947% 90.441% ### ( 3, 4 ] 5211 5.287% 95.728% # ( 4, 6 ] 3224 3.271% 99.000% # ( 6, 10 ] 675 0.685% 99.684% ( 10, 15 ] 188 0.191% 99.875% ( 15, 22 ] 24 0.024% 99.900% ( 22, 34 ] 36 0.037% 99.936% ( 34, 51 ] 3 0.003% 99.939% ( 51, 76 ] 12 0.012% 99.951% ( 76, 110 ] 1 0.001% 99.952% ( 110, 170 ] 4 0.004% 99.956% ( 170, 250 ] 8 0.008% 99.964% ( 250, 380 ] 8 0.008% 99.973% ( 380, 580 ] 6 0.006% 99.979% ( 580, 870 ] 17 0.017% 99.996% ( 870, 1300 ] 6 0.006% 100.002% ( 1900, 2900 ] 7 0.007% 100.009% ( 2900, 4400 ] 6 0.006% 100.015% ( 4400, 6600 ] 4 0.004% 100.019% ** Level 4 read latency histogram (micros): Count: 35 Average: 1811.0286 StdDev: 1476.09 Min: 179 Median: 1031.2500 Max: 5674 Percentiles: P50: 1031.25 P75: 2775.00 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 4 11.429% 14.286% ## ( 580, 870 ] 11 31.429% 45.714% ###### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 6 17.143% 77.143% ### ( 2900, 4400 ] 5 14.286% 91.429% ### ( 4400, 6600 ] 3 8.571% 100.000% ## ** Level 5 read latency histogram (micros): Count: 60 Average: 903.1333 StdDev: 1263.23 Min: 77 Median: 250.0000 Max: 4795 Percentiles: P50: 250.00 P75: 1156.67 P99: 4795.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 16 26.667% 26.667% ##### ( 110, 170 ] 8 13.333% 40.000% ### ( 170, 250 ] 6 10.000% 50.000% ## ( 250, 380 ] 5 8.333% 58.333% ## ( 380, 580 ] 6 10.000% 68.333% ## ( 580, 870 ] 2 3.333% 71.667% # ( 870, 1300 ] 3 5.000% 76.667% # ( 1300, 1900 ] 4 6.667% 83.333% # ( 1900, 2900 ] 2 3.333% 86.667% # ( 2900, 4400 ] 7 11.667% 98.333% ## ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 15.9 total, 3.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 309.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.335 H:M:S, 14.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 268.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.949 H:M:S, 25.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-16:17:11 ... thread 0: (1000000,6000000) ops and (95458.7,229127.1) ops/second in (10.475735,26.186336) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/5 1.71 GB 0.0 5.2 0.0 5.2 10.8 5.6 0.0 1.9 146.7 303.5 36.49 34.15 99 0.369 5435K 11K 0.0 0.0 L1 11/11 1.24 GB 0.0 3.8 3.6 0.2 3.8 3.6 0.2 1.0 219.2 217.0 17.91 16.83 3 5.971 3987K 40K 0.0 0.0 L2 12/8 1.39 GB 5.2 0.4 0.2 0.2 0.4 0.2 2.5 2.0 253.5 253.4 1.49 1.44 2 0.746 383K 166 0.0 0.0 L3 21/9 1.06 GB 0.3 1.2 0.9 0.4 1.2 0.8 0.5 1.4 208.2 207.9 6.05 5.46 6 1.008 1258K 1674 0.0 0.0 L4 158/0 9.42 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/33 101.68 GB 0.0 10.7 4.7 6.0 16.2 10.2 5.1 2.9 176.3 267.9 61.94 57.88 110 0.563 11M 53K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.7 4.7 6.0 16.2 10.2 5.1 2.9 176.3 267.9 61.94 57.88 110 0.563 11M 53K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.7 4.7 6.0 10.6 4.6 0.0 0.0 238.5 237.3 45.77 43.43 27 1.695 11M 53K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 354.6 16.17 14.45 83 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.4 total, 26.2 interval Flush(GB): cumulative 5.599, interval 5.599 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.21 GB write, 629.35 MB/s write, 10.66 GB read, 414.00 MB/s read, 61.9 seconds Interval compaction: 16.21 GB write, 633.73 MB/s write, 10.66 GB read, 416.88 MB/s read, 61.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 17, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2377081 Average: 2.5212 StdDev: 16.05 Min: 0 Median: 1.4524 Max: 4675 Percentiles: P50: 1.45 P75: 1.84 P99: 5.90 P99.9: 134.85 P99.99: 304.13 ------------------------------------------------------ [ 0, 1 ] 486303 20.458% 20.458% #### ( 1, 2 ] 1552275 65.302% 85.760% ############# ( 2, 3 ] 208469 8.770% 94.530% ## ( 3, 4 ] 68656 2.888% 97.418% # ( 4, 6 ] 39688 1.670% 99.088% ( 6, 10 ] 13580 0.571% 99.659% ( 10, 15 ] 2001 0.084% 99.743% ( 15, 22 ] 226 0.010% 99.753% ( 22, 34 ] 25 0.001% 99.754% ( 34, 51 ] 11 0.000% 99.754% ( 51, 76 ] 33 0.001% 99.755% ( 76, 110 ] 2450 0.103% 99.858% ( 110, 170 ] 2385 0.100% 99.959% ( 170, 250 ] 577 0.024% 99.983% ( 250, 380 ] 397 0.017% 100.000% ( 380, 580 ] 279 0.012% 100.012% ( 580, 870 ] 115 0.005% 100.016% ( 870, 1300 ] 43 0.002% 100.018% ( 1300, 1900 ] 11 0.000% 100.019% ( 1900, 2900 ] 15 0.001% 100.019% ( 2900, 4400 ] 13 0.001% 100.020% ( 4400, 6600 ] 2 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 274567 Average: 3.4440 StdDev: 28.17 Min: 0 Median: 1.6915 Max: 5293 Percentiles: P50: 1.69 P75: 2.34 P99: 8.32 P99.9: 157.81 P99.99: 373.42 ------------------------------------------------------ [ 0, 1 ] 19849 7.229% 7.229% # ( 1, 2 ] 169821 61.850% 69.080% ############ ( 2, 3 ] 48172 17.545% 86.624% #### ( 3, 4 ] 17556 6.394% 93.018% # ( 4, 6 ] 14598 5.317% 98.335% # ( 6, 10 ] 3155 1.149% 99.484% ( 10, 15 ] 590 0.215% 99.699% ( 15, 22 ] 72 0.026% 99.725% ( 22, 34 ] 7 0.003% 99.728% ( 34, 51 ] 2 0.001% 99.729% ( 51, 76 ] 2 0.001% 99.729% ( 76, 110 ] 230 0.084% 99.813% ( 110, 170 ] 303 0.110% 99.924% ( 170, 250 ] 102 0.037% 99.961% ( 250, 380 ] 88 0.032% 99.993% ( 380, 580 ] 89 0.032% 100.025% ( 580, 870 ] 48 0.017% 100.043% ( 870, 1300 ] 23 0.008% 100.051% ( 1300, 1900 ] 15 0.005% 100.056% ( 1900, 2900 ] 7 0.003% 100.059% ( 2900, 4400 ] 1 0.000% 100.059% ( 4400, 6600 ] 2 0.001% 100.060% ** Level 2 read latency histogram (micros): Count: 95684 Average: 2.3029 StdDev: 12.66 Min: 1 Median: 1.4317 Max: 1456 Percentiles: P50: 1.43 P75: 1.83 P99: 5.71 P99.9: 14.03 P99.99: 683.79 ------------------------------------------------------ [ 0, 1 ] 22006 22.999% 22.999% ##### ( 1, 2 ] 59844 62.543% 85.542% ############# ( 2, 3 ] 8030 8.392% 93.934% ## ( 3, 4 ] 3071 3.210% 97.144% # ( 4, 6 ] 2073 2.167% 99.310% ( 6, 10 ] 491 0.513% 99.823% ( 10, 15 ] 91 0.095% 99.918% ( 15, 22 ] 5 0.005% 99.924% ( 22, 34 ] 1 0.001% 99.925% ( 34, 51 ] 1 0.001% 99.926% ( 51, 76 ] 1 0.001% 99.927% ( 76, 110 ] 2 0.002% 99.929% ( 110, 170 ] 18 0.019% 99.948% ( 170, 250 ] 7 0.007% 99.955% ( 250, 380 ] 17 0.018% 99.973% ( 380, 580 ] 15 0.016% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 870, 1300 ] 6 0.006% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 124126 Average: 4.1462 StdDev: 56.00 Min: 0 Median: 1.6755 Max: 5890 Percentiles: P50: 1.68 P75: 2.30 P99: 8.76 P99.9: 370.07 P99.99: 1146.81 ------------------------------------------------------ [ 0, 1 ] 10506 8.464% 8.464% ## ( 1, 2 ] 76322 61.488% 69.952% ############ ( 2, 3 ] 20592 16.590% 86.541% ### ( 3, 4 ] 8173 6.584% 93.126% # ( 4, 6 ] 6158 4.961% 98.087% # ( 6, 10 ] 1645 1.325% 99.412% ( 10, 15 ] 340 0.274% 99.686% ( 15, 22 ] 64 0.052% 99.737% ( 22, 34 ] 38 0.031% 99.768% ( 34, 51 ] 3 0.002% 99.770% ( 51, 76 ] 12 0.010% 99.780% ( 76, 110 ] 15 0.012% 99.792% ( 110, 170 ] 35 0.028% 99.820% ( 170, 250 ] 49 0.039% 99.860% ( 250, 380 ] 54 0.044% 99.903% ( 380, 580 ] 53 0.043% 99.946% ( 580, 870 ] 43 0.035% 99.981% ( 870, 1300 ] 18 0.015% 99.995% ( 1300, 1900 ] 5 0.004% 99.999% ( 1900, 2900 ] 12 0.010% 100.009% ( 2900, 4400 ] 11 0.009% 100.018% ( 4400, 6600 ] 4 0.003% 100.021% ** Level 4 read latency histogram (micros): Count: 35 Average: 1811.0286 StdDev: 1476.09 Min: 179 Median: 1031.2500 Max: 5674 Percentiles: P50: 1031.25 P75: 2775.00 P99: 5674.00 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 4 11.429% 14.286% ## ( 580, 870 ] 11 31.429% 45.714% ###### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 6 17.143% 77.143% ### ( 2900, 4400 ] 5 14.286% 91.429% ### ( 4400, 6600 ] 3 8.571% 100.000% ## ** Level 5 read latency histogram (micros): Count: 60 Average: 903.1333 StdDev: 1263.23 Min: 77 Median: 250.0000 Max: 4795 Percentiles: P50: 250.00 P75: 1156.67 P99: 4795.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 16 26.667% 26.667% ##### ( 110, 170 ] 8 13.333% 40.000% ### ( 170, 250 ] 6 10.000% 50.000% ## ( 250, 380 ] 5 8.333% 58.333% ## ( 380, 580 ] 6 10.000% 68.333% ## ( 580, 870 ] 2 3.333% 71.667% # ( 870, 1300 ] 3 5.000% 76.667% # ( 1300, 1900 ] 4 6.667% 83.333% # ( 1900, 2900 ] 2 3.333% 86.667% # ( 2900, 4400 ] 7 11.667% 98.333% ## ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 26.4 total, 10.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 223.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.732 H:M:S, 36.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 93.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.397 H:M:S, 70.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/11/27-16:17:16 ... thread 0: (1000000,7000000) ops and (209121.7,226038.0) ops/second in (4.781905,30.968241) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 2.76 GB 44.1 5.5 0.0 5.5 12.2 6.6 0.0 1.8 133.5 293.4 42.47 38.25 113 0.376 5755K 11K 0.0 0.0 L1 11/11 1.24 GB 0.0 3.8 3.6 0.2 3.8 3.6 0.2 1.0 219.2 217.0 17.91 16.83 3 5.971 3987K 40K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.5 2.0 253.5 253.4 1.49 1.44 2 0.746 383K 166 0.0 0.0 L3 22/0 996.77 MB 1.0 3.8 2.2 1.5 3.7 2.2 0.5 1.7 187.2 186.6 20.58 17.12 15 1.372 3893K 12K 0.0 0.0 L4 170/0 9.58 GB 1.0 1.2 1.0 0.2 1.2 1.0 1.3 1.2 147.1 146.3 8.57 5.86 21 0.408 1260K 5929 0.0 0.0 L5 1072/0 88.15 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/24 102.71 GB 0.0 14.7 7.1 7.6 21.3 13.7 6.9 3.2 165.7 239.7 91.02 79.50 154 0.591 15M 70K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.7 7.1 7.6 21.3 13.7 6.9 3.2 165.7 239.7 91.02 79.50 154 0.591 15M 70K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.7 7.1 7.6 14.7 7.0 0.0 0.0 214.8 213.8 70.23 62.23 58 1.211 15M 70K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 327.2 20.79 17.27 96 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.2 total, 31.0 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.31 GB write, 700.39 MB/s write, 14.73 GB read, 484.28 MB/s read, 91.0 seconds Interval compaction: 21.31 GB write, 704.51 MB/s write, 14.73 GB read, 487.13 MB/s read, 91.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 42, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2804734 Average: 2.7297 StdDev: 30.46 Min: 0 Median: 1.5053 Max: 14811 Percentiles: P50: 1.51 P75: 1.90 P99: 6.60 P99.9: 126.15 P99.99: 306.36 ------------------------------------------------------ [ 0, 1 ] 501092 17.866% 17.866% #### ( 1, 2 ] 1783530 63.590% 81.456% ############# ( 2, 3 ] 305120 10.879% 92.335% ## ( 3, 4 ] 104848 3.738% 96.073% # ( 4, 6 ] 78878 2.812% 98.885% # ( 6, 10 ] 21560 0.769% 99.654% ( 10, 15 ] 3346 0.119% 99.773% ( 15, 22 ] 371 0.013% 99.786% ( 22, 34 ] 32 0.001% 99.788% ( 34, 51 ] 13 0.000% 99.788% ( 51, 76 ] 37 0.001% 99.789% ( 76, 110 ] 2460 0.088% 99.877% ( 110, 170 ] 2394 0.085% 99.962% ( 170, 250 ] 592 0.021% 99.984% ( 250, 380 ] 421 0.015% 99.999% ( 380, 580 ] 305 0.011% 100.009% ( 580, 870 ] 147 0.005% 100.015% ( 870, 1300 ] 77 0.003% 100.017% ( 1300, 1900 ] 33 0.001% 100.019% ( 1900, 2900 ] 50 0.002% 100.020% ( 2900, 4400 ] 37 0.001% 100.022% ( 4400, 6600 ] 14 0.000% 100.022% ( 6600, 9900 ] 9 0.000% 100.023% ( 9900, 14000 ] 3 0.000% 100.023% ( 14000, 22000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 658528 Average: 4.7411 StdDev: 74.19 Min: 0 Median: 1.8281 Max: 12860 Percentiles: P50: 1.83 P75: 2.74 P99: 9.03 P99.9: 133.43 P99.99: 420.69 ------------------------------------------------------ [ 0, 1 ] 25724 3.906% 3.906% # ( 1, 2 ] 366549 55.662% 59.568% ########### ( 2, 3 ] 137308 20.851% 80.419% #### ( 3, 4 ] 58828 8.933% 89.352% ## ( 4, 6 ] 53751 8.162% 97.514% ## ( 6, 10 ] 12925 1.963% 99.477% ( 10, 15 ] 2121 0.322% 99.799% ( 15, 22 ] 262 0.040% 99.839% ( 22, 34 ] 18 0.003% 99.842% ( 34, 51 ] 5 0.001% 99.843% ( 51, 76 ] 3 0.000% 99.843% ( 76, 110 ] 247 0.038% 99.880% ( 110, 170 ] 329 0.050% 99.930% ( 170, 250 ] 152 0.023% 99.954% ( 250, 380 ] 196 0.030% 99.983% ( 380, 580 ] 217 0.033% 100.016% ( 580, 870 ] 183 0.028% 100.044% ( 870, 1300 ] 124 0.019% 100.063% ( 1300, 1900 ] 87 0.013% 100.076% ( 1900, 2900 ] 75 0.011% 100.087% ( 2900, 4400 ] 57 0.009% 100.096% ( 4400, 6600 ] 21 0.003% 100.099% ( 6600, 9900 ] 13 0.002% 100.101% ( 9900, 14000 ] 5 0.001% 100.102% ** Level 2 read latency histogram (micros): Count: 95926 Average: 2.3055 StdDev: 12.65 Min: 1 Median: 1.4333 Max: 1456 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 14.03 P99.99: 682.04 ------------------------------------------------------ [ 0, 1 ] 22006 22.941% 22.941% ##### ( 1, 2 ] 59905 62.449% 85.390% ############ ( 2, 3 ] 8141 8.487% 93.877% ## ( 3, 4 ] 3106 3.238% 97.114% # ( 4, 6 ] 2100 2.189% 99.304% ( 6, 10 ] 498 0.519% 99.823% ( 10, 15 ] 92 0.096% 99.919% ( 15, 22 ] 5 0.005% 99.924% ( 22, 34 ] 1 0.001% 99.925% ( 34, 51 ] 1 0.001% 99.926% ( 51, 76 ] 1 0.001% 99.927% ( 76, 110 ] 2 0.002% 99.929% ( 110, 170 ] 18 0.019% 99.948% ( 170, 250 ] 7 0.007% 99.955% ( 250, 380 ] 17 0.018% 99.973% ( 380, 580 ] 15 0.016% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 870, 1300 ] 6 0.006% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 626599 Average: 5.7130 StdDev: 75.40 Min: 0 Median: 1.9045 Max: 9316 Percentiles: P50: 1.90 P75: 2.89 P99: 9.09 P99.9: 212.52 P99.99: 428.75 ------------------------------------------------------ [ 0, 1 ] 17957 2.866% 2.866% # ( 1, 2 ] 326530 52.111% 54.977% ########## ( 2, 3 ] 141137 22.524% 77.502% ##### ( 3, 4 ] 65993 10.532% 88.033% ## ( 4, 6 ] 59802 9.544% 97.577% ## ( 6, 10 ] 11541 1.842% 99.419% ( 10, 15 ] 2175 0.347% 99.766% ( 15, 22 ] 274 0.044% 99.810% ( 22, 34 ] 48 0.008% 99.818% ( 34, 51 ] 13 0.002% 99.820% ( 51, 76 ] 14 0.002% 99.822% ( 76, 110 ] 86 0.014% 99.836% ( 110, 170 ] 252 0.040% 99.876% ( 170, 250 ] 283 0.045% 99.921% ( 250, 380 ] 328 0.052% 99.974% ( 380, 580 ] 424 0.068% 100.041% ( 580, 870 ] 348 0.056% 100.097% ( 870, 1300 ] 191 0.030% 100.127% ( 1300, 1900 ] 82 0.013% 100.140% ( 1900, 2900 ] 107 0.017% 100.157% ( 2900, 4400 ] 126 0.020% 100.177% ( 4400, 6600 ] 19 0.003% 100.180% ( 6600, 9900 ] 1 0.000% 100.181% ** Level 4 read latency histogram (micros): Count: 235 Average: 378.1489 StdDev: 896.60 Min: 1 Median: 2.7885 Max: 5674 Percentiles: P50: 2.79 P75: 238.42 P99: 4876.67 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ [ 0, 1 ] 36 15.319% 15.319% ### ( 1, 2 ] 61 25.957% 41.277% ##### ( 2, 3 ] 26 11.064% 52.340% ## ( 3, 4 ] 15 6.383% 58.723% # ( 4, 6 ] 5 2.128% 60.851% ( 6, 10 ] 5 2.128% 62.979% ( 10, 15 ] 3 1.277% 64.255% ( 15, 22 ] 4 1.702% 65.957% ( 22, 34 ] 3 1.277% 67.234% ( 110, 170 ] 2 0.851% 68.085% ( 170, 250 ] 19 8.085% 76.170% ## ( 250, 380 ] 3 1.277% 77.447% ( 380, 580 ] 9 3.830% 81.277% # ( 580, 870 ] 16 6.809% 88.085% # ( 870, 1300 ] 8 3.404% 91.489% # ( 1300, 1900 ] 4 1.702% 93.191% ( 1900, 2900 ] 7 2.979% 96.170% # ( 2900, 4400 ] 6 2.553% 98.723% # ( 4400, 6600 ] 3 1.277% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1066.3214 StdDev: 1241.91 Min: 77 Median: 473.3333 Max: 4795 Percentiles: P50: 473.33 P75: 1623.08 P99: 4795.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 20 14.286% 14.286% ### ( 110, 170 ] 17 12.143% 26.429% ## ( 170, 250 ] 14 10.000% 36.429% ## ( 250, 380 ] 12 8.571% 45.000% ## ( 380, 580 ] 15 10.714% 55.714% ## ( 580, 870 ] 13 9.286% 65.000% ## ( 870, 1300 ] 7 5.000% 70.000% # ( 1300, 1900 ] 13 9.286% 79.286% ## ( 1900, 2900 ] 9 6.429% 85.714% # ( 2900, 4400 ] 18 12.857% 98.571% ### ( 4400, 6600 ] 2 1.429% 100.000% ** DB Stats ** Uptime(secs): 31.2 total, 4.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 221.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.462 H:M:S, 36.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 205.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.731 H:M:S, 36.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/27-16:17:19 ... thread 0: (1000000,8000000) ops and (324995.0,234981.7) ops/second in (3.076970,34.045211) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/9 3.68 GB 176.2 6.7 0.0 6.7 14.3 7.6 0.0 1.9 137.9 293.2 49.80 45.14 130 0.383 6970K 12K 0.0 0.0 L1 11/11 1.24 GB 0.0 3.8 3.6 0.2 3.8 3.6 0.2 1.0 219.2 217.0 17.91 16.83 3 5.971 3987K 40K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.5 2.0 253.5 253.4 1.49 1.44 2 0.746 383K 166 0.0 0.0 L3 22/0 996.77 MB 1.0 3.8 2.2 1.5 3.7 2.2 0.5 1.7 187.2 186.6 20.58 17.12 15 1.372 3893K 12K 0.0 0.0 L4 170/0 9.58 GB 1.0 1.2 1.0 0.2 1.2 1.0 1.3 1.2 147.1 146.3 8.57 5.86 21 0.408 1260K 5929 0.0 0.0 L5 1072/0 88.15 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/20 103.63 GB 0.0 15.9 7.1 8.8 23.4 14.6 6.9 3.1 165.6 243.6 98.35 86.39 171 0.575 16M 71K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.9 7.1 8.8 23.4 14.6 6.9 3.1 165.6 243.6 98.35 86.39 171 0.575 16M 71K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.9 7.1 8.8 15.8 7.0 0.0 0.0 217.5 216.5 74.86 66.71 62 1.207 16M 71K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 329.9 23.49 19.68 109 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.2 total, 34.0 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.40 GB write, 699.96 MB/s write, 15.90 GB read, 475.72 MB/s read, 98.4 seconds Interval compaction: 23.40 GB write, 703.70 MB/s write, 15.90 GB read, 478.26 MB/s read, 98.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 45, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3107360 Average: 2.7000 StdDev: 29.31 Min: 0 Median: 1.5097 Max: 14811 Percentiles: P50: 1.51 P75: 1.90 P99: 6.47 P99.9: 120.38 P99.99: 288.50 ------------------------------------------------------ [ 0, 1 ] 541487 17.426% 17.426% ### ( 1, 2 ] 1985855 63.908% 81.334% ############# ( 2, 3 ] 343940 11.069% 92.403% ## ( 3, 4 ] 116461 3.748% 96.151% # ( 4, 6 ] 85770 2.760% 98.911% # ( 6, 10 ] 23610 0.760% 99.671% ( 10, 15 ] 3733 0.120% 99.791% ( 15, 22 ] 398 0.013% 99.803% ( 22, 34 ] 34 0.001% 99.805% ( 34, 51 ] 14 0.000% 99.805% ( 51, 76 ] 38 0.001% 99.806% ( 76, 110 ] 2491 0.080% 99.886% ( 110, 170 ] 2449 0.079% 99.965% ( 170, 250 ] 638 0.021% 99.986% ( 250, 380 ] 450 0.014% 100.000% ( 380, 580 ] 329 0.011% 100.011% ( 580, 870 ] 166 0.005% 100.016% ( 870, 1300 ] 84 0.003% 100.019% ( 1300, 1900 ] 34 0.001% 100.020% ( 1900, 2900 ] 51 0.002% 100.022% ( 2900, 4400 ] 37 0.001% 100.023% ( 4400, 6600 ] 15 0.000% 100.023% ( 6600, 9900 ] 9 0.000% 100.024% ( 9900, 14000 ] 3 0.000% 100.024% ( 14000, 22000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 752502 Average: 4.4769 StdDev: 69.53 Min: 0 Median: 1.7889 Max: 12860 Percentiles: P50: 1.79 P75: 2.65 P99: 8.95 P99.9: 133.05 P99.99: 428.50 ------------------------------------------------------ [ 0, 1 ] 37413 4.972% 4.972% # ( 1, 2 ] 429496 57.076% 62.048% ########### ( 2, 3 ] 149528 19.871% 81.918% #### ( 3, 4 ] 61909 8.227% 90.145% ## ( 4, 6 ] 56079 7.452% 97.598% # ( 6, 10 ] 14323 1.903% 99.501% ( 10, 15 ] 2232 0.297% 99.798% ( 15, 22 ] 271 0.036% 99.834% ( 22, 34 ] 18 0.002% 99.836% ( 34, 51 ] 5 0.001% 99.837% ( 51, 76 ] 4 0.001% 99.837% ( 76, 110 ] 325 0.043% 99.881% ( 110, 170 ] 384 0.051% 99.932% ( 170, 250 ] 170 0.023% 99.954% ( 250, 380 ] 214 0.028% 99.983% ( 380, 580 ] 234 0.031% 100.014% ( 580, 870 ] 187 0.025% 100.039% ( 870, 1300 ] 124 0.016% 100.055% ( 1300, 1900 ] 88 0.012% 100.067% ( 1900, 2900 ] 75 0.010% 100.077% ( 2900, 4400 ] 57 0.008% 100.084% ( 4400, 6600 ] 21 0.003% 100.087% ( 6600, 9900 ] 13 0.002% 100.089% ( 9900, 14000 ] 5 0.001% 100.089% ** Level 2 read latency histogram (micros): Count: 95926 Average: 2.3055 StdDev: 12.65 Min: 1 Median: 1.4333 Max: 1456 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 14.03 P99.99: 682.04 ------------------------------------------------------ [ 0, 1 ] 22006 22.941% 22.941% ##### ( 1, 2 ] 59905 62.449% 85.390% ############ ( 2, 3 ] 8141 8.487% 93.877% ## ( 3, 4 ] 3106 3.238% 97.114% # ( 4, 6 ] 2100 2.189% 99.304% ( 6, 10 ] 498 0.519% 99.823% ( 10, 15 ] 92 0.096% 99.919% ( 15, 22 ] 5 0.005% 99.924% ( 22, 34 ] 1 0.001% 99.925% ( 34, 51 ] 1 0.001% 99.926% ( 51, 76 ] 1 0.001% 99.927% ( 76, 110 ] 2 0.002% 99.929% ( 110, 170 ] 18 0.019% 99.948% ( 170, 250 ] 7 0.007% 99.955% ( 250, 380 ] 17 0.018% 99.973% ( 380, 580 ] 15 0.016% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 870, 1300 ] 6 0.006% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 626599 Average: 5.7130 StdDev: 75.40 Min: 0 Median: 1.9045 Max: 9316 Percentiles: P50: 1.90 P75: 2.89 P99: 9.09 P99.9: 212.52 P99.99: 428.75 ------------------------------------------------------ [ 0, 1 ] 17957 2.866% 2.866% # ( 1, 2 ] 326530 52.111% 54.977% ########## ( 2, 3 ] 141137 22.524% 77.502% ##### ( 3, 4 ] 65993 10.532% 88.033% ## ( 4, 6 ] 59802 9.544% 97.577% ## ( 6, 10 ] 11541 1.842% 99.419% ( 10, 15 ] 2175 0.347% 99.766% ( 15, 22 ] 274 0.044% 99.810% ( 22, 34 ] 48 0.008% 99.818% ( 34, 51 ] 13 0.002% 99.820% ( 51, 76 ] 14 0.002% 99.822% ( 76, 110 ] 86 0.014% 99.836% ( 110, 170 ] 252 0.040% 99.876% ( 170, 250 ] 283 0.045% 99.921% ( 250, 380 ] 328 0.052% 99.974% ( 380, 580 ] 424 0.068% 100.041% ( 580, 870 ] 348 0.056% 100.097% ( 870, 1300 ] 191 0.030% 100.127% ( 1300, 1900 ] 82 0.013% 100.140% ( 1900, 2900 ] 107 0.017% 100.157% ( 2900, 4400 ] 126 0.020% 100.177% ( 4400, 6600 ] 19 0.003% 100.180% ( 6600, 9900 ] 1 0.000% 100.181% ** Level 4 read latency histogram (micros): Count: 235 Average: 378.1489 StdDev: 896.60 Min: 1 Median: 2.7885 Max: 5674 Percentiles: P50: 2.79 P75: 238.42 P99: 4876.67 P99.9: 5674.00 P99.99: 5674.00 ------------------------------------------------------ [ 0, 1 ] 36 15.319% 15.319% ### ( 1, 2 ] 61 25.957% 41.277% ##### ( 2, 3 ] 26 11.064% 52.340% ## ( 3, 4 ] 15 6.383% 58.723% # ( 4, 6 ] 5 2.128% 60.851% ( 6, 10 ] 5 2.128% 62.979% ( 10, 15 ] 3 1.277% 64.255% ( 15, 22 ] 4 1.702% 65.957% ( 22, 34 ] 3 1.277% 67.234% ( 110, 170 ] 2 0.851% 68.085% ( 170, 250 ] 19 8.085% 76.170% ## ( 250, 380 ] 3 1.277% 77.447% ( 380, 580 ] 9 3.830% 81.277% # ( 580, 870 ] 16 6.809% 88.085% # ( 870, 1300 ] 8 3.404% 91.489% # ( 1300, 1900 ] 4 1.702% 93.191% ( 1900, 2900 ] 7 2.979% 96.170% # ( 2900, 4400 ] 6 2.553% 98.723% # ( 4400, 6600 ] 3 1.277% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1066.3214 StdDev: 1241.91 Min: 77 Median: 473.3333 Max: 4795 Percentiles: P50: 473.33 P75: 1623.08 P99: 4795.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 20 14.286% 14.286% ### ( 110, 170 ] 17 12.143% 26.429% ## ( 170, 250 ] 14 10.000% 36.429% ## ( 250, 380 ] 12 8.571% 45.000% ## ( 380, 580 ] 15 10.714% 55.714% ## ( 580, 870 ] 13 9.286% 65.000% ## ( 870, 1300 ] 7 5.000% 70.000% # ( 1300, 1900 ] 13 9.286% 79.286% ## ( 1900, 2900 ] 9 6.429% 85.714% # ( 2900, 4400 ] 18 12.857% 98.571% ### ( 4400, 6600 ] 2 1.429% 100.000% ** DB Stats ** Uptime(secs): 34.2 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 230.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.867 H:M:S, 34.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-16:17:28 ... thread 0: (1000000,9000000) ops and (119611.5,212236.0) ops/second in (8.360403,42.405614) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/6 3.01 GB 163.6 8.0 0.0 8.0 16.6 8.6 0.0 1.9 141.5 293.7 57.86 52.78 151 0.383 8314K 14K 0.0 0.0 L1 13/0 1.37 GB 140.4 6.8 5.3 1.4 6.7 5.3 0.2 1.3 216.6 214.4 32.10 29.85 4 8.024 6816K 40K 0.0 0.0 L2 3/2 258.44 MB 0.9 0.4 0.2 0.2 0.4 0.2 4.1 2.0 253.5 253.4 1.49 1.44 2 0.746 383K 166 0.0 0.0 L3 33/11 2.01 GB 1.3 5.0 3.0 2.1 5.0 2.9 1.1 1.7 170.7 169.9 30.17 23.11 23 1.312 5210K 21K 0.0 0.0 L4 173/11 9.84 GB 1.0 1.5 1.3 0.2 1.5 1.3 1.3 1.2 146.7 145.9 10.79 7.37 25 0.432 1588K 8120 0.0 0.0 L5 1072/0 88.15 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/30 104.64 GB 0.0 21.7 9.8 12.0 30.2 18.3 9.0 3.5 168.0 233.8 132.41 114.55 205 0.646 22M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.7 9.8 12.0 30.2 18.3 9.0 3.5 168.0 233.8 132.41 114.55 205 0.646 22M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.7 9.8 12.0 21.6 9.7 0.0 0.0 210.1 209.0 105.90 92.17 80 1.324 22M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 332.7 26.51 22.38 125 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.6 total, 42.4 interval Flush(GB): cumulative 8.613, interval 8.613 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.23 GB write, 726.83 MB/s write, 21.73 GB read, 522.46 MB/s read, 132.4 seconds Interval compaction: 30.23 GB write, 729.95 MB/s write, 21.73 GB read, 524.70 MB/s read, 132.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 19, pending-compaction-bytes-stops: 0, total-delays: 38, total-stops: 46, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3705080 Average: 2.6645 StdDev: 27.50 Min: 0 Median: 1.5184 Max: 14811 Percentiles: P50: 1.52 P75: 1.91 P99: 6.49 P99.9: 111.00 P99.99: 283.24 ------------------------------------------------------ [ 0, 1 ] 625238 16.875% 16.875% ### ( 1, 2 ] 2367409 63.896% 80.771% ############# ( 2, 3 ] 417918 11.280% 92.051% ## ( 3, 4 ] 145756 3.934% 95.985% # ( 4, 6 ] 108132 2.918% 98.903% # ( 6, 10 ] 29026 0.783% 99.687% ( 10, 15 ] 4611 0.124% 99.811% ( 15, 22 ] 515 0.014% 99.825% ( 22, 34 ] 37 0.001% 99.826% ( 34, 51 ] 20 0.001% 99.827% ( 51, 76 ] 42 0.001% 99.828% ( 76, 110 ] 2629 0.071% 99.899% ( 110, 170 ] 2563 0.069% 99.968% ( 170, 250 ] 692 0.019% 99.987% ( 250, 380 ] 479 0.013% 100.000% ( 380, 580 ] 358 0.010% 100.009% ( 580, 870 ] 195 0.005% 100.015% ( 870, 1300 ] 95 0.003% 100.017% ( 1300, 1900 ] 37 0.001% 100.018% ( 1900, 2900 ] 55 0.001% 100.020% ( 2900, 4400 ] 41 0.001% 100.021% ( 4400, 6600 ] 15 0.000% 100.021% ( 6600, 9900 ] 9 0.000% 100.021% ( 9900, 14000 ] 3 0.000% 100.021% ( 14000, 22000 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1270420 Average: 4.7022 StdDev: 69.97 Min: 0 Median: 1.7853 Max: 12860 Percentiles: P50: 1.79 P75: 2.68 P99: 9.12 P99.9: 145.55 P99.99: 462.01 ------------------------------------------------------ [ 0, 1 ] 76997 6.061% 6.061% # ( 1, 2 ] 710862 55.955% 62.016% ########### ( 2, 3 ] 243812 19.191% 81.207% #### ( 3, 4 ] 104900 8.257% 89.464% ## ( 4, 6 ] 100190 7.886% 97.351% ## ( 6, 10 ] 26879 2.116% 99.466% ( 10, 15 ] 3946 0.311% 99.777% ( 15, 22 ] 506 0.040% 99.817% ( 22, 34 ] 43 0.003% 99.820% ( 34, 51 ] 20 0.002% 99.822% ( 51, 76 ] 52 0.004% 99.826% ( 76, 110 ] 575 0.045% 99.871% ( 110, 170 ] 622 0.049% 99.920% ( 170, 250 ] 304 0.024% 99.944% ( 250, 380 ] 392 0.031% 99.975% ( 380, 580 ] 473 0.037% 100.012% ( 580, 870 ] 395 0.031% 100.043% ( 870, 1300 ] 267 0.021% 100.064% ( 1300, 1900 ] 153 0.012% 100.076% ( 1900, 2900 ] 132 0.010% 100.087% ( 2900, 4400 ] 129 0.010% 100.097% ( 4400, 6600 ] 45 0.004% 100.100% ( 6600, 9900 ] 16 0.001% 100.102% ( 9900, 14000 ] 5 0.000% 100.102% ** Level 2 read latency histogram (micros): Count: 95926 Average: 2.3055 StdDev: 12.65 Min: 1 Median: 1.4333 Max: 1456 Percentiles: P50: 1.43 P75: 1.83 P99: 5.72 P99.9: 14.03 P99.99: 682.04 ------------------------------------------------------ [ 0, 1 ] 22006 22.941% 22.941% ##### ( 1, 2 ] 59905 62.449% 85.390% ############ ( 2, 3 ] 8141 8.487% 93.877% ## ( 3, 4 ] 3106 3.238% 97.114% # ( 4, 6 ] 2100 2.189% 99.304% ( 6, 10 ] 498 0.519% 99.823% ( 10, 15 ] 92 0.096% 99.919% ( 15, 22 ] 5 0.005% 99.924% ( 22, 34 ] 1 0.001% 99.925% ( 34, 51 ] 1 0.001% 99.926% ( 51, 76 ] 1 0.001% 99.927% ( 76, 110 ] 2 0.002% 99.929% ( 110, 170 ] 18 0.019% 99.948% ( 170, 250 ] 7 0.007% 99.955% ( 250, 380 ] 17 0.018% 99.973% ( 380, 580 ] 15 0.016% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 870, 1300 ] 6 0.006% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 948496 Average: 6.7464 StdDev: 84.68 Min: 0 Median: 1.9601 Max: 9316 Percentiles: P50: 1.96 P75: 3.00 P99: 9.40 P99.9: 377.26 P99.99: 583.72 ------------------------------------------------------ [ 0, 1 ] 21741 2.292% 2.292% ( 1, 2 ] 471328 49.692% 51.984% ########## ( 2, 3 ] 218877 23.076% 75.061% ##### ( 3, 4 ] 106084 11.184% 86.245% ## ( 4, 6 ] 103277 10.889% 97.133% ## ( 6, 10 ] 20808 2.194% 99.327% ( 10, 15 ] 3540 0.373% 99.700% ( 15, 22 ] 471 0.050% 99.750% ( 22, 34 ] 60 0.006% 99.756% ( 34, 51 ] 17 0.002% 99.758% ( 51, 76 ] 45 0.005% 99.763% ( 76, 110 ] 107 0.011% 99.774% ( 110, 170 ] 298 0.031% 99.806% ( 170, 250 ] 362 0.038% 99.844% ( 250, 380 ] 545 0.057% 99.901% ( 380, 580 ] 831 0.088% 99.989% ( 580, 870 ] 869 0.092% 100.081% ( 870, 1300 ] 534 0.056% 100.137% ( 1300, 1900 ] 220 0.023% 100.160% ( 1900, 2900 ] 180 0.019% 100.179% ( 2900, 4400 ] 210 0.022% 100.201% ( 4400, 6600 ] 39 0.004% 100.205% ( 6600, 9900 ] 4 0.000% 100.206% ** Level 4 read latency histogram (micros): Count: 6940 Average: 24.1225 StdDev: 201.51 Min: 1 Median: 2.2575 Max: 5674 Percentiles: P50: 2.26 P75: 3.55 P99: 718.63 P99.9: 3415.00 P99.99: 5674.00 ------------------------------------------------------ [ 0, 1 ] 112 1.614% 1.614% ( 1, 2 ] 2928 42.190% 43.804% ######## ( 2, 3 ] 1670 24.063% 67.867% ##### ( 3, 4 ] 905 13.040% 80.908% ### ( 4, 6 ] 969 13.963% 94.870% ### ( 6, 10 ] 156 2.248% 97.118% ( 10, 15 ] 34 0.490% 97.608% ( 15, 22 ] 9 0.130% 97.738% ( 22, 34 ] 5 0.072% 97.810% ( 76, 110 ] 1 0.014% 97.824% ( 110, 170 ] 2 0.029% 97.853% ( 170, 250 ] 26 0.375% 98.228% ( 250, 380 ] 11 0.159% 98.386% ( 380, 580 ] 23 0.331% 98.718% ( 580, 870 ] 41 0.591% 99.308% ( 870, 1300 ] 20 0.288% 99.597% ( 1300, 1900 ] 6 0.086% 99.683% ( 1900, 2900 ] 13 0.187% 99.870% ( 2900, 4400 ] 6 0.086% 99.957% ( 4400, 6600 ] 3 0.043% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1066.3214 StdDev: 1241.91 Min: 77 Median: 473.3333 Max: 4795 Percentiles: P50: 473.33 P75: 1623.08 P99: 4795.00 P99.9: 4795.00 P99.99: 4795.00 ------------------------------------------------------ ( 76, 110 ] 20 14.286% 14.286% ### ( 110, 170 ] 17 12.143% 26.429% ## ( 170, 250 ] 14 10.000% 36.429% ## ( 250, 380 ] 12 8.571% 45.000% ## ( 380, 580 ] 15 10.714% 55.714% ## ( 580, 870 ] 13 9.286% 65.000% ## ( 870, 1300 ] 7 5.000% 70.000% # ( 1300, 1900 ] 13 9.286% 79.286% ## ( 1900, 2900 ] 9 6.429% 85.714% # ( 2900, 4400 ] 18 12.857% 98.571% ### ( 4400, 6600 ] 2 1.429% 100.000% ** DB Stats ** Uptime(secs): 42.6 total, 8.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 207.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.365 H:M:S, 40.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 117.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.498 H:M:S, 65.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.141 micros/op 162838 ops/sec 60.041 seconds 9776999 operations; 157.8 MB/s Microseconds per write: Count: 9776999 Average: 6.1410 StdDev: 328.07 Min: 1 Median: 1.7721 Max: 431816 Percentiles: P50: 1.77 P75: 2.82 P99: 9.82 P99.9: 1167.38 P99.99: 2698.85 ------------------------------------------------------ [ 0, 1 ] 1117041 11.425% 11.425% ## ( 1, 2 ] 4884917 49.963% 61.389% ########## ( 2, 3 ] 1615782 16.526% 77.915% ### ( 3, 4 ] 1367518 13.987% 91.902% ### ( 4, 6 ] 561494 5.743% 97.645% # ( 6, 10 ] 138899 1.421% 99.066% ( 10, 15 ] 46821 0.479% 99.545% ( 15, 22 ] 10124 0.104% 99.648% ( 22, 34 ] 1850 0.019% 99.667% ( 34, 51 ] 225 0.002% 99.669% ( 51, 76 ] 28 0.000% 99.670% ( 76, 110 ] 6715 0.069% 99.738% ( 110, 170 ] 2730 0.028% 99.766% ( 170, 250 ] 278 0.003% 99.769% ( 250, 380 ] 197 0.002% 99.771% ( 380, 580 ] 13 0.000% 99.771% ( 580, 870 ] 19 0.000% 99.771% ( 870, 1300 ] 18177 0.186% 99.957% ( 1300, 1900 ] 73 0.001% 99.958% ( 1900, 2900 ] 3906 0.040% 99.998% ( 2900, 4400 ] 137 0.001% 99.999% ( 4400, 6600 ] 21 0.000% 100.000% ( 6600, 9900 ] 11 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 201887 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9776999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10089862968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 541 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32261562 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31249771195 rocksdb.compact.write.bytes COUNT : 31056602689 rocksdb.flush.write.bytes COUNT : 10040975024 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 55 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 350 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9959852032 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3712000 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31341132400 rocksdb.non.last.level.read.count COUNT : 7573805 rocksdb.block.checksum.compute.count COUNT : 7572778 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.406580 P95 : 3.970152 P99 : 8.488038 P100 : 431813.000000 COUNT : 9776999 SUM : 55100155 rocksdb.compaction.times.micros P50 : 980789.473684 P95 : 3635000.000000 P99 : 14080000.000000 P100 : 14182599.000000 COUNT : 99 SUM : 128591688 rocksdb.compaction.times.cpu_micros P50 : 882368.421053 P95 : 2970000.000000 P99 : 11921000.000000 P100 : 13021806.000000 COUNT : 99 SUM : 110412193 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 723.253012 P95 : 4840.000000 P99 : 63666.666667 P100 : 64352.000000 COUNT : 136 SUM : 329220 rocksdb.compaction.outfile.sync.micros P50 : 1119.126984 P95 : 61125.000000 P99 : 175800.000000 P100 : 193789.000000 COUNT : 371 SUM : 3839688 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 102.775000 P95 : 851.545455 P99 : 2160.000000 P100 : 4983.000000 COUNT : 274 SUM : 68900 rocksdb.table.open.io.micros P50 : 1278.802817 P95 : 6957.500000 P99 : 12191.900000 P100 : 14094.000000 COUNT : 541 SUM : 1069105 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.653742 P95 : 7.828749 P99 : 10.587904 P100 : 20938.000000 COUNT : 7571219 SUM : 43367159 rocksdb.read.block.get.micros P50 : 377.815126 P95 : 3343.617021 P99 : 5519.800000 P100 : 9332.000000 COUNT : 1082 SUM : 887034 rocksdb.write.raw.block.micros P50 : 0.512820 P95 : 0.974358 P99 : 2.938635 P100 : 19761.000000 COUNT : 9953539 SUM : 19226970 rocksdb.numfiles.in.singlecompaction P50 : 3.080882 P95 : 5.825000 P99 : 20.355000 P100 : 24.000000 COUNT : 147 SUM : 530 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563114 P95 : 1159.917721 P99 : 2421.771370 P100 : 431600.000000 COUNT : 200044 SUM : 32282716 rocksdb.sst.read.micros P50 : 1.592845 P95 : 4.682427 P99 : 8.214436 P100 : 14811.000000 COUNT : 7573936 SUM : 27777131 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9776999 SUM : 10089862968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 208588.235294 P95 : 361800.000000 P99 : 547200.000000 P100 : 681129.000000 COUNT : 136 SUM : 28644847 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 352 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0