[2024-12-16 09:25:23.190900] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 23.11.0 initialization... [2024-12-16 09:25:23.191167] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid434802 ] Set seed to 1734337523184204 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-16 09:25:23.321285] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-16 09:25:23.345065] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-16 09:25:23.345112] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 434802' to capture a snapshot of events at runtime. [2024-12-16 09:25:23.345126] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-16 09:25:23.345138] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-16 09:25:23.345150] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid434802 for offline analysis/debug. [2024-12-16 09:25:23.345803] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 16 09:25:27 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/16-09:25:30 ... thread 0: (1000000,1000000) ops and (332916.4,332916.4) ops/second in (3.003757,3.003757) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.96 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 353.2 2.50 2.25 12 0.208 0 0 0.0 0.0 L1 3/0 249.82 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.5 248.3 1.01 0.98 1 1.014 255K 254 0.0 0.0 L2 3/2 190.78 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 241.1 241.0 0.80 0.77 2 0.399 195K 101 0.0 0.0 L3 9/0 741.19 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 1.0 1.5 103.1 307.8 4.31 4.00 15 0.287 451K 355 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.9 1.5 103.1 307.8 4.31 4.00 15 0.287 451K 355 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 245.3 245.1 1.81 1.75 3 0.604 451K 355 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 353.2 2.50 2.25 12 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.29 GB write, 409.28 MB/s write, 0.43 GB read, 137.15 MB/s read, 4.3 seconds Interval compaction: 1.29 GB write, 441.13 MB/s write, 0.43 GB read, 147.82 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 158168 Average: 1.9964 StdDev: 15.68 Min: 0 Median: 1.3189 Max: 3375 Percentiles: P50: 1.32 P75: 1.75 P99: 5.34 P99.9: 9.80 P99.99: 21.39 ------------------------------------------------------ [ 0, 1 ] 49565 31.337% 31.337% ###### ( 1, 2 ] 92562 58.521% 89.858% ############ ( 2, 3 ] 8911 5.634% 95.492% # ( 3, 4 ] 3964 2.506% 97.998% # ( 4, 6 ] 2365 1.495% 99.494% ( 6, 10 ] 676 0.427% 99.921% ( 10, 15 ] 90 0.057% 99.978% ( 15, 22 ] 21 0.013% 99.991% ( 22, 34 ] 3 0.002% 99.993% ( 34, 51 ] 5 0.003% 99.996% ( 51, 76 ] 2 0.001% 99.997% ( 110, 170 ] 4 0.003% 100.000% ( 170, 250 ] 8 0.005% 100.005% ( 250, 380 ] 4 0.003% 100.008% ( 380, 580 ] 1 0.001% 100.008% ( 870, 1300 ] 2 0.001% 100.009% ( 1900, 2900 ] 3 0.002% 100.011% ( 2900, 4400 ] 2 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 507 Average: 8.0533 StdDev: 52.56 Min: 1 Median: 2.1057 Max: 753 Percentiles: P50: 2.11 P75: 2.76 P99: 165.80 P99.9: 753.00 P99.99: 753.00 ------------------------------------------------------ [ 0, 1 ] 21 4.142% 4.142% # ( 1, 2 ] 212 41.815% 45.957% ######## ( 2, 3 ] 194 38.264% 84.221% ######## ( 3, 4 ] 28 5.523% 89.744% # ( 4, 6 ] 32 6.312% 96.055% # ( 6, 10 ] 11 2.170% 98.225% ( 10, 15 ] 2 0.394% 98.619% ( 15, 22 ] 1 0.197% 98.817% ( 110, 170 ] 1 0.197% 99.014% ( 170, 250 ] 1 0.197% 99.211% ( 380, 580 ] 2 0.394% 99.606% ( 580, 870 ] 2 0.394% 100.000% ** Level 2 read latency histogram (micros): Count: 42659 Average: 2.4528 StdDev: 18.30 Min: 0 Median: 1.5421 Max: 2533 Percentiles: P50: 1.54 P75: 1.91 P99: 6.15 P99.9: 13.11 P99.99: 650.96 ------------------------------------------------------ [ 0, 1 ] 5553 13.017% 13.017% ### ( 1, 2 ] 29102 68.220% 81.237% ############## ( 2, 3 ] 4392 10.296% 91.533% ## ( 3, 4 ] 1861 4.363% 95.895% # ( 4, 6 ] 1311 3.073% 98.969% # ( 6, 10 ] 365 0.856% 99.824% ( 10, 15 ] 52 0.122% 99.946% ( 15, 22 ] 7 0.016% 99.962% ( 22, 34 ] 1 0.002% 99.965% ( 34, 51 ] 1 0.002% 99.967% ( 51, 76 ] 1 0.002% 99.970% ( 76, 110 ] 1 0.002% 99.972% ( 170, 250 ] 1 0.002% 99.974% ( 250, 380 ] 4 0.009% 99.984% ( 380, 580 ] 2 0.005% 99.988% ( 580, 870 ] 3 0.007% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1560.6727 StdDev: 1327.23 Min: 187 Median: 826.5000 Max: 5765 Percentiles: P50: 826.50 P75: 2705.56 P99: 5765.00 P99.9: 5765.00 P99.99: 5765.00 ------------------------------------------------------ ( 170, 250 ] 1 1.818% 1.818% ( 250, 380 ] 5 9.091% 10.909% ## ( 380, 580 ] 13 23.636% 34.545% ##### ( 580, 870 ] 10 18.182% 52.727% #### ( 870, 1300 ] 2 3.636% 56.364% # ( 1300, 1900 ] 3 5.455% 61.818% # ( 1900, 2900 ] 9 16.364% 78.182% ### ( 2900, 4400 ] 10 18.182% 96.364% #### ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 4 read latency histogram (micros): Count: 15 Average: 1918.8000 StdDev: 1568.90 Min: 525 Median: 1525.0000 Max: 5833 Percentiles: P50: 1525.00 P75: 2316.67 P99: 5833.00 P99.9: 5833.00 P99.99: 5833.00 ------------------------------------------------------ ( 380, 580 ] 2 13.333% 13.333% ### ( 580, 870 ] 4 26.667% 40.000% ##### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 603.0500 StdDev: 844.31 Min: 87 Median: 150.0000 Max: 3421 Percentiles: P50: 150.00 P75: 580.00 P99: 3421.00 P99.9: 3421.00 P99.99: 3421.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 6 30.000% 60.000% ###### ( 380, 580 ] 3 15.000% 75.000% ### ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 1 5.000% 85.000% # ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 303.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.428 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.428 H:M:S, 14.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-09:25:33 ... thread 0: (1000000,2000000) ops and (354677.3,343452.5) ops/second in (2.819464,5.823221) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.35 GB 81.8 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.8 319.2 8.29 7.70 29 0.286 831K 877 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.5 248.3 1.01 0.98 1 1.014 255K 254 0.0 0.0 L2 1/0 3.28 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 241.1 241.0 0.80 0.77 2 0.399 195K 101 0.0 0.0 L3 33/0 984.81 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 198.8 198.6 3.14 2.74 3 1.048 634K 516 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1233/8 97.92 GB 0.0 1.8 0.8 1.0 3.6 2.6 1.4 2.0 142.6 280.5 13.24 12.19 35 0.378 1917K 1748 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.8 1.0 3.6 2.6 1.3 2.0 142.6 280.5 13.24 12.19 35 0.378 1917K 1748 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.8 1.0 1.8 0.8 0.0 0.0 233.8 233.5 8.08 7.56 9 0.897 1917K 1748 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.9 5.16 4.63 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.63 GB write, 612.85 MB/s write, 1.84 GB read, 311.62 MB/s read, 13.2 seconds Interval compaction: 3.63 GB write, 637.46 MB/s write, 1.84 GB read, 324.14 MB/s read, 13.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 375315 Average: 2.0423 StdDev: 12.36 Min: 0 Median: 1.3762 Max: 3375 Percentiles: P50: 1.38 P75: 1.78 P99: 5.46 P99.9: 10.19 P99.99: 21.41 ------------------------------------------------------ [ 0, 1 ] 101013 26.914% 26.914% ##### ( 1, 2 ] 230289 61.359% 88.273% ############ ( 2, 3 ] 25379 6.762% 95.035% # ( 3, 4 ] 10520 2.803% 97.838% # ( 4, 6 ] 5983 1.594% 99.432% ( 6, 10 ] 1744 0.465% 99.897% ( 10, 15 ] 311 0.083% 99.980% ( 15, 22 ] 42 0.011% 99.991% ( 22, 34 ] 5 0.001% 99.992% ( 34, 51 ] 5 0.001% 99.994% ( 51, 76 ] 3 0.001% 99.994% ( 110, 170 ] 10 0.003% 99.997% ( 170, 250 ] 19 0.005% 100.002% ( 250, 380 ] 8 0.002% 100.004% ( 380, 580 ] 4 0.001% 100.005% ( 580, 870 ] 5 0.001% 100.007% ( 870, 1300 ] 7 0.002% 100.009% ( 1900, 2900 ] 4 0.001% 100.010% ( 2900, 4400 ] 2 0.001% 100.010% ** Level 1 read latency histogram (micros): Count: 63919 Average: 2.3373 StdDev: 4.83 Min: 1 Median: 1.6017 Max: 753 Percentiles: P50: 1.60 P75: 1.97 P99: 5.89 P99.9: 12.13 P99.99: 24.43 ------------------------------------------------------ [ 0, 1 ] 6162 9.640% 9.640% ## ( 1, 2 ] 42874 67.076% 76.716% ############# ( 2, 3 ] 9574 14.978% 91.694% ### ( 3, 4 ] 2898 4.534% 96.228% # ( 4, 6 ] 1870 2.926% 99.154% # ( 6, 10 ] 440 0.688% 99.842% ( 10, 15 ] 87 0.136% 99.978% ( 15, 22 ] 7 0.011% 99.989% ( 22, 34 ] 3 0.005% 99.994% ( 34, 51 ] 1 0.002% 99.995% ( 76, 110 ] 1 0.002% 99.997% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 380, 580 ] 2 0.003% 100.003% ( 580, 870 ] 2 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 47976 Average: 2.4300 StdDev: 17.26 Min: 0 Median: 1.5490 Max: 2533 Percentiles: P50: 1.55 P75: 1.92 P99: 5.98 P99.9: 12.64 P99.99: 599.57 ------------------------------------------------------ [ 0, 1 ] 6026 12.560% 12.560% ### ( 1, 2 ] 32720 68.201% 80.761% ############## ( 2, 3 ] 5308 11.064% 91.825% ## ( 3, 4 ] 2013 4.196% 96.021% # ( 4, 6 ] 1446 3.014% 99.035% # ( 6, 10 ] 387 0.807% 99.842% ( 10, 15 ] 53 0.110% 99.952% ( 15, 22 ] 7 0.015% 99.967% ( 22, 34 ] 1 0.002% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 170, 250 ] 1 0.002% 99.977% ( 250, 380 ] 4 0.008% 99.985% ( 380, 580 ] 2 0.004% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47953 Average: 4.2319 StdDev: 69.91 Min: 0 Median: 1.5908 Max: 5765 Percentiles: P50: 1.59 P75: 1.96 P99: 6.70 P99.9: 430.59 P99.99: 3380.70 ------------------------------------------------------ [ 0, 1 ] 5002 10.431% 10.431% ## ( 1, 2 ] 32115 66.972% 77.403% ############# ( 2, 3 ] 6705 13.982% 91.385% ### ( 3, 4 ] 2215 4.619% 96.004% # ( 4, 6 ] 1376 2.869% 98.874% # ( 6, 10 ] 345 0.719% 99.593% ( 10, 15 ] 71 0.148% 99.741% ( 15, 22 ] 32 0.067% 99.808% ( 22, 34 ] 22 0.046% 99.854% ( 51, 76 ] 1 0.002% 99.856% ( 110, 170 ] 5 0.010% 99.867% ( 170, 250 ] 3 0.006% 99.873% ( 250, 380 ] 9 0.019% 99.892% ( 380, 580 ] 16 0.033% 99.925% ( 580, 870 ] 12 0.025% 99.950% ( 870, 1300 ] 4 0.008% 99.958% ( 1300, 1900 ] 3 0.006% 99.965% ( 1900, 2900 ] 9 0.019% 99.983% ( 2900, 4400 ] 10 0.021% 100.004% ( 4400, 6600 ] 2 0.004% 100.008% ** Level 4 read latency histogram (micros): Count: 15 Average: 1918.8000 StdDev: 1568.90 Min: 525 Median: 1525.0000 Max: 5833 Percentiles: P50: 1525.00 P75: 2316.67 P99: 5833.00 P99.9: 5833.00 P99.99: 5833.00 ------------------------------------------------------ ( 380, 580 ] 2 13.333% 13.333% ### ( 580, 870 ] 4 26.667% 40.000% ##### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 603.0500 StdDev: 844.31 Min: 87 Median: 150.0000 Max: 3421 Percentiles: P50: 150.00 P75: 580.00 P99: 3421.00 P99.9: 3421.00 P99.99: 3421.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 6 30.000% 60.000% ###### ( 380, 580 ] 3 15.000% 75.000% ### ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 1 5.000% 85.000% # ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.646 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 349.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.218 H:M:S, 7.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-09:25:36 ... thread 0: (1000000,3000000) ops and (336125.5,340975.0) ops/second in (2.975079,8.798300) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.34 GB 207.7 1.9 0.0 1.9 4.7 2.8 0.0 1.7 127.8 313.2 15.28 14.36 47 0.325 1982K 2062 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.5 248.3 1.01 0.98 1 1.014 255K 254 0.0 0.0 L2 1/0 3.28 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 241.1 241.0 0.80 0.77 2 0.399 195K 101 0.0 0.0 L3 33/0 984.81 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 198.8 198.6 3.14 2.74 3 1.048 634K 516 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1235/4 98.90 GB 0.0 3.0 0.8 2.2 5.7 3.6 1.4 2.1 149.4 289.3 20.23 18.84 53 0.382 3068K 2933 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 0.8 2.2 5.7 3.6 1.3 2.1 149.4 289.3 20.23 18.84 53 0.382 3068K 2933 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 0.8 2.2 2.9 0.8 0.0 0.0 244.8 244.6 12.34 11.75 13 0.950 3068K 2933 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.4 7.89 7.10 40 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.72 GB write, 647.98 MB/s write, 2.95 GB read, 334.52 MB/s read, 20.2 seconds Interval compaction: 5.72 GB write, 665.20 MB/s write, 2.95 GB read, 343.41 MB/s read, 20.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 637286 Average: 1.9834 StdDev: 11.19 Min: 0 Median: 1.3509 Max: 3375 Percentiles: P50: 1.35 P75: 1.76 P99: 5.15 P99.9: 10.20 P99.99: 20.20 ------------------------------------------------------ [ 0, 1 ] 180651 28.347% 28.347% ###### ( 1, 2 ] 393216 61.702% 90.049% ############ ( 2, 3 ] 37646 5.907% 95.956% # ( 3, 4 ] 15010 2.355% 98.311% ( 4, 6 ] 7669 1.203% 99.515% ( 6, 10 ] 2437 0.382% 99.897% ( 10, 15 ] 547 0.086% 99.983% ( 15, 22 ] 65 0.010% 99.993% ( 22, 34 ] 9 0.001% 99.994% ( 34, 51 ] 6 0.001% 99.995% ( 51, 76 ] 5 0.001% 99.996% ( 110, 170 ] 13 0.002% 99.998% ( 170, 250 ] 31 0.005% 100.003% ( 250, 380 ] 14 0.002% 100.005% ( 380, 580 ] 6 0.001% 100.006% ( 580, 870 ] 13 0.002% 100.008% ( 870, 1300 ] 10 0.002% 100.010% ( 1300, 1900 ] 1 0.000% 100.010% ( 1900, 2900 ] 4 0.001% 100.011% ( 2900, 4400 ] 3 0.000% 100.011% ** Level 1 read latency histogram (micros): Count: 63919 Average: 2.3373 StdDev: 4.83 Min: 1 Median: 1.6017 Max: 753 Percentiles: P50: 1.60 P75: 1.97 P99: 5.89 P99.9: 12.13 P99.99: 24.43 ------------------------------------------------------ [ 0, 1 ] 6162 9.640% 9.640% ## ( 1, 2 ] 42874 67.076% 76.716% ############# ( 2, 3 ] 9574 14.978% 91.694% ### ( 3, 4 ] 2898 4.534% 96.228% # ( 4, 6 ] 1870 2.926% 99.154% # ( 6, 10 ] 440 0.688% 99.842% ( 10, 15 ] 87 0.136% 99.978% ( 15, 22 ] 7 0.011% 99.989% ( 22, 34 ] 3 0.005% 99.994% ( 34, 51 ] 1 0.002% 99.995% ( 76, 110 ] 1 0.002% 99.997% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 380, 580 ] 2 0.003% 100.003% ( 580, 870 ] 2 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 47976 Average: 2.4300 StdDev: 17.26 Min: 0 Median: 1.5490 Max: 2533 Percentiles: P50: 1.55 P75: 1.92 P99: 5.98 P99.9: 12.64 P99.99: 599.57 ------------------------------------------------------ [ 0, 1 ] 6026 12.560% 12.560% ### ( 1, 2 ] 32720 68.201% 80.761% ############## ( 2, 3 ] 5308 11.064% 91.825% ## ( 3, 4 ] 2013 4.196% 96.021% # ( 4, 6 ] 1446 3.014% 99.035% # ( 6, 10 ] 387 0.807% 99.842% ( 10, 15 ] 53 0.110% 99.952% ( 15, 22 ] 7 0.015% 99.967% ( 22, 34 ] 1 0.002% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 170, 250 ] 1 0.002% 99.977% ( 250, 380 ] 4 0.008% 99.985% ( 380, 580 ] 2 0.004% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47953 Average: 4.2319 StdDev: 69.91 Min: 0 Median: 1.5908 Max: 5765 Percentiles: P50: 1.59 P75: 1.96 P99: 6.70 P99.9: 430.59 P99.99: 3380.70 ------------------------------------------------------ [ 0, 1 ] 5002 10.431% 10.431% ## ( 1, 2 ] 32115 66.972% 77.403% ############# ( 2, 3 ] 6705 13.982% 91.385% ### ( 3, 4 ] 2215 4.619% 96.004% # ( 4, 6 ] 1376 2.869% 98.874% # ( 6, 10 ] 345 0.719% 99.593% ( 10, 15 ] 71 0.148% 99.741% ( 15, 22 ] 32 0.067% 99.808% ( 22, 34 ] 22 0.046% 99.854% ( 51, 76 ] 1 0.002% 99.856% ( 110, 170 ] 5 0.010% 99.867% ( 170, 250 ] 3 0.006% 99.873% ( 250, 380 ] 9 0.019% 99.892% ( 380, 580 ] 16 0.033% 99.925% ( 580, 870 ] 12 0.025% 99.950% ( 870, 1300 ] 4 0.008% 99.958% ( 1300, 1900 ] 3 0.006% 99.965% ( 1900, 2900 ] 9 0.019% 99.983% ( 2900, 4400 ] 10 0.021% 100.004% ( 4400, 6600 ] 2 0.004% 100.008% ** Level 4 read latency histogram (micros): Count: 15 Average: 1918.8000 StdDev: 1568.90 Min: 525 Median: 1525.0000 Max: 5833 Percentiles: P50: 1525.00 P75: 2316.67 P99: 5833.00 P99.9: 5833.00 P99.99: 5833.00 ------------------------------------------------------ ( 380, 580 ] 2 13.333% 13.333% ### ( 580, 870 ] 4 26.667% 40.000% ##### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 603.0500 StdDev: 844.31 Min: 87 Median: 150.0000 Max: 3421 Percentiles: P50: 150.00 P75: 580.00 P99: 3421.00 P99.9: 3421.00 P99.99: 3421.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 6 30.000% 60.000% ###### ( 380, 580 ] 3 15.000% 75.000% ### ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 1 5.000% 85.000% # ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.017 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.371 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/16-09:25:39 ... thread 0: (1000000,4000000) ops and (334166.4,339246.9) ops/second in (2.992521,11.790821) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 3.32 GB 308.3 3.0 0.0 3.0 6.8 3.7 0.0 1.8 138.3 310.3 22.32 21.04 65 0.343 3134K 3331 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.5 248.3 1.01 0.98 1 1.014 255K 254 0.0 0.0 L2 1/0 3.28 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 241.1 241.0 0.80 0.77 2 0.399 195K 101 0.0 0.0 L3 33/0 984.81 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 198.8 198.6 3.14 2.74 3 1.048 634K 516 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1237/4 99.88 GB 0.0 4.1 0.8 3.3 7.8 4.5 1.4 2.1 152.4 293.1 27.27 25.53 71 0.384 4219K 4202 0.0 0.0 Int 0/0 0.00 KB 0.0 4.1 0.8 3.3 7.8 4.5 1.3 2.1 152.4 293.1 27.27 25.53 71 0.384 4219K 4202 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.1 0.8 3.3 4.1 0.8 0.0 0.0 249.8 249.5 16.64 15.96 17 0.979 4219K 4202 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 361.3 10.64 9.57 54 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.81 GB write, 664.73 MB/s write, 4.06 GB read, 345.57 MB/s read, 27.3 seconds Interval compaction: 7.81 GB write, 677.91 MB/s write, 4.06 GB read, 352.42 MB/s read, 27.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 900280 Average: 1.9639 StdDev: 10.54 Min: 0 Median: 1.3434 Max: 3375 Percentiles: P50: 1.34 P75: 1.75 P99: 5.02 P99.9: 9.97 P99.99: 19.69 ------------------------------------------------------ [ 0, 1 ] 259065 28.776% 28.776% ###### ( 1, 2 ] 556414 61.805% 90.581% ############ ( 2, 3 ] 50741 5.636% 96.217% # ( 3, 4 ] 20006 2.222% 98.439% ( 4, 6 ] 9872 1.097% 99.535% ( 6, 10 ] 3308 0.367% 99.903% ( 10, 15 ] 720 0.080% 99.983% ( 15, 22 ] 97 0.011% 99.994% ( 22, 34 ] 15 0.002% 99.995% ( 34, 51 ] 8 0.001% 99.996% ( 51, 76 ] 7 0.001% 99.997% ( 110, 170 ] 20 0.002% 99.999% ( 170, 250 ] 37 0.004% 100.003% ( 250, 380 ] 22 0.002% 100.006% ( 380, 580 ] 10 0.001% 100.007% ( 580, 870 ] 19 0.002% 100.009% ( 870, 1300 ] 12 0.001% 100.010% ( 1300, 1900 ] 3 0.000% 100.011% ( 1900, 2900 ] 4 0.000% 100.011% ( 2900, 4400 ] 4 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 63919 Average: 2.3373 StdDev: 4.83 Min: 1 Median: 1.6017 Max: 753 Percentiles: P50: 1.60 P75: 1.97 P99: 5.89 P99.9: 12.13 P99.99: 24.43 ------------------------------------------------------ [ 0, 1 ] 6162 9.640% 9.640% ## ( 1, 2 ] 42874 67.076% 76.716% ############# ( 2, 3 ] 9574 14.978% 91.694% ### ( 3, 4 ] 2898 4.534% 96.228% # ( 4, 6 ] 1870 2.926% 99.154% # ( 6, 10 ] 440 0.688% 99.842% ( 10, 15 ] 87 0.136% 99.978% ( 15, 22 ] 7 0.011% 99.989% ( 22, 34 ] 3 0.005% 99.994% ( 34, 51 ] 1 0.002% 99.995% ( 76, 110 ] 1 0.002% 99.997% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 380, 580 ] 2 0.003% 100.003% ( 580, 870 ] 2 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 47976 Average: 2.4300 StdDev: 17.26 Min: 0 Median: 1.5490 Max: 2533 Percentiles: P50: 1.55 P75: 1.92 P99: 5.98 P99.9: 12.64 P99.99: 599.57 ------------------------------------------------------ [ 0, 1 ] 6026 12.560% 12.560% ### ( 1, 2 ] 32720 68.201% 80.761% ############## ( 2, 3 ] 5308 11.064% 91.825% ## ( 3, 4 ] 2013 4.196% 96.021% # ( 4, 6 ] 1446 3.014% 99.035% # ( 6, 10 ] 387 0.807% 99.842% ( 10, 15 ] 53 0.110% 99.952% ( 15, 22 ] 7 0.015% 99.967% ( 22, 34 ] 1 0.002% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 170, 250 ] 1 0.002% 99.977% ( 250, 380 ] 4 0.008% 99.985% ( 380, 580 ] 2 0.004% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47953 Average: 4.2319 StdDev: 69.91 Min: 0 Median: 1.5908 Max: 5765 Percentiles: P50: 1.59 P75: 1.96 P99: 6.70 P99.9: 430.59 P99.99: 3380.70 ------------------------------------------------------ [ 0, 1 ] 5002 10.431% 10.431% ## ( 1, 2 ] 32115 66.972% 77.403% ############# ( 2, 3 ] 6705 13.982% 91.385% ### ( 3, 4 ] 2215 4.619% 96.004% # ( 4, 6 ] 1376 2.869% 98.874% # ( 6, 10 ] 345 0.719% 99.593% ( 10, 15 ] 71 0.148% 99.741% ( 15, 22 ] 32 0.067% 99.808% ( 22, 34 ] 22 0.046% 99.854% ( 51, 76 ] 1 0.002% 99.856% ( 110, 170 ] 5 0.010% 99.867% ( 170, 250 ] 3 0.006% 99.873% ( 250, 380 ] 9 0.019% 99.892% ( 380, 580 ] 16 0.033% 99.925% ( 580, 870 ] 12 0.025% 99.950% ( 870, 1300 ] 4 0.008% 99.958% ( 1300, 1900 ] 3 0.006% 99.965% ( 1900, 2900 ] 9 0.019% 99.983% ( 2900, 4400 ] 10 0.021% 100.004% ( 4400, 6600 ] 2 0.004% 100.008% ** Level 4 read latency histogram (micros): Count: 15 Average: 1918.8000 StdDev: 1568.90 Min: 525 Median: 1525.0000 Max: 5833 Percentiles: P50: 1525.00 P75: 2316.67 P99: 5833.00 P99.9: 5833.00 P99.99: 5833.00 ------------------------------------------------------ ( 380, 580 ] 2 13.333% 13.333% ### ( 580, 870 ] 4 26.667% 40.000% ##### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 603.0500 StdDev: 844.31 Min: 87 Median: 150.0000 Max: 3421 Percentiles: P50: 150.00 P75: 580.00 P99: 3421.00 P99.9: 3421.00 P99.99: 3421.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 6 30.000% 60.000% ###### ( 380, 580 ] 3 15.000% 75.000% ### ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 1 5.000% 85.000% # ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 327.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.405 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.388 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/16-09:25:43 ... thread 0: (1000000,5000000) ops and (281744.3,325942.3) ops/second in (3.549318,15.340139) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/18 4.24 GB 0.0 4.1 0.0 4.1 8.8 4.7 0.0 1.9 142.8 309.1 29.13 27.48 85 0.343 4221K 4384 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.5 248.3 1.01 0.98 1 1.014 255K 254 0.0 0.0 L2 1/0 3.28 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 241.1 241.0 0.80 0.77 2 0.399 195K 101 0.0 0.0 L3 33/0 984.81 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 198.8 198.6 3.14 2.74 3 1.048 634K 516 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1240/18 100.81 GB 0.0 5.1 0.8 4.3 9.8 5.5 1.4 2.1 153.4 295.5 34.08 31.97 91 0.375 5307K 5255 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 0.8 4.3 9.8 5.5 1.3 2.1 153.4 295.5 34.08 31.97 91 0.375 5307K 5255 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 0.8 4.3 5.1 0.8 0.0 0.0 253.2 253.0 20.64 19.89 21 0.983 5307K 5255 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 360.9 13.44 12.08 70 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.3 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.84 GB write, 646.66 MB/s write, 5.10 GB read, 335.58 MB/s read, 34.1 seconds Interval compaction: 9.84 GB write, 656.52 MB/s write, 5.10 GB read, 340.70 MB/s read, 34.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 14, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1181574 Average: 1.9729 StdDev: 11.65 Min: 0 Median: 1.3276 Max: 4037 Percentiles: P50: 1.33 P75: 1.74 P99: 4.89 P99.9: 11.28 P99.99: 128.27 ------------------------------------------------------ [ 0, 1 ] 353471 29.915% 29.915% ###### ( 1, 2 ] 724401 61.308% 91.223% ############ ( 2, 3 ] 61823 5.232% 96.456% # ( 3, 4 ] 24911 2.108% 98.564% ( 4, 6 ] 11557 0.978% 99.542% ( 6, 10 ] 3987 0.337% 99.879% ( 10, 15 ] 944 0.080% 99.959% ( 15, 22 ] 125 0.011% 99.970% ( 22, 34 ] 22 0.002% 99.972% ( 34, 51 ] 11 0.001% 99.973% ( 51, 76 ] 7 0.001% 99.973% ( 76, 110 ] 160 0.014% 99.987% ( 110, 170 ] 121 0.010% 99.997% ( 170, 250 ] 57 0.005% 100.002% ( 250, 380 ] 33 0.003% 100.005% ( 380, 580 ] 15 0.001% 100.006% ( 580, 870 ] 27 0.002% 100.008% ( 870, 1300 ] 13 0.001% 100.009% ( 1300, 1900 ] 5 0.000% 100.010% ( 1900, 2900 ] 5 0.000% 100.010% ( 2900, 4400 ] 7 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 63919 Average: 2.3373 StdDev: 4.83 Min: 1 Median: 1.6017 Max: 753 Percentiles: P50: 1.60 P75: 1.97 P99: 5.89 P99.9: 12.13 P99.99: 24.43 ------------------------------------------------------ [ 0, 1 ] 6162 9.640% 9.640% ## ( 1, 2 ] 42874 67.076% 76.716% ############# ( 2, 3 ] 9574 14.978% 91.694% ### ( 3, 4 ] 2898 4.534% 96.228% # ( 4, 6 ] 1870 2.926% 99.154% # ( 6, 10 ] 440 0.688% 99.842% ( 10, 15 ] 87 0.136% 99.978% ( 15, 22 ] 7 0.011% 99.989% ( 22, 34 ] 3 0.005% 99.994% ( 34, 51 ] 1 0.002% 99.995% ( 76, 110 ] 1 0.002% 99.997% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 380, 580 ] 2 0.003% 100.003% ( 580, 870 ] 2 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 47976 Average: 2.4300 StdDev: 17.26 Min: 0 Median: 1.5490 Max: 2533 Percentiles: P50: 1.55 P75: 1.92 P99: 5.98 P99.9: 12.64 P99.99: 599.57 ------------------------------------------------------ [ 0, 1 ] 6026 12.560% 12.560% ### ( 1, 2 ] 32720 68.201% 80.761% ############## ( 2, 3 ] 5308 11.064% 91.825% ## ( 3, 4 ] 2013 4.196% 96.021% # ( 4, 6 ] 1446 3.014% 99.035% # ( 6, 10 ] 387 0.807% 99.842% ( 10, 15 ] 53 0.110% 99.952% ( 15, 22 ] 7 0.015% 99.967% ( 22, 34 ] 1 0.002% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 170, 250 ] 1 0.002% 99.977% ( 250, 380 ] 4 0.008% 99.985% ( 380, 580 ] 2 0.004% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47953 Average: 4.2319 StdDev: 69.91 Min: 0 Median: 1.5908 Max: 5765 Percentiles: P50: 1.59 P75: 1.96 P99: 6.70 P99.9: 430.59 P99.99: 3380.70 ------------------------------------------------------ [ 0, 1 ] 5002 10.431% 10.431% ## ( 1, 2 ] 32115 66.972% 77.403% ############# ( 2, 3 ] 6705 13.982% 91.385% ### ( 3, 4 ] 2215 4.619% 96.004% # ( 4, 6 ] 1376 2.869% 98.874% # ( 6, 10 ] 345 0.719% 99.593% ( 10, 15 ] 71 0.148% 99.741% ( 15, 22 ] 32 0.067% 99.808% ( 22, 34 ] 22 0.046% 99.854% ( 51, 76 ] 1 0.002% 99.856% ( 110, 170 ] 5 0.010% 99.867% ( 170, 250 ] 3 0.006% 99.873% ( 250, 380 ] 9 0.019% 99.892% ( 380, 580 ] 16 0.033% 99.925% ( 580, 870 ] 12 0.025% 99.950% ( 870, 1300 ] 4 0.008% 99.958% ( 1300, 1900 ] 3 0.006% 99.965% ( 1900, 2900 ] 9 0.019% 99.983% ( 2900, 4400 ] 10 0.021% 100.004% ( 4400, 6600 ] 2 0.004% 100.008% ** Level 4 read latency histogram (micros): Count: 15 Average: 1918.8000 StdDev: 1568.90 Min: 525 Median: 1525.0000 Max: 5833 Percentiles: P50: 1525.00 P75: 2316.67 P99: 5833.00 P99.9: 5833.00 P99.99: 5833.00 ------------------------------------------------------ ( 380, 580 ] 2 13.333% 13.333% ### ( 580, 870 ] 4 26.667% 40.000% ##### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 603.0500 StdDev: 844.31 Min: 87 Median: 150.0000 Max: 3421 Percentiles: P50: 150.00 P75: 580.00 P99: 3421.00 P99.9: 3421.00 P99.99: 3421.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 6 30.000% 60.000% ###### ( 380, 580 ] 3 15.000% 75.000% ### ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 1 5.000% 85.000% # ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.6 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 315.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.316 H:M:S, 14.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 277.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.911 H:M:S, 25.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/16-09:26:07 ... thread 0: (1000000,6000000) ops and (40367.5,149579.1) ops/second in (24.772423,40.112562) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 566.88 MB 18.9 4.3 0.0 4.3 10.0 5.7 0.0 1.8 124.2 287.3 35.50 31.01 98 0.362 4477K 4628 0.0 0.0 L1 3/0 175.27 MB 17.5 5.0 4.9 0.1 5.0 4.8 0.2 1.0 201.9 198.3 25.59 21.91 3 8.531 5112K 90K 0.0 0.0 L2 14/11 1.40 GB 3.2 0.2 0.1 0.1 0.2 0.1 4.7 1.5 241.1 241.0 0.80 0.77 2 0.399 195K 101 0.0 0.0 L3 25/24 1.86 GB 0.0 2.0 1.6 0.4 2.0 1.6 2.0 1.3 148.0 147.7 13.56 9.05 12 1.130 1706K 888 0.0 0.0 L4 151/7 9.87 GB 1.0 2.0 1.7 0.3 2.0 1.7 0.9 1.2 113.0 112.6 18.51 9.91 17 1.089 2102K 6085 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/46 101.69 GB 0.0 13.5 8.3 5.2 19.1 13.9 10.0 3.4 147.6 208.1 93.96 72.65 132 0.712 13M 102K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.5 8.3 5.2 19.1 13.9 9.9 3.4 147.6 208.1 93.96 72.65 132 0.712 13M 102K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.5 8.3 5.2 13.4 8.2 0.0 0.0 184.7 183.2 75.08 57.96 50 1.502 13M 102K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 307.0 18.88 14.69 82 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.3 total, 40.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.10 GB write, 484.64 MB/s write, 13.54 GB read, 343.66 MB/s read, 94.0 seconds Interval compaction: 19.10 GB write, 487.46 MB/s write, 13.54 GB read, 345.67 MB/s read, 94.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 47, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 47, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2532389 Average: 2.9165 StdDev: 33.54 Min: 0 Median: 1.3382 Max: 13905 Percentiles: P50: 1.34 P75: 1.76 P99: 7.11 P99.9: 160.83 P99.99: 799.88 ------------------------------------------------------ [ 0, 1 ] 755251 29.824% 29.824% ###### ( 1, 2 ] 1510589 59.651% 89.474% ############ ( 2, 3 ] 132053 5.215% 94.689% # ( 3, 4 ] 61007 2.409% 97.098% ( 4, 6 ] 44882 1.772% 98.870% ( 6, 10 ] 11834 0.467% 99.338% ( 10, 15 ] 3538 0.140% 99.477% ( 15, 22 ] 720 0.028% 99.506% ( 22, 34 ] 50 0.002% 99.508% ( 34, 51 ] 15 0.001% 99.508% ( 51, 76 ] 104 0.004% 99.512% ( 76, 110 ] 6441 0.254% 99.767% ( 110, 170 ] 3982 0.157% 99.924% ( 170, 250 ] 608 0.024% 99.948% ( 250, 380 ] 478 0.019% 99.967% ( 380, 580 ] 399 0.016% 99.983% ( 580, 870 ] 245 0.010% 99.992% ( 870, 1300 ] 111 0.004% 99.997% ( 1300, 1900 ] 63 0.002% 99.999% ( 1900, 2900 ] 71 0.003% 100.002% ( 2900, 4400 ] 89 0.004% 100.006% ( 4400, 6600 ] 13 0.001% 100.006% ( 6600, 9900 ] 2 0.000% 100.006% ( 9900, 14000 ] 1 0.000% 100.006% ** Level 1 read latency histogram (micros): Count: 914602 Average: 8.5398 StdDev: 126.84 Min: 1 Median: 1.9784 Max: 14544 Percentiles: P50: 1.98 P75: 2.99 P99: 9.29 P99.9: 21.85 P99.99: 516.72 ------------------------------------------------------ [ 0, 1 ] 15725 1.719% 1.719% ( 1, 2 ] 451328 49.347% 51.066% ########## ( 2, 3 ] 220327 24.090% 75.156% ##### ( 3, 4 ] 102858 11.246% 86.402% ## ( 4, 6 ] 98991 10.823% 97.226% ## ( 6, 10 ] 19742 2.159% 99.384% ( 10, 15 ] 4244 0.464% 99.848% ( 15, 22 ] 483 0.053% 99.901% ( 22, 34 ] 46 0.005% 99.906% ( 34, 51 ] 29 0.003% 99.909% ( 51, 76 ] 10 0.001% 99.910% ( 76, 110 ] 31 0.003% 99.914% ( 110, 170 ] 74 0.008% 99.922% ( 170, 250 ] 106 0.012% 99.934% ( 250, 380 ] 226 0.025% 99.958% ( 380, 580 ] 425 0.046% 100.005% ( 580, 870 ] 537 0.059% 100.063% ( 870, 1300 ] 436 0.048% 100.111% ( 1300, 1900 ] 292 0.032% 100.143% ( 1900, 2900 ] 414 0.045% 100.188% ( 2900, 4400 ] 494 0.054% 100.242% ( 4400, 6600 ] 119 0.013% 100.255% ( 6600, 9900 ] 20 0.002% 100.257% ( 9900, 14000 ] 2 0.000% 100.258% ( 14000, 22000 ] 1 0.000% 100.258% ** Level 2 read latency histogram (micros): Count: 48651 Average: 5.3842 StdDev: 93.47 Min: 0 Median: 1.5566 Max: 6414 Percentiles: P50: 1.56 P75: 1.93 P99: 6.77 P99.9: 966.68 P99.99: 4195.35 ------------------------------------------------------ [ 0, 1 ] 6026 12.386% 12.386% ## ( 1, 2 ] 32878 67.579% 79.965% ############## ( 2, 3 ] 5561 11.430% 91.396% ## ( 3, 4 ] 2100 4.316% 95.712% # ( 4, 6 ] 1522 3.128% 98.841% # ( 6, 10 ] 402 0.826% 99.667% ( 10, 15 ] 60 0.123% 99.790% ( 15, 22 ] 7 0.014% 99.805% ( 22, 34 ] 1 0.002% 99.807% ( 34, 51 ] 1 0.002% 99.809% ( 51, 76 ] 1 0.002% 99.811% ( 76, 110 ] 1 0.002% 99.813% ( 110, 170 ] 3 0.006% 99.819% ( 170, 250 ] 4 0.008% 99.827% ( 250, 380 ] 7 0.014% 99.842% ( 380, 580 ] 15 0.031% 99.873% ( 580, 870 ] 12 0.025% 99.897% ( 870, 1300 ] 6 0.012% 99.910% ( 1300, 1900 ] 8 0.016% 99.926% ( 1900, 2900 ] 13 0.027% 99.953% ( 2900, 4400 ] 21 0.043% 99.996% ( 4400, 6600 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 455370 Average: 14.5392 StdDev: 169.47 Min: 0 Median: 1.9329 Max: 8826 Percentiles: P50: 1.93 P75: 2.95 P99: 13.24 P99.9: 1660.04 P99.99: 2589.31 ------------------------------------------------------ [ 0, 1 ] 10942 2.403% 2.403% ( 1, 2 ] 232339 51.022% 53.425% ########## ( 2, 3 ] 103638 22.759% 76.184% ##### ( 3, 4 ] 50005 10.981% 87.165% ## ( 4, 6 ] 43738 9.605% 96.770% ## ( 6, 10 ] 8892 1.953% 98.723% ( 10, 15 ] 1945 0.427% 99.150% ( 15, 22 ] 275 0.060% 99.210% ( 22, 34 ] 47 0.010% 99.221% ( 34, 51 ] 15 0.003% 99.224% ( 51, 76 ] 4 0.001% 99.225% ( 76, 110 ] 17 0.004% 99.229% ( 110, 170 ] 157 0.034% 99.263% ( 170, 250 ] 210 0.046% 99.309% ( 250, 380 ] 389 0.085% 99.395% ( 380, 580 ] 648 0.142% 99.537% ( 580, 870 ] 784 0.172% 99.709% ( 870, 1300 ] 626 0.137% 99.846% ( 1300, 1900 ] 406 0.089% 99.936% ( 1900, 2900 ] 359 0.079% 100.014% ( 2900, 4400 ] 417 0.092% 100.106% ( 4400, 6600 ] 102 0.022% 100.128% ( 6600, 9900 ] 13 0.003% 100.131% ** Level 4 read latency histogram (micros): Count: 30823 Average: 12.5250 StdDev: 134.01 Min: 1 Median: 1.9829 Max: 5833 Percentiles: P50: 1.98 P75: 2.99 P99: 14.91 P99.9: 2317.14 P99.99: 4216.27 ------------------------------------------------------ [ 0, 1 ] 528 1.713% 1.713% ( 1, 2 ] 15143 49.129% 50.842% ########## ( 2, 3 ] 7507 24.355% 75.197% ##### ( 3, 4 ] 3617 11.735% 86.932% ## ( 4, 6 ] 2817 9.139% 96.071% ## ( 6, 10 ] 731 2.372% 98.443% ( 10, 15 ] 175 0.568% 99.010% ( 15, 22 ] 15 0.049% 99.059% ( 22, 34 ] 7 0.023% 99.082% ( 34, 51 ] 2 0.006% 99.088% ( 51, 76 ] 2 0.006% 99.095% ( 76, 110 ] 2 0.006% 99.101% ( 110, 170 ] 5 0.016% 99.118% ( 170, 250 ] 36 0.117% 99.234% ( 250, 380 ] 18 0.058% 99.293% ( 380, 580 ] 43 0.140% 99.432% ( 580, 870 ] 57 0.185% 99.617% ( 870, 1300 ] 45 0.146% 99.763% ( 1300, 1900 ] 33 0.107% 99.870% ( 1900, 2900 ] 22 0.071% 99.942% ( 2900, 4400 ] 17 0.055% 99.997% ( 4400, 6600 ] 2 0.006% 100.003% ** Level 5 read latency histogram (micros): Count: 144 Average: 1763.3264 StdDev: 1829.42 Min: 87 Median: 1104.5455 Max: 13748 Percentiles: P50: 1104.55 P75: 2622.22 P99: 8448.00 P99.9: 13409.60 P99.99: 13748.00 ------------------------------------------------------ ( 76, 110 ] 6 4.167% 4.167% # ( 110, 170 ] 6 4.167% 8.333% # ( 170, 250 ] 3 2.083% 10.417% ( 250, 380 ] 9 6.250% 16.667% # ( 380, 580 ] 16 11.111% 27.778% ## ( 580, 870 ] 20 13.889% 41.667% ### ( 870, 1300 ] 22 15.278% 56.944% ### ( 1300, 1900 ] 13 9.028% 65.972% ## ( 1900, 2900 ] 18 12.500% 78.472% ### ( 2900, 4400 ] 20 13.889% 92.361% ### ( 4400, 6600 ] 9 6.250% 98.611% # ( 6600, 9900 ] 1 0.694% 99.306% ( 9900, 14000 ] 1 0.694% 100.000% ** DB Stats ** Uptime(secs): 40.3 total, 24.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 146.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.528 H:M:S, 58.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 39.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:21.212 H:M:S, 85.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/12/16-09:26:11 ... thread 0: (1000000,7000000) ops and (267829.5,159648.7) ops/second in (3.733719,43.846281) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.48 GB 56.7 5.0 0.0 5.0 11.6 6.6 0.0 1.8 120.8 280.1 42.26 36.26 112 0.377 5181K 5492 0.0 0.0 L1 3/3 175.27 MB 0.0 5.0 4.9 0.1 5.0 4.8 0.2 1.0 201.9 198.3 25.59 21.91 3 8.531 5112K 90K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.7 1.5 241.1 241.0 0.80 0.77 2 0.399 195K 101 0.0 0.0 L3 18/1 1.09 GB 1.0 4.9 2.8 2.1 4.9 2.7 2.2 1.8 149.4 149.0 33.39 22.79 19 1.757 4081K 8923 0.0 0.0 L4 152/2 9.68 GB 1.0 2.9 2.5 0.5 2.9 2.5 2.3 1.2 125.7 125.3 23.87 14.08 25 0.955 3019K 7639 0.0 0.0 L5 1096/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1281/14 102.60 GB 0.0 18.0 10.3 7.7 24.5 16.7 14.0 3.7 146.5 199.1 125.91 95.81 161 0.782 17M 112K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.0 10.3 7.7 24.5 16.7 13.9 3.7 146.5 199.1 125.91 95.81 161 0.782 17M 112K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.0 10.3 7.7 17.9 10.2 0.0 0.0 177.9 176.8 103.69 78.65 67 1.548 17M 112K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 303.4 22.22 17.16 94 0.236 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.1 total, 43.8 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.48 GB write, 568.68 MB/s write, 18.02 GB read, 418.54 MB/s read, 125.9 seconds Interval compaction: 24.48 GB write, 571.72 MB/s write, 18.02 GB read, 420.77 MB/s read, 125.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 65, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 65, interval: 80 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2798947 Average: 2.9357 StdDev: 32.93 Min: 0 Median: 1.3801 Max: 13905 Percentiles: P50: 1.38 P75: 1.80 P99: 7.45 P99.9: 157.89 P99.99: 743.70 ------------------------------------------------------ [ 0, 1 ] 766525 27.386% 27.386% ##### ( 1, 2 ] 1665257 59.496% 86.882% ############ ( 2, 3 ] 184842 6.604% 93.486% # ( 3, 4 ] 83592 2.987% 96.473% # ( 4, 6 ] 64920 2.319% 98.792% ( 6, 10 ] 16072 0.574% 99.366% ( 10, 15 ] 4306 0.154% 99.520% ( 15, 22 ] 826 0.030% 99.550% ( 22, 34 ] 55 0.002% 99.552% ( 34, 51 ] 17 0.001% 99.552% ( 51, 76 ] 106 0.004% 99.556% ( 76, 110 ] 6443 0.230% 99.786% ( 110, 170 ] 3993 0.143% 99.929% ( 170, 250 ] 634 0.023% 99.951% ( 250, 380 ] 497 0.018% 99.969% ( 380, 580 ] 428 0.015% 99.984% ( 580, 870 ] 273 0.010% 99.994% ( 870, 1300 ] 127 0.005% 99.999% ( 1300, 1900 ] 78 0.003% 100.002% ( 1900, 2900 ] 74 0.003% 100.004% ( 2900, 4400 ] 90 0.003% 100.007% ( 4400, 6600 ] 16 0.001% 100.008% ( 6600, 9900 ] 2 0.000% 100.008% ( 9900, 14000 ] 1 0.000% 100.008% ** Level 1 read latency histogram (micros): Count: 1250148 Average: 7.6458 StdDev: 113.10 Min: 1 Median: 1.9527 Max: 14544 Percentiles: P50: 1.95 P75: 2.95 P99: 9.31 P99.9: 117.20 P99.99: 519.10 ------------------------------------------------------ [ 0, 1 ] 21320 1.705% 1.705% ( 1, 2 ] 633716 50.691% 52.397% ########## ( 2, 3 ] 298372 23.867% 76.264% ##### ( 3, 4 ] 133664 10.692% 86.955% ## ( 4, 6 ] 127090 10.166% 97.121% ## ( 6, 10 ] 28350 2.268% 99.389% ( 10, 15 ] 5537 0.443% 99.832% ( 15, 22 ] 649 0.052% 99.884% ( 22, 34 ] 58 0.005% 99.889% ( 34, 51 ] 32 0.003% 99.891% ( 51, 76 ] 17 0.001% 99.893% ( 76, 110 ] 75 0.006% 99.899% ( 110, 170 ] 157 0.013% 99.911% ( 170, 250 ] 207 0.017% 99.928% ( 250, 380 ] 362 0.029% 99.957% ( 380, 580 ] 601 0.048% 100.005% ( 580, 870 ] 701 0.056% 100.061% ( 870, 1300 ] 571 0.046% 100.106% ( 1300, 1900 ] 365 0.029% 100.136% ( 1900, 2900 ] 465 0.037% 100.173% ( 2900, 4400 ] 523 0.042% 100.215% ( 4400, 6600 ] 125 0.010% 100.225% ( 6600, 9900 ] 20 0.002% 100.226% ( 9900, 14000 ] 2 0.000% 100.226% ( 14000, 22000 ] 1 0.000% 100.227% ** Level 2 read latency histogram (micros): Count: 77061 Average: 7.4393 StdDev: 103.65 Min: 0 Median: 1.6743 Max: 6414 Percentiles: P50: 1.67 P75: 2.31 P99: 9.11 P99.9: 1547.01 P99.99: 4231.54 ------------------------------------------------------ [ 0, 1 ] 6295 8.169% 8.169% ## ( 1, 2 ] 47804 62.034% 70.203% ############ ( 2, 3 ] 11929 15.480% 85.683% ### ( 3, 4 ] 5068 6.577% 92.259% # ( 4, 6 ] 4334 5.624% 97.883% # ( 6, 10 ] 1107 1.437% 99.320% ( 10, 15 ] 173 0.224% 99.545% ( 15, 22 ] 19 0.025% 99.569% ( 22, 34 ] 1 0.001% 99.570% ( 34, 51 ] 3 0.004% 99.574% ( 51, 76 ] 1 0.001% 99.576% ( 76, 110 ] 2 0.003% 99.578% ( 110, 170 ] 10 0.013% 99.591% ( 170, 250 ] 19 0.025% 99.616% ( 250, 380 ] 30 0.039% 99.655% ( 380, 580 ] 58 0.075% 99.730% ( 580, 870 ] 69 0.090% 99.820% ( 870, 1300 ] 50 0.065% 99.885% ( 1300, 1900 ] 29 0.038% 99.922% ( 1900, 2900 ] 23 0.030% 99.952% ( 2900, 4400 ] 33 0.043% 99.995% ( 4400, 6600 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 748206 Average: 11.2431 StdDev: 140.27 Min: 0 Median: 1.9246 Max: 8826 Percentiles: P50: 1.92 P75: 2.92 P99: 10.62 P99.9: 1212.65 P99.99: 1983.56 ------------------------------------------------------ [ 0, 1 ] 16036 2.143% 2.143% ( 1, 2 ] 387265 51.759% 53.902% ########## ( 2, 3 ] 172484 23.053% 76.955% ##### ( 3, 4 ] 79707 10.653% 87.608% ## ( 4, 6 ] 69710 9.317% 96.925% ## ( 6, 10 ] 15159 2.026% 98.951% ( 10, 15 ] 2931 0.392% 99.343% ( 15, 22 ] 405 0.054% 99.397% ( 22, 34 ] 55 0.007% 99.405% ( 34, 51 ] 19 0.003% 99.407% ( 51, 76 ] 8 0.001% 99.408% ( 76, 110 ] 74 0.010% 99.418% ( 110, 170 ] 261 0.035% 99.453% ( 170, 250 ] 342 0.046% 99.499% ( 250, 380 ] 573 0.077% 99.575% ( 380, 580 ] 839 0.112% 99.688% ( 580, 870 ] 981 0.131% 99.819% ( 870, 1300 ] 764 0.102% 99.921% ( 1300, 1900 ] 482 0.064% 99.985% ( 1900, 2900 ] 433 0.058% 100.043% ( 2900, 4400 ] 460 0.061% 100.105% ( 4400, 6600 ] 107 0.014% 100.119% ( 6600, 9900 ] 14 0.002% 100.121% ** Level 4 read latency histogram (micros): Count: 46502 Average: 11.2414 StdDev: 118.63 Min: 1 Median: 1.9642 Max: 5833 Percentiles: P50: 1.96 P75: 2.97 P99: 21.99 P99.9: 1919.15 P99.99: 4126.23 ------------------------------------------------------ [ 0, 1 ] 820 1.763% 1.763% ( 1, 2 ] 23265 50.030% 51.793% ########## ( 2, 3 ] 11178 24.038% 75.831% ##### ( 3, 4 ] 5213 11.210% 87.041% ## ( 4, 6 ] 4203 9.038% 96.080% ## ( 6, 10 ] 1088 2.340% 98.419% ( 10, 15 ] 249 0.535% 98.955% ( 15, 22 ] 21 0.045% 99.000% ( 22, 34 ] 10 0.022% 99.022% ( 34, 51 ] 3 0.006% 99.028% ( 51, 76 ] 2 0.004% 99.032% ( 76, 110 ] 3 0.006% 99.039% ( 110, 170 ] 32 0.069% 99.108% ( 170, 250 ] 72 0.155% 99.262% ( 250, 380 ] 43 0.092% 99.355% ( 380, 580 ] 70 0.151% 99.505% ( 580, 870 ] 89 0.191% 99.697% ( 870, 1300 ] 57 0.123% 99.819% ( 1300, 1900 ] 37 0.080% 99.899% ( 1900, 2900 ] 26 0.056% 99.955% ( 2900, 4400 ] 20 0.043% 99.998% ( 4400, 6600 ] 2 0.004% 100.002% ** Level 5 read latency histogram (micros): Count: 280 Average: 1597.5571 StdDev: 1644.98 Min: 87 Median: 961.2121 Max: 13748 Percentiles: P50: 961.21 P75: 2431.25 P99: 6930.00 P99.9: 12852.00 P99.99: 13748.00 ------------------------------------------------------ ( 76, 110 ] 9 3.214% 3.214% # ( 110, 170 ] 20 7.143% 10.357% # ( 170, 250 ] 11 3.929% 14.286% # ( 250, 380 ] 22 7.857% 22.143% ## ( 380, 580 ] 33 11.786% 33.929% ## ( 580, 870 ] 38 13.571% 47.500% ### ( 870, 1300 ] 33 11.786% 59.286% ## ( 1300, 1900 ] 27 9.643% 68.929% ## ( 1900, 2900 ] 32 11.429% 80.357% ## ( 2900, 4400 ] 41 14.643% 95.000% ### ( 4400, 6600 ] 11 3.929% 98.929% # ( 6600, 9900 ] 2 0.714% 99.643% ( 9900, 14000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 44.1 total, 3.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 156.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.402 H:M:S, 55.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 263.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.874 H:M:S, 23.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/16-09:26:14 ... thread 0: (1000000,8000000) ops and (297902.5,169480.5) ops/second in (3.356803,47.203084) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 1.91 GB 44.1 5.8 0.0 5.8 13.5 7.6 0.0 1.8 122.4 282.0 48.91 42.44 129 0.379 6076K 6470 0.0 0.0 L1 7/7 421.63 MB 0.0 5.8 5.5 0.3 5.7 5.4 0.2 1.0 202.4 199.3 29.49 25.53 4 7.373 5929K 92K 0.0 0.0 L2 1/0 95.32 MB 1.0 0.2 0.1 0.1 0.2 0.1 5.1 1.5 241.1 241.0 0.80 0.77 2 0.399 195K 101 0.0 0.0 L3 16/0 922.28 MB 0.9 5.4 3.0 2.4 5.4 3.0 2.2 1.8 153.7 153.2 36.20 25.36 22 1.645 4664K 10K 0.0 0.0 L4 148/0 9.47 GB 1.0 3.8 2.9 0.8 3.8 2.9 2.3 1.3 136.3 135.9 28.33 18.03 30 0.944 3894K 10K 0.0 0.0 L5 1104/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/18 103.64 GB 0.0 21.1 11.6 9.4 28.6 19.1 15.0 3.7 150.1 203.5 143.72 112.13 187 0.769 20M 120K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.1 11.6 9.4 28.6 19.1 14.9 3.7 150.1 203.5 143.72 112.13 187 0.769 20M 120K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.1 11.6 9.4 20.9 11.5 0.0 0.0 182.3 181.2 118.34 92.20 79 1.498 20M 120K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 307.8 25.38 19.93 108 0.235 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.4 total, 47.2 interval Flush(GB): cumulative 7.628, interval 7.628 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.57 GB write, 616.65 MB/s write, 21.07 GB read, 454.74 MB/s read, 143.7 seconds Interval compaction: 28.57 GB write, 619.71 MB/s write, 21.07 GB read, 456.99 MB/s read, 143.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 75, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 75, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3143980 Average: 2.9021 StdDev: 31.52 Min: 0 Median: 1.4127 Max: 13905 Percentiles: P50: 1.41 P75: 1.83 P99: 7.18 P99.9: 151.48 P99.99: 556.61 ------------------------------------------------------ [ 0, 1 ] 792404 25.204% 25.204% ##### ( 1, 2 ] 1888931 60.081% 85.285% ############ ( 2, 3 ] 238922 7.599% 92.884% ## ( 3, 4 ] 106261 3.380% 96.264% # ( 4, 6 ] 80496 2.560% 98.824% # ( 6, 10 ] 18818 0.599% 99.423% ( 10, 15 ] 4703 0.150% 99.572% ( 15, 22 ] 858 0.027% 99.600% ( 22, 34 ] 57 0.002% 99.601% ( 34, 51 ] 18 0.001% 99.602% ( 51, 76 ] 107 0.003% 99.605% ( 76, 110 ] 6465 0.206% 99.811% ( 110, 170 ] 4047 0.129% 99.940% ( 170, 250 ] 657 0.021% 99.961% ( 250, 380 ] 528 0.017% 99.977% ( 380, 580 ] 448 0.014% 99.992% ( 580, 870 ] 278 0.009% 100.001% ( 870, 1300 ] 138 0.004% 100.005% ( 1300, 1900 ] 84 0.003% 100.008% ( 1900, 2900 ] 77 0.002% 100.010% ( 2900, 4400 ] 93 0.003% 100.013% ( 4400, 6600 ] 16 0.001% 100.014% ( 6600, 9900 ] 2 0.000% 100.014% ( 9900, 14000 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 1354992 Average: 7.3151 StdDev: 108.78 Min: 0 Median: 1.9365 Max: 14544 Percentiles: P50: 1.94 P75: 2.92 P99: 9.29 P99.9: 130.60 P99.99: 509.31 ------------------------------------------------------ [ 0, 1 ] 24767 1.828% 1.828% ( 1, 2 ] 696986 51.438% 53.266% ########## ( 2, 3 ] 320329 23.641% 76.907% ##### ( 3, 4 ] 141242 10.424% 87.331% ## ( 4, 6 ] 133330 9.840% 97.171% ## ( 6, 10 ] 30169 2.227% 99.397% ( 10, 15 ] 5862 0.433% 99.830% ( 15, 22 ] 679 0.050% 99.880% ( 22, 34 ] 63 0.005% 99.885% ( 34, 51 ] 34 0.003% 99.887% ( 51, 76 ] 17 0.001% 99.888% ( 76, 110 ] 78 0.006% 99.894% ( 110, 170 ] 236 0.017% 99.911% ( 170, 250 ] 258 0.019% 99.930% ( 250, 380 ] 394 0.029% 99.960% ( 380, 580 ] 638 0.047% 100.007% ( 580, 870 ] 723 0.053% 100.060% ( 870, 1300 ] 580 0.043% 100.103% ( 1300, 1900 ] 367 0.027% 100.130% ( 1900, 2900 ] 465 0.034% 100.164% ( 2900, 4400 ] 523 0.039% 100.203% ( 4400, 6600 ] 125 0.009% 100.212% ( 6600, 9900 ] 20 0.001% 100.214% ( 9900, 14000 ] 2 0.000% 100.214% ( 14000, 22000 ] 1 0.000% 100.214% ** Level 2 read latency histogram (micros): Count: 77061 Average: 7.4393 StdDev: 103.65 Min: 0 Median: 1.6743 Max: 6414 Percentiles: P50: 1.67 P75: 2.31 P99: 9.11 P99.9: 1547.01 P99.99: 4231.54 ------------------------------------------------------ [ 0, 1 ] 6295 8.169% 8.169% ## ( 1, 2 ] 47804 62.034% 70.203% ############ ( 2, 3 ] 11929 15.480% 85.683% ### ( 3, 4 ] 5068 6.577% 92.259% # ( 4, 6 ] 4334 5.624% 97.883% # ( 6, 10 ] 1107 1.437% 99.320% ( 10, 15 ] 173 0.224% 99.545% ( 15, 22 ] 19 0.025% 99.569% ( 22, 34 ] 1 0.001% 99.570% ( 34, 51 ] 3 0.004% 99.574% ( 51, 76 ] 1 0.001% 99.576% ( 76, 110 ] 2 0.003% 99.578% ( 110, 170 ] 10 0.013% 99.591% ( 170, 250 ] 19 0.025% 99.616% ( 250, 380 ] 30 0.039% 99.655% ( 380, 580 ] 58 0.075% 99.730% ( 580, 870 ] 69 0.090% 99.820% ( 870, 1300 ] 50 0.065% 99.885% ( 1300, 1900 ] 29 0.038% 99.922% ( 1900, 2900 ] 23 0.030% 99.952% ( 2900, 4400 ] 33 0.043% 99.995% ( 4400, 6600 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 919199 Average: 9.9916 StdDev: 127.27 Min: 0 Median: 1.9020 Max: 8826 Percentiles: P50: 1.90 P75: 2.87 P99: 10.14 P99.9: 1089.17 P99.99: 1836.88 ------------------------------------------------------ [ 0, 1 ] 20470 2.227% 2.227% ( 1, 2 ] 486844 52.964% 55.191% ########### ( 2, 3 ] 209679 22.811% 78.002% ##### ( 3, 4 ] 93325 10.153% 88.155% ## ( 4, 6 ] 80505 8.758% 96.913% ## ( 6, 10 ] 19087 2.076% 98.989% ( 10, 15 ] 3385 0.368% 99.358% ( 15, 22 ] 472 0.051% 99.409% ( 22, 34 ] 58 0.006% 99.415% ( 34, 51 ] 19 0.002% 99.417% ( 51, 76 ] 10 0.001% 99.419% ( 76, 110 ] 221 0.024% 99.443% ( 110, 170 ] 500 0.054% 99.497% ( 170, 250 ] 517 0.056% 99.553% ( 250, 380 ] 731 0.080% 99.633% ( 380, 580 ] 982 0.107% 99.740% ( 580, 870 ] 1065 0.116% 99.855% ( 870, 1300 ] 804 0.087% 99.943% ( 1300, 1900 ] 484 0.053% 99.996% ( 1900, 2900 ] 433 0.047% 100.043% ( 2900, 4400 ] 461 0.050% 100.093% ( 4400, 6600 ] 107 0.012% 100.104% ( 6600, 9900 ] 14 0.002% 100.106% ** Level 4 read latency histogram (micros): Count: 113838 Average: 7.4932 StdDev: 79.42 Min: 1 Median: 1.9156 Max: 5833 Percentiles: P50: 1.92 P75: 2.90 P99: 12.81 P99.9: 903.13 P99.99: 2000.62 ------------------------------------------------------ [ 0, 1 ] 1917 1.684% 1.684% ( 1, 2 ] 60073 52.771% 54.455% ########### ( 2, 3 ] 26089 22.918% 77.372% ##### ( 3, 4 ] 11554 10.150% 87.522% ## ( 4, 6 ] 9893 8.690% 96.212% ## ( 6, 10 ] 2916 2.562% 98.774% # ( 10, 15 ] 459 0.403% 99.177% ( 15, 22 ] 60 0.053% 99.230% ( 22, 34 ] 12 0.011% 99.240% ( 34, 51 ] 4 0.004% 99.244% ( 51, 76 ] 4 0.004% 99.247% ( 76, 110 ] 35 0.031% 99.278% ( 110, 170 ] 124 0.109% 99.387% ( 170, 250 ] 184 0.162% 99.548% ( 250, 380 ] 118 0.104% 99.652% ( 380, 580 ] 147 0.129% 99.781% ( 580, 870 ] 130 0.114% 99.895% ( 870, 1300 ] 67 0.059% 99.954% ( 1300, 1900 ] 38 0.033% 99.988% ( 1900, 2900 ] 26 0.023% 100.011% ( 2900, 4400 ] 20 0.018% 100.028% ( 4400, 6600 ] 2 0.002% 100.030% ** Level 5 read latency histogram (micros): Count: 320 Average: 1487.6969 StdDev: 1604.12 Min: 86 Median: 862.5641 Max: 13748 Percentiles: P50: 862.56 P75: 2223.53 P99: 6563.33 P99.9: 12688.00 P99.99: 13748.00 ------------------------------------------------------ ( 76, 110 ] 17 5.312% 5.312% # ( 110, 170 ] 29 9.062% 14.375% ## ( 170, 250 ] 15 4.688% 19.062% # ( 250, 380 ] 26 8.125% 27.188% ## ( 380, 580 ] 35 10.938% 38.125% ## ( 580, 870 ] 39 12.188% 50.312% ## ( 870, 1300 ] 36 11.250% 61.562% ## ( 1300, 1900 ] 32 10.000% 71.562% ## ( 1900, 2900 ] 34 10.625% 82.188% ## ( 2900, 4400 ] 42 13.125% 95.312% ### ( 4400, 6600 ] 12 3.750% 99.062% # ( 6600, 9900 ] 2 0.625% 99.688% ( 9900, 14000 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 47.4 total, 3.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 165.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.064 H:M:S, 52.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 293.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.663 H:M:S, 19.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-09:26:18 ... thread 0: (1000000,9000000) ops and (317363.5,178734.4) ops/second in (3.150961,50.354045) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 2.83 GB 132.2 6.6 0.0 6.6 15.2 8.5 0.0 1.8 124.3 284.2 54.73 47.92 145 0.377 6908K 7337 0.0 0.0 L1 7/7 421.63 MB 0.0 5.8 5.5 0.3 5.7 5.4 0.2 1.0 202.4 199.3 29.49 25.53 4 7.373 5929K 92K 0.0 0.0 L2 1/0 95.32 MB 1.0 0.2 0.1 0.1 0.2 0.1 5.1 1.5 241.1 241.0 0.80 0.77 2 0.399 195K 101 0.0 0.0 L3 16/0 922.28 MB 0.9 5.4 3.0 2.4 5.4 3.0 2.2 1.8 153.7 153.2 36.20 25.36 22 1.645 4664K 10K 0.0 0.0 L4 148/0 9.47 GB 1.0 3.8 2.9 0.8 3.8 2.9 2.3 1.3 136.3 135.9 28.33 18.03 30 0.944 3894K 10K 0.0 0.0 L5 1104/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/18 104.56 GB 0.0 21.9 11.6 10.2 30.3 20.1 15.0 3.5 149.7 207.4 149.55 117.60 203 0.737 21M 121K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.9 11.6 10.2 30.3 20.1 14.9 3.5 149.7 207.4 149.55 117.60 203 0.737 21M 121K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.9 11.6 10.2 21.7 11.5 0.0 0.0 184.3 183.3 121.46 95.26 82 1.481 21M 121K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 311.8 28.09 22.34 121 0.232 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.6 total, 50.4 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.29 GB write, 613.10 MB/s write, 21.87 GB read, 442.61 MB/s read, 149.6 seconds Interval compaction: 30.29 GB write, 615.95 MB/s write, 21.87 GB read, 444.67 MB/s read, 149.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 79, interval: 95 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3484237 Average: 2.8333 StdDev: 30.15 Min: 0 Median: 1.4200 Max: 13905 Percentiles: P50: 1.42 P75: 1.83 P99: 6.87 P99.9: 146.28 P99.99: 510.97 ------------------------------------------------------ [ 0, 1 ] 850165 24.400% 24.400% ##### ( 1, 2 ] 2123678 60.951% 85.351% ############ ( 2, 3 ] 269586 7.737% 93.089% ## ( 3, 4 ] 116427 3.342% 96.430% # ( 4, 6 ] 85016 2.440% 98.870% ( 6, 10 ] 20897 0.600% 99.470% ( 10, 15 ] 4940 0.142% 99.612% ( 15, 22 ] 881 0.025% 99.637% ( 22, 34 ] 61 0.002% 99.639% ( 34, 51 ] 18 0.001% 99.639% ( 51, 76 ] 108 0.003% 99.642% ( 76, 110 ] 6503 0.187% 99.829% ( 110, 170 ] 4093 0.117% 99.947% ( 170, 250 ] 674 0.019% 99.966% ( 250, 380 ] 543 0.016% 99.981% ( 380, 580 ] 459 0.013% 99.995% ( 580, 870 ] 286 0.008% 100.003% ( 870, 1300 ] 144 0.004% 100.007% ( 1300, 1900 ] 85 0.002% 100.009% ( 1900, 2900 ] 78 0.002% 100.012% ( 2900, 4400 ] 95 0.003% 100.014% ( 4400, 6600 ] 16 0.000% 100.015% ( 6600, 9900 ] 2 0.000% 100.015% ( 9900, 14000 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 1400787 Average: 7.1742 StdDev: 107.05 Min: 0 Median: 1.9192 Max: 14544 Percentiles: P50: 1.92 P75: 2.89 P99: 9.27 P99.9: 141.12 P99.99: 511.05 ------------------------------------------------------ [ 0, 1 ] 30318 2.164% 2.164% ( 1, 2 ] 729013 52.043% 54.207% ########## ( 2, 3 ] 325445 23.233% 77.440% ##### ( 3, 4 ] 142668 10.185% 87.625% ## ( 4, 6 ] 134091 9.573% 97.198% ## ( 6, 10 ] 30841 2.202% 99.400% ( 10, 15 ] 5906 0.422% 99.821% ( 15, 22 ] 685 0.049% 99.870% ( 22, 34 ] 64 0.005% 99.875% ( 34, 51 ] 34 0.002% 99.877% ( 51, 76 ] 17 0.001% 99.878% ( 76, 110 ] 145 0.010% 99.889% ( 110, 170 ] 307 0.022% 99.911% ( 170, 250 ] 271 0.019% 99.930% ( 250, 380 ] 416 0.030% 99.960% ( 380, 580 ] 650 0.046% 100.006% ( 580, 870 ] 728 0.052% 100.058% ( 870, 1300 ] 580 0.041% 100.099% ( 1300, 1900 ] 367 0.026% 100.126% ( 1900, 2900 ] 465 0.033% 100.159% ( 2900, 4400 ] 524 0.037% 100.196% ( 4400, 6600 ] 125 0.009% 100.205% ( 6600, 9900 ] 20 0.001% 100.207% ( 9900, 14000 ] 2 0.000% 100.207% ( 14000, 22000 ] 1 0.000% 100.207% ** Level 2 read latency histogram (micros): Count: 77061 Average: 7.4393 StdDev: 103.65 Min: 0 Median: 1.6743 Max: 6414 Percentiles: P50: 1.67 P75: 2.31 P99: 9.11 P99.9: 1547.01 P99.99: 4231.54 ------------------------------------------------------ [ 0, 1 ] 6295 8.169% 8.169% ## ( 1, 2 ] 47804 62.034% 70.203% ############ ( 2, 3 ] 11929 15.480% 85.683% ### ( 3, 4 ] 5068 6.577% 92.259% # ( 4, 6 ] 4334 5.624% 97.883% # ( 6, 10 ] 1107 1.437% 99.320% ( 10, 15 ] 173 0.224% 99.545% ( 15, 22 ] 19 0.025% 99.569% ( 22, 34 ] 1 0.001% 99.570% ( 34, 51 ] 3 0.004% 99.574% ( 51, 76 ] 1 0.001% 99.576% ( 76, 110 ] 2 0.003% 99.578% ( 110, 170 ] 10 0.013% 99.591% ( 170, 250 ] 19 0.025% 99.616% ( 250, 380 ] 30 0.039% 99.655% ( 380, 580 ] 58 0.075% 99.730% ( 580, 870 ] 69 0.090% 99.820% ( 870, 1300 ] 50 0.065% 99.885% ( 1300, 1900 ] 29 0.038% 99.922% ( 1900, 2900 ] 23 0.030% 99.952% ( 2900, 4400 ] 33 0.043% 99.995% ( 4400, 6600 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 919199 Average: 9.9916 StdDev: 127.27 Min: 0 Median: 1.9020 Max: 8826 Percentiles: P50: 1.90 P75: 2.87 P99: 10.14 P99.9: 1089.17 P99.99: 1836.88 ------------------------------------------------------ [ 0, 1 ] 20470 2.227% 2.227% ( 1, 2 ] 486844 52.964% 55.191% ########### ( 2, 3 ] 209679 22.811% 78.002% ##### ( 3, 4 ] 93325 10.153% 88.155% ## ( 4, 6 ] 80505 8.758% 96.913% ## ( 6, 10 ] 19087 2.076% 98.989% ( 10, 15 ] 3385 0.368% 99.358% ( 15, 22 ] 472 0.051% 99.409% ( 22, 34 ] 58 0.006% 99.415% ( 34, 51 ] 19 0.002% 99.417% ( 51, 76 ] 10 0.001% 99.419% ( 76, 110 ] 221 0.024% 99.443% ( 110, 170 ] 500 0.054% 99.497% ( 170, 250 ] 517 0.056% 99.553% ( 250, 380 ] 731 0.080% 99.633% ( 380, 580 ] 982 0.107% 99.740% ( 580, 870 ] 1065 0.116% 99.855% ( 870, 1300 ] 804 0.087% 99.943% ( 1300, 1900 ] 484 0.053% 99.996% ( 1900, 2900 ] 433 0.047% 100.043% ( 2900, 4400 ] 461 0.050% 100.093% ( 4400, 6600 ] 107 0.012% 100.104% ( 6600, 9900 ] 14 0.002% 100.106% ** Level 4 read latency histogram (micros): Count: 113838 Average: 7.4932 StdDev: 79.42 Min: 1 Median: 1.9156 Max: 5833 Percentiles: P50: 1.92 P75: 2.90 P99: 12.81 P99.9: 903.13 P99.99: 2000.62 ------------------------------------------------------ [ 0, 1 ] 1917 1.684% 1.684% ( 1, 2 ] 60073 52.771% 54.455% ########### ( 2, 3 ] 26089 22.918% 77.372% ##### ( 3, 4 ] 11554 10.150% 87.522% ## ( 4, 6 ] 9893 8.690% 96.212% ## ( 6, 10 ] 2916 2.562% 98.774% # ( 10, 15 ] 459 0.403% 99.177% ( 15, 22 ] 60 0.053% 99.230% ( 22, 34 ] 12 0.011% 99.240% ( 34, 51 ] 4 0.004% 99.244% ( 51, 76 ] 4 0.004% 99.247% ( 76, 110 ] 35 0.031% 99.278% ( 110, 170 ] 124 0.109% 99.387% ( 170, 250 ] 184 0.162% 99.548% ( 250, 380 ] 118 0.104% 99.652% ( 380, 580 ] 147 0.129% 99.781% ( 580, 870 ] 130 0.114% 99.895% ( 870, 1300 ] 67 0.059% 99.954% ( 1300, 1900 ] 38 0.033% 99.988% ( 1900, 2900 ] 26 0.023% 100.011% ( 2900, 4400 ] 20 0.018% 100.028% ( 4400, 6600 ] 2 0.002% 100.030% ** Level 5 read latency histogram (micros): Count: 320 Average: 1487.6969 StdDev: 1604.12 Min: 86 Median: 862.5641 Max: 13748 Percentiles: P50: 862.56 P75: 2223.53 P99: 6563.33 P99.9: 12688.00 P99.99: 13748.00 ------------------------------------------------------ ( 76, 110 ] 17 5.312% 5.312% # ( 110, 170 ] 29 9.062% 14.375% ## ( 170, 250 ] 15 4.688% 19.062% # ( 250, 380 ] 26 8.125% 27.188% ## ( 380, 580 ] 35 10.938% 38.125% ## ( 580, 870 ] 39 12.188% 50.312% ## ( 870, 1300 ] 36 11.250% 61.562% ## ( 1300, 1900 ] 32 10.000% 71.562% ## ( 1900, 2900 ] 34 10.625% 82.188% ## ( 2900, 4400 ] 42 13.125% 95.312% ### ( 4400, 6600 ] 12 3.750% 99.062% # ( 6600, 9900 ] 2 0.625% 99.688% ( 9900, 14000 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 50.6 total, 3.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 175.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.534 H:M:S, 50.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 312.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.470 H:M:S, 14.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-09:26:21 ... thread 0: (1000000,10000000) ops and (282270.7,185540.0) ops/second in (3.542698,53.896743) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 2.52 GB 6.3 7.4 0.0 7.4 16.9 9.5 0.0 1.8 125.8 285.8 60.58 53.39 163 0.372 7739K 8167 0.0 0.0 L1 16/16 1.63 GB 0.0 7.5 6.8 0.7 7.4 6.7 0.2 1.1 205.9 203.1 37.15 32.88 5 7.431 7636K 104K 0.0 0.0 L2 1/0 95.32 MB 1.0 0.2 0.1 0.1 0.2 0.1 5.1 1.5 241.1 241.0 0.80 0.77 2 0.399 195K 101 0.0 0.0 L3 16/0 922.28 MB 0.9 5.4 3.0 2.4 5.4 3.0 2.2 1.8 153.7 153.2 36.20 25.36 22 1.645 4664K 10K 0.0 0.0 L4 148/0 9.47 GB 1.0 3.8 2.9 0.8 3.8 2.9 2.3 1.3 136.3 135.9 28.33 18.03 30 0.944 3894K 10K 0.0 0.0 L5 1104/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1301/31 105.47 GB 0.0 24.3 12.9 11.4 33.6 22.2 15.0 3.6 152.6 211.3 163.06 130.42 222 0.735 24M 134K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.3 12.9 11.4 33.6 22.2 14.9 3.6 152.6 211.3 163.06 130.42 222 0.735 24M 134K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.3 12.9 11.4 24.2 12.7 0.0 0.0 188.2 187.2 132.22 105.64 86 1.537 24M 134K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 314.6 30.84 24.77 136 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.1 total, 53.9 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.64 GB write, 636.37 MB/s write, 24.31 GB read, 459.82 MB/s read, 163.1 seconds Interval compaction: 33.64 GB write, 639.13 MB/s write, 24.31 GB read, 461.81 MB/s read, 163.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 80, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 80, interval: 101 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3793326 Average: 2.7902 StdDev: 29.23 Min: 0 Median: 1.4256 Max: 13905 Percentiles: P50: 1.43 P75: 1.83 P99: 6.71 P99.9: 142.53 P99.99: 478.40 ------------------------------------------------------ [ 0, 1 ] 903282 23.812% 23.812% ##### ( 1, 2 ] 2333930 61.527% 85.340% ############ ( 2, 3 ] 298403 7.867% 93.206% ## ( 3, 4 ] 126496 3.335% 96.541% # ( 4, 6 ] 89238 2.353% 98.893% ( 6, 10 ] 22904 0.604% 99.497% ( 10, 15 ] 5359 0.141% 99.638% ( 15, 22 ] 906 0.024% 99.662% ( 22, 34 ] 65 0.002% 99.664% ( 34, 51 ] 22 0.001% 99.665% ( 51, 76 ] 110 0.003% 99.668% ( 76, 110 ] 6550 0.173% 99.840% ( 110, 170 ] 4183 0.110% 99.950% ( 170, 250 ] 696 0.018% 99.969% ( 250, 380 ] 567 0.015% 99.984% ( 380, 580 ] 479 0.013% 99.996% ( 580, 870 ] 302 0.008% 100.004% ( 870, 1300 ] 146 0.004% 100.008% ( 1300, 1900 ] 88 0.002% 100.011% ( 1900, 2900 ] 80 0.002% 100.013% ( 2900, 4400 ] 96 0.003% 100.015% ( 4400, 6600 ] 17 0.000% 100.016% ( 6600, 9900 ] 2 0.000% 100.016% ( 9900, 14000 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 1483113 Average: 6.9398 StdDev: 104.13 Min: 0 Median: 1.8895 Max: 14544 Percentiles: P50: 1.89 P75: 2.85 P99: 9.25 P99.9: 150.26 P99.99: 516.78 ------------------------------------------------------ [ 0, 1 ] 43161 2.910% 2.910% # ( 1, 2 ] 785188 52.942% 55.852% ########### ( 2, 3 ] 333122 22.461% 78.313% #### ( 3, 4 ] 145311 9.798% 88.111% ## ( 4, 6 ] 135408 9.130% 97.241% ## ( 6, 10 ] 32082 2.163% 99.404% ( 10, 15 ] 5996 0.404% 99.808% ( 15, 22 ] 699 0.047% 99.855% ( 22, 34 ] 66 0.004% 99.860% ( 34, 51 ] 35 0.002% 99.862% ( 51, 76 ] 22 0.001% 99.864% ( 76, 110 ] 252 0.017% 99.881% ( 110, 170 ] 429 0.029% 99.910% ( 170, 250 ] 296 0.020% 99.929% ( 250, 380 ] 434 0.029% 99.959% ( 380, 580 ] 678 0.046% 100.004% ( 580, 870 ] 737 0.050% 100.054% ( 870, 1300 ] 588 0.040% 100.094% ( 1300, 1900 ] 368 0.025% 100.119% ( 1900, 2900 ] 465 0.031% 100.150% ( 2900, 4400 ] 524 0.035% 100.185% ( 4400, 6600 ] 125 0.008% 100.194% ( 6600, 9900 ] 20 0.001% 100.195% ( 9900, 14000 ] 2 0.000% 100.195% ( 14000, 22000 ] 1 0.000% 100.195% ** Level 2 read latency histogram (micros): Count: 77061 Average: 7.4393 StdDev: 103.65 Min: 0 Median: 1.6743 Max: 6414 Percentiles: P50: 1.67 P75: 2.31 P99: 9.11 P99.9: 1547.01 P99.99: 4231.54 ------------------------------------------------------ [ 0, 1 ] 6295 8.169% 8.169% ## ( 1, 2 ] 47804 62.034% 70.203% ############ ( 2, 3 ] 11929 15.480% 85.683% ### ( 3, 4 ] 5068 6.577% 92.259% # ( 4, 6 ] 4334 5.624% 97.883% # ( 6, 10 ] 1107 1.437% 99.320% ( 10, 15 ] 173 0.224% 99.545% ( 15, 22 ] 19 0.025% 99.569% ( 22, 34 ] 1 0.001% 99.570% ( 34, 51 ] 3 0.004% 99.574% ( 51, 76 ] 1 0.001% 99.576% ( 76, 110 ] 2 0.003% 99.578% ( 110, 170 ] 10 0.013% 99.591% ( 170, 250 ] 19 0.025% 99.616% ( 250, 380 ] 30 0.039% 99.655% ( 380, 580 ] 58 0.075% 99.730% ( 580, 870 ] 69 0.090% 99.820% ( 870, 1300 ] 50 0.065% 99.885% ( 1300, 1900 ] 29 0.038% 99.922% ( 1900, 2900 ] 23 0.030% 99.952% ( 2900, 4400 ] 33 0.043% 99.995% ( 4400, 6600 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 919199 Average: 9.9916 StdDev: 127.27 Min: 0 Median: 1.9020 Max: 8826 Percentiles: P50: 1.90 P75: 2.87 P99: 10.14 P99.9: 1089.17 P99.99: 1836.88 ------------------------------------------------------ [ 0, 1 ] 20470 2.227% 2.227% ( 1, 2 ] 486844 52.964% 55.191% ########### ( 2, 3 ] 209679 22.811% 78.002% ##### ( 3, 4 ] 93325 10.153% 88.155% ## ( 4, 6 ] 80505 8.758% 96.913% ## ( 6, 10 ] 19087 2.076% 98.989% ( 10, 15 ] 3385 0.368% 99.358% ( 15, 22 ] 472 0.051% 99.409% ( 22, 34 ] 58 0.006% 99.415% ( 34, 51 ] 19 0.002% 99.417% ( 51, 76 ] 10 0.001% 99.419% ( 76, 110 ] 221 0.024% 99.443% ( 110, 170 ] 500 0.054% 99.497% ( 170, 250 ] 517 0.056% 99.553% ( 250, 380 ] 731 0.080% 99.633% ( 380, 580 ] 982 0.107% 99.740% ( 580, 870 ] 1065 0.116% 99.855% ( 870, 1300 ] 804 0.087% 99.943% ( 1300, 1900 ] 484 0.053% 99.996% ( 1900, 2900 ] 433 0.047% 100.043% ( 2900, 4400 ] 461 0.050% 100.093% ( 4400, 6600 ] 107 0.012% 100.104% ( 6600, 9900 ] 14 0.002% 100.106% ** Level 4 read latency histogram (micros): Count: 113838 Average: 7.4932 StdDev: 79.42 Min: 1 Median: 1.9156 Max: 5833 Percentiles: P50: 1.92 P75: 2.90 P99: 12.81 P99.9: 903.13 P99.99: 2000.62 ------------------------------------------------------ [ 0, 1 ] 1917 1.684% 1.684% ( 1, 2 ] 60073 52.771% 54.455% ########### ( 2, 3 ] 26089 22.918% 77.372% ##### ( 3, 4 ] 11554 10.150% 87.522% ## ( 4, 6 ] 9893 8.690% 96.212% ## ( 6, 10 ] 2916 2.562% 98.774% # ( 10, 15 ] 459 0.403% 99.177% ( 15, 22 ] 60 0.053% 99.230% ( 22, 34 ] 12 0.011% 99.240% ( 34, 51 ] 4 0.004% 99.244% ( 51, 76 ] 4 0.004% 99.247% ( 76, 110 ] 35 0.031% 99.278% ( 110, 170 ] 124 0.109% 99.387% ( 170, 250 ] 184 0.162% 99.548% ( 250, 380 ] 118 0.104% 99.652% ( 380, 580 ] 147 0.129% 99.781% ( 580, 870 ] 130 0.114% 99.895% ( 870, 1300 ] 67 0.059% 99.954% ( 1300, 1900 ] 38 0.033% 99.988% ( 1900, 2900 ] 26 0.023% 100.011% ( 2900, 4400 ] 20 0.018% 100.028% ( 4400, 6600 ] 2 0.002% 100.030% ** Level 5 read latency histogram (micros): Count: 320 Average: 1487.6969 StdDev: 1604.12 Min: 86 Median: 862.5641 Max: 13748 Percentiles: P50: 862.56 P75: 2223.53 P99: 6563.33 P99.9: 12688.00 P99.99: 13748.00 ------------------------------------------------------ ( 76, 110 ] 17 5.312% 5.312% # ( 110, 170 ] 29 9.062% 14.375% ## ( 170, 250 ] 15 4.688% 19.062% # ( 250, 380 ] 26 8.125% 27.188% ## ( 380, 580 ] 35 10.938% 38.125% ## ( 580, 870 ] 39 12.188% 50.312% ## ( 870, 1300 ] 36 11.250% 61.562% ## ( 1300, 1900 ] 32 10.000% 71.562% ## ( 1900, 2900 ] 34 10.625% 82.188% ## ( 2900, 4400 ] 42 13.125% 95.312% ### ( 4400, 6600 ] 12 3.750% 99.062% # ( 6600, 9900 ] 2 0.625% 99.688% ( 9900, 14000 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 54.1 total, 3.5 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 181.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.418 H:M:S, 48.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 277.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.884 H:M:S, 25.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-09:26:25 ... thread 0: (1000000,11000000) ops and (248974.5,189939.4) ops/second in (4.016476,57.913219) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.50 GB 132.2 8.6 0.0 8.6 19.0 10.4 0.0 1.8 128.8 286.2 67.97 60.32 181 0.376 8891K 9427 0.0 0.0 L1 16/16 1.63 GB 0.0 7.5 6.8 0.7 7.4 6.7 0.2 1.1 205.9 203.1 37.15 32.88 5 7.431 7636K 104K 0.0 0.0 L2 1/0 95.32 MB 1.0 0.2 0.1 0.1 0.2 0.1 5.1 1.5 241.1 241.0 0.80 0.77 2 0.399 195K 101 0.0 0.0 L3 16/0 922.28 MB 0.9 5.4 3.0 2.4 5.4 3.0 2.2 1.8 153.7 153.2 36.20 25.36 22 1.645 4664K 10K 0.0 0.0 L4 148/0 9.47 GB 1.0 3.8 2.9 0.8 3.8 2.9 2.3 1.3 136.3 135.9 28.33 18.03 30 0.944 3894K 10K 0.0 0.0 L5 1104/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1303/27 106.45 GB 0.0 25.4 12.9 12.6 35.7 23.2 15.0 3.4 152.7 214.7 170.45 137.35 240 0.710 25M 135K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.4 12.9 12.6 35.7 23.2 14.9 3.4 152.7 214.7 170.45 137.35 240 0.710 25M 135K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.4 12.9 12.6 25.3 12.7 0.0 0.0 190.4 189.4 136.66 109.96 90 1.518 25M 135K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 316.9 33.79 27.38 150 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.1 total, 57.9 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.73 GB write, 629.22 MB/s write, 25.41 GB read, 447.56 MB/s read, 170.5 seconds Interval compaction: 35.73 GB write, 631.76 MB/s write, 25.41 GB read, 449.36 MB/s read, 170.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 27, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 27, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 83, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 83, interval: 110 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4205245 Average: 2.7395 StdDev: 27.95 Min: 0 Median: 1.4346 Max: 13905 Percentiles: P50: 1.43 P75: 1.84 P99: 6.47 P99.9: 136.58 P99.99: 420.03 ------------------------------------------------------ [ 0, 1 ] 967129 22.998% 22.998% ##### ( 1, 2 ] 2612813 62.132% 85.130% ############ ( 2, 3 ] 343233 8.162% 93.292% ## ( 3, 4 ] 140703 3.346% 96.638% # ( 4, 6 ] 96373 2.292% 98.930% ( 6, 10 ] 25258 0.601% 99.531% ( 10, 15 ] 5890 0.140% 99.671% ( 15, 22 ] 951 0.023% 99.693% ( 22, 34 ] 69 0.002% 99.695% ( 34, 51 ] 24 0.001% 99.696% ( 51, 76 ] 110 0.003% 99.698% ( 76, 110 ] 6603 0.157% 99.855% ( 110, 170 ] 4253 0.101% 99.956% ( 170, 250 ] 727 0.017% 99.974% ( 250, 380 ] 589 0.014% 99.988% ( 380, 580 ] 497 0.012% 99.999% ( 580, 870 ] 308 0.007% 100.007% ( 870, 1300 ] 157 0.004% 100.011% ( 1300, 1900 ] 91 0.002% 100.013% ( 1900, 2900 ] 82 0.002% 100.015% ( 2900, 4400 ] 96 0.002% 100.017% ( 4400, 6600 ] 17 0.000% 100.017% ( 6600, 9900 ] 2 0.000% 100.017% ( 9900, 14000 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 1560592 Average: 6.7359 StdDev: 101.56 Min: 0 Median: 1.8684 Max: 14544 Percentiles: P50: 1.87 P75: 2.82 P99: 9.23 P99.9: 153.67 P99.99: 517.59 ------------------------------------------------------ [ 0, 1 ] 52708 3.377% 3.377% # ( 1, 2 ] 837868 53.689% 57.067% ########### ( 2, 3 ] 342664 21.957% 79.024% #### ( 3, 4 ] 147807 9.471% 88.495% ## ( 4, 6 ] 137013 8.780% 97.275% ## ( 6, 10 ] 33346 2.137% 99.411% ( 10, 15 ] 6079 0.390% 99.801% ( 15, 22 ] 703 0.045% 99.846% ( 22, 34 ] 66 0.004% 99.850% ( 34, 51 ] 35 0.002% 99.852% ( 51, 76 ] 34 0.002% 99.855% ( 76, 110 ] 311 0.020% 99.875% ( 110, 170 ] 546 0.035% 99.910% ( 170, 250 ] 326 0.021% 99.930% ( 250, 380 ] 458 0.029% 99.960% ( 380, 580 ] 686 0.044% 100.004% ( 580, 870 ] 742 0.048% 100.051% ( 870, 1300 ] 590 0.038% 100.089% ( 1300, 1900 ] 369 0.024% 100.113% ( 1900, 2900 ] 465 0.030% 100.143% ( 2900, 4400 ] 524 0.034% 100.176% ( 4400, 6600 ] 125 0.008% 100.184% ( 6600, 9900 ] 20 0.001% 100.185% ( 9900, 14000 ] 2 0.000% 100.186% ( 14000, 22000 ] 1 0.000% 100.186% ** Level 2 read latency histogram (micros): Count: 77061 Average: 7.4393 StdDev: 103.65 Min: 0 Median: 1.6743 Max: 6414 Percentiles: P50: 1.67 P75: 2.31 P99: 9.11 P99.9: 1547.01 P99.99: 4231.54 ------------------------------------------------------ [ 0, 1 ] 6295 8.169% 8.169% ## ( 1, 2 ] 47804 62.034% 70.203% ############ ( 2, 3 ] 11929 15.480% 85.683% ### ( 3, 4 ] 5068 6.577% 92.259% # ( 4, 6 ] 4334 5.624% 97.883% # ( 6, 10 ] 1107 1.437% 99.320% ( 10, 15 ] 173 0.224% 99.545% ( 15, 22 ] 19 0.025% 99.569% ( 22, 34 ] 1 0.001% 99.570% ( 34, 51 ] 3 0.004% 99.574% ( 51, 76 ] 1 0.001% 99.576% ( 76, 110 ] 2 0.003% 99.578% ( 110, 170 ] 10 0.013% 99.591% ( 170, 250 ] 19 0.025% 99.616% ( 250, 380 ] 30 0.039% 99.655% ( 380, 580 ] 58 0.075% 99.730% ( 580, 870 ] 69 0.090% 99.820% ( 870, 1300 ] 50 0.065% 99.885% ( 1300, 1900 ] 29 0.038% 99.922% ( 1900, 2900 ] 23 0.030% 99.952% ( 2900, 4400 ] 33 0.043% 99.995% ( 4400, 6600 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 919199 Average: 9.9916 StdDev: 127.27 Min: 0 Median: 1.9020 Max: 8826 Percentiles: P50: 1.90 P75: 2.87 P99: 10.14 P99.9: 1089.17 P99.99: 1836.88 ------------------------------------------------------ [ 0, 1 ] 20470 2.227% 2.227% ( 1, 2 ] 486844 52.964% 55.191% ########### ( 2, 3 ] 209679 22.811% 78.002% ##### ( 3, 4 ] 93325 10.153% 88.155% ## ( 4, 6 ] 80505 8.758% 96.913% ## ( 6, 10 ] 19087 2.076% 98.989% ( 10, 15 ] 3385 0.368% 99.358% ( 15, 22 ] 472 0.051% 99.409% ( 22, 34 ] 58 0.006% 99.415% ( 34, 51 ] 19 0.002% 99.417% ( 51, 76 ] 10 0.001% 99.419% ( 76, 110 ] 221 0.024% 99.443% ( 110, 170 ] 500 0.054% 99.497% ( 170, 250 ] 517 0.056% 99.553% ( 250, 380 ] 731 0.080% 99.633% ( 380, 580 ] 982 0.107% 99.740% ( 580, 870 ] 1065 0.116% 99.855% ( 870, 1300 ] 804 0.087% 99.943% ( 1300, 1900 ] 484 0.053% 99.996% ( 1900, 2900 ] 433 0.047% 100.043% ( 2900, 4400 ] 461 0.050% 100.093% ( 4400, 6600 ] 107 0.012% 100.104% ( 6600, 9900 ] 14 0.002% 100.106% ** Level 4 read latency histogram (micros): Count: 113838 Average: 7.4932 StdDev: 79.42 Min: 1 Median: 1.9156 Max: 5833 Percentiles: P50: 1.92 P75: 2.90 P99: 12.81 P99.9: 903.13 P99.99: 2000.62 ------------------------------------------------------ [ 0, 1 ] 1917 1.684% 1.684% ( 1, 2 ] 60073 52.771% 54.455% ########### ( 2, 3 ] 26089 22.918% 77.372% ##### ( 3, 4 ] 11554 10.150% 87.522% ## ( 4, 6 ] 9893 8.690% 96.212% ## ( 6, 10 ] 2916 2.562% 98.774% # ( 10, 15 ] 459 0.403% 99.177% ( 15, 22 ] 60 0.053% 99.230% ( 22, 34 ] 12 0.011% 99.240% ( 34, 51 ] 4 0.004% 99.244% ( 51, 76 ] 4 0.004% 99.247% ( 76, 110 ] 35 0.031% 99.278% ( 110, 170 ] 124 0.109% 99.387% ( 170, 250 ] 184 0.162% 99.548% ( 250, 380 ] 118 0.104% 99.652% ( 380, 580 ] 147 0.129% 99.781% ( 580, 870 ] 130 0.114% 99.895% ( 870, 1300 ] 67 0.059% 99.954% ( 1300, 1900 ] 38 0.033% 99.988% ( 1900, 2900 ] 26 0.023% 100.011% ( 2900, 4400 ] 20 0.018% 100.028% ( 4400, 6600 ] 2 0.002% 100.030% ** Level 5 read latency histogram (micros): Count: 320 Average: 1487.6969 StdDev: 1604.12 Min: 86 Median: 862.5641 Max: 13748 Percentiles: P50: 862.56 P75: 2223.53 P99: 6563.33 P99.9: 12688.00 P99.99: 13748.00 ------------------------------------------------------ ( 76, 110 ] 17 5.312% 5.312% # ( 110, 170 ] 29 9.062% 14.375% ## ( 170, 250 ] 15 4.688% 19.062% # ( 250, 380 ] 26 8.125% 27.188% ## ( 380, 580 ] 35 10.938% 38.125% ## ( 580, 870 ] 39 12.188% 50.312% ## ( 870, 1300 ] 36 11.250% 61.562% ## ( 1300, 1900 ] 32 10.000% 71.562% ## ( 1900, 2900 ] 34 10.625% 82.188% ## ( 2900, 4400 ] 42 13.125% 95.312% ### ( 4400, 6600 ] 12 3.750% 99.062% # ( 6600, 9900 ] 2 0.625% 99.688% ( 9900, 14000 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 58.1 total, 4.0 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 186.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.722 H:M:S, 47.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 245.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.303 H:M:S, 32.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.439 micros/op 183864 ops/sec 60.022 seconds 11035999 operations; 178.2 MB/s Microseconds per write: Count: 11035999 Average: 5.4388 StdDev: 509.96 Min: 0 Median: 1.7294 Max: 898689 Percentiles: P50: 1.73 P75: 2.73 P99: 9.16 P99.9: 1082.26 P99.99: 2726.43 ------------------------------------------------------ [ 0, 1 ] 1534470 13.904% 13.904% ### ( 1, 2 ] 5461317 49.486% 63.391% ########## ( 2, 3 ] 1745840 15.820% 79.210% ### ( 3, 4 ] 1503832 13.627% 92.837% ### ( 4, 6 ] 579771 5.253% 98.090% # ( 6, 10 ] 127189 1.152% 99.243% ( 10, 15 ] 42917 0.389% 99.632% ( 15, 22 ] 10852 0.098% 99.730% ( 22, 34 ] 2318 0.021% 99.751% ( 34, 51 ] 276 0.003% 99.753% ( 51, 76 ] 32 0.000% 99.754% ( 76, 110 ] 7275 0.066% 99.820% ( 110, 170 ] 3360 0.030% 99.850% ( 170, 250 ] 356 0.003% 99.853% ( 250, 380 ] 205 0.002% 99.855% ( 380, 580 ] 41 0.000% 99.855% ( 580, 870 ] 24 0.000% 99.856% ( 870, 1300 ] 9902 0.090% 99.945% ( 1300, 1900 ] 35 0.000% 99.946% ( 1900, 2900 ] 5909 0.054% 99.999% ( 2900, 4400 ] 36 0.000% 100.000% ( 4400, 6600 ] 6 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 4 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 168899 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11035999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11389150968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 570 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29637895 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29204670168 rocksdb.compact.write.bytes COUNT : 29035284303 rocksdb.flush.write.bytes COUNT : 11361785306 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 71 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 337 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11270242304 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4440064 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29313747423 rocksdb.non.last.level.read.count COUNT : 7076134 rocksdb.block.checksum.compute.count COUNT : 7075065 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.374883 P95 : 3.899792 P99 : 7.599158 P100 : 898687.000000 COUNT : 11035999 SUM : 54888196 rocksdb.compaction.times.micros P50 : 1095000.000000 P95 : 4630000.000000 P99 : 14720000.000000 P100 : 20049140.000000 COUNT : 91 SUM : 137586709 rocksdb.compaction.times.cpu_micros P50 : 877000.000000 P95 : 3110000.000000 P99 : 14720000.000000 P100 : 18259081.000000 COUNT : 91 SUM : 110879041 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 712.111111 P95 : 3600.000000 P99 : 11868.000000 P100 : 14047.000000 COUNT : 152 SUM : 158819 rocksdb.compaction.outfile.sync.micros P50 : 1079.625000 P95 : 77187.500000 P99 : 153333.333333 P100 : 263196.000000 COUNT : 350 SUM : 4535977 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.431818 P95 : 1214.000000 P99 : 5038.000000 P100 : 5675.000000 COUNT : 284 SUM : 91955 rocksdb.table.open.io.micros P50 : 1423.076923 P95 : 9172.058824 P99 : 13590.000000 P100 : 25431.000000 COUNT : 570 SUM : 1368879 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.622164 P95 : 7.851161 P99 : 12.160172 P100 : 17621.000000 COUNT : 7073526 SUM : 47818589 rocksdb.read.block.get.micros P50 : 466.666667 P95 : 3731.081081 P99 : 5720.000000 P100 : 8912.000000 COUNT : 1140 SUM : 1087787 rocksdb.write.raw.block.micros P50 : 0.515243 P95 : 0.978962 P99 : 2.984422 P100 : 15133.000000 COUNT : 9783843 SUM : 21442340 rocksdb.numfiles.in.singlecompaction P50 : 3.293478 P95 : 6.320000 P99 : 18.360000 P100 : 27.000000 COUNT : 152 SUM : 580 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.568123 P95 : 1268.453352 P99 : 2679.792693 P100 : 898500.000000 COUNT : 133092 SUM : 29653673 rocksdb.sst.read.micros P50 : 1.585916 P95 : 4.649730 P99 : 8.779470 P100 : 14544.000000 COUNT : 7076513 SUM : 33628478 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11035999 SUM : 11389150968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 208762.886598 P95 : 424333.333333 P99 : 941600.000000 P100 : 1045867.000000 COUNT : 152 SUM : 34153992 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 362 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0