[2024-11-26 10:01:49.062577] Starting SPDK v25.01-pre git sha1 2a91567e4 / DPDK 22.11.4 initialization... [2024-11-26 10:01:49.062723] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1166525 ] Set seed to 1732611709059016 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-26 10:01:49.161286] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-26 10:01:49.184794] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-26 10:01:49.184839] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1166525' to capture a snapshot of events at runtime. [2024-11-26 10:01:49.184849] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-26 10:01:49.184875] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-26 10:01:49.184883] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1166525 for offline analysis/debug. [2024-11-26 10:01:49.185468] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 26 10:01:53 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/26-10:01:56 ... thread 0: (1000000,1000000) ops and (357363.9,357363.9) ops/second in (2.798268,2.798268) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.02 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 355.6 2.30 2.08 12 0.192 0 0 0.0 0.0 L2 3/2 251.73 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 L3 11/0 867.42 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1183/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 98.9 313.3 3.82 3.54 14 0.273 383K 205 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 98.9 313.3 3.82 3.54 14 0.273 383K 205 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 355.6 2.30 2.08 12 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 397.54 MB/s write, 0.37 GB read, 125.54 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 427.40 MB/s write, 0.37 GB read, 134.97 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 100919 Average: 1.8227 StdDev: 14.26 Min: 1 Median: 1.1982 Max: 3251 Percentiles: P50: 1.20 P75: 1.64 P99: 3.78 P99.9: 9.42 P99.99: 325.61 ------------------------------------------------------ [ 0, 1 ] 39229 38.872% 38.872% ######## ( 1, 2 ] 56674 56.158% 95.030% ########### ( 2, 3 ] 3163 3.134% 98.164% # ( 3, 4 ] 1085 1.075% 99.239% ( 4, 6 ] 503 0.498% 99.737% ( 6, 10 ] 193 0.191% 99.929% ( 10, 15 ] 38 0.038% 99.966% ( 15, 22 ] 7 0.007% 99.973% ( 22, 34 ] 1 0.001% 99.974% ( 34, 51 ] 2 0.002% 99.976% ( 51, 76 ] 1 0.001% 99.977% ( 110, 170 ] 6 0.006% 99.983% ( 170, 250 ] 5 0.005% 99.988% ( 250, 380 ] 5 0.005% 99.993% ( 380, 580 ] 5 0.005% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 51901 Average: 2.1139 StdDev: 24.60 Min: 0 Median: 1.2642 Max: 3465 Percentiles: P50: 1.26 P75: 1.69 P99: 5.06 P99.9: 11.64 P99.99: 1044.13 ------------------------------------------------------ [ 0, 1 ] 17958 34.600% 34.600% ####### ( 1, 2 ] 30250 58.284% 92.885% ############ ( 2, 3 ] 2014 3.880% 96.765% # ( 3, 4 ] 878 1.692% 98.457% ( 4, 6 ] 530 1.021% 99.478% ( 6, 10 ] 206 0.397% 99.875% ( 10, 15 ] 40 0.077% 99.952% ( 15, 22 ] 7 0.013% 99.965% ( 22, 34 ] 1 0.002% 99.967% ( 51, 76 ] 1 0.002% 99.969% ( 170, 250 ] 1 0.002% 99.971% ( 250, 380 ] 3 0.006% 99.977% ( 380, 580 ] 4 0.008% 99.985% ( 580, 870 ] 2 0.004% 99.988% ( 870, 1300 ] 2 0.004% 99.992% ( 1900, 2900 ] 3 0.006% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 45 Average: 1502.6667 StdDev: 1035.56 Min: 59 Median: 1219.3750 Max: 3487 Percentiles: P50: 1219.38 P75: 2435.71 P99: 3487.00 P99.9: 3487.00 P99.99: 3487.00 ------------------------------------------------------ ( 51, 76 ] 1 2.222% 2.222% ( 76, 110 ] 1 2.222% 4.444% ( 110, 170 ] 2 4.444% 8.889% # ( 170, 250 ] 1 2.222% 11.111% ( 250, 380 ] 1 2.222% 13.333% ( 380, 580 ] 5 11.111% 24.444% ## ( 580, 870 ] 5 11.111% 35.556% ## ( 870, 1300 ] 8 17.778% 53.333% #### ( 1300, 1900 ] 6 13.333% 66.667% ### ( 1900, 2900 ] 7 15.556% 82.222% ### ( 2900, 4400 ] 8 17.778% 100.000% #### ** Level 4 read latency histogram (micros): Count: 25 Average: 1779.0400 StdDev: 1080.55 Min: 444 Median: 1428.5714 Max: 4231 Percentiles: P50: 1428.57 P75: 2150.00 P99: 4231.00 P99.9: 4231.00 P99.99: 4231.00 ------------------------------------------------------ ( 380, 580 ] 2 8.000% 8.000% ## ( 580, 870 ] 1 4.000% 12.000% # ( 870, 1300 ] 8 32.000% 44.000% ###### ( 1300, 1900 ] 7 28.000% 72.000% ###### ( 1900, 2900 ] 3 12.000% 84.000% ## ( 2900, 4400 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 326.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.198 H:M:S, 6.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.198 H:M:S, 7.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/26-10:01:59 ... thread 0: (1000000,2000000) ops and (319836.9,337560.6) ops/second in (3.126594,5.924862) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/6 1.17 GB 56.7 0.5 0.0 0.5 2.3 1.8 0.0 1.3 70.6 326.5 7.14 6.55 28 0.255 511K 478 0.0 0.0 L1 1/1 3.35 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 236.8 236.3 1.60 1.54 1 1.597 383K 648 0.0 0.0 L2 2/1 53.95 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 L3 21/11 1.19 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 228.7 228.7 1.09 1.02 1 1.091 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 147.4 147.5 1.52 1.13 1 1.523 227K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/19 97.92 GB 0.0 1.7 1.0 0.7 3.5 2.8 1.1 1.9 134.8 276.7 12.86 11.70 33 0.390 1760K 1331 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 1.0 0.7 3.5 2.8 1.0 1.9 134.8 276.7 12.86 11.70 33 0.390 1760K 1331 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 1.0 0.7 1.7 1.0 0.0 0.0 226.0 225.8 7.67 7.07 7 1.096 1760K 1331 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.8 5.19 4.64 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.48 GB write, 580.03 MB/s write, 1.69 GB read, 282.55 MB/s read, 12.9 seconds Interval compaction: 3.48 GB write, 600.61 MB/s write, 1.69 GB read, 292.58 MB/s read, 12.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 397395 Average: 2.2461 StdDev: 11.59 Min: 1 Median: 1.5154 Max: 3251 Percentiles: P50: 1.52 P75: 1.90 P99: 5.69 P99.9: 10.89 P99.99: 14.56 ------------------------------------------------------ [ 0, 1 ] 67130 16.893% 16.893% ### ( 1, 2 ] 255284 64.239% 81.132% ############# ( 2, 3 ] 45654 11.488% 92.620% ## ( 3, 4 ] 16347 4.114% 96.734% # ( 4, 6 ] 10677 2.687% 99.420% # ( 6, 10 ] 1820 0.458% 99.878% ( 10, 15 ] 487 0.123% 100.001% ( 15, 22 ] 39 0.010% 100.011% ( 22, 34 ] 4 0.001% 100.012% ( 34, 51 ] 4 0.001% 100.013% ( 51, 76 ] 4 0.001% 100.014% ( 110, 170 ] 8 0.002% 100.016% ( 170, 250 ] 14 0.004% 100.019% ( 250, 380 ] 10 0.003% 100.022% ( 380, 580 ] 8 0.002% 100.024% ( 580, 870 ] 5 0.001% 100.025% ( 870, 1300 ] 4 0.001% 100.026% ( 1300, 1900 ] 3 0.001% 100.027% ( 1900, 2900 ] 3 0.001% 100.028% ( 2900, 4400 ] 2 0.001% 100.028% ** Level 1 read latency histogram (micros): Count: 26 Average: 188.7308 StdDev: 363.99 Min: 1 Median: 1.8750 Max: 1325 Percentiles: P50: 1.88 P75: 230.00 P99: 1325.00 P99.9: 1325.00 P99.99: 1325.00 ------------------------------------------------------ [ 0, 1 ] 6 23.077% 23.077% ##### ( 1, 2 ] 8 30.769% 53.846% ###### ( 2, 3 ] 2 7.692% 61.538% ## ( 3, 4 ] 1 3.846% 65.385% # ( 4, 6 ] 1 3.846% 69.231% # ( 170, 250 ] 2 7.692% 76.923% ## ( 250, 380 ] 3 11.538% 88.462% ## ( 870, 1300 ] 2 7.692% 96.154% ## ( 1300, 1900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 95676 Average: 2.1887 StdDev: 18.13 Min: 0 Median: 1.4239 Max: 3465 Percentiles: P50: 1.42 P75: 1.82 P99: 5.60 P99.9: 11.82 P99.99: 501.62 ------------------------------------------------------ [ 0, 1 ] 22379 23.390% 23.390% ##### ( 1, 2 ] 60058 62.772% 86.163% ############# ( 2, 3 ] 7659 8.005% 94.168% ## ( 3, 4 ] 3146 3.288% 97.456% # ( 4, 6 ] 1845 1.928% 99.384% ( 6, 10 ] 457 0.478% 99.862% ( 10, 15 ] 100 0.105% 99.967% ( 15, 22 ] 13 0.014% 99.980% ( 22, 34 ] 1 0.001% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 3 0.003% 99.987% ( 380, 580 ] 4 0.004% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1900, 2900 ] 3 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 184948 Average: 3.3816 StdDev: 33.07 Min: 1 Median: 1.6547 Max: 3487 Percentiles: P50: 1.65 P75: 2.20 P99: 8.59 P99.9: 150.50 P99.99: 300.96 ------------------------------------------------------ [ 0, 1 ] 16891 9.133% 9.133% ## ( 1, 2 ] 115438 62.416% 71.549% ############ ( 2, 3 ] 31716 17.149% 88.698% ### ( 3, 4 ] 9211 4.980% 93.678% # ( 4, 6 ] 8031 4.342% 98.021% # ( 6, 10 ] 2796 1.512% 99.532% ( 10, 15 ] 377 0.204% 99.736% ( 15, 22 ] 65 0.035% 99.771% ( 22, 34 ] 15 0.008% 99.779% ( 34, 51 ] 4 0.002% 99.782% ( 51, 76 ] 8 0.004% 99.786% ( 76, 110 ] 72 0.039% 99.825% ( 110, 170 ] 206 0.111% 99.936% ( 170, 250 ] 85 0.046% 99.982% ( 250, 380 ] 37 0.020% 100.002% ( 380, 580 ] 45 0.024% 100.026% ( 580, 870 ] 22 0.012% 100.038% ( 870, 1300 ] 18 0.010% 100.048% ( 1300, 1900 ] 7 0.004% 100.052% ( 1900, 2900 ] 7 0.004% 100.056% ( 2900, 4400 ] 9 0.005% 100.061% ** Level 4 read latency histogram (micros): Count: 315 Average: 147.2095 StdDev: 568.42 Min: 1 Median: 2.0789 Max: 4231 Percentiles: P50: 2.08 P75: 6.60 P99: 3218.75 P99.9: 4231.00 P99.99: 4231.00 ------------------------------------------------------ [ 0, 1 ] 49 15.556% 15.556% ### ( 1, 2 ] 104 33.016% 48.571% ####### ( 2, 3 ] 57 18.095% 66.667% #### ( 3, 4 ] 11 3.492% 70.159% # ( 4, 6 ] 13 4.127% 74.286% # ( 6, 10 ] 15 4.762% 79.048% # ( 10, 15 ] 25 7.937% 86.984% ## ( 15, 22 ] 14 4.444% 91.429% # ( 110, 170 ] 1 0.317% 91.746% ( 380, 580 ] 3 0.952% 92.698% ( 580, 870 ] 1 0.317% 93.016% ( 870, 1300 ] 8 2.540% 95.556% # ( 1300, 1900 ] 7 2.222% 97.778% ( 1900, 2900 ] 3 0.952% 98.730% ( 2900, 4400 ] 4 1.270% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.607 H:M:S, 9.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.409 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/26-10:02:02 ... thread 0: (1000000,3000000) ops and (294974.5,322061.7) ops/second in (3.390124,9.314986) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.54 GB 44.1 1.0 0.0 1.0 3.8 2.8 0.0 1.4 86.3 314.7 12.41 11.27 43 0.289 1087K 1103 0.0 0.0 L1 3/3 180.27 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 229.0 228.5 4.42 4.26 2 2.208 1026K 2257 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 L3 23/0 942.91 MB 0.9 1.9 0.7 1.2 1.9 0.7 0.4 2.6 220.6 220.1 8.93 8.10 6 1.488 2000K 4107 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 147.4 147.5 1.52 1.13 1 1.523 227K 0 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/13 98.90 GB 0.0 4.5 2.1 2.4 7.3 4.9 3.3 2.6 161.6 259.8 28.79 26.22 54 0.533 4725K 7672 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 2.1 2.4 7.3 4.9 3.2 2.6 161.6 259.8 28.79 26.22 54 0.533 4725K 7672 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 2.1 2.4 4.5 2.1 0.0 0.0 226.8 226.4 20.52 19.01 15 1.368 4725K 7672 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 342.6 8.27 7.21 39 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.5 total, 9.3 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.31 GB write, 785.22 MB/s write, 4.54 GB read, 488.48 MB/s read, 28.8 seconds Interval compaction: 7.31 GB write, 802.94 MB/s write, 4.54 GB read, 499.51 MB/s read, 28.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 760397 Average: 2.3149 StdDev: 11.10 Min: 1 Median: 1.5620 Max: 4290 Percentiles: P50: 1.56 P75: 1.94 P99: 5.75 P99.9: 10.37 P99.99: 14.09 ------------------------------------------------------ [ 0, 1 ] 100294 13.190% 13.190% ### ( 1, 2 ] 498051 65.499% 78.689% ############# ( 2, 3 ] 97603 12.836% 91.524% ### ( 3, 4 ] 35677 4.692% 96.216% # ( 4, 6 ] 24138 3.174% 99.391% # ( 6, 10 ] 3808 0.501% 99.891% ( 10, 15 ] 920 0.121% 100.012% ( 15, 22 ] 104 0.014% 100.026% ( 22, 34 ] 11 0.001% 100.027% ( 34, 51 ] 6 0.001% 100.028% ( 51, 76 ] 5 0.001% 100.029% ( 76, 110 ] 13 0.002% 100.031% ( 110, 170 ] 10 0.001% 100.032% ( 170, 250 ] 21 0.003% 100.035% ( 250, 380 ] 18 0.002% 100.037% ( 380, 580 ] 11 0.001% 100.039% ( 580, 870 ] 9 0.001% 100.040% ( 870, 1300 ] 9 0.001% 100.041% ( 1300, 1900 ] 4 0.001% 100.041% ( 1900, 2900 ] 5 0.001% 100.042% ( 2900, 4400 ] 3 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 209482 Average: 2.7991 StdDev: 11.39 Min: 1 Median: 1.7634 Max: 3006 Percentiles: P50: 1.76 P75: 2.57 P99: 6.55 P99.9: 9.84 P99.99: 11.31 ------------------------------------------------------ [ 0, 1 ] 8817 4.209% 4.209% # ( 1, 2 ] 125648 59.980% 64.189% ############ ( 2, 3 ] 39845 19.021% 83.210% #### ( 3, 4 ] 17680 8.440% 91.650% ## ( 4, 6 ] 15079 7.198% 98.848% # ( 6, 10 ] 2294 1.095% 99.943% ( 10, 15 ] 374 0.179% 100.122% ( 15, 22 ] 70 0.033% 100.155% ( 22, 34 ] 5 0.002% 100.158% ( 34, 51 ] 2 0.001% 100.158% ( 51, 76 ] 1 0.000% 100.159% ( 76, 110 ] 26 0.012% 100.171% ( 110, 170 ] 22 0.011% 100.182% ( 170, 250 ] 14 0.007% 100.189% ( 250, 380 ] 20 0.010% 100.198% ( 380, 580 ] 11 0.005% 100.203% ( 580, 870 ] 5 0.002% 100.206% ( 870, 1300 ] 7 0.003% 100.209% ( 1300, 1900 ] 1 0.000% 100.210% ( 2900, 4400 ] 1 0.000% 100.210% ** Level 2 read latency histogram (micros): Count: 124238 Average: 3.2582 StdDev: 38.67 Min: 0 Median: 1.5047 Max: 3465 Percentiles: P50: 1.50 P75: 1.91 P99: 6.96 P99.9: 287.81 P99.99: 2271.75 ------------------------------------------------------ [ 0, 1 ] 23523 18.934% 18.934% #### ( 1, 2 ] 76474 61.554% 80.488% ############ ( 2, 3 ] 12672 10.200% 90.688% ## ( 3, 4 ] 5770 4.644% 95.332% # ( 4, 6 ] 4291 3.454% 98.786% # ( 6, 10 ] 1110 0.893% 99.680% ( 10, 15 ] 158 0.127% 99.807% ( 15, 22 ] 24 0.019% 99.826% ( 22, 34 ] 1 0.001% 99.827% ( 34, 51 ] 1 0.001% 99.828% ( 51, 76 ] 2 0.002% 99.829% ( 76, 110 ] 17 0.014% 99.843% ( 110, 170 ] 27 0.022% 99.865% ( 170, 250 ] 33 0.027% 99.891% ( 250, 380 ] 37 0.030% 99.921% ( 380, 580 ] 33 0.027% 99.948% ( 580, 870 ] 18 0.014% 99.962% ( 870, 1300 ] 18 0.014% 99.977% ( 1300, 1900 ] 11 0.009% 99.986% ( 1900, 2900 ] 15 0.012% 99.998% ( 2900, 4400 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 255432 Average: 3.3632 StdDev: 31.29 Min: 0 Median: 1.6456 Max: 3578 Percentiles: P50: 1.65 P75: 2.16 P99: 8.66 P99.9: 164.18 P99.99: 416.96 ------------------------------------------------------ [ 0, 1 ] 23248 9.101% 9.101% ## ( 1, 2 ] 161809 63.347% 72.449% ############# ( 2, 3 ] 40980 16.043% 88.492% ### ( 3, 4 ] 13322 5.215% 93.708% # ( 4, 6 ] 10859 4.251% 97.959% # ( 6, 10 ] 4004 1.568% 99.526% ( 10, 15 ] 457 0.179% 99.705% ( 15, 22 ] 82 0.032% 99.737% ( 22, 34 ] 19 0.007% 99.745% ( 34, 51 ] 4 0.002% 99.746% ( 51, 76 ] 13 0.005% 99.751% ( 76, 110 ] 115 0.045% 99.796% ( 110, 170 ] 293 0.115% 99.911% ( 170, 250 ] 133 0.052% 99.963% ( 250, 380 ] 57 0.022% 99.986% ( 380, 580 ] 62 0.024% 100.010% ( 580, 870 ] 36 0.014% 100.024% ( 870, 1300 ] 25 0.010% 100.034% ( 1300, 1900 ] 8 0.003% 100.037% ( 1900, 2900 ] 8 0.003% 100.040% ( 2900, 4400 ] 10 0.004% 100.044% ** Level 4 read latency histogram (micros): Count: 315 Average: 147.2095 StdDev: 568.42 Min: 1 Median: 2.0789 Max: 4231 Percentiles: P50: 2.08 P75: 6.60 P99: 3218.75 P99.9: 4231.00 P99.99: 4231.00 ------------------------------------------------------ [ 0, 1 ] 49 15.556% 15.556% ### ( 1, 2 ] 104 33.016% 48.571% ####### ( 2, 3 ] 57 18.095% 66.667% #### ( 3, 4 ] 11 3.492% 70.159% # ( 4, 6 ] 13 4.127% 74.286% # ( 6, 10 ] 15 4.762% 79.048% # ( 10, 15 ] 25 7.937% 86.984% ## ( 15, 22 ] 14 4.444% 91.429% # ( 110, 170 ] 1 0.317% 91.746% ( 380, 580 ] 3 0.952% 92.698% ( 580, 870 ] 1 0.317% 93.016% ( 870, 1300 ] 8 2.540% 95.556% # ( 1300, 1900 ] 7 2.222% 97.778% ( 1900, 2900 ] 3 0.952% 98.730% ( 2900, 4400 ] 4 1.270% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 756.1667 StdDev: 886.82 Min: 76 Median: 380.0000 Max: 3460 Percentiles: P50: 380.00 P75: 1042.00 P99: 3460.00 P99.9: 3460.00 P99.99: 3460.00 ------------------------------------------------------ ( 51, 76 ] 1 1.667% 1.667% ( 76, 110 ] 11 18.333% 20.000% #### ( 110, 170 ] 11 18.333% 38.333% #### ( 170, 250 ] 4 6.667% 45.000% # ( 250, 380 ] 3 5.000% 50.000% # ( 380, 580 ] 8 13.333% 63.333% ### ( 580, 870 ] 5 8.333% 71.667% ## ( 870, 1300 ] 5 8.333% 80.000% ## ( 1300, 1900 ] 5 8.333% 88.333% ## ( 1900, 2900 ] 4 6.667% 95.000% # ( 2900, 4400 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.5 total, 3.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 309.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.228 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 290.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.621 H:M:S, 18.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/26-10:02:05 ... thread 0: (1000000,4000000) ops and (321706.2,321972.7) ops/second in (3.108426,12.423412) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.66 GB 144.8 1.8 0.0 1.8 5.6 3.8 0.0 1.5 102.7 311.5 18.40 16.88 60 0.307 1918K 1973 0.0 0.0 L1 7/0 628.62 MB 62.9 2.0 1.8 0.2 2.0 1.8 0.2 1.1 228.8 228.0 9.06 8.72 3 3.020 2104K 7041 0.0 0.0 L2 4/3 428.14 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.3 2.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 L3 23/9 942.91 MB 0.4 1.9 0.7 1.2 1.9 0.7 0.4 2.6 220.6 220.1 8.93 8.10 6 1.488 2000K 4107 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 147.4 147.5 1.52 1.13 1 1.523 227K 0 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/16 99.88 GB 0.0 6.4 3.0 3.4 10.1 6.7 3.7 2.7 165.7 262.9 39.42 36.29 72 0.548 6635K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 3.0 3.4 10.1 6.7 3.6 2.7 165.7 262.9 39.42 36.29 72 0.548 6635K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 3.0 3.4 6.4 3.0 0.0 0.0 231.4 230.9 28.24 26.49 19 1.486 6635K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 343.6 11.19 9.80 53 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.6 total, 12.4 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.12 GB write, 820.19 MB/s write, 6.38 GB read, 517.15 MB/s read, 39.4 seconds Interval compaction: 10.12 GB write, 834.08 MB/s write, 6.38 GB read, 525.90 MB/s read, 39.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 19, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1063749 Average: 2.3234 StdDev: 11.17 Min: 1 Median: 1.5506 Max: 4290 Percentiles: P50: 1.55 P75: 1.93 P99: 5.78 P99.9: 11.02 P99.99: 14.69 ------------------------------------------------------ [ 0, 1 ] 146720 13.793% 13.793% ### ( 1, 2 ] 699495 65.758% 79.550% ############# ( 2, 3 ] 130662 12.283% 91.833% ## ( 3, 4 ] 47602 4.475% 96.308% # ( 4, 6 ] 32147 3.022% 99.330% # ( 6, 10 ] 5794 0.545% 99.875% ( 10, 15 ] 1305 0.123% 99.998% ( 15, 22 ] 137 0.013% 100.011% ( 22, 34 ] 14 0.001% 100.012% ( 34, 51 ] 6 0.001% 100.013% ( 51, 76 ] 8 0.001% 100.013% ( 76, 110 ] 46 0.004% 100.018% ( 110, 170 ] 67 0.006% 100.024% ( 170, 250 ] 50 0.005% 100.029% ( 250, 380 ] 39 0.004% 100.032% ( 380, 580 ] 25 0.002% 100.035% ( 580, 870 ] 21 0.002% 100.037% ( 870, 1300 ] 14 0.001% 100.038% ( 1300, 1900 ] 7 0.001% 100.039% ( 1900, 2900 ] 6 0.001% 100.039% ( 2900, 4400 ] 4 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 299804 Average: 2.8216 StdDev: 13.45 Min: 1 Median: 1.7264 Max: 3245 Percentiles: P50: 1.73 P75: 2.47 P99: 6.98 P99.9: 11.56 P99.99: 14.01 ------------------------------------------------------ [ 0, 1 ] 17563 5.858% 5.858% # ( 1, 2 ] 182182 60.767% 66.625% ############ ( 2, 3 ] 53954 17.996% 84.622% #### ( 3, 4 ] 22857 7.624% 92.246% ## ( 4, 6 ] 19429 6.481% 98.726% # ( 6, 10 ] 3349 1.117% 99.843% ( 10, 15 ] 550 0.183% 100.027% ( 15, 22 ] 98 0.033% 100.059% ( 22, 34 ] 8 0.003% 100.062% ( 34, 51 ] 3 0.001% 100.063% ( 51, 76 ] 4 0.001% 100.064% ( 76, 110 ] 102 0.034% 100.098% ( 110, 170 ] 65 0.022% 100.120% ( 170, 250 ] 30 0.010% 100.130% ( 250, 380 ] 39 0.013% 100.143% ( 380, 580 ] 25 0.008% 100.151% ( 580, 870 ] 12 0.004% 100.155% ( 870, 1300 ] 10 0.003% 100.159% ( 1300, 1900 ] 2 0.001% 100.159% ( 2900, 4400 ] 2 0.001% 100.160% ** Level 2 read latency histogram (micros): Count: 124238 Average: 3.2582 StdDev: 38.67 Min: 0 Median: 1.5047 Max: 3465 Percentiles: P50: 1.50 P75: 1.91 P99: 6.96 P99.9: 287.81 P99.99: 2271.75 ------------------------------------------------------ [ 0, 1 ] 23523 18.934% 18.934% #### ( 1, 2 ] 76474 61.554% 80.488% ############ ( 2, 3 ] 12672 10.200% 90.688% ## ( 3, 4 ] 5770 4.644% 95.332% # ( 4, 6 ] 4291 3.454% 98.786% # ( 6, 10 ] 1110 0.893% 99.680% ( 10, 15 ] 158 0.127% 99.807% ( 15, 22 ] 24 0.019% 99.826% ( 22, 34 ] 1 0.001% 99.827% ( 34, 51 ] 1 0.001% 99.828% ( 51, 76 ] 2 0.002% 99.829% ( 76, 110 ] 17 0.014% 99.843% ( 110, 170 ] 27 0.022% 99.865% ( 170, 250 ] 33 0.027% 99.891% ( 250, 380 ] 37 0.030% 99.921% ( 380, 580 ] 33 0.027% 99.948% ( 580, 870 ] 18 0.014% 99.962% ( 870, 1300 ] 18 0.014% 99.977% ( 1300, 1900 ] 11 0.009% 99.986% ( 1900, 2900 ] 15 0.012% 99.998% ( 2900, 4400 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 311480 Average: 3.4519 StdDev: 30.14 Min: 0 Median: 1.6814 Max: 3578 Percentiles: P50: 1.68 P75: 2.31 P99: 8.88 P99.9: 161.27 P99.99: 317.12 ------------------------------------------------------ [ 0, 1 ] 24658 7.916% 7.916% ## ( 1, 2 ] 192368 61.759% 69.676% ############ ( 2, 3 ] 53613 17.212% 86.888% ### ( 3, 4 ] 18314 5.880% 92.768% # ( 4, 6 ] 15671 5.031% 97.799% # ( 6, 10 ] 5200 1.669% 99.468% ( 10, 15 ] 679 0.218% 99.686% ( 15, 22 ] 122 0.039% 99.726% ( 22, 34 ] 21 0.007% 99.732% ( 34, 51 ] 5 0.002% 99.734% ( 51, 76 ] 15 0.005% 99.739% ( 76, 110 ] 165 0.053% 99.792% ( 110, 170 ] 395 0.127% 99.918% ( 170, 250 ] 180 0.058% 99.976% ( 250, 380 ] 83 0.027% 100.003% ( 380, 580 ] 79 0.025% 100.028% ( 580, 870 ] 45 0.014% 100.043% ( 870, 1300 ] 26 0.008% 100.051% ( 1300, 1900 ] 8 0.003% 100.054% ( 1900, 2900 ] 9 0.003% 100.057% ( 2900, 4400 ] 11 0.004% 100.060% ** Level 4 read latency histogram (micros): Count: 315 Average: 147.2095 StdDev: 568.42 Min: 1 Median: 2.0789 Max: 4231 Percentiles: P50: 2.08 P75: 6.60 P99: 3218.75 P99.9: 4231.00 P99.99: 4231.00 ------------------------------------------------------ [ 0, 1 ] 49 15.556% 15.556% ### ( 1, 2 ] 104 33.016% 48.571% ####### ( 2, 3 ] 57 18.095% 66.667% #### ( 3, 4 ] 11 3.492% 70.159% # ( 4, 6 ] 13 4.127% 74.286% # ( 6, 10 ] 15 4.762% 79.048% # ( 10, 15 ] 25 7.937% 86.984% ## ( 15, 22 ] 14 4.444% 91.429% # ( 110, 170 ] 1 0.317% 91.746% ( 380, 580 ] 3 0.952% 92.698% ( 580, 870 ] 1 0.317% 93.016% ( 870, 1300 ] 8 2.540% 95.556% # ( 1300, 1900 ] 7 2.222% 97.778% ( 1900, 2900 ] 3 0.952% 98.730% ( 2900, 4400 ] 4 1.270% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 756.1667 StdDev: 886.82 Min: 76 Median: 380.0000 Max: 3460 Percentiles: P50: 380.00 P75: 1042.00 P99: 3460.00 P99.9: 3460.00 P99.99: 3460.00 ------------------------------------------------------ ( 51, 76 ] 1 1.667% 1.667% ( 76, 110 ] 11 18.333% 20.000% #### ( 110, 170 ] 11 18.333% 38.333% #### ( 170, 250 ] 4 6.667% 45.000% # ( 250, 380 ] 3 5.000% 50.000% # ( 380, 580 ] 8 13.333% 63.333% ### ( 580, 870 ] 5 8.333% 71.667% ## ( 870, 1300 ] 5 8.333% 80.000% ## ( 1300, 1900 ] 5 8.333% 88.333% ## ( 1900, 2900 ] 4 6.667% 95.000% # ( 2900, 4400 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.6 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 311.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.694 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.466 H:M:S, 15.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/26-10:02:08 ... thread 0: (1000000,5000000) ops and (320079.0,321592.2) ops/second in (3.124229,15.547641) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/13 2.64 GB 62.9 2.6 0.0 2.6 7.4 4.7 0.0 1.6 110.7 308.7 24.48 22.56 77 0.318 2750K 2857 0.0 0.0 L1 7/7 628.62 MB 0.0 2.0 1.8 0.2 2.0 1.8 0.2 1.1 228.8 228.0 9.06 8.72 3 3.020 2104K 7041 0.0 0.0 L2 1/0 51.00 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.3 2.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 L3 25/0 991.76 MB 1.0 2.8 1.1 1.7 2.8 1.1 0.4 2.5 217.7 217.1 13.14 12.04 9 1.460 2905K 8021 0.0 0.0 L4 174/0 9.53 GB 1.0 0.5 0.4 0.0 0.5 0.4 0.8 1.1 161.7 161.5 3.00 2.40 5 0.599 492K 583 0.0 0.0 L5 1060/0 87.05 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/20 100.85 GB 0.0 8.3 3.6 4.7 13.0 8.3 4.1 2.7 166.1 260.5 51.19 47.19 96 0.533 8636K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.3 3.6 4.7 13.0 8.3 4.0 2.7 166.1 260.5 51.19 47.19 96 0.533 8636K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.3 3.6 4.7 8.3 3.6 0.0 0.0 229.1 228.6 37.13 34.84 29 1.280 8636K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 344.8 14.07 12.35 67 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.5 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.02 GB write, 846.26 MB/s write, 8.31 GB read, 539.68 MB/s read, 51.2 seconds Interval compaction: 13.02 GB write, 857.70 MB/s write, 8.31 GB read, 546.98 MB/s read, 51.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 23, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1401808 Average: 2.3332 StdDev: 11.27 Min: 1 Median: 1.5532 Max: 4290 Percentiles: P50: 1.55 P75: 1.93 P99: 5.79 P99.9: 10.89 P99.99: 14.62 ------------------------------------------------------ [ 0, 1 ] 187449 13.372% 13.372% ### ( 1, 2 ] 928148 66.211% 79.583% ############# ( 2, 3 ] 172874 12.332% 91.915% ## ( 3, 4 ] 62145 4.433% 96.348% # ( 4, 6 ] 41516 2.962% 99.310% # ( 6, 10 ] 7973 0.569% 99.879% ( 10, 15 ] 1693 0.121% 99.999% ( 15, 22 ] 169 0.012% 100.011% ( 22, 34 ] 17 0.001% 100.013% ( 34, 51 ] 9 0.001% 100.013% ( 51, 76 ] 9 0.001% 100.014% ( 76, 110 ] 79 0.006% 100.019% ( 110, 170 ] 97 0.007% 100.026% ( 170, 250 ] 74 0.005% 100.032% ( 250, 380 ] 51 0.004% 100.035% ( 380, 580 ] 35 0.002% 100.038% ( 580, 870 ] 30 0.002% 100.040% ( 870, 1300 ] 17 0.001% 100.041% ( 1300, 1900 ] 10 0.001% 100.042% ( 1900, 2900 ] 11 0.001% 100.043% ( 2900, 4400 ] 4 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 350866 Average: 2.8370 StdDev: 13.27 Min: 1 Median: 1.7302 Max: 3245 Percentiles: P50: 1.73 P75: 2.47 P99: 7.10 P99.9: 11.90 P99.99: 14.27 ------------------------------------------------------ [ 0, 1 ] 19451 5.544% 5.544% # ( 1, 2 ] 213619 60.883% 66.427% ############ ( 2, 3 ] 64238 18.308% 84.735% #### ( 3, 4 ] 26573 7.574% 92.309% ## ( 4, 6 ] 22377 6.378% 98.687% # ( 6, 10 ] 4005 1.141% 99.828% ( 10, 15 ] 665 0.190% 100.018% ( 15, 22 ] 116 0.033% 100.051% ( 22, 34 ] 10 0.003% 100.054% ( 34, 51 ] 3 0.001% 100.054% ( 51, 76 ] 4 0.001% 100.056% ( 76, 110 ] 115 0.033% 100.088% ( 110, 170 ] 80 0.023% 100.111% ( 170, 250 ] 40 0.011% 100.123% ( 250, 380 ] 52 0.015% 100.137% ( 380, 580 ] 32 0.009% 100.146% ( 580, 870 ] 15 0.004% 100.151% ( 870, 1300 ] 12 0.003% 100.154% ( 1300, 1900 ] 2 0.001% 100.155% ( 2900, 4400 ] 2 0.001% 100.155% ** Level 2 read latency histogram (micros): Count: 124238 Average: 3.2582 StdDev: 38.67 Min: 0 Median: 1.5047 Max: 3465 Percentiles: P50: 1.50 P75: 1.91 P99: 6.96 P99.9: 287.81 P99.99: 2271.75 ------------------------------------------------------ [ 0, 1 ] 23523 18.934% 18.934% #### ( 1, 2 ] 76474 61.554% 80.488% ############ ( 2, 3 ] 12672 10.200% 90.688% ## ( 3, 4 ] 5770 4.644% 95.332% # ( 4, 6 ] 4291 3.454% 98.786% # ( 6, 10 ] 1110 0.893% 99.680% ( 10, 15 ] 158 0.127% 99.807% ( 15, 22 ] 24 0.019% 99.826% ( 22, 34 ] 1 0.001% 99.827% ( 34, 51 ] 1 0.001% 99.828% ( 51, 76 ] 2 0.002% 99.829% ( 76, 110 ] 17 0.014% 99.843% ( 110, 170 ] 27 0.022% 99.865% ( 170, 250 ] 33 0.027% 99.891% ( 250, 380 ] 37 0.030% 99.921% ( 380, 580 ] 33 0.027% 99.948% ( 580, 870 ] 18 0.014% 99.962% ( 870, 1300 ] 18 0.014% 99.977% ( 1300, 1900 ] 11 0.009% 99.986% ( 1900, 2900 ] 15 0.012% 99.998% ( 2900, 4400 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 443771 Average: 3.3321 StdDev: 25.96 Min: 0 Median: 1.7242 Max: 3578 Percentiles: P50: 1.72 P75: 2.44 P99: 8.74 P99.9: 120.33 P99.99: 185.22 ------------------------------------------------------ [ 0, 1 ] 28357 6.390% 6.390% # ( 1, 2 ] 267246 60.222% 66.612% ############ ( 2, 3 ] 83816 18.887% 85.499% #### ( 3, 4 ] 29515 6.651% 92.150% # ( 4, 6 ] 25230 5.685% 97.835% # ( 6, 10 ] 7550 1.701% 99.536% ( 10, 15 ] 1119 0.252% 99.789% ( 15, 22 ] 186 0.042% 99.831% ( 22, 34 ] 23 0.005% 99.836% ( 34, 51 ] 6 0.001% 99.837% ( 51, 76 ] 15 0.003% 99.840% ( 76, 110 ] 190 0.043% 99.883% ( 110, 170 ] 431 0.097% 99.980% ( 170, 250 ] 224 0.050% 100.031% ( 250, 380 ] 112 0.025% 100.056% ( 380, 580 ] 94 0.021% 100.077% ( 580, 870 ] 52 0.012% 100.089% ( 870, 1300 ] 30 0.007% 100.096% ( 1300, 1900 ] 8 0.002% 100.098% ( 1900, 2900 ] 9 0.002% 100.100% ( 2900, 4400 ] 11 0.002% 100.102% ** Level 4 read latency histogram (micros): Count: 8086 Average: 23.1819 StdDev: 135.00 Min: 1 Median: 1.9014 Max: 4231 Percentiles: P50: 1.90 P75: 3.02 P99: 474.19 P99.9: 1721.20 P99.99: 3721.77 ------------------------------------------------------ [ 0, 1 ] 349 4.316% 4.316% # ( 1, 2 ] 4098 50.680% 54.996% ########## ( 2, 3 ] 1603 19.824% 74.821% #### ( 3, 4 ] 791 9.782% 84.603% ## ( 4, 6 ] 435 5.380% 89.983% # ( 6, 10 ] 183 2.263% 92.246% ( 10, 15 ] 57 0.705% 92.951% ( 15, 22 ] 17 0.210% 93.161% ( 22, 34 ] 5 0.062% 93.223% ( 76, 110 ] 114 1.410% 94.633% ( 110, 170 ] 174 2.152% 96.785% ( 170, 250 ] 65 0.804% 97.588% ( 250, 380 ] 84 1.039% 98.627% ( 380, 580 ] 64 0.791% 99.419% ( 580, 870 ] 22 0.272% 99.691% ( 870, 1300 ] 12 0.148% 99.839% ( 1300, 1900 ] 7 0.087% 99.926% ( 1900, 2900 ] 3 0.037% 99.963% ( 2900, 4400 ] 4 0.049% 100.012% ** Level 5 read latency histogram (micros): Count: 80 Average: 745.9625 StdDev: 903.01 Min: 76 Median: 302.0000 Max: 3460 Percentiles: P50: 302.00 P75: 956.00 P99: 3460.00 P99.9: 3460.00 P99.99: 3460.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 13 16.250% 17.500% ### ( 110, 170 ] 16 20.000% 37.500% #### ( 170, 250 ] 8 10.000% 47.500% ## ( 250, 380 ] 5 6.250% 53.750% # ( 380, 580 ] 9 11.250% 65.000% ## ( 580, 870 ] 7 8.750% 73.750% ## ( 870, 1300 ] 5 6.250% 80.000% # ( 1300, 1900 ] 6 7.500% 87.500% ## ( 1900, 2900 ] 6 7.500% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.8 total, 3.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 312.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.145 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.450 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/26-10:02:12 ... thread 0: (1000000,6000000) ops and (270965.0,311880.2) ops/second in (3.690513,19.238154) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.56 GB 163.6 3.7 0.0 3.7 9.3 5.7 0.0 1.7 121.0 306.4 31.24 28.90 96 0.325 3837K 3960 0.0 0.0 L1 7/7 628.62 MB 0.0 2.0 1.8 0.2 2.0 1.8 0.2 1.1 228.8 228.0 9.06 8.72 3 3.020 2104K 7041 0.0 0.0 L2 1/0 51.00 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.3 2.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 L3 25/0 991.76 MB 1.0 2.8 1.1 1.7 2.8 1.1 0.4 2.5 217.7 217.1 13.14 12.04 9 1.460 2905K 8021 0.0 0.0 L4 174/0 9.53 GB 1.0 0.5 0.4 0.0 0.5 0.4 0.8 1.1 161.7 161.5 3.00 2.40 5 0.599 492K 583 0.0 0.0 L5 1060/0 87.05 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/20 101.78 GB 0.0 9.4 3.6 5.8 15.0 9.2 4.1 2.6 165.2 264.9 57.95 53.53 115 0.504 9724K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.4 3.6 5.8 15.0 9.2 4.0 2.6 165.2 264.9 57.95 53.53 115 0.504 9724K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.4 3.6 5.8 9.3 3.6 0.0 0.0 232.4 231.9 41.20 38.83 33 1.248 9724K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 346.0 16.75 14.70 82 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.5 total, 19.2 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.99 GB write, 789.27 MB/s write, 9.35 GB read, 492.34 MB/s read, 58.0 seconds Interval compaction: 14.99 GB write, 797.90 MB/s write, 9.35 GB read, 497.72 MB/s read, 58.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 23, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1827438 Average: 2.3331 StdDev: 12.47 Min: 1 Median: 1.5430 Max: 4771 Percentiles: P50: 1.54 P75: 1.92 P99: 5.78 P99.9: 10.84 P99.99: 14.96 ------------------------------------------------------ [ 0, 1 ] 251614 13.769% 13.769% ### ( 1, 2 ] 1219418 66.728% 80.497% ############# ( 2, 3 ] 217006 11.875% 92.372% ## ( 3, 4 ] 76974 4.212% 96.584% # ( 4, 6 ] 49661 2.718% 99.301% # ( 6, 10 ] 10604 0.580% 99.882% ( 10, 15 ] 1994 0.109% 99.991% ( 15, 22 ] 219 0.012% 100.003% ( 22, 34 ] 30 0.002% 100.004% ( 34, 51 ] 16 0.001% 100.005% ( 51, 76 ] 12 0.001% 100.006% ( 76, 110 ] 140 0.008% 100.014% ( 110, 170 ] 173 0.009% 100.023% ( 170, 250 ] 127 0.007% 100.030% ( 250, 380 ] 64 0.004% 100.034% ( 380, 580 ] 58 0.003% 100.037% ( 580, 870 ] 42 0.002% 100.039% ( 870, 1300 ] 26 0.001% 100.040% ( 1300, 1900 ] 13 0.001% 100.041% ( 1900, 2900 ] 16 0.001% 100.042% ( 2900, 4400 ] 6 0.000% 100.042% ( 4400, 6600 ] 1 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 401360 Average: 2.8153 StdDev: 13.64 Min: 1 Median: 1.6995 Max: 3245 Percentiles: P50: 1.70 P75: 2.37 P99: 7.20 P99.9: 12.71 P99.99: 16.93 ------------------------------------------------------ [ 0, 1 ] 27001 6.727% 6.727% # ( 1, 2 ] 248273 61.858% 68.585% ############ ( 2, 3 ] 69244 17.252% 85.838% ### ( 3, 4 ] 28083 6.997% 92.835% # ( 4, 6 ] 23358 5.820% 98.654% # ( 6, 10 ] 4612 1.149% 99.803% ( 10, 15 ] 715 0.178% 99.982% ( 15, 22 ] 123 0.031% 100.012% ( 22, 34 ] 11 0.003% 100.015% ( 34, 51 ] 3 0.001% 100.016% ( 51, 76 ] 4 0.001% 100.017% ( 76, 110 ] 140 0.035% 100.052% ( 110, 170 ] 146 0.036% 100.088% ( 170, 250 ] 53 0.013% 100.101% ( 250, 380 ] 62 0.015% 100.117% ( 380, 580 ] 42 0.010% 100.127% ( 580, 870 ] 18 0.004% 100.132% ( 870, 1300 ] 12 0.003% 100.135% ( 1300, 1900 ] 2 0.000% 100.135% ( 1900, 2900 ] 1 0.000% 100.135% ( 2900, 4400 ] 2 0.000% 100.136% ** Level 2 read latency histogram (micros): Count: 124238 Average: 3.2582 StdDev: 38.67 Min: 0 Median: 1.5047 Max: 3465 Percentiles: P50: 1.50 P75: 1.91 P99: 6.96 P99.9: 287.81 P99.99: 2271.75 ------------------------------------------------------ [ 0, 1 ] 23523 18.934% 18.934% #### ( 1, 2 ] 76474 61.554% 80.488% ############ ( 2, 3 ] 12672 10.200% 90.688% ## ( 3, 4 ] 5770 4.644% 95.332% # ( 4, 6 ] 4291 3.454% 98.786% # ( 6, 10 ] 1110 0.893% 99.680% ( 10, 15 ] 158 0.127% 99.807% ( 15, 22 ] 24 0.019% 99.826% ( 22, 34 ] 1 0.001% 99.827% ( 34, 51 ] 1 0.001% 99.828% ( 51, 76 ] 2 0.002% 99.829% ( 76, 110 ] 17 0.014% 99.843% ( 110, 170 ] 27 0.022% 99.865% ( 170, 250 ] 33 0.027% 99.891% ( 250, 380 ] 37 0.030% 99.921% ( 380, 580 ] 33 0.027% 99.948% ( 580, 870 ] 18 0.014% 99.962% ( 870, 1300 ] 18 0.014% 99.977% ( 1300, 1900 ] 11 0.009% 99.986% ( 1900, 2900 ] 15 0.012% 99.998% ( 2900, 4400 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 443771 Average: 3.3321 StdDev: 25.96 Min: 0 Median: 1.7242 Max: 3578 Percentiles: P50: 1.72 P75: 2.44 P99: 8.74 P99.9: 120.33 P99.99: 185.22 ------------------------------------------------------ [ 0, 1 ] 28357 6.390% 6.390% # ( 1, 2 ] 267246 60.222% 66.612% ############ ( 2, 3 ] 83816 18.887% 85.499% #### ( 3, 4 ] 29515 6.651% 92.150% # ( 4, 6 ] 25230 5.685% 97.835% # ( 6, 10 ] 7550 1.701% 99.536% ( 10, 15 ] 1119 0.252% 99.789% ( 15, 22 ] 186 0.042% 99.831% ( 22, 34 ] 23 0.005% 99.836% ( 34, 51 ] 6 0.001% 99.837% ( 51, 76 ] 15 0.003% 99.840% ( 76, 110 ] 190 0.043% 99.883% ( 110, 170 ] 431 0.097% 99.980% ( 170, 250 ] 224 0.050% 100.031% ( 250, 380 ] 112 0.025% 100.056% ( 380, 580 ] 94 0.021% 100.077% ( 580, 870 ] 52 0.012% 100.089% ( 870, 1300 ] 30 0.007% 100.096% ( 1300, 1900 ] 8 0.002% 100.098% ( 1900, 2900 ] 9 0.002% 100.100% ( 2900, 4400 ] 11 0.002% 100.102% ** Level 4 read latency histogram (micros): Count: 8086 Average: 23.1819 StdDev: 135.00 Min: 1 Median: 1.9014 Max: 4231 Percentiles: P50: 1.90 P75: 3.02 P99: 474.19 P99.9: 1721.20 P99.99: 3721.77 ------------------------------------------------------ [ 0, 1 ] 349 4.316% 4.316% # ( 1, 2 ] 4098 50.680% 54.996% ########## ( 2, 3 ] 1603 19.824% 74.821% #### ( 3, 4 ] 791 9.782% 84.603% ## ( 4, 6 ] 435 5.380% 89.983% # ( 6, 10 ] 183 2.263% 92.246% ( 10, 15 ] 57 0.705% 92.951% ( 15, 22 ] 17 0.210% 93.161% ( 22, 34 ] 5 0.062% 93.223% ( 76, 110 ] 114 1.410% 94.633% ( 110, 170 ] 174 2.152% 96.785% ( 170, 250 ] 65 0.804% 97.588% ( 250, 380 ] 84 1.039% 98.627% ( 380, 580 ] 64 0.791% 99.419% ( 580, 870 ] 22 0.272% 99.691% ( 870, 1300 ] 12 0.148% 99.839% ( 1300, 1900 ] 7 0.087% 99.926% ( 1900, 2900 ] 3 0.037% 99.963% ( 2900, 4400 ] 4 0.049% 100.012% ** Level 5 read latency histogram (micros): Count: 80 Average: 745.9625 StdDev: 903.01 Min: 76 Median: 302.0000 Max: 3460 Percentiles: P50: 302.00 P75: 956.00 P99: 3460.00 P99.9: 3460.00 P99.99: 3460.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 13 16.250% 17.500% ### ( 110, 170 ] 16 20.000% 37.500% #### ( 170, 250 ] 8 10.000% 47.500% ## ( 250, 380 ] 5 6.250% 53.750% # ( 380, 580 ] 9 11.250% 65.000% ## ( 580, 870 ] 7 8.750% 73.750% ## ( 870, 1300 ] 5 6.250% 80.000% # ( 1300, 1900 ] 6 7.500% 87.500% ## ( 1900, 2900 ] 6 7.500% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 19.5 total, 3.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 303.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.102 H:M:S, 15.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 266.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.957 H:M:S, 25.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/26-10:02:20 ... thread 0: (1000000,7000000) ops and (130737.6,260348.3) ops/second in (7.648909,26.887063) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/6 2.77 GB 151.1 4.4 0.0 4.4 11.0 6.6 0.0 1.7 116.5 289.5 38.93 34.29 112 0.348 4605K 4709 0.0 0.0 L1 5/0 584.28 MB 58.4 4.4 3.6 0.8 4.3 3.5 0.2 1.2 227.7 226.0 19.60 18.87 4 4.901 4532K 32K 0.0 0.0 L2 6/6 772.66 MB 0.0 0.4 0.2 0.2 0.4 0.2 3.0 2.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 L3 44/20 1.94 GB 1.0 4.7 2.1 2.6 4.7 2.1 0.4 2.2 179.1 178.4 26.95 21.18 17 1.585 4902K 18K 0.0 0.0 L4 175/3 9.59 GB 1.0 0.5 0.5 0.0 0.5 0.5 0.8 1.1 154.7 154.5 3.51 2.68 6 0.586 548K 583 0.0 0.0 L5 1060/0 87.05 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/35 102.66 GB 0.0 14.4 6.4 8.0 20.9 12.9 5.8 3.2 162.9 236.8 90.52 78.48 141 0.642 14M 56K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.4 6.4 8.0 20.9 12.9 5.7 3.2 162.9 236.8 90.52 78.48 141 0.642 14M 56K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.4 6.4 8.0 14.3 6.3 0.0 0.0 213.0 212.2 69.22 61.24 46 1.505 14M 56K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 316.5 21.30 17.24 95 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.1 total, 26.9 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.93 GB write, 790.86 MB/s write, 14.40 GB read, 544.23 MB/s read, 90.5 seconds Interval compaction: 20.93 GB write, 797.05 MB/s write, 14.40 GB read, 548.48 MB/s read, 90.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 32, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2460845 Average: 2.5074 StdDev: 20.32 Min: 1 Median: 1.5594 Max: 6392 Percentiles: P50: 1.56 P75: 1.94 P99: 5.95 P99.9: 12.35 P99.99: 89.56 ------------------------------------------------------ [ 0, 1 ] 327434 13.306% 13.306% ### ( 1, 2 ] 1614214 65.596% 78.902% ############# ( 2, 3 ] 301556 12.254% 91.156% ## ( 3, 4 ] 113937 4.630% 95.786% # ( 4, 6 ] 81198 3.300% 99.085% # ( 6, 10 ] 18545 0.754% 99.839% ( 10, 15 ] 3193 0.130% 99.969% ( 15, 22 ] 352 0.014% 99.983% ( 22, 34 ] 39 0.002% 99.985% ( 34, 51 ] 18 0.001% 99.985% ( 51, 76 ] 13 0.001% 99.986% ( 76, 110 ] 253 0.010% 99.996% ( 110, 170 ] 278 0.011% 100.008% ( 170, 250 ] 165 0.007% 100.014% ( 250, 380 ] 116 0.005% 100.019% ( 380, 580 ] 134 0.005% 100.024% ( 580, 870 ] 107 0.004% 100.029% ( 870, 1300 ] 99 0.004% 100.033% ( 1300, 1900 ] 38 0.002% 100.034% ( 1900, 2900 ] 39 0.002% 100.036% ( 2900, 4400 ] 23 0.001% 100.037% ( 4400, 6600 ] 7 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 949768 Average: 4.6482 StdDev: 72.20 Min: 1 Median: 1.7942 Max: 7933 Percentiles: P50: 1.79 P75: 2.68 P99: 8.59 P99.9: 14.36 P99.99: 79.87 ------------------------------------------------------ [ 0, 1 ] 48849 5.143% 5.143% # ( 1, 2 ] 536465 56.484% 61.627% ########### ( 2, 3 ] 186685 19.656% 81.283% #### ( 3, 4 ] 80943 8.522% 89.805% ## ( 4, 6 ] 76082 8.011% 97.816% ## ( 6, 10 ] 17336 1.825% 99.641% ( 10, 15 ] 2821 0.297% 99.938% ( 15, 22 ] 382 0.040% 99.978% ( 22, 34 ] 45 0.005% 99.983% ( 34, 51 ] 16 0.002% 99.985% ( 51, 76 ] 17 0.002% 99.987% ( 76, 110 ] 281 0.030% 100.016% ( 110, 170 ] 302 0.032% 100.048% ( 170, 250 ] 138 0.015% 100.063% ( 250, 380 ] 209 0.022% 100.085% ( 380, 580 ] 249 0.026% 100.111% ( 580, 870 ] 219 0.023% 100.134% ( 870, 1300 ] 159 0.017% 100.151% ( 1300, 1900 ] 88 0.009% 100.160% ( 1900, 2900 ] 117 0.012% 100.172% ( 2900, 4400 ] 149 0.016% 100.188% ( 4400, 6600 ] 39 0.004% 100.192% ( 6600, 9900 ] 13 0.001% 100.193% ** Level 2 read latency histogram (micros): Count: 124238 Average: 3.2582 StdDev: 38.67 Min: 0 Median: 1.5047 Max: 3465 Percentiles: P50: 1.50 P75: 1.91 P99: 6.96 P99.9: 287.81 P99.99: 2271.75 ------------------------------------------------------ [ 0, 1 ] 23523 18.934% 18.934% #### ( 1, 2 ] 76474 61.554% 80.488% ############ ( 2, 3 ] 12672 10.200% 90.688% ## ( 3, 4 ] 5770 4.644% 95.332% # ( 4, 6 ] 4291 3.454% 98.786% # ( 6, 10 ] 1110 0.893% 99.680% ( 10, 15 ] 158 0.127% 99.807% ( 15, 22 ] 24 0.019% 99.826% ( 22, 34 ] 1 0.001% 99.827% ( 34, 51 ] 1 0.001% 99.828% ( 51, 76 ] 2 0.002% 99.829% ( 76, 110 ] 17 0.014% 99.843% ( 110, 170 ] 27 0.022% 99.865% ( 170, 250 ] 33 0.027% 99.891% ( 250, 380 ] 37 0.030% 99.921% ( 380, 580 ] 33 0.027% 99.948% ( 580, 870 ] 18 0.014% 99.962% ( 870, 1300 ] 18 0.014% 99.977% ( 1300, 1900 ] 11 0.009% 99.986% ( 1900, 2900 ] 15 0.012% 99.998% ( 2900, 4400 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 826884 Average: 5.3571 StdDev: 77.62 Min: 0 Median: 1.8410 Max: 14379 Percentiles: P50: 1.84 P75: 2.76 P99: 9.20 P99.9: 162.58 P99.99: 343.47 ------------------------------------------------------ [ 0, 1 ] 32676 3.952% 3.952% # ( 1, 2 ] 452736 54.752% 58.704% ########### ( 2, 3 ] 178238 21.555% 80.259% #### ( 3, 4 ] 72740 8.797% 89.056% ## ( 4, 6 ] 68869 8.329% 97.385% ## ( 6, 10 ] 16706 2.020% 99.405% ( 10, 15 ] 2945 0.356% 99.761% ( 15, 22 ] 411 0.050% 99.811% ( 22, 34 ] 43 0.005% 99.816% ( 34, 51 ] 12 0.001% 99.818% ( 51, 76 ] 22 0.003% 99.820% ( 76, 110 ] 200 0.024% 99.844% ( 110, 170 ] 525 0.063% 99.908% ( 170, 250 ] 414 0.050% 99.958% ( 250, 380 ] 369 0.045% 100.003% ( 380, 580 ] 402 0.049% 100.051% ( 580, 870 ] 303 0.037% 100.088% ( 870, 1300 ] 195 0.024% 100.112% ( 1300, 1900 ] 112 0.014% 100.125% ( 1900, 2900 ] 107 0.013% 100.138% ( 2900, 4400 ] 153 0.019% 100.156% ( 4400, 6600 ] 35 0.004% 100.161% ( 6600, 9900 ] 8 0.001% 100.162% ( 14000, 22000 ] 1 0.000% 100.162% ** Level 4 read latency histogram (micros): Count: 9766 Average: 47.8250 StdDev: 262.90 Min: 1 Median: 1.9314 Max: 5836 Percentiles: P50: 1.93 P75: 3.20 P99: 1115.10 P99.9: 3852.13 P99.99: 4425.74 ------------------------------------------------------ [ 0, 1 ] 401 4.106% 4.106% # ( 1, 2 ] 4812 49.273% 53.379% ########## ( 2, 3 ] 1914 19.599% 72.978% #### ( 3, 4 ] 976 9.994% 82.972% ## ( 4, 6 ] 547 5.601% 88.573% # ( 6, 10 ] 221 2.263% 90.836% ( 10, 15 ] 65 0.666% 91.501% ( 15, 22 ] 19 0.195% 91.696% ( 22, 34 ] 5 0.051% 91.747% ( 76, 110 ] 117 1.198% 92.945% ( 110, 170 ] 182 1.864% 94.809% ( 170, 250 ] 80 0.819% 95.628% ( 250, 380 ] 108 1.106% 96.734% ( 380, 580 ] 110 1.126% 97.860% ( 580, 870 ] 76 0.778% 98.638% ( 870, 1300 ] 62 0.635% 99.273% ( 1300, 1900 ] 31 0.317% 99.590% ( 1900, 2900 ] 15 0.154% 99.744% ( 2900, 4400 ] 24 0.246% 99.990% ( 4400, 6600 ] 2 0.020% 100.010% ** Level 5 read latency histogram (micros): Count: 80 Average: 745.9625 StdDev: 903.01 Min: 76 Median: 302.0000 Max: 3460 Percentiles: P50: 302.00 P75: 956.00 P99: 3460.00 P99.9: 3460.00 P99.99: 3460.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 13 16.250% 17.500% ### ( 110, 170 ] 16 20.000% 37.500% #### ( 170, 250 ] 8 10.000% 47.500% ## ( 250, 380 ] 5 6.250% 53.750% # ( 380, 580 ] 9 11.250% 65.000% ## ( 580, 870 ] 7 8.750% 73.750% ## ( 870, 1300 ] 5 6.250% 80.000% # ( 1300, 1900 ] 6 7.500% 87.500% ## ( 1900, 2900 ] 6 7.500% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 27.1 total, 7.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 254.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.584 H:M:S, 28.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 128.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.482 H:M:S, 58.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/26-10:02:24 ... thread 0: (1000000,8000000) ops and (238026.7,257331.8) ops/second in (4.201209,31.088272) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 3.74 GB 56.7 6.3 0.0 6.3 13.9 7.6 0.0 1.8 125.8 275.8 51.57 44.58 128 0.403 6587K 12K 0.0 0.0 L1 5/5 584.28 MB 0.0 4.4 3.6 0.8 4.3 3.5 0.2 1.2 227.7 226.0 19.60 18.87 4 4.901 4532K 32K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.0 2.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 L3 24/0 972.97 MB 1.0 6.3 2.9 3.4 6.2 2.9 0.4 2.2 165.9 165.2 38.64 28.45 23 1.680 6509K 26K 0.0 0.0 L4 186/0 9.66 GB 1.0 2.4 2.2 0.2 2.4 2.2 0.8 1.1 138.8 138.5 17.61 11.49 38 0.463 2369K 1162 0.0 0.0 L5 1080/0 88.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1311/17 103.63 GB 0.0 19.7 8.9 10.8 27.2 16.4 7.5 3.6 156.5 216.0 128.94 104.85 195 0.661 20M 73K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.7 8.9 10.8 27.2 16.4 7.4 3.6 156.5 216.0 128.94 104.85 195 0.661 20M 73K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.7 8.9 10.8 19.6 8.8 0.0 0.0 194.6 193.8 103.72 84.99 87 1.192 20M 73K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 307.2 25.22 19.87 108 0.234 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.3 total, 31.1 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.20 GB write, 889.89 MB/s write, 19.71 GB read, 644.82 MB/s read, 128.9 seconds Interval compaction: 27.20 GB write, 895.91 MB/s write, 19.71 GB read, 649.18 MB/s read, 128.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 61, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 61, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2764518 Average: 2.6277 StdDev: 24.61 Min: 0 Median: 1.5666 Max: 9411 Percentiles: P50: 1.57 P75: 1.95 P99: 6.00 P99.9: 13.07 P99.99: 143.21 ------------------------------------------------------ [ 0, 1 ] 363332 13.143% 13.143% ### ( 1, 2 ] 1798456 65.055% 78.198% ############# ( 2, 3 ] 346298 12.527% 90.724% ### ( 3, 4 ] 131337 4.751% 95.475% # ( 4, 6 ] 97464 3.526% 99.001% # ( 6, 10 ] 22448 0.812% 99.813% ( 10, 15 ] 3940 0.143% 99.955% ( 15, 22 ] 439 0.016% 99.971% ( 22, 34 ] 43 0.002% 99.972% ( 34, 51 ] 19 0.001% 99.973% ( 51, 76 ] 15 0.001% 99.974% ( 76, 110 ] 272 0.010% 99.984% ( 110, 170 ] 328 0.012% 99.995% ( 170, 250 ] 199 0.007% 100.003% ( 250, 380 ] 186 0.007% 100.009% ( 380, 580 ] 209 0.008% 100.017% ( 580, 870 ] 191 0.007% 100.024% ( 870, 1300 ] 149 0.005% 100.029% ( 1300, 1900 ] 71 0.003% 100.032% ( 1900, 2900 ] 64 0.002% 100.034% ( 2900, 4400 ] 34 0.001% 100.035% ( 4400, 6600 ] 10 0.000% 100.036% ( 6600, 9900 ] 1 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 975234 Average: 4.7307 StdDev: 74.92 Min: 1 Median: 1.7986 Max: 8901 Percentiles: P50: 1.80 P75: 2.69 P99: 8.63 P99.9: 14.49 P99.99: 87.73 ------------------------------------------------------ [ 0, 1 ] 49351 5.060% 5.060% # ( 1, 2 ] 548760 56.270% 61.330% ########### ( 2, 3 ] 192655 19.755% 81.085% #### ( 3, 4 ] 83816 8.594% 89.679% ## ( 4, 6 ] 79028 8.103% 97.783% ## ( 6, 10 ] 18022 1.848% 99.631% ( 10, 15 ] 2923 0.300% 99.930% ( 15, 22 ] 397 0.041% 99.971% ( 22, 34 ] 47 0.005% 99.976% ( 34, 51 ] 17 0.002% 99.978% ( 51, 76 ] 17 0.002% 99.979% ( 76, 110 ] 300 0.031% 100.010% ( 110, 170 ] 318 0.033% 100.043% ( 170, 250 ] 155 0.016% 100.059% ( 250, 380 ] 214 0.022% 100.081% ( 380, 580 ] 256 0.026% 100.107% ( 580, 870 ] 220 0.023% 100.129% ( 870, 1300 ] 160 0.016% 100.146% ( 1300, 1900 ] 90 0.009% 100.155% ( 1900, 2900 ] 124 0.013% 100.168% ( 2900, 4400 ] 160 0.016% 100.184% ( 4400, 6600 ] 43 0.004% 100.189% ( 6600, 9900 ] 16 0.002% 100.190% ** Level 2 read latency histogram (micros): Count: 124238 Average: 3.2582 StdDev: 38.67 Min: 0 Median: 1.5047 Max: 3465 Percentiles: P50: 1.50 P75: 1.91 P99: 6.96 P99.9: 287.81 P99.99: 2271.75 ------------------------------------------------------ [ 0, 1 ] 23523 18.934% 18.934% #### ( 1, 2 ] 76474 61.554% 80.488% ############ ( 2, 3 ] 12672 10.200% 90.688% ## ( 3, 4 ] 5770 4.644% 95.332% # ( 4, 6 ] 4291 3.454% 98.786% # ( 6, 10 ] 1110 0.893% 99.680% ( 10, 15 ] 158 0.127% 99.807% ( 15, 22 ] 24 0.019% 99.826% ( 22, 34 ] 1 0.001% 99.827% ( 34, 51 ] 1 0.001% 99.828% ( 51, 76 ] 2 0.002% 99.829% ( 76, 110 ] 17 0.014% 99.843% ( 110, 170 ] 27 0.022% 99.865% ( 170, 250 ] 33 0.027% 99.891% ( 250, 380 ] 37 0.030% 99.921% ( 380, 580 ] 33 0.027% 99.948% ( 580, 870 ] 18 0.014% 99.962% ( 870, 1300 ] 18 0.014% 99.977% ( 1300, 1900 ] 11 0.009% 99.986% ( 1900, 2900 ] 15 0.012% 99.998% ( 2900, 4400 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1337281 Average: 5.4629 StdDev: 83.89 Min: 0 Median: 1.9013 Max: 14379 Percentiles: P50: 1.90 P75: 2.86 P99: 8.79 P99.9: 13.94 P99.99: 16.23 ------------------------------------------------------ [ 0, 1 ] 37441 2.800% 2.800% # ( 1, 2 ] 700350 52.371% 55.171% ########## ( 2, 3 ] 308289 23.053% 78.224% ##### ( 3, 4 ] 133011 9.946% 88.171% ## ( 4, 6 ] 126303 9.445% 97.616% ## ( 6, 10 ] 26513 1.983% 99.598% ( 10, 15 ] 5126 0.383% 99.981% ( 15, 22 ] 650 0.049% 100.030% ( 22, 34 ] 61 0.005% 100.035% ( 34, 51 ] 17 0.001% 100.036% ( 51, 76 ] 26 0.002% 100.038% ( 76, 110 ] 202 0.015% 100.053% ( 110, 170 ] 547 0.041% 100.094% ( 170, 250 ] 475 0.036% 100.129% ( 250, 380 ] 451 0.034% 100.163% ( 380, 580 ] 527 0.039% 100.203% ( 580, 870 ] 455 0.034% 100.237% ( 870, 1300 ] 312 0.023% 100.260% ( 1300, 1900 ] 198 0.015% 100.275% ( 1900, 2900 ] 213 0.016% 100.291% ( 2900, 4400 ] 251 0.019% 100.309% ( 4400, 6600 ] 64 0.005% 100.314% ( 6600, 9900 ] 25 0.002% 100.316% ( 9900, 14000 ] 3 0.000% 100.316% ( 14000, 22000 ] 1 0.000% 100.316% ** Level 4 read latency histogram (micros): Count: 40932 Average: 67.5110 StdDev: 357.91 Min: 1 Median: 1.9507 Max: 9580 Percentiles: P50: 1.95 P75: 3.13 P99: 1690.34 P99.9: 4246.81 P99.99: 5677.64 ------------------------------------------------------ [ 0, 1 ] 1223 2.988% 2.988% # ( 1, 2 ] 20240 49.448% 52.436% ########## ( 2, 3 ] 8642 21.113% 73.549% #### ( 3, 4 ] 4440 10.847% 84.396% ## ( 4, 6 ] 2541 6.208% 90.604% # ( 6, 10 ] 913 2.231% 92.834% ( 10, 15 ] 175 0.428% 93.262% ( 15, 22 ] 34 0.083% 93.345% ( 22, 34 ] 6 0.015% 93.360% ( 76, 110 ] 126 0.308% 93.668% ( 110, 170 ] 214 0.523% 94.190% ( 170, 250 ] 194 0.474% 94.664% ( 250, 380 ] 275 0.672% 95.336% ( 380, 580 ] 403 0.985% 96.321% ( 580, 870 ] 494 1.207% 97.528% ( 870, 1300 ] 455 1.112% 98.639% ( 1300, 1900 ] 227 0.555% 99.194% ( 1900, 2900 ] 149 0.364% 99.558% ( 2900, 4400 ] 156 0.381% 99.939% ( 4400, 6600 ] 36 0.088% 100.027% ( 6600, 9900 ] 4 0.010% 100.037% ** Level 5 read latency histogram (micros): Count: 180 Average: 1197.5778 StdDev: 1439.59 Min: 76 Median: 571.6667 Max: 9878 Percentiles: P50: 571.67 P75: 1715.38 P99: 6160.00 P99.9: 9306.00 P99.99: 9840.60 ------------------------------------------------------ ( 51, 76 ] 1 0.556% 0.556% ( 76, 110 ] 16 8.889% 9.444% ## ( 110, 170 ] 26 14.444% 23.889% ### ( 170, 250 ] 13 7.222% 31.111% # ( 250, 380 ] 11 6.111% 37.222% # ( 380, 580 ] 24 13.333% 50.556% ### ( 580, 870 ] 18 10.000% 60.556% ## ( 870, 1300 ] 17 9.444% 70.000% ## ( 1300, 1900 ] 13 7.222% 77.222% # ( 1900, 2900 ] 16 8.889% 86.111% ## ( 2900, 4400 ] 20 11.111% 97.222% ## ( 4400, 6600 ] 4 2.222% 99.444% ( 6600, 9900 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 31.3 total, 4.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 251.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.018 H:M:S, 28.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 234.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.434 H:M:S, 34.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/26-10:02:28 ... thread 0: (1000000,9000000) ops and (258291.5,257438.1) ops/second in (3.871595,34.959867) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 4.73 GB 182.5 7.4 0.0 7.4 16.0 8.5 0.0 1.9 129.8 278.8 58.70 51.33 146 0.402 7738K 14K 0.0 0.0 L1 5/5 584.28 MB 0.0 4.4 3.6 0.8 4.3 3.5 0.2 1.2 227.7 226.0 19.60 18.87 4 4.901 4532K 32K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.0 2.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 L3 24/0 972.97 MB 1.0 6.3 2.9 3.4 6.2 2.9 0.4 2.2 165.9 165.2 38.64 28.45 23 1.680 6509K 26K 0.0 0.0 L4 186/0 9.66 GB 1.0 2.4 2.2 0.2 2.4 2.2 0.8 1.1 138.8 138.5 17.61 11.49 38 0.463 2369K 1162 0.0 0.0 L5 1080/0 88.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1313/13 104.61 GB 0.0 20.8 8.9 11.9 29.3 17.4 7.5 3.4 156.7 220.4 136.07 111.60 213 0.639 21M 74K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.8 8.9 11.9 29.3 17.4 7.4 3.4 156.7 220.4 136.07 111.60 213 0.639 21M 74K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.8 8.9 11.9 20.7 8.8 0.0 0.0 197.4 196.6 108.00 89.20 91 1.187 21M 74K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 312.0 28.06 22.39 122 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.2 total, 35.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.29 GB write, 852.80 MB/s write, 20.82 GB read, 606.08 MB/s read, 136.1 seconds Interval compaction: 29.29 GB write, 857.93 MB/s write, 20.82 GB read, 609.73 MB/s read, 136.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 63, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3238347 Average: 2.5726 StdDev: 23.16 Min: 0 Median: 1.5626 Max: 9411 Percentiles: P50: 1.56 P75: 1.94 P99: 5.99 P99.9: 12.59 P99.99: 94.77 ------------------------------------------------------ [ 0, 1 ] 427542 13.202% 13.202% ### ( 1, 2 ] 2118232 65.411% 78.613% ############# ( 2, 3 ] 405802 12.531% 91.145% ### ( 3, 4 ] 147440 4.553% 95.697% # ( 4, 6 ] 107426 3.317% 99.015% # ( 6, 10 ] 26301 0.812% 99.827% ( 10, 15 ] 4562 0.141% 99.968% ( 15, 22 ] 484 0.015% 99.983% ( 22, 34 ] 46 0.001% 99.984% ( 34, 51 ] 20 0.001% 99.985% ( 51, 76 ] 18 0.001% 99.985% ( 76, 110 ] 272 0.008% 99.994% ( 110, 170 ] 334 0.010% 100.004% ( 170, 250 ] 212 0.007% 100.011% ( 250, 380 ] 191 0.006% 100.017% ( 380, 580 ] 213 0.007% 100.023% ( 580, 870 ] 194 0.006% 100.029% ( 870, 1300 ] 154 0.005% 100.034% ( 1300, 1900 ] 71 0.002% 100.036% ( 1900, 2900 ] 67 0.002% 100.038% ( 2900, 4400 ] 37 0.001% 100.039% ( 4400, 6600 ] 10 0.000% 100.040% ( 6600, 9900 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 998997 Average: 4.6713 StdDev: 74.02 Min: 1 Median: 1.7914 Max: 8901 Percentiles: P50: 1.79 P75: 2.67 P99: 8.62 P99.9: 14.46 P99.99: 87.57 ------------------------------------------------------ [ 0, 1 ] 52333 5.239% 5.239% # ( 1, 2 ] 565003 56.557% 61.796% ########### ( 2, 3 ] 195605 19.580% 81.376% #### ( 3, 4 ] 84537 8.462% 89.838% ## ( 4, 6 ] 79524 7.960% 97.798% ## ( 6, 10 ] 18361 1.838% 99.636% ( 10, 15 ] 2953 0.296% 99.932% ( 15, 22 ] 398 0.040% 99.972% ( 22, 34 ] 47 0.005% 99.976% ( 34, 51 ] 17 0.002% 99.978% ( 51, 76 ] 17 0.002% 99.980% ( 76, 110 ] 300 0.030% 100.010% ( 110, 170 ] 318 0.032% 100.042% ( 170, 250 ] 155 0.016% 100.057% ( 250, 380 ] 215 0.022% 100.079% ( 380, 580 ] 256 0.026% 100.104% ( 580, 870 ] 220 0.022% 100.126% ( 870, 1300 ] 160 0.016% 100.142% ( 1300, 1900 ] 90 0.009% 100.151% ( 1900, 2900 ] 124 0.012% 100.164% ( 2900, 4400 ] 160 0.016% 100.180% ( 4400, 6600 ] 43 0.004% 100.184% ( 6600, 9900 ] 16 0.002% 100.186% ** Level 2 read latency histogram (micros): Count: 124238 Average: 3.2582 StdDev: 38.67 Min: 0 Median: 1.5047 Max: 3465 Percentiles: P50: 1.50 P75: 1.91 P99: 6.96 P99.9: 287.81 P99.99: 2271.75 ------------------------------------------------------ [ 0, 1 ] 23523 18.934% 18.934% #### ( 1, 2 ] 76474 61.554% 80.488% ############ ( 2, 3 ] 12672 10.200% 90.688% ## ( 3, 4 ] 5770 4.644% 95.332% # ( 4, 6 ] 4291 3.454% 98.786% # ( 6, 10 ] 1110 0.893% 99.680% ( 10, 15 ] 158 0.127% 99.807% ( 15, 22 ] 24 0.019% 99.826% ( 22, 34 ] 1 0.001% 99.827% ( 34, 51 ] 1 0.001% 99.828% ( 51, 76 ] 2 0.002% 99.829% ( 76, 110 ] 17 0.014% 99.843% ( 110, 170 ] 27 0.022% 99.865% ( 170, 250 ] 33 0.027% 99.891% ( 250, 380 ] 37 0.030% 99.921% ( 380, 580 ] 33 0.027% 99.948% ( 580, 870 ] 18 0.014% 99.962% ( 870, 1300 ] 18 0.014% 99.977% ( 1300, 1900 ] 11 0.009% 99.986% ( 1900, 2900 ] 15 0.012% 99.998% ( 2900, 4400 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1337281 Average: 5.4629 StdDev: 83.89 Min: 0 Median: 1.9013 Max: 14379 Percentiles: P50: 1.90 P75: 2.86 P99: 8.79 P99.9: 13.94 P99.99: 16.23 ------------------------------------------------------ [ 0, 1 ] 37441 2.800% 2.800% # ( 1, 2 ] 700350 52.371% 55.171% ########## ( 2, 3 ] 308289 23.053% 78.224% ##### ( 3, 4 ] 133011 9.946% 88.171% ## ( 4, 6 ] 126303 9.445% 97.616% ## ( 6, 10 ] 26513 1.983% 99.598% ( 10, 15 ] 5126 0.383% 99.981% ( 15, 22 ] 650 0.049% 100.030% ( 22, 34 ] 61 0.005% 100.035% ( 34, 51 ] 17 0.001% 100.036% ( 51, 76 ] 26 0.002% 100.038% ( 76, 110 ] 202 0.015% 100.053% ( 110, 170 ] 547 0.041% 100.094% ( 170, 250 ] 475 0.036% 100.129% ( 250, 380 ] 451 0.034% 100.163% ( 380, 580 ] 527 0.039% 100.203% ( 580, 870 ] 455 0.034% 100.237% ( 870, 1300 ] 312 0.023% 100.260% ( 1300, 1900 ] 198 0.015% 100.275% ( 1900, 2900 ] 213 0.016% 100.291% ( 2900, 4400 ] 251 0.019% 100.309% ( 4400, 6600 ] 64 0.005% 100.314% ( 6600, 9900 ] 25 0.002% 100.316% ( 9900, 14000 ] 3 0.000% 100.316% ( 14000, 22000 ] 1 0.000% 100.316% ** Level 4 read latency histogram (micros): Count: 40932 Average: 67.5110 StdDev: 357.91 Min: 1 Median: 1.9507 Max: 9580 Percentiles: P50: 1.95 P75: 3.13 P99: 1690.34 P99.9: 4246.81 P99.99: 5677.64 ------------------------------------------------------ [ 0, 1 ] 1223 2.988% 2.988% # ( 1, 2 ] 20240 49.448% 52.436% ########## ( 2, 3 ] 8642 21.113% 73.549% #### ( 3, 4 ] 4440 10.847% 84.396% ## ( 4, 6 ] 2541 6.208% 90.604% # ( 6, 10 ] 913 2.231% 92.834% ( 10, 15 ] 175 0.428% 93.262% ( 15, 22 ] 34 0.083% 93.345% ( 22, 34 ] 6 0.015% 93.360% ( 76, 110 ] 126 0.308% 93.668% ( 110, 170 ] 214 0.523% 94.190% ( 170, 250 ] 194 0.474% 94.664% ( 250, 380 ] 275 0.672% 95.336% ( 380, 580 ] 403 0.985% 96.321% ( 580, 870 ] 494 1.207% 97.528% ( 870, 1300 ] 455 1.112% 98.639% ( 1300, 1900 ] 227 0.555% 99.194% ( 1900, 2900 ] 149 0.364% 99.558% ( 2900, 4400 ] 156 0.381% 99.939% ( 4400, 6600 ] 36 0.088% 100.027% ( 6600, 9900 ] 4 0.010% 100.037% ** Level 5 read latency histogram (micros): Count: 180 Average: 1197.5778 StdDev: 1439.59 Min: 76 Median: 571.6667 Max: 9878 Percentiles: P50: 571.67 P75: 1715.38 P99: 6160.00 P99.9: 9306.00 P99.99: 9840.60 ------------------------------------------------------ ( 51, 76 ] 1 0.556% 0.556% ( 76, 110 ] 16 8.889% 9.444% ## ( 110, 170 ] 26 14.444% 23.889% ### ( 170, 250 ] 13 7.222% 31.111% # ( 250, 380 ] 11 6.111% 37.222% # ( 380, 580 ] 24 13.333% 50.556% ### ( 580, 870 ] 18 10.000% 60.556% ## ( 870, 1300 ] 17 9.444% 70.000% ## ( 1300, 1900 ] 13 7.222% 77.222% # ( 1900, 2900 ] 16 8.889% 86.111% ## ( 2900, 4400 ] 20 11.111% 97.222% ## ( 4400, 6600 ] 4 2.222% 99.444% ( 6600, 9900 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 35.2 total, 3.9 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 251.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.287 H:M:S, 29.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 254.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.268 H:M:S, 32.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/26-10:02:41 ... thread 0: (1000000,10000000) ops and (73993.9,206294.0) ops/second in (13.514634,48.474501) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 2.70 GB 6.3 9.0 0.0 9.0 18.4 9.5 0.0 1.9 136.4 280.1 67.41 59.51 165 0.409 9337K 17K 0.0 0.0 L1 33/33 2.24 GB 0.0 7.9 6.5 1.4 7.8 6.4 0.2 1.2 224.4 222.0 35.92 34.23 5 7.185 8186K 85K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.2 2.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 L3 17/0 925.16 MB 0.9 7.6 3.7 4.0 7.6 3.6 0.9 2.1 162.3 161.4 48.16 35.01 34 1.417 7939K 44K 0.0 0.0 L4 190/4 9.92 GB 1.0 3.8 3.5 0.3 3.8 3.5 0.9 1.1 144.7 144.2 27.05 18.22 53 0.510 3826K 8997 0.0 0.0 L5 1092/0 89.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1345/49 105.45 GB 0.0 28.7 13.8 14.8 38.0 23.2 10.2 4.0 163.1 216.1 180.06 148.42 259 0.695 29M 156K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.7 13.8 14.8 38.0 23.2 10.0 4.0 163.1 216.1 180.06 148.42 259 0.695 29M 156K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.7 13.8 14.8 28.5 13.7 0.0 0.0 196.8 195.7 149.25 123.58 122 1.223 29M 156K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 314.8 30.82 24.84 137 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.7 total, 48.5 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.99 GB write, 799.11 MB/s write, 28.68 GB read, 603.17 MB/s read, 180.1 seconds Interval compaction: 37.99 GB write, 802.58 MB/s write, 28.68 GB read, 605.79 MB/s read, 180.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 29, pending-compaction-bytes-stops: 0, total-delays: 54, total-stops: 63, interval: 117 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4245614 Average: 2.6917 StdDev: 24.91 Min: 0 Median: 1.5505 Max: 9411 Percentiles: P50: 1.55 P75: 1.93 P99: 6.42 P99.9: 14.95 P99.99: 219.91 ------------------------------------------------------ [ 0, 1 ] 597123 14.064% 14.064% ### ( 1, 2 ] 2771411 65.277% 79.342% ############# ( 2, 3 ] 513226 12.088% 91.430% ## ( 3, 4 ] 183009 4.311% 95.740% # ( 4, 6 ] 134582 3.170% 98.910% # ( 6, 10 ] 36311 0.855% 99.766% ( 10, 15 ] 5769 0.136% 99.901% ( 15, 22 ] 687 0.016% 99.918% ( 22, 34 ] 54 0.001% 99.919% ( 34, 51 ] 76 0.002% 99.921% ( 51, 76 ] 79 0.002% 99.923% ( 76, 110 ] 1261 0.030% 99.952% ( 110, 170 ] 1239 0.029% 99.981% ( 170, 250 ] 581 0.014% 99.995% ( 250, 380 ] 467 0.011% 100.006% ( 380, 580 ] 401 0.009% 100.016% ( 580, 870 ] 366 0.009% 100.024% ( 870, 1300 ] 258 0.006% 100.030% ( 1300, 1900 ] 123 0.003% 100.033% ( 1900, 2900 ] 88 0.002% 100.035% ( 2900, 4400 ] 59 0.001% 100.037% ( 4400, 6600 ] 13 0.000% 100.037% ( 6600, 9900 ] 1 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 1322045 Average: 4.7749 StdDev: 72.97 Min: 1 Median: 1.7724 Max: 9155 Percentiles: P50: 1.77 P75: 2.67 P99: 8.81 P99.9: 16.17 P99.99: 105.87 ------------------------------------------------------ [ 0, 1 ] 99420 7.520% 7.520% ## ( 1, 2 ] 727113 54.999% 62.519% ########### ( 2, 3 ] 246705 18.661% 81.180% #### ( 3, 4 ] 110739 8.376% 89.556% ## ( 4, 6 ] 107047 8.097% 97.654% ## ( 6, 10 ] 25379 1.920% 99.573% ( 10, 15 ] 4224 0.320% 99.893% ( 15, 22 ] 573 0.043% 99.936% ( 22, 34 ] 63 0.005% 99.941% ( 34, 51 ] 25 0.002% 99.943% ( 51, 76 ] 124 0.009% 99.952% ( 76, 110 ] 570 0.043% 99.995% ( 110, 170 ] 468 0.035% 100.031% ( 170, 250 ] 268 0.020% 100.051% ( 250, 380 ] 389 0.029% 100.080% ( 380, 580 ] 401 0.030% 100.111% ( 580, 870 ] 388 0.029% 100.140% ( 870, 1300 ] 271 0.020% 100.161% ( 1300, 1900 ] 143 0.011% 100.171% ( 1900, 2900 ] 147 0.011% 100.182% ( 2900, 4400 ] 197 0.015% 100.197% ( 4400, 6600 ] 60 0.005% 100.202% ( 6600, 9900 ] 18 0.001% 100.203% ** Level 2 read latency histogram (micros): Count: 124238 Average: 3.2582 StdDev: 38.67 Min: 0 Median: 1.5047 Max: 3465 Percentiles: P50: 1.50 P75: 1.91 P99: 6.96 P99.9: 287.81 P99.99: 2271.75 ------------------------------------------------------ [ 0, 1 ] 23523 18.934% 18.934% #### ( 1, 2 ] 76474 61.554% 80.488% ############ ( 2, 3 ] 12672 10.200% 90.688% ## ( 3, 4 ] 5770 4.644% 95.332% # ( 4, 6 ] 4291 3.454% 98.786% # ( 6, 10 ] 1110 0.893% 99.680% ( 10, 15 ] 158 0.127% 99.807% ( 15, 22 ] 24 0.019% 99.826% ( 22, 34 ] 1 0.001% 99.827% ( 34, 51 ] 1 0.001% 99.828% ( 51, 76 ] 2 0.002% 99.829% ( 76, 110 ] 17 0.014% 99.843% ( 110, 170 ] 27 0.022% 99.865% ( 170, 250 ] 33 0.027% 99.891% ( 250, 380 ] 37 0.030% 99.921% ( 380, 580 ] 33 0.027% 99.948% ( 580, 870 ] 18 0.014% 99.962% ( 870, 1300 ] 18 0.014% 99.977% ( 1300, 1900 ] 11 0.009% 99.986% ( 1900, 2900 ] 15 0.012% 99.998% ( 2900, 4400 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1812216 Average: 5.4571 StdDev: 80.26 Min: 0 Median: 1.9145 Max: 14379 Percentiles: P50: 1.91 P75: 2.89 P99: 8.81 P99.9: 13.95 P99.99: 16.65 ------------------------------------------------------ [ 0, 1 ] 46975 2.592% 2.592% # ( 1, 2 ] 939455 51.840% 54.432% ########## ( 2, 3 ] 417097 23.016% 77.448% ##### ( 3, 4 ] 186019 10.265% 87.713% ## ( 4, 6 ] 178598 9.855% 97.568% ## ( 6, 10 ] 36915 2.037% 99.605% ( 10, 15 ] 6773 0.374% 99.979% ( 15, 22 ] 861 0.048% 100.026% ( 22, 34 ] 83 0.005% 100.031% ( 34, 51 ] 33 0.002% 100.033% ( 51, 76 ] 75 0.004% 100.037% ( 76, 110 ] 222 0.012% 100.049% ( 110, 170 ] 605 0.033% 100.082% ( 170, 250 ] 647 0.036% 100.118% ( 250, 380 ] 731 0.040% 100.159% ( 380, 580 ] 818 0.045% 100.204% ( 580, 870 ] 725 0.040% 100.244% ( 870, 1300 ] 497 0.027% 100.271% ( 1300, 1900 ] 275 0.015% 100.286% ( 1900, 2900 ] 253 0.014% 100.300% ( 2900, 4400 ] 306 0.017% 100.317% ( 4400, 6600 ] 85 0.005% 100.322% ( 6600, 9900 ] 29 0.002% 100.323% ( 9900, 14000 ] 3 0.000% 100.324% ( 14000, 22000 ] 1 0.000% 100.324% ** Level 4 read latency histogram (micros): Count: 91477 Average: 45.2300 StdDev: 281.85 Min: 1 Median: 1.9241 Max: 9580 Percentiles: P50: 1.92 P75: 3.03 P99: 1195.81 P99.9: 3709.74 P99.99: 4286.82 ------------------------------------------------------ [ 0, 1 ] 2985 3.263% 3.263% # ( 1, 2 ] 46267 50.578% 53.841% ########## ( 2, 3 ] 19023 20.795% 74.636% #### ( 3, 4 ] 9768 10.678% 85.314% ## ( 4, 6 ] 6897 7.540% 92.854% ## ( 6, 10 ] 2019 2.207% 95.061% ( 10, 15 ] 297 0.325% 95.386% ( 15, 22 ] 57 0.062% 95.448% ( 22, 34 ] 8 0.009% 95.457% ( 34, 51 ] 2 0.002% 95.459% ( 51, 76 ] 8 0.009% 95.468% ( 76, 110 ] 175 0.191% 95.659% ( 110, 170 ] 298 0.326% 95.985% ( 170, 250 ] 319 0.349% 96.334% ( 250, 380 ] 452 0.494% 96.828% ( 380, 580 ] 668 0.730% 97.558% ( 580, 870 ] 804 0.879% 98.437% ( 870, 1300 ] 680 0.743% 99.180% ( 1300, 1900 ] 328 0.359% 99.539% ( 1900, 2900 ] 215 0.235% 99.774% ( 2900, 4400 ] 214 0.234% 100.008% ( 4400, 6600 ] 45 0.049% 100.057% ( 6600, 9900 ] 4 0.004% 100.061% ** Level 5 read latency histogram (micros): Count: 248 Average: 1222.5887 StdDev: 1467.58 Min: 76 Median: 580.0000 Max: 9878 Percentiles: P50: 580.00 P75: 1787.50 P99: 6388.80 P99.9: 9490.80 P99.99: 9859.08 ------------------------------------------------------ ( 51, 76 ] 1 0.403% 0.403% ( 76, 110 ] 19 7.661% 8.065% ## ( 110, 170 ] 33 13.306% 21.371% ### ( 170, 250 ] 18 7.258% 28.629% # ( 250, 380 ] 22 8.871% 37.500% ## ( 380, 580 ] 31 12.500% 50.000% ### ( 580, 870 ] 25 10.081% 60.081% ## ( 870, 1300 ] 24 9.677% 69.758% ## ( 1300, 1900 ] 16 6.452% 76.210% # ( 1900, 2900 ] 24 9.677% 85.887% ## ( 2900, 4400 ] 28 11.290% 97.177% ## ( 4400, 6600 ] 5 2.016% 99.194% ( 6600, 9900 ] 2 0.806% 100.000% ** DB Stats ** Uptime(secs): 48.7 total, 13.5 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 202.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.052 H:M:S, 43.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 72.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.765 H:M:S, 79.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/26-10:02:52 ... thread 0: (1000000,11000000) ops and (99132.1,187835.0) ops/second in (10.087550,58.562051) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 3.75 GB 138.5 10.0 0.0 10.0 20.5 10.5 0.0 2.0 137.8 282.1 74.51 66.21 183 0.407 10M 18K 0.0 0.0 L1 33/33 2.24 GB 0.0 7.9 6.5 1.4 7.8 6.4 0.2 1.2 224.4 222.0 35.92 34.23 5 7.185 8186K 85K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.2 2.0 249.1 249.0 1.52 1.46 2 0.758 383K 205 0.0 0.0 L3 17/0 925.16 MB 0.9 7.6 3.7 4.0 7.6 3.6 0.9 2.1 162.3 161.4 48.16 35.01 34 1.417 7939K 44K 0.0 0.0 L4 186/0 9.61 GB 1.0 3.8 3.5 0.3 3.8 3.5 0.9 1.1 144.7 144.2 27.05 18.22 53 0.510 3826K 8997 0.0 0.0 L5 1096/0 90.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/41 106.50 GB 0.0 29.7 13.8 15.9 40.1 24.2 10.5 3.8 162.6 219.3 187.16 155.12 277 0.676 30M 157K 0.0 0.0 Int 0/0 0.00 KB 0.0 29.7 13.8 15.9 40.1 24.2 10.4 3.8 162.6 219.3 187.16 155.12 277 0.676 30M 157K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 29.7 13.8 15.9 29.6 13.7 0.0 0.0 198.5 197.5 153.32 127.57 126 1.217 30M 157K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 318.3 33.84 27.55 151 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.8 total, 58.6 interval Flush(GB): cumulative 10.520, interval 10.520 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.08 GB write, 698.38 MB/s write, 29.72 GB read, 517.87 MB/s read, 187.2 seconds Interval compaction: 40.08 GB write, 700.88 MB/s write, 29.72 GB read, 519.73 MB/s read, 187.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 67, pending-compaction-bytes-delays: 32, pending-compaction-bytes-stops: 0, total-delays: 57, total-stops: 67, interval: 124 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4827518 Average: 2.6322 StdDev: 23.69 Min: 0 Median: 1.5361 Max: 9411 Percentiles: P50: 1.54 P75: 1.92 P99: 6.23 P99.9: 14.84 P99.99: 204.12 ------------------------------------------------------ [ 0, 1 ] 723239 14.982% 14.982% ### ( 1, 2 ] 3153287 65.319% 80.301% ############# ( 2, 3 ] 557612 11.551% 91.851% ## ( 3, 4 ] 197713 4.096% 95.947% # ( 4, 6 ] 145133 3.006% 98.953% # ( 6, 10 ] 39567 0.820% 99.773% ( 10, 15 ] 6338 0.131% 99.904% ( 15, 22 ] 814 0.017% 99.921% ( 22, 34 ] 56 0.001% 99.922% ( 34, 51 ] 77 0.002% 99.924% ( 51, 76 ] 93 0.002% 99.926% ( 76, 110 ] 1431 0.030% 99.955% ( 110, 170 ] 1405 0.029% 99.984% ( 170, 250 ] 636 0.013% 99.998% ( 250, 380 ] 508 0.011% 100.008% ( 380, 580 ] 435 0.009% 100.017% ( 580, 870 ] 384 0.008% 100.025% ( 870, 1300 ] 261 0.005% 100.030% ( 1300, 1900 ] 124 0.003% 100.033% ( 1900, 2900 ] 89 0.002% 100.035% ( 2900, 4400 ] 62 0.001% 100.036% ( 4400, 6600 ] 13 0.000% 100.036% ( 6600, 9900 ] 1 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 1597698 Average: 4.3527 StdDev: 66.52 Min: 1 Median: 1.6804 Max: 9155 Percentiles: P50: 1.68 P75: 2.45 P99: 8.67 P99.9: 77.03 P99.99: 140.15 ------------------------------------------------------ [ 0, 1 ] 194805 12.193% 12.193% ## ( 1, 2 ] 887777 55.566% 67.759% ########### ( 2, 3 ] 255296 15.979% 83.738% ### ( 3, 4 ] 114437 7.163% 90.900% # ( 4, 6 ] 111590 6.984% 97.885% # ( 6, 10 ] 26656 1.668% 99.553% ( 10, 15 ] 4512 0.282% 99.836% ( 15, 22 ] 693 0.043% 99.879% ( 22, 34 ] 63 0.004% 99.883% ( 34, 51 ] 25 0.002% 99.885% ( 51, 76 ] 215 0.013% 99.898% ( 76, 110 ] 1035 0.065% 99.963% ( 110, 170 ] 864 0.054% 100.017% ( 170, 250 ] 324 0.020% 100.037% ( 250, 380 ] 430 0.027% 100.064% ( 380, 580 ] 426 0.027% 100.091% ( 580, 870 ] 399 0.025% 100.116% ( 870, 1300 ] 273 0.017% 100.133% ( 1300, 1900 ] 143 0.009% 100.142% ( 1900, 2900 ] 147 0.009% 100.151% ( 2900, 4400 ] 197 0.012% 100.163% ( 4400, 6600 ] 60 0.004% 100.167% ( 6600, 9900 ] 18 0.001% 100.168% ** Level 2 read latency histogram (micros): Count: 124238 Average: 3.2582 StdDev: 38.67 Min: 0 Median: 1.5047 Max: 3465 Percentiles: P50: 1.50 P75: 1.91 P99: 6.96 P99.9: 287.81 P99.99: 2271.75 ------------------------------------------------------ [ 0, 1 ] 23523 18.934% 18.934% #### ( 1, 2 ] 76474 61.554% 80.488% ############ ( 2, 3 ] 12672 10.200% 90.688% ## ( 3, 4 ] 5770 4.644% 95.332% # ( 4, 6 ] 4291 3.454% 98.786% # ( 6, 10 ] 1110 0.893% 99.680% ( 10, 15 ] 158 0.127% 99.807% ( 15, 22 ] 24 0.019% 99.826% ( 22, 34 ] 1 0.001% 99.827% ( 34, 51 ] 1 0.001% 99.828% ( 51, 76 ] 2 0.002% 99.829% ( 76, 110 ] 17 0.014% 99.843% ( 110, 170 ] 27 0.022% 99.865% ( 170, 250 ] 33 0.027% 99.891% ( 250, 380 ] 37 0.030% 99.921% ( 380, 580 ] 33 0.027% 99.948% ( 580, 870 ] 18 0.014% 99.962% ( 870, 1300 ] 18 0.014% 99.977% ( 1300, 1900 ] 11 0.009% 99.986% ( 1900, 2900 ] 15 0.012% 99.998% ( 2900, 4400 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1812216 Average: 5.4571 StdDev: 80.26 Min: 0 Median: 1.9145 Max: 14379 Percentiles: P50: 1.91 P75: 2.89 P99: 8.81 P99.9: 13.95 P99.99: 16.65 ------------------------------------------------------ [ 0, 1 ] 46975 2.592% 2.592% # ( 1, 2 ] 939455 51.840% 54.432% ########## ( 2, 3 ] 417097 23.016% 77.448% ##### ( 3, 4 ] 186019 10.265% 87.713% ## ( 4, 6 ] 178598 9.855% 97.568% ## ( 6, 10 ] 36915 2.037% 99.605% ( 10, 15 ] 6773 0.374% 99.979% ( 15, 22 ] 861 0.048% 100.026% ( 22, 34 ] 83 0.005% 100.031% ( 34, 51 ] 33 0.002% 100.033% ( 51, 76 ] 75 0.004% 100.037% ( 76, 110 ] 222 0.012% 100.049% ( 110, 170 ] 605 0.033% 100.082% ( 170, 250 ] 647 0.036% 100.118% ( 250, 380 ] 731 0.040% 100.159% ( 380, 580 ] 818 0.045% 100.204% ( 580, 870 ] 725 0.040% 100.244% ( 870, 1300 ] 497 0.027% 100.271% ( 1300, 1900 ] 275 0.015% 100.286% ( 1900, 2900 ] 253 0.014% 100.300% ( 2900, 4400 ] 306 0.017% 100.317% ( 4400, 6600 ] 85 0.005% 100.322% ( 6600, 9900 ] 29 0.002% 100.323% ( 9900, 14000 ] 3 0.000% 100.324% ( 14000, 22000 ] 1 0.000% 100.324% ** Level 4 read latency histogram (micros): Count: 91477 Average: 45.2300 StdDev: 281.85 Min: 1 Median: 1.9241 Max: 9580 Percentiles: P50: 1.92 P75: 3.03 P99: 1195.81 P99.9: 3709.74 P99.99: 4286.82 ------------------------------------------------------ [ 0, 1 ] 2985 3.263% 3.263% # ( 1, 2 ] 46267 50.578% 53.841% ########## ( 2, 3 ] 19023 20.795% 74.636% #### ( 3, 4 ] 9768 10.678% 85.314% ## ( 4, 6 ] 6897 7.540% 92.854% ## ( 6, 10 ] 2019 2.207% 95.061% ( 10, 15 ] 297 0.325% 95.386% ( 15, 22 ] 57 0.062% 95.448% ( 22, 34 ] 8 0.009% 95.457% ( 34, 51 ] 2 0.002% 95.459% ( 51, 76 ] 8 0.009% 95.468% ( 76, 110 ] 175 0.191% 95.659% ( 110, 170 ] 298 0.326% 95.985% ( 170, 250 ] 319 0.349% 96.334% ( 250, 380 ] 452 0.494% 96.828% ( 380, 580 ] 668 0.730% 97.558% ( 580, 870 ] 804 0.879% 98.437% ( 870, 1300 ] 680 0.743% 99.180% ( 1300, 1900 ] 328 0.359% 99.539% ( 1900, 2900 ] 215 0.235% 99.774% ( 2900, 4400 ] 214 0.234% 100.008% ( 4400, 6600 ] 45 0.049% 100.057% ( 6600, 9900 ] 4 0.004% 100.061% ** Level 5 read latency histogram (micros): Count: 260 Average: 1208.4615 StdDev: 1445.68 Min: 76 Median: 580.0000 Max: 9878 Percentiles: P50: 580.00 P75: 1758.82 P99: 6336.00 P99.9: 9471.00 P99.99: 9857.10 ------------------------------------------------------ ( 51, 76 ] 1 0.385% 0.385% ( 76, 110 ] 20 7.692% 8.077% ## ( 110, 170 ] 34 13.077% 21.154% ### ( 170, 250 ] 20 7.692% 28.846% ## ( 250, 380 ] 23 8.846% 37.692% ## ( 380, 580 ] 32 12.308% 50.000% ## ( 580, 870 ] 26 10.000% 60.000% ## ( 870, 1300 ] 26 10.000% 70.000% ## ( 1300, 1900 ] 17 6.538% 76.538% # ( 1900, 2900 ] 26 10.000% 86.538% ## ( 2900, 4400 ] 28 10.769% 97.308% ## ( 4400, 6600 ] 5 1.923% 99.231% ( 6600, 9900 ] 2 0.769% 100.000% ** DB Stats ** Uptime(secs): 58.8 total, 10.1 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 184.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.362 H:M:S, 48.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 97.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.310 H:M:S, 72.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.450 micros/op 183473 ops/sec 60.009 seconds 11009999 operations; 177.8 MB/s Microseconds per write: Count: 11009999 Average: 5.4502 StdDev: 470.13 Min: 0 Median: 1.7594 Max: 735443 Percentiles: P50: 1.76 P75: 2.77 P99: 7.74 P99.9: 1093.37 P99.99: 2655.01 ------------------------------------------------------ [ 0, 1 ] 1333496 12.112% 12.112% ## ( 1, 2 ] 5492927 49.890% 62.002% ########## ( 2, 3 ] 1865657 16.945% 78.947% ### ( 3, 4 ] 1553312 14.108% 93.055% ### ( 4, 6 ] 616260 5.597% 98.653% # ( 6, 10 ] 87762 0.797% 99.450% ( 10, 15 ] 21288 0.193% 99.643% ( 15, 22 ] 7247 0.066% 99.709% ( 22, 34 ] 1871 0.017% 99.726% ( 34, 51 ] 269 0.002% 99.728% ( 51, 76 ] 53 0.000% 99.729% ( 76, 110 ] 7550 0.069% 99.797% ( 110, 170 ] 3233 0.029% 99.827% ( 170, 250 ] 326 0.003% 99.830% ( 250, 380 ] 131 0.001% 99.831% ( 380, 580 ] 35 0.000% 99.831% ( 580, 870 ] 30 0.000% 99.831% ( 870, 1300 ] 14519 0.132% 99.963% ( 1300, 1900 ] 69 0.001% 99.964% ( 1900, 2900 ] 3792 0.034% 99.998% ( 2900, 4400 ] 121 0.001% 100.000% ( 4400, 6600 ] 19 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 215064 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11009999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11362318968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 664 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29754405 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 35326179912 rocksdb.compact.write.bytes COUNT : 35118541379 rocksdb.flush.write.bytes COUNT : 11361931513 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 61 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 341 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11270330368 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4381696 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 35429369844 rocksdb.non.last.level.read.count COUNT : 8561661 rocksdb.block.checksum.compute.count COUNT : 8560394 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.400314 P95 : 3.861403 P99 : 5.972612 P100 : 735442.000000 COUNT : 11009999 SUM : 54792545 rocksdb.compaction.times.micros P50 : 916666.666667 P95 : 2857142.857143 P99 : 12908000.000000 P100 : 16318617.000000 COUNT : 126 SUM : 153319602 rocksdb.compaction.times.cpu_micros P50 : 818571.428571 P95 : 2600000.000000 P99 : 12908000.000000 P100 : 15359151.000000 COUNT : 126 SUM : 127570282 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 733.146067 P95 : 2033.333333 P99 : 41160.000000 P100 : 76066.000000 COUNT : 152 SUM : 242616 rocksdb.compaction.outfile.sync.micros P50 : 1133.960396 P95 : 83833.333333 P99 : 142600.000000 P100 : 251017.000000 COUNT : 474 SUM : 6106446 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 109.451613 P95 : 1276.545455 P99 : 2870.000000 P100 : 3899.000000 COUNT : 312 SUM : 91820 rocksdb.table.open.io.micros P50 : 1250.574713 P95 : 6705.600000 P99 : 11512.666667 P100 : 15631.000000 COUNT : 664 SUM : 1269570 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.703363 P95 : 7.975110 P99 : 10.869050 P100 : 14399.000000 COUNT : 8558422 SUM : 52509514 rocksdb.read.block.get.micros P50 : 362.171429 P95 : 3306.153846 P99 : 5186.500000 P100 : 10022.000000 COUNT : 1328 SUM : 1043264 rocksdb.write.raw.block.micros P50 : 0.513683 P95 : 0.975998 P99 : 3.003300 P100 : 13762.000000 COUNT : 11257728 SUM : 23338525 rocksdb.numfiles.in.singlecompaction P50 : 2.807692 P95 : 5.583333 P99 : 17.450000 P100 : 41.000000 COUNT : 165 SUM : 583 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.556370 P95 : 1145.822583 P99 : 2445.563212 P100 : 735208.000000 COUNT : 182959 SUM : 29765096 rocksdb.sst.read.micros P50 : 1.631751 P95 : 4.766364 P99 : 8.345980 P100 : 14379.000000 COUNT : 8561809 SUM : 34797501 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11009999 SUM : 11362318968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215000.000000 P95 : 376100.000000 P99 : 909767.000000 P100 : 909767.000000 COUNT : 152 SUM : 34034965 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 439 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0