[2024-11-28 04:21:20.174930] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-28 04:21:20.175073] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3041964 ] Set seed to 1732764080171483 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-28 04:21:20.279776] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-28 04:21:20.489544] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-28 04:21:20.489587] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3041964' to capture a snapshot of events at runtime. [2024-11-28 04:21:20.489598] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3041964 for offline analysis/debug. [2024-11-28 04:21:20.489620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Nov 28 04:21:29 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/28-04:21:31 ... thread 0: (1000000,1000000) ops and (357299.0,357299.0) ops/second in (2.798776,2.798776) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/9 567.01 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 351.1 2.33 2.10 12 0.194 0 0 0.0 0.0 L1 3/3 188.86 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 252.5 252.4 0.75 0.73 1 0.748 191K 89 0.0 0.0 L2 1/0 48.77 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 247.9 247.8 0.45 0.42 1 0.449 113K 21 0.0 0.0 L3 17/0 818.42 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 223.5 223.5 0.28 0.24 1 0.280 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1190/12 96.94 GB 0.0 0.4 0.2 0.1 1.2 1.0 0.2 1.4 95.2 310.1 3.81 3.49 15 0.254 368K 110 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.1 1.2 1.0 0.1 1.4 95.2 310.1 3.81 3.49 15 0.254 368K 110 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.1 0.4 0.2 0.0 0.0 245.6 245.5 1.48 1.39 3 0.492 368K 110 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 351.1 2.33 2.10 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.15 GB write, 395.68 MB/s write, 0.35 GB read, 121.47 MB/s read, 3.8 seconds Interval compaction: 1.15 GB write, 421.97 MB/s write, 0.35 GB read, 129.54 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 102753 Average: 1.9028 StdDev: 14.77 Min: 0 Median: 1.2759 Max: 3443 Percentiles: P50: 1.28 P75: 1.68 P99: 3.93 P99.9: 9.89 P99.99: 242.66 ------------------------------------------------------ [ 0, 1 ] 33689 32.786% 32.786% ####### ( 1, 2 ] 64122 62.404% 95.190% ############ ( 2, 3 ] 2793 2.718% 97.909% # ( 3, 4 ] 1214 1.181% 99.090% ( 4, 6 ] 565 0.550% 99.640% ( 6, 10 ] 278 0.271% 99.910% ( 10, 15 ] 58 0.056% 99.967% ( 15, 22 ] 9 0.009% 99.976% ( 22, 34 ] 5 0.005% 99.981% ( 51, 76 ] 2 0.002% 99.982% ( 110, 170 ] 8 0.008% 99.990% ( 170, 250 ] 3 0.003% 99.993% ( 250, 380 ] 2 0.002% 99.995% ( 380, 580 ] 5 0.005% 100.000% ( 580, 870 ] 1 0.001% 100.001% ( 870, 1300 ] 3 0.003% 100.004% ( 1900, 2900 ] 1 0.001% 100.005% ( 2900, 4400 ] 1 0.001% 100.006% ** Level 1 read latency histogram (micros): Count: 31558 Average: 2.4163 StdDev: 31.87 Min: 0 Median: 1.2941 Max: 4088 Percentiles: P50: 1.29 P75: 1.68 P99: 5.98 P99.9: 75.07 P99.99: 1553.26 ------------------------------------------------------ [ 0, 1 ] 9833 31.159% 31.159% ###### ( 1, 2 ] 20221 64.076% 95.234% ############# ( 2, 3 ] 667 2.114% 97.348% ( 3, 4 ] 364 1.153% 98.501% ( 4, 6 ] 160 0.507% 99.008% ( 6, 10 ] 174 0.551% 99.560% ( 10, 15 ] 59 0.187% 99.746% ( 15, 22 ] 7 0.022% 99.769% ( 34, 51 ] 2 0.006% 99.775% ( 51, 76 ] 42 0.133% 99.908% ( 76, 110 ] 8 0.025% 99.933% ( 110, 170 ] 3 0.010% 99.943% ( 170, 250 ] 9 0.029% 99.971% ( 250, 380 ] 3 0.010% 99.981% ( 580, 870 ] 1 0.003% 99.984% ( 870, 1300 ] 2 0.006% 99.990% ( 1300, 1900 ] 2 0.006% 99.997% ( 1900, 2900 ] 1 0.003% 100.000% ( 2900, 4400 ] 1 0.003% 100.003% ** Level 2 read latency histogram (micros): Count: 15872 Average: 1.8352 StdDev: 4.56 Min: 0 Median: 1.2546 Max: 434 Percentiles: P50: 1.25 P75: 1.67 P99: 5.20 P99.9: 10.06 P99.99: 234.34 ------------------------------------------------------ [ 0, 1 ] 5491 34.596% 34.596% ####### ( 1, 2 ] 9603 60.503% 95.098% ############ ( 2, 3 ] 300 1.890% 96.988% ( 3, 4 ] 212 1.336% 98.324% ( 4, 6 ] 179 1.128% 99.452% ( 6, 10 ] 71 0.447% 99.899% ( 10, 15 ] 11 0.069% 99.968% ( 15, 22 ] 1 0.006% 99.975% ( 170, 250 ] 3 0.019% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 1560.8235 StdDev: 2300.94 Min: 0 Median: 315.0000 Max: 8540 Percentiles: P50: 315.00 P75: 2118.75 P99: 8540.00 P99.9: 8540.00 P99.99: 8540.00 ------------------------------------------------------ [ 0, 1 ] 31 36.471% 36.471% ####### ( 1, 2 ] 7 8.235% 44.706% ## ( 170, 250 ] 3 3.529% 48.235% # ( 250, 380 ] 3 3.529% 51.765% # ( 380, 580 ] 1 1.176% 52.941% ( 580, 870 ] 3 3.529% 56.471% # ( 870, 1300 ] 4 4.706% 61.176% # ( 1300, 1900 ] 10 11.765% 72.941% ## ( 1900, 2900 ] 8 9.412% 82.353% ## ( 2900, 4400 ] 4 4.706% 87.059% # ( 4400, 6600 ] 3 3.529% 90.588% # ( 6600, 9900 ] 8 9.412% 100.000% ## ** Level 4 read latency histogram (micros): Count: 30 Average: 3746.1333 StdDev: 3150.61 Min: 246 Median: 2471.4286 Max: 10025 Percentiles: P50: 2471.43 P75: 7516.67 P99: 10025.00 P99.9: 10025.00 P99.99: 10025.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 1 3.333% 6.667% # ( 580, 870 ] 6 20.000% 26.667% #### ( 870, 1300 ] 1 3.333% 30.000% # ( 1300, 1900 ] 2 6.667% 36.667% # ( 1900, 2900 ] 7 23.333% 60.000% ##### ( 2900, 4400 ] 1 3.333% 63.333% # ( 4400, 6600 ] 1 3.333% 66.667% # ( 6600, 9900 ] 9 30.000% 96.667% ###### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 329.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.171 H:M:S, 5.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.171 H:M:S, 6.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-04:21:35 ... thread 0: (1000000,2000000) ops and (316740.0,335799.2) ops/second in (3.157164,5.955940) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 1.23 GB 18.9 0.8 0.0 0.8 2.6 1.8 0.0 1.4 97.4 314.4 8.41 7.77 29 0.290 831K 870 0.0 0.0 L1 1/1 4.21 MB 0.0 0.7 0.4 0.2 0.7 0.4 0.1 1.6 242.0 241.6 2.86 2.79 2 1.431 703K 1038 0.0 0.0 L2 5/4 547.41 MB 1.1 0.1 0.1 0.0 0.1 0.1 0.5 1.8 247.9 247.8 0.45 0.42 1 0.449 113K 21 0.0 0.0 L3 17/10 818.42 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 223.5 223.5 0.28 0.24 1 0.280 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1192/21 97.92 GB 0.0 1.6 0.6 1.1 3.4 2.3 0.7 1.9 140.4 292.5 12.00 11.22 33 0.364 1711K 1929 0.0 0.0 Int 0/0 0.00 KB 0.0 1.6 0.6 1.1 3.4 2.3 0.6 1.9 140.4 292.5 12.00 11.22 33 0.364 1711K 1929 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.6 0.6 1.1 1.6 0.6 0.0 0.0 250.3 250.0 6.73 6.53 7 0.962 1711K 1929 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 346.7 5.27 4.69 26 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.43 GB write, 571.42 MB/s write, 1.65 GB read, 274.38 MB/s read, 12.0 seconds Interval compaction: 3.43 GB write, 589.27 MB/s write, 1.65 GB read, 282.95 MB/s read, 12.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 378433 Average: 2.2159 StdDev: 14.32 Min: 0 Median: 1.4811 Max: 3944 Percentiles: P50: 1.48 P75: 1.87 P99: 5.68 P99.9: 11.05 P99.99: 19.49 ------------------------------------------------------ [ 0, 1 ] 70659 18.671% 18.671% #### ( 1, 2 ] 246425 65.117% 83.789% ############# ( 2, 3 ] 37102 9.804% 93.593% ## ( 3, 4 ] 12632 3.338% 96.931% # ( 4, 6 ] 9337 2.467% 99.398% ( 6, 10 ] 1818 0.480% 99.878% ( 10, 15 ] 393 0.104% 99.982% ( 15, 22 ] 47 0.012% 99.995% ( 22, 34 ] 10 0.003% 99.997% ( 34, 51 ] 1 0.000% 99.998% ( 51, 76 ] 8 0.002% 100.000% ( 110, 170 ] 15 0.004% 100.004% ( 170, 250 ] 7 0.002% 100.006% ( 250, 380 ] 4 0.001% 100.007% ( 380, 580 ] 10 0.003% 100.009% ( 580, 870 ] 7 0.002% 100.011% ( 870, 1300 ] 4 0.001% 100.012% ( 1300, 1900 ] 4 0.001% 100.013% ( 1900, 2900 ] 5 0.001% 100.015% ( 2900, 4400 ] 2 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 129669 Average: 2.4475 StdDev: 17.60 Min: 0 Median: 1.5653 Max: 4088 Percentiles: P50: 1.57 P75: 1.95 P99: 5.87 P99.9: 14.27 P99.99: 343.47 ------------------------------------------------------ [ 0, 1 ] 17482 13.482% 13.482% ### ( 1, 2 ] 83760 64.595% 78.077% ############# ( 2, 3 ] 17236 13.292% 91.370% ### ( 3, 4 ] 5663 4.367% 95.737% # ( 4, 6 ] 4527 3.491% 99.228% # ( 6, 10 ] 733 0.565% 99.793% ( 10, 15 ] 162 0.125% 99.918% ( 15, 22 ] 19 0.015% 99.933% ( 22, 34 ] 4 0.003% 99.936% ( 34, 51 ] 2 0.002% 99.938% ( 51, 76 ] 43 0.033% 99.971% ( 76, 110 ] 8 0.006% 99.977% ( 110, 170 ] 3 0.002% 99.979% ( 170, 250 ] 9 0.007% 99.986% ( 250, 380 ] 7 0.005% 99.992% ( 580, 870 ] 1 0.001% 99.992% ( 870, 1300 ] 4 0.003% 99.995% ( 1300, 1900 ] 4 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15935 Average: 1.8411 StdDev: 4.55 Min: 0 Median: 1.2574 Max: 434 Percentiles: P50: 1.26 P75: 1.67 P99: 5.22 P99.9: 10.48 P99.99: 234.17 ------------------------------------------------------ [ 0, 1 ] 5491 34.459% 34.459% ####### ( 1, 2 ] 9621 60.377% 94.835% ############ ( 2, 3 ] 336 2.109% 96.944% ( 3, 4 ] 218 1.368% 98.312% ( 4, 6 ] 180 1.130% 99.441% ( 6, 10 ] 72 0.452% 99.893% ( 10, 15 ] 11 0.069% 99.962% ( 15, 22 ] 1 0.006% 99.969% ( 22, 34 ] 1 0.006% 99.975% ( 170, 250 ] 3 0.019% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 109665 Average: 4.3688 StdDev: 79.00 Min: 0 Median: 1.6489 Max: 8540 Percentiles: P50: 1.65 P75: 2.19 P99: 9.53 P99.9: 281.12 P99.99: 2912.56 ------------------------------------------------------ [ 0, 1 ] 9715 8.859% 8.859% ## ( 1, 2 ] 69530 63.402% 72.261% ############# ( 2, 3 ] 16116 14.696% 86.957% ### ( 3, 4 ] 6218 5.670% 92.627% # ( 4, 6 ] 5257 4.794% 97.420% # ( 6, 10 ] 1963 1.790% 99.210% ( 10, 15 ] 408 0.372% 99.582% ( 15, 22 ] 65 0.059% 99.642% ( 22, 34 ] 6 0.005% 99.647% ( 76, 110 ] 81 0.074% 99.721% ( 110, 170 ] 147 0.134% 99.855% ( 170, 250 ] 40 0.036% 99.891% ( 250, 380 ] 39 0.036% 99.927% ( 380, 580 ] 24 0.022% 99.949% ( 580, 870 ] 17 0.016% 99.964% ( 870, 1300 ] 8 0.007% 99.972% ( 1300, 1900 ] 12 0.011% 99.983% ( 1900, 2900 ] 8 0.007% 99.990% ( 2900, 4400 ] 4 0.004% 99.994% ( 4400, 6600 ] 3 0.003% 99.996% ( 6600, 9900 ] 8 0.007% 100.004% ** Level 4 read latency histogram (micros): Count: 30 Average: 3746.1333 StdDev: 3150.61 Min: 246 Median: 2471.4286 Max: 10025 Percentiles: P50: 2471.43 P75: 7516.67 P99: 10025.00 P99.9: 10025.00 P99.99: 10025.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 1 3.333% 6.667% # ( 580, 870 ] 6 20.000% 26.667% #### ( 870, 1300 ] 1 3.333% 30.000% # ( 1300, 1900 ] 2 6.667% 36.667% # ( 1900, 2900 ] 7 23.333% 60.000% ##### ( 2900, 4400 ] 1 3.333% 63.333% # ( 4400, 6600 ] 1 3.333% 66.667% # ( 6600, 9900 ] 9 30.000% 96.667% ###### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.606 H:M:S, 9.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 311.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.435 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/28-04:21:38 ... thread 0: (1000000,3000000) ops and (314066.1,328228.2) ops/second in (3.184043,9.139983) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.21 GB 88.1 1.6 0.0 1.6 4.4 2.8 0.0 1.6 112.3 306.5 14.59 13.54 46 0.317 1663K 1706 0.0 0.0 L1 1/1 4.21 MB 0.0 0.7 0.4 0.2 0.7 0.4 0.1 1.6 242.0 241.6 2.86 2.79 2 1.431 703K 1038 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.5 1.8 247.9 247.8 0.45 0.42 1 0.449 113K 21 0.0 0.0 L3 25/0 977.26 MB 1.0 1.5 0.6 0.9 1.5 0.6 0.0 2.5 204.1 204.0 7.36 6.43 4 1.841 1516K 738 0.0 0.0 L4 156/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/11 98.90 GB 0.0 3.9 1.1 2.8 6.6 3.9 1.3 2.4 156.2 268.3 25.26 23.19 53 0.477 3995K 3503 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.1 2.8 6.6 3.9 1.3 2.4 156.2 268.3 25.26 23.19 53 0.477 3995K 3503 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.1 2.8 3.8 1.1 0.0 0.0 231.0 230.8 17.08 15.92 13 1.314 3995K 3503 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 346.5 8.18 7.26 40 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.62 GB write, 726.48 MB/s write, 3.85 GB read, 422.95 MB/s read, 25.3 seconds Interval compaction: 6.62 GB write, 741.27 MB/s write, 3.85 GB read, 431.56 MB/s read, 25.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 780926 Average: 2.4429 StdDev: 14.47 Min: 0 Median: 1.5824 Max: 4550 Percentiles: P50: 1.58 P75: 1.97 P99: 5.89 P99.9: 11.57 P99.99: 17.25 ------------------------------------------------------ [ 0, 1 ] 97987 12.548% 12.548% ### ( 1, 2 ] 502172 64.305% 76.852% ############# ( 2, 3 ] 109131 13.975% 90.827% ### ( 3, 4 ] 34950 4.475% 95.302% # ( 4, 6 ] 30504 3.906% 99.208% # ( 6, 10 ] 5093 0.652% 99.861% ( 10, 15 ] 980 0.125% 99.986% ( 15, 22 ] 96 0.012% 99.998% ( 22, 34 ] 13 0.002% 100.000% ( 34, 51 ] 7 0.001% 100.001% ( 51, 76 ] 15 0.002% 100.003% ( 76, 110 ] 41 0.005% 100.008% ( 110, 170 ] 85 0.011% 100.019% ( 170, 250 ] 49 0.006% 100.025% ( 250, 380 ] 30 0.004% 100.029% ( 380, 580 ] 34 0.004% 100.033% ( 580, 870 ] 25 0.003% 100.037% ( 870, 1300 ] 7 0.001% 100.038% ( 1300, 1900 ] 9 0.001% 100.039% ( 1900, 2900 ] 9 0.001% 100.040% ( 2900, 4400 ] 3 0.000% 100.040% ( 4400, 6600 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 186851 Average: 2.5726 StdDev: 15.02 Min: 0 Median: 1.6414 Max: 4088 Percentiles: P50: 1.64 P75: 2.18 P99: 6.57 P99.9: 14.74 P99.99: 358.09 ------------------------------------------------------ [ 0, 1 ] 19593 10.486% 10.486% ## ( 1, 2 ] 115111 61.606% 72.092% ############ ( 2, 3 ] 30890 16.532% 88.624% ### ( 3, 4 ] 10356 5.542% 94.166% # ( 4, 6 ] 8805 4.712% 98.878% # ( 6, 10 ] 1598 0.855% 99.733% ( 10, 15 ] 328 0.176% 99.909% ( 15, 22 ] 44 0.024% 99.933% ( 22, 34 ] 7 0.004% 99.936% ( 34, 51 ] 2 0.001% 99.937% ( 51, 76 ] 43 0.023% 99.960% ( 76, 110 ] 23 0.012% 99.973% ( 110, 170 ] 9 0.005% 99.978% ( 170, 250 ] 15 0.008% 99.986% ( 250, 380 ] 10 0.005% 99.991% ( 380, 580 ] 6 0.003% 99.994% ( 580, 870 ] 1 0.001% 99.995% ( 870, 1300 ] 4 0.002% 99.997% ( 1300, 1900 ] 4 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.0798 StdDev: 3.50 Min: 0 Median: 1.4373 Max: 434 Percentiles: P50: 1.44 P75: 1.84 P99: 5.69 P99.9: 9.91 P99.99: 201.31 ------------------------------------------------------ [ 0, 1 ] 6403 22.659% 22.659% ##### ( 1, 2 ] 17667 62.520% 85.179% ############# ( 2, 3 ] 2374 8.401% 93.581% ## ( 3, 4 ] 904 3.199% 96.780% # ( 4, 6 ] 744 2.633% 99.413% # ( 6, 10 ] 141 0.499% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 170, 250 ] 3 0.011% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 227224 Average: 4.3350 StdDev: 58.36 Min: 0 Median: 1.6762 Max: 8540 Percentiles: P50: 1.68 P75: 2.29 P99: 9.84 P99.9: 378.02 P99.99: 1363.88 ------------------------------------------------------ [ 0, 1 ] 17549 7.723% 7.723% ## ( 1, 2 ] 142057 62.518% 70.242% ############# ( 2, 3 ] 36784 16.188% 86.430% ### ( 3, 4 ] 13122 5.775% 92.205% # ( 4, 6 ] 11477 5.051% 97.256% # ( 6, 10 ] 4129 1.817% 99.073% ( 10, 15 ] 767 0.338% 99.411% ( 15, 22 ] 100 0.044% 99.455% ( 22, 34 ] 45 0.020% 99.475% ( 34, 51 ] 16 0.007% 99.482% ( 76, 110 ] 197 0.087% 99.568% ( 110, 170 ] 417 0.184% 99.752% ( 170, 250 ] 193 0.085% 99.837% ( 250, 380 ] 146 0.064% 99.901% ( 380, 580 ] 116 0.051% 99.952% ( 580, 870 ] 71 0.031% 99.983% ( 870, 1300 ] 14 0.006% 99.989% ( 1300, 1900 ] 12 0.005% 99.995% ( 1900, 2900 ] 10 0.004% 99.999% ( 2900, 4400 ] 4 0.002% 100.001% ( 4400, 6600 ] 3 0.001% 100.002% ( 6600, 9900 ] 8 0.004% 100.006% ** Level 4 read latency histogram (micros): Count: 30 Average: 3746.1333 StdDev: 3150.61 Min: 246 Median: 2471.4286 Max: 10025 Percentiles: P50: 2471.43 P75: 7516.67 P99: 10025.00 P99.9: 10025.00 P99.99: 10025.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 1 3.333% 6.667% # ( 580, 870 ] 6 20.000% 26.667% #### ( 870, 1300 ] 1 3.333% 30.000% # ( 1300, 1900 ] 2 6.667% 36.667% # ( 1900, 2900 ] 7 23.333% 60.000% ##### ( 2900, 4400 ] 1 3.333% 63.333% # ( 4400, 6600 ] 1 3.333% 66.667% # ( 6600, 9900 ] 9 30.000% 96.667% ###### ( 9900, 14000 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 976.6500 StdDev: 1288.98 Min: 109 Median: 250.0000 Max: 4211 Percentiles: P50: 250.00 P75: 1300.00 P99: 4211.00 P99.9: 4211.00 P99.99: 4211.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 8 40.000% 45.000% ######## ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.3 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 316.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.040 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 309.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.434 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-04:21:41 ... thread 0: (1000000,4000000) ops and (319459.2,325991.1) ops/second in (3.130290,12.270273) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/16 2.15 GB 0.0 2.2 0.0 2.2 5.9 3.8 0.0 1.6 111.9 306.7 19.71 18.32 62 0.318 2238K 2308 0.0 0.0 L1 10/10 1.04 GB 0.0 1.7 1.5 0.3 1.7 1.5 0.1 1.2 227.8 227.0 7.76 7.50 3 2.586 1794K 5648 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.5 1.8 247.9 247.8 0.45 0.42 1 0.449 113K 21 0.0 0.0 L3 25/0 977.26 MB 1.0 1.5 0.6 0.9 1.5 0.6 0.0 2.5 204.1 204.0 7.36 6.43 4 1.841 1516K 738 0.0 0.0 L4 156/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/26 99.88 GB 0.0 5.5 2.1 3.3 9.2 5.9 1.3 2.5 158.4 267.0 35.28 32.67 70 0.504 5662K 8715 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 2.1 3.3 9.2 5.9 1.3 2.5 158.4 267.0 35.28 32.67 70 0.504 5662K 8715 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 2.1 3.3 5.4 2.1 0.0 0.0 230.9 230.5 24.19 22.80 16 1.512 5662K 8715 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 346.6 11.09 9.86 54 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.20 GB write, 756.14 MB/s write, 5.46 GB read, 448.41 MB/s read, 35.3 seconds Interval compaction: 9.20 GB write, 767.61 MB/s write, 5.46 GB read, 455.21 MB/s read, 35.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1082898 Average: 2.4067 StdDev: 13.56 Min: 0 Median: 1.5683 Max: 4550 Percentiles: P50: 1.57 P75: 1.95 P99: 5.89 P99.9: 11.50 P99.99: 16.44 ------------------------------------------------------ [ 0, 1 ] 138405 12.781% 12.781% ### ( 1, 2 ] 709266 65.497% 78.278% ############# ( 2, 3 ] 143874 13.286% 91.564% ### ( 3, 4 ] 44715 4.129% 95.693% # ( 4, 6 ] 37828 3.493% 99.186% # ( 6, 10 ] 7323 0.676% 99.863% ( 10, 15 ] 1356 0.125% 99.988% ( 15, 22 ] 120 0.011% 99.999% ( 22, 34 ] 18 0.002% 100.001% ( 34, 51 ] 9 0.001% 100.001% ( 51, 76 ] 16 0.001% 100.003% ( 76, 110 ] 46 0.004% 100.007% ( 110, 170 ] 124 0.011% 100.019% ( 170, 250 ] 66 0.006% 100.025% ( 250, 380 ] 45 0.004% 100.029% ( 380, 580 ] 53 0.005% 100.034% ( 580, 870 ] 33 0.003% 100.037% ( 870, 1300 ] 11 0.001% 100.038% ( 1300, 1900 ] 10 0.001% 100.039% ( 1900, 2900 ] 9 0.001% 100.040% ( 2900, 4400 ] 5 0.000% 100.040% ( 4400, 6600 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 223431 Average: 2.6608 StdDev: 17.41 Min: 0 Median: 1.6116 Max: 4088 Percentiles: P50: 1.61 P75: 2.04 P99: 7.10 P99.9: 75.19 P99.99: 611.75 ------------------------------------------------------ [ 0, 1 ] 26106 11.684% 11.684% ## ( 1, 2 ] 139976 62.648% 74.333% ############# ( 2, 3 ] 34042 15.236% 89.569% ### ( 3, 4 ] 11185 5.006% 94.575% # ( 4, 6 ] 9307 4.165% 98.740% # ( 6, 10 ] 2117 0.947% 99.688% ( 10, 15 ] 371 0.166% 99.854% ( 15, 22 ] 52 0.023% 99.877% ( 22, 34 ] 8 0.004% 99.881% ( 34, 51 ] 2 0.001% 99.881% ( 51, 76 ] 44 0.020% 99.901% ( 76, 110 ] 81 0.036% 99.937% ( 110, 170 ] 45 0.020% 99.957% ( 170, 250 ] 33 0.015% 99.972% ( 250, 380 ] 28 0.013% 99.985% ( 380, 580 ] 12 0.005% 99.990% ( 580, 870 ] 6 0.003% 99.993% ( 870, 1300 ] 5 0.002% 99.995% ( 1300, 1900 ] 8 0.004% 99.999% ( 1900, 2900 ] 3 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.0798 StdDev: 3.50 Min: 0 Median: 1.4373 Max: 434 Percentiles: P50: 1.44 P75: 1.84 P99: 5.69 P99.9: 9.91 P99.99: 201.31 ------------------------------------------------------ [ 0, 1 ] 6403 22.659% 22.659% ##### ( 1, 2 ] 17667 62.520% 85.179% ############# ( 2, 3 ] 2374 8.401% 93.581% ## ( 3, 4 ] 904 3.199% 96.780% # ( 4, 6 ] 744 2.633% 99.413% # ( 6, 10 ] 141 0.499% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 170, 250 ] 3 0.011% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 227224 Average: 4.3350 StdDev: 58.36 Min: 0 Median: 1.6762 Max: 8540 Percentiles: P50: 1.68 P75: 2.29 P99: 9.84 P99.9: 378.02 P99.99: 1363.88 ------------------------------------------------------ [ 0, 1 ] 17549 7.723% 7.723% ## ( 1, 2 ] 142057 62.518% 70.242% ############# ( 2, 3 ] 36784 16.188% 86.430% ### ( 3, 4 ] 13122 5.775% 92.205% # ( 4, 6 ] 11477 5.051% 97.256% # ( 6, 10 ] 4129 1.817% 99.073% ( 10, 15 ] 767 0.338% 99.411% ( 15, 22 ] 100 0.044% 99.455% ( 22, 34 ] 45 0.020% 99.475% ( 34, 51 ] 16 0.007% 99.482% ( 76, 110 ] 197 0.087% 99.568% ( 110, 170 ] 417 0.184% 99.752% ( 170, 250 ] 193 0.085% 99.837% ( 250, 380 ] 146 0.064% 99.901% ( 380, 580 ] 116 0.051% 99.952% ( 580, 870 ] 71 0.031% 99.983% ( 870, 1300 ] 14 0.006% 99.989% ( 1300, 1900 ] 12 0.005% 99.995% ( 1900, 2900 ] 10 0.004% 99.999% ( 2900, 4400 ] 4 0.002% 100.001% ( 4400, 6600 ] 3 0.001% 100.002% ( 6600, 9900 ] 8 0.004% 100.006% ** Level 4 read latency histogram (micros): Count: 30 Average: 3746.1333 StdDev: 3150.61 Min: 246 Median: 2471.4286 Max: 10025 Percentiles: P50: 2471.43 P75: 7516.67 P99: 10025.00 P99.9: 10025.00 P99.99: 10025.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 1 3.333% 6.667% # ( 580, 870 ] 6 20.000% 26.667% #### ( 870, 1300 ] 1 3.333% 30.000% # ( 1300, 1900 ] 2 6.667% 36.667% # ( 1900, 2900 ] 7 23.333% 60.000% ##### ( 2900, 4400 ] 1 3.333% 63.333% # ( 4400, 6600 ] 1 3.333% 66.667% # ( 6600, 9900 ] 9 30.000% 96.667% ###### ( 9900, 14000 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 976.6500 StdDev: 1288.98 Min: 109 Median: 250.0000 Max: 4211 Percentiles: P50: 250.00 P75: 1300.00 P99: 4211.00 P99.9: 4211.00 P99.99: 4211.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 8 40.000% 45.000% ######## ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.5 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 316.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.488 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.448 H:M:S, 14.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/28-04:21:44 ... thread 0: (1000000,5000000) ops and (319544.8,324681.1) ops/second in (3.129452,15.399725) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 3.07 GB 119.6 3.3 0.0 3.3 7.9 4.7 0.0 1.7 124.6 303.1 26.80 25.04 79 0.339 3390K 3486 0.0 0.0 L1 10/10 1.04 GB 0.0 1.7 1.5 0.3 1.7 1.5 0.1 1.2 227.8 227.0 7.76 7.50 3 2.586 1794K 5648 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.5 1.8 247.9 247.8 0.45 0.42 1 0.449 113K 21 0.0 0.0 L3 25/0 977.26 MB 1.0 1.5 0.6 0.9 1.5 0.6 0.0 2.5 204.1 204.0 7.36 6.43 4 1.841 1516K 738 0.0 0.0 L4 156/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/22 100.80 GB 0.0 6.6 2.1 4.4 11.2 6.8 1.3 2.4 158.6 271.3 42.37 39.39 87 0.487 6813K 9893 0.0 0.0 Int 0/0 0.00 KB 0.0 6.6 2.1 4.4 11.2 6.8 1.3 2.4 158.6 271.3 42.37 39.39 87 0.487 6813K 9893 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.6 2.1 4.4 6.6 2.1 0.0 0.0 235.5 235.1 28.54 27.07 20 1.427 6813K 9893 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 346.0 13.84 12.32 67 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.23 GB write, 737.63 MB/s write, 6.56 GB read, 431.14 MB/s read, 42.4 seconds Interval compaction: 11.23 GB write, 746.54 MB/s write, 6.56 GB read, 436.34 MB/s read, 42.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1444114 Average: 2.3911 StdDev: 12.87 Min: 0 Median: 1.5689 Max: 4550 Percentiles: P50: 1.57 P75: 1.95 P99: 5.86 P99.9: 11.06 P99.99: 14.91 ------------------------------------------------------ [ 0, 1 ] 177820 12.313% 12.313% ## ( 1, 2 ] 956633 66.244% 78.557% ############# ( 2, 3 ] 192895 13.357% 91.914% ### ( 3, 4 ] 57843 4.005% 95.920% # ( 4, 6 ] 47884 3.316% 99.236% # ( 6, 10 ] 9236 0.640% 99.875% ( 10, 15 ] 1690 0.117% 99.992% ( 15, 22 ] 133 0.009% 100.001% ( 22, 34 ] 22 0.002% 100.003% ( 34, 51 ] 12 0.001% 100.004% ( 51, 76 ] 19 0.001% 100.005% ( 76, 110 ] 66 0.005% 100.010% ( 110, 170 ] 156 0.011% 100.020% ( 170, 250 ] 86 0.006% 100.026% ( 250, 380 ] 52 0.004% 100.030% ( 380, 580 ] 66 0.005% 100.035% ( 580, 870 ] 38 0.003% 100.037% ( 870, 1300 ] 22 0.002% 100.039% ( 1300, 1900 ] 12 0.001% 100.040% ( 1900, 2900 ] 10 0.001% 100.040% ( 2900, 4400 ] 6 0.000% 100.041% ( 4400, 6600 ] 1 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 292136 Average: 2.6863 StdDev: 17.01 Min: 0 Median: 1.6128 Max: 4088 Percentiles: P50: 1.61 P75: 2.02 P99: 7.68 P99.9: 91.37 P99.99: 568.97 ------------------------------------------------------ [ 0, 1 ] 31675 10.843% 10.843% ## ( 1, 2 ] 186663 63.896% 74.738% ############# ( 2, 3 ] 44597 15.266% 90.004% ### ( 3, 4 ] 13475 4.613% 94.617% # ( 4, 6 ] 11404 3.904% 98.521% # ( 6, 10 ] 3342 1.144% 99.665% ( 10, 15 ] 514 0.176% 99.840% ( 15, 22 ] 61 0.021% 99.861% ( 22, 34 ] 8 0.003% 99.864% ( 34, 51 ] 2 0.001% 99.865% ( 51, 76 ] 45 0.015% 99.880% ( 76, 110 ] 128 0.044% 99.924% ( 110, 170 ] 84 0.029% 99.953% ( 170, 250 ] 50 0.017% 99.970% ( 250, 380 ] 38 0.013% 99.983% ( 380, 580 ] 22 0.008% 99.990% ( 580, 870 ] 10 0.003% 99.994% ( 870, 1300 ] 5 0.002% 99.996% ( 1300, 1900 ] 8 0.003% 99.998% ( 1900, 2900 ] 3 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.0798 StdDev: 3.50 Min: 0 Median: 1.4373 Max: 434 Percentiles: P50: 1.44 P75: 1.84 P99: 5.69 P99.9: 9.91 P99.99: 201.31 ------------------------------------------------------ [ 0, 1 ] 6403 22.659% 22.659% ##### ( 1, 2 ] 17667 62.520% 85.179% ############# ( 2, 3 ] 2374 8.401% 93.581% ## ( 3, 4 ] 904 3.199% 96.780% # ( 4, 6 ] 744 2.633% 99.413% # ( 6, 10 ] 141 0.499% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 170, 250 ] 3 0.011% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 227224 Average: 4.3350 StdDev: 58.36 Min: 0 Median: 1.6762 Max: 8540 Percentiles: P50: 1.68 P75: 2.29 P99: 9.84 P99.9: 378.02 P99.99: 1363.88 ------------------------------------------------------ [ 0, 1 ] 17549 7.723% 7.723% ## ( 1, 2 ] 142057 62.518% 70.242% ############# ( 2, 3 ] 36784 16.188% 86.430% ### ( 3, 4 ] 13122 5.775% 92.205% # ( 4, 6 ] 11477 5.051% 97.256% # ( 6, 10 ] 4129 1.817% 99.073% ( 10, 15 ] 767 0.338% 99.411% ( 15, 22 ] 100 0.044% 99.455% ( 22, 34 ] 45 0.020% 99.475% ( 34, 51 ] 16 0.007% 99.482% ( 76, 110 ] 197 0.087% 99.568% ( 110, 170 ] 417 0.184% 99.752% ( 170, 250 ] 193 0.085% 99.837% ( 250, 380 ] 146 0.064% 99.901% ( 380, 580 ] 116 0.051% 99.952% ( 580, 870 ] 71 0.031% 99.983% ( 870, 1300 ] 14 0.006% 99.989% ( 1300, 1900 ] 12 0.005% 99.995% ( 1900, 2900 ] 10 0.004% 99.999% ( 2900, 4400 ] 4 0.002% 100.001% ( 4400, 6600 ] 3 0.001% 100.002% ( 6600, 9900 ] 8 0.004% 100.006% ** Level 4 read latency histogram (micros): Count: 30 Average: 3746.1333 StdDev: 3150.61 Min: 246 Median: 2471.4286 Max: 10025 Percentiles: P50: 2471.43 P75: 7516.67 P99: 10025.00 P99.9: 10025.00 P99.99: 10025.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 1 3.333% 6.667% # ( 580, 870 ] 6 20.000% 26.667% #### ( 870, 1300 ] 1 3.333% 30.000% # ( 1300, 1900 ] 2 6.667% 36.667% # ( 1900, 2900 ] 7 23.333% 60.000% ##### ( 2900, 4400 ] 1 3.333% 63.333% # ( 4400, 6600 ] 1 3.333% 66.667% # ( 6600, 9900 ] 9 30.000% 96.667% ###### ( 9900, 14000 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 976.6500 StdDev: 1288.98 Min: 109 Median: 250.0000 Max: 4211 Percentiles: P50: 250.00 P75: 1300.00 P99: 4211.00 P99.9: 4211.00 P99.99: 4211.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 8 40.000% 45.000% ######## ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 15.6 total, 3.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 315.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.912 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.424 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-04:21:51 ... thread 0: (1000000,6000000) ops and (147280.8,270398.5) ops/second in (6.789751,22.189476) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 4.12 GB 257.9 5.0 0.0 5.0 10.7 5.7 0.0 1.9 139.6 299.6 36.56 34.34 100 0.366 5180K 6302 0.0 0.0 L1 10/10 1.04 GB 0.0 1.7 1.5 0.3 1.7 1.5 0.1 1.2 227.8 227.0 7.76 7.50 3 2.586 1794K 5648 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.5 1.8 247.9 247.8 0.45 0.42 1 0.449 113K 21 0.0 0.0 L3 25/0 977.26 MB 1.0 1.5 0.6 0.9 1.5 0.6 0.0 2.5 204.1 204.0 7.36 6.43 4 1.841 1516K 738 0.0 0.0 L4 156/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/18 101.85 GB 0.0 8.3 2.1 6.2 14.0 7.8 1.3 2.4 162.7 274.9 52.13 48.70 108 0.483 8604K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.3 2.1 6.2 14.0 7.8 1.3 2.4 162.7 274.9 52.13 48.70 108 0.483 8604K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.3 2.1 6.2 8.3 2.1 0.0 0.0 241.2 240.8 35.17 33.59 25 1.407 8604K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 345.5 16.96 15.10 83 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.4 total, 22.2 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.99 GB write, 640.35 MB/s write, 8.28 GB read, 379.12 MB/s read, 52.1 seconds Interval compaction: 13.99 GB write, 645.72 MB/s write, 8.28 GB read, 382.30 MB/s read, 52.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 22, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2100487 Average: 2.3511 StdDev: 11.65 Min: 0 Median: 1.5514 Max: 4550 Percentiles: P50: 1.55 P75: 1.92 P99: 5.85 P99.9: 11.06 P99.99: 21.60 ------------------------------------------------------ [ 0, 1 ] 268863 12.800% 12.800% ### ( 1, 2 ] 1417172 67.469% 80.269% ############# ( 2, 3 ] 260459 12.400% 92.669% ## ( 3, 4 ] 77149 3.673% 96.342% # ( 4, 6 ] 60234 2.868% 99.209% # ( 6, 10 ] 14045 0.669% 99.878% ( 10, 15 ] 2189 0.104% 99.982% ( 15, 22 ] 176 0.008% 99.990% ( 22, 34 ] 30 0.001% 99.992% ( 34, 51 ] 15 0.001% 99.993% ( 51, 76 ] 23 0.001% 99.994% ( 76, 110 ] 153 0.007% 100.001% ( 110, 170 ] 267 0.013% 100.014% ( 170, 250 ] 128 0.006% 100.020% ( 250, 380 ] 82 0.004% 100.024% ( 380, 580 ] 100 0.005% 100.028% ( 580, 870 ] 53 0.003% 100.031% ( 870, 1300 ] 30 0.001% 100.032% ( 1300, 1900 ] 16 0.001% 100.033% ( 1900, 2900 ] 11 0.001% 100.034% ( 2900, 4400 ] 6 0.000% 100.034% ( 4400, 6600 ] 1 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 442751 Average: 2.6458 StdDev: 14.76 Min: 0 Median: 1.5902 Max: 4088 Percentiles: P50: 1.59 P75: 1.97 P99: 7.96 P99.9: 107.93 P99.99: 524.46 ------------------------------------------------------ [ 0, 1 ] 49024 11.073% 11.073% ## ( 1, 2 ] 292042 65.961% 77.033% ############# ( 2, 3 ] 62146 14.036% 91.070% ### ( 3, 4 ] 17677 3.993% 95.062% # ( 4, 6 ] 14625 3.303% 98.365% # ( 6, 10 ] 5739 1.296% 99.662% ( 10, 15 ] 700 0.158% 99.820% ( 15, 22 ] 73 0.016% 99.836% ( 22, 34 ] 8 0.002% 99.838% ( 34, 51 ] 2 0.000% 99.839% ( 51, 76 ] 45 0.010% 99.849% ( 76, 110 ] 242 0.055% 99.903% ( 110, 170 ] 238 0.054% 99.957% ( 170, 250 ] 71 0.016% 99.973% ( 250, 380 ] 48 0.011% 99.984% ( 380, 580 ] 37 0.008% 99.992% ( 580, 870 ] 16 0.004% 99.996% ( 870, 1300 ] 5 0.001% 99.997% ( 1300, 1900 ] 8 0.002% 99.999% ( 1900, 2900 ] 3 0.001% 100.000% ( 2900, 4400 ] 2 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.0798 StdDev: 3.50 Min: 0 Median: 1.4373 Max: 434 Percentiles: P50: 1.44 P75: 1.84 P99: 5.69 P99.9: 9.91 P99.99: 201.31 ------------------------------------------------------ [ 0, 1 ] 6403 22.659% 22.659% ##### ( 1, 2 ] 17667 62.520% 85.179% ############# ( 2, 3 ] 2374 8.401% 93.581% ## ( 3, 4 ] 904 3.199% 96.780% # ( 4, 6 ] 744 2.633% 99.413% # ( 6, 10 ] 141 0.499% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 170, 250 ] 3 0.011% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 227224 Average: 4.3350 StdDev: 58.36 Min: 0 Median: 1.6762 Max: 8540 Percentiles: P50: 1.68 P75: 2.29 P99: 9.84 P99.9: 378.02 P99.99: 1363.88 ------------------------------------------------------ [ 0, 1 ] 17549 7.723% 7.723% ## ( 1, 2 ] 142057 62.518% 70.242% ############# ( 2, 3 ] 36784 16.188% 86.430% ### ( 3, 4 ] 13122 5.775% 92.205% # ( 4, 6 ] 11477 5.051% 97.256% # ( 6, 10 ] 4129 1.817% 99.073% ( 10, 15 ] 767 0.338% 99.411% ( 15, 22 ] 100 0.044% 99.455% ( 22, 34 ] 45 0.020% 99.475% ( 34, 51 ] 16 0.007% 99.482% ( 76, 110 ] 197 0.087% 99.568% ( 110, 170 ] 417 0.184% 99.752% ( 170, 250 ] 193 0.085% 99.837% ( 250, 380 ] 146 0.064% 99.901% ( 380, 580 ] 116 0.051% 99.952% ( 580, 870 ] 71 0.031% 99.983% ( 870, 1300 ] 14 0.006% 99.989% ( 1300, 1900 ] 12 0.005% 99.995% ( 1900, 2900 ] 10 0.004% 99.999% ( 2900, 4400 ] 4 0.002% 100.001% ( 4400, 6600 ] 3 0.001% 100.002% ( 6600, 9900 ] 8 0.004% 100.006% ** Level 4 read latency histogram (micros): Count: 30 Average: 3746.1333 StdDev: 3150.61 Min: 246 Median: 2471.4286 Max: 10025 Percentiles: P50: 2471.43 P75: 7516.67 P99: 10025.00 P99.9: 10025.00 P99.99: 10025.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 1 3.333% 6.667% # ( 580, 870 ] 6 20.000% 26.667% #### ( 870, 1300 ] 1 3.333% 30.000% # ( 1300, 1900 ] 2 6.667% 36.667% # ( 1900, 2900 ] 7 23.333% 60.000% ##### ( 2900, 4400 ] 1 3.333% 63.333% # ( 4400, 6600 ] 1 3.333% 66.667% # ( 6600, 9900 ] 9 30.000% 96.667% ###### ( 9900, 14000 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 976.6500 StdDev: 1288.98 Min: 109 Median: 250.0000 Max: 4211 Percentiles: P50: 250.00 P75: 1300.00 P99: 4211.00 P99.9: 4211.00 P99.99: 4211.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 8 40.000% 45.000% ######## ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 22.4 total, 6.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 263.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.803 H:M:S, 25.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 144.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.891 H:M:S, 57.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/28-04:21:54 ... thread 0: (1000000,7000000) ops and (307525.7,275143.9) ops/second in (3.251761,25.441237) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 3.38 GB 31.5 5.5 0.0 5.5 12.1 6.6 0.0 1.8 136.4 300.2 41.10 38.56 115 0.357 5692K 6763 0.0 0.0 L1 25/25 2.11 GB 0.0 4.4 3.1 1.3 4.3 3.0 0.1 1.4 223.6 221.8 20.01 19.25 4 5.002 4542K 35K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.0 1.8 247.9 247.8 0.45 0.42 1 0.449 113K 21 0.0 0.0 L3 15/0 860.61 MB 0.9 1.5 0.6 0.9 1.5 0.6 0.5 2.5 204.1 204.0 7.36 6.43 4 1.841 1516K 738 0.0 0.0 L4 170/0 9.55 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.9 1.0 168.2 168.2 0.48 0.38 1 0.482 73K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/40 102.68 GB 0.0 11.5 3.8 7.7 18.0 10.4 3.6 2.7 169.7 266.2 69.40 65.04 125 0.555 11M 42K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.5 3.8 7.7 18.0 10.4 3.5 2.7 169.7 266.2 69.40 65.04 125 0.555 11M 42K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.5 3.8 7.7 11.5 3.8 0.0 0.0 236.1 235.3 49.86 47.64 29 1.719 11M 42K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 345.0 19.54 17.39 96 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.6 total, 25.4 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.04 GB write, 720.75 MB/s write, 11.50 GB read, 459.43 MB/s read, 69.4 seconds Interval compaction: 18.04 GB write, 726.02 MB/s write, 11.50 GB read, 462.79 MB/s read, 69.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 24, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2381290 Average: 2.3844 StdDev: 13.08 Min: 0 Median: 1.5436 Max: 4550 Percentiles: P50: 1.54 P75: 1.91 P99: 5.87 P99.9: 12.06 P99.99: 128.88 ------------------------------------------------------ [ 0, 1 ] 315040 13.230% 13.230% ### ( 1, 2 ] 1610668 67.638% 80.868% ############## ( 2, 3 ] 286419 12.028% 92.896% ## ( 3, 4 ] 84451 3.546% 96.443% # ( 4, 6 ] 65002 2.730% 99.172% # ( 6, 10 ] 16327 0.686% 99.858% ( 10, 15 ] 2437 0.102% 99.960% ( 15, 22 ] 197 0.008% 99.969% ( 22, 34 ] 30 0.001% 99.970% ( 34, 51 ] 17 0.001% 99.971% ( 51, 76 ] 31 0.001% 99.972% ( 76, 110 ] 269 0.011% 99.983% ( 110, 170 ] 524 0.022% 100.005% ( 170, 250 ] 203 0.009% 100.014% ( 250, 380 ] 127 0.005% 100.019% ( 380, 580 ] 139 0.006% 100.025% ( 580, 870 ] 86 0.004% 100.028% ( 870, 1300 ] 37 0.002% 100.030% ( 1300, 1900 ] 18 0.001% 100.031% ( 1900, 2900 ] 13 0.001% 100.031% ( 2900, 4400 ] 12 0.001% 100.032% ( 4400, 6600 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 459664 Average: 2.7628 StdDev: 18.69 Min: 0 Median: 1.5869 Max: 4088 Percentiles: P50: 1.59 P75: 1.97 P99: 8.04 P99.9: 129.65 P99.99: 800.79 ------------------------------------------------------ [ 0, 1 ] 51808 11.271% 11.271% ## ( 1, 2 ] 303355 65.995% 77.266% ############# ( 2, 3 ] 63857 13.892% 91.158% ### ( 3, 4 ] 18048 3.926% 95.084% # ( 4, 6 ] 14935 3.249% 98.333% # ( 6, 10 ] 5995 1.304% 99.638% ( 10, 15 ] 725 0.158% 99.795% ( 15, 22 ] 84 0.018% 99.814% ( 22, 34 ] 9 0.002% 99.816% ( 34, 51 ] 2 0.000% 99.816% ( 51, 76 ] 46 0.010% 99.826% ( 76, 110 ] 248 0.054% 99.880% ( 110, 170 ] 282 0.061% 99.941% ( 170, 250 ] 83 0.018% 99.959% ( 250, 380 ] 66 0.014% 99.974% ( 380, 580 ] 56 0.012% 99.986% ( 580, 870 ] 25 0.005% 99.991% ( 870, 1300 ] 15 0.003% 99.995% ( 1300, 1900 ] 17 0.004% 99.998% ( 1900, 2900 ] 5 0.001% 99.999% ( 2900, 4400 ] 3 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.0798 StdDev: 3.50 Min: 0 Median: 1.4373 Max: 434 Percentiles: P50: 1.44 P75: 1.84 P99: 5.69 P99.9: 9.91 P99.99: 201.31 ------------------------------------------------------ [ 0, 1 ] 6403 22.659% 22.659% ##### ( 1, 2 ] 17667 62.520% 85.179% ############# ( 2, 3 ] 2374 8.401% 93.581% ## ( 3, 4 ] 904 3.199% 96.780% # ( 4, 6 ] 744 2.633% 99.413% # ( 6, 10 ] 141 0.499% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 170, 250 ] 3 0.011% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 247813 Average: 4.2854 StdDev: 56.22 Min: 0 Median: 1.6732 Max: 8540 Percentiles: P50: 1.67 P75: 2.27 P99: 9.85 P99.9: 373.69 P99.99: 1277.60 ------------------------------------------------------ [ 0, 1 ] 19233 7.761% 7.761% ## ( 1, 2 ] 155480 62.741% 70.502% ############# ( 2, 3 ] 40686 16.418% 86.920% ### ( 3, 4 ] 13639 5.504% 92.424% # ( 4, 6 ] 12014 4.848% 97.272% # ( 6, 10 ] 4455 1.798% 99.069% ( 10, 15 ] 829 0.335% 99.404% ( 15, 22 ] 102 0.041% 99.445% ( 22, 34 ] 45 0.018% 99.463% ( 34, 51 ] 16 0.006% 99.470% ( 76, 110 ] 226 0.091% 99.561% ( 110, 170 ] 471 0.190% 99.751% ( 170, 250 ] 216 0.087% 99.838% ( 250, 380 ] 161 0.065% 99.903% ( 380, 580 ] 125 0.050% 99.954% ( 580, 870 ] 76 0.031% 99.984% ( 870, 1300 ] 15 0.006% 99.990% ( 1300, 1900 ] 12 0.005% 99.995% ( 1900, 2900 ] 10 0.004% 99.999% ( 2900, 4400 ] 4 0.002% 100.001% ( 4400, 6600 ] 3 0.001% 100.002% ( 6600, 9900 ] 8 0.003% 100.005% ** Level 4 read latency histogram (micros): Count: 80 Average: 1413.5750 StdDev: 2643.45 Min: 0 Median: 15.0000 Max: 10025 Percentiles: P50: 15.00 P75: 1600.00 P99: 10025.00 P99.9: 10025.00 P99.99: 10025.00 ------------------------------------------------------ [ 0, 1 ] 20 25.000% 25.000% ##### ( 1, 2 ] 10 12.500% 37.500% ### ( 2, 3 ] 4 5.000% 42.500% # ( 3, 4 ] 2 2.500% 45.000% # ( 4, 6 ] 3 3.750% 48.750% # ( 10, 15 ] 1 1.250% 50.000% ( 22, 34 ] 8 10.000% 60.000% ## ( 170, 250 ] 3 3.750% 63.750% # ( 380, 580 ] 1 1.250% 65.000% ( 580, 870 ] 6 7.500% 72.500% ## ( 870, 1300 ] 1 1.250% 73.750% ( 1300, 1900 ] 2 2.500% 76.250% # ( 1900, 2900 ] 7 8.750% 85.000% ## ( 2900, 4400 ] 1 1.250% 86.250% ( 4400, 6600 ] 1 1.250% 87.500% ( 6600, 9900 ] 9 11.250% 98.750% ## ( 9900, 14000 ] 1 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 953.2667 StdDev: 1150.95 Min: 84 Median: 328.0000 Max: 4211 Percentiles: P50: 328.00 P75: 1450.00 P99: 4211.00 P99.9: 4211.00 P99.99: 4211.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 13 21.667% 31.667% #### ( 170, 250 ] 8 13.333% 45.000% ### ( 250, 380 ] 5 8.333% 53.333% ## ( 380, 580 ] 3 5.000% 58.333% # ( 580, 870 ] 6 10.000% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 4 6.667% 80.000% # ( 1900, 2900 ] 6 10.000% 90.000% ## ( 2900, 4400 ] 6 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 25.6 total, 3.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 268.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.386 H:M:S, 24.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.583 H:M:S, 17.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-04:22:19 ... thread 0: (1000000,8000000) ops and (40557.1,159687.6) ops/second in (24.656566,50.097803) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/2 1.59 GB 18.9 7.9 0.0 7.9 15.5 7.6 0.0 2.0 146.8 286.5 55.35 50.79 134 0.413 8249K 15K 0.0 0.0 L1 15/15 1.32 GB 0.0 9.2 5.8 3.4 9.1 5.7 0.1 1.6 218.5 215.4 43.32 40.59 5 8.664 9101K 35K 0.0 0.0 L2 2/1 257.56 MB 1.3 0.1 0.1 0.0 0.1 0.1 4.5 1.8 247.9 247.8 0.45 0.42 1 0.449 113K 21 0.0 0.0 L3 28/12 2.07 GB 1.1 2.3 1.0 1.4 2.3 1.0 3.3 2.4 166.7 166.1 14.43 10.67 7 2.061 2431K 8355 0.0 0.0 L4 190/19 11.50 GB 1.1 2.1 1.8 0.2 2.0 1.8 1.1 1.1 115.5 115.0 18.25 10.15 18 1.014 2132K 10K 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/49 103.54 GB 0.0 21.7 8.7 13.0 29.1 16.1 10.1 3.8 168.5 226.1 131.80 112.62 165 0.799 22M 69K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.7 8.7 13.0 29.1 16.1 10.0 3.8 168.5 226.1 131.80 112.62 165 0.799 22M 69K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.7 8.7 13.0 21.5 8.5 0.0 0.0 205.1 203.6 108.30 92.51 55 1.969 22M 69K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 329.9 23.49 20.11 110 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.3 total, 50.1 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.10 GB write, 592.51 MB/s write, 21.69 GB read, 441.74 MB/s read, 131.8 seconds Interval compaction: 29.10 GB write, 594.71 MB/s write, 21.69 GB read, 443.38 MB/s read, 131.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 17, pending-compaction-bytes-stops: 0, total-delays: 33, total-stops: 37, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3715333 Average: 2.9470 StdDev: 24.62 Min: 0 Median: 1.5273 Max: 7717 Percentiles: P50: 1.53 P75: 1.90 P99: 7.69 P99.9: 157.02 P99.99: 364.37 ------------------------------------------------------ [ 0, 1 ] 555441 14.950% 14.950% ### ( 1, 2 ] 2469606 66.471% 81.421% ############# ( 2, 3 ] 414092 11.145% 92.566% ## ( 3, 4 ] 124100 3.340% 95.906% # ( 4, 6 ] 100751 2.712% 98.618% # ( 6, 10 ] 33514 0.902% 99.520% ( 10, 15 ] 4607 0.124% 99.644% ( 15, 22 ] 554 0.015% 99.659% ( 22, 34 ] 51 0.001% 99.660% ( 34, 51 ] 22 0.001% 99.661% ( 51, 76 ] 46 0.001% 99.662% ( 76, 110 ] 3999 0.108% 99.770% ( 110, 170 ] 6169 0.166% 99.936% ( 170, 250 ] 1274 0.034% 99.970% ( 250, 380 ] 836 0.023% 99.993% ( 380, 580 ] 666 0.018% 100.011% ( 580, 870 ] 275 0.007% 100.018% ( 870, 1300 ] 106 0.003% 100.021% ( 1300, 1900 ] 47 0.001% 100.022% ( 1900, 2900 ] 59 0.002% 100.024% ( 2900, 4400 ] 60 0.002% 100.025% ( 4400, 6600 ] 10 0.000% 100.026% ( 6600, 9900 ] 2 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1602916 Average: 4.7138 StdDev: 70.53 Min: 0 Median: 1.6511 Max: 9913 Percentiles: P50: 1.65 P75: 2.34 P99: 9.39 P99.9: 137.54 P99.99: 314.29 ------------------------------------------------------ [ 0, 1 ] 210560 13.136% 13.136% ### ( 1, 2 ] 907572 56.620% 69.756% ########### ( 2, 3 ] 248977 15.533% 85.289% ### ( 3, 4 ] 92633 5.779% 91.068% # ( 4, 6 ] 100440 6.266% 97.334% # ( 6, 10 ] 31534 1.967% 99.301% ( 10, 15 ] 6481 0.404% 99.706% ( 15, 22 ] 863 0.054% 99.759% ( 22, 34 ] 53 0.003% 99.763% ( 34, 51 ] 15 0.001% 99.764% ( 51, 76 ] 59 0.004% 99.767% ( 76, 110 ] 1376 0.086% 99.853% ( 110, 170 ] 1634 0.102% 99.955% ( 170, 250 ] 351 0.022% 99.977% ( 250, 380 ] 420 0.026% 100.003% ( 380, 580 ] 514 0.032% 100.035% ( 580, 870 ] 403 0.025% 100.060% ( 870, 1300 ] 332 0.021% 100.081% ( 1300, 1900 ] 195 0.012% 100.093% ( 1900, 2900 ] 225 0.014% 100.107% ( 2900, 4400 ] 247 0.015% 100.123% ( 4400, 6600 ] 65 0.004% 100.127% ( 6600, 9900 ] 11 0.001% 100.128% ( 9900, 14000 ] 1 0.000% 100.128% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.0798 StdDev: 3.50 Min: 0 Median: 1.4373 Max: 434 Percentiles: P50: 1.44 P75: 1.84 P99: 5.69 P99.9: 9.91 P99.99: 201.31 ------------------------------------------------------ [ 0, 1 ] 6403 22.659% 22.659% ##### ( 1, 2 ] 17667 62.520% 85.179% ############# ( 2, 3 ] 2374 8.401% 93.581% ## ( 3, 4 ] 904 3.199% 96.780% # ( 4, 6 ] 744 2.633% 99.413% # ( 6, 10 ] 141 0.499% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 170, 250 ] 3 0.011% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 436550 Average: 8.6393 StdDev: 104.81 Min: 0 Median: 1.8124 Max: 8760 Percentiles: P50: 1.81 P75: 2.72 P99: 12.52 P99.9: 1030.04 P99.99: 1757.45 ------------------------------------------------------ [ 0, 1 ] 22197 5.085% 5.085% # ( 1, 2 ] 241368 55.290% 60.375% ########### ( 2, 3 ] 88885 20.361% 80.735% #### ( 3, 4 ] 35573 8.149% 88.884% ## ( 4, 6 ] 34737 7.957% 96.841% ## ( 6, 10 ] 8497 1.946% 98.788% ( 10, 15 ] 1841 0.422% 99.209% ( 15, 22 ] 231 0.053% 99.262% ( 22, 34 ] 54 0.012% 99.275% ( 34, 51 ] 16 0.004% 99.278% ( 51, 76 ] 1 0.000% 99.278% ( 76, 110 ] 230 0.053% 99.331% ( 110, 170 ] 506 0.116% 99.447% ( 170, 250 ] 317 0.073% 99.520% ( 250, 380 ] 407 0.093% 99.613% ( 380, 580 ] 586 0.134% 99.747% ( 580, 870 ] 530 0.121% 99.869% ( 870, 1300 ] 372 0.085% 99.954% ( 1300, 1900 ] 209 0.048% 100.002% ( 1900, 2900 ] 135 0.031% 100.033% ( 2900, 4400 ] 121 0.028% 100.060% ( 4400, 6600 ] 17 0.004% 100.064% ( 6600, 9900 ] 11 0.003% 100.067% ** Level 4 read latency histogram (micros): Count: 30052 Average: 9.1152 StdDev: 169.14 Min: 0 Median: 2.1989 Max: 10025 Percentiles: P50: 2.20 P75: 3.24 P99: 9.93 P99.9: 934.43 P99.99: 2649.57 ------------------------------------------------------ [ 0, 1 ] 340 1.131% 1.131% ( 1, 2 ] 13018 43.318% 44.450% ######### ( 2, 3 ] 8388 27.912% 72.361% ###### ( 3, 4 ] 3330 11.081% 83.442% ## ( 4, 6 ] 4078 13.570% 97.012% ### ( 6, 10 ] 608 2.023% 99.035% ( 10, 15 ] 171 0.569% 99.604% ( 15, 22 ] 17 0.057% 99.661% ( 22, 34 ] 14 0.047% 99.707% ( 34, 51 ] 3 0.010% 99.717% ( 51, 76 ] 2 0.007% 99.724% ( 76, 110 ] 2 0.007% 99.730% ( 110, 170 ] 5 0.017% 99.747% ( 170, 250 ] 25 0.083% 99.830% ( 250, 380 ] 3 0.010% 99.840% ( 380, 580 ] 3 0.010% 99.850% ( 580, 870 ] 13 0.043% 99.894% ( 870, 1300 ] 13 0.043% 99.937% ( 1300, 1900 ] 7 0.023% 99.960% ( 1900, 2900 ] 12 0.040% 100.000% ( 2900, 4400 ] 7 0.023% 100.023% ( 4400, 6600 ] 1 0.003% 100.027% ( 6600, 9900 ] 9 0.030% 100.057% ( 9900, 14000 ] 1 0.003% 100.060% ** Level 5 read latency histogram (micros): Count: 60 Average: 953.2667 StdDev: 1150.95 Min: 84 Median: 328.0000 Max: 4211 Percentiles: P50: 328.00 P75: 1450.00 P99: 4211.00 P99.9: 4211.00 P99.99: 4211.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 13 21.667% 31.667% #### ( 170, 250 ] 8 13.333% 45.000% ### ( 250, 380 ] 5 8.333% 53.333% ## ( 380, 580 ] 3 5.000% 58.333% # ( 580, 870 ] 6 10.000% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 4 6.667% 80.000% # ( 1900, 2900 ] 6 10.000% 90.000% ## ( 2900, 4400 ] 6 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 50.3 total, 24.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 156.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.336 H:M:S, 54.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 39.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:20.950 H:M:S, 85.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/28-04:22:23 ... thread 0: (1000000,9000000) ops and (227989.9,165186.2) ops/second in (4.386160,54.483963) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/6 2.57 GB 88.1 8.6 0.0 8.6 17.1 8.5 0.0 2.0 141.4 281.6 62.35 56.23 149 0.418 8952K 16K 0.0 0.0 L1 15/15 1.32 GB 0.0 9.2 5.8 3.4 9.1 5.7 0.1 1.6 218.5 215.4 43.32 40.59 5 8.664 9101K 35K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.5 1.8 247.9 247.8 0.45 0.42 1 0.449 113K 21 0.0 0.0 L3 13/0 956.42 MB 1.0 2.8 1.2 1.6 2.8 1.2 3.3 2.3 161.9 161.2 17.79 12.85 9 1.976 2915K 12K 0.0 0.0 L4 164/0 9.56 GB 1.0 4.0 3.2 0.8 4.0 3.2 1.2 1.3 123.2 122.7 33.53 19.72 32 1.048 4188K 19K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/21 104.51 GB 0.0 24.8 10.3 14.5 33.2 18.7 13.4 3.9 161.4 215.9 157.43 129.82 196 0.803 25M 83K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.8 10.3 14.5 33.2 18.7 13.4 3.9 161.4 215.9 157.43 129.82 196 0.803 25M 83K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.8 10.3 14.5 24.6 10.1 0.0 0.0 195.8 194.4 129.78 106.99 73 1.778 25M 83K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 316.7 27.65 22.83 123 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.7 total, 54.5 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.18 GB write, 621.55 MB/s write, 24.81 GB read, 464.70 MB/s read, 157.4 seconds Interval compaction: 33.18 GB write, 623.67 MB/s write, 24.81 GB read, 466.28 MB/s read, 157.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 57, pending-compaction-bytes-delays: 17, pending-compaction-bytes-stops: 0, total-delays: 33, total-stops: 57, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4107451 Average: 3.0743 StdDev: 31.59 Min: 0 Median: 1.5487 Max: 8294 Percentiles: P50: 1.55 P75: 1.93 P99: 7.93 P99.9: 155.94 P99.99: 395.37 ------------------------------------------------------ [ 0, 1 ] 576571 14.037% 14.037% ### ( 1, 2 ] 2691988 65.539% 79.576% ############# ( 2, 3 ] 501078 12.199% 91.776% ## ( 3, 4 ] 147825 3.599% 95.375% # ( 4, 6 ] 129327 3.149% 98.523% # ( 6, 10 ] 40526 0.987% 99.510% ( 10, 15 ] 6395 0.156% 99.665% ( 15, 22 ] 737 0.018% 99.683% ( 22, 34 ] 62 0.002% 99.685% ( 34, 51 ] 24 0.001% 99.685% ( 51, 76 ] 47 0.001% 99.687% ( 76, 110 ] 4014 0.098% 99.784% ( 110, 170 ] 6204 0.151% 99.935% ( 170, 250 ] 1314 0.032% 99.967% ( 250, 380 ] 874 0.021% 99.989% ( 380, 580 ] 719 0.018% 100.006% ( 580, 870 ] 327 0.008% 100.014% ( 870, 1300 ] 152 0.004% 100.018% ( 1300, 1900 ] 85 0.002% 100.020% ( 1900, 2900 ] 105 0.003% 100.022% ( 2900, 4400 ] 118 0.003% 100.025% ( 4400, 6600 ] 26 0.001% 100.026% ( 6600, 9900 ] 5 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1858050 Average: 5.3158 StdDev: 83.10 Min: 0 Median: 1.6959 Max: 10344 Percentiles: P50: 1.70 P75: 2.48 P99: 9.53 P99.9: 144.95 P99.99: 417.09 ------------------------------------------------------ [ 0, 1 ] 214362 11.537% 11.537% ## ( 1, 2 ] 1026917 55.269% 66.805% ########### ( 2, 3 ] 316219 17.019% 83.824% ### ( 3, 4 ] 117745 6.337% 90.161% # ( 4, 6 ] 130256 7.010% 97.172% # ( 6, 10 ] 38481 2.071% 99.243% ( 10, 15 ] 8606 0.463% 99.706% ( 15, 22 ] 1101 0.059% 99.765% ( 22, 34 ] 66 0.004% 99.769% ( 34, 51 ] 17 0.001% 99.770% ( 51, 76 ] 64 0.003% 99.773% ( 76, 110 ] 1380 0.074% 99.847% ( 110, 170 ] 1679 0.090% 99.938% ( 170, 250 ] 374 0.020% 99.958% ( 250, 380 ] 485 0.026% 99.984% ( 380, 580 ] 605 0.033% 100.017% ( 580, 870 ] 530 0.029% 100.045% ( 870, 1300 ] 449 0.024% 100.069% ( 1300, 1900 ] 301 0.016% 100.085% ( 1900, 2900 ] 346 0.019% 100.104% ( 2900, 4400 ] 369 0.020% 100.124% ( 4400, 6600 ] 117 0.006% 100.130% ( 6600, 9900 ] 21 0.001% 100.131% ( 9900, 14000 ] 2 0.000% 100.131% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.0798 StdDev: 3.50 Min: 0 Median: 1.4373 Max: 434 Percentiles: P50: 1.44 P75: 1.84 P99: 5.69 P99.9: 9.91 P99.99: 201.31 ------------------------------------------------------ [ 0, 1 ] 6403 22.659% 22.659% ##### ( 1, 2 ] 17667 62.520% 85.179% ############# ( 2, 3 ] 2374 8.401% 93.581% ## ( 3, 4 ] 904 3.199% 96.780% # ( 4, 6 ] 744 2.633% 99.413% # ( 6, 10 ] 141 0.499% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 170, 250 ] 3 0.011% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 666877 Average: 8.3424 StdDev: 105.06 Min: 0 Median: 1.8855 Max: 8760 Percentiles: P50: 1.89 P75: 2.85 P99: 10.94 P99.9: 864.26 P99.99: 1462.54 ------------------------------------------------------ [ 0, 1 ] 25242 3.785% 3.785% # ( 1, 2 ] 348063 52.193% 55.978% ########## ( 2, 3 ] 149464 22.413% 78.391% #### ( 3, 4 ] 60333 9.047% 87.438% ## ( 4, 6 ] 63364 9.502% 96.939% ## ( 6, 10 ] 13164 1.974% 98.913% ( 10, 15 ] 3091 0.464% 99.377% ( 15, 22 ] 352 0.053% 99.430% ( 22, 34 ] 58 0.009% 99.438% ( 34, 51 ] 16 0.002% 99.441% ( 51, 76 ] 2 0.000% 99.441% ( 76, 110 ] 232 0.035% 99.476% ( 110, 170 ] 537 0.081% 99.556% ( 170, 250 ] 366 0.055% 99.611% ( 250, 380 ] 500 0.075% 99.686% ( 380, 580 ] 739 0.111% 99.797% ( 580, 870 ] 701 0.105% 99.902% ( 870, 1300 ] 511 0.077% 99.979% ( 1300, 1900 ] 278 0.042% 100.020% ( 1900, 2900 ] 216 0.032% 100.053% ( 2900, 4400 ] 209 0.031% 100.084% ( 4400, 6600 ] 32 0.005% 100.089% ( 6600, 9900 ] 14 0.002% 100.091% ** Level 4 read latency histogram (micros): Count: 124355 Average: 11.8159 StdDev: 160.15 Min: 0 Median: 2.2315 Max: 10025 Percentiles: P50: 2.23 P75: 3.32 P99: 12.70 P99.9: 1882.56 P99.99: 3206.75 ------------------------------------------------------ [ 0, 1 ] 956 0.769% 0.769% ( 1, 2 ] 53184 42.768% 43.537% ######### ( 2, 3 ] 34719 27.919% 71.456% ###### ( 3, 4 ] 13756 11.062% 82.518% ## ( 4, 6 ] 16681 13.414% 95.932% ### ( 6, 10 ] 3245 2.609% 98.541% # ( 10, 15 ] 1056 0.849% 99.390% ( 15, 22 ] 96 0.077% 99.468% ( 22, 34 ] 26 0.021% 99.489% ( 34, 51 ] 4 0.003% 99.492% ( 51, 76 ] 4 0.003% 99.495% ( 76, 110 ] 8 0.006% 99.501% ( 110, 170 ] 21 0.017% 99.518% ( 170, 250 ] 69 0.055% 99.574% ( 250, 380 ] 32 0.026% 99.600% ( 380, 580 ] 78 0.063% 99.662% ( 580, 870 ] 104 0.084% 99.746% ( 870, 1300 ] 113 0.091% 99.837% ( 1300, 1900 ] 81 0.065% 99.902% ( 1900, 2900 ] 93 0.075% 99.977% ( 2900, 4400 ] 81 0.065% 100.042% ( 4400, 6600 ] 14 0.011% 100.053% ( 6600, 9900 ] 13 0.010% 100.064% ( 9900, 14000 ] 1 0.001% 100.064% ** Level 5 read latency histogram (micros): Count: 260 Average: 1670.4038 StdDev: 1597.78 Min: 84 Median: 994.8387 Max: 6546 Percentiles: P50: 994.84 P75: 2854.55 P99: 6298.95 P99.9: 6546.00 P99.99: 6546.00 ------------------------------------------------------ ( 76, 110 ] 8 3.077% 3.077% # ( 110, 170 ] 20 7.692% 10.769% ## ( 170, 250 ] 19 7.308% 18.077% # ( 250, 380 ] 24 9.231% 27.308% ## ( 380, 580 ] 15 5.769% 33.077% # ( 580, 870 ] 35 13.462% 46.538% ### ( 870, 1300 ] 31 11.923% 58.462% ## ( 1300, 1900 ] 22 8.462% 66.923% ## ( 1900, 2900 ] 22 8.462% 75.385% ## ( 2900, 4400 ] 45 17.308% 92.692% ### ( 4400, 6600 ] 19 7.308% 100.000% # ** DB Stats ** Uptime(secs): 54.7 total, 4.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 162.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.926 H:M:S, 52.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 224.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.590 H:M:S, 36.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-04:22:26 ... thread 0: (1000000,10000000) ops and (318407.3,173537.0) ops/second in (3.140632,57.624595) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/6 3.50 GB 182.5 9.7 0.0 9.7 19.2 9.5 0.0 2.0 143.2 282.5 69.51 63.02 166 0.419 10M 17K 0.0 0.0 L1 15/15 1.32 GB 0.0 9.2 5.8 3.4 9.1 5.7 0.1 1.6 218.5 215.4 43.32 40.59 5 8.664 9101K 35K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.5 1.8 247.9 247.8 0.45 0.42 1 0.449 113K 21 0.0 0.0 L3 13/0 956.42 MB 1.0 2.8 1.2 1.6 2.8 1.2 3.3 2.3 161.9 161.2 17.79 12.85 9 1.976 2915K 12K 0.0 0.0 L4 164/0 9.56 GB 1.0 4.0 3.2 0.8 4.0 3.2 1.2 1.3 123.2 122.7 33.53 19.72 32 1.048 4188K 19K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1300/21 105.43 GB 0.0 25.9 10.3 15.6 35.2 19.6 13.4 3.7 161.2 219.1 164.60 136.61 213 0.773 26M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.9 10.3 15.6 35.2 19.6 13.4 3.7 161.2 219.1 164.60 136.61 213 0.773 26M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.9 10.3 15.6 25.7 10.1 0.0 0.0 197.8 196.4 134.17 111.30 77 1.742 26M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 318.8 30.43 25.31 136 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.8 total, 57.6 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.21 GB write, 623.72 MB/s write, 25.92 GB read, 459.07 MB/s read, 164.6 seconds Interval compaction: 35.21 GB write, 625.73 MB/s write, 25.92 GB read, 460.55 MB/s read, 164.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 17, pending-compaction-bytes-stops: 0, total-delays: 33, total-stops: 62, interval: 95 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4399095 Average: 3.0254 StdDev: 30.69 Min: 0 Median: 1.5508 Max: 8294 Percentiles: P50: 1.55 P75: 1.93 P99: 7.76 P99.9: 152.50 P99.99: 372.59 ------------------------------------------------------ [ 0, 1 ] 607715 13.815% 13.815% ### ( 1, 2 ] 2890238 65.701% 79.515% ############# ( 2, 3 ] 541646 12.313% 91.828% ## ( 3, 4 ] 159144 3.618% 95.446% # ( 4, 6 ] 137833 3.133% 98.579% # ( 6, 10 ] 42177 0.959% 99.538% ( 10, 15 ] 6632 0.151% 99.688% ( 15, 22 ] 762 0.017% 99.706% ( 22, 34 ] 64 0.001% 99.707% ( 34, 51 ] 26 0.001% 99.708% ( 51, 76 ] 50 0.001% 99.709% ( 76, 110 ] 4014 0.091% 99.800% ( 110, 170 ] 6206 0.141% 99.941% ( 170, 250 ] 1323 0.030% 99.971% ( 250, 380 ] 876 0.020% 99.991% ( 380, 580 ] 724 0.016% 100.008% ( 580, 870 ] 335 0.008% 100.015% ( 870, 1300 ] 155 0.004% 100.019% ( 1300, 1900 ] 86 0.002% 100.021% ( 1900, 2900 ] 108 0.002% 100.023% ( 2900, 4400 ] 119 0.003% 100.026% ( 4400, 6600 ] 26 0.001% 100.026% ( 6600, 9900 ] 5 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1999516 Average: 5.1399 StdDev: 80.17 Min: 0 Median: 1.6904 Max: 10344 Percentiles: P50: 1.69 P75: 2.45 P99: 9.48 P99.9: 145.60 P99.99: 422.00 ------------------------------------------------------ [ 0, 1 ] 224200 11.213% 11.213% ## ( 1, 2 ] 1123423 56.185% 67.397% ########### ( 2, 3 ] 339104 16.959% 84.357% ### ( 3, 4 ] 122530 6.128% 90.485% # ( 4, 6 ] 134619 6.733% 97.217% # ( 6, 10 ] 40994 2.050% 99.268% ( 10, 15 ] 8834 0.442% 99.709% ( 15, 22 ] 1121 0.056% 99.765% ( 22, 34 ] 69 0.003% 99.769% ( 34, 51 ] 17 0.001% 99.770% ( 51, 76 ] 64 0.003% 99.773% ( 76, 110 ] 1472 0.074% 99.847% ( 110, 170 ] 1804 0.090% 99.937% ( 170, 250 ] 431 0.022% 99.958% ( 250, 380 ] 504 0.025% 99.983% ( 380, 580 ] 624 0.031% 100.015% ( 580, 870 ] 541 0.027% 100.042% ( 870, 1300 ] 452 0.023% 100.064% ( 1300, 1900 ] 301 0.015% 100.079% ( 1900, 2900 ] 346 0.017% 100.097% ( 2900, 4400 ] 369 0.018% 100.115% ( 4400, 6600 ] 117 0.006% 100.121% ( 6600, 9900 ] 21 0.001% 100.122% ( 9900, 14000 ] 2 0.000% 100.122% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.0798 StdDev: 3.50 Min: 0 Median: 1.4373 Max: 434 Percentiles: P50: 1.44 P75: 1.84 P99: 5.69 P99.9: 9.91 P99.99: 201.31 ------------------------------------------------------ [ 0, 1 ] 6403 22.659% 22.659% ##### ( 1, 2 ] 17667 62.520% 85.179% ############# ( 2, 3 ] 2374 8.401% 93.581% ## ( 3, 4 ] 904 3.199% 96.780% # ( 4, 6 ] 744 2.633% 99.413% # ( 6, 10 ] 141 0.499% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 170, 250 ] 3 0.011% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 666877 Average: 8.3424 StdDev: 105.06 Min: 0 Median: 1.8855 Max: 8760 Percentiles: P50: 1.89 P75: 2.85 P99: 10.94 P99.9: 864.26 P99.99: 1462.54 ------------------------------------------------------ [ 0, 1 ] 25242 3.785% 3.785% # ( 1, 2 ] 348063 52.193% 55.978% ########## ( 2, 3 ] 149464 22.413% 78.391% #### ( 3, 4 ] 60333 9.047% 87.438% ## ( 4, 6 ] 63364 9.502% 96.939% ## ( 6, 10 ] 13164 1.974% 98.913% ( 10, 15 ] 3091 0.464% 99.377% ( 15, 22 ] 352 0.053% 99.430% ( 22, 34 ] 58 0.009% 99.438% ( 34, 51 ] 16 0.002% 99.441% ( 51, 76 ] 2 0.000% 99.441% ( 76, 110 ] 232 0.035% 99.476% ( 110, 170 ] 537 0.081% 99.556% ( 170, 250 ] 366 0.055% 99.611% ( 250, 380 ] 500 0.075% 99.686% ( 380, 580 ] 739 0.111% 99.797% ( 580, 870 ] 701 0.105% 99.902% ( 870, 1300 ] 511 0.077% 99.979% ( 1300, 1900 ] 278 0.042% 100.020% ( 1900, 2900 ] 216 0.032% 100.053% ( 2900, 4400 ] 209 0.031% 100.084% ( 4400, 6600 ] 32 0.005% 100.089% ( 6600, 9900 ] 14 0.002% 100.091% ** Level 4 read latency histogram (micros): Count: 124355 Average: 11.8159 StdDev: 160.15 Min: 0 Median: 2.2315 Max: 10025 Percentiles: P50: 2.23 P75: 3.32 P99: 12.70 P99.9: 1882.56 P99.99: 3206.75 ------------------------------------------------------ [ 0, 1 ] 956 0.769% 0.769% ( 1, 2 ] 53184 42.768% 43.537% ######### ( 2, 3 ] 34719 27.919% 71.456% ###### ( 3, 4 ] 13756 11.062% 82.518% ## ( 4, 6 ] 16681 13.414% 95.932% ### ( 6, 10 ] 3245 2.609% 98.541% # ( 10, 15 ] 1056 0.849% 99.390% ( 15, 22 ] 96 0.077% 99.468% ( 22, 34 ] 26 0.021% 99.489% ( 34, 51 ] 4 0.003% 99.492% ( 51, 76 ] 4 0.003% 99.495% ( 76, 110 ] 8 0.006% 99.501% ( 110, 170 ] 21 0.017% 99.518% ( 170, 250 ] 69 0.055% 99.574% ( 250, 380 ] 32 0.026% 99.600% ( 380, 580 ] 78 0.063% 99.662% ( 580, 870 ] 104 0.084% 99.746% ( 870, 1300 ] 113 0.091% 99.837% ( 1300, 1900 ] 81 0.065% 99.902% ( 1900, 2900 ] 93 0.075% 99.977% ( 2900, 4400 ] 81 0.065% 100.042% ( 4400, 6600 ] 14 0.011% 100.053% ( 6600, 9900 ] 13 0.010% 100.064% ( 9900, 14000 ] 1 0.001% 100.064% ** Level 5 read latency histogram (micros): Count: 260 Average: 1670.4038 StdDev: 1597.78 Min: 84 Median: 994.8387 Max: 6546 Percentiles: P50: 994.84 P75: 2854.55 P99: 6298.95 P99.9: 6546.00 P99.99: 6546.00 ------------------------------------------------------ ( 76, 110 ] 8 3.077% 3.077% # ( 110, 170 ] 20 7.692% 10.769% ## ( 170, 250 ] 19 7.308% 18.077% # ( 250, 380 ] 24 9.231% 27.308% ## ( 380, 580 ] 15 5.769% 33.077% # ( 580, 870 ] 35 13.462% 46.538% ### ( 870, 1300 ] 31 11.923% 58.462% ## ( 1300, 1900 ] 22 8.462% 66.923% ## ( 1900, 2900 ] 22 8.462% 75.385% ## ( 2900, 4400 ] 45 17.308% 92.692% ### ( 4400, 6600 ] 19 7.308% 100.000% # ** DB Stats ** Uptime(secs): 57.8 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 170.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.356 H:M:S, 50.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.430 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.592 micros/op 178830 ops/sec 60.118 seconds 10750999 operations; 173.3 MB/s Microseconds per write: Count: 10750999 Average: 5.5919 StdDev: 441.06 Min: 1 Median: 1.7889 Max: 743802 Percentiles: P50: 1.79 P75: 2.81 P99: 9.52 P99.9: 1098.94 P99.99: 2583.60 ------------------------------------------------------ [ 0, 1 ] 1086191 10.103% 10.103% ## ( 1, 2 ] 5437204 50.574% 60.677% ########## ( 2, 3 ] 1898411 17.658% 78.335% #### ( 3, 4 ] 1491696 13.875% 92.210% ### ( 4, 6 ] 602610 5.605% 97.815% # ( 6, 10 ] 144852 1.347% 99.163% ( 10, 15 ] 47605 0.443% 99.605% ( 15, 22 ] 10337 0.096% 99.701% ( 22, 34 ] 1670 0.016% 99.717% ( 34, 51 ] 184 0.002% 99.719% ( 51, 76 ] 20 0.000% 99.719% ( 76, 110 ] 7905 0.074% 99.792% ( 110, 170 ] 2517 0.023% 99.816% ( 170, 250 ] 277 0.003% 99.818% ( 250, 380 ] 182 0.002% 99.820% ( 380, 580 ] 30 0.000% 99.820% ( 580, 870 ] 15 0.000% 99.821% ( 870, 1300 ] 16044 0.149% 99.970% ( 1300, 1900 ] 52 0.000% 99.970% ( 1900, 2900 ] 3104 0.029% 99.999% ( 2900, 4400 ] 49 0.000% 100.000% ( 4400, 6600 ] 12 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 200249 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10750999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11095030968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 541 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29817950 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31248622084 rocksdb.compact.write.bytes COUNT : 31051795093 rocksdb.flush.write.bytes COUNT : 11031469094 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 62 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 207 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10942605312 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4325376 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31350154487 rocksdb.non.last.level.read.count COUNT : 7572810 rocksdb.block.checksum.compute.count COUNT : 7571790 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.446109 P95 : 3.946269 P99 : 8.037579 P100 : 743800.000000 COUNT : 10750999 SUM : 54837460 rocksdb.compaction.times.micros P50 : 1212500.000000 P95 : 4355000.000000 P99 : 23311436.000000 P100 : 23311436.000000 COUNT : 79 SUM : 136601990 rocksdb.compaction.times.cpu_micros P50 : 952285.714286 P95 : 4355000.000000 P99 : 15680000.000000 P100 : 21348670.000000 COUNT : 79 SUM : 113687417 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 712.916667 P95 : 1430.000000 P99 : 101775.000000 P100 : 162215.000000 COUNT : 147 SUM : 453151 rocksdb.compaction.outfile.sync.micros P50 : 993.698630 P95 : 120285.714286 P99 : 209680.000000 P100 : 264608.000000 COUNT : 352 SUM : 7080384 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 106.273973 P95 : 1615.000000 P99 : 3110.000000 P100 : 3881.000000 COUNT : 258 SUM : 80568 rocksdb.table.open.io.micros P50 : 1513.043478 P95 : 10699.500000 P99 : 19722.105263 P100 : 21084.000000 COUNT : 541 SUM : 1459153 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.694315 P95 : 7.934753 P99 : 12.354304 P100 : 10350.000000 COUNT : 7570350 SUM : 47369410 rocksdb.read.block.get.micros P50 : 531.111111 P95 : 4111.029412 P99 : 7739.600000 P100 : 10178.000000 COUNT : 1082 SUM : 1147947 rocksdb.write.raw.block.micros P50 : 0.512716 P95 : 0.974161 P99 : 2.906436 P100 : 13748.000000 COUNT : 10192866 SUM : 20713417 rocksdb.numfiles.in.singlecompaction P50 : 3.317073 P95 : 6.666667 P99 : 21.300000 P100 : 36.000000 COUNT : 130 SUM : 539 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562001 P95 : 1151.113069 P99 : 2361.626331 P100 : 743613.000000 COUNT : 175542 SUM : 29837271 rocksdb.sst.read.micros P50 : 1.618854 P95 : 4.771523 P99 : 8.992207 P100 : 10344.000000 COUNT : 7573186 SUM : 32134611 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10750999 SUM : 11095030968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214955.752212 P95 : 377323.529412 P99 : 814566.666667 P100 : 906286.000000 COUNT : 147 SUM : 32843576 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 348 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0