[2024-12-12 06:50:21.817102] Starting SPDK v25.01-pre git sha1 d58eef2a2 / DPDK 24.03.0 initialization... [2024-12-12 06:50:21.817246] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1698090 ] Set seed to 1733982621813395 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-12 06:50:21.935106] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-12 06:50:22.045186] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-12 06:50:22.045229] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1698090' to capture a snapshot of events at runtime. [2024-12-12 06:50:22.045239] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-12 06:50:22.045249] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-12 06:50:22.045257] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1698090 for offline analysis/debug. [2024-12-12 06:50:22.046640] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Dec 12 06:50:30 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/12-06:50:33 ... thread 0: (1000000,1000000) ops and (362068.5,362068.5) ops/second in (2.761908,2.761908) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 504.00 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 360.2 2.27 2.04 12 0.189 0 0 0.0 0.0 L1 1/0 1.93 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 249.5 249.3 1.01 0.98 1 1.010 255K 203 0.0 0.0 L2 3/2 298.56 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.3 1.8 239.8 239.8 0.46 0.43 1 0.464 113K 27 0.0 0.0 L3 16/9 755.50 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 203.6 203.6 0.31 0.25 1 0.307 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/17 96.94 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 105.0 306.9 4.06 3.71 15 0.270 432K 230 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 105.0 306.9 4.06 3.71 15 0.270 432K 230 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 239.1 238.9 1.78 1.67 3 0.594 432K 230 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 360.2 2.27 2.04 12 0.189 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.22 GB write, 416.92 MB/s write, 0.42 GB read, 142.66 MB/s read, 4.1 seconds Interval compaction: 1.22 GB write, 450.41 MB/s write, 0.42 GB read, 154.12 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 113194 Average: 1.9297 StdDev: 15.69 Min: 0 Median: 1.2797 Max: 3305 Percentiles: P50: 1.28 P75: 1.69 P99: 4.64 P99.9: 11.10 P99.99: 359.24 ------------------------------------------------------ [ 0, 1 ] 37281 32.935% 32.935% ####### ( 1, 2 ] 69055 61.006% 93.941% ############ ( 2, 3 ] 3897 3.443% 97.384% # ( 3, 4 ] 1559 1.377% 98.761% ( 4, 6 ] 854 0.754% 99.516% ( 6, 10 ] 416 0.368% 99.883% ( 10, 15 ] 99 0.087% 99.971% ( 15, 22 ] 8 0.007% 99.978% ( 22, 34 ] 1 0.001% 99.979% ( 34, 51 ] 1 0.001% 99.980% ( 51, 76 ] 2 0.002% 99.981% ( 110, 170 ] 7 0.006% 99.988% ( 170, 250 ] 4 0.004% 99.991% ( 250, 380 ] 2 0.002% 99.993% ( 380, 580 ] 4 0.004% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 3 0.003% 100.001% ( 2900, 4400 ] 2 0.002% 100.003% ** Level 1 read latency histogram (micros): Count: 16252 Average: 4.0028 StdDev: 75.12 Min: 1 Median: 1.3761 Max: 7478 Percentiles: P50: 1.38 P75: 1.81 P99: 9.60 P99.9: 321.45 P99.99: 3462.20 ------------------------------------------------------ [ 0, 1 ] 4613 28.384% 28.384% ###### ( 1, 2 ] 9340 57.470% 85.854% ########### ( 2, 3 ] 1137 6.996% 92.850% # ( 3, 4 ] 415 2.554% 95.404% # ( 4, 6 ] 391 2.406% 97.810% ( 6, 10 ] 215 1.323% 99.132% ( 10, 15 ] 38 0.234% 99.366% ( 15, 22 ] 5 0.031% 99.397% ( 22, 34 ] 1 0.006% 99.403% ( 34, 51 ] 1 0.006% 99.409% ( 51, 76 ] 47 0.289% 99.698% ( 76, 110 ] 12 0.074% 99.772% ( 110, 170 ] 12 0.074% 99.846% ( 170, 250 ] 6 0.037% 99.883% ( 250, 380 ] 5 0.031% 99.914% ( 380, 580 ] 4 0.025% 99.938% ( 580, 870 ] 4 0.025% 99.963% ( 870, 1300 ] 1 0.006% 99.969% ( 1900, 2900 ] 3 0.018% 99.988% ( 2900, 4400 ] 1 0.006% 99.994% ( 6600, 9900 ] 1 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 15900 Average: 1.8279 StdDev: 3.75 Min: 0 Median: 1.2384 Max: 311 Percentiles: P50: 1.24 P75: 1.67 P99: 5.31 P99.9: 11.55 P99.99: 226.40 ------------------------------------------------------ [ 0, 1 ] 5774 36.314% 36.314% ####### ( 1, 2 ] 9126 57.396% 93.711% ########### ( 2, 3 ] 505 3.176% 96.887% # ( 3, 4 ] 216 1.358% 98.245% ( 4, 6 ] 183 1.151% 99.396% ( 6, 10 ] 77 0.484% 99.881% ( 10, 15 ] 10 0.063% 99.943% ( 15, 22 ] 5 0.031% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 8453 Average: 17.1240 StdDev: 250.38 Min: 1 Median: 1.6189 Max: 7525 Percentiles: P50: 1.62 P75: 2.01 P99: 134.77 P99.9: 4065.50 P99.99: 7525.00 ------------------------------------------------------ [ 0, 1 ] 804 9.511% 9.511% ## ( 1, 2 ] 5530 65.421% 74.932% ############# ( 2, 3 ] 1052 12.445% 87.377% ## ( 3, 4 ] 413 4.886% 92.263% # ( 4, 6 ] 349 4.129% 96.392% # ( 6, 10 ] 162 1.916% 98.308% ( 10, 15 ] 34 0.402% 98.711% ( 15, 22 ] 2 0.024% 98.734% ( 22, 34 ] 1 0.012% 98.746% ( 110, 170 ] 52 0.615% 99.361% ( 170, 250 ] 10 0.118% 99.479% ( 250, 380 ] 7 0.083% 99.562% ( 380, 580 ] 4 0.047% 99.610% ( 580, 870 ] 6 0.071% 99.681% ( 870, 1300 ] 1 0.012% 99.692% ( 1300, 1900 ] 5 0.059% 99.752% ( 1900, 2900 ] 4 0.047% 99.799% ( 2900, 4400 ] 11 0.130% 99.929% ( 6600, 9900 ] 7 0.083% 100.012% ** Level 4 read latency histogram (micros): Count: 35 Average: 3572.5143 StdDev: 2422.77 Min: 205 Median: 3025.0000 Max: 8574 Percentiles: P50: 3025.00 P75: 5591.67 P99: 8574.00 P99.9: 8574.00 P99.99: 8574.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 580, 870 ] 2 5.714% 11.429% # ( 870, 1300 ] 2 5.714% 17.143% # ( 1300, 1900 ] 6 17.143% 34.286% ### ( 1900, 2900 ] 5 14.286% 48.571% ### ( 2900, 4400 ] 6 17.143% 65.714% ### ( 4400, 6600 ] 6 17.143% 82.857% ### ( 6600, 9900 ] 6 17.143% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 329.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.172 H:M:S, 5.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 356.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.172 H:M:S, 6.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/12-06:50:36 ... thread 0: (1000000,2000000) ops and (326132.5,343162.3) ops/second in (3.066238,5.828146) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.48 GB 94.4 0.9 0.0 0.9 2.7 1.8 0.0 1.5 107.6 315.6 8.78 8.13 29 0.303 959K 1236 0.0 0.0 L1 1/0 1.93 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 249.5 249.3 1.01 0.98 1 1.010 255K 203 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 239.8 239.8 0.46 0.43 1 0.464 113K 27 0.0 0.0 L3 40/0 994.76 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 205.9 205.8 5.56 4.81 4 1.390 1134K 510 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1224/8 97.92 GB 0.0 2.4 0.6 1.8 4.2 2.4 0.5 2.3 155.1 270.5 15.81 14.36 35 0.452 2462K 1976 0.0 0.0 Int 0/0 0.00 KB 0.0 2.4 0.6 1.8 4.2 2.4 0.4 2.3 155.1 270.5 15.81 14.36 35 0.452 2462K 1976 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.4 0.6 1.8 2.4 0.6 0.0 0.0 228.9 228.7 10.71 9.84 9 1.191 2462K 1976 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 358.4 5.10 4.52 26 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.18 GB write, 706.85 MB/s write, 2.40 GB read, 405.30 MB/s read, 15.8 seconds Interval compaction: 4.18 GB write, 733.77 MB/s write, 2.40 GB read, 420.74 MB/s read, 15.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 386508 Average: 2.3519 StdDev: 12.53 Min: 0 Median: 1.5637 Max: 3305 Percentiles: P50: 1.56 P75: 1.96 P99: 5.88 P99.9: 12.06 P99.99: 17.37 ------------------------------------------------------ [ 0, 1 ] 56834 14.704% 14.704% ### ( 1, 2 ] 242010 62.614% 77.319% ############# ( 2, 3 ] 55282 14.303% 91.622% ### ( 3, 4 ] 15862 4.104% 95.726% # ( 4, 6 ] 13482 3.488% 99.214% # ( 6, 10 ] 2427 0.628% 99.842% ( 10, 15 ] 551 0.143% 99.984% ( 15, 22 ] 69 0.018% 100.002% ( 22, 34 ] 7 0.002% 100.004% ( 34, 51 ] 5 0.001% 100.005% ( 51, 76 ] 5 0.001% 100.007% ( 110, 170 ] 10 0.003% 100.009% ( 170, 250 ] 11 0.003% 100.012% ( 250, 380 ] 4 0.001% 100.013% ( 380, 580 ] 8 0.002% 100.015% ( 580, 870 ] 7 0.002% 100.017% ( 870, 1300 ] 11 0.003% 100.020% ( 1300, 1900 ] 4 0.001% 100.021% ( 2900, 4400 ] 3 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 75715 Average: 2.9588 StdDev: 34.82 Min: 1 Median: 1.7290 Max: 7478 Percentiles: P50: 1.73 P75: 2.44 P99: 7.73 P99.9: 62.09 P99.99: 756.07 ------------------------------------------------------ [ 0, 1 ] 6025 7.957% 7.957% ## ( 1, 2 ] 43664 57.669% 65.626% ############ ( 2, 3 ] 16022 21.161% 86.787% #### ( 3, 4 ] 4395 5.805% 92.592% # ( 4, 6 ] 4485 5.924% 98.515% # ( 6, 10 ] 849 1.121% 99.637% ( 10, 15 ] 159 0.210% 99.847% ( 15, 22 ] 12 0.016% 99.863% ( 22, 34 ] 5 0.007% 99.869% ( 34, 51 ] 2 0.003% 99.872% ( 51, 76 ] 48 0.063% 99.935% ( 76, 110 ] 12 0.016% 99.951% ( 110, 170 ] 12 0.016% 99.967% ( 170, 250 ] 6 0.008% 99.975% ( 250, 380 ] 5 0.007% 99.982% ( 380, 580 ] 4 0.005% 99.987% ( 580, 870 ] 4 0.005% 99.992% ( 870, 1300 ] 1 0.001% 99.993% ( 1900, 2900 ] 3 0.004% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28276 Average: 1.9736 StdDev: 2.86 Min: 0 Median: 1.3921 Max: 311 Percentiles: P50: 1.39 P75: 1.79 P99: 5.31 P99.9: 9.70 P99.99: 176.90 ------------------------------------------------------ [ 0, 1 ] 7163 25.332% 25.332% ##### ( 1, 2 ] 17787 62.905% 88.237% ############# ( 2, 3 ] 2185 7.727% 95.965% ## ( 3, 4 ] 568 2.009% 97.974% ( 4, 6 ] 443 1.567% 99.540% ( 6, 10 ] 110 0.389% 99.929% ( 10, 15 ] 11 0.039% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 199304 Average: 3.7844 StdDev: 54.13 Min: 0 Median: 1.6822 Max: 7525 Percentiles: P50: 1.68 P75: 2.32 P99: 9.19 P99.9: 199.70 P99.99: 541.06 ------------------------------------------------------ [ 0, 1 ] 14872 7.462% 7.462% # ( 1, 2 ] 124282 62.358% 69.820% ############ ( 2, 3 ] 32713 16.414% 86.234% ### ( 3, 4 ] 11827 5.934% 92.168% # ( 4, 6 ] 10177 5.106% 97.274% # ( 6, 10 ] 4311 2.163% 99.437% ( 10, 15 ] 462 0.232% 99.669% ( 15, 22 ] 51 0.026% 99.694% ( 22, 34 ] 14 0.007% 99.701% ( 34, 51 ] 3 0.002% 99.703% ( 51, 76 ] 6 0.003% 99.706% ( 76, 110 ] 119 0.060% 99.766% ( 110, 170 ] 225 0.113% 99.879% ( 170, 250 ] 115 0.058% 99.936% ( 250, 380 ] 66 0.033% 99.969% ( 380, 580 ] 51 0.026% 99.995% ( 580, 870 ] 26 0.013% 100.008% ( 870, 1300 ] 11 0.006% 100.014% ( 1300, 1900 ] 8 0.004% 100.018% ( 1900, 2900 ] 4 0.002% 100.020% ( 2900, 4400 ] 11 0.006% 100.025% ( 6600, 9900 ] 7 0.004% 100.029% ** Level 4 read latency histogram (micros): Count: 35 Average: 3572.5143 StdDev: 2422.77 Min: 205 Median: 3025.0000 Max: 8574 Percentiles: P50: 3025.00 P75: 5591.67 P99: 8574.00 P99.9: 8574.00 P99.99: 8574.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 580, 870 ] 2 5.714% 11.429% # ( 870, 1300 ] 2 5.714% 17.143% # ( 1300, 1900 ] 6 17.143% 34.286% ### ( 1900, 2900 ] 5 14.286% 48.571% ### ( 2900, 4400 ] 6 17.143% 65.714% ### ( 4400, 6600 ] 6 17.143% 82.857% ### ( 6600, 9900 ] 6 17.143% 100.000% ### ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 325.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.547 H:M:S, 9.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.375 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/12-06:50:39 ... thread 0: (1000000,3000000) ops and (337401.6,341220.3) ops/second in (2.963827,8.791973) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.46 GB 226.5 2.0 0.0 2.0 4.8 2.8 0.0 1.7 131.5 310.7 15.81 14.78 47 0.336 2110K 2483 0.0 0.0 L1 1/0 1.93 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 249.5 249.3 1.01 0.98 1 1.010 255K 203 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 239.8 239.8 0.46 0.43 1 0.464 113K 27 0.0 0.0 L3 40/0 994.76 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 205.9 205.8 5.56 4.81 4 1.390 1134K 510 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1226/4 98.90 GB 0.0 3.5 0.6 2.9 6.3 3.4 0.5 2.3 157.0 281.0 22.84 21.00 53 0.431 3613K 3223 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 0.6 2.9 6.3 3.4 0.4 2.3 157.0 281.0 22.84 21.00 53 0.431 3613K 3223 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 0.6 2.9 3.5 0.6 0.0 0.0 238.9 238.7 15.01 14.05 13 1.155 3613K 3223 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 362.2 7.83 6.96 40 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.27 GB write, 711.90 MB/s write, 3.50 GB read, 397.84 MB/s read, 22.8 seconds Interval compaction: 6.27 GB write, 729.88 MB/s write, 3.50 GB read, 407.88 MB/s read, 22.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 655330 Average: 2.2391 StdDev: 13.34 Min: 0 Median: 1.5029 Max: 3862 Percentiles: P50: 1.50 P75: 1.89 P99: 5.69 P99.9: 11.23 P99.99: 16.62 ------------------------------------------------------ [ 0, 1 ] 115465 17.619% 17.619% #### ( 1, 2 ] 421960 64.389% 82.008% ############# ( 2, 3 ] 75982 11.594% 93.603% ## ( 3, 4 ] 21521 3.284% 96.887% # ( 4, 6 ] 16404 2.503% 99.390% # ( 6, 10 ] 3159 0.482% 99.872% ( 10, 15 ] 753 0.115% 99.987% ( 15, 22 ] 93 0.014% 100.001% ( 22, 34 ] 8 0.001% 100.002% ( 34, 51 ] 5 0.001% 100.003% ( 51, 76 ] 6 0.001% 100.004% ( 110, 170 ] 14 0.002% 100.006% ( 170, 250 ] 15 0.002% 100.008% ( 250, 380 ] 8 0.001% 100.010% ( 380, 580 ] 12 0.002% 100.011% ( 580, 870 ] 16 0.002% 100.014% ( 870, 1300 ] 17 0.003% 100.016% ( 1300, 1900 ] 5 0.001% 100.017% ( 1900, 2900 ] 1 0.000% 100.017% ( 2900, 4400 ] 6 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 75715 Average: 2.9588 StdDev: 34.82 Min: 1 Median: 1.7290 Max: 7478 Percentiles: P50: 1.73 P75: 2.44 P99: 7.73 P99.9: 62.09 P99.99: 756.07 ------------------------------------------------------ [ 0, 1 ] 6025 7.957% 7.957% ## ( 1, 2 ] 43664 57.669% 65.626% ############ ( 2, 3 ] 16022 21.161% 86.787% #### ( 3, 4 ] 4395 5.805% 92.592% # ( 4, 6 ] 4485 5.924% 98.515% # ( 6, 10 ] 849 1.121% 99.637% ( 10, 15 ] 159 0.210% 99.847% ( 15, 22 ] 12 0.016% 99.863% ( 22, 34 ] 5 0.007% 99.869% ( 34, 51 ] 2 0.003% 99.872% ( 51, 76 ] 48 0.063% 99.935% ( 76, 110 ] 12 0.016% 99.951% ( 110, 170 ] 12 0.016% 99.967% ( 170, 250 ] 6 0.008% 99.975% ( 250, 380 ] 5 0.007% 99.982% ( 380, 580 ] 4 0.005% 99.987% ( 580, 870 ] 4 0.005% 99.992% ( 870, 1300 ] 1 0.001% 99.993% ( 1900, 2900 ] 3 0.004% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28276 Average: 1.9736 StdDev: 2.86 Min: 0 Median: 1.3921 Max: 311 Percentiles: P50: 1.39 P75: 1.79 P99: 5.31 P99.9: 9.70 P99.99: 176.90 ------------------------------------------------------ [ 0, 1 ] 7163 25.332% 25.332% ##### ( 1, 2 ] 17787 62.905% 88.237% ############# ( 2, 3 ] 2185 7.727% 95.965% ## ( 3, 4 ] 568 2.009% 97.974% ( 4, 6 ] 443 1.567% 99.540% ( 6, 10 ] 110 0.389% 99.929% ( 10, 15 ] 11 0.039% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 199304 Average: 3.7844 StdDev: 54.13 Min: 0 Median: 1.6822 Max: 7525 Percentiles: P50: 1.68 P75: 2.32 P99: 9.19 P99.9: 199.70 P99.99: 541.06 ------------------------------------------------------ [ 0, 1 ] 14872 7.462% 7.462% # ( 1, 2 ] 124282 62.358% 69.820% ############ ( 2, 3 ] 32713 16.414% 86.234% ### ( 3, 4 ] 11827 5.934% 92.168% # ( 4, 6 ] 10177 5.106% 97.274% # ( 6, 10 ] 4311 2.163% 99.437% ( 10, 15 ] 462 0.232% 99.669% ( 15, 22 ] 51 0.026% 99.694% ( 22, 34 ] 14 0.007% 99.701% ( 34, 51 ] 3 0.002% 99.703% ( 51, 76 ] 6 0.003% 99.706% ( 76, 110 ] 119 0.060% 99.766% ( 110, 170 ] 225 0.113% 99.879% ( 170, 250 ] 115 0.058% 99.936% ( 250, 380 ] 66 0.033% 99.969% ( 380, 580 ] 51 0.026% 99.995% ( 580, 870 ] 26 0.013% 100.008% ( 870, 1300 ] 11 0.006% 100.014% ( 1300, 1900 ] 8 0.004% 100.018% ( 1900, 2900 ] 4 0.002% 100.020% ( 2900, 4400 ] 11 0.006% 100.025% ( 6600, 9900 ] 7 0.004% 100.029% ** Level 4 read latency histogram (micros): Count: 35 Average: 3572.5143 StdDev: 2422.77 Min: 205 Median: 3025.0000 Max: 8574 Percentiles: P50: 3025.00 P75: 5591.67 P99: 8574.00 P99.9: 8574.00 P99.99: 8574.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 580, 870 ] 2 5.714% 11.429% # ( 870, 1300 ] 2 5.714% 17.143% # ( 1300, 1900 ] 6 17.143% 34.286% ### ( 1900, 2900 ] 5 14.286% 48.571% ### ( 2900, 4400 ] 6 17.143% 65.714% ### ( 4400, 6600 ] 6 17.143% 82.857% ### ( 6600, 9900 ] 6 17.143% 100.000% ### ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 327.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.913 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.365 H:M:S, 12.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/12-06:50:42 ... thread 0: (1000000,4000000) ops and (338188.5,340457.3) ops/second in (2.956931,11.748904) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/18 3.44 GB 0.0 2.8 0.0 2.8 6.6 3.7 0.0 1.8 133.7 310.9 21.67 20.26 64 0.339 2942K 3318 0.0 0.0 L1 1/1 1.93 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 249.5 249.3 1.01 0.98 1 1.010 255K 203 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 239.8 239.8 0.46 0.43 1 0.464 113K 27 0.0 0.0 L3 40/0 994.76 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 205.9 205.8 5.56 4.81 4 1.390 1134K 510 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1231/19 99.89 GB 0.0 4.3 0.6 3.7 8.1 4.3 0.5 2.1 153.5 287.2 28.70 26.49 70 0.410 4445K 4058 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 0.6 3.7 8.1 4.3 0.4 2.1 153.5 287.2 28.70 26.49 70 0.410 4445K 4058 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 0.6 3.7 4.3 0.6 0.0 0.0 244.0 243.7 18.06 17.03 16 1.129 4445K 4058 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 361.0 10.65 9.46 54 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.05 GB write, 688.60 MB/s write, 4.30 GB read, 367.98 MB/s read, 28.7 seconds Interval compaction: 8.05 GB write, 701.61 MB/s write, 4.30 GB read, 374.93 MB/s read, 28.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 873371 Average: 2.2129 StdDev: 13.76 Min: 0 Median: 1.4717 Max: 3956 Percentiles: P50: 1.47 P75: 1.86 P99: 5.58 P99.9: 11.73 P99.99: 138.41 ------------------------------------------------------ [ 0, 1 ] 168927 19.342% 19.342% #### ( 1, 2 ] 567647 64.995% 84.337% ############# ( 2, 3 ] 88039 10.080% 94.417% ## ( 3, 4 ] 25650 2.937% 97.354% # ( 4, 6 ] 18203 2.084% 99.438% ( 6, 10 ] 3726 0.427% 99.865% ( 10, 15 ] 890 0.102% 99.967% ( 15, 22 ] 115 0.013% 99.980% ( 22, 34 ] 10 0.001% 99.981% ( 34, 51 ] 6 0.001% 99.982% ( 51, 76 ] 7 0.001% 99.983% ( 76, 110 ] 6 0.001% 99.983% ( 110, 170 ] 126 0.014% 99.998% ( 170, 250 ] 51 0.006% 100.004% ( 250, 380 ] 18 0.002% 100.006% ( 380, 580 ] 21 0.002% 100.008% ( 580, 870 ] 25 0.003% 100.011% ( 870, 1300 ] 21 0.002% 100.013% ( 1300, 1900 ] 6 0.001% 100.014% ( 1900, 2900 ] 2 0.000% 100.014% ( 2900, 4400 ] 8 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 75716 Average: 2.9618 StdDev: 34.83 Min: 1 Median: 1.7290 Max: 7478 Percentiles: P50: 1.73 P75: 2.44 P99: 7.73 P99.9: 62.61 P99.99: 756.06 ------------------------------------------------------ [ 0, 1 ] 6025 7.957% 7.957% ## ( 1, 2 ] 43664 57.668% 65.625% ############ ( 2, 3 ] 16022 21.161% 86.786% #### ( 3, 4 ] 4395 5.805% 92.591% # ( 4, 6 ] 4485 5.923% 98.514% # ( 6, 10 ] 849 1.121% 99.635% ( 10, 15 ] 159 0.210% 99.845% ( 15, 22 ] 12 0.016% 99.861% ( 22, 34 ] 5 0.007% 99.868% ( 34, 51 ] 2 0.003% 99.871% ( 51, 76 ] 48 0.063% 99.934% ( 76, 110 ] 12 0.016% 99.950% ( 110, 170 ] 12 0.016% 99.966% ( 170, 250 ] 7 0.009% 99.975% ( 250, 380 ] 5 0.007% 99.982% ( 380, 580 ] 4 0.005% 99.987% ( 580, 870 ] 4 0.005% 99.992% ( 870, 1300 ] 1 0.001% 99.993% ( 1900, 2900 ] 3 0.004% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28276 Average: 1.9736 StdDev: 2.86 Min: 0 Median: 1.3921 Max: 311 Percentiles: P50: 1.39 P75: 1.79 P99: 5.31 P99.9: 9.70 P99.99: 176.90 ------------------------------------------------------ [ 0, 1 ] 7163 25.332% 25.332% ##### ( 1, 2 ] 17787 62.905% 88.237% ############# ( 2, 3 ] 2185 7.727% 95.965% ## ( 3, 4 ] 568 2.009% 97.974% ( 4, 6 ] 443 1.567% 99.540% ( 6, 10 ] 110 0.389% 99.929% ( 10, 15 ] 11 0.039% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 199304 Average: 3.7844 StdDev: 54.13 Min: 0 Median: 1.6822 Max: 7525 Percentiles: P50: 1.68 P75: 2.32 P99: 9.19 P99.9: 199.70 P99.99: 541.06 ------------------------------------------------------ [ 0, 1 ] 14872 7.462% 7.462% # ( 1, 2 ] 124282 62.358% 69.820% ############ ( 2, 3 ] 32713 16.414% 86.234% ### ( 3, 4 ] 11827 5.934% 92.168% # ( 4, 6 ] 10177 5.106% 97.274% # ( 6, 10 ] 4311 2.163% 99.437% ( 10, 15 ] 462 0.232% 99.669% ( 15, 22 ] 51 0.026% 99.694% ( 22, 34 ] 14 0.007% 99.701% ( 34, 51 ] 3 0.002% 99.703% ( 51, 76 ] 6 0.003% 99.706% ( 76, 110 ] 119 0.060% 99.766% ( 110, 170 ] 225 0.113% 99.879% ( 170, 250 ] 115 0.058% 99.936% ( 250, 380 ] 66 0.033% 99.969% ( 380, 580 ] 51 0.026% 99.995% ( 580, 870 ] 26 0.013% 100.008% ( 870, 1300 ] 11 0.006% 100.014% ( 1300, 1900 ] 8 0.004% 100.018% ( 1900, 2900 ] 4 0.002% 100.020% ( 2900, 4400 ] 11 0.006% 100.025% ( 6600, 9900 ] 7 0.004% 100.029% ** Level 4 read latency histogram (micros): Count: 35 Average: 3572.5143 StdDev: 2422.77 Min: 205 Median: 3025.0000 Max: 8574 Percentiles: P50: 3025.00 P75: 5591.67 P99: 8574.00 P99.9: 8574.00 P99.99: 8574.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 580, 870 ] 2 5.714% 11.429% # ( 870, 1300 ] 2 5.714% 17.143% # ( 1300, 1900 ] 6 17.143% 34.286% ### ( 1900, 2900 ] 5 14.286% 48.571% ### ( 2900, 4400 ] 6 17.143% 65.714% ### ( 4400, 6600 ] 6 17.143% 82.857% ### ( 6600, 9900 ] 6 17.143% 100.000% ### ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 328.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.278 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.366 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/12-06:50:51 ... thread 0: (1000000,5000000) ops and (104050.0,234086.1) ops/second in (9.610760,21.359664) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 4.36 GB 125.4 4.9 0.0 4.9 9.6 4.7 0.0 2.1 155.9 303.8 32.32 30.44 84 0.385 5116K 8836 0.0 0.0 L1 1/1 1.93 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 249.5 249.3 1.01 0.98 1 1.010 255K 203 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 239.8 239.8 0.46 0.43 1 0.464 113K 27 0.0 0.0 L3 40/0 994.76 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 205.9 205.8 5.56 4.81 4 1.390 1134K 510 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1231/15 100.80 GB 0.0 6.4 0.6 5.8 11.1 5.3 0.5 2.4 166.4 287.8 39.35 36.66 90 0.437 6619K 9576 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 0.6 5.8 11.1 5.3 0.4 2.4 166.4 287.8 39.35 36.66 90 0.437 6619K 9576 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 0.6 5.8 6.4 0.6 0.0 0.0 251.3 250.9 26.05 24.86 21 1.240 6619K 9576 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 360.0 13.30 11.81 69 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.6 total, 21.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.06 GB write, 524.69 MB/s write, 6.39 GB read, 303.31 MB/s read, 39.3 seconds Interval compaction: 11.06 GB write, 530.14 MB/s write, 6.39 GB read, 306.47 MB/s read, 39.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 15, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1957749 Average: 2.3140 StdDev: 12.11 Min: 0 Median: 1.4996 Max: 3956 Percentiles: P50: 1.50 P75: 1.87 P99: 5.74 P99.9: 15.43 P99.99: 167.50 ------------------------------------------------------ [ 0, 1 ] 322694 16.483% 16.483% ### ( 1, 2 ] 1313412 67.088% 83.571% ############# ( 2, 3 ] 216358 11.051% 94.622% ## ( 3, 4 ] 53403 2.728% 97.350% # ( 4, 6 ] 37137 1.897% 99.247% ( 6, 10 ] 10909 0.557% 99.804% ( 10, 15 ] 1845 0.094% 99.898% ( 15, 22 ] 537 0.027% 99.926% ( 22, 34 ] 19 0.001% 99.927% ( 34, 51 ] 8 0.000% 99.927% ( 51, 76 ] 10 0.001% 99.928% ( 76, 110 ] 446 0.023% 99.950% ( 110, 170 ] 809 0.041% 99.992% ( 170, 250 ] 217 0.011% 100.003% ( 250, 380 ] 111 0.006% 100.008% ( 380, 580 ] 109 0.006% 100.014% ( 580, 870 ] 61 0.003% 100.017% ( 870, 1300 ] 29 0.001% 100.019% ( 1300, 1900 ] 7 0.000% 100.019% ( 1900, 2900 ] 2 0.000% 100.019% ( 2900, 4400 ] 12 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 75716 Average: 2.9618 StdDev: 34.83 Min: 1 Median: 1.7290 Max: 7478 Percentiles: P50: 1.73 P75: 2.44 P99: 7.73 P99.9: 62.61 P99.99: 756.06 ------------------------------------------------------ [ 0, 1 ] 6025 7.957% 7.957% ## ( 1, 2 ] 43664 57.668% 65.625% ############ ( 2, 3 ] 16022 21.161% 86.786% #### ( 3, 4 ] 4395 5.805% 92.591% # ( 4, 6 ] 4485 5.923% 98.514% # ( 6, 10 ] 849 1.121% 99.635% ( 10, 15 ] 159 0.210% 99.845% ( 15, 22 ] 12 0.016% 99.861% ( 22, 34 ] 5 0.007% 99.868% ( 34, 51 ] 2 0.003% 99.871% ( 51, 76 ] 48 0.063% 99.934% ( 76, 110 ] 12 0.016% 99.950% ( 110, 170 ] 12 0.016% 99.966% ( 170, 250 ] 7 0.009% 99.975% ( 250, 380 ] 5 0.007% 99.982% ( 380, 580 ] 4 0.005% 99.987% ( 580, 870 ] 4 0.005% 99.992% ( 870, 1300 ] 1 0.001% 99.993% ( 1900, 2900 ] 3 0.004% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28276 Average: 1.9736 StdDev: 2.86 Min: 0 Median: 1.3921 Max: 311 Percentiles: P50: 1.39 P75: 1.79 P99: 5.31 P99.9: 9.70 P99.99: 176.90 ------------------------------------------------------ [ 0, 1 ] 7163 25.332% 25.332% ##### ( 1, 2 ] 17787 62.905% 88.237% ############# ( 2, 3 ] 2185 7.727% 95.965% ## ( 3, 4 ] 568 2.009% 97.974% ( 4, 6 ] 443 1.567% 99.540% ( 6, 10 ] 110 0.389% 99.929% ( 10, 15 ] 11 0.039% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 199304 Average: 3.7844 StdDev: 54.13 Min: 0 Median: 1.6822 Max: 7525 Percentiles: P50: 1.68 P75: 2.32 P99: 9.19 P99.9: 199.70 P99.99: 541.06 ------------------------------------------------------ [ 0, 1 ] 14872 7.462% 7.462% # ( 1, 2 ] 124282 62.358% 69.820% ############ ( 2, 3 ] 32713 16.414% 86.234% ### ( 3, 4 ] 11827 5.934% 92.168% # ( 4, 6 ] 10177 5.106% 97.274% # ( 6, 10 ] 4311 2.163% 99.437% ( 10, 15 ] 462 0.232% 99.669% ( 15, 22 ] 51 0.026% 99.694% ( 22, 34 ] 14 0.007% 99.701% ( 34, 51 ] 3 0.002% 99.703% ( 51, 76 ] 6 0.003% 99.706% ( 76, 110 ] 119 0.060% 99.766% ( 110, 170 ] 225 0.113% 99.879% ( 170, 250 ] 115 0.058% 99.936% ( 250, 380 ] 66 0.033% 99.969% ( 380, 580 ] 51 0.026% 99.995% ( 580, 870 ] 26 0.013% 100.008% ( 870, 1300 ] 11 0.006% 100.014% ( 1300, 1900 ] 8 0.004% 100.018% ( 1900, 2900 ] 4 0.002% 100.020% ( 2900, 4400 ] 11 0.006% 100.025% ( 6600, 9900 ] 7 0.004% 100.029% ** Level 4 read latency histogram (micros): Count: 35 Average: 3572.5143 StdDev: 2422.77 Min: 205 Median: 3025.0000 Max: 8574 Percentiles: P50: 3025.00 P75: 5591.67 P99: 8574.00 P99.9: 8574.00 P99.99: 8574.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 580, 870 ] 2 5.714% 11.429% # ( 870, 1300 ] 2 5.714% 17.143% # ( 1300, 1900 ] 6 17.143% 34.286% ### ( 1900, 2900 ] 5 14.286% 48.571% ### ( 2900, 4400 ] 6 17.143% 65.714% ### ( 4400, 6600 ] 6 17.143% 82.857% ### ( 6600, 9900 ] 6 17.143% 100.000% ### ** DB Stats ** Uptime(secs): 21.6 total, 9.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 228.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.174 H:M:S, 37.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 102.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.896 H:M:S, 71.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/12-06:50:57 ... thread 0: (1000000,6000000) ops and (165259.2,218892.1) ops/second in (6.051100,27.410764) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 2.21 GB 12.6 5.7 0.0 5.7 11.3 5.7 0.0 2.0 150.5 300.8 38.50 35.75 102 0.377 5883K 9582 0.0 0.0 L1 18/18 1.59 GB 0.0 3.4 3.3 0.1 3.3 3.3 0.1 1.0 221.8 218.7 15.61 14.83 2 7.806 3516K 48K 0.0 0.0 L2 2/0 99.25 MB 1.0 0.1 0.1 0.0 0.1 0.1 1.8 1.8 239.8 239.8 0.46 0.43 1 0.464 113K 27 0.0 0.0 L3 19/0 950.74 MB 1.0 2.0 1.1 0.8 2.0 1.1 0.6 1.7 156.4 156.2 12.90 9.05 20 0.645 1977K 1679 0.0 0.0 L4 179/0 9.74 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.4 1.0 126.4 126.4 0.98 0.60 1 0.981 125K 0 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1288/26 101.74 GB 0.0 11.2 4.6 6.6 16.8 10.2 5.2 3.0 168.2 251.9 68.46 60.66 126 0.543 11M 59K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.2 4.6 6.6 16.8 10.2 5.2 3.0 168.2 251.9 68.46 60.66 126 0.543 11M 59K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.2 4.6 6.6 11.2 4.6 0.0 0.0 222.2 221.0 51.81 46.27 42 1.234 11M 59K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 348.1 16.65 14.38 84 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.6 total, 27.4 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.84 GB write, 624.08 MB/s write, 11.24 GB read, 416.57 MB/s read, 68.5 seconds Interval compaction: 16.84 GB write, 629.13 MB/s write, 11.24 GB read, 419.95 MB/s read, 68.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 27, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2477171 Average: 2.4885 StdDev: 20.69 Min: 0 Median: 1.5095 Max: 8154 Percentiles: P50: 1.51 P75: 1.88 P99: 5.94 P99.9: 94.37 P99.99: 230.52 ------------------------------------------------------ [ 0, 1 ] 394919 15.942% 15.942% ### ( 1, 2 ] 1655846 66.844% 82.787% ############# ( 2, 3 ] 282924 11.421% 94.208% ## ( 3, 4 ] 69450 2.804% 97.011% # ( 4, 6 ] 50771 2.050% 99.061% ( 6, 10 ] 16974 0.685% 99.746% ( 10, 15 ] 2532 0.102% 99.848% ( 15, 22 ] 717 0.029% 99.877% ( 22, 34 ] 28 0.001% 99.878% ( 34, 51 ] 20 0.001% 99.879% ( 51, 76 ] 60 0.002% 99.882% ( 76, 110 ] 842 0.034% 99.916% ( 110, 170 ] 1548 0.062% 99.978% ( 170, 250 ] 389 0.016% 99.994% ( 250, 380 ] 229 0.009% 100.003% ( 380, 580 ] 212 0.009% 100.012% ( 580, 870 ] 131 0.005% 100.017% ( 870, 1300 ] 49 0.002% 100.019% ( 1300, 1900 ] 20 0.001% 100.020% ( 1900, 2900 ] 8 0.000% 100.020% ( 2900, 4400 ] 28 0.001% 100.021% ( 4400, 6600 ] 7 0.000% 100.022% ( 6600, 9900 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 276466 Average: 4.0497 StdDev: 62.85 Min: 0 Median: 2.0384 Max: 9019 Percentiles: P50: 2.04 P75: 2.94 P99: 7.92 P99.9: 9.98 P99.99: 11.46 ------------------------------------------------------ [ 0, 1 ] 7233 2.616% 2.616% # ( 1, 2 ] 128053 46.318% 48.934% ######### ( 2, 3 ] 76685 27.738% 76.672% ###### ( 3, 4 ] 28056 10.148% 86.820% ## ( 4, 6 ] 31356 11.342% 98.161% ## ( 6, 10 ] 4827 1.746% 99.907% ( 10, 15 ] 782 0.283% 100.190% ( 15, 22 ] 74 0.027% 100.217% ( 22, 34 ] 15 0.005% 100.222% ( 34, 51 ] 7 0.003% 100.225% ( 51, 76 ] 49 0.018% 100.243% ( 76, 110 ] 34 0.012% 100.255% ( 110, 170 ] 78 0.028% 100.283% ( 170, 250 ] 37 0.013% 100.297% ( 250, 380 ] 32 0.012% 100.308% ( 380, 580 ] 26 0.009% 100.318% ( 580, 870 ] 27 0.010% 100.327% ( 870, 1300 ] 10 0.004% 100.331% ( 1300, 1900 ] 1 0.000% 100.331% ( 1900, 2900 ] 10 0.004% 100.335% ( 2900, 4400 ] 39 0.014% 100.349% ( 4400, 6600 ] 1 0.000% 100.349% ( 6600, 9900 ] 6 0.002% 100.352% ** Level 2 read latency histogram (micros): Count: 28276 Average: 1.9736 StdDev: 2.86 Min: 0 Median: 1.3921 Max: 311 Percentiles: P50: 1.39 P75: 1.79 P99: 5.31 P99.9: 9.70 P99.99: 176.90 ------------------------------------------------------ [ 0, 1 ] 7163 25.332% 25.332% ##### ( 1, 2 ] 17787 62.905% 88.237% ############# ( 2, 3 ] 2185 7.727% 95.965% ## ( 3, 4 ] 568 2.009% 97.974% ( 4, 6 ] 443 1.567% 99.540% ( 6, 10 ] 110 0.389% 99.929% ( 10, 15 ] 11 0.039% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 250824 Average: 6.6321 StdDev: 90.55 Min: 0 Median: 1.7096 Max: 12016 Percentiles: P50: 1.71 P75: 2.41 P99: 10.24 P99.9: 746.96 P99.99: 1651.10 ------------------------------------------------------ [ 0, 1 ] 17025 6.788% 6.788% # ( 1, 2 ] 152753 60.900% 67.688% ############ ( 2, 3 ] 44284 17.655% 85.344% #### ( 3, 4 ] 15699 6.259% 91.602% # ( 4, 6 ] 13105 5.225% 96.827% # ( 6, 10 ] 5416 2.159% 98.987% ( 10, 15 ] 704 0.281% 99.267% ( 15, 22 ] 79 0.031% 99.299% ( 22, 34 ] 18 0.007% 99.306% ( 34, 51 ] 7 0.003% 99.309% ( 51, 76 ] 6 0.002% 99.311% ( 76, 110 ] 136 0.054% 99.365% ( 110, 170 ] 348 0.139% 99.504% ( 170, 250 ] 273 0.109% 99.613% ( 250, 380 ] 254 0.101% 99.714% ( 380, 580 ] 328 0.131% 99.845% ( 580, 870 ] 240 0.096% 99.941% ( 870, 1300 ] 97 0.039% 99.979% ( 1300, 1900 ] 46 0.018% 99.998% ( 1900, 2900 ] 24 0.010% 100.007% ( 2900, 4400 ] 39 0.016% 100.023% ( 4400, 6600 ] 5 0.002% 100.025% ( 6600, 9900 ] 12 0.005% 100.030% ( 9900, 14000 ] 1 0.000% 100.030% ** Level 4 read latency histogram (micros): Count: 165 Average: 764.9212 StdDev: 1835.27 Min: 0 Median: 1.8375 Max: 8574 Percentiles: P50: 1.84 P75: 18.21 P99: 8574.00 P99.9: 8574.00 P99.99: 8574.00 ------------------------------------------------------ [ 0, 1 ] 49 29.697% 29.697% ###### ( 1, 2 ] 40 24.242% 53.939% ##### ( 2, 3 ] 5 3.030% 56.970% # ( 3, 4 ] 6 3.636% 60.606% # ( 4, 6 ] 2 1.212% 61.818% ( 6, 10 ] 3 1.818% 63.636% ( 10, 15 ] 16 9.697% 73.333% ## ( 15, 22 ] 6 3.636% 76.970% # ( 170, 250 ] 3 1.818% 78.788% ( 250, 380 ] 2 1.212% 80.000% ( 580, 870 ] 2 1.212% 81.212% ( 870, 1300 ] 2 1.212% 82.424% ( 1300, 1900 ] 6 3.636% 86.061% # ( 1900, 2900 ] 5 3.030% 89.091% # ( 2900, 4400 ] 6 3.636% 92.727% # ( 4400, 6600 ] 6 3.636% 96.364% # ( 6600, 9900 ] 6 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 1744.9125 StdDev: 1810.63 Min: 87 Median: 870.0000 Max: 7670 Percentiles: P50: 870.00 P75: 2816.67 P99: 7260.00 P99.9: 7670.00 P99.99: 7670.00 ------------------------------------------------------ ( 76, 110 ] 4 5.000% 5.000% # ( 110, 170 ] 3 3.750% 8.750% # ( 170, 250 ] 5 6.250% 15.000% # ( 250, 380 ] 14 17.500% 32.500% #### ( 380, 580 ] 8 10.000% 42.500% ## ( 580, 870 ] 6 7.500% 50.000% ## ( 870, 1300 ] 7 8.750% 58.750% ## ( 1300, 1900 ] 2 2.500% 61.250% # ( 1900, 2900 ] 12 15.000% 76.250% ### ( 2900, 4400 ] 11 13.750% 90.000% ### ( 4400, 6600 ] 7 8.750% 98.750% ## ( 6600, 9900 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 27.6 total, 6.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 213.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.390 H:M:S, 41.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 162.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.216 H:M:S, 53.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/12-06:51:00 ... thread 0: (1000000,7000000) ops and (328523.4,229849.7) ops/second in (3.043923,30.454687) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 3.13 GB 107.0 6.5 0.0 6.5 13.1 6.6 0.0 2.0 149.9 301.0 44.53 41.43 118 0.377 6779K 10K 0.0 0.0 L1 18/18 1.59 GB 0.0 3.4 3.3 0.1 3.3 3.3 0.1 1.0 221.8 218.7 15.61 14.83 2 7.806 3516K 48K 0.0 0.0 L2 2/0 99.25 MB 1.0 0.1 0.1 0.0 0.1 0.1 1.8 1.8 239.8 239.8 0.46 0.43 1 0.464 113K 27 0.0 0.0 L3 19/0 950.74 MB 1.0 2.0 1.1 0.8 2.0 1.1 0.6 1.7 156.4 156.2 12.90 9.05 20 0.645 1977K 1679 0.0 0.0 L4 179/0 9.74 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.4 1.0 126.4 126.4 0.98 0.60 1 0.981 125K 0 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/26 102.66 GB 0.0 12.1 4.6 7.5 18.6 11.2 5.2 2.8 166.4 256.0 74.49 66.34 142 0.525 12M 60K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.1 4.6 7.5 18.6 11.2 5.2 2.8 166.4 256.0 74.49 66.34 142 0.525 12M 60K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.1 4.6 7.5 12.0 4.6 0.0 0.0 224.6 223.5 55.18 49.58 45 1.226 12M 60K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 349.1 19.31 16.75 97 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.7 total, 30.5 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.62 GB write, 621.67 MB/s write, 12.10 GB read, 403.99 MB/s read, 74.5 seconds Interval compaction: 18.62 GB write, 626.20 MB/s write, 12.10 GB read, 406.93 MB/s read, 74.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 29, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2873400 Average: 2.4801 StdDev: 19.64 Min: 0 Median: 1.5259 Max: 8154 Percentiles: P50: 1.53 P75: 1.90 P99: 5.94 P99.9: 37.91 P99.99: 182.32 ------------------------------------------------------ [ 0, 1 ] 428136 14.900% 14.900% ### ( 1, 2 ] 1917954 66.749% 81.649% ############# ( 2, 3 ] 354617 12.341% 93.990% ## ( 3, 4 ] 83561 2.908% 96.898% # ( 4, 6 ] 62180 2.164% 99.062% ( 6, 10 ] 20390 0.710% 99.772% ( 10, 15 ] 2901 0.101% 99.873% ( 15, 22 ] 748 0.026% 99.899% ( 22, 34 ] 36 0.001% 99.900% ( 34, 51 ] 20 0.001% 99.901% ( 51, 76 ] 63 0.002% 99.903% ( 76, 110 ] 872 0.030% 99.933% ( 110, 170 ] 1573 0.055% 99.988% ( 170, 250 ] 407 0.014% 100.002% ( 250, 380 ] 240 0.008% 100.010% ( 380, 580 ] 221 0.008% 100.018% ( 580, 870 ] 140 0.005% 100.023% ( 870, 1300 ] 57 0.002% 100.025% ( 1300, 1900 ] 21 0.001% 100.026% ( 1900, 2900 ] 9 0.000% 100.026% ( 2900, 4400 ] 30 0.001% 100.027% ( 4400, 6600 ] 7 0.000% 100.027% ( 6600, 9900 ] 2 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 297299 Average: 4.0222 StdDev: 60.86 Min: 0 Median: 1.9843 Max: 9019 Percentiles: P50: 1.98 P75: 2.90 P99: 8.00 P99.9: 10.61 P99.99: 12.30 ------------------------------------------------------ [ 0, 1 ] 8751 2.944% 2.944% # ( 1, 2 ] 142131 47.807% 50.751% ########## ( 2, 3 ] 80360 27.030% 77.781% ##### ( 3, 4 ] 28644 9.635% 87.416% ## ( 4, 6 ] 31863 10.717% 98.133% ## ( 6, 10 ] 5156 1.734% 99.867% ( 10, 15 ] 791 0.266% 100.134% ( 15, 22 ] 75 0.025% 100.159% ( 22, 34 ] 15 0.005% 100.164% ( 34, 51 ] 7 0.002% 100.166% ( 51, 76 ] 49 0.016% 100.183% ( 76, 110 ] 61 0.021% 100.203% ( 110, 170 ] 122 0.041% 100.244% ( 170, 250 ] 65 0.022% 100.266% ( 250, 380 ] 46 0.015% 100.282% ( 380, 580 ] 35 0.012% 100.293% ( 580, 870 ] 32 0.011% 100.304% ( 870, 1300 ] 11 0.004% 100.308% ( 1300, 1900 ] 1 0.000% 100.308% ( 1900, 2900 ] 10 0.003% 100.311% ( 2900, 4400 ] 39 0.013% 100.325% ( 4400, 6600 ] 1 0.000% 100.325% ( 6600, 9900 ] 6 0.002% 100.327% ** Level 2 read latency histogram (micros): Count: 28276 Average: 1.9736 StdDev: 2.86 Min: 0 Median: 1.3921 Max: 311 Percentiles: P50: 1.39 P75: 1.79 P99: 5.31 P99.9: 9.70 P99.99: 176.90 ------------------------------------------------------ [ 0, 1 ] 7163 25.332% 25.332% ##### ( 1, 2 ] 17787 62.905% 88.237% ############# ( 2, 3 ] 2185 7.727% 95.965% ## ( 3, 4 ] 568 2.009% 97.974% ( 4, 6 ] 443 1.567% 99.540% ( 6, 10 ] 110 0.389% 99.929% ( 10, 15 ] 11 0.039% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 250824 Average: 6.6321 StdDev: 90.55 Min: 0 Median: 1.7096 Max: 12016 Percentiles: P50: 1.71 P75: 2.41 P99: 10.24 P99.9: 746.96 P99.99: 1651.10 ------------------------------------------------------ [ 0, 1 ] 17025 6.788% 6.788% # ( 1, 2 ] 152753 60.900% 67.688% ############ ( 2, 3 ] 44284 17.655% 85.344% #### ( 3, 4 ] 15699 6.259% 91.602% # ( 4, 6 ] 13105 5.225% 96.827% # ( 6, 10 ] 5416 2.159% 98.987% ( 10, 15 ] 704 0.281% 99.267% ( 15, 22 ] 79 0.031% 99.299% ( 22, 34 ] 18 0.007% 99.306% ( 34, 51 ] 7 0.003% 99.309% ( 51, 76 ] 6 0.002% 99.311% ( 76, 110 ] 136 0.054% 99.365% ( 110, 170 ] 348 0.139% 99.504% ( 170, 250 ] 273 0.109% 99.613% ( 250, 380 ] 254 0.101% 99.714% ( 380, 580 ] 328 0.131% 99.845% ( 580, 870 ] 240 0.096% 99.941% ( 870, 1300 ] 97 0.039% 99.979% ( 1300, 1900 ] 46 0.018% 99.998% ( 1900, 2900 ] 24 0.010% 100.007% ( 2900, 4400 ] 39 0.016% 100.023% ( 4400, 6600 ] 5 0.002% 100.025% ( 6600, 9900 ] 12 0.005% 100.030% ( 9900, 14000 ] 1 0.000% 100.030% ** Level 4 read latency histogram (micros): Count: 165 Average: 764.9212 StdDev: 1835.27 Min: 0 Median: 1.8375 Max: 8574 Percentiles: P50: 1.84 P75: 18.21 P99: 8574.00 P99.9: 8574.00 P99.99: 8574.00 ------------------------------------------------------ [ 0, 1 ] 49 29.697% 29.697% ###### ( 1, 2 ] 40 24.242% 53.939% ##### ( 2, 3 ] 5 3.030% 56.970% # ( 3, 4 ] 6 3.636% 60.606% # ( 4, 6 ] 2 1.212% 61.818% ( 6, 10 ] 3 1.818% 63.636% ( 10, 15 ] 16 9.697% 73.333% ## ( 15, 22 ] 6 3.636% 76.970% # ( 170, 250 ] 3 1.818% 78.788% ( 250, 380 ] 2 1.212% 80.000% ( 580, 870 ] 2 1.212% 81.212% ( 870, 1300 ] 2 1.212% 82.424% ( 1300, 1900 ] 6 3.636% 86.061% # ( 1900, 2900 ] 5 3.030% 89.091% # ( 2900, 4400 ] 6 3.636% 92.727% # ( 4400, 6600 ] 6 3.636% 96.364% # ( 6600, 9900 ] 6 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 1744.9125 StdDev: 1810.63 Min: 87 Median: 870.0000 Max: 7670 Percentiles: P50: 870.00 P75: 2816.67 P99: 7260.00 P99.9: 7670.00 P99.99: 7670.00 ------------------------------------------------------ ( 76, 110 ] 4 5.000% 5.000% # ( 110, 170 ] 3 3.750% 8.750% # ( 170, 250 ] 5 6.250% 15.000% # ( 250, 380 ] 14 17.500% 32.500% #### ( 380, 580 ] 8 10.000% 42.500% ## ( 580, 870 ] 6 7.500% 50.000% ## ( 870, 1300 ] 7 8.750% 58.750% ## ( 1300, 1900 ] 2 2.500% 61.250% # ( 1900, 2900 ] 12 15.000% 76.250% ### ( 2900, 4400 ] 11 13.750% 90.000% ### ( 4400, 6600 ] 7 8.750% 98.750% ## ( 6600, 9900 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 30.7 total, 3.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 224.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.810 H:M:S, 38.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.420 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/12-06:51:14 ... thread 0: (1000000,8000000) ops and (73908.6,181880.6) ops/second in (13.530224,43.984911) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.34 GB 6.3 7.4 0.0 7.4 14.9 7.6 0.0 2.0 144.2 291.9 52.41 47.50 134 0.391 7674K 11K 0.0 0.0 L1 13/13 1.55 GB 0.0 6.7 5.1 1.7 6.7 5.0 0.1 1.3 224.9 222.0 30.73 29.03 3 10.243 5365K 48K 0.0 0.0 L2 1/0 73.71 MB 0.7 0.1 0.1 0.0 0.1 0.1 3.6 1.8 239.8 239.8 0.46 0.43 1 0.464 113K 27 0.0 0.0 L3 21/0 969.85 MB 1.0 2.9 1.5 1.4 2.9 1.5 2.1 1.9 139.3 138.7 21.25 13.46 26 0.817 2935K 12K 0.0 0.0 L4 173/0 9.49 GB 1.0 1.9 1.7 0.2 1.9 1.7 1.6 1.1 125.2 124.9 15.40 9.08 18 0.856 1958K 5235 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/26 103.59 GB 0.0 19.0 8.3 10.7 26.5 15.8 10.7 3.5 161.9 225.4 120.25 99.49 182 0.661 18M 77K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.0 8.3 10.7 26.5 15.8 10.6 3.5 161.9 225.4 120.25 99.49 182 0.661 18M 77K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.0 8.3 10.7 18.9 8.2 0.0 0.0 201.7 200.5 96.54 80.05 72 1.341 18M 77K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 326.7 23.72 19.44 110 0.216 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.2 total, 44.0 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.46 GB write, 613.01 MB/s write, 19.02 GB read, 440.45 MB/s read, 120.3 seconds Interval compaction: 26.46 GB write, 616.10 MB/s write, 19.02 GB read, 442.67 MB/s read, 120.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 56, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3413133 Average: 2.6560 StdDev: 30.44 Min: 0 Median: 1.5335 Max: 21477 Percentiles: P50: 1.53 P75: 1.91 P99: 6.07 P99.9: 80.69 P99.99: 284.27 ------------------------------------------------------ [ 0, 1 ] 498068 14.593% 14.593% ### ( 1, 2 ] 2265245 66.368% 80.961% ############# ( 2, 3 ] 427802 12.534% 93.495% ### ( 3, 4 ] 104632 3.066% 96.561% # ( 4, 6 ] 82823 2.427% 98.987% ( 6, 10 ] 26389 0.773% 99.761% ( 10, 15 ] 3615 0.106% 99.866% ( 15, 22 ] 876 0.026% 99.892% ( 22, 34 ] 48 0.001% 99.893% ( 34, 51 ] 25 0.001% 99.894% ( 51, 76 ] 66 0.002% 99.896% ( 76, 110 ] 963 0.028% 99.924% ( 110, 170 ] 1678 0.049% 99.974% ( 170, 250 ] 478 0.014% 99.988% ( 250, 380 ] 325 0.010% 99.997% ( 380, 580 ] 343 0.010% 100.007% ( 580, 870 ] 275 0.008% 100.015% ( 870, 1300 ] 133 0.004% 100.019% ( 1300, 1900 ] 69 0.002% 100.021% ( 1900, 2900 ] 43 0.001% 100.022% ( 2900, 4400 ] 61 0.002% 100.024% ( 4400, 6600 ] 26 0.001% 100.025% ( 6600, 9900 ] 3 0.000% 100.025% ( 9900, 14000 ] 1 0.000% 100.025% ( 14000, 22000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1167012 Average: 4.6708 StdDev: 79.26 Min: 0 Median: 1.7588 Max: 18032 Percentiles: P50: 1.76 P75: 2.61 P99: 8.56 P99.9: 14.62 P99.99: 88.23 ------------------------------------------------------ [ 0, 1 ] 120245 10.304% 10.304% ## ( 1, 2 ] 610544 52.317% 62.621% ########## ( 2, 3 ] 236350 20.253% 82.873% #### ( 3, 4 ] 82547 7.073% 89.946% # ( 4, 6 ] 92315 7.910% 97.857% ## ( 6, 10 ] 20837 1.786% 99.642% ( 10, 15 ] 3257 0.279% 99.921% ( 15, 22 ] 465 0.040% 99.961% ( 22, 34 ] 32 0.003% 99.964% ( 34, 51 ] 21 0.002% 99.966% ( 51, 76 ] 55 0.005% 99.971% ( 76, 110 ] 632 0.054% 100.025% ( 110, 170 ] 616 0.053% 100.077% ( 170, 250 ] 253 0.022% 100.099% ( 250, 380 ] 236 0.020% 100.119% ( 380, 580 ] 273 0.023% 100.143% ( 580, 870 ] 258 0.022% 100.165% ( 870, 1300 ] 183 0.016% 100.181% ( 1300, 1900 ] 100 0.009% 100.189% ( 1900, 2900 ] 111 0.010% 100.199% ( 2900, 4400 ] 183 0.016% 100.214% ( 4400, 6600 ] 55 0.005% 100.219% ( 6600, 9900 ] 26 0.002% 100.221% ( 9900, 14000 ] 1 0.000% 100.221% ( 14000, 22000 ] 1 0.000% 100.221% ** Level 2 read latency histogram (micros): Count: 28276 Average: 1.9736 StdDev: 2.86 Min: 0 Median: 1.3921 Max: 311 Percentiles: P50: 1.39 P75: 1.79 P99: 5.31 P99.9: 9.70 P99.99: 176.90 ------------------------------------------------------ [ 0, 1 ] 7163 25.332% 25.332% ##### ( 1, 2 ] 17787 62.905% 88.237% ############# ( 2, 3 ] 2185 7.727% 95.965% ## ( 3, 4 ] 568 2.009% 97.974% ( 4, 6 ] 443 1.567% 99.540% ( 6, 10 ] 110 0.389% 99.929% ( 10, 15 ] 11 0.039% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 432297 Average: 7.7420 StdDev: 101.73 Min: 0 Median: 1.8496 Max: 12016 Percentiles: P50: 1.85 P75: 2.75 P99: 9.82 P99.9: 720.23 P99.99: 1078.16 ------------------------------------------------------ [ 0, 1 ] 18187 4.207% 4.207% # ( 1, 2 ] 233019 53.903% 58.110% ########### ( 2, 3 ] 97733 22.608% 80.717% ##### ( 3, 4 ] 35351 8.177% 88.895% ## ( 4, 6 ] 35287 8.163% 97.058% ## ( 6, 10 ] 8787 2.033% 99.090% ( 10, 15 ] 1234 0.285% 99.376% ( 15, 22 ] 132 0.031% 99.406% ( 22, 34 ] 21 0.005% 99.411% ( 34, 51 ] 10 0.002% 99.413% ( 51, 76 ] 7 0.002% 99.415% ( 76, 110 ] 141 0.033% 99.448% ( 110, 170 ] 400 0.093% 99.540% ( 170, 250 ] 361 0.084% 99.624% ( 250, 380 ] 404 0.093% 99.717% ( 380, 580 ] 547 0.127% 99.844% ( 580, 870 ] 504 0.117% 99.960% ( 870, 1300 ] 266 0.062% 100.022% ( 1300, 1900 ] 118 0.027% 100.049% ( 1900, 2900 ] 82 0.019% 100.068% ( 2900, 4400 ] 99 0.023% 100.091% ( 4400, 6600 ] 25 0.006% 100.097% ( 6600, 9900 ] 16 0.004% 100.100% ( 9900, 14000 ] 1 0.000% 100.101% ** Level 4 read latency histogram (micros): Count: 35903 Average: 27.8735 StdDev: 248.86 Min: 0 Median: 2.0134 Max: 8574 Percentiles: P50: 2.01 P75: 2.95 P99: 748.95 P99.9: 4066.23 P99.99: 7736.00 ------------------------------------------------------ [ 0, 1 ] 689 1.919% 1.919% ( 1, 2 ] 17134 47.723% 49.642% ########## ( 2, 3 ] 9564 26.638% 76.281% ##### ( 3, 4 ] 3522 9.810% 86.090% ## ( 4, 6 ] 3322 9.253% 95.343% ## ( 6, 10 ] 669 1.863% 97.206% ( 10, 15 ] 106 0.295% 97.502% ( 15, 22 ] 14 0.039% 97.541% ( 22, 34 ] 5 0.014% 97.555% ( 34, 51 ] 1 0.003% 97.557% ( 51, 76 ] 5 0.014% 97.571% ( 76, 110 ] 5 0.014% 97.585% ( 110, 170 ] 62 0.173% 97.758% ( 170, 250 ] 93 0.259% 98.017% ( 250, 380 ] 103 0.287% 98.304% ( 380, 580 ] 162 0.451% 98.755% ( 580, 870 ] 151 0.421% 99.176% ( 870, 1300 ] 119 0.331% 99.507% ( 1300, 1900 ] 63 0.175% 99.682% ( 1900, 2900 ] 40 0.111% 99.794% ( 2900, 4400 ] 49 0.136% 99.930% ( 4400, 6600 ] 19 0.053% 99.983% ( 6600, 9900 ] 7 0.019% 100.003% ** Level 5 read latency histogram (micros): Count: 200 Average: 1683.3750 StdDev: 1733.00 Min: 87 Median: 927.3333 Max: 10047 Percentiles: P50: 927.33 P75: 2788.89 P99: 6600.00 P99.9: 10047.00 P99.99: 10047.00 ------------------------------------------------------ ( 76, 110 ] 6 3.000% 3.000% # ( 110, 170 ] 15 7.500% 10.500% ## ( 170, 250 ] 13 6.500% 17.000% # ( 250, 380 ] 27 13.500% 30.500% ### ( 380, 580 ] 21 10.500% 41.000% ## ( 580, 870 ] 16 8.000% 49.000% ## ( 870, 1300 ] 15 7.500% 56.500% ## ( 1300, 1900 ] 13 6.500% 63.000% # ( 1900, 2900 ] 27 13.500% 76.500% ### ( 2900, 4400 ] 32 16.000% 92.500% ### ( 4400, 6600 ] 13 6.500% 99.000% # ( 6600, 9900 ] 1 0.500% 99.500% ( 9900, 14000 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 44.2 total, 13.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 178.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.152 H:M:S, 50.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 72.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.342 H:M:S, 76.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/12-06:51:17 ... thread 0: (1000000,9000000) ops and (321072.7,191085.0) ops/second in (3.114559,47.099470) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.32 GB 119.6 8.3 0.0 8.3 16.8 8.5 0.0 2.0 144.2 292.5 58.96 53.64 151 0.390 8634K 12K 0.0 0.0 L1 13/13 1.55 GB 0.0 6.7 5.1 1.7 6.7 5.0 0.1 1.3 224.9 222.0 30.73 29.03 3 10.243 5365K 48K 0.0 0.0 L2 1/0 73.71 MB 0.7 0.1 0.1 0.0 0.1 0.1 3.6 1.8 239.8 239.8 0.46 0.43 1 0.464 113K 27 0.0 0.0 L3 21/0 969.85 MB 1.0 2.9 1.5 1.4 2.9 1.5 2.1 1.9 139.3 138.7 21.25 13.46 26 0.817 2935K 12K 0.0 0.0 L4 173/0 9.49 GB 1.0 1.9 1.7 0.2 1.9 1.7 1.6 1.1 125.2 124.9 15.40 9.08 18 0.856 1958K 5235 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1311/26 104.57 GB 0.0 19.9 8.3 11.6 28.4 16.8 10.7 3.3 161.0 229.1 126.80 105.63 199 0.637 19M 78K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.9 8.3 11.6 28.4 16.8 10.6 3.3 161.0 229.1 126.80 105.63 199 0.637 19M 78K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.9 8.3 11.6 19.8 8.2 0.0 0.0 203.7 202.5 100.21 83.64 75 1.336 19M 78K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 329.3 26.59 21.99 124 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.3 total, 47.1 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.37 GB write, 613.90 MB/s write, 19.94 GB read, 431.43 MB/s read, 126.8 seconds Interval compaction: 28.37 GB write, 616.80 MB/s write, 19.94 GB read, 433.46 MB/s read, 126.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 60, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3818928 Average: 2.6434 StdDev: 29.12 Min: 0 Median: 1.5422 Max: 21477 Percentiles: P50: 1.54 P75: 1.92 P99: 5.99 P99.9: 21.95 P99.99: 238.48 ------------------------------------------------------ [ 0, 1 ] 533921 13.981% 13.981% ### ( 1, 2 ] 2536805 66.427% 80.408% ############# ( 2, 3 ] 495840 12.984% 93.392% ### ( 3, 4 ] 119544 3.130% 96.522% # ( 4, 6 ] 94959 2.487% 99.009% ( 6, 10 ] 29389 0.770% 99.778% ( 10, 15 ] 3763 0.099% 99.877% ( 15, 22 ] 896 0.023% 99.900% ( 22, 34 ] 51 0.001% 99.902% ( 34, 51 ] 25 0.001% 99.902% ( 51, 76 ] 70 0.002% 99.904% ( 76, 110 ] 1030 0.027% 99.931% ( 110, 170 ] 1797 0.047% 99.978% ( 170, 250 ] 534 0.014% 99.992% ( 250, 380 ] 359 0.009% 100.001% ( 380, 580 ] 374 0.010% 100.011% ( 580, 870 ] 290 0.008% 100.019% ( 870, 1300 ] 145 0.004% 100.023% ( 1300, 1900 ] 72 0.002% 100.025% ( 1900, 2900 ] 47 0.001% 100.026% ( 2900, 4400 ] 62 0.002% 100.027% ( 4400, 6600 ] 26 0.001% 100.028% ( 6600, 9900 ] 3 0.000% 100.028% ( 9900, 14000 ] 1 0.000% 100.028% ( 14000, 22000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1206661 Average: 4.6187 StdDev: 78.00 Min: 0 Median: 1.7558 Max: 18032 Percentiles: P50: 1.76 P75: 2.60 P99: 8.56 P99.9: 14.75 P99.99: 93.49 ------------------------------------------------------ [ 0, 1 ] 122415 10.145% 10.145% ## ( 1, 2 ] 636319 52.734% 62.879% ########### ( 2, 3 ] 244381 20.253% 83.131% #### ( 3, 4 ] 83930 6.956% 90.087% # ( 4, 6 ] 93774 7.771% 97.858% ## ( 6, 10 ] 21518 1.783% 99.642% ( 10, 15 ] 3279 0.272% 99.913% ( 15, 22 ] 465 0.039% 99.952% ( 22, 34 ] 32 0.003% 99.955% ( 34, 51 ] 21 0.002% 99.956% ( 51, 76 ] 56 0.005% 99.961% ( 76, 110 ] 681 0.056% 100.017% ( 110, 170 ] 646 0.054% 100.071% ( 170, 250 ] 273 0.023% 100.094% ( 250, 380 ] 246 0.020% 100.114% ( 380, 580 ] 284 0.024% 100.137% ( 580, 870 ] 264 0.022% 100.159% ( 870, 1300 ] 184 0.015% 100.175% ( 1300, 1900 ] 100 0.008% 100.183% ( 1900, 2900 ] 111 0.009% 100.192% ( 2900, 4400 ] 183 0.015% 100.207% ( 4400, 6600 ] 55 0.005% 100.212% ( 6600, 9900 ] 26 0.002% 100.214% ( 9900, 14000 ] 1 0.000% 100.214% ( 14000, 22000 ] 1 0.000% 100.214% ** Level 2 read latency histogram (micros): Count: 28276 Average: 1.9736 StdDev: 2.86 Min: 0 Median: 1.3921 Max: 311 Percentiles: P50: 1.39 P75: 1.79 P99: 5.31 P99.9: 9.70 P99.99: 176.90 ------------------------------------------------------ [ 0, 1 ] 7163 25.332% 25.332% ##### ( 1, 2 ] 17787 62.905% 88.237% ############# ( 2, 3 ] 2185 7.727% 95.965% ## ( 3, 4 ] 568 2.009% 97.974% ( 4, 6 ] 443 1.567% 99.540% ( 6, 10 ] 110 0.389% 99.929% ( 10, 15 ] 11 0.039% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 432297 Average: 7.7420 StdDev: 101.73 Min: 0 Median: 1.8496 Max: 12016 Percentiles: P50: 1.85 P75: 2.75 P99: 9.82 P99.9: 720.23 P99.99: 1078.16 ------------------------------------------------------ [ 0, 1 ] 18187 4.207% 4.207% # ( 1, 2 ] 233019 53.903% 58.110% ########### ( 2, 3 ] 97733 22.608% 80.717% ##### ( 3, 4 ] 35351 8.177% 88.895% ## ( 4, 6 ] 35287 8.163% 97.058% ## ( 6, 10 ] 8787 2.033% 99.090% ( 10, 15 ] 1234 0.285% 99.376% ( 15, 22 ] 132 0.031% 99.406% ( 22, 34 ] 21 0.005% 99.411% ( 34, 51 ] 10 0.002% 99.413% ( 51, 76 ] 7 0.002% 99.415% ( 76, 110 ] 141 0.033% 99.448% ( 110, 170 ] 400 0.093% 99.540% ( 170, 250 ] 361 0.084% 99.624% ( 250, 380 ] 404 0.093% 99.717% ( 380, 580 ] 547 0.127% 99.844% ( 580, 870 ] 504 0.117% 99.960% ( 870, 1300 ] 266 0.062% 100.022% ( 1300, 1900 ] 118 0.027% 100.049% ( 1900, 2900 ] 82 0.019% 100.068% ( 2900, 4400 ] 99 0.023% 100.091% ( 4400, 6600 ] 25 0.006% 100.097% ( 6600, 9900 ] 16 0.004% 100.100% ( 9900, 14000 ] 1 0.000% 100.101% ** Level 4 read latency histogram (micros): Count: 35903 Average: 27.8735 StdDev: 248.86 Min: 0 Median: 2.0134 Max: 8574 Percentiles: P50: 2.01 P75: 2.95 P99: 748.95 P99.9: 4066.23 P99.99: 7736.00 ------------------------------------------------------ [ 0, 1 ] 689 1.919% 1.919% ( 1, 2 ] 17134 47.723% 49.642% ########## ( 2, 3 ] 9564 26.638% 76.281% ##### ( 3, 4 ] 3522 9.810% 86.090% ## ( 4, 6 ] 3322 9.253% 95.343% ## ( 6, 10 ] 669 1.863% 97.206% ( 10, 15 ] 106 0.295% 97.502% ( 15, 22 ] 14 0.039% 97.541% ( 22, 34 ] 5 0.014% 97.555% ( 34, 51 ] 1 0.003% 97.557% ( 51, 76 ] 5 0.014% 97.571% ( 76, 110 ] 5 0.014% 97.585% ( 110, 170 ] 62 0.173% 97.758% ( 170, 250 ] 93 0.259% 98.017% ( 250, 380 ] 103 0.287% 98.304% ( 380, 580 ] 162 0.451% 98.755% ( 580, 870 ] 151 0.421% 99.176% ( 870, 1300 ] 119 0.331% 99.507% ( 1300, 1900 ] 63 0.175% 99.682% ( 1900, 2900 ] 40 0.111% 99.794% ( 2900, 4400 ] 49 0.136% 99.930% ( 4400, 6600 ] 19 0.053% 99.983% ( 6600, 9900 ] 7 0.019% 100.003% ** Level 5 read latency histogram (micros): Count: 200 Average: 1683.3750 StdDev: 1733.00 Min: 87 Median: 927.3333 Max: 10047 Percentiles: P50: 927.33 P75: 2788.89 P99: 6600.00 P99.9: 10047.00 P99.99: 10047.00 ------------------------------------------------------ ( 76, 110 ] 6 3.000% 3.000% # ( 110, 170 ] 15 7.500% 10.500% ## ( 170, 250 ] 13 6.500% 17.000% # ( 250, 380 ] 27 13.500% 30.500% ### ( 380, 580 ] 21 10.500% 41.000% ## ( 580, 870 ] 16 8.000% 49.000% ## ( 870, 1300 ] 15 7.500% 56.500% ## ( 1300, 1900 ] 13 6.500% 63.000% # ( 1900, 2900 ] 27 13.500% 76.500% ### ( 2900, 4400 ] 32 16.000% 92.500% ### ( 4400, 6600 ] 13 6.500% 99.000% # ( 6600, 9900 ] 1 0.500% 99.500% ( 9900, 14000 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 47.3 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 187.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.612 H:M:S, 47.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.460 H:M:S, 14.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.251 micros/op 159978 ops/sec 60.008 seconds 9599999 operations; 155.0 MB/s Microseconds per write: Count: 9599999 Average: 6.2506 StdDev: 413.84 Min: 1 Median: 1.7503 Max: 861999 Percentiles: P50: 1.75 P75: 2.78 P99: 9.27 P99.9: 1178.01 P99.99: 2690.79 ------------------------------------------------------ [ 0, 1 ] 1191988 12.417% 12.417% ## ( 1, 2 ] 4808477 50.088% 62.505% ########## ( 2, 3 ] 1546366 16.108% 78.613% ### ( 3, 4 ] 1343457 13.994% 92.607% ### ( 4, 6 ] 519477 5.411% 98.018% # ( 6, 10 ] 115347 1.202% 99.220% ( 10, 15 ] 33258 0.346% 99.566% ( 15, 22 ] 7431 0.077% 99.644% ( 22, 34 ] 1184 0.012% 99.656% ( 34, 51 ] 207 0.002% 99.658% ( 51, 76 ] 36 0.000% 99.659% ( 76, 110 ] 6844 0.071% 99.730% ( 110, 170 ] 2487 0.026% 99.756% ( 170, 250 ] 261 0.003% 99.759% ( 250, 380 ] 145 0.002% 99.760% ( 380, 580 ] 28 0.000% 99.760% ( 580, 870 ] 19 0.000% 99.761% ( 870, 1300 ] 18689 0.195% 99.955% ( 1300, 1900 ] 23 0.000% 99.955% ( 1900, 2900 ] 4192 0.044% 99.999% ( 2900, 4400 ] 53 0.001% 100.000% ( 4400, 6600 ] 4 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 186332 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9599999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9907198968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 543 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33325402 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29080597236 rocksdb.compact.write.bytes COUNT : 28880932948 rocksdb.flush.write.bytes COUNT : 9776540983 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 51 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 300 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9697641472 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3703808 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29172164950 rocksdb.non.last.level.read.count COUNT : 7045831 rocksdb.block.checksum.compute.count COUNT : 7044796 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.420415 P95 : 3.924818 P99 : 7.940207 P100 : 861997.000000 COUNT : 9599999 SUM : 55597866 rocksdb.compaction.times.micros P50 : 999642.857143 P95 : 4265000.000000 P99 : 18355422.000000 P100 : 18355422.000000 COUNT : 81 SUM : 130531041 rocksdb.compaction.times.cpu_micros P50 : 865666.666667 P95 : 4230000.000000 P99 : 15147379.000000 P100 : 15147379.000000 COUNT : 81 SUM : 109805169 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 702.402597 P95 : 1258.264706 P99 : 66750.000000 P100 : 185651.000000 COUNT : 133 SUM : 403513 rocksdb.compaction.outfile.sync.micros P50 : 959.382022 P95 : 120636.363636 P99 : 231600.000000 P100 : 282483.000000 COUNT : 361 SUM : 6392739 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.372340 P95 : 1405.000000 P99 : 3641.000000 P100 : 4179.000000 COUNT : 253 SUM : 77924 rocksdb.table.open.io.micros P50 : 1334.375000 P95 : 9526.578947 P99 : 20134.736842 P100 : 22609.000000 COUNT : 543 SUM : 1297715 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.649920 P95 : 7.374837 P99 : 10.962997 P100 : 21487.000000 COUNT : 7043258 SUM : 42644184 rocksdb.read.block.get.micros P50 : 462.666667 P95 : 3901.020408 P99 : 8072.625000 P100 : 11322.000000 COUNT : 1086 SUM : 1015926 rocksdb.write.raw.block.micros P50 : 0.512772 P95 : 0.974267 P99 : 2.918456 P100 : 21764.000000 COUNT : 9365546 SUM : 19068262 rocksdb.numfiles.in.singlecompaction P50 : 3.072368 P95 : 4.150000 P99 : 20.670000 P100 : 34.000000 COUNT : 157 SUM : 576 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562417 P95 : 1159.095707 P99 : 2411.577438 P100 : 861815.000000 COUNT : 206856 SUM : 33343437 rocksdb.sst.read.micros P50 : 1.605113 P95 : 4.374353 P99 : 8.575077 P100 : 21477.000000 COUNT : 7046218 SUM : 28494869 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9599999 SUM : 9907198968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 209565.217391 P95 : 393300.000000 P99 : 764300.000000 P100 : 1049515.000000 COUNT : 133 SUM : 28596615 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 333 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0