[2024-12-05 20:29:52.615799] Starting SPDK v25.01-pre git sha1 e2dfdf06c / DPDK 24.03.0 initialization... [2024-12-05 20:29:52.615963] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid745469 ] Set seed to 1733426992612248 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-05 20:29:52.753240] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-05 20:29:52.861038] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-05 20:29:52.861097] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 745469' to capture a snapshot of events at runtime. [2024-12-05 20:29:52.861111] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-05 20:29:52.861124] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-05 20:29:52.861134] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid745469 for offline analysis/debug. [2024-12-05 20:29:52.862497] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Dec 5 20:29:55 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/05-20:29:58 ... thread 0: (1000000,1000000) ops and (333817.1,333817.1) ops/second in (2.995652,2.995652) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 503.29 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 350.8 2.51 2.34 13 0.193 0 0 0.0 0.0 L1 1/0 12.45 MB 1.2 0.2 0.2 0.0 0.2 0.2 0.1 1.0 245.5 244.5 1.02 1.00 1 1.024 255K 1006 0.0 0.0 L2 3/2 278.92 MB 1.3 0.3 0.1 0.1 0.3 0.1 0.3 2.1 243.4 243.0 1.06 1.03 2 0.531 262K 426 0.0 0.0 L3 16/16 749.24 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 213.8 213.8 0.56 0.54 1 0.558 121K 0 0.0 0.0 L4 124/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 116/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 268/23 20.09 GB 0.0 0.6 0.5 0.1 1.5 1.3 1.0 1.7 122.1 292.6 5.15 4.91 17 0.303 638K 1432 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.5 0.1 1.5 1.3 1.0 1.7 122.1 292.6 5.15 4.91 17 0.303 638K 1432 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.5 0.1 0.6 0.5 0.0 0.0 238.0 237.4 2.64 2.57 4 0.661 638K 1432 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 350.8 2.51 2.34 13 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.47 GB write, 490.31 MB/s write, 0.61 GB read, 204.52 MB/s read, 5.2 seconds Interval compaction: 1.47 GB write, 502.99 MB/s write, 0.61 GB read, 209.81 MB/s read, 5.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 139736 Average: 2.0843 StdDev: 5.19 Min: 0 Median: 1.4171 Max: 1147 Percentiles: P50: 1.42 P75: 1.82 P99: 5.93 P99.9: 12.81 P99.99: 51.13 ------------------------------------------------------ [ 0, 1 ] 33747 24.151% 24.151% ##### ( 1, 2 ] 86605 61.978% 86.128% ############ ( 2, 3 ] 11425 8.176% 94.304% ## ( 3, 4 ] 4137 2.961% 97.265% # ( 4, 6 ] 2521 1.804% 99.069% ( 6, 10 ] 1040 0.744% 99.813% ( 10, 15 ] 219 0.157% 99.970% ( 15, 22 ] 22 0.016% 99.986% ( 22, 34 ] 5 0.004% 99.989% ( 34, 51 ] 3 0.002% 99.991% ( 51, 76 ] 5 0.004% 99.995% ( 170, 250 ] 12 0.009% 100.004% ( 250, 380 ] 9 0.006% 100.010% ( 380, 580 ] 4 0.003% 100.013% ( 870, 1300 ] 1 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 10897 Average: 3.8877 StdDev: 59.96 Min: 1 Median: 1.3546 Max: 5306 Percentiles: P50: 1.35 P75: 1.77 P99: 12.09 P99.9: 241.02 P99.99: 2810.20 ------------------------------------------------------ [ 0, 1 ] 3145 28.861% 28.861% ###### ( 1, 2 ] 6497 59.622% 88.483% ############ ( 2, 3 ] 534 4.900% 93.384% # ( 3, 4 ] 216 1.982% 95.366% ( 4, 6 ] 255 2.340% 97.706% ( 6, 10 ] 119 1.092% 98.798% ( 10, 15 ] 55 0.505% 99.303% ( 15, 22 ] 4 0.037% 99.339% ( 76, 110 ] 36 0.330% 99.670% ( 110, 170 ] 19 0.174% 99.844% ( 170, 250 ] 8 0.073% 99.917% ( 250, 380 ] 1 0.009% 99.927% ( 380, 580 ] 3 0.028% 99.954% ( 580, 870 ] 3 0.028% 99.982% ( 870, 1300 ] 1 0.009% 99.991% ( 1900, 2900 ] 1 0.009% 100.000% ( 4400, 6600 ] 1 0.009% 100.009% ** Level 2 read latency histogram (micros): Count: 55648 Average: 2.1721 StdDev: 4.04 Min: 1 Median: 1.4712 Max: 561 Percentiles: P50: 1.47 P75: 1.87 P99: 7.34 P99.9: 14.26 P99.99: 153.06 ------------------------------------------------------ [ 0, 1 ] 11333 20.366% 20.366% #### ( 1, 2 ] 34996 62.888% 83.254% ############# ( 2, 3 ] 5483 9.853% 93.107% ## ( 3, 4 ] 1776 3.191% 96.298% # ( 4, 6 ] 1323 2.377% 98.676% ( 6, 10 ] 539 0.969% 99.644% ( 10, 15 ] 167 0.300% 99.944% ( 15, 22 ] 15 0.027% 99.971% ( 22, 34 ] 6 0.011% 99.982% ( 34, 51 ] 2 0.004% 99.986% ( 51, 76 ] 1 0.002% 99.987% ( 110, 170 ] 2 0.004% 99.991% ( 170, 250 ] 2 0.004% 99.995% ( 380, 580 ] 3 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 12298 Average: 14.8563 StdDev: 190.62 Min: 0 Median: 1.8596 Max: 5150 Percentiles: P50: 1.86 P75: 2.78 P99: 20.69 P99.9: 2327.45 P99.99: 3347.21 ------------------------------------------------------ [ 0, 1 ] 456 3.708% 3.708% # ( 1, 2 ] 6623 53.854% 57.562% ########### ( 2, 3 ] 2737 22.256% 79.818% #### ( 3, 4 ] 1035 8.416% 88.234% ## ( 4, 6 ] 891 7.245% 95.479% # ( 6, 10 ] 287 2.334% 97.813% ( 10, 15 ] 120 0.976% 98.788% ( 15, 22 ] 32 0.260% 99.049% ( 22, 34 ] 2 0.016% 99.065% ( 34, 51 ] 2 0.016% 99.081% ( 51, 76 ] 1 0.008% 99.089% ( 76, 110 ] 13 0.106% 99.195% ( 110, 170 ] 33 0.268% 99.463% ( 170, 250 ] 15 0.122% 99.585% ( 250, 380 ] 11 0.089% 99.675% ( 380, 580 ] 9 0.073% 99.748% ( 580, 870 ] 3 0.024% 99.772% ( 870, 1300 ] 5 0.041% 99.813% ( 1300, 1900 ] 6 0.049% 99.862% ( 1900, 2900 ] 11 0.089% 99.951% ( 2900, 4400 ] 16 0.130% 100.081% ( 4400, 6600 ] 6 0.049% 100.130% ** Level 4 read latency histogram (micros): Count: 15 Average: 3333.5333 StdDev: 1421.57 Min: 1672 Median: 2800.0000 Max: 5952 Percentiles: P50: 2800.00 P75: 4950.00 P99: 5952.00 P99.9: 5952.00 P99.99: 5952.00 ------------------------------------------------------ ( 1300, 1900 ] 3 20.000% 20.000% #### ( 1900, 2900 ] 5 33.333% 53.333% ####### ( 2900, 4400 ] 2 13.333% 66.667% ### ( 4400, 6600 ] 5 33.333% 100.000% ####### ** Level 5 read latency histogram (micros): Count: 20 Average: 391.2500 StdDev: 466.96 Min: 105 Median: 156.6667 Max: 1891 Percentiles: P50: 156.67 P75: 380.00 P99: 1780.00 P99.9: 1888.00 P99.99: 1891.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 9 45.000% 60.000% ######### ( 250, 380 ] 3 15.000% 75.000% ### ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 319.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.156 H:M:S, 5.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.156 H:M:S, 5.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/05-20:30:01 ... thread 0: (1000000,2000000) ops and (317186.7,325289.5) ops/second in (3.152717,6.148369) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.47 GB 125.2 1.0 0.0 1.0 2.9 1.8 0.0 1.6 112.1 309.3 9.54 9.06 33 0.289 1086K 5797 0.0 0.0 L1 1/0 12.45 MB 1.2 0.2 0.2 0.0 0.2 0.2 0.1 1.0 245.5 244.5 1.02 1.00 1 1.024 255K 1006 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.3 2.1 243.4 243.0 1.06 1.03 2 0.531 262K 426 0.0 0.0 L3 15/0 966.65 MB 1.0 1.1 0.4 0.7 1.1 0.4 0.0 2.8 221.9 220.9 4.98 4.81 4 1.245 1122K 4901 0.0 0.0 L4 130/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 202.3 202.3 0.28 0.26 1 0.280 57K 0 0.0 0.0 L5 116/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 273/4 21.06 GB 0.0 2.7 0.8 1.9 4.5 2.6 1.0 2.4 162.3 273.4 16.89 16.17 41 0.412 2783K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.7 0.8 1.9 4.5 2.6 1.0 2.4 162.3 273.4 16.89 16.17 41 0.412 2783K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.7 0.8 1.9 2.7 0.8 0.0 0.0 237.7 236.7 11.53 11.22 12 0.961 2783K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.3 5.36 4.95 29 0.185 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.2 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.51 GB write, 741.07 MB/s write, 2.68 GB read, 440.05 MB/s read, 16.9 seconds Interval compaction: 4.51 GB write, 750.41 MB/s write, 2.68 GB read, 445.60 MB/s read, 16.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 405998 Average: 2.3436 StdDev: 5.80 Min: 0 Median: 1.5779 Max: 1147 Percentiles: P50: 1.58 P75: 1.97 P99: 6.09 P99.9: 13.14 P99.99: 21.27 ------------------------------------------------------ [ 0, 1 ] 54747 13.485% 13.485% ### ( 1, 2 ] 256532 63.186% 76.670% ############# ( 2, 3 ] 57854 14.250% 90.920% ### ( 3, 4 ] 19491 4.801% 95.721% # ( 4, 6 ] 13245 3.262% 98.983% # ( 6, 10 ] 3231 0.796% 99.779% ( 10, 15 ] 784 0.193% 99.972% ( 15, 22 ] 83 0.020% 99.992% ( 22, 34 ] 14 0.003% 99.996% ( 34, 51 ] 4 0.001% 99.997% ( 51, 76 ] 9 0.002% 99.999% ( 170, 250 ] 27 0.007% 100.006% ( 250, 380 ] 12 0.003% 100.009% ( 380, 580 ] 18 0.004% 100.013% ( 580, 870 ] 3 0.001% 100.014% ( 870, 1300 ] 6 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 69297 Average: 2.8751 StdDev: 23.82 Min: 1 Median: 1.7355 Max: 5306 Percentiles: P50: 1.74 P75: 2.47 P99: 8.43 P99.9: 80.32 P99.99: 518.02 ------------------------------------------------------ [ 0, 1 ] 4684 6.759% 6.759% # ( 1, 2 ] 40740 58.790% 65.550% ############ ( 2, 3 ] 13895 20.051% 85.601% #### ( 3, 4 ] 4851 7.000% 92.601% # ( 4, 6 ] 3896 5.622% 98.224% # ( 6, 10 ] 887 1.280% 99.504% ( 10, 15 ] 230 0.332% 99.835% ( 15, 22 ] 32 0.046% 99.882% ( 22, 34 ] 5 0.007% 99.889% ( 34, 51 ] 1 0.001% 99.890% ( 51, 76 ] 2 0.003% 99.893% ( 76, 110 ] 37 0.053% 99.947% ( 110, 170 ] 19 0.027% 99.974% ( 170, 250 ] 8 0.012% 99.986% ( 250, 380 ] 1 0.001% 99.987% ( 380, 580 ] 3 0.004% 99.991% ( 580, 870 ] 3 0.004% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 65516 Average: 2.3242 StdDev: 6.59 Min: 1 Median: 1.5021 Max: 590 Percentiles: P50: 1.50 P75: 1.90 P99: 7.70 P99.9: 16.96 P99.99: 368.05 ------------------------------------------------------ [ 0, 1 ] 12073 18.428% 18.428% #### ( 1, 2 ] 41200 62.885% 81.313% ############# ( 2, 3 ] 7554 11.530% 92.843% ## ( 3, 4 ] 2122 3.239% 96.082% # ( 4, 6 ] 1607 2.453% 98.535% ( 6, 10 ] 716 1.093% 99.628% ( 10, 15 ] 174 0.266% 99.893% ( 15, 22 ] 16 0.024% 99.918% ( 22, 34 ] 6 0.009% 99.927% ( 34, 51 ] 2 0.003% 99.930% ( 51, 76 ] 1 0.002% 99.931% ( 110, 170 ] 23 0.035% 99.966% ( 170, 250 ] 10 0.015% 99.982% ( 250, 380 ] 6 0.009% 99.991% ( 380, 580 ] 5 0.008% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 193956 Average: 3.6416 StdDev: 48.62 Min: 0 Median: 1.7556 Max: 5150 Percentiles: P50: 1.76 P75: 2.48 P99: 9.56 P99.9: 126.88 P99.99: 556.04 ------------------------------------------------------ [ 0, 1 ] 8603 4.436% 4.436% # ( 1, 2 ] 116959 60.302% 64.737% ############ ( 2, 3 ] 41148 21.215% 85.952% #### ( 3, 4 ] 12146 6.262% 92.215% # ( 4, 6 ] 9639 4.970% 97.184% # ( 6, 10 ] 3958 2.041% 99.225% ( 10, 15 ] 793 0.409% 99.634% ( 15, 22 ] 113 0.058% 99.692% ( 22, 34 ] 10 0.005% 99.697% ( 34, 51 ] 198 0.102% 99.799% ( 51, 76 ] 96 0.049% 99.849% ( 76, 110 ] 65 0.034% 99.882% ( 110, 170 ] 121 0.062% 99.945% ( 170, 250 ] 49 0.025% 99.970% ( 250, 380 ] 21 0.011% 99.981% ( 380, 580 ] 20 0.010% 99.991% ( 580, 870 ] 8 0.004% 99.995% ( 870, 1300 ] 5 0.003% 99.998% ( 1300, 1900 ] 6 0.003% 100.001% ( 1900, 2900 ] 11 0.006% 100.007% ( 2900, 4400 ] 16 0.008% 100.015% ( 4400, 6600 ] 6 0.003% 100.018% ** Level 4 read latency histogram (micros): Count: 45 Average: 1120.5778 StdDev: 1767.35 Min: 1 Median: 8.8000 Max: 5952 Percentiles: P50: 8.80 P75: 2050.00 P99: 5952.00 P99.9: 5952.00 P99.99: 5952.00 ------------------------------------------------------ [ 0, 1 ] 6 13.333% 13.333% ### ( 1, 2 ] 9 20.000% 33.333% #### ( 2, 3 ] 3 6.667% 40.000% # ( 3, 4 ] 1 2.222% 42.222% ( 6, 10 ] 5 11.111% 53.333% ## ( 15, 22 ] 4 8.889% 62.222% ## ( 22, 34 ] 1 2.222% 64.444% ( 250, 380 ] 1 2.222% 66.667% ( 1300, 1900 ] 3 6.667% 73.333% # ( 1900, 2900 ] 5 11.111% 84.444% ## ( 2900, 4400 ] 2 4.444% 88.889% # ( 4400, 6600 ] 5 11.111% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 391.2500 StdDev: 466.96 Min: 105 Median: 156.6667 Max: 1891 Percentiles: P50: 156.67 P75: 380.00 P99: 1780.00 P99.9: 1888.00 P99.99: 1891.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 9 45.000% 60.000% ######### ( 250, 380 ] 3 15.000% 75.000% ### ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 316.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.156 H:M:S, 2.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 312.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/05-20:30:05 ... thread 0: (1000000,3000000) ops and (311928.2,320710.4) ops/second in (3.205866,9.354235) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 2.39 GB 18.9 1.8 0.0 1.8 4.5 2.8 0.0 1.6 118.1 300.7 15.45 14.70 50 0.309 1852K 9447 0.0 0.0 L1 1/1 12.45 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 245.5 244.5 1.02 1.00 1 1.024 255K 1006 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.3 2.1 243.4 243.0 1.06 1.03 2 0.531 262K 426 0.0 0.0 L3 15/0 966.65 MB 1.0 1.1 0.4 0.7 1.1 0.4 0.0 2.8 221.9 220.9 4.98 4.81 4 1.245 1122K 4901 0.0 0.0 L4 130/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 202.3 202.3 0.28 0.26 1 0.280 57K 0 0.0 0.0 L5 116/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 278/15 21.98 GB 0.0 3.4 0.8 2.6 6.2 3.6 1.0 2.2 153.4 276.9 22.79 21.82 58 0.393 3550K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.4 0.8 2.6 6.2 3.6 1.0 2.2 153.4 276.9 22.79 21.82 58 0.393 3550K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.4 0.8 2.6 3.4 0.8 0.0 0.0 239.5 238.4 14.60 14.21 15 0.973 3550K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 345.5 8.19 7.61 43 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.4 total, 9.4 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.16 GB write, 668.88 MB/s write, 3.41 GB read, 370.54 MB/s read, 22.8 seconds Interval compaction: 6.16 GB write, 674.42 MB/s write, 3.41 GB read, 373.61 MB/s read, 22.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 647445 Average: 2.2672 StdDev: 6.41 Min: 0 Median: 1.5158 Max: 1264 Percentiles: P50: 1.52 P75: 1.90 P99: 5.94 P99.9: 13.80 P99.99: 154.47 ------------------------------------------------------ [ 0, 1 ] 108917 16.823% 16.823% ### ( 1, 2 ] 416490 64.328% 81.151% ############# ( 2, 3 ] 76014 11.741% 92.891% ## ( 3, 4 ] 24612 3.801% 96.693% # ( 4, 6 ] 15374 2.375% 99.067% ( 6, 10 ] 4527 0.699% 99.767% ( 10, 15 ] 1138 0.176% 99.942% ( 15, 22 ] 130 0.020% 99.962% ( 22, 34 ] 21 0.003% 99.966% ( 34, 51 ] 6 0.001% 99.967% ( 51, 76 ] 11 0.002% 99.968% ( 76, 110 ] 36 0.006% 99.974% ( 110, 170 ] 142 0.022% 99.996% ( 170, 250 ] 51 0.008% 100.004% ( 250, 380 ] 27 0.004% 100.008% ( 380, 580 ] 23 0.004% 100.011% ( 580, 870 ] 8 0.001% 100.013% ( 870, 1300 ] 9 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 69298 Average: 2.8766 StdDev: 23.82 Min: 1 Median: 1.7355 Max: 5306 Percentiles: P50: 1.74 P75: 2.47 P99: 8.43 P99.9: 81.10 P99.99: 518.01 ------------------------------------------------------ [ 0, 1 ] 4684 6.759% 6.759% # ( 1, 2 ] 40740 58.790% 65.549% ############ ( 2, 3 ] 13895 20.051% 85.600% #### ( 3, 4 ] 4851 7.000% 92.600% # ( 4, 6 ] 3896 5.622% 98.222% # ( 6, 10 ] 887 1.280% 99.502% ( 10, 15 ] 230 0.332% 99.834% ( 15, 22 ] 32 0.046% 99.880% ( 22, 34 ] 5 0.007% 99.887% ( 34, 51 ] 1 0.001% 99.889% ( 51, 76 ] 2 0.003% 99.892% ( 76, 110 ] 38 0.055% 99.947% ( 110, 170 ] 19 0.027% 99.974% ( 170, 250 ] 8 0.012% 99.986% ( 250, 380 ] 1 0.001% 99.987% ( 380, 580 ] 3 0.004% 99.991% ( 580, 870 ] 3 0.004% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 65516 Average: 2.3242 StdDev: 6.59 Min: 1 Median: 1.5021 Max: 590 Percentiles: P50: 1.50 P75: 1.90 P99: 7.70 P99.9: 16.96 P99.99: 368.05 ------------------------------------------------------ [ 0, 1 ] 12073 18.428% 18.428% #### ( 1, 2 ] 41200 62.885% 81.313% ############# ( 2, 3 ] 7554 11.530% 92.843% ## ( 3, 4 ] 2122 3.239% 96.082% # ( 4, 6 ] 1607 2.453% 98.535% ( 6, 10 ] 716 1.093% 99.628% ( 10, 15 ] 174 0.266% 99.893% ( 15, 22 ] 16 0.024% 99.918% ( 22, 34 ] 6 0.009% 99.927% ( 34, 51 ] 2 0.003% 99.930% ( 51, 76 ] 1 0.002% 99.931% ( 110, 170 ] 23 0.035% 99.966% ( 170, 250 ] 10 0.015% 99.982% ( 250, 380 ] 6 0.009% 99.991% ( 380, 580 ] 5 0.008% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 193956 Average: 3.6416 StdDev: 48.62 Min: 0 Median: 1.7556 Max: 5150 Percentiles: P50: 1.76 P75: 2.48 P99: 9.56 P99.9: 126.88 P99.99: 556.04 ------------------------------------------------------ [ 0, 1 ] 8603 4.436% 4.436% # ( 1, 2 ] 116959 60.302% 64.737% ############ ( 2, 3 ] 41148 21.215% 85.952% #### ( 3, 4 ] 12146 6.262% 92.215% # ( 4, 6 ] 9639 4.970% 97.184% # ( 6, 10 ] 3958 2.041% 99.225% ( 10, 15 ] 793 0.409% 99.634% ( 15, 22 ] 113 0.058% 99.692% ( 22, 34 ] 10 0.005% 99.697% ( 34, 51 ] 198 0.102% 99.799% ( 51, 76 ] 96 0.049% 99.849% ( 76, 110 ] 65 0.034% 99.882% ( 110, 170 ] 121 0.062% 99.945% ( 170, 250 ] 49 0.025% 99.970% ( 250, 380 ] 21 0.011% 99.981% ( 380, 580 ] 20 0.010% 99.991% ( 580, 870 ] 8 0.004% 99.995% ( 870, 1300 ] 5 0.003% 99.998% ( 1300, 1900 ] 6 0.003% 100.001% ( 1900, 2900 ] 11 0.006% 100.007% ( 2900, 4400 ] 16 0.008% 100.015% ( 4400, 6600 ] 6 0.003% 100.018% ** Level 4 read latency histogram (micros): Count: 45 Average: 1120.5778 StdDev: 1767.35 Min: 1 Median: 8.8000 Max: 5952 Percentiles: P50: 8.80 P75: 2050.00 P99: 5952.00 P99.9: 5952.00 P99.99: 5952.00 ------------------------------------------------------ [ 0, 1 ] 6 13.333% 13.333% ### ( 1, 2 ] 9 20.000% 33.333% #### ( 2, 3 ] 3 6.667% 40.000% # ( 3, 4 ] 1 2.222% 42.222% ( 6, 10 ] 5 11.111% 53.333% ## ( 15, 22 ] 4 8.889% 62.222% ## ( 22, 34 ] 1 2.222% 64.444% ( 250, 380 ] 1 2.222% 66.667% ( 1300, 1900 ] 3 6.667% 73.333% # ( 1900, 2900 ] 5 11.111% 84.444% ## ( 2900, 4400 ] 2 4.444% 88.889% # ( 4400, 6600 ] 5 11.111% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 391.2500 StdDev: 466.96 Min: 105 Median: 156.6667 Max: 1891 Percentiles: P50: 156.67 P75: 380.00 P99: 1780.00 P99.9: 1888.00 P99.99: 1891.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 9 45.000% 60.000% ######### ( 250, 380 ] 3 15.000% 75.000% ### ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.4 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 312.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.502 H:M:S, 5.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 307.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.346 H:M:S, 10.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/05-20:30:09 ... thread 0: (1000000,4000000) ops and (217954.9,286895.9) ops/second in (4.588105,13.942340) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.42 GB 150.3 3.0 0.0 3.0 6.8 3.8 0.0 1.8 130.4 294.7 23.64 22.59 72 0.328 3130K 15K 0.0 0.0 L1 1/1 12.45 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 245.5 244.5 1.02 1.00 1 1.024 255K 1006 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.3 2.1 243.4 243.0 1.06 1.03 2 0.531 262K 426 0.0 0.0 L3 15/0 966.65 MB 1.0 1.1 0.4 0.7 1.1 0.4 0.0 2.8 221.9 220.9 4.98 4.81 4 1.245 1122K 4901 0.0 0.0 L4 130/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 202.3 202.3 0.28 0.26 1 0.280 57K 0 0.0 0.0 L5 116/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 280/11 23.01 GB 0.0 4.6 0.8 3.8 8.4 4.6 1.0 2.2 153.4 278.6 30.98 29.70 80 0.387 4828K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 0.8 3.8 8.4 4.6 1.0 2.2 153.4 278.6 30.98 29.70 80 0.387 4828K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 0.8 3.8 4.6 0.8 0.0 0.0 239.9 238.8 19.82 19.33 20 0.991 4828K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 349.2 11.17 10.37 60 0.186 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.0 total, 13.9 interval Flush(GB): cumulative 3.809, interval 3.809 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.43 GB write, 615.58 MB/s write, 4.64 GB read, 339.03 MB/s read, 31.0 seconds Interval compaction: 8.43 GB write, 619.00 MB/s write, 4.64 GB read, 340.92 MB/s read, 31.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 6, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1210096 Average: 2.3473 StdDev: 7.04 Min: 0 Median: 1.5548 Max: 2063 Percentiles: P50: 1.55 P75: 1.94 P99: 6.05 P99.9: 13.54 P99.99: 136.35 ------------------------------------------------------ [ 0, 1 ] 167065 13.806% 13.806% ### ( 1, 2 ] 789454 65.239% 79.045% ############# ( 2, 3 ] 167924 13.877% 92.922% ### ( 3, 4 ] 45034 3.722% 96.643% # ( 4, 6 ] 28403 2.347% 98.990% ( 6, 10 ] 9753 0.806% 99.796% ( 10, 15 ] 1772 0.146% 99.943% ( 15, 22 ] 181 0.015% 99.958% ( 22, 34 ] 36 0.003% 99.961% ( 34, 51 ] 7 0.001% 99.961% ( 51, 76 ] 13 0.001% 99.962% ( 76, 110 ] 131 0.011% 99.973% ( 110, 170 ] 460 0.038% 100.011% ( 170, 250 ] 108 0.009% 100.020% ( 250, 380 ] 51 0.004% 100.024% ( 380, 580 ] 40 0.003% 100.028% ( 580, 870 ] 19 0.002% 100.029% ( 870, 1300 ] 14 0.001% 100.030% ( 1300, 1900 ] 1 0.000% 100.031% ( 1900, 2900 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 69298 Average: 2.8766 StdDev: 23.82 Min: 1 Median: 1.7355 Max: 5306 Percentiles: P50: 1.74 P75: 2.47 P99: 8.43 P99.9: 81.10 P99.99: 518.01 ------------------------------------------------------ [ 0, 1 ] 4684 6.759% 6.759% # ( 1, 2 ] 40740 58.790% 65.549% ############ ( 2, 3 ] 13895 20.051% 85.600% #### ( 3, 4 ] 4851 7.000% 92.600% # ( 4, 6 ] 3896 5.622% 98.222% # ( 6, 10 ] 887 1.280% 99.502% ( 10, 15 ] 230 0.332% 99.834% ( 15, 22 ] 32 0.046% 99.880% ( 22, 34 ] 5 0.007% 99.887% ( 34, 51 ] 1 0.001% 99.889% ( 51, 76 ] 2 0.003% 99.892% ( 76, 110 ] 38 0.055% 99.947% ( 110, 170 ] 19 0.027% 99.974% ( 170, 250 ] 8 0.012% 99.986% ( 250, 380 ] 1 0.001% 99.987% ( 380, 580 ] 3 0.004% 99.991% ( 580, 870 ] 3 0.004% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 65516 Average: 2.3242 StdDev: 6.59 Min: 1 Median: 1.5021 Max: 590 Percentiles: P50: 1.50 P75: 1.90 P99: 7.70 P99.9: 16.96 P99.99: 368.05 ------------------------------------------------------ [ 0, 1 ] 12073 18.428% 18.428% #### ( 1, 2 ] 41200 62.885% 81.313% ############# ( 2, 3 ] 7554 11.530% 92.843% ## ( 3, 4 ] 2122 3.239% 96.082% # ( 4, 6 ] 1607 2.453% 98.535% ( 6, 10 ] 716 1.093% 99.628% ( 10, 15 ] 174 0.266% 99.893% ( 15, 22 ] 16 0.024% 99.918% ( 22, 34 ] 6 0.009% 99.927% ( 34, 51 ] 2 0.003% 99.930% ( 51, 76 ] 1 0.002% 99.931% ( 110, 170 ] 23 0.035% 99.966% ( 170, 250 ] 10 0.015% 99.982% ( 250, 380 ] 6 0.009% 99.991% ( 380, 580 ] 5 0.008% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 193956 Average: 3.6416 StdDev: 48.62 Min: 0 Median: 1.7556 Max: 5150 Percentiles: P50: 1.76 P75: 2.48 P99: 9.56 P99.9: 126.88 P99.99: 556.04 ------------------------------------------------------ [ 0, 1 ] 8603 4.436% 4.436% # ( 1, 2 ] 116959 60.302% 64.737% ############ ( 2, 3 ] 41148 21.215% 85.952% #### ( 3, 4 ] 12146 6.262% 92.215% # ( 4, 6 ] 9639 4.970% 97.184% # ( 6, 10 ] 3958 2.041% 99.225% ( 10, 15 ] 793 0.409% 99.634% ( 15, 22 ] 113 0.058% 99.692% ( 22, 34 ] 10 0.005% 99.697% ( 34, 51 ] 198 0.102% 99.799% ( 51, 76 ] 96 0.049% 99.849% ( 76, 110 ] 65 0.034% 99.882% ( 110, 170 ] 121 0.062% 99.945% ( 170, 250 ] 49 0.025% 99.970% ( 250, 380 ] 21 0.011% 99.981% ( 380, 580 ] 20 0.010% 99.991% ( 580, 870 ] 8 0.004% 99.995% ( 870, 1300 ] 5 0.003% 99.998% ( 1300, 1900 ] 6 0.003% 100.001% ( 1900, 2900 ] 11 0.006% 100.007% ( 2900, 4400 ] 16 0.008% 100.015% ( 4400, 6600 ] 6 0.003% 100.018% ** Level 4 read latency histogram (micros): Count: 45 Average: 1120.5778 StdDev: 1767.35 Min: 1 Median: 8.8000 Max: 5952 Percentiles: P50: 8.80 P75: 2050.00 P99: 5952.00 P99.9: 5952.00 P99.99: 5952.00 ------------------------------------------------------ [ 0, 1 ] 6 13.333% 13.333% ### ( 1, 2 ] 9 20.000% 33.333% #### ( 2, 3 ] 3 6.667% 40.000% # ( 3, 4 ] 1 2.222% 42.222% ( 6, 10 ] 5 11.111% 53.333% ## ( 15, 22 ] 4 8.889% 62.222% ## ( 22, 34 ] 1 2.222% 64.444% ( 250, 380 ] 1 2.222% 66.667% ( 1300, 1900 ] 3 6.667% 73.333% # ( 1900, 2900 ] 5 11.111% 84.444% ## ( 2900, 4400 ] 2 4.444% 88.889% # ( 4400, 6600 ] 5 11.111% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 391.2500 StdDev: 466.96 Min: 105 Median: 156.6667 Max: 1891 Percentiles: P50: 156.67 P75: 380.00 P99: 1780.00 P99.9: 1888.00 P99.99: 1891.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 9 45.000% 60.000% ######### ( 250, 380 ] 3 15.000% 75.000% ### ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 14.0 total, 4.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 280.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.244 H:M:S, 16.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 214.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.742 H:M:S, 38.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.053 micros/op 246743 ops/sec 20.001 seconds 4934999 operations; 239.1 MB/s Microseconds per write: Count: 4934999 Average: 4.0528 StdDev: 284.10 Min: 1 Median: 1.8034 Max: 514042 Percentiles: P50: 1.80 P75: 3.18 P99: 8.95 P99.9: 150.93 P99.99: 2326.86 ------------------------------------------------------ [ 0, 1 ] 647301 13.117% 13.117% ### ( 1, 2 ] 2265746 45.912% 59.028% ######### ( 2, 3 ] 661895 13.412% 72.441% ### ( 3, 4 ] 707198 14.330% 86.771% ### ( 4, 6 ] 539831 10.939% 97.710% ## ( 6, 10 ] 86224 1.747% 99.457% ( 10, 15 ] 13558 0.275% 99.732% ( 15, 22 ] 3837 0.078% 99.809% ( 22, 34 ] 1095 0.022% 99.832% ( 34, 51 ] 190 0.004% 99.835% ( 51, 76 ] 41 0.001% 99.836% ( 76, 110 ] 13 0.000% 99.836% ( 110, 170 ] 4596 0.093% 99.930% ( 170, 250 ] 327 0.007% 99.936% ( 250, 380 ] 61 0.001% 99.937% ( 380, 580 ] 14 0.000% 99.938% ( 580, 870 ] 12 0.000% 99.938% ( 870, 1300 ] 2257 0.046% 99.984% ( 1300, 1900 ] 6 0.000% 99.984% ( 1900, 2900 ] 711 0.014% 99.998% ( 2900, 4400 ] 66 0.001% 100.000% ( 4400, 6600 ] 6 0.000% 100.000% ( 6600, 9900 ] 7 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 230622 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4934999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5092918968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 188 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5022358 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 11475376390 rocksdb.compact.write.bytes COUNT : 11237381805 rocksdb.flush.write.bytes COUNT : 4946991866 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 18 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 82 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4914333696 rocksdb.memtable.garbage.bytes.at.flush COUNT : 8534016 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 11477603856 rocksdb.non.last.level.read.count COUNT : 2774302 rocksdb.block.checksum.compute.count COUNT : 2783719 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.467693 P95 : 4.932355 P99 : 7.647725 P100 : 514034.000000 COUNT : 4934999 SUM : 17656843 rocksdb.compaction.times.micros P50 : 1030000.000000 P95 : 3390000.000000 P99 : 8711000.000000 P100 : 8930146.000000 COUNT : 33 SUM : 40845531 rocksdb.compaction.times.cpu_micros P50 : 916666.666667 P95 : 2250000.000000 P99 : 8602406.000000 P100 : 8602406.000000 COUNT : 33 SUM : 36853854 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 685.454545 P95 : 1290.076923 P99 : 7524.000000 P100 : 8212.000000 COUNT : 72 SUM : 59704 rocksdb.compaction.outfile.sync.micros P50 : 775.306122 P95 : 5280.000000 P99 : 7654.000000 P100 : 7654.000000 COUNT : 108 SUM : 153542 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 96.400000 P95 : 307.200000 P99 : 1804.000000 P100 : 3887.000000 COUNT : 116 SUM : 18198 rocksdb.table.open.io.micros P50 : 835.882353 P95 : 12360.000000 P99 : 17674.000000 P100 : 17674.000000 COUNT : 188 SUM : 418529 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.859830 P95 : 8.540896 P99 : 12.788097 P100 : 16368.000000 COUNT : 2783522 SUM : 17881374 rocksdb.read.block.get.micros P50 : 376.854839 P95 : 3888.235294 P99 : 5963.692308 P100 : 6092.000000 COUNT : 376 SUM : 298493 rocksdb.write.raw.block.micros P50 : 0.518268 P95 : 0.984708 P99 : 3.332931 P100 : 21784.000000 COUNT : 3925242 SUM : 9316204 rocksdb.numfiles.in.singlecompaction P50 : 3.190476 P95 : 8.400000 P99 : 11.000000 P100 : 11.000000 COUNT : 52 SUM : 193 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559231 P95 : 1163.429174 P99 : 2497.883212 P100 : 513824.000000 COUNT : 28145 SUM : 5024873 rocksdb.sst.read.micros P50 : 1.727891 P95 : 5.096703 P99 : 9.012274 P100 : 16362.000000 COUNT : 2774757 SUM : 11639105 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4934999 SUM : 5092918968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 197906.976744 P95 : 405333.333333 P99 : 651200.000000 P100 : 750573.000000 COUNT : 72 SUM : 14685913 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 126 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0