[2024-12-09 11:23:44.659875] Starting SPDK v25.01-pre git sha1 51286f61a / DPDK 24.03.0 initialization... [2024-12-09 11:23:44.660137] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid347348 ] Set seed to 1733739824653166 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-09 11:23:44.799825] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-09 11:23:44.907759] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-09 11:23:44.907810] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 347348' to capture a snapshot of events at runtime. [2024-12-09 11:23:44.907821] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-09 11:23:44.907831] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-09 11:23:44.907839] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid347348 for offline analysis/debug. [2024-12-09 11:23:44.909203] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 9 11:23:50 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/09-11:23:53 ... thread 0: (1000000,1000000) ops and (337206.6,337206.6) ops/second in (2.965541,2.965541) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 628.85 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 348.8 2.52 2.27 12 0.210 0 0 0.0 0.0 L1 3/3 188.08 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 255.4 254.8 0.74 0.71 1 0.738 191K 444 0.0 0.0 L2 1/1 100.30 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.0 2.6 243.2 242.8 0.66 0.64 1 0.661 163K 316 0.0 0.0 L3 16/9 816.11 MB 0.1 0.1 0.1 0.0 0.1 0.1 0.0 1.0 165.8 165.8 0.36 0.30 1 0.363 61K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 253/21 20.09 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 95.5 300.7 4.29 3.92 15 0.286 415K 760 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 95.5 300.7 4.29 3.92 15 0.286 415K 760 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 232.4 232.0 1.76 1.65 3 0.587 415K 760 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 348.8 2.52 2.27 12 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.26 GB write, 419.01 MB/s write, 0.40 GB read, 133.11 MB/s read, 4.3 seconds Interval compaction: 1.26 GB write, 434.23 MB/s write, 0.40 GB read, 137.94 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 132918 Average: 2.1304 StdDev: 9.87 Min: 1 Median: 1.4291 Max: 1859 Percentiles: P50: 1.43 P75: 1.83 P99: 5.67 P99.9: 9.69 P99.99: 17.37 ------------------------------------------------------ [ 0, 1 ] 31267 23.524% 23.524% ##### ( 1, 2 ] 82004 61.695% 85.219% ############ ( 2, 3 ] 11281 8.487% 93.706% ## ( 3, 4 ] 4177 3.143% 96.848% # ( 4, 6 ] 3433 2.583% 99.431% # ( 6, 10 ] 676 0.509% 99.940% ( 10, 15 ] 65 0.049% 99.989% ( 15, 22 ] 8 0.006% 99.995% ( 51, 76 ] 2 0.002% 99.996% ( 76, 110 ] 1 0.001% 99.997% ( 110, 170 ] 6 0.005% 100.002% ( 170, 250 ] 4 0.003% 100.005% ( 250, 380 ] 3 0.002% 100.007% ( 380, 580 ] 5 0.004% 100.011% ( 870, 1300 ] 4 0.003% 100.014% ( 1300, 1900 ] 2 0.002% 100.015% ** Level 1 read latency histogram (micros): Count: 28210 Average: 2.1864 StdDev: 9.74 Min: 1 Median: 1.4718 Max: 1405 Percentiles: P50: 1.47 P75: 1.88 P99: 5.63 P99.9: 9.27 P99.99: 415.80 ------------------------------------------------------ [ 0, 1 ] 5862 20.780% 20.780% #### ( 1, 2 ] 17471 61.932% 82.712% ############ ( 2, 3 ] 2944 10.436% 93.148% ## ( 3, 4 ] 882 3.127% 96.274% # ( 4, 6 ] 946 3.353% 99.628% # ( 6, 10 ] 94 0.333% 99.961% ( 10, 15 ] 5 0.018% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 380, 580 ] 1 0.004% 99.993% ( 580, 870 ] 1 0.004% 99.996% ( 1300, 1900 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 40232 Average: 2.6830 StdDev: 34.15 Min: 1 Median: 1.4935 Max: 5172 Percentiles: P50: 1.49 P75: 1.92 P99: 8.30 P99.9: 66.88 P99.99: 1010.01 ------------------------------------------------------ [ 0, 1 ] 8604 21.386% 21.386% #### ( 1, 2 ] 23325 57.976% 79.362% ############ ( 2, 3 ] 4385 10.899% 90.261% ## ( 3, 4 ] 1471 3.656% 93.918% # ( 4, 6 ] 1741 4.327% 98.245% # ( 6, 10 ] 529 1.315% 99.560% ( 10, 15 ] 92 0.229% 99.789% ( 15, 22 ] 9 0.022% 99.811% ( 22, 34 ] 1 0.002% 99.814% ( 34, 51 ] 10 0.025% 99.838% ( 51, 76 ] 39 0.097% 99.935% ( 76, 110 ] 8 0.020% 99.955% ( 110, 170 ] 1 0.002% 99.958% ( 170, 250 ] 8 0.020% 99.978% ( 250, 380 ] 4 0.010% 99.988% ( 870, 1300 ] 3 0.007% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 29239 Average: 7.2167 StdDev: 138.87 Min: 1 Median: 1.7468 Max: 7518 Percentiles: P50: 1.75 P75: 2.55 P99: 10.00 P99.9: 834.07 P99.99: 7487.78 ------------------------------------------------------ [ 0, 1 ] 1443 4.935% 4.935% # ( 1, 2 ] 17644 60.344% 65.279% ############ ( 2, 3 ] 5136 17.566% 82.845% #### ( 3, 4 ] 1926 6.587% 89.432% # ( 4, 6 ] 2131 7.288% 96.720% # ( 6, 10 ] 667 2.281% 99.001% ( 10, 15 ] 131 0.448% 99.449% ( 15, 22 ] 18 0.062% 99.511% ( 22, 34 ] 7 0.024% 99.535% ( 34, 51 ] 1 0.003% 99.538% ( 51, 76 ] 2 0.007% 99.545% ( 76, 110 ] 1 0.003% 99.549% ( 110, 170 ] 57 0.195% 99.743% ( 170, 250 ] 17 0.058% 99.802% ( 250, 380 ] 14 0.048% 99.850% ( 380, 580 ] 6 0.021% 99.870% ( 580, 870 ] 10 0.034% 99.904% ( 870, 1300 ] 9 0.031% 99.935% ( 1300, 1900 ] 1 0.003% 99.938% ( 1900, 2900 ] 1 0.003% 99.942% ( 2900, 4400 ] 4 0.014% 99.956% ( 4400, 6600 ] 9 0.031% 99.986% ( 6600, 9900 ] 4 0.014% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3164.3667 StdDev: 2345.92 Min: 86 Median: 3114.2857 Max: 7896 Percentiles: P50: 3114.29 P75: 4950.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ ( 76, 110 ] 2 6.667% 6.667% # ( 250, 380 ] 1 3.333% 10.000% # ( 380, 580 ] 3 10.000% 20.000% ## ( 870, 1300 ] 3 10.000% 30.000% ## ( 1300, 1900 ] 5 16.667% 46.667% ### ( 2900, 4400 ] 7 23.333% 70.000% ##### ( 4400, 6600 ] 6 20.000% 90.000% #### ( 6600, 9900 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 319.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.392 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.392 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/09-11:23:56 ... thread 0: (1000000,2000000) ops and (326052.9,331536.0) ops/second in (3.066987,6.032528) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.29 GB 100.2 0.8 0.0 0.8 2.6 1.8 0.0 1.4 96.2 310.3 8.50 7.83 28 0.304 830K 4339 0.0 0.0 L1 1/0 49.78 MB 5.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 242.5 240.9 2.59 2.52 2 1.296 638K 4020 0.0 0.0 L2 2/2 229.07 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.6 243.2 242.8 0.66 0.64 1 0.661 163K 316 0.0 0.0 L3 17/11 1.05 GB 0.3 0.4 0.3 0.1 0.4 0.3 0.0 1.2 193.8 193.3 1.94 1.74 3 0.646 381K 904 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 253/17 21.00 GB 0.0 1.9 0.8 1.1 3.7 2.6 0.4 2.1 144.8 277.3 13.69 12.74 34 0.403 2013K 9579 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 0.8 1.1 3.7 2.6 0.4 2.1 144.8 277.3 13.69 12.74 34 0.403 2013K 9579 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 0.8 1.1 1.9 0.8 0.0 0.0 235.4 234.3 8.42 8.05 9 0.936 2013K 9579 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 346.1 5.27 4.69 25 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 6.0 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.71 GB write, 617.93 MB/s write, 1.94 GB read, 322.66 MB/s read, 13.7 seconds Interval compaction: 3.71 GB write, 628.96 MB/s write, 1.94 GB read, 328.43 MB/s read, 13.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 356952 Average: 2.5708 StdDev: 14.68 Min: 1 Median: 1.5876 Max: 2767 Percentiles: P50: 1.59 P75: 1.98 P99: 5.98 P99.9: 14.00 P99.99: 350.42 ------------------------------------------------------ [ 0, 1 ] 46404 13.000% 13.000% ### ( 1, 2 ] 224748 62.963% 75.963% ############# ( 2, 3 ] 52776 14.785% 90.748% ### ( 3, 4 ] 15875 4.447% 95.196% # ( 4, 6 ] 13715 3.842% 99.038% # ( 6, 10 ] 2756 0.772% 99.810% ( 10, 15 ] 403 0.113% 99.923% ( 15, 22 ] 44 0.012% 99.935% ( 22, 34 ] 7 0.002% 99.937% ( 51, 76 ] 4 0.001% 99.938% ( 76, 110 ] 26 0.007% 99.946% ( 110, 170 ] 53 0.015% 99.960% ( 170, 250 ] 70 0.020% 99.980% ( 250, 380 ] 47 0.013% 99.993% ( 380, 580 ] 30 0.008% 100.002% ( 580, 870 ] 23 0.006% 100.008% ( 870, 1300 ] 15 0.004% 100.012% ( 1300, 1900 ] 5 0.001% 100.014% ( 1900, 2900 ] 3 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 137782 Average: 3.0359 StdDev: 16.78 Min: 1 Median: 1.7788 Max: 2884 Percentiles: P50: 1.78 P75: 2.55 P99: 8.61 P99.9: 95.01 P99.99: 334.60 ------------------------------------------------------ [ 0, 1 ] 8273 6.004% 6.004% # ( 1, 2 ] 77833 56.490% 62.494% ########### ( 2, 3 ] 31582 22.922% 85.416% ##### ( 3, 4 ] 8482 6.156% 91.572% # ( 4, 6 ] 8882 6.446% 98.019% # ( 6, 10 ] 2070 1.502% 99.521% ( 10, 15 ] 438 0.318% 99.839% ( 15, 22 ] 61 0.044% 99.883% ( 22, 34 ] 6 0.004% 99.888% ( 34, 51 ] 1 0.001% 99.888% ( 51, 76 ] 1 0.001% 99.889% ( 76, 110 ] 29 0.021% 99.910% ( 110, 170 ] 55 0.040% 99.950% ( 170, 250 ] 38 0.028% 99.978% ( 250, 380 ] 28 0.020% 99.998% ( 380, 580 ] 25 0.018% 100.016% ( 580, 870 ] 8 0.006% 100.022% ( 870, 1300 ] 2 0.001% 100.023% ( 1300, 1900 ] 3 0.002% 100.025% ( 1900, 2900 ] 2 0.001% 100.027% ** Level 2 read latency histogram (micros): Count: 65615 Average: 3.0197 StdDev: 28.75 Min: 1 Median: 1.6165 Max: 5172 Percentiles: P50: 1.62 P75: 2.18 P99: 8.82 P99.9: 179.67 P99.99: 756.79 ------------------------------------------------------ [ 0, 1 ] 9422 14.360% 14.360% ### ( 1, 2 ] 37930 57.807% 72.166% ############ ( 2, 3 ] 10305 15.705% 87.872% ### ( 3, 4 ] 3165 4.824% 92.695% # ( 4, 6 ] 3371 5.138% 97.833% # ( 6, 10 ] 1086 1.655% 99.488% ( 10, 15 ] 154 0.235% 99.723% ( 15, 22 ] 20 0.030% 99.753% ( 22, 34 ] 1 0.002% 99.755% ( 34, 51 ] 10 0.015% 99.770% ( 51, 76 ] 39 0.059% 99.829% ( 76, 110 ] 11 0.017% 99.846% ( 110, 170 ] 32 0.049% 99.895% ( 170, 250 ] 28 0.043% 99.938% ( 250, 380 ] 21 0.032% 99.970% ( 380, 580 ] 11 0.017% 99.986% ( 580, 870 ] 4 0.006% 99.992% ( 870, 1300 ] 3 0.005% 99.997% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 214919 Average: 4.0000 StdDev: 54.67 Min: 1 Median: 1.7125 Max: 7518 Percentiles: P50: 1.71 P75: 2.37 P99: 9.30 P99.9: 281.20 P99.99: 797.55 ------------------------------------------------------ [ 0, 1 ] 13011 6.054% 6.054% # ( 1, 2 ] 132553 61.676% 67.730% ############ ( 2, 3 ] 41775 19.438% 87.167% #### ( 3, 4 ] 11100 5.165% 92.332% # ( 4, 6 ] 10890 5.067% 97.399% # ( 6, 10 ] 4166 1.938% 99.337% ( 10, 15 ] 501 0.233% 99.571% ( 15, 22 ] 67 0.031% 99.602% ( 22, 34 ] 8 0.004% 99.605% ( 34, 51 ] 1 0.000% 99.606% ( 51, 76 ] 4 0.002% 99.608% ( 76, 110 ] 147 0.068% 99.676% ( 110, 170 ] 333 0.155% 99.831% ( 170, 250 ] 126 0.059% 99.890% ( 250, 380 ] 92 0.043% 99.933% ( 380, 580 ] 89 0.041% 99.974% ( 580, 870 ] 46 0.021% 99.995% ( 870, 1300 ] 21 0.010% 100.005% ( 1300, 1900 ] 6 0.003% 100.008% ( 1900, 2900 ] 1 0.000% 100.008% ( 2900, 4400 ] 4 0.002% 100.010% ( 4400, 6600 ] 9 0.004% 100.014% ( 6600, 9900 ] 4 0.002% 100.016% ** Level 4 read latency histogram (micros): Count: 30 Average: 3164.3667 StdDev: 2345.92 Min: 86 Median: 3114.2857 Max: 7896 Percentiles: P50: 3114.29 P75: 4950.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ ( 76, 110 ] 2 6.667% 6.667% # ( 250, 380 ] 1 3.333% 10.000% # ( 380, 580 ] 3 10.000% 20.000% ## ( 870, 1300 ] 3 10.000% 30.000% ## ( 1300, 1900 ] 5 16.667% 46.667% ### ( 2900, 4400 ] 7 23.333% 70.000% ##### ( 4400, 6600 ] 6 20.000% 90.000% #### ( 6600, 9900 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.796 H:M:S, 13.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.404 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/09-11:23:59 ... thread 0: (1000000,3000000) ops and (330566.3,331212.1) ops/second in (3.025112,9.057640) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.26 GB 206.6 1.7 0.0 1.7 4.4 2.8 0.0 1.6 114.7 305.1 14.81 13.74 45 0.329 1724K 9221 0.0 0.0 L1 1/0 49.78 MB 5.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 242.5 240.9 2.59 2.52 2 1.296 638K 4020 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.6 243.2 242.8 0.66 0.64 1 0.661 163K 316 0.0 0.0 L3 17/0 812.48 MB 0.8 1.4 0.5 0.8 1.4 0.5 0.0 2.6 221.3 220.7 6.36 5.81 5 1.272 1429K 3753 0.0 0.0 L4 123/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 205.4 205.4 1.11 1.04 2 0.557 232K 0 0.0 0.0 L5 112/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 267/4 21.97 GB 0.0 4.0 1.2 2.8 6.8 4.0 1.1 2.5 161.5 271.6 25.53 23.75 55 0.464 4187K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 1.2 2.8 6.8 4.0 1.1 2.5 161.5 271.6 25.53 23.75 55 0.464 4187K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 1.2 2.8 4.0 1.2 0.0 0.0 236.4 235.4 17.44 16.55 16 1.090 4187K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 349.5 8.10 7.20 39 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.1 interval Flush(GB): cumulative 2.763, interval 2.763 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.77 GB write, 756.45 MB/s write, 4.03 GB read, 449.71 MB/s read, 25.5 seconds Interval compaction: 6.77 GB write, 765.45 MB/s write, 4.03 GB read, 455.06 MB/s read, 25.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 619386 Average: 2.3960 StdDev: 13.26 Min: 1 Median: 1.5404 Max: 4377 Percentiles: P50: 1.54 P75: 1.93 P99: 5.86 P99.9: 12.38 P99.99: 242.06 ------------------------------------------------------ [ 0, 1 ] 95337 15.392% 15.392% ### ( 1, 2 ] 396651 64.039% 79.432% ############# ( 2, 3 ] 79723 12.871% 92.303% ### ( 3, 4 ] 23837 3.848% 96.151% # ( 4, 6 ] 18947 3.059% 99.210% # ( 6, 10 ] 3988 0.644% 99.854% ( 10, 15 ] 597 0.096% 99.951% ( 15, 22 ] 74 0.012% 99.963% ( 22, 34 ] 13 0.002% 99.965% ( 34, 51 ] 1 0.000% 99.965% ( 51, 76 ] 4 0.001% 99.965% ( 76, 110 ] 26 0.004% 99.970% ( 110, 170 ] 55 0.009% 99.979% ( 170, 250 ] 80 0.013% 99.991% ( 250, 380 ] 50 0.008% 100.000% ( 380, 580 ] 36 0.006% 100.005% ( 580, 870 ] 29 0.005% 100.010% ( 870, 1300 ] 20 0.003% 100.013% ( 1300, 1900 ] 6 0.001% 100.014% ( 1900, 2900 ] 3 0.000% 100.015% ( 2900, 4400 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 145821 Average: 3.0328 StdDev: 16.51 Min: 1 Median: 1.7830 Max: 2884 Percentiles: P50: 1.78 P75: 2.55 P99: 8.71 P99.9: 87.93 P99.99: 340.15 ------------------------------------------------------ [ 0, 1 ] 8461 5.802% 5.802% # ( 1, 2 ] 82310 56.446% 62.248% ########### ( 2, 3 ] 33548 23.006% 85.255% ##### ( 3, 4 ] 9117 6.252% 91.507% # ( 4, 6 ] 9388 6.438% 97.945% # ( 6, 10 ] 2274 1.559% 99.504% ( 10, 15 ] 484 0.332% 99.836% ( 15, 22 ] 73 0.050% 99.886% ( 22, 34 ] 8 0.005% 99.892% ( 34, 51 ] 1 0.001% 99.892% ( 51, 76 ] 1 0.001% 99.893% ( 76, 110 ] 29 0.020% 99.913% ( 110, 170 ] 55 0.038% 99.951% ( 170, 250 ] 38 0.026% 99.977% ( 250, 380 ] 28 0.019% 99.996% ( 380, 580 ] 26 0.018% 100.014% ( 580, 870 ] 9 0.006% 100.020% ( 870, 1300 ] 2 0.001% 100.021% ( 1300, 1900 ] 3 0.002% 100.023% ( 1900, 2900 ] 2 0.001% 100.025% ** Level 2 read latency histogram (micros): Count: 65615 Average: 3.0197 StdDev: 28.75 Min: 1 Median: 1.6165 Max: 5172 Percentiles: P50: 1.62 P75: 2.18 P99: 8.82 P99.9: 179.67 P99.99: 756.79 ------------------------------------------------------ [ 0, 1 ] 9422 14.360% 14.360% ### ( 1, 2 ] 37930 57.807% 72.166% ############ ( 2, 3 ] 10305 15.705% 87.872% ### ( 3, 4 ] 3165 4.824% 92.695% # ( 4, 6 ] 3371 5.138% 97.833% # ( 6, 10 ] 1086 1.655% 99.488% ( 10, 15 ] 154 0.235% 99.723% ( 15, 22 ] 20 0.030% 99.753% ( 22, 34 ] 1 0.002% 99.755% ( 34, 51 ] 10 0.015% 99.770% ( 51, 76 ] 39 0.059% 99.829% ( 76, 110 ] 11 0.017% 99.846% ( 110, 170 ] 32 0.049% 99.895% ( 170, 250 ] 28 0.043% 99.938% ( 250, 380 ] 21 0.032% 99.970% ( 380, 580 ] 11 0.017% 99.986% ( 580, 870 ] 4 0.006% 99.992% ( 870, 1300 ] 3 0.005% 99.997% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 276717 Average: 3.8949 StdDev: 49.08 Min: 1 Median: 1.7428 Max: 7518 Percentiles: P50: 1.74 P75: 2.45 P99: 9.27 P99.9: 254.72 P99.99: 693.60 ------------------------------------------------------ [ 0, 1 ] 14141 5.110% 5.110% # ( 1, 2 ] 167221 60.430% 65.541% ############ ( 2, 3 ] 58493 21.138% 86.679% #### ( 3, 4 ] 15001 5.421% 92.100% # ( 4, 6 ] 14886 5.380% 97.479% # ( 6, 10 ] 5144 1.859% 99.338% ( 10, 15 ] 741 0.268% 99.606% ( 15, 22 ] 93 0.034% 99.640% ( 22, 34 ] 10 0.004% 99.643% ( 34, 51 ] 1 0.000% 99.644% ( 51, 76 ] 6 0.002% 99.646% ( 76, 110 ] 154 0.056% 99.702% ( 110, 170 ] 381 0.138% 99.839% ( 170, 250 ] 164 0.059% 99.898% ( 250, 380 ] 118 0.043% 99.941% ( 380, 580 ] 113 0.041% 99.982% ( 580, 870 ] 57 0.021% 100.003% ( 870, 1300 ] 26 0.009% 100.012% ( 1300, 1900 ] 7 0.003% 100.014% ( 1900, 2900 ] 1 0.000% 100.015% ( 2900, 4400 ] 4 0.001% 100.016% ( 4400, 6600 ] 9 0.003% 100.020% ( 6600, 9900 ] 4 0.001% 100.021% ** Level 4 read latency histogram (micros): Count: 65 Average: 1516.0000 StdDev: 2212.26 Min: 1 Median: 271.6667 Max: 7896 Percentiles: P50: 271.67 P75: 1870.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ [ 0, 1 ] 9 13.846% 13.846% ### ( 1, 2 ] 10 15.385% 29.231% ### ( 2, 3 ] 2 3.077% 32.308% # ( 4, 6 ] 1 1.538% 33.846% ( 15, 22 ] 1 1.538% 35.385% ( 22, 34 ] 1 1.538% 36.923% ( 34, 51 ] 1 1.538% 38.462% ( 76, 110 ] 2 3.077% 41.538% # ( 110, 170 ] 5 7.692% 49.231% ## ( 250, 380 ] 3 4.615% 53.846% # ( 380, 580 ] 3 4.615% 58.462% # ( 580, 870 ] 2 3.077% 61.538% # ( 870, 1300 ] 4 6.154% 67.692% # ( 1300, 1900 ] 5 7.692% 75.385% ## ( 2900, 4400 ] 7 10.769% 86.154% ## ( 4400, 6600 ] 6 9.231% 95.385% ## ( 6600, 9900 ] 3 4.615% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 991.4500 StdDev: 1176.64 Min: 138 Median: 250.0000 Max: 3851 Percentiles: P50: 250.00 P75: 1600.00 P99: 3851.00 P99.9: 3851.00 P99.99: 3851.00 ------------------------------------------------------ ( 110, 170 ] 5 25.000% 25.000% ##### ( 170, 250 ] 5 25.000% 50.000% ##### ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.204 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.408 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/09-11:24:02 ... thread 0: (1000000,4000000) ops and (311133.6,325953.4) ops/second in (3.214053,12.271693) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.24 GB 68.9 2.4 0.0 2.4 6.1 3.7 0.0 1.6 119.5 305.6 20.53 19.11 62 0.331 2490K 12K 0.0 0.0 L1 1/1 49.78 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 242.5 240.9 2.59 2.52 2 1.296 638K 4020 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.6 243.2 242.8 0.66 0.64 1 0.661 163K 316 0.0 0.0 L3 17/0 812.48 MB 0.8 1.4 0.5 0.8 1.4 0.5 0.0 2.6 221.3 220.7 6.36 5.81 5 1.272 1429K 3753 0.0 0.0 L4 123/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 205.4 205.4 1.11 1.04 2 0.557 232K 0 0.0 0.0 L5 112/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 272/16 22.95 GB 0.0 4.8 1.2 3.5 8.5 5.0 1.1 2.3 156.1 278.1 31.26 29.12 72 0.434 4954K 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 1.2 3.5 8.5 5.0 1.1 2.3 156.1 278.1 31.26 29.12 72 0.434 4954K 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 1.2 3.5 4.7 1.2 0.0 0.0 240.5 239.4 20.29 19.35 19 1.068 4954K 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 349.6 10.97 9.78 53 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.3 interval Flush(GB): cumulative 3.746, interval 3.746 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.49 GB write, 702.03 MB/s write, 4.76 GB read, 393.96 MB/s read, 31.3 seconds Interval compaction: 8.49 GB write, 708.20 MB/s write, 4.76 GB read, 397.42 MB/s read, 31.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 16, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 951827 Average: 2.4919 StdDev: 14.26 Min: 1 Median: 1.5391 Max: 4377 Percentiles: P50: 1.54 P75: 1.92 P99: 5.91 P99.9: 51.43 P99.99: 333.96 ------------------------------------------------------ [ 0, 1 ] 140062 14.715% 14.715% ### ( 1, 2 ] 622963 65.449% 80.164% ############# ( 2, 3 ] 122073 12.825% 92.989% ### ( 3, 4 ] 33657 3.536% 96.525% # ( 4, 6 ] 24698 2.595% 99.120% # ( 6, 10 ] 6493 0.682% 99.802% ( 10, 15 ] 804 0.084% 99.887% ( 15, 22 ] 107 0.011% 99.898% ( 22, 34 ] 14 0.001% 99.900% ( 34, 51 ] 5 0.001% 99.900% ( 51, 76 ] 10 0.001% 99.901% ( 76, 110 ] 159 0.017% 99.918% ( 110, 170 ] 435 0.046% 99.964% ( 170, 250 ] 185 0.019% 99.983% ( 250, 380 ] 105 0.011% 99.994% ( 380, 580 ] 94 0.010% 100.004% ( 580, 870 ] 61 0.006% 100.010% ( 870, 1300 ] 28 0.003% 100.013% ( 1300, 1900 ] 6 0.001% 100.014% ( 1900, 2900 ] 7 0.001% 100.015% ( 2900, 4400 ] 2 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 145822 Average: 3.0343 StdDev: 16.52 Min: 1 Median: 1.7830 Max: 2884 Percentiles: P50: 1.78 P75: 2.55 P99: 8.71 P99.9: 89.11 P99.99: 340.15 ------------------------------------------------------ [ 0, 1 ] 8461 5.802% 5.802% # ( 1, 2 ] 82310 56.446% 62.248% ########### ( 2, 3 ] 33548 23.006% 85.254% ##### ( 3, 4 ] 9117 6.252% 91.506% # ( 4, 6 ] 9388 6.438% 97.944% # ( 6, 10 ] 2274 1.559% 99.504% ( 10, 15 ] 484 0.332% 99.835% ( 15, 22 ] 73 0.050% 99.885% ( 22, 34 ] 8 0.005% 99.891% ( 34, 51 ] 1 0.001% 99.892% ( 51, 76 ] 1 0.001% 99.892% ( 76, 110 ] 29 0.020% 99.912% ( 110, 170 ] 55 0.038% 99.950% ( 170, 250 ] 39 0.027% 99.977% ( 250, 380 ] 28 0.019% 99.996% ( 380, 580 ] 26 0.018% 100.014% ( 580, 870 ] 9 0.006% 100.020% ( 870, 1300 ] 2 0.001% 100.021% ( 1300, 1900 ] 3 0.002% 100.023% ( 1900, 2900 ] 2 0.001% 100.025% ** Level 2 read latency histogram (micros): Count: 65615 Average: 3.0197 StdDev: 28.75 Min: 1 Median: 1.6165 Max: 5172 Percentiles: P50: 1.62 P75: 2.18 P99: 8.82 P99.9: 179.67 P99.99: 756.79 ------------------------------------------------------ [ 0, 1 ] 9422 14.360% 14.360% ### ( 1, 2 ] 37930 57.807% 72.166% ############ ( 2, 3 ] 10305 15.705% 87.872% ### ( 3, 4 ] 3165 4.824% 92.695% # ( 4, 6 ] 3371 5.138% 97.833% # ( 6, 10 ] 1086 1.655% 99.488% ( 10, 15 ] 154 0.235% 99.723% ( 15, 22 ] 20 0.030% 99.753% ( 22, 34 ] 1 0.002% 99.755% ( 34, 51 ] 10 0.015% 99.770% ( 51, 76 ] 39 0.059% 99.829% ( 76, 110 ] 11 0.017% 99.846% ( 110, 170 ] 32 0.049% 99.895% ( 170, 250 ] 28 0.043% 99.938% ( 250, 380 ] 21 0.032% 99.970% ( 380, 580 ] 11 0.017% 99.986% ( 580, 870 ] 4 0.006% 99.992% ( 870, 1300 ] 3 0.005% 99.997% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 276717 Average: 3.8949 StdDev: 49.08 Min: 1 Median: 1.7428 Max: 7518 Percentiles: P50: 1.74 P75: 2.45 P99: 9.27 P99.9: 254.72 P99.99: 693.60 ------------------------------------------------------ [ 0, 1 ] 14141 5.110% 5.110% # ( 1, 2 ] 167221 60.430% 65.541% ############ ( 2, 3 ] 58493 21.138% 86.679% #### ( 3, 4 ] 15001 5.421% 92.100% # ( 4, 6 ] 14886 5.380% 97.479% # ( 6, 10 ] 5144 1.859% 99.338% ( 10, 15 ] 741 0.268% 99.606% ( 15, 22 ] 93 0.034% 99.640% ( 22, 34 ] 10 0.004% 99.643% ( 34, 51 ] 1 0.000% 99.644% ( 51, 76 ] 6 0.002% 99.646% ( 76, 110 ] 154 0.056% 99.702% ( 110, 170 ] 381 0.138% 99.839% ( 170, 250 ] 164 0.059% 99.898% ( 250, 380 ] 118 0.043% 99.941% ( 380, 580 ] 113 0.041% 99.982% ( 580, 870 ] 57 0.021% 100.003% ( 870, 1300 ] 26 0.009% 100.012% ( 1300, 1900 ] 7 0.003% 100.014% ( 1900, 2900 ] 1 0.000% 100.015% ( 2900, 4400 ] 4 0.001% 100.016% ( 4400, 6600 ] 9 0.003% 100.020% ( 6600, 9900 ] 4 0.001% 100.021% ** Level 4 read latency histogram (micros): Count: 65 Average: 1516.0000 StdDev: 2212.26 Min: 1 Median: 271.6667 Max: 7896 Percentiles: P50: 271.67 P75: 1870.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ [ 0, 1 ] 9 13.846% 13.846% ### ( 1, 2 ] 10 15.385% 29.231% ### ( 2, 3 ] 2 3.077% 32.308% # ( 4, 6 ] 1 1.538% 33.846% ( 15, 22 ] 1 1.538% 35.385% ( 22, 34 ] 1 1.538% 36.923% ( 34, 51 ] 1 1.538% 38.462% ( 76, 110 ] 2 3.077% 41.538% # ( 110, 170 ] 5 7.692% 49.231% ## ( 250, 380 ] 3 4.615% 53.846% # ( 380, 580 ] 3 4.615% 58.462% # ( 580, 870 ] 2 3.077% 61.538% # ( 870, 1300 ] 4 6.154% 67.692% # ( 1300, 1900 ] 5 7.692% 75.385% ## ( 2900, 4400 ] 7 10.769% 86.154% ## ( 4400, 6600 ] 6 9.231% 95.385% ## ( 6600, 9900 ] 3 4.615% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 991.4500 StdDev: 1176.64 Min: 138 Median: 250.0000 Max: 3851 Percentiles: P50: 250.00 P75: 1600.00 P99: 3851.00 P99.9: 3851.00 P99.99: 3851.00 ------------------------------------------------------ ( 110, 170 ] 5 25.000% 25.000% ##### ( 170, 250 ] 5 25.000% 50.000% ##### ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.4 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 317.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.793 H:M:S, 14.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 306.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.589 H:M:S, 18.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.161 micros/op 240350 ops/sec 20.125 seconds 4836999 operations; 232.9 MB/s Microseconds per write: Count: 4836999 Average: 4.1606 StdDev: 256.96 Min: 0 Median: 1.7061 Max: 206357 Percentiles: P50: 1.71 P75: 2.69 P99: 8.39 P99.9: 154.35 P99.99: 2405.06 ------------------------------------------------------ [ 0, 1 ] 711076 14.701% 14.701% ### ( 1, 2 ] 2418088 49.991% 64.692% ########## ( 2, 3 ] 727446 15.039% 79.731% ### ( 3, 4 ] 661298 13.672% 93.403% ### ( 4, 6 ] 242739 5.018% 98.422% # ( 6, 10 ] 46832 0.968% 99.390% ( 10, 15 ] 15549 0.321% 99.711% ( 15, 22 ] 4035 0.083% 99.795% ( 22, 34 ] 593 0.012% 99.807% ( 34, 51 ] 96 0.002% 99.809% ( 51, 76 ] 23 0.000% 99.809% ( 76, 110 ] 3435 0.071% 99.880% ( 110, 170 ] 1288 0.027% 99.907% ( 170, 250 ] 126 0.003% 99.910% ( 250, 380 ] 47 0.001% 99.911% ( 380, 580 ] 12 0.000% 99.911% ( 580, 870 ] 4 0.000% 99.911% ( 870, 1300 ] 3343 0.069% 99.980% ( 1300, 1900 ] 6 0.000% 99.980% ( 1900, 2900 ] 949 0.020% 100.000% ( 4400, 6600 ] 3 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 7 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 166203 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4836999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4991782968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 147 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 7190258 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9271247181 rocksdb.compact.write.bytes COUNT : 9110895834 rocksdb.flush.write.bytes COUNT : 4945854551 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 14 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 64 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4914363392 rocksdb.memtable.garbage.bytes.at.flush COUNT : 9624576 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9311960079 rocksdb.non.last.level.read.count COUNT : 2250152 rocksdb.block.checksum.compute.count COUNT : 2249872 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.343057 P95 : 3.848376 P99 : 6.517171 P100 : 206353.000000 COUNT : 4836999 SUM : 17916197 rocksdb.compaction.times.micros P50 : 999090.909091 P95 : 1873750.000000 P99 : 3544919.000000 P100 : 3544919.000000 COUNT : 23 SUM : 24407530 rocksdb.compaction.times.cpu_micros P50 : 968181.818182 P95 : 1865000.000000 P99 : 3266635.000000 P100 : 3266635.000000 COUNT : 23 SUM : 23345047 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 853.888889 P95 : 1498.000000 P99 : 1683.000000 P100 : 1683.000000 COUNT : 67 SUM : 55653 rocksdb.compaction.outfile.sync.micros P50 : 783.000000 P95 : 1742.500000 P99 : 2196.000000 P100 : 2196.000000 COUNT : 81 SUM : 68315 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 89.324324 P95 : 240.000000 P99 : 320.000000 P100 : 320.000000 COUNT : 95 SUM : 10068 rocksdb.table.open.io.micros P50 : 1265.322581 P95 : 17100.000000 P99 : 20427.000000 P100 : 20427.000000 COUNT : 147 SUM : 429963 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.610610 P95 : 6.818417 P99 : 10.181347 P100 : 3373.000000 COUNT : 2249456 SUM : 11456616 rocksdb.read.block.get.micros P50 : 477.777778 P95 : 4821.666667 P99 : 7959.600000 P100 : 8156.000000 COUNT : 294 SUM : 310731 rocksdb.write.raw.block.micros P50 : 0.512546 P95 : 0.973837 P99 : 2.803435 P100 : 3440.000000 COUNT : 3405960 SUM : 6357603 rocksdb.numfiles.in.singlecompaction P50 : 3.366667 P95 : 9.100000 P99 : 12.000000 P100 : 12.000000 COUNT : 29 SUM : 117 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559879 P95 : 1162.763362 P99 : 2485.700738 P100 : 206142.000000 COUNT : 40617 SUM : 7194810 rocksdb.sst.read.micros P50 : 1.577710 P95 : 3.905004 P99 : 8.286868 P100 : 7896.000000 COUNT : 2250219 SUM : 7088597 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4836999 SUM : 4991782968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210800.000000 P95 : 331611.111111 P99 : 367278.000000 P100 : 367278.000000 COUNT : 67 SUM : 13506045 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 87 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0