[2024-11-20 08:10:14.015160] Starting SPDK v25.01-pre git sha1 097b7c969 / DPDK 24.03.0 initialization... [2024-11-20 08:10:14.015284] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1271629 ] Set seed to 1732086614012635 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 08:10:14.151975] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 08:10:14.256720] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 08:10:14.256773] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1271629' to capture a snapshot of events at runtime. [2024-11-20 08:10:14.256803] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 08:10:14.256816] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 08:10:14.256826] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1271629 for offline analysis/debug. [2024-11-20 08:10:14.258010] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 08:10:17 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/20-08:10:20 ... thread 0: (1000000,1000000) ops and (333690.4,333690.4) ops/second in (2.996790,2.996790) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 440.39 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 352.0 2.50 2.33 13 0.192 0 0 0.0 0.0 L1 4/0 312.49 MB 31.2 0.3 0.2 0.1 0.3 0.2 0.2 1.2 245.9 244.4 1.28 1.25 1 1.279 319K 1849 0.0 0.0 L2 1/0 5.83 MB 0.1 0.1 0.1 0.1 0.1 0.1 0.1 2.0 249.3 248.9 0.50 0.49 1 0.505 127K 178 0.0 0.0 L3 18/0 980.11 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.2 1.0 244.6 244.6 0.49 0.47 1 0.490 121K 0 0.0 0.0 L4 126/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 204.3 204.4 0.28 0.26 1 0.276 57K 0 0.0 0.0 L5 116/0 8.92 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 272/5 20.09 GB 0.0 0.6 0.5 0.1 1.5 1.3 0.7 1.7 122.0 296.0 5.05 4.81 17 0.297 626K 2027 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.5 0.1 1.5 1.3 0.6 1.7 122.0 296.0 5.05 4.81 17 0.297 626K 2027 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.5 0.1 0.6 0.5 0.0 0.0 241.8 241.0 2.55 2.48 4 0.637 626K 2027 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 352.0 2.50 2.33 13 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.46 GB write, 482.78 MB/s write, 0.60 GB read, 199.07 MB/s read, 5.1 seconds Interval compaction: 1.46 GB write, 498.48 MB/s write, 0.60 GB read, 205.55 MB/s read, 5.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 143454 Average: 2.0040 StdDev: 5.35 Min: 1 Median: 1.3807 Max: 1265 Percentiles: P50: 1.38 P75: 1.78 P99: 5.51 P99.9: 10.03 P99.99: 26.87 ------------------------------------------------------ [ 0, 1 ] 37599 26.210% 26.210% ##### ( 1, 2 ] 89654 62.497% 88.706% ############ ( 2, 3 ] 9781 6.818% 95.525% # ( 3, 4 ] 3531 2.461% 97.986% ( 4, 6 ] 1928 1.344% 99.330% ( 6, 10 ] 817 0.570% 99.900% ( 10, 15 ] 109 0.076% 99.976% ( 15, 22 ] 17 0.012% 99.987% ( 22, 34 ] 9 0.006% 99.994% ( 34, 51 ] 1 0.001% 99.994% ( 170, 250 ] 12 0.008% 100.003% ( 250, 380 ] 7 0.005% 100.008% ( 380, 580 ] 6 0.004% 100.012% ( 870, 1300 ] 1 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 20 Average: 130.7500 StdDev: 222.80 Min: 1 Median: 1.6667 Max: 646 Percentiles: P50: 1.67 P75: 170.00 P99: 646.00 P99.9: 646.00 P99.99: 646.00 ------------------------------------------------------ [ 0, 1 ] 6 30.000% 30.000% ###### ( 1, 2 ] 6 30.000% 60.000% ###### ( 4, 6 ] 1 5.000% 65.000% # ( 15, 22 ] 1 5.000% 70.000% # ( 110, 170 ] 1 5.000% 75.000% # ( 170, 250 ] 1 5.000% 80.000% # ( 380, 580 ] 2 10.000% 90.000% ## ( 580, 870 ] 2 10.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 30439 Average: 2.5064 StdDev: 53.65 Min: 0 Median: 1.2093 Max: 4958 Percentiles: P50: 1.21 P75: 1.65 P99: 5.13 P99.9: 9.92 P99.99: 3617.07 ------------------------------------------------------ [ 0, 1 ] 11606 38.129% 38.129% ######## ( 1, 2 ] 17263 56.713% 94.842% ########### ( 2, 3 ] 837 2.750% 97.592% # ( 3, 4 ] 291 0.956% 98.548% ( 4, 6 ] 244 0.802% 99.350% ( 6, 10 ] 171 0.562% 99.911% ( 10, 15 ] 9 0.030% 99.941% ( 15, 22 ] 4 0.013% 99.954% ( 34, 51 ] 1 0.003% 99.957% ( 51, 76 ] 1 0.003% 99.961% ( 170, 250 ] 1 0.003% 99.964% ( 250, 380 ] 2 0.007% 99.970% ( 380, 580 ] 1 0.003% 99.974% ( 580, 870 ] 2 0.007% 99.980% ( 870, 1300 ] 1 0.003% 99.984% ( 1300, 1900 ] 1 0.003% 99.987% ( 2900, 4400 ] 2 0.007% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 14418 Average: 11.3447 StdDev: 189.48 Min: 0 Median: 1.6781 Max: 6829 Percentiles: P50: 1.68 P75: 2.27 P99: 10.42 P99.9: 3774.85 P99.99: 6829.00 ------------------------------------------------------ [ 0, 1 ] 959 6.651% 6.651% # ( 1, 2 ] 9217 63.927% 70.578% ############# ( 2, 3 ] 2328 16.146% 86.725% ### ( 3, 4 ] 817 5.667% 92.391% # ( 4, 6 ] 717 4.973% 97.364% # ( 6, 10 ] 229 1.588% 98.953% ( 10, 15 ] 82 0.569% 99.521% ( 15, 22 ] 15 0.104% 99.625% ( 22, 34 ] 1 0.007% 99.632% ( 34, 51 ] 3 0.021% 99.653% ( 51, 76 ] 1 0.007% 99.660% ( 110, 170 ] 4 0.028% 99.688% ( 170, 250 ] 1 0.007% 99.695% ( 250, 380 ] 3 0.021% 99.716% ( 380, 580 ] 6 0.042% 99.757% ( 580, 870 ] 3 0.021% 99.778% ( 870, 1300 ] 1 0.007% 99.785% ( 1300, 1900 ] 1 0.007% 99.792% ( 1900, 2900 ] 8 0.055% 99.847% ( 2900, 4400 ] 13 0.090% 99.938% ( 4400, 6600 ] 7 0.049% 99.986% ( 6600, 9900 ] 2 0.014% 100.000% ** Level 4 read latency histogram (micros): Count: 55 Average: 1512.6182 StdDev: 2065.46 Min: 0 Median: 16.7500 Max: 6116 Percentiles: P50: 16.75 P75: 3321.88 P99: 6116.00 P99.9: 6116.00 P99.99: 6116.00 ------------------------------------------------------ [ 0, 1 ] 12 21.818% 21.818% #### ( 1, 2 ] 7 12.727% 34.545% ### ( 3, 4 ] 1 1.818% 36.364% ( 4, 6 ] 1 1.818% 38.182% ( 6, 10 ] 2 3.636% 41.818% # ( 10, 15 ] 4 7.273% 49.091% # ( 15, 22 ] 2 3.636% 52.727% # ( 110, 170 ] 1 1.818% 54.545% ( 250, 380 ] 2 3.636% 58.182% # ( 580, 870 ] 2 3.636% 61.818% # ( 870, 1300 ] 3 5.455% 67.273% # ( 1900, 2900 ] 2 3.636% 70.909% # ( 2900, 4400 ] 8 14.545% 85.455% ### ( 4400, 6600 ] 8 14.545% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 454.4500 StdDev: 442.27 Min: 126 Median: 234.0000 Max: 1870 Percentiles: P50: 234.00 P75: 725.00 P99: 1780.00 P99.9: 1870.00 P99.99: 1870.00 ------------------------------------------------------ ( 110, 170 ] 6 30.000% 30.000% ###### ( 170, 250 ] 5 25.000% 55.000% ##### ( 250, 380 ] 2 10.000% 65.000% ## ( 380, 580 ] 1 5.000% 70.000% # ( 580, 870 ] 2 10.000% 80.000% ## ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 317.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.157 H:M:S, 5.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.157 H:M:S, 5.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-08:10:23 ... thread 0: (1000000,2000000) ops and (349095.6,341219.2) ops/second in (2.864545,5.861335) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.41 GB 119.0 1.0 0.0 1.0 2.9 1.8 0.0 1.6 114.7 316.5 9.32 8.88 33 0.283 1086K 5676 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 245.9 244.4 1.28 1.25 1 1.279 319K 1849 0.0 0.0 L2 2/0 60.67 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 1.9 244.6 244.1 0.60 0.58 2 0.299 148K 274 0.0 0.0 L3 15/0 921.98 MB 0.9 0.3 0.2 0.0 0.3 0.2 0.3 1.2 236.7 236.2 1.26 1.22 2 0.630 302K 713 0.0 0.0 L4 126/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 204.3 204.4 0.28 0.26 1 0.276 57K 0 0.0 0.0 L5 120/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 273/4 21.06 GB 0.0 1.8 0.6 1.2 3.7 2.5 1.7 2.0 148.0 295.5 12.74 12.20 39 0.327 1914K 8512 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.6 1.2 3.7 2.5 1.6 2.0 148.0 295.5 12.74 12.20 39 0.327 1914K 8512 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.6 1.2 1.8 0.6 0.0 0.0 249.3 248.2 7.56 7.39 10 0.756 1914K 8512 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 364.5 5.18 4.81 29 0.179 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.9 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.68 GB write, 631.32 MB/s write, 1.84 GB read, 316.20 MB/s read, 12.7 seconds Interval compaction: 3.68 GB write, 641.82 MB/s write, 1.84 GB read, 321.46 MB/s read, 12.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 407842 Average: 2.0997 StdDev: 6.28 Min: 1 Median: 1.4424 Max: 1866 Percentiles: P50: 1.44 P75: 1.83 P99: 5.68 P99.9: 11.92 P99.99: 20.39 ------------------------------------------------------ [ 0, 1 ] 88158 21.616% 21.616% #### ( 1, 2 ] 261691 64.165% 85.781% ############# ( 2, 3 ] 36154 8.865% 94.645% ## ( 3, 4 ] 12309 3.018% 97.663% # ( 4, 6 ] 6501 1.594% 99.257% ( 6, 10 ] 2430 0.596% 99.853% ( 10, 15 ] 504 0.124% 99.977% ( 15, 22 ] 73 0.018% 99.995% ( 22, 34 ] 24 0.006% 100.000% ( 34, 51 ] 2 0.000% 100.001% ( 51, 76 ] 1 0.000% 100.001% ( 170, 250 ] 28 0.007% 100.008% ( 250, 380 ] 14 0.003% 100.012% ( 380, 580 ] 16 0.004% 100.015% ( 580, 870 ] 3 0.001% 100.016% ( 870, 1300 ] 4 0.001% 100.017% ( 1300, 1900 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 36439 Average: 2.5081 StdDev: 6.14 Min: 1 Median: 1.6636 Max: 646 Percentiles: P50: 1.66 P75: 2.20 P99: 7.04 P99.9: 12.90 P99.99: 131.37 ------------------------------------------------------ [ 0, 1 ] 2696 7.399% 7.399% # ( 1, 2 ] 23393 64.198% 71.596% ############# ( 2, 3 ] 6198 17.009% 88.606% ### ( 3, 4 ] 2100 5.763% 94.369% # ( 4, 6 ] 1583 4.344% 98.713% # ( 6, 10 ] 403 1.106% 99.819% ( 10, 15 ] 51 0.140% 99.959% ( 15, 22 ] 8 0.022% 99.981% ( 22, 34 ] 3 0.008% 99.989% ( 110, 170 ] 1 0.003% 99.992% ( 170, 250 ] 1 0.003% 99.995% ( 380, 580 ] 2 0.005% 100.000% ( 580, 870 ] 2 0.005% 100.005% ** Level 2 read latency histogram (micros): Count: 31925 Average: 2.5061 StdDev: 52.39 Min: 0 Median: 1.2336 Max: 4958 Percentiles: P50: 1.23 P75: 1.67 P99: 5.32 P99.9: 9.98 P99.99: 3505.62 ------------------------------------------------------ [ 0, 1 ] 11711 36.683% 36.683% ####### ( 1, 2 ] 18200 57.009% 93.691% ########### ( 2, 3 ] 1088 3.408% 97.099% # ( 3, 4 ] 402 1.259% 98.359% ( 4, 6 ] 311 0.974% 99.333% ( 6, 10 ] 182 0.570% 99.903% ( 10, 15 ] 12 0.038% 99.940% ( 15, 22 ] 4 0.013% 99.953% ( 34, 51 ] 1 0.003% 99.956% ( 51, 76 ] 2 0.006% 99.962% ( 170, 250 ] 1 0.003% 99.966% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 1 0.003% 99.975% ( 580, 870 ] 2 0.006% 99.981% ( 870, 1300 ] 1 0.003% 99.984% ( 1300, 1900 ] 1 0.003% 99.987% ( 2900, 4400 ] 2 0.006% 99.994% ( 4400, 6600 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 27057 Average: 7.1501 StdDev: 138.44 Min: 0 Median: 1.6160 Max: 6829 Percentiles: P50: 1.62 P75: 2.00 P99: 8.94 P99.9: 2267.88 P99.99: 6378.21 ------------------------------------------------------ [ 0, 1 ] 2638 9.750% 9.750% ## ( 1, 2 ] 17680 65.344% 75.093% ############# ( 2, 3 ] 3770 13.934% 89.027% ### ( 3, 4 ] 1449 5.355% 94.382% # ( 4, 6 ] 1005 3.714% 98.097% # ( 6, 10 ] 333 1.231% 99.327% ( 10, 15 ] 100 0.370% 99.697% ( 15, 22 ] 18 0.067% 99.763% ( 22, 34 ] 2 0.007% 99.771% ( 34, 51 ] 3 0.011% 99.782% ( 51, 76 ] 1 0.004% 99.786% ( 76, 110 ] 1 0.004% 99.789% ( 110, 170 ] 7 0.026% 99.815% ( 170, 250 ] 3 0.011% 99.826% ( 250, 380 ] 6 0.022% 99.848% ( 380, 580 ] 6 0.022% 99.871% ( 580, 870 ] 3 0.011% 99.882% ( 870, 1300 ] 1 0.004% 99.885% ( 1300, 1900 ] 1 0.004% 99.889% ( 1900, 2900 ] 8 0.030% 99.919% ( 2900, 4400 ] 13 0.048% 99.967% ( 4400, 6600 ] 7 0.026% 99.993% ( 6600, 9900 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 55 Average: 1512.6182 StdDev: 2065.46 Min: 0 Median: 16.7500 Max: 6116 Percentiles: P50: 16.75 P75: 3321.88 P99: 6116.00 P99.9: 6116.00 P99.99: 6116.00 ------------------------------------------------------ [ 0, 1 ] 12 21.818% 21.818% #### ( 1, 2 ] 7 12.727% 34.545% ### ( 3, 4 ] 1 1.818% 36.364% ( 4, 6 ] 1 1.818% 38.182% ( 6, 10 ] 2 3.636% 41.818% # ( 10, 15 ] 4 7.273% 49.091% # ( 15, 22 ] 2 3.636% 52.727% # ( 110, 170 ] 1 1.818% 54.545% ( 250, 380 ] 2 3.636% 58.182% # ( 580, 870 ] 2 3.636% 61.818% # ( 870, 1300 ] 3 5.455% 67.273% # ( 1900, 2900 ] 2 3.636% 70.909% # ( 2900, 4400 ] 8 14.545% 85.455% ### ( 4400, 6600 ] 8 14.545% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 451.5000 StdDev: 444.86 Min: 107 Median: 236.6667 Max: 1870 Percentiles: P50: 236.67 P75: 725.00 P99: 1780.00 P99.9: 1870.00 P99.99: 1870.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 13 32.500% 37.500% ####### ( 170, 250 ] 6 15.000% 52.500% ### ( 250, 380 ] 5 12.500% 65.000% ### ( 380, 580 ] 2 5.000% 70.000% # ( 580, 870 ] 4 10.000% 80.000% ## ( 870, 1300 ] 6 15.000% 95.000% ### ( 1300, 1900 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 330.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.157 H:M:S, 2.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 343.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-08:10:25 ... thread 0: (1000000,3000000) ops and (351582.8,344605.2) ops/second in (2.844280,8.705615) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.32 GB 212.8 2.0 0.0 2.0 4.8 2.8 0.0 1.7 131.6 310.3 15.78 15.08 52 0.303 2108K 10K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 245.9 244.4 1.28 1.25 1 1.279 319K 1849 0.0 0.0 L2 2/0 60.67 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 1.9 244.6 244.1 0.60 0.58 2 0.299 148K 274 0.0 0.0 L3 15/0 921.98 MB 0.9 0.3 0.2 0.0 0.3 0.2 0.3 1.2 236.7 236.2 1.26 1.22 2 0.630 302K 713 0.0 0.0 L4 126/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 204.3 204.4 0.28 0.26 1 0.276 57K 0 0.0 0.0 L5 120/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 276/4 21.98 GB 0.0 2.8 0.6 2.2 5.6 3.4 1.7 2.0 150.7 297.4 19.19 18.40 58 0.331 2936K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.8 0.6 2.2 5.6 3.4 1.6 2.0 150.7 297.4 19.19 18.40 58 0.331 2936K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.8 0.6 2.2 2.8 0.6 0.0 0.0 252.4 251.2 11.46 11.22 14 0.818 2936K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 365.9 7.74 7.18 44 0.176 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.8 total, 8.7 interval Flush(GB): cumulative 2.765, interval 2.765 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.57 GB write, 648.30 MB/s write, 2.82 GB read, 328.37 MB/s read, 19.2 seconds Interval compaction: 5.57 GB write, 655.56 MB/s write, 2.82 GB read, 332.05 MB/s read, 19.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 655644 Average: 2.0811 StdDev: 6.41 Min: 1 Median: 1.4331 Max: 1866 Percentiles: P50: 1.43 P75: 1.82 P99: 5.63 P99.9: 12.27 P99.99: 20.45 ------------------------------------------------------ [ 0, 1 ] 144384 22.022% 22.022% #### ( 1, 2 ] 423561 64.602% 86.624% ############# ( 2, 3 ] 55726 8.499% 95.123% ## ( 3, 4 ] 17930 2.735% 97.858% # ( 4, 6 ] 9204 1.404% 99.262% ( 6, 10 ] 3764 0.574% 99.836% ( 10, 15 ] 923 0.141% 99.977% ( 15, 22 ] 111 0.017% 99.994% ( 22, 34 ] 38 0.006% 100.000% ( 34, 51 ] 6 0.001% 100.000% ( 51, 76 ] 1 0.000% 100.001% ( 170, 250 ] 43 0.007% 100.007% ( 250, 380 ] 21 0.003% 100.010% ( 380, 580 ] 24 0.004% 100.014% ( 580, 870 ] 5 0.001% 100.015% ( 870, 1300 ] 9 0.001% 100.016% ( 1300, 1900 ] 2 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 36439 Average: 2.5081 StdDev: 6.14 Min: 1 Median: 1.6636 Max: 646 Percentiles: P50: 1.66 P75: 2.20 P99: 7.04 P99.9: 12.90 P99.99: 131.37 ------------------------------------------------------ [ 0, 1 ] 2696 7.399% 7.399% # ( 1, 2 ] 23393 64.198% 71.596% ############# ( 2, 3 ] 6198 17.009% 88.606% ### ( 3, 4 ] 2100 5.763% 94.369% # ( 4, 6 ] 1583 4.344% 98.713% # ( 6, 10 ] 403 1.106% 99.819% ( 10, 15 ] 51 0.140% 99.959% ( 15, 22 ] 8 0.022% 99.981% ( 22, 34 ] 3 0.008% 99.989% ( 110, 170 ] 1 0.003% 99.992% ( 170, 250 ] 1 0.003% 99.995% ( 380, 580 ] 2 0.005% 100.000% ( 580, 870 ] 2 0.005% 100.005% ** Level 2 read latency histogram (micros): Count: 31925 Average: 2.5061 StdDev: 52.39 Min: 0 Median: 1.2336 Max: 4958 Percentiles: P50: 1.23 P75: 1.67 P99: 5.32 P99.9: 9.98 P99.99: 3505.62 ------------------------------------------------------ [ 0, 1 ] 11711 36.683% 36.683% ####### ( 1, 2 ] 18200 57.009% 93.691% ########### ( 2, 3 ] 1088 3.408% 97.099% # ( 3, 4 ] 402 1.259% 98.359% ( 4, 6 ] 311 0.974% 99.333% ( 6, 10 ] 182 0.570% 99.903% ( 10, 15 ] 12 0.038% 99.940% ( 15, 22 ] 4 0.013% 99.953% ( 34, 51 ] 1 0.003% 99.956% ( 51, 76 ] 2 0.006% 99.962% ( 170, 250 ] 1 0.003% 99.966% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 1 0.003% 99.975% ( 580, 870 ] 2 0.006% 99.981% ( 870, 1300 ] 1 0.003% 99.984% ( 1300, 1900 ] 1 0.003% 99.987% ( 2900, 4400 ] 2 0.006% 99.994% ( 4400, 6600 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 27057 Average: 7.1501 StdDev: 138.44 Min: 0 Median: 1.6160 Max: 6829 Percentiles: P50: 1.62 P75: 2.00 P99: 8.94 P99.9: 2267.88 P99.99: 6378.21 ------------------------------------------------------ [ 0, 1 ] 2638 9.750% 9.750% ## ( 1, 2 ] 17680 65.344% 75.093% ############# ( 2, 3 ] 3770 13.934% 89.027% ### ( 3, 4 ] 1449 5.355% 94.382% # ( 4, 6 ] 1005 3.714% 98.097% # ( 6, 10 ] 333 1.231% 99.327% ( 10, 15 ] 100 0.370% 99.697% ( 15, 22 ] 18 0.067% 99.763% ( 22, 34 ] 2 0.007% 99.771% ( 34, 51 ] 3 0.011% 99.782% ( 51, 76 ] 1 0.004% 99.786% ( 76, 110 ] 1 0.004% 99.789% ( 110, 170 ] 7 0.026% 99.815% ( 170, 250 ] 3 0.011% 99.826% ( 250, 380 ] 6 0.022% 99.848% ( 380, 580 ] 6 0.022% 99.871% ( 580, 870 ] 3 0.011% 99.882% ( 870, 1300 ] 1 0.004% 99.885% ( 1300, 1900 ] 1 0.004% 99.889% ( 1900, 2900 ] 8 0.030% 99.919% ( 2900, 4400 ] 13 0.048% 99.967% ( 4400, 6600 ] 7 0.026% 99.993% ( 6600, 9900 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 55 Average: 1512.6182 StdDev: 2065.46 Min: 0 Median: 16.7500 Max: 6116 Percentiles: P50: 16.75 P75: 3321.88 P99: 6116.00 P99.9: 6116.00 P99.99: 6116.00 ------------------------------------------------------ [ 0, 1 ] 12 21.818% 21.818% #### ( 1, 2 ] 7 12.727% 34.545% ### ( 3, 4 ] 1 1.818% 36.364% ( 4, 6 ] 1 1.818% 38.182% ( 6, 10 ] 2 3.636% 41.818% # ( 10, 15 ] 4 7.273% 49.091% # ( 15, 22 ] 2 3.636% 52.727% # ( 110, 170 ] 1 1.818% 54.545% ( 250, 380 ] 2 3.636% 58.182% # ( 580, 870 ] 2 3.636% 61.818% # ( 870, 1300 ] 3 5.455% 67.273% # ( 1900, 2900 ] 2 3.636% 70.909% # ( 2900, 4400 ] 8 14.545% 85.455% ### ( 4400, 6600 ] 8 14.545% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 451.5000 StdDev: 444.86 Min: 107 Median: 236.6667 Max: 1870 Percentiles: P50: 236.67 P75: 725.00 P99: 1780.00 P99.9: 1870.00 P99.99: 1870.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 13 32.500% 37.500% ####### ( 170, 250 ] 6 15.000% 52.500% ### ( 250, 380 ] 5 12.500% 65.000% ### ( 380, 580 ] 2 5.000% 70.000% # ( 580, 870 ] 4 10.000% 80.000% ## ( 870, 1300 ] 6 15.000% 95.000% ### ( 1300, 1900 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.8 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 335.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.157 H:M:S, 1.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 346.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-08:10:28 ... thread 0: (1000000,4000000) ops and (352719.9,346598.6) ops/second in (2.835111,11.540726) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 3.24 GB 281.6 2.8 0.0 2.8 6.4 3.7 0.0 1.7 133.6 311.0 21.19 20.27 70 0.303 2874K 14K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 245.9 244.4 1.28 1.25 1 1.279 319K 1849 0.0 0.0 L2 2/0 60.67 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 1.9 244.6 244.1 0.60 0.58 2 0.299 148K 274 0.0 0.0 L3 15/0 921.98 MB 0.9 0.3 0.2 0.0 0.3 0.2 0.3 1.2 236.7 236.2 1.26 1.22 2 0.630 302K 713 0.0 0.0 L4 126/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 204.3 204.4 0.28 0.26 1 0.276 57K 0 0.0 0.0 L5 120/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 282/8 22.90 GB 0.0 3.6 0.6 2.9 7.2 4.3 1.7 2.0 148.2 300.9 24.61 23.59 76 0.324 3702K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 0.6 2.9 7.2 4.3 1.6 2.0 148.2 300.9 24.61 23.59 76 0.324 3702K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 0.6 2.9 3.5 0.6 0.0 0.0 254.5 253.3 14.33 14.04 17 0.843 3702K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 367.2 10.28 9.55 59 0.174 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.6 total, 11.5 interval Flush(GB): cumulative 3.686, interval 3.686 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.23 GB write, 636.02 MB/s write, 3.56 GB read, 313.26 MB/s read, 24.6 seconds Interval compaction: 7.23 GB write, 641.39 MB/s write, 3.56 GB read, 315.90 MB/s read, 24.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 898305 Average: 2.0615 StdDev: 6.13 Min: 1 Median: 1.4259 Max: 1866 Percentiles: P50: 1.43 P75: 1.81 P99: 5.52 P99.9: 11.93 P99.99: 20.86 ------------------------------------------------------ [ 0, 1 ] 200326 22.300% 22.300% #### ( 1, 2 ] 584192 65.033% 87.333% ############# ( 2, 3 ] 72779 8.102% 95.435% ## ( 3, 4 ] 23328 2.597% 98.032% # ( 4, 6 ] 11463 1.276% 99.308% ( 6, 10 ] 4884 0.544% 99.852% ( 10, 15 ] 1133 0.126% 99.978% ( 15, 22 ] 134 0.015% 99.993% ( 22, 34 ] 42 0.005% 99.997% ( 34, 51 ] 8 0.001% 99.998% ( 51, 76 ] 5 0.001% 99.999% ( 76, 110 ] 1 0.000% 99.999% ( 170, 250 ] 58 0.006% 100.005% ( 250, 380 ] 31 0.003% 100.009% ( 380, 580 ] 30 0.003% 100.012% ( 580, 870 ] 6 0.001% 100.013% ( 870, 1300 ] 13 0.001% 100.014% ( 1300, 1900 ] 2 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 36439 Average: 2.5081 StdDev: 6.14 Min: 1 Median: 1.6636 Max: 646 Percentiles: P50: 1.66 P75: 2.20 P99: 7.04 P99.9: 12.90 P99.99: 131.37 ------------------------------------------------------ [ 0, 1 ] 2696 7.399% 7.399% # ( 1, 2 ] 23393 64.198% 71.596% ############# ( 2, 3 ] 6198 17.009% 88.606% ### ( 3, 4 ] 2100 5.763% 94.369% # ( 4, 6 ] 1583 4.344% 98.713% # ( 6, 10 ] 403 1.106% 99.819% ( 10, 15 ] 51 0.140% 99.959% ( 15, 22 ] 8 0.022% 99.981% ( 22, 34 ] 3 0.008% 99.989% ( 110, 170 ] 1 0.003% 99.992% ( 170, 250 ] 1 0.003% 99.995% ( 380, 580 ] 2 0.005% 100.000% ( 580, 870 ] 2 0.005% 100.005% ** Level 2 read latency histogram (micros): Count: 31925 Average: 2.5061 StdDev: 52.39 Min: 0 Median: 1.2336 Max: 4958 Percentiles: P50: 1.23 P75: 1.67 P99: 5.32 P99.9: 9.98 P99.99: 3505.62 ------------------------------------------------------ [ 0, 1 ] 11711 36.683% 36.683% ####### ( 1, 2 ] 18200 57.009% 93.691% ########### ( 2, 3 ] 1088 3.408% 97.099% # ( 3, 4 ] 402 1.259% 98.359% ( 4, 6 ] 311 0.974% 99.333% ( 6, 10 ] 182 0.570% 99.903% ( 10, 15 ] 12 0.038% 99.940% ( 15, 22 ] 4 0.013% 99.953% ( 34, 51 ] 1 0.003% 99.956% ( 51, 76 ] 2 0.006% 99.962% ( 170, 250 ] 1 0.003% 99.966% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 1 0.003% 99.975% ( 580, 870 ] 2 0.006% 99.981% ( 870, 1300 ] 1 0.003% 99.984% ( 1300, 1900 ] 1 0.003% 99.987% ( 2900, 4400 ] 2 0.006% 99.994% ( 4400, 6600 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 27057 Average: 7.1501 StdDev: 138.44 Min: 0 Median: 1.6160 Max: 6829 Percentiles: P50: 1.62 P75: 2.00 P99: 8.94 P99.9: 2267.88 P99.99: 6378.21 ------------------------------------------------------ [ 0, 1 ] 2638 9.750% 9.750% ## ( 1, 2 ] 17680 65.344% 75.093% ############# ( 2, 3 ] 3770 13.934% 89.027% ### ( 3, 4 ] 1449 5.355% 94.382% # ( 4, 6 ] 1005 3.714% 98.097% # ( 6, 10 ] 333 1.231% 99.327% ( 10, 15 ] 100 0.370% 99.697% ( 15, 22 ] 18 0.067% 99.763% ( 22, 34 ] 2 0.007% 99.771% ( 34, 51 ] 3 0.011% 99.782% ( 51, 76 ] 1 0.004% 99.786% ( 76, 110 ] 1 0.004% 99.789% ( 110, 170 ] 7 0.026% 99.815% ( 170, 250 ] 3 0.011% 99.826% ( 250, 380 ] 6 0.022% 99.848% ( 380, 580 ] 6 0.022% 99.871% ( 580, 870 ] 3 0.011% 99.882% ( 870, 1300 ] 1 0.004% 99.885% ( 1300, 1900 ] 1 0.004% 99.889% ( 1900, 2900 ] 8 0.030% 99.919% ( 2900, 4400 ] 13 0.048% 99.967% ( 4400, 6600 ] 7 0.026% 99.993% ( 6600, 9900 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 55 Average: 1512.6182 StdDev: 2065.46 Min: 0 Median: 16.7500 Max: 6116 Percentiles: P50: 16.75 P75: 3321.88 P99: 6116.00 P99.9: 6116.00 P99.99: 6116.00 ------------------------------------------------------ [ 0, 1 ] 12 21.818% 21.818% #### ( 1, 2 ] 7 12.727% 34.545% ### ( 3, 4 ] 1 1.818% 36.364% ( 4, 6 ] 1 1.818% 38.182% ( 6, 10 ] 2 3.636% 41.818% # ( 10, 15 ] 4 7.273% 49.091% # ( 15, 22 ] 2 3.636% 52.727% # ( 110, 170 ] 1 1.818% 54.545% ( 250, 380 ] 2 3.636% 58.182% # ( 580, 870 ] 2 3.636% 61.818% # ( 870, 1300 ] 3 5.455% 67.273% # ( 1900, 2900 ] 2 3.636% 70.909% # ( 2900, 4400 ] 8 14.545% 85.455% ### ( 4400, 6600 ] 8 14.545% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 451.5000 StdDev: 444.86 Min: 107 Median: 236.6667 Max: 1870 Percentiles: P50: 236.67 P75: 725.00 P99: 1780.00 P99.9: 1870.00 P99.99: 1870.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 13 32.500% 37.500% ####### ( 170, 250 ] 6 15.000% 52.500% ### ( 250, 380 ] 5 12.500% 65.000% ### ( 380, 580 ] 2 5.000% 70.000% # ( 580, 870 ] 4 10.000% 80.000% ## ( 870, 1300 ] 6 15.000% 95.000% ### ( 1300, 1900 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 11.6 total, 2.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 338.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.157 H:M:S, 1.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 347.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.060 micros/op 246274 ops/sec 20.132 seconds 4957999 operations; 238.6 MB/s Microseconds per write: Count: 4957999 Average: 4.0605 StdDev: 77.44 Min: 1 Median: 1.7726 Max: 144336 Percentiles: P50: 1.77 P75: 3.06 P99: 8.97 P99.9: 168.47 P99.99: 2293.85 ------------------------------------------------------ [ 0, 1 ] 608129 12.266% 12.266% ## ( 1, 2 ] 2421467 48.840% 61.105% ########## ( 2, 3 ] 648278 13.075% 74.181% ### ( 3, 4 ] 673508 13.584% 87.765% ### ( 4, 6 ] 509495 10.276% 98.041% ## ( 6, 10 ] 63994 1.291% 99.332% ( 10, 15 ] 17382 0.351% 99.682% ( 15, 22 ] 4851 0.098% 99.780% ( 22, 34 ] 1216 0.025% 99.805% ( 34, 51 ] 197 0.004% 99.809% ( 51, 76 ] 36 0.001% 99.809% ( 76, 110 ] 4 0.000% 99.810% ( 110, 170 ] 4601 0.093% 99.902% ( 170, 250 ] 331 0.007% 99.909% ( 250, 380 ] 87 0.002% 99.911% ( 380, 580 ] 10 0.000% 99.911% ( 580, 870 ] 7 0.000% 99.911% ( 870, 1300 ] 3586 0.072% 99.983% ( 1300, 1900 ] 4 0.000% 99.984% ( 1900, 2900 ] 813 0.016% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 157557 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4957999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5116654968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 142 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5719801 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 6699130307 rocksdb.compact.write.bytes COUNT : 6543852205 rocksdb.flush.write.bytes COUNT : 5079443915 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 17 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 78 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5045446656 rocksdb.memtable.garbage.bytes.at.flush COUNT : 8321024 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 6742702527 rocksdb.non.last.level.read.count COUNT : 1625165 rocksdb.block.checksum.compute.count COUNT : 1624898 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.444558 P95 : 4.834693 P99 : 7.604398 P100 : 144329.000000 COUNT : 4957999 SUM : 17896635 rocksdb.compaction.times.micros P50 : 996000.000000 P95 : 1278590.000000 P99 : 1278590.000000 P100 : 1278590.000000 COUNT : 22 SUM : 19184143 rocksdb.compaction.times.cpu_micros P50 : 996000.000000 P95 : 1254067.000000 P99 : 1254067.000000 P100 : 1254067.000000 COUNT : 22 SUM : 18813804 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 545.853659 P95 : 1106.000000 P99 : 1106.000000 P100 : 1106.000000 COUNT : 76 SUM : 49761 rocksdb.compaction.outfile.sync.micros P50 : 699.411765 P95 : 1113.666667 P99 : 1161.000000 P100 : 1161.000000 COUNT : 52 SUM : 34867 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 88.853659 P95 : 261.916667 P99 : 320.000000 P100 : 320.000000 COUNT : 109 SUM : 11881 rocksdb.table.open.io.micros P50 : 778.421053 P95 : 14900.000000 P99 : 20580.000000 P100 : 20750.000000 COUNT : 142 SUM : 373466 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.462052 P95 : 5.751157 P99 : 9.503104 P100 : 4449.000000 COUNT : 1624629 SUM : 6853563 rocksdb.read.block.get.micros P50 : 363.189655 P95 : 4682.857143 P99 : 6468.000000 P100 : 7013.000000 COUNT : 284 SUM : 247198 rocksdb.write.raw.block.micros P50 : 0.510867 P95 : 0.970648 P99 : 2.919909 P100 : 2505.000000 COUNT : 2815485 SUM : 5310130 rocksdb.numfiles.in.singlecompaction P50 : 3.289474 P95 : 5.350000 P99 : 17.000000 P100 : 17.000000 COUNT : 33 SUM : 120 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561249 P95 : 1154.123398 P99 : 2402.361624 P100 : 144053.000000 COUNT : 40658 SUM : 5724668 rocksdb.sst.read.micros P50 : 1.405007 P95 : 2.914560 P99 : 5.661421 P100 : 6829.000000 COUNT : 1625371 SUM : 3695685 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4957999 SUM : 5116654968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 158510.638298 P95 : 244666.666667 P99 : 330600.000000 P100 : 341735.000000 COUNT : 76 SUM : 13168731 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 81 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0