[2024-12-09 11:38:33.022724] Starting SPDK v25.01-pre git sha1 ed6b97c3e / DPDK 24.03.0 initialization... [2024-12-09 11:38:33.022994] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1295149 ] Set seed to 1733740713015863 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-09 11:38:33.203821] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-09 11:38:33.363288] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-09 11:38:33.363346] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1295149' to capture a snapshot of events at runtime. [2024-12-09 11:38:33.363362] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-09 11:38:33.363378] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-09 11:38:33.363390] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1295149 for offline analysis/debug. [2024-12-09 11:38:33.365722] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 9 11:38:40 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/09-11:38:44 ... thread 0: (1000000,1000000) ops and (264598.9,264598.9) ops/second in (3.779305,3.779305) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 566.23 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 276.1 3.19 2.88 14 0.228 0 0 0.0 0.0 L1 3/3 188.13 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 183.9 183.3 1.03 1.00 1 1.026 191K 608 0.0 0.0 L2 2/1 125.63 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 172.5 172.2 0.73 0.71 1 0.729 127K 180 0.0 0.0 L3 9/0 727.81 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 124/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 116/0 8.92 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 263/12 20.09 GB 0.0 0.3 0.2 0.1 1.2 1.1 1.0 1.4 63.6 241.5 4.95 4.58 16 0.309 319K 788 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.2 1.1 0.8 1.4 63.6 241.5 4.95 4.58 16 0.309 319K 788 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 179.2 178.7 1.76 1.70 2 0.878 319K 788 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 276.1 3.19 2.88 14 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.9 total, 3.8 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 305.99 MB/s write, 0.31 GB read, 80.58 MB/s read, 4.9 seconds Interval compaction: 1.17 GB write, 315.78 MB/s write, 0.31 GB read, 83.16 MB/s read, 4.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 126406 Average: 2.6319 StdDev: 7.92 Min: 1 Median: 1.8072 Max: 1632 Percentiles: P50: 1.81 P75: 2.42 P99: 6.43 P99.9: 12.29 P99.99: 223.48 ------------------------------------------------------ [ 0, 1 ] 179 0.142% 0.142% ( 1, 2 ] 78079 61.768% 61.910% ############ ( 2, 3 ] 39579 31.311% 93.221% ###### ( 3, 4 ] 3738 2.957% 96.178% # ( 4, 6 ] 3440 2.721% 98.900% # ( 6, 10 ] 1199 0.949% 99.848% ( 10, 15 ] 150 0.119% 99.967% ( 15, 22 ] 13 0.010% 99.977% ( 22, 34 ] 5 0.004% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 3 0.002% 99.984% ( 76, 110 ] 1 0.001% 99.985% ( 170, 250 ] 14 0.011% 99.996% ( 380, 580 ] 5 0.004% 100.000% ( 580, 870 ] 8 0.006% 100.006% ( 1300, 1900 ] 1 0.001% 100.007% ** Level 1 read latency histogram (micros): Count: 22569 Average: 2.7018 StdDev: 9.35 Min: 1 Median: 1.8808 Max: 1134 Percentiles: P50: 1.88 P75: 2.51 P99: 5.98 P99.9: 9.97 P99.99: 528.60 ------------------------------------------------------ [ 0, 1 ] 17 0.075% 0.075% ( 1, 2 ] 12792 56.680% 56.755% ########### ( 2, 3 ] 8065 35.735% 92.490% ####### ( 3, 4 ] 744 3.297% 95.786% # ( 4, 6 ] 732 3.243% 99.030% # ( 6, 10 ] 199 0.882% 99.911% ( 10, 15 ] 15 0.066% 99.978% ( 15, 22 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.987% ( 170, 250 ] 1 0.004% 99.991% ( 380, 580 ] 1 0.004% 99.996% ( 580, 870 ] 1 0.004% 100.000% ( 870, 1300 ] 1 0.004% 100.004% ** Level 2 read latency histogram (micros): Count: 15038 Average: 5.4388 StdDev: 118.00 Min: 1 Median: 2.4540 Max: 9436 Percentiles: P50: 2.45 P75: 2.90 P99: 9.14 P99.9: 21.95 P99.99: 7418.73 ------------------------------------------------------ [ 0, 1 ] 3 0.020% 0.020% ( 1, 2 ] 3674 24.431% 24.451% ##### ( 2, 3 ] 8463 56.277% 80.729% ########### ( 3, 4 ] 1172 7.794% 88.522% ## ( 4, 6 ] 1258 8.365% 96.888% ## ( 6, 10 ] 406 2.700% 99.588% # ( 10, 15 ] 43 0.286% 99.874% ( 15, 22 ] 5 0.033% 99.907% ( 51, 76 ] 2 0.013% 99.920% ( 110, 170 ] 1 0.007% 99.927% ( 170, 250 ] 1 0.007% 99.934% ( 380, 580 ] 1 0.007% 99.940% ( 870, 1300 ] 5 0.033% 99.973% ( 1300, 1900 ] 1 0.007% 99.980% ( 2900, 4400 ] 1 0.007% 99.987% ( 4400, 6600 ] 1 0.007% 99.993% ( 6600, 9900 ] 2 0.013% 100.007% ** Level 3 read latency histogram (micros): Count: 55 Average: 3921.9455 StdDev: 3185.41 Min: 71 Median: 2775.0000 Max: 11467 Percentiles: P50: 2775.00 P75: 6250.00 P99: 11467.00 P99.9: 11467.00 P99.99: 11467.00 ------------------------------------------------------ ( 51, 76 ] 1 1.818% 1.818% ( 110, 170 ] 1 1.818% 3.636% ( 170, 250 ] 2 3.636% 7.273% # ( 250, 380 ] 1 1.818% 9.091% ( 380, 580 ] 1 1.818% 10.909% ( 580, 870 ] 2 3.636% 14.545% # ( 870, 1300 ] 4 7.273% 21.818% # ( 1300, 1900 ] 12 21.818% 43.636% #### ( 1900, 2900 ] 4 7.273% 50.909% # ( 2900, 4400 ] 4 7.273% 58.182% # ( 4400, 6600 ] 11 20.000% 78.182% #### ( 6600, 9900 ] 9 16.364% 94.545% ### ( 9900, 14000 ] 3 5.455% 100.000% # ** Level 4 read latency histogram (micros): Count: 15 Average: 5435.4667 StdDev: 2581.40 Min: 1404 Median: 5500.0000 Max: 9653 Percentiles: P50: 5500.00 P75: 7837.50 P99: 9653.00 P99.9: 9653.00 P99.99: 9653.00 ------------------------------------------------------ ( 1300, 1900 ] 2 13.333% 13.333% ### ( 1900, 2900 ] 1 6.667% 20.000% # ( 2900, 4400 ] 3 20.000% 40.000% #### ( 4400, 6600 ] 3 20.000% 60.000% #### ( 6600, 9900 ] 6 40.000% 100.000% ######## ** Level 5 read latency histogram (micros): Count: 20 Average: 574.0000 StdDev: 750.75 Min: 61 Median: 76.0000 Max: 2870 Percentiles: P50: 76.00 P75: 870.00 P99: 2700.00 P99.9: 2870.00 P99.99: 2870.00 ------------------------------------------------------ ( 51, 76 ] 10 50.000% 50.000% ########## ( 110, 170 ] 2 10.000% 60.000% ## ( 580, 870 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.9 total, 3.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 252.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 260.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/09-11:38:48 ... thread 0: (1000000,2000000) ops and (256487.9,260480.3) ops/second in (3.898820,7.678125) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.29 GB 106.4 1.0 0.0 1.0 2.8 1.8 0.0 1.5 83.8 240.6 12.01 11.16 34 0.353 1022K 4995 0.0 0.0 L1 1/0 49.77 MB 5.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 179.7 178.5 3.50 3.42 2 1.749 638K 4239 0.0 0.0 L2 2/2 133.54 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 172.5 172.2 0.73 0.71 1 0.729 127K 180 0.0 0.0 L3 23/14 1.08 GB 0.3 0.5 0.4 0.1 0.5 0.4 0.2 1.3 158.8 158.3 3.06 2.88 3 1.021 494K 1610 0.0 0.0 L4 124/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 116/0 8.92 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 275/20 21.06 GB 0.0 2.2 0.9 1.3 4.0 2.7 1.3 2.2 116.5 213.7 19.30 18.16 40 0.482 2282K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.2 0.9 1.3 4.0 2.7 1.2 2.2 116.5 213.7 19.30 18.16 40 0.482 2282K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.2 0.9 1.3 2.2 0.9 0.0 0.0 179.6 178.7 12.51 12.12 10 1.251 2282K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 278.2 6.79 6.04 30 0.226 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.8 total, 7.7 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.03 GB write, 528.51 MB/s write, 2.19 GB read, 288.05 MB/s read, 19.3 seconds Interval compaction: 4.03 GB write, 536.83 MB/s write, 2.19 GB read, 292.59 MB/s read, 19.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 413720 Average: 3.0946 StdDev: 8.20 Min: 1 Median: 2.2891 Max: 1706 Percentiles: P50: 2.29 P75: 2.82 P99: 8.69 P99.9: 13.67 P99.99: 19.54 ------------------------------------------------------ [ 0, 1 ] 211 0.051% 0.051% ( 1, 2 ] 150022 36.262% 36.313% ####### ( 2, 3 ] 195847 47.338% 83.651% ######### ( 3, 4 ] 28483 6.885% 90.535% # ( 4, 6 ] 28913 6.989% 97.524% # ( 6, 10 ] 9073 2.193% 99.717% ( 10, 15 ] 1034 0.250% 99.967% ( 15, 22 ] 149 0.036% 100.003% ( 22, 34 ] 9 0.002% 100.005% ( 34, 51 ] 2 0.000% 100.006% ( 51, 76 ] 5 0.001% 100.007% ( 76, 110 ] 1 0.000% 100.007% ( 170, 250 ] 30 0.007% 100.014% ( 380, 580 ] 5 0.001% 100.015% ( 580, 870 ] 23 0.006% 100.021% ( 870, 1300 ] 6 0.001% 100.022% ( 1300, 1900 ] 4 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 142313 Average: 3.5551 StdDev: 11.05 Min: 1 Median: 2.5176 Max: 1826 Percentiles: P50: 2.52 P75: 2.98 P99: 9.70 P99.9: 20.18 P99.99: 307.69 ------------------------------------------------------ [ 0, 1 ] 27 0.019% 0.019% ( 1, 2 ] 31616 22.216% 22.235% #### ( 2, 3 ] 76340 53.642% 75.877% ########### ( 3, 4 ] 14560 10.231% 86.108% ## ( 4, 6 ] 13681 9.613% 95.721% ## ( 6, 10 ] 5050 3.549% 99.270% # ( 10, 15 ] 799 0.561% 99.831% ( 15, 22 ] 132 0.093% 99.924% ( 22, 34 ] 15 0.011% 99.935% ( 34, 51 ] 3 0.002% 99.937% ( 51, 76 ] 7 0.005% 99.942% ( 76, 110 ] 20 0.014% 99.956% ( 110, 170 ] 21 0.015% 99.970% ( 170, 250 ] 22 0.015% 99.986% ( 250, 380 ] 13 0.009% 99.995% ( 380, 580 ] 12 0.008% 100.004% ( 580, 870 ] 3 0.002% 100.006% ( 870, 1300 ] 3 0.002% 100.008% ( 1300, 1900 ] 3 0.002% 100.010% ** Level 2 read latency histogram (micros): Count: 31404 Average: 4.5905 StdDev: 82.43 Min: 1 Median: 2.4766 Max: 9436 Percentiles: P50: 2.48 P75: 2.91 P99: 9.14 P99.9: 210.85 P99.99: 4189.40 ------------------------------------------------------ [ 0, 1 ] 3 0.010% 0.010% ( 1, 2 ] 7038 22.411% 22.421% #### ( 2, 3 ] 18172 57.865% 80.286% ############ ( 3, 4 ] 2744 8.738% 89.024% ## ( 4, 6 ] 2520 8.024% 97.048% ## ( 6, 10 ] 782 2.490% 99.538% ( 10, 15 ] 85 0.271% 99.809% ( 15, 22 ] 15 0.048% 99.857% ( 51, 76 ] 2 0.006% 99.863% ( 110, 170 ] 7 0.022% 99.885% ( 170, 250 ] 9 0.029% 99.914% ( 250, 380 ] 7 0.022% 99.936% ( 380, 580 ] 8 0.025% 99.962% ( 580, 870 ] 2 0.006% 99.968% ( 870, 1300 ] 5 0.016% 99.984% ( 1300, 1900 ] 1 0.003% 99.987% ( 2900, 4400 ] 1 0.003% 99.990% ( 4400, 6600 ] 1 0.003% 99.994% ( 6600, 9900 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 152266 Average: 5.6410 StdDev: 97.49 Min: 1 Median: 2.5842 Max: 11467 Percentiles: P50: 2.58 P75: 3.22 P99: 11.79 P99.9: 241.16 P99.99: 524.42 ------------------------------------------------------ [ 0, 1 ] 18 0.012% 0.012% ( 1, 2 ] 27750 18.225% 18.237% #### ( 2, 3 ] 82786 54.369% 72.606% ########### ( 3, 4 ] 16595 10.899% 83.505% ## ( 4, 6 ] 17166 11.274% 94.778% ## ( 6, 10 ] 5961 3.915% 98.693% # ( 10, 15 ] 1307 0.858% 99.551% ( 15, 22 ] 202 0.133% 99.684% ( 22, 34 ] 11 0.007% 99.691% ( 34, 51 ] 5 0.003% 99.695% ( 51, 76 ] 5 0.003% 99.698% ( 76, 110 ] 117 0.077% 99.775% ( 110, 170 ] 85 0.056% 99.831% ( 170, 250 ] 120 0.079% 99.909% ( 250, 380 ] 92 0.060% 99.970% ( 380, 580 ] 44 0.029% 99.999% ( 580, 870 ] 11 0.007% 100.006% ( 870, 1300 ] 7 0.005% 100.011% ( 1300, 1900 ] 17 0.011% 100.022% ( 1900, 2900 ] 4 0.003% 100.024% ( 2900, 4400 ] 4 0.003% 100.027% ( 4400, 6600 ] 11 0.007% 100.034% ( 6600, 9900 ] 9 0.006% 100.040% ( 9900, 14000 ] 3 0.002% 100.042% ** Level 4 read latency histogram (micros): Count: 15 Average: 5435.4667 StdDev: 2581.40 Min: 1404 Median: 5500.0000 Max: 9653 Percentiles: P50: 5500.00 P75: 7837.50 P99: 9653.00 P99.9: 9653.00 P99.99: 9653.00 ------------------------------------------------------ ( 1300, 1900 ] 2 13.333% 13.333% ### ( 1900, 2900 ] 1 6.667% 20.000% # ( 2900, 4400 ] 3 20.000% 40.000% #### ( 4400, 6600 ] 3 20.000% 60.000% #### ( 6600, 9900 ] 6 40.000% 100.000% ######## ** Level 5 read latency histogram (micros): Count: 20 Average: 574.0000 StdDev: 750.75 Min: 61 Median: 76.0000 Max: 2870 Percentiles: P50: 76.00 P75: 870.00 P99: 2700.00 P99.9: 2870.00 P99.99: 2870.00 ------------------------------------------------------ ( 51, 76 ] 10 50.000% 50.000% ########## ( 110, 170 ] 2 10.000% 60.000% ## ( 580, 870 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 7.8 total, 3.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 252.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 252.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/09-11:38:52 ... thread 0: (1000000,3000000) ops and (259624.3,260194.3) ops/second in (3.851719,11.529844) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 2.20 GB 175.3 1.7 0.0 1.7 4.5 2.8 0.0 1.6 91.5 238.2 19.24 17.92 52 0.370 1788K 8719 0.0 0.0 L1 1/0 49.77 MB 5.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 179.7 178.5 3.50 3.42 2 1.749 638K 4239 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 172.5 172.2 0.73 0.71 1 0.729 127K 180 0.0 0.0 L3 21/0 976.72 MB 1.0 1.4 0.5 0.9 1.4 0.5 0.2 2.8 170.5 169.6 8.46 7.94 5 1.691 1464K 7283 0.0 0.0 L4 127/0 9.54 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 155.0 155.0 1.65 1.52 1 1.651 259K 0 0.0 0.0 L5 120/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 284/8 21.97 GB 0.0 4.1 1.2 2.9 6.9 4.0 1.6 2.5 125.5 209.2 33.58 31.52 61 0.550 4279K 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.1 1.2 2.9 6.9 4.0 1.5 2.5 125.5 209.2 33.58 31.52 61 0.550 4279K 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.1 1.2 2.9 4.1 1.2 0.0 0.0 180.1 179.2 23.40 22.48 16 1.462 4279K 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 278.2 10.18 9.03 45 0.226 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.7 total, 11.5 interval Flush(GB): cumulative 2.765, interval 2.765 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.86 GB write, 602.68 MB/s write, 4.11 GB read, 361.53 MB/s read, 33.6 seconds Interval compaction: 6.86 GB write, 609.00 MB/s write, 4.11 GB read, 365.32 MB/s read, 33.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 660532 Average: 3.0736 StdDev: 8.24 Min: 1 Median: 2.3045 Max: 1706 Percentiles: P50: 2.30 P75: 2.80 P99: 8.39 P99.9: 13.39 P99.99: 19.77 ------------------------------------------------------ [ 0, 1 ] 247 0.037% 0.037% ( 1, 2 ] 229235 34.705% 34.742% ####### ( 2, 3 ] 330943 50.102% 84.844% ########## ( 3, 4 ] 44437 6.727% 91.572% # ( 4, 6 ] 41672 6.309% 97.881% # ( 6, 10 ] 12374 1.873% 99.754% ( 10, 15 ] 1426 0.216% 99.970% ( 15, 22 ] 198 0.030% 100.000% ( 22, 34 ] 13 0.002% 100.002% ( 34, 51 ] 6 0.001% 100.003% ( 51, 76 ] 9 0.001% 100.004% ( 76, 110 ] 2 0.000% 100.005% ( 170, 250 ] 45 0.007% 100.011% ( 380, 580 ] 6 0.001% 100.012% ( 580, 870 ] 36 0.005% 100.018% ( 870, 1300 ] 11 0.002% 100.019% ( 1300, 1900 ] 6 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 145853 Average: 3.5517 StdDev: 10.92 Min: 1 Median: 2.5186 Max: 1826 Percentiles: P50: 2.52 P75: 2.98 P99: 9.71 P99.9: 20.16 P99.99: 304.15 ------------------------------------------------------ [ 0, 1 ] 27 0.019% 0.019% ( 1, 2 ] 32127 22.027% 22.045% #### ( 2, 3 ] 78621 53.904% 75.950% ########### ( 3, 4 ] 14877 10.200% 86.150% ## ( 4, 6 ] 13953 9.566% 95.716% ## ( 6, 10 ] 5167 3.543% 99.259% # ( 10, 15 ] 832 0.570% 99.829% ( 15, 22 ] 140 0.096% 99.925% ( 22, 34 ] 16 0.011% 99.936% ( 34, 51 ] 3 0.002% 99.938% ( 51, 76 ] 7 0.005% 99.943% ( 76, 110 ] 20 0.014% 99.957% ( 110, 170 ] 21 0.014% 99.971% ( 170, 250 ] 22 0.015% 99.986% ( 250, 380 ] 13 0.009% 99.995% ( 380, 580 ] 12 0.008% 100.003% ( 580, 870 ] 3 0.002% 100.005% ( 870, 1300 ] 3 0.002% 100.008% ( 1300, 1900 ] 3 0.002% 100.010% ** Level 2 read latency histogram (micros): Count: 72773 Average: 4.3215 StdDev: 56.26 Min: 1 Median: 2.4166 Max: 9436 Percentiles: P50: 2.42 P75: 2.86 P99: 9.66 P99.9: 299.36 P99.99: 1282.97 ------------------------------------------------------ [ 0, 1 ] 6 0.008% 0.008% ( 1, 2 ] 19430 26.699% 26.708% ##### ( 2, 3 ] 40684 55.905% 82.613% ########### ( 3, 4 ] 5651 7.765% 90.378% ## ( 4, 6 ] 4684 6.436% 96.815% # ( 6, 10 ] 1738 2.388% 99.203% ( 10, 15 ] 317 0.436% 99.639% ( 15, 22 ] 33 0.045% 99.684% ( 22, 34 ] 2 0.003% 99.687% ( 34, 51 ] 1 0.001% 99.688% ( 51, 76 ] 4 0.005% 99.694% ( 76, 110 ] 43 0.059% 99.753% ( 110, 170 ] 42 0.058% 99.810% ( 170, 250 ] 47 0.065% 99.875% ( 250, 380 ] 48 0.066% 99.941% ( 380, 580 ] 27 0.037% 99.978% ( 580, 870 ] 2 0.003% 99.981% ( 870, 1300 ] 7 0.010% 99.990% ( 1300, 1900 ] 3 0.004% 99.995% ( 2900, 4400 ] 1 0.001% 99.996% ( 4400, 6600 ] 1 0.001% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 260278 Average: 5.0066 StdDev: 75.49 Min: 1 Median: 2.5358 Max: 11467 Percentiles: P50: 2.54 P75: 2.98 P99: 11.40 P99.9: 258.42 P99.99: 555.60 ------------------------------------------------------ [ 0, 1 ] 26 0.010% 0.010% ( 1, 2 ] 51575 19.815% 19.825% #### ( 2, 3 ] 146587 56.319% 76.145% ########### ( 3, 4 ] 26295 10.103% 86.247% ## ( 4, 6 ] 23891 9.179% 95.426% ## ( 6, 10 ] 8747 3.361% 98.787% # ( 10, 15 ] 1981 0.761% 99.548% ( 15, 22 ] 282 0.108% 99.657% ( 22, 34 ] 15 0.006% 99.662% ( 34, 51 ] 6 0.002% 99.665% ( 51, 76 ] 8 0.003% 99.668% ( 76, 110 ] 217 0.083% 99.751% ( 110, 170 ] 169 0.065% 99.816% ( 170, 250 ] 207 0.080% 99.895% ( 250, 380 ] 181 0.070% 99.965% ( 380, 580 ] 74 0.028% 99.993% ( 580, 870 ] 25 0.010% 100.003% ( 870, 1300 ] 12 0.005% 100.008% ( 1300, 1900 ] 18 0.007% 100.015% ( 1900, 2900 ] 4 0.002% 100.016% ( 2900, 4400 ] 4 0.002% 100.018% ( 4400, 6600 ] 11 0.004% 100.022% ( 6600, 9900 ] 9 0.003% 100.025% ( 9900, 14000 ] 3 0.001% 100.027% ** Level 4 read latency histogram (micros): Count: 50 Average: 1697.1800 StdDev: 2829.52 Min: 2 Median: 34.0000 Max: 9653 Percentiles: P50: 34.00 P75: 2400.00 P99: 9625.00 P99.9: 9653.00 P99.99: 9653.00 ------------------------------------------------------ ( 1, 2 ] 15 30.000% 30.000% ###### ( 2, 3 ] 8 16.000% 46.000% ### ( 15, 22 ] 1 2.000% 48.000% ( 22, 34 ] 1 2.000% 50.000% ( 170, 250 ] 6 12.000% 62.000% ## ( 380, 580 ] 4 8.000% 70.000% ## ( 1300, 1900 ] 2 4.000% 74.000% # ( 1900, 2900 ] 1 2.000% 76.000% ( 2900, 4400 ] 3 6.000% 82.000% # ( 4400, 6600 ] 3 6.000% 88.000% # ( 6600, 9900 ] 6 12.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 40 Average: 636.7000 StdDev: 775.45 Min: 61 Median: 196.6667 Max: 2999 Percentiles: P50: 196.67 P75: 1085.00 P99: 2999.00 P99.9: 2999.00 P99.99: 2999.00 ------------------------------------------------------ ( 51, 76 ] 15 37.500% 37.500% ######## ( 110, 170 ] 4 10.000% 47.500% ## ( 170, 250 ] 3 7.500% 55.000% ## ( 250, 380 ] 1 2.500% 57.500% # ( 380, 580 ] 1 2.500% 60.000% # ( 580, 870 ] 5 12.500% 72.500% ### ( 870, 1300 ] 2 5.000% 77.500% # ( 1300, 1900 ] 7 17.500% 95.000% #### ( 1900, 2900 ] 1 2.500% 97.500% # ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 11.7 total, 3.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 253.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 255.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/09-11:38:55 ... thread 0: (1000000,4000000) ops and (264465.7,261249.2) ops/second in (3.781209,15.311053) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 3.18 GB 275.4 2.7 0.0 2.7 6.4 3.7 0.0 1.7 99.5 237.0 27.81 26.04 72 0.386 2811K 13K 0.0 0.0 L1 1/0 49.77 MB 5.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 179.7 178.5 3.50 3.42 2 1.749 638K 4239 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 172.5 172.2 0.73 0.71 1 0.729 127K 180 0.0 0.0 L3 21/0 976.72 MB 1.0 1.4 0.5 0.9 1.4 0.5 0.2 2.8 170.5 169.6 8.46 7.94 5 1.691 1464K 7283 0.0 0.0 L4 127/0 9.54 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 155.0 155.0 1.65 1.52 1 1.651 259K 0 0.0 0.0 L5 120/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 288/8 22.95 GB 0.0 5.1 1.2 3.9 8.8 5.0 1.6 2.4 123.9 214.3 42.15 39.63 81 0.520 5301K 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 1.2 3.9 8.8 5.0 1.5 2.4 123.9 214.3 42.15 39.63 81 0.520 5301K 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 1.2 3.9 5.1 1.2 0.0 0.0 183.4 182.5 28.46 27.45 20 1.423 5301K 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 280.5 13.68 12.18 61 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.3 interval Flush(GB): cumulative 3.748, interval 3.748 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.82 GB write, 585.15 MB/s write, 5.10 GB read, 338.18 MB/s read, 42.1 seconds Interval compaction: 8.82 GB write, 589.77 MB/s write, 5.10 GB read, 340.85 MB/s read, 42.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 908403 Average: 2.9777 StdDev: 8.45 Min: 1 Median: 2.2223 Max: 1706 Percentiles: P50: 2.22 P75: 2.75 P99: 7.96 P99.9: 12.97 P99.99: 20.17 ------------------------------------------------------ [ 0, 1 ] 326 0.036% 0.036% ( 1, 2 ] 357531 39.358% 39.394% ######## ( 2, 3 ] 433309 47.700% 87.094% ########## ( 3, 4 ] 52793 5.812% 92.906% # ( 4, 6 ] 48435 5.332% 98.238% # ( 6, 10 ] 14143 1.557% 99.795% ( 10, 15 ] 1613 0.178% 99.972% ( 15, 22 ] 221 0.024% 99.996% ( 22, 34 ] 18 0.002% 99.998% ( 34, 51 ] 9 0.001% 99.999% ( 51, 76 ] 12 0.001% 100.001% ( 76, 110 ] 2 0.000% 100.001% ( 170, 250 ] 61 0.007% 100.008% ( 380, 580 ] 9 0.001% 100.009% ( 580, 870 ] 48 0.005% 100.014% ( 870, 1300 ] 17 0.002% 100.016% ( 1300, 1900 ] 9 0.001% 100.017% ** Level 1 read latency histogram (micros): Count: 145853 Average: 3.5517 StdDev: 10.92 Min: 1 Median: 2.5186 Max: 1826 Percentiles: P50: 2.52 P75: 2.98 P99: 9.71 P99.9: 20.16 P99.99: 304.15 ------------------------------------------------------ [ 0, 1 ] 27 0.019% 0.019% ( 1, 2 ] 32127 22.027% 22.045% #### ( 2, 3 ] 78621 53.904% 75.950% ########### ( 3, 4 ] 14877 10.200% 86.150% ## ( 4, 6 ] 13953 9.566% 95.716% ## ( 6, 10 ] 5167 3.543% 99.259% # ( 10, 15 ] 832 0.570% 99.829% ( 15, 22 ] 140 0.096% 99.925% ( 22, 34 ] 16 0.011% 99.936% ( 34, 51 ] 3 0.002% 99.938% ( 51, 76 ] 7 0.005% 99.943% ( 76, 110 ] 20 0.014% 99.957% ( 110, 170 ] 21 0.014% 99.971% ( 170, 250 ] 22 0.015% 99.986% ( 250, 380 ] 13 0.009% 99.995% ( 380, 580 ] 12 0.008% 100.003% ( 580, 870 ] 3 0.002% 100.005% ( 870, 1300 ] 3 0.002% 100.008% ( 1300, 1900 ] 3 0.002% 100.010% ** Level 2 read latency histogram (micros): Count: 72773 Average: 4.3215 StdDev: 56.26 Min: 1 Median: 2.4166 Max: 9436 Percentiles: P50: 2.42 P75: 2.86 P99: 9.66 P99.9: 299.36 P99.99: 1282.97 ------------------------------------------------------ [ 0, 1 ] 6 0.008% 0.008% ( 1, 2 ] 19430 26.699% 26.708% ##### ( 2, 3 ] 40684 55.905% 82.613% ########### ( 3, 4 ] 5651 7.765% 90.378% ## ( 4, 6 ] 4684 6.436% 96.815% # ( 6, 10 ] 1738 2.388% 99.203% ( 10, 15 ] 317 0.436% 99.639% ( 15, 22 ] 33 0.045% 99.684% ( 22, 34 ] 2 0.003% 99.687% ( 34, 51 ] 1 0.001% 99.688% ( 51, 76 ] 4 0.005% 99.694% ( 76, 110 ] 43 0.059% 99.753% ( 110, 170 ] 42 0.058% 99.810% ( 170, 250 ] 47 0.065% 99.875% ( 250, 380 ] 48 0.066% 99.941% ( 380, 580 ] 27 0.037% 99.978% ( 580, 870 ] 2 0.003% 99.981% ( 870, 1300 ] 7 0.010% 99.990% ( 1300, 1900 ] 3 0.004% 99.995% ( 2900, 4400 ] 1 0.001% 99.996% ( 4400, 6600 ] 1 0.001% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 260278 Average: 5.0066 StdDev: 75.49 Min: 1 Median: 2.5358 Max: 11467 Percentiles: P50: 2.54 P75: 2.98 P99: 11.40 P99.9: 258.42 P99.99: 555.60 ------------------------------------------------------ [ 0, 1 ] 26 0.010% 0.010% ( 1, 2 ] 51575 19.815% 19.825% #### ( 2, 3 ] 146587 56.319% 76.145% ########### ( 3, 4 ] 26295 10.103% 86.247% ## ( 4, 6 ] 23891 9.179% 95.426% ## ( 6, 10 ] 8747 3.361% 98.787% # ( 10, 15 ] 1981 0.761% 99.548% ( 15, 22 ] 282 0.108% 99.657% ( 22, 34 ] 15 0.006% 99.662% ( 34, 51 ] 6 0.002% 99.665% ( 51, 76 ] 8 0.003% 99.668% ( 76, 110 ] 217 0.083% 99.751% ( 110, 170 ] 169 0.065% 99.816% ( 170, 250 ] 207 0.080% 99.895% ( 250, 380 ] 181 0.070% 99.965% ( 380, 580 ] 74 0.028% 99.993% ( 580, 870 ] 25 0.010% 100.003% ( 870, 1300 ] 12 0.005% 100.008% ( 1300, 1900 ] 18 0.007% 100.015% ( 1900, 2900 ] 4 0.002% 100.016% ( 2900, 4400 ] 4 0.002% 100.018% ( 4400, 6600 ] 11 0.004% 100.022% ( 6600, 9900 ] 9 0.003% 100.025% ( 9900, 14000 ] 3 0.001% 100.027% ** Level 4 read latency histogram (micros): Count: 50 Average: 1697.1800 StdDev: 2829.52 Min: 2 Median: 34.0000 Max: 9653 Percentiles: P50: 34.00 P75: 2400.00 P99: 9625.00 P99.9: 9653.00 P99.99: 9653.00 ------------------------------------------------------ ( 1, 2 ] 15 30.000% 30.000% ###### ( 2, 3 ] 8 16.000% 46.000% ### ( 15, 22 ] 1 2.000% 48.000% ( 22, 34 ] 1 2.000% 50.000% ( 170, 250 ] 6 12.000% 62.000% ## ( 380, 580 ] 4 8.000% 70.000% ## ( 1300, 1900 ] 2 4.000% 74.000% # ( 1900, 2900 ] 1 2.000% 76.000% ( 2900, 4400 ] 3 6.000% 82.000% # ( 4400, 6600 ] 3 6.000% 88.000% # ( 6600, 9900 ] 6 12.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 40 Average: 636.7000 StdDev: 775.45 Min: 61 Median: 196.6667 Max: 2999 Percentiles: P50: 196.67 P75: 1085.00 P99: 2999.00 P99.9: 2999.00 P99.99: 2999.00 ------------------------------------------------------ ( 51, 76 ] 15 37.500% 37.500% ######## ( 110, 170 ] 4 10.000% 47.500% ## ( 170, 250 ] 3 7.500% 55.000% ## ( 250, 380 ] 1 2.500% 57.500% # ( 380, 580 ] 1 2.500% 60.000% # ( 580, 870 ] 5 12.500% 72.500% ### ( 870, 1300 ] 2 5.000% 77.500% # ( 1300, 1900 ] 7 17.500% 95.000% #### ( 1900, 2900 ] 1 2.500% 97.500% # ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 15.4 total, 3.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 255.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 260.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.291 micros/op 233038 ops/sec 20.001 seconds 4660999 operations; 225.8 MB/s Microseconds per write: Count: 4660999 Average: 4.2911 StdDev: 28.58 Min: 1 Median: 2.7174 Max: 25678 Percentiles: P50: 2.72 P75: 4.07 P99: 9.62 P99.9: 134.30 P99.99: 1257.86 ------------------------------------------------------ [ 0, 1 ] 1145 0.025% 0.025% ( 1, 2 ] 840664 18.036% 18.061% #### ( 2, 3 ] 2075220 44.523% 62.584% ######### ( 3, 4 ] 547251 11.741% 74.325% ## ( 4, 6 ] 959899 20.594% 94.919% #### ( 6, 10 ] 210420 4.514% 99.434% # ( 10, 15 ] 15041 0.323% 99.756% ( 15, 22 ] 3057 0.066% 99.822% ( 22, 34 ] 1713 0.037% 99.859% ( 34, 51 ] 181 0.004% 99.863% ( 51, 76 ] 19 0.000% 99.863% ( 76, 110 ] 3 0.000% 99.863% ( 110, 170 ] 4260 0.091% 99.954% ( 170, 250 ] 361 0.008% 99.962% ( 250, 380 ] 114 0.002% 99.965% ( 380, 580 ] 6 0.000% 99.965% ( 870, 1300 ] 1307 0.028% 99.993% ( 1300, 1900 ] 1 0.000% 99.993% ( 1900, 2900 ] 336 0.007% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 66226 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4660999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4810150968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 163 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 2100341 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 6974812298 rocksdb.compact.write.bytes COUNT : 6907426360 rocksdb.flush.write.bytes COUNT : 4749860799 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 15 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 98 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4717795328 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7521280 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 7014872972 rocksdb.non.last.level.read.count COUNT : 1690285 rocksdb.block.checksum.compute.count COUNT : 1689974 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.968926 P95 : 5.649256 P99 : 8.901975 P100 : 2422.000000 COUNT : 4660999 SUM : 16785489 rocksdb.compaction.times.micros P50 : 1488235.294118 P95 : 2700000.000000 P99 : 3964000.000000 P100 : 4022317.000000 COUNT : 24 SUM : 33494906 rocksdb.compaction.times.cpu_micros P50 : 1488235.294118 P95 : 2700000.000000 P99 : 3762292.000000 P100 : 3762292.000000 COUNT : 24 SUM : 32394186 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 716.470588 P95 : 1770.000000 P99 : 1905.000000 P100 : 1905.000000 COUNT : 72 SUM : 62864 rocksdb.compaction.outfile.sync.micros P50 : 870.000000 P95 : 1583.000000 P99 : 1583.000000 P100 : 1583.000000 COUNT : 70 SUM : 64446 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 118.461538 P95 : 287.916667 P99 : 378.916667 P100 : 418.000000 COUNT : 105 SUM : 14426 rocksdb.table.open.io.micros P50 : 1162.710843 P95 : 23038.888889 P99 : 31007.777778 P100 : 31671.000000 COUNT : 163 SUM : 550446 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 5.096155 P95 : 8.937279 P99 : 12.997202 P100 : 6530.000000 COUNT : 1689638 SUM : 10027448 rocksdb.read.block.get.micros P50 : 583.625000 P95 : 5940.000000 P99 : 9278.500000 P100 : 11846.000000 COUNT : 326 SUM : 360729 rocksdb.write.raw.block.micros P50 : 0.539680 P95 : 1.436838 P99 : 4.316799 P100 : 6568.000000 COUNT : 2823640 SUM : 6785102 rocksdb.numfiles.in.singlecompaction P50 : 3.394737 P95 : 8.700000 P99 : 18.000000 P100 : 18.000000 COUNT : 33 SUM : 139 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.568501 P95 : 1184.882669 P99 : 2251.000000 P100 : 2251.000000 COUNT : 13702 SUM : 2101863 rocksdb.sst.read.micros P50 : 2.292248 P95 : 5.121445 P99 : 8.903386 P100 : 11467.000000 COUNT : 1690550 SUM : 5911644 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4660999 SUM : 4810150968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210563.380282 P95 : 247070.422535 P99 : 411835.000000 P100 : 411835.000000 COUNT : 72 SUM : 16150434 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 101 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0