[2024-11-27 15:12:16.128089] Starting SPDK v25.01-pre git sha1 38b931b23 / DPDK 24.03.0 initialization... [2024-11-27 15:12:16.128270] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4010722 ] Set seed to 1732716736124984 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-27 15:12:16.280232] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-27 15:12:16.398864] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-27 15:12:16.398953] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 4010722' to capture a snapshot of events at runtime. [2024-11-27 15:12:16.398975] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-27 15:12:16.398995] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-27 15:12:16.399011] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid4010722 for offline analysis/debug. [2024-11-27 15:12:16.400598] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 27 15:12:22 2024 CPU: 48 * Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz CPUCache: 30720 KB 2024/11/27-15:12:27 ... thread 0: (1000000,1000000) ops and (203665.6,203665.6) ops/second in (4.910010,4.910010) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 565.00 MB 31.3 0.2 0.0 0.2 1.1 0.9 0.0 1.3 49.3 221.7 5.10 4.71 15 0.340 255K 1183 0.0 0.0 L1 1/0 10.04 MB 1.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 156.3 155.5 1.61 1.57 1 1.610 255K 1256 0.0 0.0 L2 3/2 340.39 MB 1.1 0.2 0.1 0.1 0.2 0.1 0.2 2.6 149.0 148.7 1.08 1.03 1 1.079 163K 327 0.0 0.0 L3 17/11 753.31 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 125.9 125.9 0.48 0.42 1 0.480 61K 0 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 132/0 8.74 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 303/17 20.08 GB 0.0 0.7 0.4 0.3 1.6 1.2 0.3 1.8 87.6 193.8 8.27 7.74 18 0.459 735K 2766 0.0 0.0 Int 0/0 0.00 KB 0.0 0.7 0.4 0.3 1.6 1.2 0.3 1.8 87.6 193.8 8.27 7.74 18 0.459 735K 2766 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.7 0.4 0.3 0.7 0.4 0.0 0.0 154.3 153.7 4.69 4.53 4 1.173 735K 2766 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 246.3 3.58 3.21 14 0.255 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.0 total, 4.9 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.56 GB write, 320.16 MB/s write, 0.71 GB read, 144.74 MB/s read, 8.3 seconds Interval compaction: 1.56 GB write, 326.28 MB/s write, 0.71 GB read, 147.51 MB/s read, 8.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 169995 Average: 3.2371 StdDev: 12.92 Min: 1 Median: 2.4249 Max: 3289 Percentiles: P50: 2.42 P75: 2.85 P99: 9.64 P99.9: 20.90 P99.99: 175.72 ------------------------------------------------------ [ 0, 1 ] 7 0.004% 0.004% ( 1, 2 ] 42445 24.968% 24.972% ##### ( 2, 3 ] 100134 58.904% 83.877% ############ ( 3, 4 ] 16752 9.854% 93.731% ## ( 4, 6 ] 6420 3.777% 97.508% # ( 6, 10 ] 2793 1.643% 99.151% ( 10, 15 ] 738 0.434% 99.585% ( 15, 22 ] 639 0.376% 99.961% ( 22, 34 ] 47 0.028% 99.988% ( 34, 51 ] 4 0.002% 99.991% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 14 0.008% 99.999% ( 380, 580 ] 6 0.004% 100.003% ( 580, 870 ] 3 0.002% 100.005% ( 870, 1300 ] 4 0.002% 100.007% ( 1300, 1900 ] 1 0.001% 100.008% ( 1900, 2900 ] 1 0.001% 100.008% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 17576 Average: 3.7082 StdDev: 18.53 Min: 1 Median: 2.6464 Max: 2100 Percentiles: P50: 2.65 P75: 3.00 P99: 10.38 P99.9: 19.55 P99.99: 974.23 ------------------------------------------------------ [ 0, 1 ] 2 0.011% 0.011% ( 1, 2 ] 656 3.732% 3.744% # ( 2, 3 ] 12578 71.563% 75.307% ############## ( 3, 4 ] 3019 17.177% 92.484% ### ( 4, 6 ] 644 3.664% 96.148% # ( 6, 10 ] 491 2.794% 98.942% # ( 10, 15 ] 146 0.831% 99.772% ( 15, 22 ] 36 0.205% 99.977% ( 170, 250 ] 1 0.006% 99.983% ( 380, 580 ] 2 0.011% 99.994% ( 870, 1300 ] 1 0.006% 100.000% ( 1900, 2900 ] 1 0.006% 100.006% ** Level 2 read latency histogram (micros): Count: 40432 Average: 4.6218 StdDev: 78.32 Min: 1 Median: 2.4155 Max: 11046 Percentiles: P50: 2.42 P75: 2.84 P99: 14.84 P99.9: 223.87 P99.99: 1295.36 ------------------------------------------------------ [ 0, 1 ] 3 0.007% 0.007% ( 1, 2 ] 10388 25.693% 25.700% ##### ( 2, 3 ] 23647 58.486% 84.186% ############ ( 3, 4 ] 3024 7.479% 91.665% # ( 4, 6 ] 1761 4.355% 96.020% # ( 6, 10 ] 885 2.189% 98.209% ( 10, 15 ] 330 0.816% 99.026% ( 15, 22 ] 219 0.542% 99.567% ( 22, 34 ] 25 0.062% 99.629% ( 34, 51 ] 6 0.015% 99.644% ( 51, 76 ] 1 0.002% 99.646% ( 76, 110 ] 33 0.082% 99.728% ( 110, 170 ] 46 0.114% 99.842% ( 170, 250 ] 35 0.087% 99.928% ( 250, 380 ] 13 0.032% 99.960% ( 380, 580 ] 4 0.010% 99.970% ( 580, 870 ] 4 0.010% 99.980% ( 870, 1300 ] 4 0.010% 99.990% ( 1900, 2900 ] 1 0.002% 99.993% ( 4400, 6600 ] 1 0.002% 99.995% ( 6600, 9900 ] 1 0.002% 99.998% ( 9900, 14000 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 77653 Average: 6.9947 StdDev: 136.39 Min: 1 Median: 2.6689 Max: 11055 Percentiles: P50: 2.67 P75: 3.14 P99: 16.96 P99.9: 377.71 P99.99: 8864.54 ------------------------------------------------------ [ 0, 1 ] 5 0.006% 0.006% ( 1, 2 ] 3575 4.604% 4.610% # ( 2, 3 ] 52690 67.853% 72.463% ############## ( 3, 4 ] 14041 18.082% 90.545% #### ( 4, 6 ] 3434 4.422% 94.967% # ( 6, 10 ] 1736 2.236% 97.203% ( 10, 15 ] 1266 1.630% 98.833% ( 15, 22 ] 466 0.600% 99.433% ( 22, 34 ] 47 0.061% 99.494% ( 34, 51 ] 6 0.008% 99.502% ( 51, 76 ] 3 0.004% 99.505% ( 76, 110 ] 3 0.004% 99.509% ( 110, 170 ] 154 0.198% 99.708% ( 170, 250 ] 114 0.147% 99.854% ( 250, 380 ] 37 0.048% 99.902% ( 380, 580 ] 26 0.033% 99.936% ( 580, 870 ] 12 0.015% 99.951% ( 870, 1300 ] 12 0.015% 99.967% ( 1300, 1900 ] 5 0.006% 99.973% ( 2900, 4400 ] 3 0.004% 99.977% ( 4400, 6600 ] 3 0.004% 99.981% ( 6600, 9900 ] 12 0.015% 99.996% ( 9900, 14000 ] 4 0.005% 100.001% ** Level 4 read latency histogram (micros): Count: 20 Average: 4676.0000 StdDev: 4009.47 Min: 587 Median: 2900.0000 Max: 10505 Percentiles: P50: 2900.00 P75: 9900.00 P99: 10505.00 P99.9: 10505.00 P99.99: 10505.00 ------------------------------------------------------ ( 580, 870 ] 3 15.000% 15.000% ### ( 870, 1300 ] 2 10.000% 25.000% ## ( 1300, 1900 ] 4 20.000% 45.000% #### ( 1900, 2900 ] 1 5.000% 50.000% # ( 2900, 4400 ] 2 10.000% 60.000% ## ( 6600, 9900 ] 3 15.000% 75.000% ### ( 9900, 14000 ] 5 25.000% 100.000% ##### ** DB Stats ** Uptime(secs): 5.0 total, 4.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 196.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 200.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/27-15:12:32 ... thread 0: (1000000,2000000) ops and (198142.4,200866.0) ops/second in (5.046876,9.956886) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.53 GB 131.5 1.2 0.0 1.2 3.1 1.8 0.0 1.7 82.2 205.2 15.30 14.34 35 0.437 1277K 6037 0.0 0.0 L1 1/0 10.04 MB 1.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 156.3 155.5 1.61 1.57 1 1.610 255K 1256 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 2.6 149.0 148.7 1.08 1.03 1 1.079 163K 327 0.0 0.0 L3 20/0 961.89 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.0 146.9 146.5 8.08 7.65 4 2.021 1205K 3068 0.0 0.0 L4 146/0 9.60 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 133.4 133.4 0.97 0.90 1 0.965 130K 0 0.0 0.0 L5 136/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 313/4 21.06 GB 0.0 2.9 0.8 2.1 4.7 2.7 0.5 2.6 110.5 179.9 27.04 25.50 42 0.644 3033K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 0.8 2.1 4.7 2.7 0.5 2.6 110.5 179.9 27.04 25.50 42 0.644 3033K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 0.8 2.1 2.9 0.8 0.0 0.0 153.0 152.4 19.52 18.80 12 1.627 3033K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 251.0 7.52 6.70 30 0.251 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.1 total, 10.0 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.75 GB write, 483.80 MB/s write, 2.92 GB read, 297.10 MB/s read, 27.0 seconds Interval compaction: 4.75 GB write, 488.36 MB/s write, 2.92 GB read, 299.90 MB/s read, 27.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 418404 Average: 3.3189 StdDev: 13.90 Min: 1 Median: 2.4852 Max: 3665 Percentiles: P50: 2.49 P75: 2.88 P99: 9.80 P99.9: 21.13 P99.99: 186.43 ------------------------------------------------------ [ 0, 1 ] 14 0.003% 0.003% ( 1, 2 ] 79084 18.901% 18.905% #### ( 2, 3 ] 268159 64.091% 82.996% ############# ( 3, 4 ] 45935 10.979% 93.974% ## ( 4, 6 ] 14324 3.423% 97.398% # ( 6, 10 ] 7056 1.686% 99.084% ( 10, 15 ] 1879 0.449% 99.533% ( 15, 22 ] 1753 0.419% 99.952% ( 22, 34 ] 130 0.031% 99.983% ( 34, 51 ] 18 0.004% 99.988% ( 51, 76 ] 1 0.000% 99.988% ( 76, 110 ] 4 0.001% 99.989% ( 170, 250 ] 30 0.007% 99.996% ( 380, 580 ] 14 0.003% 99.999% ( 580, 870 ] 6 0.001% 100.001% ( 870, 1300 ] 9 0.002% 100.003% ( 1300, 1900 ] 6 0.001% 100.004% ( 1900, 2900 ] 1 0.000% 100.005% ( 2900, 4400 ] 4 0.001% 100.005% ** Level 1 read latency histogram (micros): Count: 61041 Average: 3.8268 StdDev: 12.77 Min: 1 Median: 2.6980 Max: 2100 Percentiles: P50: 2.70 P75: 3.21 P99: 12.15 P99.9: 30.82 P99.99: 519.88 ------------------------------------------------------ [ 0, 1 ] 2 0.003% 0.003% ( 1, 2 ] 1648 2.700% 2.703% # ( 2, 3 ] 41364 67.764% 70.467% ############## ( 3, 4 ] 12941 21.201% 91.668% #### ( 4, 6 ] 2804 4.594% 96.262% # ( 6, 10 ] 1434 2.349% 98.611% ( 10, 15 ] 553 0.906% 99.517% ( 15, 22 ] 220 0.360% 99.877% ( 22, 34 ] 19 0.031% 99.908% ( 34, 51 ] 1 0.002% 99.910% ( 110, 170 ] 14 0.023% 99.933% ( 170, 250 ] 20 0.033% 99.966% ( 250, 380 ] 10 0.016% 99.982% ( 380, 580 ] 7 0.011% 99.993% ( 580, 870 ] 2 0.003% 99.997% ( 870, 1300 ] 1 0.002% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 65604 Average: 4.3096 StdDev: 61.91 Min: 1 Median: 2.4762 Max: 11046 Percentiles: P50: 2.48 P75: 2.87 P99: 15.09 P99.9: 203.99 P99.99: 1079.81 ------------------------------------------------------ [ 0, 1 ] 3 0.005% 0.005% ( 1, 2 ] 13167 20.070% 20.075% #### ( 2, 3 ] 41226 62.841% 82.916% ############# ( 3, 4 ] 5953 9.074% 91.990% ## ( 4, 6 ] 2410 3.674% 95.663% # ( 6, 10 ] 1379 2.102% 97.765% ( 10, 15 ] 805 1.227% 98.992% ( 15, 22 ] 404 0.616% 99.608% ( 22, 34 ] 66 0.101% 99.709% ( 34, 51 ] 14 0.021% 99.730% ( 51, 76 ] 1 0.002% 99.732% ( 76, 110 ] 35 0.053% 99.785% ( 110, 170 ] 55 0.084% 99.869% ( 170, 250 ] 48 0.073% 99.942% ( 250, 380 ] 19 0.029% 99.971% ( 380, 580 ] 5 0.008% 99.979% ( 580, 870 ] 5 0.008% 99.986% ( 870, 1300 ] 5 0.008% 99.994% ( 1900, 2900 ] 1 0.002% 99.995% ( 4400, 6600 ] 1 0.002% 99.997% ( 6600, 9900 ] 1 0.002% 99.998% ( 9900, 14000 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 232506 Average: 5.1981 StdDev: 79.86 Min: 1 Median: 2.6782 Max: 11055 Percentiles: P50: 2.68 P75: 3.16 P99: 14.56 P99.9: 278.43 P99.99: 1138.73 ------------------------------------------------------ [ 0, 1 ] 19 0.008% 0.008% ( 1, 2 ] 9335 4.015% 4.023% # ( 2, 3 ] 157632 67.797% 71.820% ############## ( 3, 4 ] 44821 19.277% 91.097% #### ( 4, 6 ] 9574 4.118% 95.215% # ( 6, 10 ] 5200 2.237% 97.452% ( 10, 15 ] 3944 1.696% 99.148% ( 15, 22 ] 1014 0.436% 99.584% ( 22, 34 ] 124 0.053% 99.637% ( 34, 51 ] 23 0.010% 99.647% ( 51, 76 ] 3 0.001% 99.649% ( 76, 110 ] 14 0.006% 99.655% ( 110, 170 ] 294 0.126% 99.781% ( 170, 250 ] 252 0.108% 99.889% ( 250, 380 ] 112 0.048% 99.938% ( 380, 580 ] 83 0.036% 99.973% ( 580, 870 ] 30 0.013% 99.986% ( 870, 1300 ] 14 0.006% 99.992% ( 1300, 1900 ] 5 0.002% 99.994% ( 2900, 4400 ] 3 0.001% 99.996% ( 4400, 6600 ] 3 0.001% 99.997% ( 6600, 9900 ] 12 0.005% 100.002% ( 9900, 14000 ] 4 0.002% 100.004% ** Level 4 read latency histogram (micros): Count: 50 Average: 1902.2600 StdDev: 3401.10 Min: 1 Median: 87.3333 Max: 10505 Percentiles: P50: 87.33 P75: 1675.00 P99: 10505.00 P99.9: 10505.00 P99.99: 10505.00 ------------------------------------------------------ [ 0, 1 ] 1 2.000% 2.000% ( 1, 2 ] 10 20.000% 22.000% #### ( 2, 3 ] 2 4.000% 26.000% # ( 3, 4 ] 4 8.000% 34.000% ## ( 4, 6 ] 2 4.000% 38.000% # ( 10, 15 ] 1 2.000% 40.000% ( 15, 22 ] 1 2.000% 42.000% ( 22, 34 ] 1 2.000% 44.000% ( 34, 51 ] 2 4.000% 48.000% # ( 76, 110 ] 3 6.000% 54.000% # ( 250, 380 ] 2 4.000% 58.000% # ( 380, 580 ] 1 2.000% 60.000% ( 580, 870 ] 3 6.000% 66.000% # ( 870, 1300 ] 2 4.000% 70.000% # ( 1300, 1900 ] 4 8.000% 78.000% ## ( 1900, 2900 ] 1 2.000% 80.000% ( 2900, 4400 ] 2 4.000% 84.000% # ( 6600, 9900 ] 3 6.000% 90.000% # ( 9900, 14000 ] 5 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 808.0500 StdDev: 1065.53 Min: 119 Median: 250.0000 Max: 4275 Percentiles: P50: 250.00 P75: 797.50 P99: 4100.00 P99.9: 4275.00 P99.99: 4275.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 6 30.000% 50.000% ###### ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 4 20.000% 80.000% #### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 10.1 total, 5.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 195.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 195.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-15:12:36 ... thread 0: (1000000,3000000) ops and (206180.5,202606.8) ops/second in (4.850119,14.807005) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.51 GB 231.7 2.2 0.0 2.2 5.0 2.8 0.0 1.8 90.3 205.2 25.08 23.60 55 0.456 2300K 10K 0.0 0.0 L1 1/0 10.04 MB 1.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 156.3 155.5 1.61 1.57 1 1.610 255K 1256 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 2.6 149.0 148.7 1.08 1.03 1 1.079 163K 327 0.0 0.0 L3 20/0 961.89 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.0 146.9 146.5 8.08 7.65 4 2.021 1205K 3068 0.0 0.0 L4 146/0 9.60 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 133.4 133.4 0.97 0.90 1 0.965 130K 0 0.0 0.0 L5 136/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 317/4 22.04 GB 0.0 3.9 0.8 3.1 6.7 3.6 0.5 2.4 108.4 186.6 36.82 34.76 62 0.594 4055K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 0.8 3.1 6.7 3.6 0.5 2.4 108.4 186.6 36.82 34.76 62 0.594 4055K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 0.8 3.1 3.9 0.8 0.0 0.0 156.2 155.5 25.57 24.71 16 1.598 4055K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 257.3 11.25 10.04 46 0.245 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.9 total, 14.8 interval Flush(GB): cumulative 2.826, interval 2.826 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.71 GB write, 461.11 MB/s write, 3.90 GB read, 267.96 MB/s read, 36.8 seconds Interval compaction: 6.71 GB write, 464.03 MB/s write, 3.90 GB read, 269.66 MB/s read, 36.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 670669 Average: 3.1807 StdDev: 12.67 Min: 1 Median: 2.3845 Max: 3665 Percentiles: P50: 2.38 P75: 2.81 P99: 9.70 P99.9: 21.27 P99.99: 194.23 ------------------------------------------------------ [ 0, 1 ] 33 0.005% 0.005% ( 1, 2 ] 182920 27.274% 27.279% ##### ( 2, 3 ] 396336 59.096% 86.375% ############ ( 3, 4 ] 55031 8.205% 94.580% ## ( 4, 6 ] 20274 3.023% 97.603% # ( 6, 10 ] 10125 1.510% 99.113% ( 10, 15 ] 2247 0.335% 99.448% ( 15, 22 ] 3389 0.505% 99.953% ( 22, 34 ] 204 0.030% 99.984% ( 34, 51 ] 22 0.003% 99.987% ( 51, 76 ] 1 0.000% 99.987% ( 76, 110 ] 6 0.001% 99.988% ( 110, 170 ] 1 0.000% 99.988% ( 170, 250 ] 46 0.007% 99.995% ( 250, 380 ] 2 0.000% 99.995% ( 380, 580 ] 22 0.003% 99.999% ( 580, 870 ] 10 0.001% 100.000% ( 870, 1300 ] 14 0.002% 100.002% ( 1300, 1900 ] 10 0.001% 100.004% ( 1900, 2900 ] 2 0.000% 100.004% ( 2900, 4400 ] 4 0.001% 100.004% ** Level 1 read latency histogram (micros): Count: 61041 Average: 3.8268 StdDev: 12.77 Min: 1 Median: 2.6980 Max: 2100 Percentiles: P50: 2.70 P75: 3.21 P99: 12.15 P99.9: 30.82 P99.99: 519.88 ------------------------------------------------------ [ 0, 1 ] 2 0.003% 0.003% ( 1, 2 ] 1648 2.700% 2.703% # ( 2, 3 ] 41364 67.764% 70.467% ############## ( 3, 4 ] 12941 21.201% 91.668% #### ( 4, 6 ] 2804 4.594% 96.262% # ( 6, 10 ] 1434 2.349% 98.611% ( 10, 15 ] 553 0.906% 99.517% ( 15, 22 ] 220 0.360% 99.877% ( 22, 34 ] 19 0.031% 99.908% ( 34, 51 ] 1 0.002% 99.910% ( 110, 170 ] 14 0.023% 99.933% ( 170, 250 ] 20 0.033% 99.966% ( 250, 380 ] 10 0.016% 99.982% ( 380, 580 ] 7 0.011% 99.993% ( 580, 870 ] 2 0.003% 99.997% ( 870, 1300 ] 1 0.002% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 65604 Average: 4.3096 StdDev: 61.91 Min: 1 Median: 2.4762 Max: 11046 Percentiles: P50: 2.48 P75: 2.87 P99: 15.09 P99.9: 203.99 P99.99: 1079.81 ------------------------------------------------------ [ 0, 1 ] 3 0.005% 0.005% ( 1, 2 ] 13167 20.070% 20.075% #### ( 2, 3 ] 41226 62.841% 82.916% ############# ( 3, 4 ] 5953 9.074% 91.990% ## ( 4, 6 ] 2410 3.674% 95.663% # ( 6, 10 ] 1379 2.102% 97.765% ( 10, 15 ] 805 1.227% 98.992% ( 15, 22 ] 404 0.616% 99.608% ( 22, 34 ] 66 0.101% 99.709% ( 34, 51 ] 14 0.021% 99.730% ( 51, 76 ] 1 0.002% 99.732% ( 76, 110 ] 35 0.053% 99.785% ( 110, 170 ] 55 0.084% 99.869% ( 170, 250 ] 48 0.073% 99.942% ( 250, 380 ] 19 0.029% 99.971% ( 380, 580 ] 5 0.008% 99.979% ( 580, 870 ] 5 0.008% 99.986% ( 870, 1300 ] 5 0.008% 99.994% ( 1900, 2900 ] 1 0.002% 99.995% ( 4400, 6600 ] 1 0.002% 99.997% ( 6600, 9900 ] 1 0.002% 99.998% ( 9900, 14000 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 232506 Average: 5.1981 StdDev: 79.86 Min: 1 Median: 2.6782 Max: 11055 Percentiles: P50: 2.68 P75: 3.16 P99: 14.56 P99.9: 278.43 P99.99: 1138.73 ------------------------------------------------------ [ 0, 1 ] 19 0.008% 0.008% ( 1, 2 ] 9335 4.015% 4.023% # ( 2, 3 ] 157632 67.797% 71.820% ############## ( 3, 4 ] 44821 19.277% 91.097% #### ( 4, 6 ] 9574 4.118% 95.215% # ( 6, 10 ] 5200 2.237% 97.452% ( 10, 15 ] 3944 1.696% 99.148% ( 15, 22 ] 1014 0.436% 99.584% ( 22, 34 ] 124 0.053% 99.637% ( 34, 51 ] 23 0.010% 99.647% ( 51, 76 ] 3 0.001% 99.649% ( 76, 110 ] 14 0.006% 99.655% ( 110, 170 ] 294 0.126% 99.781% ( 170, 250 ] 252 0.108% 99.889% ( 250, 380 ] 112 0.048% 99.938% ( 380, 580 ] 83 0.036% 99.973% ( 580, 870 ] 30 0.013% 99.986% ( 870, 1300 ] 14 0.006% 99.992% ( 1300, 1900 ] 5 0.002% 99.994% ( 2900, 4400 ] 3 0.001% 99.996% ( 4400, 6600 ] 3 0.001% 99.997% ( 6600, 9900 ] 12 0.005% 100.002% ( 9900, 14000 ] 4 0.002% 100.004% ** Level 4 read latency histogram (micros): Count: 50 Average: 1902.2600 StdDev: 3401.10 Min: 1 Median: 87.3333 Max: 10505 Percentiles: P50: 87.33 P75: 1675.00 P99: 10505.00 P99.9: 10505.00 P99.99: 10505.00 ------------------------------------------------------ [ 0, 1 ] 1 2.000% 2.000% ( 1, 2 ] 10 20.000% 22.000% #### ( 2, 3 ] 2 4.000% 26.000% # ( 3, 4 ] 4 8.000% 34.000% ## ( 4, 6 ] 2 4.000% 38.000% # ( 10, 15 ] 1 2.000% 40.000% ( 15, 22 ] 1 2.000% 42.000% ( 22, 34 ] 1 2.000% 44.000% ( 34, 51 ] 2 4.000% 48.000% # ( 76, 110 ] 3 6.000% 54.000% # ( 250, 380 ] 2 4.000% 58.000% # ( 380, 580 ] 1 2.000% 60.000% ( 580, 870 ] 3 6.000% 66.000% # ( 870, 1300 ] 2 4.000% 70.000% # ( 1300, 1900 ] 4 8.000% 78.000% ## ( 1900, 2900 ] 1 2.000% 80.000% ( 2900, 4400 ] 2 4.000% 84.000% # ( 6600, 9900 ] 3 6.000% 90.000% # ( 9900, 14000 ] 5 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 808.0500 StdDev: 1065.53 Min: 119 Median: 250.0000 Max: 4275 Percentiles: P50: 250.00 P75: 797.50 P99: 4100.00 P99.9: 4275.00 P99.99: 4275.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 6 30.000% 50.000% ###### ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 4 20.000% 80.000% #### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 14.9 total, 4.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 198.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 202.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/27-15:12:41 ... thread 0: (1000000,4000000) ops and (198543.6,201575.5) ops/second in (5.036677,19.843682) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/4 3.42 GB 325.5 3.2 0.0 3.2 6.9 3.7 0.0 1.8 94.4 204.8 34.64 32.65 74 0.468 3322K 15K 0.0 0.0 L1 1/0 10.04 MB 1.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 156.3 155.5 1.61 1.57 1 1.610 255K 1256 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 2.6 149.0 148.7 1.08 1.03 1 1.079 163K 327 0.0 0.0 L3 20/0 961.89 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.0 146.9 146.5 8.08 7.65 4 2.021 1205K 3068 0.0 0.0 L4 146/0 9.60 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 133.4 133.4 0.97 0.90 1 0.965 130K 0 0.0 0.0 L5 136/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 320/4 22.95 GB 0.0 4.9 0.8 4.1 8.6 4.6 0.5 2.3 107.8 190.1 46.38 43.81 81 0.573 5077K 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 0.8 4.1 8.6 4.6 0.5 2.3 107.8 190.1 46.38 43.81 81 0.573 5077K 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 0.8 4.1 4.9 0.8 0.0 0.0 158.4 157.8 31.56 30.58 20 1.578 5077K 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 259.0 14.82 13.22 61 0.243 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.9 total, 19.8 interval Flush(GB): cumulative 3.748, interval 3.748 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.61 GB write, 442.20 MB/s write, 4.88 GB read, 250.76 MB/s read, 46.4 seconds Interval compaction: 8.61 GB write, 444.29 MB/s write, 4.88 GB read, 251.94 MB/s read, 46.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 0, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 927950 Average: 3.1250 StdDev: 12.97 Min: 1 Median: 2.3311 Max: 3665 Percentiles: P50: 2.33 P75: 2.77 P99: 9.72 P99.9: 21.33 P99.99: 186.55 ------------------------------------------------------ [ 0, 1 ] 45 0.005% 0.005% ( 1, 2 ] 289726 31.222% 31.227% ###### ( 2, 3 ] 526174 56.703% 87.930% ########### ( 3, 4 ] 64522 6.953% 94.883% # ( 4, 6 ] 26169 2.820% 97.703% # ( 6, 10 ] 12938 1.394% 99.097% ( 10, 15 ] 2730 0.294% 99.392% ( 15, 22 ] 5215 0.562% 99.954% ( 22, 34 ] 287 0.031% 99.984% ( 34, 51 ] 26 0.003% 99.987% ( 51, 76 ] 4 0.000% 99.988% ( 76, 110 ] 9 0.001% 99.989% ( 110, 170 ] 1 0.000% 99.989% ( 170, 250 ] 59 0.006% 99.995% ( 250, 380 ] 4 0.000% 99.996% ( 380, 580 ] 29 0.003% 99.999% ( 580, 870 ] 12 0.001% 100.000% ( 870, 1300 ] 21 0.002% 100.002% ( 1300, 1900 ] 12 0.001% 100.004% ( 1900, 2900 ] 7 0.001% 100.004% ( 2900, 4400 ] 4 0.000% 100.005% ** Level 1 read latency histogram (micros): Count: 61041 Average: 3.8268 StdDev: 12.77 Min: 1 Median: 2.6980 Max: 2100 Percentiles: P50: 2.70 P75: 3.21 P99: 12.15 P99.9: 30.82 P99.99: 519.88 ------------------------------------------------------ [ 0, 1 ] 2 0.003% 0.003% ( 1, 2 ] 1648 2.700% 2.703% # ( 2, 3 ] 41364 67.764% 70.467% ############## ( 3, 4 ] 12941 21.201% 91.668% #### ( 4, 6 ] 2804 4.594% 96.262% # ( 6, 10 ] 1434 2.349% 98.611% ( 10, 15 ] 553 0.906% 99.517% ( 15, 22 ] 220 0.360% 99.877% ( 22, 34 ] 19 0.031% 99.908% ( 34, 51 ] 1 0.002% 99.910% ( 110, 170 ] 14 0.023% 99.933% ( 170, 250 ] 20 0.033% 99.966% ( 250, 380 ] 10 0.016% 99.982% ( 380, 580 ] 7 0.011% 99.993% ( 580, 870 ] 2 0.003% 99.997% ( 870, 1300 ] 1 0.002% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 65604 Average: 4.3096 StdDev: 61.91 Min: 1 Median: 2.4762 Max: 11046 Percentiles: P50: 2.48 P75: 2.87 P99: 15.09 P99.9: 203.99 P99.99: 1079.81 ------------------------------------------------------ [ 0, 1 ] 3 0.005% 0.005% ( 1, 2 ] 13167 20.070% 20.075% #### ( 2, 3 ] 41226 62.841% 82.916% ############# ( 3, 4 ] 5953 9.074% 91.990% ## ( 4, 6 ] 2410 3.674% 95.663% # ( 6, 10 ] 1379 2.102% 97.765% ( 10, 15 ] 805 1.227% 98.992% ( 15, 22 ] 404 0.616% 99.608% ( 22, 34 ] 66 0.101% 99.709% ( 34, 51 ] 14 0.021% 99.730% ( 51, 76 ] 1 0.002% 99.732% ( 76, 110 ] 35 0.053% 99.785% ( 110, 170 ] 55 0.084% 99.869% ( 170, 250 ] 48 0.073% 99.942% ( 250, 380 ] 19 0.029% 99.971% ( 380, 580 ] 5 0.008% 99.979% ( 580, 870 ] 5 0.008% 99.986% ( 870, 1300 ] 5 0.008% 99.994% ( 1900, 2900 ] 1 0.002% 99.995% ( 4400, 6600 ] 1 0.002% 99.997% ( 6600, 9900 ] 1 0.002% 99.998% ( 9900, 14000 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 232506 Average: 5.1981 StdDev: 79.86 Min: 1 Median: 2.6782 Max: 11055 Percentiles: P50: 2.68 P75: 3.16 P99: 14.56 P99.9: 278.43 P99.99: 1138.73 ------------------------------------------------------ [ 0, 1 ] 19 0.008% 0.008% ( 1, 2 ] 9335 4.015% 4.023% # ( 2, 3 ] 157632 67.797% 71.820% ############## ( 3, 4 ] 44821 19.277% 91.097% #### ( 4, 6 ] 9574 4.118% 95.215% # ( 6, 10 ] 5200 2.237% 97.452% ( 10, 15 ] 3944 1.696% 99.148% ( 15, 22 ] 1014 0.436% 99.584% ( 22, 34 ] 124 0.053% 99.637% ( 34, 51 ] 23 0.010% 99.647% ( 51, 76 ] 3 0.001% 99.649% ( 76, 110 ] 14 0.006% 99.655% ( 110, 170 ] 294 0.126% 99.781% ( 170, 250 ] 252 0.108% 99.889% ( 250, 380 ] 112 0.048% 99.938% ( 380, 580 ] 83 0.036% 99.973% ( 580, 870 ] 30 0.013% 99.986% ( 870, 1300 ] 14 0.006% 99.992% ( 1300, 1900 ] 5 0.002% 99.994% ( 2900, 4400 ] 3 0.001% 99.996% ( 4400, 6600 ] 3 0.001% 99.997% ( 6600, 9900 ] 12 0.005% 100.002% ( 9900, 14000 ] 4 0.002% 100.004% ** Level 4 read latency histogram (micros): Count: 50 Average: 1902.2600 StdDev: 3401.10 Min: 1 Median: 87.3333 Max: 10505 Percentiles: P50: 87.33 P75: 1675.00 P99: 10505.00 P99.9: 10505.00 P99.99: 10505.00 ------------------------------------------------------ [ 0, 1 ] 1 2.000% 2.000% ( 1, 2 ] 10 20.000% 22.000% #### ( 2, 3 ] 2 4.000% 26.000% # ( 3, 4 ] 4 8.000% 34.000% ## ( 4, 6 ] 2 4.000% 38.000% # ( 10, 15 ] 1 2.000% 40.000% ( 15, 22 ] 1 2.000% 42.000% ( 22, 34 ] 1 2.000% 44.000% ( 34, 51 ] 2 4.000% 48.000% # ( 76, 110 ] 3 6.000% 54.000% # ( 250, 380 ] 2 4.000% 58.000% # ( 380, 580 ] 1 2.000% 60.000% ( 580, 870 ] 3 6.000% 66.000% # ( 870, 1300 ] 2 4.000% 70.000% # ( 1300, 1900 ] 4 8.000% 78.000% ## ( 1900, 2900 ] 1 2.000% 80.000% ( 2900, 4400 ] 2 4.000% 84.000% # ( 6600, 9900 ] 3 6.000% 90.000% # ( 9900, 14000 ] 5 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 808.0500 StdDev: 1065.53 Min: 119 Median: 250.0000 Max: 4275 Percentiles: P50: 250.00 P75: 797.50 P99: 4100.00 P99.9: 4275.00 P99.99: 4275.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 6 30.000% 50.000% ###### ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 4 20.000% 80.000% #### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 19.9 total, 5.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 197.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.200 H:M:S, 1.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 195.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.200 H:M:S, 4.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.961 micros/op 201558 ops/sec 20.004 seconds 4031999 operations; 195.3 MB/s Microseconds per write: Count: 4031999 Average: 4.9613 StdDev: 12.19 Min: 2 Median: 3.5381 Max: 15983 Percentiles: P50: 3.54 P75: 5.16 P99: 17.59 P99.9: 114.37 P99.99: 229.55 ------------------------------------------------------ ( 1, 2 ] 120791 2.996% 2.996% # ( 2, 3 ] 1247601 30.942% 33.938% ###### ( 3, 4 ] 1203520 29.849% 63.788% ###### ( 4, 6 ] 779298 19.328% 83.115% #### ( 6, 10 ] 580460 14.396% 97.512% ### ( 10, 15 ] 46500 1.153% 98.665% ( 15, 22 ] 36554 0.907% 99.572% ( 22, 34 ] 12072 0.299% 99.871% ( 34, 51 ] 863 0.021% 99.892% ( 51, 76 ] 49 0.001% 99.894% ( 76, 110 ] 7 0.000% 99.894% ( 110, 170 ] 3458 0.086% 99.980% ( 170, 250 ] 568 0.014% 99.994% ( 250, 380 ] 64 0.002% 99.995% ( 380, 580 ] 3 0.000% 99.995% ( 870, 1300 ] 190 0.005% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 20873 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4031999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4161022968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 135 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 199676 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 5343419932 rocksdb.compact.write.bytes COUNT : 5320200335 rocksdb.flush.write.bytes COUNT : 4090273810 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 12 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 78 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4062532608 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6349824 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 5377008084 rocksdb.non.last.level.read.count COUNT : 1294777 rocksdb.block.checksum.compute.count COUNT : 1294519 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 2.605056 P95 : 7.833145 P99 : 15.100830 P100 : 1258.000000 COUNT : 4031999 SUM : 15988644 rocksdb.compaction.times.micros P50 : 1480000.000000 P95 : 1900000.000000 P99 : 5164366.000000 P100 : 5164366.000000 COUNT : 20 SUM : 31559278 rocksdb.compaction.times.cpu_micros P50 : 1450000.000000 P95 : 1900000.000000 P99 : 4884360.000000 P100 : 4884360.000000 COUNT : 20 SUM : 30584232 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 791.621622 P95 : 1756.923077 P99 : 1779.000000 P100 : 1779.000000 COUNT : 62 SUM : 54742 rocksdb.compaction.outfile.sync.micros P50 : 981.800000 P95 : 1758.571429 P99 : 2128.000000 P100 : 2128.000000 COUNT : 53 SUM : 55184 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 142.727273 P95 : 408.000000 P99 : 545.600000 P100 : 571.000000 COUNT : 86 SUM : 14319 rocksdb.table.open.io.micros P50 : 1277.127660 P95 : 22392.857143 P99 : 24863.000000 P100 : 24863.000000 COUNT : 135 SUM : 524016 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 5.657844 P95 : 11.111488 P99 : 20.163108 P100 : 12761.000000 COUNT : 1294135 SUM : 9116088 rocksdb.read.block.get.micros P50 : 492.195122 P95 : 8470.000000 P99 : 11136.000000 P100 : 11136.000000 COUNT : 270 SUM : 397984 rocksdb.write.raw.block.micros P50 : 0.648270 P95 : 1.887070 P99 : 5.737022 P100 : 4123.000000 COUNT : 2279671 SUM : 6636704 rocksdb.numfiles.in.singlecompaction P50 : 3.375000 P95 : 9.200000 P99 : 11.000000 P100 : 11.000000 COUNT : 24 SUM : 93 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560906 P95 : 1096.674731 P99 : 1246.000000 P100 : 1246.000000 COUNT : 1759 SUM : 199943 rocksdb.sst.read.micros P50 : 2.428318 P95 : 4.694103 P99 : 12.389102 P100 : 11055.000000 COUNT : 1294828 SUM : 4758567 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4031999 SUM : 4161022968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 218627.450980 P95 : 352700.000000 P99 : 452200.000000 P100 : 484128.000000 COUNT : 62 SUM : 15042598 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 82 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0