[2024-12-07 04:54:19.338247] Starting SPDK v25.01-pre git sha1 42416bc2c / DPDK 24.03.0 initialization... [2024-12-07 04:54:19.338423] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4085268 ] Set seed to 1733543659334707 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-07 04:54:19.479699] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-07 04:54:19.583120] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-07 04:54:19.583172] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 4085268' to capture a snapshot of events at runtime. [2024-12-07 04:54:19.583185] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-07 04:54:19.583199] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-07 04:54:19.583209] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid4085268 for offline analysis/debug. [2024-12-07 04:54:19.584533] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 7 04:54:22 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/07-04:54:30 ... thread 0: (1000000,1000000) ops and (132525.7,132525.7) ops/second in (7.545705,7.545705) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 879.89 MB 25.1 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 130.4 6.75 2.86 10 0.675 0 0 0.0 0.0 L1 2/2 165.67 MB 0.0 0.3 0.2 0.0 0.3 0.2 0.0 1.2 116.8 116.1 2.31 1.35 1 2.307 273K 1554 0.0 0.0 L2 2/0 102.20 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 102.5 102.5 1.00 0.50 1 0.997 103K 0 0.0 0.0 L3 36/8 1.89 GB 1.5 2.7 1.9 0.9 2.6 1.8 0.0 1.4 94.9 91.2 29.48 16.37 12 2.457 2064K 9825 0.0 0.0 L4 161/24 11.82 GB 1.0 2.8 1.7 1.1 2.7 1.6 0.6 1.6 114.8 110.4 24.73 15.05 14 1.766 642K 0 0.0 0.0 L5 116/0 9.35 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 327/41 24.18 GB 0.0 5.9 3.9 2.0 6.5 4.6 0.6 7.6 93.5 103.8 64.25 36.13 38 1.691 3083K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 3.9 2.0 6.5 4.6 0.6 7.6 93.5 103.8 64.25 36.13 38 1.691 3083K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 3.9 2.0 5.7 3.7 0.0 0.0 104.5 100.7 57.51 33.27 28 2.054 3083K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 130.4 6.75 2.86 10 0.675 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.6 total, 7.5 interval Flush(GB): cumulative 0.859, interval 0.859 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.51 GB write, 876.09 MB/s write, 5.87 GB read, 788.96 MB/s read, 64.3 seconds Interval compaction: 6.51 GB write, 883.76 MB/s write, 5.87 GB read, 795.86 MB/s read, 64.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 18, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 133409 Average: 44.9853 StdDev: 456.77 Min: 1 Median: 2.2490 Max: 46400 Percentiles: P50: 2.25 P75: 3.39 P99: 943.06 P99.9: 4383.06 P99.99: 15626.22 ------------------------------------------------------ [ 0, 1 ] 2697 2.022% 2.022% ( 1, 2 ] 54720 41.017% 43.038% ######## ( 2, 3 ] 37308 27.965% 71.003% ###### ( 3, 4 ] 13523 10.136% 81.140% ## ( 4, 6 ] 15335 11.495% 92.635% ## ( 6, 10 ] 4034 3.024% 95.658% # ( 10, 15 ] 873 0.654% 96.313% ( 15, 22 ] 160 0.120% 96.433% ( 22, 34 ] 18 0.013% 96.446% ( 34, 51 ] 15 0.011% 96.458% ( 51, 76 ] 11 0.008% 96.466% ( 76, 110 ] 4 0.003% 96.469% ( 110, 170 ] 34 0.025% 96.494% ( 170, 250 ] 170 0.127% 96.622% ( 250, 380 ] 503 0.377% 96.999% ( 380, 580 ] 1276 0.956% 97.955% ( 580, 870 ] 1297 0.972% 98.927% ( 870, 1300 ] 588 0.441% 99.368% ( 1300, 1900 ] 180 0.135% 99.503% ( 1900, 2900 ] 234 0.175% 99.678% ( 2900, 4400 ] 302 0.226% 99.905% ( 4400, 6600 ] 90 0.067% 99.972% ( 6600, 9900 ] 22 0.016% 99.989% ( 9900, 14000 ] 1 0.001% 99.990% ( 14000, 22000 ] 18 0.013% 100.003% ( 22000, 33000 ] 8 0.006% 100.009% ( 33000, 50000 ] 5 0.004% 100.013% ** Level 1 read latency histogram (micros): Count: 64030 Average: 19.5918 StdDev: 376.70 Min: 1 Median: 2.3190 Max: 46722 Percentiles: P50: 2.32 P75: 3.36 P99: 54.50 P99.9: 3955.80 P99.99: 17194.00 ------------------------------------------------------ [ 0, 1 ] 591 0.923% 0.923% ( 1, 2 ] 25163 39.299% 40.222% ######## ( 2, 3 ] 19627 30.653% 70.875% ###### ( 3, 4 ] 7378 11.523% 82.397% ## ( 4, 6 ] 8114 12.672% 95.069% ### ( 6, 10 ] 2014 3.145% 98.215% # ( 10, 15 ] 409 0.639% 98.854% ( 15, 22 ] 54 0.084% 98.938% ( 22, 34 ] 15 0.023% 98.961% ( 34, 51 ] 24 0.037% 98.999% ( 51, 76 ] 5 0.008% 99.007% ( 76, 110 ] 13 0.020% 99.027% ( 110, 170 ] 6 0.009% 99.036% ( 170, 250 ] 38 0.059% 99.096% ( 250, 380 ] 113 0.176% 99.272% ( 380, 580 ] 121 0.189% 99.461% ( 580, 870 ] 117 0.183% 99.644% ( 870, 1300 ] 61 0.095% 99.739% ( 1300, 1900 ] 25 0.039% 99.778% ( 1900, 2900 ] 47 0.073% 99.852% ( 2900, 4400 ] 44 0.069% 99.920% ( 4400, 6600 ] 21 0.033% 99.953% ( 6600, 9900 ] 20 0.031% 99.984% ( 9900, 14000 ] 2 0.003% 99.988% ( 14000, 22000 ] 4 0.006% 99.994% ( 22000, 33000 ] 2 0.003% 99.997% ( 33000, 50000 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 405511 Average: 18.5809 StdDev: 317.37 Min: 1 Median: 2.2429 Max: 42143 Percentiles: P50: 2.24 P75: 3.26 P99: 13.47 P99.9: 1837.53 P99.99: 2974.80 ------------------------------------------------------ [ 0, 1 ] 4955 1.222% 1.222% ( 1, 2 ] 169031 41.683% 42.905% ######## ( 2, 3 ] 118428 29.205% 72.110% ###### ( 3, 4 ] 45354 11.184% 83.294% ## ( 4, 6 ] 49396 12.181% 95.476% ## ( 6, 10 ] 12024 2.965% 98.441% # ( 10, 15 ] 3264 0.805% 99.246% ( 15, 22 ] 574 0.142% 99.387% ( 22, 34 ] 73 0.018% 99.405% ( 34, 51 ] 90 0.022% 99.427% ( 51, 76 ] 59 0.015% 99.442% ( 76, 110 ] 24 0.006% 99.448% ( 110, 170 ] 27 0.007% 99.455% ( 170, 250 ] 86 0.021% 99.476% ( 250, 380 ] 284 0.070% 99.546% ( 380, 580 ] 516 0.127% 99.673% ( 580, 870 ] 463 0.114% 99.787% ( 870, 1300 ] 281 0.069% 99.856% ( 1300, 1900 ] 197 0.049% 99.905% ( 1900, 2900 ] 325 0.080% 99.985% ( 2900, 4400 ] 390 0.096% 100.081% ( 4400, 6600 ] 132 0.033% 100.114% ( 6600, 9900 ] 105 0.026% 100.140% ( 9900, 14000 ] 21 0.005% 100.145% ( 14000, 22000 ] 48 0.012% 100.157% ( 22000, 33000 ] 10 0.002% 100.159% ( 33000, 50000 ] 1 0.000% 100.160% ** Level 3 read latency histogram (micros): Count: 667322 Average: 19.4836 StdDev: 334.88 Min: 1 Median: 2.3274 Max: 55408 Percentiles: P50: 2.33 P75: 3.34 P99: 14.75 P99.9: 1193.39 P99.99: 1915.17 ------------------------------------------------------ [ 0, 1 ] 5564 0.834% 0.834% ( 1, 2 ] 259452 38.880% 39.713% ######## ( 2, 3 ] 209658 31.418% 71.131% ###### ( 3, 4 ] 76340 11.440% 82.571% ## ( 4, 6 ] 85279 12.779% 95.350% ### ( 6, 10 ] 19910 2.984% 98.334% # ( 10, 15 ] 4678 0.701% 99.035% ( 15, 22 ] 667 0.100% 99.135% ( 22, 34 ] 84 0.013% 99.147% ( 34, 51 ] 160 0.024% 99.171% ( 51, 76 ] 135 0.020% 99.192% ( 76, 110 ] 47 0.007% 99.199% ( 110, 170 ] 87 0.013% 99.212% ( 170, 250 ] 238 0.036% 99.247% ( 250, 380 ] 689 0.103% 99.351% ( 380, 580 ] 1497 0.224% 99.575% ( 580, 870 ] 1559 0.234% 99.808% ( 870, 1300 ] 812 0.122% 99.930% ( 1300, 1900 ] 391 0.059% 99.989% ( 1900, 2900 ] 545 0.082% 100.070% ( 2900, 4400 ] 632 0.095% 100.165% ( 4400, 6600 ] 188 0.028% 100.193% ( 6600, 9900 ] 105 0.016% 100.209% ( 9900, 14000 ] 24 0.004% 100.213% ( 14000, 22000 ] 42 0.006% 100.219% ( 22000, 33000 ] 27 0.004% 100.223% ( 33000, 50000 ] 8 0.001% 100.224% ( 50000, 75000 ] 1 0.000% 100.224% ** Level 4 read latency histogram (micros): Count: 544016 Average: 35.1042 StdDev: 491.22 Min: 1 Median: 2.3728 Max: 70156 Percentiles: P50: 2.37 P75: 3.47 P99: 652.37 P99.9: 2459.08 P99.99: 3140.24 ------------------------------------------------------ [ 0, 1 ] 4346 0.799% 0.799% ( 1, 2 ] 204808 37.647% 38.446% ######## ( 2, 3 ] 168604 30.992% 69.439% ###### ( 3, 4 ] 64829 11.917% 81.356% ## ( 4, 6 ] 69466 12.769% 94.125% ### ( 6, 10 ] 16111 2.961% 97.086% # ( 10, 15 ] 3706 0.681% 97.767% ( 15, 22 ] 514 0.094% 97.862% ( 22, 34 ] 107 0.020% 97.881% ( 34, 51 ] 187 0.034% 97.916% ( 51, 76 ] 125 0.023% 97.939% ( 76, 110 ] 47 0.009% 97.947% ( 110, 170 ] 128 0.024% 97.971% ( 170, 250 ] 389 0.072% 98.043% ( 250, 380 ] 1355 0.249% 98.292% ( 380, 580 ] 3071 0.565% 98.856% ( 580, 870 ] 3141 0.577% 99.433% ( 870, 1300 ] 1503 0.276% 99.710% ( 1300, 1900 ] 615 0.113% 99.823% ( 1900, 2900 ] 753 0.138% 99.961% ( 2900, 4400 ] 984 0.181% 100.142% ( 4400, 6600 ] 290 0.053% 100.195% ( 6600, 9900 ] 107 0.020% 100.215% ( 9900, 14000 ] 20 0.004% 100.219% ( 14000, 22000 ] 53 0.010% 100.228% ( 22000, 33000 ] 32 0.006% 100.234% ( 33000, 50000 ] 15 0.003% 100.237% ( 50000, 75000 ] 8 0.001% 100.239% ** Level 5 read latency histogram (micros): Count: 8511 Average: 1190.1357 StdDev: 2336.68 Min: 92 Median: 664.9052 Max: 65853 Percentiles: P50: 664.91 P75: 1102.28 P99: 6966.75 P99.9: 30489.00 P99.99: 65744.50 ------------------------------------------------------ ( 76, 110 ] 5 0.059% 0.059% ( 110, 170 ] 64 0.752% 0.811% ( 170, 250 ] 297 3.490% 4.300% # ( 250, 380 ] 1013 11.902% 16.203% ## ( 380, 580 ] 2228 26.178% 42.380% ##### ( 580, 870 ] 2215 26.025% 68.406% ##### ( 870, 1300 ] 1039 12.208% 80.613% ## ( 1300, 1900 ] 409 4.806% 85.419% # ( 1900, 2900 ] 409 4.806% 90.224% # ( 2900, 4400 ] 557 6.544% 96.769% # ( 4400, 6600 ] 185 2.174% 98.943% ( 6600, 9900 ] 44 0.517% 99.460% ( 9900, 14000 ] 10 0.117% 99.577% ( 14000, 22000 ] 19 0.223% 99.800% ( 22000, 33000 ] 11 0.129% 99.930% ( 33000, 50000 ] 2 0.023% 99.953% ( 50000, 75000 ] 5 0.059% 100.012% ** DB Stats ** Uptime(secs): 7.6 total, 7.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 129.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.676 H:M:S, 35.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.676 H:M:S, 35.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/07-04:54:36 ... thread 0: (1000000,2000000) ops and (155022.4,142894.0) ops/second in (6.450681,13.996386) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 1.59 GB 100.1 0.7 0.0 0.7 2.5 1.8 0.0 1.4 30.5 113.7 22.63 9.52 25 0.905 702K 4540 0.0 0.0 L1 1/0 43.09 MB 4.3 0.7 0.5 0.2 0.7 0.5 0.0 1.4 93.5 92.9 7.34 3.74 2 3.670 697K 4643 0.0 0.0 L2 3/2 197.55 MB 0.6 0.2 0.2 0.1 0.2 0.2 0.3 1.4 107.6 107.2 2.18 1.23 2 1.092 238K 808 0.0 0.0 L3 18/10 1014.65 MB 0.4 2.8 1.9 0.9 2.7 1.8 0.2 1.4 96.0 92.4 30.19 16.89 13 2.322 2167K 11K 0.0 0.0 L4 153/2 9.81 GB 1.0 9.3 2.8 6.5 8.1 1.6 0.7 2.8 123.3 107.0 77.35 46.95 37 2.090 1817K 0 0.0 0.0 L5 147/0 11.39 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 336/22 24.02 GB 0.0 13.7 5.4 8.3 14.2 5.9 3.2 7.7 100.6 104.2 139.69 78.33 79 1.768 5622K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.7 5.4 8.3 14.2 5.9 3.2 7.7 100.6 104.2 139.69 78.33 79 1.768 5622K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.7 5.4 8.3 12.4 4.0 0.0 0.0 111.2 100.3 126.34 72.36 56 2.256 5622K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 141.2 13.35 5.97 23 0.581 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.1 total, 14.0 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.21 GB write, 1034.74 MB/s write, 13.72 GB read, 998.99 MB/s read, 139.7 seconds Interval compaction: 14.21 GB write, 1039.62 MB/s write, 13.72 GB read, 1003.71 MB/s read, 139.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 33, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 382913 Average: 42.0343 StdDev: 485.61 Min: 1 Median: 2.1833 Max: 74181 Percentiles: P50: 2.18 P75: 3.25 P99: 872.18 P99.9: 4046.21 P99.99: 6596.54 ------------------------------------------------------ [ 0, 1 ] 7874 2.056% 2.056% ( 1, 2 ] 164227 42.889% 44.945% ######### ( 2, 3 ] 105616 27.582% 72.527% ###### ( 3, 4 ] 38391 10.026% 82.553% ## ( 4, 6 ] 40384 10.547% 93.100% ## ( 6, 10 ] 10465 2.733% 95.833% # ( 10, 15 ] 2109 0.551% 96.384% ( 15, 22 ] 303 0.079% 96.463% ( 22, 34 ] 34 0.009% 96.472% ( 34, 51 ] 54 0.014% 96.486% ( 51, 76 ] 29 0.008% 96.493% ( 76, 110 ] 10 0.003% 96.496% ( 110, 170 ] 142 0.037% 96.533% ( 170, 250 ] 660 0.172% 96.706% ( 250, 380 ] 1825 0.477% 97.182% ( 380, 580 ] 3393 0.886% 98.068% ( 580, 870 ] 3559 0.929% 98.998% ( 870, 1300 ] 1747 0.456% 99.454% ( 1300, 1900 ] 546 0.143% 99.597% ( 1900, 2900 ] 644 0.168% 99.765% ( 2900, 4400 ] 678 0.177% 99.942% ( 4400, 6600 ] 185 0.048% 99.990% ( 6600, 9900 ] 44 0.011% 100.002% ( 9900, 14000 ] 11 0.003% 100.004% ( 14000, 22000 ] 34 0.009% 100.013% ( 22000, 33000 ] 27 0.007% 100.020% ( 33000, 50000 ] 13 0.003% 100.024% ( 50000, 75000 ] 4 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 126407 Average: 19.4258 StdDev: 352.01 Min: 1 Median: 2.3558 Max: 46722 Percentiles: P50: 2.36 P75: 3.38 P99: 298.11 P99.9: 3398.72 P99.99: 11014.63 ------------------------------------------------------ [ 0, 1 ] 975 0.771% 0.771% ( 1, 2 ] 47800 37.814% 38.586% ######## ( 2, 3 ] 40555 32.083% 70.669% ###### ( 3, 4 ] 14466 11.444% 82.113% ## ( 4, 6 ] 16217 12.829% 94.942% ### ( 6, 10 ] 3952 3.126% 98.068% # ( 10, 15 ] 779 0.616% 98.684% ( 15, 22 ] 104 0.082% 98.767% ( 22, 34 ] 23 0.018% 98.785% ( 34, 51 ] 46 0.036% 98.821% ( 51, 76 ] 16 0.013% 98.834% ( 76, 110 ] 16 0.013% 98.847% ( 110, 170 ] 15 0.012% 98.858% ( 170, 250 ] 89 0.070% 98.929% ( 250, 380 ] 243 0.192% 99.121% ( 380, 580 ] 283 0.224% 99.345% ( 580, 870 ] 344 0.272% 99.617% ( 870, 1300 ] 169 0.134% 99.751% ( 1300, 1900 ] 80 0.063% 99.814% ( 1900, 2900 ] 80 0.063% 99.877% ( 2900, 4400 ] 86 0.068% 99.945% ( 4400, 6600 ] 31 0.025% 99.970% ( 6600, 9900 ] 24 0.019% 99.989% ( 9900, 14000 ] 5 0.004% 99.993% ( 14000, 22000 ] 10 0.008% 100.001% ( 22000, 33000 ] 3 0.002% 100.003% ( 33000, 50000 ] 3 0.002% 100.006% ** Level 2 read latency histogram (micros): Count: 421759 Average: 18.9497 StdDev: 317.81 Min: 1 Median: 2.2499 Max: 42143 Percentiles: P50: 2.25 P75: 3.27 P99: 13.91 P99.9: 1915.51 P99.99: 3071.31 ------------------------------------------------------ [ 0, 1 ] 5095 1.208% 1.208% ( 1, 2 ] 174910 41.472% 42.680% ######## ( 2, 3 ] 123539 29.291% 71.971% ###### ( 3, 4 ] 47277 11.209% 83.180% ## ( 4, 6 ] 51530 12.218% 95.398% ## ( 6, 10 ] 12552 2.976% 98.374% # ( 10, 15 ] 3374 0.800% 99.174% ( 15, 22 ] 602 0.143% 99.317% ( 22, 34 ] 74 0.018% 99.335% ( 34, 51 ] 92 0.022% 99.357% ( 51, 76 ] 60 0.014% 99.371% ( 76, 110 ] 24 0.006% 99.376% ( 110, 170 ] 32 0.008% 99.384% ( 170, 250 ] 106 0.025% 99.409% ( 250, 380 ] 337 0.080% 99.489% ( 380, 580 ] 617 0.146% 99.635% ( 580, 870 ] 578 0.137% 99.772% ( 870, 1300 ] 328 0.078% 99.850% ( 1300, 1900 ] 205 0.049% 99.899% ( 1900, 2900 ] 338 0.080% 99.979% ( 2900, 4400 ] 410 0.097% 100.076% ( 4400, 6600 ] 135 0.032% 100.108% ( 6600, 9900 ] 108 0.026% 100.134% ( 9900, 14000 ] 21 0.005% 100.139% ( 14000, 22000 ] 50 0.012% 100.151% ( 22000, 33000 ] 11 0.003% 100.153% ( 33000, 50000 ] 1 0.000% 100.153% ** Level 3 read latency histogram (micros): Count: 999741 Average: 19.8478 StdDev: 355.24 Min: 1 Median: 2.3326 Max: 56020 Percentiles: P50: 2.33 P75: 3.35 P99: 35.54 P99.9: 1327.44 P99.99: 2326.58 ------------------------------------------------------ [ 0, 1 ] 8151 0.815% 0.815% ( 1, 2 ] 387407 38.751% 39.566% ######## ( 2, 3 ] 313582 31.366% 70.932% ###### ( 3, 4 ] 115142 11.517% 82.450% ## ( 4, 6 ] 127196 12.723% 95.172% ### ( 6, 10 ] 30333 3.034% 98.207% # ( 10, 15 ] 6852 0.685% 98.892% ( 15, 22 ] 937 0.094% 98.986% ( 22, 34 ] 121 0.012% 98.998% ( 34, 51 ] 250 0.025% 99.023% ( 51, 76 ] 200 0.020% 99.043% ( 76, 110 ] 69 0.007% 99.050% ( 110, 170 ] 130 0.013% 99.063% ( 170, 250 ] 483 0.048% 99.111% ( 250, 380 ] 1299 0.130% 99.241% ( 380, 580 ] 2504 0.250% 99.491% ( 580, 870 ] 2630 0.263% 99.754% ( 870, 1300 ] 1428 0.143% 99.897% ( 1300, 1900 ] 596 0.060% 99.957% ( 1900, 2900 ] 776 0.078% 100.035% ( 2900, 4400 ] 874 0.087% 100.122% ( 4400, 6600 ] 222 0.022% 100.144% ( 6600, 9900 ] 134 0.013% 100.158% ( 9900, 14000 ] 37 0.004% 100.161% ( 14000, 22000 ] 68 0.007% 100.168% ( 22000, 33000 ] 41 0.004% 100.172% ( 33000, 50000 ] 19 0.002% 100.174% ( 50000, 75000 ] 3 0.000% 100.174% ** Level 4 read latency histogram (micros): Count: 1703663 Average: 26.2990 StdDev: 444.08 Min: 1 Median: 2.3802 Max: 70156 Percentiles: P50: 2.38 P75: 3.47 P99: 414.65 P99.9: 1289.54 P99.99: 1910.25 ------------------------------------------------------ [ 0, 1 ] 13571 0.797% 0.797% ( 1, 2 ] 638020 37.450% 38.246% ####### ( 2, 3 ] 526722 30.917% 69.164% ###### ( 3, 4 ] 210706 12.368% 81.531% ## ( 4, 6 ] 223977 13.147% 94.678% ### ( 6, 10 ] 52316 3.071% 97.749% # ( 10, 15 ] 12198 0.716% 98.465% ( 15, 22 ] 1599 0.094% 98.559% ( 22, 34 ] 265 0.016% 98.574% ( 34, 51 ] 504 0.030% 98.604% ( 51, 76 ] 422 0.025% 98.629% ( 76, 110 ] 147 0.009% 98.637% ( 110, 170 ] 309 0.018% 98.655% ( 170, 250 ] 1252 0.073% 98.729% ( 250, 380 ] 3497 0.205% 98.934% ( 380, 580 ] 6472 0.380% 99.314% ( 580, 870 ] 6627 0.389% 99.703% ( 870, 1300 ] 3439 0.202% 99.905% ( 1300, 1900 ] 1432 0.084% 99.989% ( 1900, 2900 ] 1721 0.101% 100.090% ( 2900, 4400 ] 1976 0.116% 100.206% ( 4400, 6600 ] 518 0.030% 100.236% ( 6600, 9900 ] 211 0.012% 100.249% ( 9900, 14000 ] 91 0.005% 100.254% ( 14000, 22000 ] 156 0.009% 100.263% ( 22000, 33000 ] 99 0.006% 100.269% ( 33000, 50000 ] 38 0.002% 100.271% ( 50000, 75000 ] 22 0.001% 100.273% ** Level 5 read latency histogram (micros): Count: 16429 Average: 1110.8166 StdDev: 2381.35 Min: 92 Median: 628.6833 Max: 65853 Percentiles: P50: 628.68 P75: 1012.77 P99: 6488.40 P99.9: 36973.36 P99.99: 65853.00 ------------------------------------------------------ ( 76, 110 ] 9 0.055% 0.055% ( 110, 170 ] 145 0.883% 0.937% ( 170, 250 ] 859 5.229% 6.166% # ( 250, 380 ] 2319 14.115% 20.281% ### ( 380, 580 ] 4187 25.485% 45.767% ##### ( 580, 870 ] 4143 25.218% 70.984% ##### ( 870, 1300 ] 1987 12.094% 83.079% ## ( 1300, 1900 ] 706 4.297% 87.376% # ( 1900, 2900 ] 763 4.644% 92.020% # ( 2900, 4400 ] 898 5.466% 97.486% # ( 4400, 6600 ] 262 1.595% 99.081% ( 6600, 9900 ] 61 0.371% 99.452% ( 9900, 14000 ] 15 0.091% 99.543% ( 14000, 22000 ] 32 0.195% 99.738% ( 22000, 33000 ] 24 0.146% 99.884% ( 33000, 50000 ] 11 0.067% 99.951% ( 50000, 75000 ] 9 0.055% 100.006% ** DB Stats ** Uptime(secs): 14.1 total, 6.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 139.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.665 H:M:S, 33.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 152.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.989 H:M:S, 30.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/07-04:54:40 ... thread 0: (1000000,3000000) ops and (265991.2,168957.8) ops/second in (3.759523,17.755909) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.57 GB 237.7 2.0 0.0 2.0 4.8 2.8 0.0 1.7 61.1 146.0 33.95 17.98 46 0.738 2107K 11K 0.0 0.0 L1 1/0 43.09 MB 4.3 0.7 0.5 0.2 0.7 0.5 0.0 1.4 93.5 92.9 7.34 3.74 2 3.670 697K 4643 0.0 0.0 L2 1/0 55.90 MB 0.6 0.2 0.2 0.1 0.2 0.2 0.3 1.4 107.6 107.2 2.18 1.23 2 1.092 238K 808 0.0 0.0 L3 19/0 964.89 MB 1.0 3.5 2.1 1.5 3.4 1.9 0.2 1.6 105.5 102.0 34.15 20.20 15 2.276 2776K 18K 0.0 0.0 L4 153/0 9.51 GB 1.0 9.9 3.0 7.0 8.6 1.7 0.7 2.9 126.8 110.3 80.21 49.56 39 2.057 2206K 6294 0.0 0.0 L5 152/0 11.81 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 341/4 24.92 GB 0.0 16.4 5.7 10.7 17.8 7.0 3.7 6.3 106.3 115.3 157.83 92.71 104 1.518 8026K 42K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.4 5.7 10.7 17.8 7.0 3.7 6.3 106.3 115.3 157.83 92.71 104 1.518 8026K 42K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.4 5.7 10.7 14.9 4.2 0.0 0.0 118.8 108.4 141.15 83.96 65 2.172 8026K 42K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 173.5 16.67 8.75 39 0.428 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.8 total, 17.8 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.77 GB write, 1021.03 MB/s write, 16.38 GB read, 941.10 MB/s read, 157.8 seconds Interval compaction: 17.77 GB write, 1024.83 MB/s write, 16.38 GB read, 944.60 MB/s read, 157.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 33, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 711632 Average: 26.5184 StdDev: 358.44 Min: 0 Median: 1.8762 Max: 74181 Percentiles: P50: 1.88 P75: 2.82 P99: 607.15 P99.9: 2931.37 P99.99: 4329.77 ------------------------------------------------------ [ 0, 1 ] 45615 6.410% 6.410% # ( 1, 2 ] 354050 49.752% 56.162% ########## ( 2, 3 ] 163054 22.913% 79.074% ##### ( 3, 4 ] 55396 7.784% 86.859% ## ( 4, 6 ] 54942 7.721% 94.579% ## ( 6, 10 ] 13932 1.958% 96.537% ( 10, 15 ] 2762 0.388% 96.925% ( 15, 22 ] 390 0.055% 96.980% ( 22, 34 ] 45 0.006% 96.986% ( 34, 51 ] 65 0.009% 96.995% ( 51, 76 ] 32 0.004% 97.000% ( 76, 110 ] 128 0.018% 97.018% ( 110, 170 ] 2342 0.329% 97.347% ( 170, 250 ] 4475 0.629% 97.976% ( 250, 380 ] 2973 0.418% 98.394% ( 380, 580 ] 3968 0.558% 98.951% ( 580, 870 ] 3703 0.520% 99.472% ( 870, 1300 ] 1794 0.252% 99.724% ( 1300, 1900 ] 560 0.079% 99.802% ( 1900, 2900 ] 680 0.096% 99.898% ( 2900, 4400 ] 687 0.097% 99.995% ( 4400, 6600 ] 187 0.026% 100.021% ( 6600, 9900 ] 44 0.006% 100.027% ( 9900, 14000 ] 11 0.002% 100.029% ( 14000, 22000 ] 34 0.005% 100.033% ( 22000, 33000 ] 27 0.004% 100.037% ( 33000, 50000 ] 13 0.002% 100.039% ( 50000, 75000 ] 4 0.001% 100.039% ** Level 1 read latency histogram (micros): Count: 146450 Average: 18.3456 StdDev: 329.83 Min: 1 Median: 2.3016 Max: 46722 Percentiles: P50: 2.30 P75: 3.28 P99: 268.54 P99.9: 3077.81 P99.99: 9550.86 ------------------------------------------------------ [ 0, 1 ] 1615 1.103% 1.103% ( 1, 2 ] 57717 39.411% 40.513% ######## ( 2, 3 ] 46061 31.452% 71.965% ###### ( 3, 4 ] 16000 10.925% 82.890% ## ( 4, 6 ] 17537 11.975% 94.865% ## ( 6, 10 ] 4410 3.011% 97.876% # ( 10, 15 ] 843 0.576% 98.452% ( 15, 22 ] 110 0.075% 98.527% ( 22, 34 ] 28 0.019% 98.546% ( 34, 51 ] 46 0.031% 98.578% ( 51, 76 ] 19 0.013% 98.591% ( 76, 110 ] 23 0.016% 98.606% ( 110, 170 ] 167 0.114% 98.720% ( 170, 250 ] 362 0.247% 98.968% ( 250, 380 ] 333 0.227% 99.195% ( 380, 580 ] 328 0.224% 99.419% ( 580, 870 ] 359 0.245% 99.664% ( 870, 1300 ] 171 0.117% 99.781% ( 1300, 1900 ] 81 0.055% 99.836% ( 1900, 2900 ] 83 0.057% 99.893% ( 2900, 4400 ] 89 0.061% 99.954% ( 4400, 6600 ] 31 0.021% 99.975% ( 6600, 9900 ] 25 0.017% 99.992% ( 9900, 14000 ] 6 0.004% 99.996% ( 14000, 22000 ] 10 0.007% 100.003% ( 22000, 33000 ] 3 0.002% 100.005% ( 33000, 50000 ] 3 0.002% 100.007% ** Level 2 read latency histogram (micros): Count: 422327 Average: 19.2543 StdDev: 317.82 Min: 1 Median: 2.2522 Max: 42143 Percentiles: P50: 2.25 P75: 3.28 P99: 14.74 P99.9: 1922.57 P99.99: 3074.33 ------------------------------------------------------ [ 0, 1 ] 5095 1.206% 1.206% ( 1, 2 ] 174910 41.416% 42.622% ######## ( 2, 3 ] 123539 29.252% 71.874% ###### ( 3, 4 ] 47277 11.194% 83.069% ## ( 4, 6 ] 51530 12.201% 95.270% ## ( 6, 10 ] 12552 2.972% 98.242% # ( 10, 15 ] 3374 0.799% 99.041% ( 15, 22 ] 602 0.143% 99.184% ( 22, 34 ] 74 0.018% 99.201% ( 34, 51 ] 92 0.022% 99.223% ( 51, 76 ] 60 0.014% 99.237% ( 76, 110 ] 33 0.008% 99.245% ( 110, 170 ] 196 0.046% 99.291% ( 170, 250 ] 371 0.088% 99.379% ( 250, 380 ] 413 0.098% 99.477% ( 380, 580 ] 653 0.155% 99.632% ( 580, 870 ] 587 0.139% 99.771% ( 870, 1300 ] 333 0.079% 99.849% ( 1300, 1900 ] 206 0.049% 99.898% ( 1900, 2900 ] 340 0.081% 99.979% ( 2900, 4400 ] 411 0.097% 100.076% ( 4400, 6600 ] 135 0.032% 100.108% ( 6600, 9900 ] 108 0.026% 100.134% ( 9900, 14000 ] 21 0.005% 100.139% ( 14000, 22000 ] 50 0.012% 100.150% ( 22000, 33000 ] 11 0.003% 100.153% ( 33000, 50000 ] 1 0.000% 100.153% ** Level 3 read latency histogram (micros): Count: 1132017 Average: 18.5636 StdDev: 334.69 Min: 1 Median: 2.2893 Max: 56020 Percentiles: P50: 2.29 P75: 3.27 P99: 165.38 P99.9: 1253.28 P99.99: 2211.33 ------------------------------------------------------ [ 0, 1 ] 11050 0.976% 0.976% ( 1, 2 ] 453401 40.052% 41.029% ######## ( 2, 3 ] 351074 31.013% 72.042% ###### ( 3, 4 ] 125356 11.074% 83.115% ## ( 4, 6 ] 136800 12.085% 95.200% ## ( 6, 10 ] 33249 2.937% 98.137% # ( 10, 15 ] 7338 0.648% 98.785% ( 15, 22 ] 997 0.088% 98.874% ( 22, 34 ] 134 0.012% 98.885% ( 34, 51 ] 274 0.024% 98.910% ( 51, 76 ] 205 0.018% 98.928% ( 76, 110 ] 110 0.010% 98.937% ( 110, 170 ] 768 0.068% 99.005% ( 170, 250 ] 1657 0.146% 99.152% ( 250, 380 ] 1726 0.152% 99.304% ( 380, 580 ] 2749 0.243% 99.547% ( 580, 870 ] 2709 0.239% 99.786% ( 870, 1300 ] 1445 0.128% 99.914% ( 1300, 1900 ] 609 0.054% 99.968% ( 1900, 2900 ] 812 0.072% 100.039% ( 2900, 4400 ] 883 0.078% 100.117% ( 4400, 6600 ] 225 0.020% 100.137% ( 6600, 9900 ] 134 0.012% 100.149% ( 9900, 14000 ] 37 0.003% 100.152% ( 14000, 22000 ] 68 0.006% 100.158% ( 22000, 33000 ] 41 0.004% 100.162% ( 33000, 50000 ] 19 0.002% 100.164% ( 50000, 75000 ] 3 0.000% 100.164% ** Level 4 read latency histogram (micros): Count: 1815816 Average: 28.0240 StdDev: 431.79 Min: 1 Median: 2.3655 Max: 70156 Percentiles: P50: 2.37 P75: 3.50 P99: 432.43 P99.9: 1292.56 P99.99: 1958.50 ------------------------------------------------------ [ 0, 1 ] 18511 1.019% 1.019% ( 1, 2 ] 689489 37.971% 38.991% ######## ( 2, 3 ] 546989 30.124% 69.114% ###### ( 3, 4 ] 215686 11.878% 80.993% ## ( 4, 6 ] 228080 12.561% 93.553% ### ( 6, 10 ] 54172 2.983% 96.537% # ( 10, 15 ] 12395 0.683% 97.219% ( 15, 22 ] 1615 0.089% 97.308% ( 22, 34 ] 271 0.015% 97.323% ( 34, 51 ] 517 0.028% 97.352% ( 51, 76 ] 425 0.023% 97.375% ( 76, 110 ] 556 0.031% 97.406% ( 110, 170 ] 7304 0.402% 97.808% ( 170, 250 ] 12814 0.706% 98.514% ( 250, 380 ] 6740 0.371% 98.885% ( 380, 580 ] 7991 0.440% 99.325% ( 580, 870 ] 6992 0.385% 99.710% ( 870, 1300 ] 3515 0.194% 99.903% ( 1300, 1900 ] 1468 0.081% 99.984% ( 1900, 2900 ] 1802 0.099% 100.083% ( 2900, 4400 ] 2025 0.112% 100.195% ( 4400, 6600 ] 523 0.029% 100.224% ( 6600, 9900 ] 211 0.012% 100.235% ( 9900, 14000 ] 91 0.005% 100.240% ( 14000, 22000 ] 156 0.009% 100.249% ( 22000, 33000 ] 99 0.005% 100.254% ( 33000, 50000 ] 38 0.002% 100.257% ( 50000, 75000 ] 22 0.001% 100.258% ** Level 5 read latency histogram (micros): Count: 33742 Average: 664.7347 StdDev: 1726.83 Min: 92 Median: 316.6093 Max: 65853 Percentiles: P50: 316.61 P75: 641.76 P99: 5089.17 P99.9: 26701.58 P99.99: 65627.22 ------------------------------------------------------ ( 76, 110 ] 305 0.904% 0.904% ( 110, 170 ] 5089 15.082% 15.986% ### ( 170, 250 ] 9097 26.960% 42.946% ##### ( 250, 380 ] 4645 13.766% 56.713% ### ( 380, 580 ] 5226 15.488% 72.201% ### ( 580, 870 ] 4435 13.144% 85.345% ### ( 870, 1300 ] 2051 6.078% 91.423% # ( 1300, 1900 ] 723 2.143% 93.566% ( 1900, 2900 ] 814 2.412% 95.978% ( 2900, 4400 ] 935 2.771% 98.749% # ( 4400, 6600 ] 270 0.800% 99.550% ( 6600, 9900 ] 61 0.181% 99.730% ( 9900, 14000 ] 15 0.044% 99.775% ( 14000, 22000 ] 32 0.095% 99.870% ( 22000, 33000 ] 24 0.071% 99.941% ( 33000, 50000 ] 11 0.033% 99.973% ( 50000, 75000 ] 9 0.027% 100.000% ** DB Stats ** Uptime(secs): 17.8 total, 3.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 165.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.665 H:M:S, 26.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 261.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 596.274 micros/op 6680 ops/sec 20.207 seconds 134996 operations; 6.5 MB/s (32999 of 32999 found) Microseconds per read: Count: 134996 Average: 596.3002 StdDev: 2011.69 Min: 3 Median: 271.7455 Max: 140715 Percentiles: P50: 271.75 P75: 528.22 P99: 5015.54 P99.9: 28739.14 P99.99: 84424.15 ------------------------------------------------------ ( 2, 3 ] 15 0.011% 0.011% ( 3, 4 ] 56 0.041% 0.053% ( 4, 6 ] 122 0.090% 0.143% ( 6, 10 ] 232 0.172% 0.315% ( 10, 15 ] 501 0.371% 0.686% ( 15, 22 ] 1765 1.307% 1.993% ( 22, 34 ] 2633 1.950% 3.944% ( 34, 51 ] 1764 1.307% 5.251% ( 51, 76 ] 286 0.212% 5.462% ( 76, 110 ] 66 0.049% 5.511% ( 110, 170 ] 9186 6.805% 12.316% # ( 170, 250 ] 46870 34.720% 47.035% ####### ( 250, 380 ] 23925 17.723% 64.758% #### ( 380, 580 ] 18656 13.820% 78.578% ### ( 580, 870 ] 13548 10.036% 88.614% ## ( 870, 1300 ] 6754 5.003% 93.617% # ( 1300, 1900 ] 2515 1.863% 95.480% ( 1900, 2900 ] 2106 1.560% 97.040% ( 2900, 4400 ] 2432 1.802% 98.841% ( 4400, 6600 ] 765 0.567% 99.408% ( 6600, 9900 ] 290 0.215% 99.623% ( 9900, 14000 ] 134 0.099% 99.722% ( 14000, 22000 ] 172 0.127% 99.850% ( 22000, 33000 ] 111 0.082% 99.932% ( 33000, 50000 ] 45 0.033% 99.965% ( 50000, 75000 ] 30 0.022% 99.987% ( 75000, 110000 ] 13 0.010% 99.997% ( 110000, 170000 ] 4 0.003% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 1722659 rocksdb.bloom.filter.full.positive COUNT : 150951 rocksdb.bloom.filter.full.true.positive COUNT : 134265 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 731 rocksdb.memtable.miss COUNT : 134265 rocksdb.l0.hit COUNT : 12654 rocksdb.l1.hit COUNT : 389 rocksdb.l2andup.hit COUNT : 121222 rocksdb.compaction.key.drop.new COUNT : 1494688 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3687258 rocksdb.number.keys.read COUNT : 134996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3805250256 rocksdb.bytes.read COUNT : 134996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 577 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4664850 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 18483800486 rocksdb.compact.write.bytes COUNT : 16945288675 rocksdb.flush.write.bytes COUNT : 3692686690 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 26 rocksdb.number.superversion_acquires COUNT : 781 rocksdb.number.superversion_releases COUNT : 755 rocksdb.number.superversion_cleanups COUNT : 193 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 231 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3669419008 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7416832 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 18720215541 rocksdb.non.last.level.read.count COUNT : 4497290 rocksdb.block.checksum.compute.count COUNT : 4631536 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 269.755550 P95 : 1744.970131 P99 : 5013.465969 P100 : 140713.000000 COUNT : 134996 SUM : 80371543 rocksdb.db.write.micros P50 : 1.600158 P95 : 5.069856 P99 : 6.996466 P100 : 800462.000000 COUNT : 3687258 SUM : 15236986 rocksdb.compaction.times.micros P50 : 2093548.387097 P95 : 4020000.000000 P99 : 5247816.000000 P100 : 5247816.000000 COUNT : 68 SUM : 144051458 rocksdb.compaction.times.cpu_micros P50 : 1379069.767442 P95 : 1877209.302326 P99 : 2385559.000000 P100 : 2385559.000000 COUNT : 68 SUM : 86811288 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1049.166667 P95 : 9001.666667 P99 : 9123.000000 P100 : 9123.000000 COUNT : 49 SUM : 125119 rocksdb.compaction.outfile.sync.micros P50 : 2946.153846 P95 : 8297.142857 P99 : 24346.666667 P100 : 30738.000000 COUNT : 236 SUM : 813922 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 246.521739 P95 : 2950.000000 P99 : 36387.000000 P100 : 36387.000000 COUNT : 138 SUM : 139148 rocksdb.table.open.io.micros P50 : 5388.607595 P95 : 19492.682927 P99 : 84756.250000 P100 : 103051.000000 COUNT : 577 SUM : 4255505 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.633790 P95 : 9.598371 P99 : 18.888582 P100 : 76508.000000 COUNT : 4478002 SUM : 74735854 rocksdb.read.block.get.micros P50 : 225.547838 P95 : 1447.872233 P99 : 4204.258491 P100 : 74187.000000 COUNT : 153081 SUM : 73723321 rocksdb.write.raw.block.micros P50 : 0.536428 P95 : 1.404700 P99 : 4.082034 P100 : 125985.000000 COUNT : 5012939 SUM : 23837667 rocksdb.numfiles.in.singlecompaction P50 : 3.088889 P95 : 3.988889 P99 : 6.400000 P100 : 7.000000 COUNT : 90 SUM : 297 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 223333.333333 P95 : 792333.333333 P99 : 800262.000000 P100 : 800262.000000 COUNT : 14 SUM : 4664850 rocksdb.sst.read.micros P50 : 2.226504 P95 : 9.214101 P99 : 573.284606 P100 : 74181.000000 COUNT : 4497534 SUM : 132715453 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 134996 SUM : 134996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3687258 SUM : 3805250256 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 242592.592593 P95 : 845500.000000 P99 : 1096046.000000 P100 : 1096046.000000 COUNT : 49 SUM : 18497618 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 235 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0