[2024-11-20 10:50:44.786409] Starting SPDK v25.01-pre git sha1 ace52fb4b / DPDK 24.03.0 initialization... [2024-11-20 10:50:44.786718] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2247297 ] Set seed to 1732096244779207 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 10:50:44.941089] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 10:50:45.050376] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 10:50:45.050428] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2247297' to capture a snapshot of events at runtime. [2024-11-20 10:50:45.050441] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 10:50:45.050471] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 10:50:45.050490] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2247297 for offline analysis/debug. [2024-11-20 10:50:45.051852] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 10:50:48 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/20-10:50:55 ... thread 0: (1000000,1000000) ops and (130419.3,130419.3) ops/second in (7.667576,7.667576) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.30 GB 50.1 0.3 0.0 0.3 1.2 0.9 0.0 1.4 33.9 128.5 9.28 4.24 11 0.844 319K 1798 0.0 0.0 L1 2/2 111.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/1 128.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 29/9 1.60 GB 1.1 2.2 1.6 0.6 2.1 1.6 0.0 1.3 91.6 90.4 24.33 13.28 11 2.212 1868K 7579 0.0 0.0 L4 164/26 11.88 GB 1.0 2.9 1.7 1.3 2.8 1.5 0.1 1.7 107.1 101.7 28.16 16.33 14 2.011 627K 0 0.0 0.0 L5 116/0 9.10 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 324/47 24.12 GB 0.0 5.4 3.3 2.1 6.1 4.0 0.1 7.1 90.0 101.3 61.77 33.86 36 1.716 2814K 9377 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 3.3 2.1 6.1 4.0 0.1 7.1 90.0 101.3 61.77 33.86 36 1.716 2814K 9377 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 3.3 2.1 5.2 3.1 0.0 0.0 101.6 98.2 54.72 31.02 26 2.105 2814K 9377 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 124.8 7.05 2.83 10 0.705 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.7 total, 7.7 interval Flush(GB): cumulative 0.859, interval 0.859 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.11 GB write, 807.79 MB/s write, 5.43 GB read, 718.06 MB/s read, 61.8 seconds Interval compaction: 6.11 GB write, 815.62 MB/s write, 5.43 GB read, 725.01 MB/s read, 61.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 28, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 198855 Average: 49.6643 StdDev: 549.03 Min: 1 Median: 2.1853 Max: 52850 Percentiles: P50: 2.19 P75: 3.19 P99: 1102.77 P99.9: 4671.36 P99.99: 13773.09 ------------------------------------------------------ [ 0, 1 ] 3779 1.900% 1.900% ( 1, 2 ] 85196 42.843% 44.744% ######### ( 2, 3 ] 56408 28.366% 73.110% ###### ( 3, 4 ] 19604 9.858% 82.968% ## ( 4, 6 ] 20177 10.147% 93.115% ## ( 6, 10 ] 5445 2.738% 95.853% # ( 10, 15 ] 1014 0.510% 96.363% ( 15, 22 ] 146 0.073% 96.437% ( 22, 34 ] 25 0.013% 96.449% ( 34, 51 ] 41 0.021% 96.470% ( 51, 76 ] 23 0.012% 96.481% ( 76, 110 ] 13 0.007% 96.488% ( 110, 170 ] 49 0.025% 96.513% ( 170, 250 ] 235 0.118% 96.631% ( 250, 380 ] 828 0.416% 97.047% ( 380, 580 ] 1560 0.784% 97.832% ( 580, 870 ] 1787 0.899% 98.730% ( 870, 1300 ] 991 0.498% 99.229% ( 1300, 1900 ] 398 0.200% 99.429% ( 1900, 2900 ] 387 0.195% 99.623% ( 2900, 4400 ] 533 0.268% 99.891% ( 4400, 6600 ] 139 0.070% 99.961% ( 6600, 9900 ] 42 0.021% 99.982% ( 9900, 14000 ] 16 0.008% 99.990% ( 14000, 22000 ] 22 0.011% 100.002% ( 22000, 33000 ] 11 0.006% 100.007% ( 33000, 50000 ] 12 0.006% 100.013% ( 50000, 75000 ] 2 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 15360 Average: 24.2197 StdDev: 364.11 Min: 1 Median: 2.5180 Max: 26959 Percentiles: P50: 2.52 P75: 3.71 P99: 503.39 P99.9: 4254.29 P99.99: 19856.00 ------------------------------------------------------ [ 0, 1 ] 76 0.495% 0.495% ( 1, 2 ] 4944 32.188% 32.682% ###### ( 2, 3 ] 5135 33.431% 66.113% ####### ( 3, 4 ] 1934 12.591% 78.704% ### ( 4, 6 ] 2376 15.469% 94.173% ### ( 6, 10 ] 527 3.431% 97.604% # ( 10, 15 ] 116 0.755% 98.359% ( 15, 22 ] 13 0.085% 98.444% ( 22, 34 ] 3 0.020% 98.464% ( 34, 51 ] 2 0.013% 98.477% ( 51, 76 ] 2 0.013% 98.490% ( 76, 110 ] 2 0.013% 98.503% ( 110, 170 ] 2 0.013% 98.516% ( 170, 250 ] 12 0.078% 98.594% ( 250, 380 ] 26 0.169% 98.763% ( 380, 580 ] 59 0.384% 99.147% ( 580, 870 ] 52 0.339% 99.486% ( 870, 1300 ] 32 0.208% 99.694% ( 1300, 1900 ] 10 0.065% 99.759% ( 1900, 2900 ] 9 0.059% 99.818% ( 2900, 4400 ] 14 0.091% 99.909% ( 4400, 6600 ] 9 0.059% 99.967% ( 6600, 9900 ] 2 0.013% 99.980% ( 14000, 22000 ] 2 0.013% 99.993% ( 22000, 33000 ] 1 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 359060 Average: 23.4610 StdDev: 487.11 Min: 1 Median: 2.2574 Max: 93218 Percentiles: P50: 2.26 P75: 3.25 P99: 13.70 P99.9: 2123.33 P99.99: 3438.43 ------------------------------------------------------ [ 0, 1 ] 4783 1.332% 1.332% ( 1, 2 ] 147145 40.981% 42.313% ######## ( 2, 3 ] 107230 29.864% 72.177% ###### ( 3, 4 ] 40221 11.202% 83.379% ## ( 4, 6 ] 43498 12.114% 95.493% ## ( 6, 10 ] 10518 2.929% 98.422% # ( 10, 15 ] 2804 0.781% 99.203% ( 15, 22 ] 467 0.130% 99.333% ( 22, 34 ] 70 0.019% 99.353% ( 34, 51 ] 101 0.028% 99.381% ( 51, 76 ] 84 0.023% 99.404% ( 76, 110 ] 19 0.005% 99.410% ( 110, 170 ] 23 0.006% 99.416% ( 170, 250 ] 80 0.022% 99.438% ( 250, 380 ] 269 0.075% 99.513% ( 380, 580 ] 466 0.130% 99.643% ( 580, 870 ] 438 0.122% 99.765% ( 870, 1300 ] 236 0.066% 99.831% ( 1300, 1900 ] 194 0.054% 99.885% ( 1900, 2900 ] 246 0.069% 99.953% ( 2900, 4400 ] 368 0.102% 100.056% ( 4400, 6600 ] 144 0.040% 100.096% ( 6600, 9900 ] 79 0.022% 100.118% ( 9900, 14000 ] 24 0.007% 100.124% ( 14000, 22000 ] 70 0.019% 100.144% ( 22000, 33000 ] 39 0.011% 100.155% ( 33000, 50000 ] 4 0.001% 100.156% ( 50000, 75000 ] 2 0.001% 100.157% ( 75000, 110000 ] 1 0.000% 100.157% ** Level 3 read latency histogram (micros): Count: 581524 Average: 18.9541 StdDev: 362.00 Min: 1 Median: 2.3195 Max: 49043 Percentiles: P50: 2.32 P75: 3.27 P99: 13.92 P99.9: 1174.72 P99.99: 1920.54 ------------------------------------------------------ [ 0, 1 ] 4881 0.839% 0.839% ( 1, 2 ] 226206 38.899% 39.738% ######## ( 2, 3 ] 186788 32.120% 71.859% ###### ( 3, 4 ] 66674 11.465% 83.324% ## ( 4, 6 ] 71170 12.239% 95.563% ## ( 6, 10 ] 17160 2.951% 98.513% # ( 10, 15 ] 3605 0.620% 99.133% ( 15, 22 ] 492 0.085% 99.218% ( 22, 34 ] 108 0.019% 99.236% ( 34, 51 ] 213 0.037% 99.273% ( 51, 76 ] 143 0.025% 99.298% ( 76, 110 ] 42 0.007% 99.305% ( 110, 170 ] 60 0.010% 99.315% ( 170, 250 ] 194 0.033% 99.349% ( 250, 380 ] 584 0.100% 99.449% ( 380, 580 ] 1121 0.193% 99.642% ( 580, 870 ] 1077 0.185% 99.827% ( 870, 1300 ] 599 0.103% 99.930% ( 1300, 1900 ] 341 0.059% 99.989% ( 1900, 2900 ] 382 0.066% 100.054% ( 2900, 4400 ] 506 0.087% 100.141% ( 4400, 6600 ] 146 0.025% 100.166% ( 6600, 9900 ] 75 0.013% 100.179% ( 9900, 14000 ] 27 0.005% 100.184% ( 14000, 22000 ] 51 0.009% 100.193% ( 22000, 33000 ] 36 0.006% 100.199% ( 33000, 50000 ] 9 0.002% 100.201% ** Level 4 read latency histogram (micros): Count: 655315 Average: 31.2299 StdDev: 439.27 Min: 1 Median: 2.3621 Max: 65612 Percentiles: P50: 2.36 P75: 3.44 P99: 542.13 P99.9: 1597.61 P99.99: 2115.24 ------------------------------------------------------ [ 0, 1 ] 5847 0.892% 0.892% ( 1, 2 ] 248654 37.944% 38.836% ######## ( 2, 3 ] 202045 30.832% 69.668% ###### ( 3, 4 ] 79106 12.071% 81.740% ## ( 4, 6 ] 83480 12.739% 94.479% ### ( 6, 10 ] 19643 2.997% 97.476% # ( 10, 15 ] 4042 0.617% 98.093% ( 15, 22 ] 495 0.076% 98.168% ( 22, 34 ] 97 0.015% 98.183% ( 34, 51 ] 181 0.028% 98.211% ( 51, 76 ] 157 0.024% 98.235% ( 76, 110 ] 48 0.007% 98.242% ( 110, 170 ] 134 0.020% 98.263% ( 170, 250 ] 600 0.092% 98.354% ( 250, 380 ] 1734 0.265% 98.619% ( 380, 580 ] 3085 0.471% 99.089% ( 580, 870 ] 3164 0.483% 99.572% ( 870, 1300 ] 1737 0.265% 99.837% ( 1300, 1900 ] 832 0.127% 99.964% ( 1900, 2900 ] 792 0.121% 100.085% ( 2900, 4400 ] 977 0.149% 100.234% ( 4400, 6600 ] 282 0.043% 100.277% ( 6600, 9900 ] 119 0.018% 100.295% ( 9900, 14000 ] 29 0.004% 100.300% ( 14000, 22000 ] 55 0.008% 100.308% ( 22000, 33000 ] 33 0.005% 100.313% ( 33000, 50000 ] 20 0.003% 100.316% ( 50000, 75000 ] 4 0.001% 100.317% ** Level 5 read latency histogram (micros): Count: 7933 Average: 1259.5166 StdDev: 3015.14 Min: 105 Median: 651.1661 Max: 106170 Percentiles: P50: 651.17 P75: 1119.18 P99: 8800.30 P99.9: 46883.69 P99.99: 106170.00 ------------------------------------------------------ ( 76, 110 ] 3 0.038% 0.038% ( 110, 170 ] 71 0.895% 0.933% ( 170, 250 ] 402 5.067% 6.000% # ( 250, 380 ] 1155 14.559% 20.560% ### ( 380, 580 ] 1882 23.724% 44.283% ##### ( 580, 870 ] 1848 23.295% 67.578% ##### ( 870, 1300 ] 1016 12.807% 80.386% ### ( 1300, 1900 ] 399 5.030% 85.415% # ( 1900, 2900 ] 401 5.055% 90.470% # ( 2900, 4400 ] 491 6.189% 96.660% # ( 4400, 6600 ] 161 2.029% 98.689% ( 6600, 9900 ] 37 0.466% 99.155% ( 9900, 14000 ] 14 0.176% 99.332% ( 14000, 22000 ] 16 0.202% 99.534% ( 22000, 33000 ] 16 0.202% 99.735% ( 33000, 50000 ] 16 0.202% 99.937% ( 50000, 75000 ] 3 0.038% 99.975% ( 75000, 110000 ] 1 0.013% 99.987% ** DB Stats ** Uptime(secs): 7.7 total, 7.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 127.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.663 H:M:S, 34.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 128.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.663 H:M:S, 34.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/20-10:51:00 ... thread 0: (1000000,2000000) ops and (228592.6,166083.0) ops/second in (4.374595,12.042171) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 1.84 GB 100.1 0.9 0.0 0.9 2.7 1.8 0.0 1.5 54.8 171.9 16.06 9.56 28 0.574 893K 4841 0.0 0.0 L1 3/0 221.58 MB 22.2 0.6 0.4 0.1 0.6 0.4 0.0 1.2 60.3 59.7 9.45 3.54 1 9.446 578K 6153 0.0 0.0 L2 1/0 67.52 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/1 1.07 GB 1.0 2.7 1.8 0.9 2.7 1.8 0.2 1.5 100.3 98.9 27.54 15.90 13 2.119 2408K 15K 0.0 0.0 L4 149/5 9.75 GB 1.0 6.2 2.2 4.0 5.5 1.5 0.5 2.5 124.2 110.7 50.92 31.40 23 2.214 1171K 0 0.0 0.0 L5 148/0 11.63 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 335/18 24.56 GB 0.0 10.3 4.5 5.8 11.4 5.6 3.5 6.2 101.3 112.4 103.97 60.39 65 1.600 5052K 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.3 4.5 5.8 11.4 5.6 3.5 6.2 101.3 112.4 103.97 60.39 65 1.600 5052K 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.3 4.5 5.8 9.6 3.7 0.0 0.0 113.6 105.6 92.75 54.48 40 2.319 5052K 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 168.1 11.22 5.91 25 0.449 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 12.0 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.41 GB write, 964.17 MB/s write, 10.29 GB read, 869.38 MB/s read, 104.0 seconds Interval compaction: 11.41 GB write, 970.12 MB/s write, 10.29 GB read, 874.74 MB/s read, 104.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 41, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 447717 Average: 40.2109 StdDev: 441.96 Min: 1 Median: 1.8860 Max: 52850 Percentiles: P50: 1.89 P75: 2.87 P99: 770.07 P99.9: 3724.85 P99.99: 5541.29 ------------------------------------------------------ [ 0, 1 ] 22867 5.107% 5.107% # ( 1, 2 ] 226865 50.672% 55.779% ########## ( 2, 3 ] 99365 22.194% 77.973% #### ( 3, 4 ] 33891 7.570% 85.542% ## ( 4, 6 ] 29919 6.683% 92.225% # ( 6, 10 ] 8388 1.874% 94.099% ( 10, 15 ] 1483 0.331% 94.430% ( 15, 22 ] 230 0.051% 94.481% ( 22, 34 ] 49 0.011% 94.492% ( 34, 51 ] 47 0.010% 94.503% ( 51, 76 ] 37 0.008% 94.511% ( 76, 110 ] 83 0.019% 94.529% ( 110, 170 ] 2096 0.468% 94.998% ( 170, 250 ] 7096 1.585% 96.582% ( 250, 380 ] 4983 1.113% 97.695% ( 380, 580 ] 3929 0.878% 98.573% ( 580, 870 ] 2920 0.652% 99.225% ( 870, 1300 ] 1512 0.338% 99.563% ( 1300, 1900 ] 591 0.132% 99.695% ( 1900, 2900 ] 537 0.120% 99.815% ( 2900, 4400 ] 697 0.156% 99.971% ( 4400, 6600 ] 172 0.038% 100.009% ( 6600, 9900 ] 47 0.010% 100.019% ( 9900, 14000 ] 16 0.004% 100.023% ( 14000, 22000 ] 31 0.007% 100.030% ( 22000, 33000 ] 20 0.004% 100.034% ( 33000, 50000 ] 19 0.004% 100.039% ( 50000, 75000 ] 2 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 46825 Average: 19.0346 StdDev: 227.26 Min: 1 Median: 2.3719 Max: 26959 Percentiles: P50: 2.37 P75: 3.49 P99: 365.07 P99.9: 2245.00 P99.99: 8511.94 ------------------------------------------------------ [ 0, 1 ] 497 1.061% 1.061% ( 1, 2 ] 17496 37.365% 38.426% ####### ( 2, 3 ] 14571 31.118% 69.544% ###### ( 3, 4 ] 5200 11.105% 80.649% ## ( 4, 6 ] 5639 12.043% 92.692% ## ( 6, 10 ] 1562 3.336% 96.028% # ( 10, 15 ] 277 0.592% 96.619% ( 15, 22 ] 45 0.096% 96.715% ( 22, 34 ] 11 0.023% 96.739% ( 34, 51 ] 7 0.015% 96.754% ( 51, 76 ] 4 0.009% 96.762% ( 76, 110 ] 11 0.023% 96.786% ( 110, 170 ] 196 0.419% 97.204% ( 170, 250 ] 569 1.215% 98.420% ( 250, 380 ] 307 0.656% 99.075% ( 380, 580 ] 203 0.434% 99.509% ( 580, 870 ] 106 0.226% 99.735% ( 870, 1300 ] 53 0.113% 99.848% ( 1300, 1900 ] 19 0.041% 99.889% ( 1900, 2900 ] 15 0.032% 99.921% ( 2900, 4400 ] 21 0.045% 99.966% ( 4400, 6600 ] 9 0.019% 99.985% ( 6600, 9900 ] 4 0.009% 99.994% ( 14000, 22000 ] 2 0.004% 99.998% ( 22000, 33000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 388742 Average: 22.6699 StdDev: 479.64 Min: 1 Median: 2.2686 Max: 93218 Percentiles: P50: 2.27 P75: 3.26 P99: 13.47 P99.9: 2105.74 P99.99: 3500.51 ------------------------------------------------------ [ 0, 1 ] 4988 1.283% 1.283% ( 1, 2 ] 157927 40.625% 41.908% ######## ( 2, 3 ] 117096 30.122% 72.030% ###### ( 3, 4 ] 43715 11.245% 83.275% ## ( 4, 6 ] 47547 12.231% 95.506% ## ( 6, 10 ] 11503 2.959% 98.465% # ( 10, 15 ] 2992 0.770% 99.235% ( 15, 22 ] 483 0.124% 99.359% ( 22, 34 ] 80 0.021% 99.380% ( 34, 51 ] 108 0.028% 99.408% ( 51, 76 ] 95 0.024% 99.432% ( 76, 110 ] 23 0.006% 99.438% ( 110, 170 ] 25 0.006% 99.444% ( 170, 250 ] 80 0.021% 99.465% ( 250, 380 ] 272 0.070% 99.535% ( 380, 580 ] 472 0.121% 99.656% ( 580, 870 ] 444 0.114% 99.771% ( 870, 1300 ] 246 0.063% 99.834% ( 1300, 1900 ] 205 0.053% 99.887% ( 1900, 2900 ] 254 0.065% 99.952% ( 2900, 4400 ] 370 0.095% 100.047% ( 4400, 6600 ] 147 0.038% 100.085% ( 6600, 9900 ] 83 0.021% 100.106% ( 9900, 14000 ] 27 0.007% 100.113% ( 14000, 22000 ] 74 0.019% 100.132% ( 22000, 33000 ] 42 0.011% 100.143% ( 33000, 50000 ] 4 0.001% 100.144% ( 50000, 75000 ] 2 0.001% 100.145% ( 75000, 110000 ] 1 0.000% 100.145% ** Level 3 read latency histogram (micros): Count: 784323 Average: 16.9406 StdDev: 329.54 Min: 0 Median: 2.2113 Max: 49043 Percentiles: P50: 2.21 P75: 3.07 P99: 24.26 P99.9: 1110.89 P99.99: 1946.59 ------------------------------------------------------ [ 0, 1 ] 9923 1.265% 1.265% ( 1, 2 ] 331235 42.232% 43.497% ######## ( 2, 3 ] 241376 30.775% 74.272% ###### ( 3, 4 ] 82314 10.495% 84.767% ## ( 4, 6 ] 85037 10.842% 95.609% ## ( 6, 10 ] 21773 2.776% 98.385% # ( 10, 15 ] 4227 0.539% 98.924% ( 15, 22 ] 571 0.073% 98.997% ( 22, 34 ] 126 0.016% 99.013% ( 34, 51 ] 222 0.028% 99.041% ( 51, 76 ] 157 0.020% 99.061% ( 76, 110 ] 63 0.008% 99.069% ( 110, 170 ] 450 0.057% 99.127% ( 170, 250 ] 1520 0.194% 99.321% ( 250, 380 ] 1296 0.165% 99.486% ( 380, 580 ] 1548 0.197% 99.683% ( 580, 870 ] 1299 0.166% 99.849% ( 870, 1300 ] 717 0.091% 99.940% ( 1300, 1900 ] 371 0.047% 99.988% ( 1900, 2900 ] 420 0.054% 100.041% ( 2900, 4400 ] 537 0.068% 100.110% ( 4400, 6600 ] 158 0.020% 100.130% ( 6600, 9900 ] 81 0.010% 100.140% ( 9900, 14000 ] 30 0.004% 100.144% ( 14000, 22000 ] 58 0.007% 100.151% ( 22000, 33000 ] 41 0.005% 100.156% ( 33000, 50000 ] 10 0.001% 100.158% ** Level 4 read latency histogram (micros): Count: 1051095 Average: 29.5402 StdDev: 401.98 Min: 1 Median: 2.2942 Max: 65612 Percentiles: P50: 2.29 P75: 3.37 P99: 472.96 P99.9: 1284.13 P99.99: 1793.65 ------------------------------------------------------ [ 0, 1 ] 11669 1.110% 1.110% ( 1, 2 ] 422339 40.181% 41.291% ######## ( 2, 3 ] 311193 29.607% 70.898% ###### ( 3, 4 ] 117398 11.169% 82.067% ## ( 4, 6 ] 119970 11.414% 93.481% ## ( 6, 10 ] 29635 2.819% 96.300% # ( 10, 15 ] 5937 0.565% 96.865% ( 15, 22 ] 709 0.067% 96.932% ( 22, 34 ] 143 0.014% 96.946% ( 34, 51 ] 244 0.023% 96.969% ( 51, 76 ] 213 0.020% 96.989% ( 76, 110 ] 152 0.014% 97.004% ( 110, 170 ] 2981 0.284% 97.287% ( 170, 250 ] 9159 0.871% 98.159% ( 250, 380 ] 6255 0.595% 98.754% ( 380, 580 ] 5566 0.530% 99.283% ( 580, 870 ] 4338 0.413% 99.696% ( 870, 1300 ] 2225 0.212% 99.908% ( 1300, 1900 ] 1050 0.100% 100.008% ( 1900, 2900 ] 1014 0.096% 100.104% ( 2900, 4400 ] 1156 0.110% 100.214% ( 4400, 6600 ] 330 0.031% 100.246% ( 6600, 9900 ] 151 0.014% 100.260% ( 9900, 14000 ] 45 0.004% 100.264% ( 14000, 22000 ] 88 0.008% 100.273% ( 22000, 33000 ] 53 0.005% 100.278% ( 33000, 50000 ] 24 0.002% 100.280% ( 50000, 75000 ] 5 0.000% 100.280% ** Level 5 read latency histogram (micros): Count: 22241 Average: 685.2502 StdDev: 2135.34 Min: 94 Median: 321.6659 Max: 106170 Percentiles: P50: 321.67 P75: 586.03 P99: 5330.45 P99.9: 37450.14 P99.99: 68879.50 ------------------------------------------------------ ( 76, 110 ] 76 0.342% 0.342% ( 110, 170 ] 2126 9.559% 9.901% ## ( 170, 250 ] 6521 29.320% 39.220% ###### ( 250, 380 ] 4349 19.554% 58.774% #### ( 380, 580 ] 3556 15.988% 74.763% ### ( 580, 870 ] 2538 11.411% 86.174% ## ( 870, 1300 ] 1267 5.697% 91.871% # ( 1300, 1900 ] 494 2.221% 94.092% ( 1900, 2900 ] 467 2.100% 96.192% ( 2900, 4400 ] 551 2.477% 98.669% ( 4400, 6600 ] 174 0.782% 99.451% ( 6600, 9900 ] 38 0.171% 99.622% ( 9900, 14000 ] 15 0.067% 99.690% ( 14000, 22000 ] 19 0.085% 99.775% ( 22000, 33000 ] 22 0.099% 99.874% ( 33000, 50000 ] 22 0.099% 99.973% ( 50000, 75000 ] 5 0.022% 99.996% ( 75000, 110000 ] 1 0.004% 100.000% ** DB Stats ** Uptime(secs): 12.1 total, 4.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 162.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.029 H:M:S, 25.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 224.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.366 H:M:S, 8.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-10:51:03 ... thread 0: (1000000,3000000) ops and (273804.8,191150.9) ops/second in (3.652237,15.694408) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/16 2.75 GB 0.0 2.2 0.0 2.2 5.0 2.8 0.0 1.8 75.4 169.2 30.03 18.25 48 0.626 2299K 12K 0.0 0.0 L1 3/3 221.58 MB 0.0 0.6 0.4 0.1 0.6 0.4 0.0 1.2 60.3 59.7 9.45 3.54 1 9.446 578K 6153 0.0 0.0 L2 1/0 67.52 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 961.86 MB 1.0 2.7 1.8 0.9 2.7 1.8 0.2 1.5 100.3 98.9 27.54 15.90 13 2.119 2408K 15K 0.0 0.0 L4 148/0 9.62 GB 1.0 6.6 2.3 4.3 5.9 1.6 0.5 2.5 127.2 114.1 53.10 33.40 24 2.213 1611K 7237 0.0 0.0 L5 152/0 11.87 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 337/19 25.47 GB 0.0 12.1 4.6 7.5 14.1 6.6 3.8 5.1 102.8 120.1 120.12 71.08 86 1.397 6897K 41K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.1 4.6 7.5 14.1 6.6 3.8 5.1 102.8 120.1 120.12 71.08 86 1.397 6897K 41K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.1 4.6 7.5 11.3 3.9 0.0 0.0 116.8 109.7 105.73 62.34 46 2.298 6897K 41K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 196.7 14.39 8.75 40 0.360 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.7 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.09 GB write, 914.95 MB/s write, 12.06 GB read, 783.21 MB/s read, 120.1 seconds Interval compaction: 14.09 GB write, 919.28 MB/s write, 12.06 GB read, 786.91 MB/s read, 120.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 41, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 738036 Average: 28.3453 StdDev: 346.03 Min: 1 Median: 1.7437 Max: 52850 Percentiles: P50: 1.74 P75: 2.60 P99: 529.47 P99.9: 2753.91 P99.99: 4157.59 ------------------------------------------------------ [ 0, 1 ] 68580 9.292% 9.292% ## ( 1, 2 ] 403960 54.734% 64.027% ########### ( 2, 3 ] 134960 18.286% 82.313% #### ( 3, 4 ] 44716 6.059% 88.372% # ( 4, 6 ] 37155 5.034% 93.406% # ( 6, 10 ] 10661 1.445% 94.851% ( 10, 15 ] 1844 0.250% 95.101% ( 15, 22 ] 281 0.038% 95.139% ( 22, 34 ] 75 0.010% 95.149% ( 34, 51 ] 54 0.007% 95.156% ( 51, 76 ] 39 0.005% 95.161% ( 76, 110 ] 305 0.041% 95.203% ( 110, 170 ] 5795 0.785% 95.988% ( 170, 250 ] 12908 1.749% 97.737% ( 250, 380 ] 6104 0.827% 98.564% ( 380, 580 ] 4308 0.584% 99.148% ( 580, 870 ] 2973 0.403% 99.550% ( 870, 1300 ] 1526 0.207% 99.757% ( 1300, 1900 ] 593 0.080% 99.838% ( 1900, 2900 ] 541 0.073% 99.911% ( 2900, 4400 ] 698 0.095% 100.005% ( 4400, 6600 ] 172 0.023% 100.029% ( 6600, 9900 ] 47 0.006% 100.035% ( 9900, 14000 ] 16 0.002% 100.037% ( 14000, 22000 ] 32 0.004% 100.042% ( 22000, 33000 ] 20 0.003% 100.044% ( 33000, 50000 ] 19 0.003% 100.047% ( 50000, 75000 ] 2 0.000% 100.047% ** Level 1 read latency histogram (micros): Count: 48498 Average: 25.3842 StdDev: 227.18 Min: 1 Median: 2.4293 Max: 26959 Percentiles: P50: 2.43 P75: 3.73 P99: 387.10 P99.9: 2200.13 P99.99: 8373.91 ------------------------------------------------------ [ 0, 1 ] 497 1.025% 1.025% ( 1, 2 ] 17496 36.076% 37.100% ####### ( 2, 3 ] 14571 30.045% 67.145% ###### ( 3, 4 ] 5200 10.722% 77.867% ## ( 4, 6 ] 5639 11.627% 89.494% ## ( 6, 10 ] 1562 3.221% 92.715% # ( 10, 15 ] 277 0.571% 93.286% ( 15, 22 ] 45 0.093% 93.379% ( 22, 34 ] 11 0.023% 93.402% ( 34, 51 ] 7 0.014% 93.416% ( 51, 76 ] 4 0.008% 93.424% ( 76, 110 ] 46 0.095% 93.519% ( 110, 170 ] 767 1.582% 95.101% ( 170, 250 ] 1411 2.909% 98.010% # ( 250, 380 ] 471 0.971% 98.981% ( 380, 580 ] 254 0.524% 99.505% ( 580, 870 ] 115 0.237% 99.742% ( 870, 1300 ] 53 0.109% 99.852% ( 1300, 1900 ] 19 0.039% 99.891% ( 1900, 2900 ] 15 0.031% 99.922% ( 2900, 4400 ] 21 0.043% 99.965% ( 4400, 6600 ] 10 0.021% 99.986% ( 6600, 9900 ] 4 0.008% 99.994% ( 14000, 22000 ] 2 0.004% 99.998% ( 22000, 33000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 388742 Average: 22.6699 StdDev: 479.64 Min: 1 Median: 2.2686 Max: 93218 Percentiles: P50: 2.27 P75: 3.26 P99: 13.47 P99.9: 2105.74 P99.99: 3500.51 ------------------------------------------------------ [ 0, 1 ] 4988 1.283% 1.283% ( 1, 2 ] 157927 40.625% 41.908% ######## ( 2, 3 ] 117096 30.122% 72.030% ###### ( 3, 4 ] 43715 11.245% 83.275% ## ( 4, 6 ] 47547 12.231% 95.506% ## ( 6, 10 ] 11503 2.959% 98.465% # ( 10, 15 ] 2992 0.770% 99.235% ( 15, 22 ] 483 0.124% 99.359% ( 22, 34 ] 80 0.021% 99.380% ( 34, 51 ] 108 0.028% 99.408% ( 51, 76 ] 95 0.024% 99.432% ( 76, 110 ] 23 0.006% 99.438% ( 110, 170 ] 25 0.006% 99.444% ( 170, 250 ] 80 0.021% 99.465% ( 250, 380 ] 272 0.070% 99.535% ( 380, 580 ] 472 0.121% 99.656% ( 580, 870 ] 444 0.114% 99.771% ( 870, 1300 ] 246 0.063% 99.834% ( 1300, 1900 ] 205 0.053% 99.887% ( 1900, 2900 ] 254 0.065% 99.952% ( 2900, 4400 ] 370 0.095% 100.047% ( 4400, 6600 ] 147 0.038% 100.085% ( 6600, 9900 ] 83 0.021% 100.106% ( 9900, 14000 ] 27 0.007% 100.113% ( 14000, 22000 ] 74 0.019% 100.132% ( 22000, 33000 ] 42 0.011% 100.143% ( 33000, 50000 ] 4 0.001% 100.144% ( 50000, 75000 ] 2 0.001% 100.145% ( 75000, 110000 ] 1 0.000% 100.145% ** Level 3 read latency histogram (micros): Count: 844896 Average: 16.6188 StdDev: 318.19 Min: 0 Median: 2.1833 Max: 49043 Percentiles: P50: 2.18 P75: 3.01 P99: 178.75 P99.9: 1073.97 P99.99: 1929.79 ------------------------------------------------------ [ 0, 1 ] 11184 1.324% 1.324% ( 1, 2 ] 364100 43.094% 44.418% ######### ( 2, 3 ] 257343 30.459% 74.876% ###### ( 3, 4 ] 85951 10.173% 85.049% ## ( 4, 6 ] 87660 10.375% 95.425% ## ( 6, 10 ] 23039 2.727% 98.151% # ( 10, 15 ] 4378 0.518% 98.670% ( 15, 22 ] 587 0.069% 98.739% ( 22, 34 ] 131 0.016% 98.755% ( 34, 51 ] 224 0.027% 98.781% ( 51, 76 ] 157 0.019% 98.800% ( 76, 110 ] 112 0.013% 98.813% ( 110, 170 ] 1257 0.149% 98.962% ( 170, 250 ] 2961 0.350% 99.312% ( 250, 380 ] 1648 0.195% 99.507% ( 380, 580 ] 1659 0.196% 99.704% ( 580, 870 ] 1320 0.156% 99.860% ( 870, 1300 ] 717 0.085% 99.945% ( 1300, 1900 ] 371 0.044% 99.989% ( 1900, 2900 ] 420 0.050% 100.038% ( 2900, 4400 ] 537 0.064% 100.102% ( 4400, 6600 ] 158 0.019% 100.120% ( 6600, 9900 ] 81 0.010% 100.130% ( 9900, 14000 ] 30 0.004% 100.134% ( 14000, 22000 ] 59 0.007% 100.141% ( 22000, 33000 ] 41 0.005% 100.145% ( 33000, 50000 ] 10 0.001% 100.147% ** Level 4 read latency histogram (micros): Count: 1079254 Average: 33.9829 StdDev: 398.32 Min: 0 Median: 2.3388 Max: 65612 Percentiles: P50: 2.34 P75: 3.54 P99: 485.99 P99.9: 1281.11 P99.99: 1794.19 ------------------------------------------------------ [ 0, 1 ] 11682 1.082% 1.082% ( 1, 2 ] 422438 39.142% 40.224% ######## ( 2, 3 ] 311421 28.855% 69.079% ###### ( 3, 4 ] 117564 10.893% 79.972% ## ( 4, 6 ] 120209 11.138% 91.111% ## ( 6, 10 ] 29654 2.748% 93.858% # ( 10, 15 ] 5951 0.551% 94.410% ( 15, 22 ] 715 0.066% 94.476% ( 22, 34 ] 146 0.014% 94.489% ( 34, 51 ] 244 0.023% 94.512% ( 51, 76 ] 213 0.020% 94.532% ( 76, 110 ] 706 0.065% 94.597% ( 110, 170 ] 11938 1.106% 95.703% ( 170, 250 ] 22930 2.125% 97.828% ( 250, 380 ] 9166 0.849% 98.677% ( 380, 580 ] 6575 0.609% 99.286% ( 580, 870 ] 4484 0.415% 99.702% ( 870, 1300 ] 2237 0.207% 99.909% ( 1300, 1900 ] 1060 0.098% 100.007% ( 1900, 2900 ] 1015 0.094% 100.101% ( 2900, 4400 ] 1156 0.107% 100.208% ( 4400, 6600 ] 330 0.031% 100.239% ( 6600, 9900 ] 151 0.014% 100.253% ( 9900, 14000 ] 46 0.004% 100.257% ( 14000, 22000 ] 89 0.008% 100.266% ( 22000, 33000 ] 53 0.005% 100.270% ( 33000, 50000 ] 24 0.002% 100.273% ( 50000, 75000 ] 5 0.000% 100.273% ** Level 5 read latency histogram (micros): Count: 41064 Average: 465.9084 StdDev: 1592.80 Min: 92 Median: 229.0894 Max: 106170 Percentiles: P50: 229.09 P75: 374.75 P99: 4097.18 P99.9: 26468.00 P99.99: 59468.00 ------------------------------------------------------ ( 76, 110 ] 418 1.018% 1.018% ( 110, 170 ] 8223 20.025% 21.043% #### ( 170, 250 ] 16099 39.205% 60.247% ######## ( 250, 380 ] 6313 15.374% 75.621% ### ( 380, 580 ] 4266 10.389% 86.010% ## ( 580, 870 ] 2648 6.448% 92.458% # ( 870, 1300 ] 1279 3.115% 95.573% # ( 1300, 1900 ] 498 1.213% 96.786% ( 1900, 2900 ] 468 1.140% 97.925% ( 2900, 4400 ] 553 1.347% 99.272% ( 4400, 6600 ] 174 0.424% 99.696% ( 6600, 9900 ] 40 0.097% 99.793% ( 9900, 14000 ] 16 0.039% 99.832% ( 14000, 22000 ] 19 0.046% 99.878% ( 22000, 33000 ] 22 0.054% 99.932% ( 33000, 50000 ] 22 0.054% 99.985% ( 50000, 75000 ] 5 0.012% 99.998% ( 75000, 110000 ] 1 0.002% 100.000% ** DB Stats ** Uptime(secs): 15.8 total, 3.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 187.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.029 H:M:S, 19.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 269.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 416.687 micros/op 9572 ops/sec 20.162 seconds 192996 operations; 9.3 MB/s (48999 of 48999 found) Microseconds per read: Count: 192996 Average: 416.6963 StdDev: 1647.94 Min: 2 Median: 238.6573 Max: 205298 Percentiles: P50: 238.66 P75: 361.10 P99: 3628.03 P99.9: 20557.64 P99.99: 68677.06 ------------------------------------------------------ ( 1, 2 ] 5 0.003% 0.003% ( 2, 3 ] 51 0.026% 0.029% ( 3, 4 ] 54 0.028% 0.057% ( 4, 6 ] 166 0.086% 0.143% ( 6, 10 ] 348 0.180% 0.323% ( 10, 15 ] 1079 0.559% 0.882% ( 15, 22 ] 2752 1.426% 2.308% ( 22, 34 ] 3853 1.996% 4.305% ( 34, 51 ] 2398 1.243% 5.547% ( 51, 76 ] 568 0.294% 5.842% ( 76, 110 ] 176 0.091% 5.933% ( 110, 170 ] 14095 7.303% 13.236% # ( 170, 250 ] 82675 42.838% 56.074% ######### ( 250, 380 ] 42740 22.146% 78.219% #### ( 380, 580 ] 21967 11.382% 89.601% ## ( 580, 870 ] 10193 5.281% 94.883% # ( 870, 1300 ] 4435 2.298% 97.181% ( 1300, 1900 ] 1628 0.844% 98.024% ( 1900, 2900 ] 1172 0.607% 98.632% ( 2900, 4400 ] 1465 0.759% 99.391% ( 4400, 6600 ] 498 0.258% 99.649% ( 6600, 9900 ] 264 0.137% 99.785% ( 9900, 14000 ] 121 0.063% 99.848% ( 14000, 22000 ] 122 0.063% 99.911% ( 22000, 33000 ] 88 0.046% 99.957% ( 33000, 50000 ] 51 0.026% 99.983% ( 50000, 75000 ] 17 0.009% 99.992% ( 75000, 110000 ] 8 0.004% 99.996% ( 110000, 170000 ] 6 0.003% 99.999% ( 170000, 250000 ] 1 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2963175 rocksdb.bloom.filter.full.positive COUNT : 220888 rocksdb.bloom.filter.full.true.positive COUNT : 192073 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 923 rocksdb.memtable.miss COUNT : 192073 rocksdb.l0.hit COUNT : 21848 rocksdb.l1.hit COUNT : 1745 rocksdb.l2andup.hit COUNT : 168480 rocksdb.compaction.key.drop.new COUNT : 775375 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3770096 rocksdb.number.keys.read COUNT : 192996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3890739072 rocksdb.bytes.read COUNT : 192996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 518 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4474581 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 14107029218 rocksdb.compact.write.bytes COUNT : 13305332424 rocksdb.flush.write.bytes COUNT : 3825142014 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 20 rocksdb.number.superversion_acquires COUNT : 706 rocksdb.number.superversion_releases COUNT : 682 rocksdb.number.superversion_cleanups COUNT : 174 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 166 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3800452096 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7127040 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 14592845366 rocksdb.non.last.level.read.count COUNT : 3497024 rocksdb.block.checksum.compute.count COUNT : 3641400 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 237.792489 P95 : 889.679946 P99 : 3627.530696 P100 : 205295.000000 COUNT : 192996 SUM : 80225539 rocksdb.db.write.micros P50 : 1.593307 P95 : 5.149997 P99 : 7.861061 P100 : 807315.000000 COUNT : 3770096 SUM : 15191573 rocksdb.compaction.times.micros P50 : 2038888.888889 P95 : 4210000.000000 P99 : 8991500.000000 P100 : 9445510.000000 COUNT : 49 SUM : 108682294 rocksdb.compaction.times.cpu_micros P50 : 1245652.173913 P95 : 2175000.000000 P99 : 3542074.000000 P100 : 3542074.000000 COUNT : 49 SUM : 65233323 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 777.727273 P95 : 8085.000000 P99 : 9918.000000 P100 : 9918.000000 COUNT : 53 SUM : 84576 rocksdb.compaction.outfile.sync.micros P50 : 2358.333333 P95 : 8373.750000 P99 : 23595.000000 P100 : 31868.000000 COUNT : 171 SUM : 545837 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 185.555556 P95 : 1645.000000 P99 : 13303.000000 P100 : 14260.000000 COUNT : 117 SUM : 63781 rocksdb.table.open.io.micros P50 : 5383.529412 P95 : 20327.272727 P99 : 84566.666667 P100 : 161231.000000 COUNT : 518 SUM : 3899413 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.354831 P95 : 9.662828 P99 : 210.735724 P100 : 56687.000000 COUNT : 3417328 SUM : 61268756 rocksdb.read.block.get.micros P50 : 205.411355 P95 : 790.720338 P99 : 3131.005468 P100 : 106243.000000 COUNT : 223651 SUM : 71179818 rocksdb.write.raw.block.micros P50 : 0.536680 P95 : 1.410983 P99 : 4.130177 P100 : 108857.000000 COUNT : 4150512 SUM : 17846697 rocksdb.numfiles.in.singlecompaction P50 : 3.195652 P95 : 5.791667 P99 : 11.750000 P100 : 15.000000 COUNT : 65 SUM : 246 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558136 P95 : 1104.964286 P99 : 1279.766533 P100 : 807126.000000 COUNT : 12663 SUM : 4475599 rocksdb.sst.read.micros P50 : 2.084475 P95 : 178.875848 P99 : 519.330469 P100 : 106170.000000 COUNT : 3497198 SUM : 119724871 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 192996 SUM : 192996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3770096 SUM : 3890739072 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 225789.473684 P95 : 833071.428571 P99 : 1072248.000000 P100 : 1072248.000000 COUNT : 53 SUM : 16941105 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 177 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0