[2024-12-09 23:55:11.875136] Starting SPDK v25.01-pre git sha1 06358c250 / DPDK 24.03.0 initialization... [2024-12-09 23:55:11.875311] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1179660 ] Set seed to 1733784911871622 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-09 23:55:12.016344] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-09 23:55:12.119429] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-09 23:55:12.119489] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1179660' to capture a snapshot of events at runtime. [2024-12-09 23:55:12.119509] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-09 23:55:12.119527] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-09 23:55:12.119540] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1179660 for offline analysis/debug. [2024-12-09 23:55:12.120839] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 9 23:55:15 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/09-23:55:18 ... thread 0: (1000000,1000000) ops and (332306.9,332306.9) ops/second in (3.009266,3.009266) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 629.14 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 343.0 2.57 2.39 13 0.197 0 0 0.0 0.0 L1 3/3 188.06 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 226.3 225.8 0.83 0.79 1 0.833 191K 407 0.0 0.0 L2 1/1 100.60 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.0 2.6 238.8 238.3 0.67 0.65 1 0.673 163K 326 0.0 0.0 L3 17/10 878.80 MB 0.1 0.1 0.1 0.0 0.1 0.1 0.0 1.0 206.2 206.2 0.29 0.27 1 0.291 60K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.80 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 255/23 20.09 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 93.8 295.4 4.36 4.11 16 0.273 415K 733 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 93.8 295.4 4.36 4.11 16 0.273 415K 733 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 227.8 227.3 1.80 1.72 3 0.599 415K 733 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 343.0 2.57 2.39 13 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.26 GB write, 417.01 MB/s write, 0.40 GB read, 132.39 MB/s read, 4.4 seconds Interval compaction: 1.26 GB write, 428.08 MB/s write, 0.40 GB read, 135.90 MB/s read, 4.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 114087 Average: 2.0178 StdDev: 6.78 Min: 0 Median: 1.3586 Max: 1664 Percentiles: P50: 1.36 P75: 1.78 P99: 5.71 P99.9: 12.73 P99.99: 187.28 ------------------------------------------------------ [ 0, 1 ] 32613 28.586% 28.586% ###### ( 1, 2 ] 68130 59.718% 88.304% ############ ( 2, 3 ] 7888 6.914% 95.218% # ( 3, 4 ] 2755 2.415% 97.633% ( 4, 6 ] 1827 1.601% 99.234% ( 6, 10 ] 685 0.600% 99.834% ( 10, 15 ] 141 0.124% 99.958% ( 15, 22 ] 28 0.025% 99.982% ( 22, 34 ] 3 0.003% 99.985% ( 34, 51 ] 2 0.002% 99.987% ( 51, 76 ] 3 0.003% 99.989% ( 170, 250 ] 12 0.011% 100.000% ( 250, 380 ] 8 0.007% 100.007% ( 380, 580 ] 5 0.004% 100.011% ( 1300, 1900 ] 1 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 21858 Average: 2.1172 StdDev: 6.27 Min: 0 Median: 1.4453 Max: 723 Percentiles: P50: 1.45 P75: 1.84 P99: 5.58 P99.9: 9.97 P99.99: 242.57 ------------------------------------------------------ [ 0, 1 ] 4825 22.074% 22.074% #### ( 1, 2 ] 13709 62.718% 84.793% ############# ( 2, 3 ] 2043 9.347% 94.139% ## ( 3, 4 ] 705 3.225% 97.365% # ( 4, 6 ] 453 2.072% 99.437% ( 6, 10 ] 103 0.471% 99.909% ( 10, 15 ] 14 0.064% 99.973% ( 15, 22 ] 2 0.009% 99.982% ( 51, 76 ] 1 0.005% 99.986% ( 170, 250 ] 2 0.009% 99.995% ( 380, 580 ] 1 0.005% 100.000% ( 580, 870 ] 1 0.005% 100.005% ** Level 2 read latency histogram (micros): Count: 40170 Average: 2.5155 StdDev: 27.59 Min: 0 Median: 1.4257 Max: 4827 Percentiles: P50: 1.43 P75: 1.84 P99: 8.47 P99.9: 123.58 P99.99: 335.93 ------------------------------------------------------ [ 0, 1 ] 9879 24.593% 24.593% ##### ( 1, 2 ] 23975 59.684% 84.277% ############ ( 2, 3 ] 3282 8.170% 92.447% ## ( 3, 4 ] 1215 3.025% 95.472% # ( 4, 6 ] 1115 2.776% 98.247% # ( 6, 10 ] 489 1.217% 99.465% ( 10, 15 ] 125 0.311% 99.776% ( 15, 22 ] 15 0.037% 99.813% ( 22, 34 ] 1 0.002% 99.816% ( 76, 110 ] 25 0.062% 99.878% ( 110, 170 ] 39 0.097% 99.975% ( 170, 250 ] 4 0.010% 99.985% ( 250, 380 ] 3 0.007% 99.993% ( 380, 580 ] 1 0.002% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 23631 Average: 9.4872 StdDev: 166.10 Min: 1 Median: 1.7209 Max: 6820 Percentiles: P50: 1.72 P75: 2.49 P99: 14.54 P99.9: 2992.25 P99.99: 6423.60 ------------------------------------------------------ [ 0, 1 ] 1355 5.734% 5.734% # ( 1, 2 ] 14510 61.402% 67.136% ############ ( 2, 3 ] 3798 16.072% 83.208% ### ( 3, 4 ] 1632 6.906% 90.115% # ( 4, 6 ] 1361 5.759% 95.874% # ( 6, 10 ] 527 2.230% 98.104% ( 10, 15 ] 234 0.990% 99.094% ( 15, 22 ] 28 0.118% 99.213% ( 22, 34 ] 5 0.021% 99.234% ( 34, 51 ] 7 0.030% 99.264% ( 51, 76 ] 9 0.038% 99.302% ( 76, 110 ] 9 0.038% 99.340% ( 110, 170 ] 76 0.322% 99.661% ( 170, 250 ] 31 0.131% 99.793% ( 250, 380 ] 13 0.055% 99.848% ( 380, 580 ] 3 0.013% 99.860% ( 580, 870 ] 1 0.004% 99.865% ( 1300, 1900 ] 5 0.021% 99.886% ( 1900, 2900 ] 4 0.017% 99.903% ( 2900, 4400 ] 6 0.025% 99.928% ( 4400, 6600 ] 17 0.072% 100.000% ( 6600, 9900 ] 1 0.004% 100.004% ** Level 4 read latency histogram (micros): Count: 25 Average: 2689.8400 StdDev: 1531.45 Min: 103 Median: 2587.5000 Max: 5295 Percentiles: P50: 2587.50 P75: 3837.50 P99: 5295.00 P99.9: 5295.00 P99.99: 5295.00 ------------------------------------------------------ ( 76, 110 ] 2 8.000% 8.000% ## ( 380, 580 ] 3 12.000% 20.000% ## ( 1300, 1900 ] 2 8.000% 28.000% ## ( 1900, 2900 ] 8 32.000% 60.000% ###### ( 2900, 4400 ] 6 24.000% 84.000% ##### ( 4400, 6600 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 318.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.186 H:M:S, 6.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.186 H:M:S, 6.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/09-23:55:21 ... thread 0: (1000000,2000000) ops and (318716.7,325370.0) ops/second in (3.137583,6.146849) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.29 GB 75.1 0.7 0.0 0.7 2.6 1.8 0.0 1.4 88.3 308.4 8.55 8.08 31 0.276 766K 3760 0.0 0.0 L1 1/0 23.08 MB 2.3 0.7 0.5 0.2 0.7 0.5 0.1 1.4 226.0 224.2 3.06 2.95 2 1.529 701K 5421 0.0 0.0 L2 2/2 229.38 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.5 2.6 238.8 238.3 0.67 0.65 1 0.673 163K 326 0.0 0.0 L3 19/15 1.19 GB 0.3 0.4 0.4 0.0 0.4 0.4 0.0 1.1 211.9 211.4 2.13 2.05 3 0.709 457K 1043 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.80 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 257/25 21.06 GB 0.0 2.0 0.9 1.1 3.8 2.8 0.5 2.1 142.8 273.0 14.41 13.73 37 0.390 2089K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.9 1.1 3.8 2.8 0.5 2.1 142.8 273.0 14.41 13.73 37 0.390 2089K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.9 1.1 2.0 0.9 0.0 0.0 228.8 227.6 8.99 8.72 9 0.999 2089K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 348.2 5.42 5.01 28 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.1 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.84 GB write, 631.62 MB/s write, 2.01 GB read, 330.39 MB/s read, 14.4 seconds Interval compaction: 3.84 GB write, 639.82 MB/s write, 2.01 GB read, 334.68 MB/s read, 14.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 399911 Average: 2.5795 StdDev: 7.89 Min: 0 Median: 1.6585 Max: 1886 Percentiles: P50: 1.66 P75: 2.26 P99: 7.40 P99.9: 14.68 P99.99: 151.25 ------------------------------------------------------ [ 0, 1 ] 43415 10.856% 10.856% ## ( 1, 2 ] 237731 59.446% 70.302% ############ ( 2, 3 ] 71355 17.843% 88.145% #### ( 3, 4 ] 23162 5.792% 93.937% # ( 4, 6 ] 18898 4.726% 98.662% # ( 6, 10 ] 3868 0.967% 99.629% ( 10, 15 ] 1156 0.289% 99.918% ( 15, 22 ] 145 0.036% 99.955% ( 22, 34 ] 16 0.004% 99.959% ( 34, 51 ] 6 0.002% 99.960% ( 51, 76 ] 4 0.001% 99.961% ( 76, 110 ] 28 0.007% 99.968% ( 110, 170 ] 128 0.032% 100.000% ( 170, 250 ] 50 0.013% 100.013% ( 250, 380 ] 26 0.007% 100.019% ( 380, 580 ] 21 0.005% 100.025% ( 580, 870 ] 5 0.001% 100.026% ( 870, 1300 ] 4 0.001% 100.027% ( 1300, 1900 ] 2 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 150506 Average: 2.8768 StdDev: 7.48 Min: 0 Median: 1.7964 Max: 952 Percentiles: P50: 1.80 P75: 2.59 P99: 9.05 P99.9: 21.21 P99.99: 175.78 ------------------------------------------------------ [ 0, 1 ] 7296 4.848% 4.848% # ( 1, 2 ] 85328 56.694% 61.542% ########### ( 2, 3 ] 34205 22.727% 84.268% ##### ( 3, 4 ] 10726 7.127% 91.395% # ( 4, 6 ] 9441 6.273% 97.668% # ( 6, 10 ] 2629 1.747% 99.415% ( 10, 15 ] 649 0.431% 99.846% ( 15, 22 ] 93 0.062% 99.908% ( 22, 34 ] 4 0.003% 99.910% ( 34, 51 ] 2 0.001% 99.912% ( 51, 76 ] 2 0.001% 99.913% ( 76, 110 ] 35 0.023% 99.936% ( 110, 170 ] 80 0.053% 99.989% ( 170, 250 ] 27 0.018% 100.007% ( 250, 380 ] 7 0.005% 100.012% ( 380, 580 ] 6 0.004% 100.016% ( 580, 870 ] 5 0.003% 100.019% ( 870, 1300 ] 1 0.001% 100.020% ** Level 2 read latency histogram (micros): Count: 48570 Average: 2.9179 StdDev: 26.96 Min: 0 Median: 1.4821 Max: 4827 Percentiles: P50: 1.48 P75: 1.90 P99: 9.18 P99.9: 166.25 P99.99: 537.15 ------------------------------------------------------ [ 0, 1 ] 10308 21.223% 21.223% #### ( 1, 2 ] 28991 59.689% 80.912% ############ ( 2, 3 ] 4982 10.257% 91.169% ## ( 3, 4 ] 1770 3.644% 94.814% # ( 4, 6 ] 1501 3.090% 97.904% # ( 6, 10 ] 670 1.379% 99.284% ( 10, 15 ] 156 0.321% 99.605% ( 15, 22 ] 19 0.039% 99.644% ( 22, 34 ] 1 0.002% 99.646% ( 76, 110 ] 26 0.054% 99.699% ( 110, 170 ] 105 0.216% 99.916% ( 170, 250 ] 19 0.039% 99.955% ( 250, 380 ] 15 0.031% 99.986% ( 380, 580 ] 4 0.008% 99.994% ( 580, 870 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ( 4400, 6600 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 229958 Average: 3.8359 StdDev: 54.12 Min: 1 Median: 1.7591 Max: 6820 Percentiles: P50: 1.76 P75: 2.54 P99: 9.93 P99.9: 169.57 P99.99: 470.95 ------------------------------------------------------ [ 0, 1 ] 9938 4.322% 4.322% # ( 1, 2 ] 138369 60.171% 64.493% ############ ( 2, 3 ] 44888 19.520% 84.013% #### ( 3, 4 ] 16017 6.965% 90.978% # ( 4, 6 ] 13247 5.761% 96.739% # ( 6, 10 ] 5288 2.300% 99.039% ( 10, 15 ] 1124 0.489% 99.527% ( 15, 22 ] 132 0.057% 99.585% ( 22, 34 ] 11 0.005% 99.589% ( 34, 51 ] 144 0.063% 99.652% ( 51, 76 ] 106 0.046% 99.698% ( 76, 110 ] 52 0.023% 99.721% ( 110, 170 ] 415 0.180% 99.901% ( 170, 250 ] 138 0.060% 99.961% ( 250, 380 ] 56 0.024% 99.986% ( 380, 580 ] 22 0.010% 99.995% ( 580, 870 ] 5 0.002% 99.997% ( 1300, 1900 ] 5 0.002% 100.000% ( 1900, 2900 ] 4 0.002% 100.001% ( 2900, 4400 ] 6 0.003% 100.004% ( 4400, 6600 ] 17 0.007% 100.011% ( 6600, 9900 ] 1 0.000% 100.012% ** Level 4 read latency histogram (micros): Count: 25 Average: 2689.8400 StdDev: 1531.45 Min: 103 Median: 2587.5000 Max: 5295 Percentiles: P50: 2587.50 P75: 3837.50 P99: 5295.00 P99.9: 5295.00 P99.99: 5295.00 ------------------------------------------------------ ( 76, 110 ] 2 8.000% 8.000% ## ( 380, 580 ] 3 12.000% 20.000% ## ( 1300, 1900 ] 2 8.000% 28.000% ## ( 1900, 2900 ] 8 32.000% 60.000% ###### ( 2900, 4400 ] 6 24.000% 84.000% ##### ( 4400, 6600 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 316.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.350 H:M:S, 5.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.164 H:M:S, 5.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/09-23:55:24 ... thread 0: (1000000,3000000) ops and (348147.8,332624.0) ops/second in (2.872343,9.019192) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.20 GB 200.4 1.8 0.0 1.8 4.5 2.8 0.0 1.6 117.2 298.4 15.57 14.81 50 0.311 1852K 9157 0.0 0.0 L1 1/0 23.08 MB 2.3 0.7 0.5 0.2 0.7 0.5 0.1 1.4 226.0 224.2 3.06 2.95 2 1.529 701K 5421 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.5 2.6 238.8 238.3 0.67 0.65 1 0.673 163K 326 0.0 0.0 L3 18/0 936.63 MB 0.9 1.5 0.6 0.9 1.5 0.6 0.0 2.5 225.9 225.3 7.02 6.70 5 1.405 1611K 4209 0.0 0.0 L4 122/0 9.67 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 217.2 217.2 1.18 1.12 1 1.177 259K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 267/4 21.97 GB 0.0 4.4 1.4 3.0 7.2 4.2 1.1 2.6 164.3 266.5 27.50 26.23 59 0.466 4588K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.4 1.4 3.0 7.2 4.2 1.1 2.6 164.3 266.5 27.50 26.23 59 0.466 4588K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.4 1.4 3.0 4.4 1.4 0.0 0.0 232.2 231.2 19.46 18.80 16 1.216 4588K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.0 8.04 7.43 43 0.187 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 9.0 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.16 GB write, 805.32 MB/s write, 4.41 GB read, 496.42 MB/s read, 27.5 seconds Interval compaction: 7.16 GB write, 812.45 MB/s write, 4.41 GB read, 500.82 MB/s read, 27.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 646609 Average: 2.4704 StdDev: 7.38 Min: 0 Median: 1.6191 Max: 1886 Percentiles: P50: 1.62 P75: 2.09 P99: 6.78 P99.9: 14.15 P99.99: 136.88 ------------------------------------------------------ [ 0, 1 ] 76951 11.901% 11.901% ## ( 1, 2 ] 397928 61.541% 73.441% ############ ( 2, 3 ] 106445 16.462% 89.903% ### ( 3, 4 ] 32592 5.040% 94.944% # ( 4, 6 ] 25140 3.888% 98.832% # ( 6, 10 ] 5572 0.862% 99.694% ( 10, 15 ] 1608 0.249% 99.942% ( 15, 22 ] 185 0.029% 99.971% ( 22, 34 ] 25 0.004% 99.975% ( 34, 51 ] 7 0.001% 99.976% ( 51, 76 ] 7 0.001% 99.977% ( 76, 110 ] 28 0.004% 99.981% ( 110, 170 ] 128 0.020% 100.001% ( 170, 250 ] 65 0.010% 100.011% ( 250, 380 ] 38 0.006% 100.017% ( 380, 580 ] 24 0.004% 100.021% ( 580, 870 ] 8 0.001% 100.022% ( 870, 1300 ] 9 0.001% 100.023% ( 1300, 1900 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 168222 Average: 2.8585 StdDev: 7.09 Min: 0 Median: 1.7986 Max: 952 Percentiles: P50: 1.80 P75: 2.59 P99: 9.05 P99.9: 20.15 P99.99: 170.53 ------------------------------------------------------ [ 0, 1 ] 7708 4.582% 4.582% # ( 1, 2 ] 95671 56.872% 61.454% ########### ( 2, 3 ] 38704 23.008% 84.462% ##### ( 3, 4 ] 11791 7.009% 91.471% # ( 4, 6 ] 10388 6.175% 97.646% # ( 6, 10 ] 2991 1.778% 99.424% ( 10, 15 ] 722 0.429% 99.853% ( 15, 22 ] 107 0.064% 99.917% ( 22, 34 ] 4 0.002% 99.919% ( 34, 51 ] 2 0.001% 99.920% ( 51, 76 ] 2 0.001% 99.922% ( 76, 110 ] 35 0.021% 99.942% ( 110, 170 ] 80 0.048% 99.990% ( 170, 250 ] 27 0.016% 100.006% ( 250, 380 ] 7 0.004% 100.010% ( 380, 580 ] 6 0.004% 100.014% ( 580, 870 ] 5 0.003% 100.017% ( 870, 1300 ] 1 0.001% 100.017% ** Level 2 read latency histogram (micros): Count: 65637 Average: 2.8153 StdDev: 23.20 Min: 0 Median: 1.5407 Max: 4827 Percentiles: P50: 1.54 P75: 1.95 P99: 8.92 P99.9: 156.49 P99.99: 451.81 ------------------------------------------------------ [ 0, 1 ] 11157 16.998% 16.998% ### ( 1, 2 ] 40060 61.033% 78.031% ############ ( 2, 3 ] 8063 12.284% 90.315% ## ( 3, 4 ] 2739 4.173% 94.488% # ( 4, 6 ] 2213 3.372% 97.859% # ( 6, 10 ] 1025 1.562% 99.421% ( 10, 15 ] 185 0.282% 99.703% ( 15, 22 ] 21 0.032% 99.735% ( 22, 34 ] 1 0.002% 99.736% ( 76, 110 ] 26 0.040% 99.776% ( 110, 170 ] 105 0.160% 99.936% ( 170, 250 ] 19 0.029% 99.965% ( 250, 380 ] 15 0.023% 99.988% ( 380, 580 ] 4 0.006% 99.994% ( 580, 870 ] 2 0.003% 99.997% ( 1900, 2900 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 306581 Average: 3.7172 StdDev: 47.39 Min: 0 Median: 1.7636 Max: 6820 Percentiles: P50: 1.76 P75: 2.52 P99: 9.83 P99.9: 185.17 P99.99: 450.89 ------------------------------------------------------ [ 0, 1 ] 12436 4.056% 4.056% # ( 1, 2 ] 184465 60.168% 64.225% ############ ( 2, 3 ] 63412 20.684% 84.908% #### ( 3, 4 ] 20231 6.599% 91.507% # ( 4, 6 ] 16369 5.339% 96.847% # ( 6, 10 ] 6888 2.247% 99.093% ( 10, 15 ] 1375 0.448% 99.542% ( 15, 22 ] 151 0.049% 99.591% ( 22, 34 ] 13 0.004% 99.595% ( 34, 51 ] 146 0.048% 99.643% ( 51, 76 ] 107 0.035% 99.678% ( 76, 110 ] 60 0.020% 99.697% ( 110, 170 ] 585 0.191% 99.888% ( 170, 250 ] 192 0.063% 99.951% ( 250, 380 ] 109 0.036% 99.986% ( 380, 580 ] 32 0.010% 99.997% ( 580, 870 ] 7 0.002% 99.999% ( 1300, 1900 ] 6 0.002% 100.001% ( 1900, 2900 ] 4 0.001% 100.002% ( 2900, 4400 ] 6 0.002% 100.004% ( 4400, 6600 ] 17 0.006% 100.010% ( 6600, 9900 ] 1 0.000% 100.010% ** Level 4 read latency histogram (micros): Count: 55 Average: 1262.0182 StdDev: 1664.45 Min: 0 Median: 165.0000 Max: 5295 Percentiles: P50: 165.00 P75: 2431.25 P99: 5295.00 P99.9: 5295.00 P99.99: 5295.00 ------------------------------------------------------ [ 0, 1 ] 9 16.364% 16.364% ### ( 1, 2 ] 9 16.364% 32.727% ### ( 34, 51 ] 2 3.636% 36.364% # ( 76, 110 ] 2 3.636% 40.000% # ( 110, 170 ] 6 10.909% 50.909% ## ( 170, 250 ] 2 3.636% 54.545% # ( 250, 380 ] 2 3.636% 58.182% # ( 380, 580 ] 3 5.455% 63.636% # ( 1300, 1900 ] 2 3.636% 67.273% # ( 1900, 2900 ] 8 14.545% 81.818% ### ( 2900, 4400 ] 6 10.909% 92.727% ## ( 4400, 6600 ] 4 7.273% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 492.4000 StdDev: 587.56 Min: 99 Median: 170.0000 Max: 2066 Percentiles: P50: 170.00 P75: 870.00 P99: 2066.00 P99.9: 2066.00 P99.99: 2066.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 7 35.000% 50.000% ####### ( 170, 250 ] 2 10.000% 60.000% ## ( 250, 380 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 3 15.000% 90.000% ### ( 1300, 1900 ] 1 5.000% 95.000% # ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.350 H:M:S, 3.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 342.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/09-23:55:27 ... thread 0: (1000000,4000000) ops and (334372.3,333059.4) ops/second in (2.990678,12.009870) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/4 3.18 GB 300.5 2.8 0.0 2.8 6.5 3.7 0.0 1.7 126.9 298.3 22.30 21.26 69 0.323 2874K 13K 0.0 0.0 L1 1/0 23.08 MB 2.3 0.7 0.5 0.2 0.7 0.5 0.1 1.4 226.0 224.2 3.06 2.95 2 1.529 701K 5421 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.5 2.6 238.8 238.3 0.67 0.65 1 0.673 163K 326 0.0 0.0 L3 18/0 936.63 MB 0.9 1.5 0.6 0.9 1.5 0.6 0.0 2.5 225.9 225.3 7.02 6.70 5 1.405 1611K 4209 0.0 0.0 L4 122/0 9.67 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 217.2 217.2 1.18 1.12 1 1.177 259K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 270/4 22.95 GB 0.0 5.4 1.4 4.0 9.1 5.1 1.1 2.4 161.4 272.8 34.23 32.68 78 0.439 5610K 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 1.4 4.0 9.1 5.1 1.1 2.4 161.4 272.8 34.23 32.68 78 0.439 5610K 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 1.4 4.0 5.4 1.4 0.0 0.0 235.9 234.9 23.42 22.69 20 1.171 5610K 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 354.7 10.82 9.98 58 0.186 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 12.0 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.12 GB write, 772.22 MB/s write, 5.40 GB read, 456.89 MB/s read, 34.2 seconds Interval compaction: 9.12 GB write, 777.36 MB/s write, 5.40 GB read, 459.93 MB/s read, 34.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 902114 Average: 2.3533 StdDev: 7.00 Min: 0 Median: 1.5649 Max: 1886 Percentiles: P50: 1.56 P75: 1.96 P99: 5.99 P99.9: 13.70 P99.99: 123.03 ------------------------------------------------------ [ 0, 1 ] 130250 14.438% 14.438% ### ( 1, 2 ] 567887 62.951% 77.389% ############# ( 2, 3 ] 128478 14.242% 91.631% ### ( 3, 4 ] 38789 4.300% 95.931% # ( 4, 6 ] 27821 3.084% 99.015% # ( 6, 10 ] 6569 0.728% 99.743% ( 10, 15 ] 1918 0.213% 99.955% ( 15, 22 ] 215 0.024% 99.979% ( 22, 34 ] 28 0.003% 99.982% ( 34, 51 ] 7 0.001% 99.983% ( 51, 76 ] 8 0.001% 99.984% ( 76, 110 ] 28 0.003% 99.987% ( 110, 170 ] 128 0.014% 100.001% ( 170, 250 ] 79 0.009% 100.010% ( 250, 380 ] 52 0.006% 100.016% ( 380, 580 ] 27 0.003% 100.019% ( 580, 870 ] 10 0.001% 100.020% ( 870, 1300 ] 14 0.002% 100.022% ( 1300, 1900 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 168222 Average: 2.8585 StdDev: 7.09 Min: 0 Median: 1.7986 Max: 952 Percentiles: P50: 1.80 P75: 2.59 P99: 9.05 P99.9: 20.15 P99.99: 170.53 ------------------------------------------------------ [ 0, 1 ] 7708 4.582% 4.582% # ( 1, 2 ] 95671 56.872% 61.454% ########### ( 2, 3 ] 38704 23.008% 84.462% ##### ( 3, 4 ] 11791 7.009% 91.471% # ( 4, 6 ] 10388 6.175% 97.646% # ( 6, 10 ] 2991 1.778% 99.424% ( 10, 15 ] 722 0.429% 99.853% ( 15, 22 ] 107 0.064% 99.917% ( 22, 34 ] 4 0.002% 99.919% ( 34, 51 ] 2 0.001% 99.920% ( 51, 76 ] 2 0.001% 99.922% ( 76, 110 ] 35 0.021% 99.942% ( 110, 170 ] 80 0.048% 99.990% ( 170, 250 ] 27 0.016% 100.006% ( 250, 380 ] 7 0.004% 100.010% ( 380, 580 ] 6 0.004% 100.014% ( 580, 870 ] 5 0.003% 100.017% ( 870, 1300 ] 1 0.001% 100.017% ** Level 2 read latency histogram (micros): Count: 65637 Average: 2.8153 StdDev: 23.20 Min: 0 Median: 1.5407 Max: 4827 Percentiles: P50: 1.54 P75: 1.95 P99: 8.92 P99.9: 156.49 P99.99: 451.81 ------------------------------------------------------ [ 0, 1 ] 11157 16.998% 16.998% ### ( 1, 2 ] 40060 61.033% 78.031% ############ ( 2, 3 ] 8063 12.284% 90.315% ## ( 3, 4 ] 2739 4.173% 94.488% # ( 4, 6 ] 2213 3.372% 97.859% # ( 6, 10 ] 1025 1.562% 99.421% ( 10, 15 ] 185 0.282% 99.703% ( 15, 22 ] 21 0.032% 99.735% ( 22, 34 ] 1 0.002% 99.736% ( 76, 110 ] 26 0.040% 99.776% ( 110, 170 ] 105 0.160% 99.936% ( 170, 250 ] 19 0.029% 99.965% ( 250, 380 ] 15 0.023% 99.988% ( 380, 580 ] 4 0.006% 99.994% ( 580, 870 ] 2 0.003% 99.997% ( 1900, 2900 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 306581 Average: 3.7172 StdDev: 47.39 Min: 0 Median: 1.7636 Max: 6820 Percentiles: P50: 1.76 P75: 2.52 P99: 9.83 P99.9: 185.17 P99.99: 450.89 ------------------------------------------------------ [ 0, 1 ] 12436 4.056% 4.056% # ( 1, 2 ] 184465 60.168% 64.225% ############ ( 2, 3 ] 63412 20.684% 84.908% #### ( 3, 4 ] 20231 6.599% 91.507% # ( 4, 6 ] 16369 5.339% 96.847% # ( 6, 10 ] 6888 2.247% 99.093% ( 10, 15 ] 1375 0.448% 99.542% ( 15, 22 ] 151 0.049% 99.591% ( 22, 34 ] 13 0.004% 99.595% ( 34, 51 ] 146 0.048% 99.643% ( 51, 76 ] 107 0.035% 99.678% ( 76, 110 ] 60 0.020% 99.697% ( 110, 170 ] 585 0.191% 99.888% ( 170, 250 ] 192 0.063% 99.951% ( 250, 380 ] 109 0.036% 99.986% ( 380, 580 ] 32 0.010% 99.997% ( 580, 870 ] 7 0.002% 99.999% ( 1300, 1900 ] 6 0.002% 100.001% ( 1900, 2900 ] 4 0.001% 100.002% ( 2900, 4400 ] 6 0.002% 100.004% ( 4400, 6600 ] 17 0.006% 100.010% ( 6600, 9900 ] 1 0.000% 100.010% ** Level 4 read latency histogram (micros): Count: 55 Average: 1262.0182 StdDev: 1664.45 Min: 0 Median: 165.0000 Max: 5295 Percentiles: P50: 165.00 P75: 2431.25 P99: 5295.00 P99.9: 5295.00 P99.99: 5295.00 ------------------------------------------------------ [ 0, 1 ] 9 16.364% 16.364% ### ( 1, 2 ] 9 16.364% 32.727% ### ( 34, 51 ] 2 3.636% 36.364% # ( 76, 110 ] 2 3.636% 40.000% # ( 110, 170 ] 6 10.909% 50.909% ## ( 170, 250 ] 2 3.636% 54.545% # ( 250, 380 ] 2 3.636% 58.182% # ( 380, 580 ] 3 5.455% 63.636% # ( 1300, 1900 ] 2 3.636% 67.273% # ( 1900, 2900 ] 8 14.545% 81.818% ### ( 2900, 4400 ] 6 10.909% 92.727% ## ( 4400, 6600 ] 4 7.273% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 492.4000 StdDev: 587.56 Min: 99 Median: 170.0000 Max: 2066 Percentiles: P50: 170.00 P75: 870.00 P99: 2066.00 P99.9: 2066.00 P99.99: 2066.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 7 35.000% 50.000% ####### ( 170, 250 ] 2 10.000% 60.000% ## ( 250, 380 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 3 15.000% 90.000% ### ( 1300, 1900 ] 1 5.000% 95.000% # ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.519 H:M:S, 4.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.169 H:M:S, 5.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.200 micros/op 238116 ops/sec 20.020 seconds 4766999 operations; 230.7 MB/s Microseconds per write: Count: 4766999 Average: 4.1997 StdDev: 144.83 Min: 1 Median: 1.7801 Max: 186208 Percentiles: P50: 1.78 P75: 3.06 P99: 8.47 P99.9: 169.02 P99.99: 2484.62 ------------------------------------------------------ [ 0, 1 ] 597009 12.524% 12.524% ### ( 1, 2 ] 2290152 48.042% 60.566% ########## ( 2, 3 ] 648248 13.599% 74.164% ### ( 3, 4 ] 664092 13.931% 88.095% ### ( 4, 6 ] 481879 10.109% 98.204% ## ( 6, 10 ] 61365 1.287% 99.491% ( 10, 15 ] 10557 0.221% 99.713% ( 15, 22 ] 3286 0.069% 99.782% ( 22, 34 ] 1112 0.023% 99.805% ( 34, 51 ] 149 0.003% 99.808% ( 51, 76 ] 23 0.000% 99.809% ( 76, 110 ] 7 0.000% 99.809% ( 110, 170 ] 4425 0.093% 99.902% ( 170, 250 ] 344 0.007% 99.909% ( 250, 380 ] 65 0.001% 99.910% ( 380, 580 ] 2 0.000% 99.910% ( 580, 870 ] 6 0.000% 99.910% ( 870, 1300 ] 3135 0.066% 99.976% ( 1300, 1900 ] 1 0.000% 99.976% ( 1900, 2900 ] 1138 0.024% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 162996 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4766999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4919542968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 154 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 6257171 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 8420753808 rocksdb.compact.write.bytes COUNT : 8261401039 rocksdb.flush.write.bytes COUNT : 4881029977 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 13 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 88 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4848849920 rocksdb.memtable.garbage.bytes.at.flush COUNT : 8462336 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 8460951356 rocksdb.non.last.level.read.count COUNT : 2042471 rocksdb.block.checksum.compute.count COUNT : 2042176 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.432868 P95 : 4.773373 P99 : 7.041129 P100 : 186205.000000 COUNT : 4766999 SUM : 17821945 rocksdb.compaction.times.micros P50 : 1030000.000000 P95 : 2750000.000000 P99 : 3828206.000000 P100 : 3828206.000000 COUNT : 23 SUM : 26353368 rocksdb.compaction.times.cpu_micros P50 : 1030000.000000 P95 : 2750000.000000 P99 : 3663051.000000 P100 : 3663051.000000 COUNT : 23 SUM : 25593031 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 577.058824 P95 : 1254.312500 P99 : 1363.000000 P100 : 1363.000000 COUNT : 71 SUM : 47615 rocksdb.compaction.outfile.sync.micros P50 : 714.642857 P95 : 1337.500000 P99 : 1504.000000 P100 : 1504.000000 COUNT : 75 SUM : 55147 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 73.916667 P95 : 210.666667 P99 : 315.650000 P100 : 377.000000 COUNT : 99 SUM : 9640 rocksdb.table.open.io.micros P50 : 788.539326 P95 : 16400.000000 P99 : 20315.000000 P100 : 20315.000000 COUNT : 154 SUM : 386331 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.670597 P95 : 7.288062 P99 : 11.362376 P100 : 4116.000000 COUNT : 2041720 SUM : 9649613 rocksdb.read.block.get.micros P50 : 354.545455 P95 : 4651.428571 P99 : 6587.428571 P100 : 6977.000000 COUNT : 308 SUM : 253679 rocksdb.write.raw.block.micros P50 : 0.512302 P95 : 0.973374 P99 : 2.944422 P100 : 2668.000000 COUNT : 3183298 SUM : 6044999 rocksdb.numfiles.in.singlecompaction P50 : 3.444444 P95 : 13.000000 P99 : 17.000000 P100 : 17.000000 COUNT : 28 SUM : 125 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560487 P95 : 1183.217156 P99 : 2552.425308 P100 : 186015.000000 COUNT : 39854 SUM : 6260149 rocksdb.sst.read.micros P50 : 1.566950 P95 : 3.929574 P99 : 7.894455 P100 : 6820.000000 COUNT : 2042500 SUM : 5450859 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4766999 SUM : 4919542968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 185384.615385 P95 : 264625.000000 P99 : 347801.000000 P100 : 347801.000000 COUNT : 71 SUM : 13059399 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 95 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0