[2024-07-15 13:58:35.266169] Starting SPDK v24.09-pre git sha1 2728651ee / DPDK 24.03.0 initialization... [2024-07-15 13:58:35.266333] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2726697 ] Set seed to 1721044715262580 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 13:58:35.456021] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 13:58:35.771676] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 13:58:35.771735] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2726697' to capture a snapshot of events at runtime. [2024-07-15 13:58:35.771754] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 13:58:35.771773] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 13:58:35.771787] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2726697 for offline analysis/debug. [2024-07-15 13:58:35.771923] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 13:58:40 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/15-13:58:44 ... thread 0: (1000000,1000000) ops and (255615.1,255615.1) ops/second in (3.912132,3.912132) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 629.11 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 315.3 2.79 2.58 14 0.200 0 0 0.0 0.0 L1 3/3 188.13 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 205.9 205.2 0.92 0.90 1 0.917 191K 579 0.0 0.0 L2 1/1 100.08 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.0 2.5 194.5 194.0 0.83 0.79 1 0.827 163K 346 0.0 0.0 L3 16/9 753.23 MB 0.1 0.1 0.1 0.0 0.1 0.1 0.0 1.0 204.4 204.4 0.29 0.28 1 0.295 61K 0 0.0 0.0 L4 128/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 120/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 278/21 20.09 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 84.8 266.9 4.83 4.55 17 0.284 416K 925 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 84.8 266.9 4.83 4.55 17 0.284 416K 925 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 201.0 200.6 2.04 1.97 3 0.679 416K 925 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 315.3 2.79 2.58 14 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.0 total, 3.9 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.26 GB write, 319.17 MB/s write, 0.40 GB read, 101.41 MB/s read, 4.8 seconds Interval compaction: 1.26 GB write, 329.43 MB/s write, 0.40 GB read, 104.67 MB/s read, 4.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 126560 Average: 3.0833 StdDev: 5.74 Min: 0 Median: 1.8391 Max: 527 Percentiles: P50: 1.84 P75: 2.85 P99: 10.05 P99.9: 21.13 P99.99: 32.17 ------------------------------------------------------ [ 0, 1 ] 1627 1.286% 1.286% ( 1, 2 ] 73471 58.052% 59.338% ############ ( 2, 3 ] 23208 18.338% 77.675% #### ( 3, 4 ] 8505 6.720% 84.396% # ( 4, 6 ] 13841 10.936% 95.332% ## ( 6, 10 ] 4635 3.662% 98.994% # ( 10, 15 ] 918 0.725% 99.720% ( 15, 22 ] 263 0.208% 99.927% ( 22, 34 ] 96 0.076% 100.003% ( 34, 51 ] 3 0.002% 100.006% ( 51, 76 ] 4 0.003% 100.009% ( 170, 250 ] 7 0.006% 100.014% ( 250, 380 ] 7 0.006% 100.020% ( 380, 580 ] 14 0.011% 100.031% ** Level 1 read latency histogram (micros): Count: 31485 Average: 2.7982 StdDev: 6.60 Min: 1 Median: 1.9036 Max: 871 Percentiles: P50: 1.90 P75: 2.61 P99: 8.42 P99.9: 13.41 P99.99: 238.12 ------------------------------------------------------ [ 0, 1 ] 181 0.575% 0.575% ( 1, 2 ] 17222 54.699% 55.274% ########### ( 2, 3 ] 10157 32.260% 87.534% ###### ( 3, 4 ] 1560 4.955% 92.488% # ( 4, 6 ] 1696 5.387% 97.875% # ( 6, 10 ] 588 1.868% 99.743% ( 10, 15 ] 74 0.235% 99.978% ( 15, 22 ] 1 0.003% 99.981% ( 22, 34 ] 1 0.003% 99.984% ( 34, 51 ] 1 0.003% 99.987% ( 76, 110 ] 1 0.003% 99.990% ( 170, 250 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ( 870, 1300 ] 1 0.003% 100.003% ** Level 2 read latency histogram (micros): Count: 40282 Average: 3.6929 StdDev: 60.32 Min: 1 Median: 1.7053 Max: 8467 Percentiles: P50: 1.71 P75: 2.28 P99: 9.80 P99.9: 160.51 P99.99: 2885.90 ------------------------------------------------------ [ 0, 1 ] 1067 2.649% 2.649% # ( 1, 2 ] 27044 67.137% 69.786% ############# ( 2, 3 ] 7629 18.939% 88.724% #### ( 3, 4 ] 1658 4.116% 92.840% # ( 4, 6 ] 1817 4.511% 97.351% # ( 6, 10 ] 699 1.735% 99.086% ( 10, 15 ] 188 0.467% 99.553% ( 15, 22 ] 32 0.079% 99.633% ( 22, 34 ] 3 0.007% 99.640% ( 34, 51 ] 2 0.005% 99.645% ( 51, 76 ] 27 0.067% 99.712% ( 76, 110 ] 5 0.012% 99.724% ( 110, 170 ] 84 0.209% 99.933% ( 170, 250 ] 12 0.030% 99.963% ( 250, 380 ] 4 0.010% 99.973% ( 380, 580 ] 4 0.010% 99.983% ( 1300, 1900 ] 1 0.002% 99.985% ( 1900, 2900 ] 2 0.005% 99.990% ( 2900, 4400 ] 2 0.005% 99.995% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 35846 Average: 8.8201 StdDev: 161.90 Min: 1 Median: 2.3860 Max: 10940 Percentiles: P50: 2.39 P75: 2.96 P99: 14.76 P99.9: 1678.48 P99.99: 7056.94 ------------------------------------------------------ [ 0, 1 ] 86 0.240% 0.240% ( 1, 2 ] 11847 33.050% 33.290% ####### ( 2, 3 ] 15518 43.291% 76.580% ######### ( 3, 4 ] 2631 7.340% 83.920% # ( 4, 6 ] 3472 9.686% 93.606% ## ( 6, 10 ] 1570 4.380% 97.986% # ( 10, 15 ] 382 1.066% 99.051% ( 15, 22 ] 89 0.248% 99.300% ( 22, 34 ] 12 0.033% 99.333% ( 51, 76 ] 74 0.206% 99.540% ( 76, 110 ] 19 0.053% 99.593% ( 110, 170 ] 76 0.212% 99.805% ( 170, 250 ] 23 0.064% 99.869% ( 250, 380 ] 3 0.008% 99.877% ( 380, 580 ] 4 0.011% 99.888% ( 870, 1300 ] 1 0.003% 99.891% ( 1300, 1900 ] 5 0.014% 99.905% ( 1900, 2900 ] 6 0.017% 99.922% ( 2900, 4400 ] 13 0.036% 99.958% ( 4400, 6600 ] 11 0.031% 99.989% ( 6600, 9900 ] 3 0.008% 99.997% ( 9900, 14000 ] 2 0.006% 100.003% ** Level 4 read latency histogram (micros): Count: 25 Average: 3908.1200 StdDev: 2326.81 Min: 139 Median: 4025.0000 Max: 8008 Percentiles: P50: 4025.00 P75: 5805.56 P99: 8008.00 P99.9: 8008.00 P99.99: 8008.00 ------------------------------------------------------ ( 110, 170 ] 1 4.000% 4.000% # ( 250, 380 ] 1 4.000% 8.000% # ( 380, 580 ] 2 8.000% 16.000% ## ( 1300, 1900 ] 2 8.000% 24.000% ## ( 1900, 2900 ] 5 20.000% 44.000% #### ( 2900, 4400 ] 2 8.000% 52.000% ## ( 4400, 6600 ] 9 36.000% 88.000% ####### ( 6600, 9900 ] 3 12.000% 100.000% ## ** DB Stats ** Uptime(secs): 4.0 total, 3.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 243.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 251.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/15-13:58:50 ... thread 0: (1000000,2000000) ops and (183578.1,213688.8) ops/second in (5.447273,9.359405) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 1.35 GB 6.3 1.0 0.0 1.0 2.9 1.8 0.0 1.6 87.2 240.6 12.26 11.45 33 0.372 1085K 5477 0.0 0.0 L1 1/1 49.78 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 189.2 188.0 3.32 3.26 2 1.661 638K 4224 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.5 194.5 194.0 0.83 0.79 1 0.827 163K 346 0.0 0.0 L3 17/0 749.54 MB 0.7 1.3 0.5 0.8 1.3 0.5 0.0 2.5 178.7 178.3 7.52 7.12 5 1.505 1365K 3576 0.0 0.0 L4 134/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 186.5 186.5 1.23 1.18 1 1.228 232K 0 0.0 0.0 L5 124/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 285/9 21.06 GB 0.0 3.4 1.2 2.1 5.2 3.1 1.0 2.8 136.4 210.9 25.16 23.81 42 0.599 3485K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.4 1.2 2.1 5.2 3.1 1.0 2.8 136.4 210.9 25.16 23.81 42 0.599 3485K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.4 1.2 2.1 3.3 1.2 0.0 0.0 180.3 179.5 19.04 18.22 13 1.465 3485K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 308.3 6.12 5.59 29 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.5 total, 9.4 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.18 GB write, 559.19 MB/s write, 3.35 GB read, 361.75 MB/s read, 25.2 seconds Interval compaction: 5.18 GB write, 566.71 MB/s write, 3.35 GB read, 366.61 MB/s read, 25.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 445432 Average: 3.5663 StdDev: 21.49 Min: 0 Median: 2.1156 Max: 3994 Percentiles: P50: 2.12 P75: 3.08 P99: 10.61 P99.9: 26.01 P99.99: 148.49 ------------------------------------------------------ [ 0, 1 ] 11136 2.500% 2.500% # ( 1, 2 ] 197368 44.309% 46.809% ######### ( 2, 3 ] 122941 27.600% 74.410% ###### ( 3, 4 ] 32276 7.246% 81.656% # ( 4, 6 ] 55897 12.549% 94.205% ### ( 6, 10 ] 20937 4.700% 98.905% # ( 10, 15 ] 3472 0.779% 99.685% ( 15, 22 ] 866 0.194% 99.879% ( 22, 34 ] 283 0.064% 99.943% ( 34, 51 ] 18 0.004% 99.947% ( 51, 76 ] 10 0.002% 99.949% ( 76, 110 ] 1 0.000% 99.949% ( 110, 170 ] 286 0.064% 100.013% ( 170, 250 ] 98 0.022% 100.035% ( 250, 380 ] 52 0.012% 100.047% ( 380, 580 ] 39 0.009% 100.056% ( 580, 870 ] 2 0.000% 100.056% ( 870, 1300 ] 7 0.002% 100.058% ( 1300, 1900 ] 2 0.000% 100.058% ( 1900, 2900 ] 6 0.001% 100.059% ( 2900, 4400 ] 11 0.002% 100.062% ** Level 1 read latency histogram (micros): Count: 145818 Average: 3.8459 StdDev: 14.33 Min: 1 Median: 2.5544 Max: 2927 Percentiles: P50: 2.55 P75: 3.59 P99: 11.27 P99.9: 30.93 P99.99: 212.58 ------------------------------------------------------ [ 0, 1 ] 202 0.139% 0.139% ( 1, 2 ] 36664 25.144% 25.282% ##### ( 2, 3 ] 65011 44.584% 69.866% ######### ( 3, 4 ] 12703 8.712% 78.577% ## ( 4, 6 ] 20809 14.271% 92.848% ### ( 6, 10 ] 8653 5.934% 98.782% # ( 10, 15 ] 1252 0.859% 99.641% ( 15, 22 ] 306 0.210% 99.850% ( 22, 34 ] 97 0.067% 99.917% ( 34, 51 ] 15 0.010% 99.927% ( 51, 76 ] 4 0.003% 99.930% ( 76, 110 ] 1 0.001% 99.931% ( 110, 170 ] 63 0.043% 99.974% ( 170, 250 ] 44 0.030% 100.004% ( 250, 380 ] 11 0.008% 100.012% ( 380, 580 ] 2 0.001% 100.013% ( 580, 870 ] 7 0.005% 100.018% ( 870, 1300 ] 5 0.003% 100.021% ( 1900, 2900 ] 1 0.001% 100.022% ( 2900, 4400 ] 1 0.001% 100.023% ** Level 2 read latency histogram (micros): Count: 65581 Average: 3.6365 StdDev: 47.72 Min: 1 Median: 1.8741 Max: 8467 Percentiles: P50: 1.87 P75: 2.59 P99: 9.69 P99.9: 164.22 P99.99: 1565.14 ------------------------------------------------------ [ 0, 1 ] 1090 1.662% 1.662% ( 1, 2 ] 36267 55.301% 56.963% ########### ( 2, 3 ] 19951 30.422% 87.385% ###### ( 3, 4 ] 2944 4.489% 91.874% # ( 4, 6 ] 3513 5.357% 97.231% # ( 6, 10 ] 1258 1.918% 99.149% ( 10, 15 ] 287 0.438% 99.587% ( 15, 22 ] 40 0.061% 99.648% ( 22, 34 ] 4 0.006% 99.654% ( 34, 51 ] 2 0.003% 99.657% ( 51, 76 ] 27 0.041% 99.698% ( 76, 110 ] 5 0.008% 99.706% ( 110, 170 ] 141 0.215% 99.921% ( 170, 250 ] 28 0.043% 99.963% ( 250, 380 ] 11 0.017% 99.980% ( 380, 580 ] 5 0.008% 99.988% ( 580, 870 ] 1 0.002% 99.989% ( 1300, 1900 ] 1 0.002% 99.991% ( 1900, 2900 ] 2 0.003% 99.994% ( 2900, 4400 ] 2 0.003% 99.997% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 260933 Average: 4.5015 StdDev: 61.66 Min: 1 Median: 2.3586 Max: 10940 Percentiles: P50: 2.36 P75: 2.93 P99: 11.52 P99.9: 187.42 P99.99: 546.22 ------------------------------------------------------ [ 0, 1 ] 590 0.226% 0.226% ( 1, 2 ] 89010 34.112% 34.338% ####### ( 2, 3 ] 113964 43.676% 78.014% ######### ( 3, 4 ] 17412 6.673% 84.687% # ( 4, 6 ] 26308 10.082% 94.769% ## ( 6, 10 ] 10443 4.002% 98.771% # ( 10, 15 ] 1962 0.752% 99.523% ( 15, 22 ] 336 0.129% 99.652% ( 22, 34 ] 52 0.020% 99.672% ( 34, 51 ] 11 0.004% 99.676% ( 51, 76 ] 160 0.061% 99.737% ( 76, 110 ] 53 0.020% 99.758% ( 110, 170 ] 336 0.129% 99.887% ( 170, 250 ] 161 0.062% 99.948% ( 250, 380 ] 74 0.028% 99.977% ( 380, 580 ] 42 0.016% 99.993% ( 580, 870 ] 7 0.003% 99.995% ( 870, 1300 ] 9 0.003% 99.999% ( 1300, 1900 ] 5 0.002% 100.001% ( 1900, 2900 ] 7 0.003% 100.003% ( 2900, 4400 ] 14 0.005% 100.009% ( 4400, 6600 ] 11 0.004% 100.013% ( 6600, 9900 ] 3 0.001% 100.014% ( 9900, 14000 ] 2 0.001% 100.015% ** Level 4 read latency histogram (micros): Count: 55 Average: 1809.1091 StdDev: 2477.21 Min: 1 Median: 216.6667 Max: 8008 Percentiles: P50: 216.67 P75: 3087.50 P99: 8008.00 P99.9: 8008.00 P99.99: 8008.00 ------------------------------------------------------ [ 0, 1 ] 5 9.091% 9.091% ## ( 1, 2 ] 11 20.000% 29.091% #### ( 2, 3 ] 2 3.636% 32.727% # ( 34, 51 ] 4 7.273% 40.000% # ( 110, 170 ] 2 3.636% 43.636% # ( 170, 250 ] 6 10.909% 54.545% ## ( 250, 380 ] 2 3.636% 58.182% # ( 380, 580 ] 2 3.636% 61.818% # ( 1300, 1900 ] 2 3.636% 65.455% # ( 1900, 2900 ] 5 9.091% 74.545% ## ( 2900, 4400 ] 2 3.636% 78.182% # ( 4400, 6600 ] 9 16.364% 94.545% ### ( 6600, 9900 ] 3 5.455% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 623.9000 StdDev: 719.17 Min: 118 Median: 236.6667 Max: 2897 Percentiles: P50: 236.67 P75: 870.00 P99: 2700.00 P99.9: 2880.00 P99.99: 2897.00 ------------------------------------------------------ ( 110, 170 ] 5 25.000% 25.000% ##### ( 170, 250 ] 6 30.000% 55.000% ###### ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.5 total, 5.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 207.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.277 H:M:S, 2.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 180.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.277 H:M:S, 5.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/15-13:58:58 ... thread 0: (1000000,3000000) ops and (119569.5,169274.0) ops/second in (8.363336,17.722741) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.04 GB 12.6 1.8 0.0 1.8 4.6 2.8 0.0 1.6 93.9 242.4 19.43 18.30 52 0.374 1852K 9167 0.0 0.0 L1 6/6 446.11 MB 0.0 1.9 1.7 0.2 1.9 1.7 0.1 1.1 185.4 181.3 10.75 10.44 3 3.585 2024K 43K 0.0 0.0 L2 1/0 98.54 MB 1.0 0.2 0.1 0.1 0.2 0.1 1.2 2.5 194.5 194.0 0.83 0.79 1 0.827 163K 346 0.0 0.0 L3 17/0 992.84 MB 1.0 1.6 0.7 0.9 1.6 0.7 0.6 2.2 181.8 180.8 8.88 8.41 7 1.268 1638K 8547 0.0 0.0 L4 135/0 9.67 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 186.5 186.5 1.23 1.18 1 1.228 232K 0 0.0 0.0 L5 132/0 9.78 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 299/12 21.99 GB 0.0 5.7 2.7 3.0 8.5 5.5 3.6 3.0 141.6 210.5 41.11 39.13 64 0.642 5911K 61K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 2.7 3.0 8.5 5.5 3.6 3.0 141.6 210.5 41.11 39.13 64 0.642 5911K 61K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 2.7 3.0 5.6 2.7 0.0 0.0 184.3 182.4 31.58 30.38 19 1.662 5911K 61K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 303.5 9.53 8.75 45 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.9 total, 17.7 interval Flush(GB): cumulative 2.826, interval 2.826 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.45 GB write, 484.74 MB/s write, 5.68 GB read, 326.08 MB/s read, 41.1 seconds Interval compaction: 8.45 GB write, 488.18 MB/s write, 5.68 GB read, 328.40 MB/s read, 41.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 973666 Average: 3.1541 StdDev: 15.54 Min: 0 Median: 1.9722 Max: 3994 Percentiles: P50: 1.97 P75: 2.72 P99: 9.52 P99.9: 25.01 P99.99: 160.92 ------------------------------------------------------ [ 0, 1 ] 13074 1.343% 1.343% ( 1, 2 ] 487284 50.046% 51.389% ########## ( 2, 3 ] 320582 32.925% 84.314% ####### ( 3, 4 ] 45423 4.665% 88.979% # ( 4, 6 ] 73404 7.539% 96.518% ## ( 6, 10 ] 27447 2.819% 99.337% # ( 10, 15 ] 4455 0.458% 99.795% ( 15, 22 ] 951 0.098% 99.893% ( 22, 34 ] 296 0.030% 99.923% ( 34, 51 ] 21 0.002% 99.925% ( 51, 76 ] 16 0.002% 99.927% ( 76, 110 ] 4 0.000% 99.927% ( 110, 170 ] 723 0.074% 100.001% ( 170, 250 ] 132 0.014% 100.015% ( 250, 380 ] 86 0.009% 100.024% ( 380, 580 ] 61 0.006% 100.030% ( 580, 870 ] 5 0.001% 100.031% ( 870, 1300 ] 11 0.001% 100.032% ( 1300, 1900 ] 3 0.000% 100.032% ( 1900, 2900 ] 7 0.001% 100.033% ( 2900, 4400 ] 11 0.001% 100.034% ** Level 1 read latency histogram (micros): Count: 207769 Average: 3.5949 StdDev: 16.11 Min: 1 Median: 2.3580 Max: 2927 Percentiles: P50: 2.36 P75: 2.96 P99: 9.95 P99.9: 32.07 P99.99: 215.16 ------------------------------------------------------ [ 0, 1 ] 2600 1.251% 1.251% ( 1, 2 ] 70368 33.868% 35.120% ####### ( 2, 3 ] 86369 41.570% 76.689% ######## ( 3, 4 ] 14413 6.937% 83.627% # ( 4, 6 ] 22882 11.013% 94.640% ## ( 6, 10 ] 9176 4.416% 99.056% # ( 10, 15 ] 1357 0.653% 99.709% ( 15, 22 ] 314 0.151% 99.860% ( 22, 34 ] 98 0.047% 99.908% ( 34, 51 ] 16 0.008% 99.915% ( 51, 76 ] 4 0.002% 99.917% ( 76, 110 ] 1 0.000% 99.918% ( 110, 170 ] 122 0.059% 99.976% ( 170, 250 ] 50 0.024% 100.000% ( 250, 380 ] 21 0.010% 100.011% ( 380, 580 ] 11 0.005% 100.016% ( 580, 870 ] 14 0.007% 100.023% ( 870, 1300 ] 7 0.003% 100.026% ( 1900, 2900 ] 3 0.001% 100.027% ( 2900, 4400 ] 1 0.000% 100.028% ** Level 2 read latency histogram (micros): Count: 65581 Average: 3.6365 StdDev: 47.72 Min: 1 Median: 1.8741 Max: 8467 Percentiles: P50: 1.87 P75: 2.59 P99: 9.69 P99.9: 164.22 P99.99: 1565.14 ------------------------------------------------------ [ 0, 1 ] 1090 1.662% 1.662% ( 1, 2 ] 36267 55.301% 56.963% ########### ( 2, 3 ] 19951 30.422% 87.385% ###### ( 3, 4 ] 2944 4.489% 91.874% # ( 4, 6 ] 3513 5.357% 97.231% # ( 6, 10 ] 1258 1.918% 99.149% ( 10, 15 ] 287 0.438% 99.587% ( 15, 22 ] 40 0.061% 99.648% ( 22, 34 ] 4 0.006% 99.654% ( 34, 51 ] 2 0.003% 99.657% ( 51, 76 ] 27 0.041% 99.698% ( 76, 110 ] 5 0.008% 99.706% ( 110, 170 ] 141 0.215% 99.921% ( 170, 250 ] 28 0.043% 99.963% ( 250, 380 ] 11 0.017% 99.980% ( 380, 580 ] 5 0.008% 99.988% ( 580, 870 ] 1 0.002% 99.989% ( 1300, 1900 ] 1 0.002% 99.991% ( 1900, 2900 ] 2 0.003% 99.994% ( 2900, 4400 ] 2 0.003% 99.997% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 279938 Average: 4.5345 StdDev: 60.43 Min: 0 Median: 2.3227 Max: 10940 Percentiles: P50: 2.32 P75: 2.91 P99: 11.52 P99.9: 210.66 P99.99: 769.68 ------------------------------------------------------ [ 0, 1 ] 1643 0.587% 0.587% ( 1, 2 ] 99782 35.644% 36.231% ####### ( 2, 3 ] 119450 42.670% 78.901% ######### ( 3, 4 ] 17967 6.418% 85.320% # ( 4, 6 ] 26925 9.618% 94.938% ## ( 6, 10 ] 10755 3.842% 98.780% # ( 10, 15 ] 2023 0.723% 99.502% ( 15, 22 ] 347 0.124% 99.626% ( 22, 34 ] 54 0.019% 99.646% ( 34, 51 ] 11 0.004% 99.650% ( 51, 76 ] 160 0.057% 99.707% ( 76, 110 ] 54 0.019% 99.726% ( 110, 170 ] 391 0.140% 99.866% ( 170, 250 ] 189 0.068% 99.933% ( 250, 380 ] 93 0.033% 99.966% ( 380, 580 ] 49 0.018% 99.984% ( 580, 870 ] 26 0.009% 99.993% ( 870, 1300 ] 14 0.005% 99.998% ( 1300, 1900 ] 7 0.003% 100.001% ( 1900, 2900 ] 8 0.003% 100.004% ( 2900, 4400 ] 14 0.005% 100.009% ( 4400, 6600 ] 11 0.004% 100.013% ( 6600, 9900 ] 3 0.001% 100.014% ( 9900, 14000 ] 2 0.001% 100.014% ** Level 4 read latency histogram (micros): Count: 55 Average: 1809.1091 StdDev: 2477.21 Min: 1 Median: 216.6667 Max: 8008 Percentiles: P50: 216.67 P75: 3087.50 P99: 8008.00 P99.9: 8008.00 P99.99: 8008.00 ------------------------------------------------------ [ 0, 1 ] 5 9.091% 9.091% ## ( 1, 2 ] 11 20.000% 29.091% #### ( 2, 3 ] 2 3.636% 32.727% # ( 34, 51 ] 4 7.273% 40.000% # ( 110, 170 ] 2 3.636% 43.636% # ( 170, 250 ] 6 10.909% 54.545% ## ( 250, 380 ] 2 3.636% 58.182% # ( 380, 580 ] 2 3.636% 61.818% # ( 1300, 1900 ] 2 3.636% 65.455% # ( 1900, 2900 ] 5 9.091% 74.545% ## ( 2900, 4400 ] 2 3.636% 78.182% # ( 4400, 6600 ] 9 16.364% 94.545% ### ( 6600, 9900 ] 3 5.455% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 599.5500 StdDev: 712.00 Min: 117 Median: 218.0000 Max: 2897 Percentiles: P50: 218.00 P75: 773.33 P99: 2700.00 P99.9: 2880.00 P99.99: 2897.00 ------------------------------------------------------ ( 110, 170 ] 24 40.000% 40.000% ######## ( 170, 250 ] 10 16.667% 56.667% ### ( 250, 380 ] 2 3.333% 60.000% # ( 380, 580 ] 7 11.667% 71.667% ## ( 580, 870 ] 3 5.000% 76.667% # ( 870, 1300 ] 2 3.333% 80.000% # ( 1300, 1900 ] 9 15.000% 95.000% ### ( 1900, 2900 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 17.9 total, 8.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 165.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.277 H:M:S, 1.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 117.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.109 micros/op 163699 ops/sec 20.006 seconds 3274999 operations; 158.6 MB/s Microseconds per write: Count: 3274999 Average: 6.1087 StdDev: 143.33 Min: 1 Median: 4.6439 Max: 256453 Percentiles: P50: 4.64 P75: 6.43 P99: 20.04 P99.9: 114.69 P99.99: 363.80 ------------------------------------------------------ [ 0, 1 ] 35593 1.087% 1.087% ( 1, 2 ] 471642 14.401% 15.488% ### ( 2, 3 ] 578028 17.650% 33.138% #### ( 3, 4 ] 185836 5.674% 38.812% # ( 4, 6 ] 1138076 34.750% 73.563% ####### ( 6, 10 ] 441434 13.479% 87.042% ### ( 10, 15 ] 349086 10.659% 97.701% ## ( 15, 22 ] 59156 1.806% 99.507% ( 22, 34 ] 10836 0.331% 99.838% ( 34, 51 ] 1762 0.054% 99.892% ( 51, 76 ] 194 0.006% 99.898% ( 76, 110 ] 19 0.001% 99.898% ( 110, 170 ] 794 0.024% 99.922% ( 170, 250 ] 828 0.025% 99.948% ( 250, 380 ] 1585 0.048% 99.996% ( 380, 580 ] 105 0.003% 99.999% ( 580, 870 ] 13 0.000% 100.000% ( 870, 1300 ] 1 0.000% 100.000% ( 1300, 1900 ] 5 0.000% 100.000% ( 2900, 4400 ] 3 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 74374 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3274999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3379798968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 151 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 276814 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 7014211529 rocksdb.compact.write.bytes COUNT : 6939452050 rocksdb.flush.write.bytes COUNT : 3298114161 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 21 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 78 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3276242944 rocksdb.memtable.garbage.bytes.at.flush COUNT : 5603328 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 7047212279 rocksdb.non.last.level.read.count COUNT : 1700169 rocksdb.block.checksum.compute.count COUNT : 1699888 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 3.530068 P95 : 11.661801 P99 : 15.788373 P100 : 256446.000000 COUNT : 3274999 SUM : 16474970 rocksdb.compaction.times.micros P50 : 1300000.000000 P95 : 4300000.000000 P99 : 7433051.000000 P100 : 7433051.000000 COUNT : 20 SUM : 32759955 rocksdb.compaction.times.cpu_micros P50 : 1086666.666667 P95 : 4300000.000000 P99 : 7178166.000000 P100 : 7178166.000000 COUNT : 20 SUM : 31545303 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 761.250000 P95 : 1244.000000 P99 : 1244.000000 P100 : 1244.000000 COUNT : 49 SUM : 37540 rocksdb.compaction.outfile.sync.micros P50 : 715.113636 P95 : 1215.433333 P99 : 3083.000000 P100 : 3083.000000 COUNT : 79 SUM : 58593 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 109.595238 P95 : 302.928571 P99 : 351.000000 P100 : 351.000000 COUNT : 83 SUM : 10780 rocksdb.table.open.io.micros P50 : 1124.692308 P95 : 21266.666667 P99 : 25349.000000 P100 : 25349.000000 COUNT : 151 SUM : 493876 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.931570 P95 : 9.464011 P99 : 14.518871 P100 : 10465.000000 COUNT : 1699599 SUM : 10017793 rocksdb.read.block.get.micros P50 : 452.527473 P95 : 5380.000000 P99 : 9419.142857 P100 : 11109.000000 COUNT : 302 SUM : 319061 rocksdb.write.raw.block.micros P50 : 0.533851 P95 : 1.344709 P99 : 4.648773 P100 : 4299.000000 COUNT : 2486421 SUM : 5678152 rocksdb.numfiles.in.singlecompaction P50 : 3.294118 P95 : 9.066667 P99 : 12.000000 P100 : 12.000000 COUNT : 34 SUM : 136 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 22000.000000 P95 : 256185.000000 P99 : 256185.000000 P100 : 256185.000000 COUNT : 2 SUM : 276814 rocksdb.sst.read.micros P50 : 2.071057 P95 : 5.677347 P99 : 9.699448 P100 : 10940.000000 COUNT : 1700458 SUM : 5925060 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3274999 SUM : 3379798968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211777.777778 P95 : 285750.000000 P99 : 423336.000000 P100 : 423336.000000 COUNT : 49 SUM : 10382765 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 82 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0