[2024-07-15 10:28:40.948995] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 24.03.0 initialization... [2024-07-15 10:28:40.949337] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid176136 ] Set seed to 1721032120941383 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 10:28:41.258115] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 10:28:41.557857] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 10:28:41.557920] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 176136' to capture a snapshot of events at runtime. [2024-07-15 10:28:41.557938] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 10:28:41.557957] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 10:28:41.557972] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid176136 for offline analysis/debug. [2024-07-15 10:28:41.558112] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 10:28:49 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/15-10:28:55 ... thread 0: (1000000,1000000) ops and (162087.9,162087.9) ops/second in (6.169493,6.169493) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/4 439.96 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 168.9 5.21 4.86 11 0.474 0 0 0.0 0.0 L1 4/4 250.52 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 181.9 181.1 1.38 1.34 1 1.384 255K 1138 0.0 0.0 L2 1/1 106.33 MB 0.0 0.4 0.2 0.3 0.4 0.2 0.0 2.4 192.0 191.4 2.33 2.24 2 1.164 453K 1357 0.0 0.0 L3 21/13 1.04 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.0 1.0 173.7 173.7 1.03 0.96 1 1.029 181K 0 0.0 0.0 L4 152/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 132/0 8.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 315/22 20.08 GB 0.0 0.9 0.6 0.3 1.7 1.5 0.2 2.0 88.2 176.3 9.95 9.40 15 0.663 890K 2495 0.0 0.0 Int 0/0 0.00 KB 0.0 0.9 0.6 0.3 1.7 1.5 0.2 2.0 88.2 176.3 9.95 9.40 15 0.663 890K 2495 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.9 0.6 0.3 0.9 0.6 0.0 0.0 185.1 184.5 4.74 4.54 4 1.185 890K 2495 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 168.9 5.21 4.86 11 0.474 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.2 interval Flush(GB): cumulative 0.859, interval 0.859 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.71 GB write, 277.60 MB/s write, 0.86 GB read, 138.77 MB/s read, 10.0 seconds Interval compaction: 1.71 GB write, 284.23 MB/s write, 0.86 GB read, 142.08 MB/s read, 10.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 120552 Average: 2.9968 StdDev: 16.69 Min: 1 Median: 1.9436 Max: 3627 Percentiles: P50: 1.94 P75: 2.70 P99: 8.55 P99.9: 17.45 P99.99: 545.75 ------------------------------------------------------ [ 0, 1 ] 1035 0.859% 0.859% ( 1, 2 ] 62785 52.081% 52.940% ########## ( 2, 3 ] 38008 31.528% 84.468% ###### ( 3, 4 ] 6966 5.778% 90.247% # ( 4, 6 ] 9366 7.769% 98.016% ## ( 6, 10 ] 1864 1.546% 99.562% ( 10, 15 ] 372 0.309% 99.871% ( 15, 22 ] 104 0.086% 99.957% ( 22, 34 ] 23 0.019% 99.976% ( 34, 51 ] 5 0.004% 99.980% ( 51, 76 ] 3 0.002% 99.983% ( 380, 580 ] 12 0.010% 99.993% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 4 0.003% 99.998% ( 1300, 1900 ] 2 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 1 read latency histogram (micros): Count: 6982 Average: 5.8178 StdDev: 19.47 Min: 1 Median: 4.5197 Max: 1155 Percentiles: P50: 4.52 P75: 5.53 P99: 17.12 P99.9: 34.31 P99.99: 999.77 ------------------------------------------------------ [ 0, 1 ] 2 0.029% 0.029% ( 1, 2 ] 8 0.115% 0.143% ( 2, 3 ] 58 0.831% 0.974% ( 3, 4 ] 2528 36.207% 37.181% ####### ( 4, 6 ] 3444 49.327% 86.508% ########## ( 6, 10 ] 699 10.011% 96.520% ## ( 10, 15 ] 152 2.177% 98.697% ( 15, 22 ] 70 1.003% 99.699% ( 22, 34 ] 14 0.201% 99.900% ( 34, 51 ] 1 0.014% 99.914% ( 170, 250 ] 1 0.014% 99.928% ( 250, 380 ] 1 0.014% 99.943% ( 380, 580 ] 1 0.014% 99.957% ( 580, 870 ] 2 0.029% 99.986% ( 870, 1300 ] 1 0.014% 100.000% ** Level 2 read latency histogram (micros): Count: 112259 Average: 3.0040 StdDev: 36.68 Min: 1 Median: 1.8088 Max: 9444 Percentiles: P50: 1.81 P75: 2.46 P99: 8.09 P99.9: 63.95 P99.99: 682.90 ------------------------------------------------------ [ 0, 1 ] 1445 1.287% 1.287% ( 1, 2 ] 67609 60.226% 61.513% ############ ( 2, 3 ] 32732 29.158% 90.671% ###### ( 3, 4 ] 4039 3.598% 94.269% # ( 4, 6 ] 4633 4.127% 98.396% # ( 6, 10 ] 1301 1.159% 99.555% ( 10, 15 ] 313 0.279% 99.833% ( 15, 22 ] 34 0.030% 99.864% ( 22, 34 ] 2 0.002% 99.865% ( 34, 51 ] 3 0.003% 99.868% ( 51, 76 ] 69 0.061% 99.930% ( 76, 110 ] 24 0.021% 99.951% ( 110, 170 ] 7 0.006% 99.957% ( 170, 250 ] 19 0.017% 99.974% ( 250, 380 ] 9 0.008% 99.982% ( 380, 580 ] 7 0.006% 99.988% ( 580, 870 ] 5 0.004% 99.993% ( 870, 1300 ] 4 0.004% 99.996% ( 1300, 1900 ] 3 0.003% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ( 6600, 9900 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 131174 Average: 5.3826 StdDev: 117.88 Min: 1 Median: 1.8975 Max: 12696 Percentiles: P50: 1.90 P75: 2.60 P99: 9.95 P99.9: 241.00 P99.99: 7464.78 ------------------------------------------------------ [ 0, 1 ] 1319 1.006% 1.006% ( 1, 2 ] 71611 54.592% 55.598% ########### ( 2, 3 ] 42511 32.408% 88.006% ###### ( 3, 4 ] 5096 3.885% 91.891% # ( 4, 6 ] 6344 4.836% 96.727% # ( 6, 10 ] 3021 2.303% 99.030% ( 10, 15 ] 557 0.425% 99.455% ( 15, 22 ] 111 0.085% 99.540% ( 22, 34 ] 16 0.012% 99.552% ( 34, 51 ] 1 0.001% 99.553% ( 51, 76 ] 2 0.002% 99.554% ( 76, 110 ] 78 0.059% 99.613% ( 110, 170 ] 335 0.255% 99.869% ( 170, 250 ] 46 0.035% 99.904% ( 250, 380 ] 29 0.022% 99.926% ( 380, 580 ] 29 0.022% 99.948% ( 580, 870 ] 21 0.016% 99.964% ( 870, 1300 ] 10 0.008% 99.972% ( 1300, 1900 ] 5 0.004% 99.976% ( 1900, 2900 ] 3 0.002% 99.978% ( 2900, 4400 ] 1 0.001% 99.979% ( 4400, 6600 ] 12 0.009% 99.988% ( 6600, 9900 ] 11 0.008% 99.996% ( 9900, 14000 ] 5 0.004% 100.000% ** Level 4 read latency histogram (micros): Count: 5 Average: 4584.0000 StdDev: 2726.56 Min: 309 Median: 4950.0000 Max: 8583 Percentiles: P50: 4950.00 P75: 6325.00 P99: 8583.00 P99.9: 8583.00 P99.99: 8583.00 ------------------------------------------------------ ( 250, 380 ] 1 20.000% 20.000% #### ( 2900, 4400 ] 1 20.000% 40.000% #### ( 4400, 6600 ] 2 40.000% 80.000% ######## ( 6600, 9900 ] 1 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 6.3 total, 6.2 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 155.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.445 H:M:S, 22.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 159.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.445 H:M:S, 23.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-10:29:00 ... thread 0: (1000000,2000000) ops and (205387.1,181186.5) ops/second in (4.868854,11.038347) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.41 GB 87.7 0.7 0.0 0.7 2.6 1.8 0.0 1.4 49.4 172.8 15.27 14.29 30 0.509 766K 3665 0.0 0.0 L1 4/4 250.52 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 181.9 181.1 1.38 1.34 1 1.384 255K 1138 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.3 0.4 0.2 0.0 2.4 192.0 191.4 2.33 2.24 2 1.164 453K 1357 0.0 0.0 L3 19/0 817.21 MB 0.8 1.1 0.3 0.9 1.1 0.3 0.0 4.1 193.0 191.6 6.05 5.62 2 3.023 1185K 8572 0.0 0.0 L4 154/0 9.56 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 145.2 145.2 0.58 0.50 1 0.576 84K 0 0.0 0.0 L5 140/0 9.04 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 329/12 21.06 GB 0.0 2.6 0.8 1.9 4.5 2.6 0.9 2.4 105.6 178.7 25.60 23.99 36 0.711 2746K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.6 0.8 1.9 4.5 2.6 0.9 2.4 105.6 178.7 25.60 23.99 36 0.711 2746K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.6 0.8 1.9 2.6 0.8 0.0 0.0 166.1 165.2 16.28 15.46 9 1.809 2746K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 202.5 9.32 8.53 27 0.345 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.2 total, 11.0 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.47 GB write, 408.95 MB/s write, 2.64 GB read, 241.65 MB/s read, 25.6 seconds Interval compaction: 4.47 GB write, 414.40 MB/s write, 2.64 GB read, 244.87 MB/s read, 25.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 379041 Average: 4.7488 StdDev: 17.13 Min: 1 Median: 3.5901 Max: 3627 Percentiles: P50: 3.59 P75: 5.16 P99: 15.28 P99.9: 31.46 P99.99: 91.66 ------------------------------------------------------ [ 0, 1 ] 1172 0.309% 0.309% ( 1, 2 ] 85889 22.660% 22.969% ##### ( 2, 3 ] 71068 18.749% 41.718% #### ( 3, 4 ] 53197 14.035% 55.753% ### ( 4, 6 ] 125280 33.052% 88.805% ####### ( 6, 10 ] 30459 8.036% 96.840% ## ( 10, 15 ] 8078 2.131% 98.972% ( 15, 22 ] 2754 0.727% 99.698% ( 22, 34 ] 972 0.256% 99.955% ( 34, 51 ] 98 0.026% 99.980% ( 51, 76 ] 9 0.002% 99.983% ( 76, 110 ] 61 0.016% 99.999% ( 110, 170 ] 104 0.027% 100.026% ( 170, 250 ] 85 0.022% 100.049% ( 250, 380 ] 53 0.014% 100.063% ( 380, 580 ] 46 0.012% 100.075% ( 580, 870 ] 18 0.005% 100.080% ( 870, 1300 ] 11 0.003% 100.083% ( 1300, 1900 ] 6 0.002% 100.084% ( 1900, 2900 ] 3 0.001% 100.085% ( 2900, 4400 ] 3 0.001% 100.086% ** Level 1 read latency histogram (micros): Count: 57805 Average: 6.5497 StdDev: 20.26 Min: 1 Median: 4.8391 Max: 1947 Percentiles: P50: 4.84 P75: 5.75 P99: 21.09 P99.9: 241.30 P99.99: 888.88 ------------------------------------------------------ [ 0, 1 ] 2 0.003% 0.003% ( 1, 2 ] 395 0.683% 0.687% ( 2, 3 ] 1286 2.225% 2.912% ( 3, 4 ] 13836 23.936% 26.847% ##### ( 4, 6 ] 31899 55.184% 82.031% ########### ( 6, 10 ] 7236 12.518% 94.549% ### ( 10, 15 ] 1830 3.166% 97.715% # ( 15, 22 ] 854 1.477% 99.192% ( 22, 34 ] 239 0.413% 99.606% ( 34, 51 ] 32 0.055% 99.661% ( 51, 76 ] 2 0.003% 99.664% ( 76, 110 ] 14 0.024% 99.689% ( 110, 170 ] 91 0.157% 99.846% ( 170, 250 ] 35 0.061% 99.907% ( 250, 380 ] 19 0.033% 99.939% ( 380, 580 ] 13 0.022% 99.962% ( 580, 870 ] 16 0.028% 99.990% ( 870, 1300 ] 5 0.009% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 138013 Average: 3.0954 StdDev: 33.29 Min: 1 Median: 1.8889 Max: 9444 Percentiles: P50: 1.89 P75: 2.59 P99: 8.95 P99.9: 65.49 P99.99: 589.60 ------------------------------------------------------ [ 0, 1 ] 1503 1.089% 1.089% ( 1, 2 ] 75942 55.025% 56.114% ########### ( 2, 3 ] 44480 32.229% 88.343% ###### ( 3, 4 ] 6043 4.379% 92.722% # ( 4, 6 ] 6857 4.968% 97.690% # ( 6, 10 ] 2452 1.777% 99.467% ( 10, 15 ] 501 0.363% 99.830% ( 15, 22 ] 50 0.036% 99.866% ( 22, 34 ] 4 0.003% 99.869% ( 34, 51 ] 3 0.002% 99.871% ( 51, 76 ] 69 0.050% 99.921% ( 76, 110 ] 25 0.018% 99.939% ( 110, 170 ] 27 0.020% 99.959% ( 170, 250 ] 23 0.017% 99.975% ( 250, 380 ] 11 0.008% 99.983% ( 380, 580 ] 9 0.007% 99.990% ( 580, 870 ] 6 0.004% 99.994% ( 870, 1300 ] 4 0.003% 99.997% ( 1300, 1900 ] 3 0.002% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ( 6600, 9900 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 245394 Average: 4.7696 StdDev: 87.62 Min: 1 Median: 2.0200 Max: 12696 Percentiles: P50: 2.02 P75: 2.71 P99: 10.28 P99.9: 241.07 P99.99: 5034.44 ------------------------------------------------------ [ 0, 1 ] 1947 0.793% 0.793% ( 1, 2 ] 118983 48.487% 49.280% ########## ( 2, 3 ] 88414 36.029% 85.309% ####### ( 3, 4 ] 12005 4.892% 90.201% # ( 4, 6 ] 14070 5.734% 95.935% # ( 6, 10 ] 7449 3.036% 98.971% # ( 10, 15 ] 1268 0.517% 99.487% ( 15, 22 ] 191 0.078% 99.565% ( 22, 34 ] 30 0.012% 99.577% ( 34, 51 ] 1 0.000% 99.578% ( 51, 76 ] 4 0.002% 99.579% ( 76, 110 ] 134 0.055% 99.634% ( 110, 170 ] 554 0.226% 99.860% ( 170, 250 ] 111 0.045% 99.905% ( 250, 380 ] 59 0.024% 99.929% ( 380, 580 ] 63 0.026% 99.955% ( 580, 870 ] 51 0.021% 99.976% ( 870, 1300 ] 20 0.008% 99.984% ( 1300, 1900 ] 7 0.003% 99.987% ( 1900, 2900 ] 3 0.001% 99.988% ( 2900, 4400 ] 2 0.001% 99.989% ( 4400, 6600 ] 12 0.005% 99.993% ( 6600, 9900 ] 11 0.004% 99.998% ( 9900, 14000 ] 5 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 680.4857 StdDev: 1899.00 Min: 1 Median: 2.9000 Max: 8583 Percentiles: P50: 2.90 P75: 54.12 P99: 8583.00 P99.9: 8583.00 P99.99: 8583.00 ------------------------------------------------------ [ 0, 1 ] 2 5.714% 5.714% # ( 1, 2 ] 11 31.429% 37.143% ###### ( 2, 3 ] 5 14.286% 51.429% ### ( 4, 6 ] 2 5.714% 57.143% # ( 10, 15 ] 3 8.571% 65.714% ## ( 15, 22 ] 1 2.857% 68.571% # ( 22, 34 ] 2 5.714% 74.286% # ( 51, 76 ] 2 5.714% 80.000% # ( 250, 380 ] 3 8.571% 88.571% ## ( 2900, 4400 ] 1 2.857% 91.429% # ( 4400, 6600 ] 2 5.714% 97.143% # ( 6600, 9900 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 808.1750 StdDev: 880.70 Min: 114 Median: 460.0000 Max: 3953 Percentiles: P50: 460.00 P75: 870.00 P99: 3800.00 P99.9: 3953.00 P99.99: 3953.00 ------------------------------------------------------ ( 110, 170 ] 7 17.500% 17.500% #### ( 170, 250 ] 8 20.000% 37.500% #### ( 250, 380 ] 3 7.500% 45.000% ## ( 380, 580 ] 5 12.500% 57.500% ### ( 580, 870 ] 7 17.500% 75.000% #### ( 870, 1300 ] 1 2.500% 77.500% # ( 1300, 1900 ] 5 12.500% 90.000% ### ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 11.2 total, 4.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 175.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.445 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 202.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-10:29:05 ... thread 0: (1000000,3000000) ops and (211973.2,190404.6) ops/second in (4.717577,15.755924) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.08 GB 6.3 1.7 0.0 1.7 4.5 2.8 0.0 1.6 70.6 186.2 24.96 23.33 50 0.499 1788K 8470 0.0 0.0 L1 5/5 558.92 MB 0.0 0.8 0.6 0.2 0.8 0.5 0.2 1.4 107.6 106.7 7.59 7.23 2 3.795 829K 7084 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.3 0.4 0.2 0.0 2.4 192.0 191.4 2.33 2.24 2 1.164 453K 1357 0.0 0.0 L3 19/0 817.21 MB 0.8 1.1 0.3 0.9 1.1 0.3 0.0 4.1 193.0 191.6 6.05 5.62 2 3.023 1185K 8572 0.0 0.0 L4 154/0 9.56 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 145.2 145.2 0.58 0.50 1 0.576 84K 0 0.0 0.0 L5 140/0 9.04 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 330/16 22.03 GB 0.0 4.2 1.1 3.1 7.0 3.9 0.9 2.5 103.0 172.1 41.50 38.92 57 0.728 4342K 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.2 1.1 3.1 7.0 3.9 0.9 2.5 103.0 172.1 41.50 38.92 57 0.728 4342K 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.2 1.1 3.1 4.2 1.1 0.0 0.0 150.0 149.1 28.50 27.15 14 2.036 4342K 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 222.6 13.00 11.77 43 0.302 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.9 total, 15.8 interval Flush(GB): cumulative 2.826, interval 2.826 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.98 GB write, 449.06 MB/s write, 4.18 GB read, 268.77 MB/s read, 41.5 seconds Interval compaction: 6.98 GB write, 453.25 MB/s write, 4.18 GB read, 271.29 MB/s read, 41.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 638428 Average: 4.2169 StdDev: 19.02 Min: 1 Median: 2.8902 Max: 4339 Percentiles: P50: 2.89 P75: 4.63 P99: 13.98 P99.9: 29.08 P99.99: 50.24 ------------------------------------------------------ [ 0, 1 ] 2217 0.347% 0.347% ( 1, 2 ] 204126 31.973% 32.320% ###### ( 2, 3 ] 126793 19.860% 52.181% #### ( 3, 4 ] 96469 15.110% 67.291% ### ( 4, 6 ] 157485 24.668% 91.959% ##### ( 6, 10 ] 37303 5.843% 97.802% # ( 10, 15 ] 9609 1.505% 99.307% ( 15, 22 ] 3111 0.487% 99.794% ( 22, 34 ] 1147 0.180% 99.974% ( 34, 51 ] 109 0.017% 99.991% ( 51, 76 ] 11 0.002% 99.992% ( 76, 110 ] 69 0.011% 100.003% ( 110, 170 ] 153 0.024% 100.027% ( 170, 250 ] 97 0.015% 100.042% ( 250, 380 ] 75 0.012% 100.054% ( 380, 580 ] 55 0.009% 100.063% ( 580, 870 ] 26 0.004% 100.067% ( 870, 1300 ] 17 0.003% 100.070% ( 1300, 1900 ] 7 0.001% 100.071% ( 1900, 2900 ] 6 0.001% 100.072% ( 2900, 4400 ] 9 0.001% 100.073% ** Level 1 read latency histogram (micros): Count: 63687 Average: 6.9006 StdDev: 26.83 Min: 1 Median: 4.8049 Max: 1947 Percentiles: P50: 4.80 P75: 5.73 P99: 21.73 P99.9: 305.86 P99.99: 1234.61 ------------------------------------------------------ [ 0, 1 ] 2 0.003% 0.003% ( 1, 2 ] 396 0.622% 0.625% ( 2, 3 ] 1416 2.223% 2.848% ( 3, 4 ] 16183 25.410% 28.259% ##### ( 4, 6 ] 34405 54.022% 82.281% ########### ( 6, 10 ] 7755 12.177% 94.457% ## ( 10, 15 ] 1988 3.122% 97.579% # ( 15, 22 ] 941 1.478% 99.056% ( 22, 34 ] 267 0.419% 99.476% ( 34, 51 ] 34 0.053% 99.529% ( 51, 76 ] 2 0.003% 99.532% ( 76, 110 ] 23 0.036% 99.568% ( 110, 170 ] 139 0.218% 99.786% ( 170, 250 ] 62 0.097% 99.884% ( 250, 380 ] 24 0.038% 99.921% ( 380, 580 ] 17 0.027% 99.948% ( 580, 870 ] 19 0.030% 99.978% ( 870, 1300 ] 9 0.014% 99.992% ( 1300, 1900 ] 3 0.005% 99.997% ( 1900, 2900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 138013 Average: 3.0954 StdDev: 33.29 Min: 1 Median: 1.8889 Max: 9444 Percentiles: P50: 1.89 P75: 2.59 P99: 8.95 P99.9: 65.49 P99.99: 589.60 ------------------------------------------------------ [ 0, 1 ] 1503 1.089% 1.089% ( 1, 2 ] 75942 55.025% 56.114% ########### ( 2, 3 ] 44480 32.229% 88.343% ###### ( 3, 4 ] 6043 4.379% 92.722% # ( 4, 6 ] 6857 4.968% 97.690% # ( 6, 10 ] 2452 1.777% 99.467% ( 10, 15 ] 501 0.363% 99.830% ( 15, 22 ] 50 0.036% 99.866% ( 22, 34 ] 4 0.003% 99.869% ( 34, 51 ] 3 0.002% 99.871% ( 51, 76 ] 69 0.050% 99.921% ( 76, 110 ] 25 0.018% 99.939% ( 110, 170 ] 27 0.020% 99.959% ( 170, 250 ] 23 0.017% 99.975% ( 250, 380 ] 11 0.008% 99.983% ( 380, 580 ] 9 0.007% 99.990% ( 580, 870 ] 6 0.004% 99.994% ( 870, 1300 ] 4 0.003% 99.997% ( 1300, 1900 ] 3 0.002% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ( 6600, 9900 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 245394 Average: 4.7696 StdDev: 87.62 Min: 1 Median: 2.0200 Max: 12696 Percentiles: P50: 2.02 P75: 2.71 P99: 10.28 P99.9: 241.07 P99.99: 5034.44 ------------------------------------------------------ [ 0, 1 ] 1947 0.793% 0.793% ( 1, 2 ] 118983 48.487% 49.280% ########## ( 2, 3 ] 88414 36.029% 85.309% ####### ( 3, 4 ] 12005 4.892% 90.201% # ( 4, 6 ] 14070 5.734% 95.935% # ( 6, 10 ] 7449 3.036% 98.971% # ( 10, 15 ] 1268 0.517% 99.487% ( 15, 22 ] 191 0.078% 99.565% ( 22, 34 ] 30 0.012% 99.577% ( 34, 51 ] 1 0.000% 99.578% ( 51, 76 ] 4 0.002% 99.579% ( 76, 110 ] 134 0.055% 99.634% ( 110, 170 ] 554 0.226% 99.860% ( 170, 250 ] 111 0.045% 99.905% ( 250, 380 ] 59 0.024% 99.929% ( 380, 580 ] 63 0.026% 99.955% ( 580, 870 ] 51 0.021% 99.976% ( 870, 1300 ] 20 0.008% 99.984% ( 1300, 1900 ] 7 0.003% 99.987% ( 1900, 2900 ] 3 0.001% 99.988% ( 2900, 4400 ] 2 0.001% 99.989% ( 4400, 6600 ] 12 0.005% 99.993% ( 6600, 9900 ] 11 0.004% 99.998% ( 9900, 14000 ] 5 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 680.4857 StdDev: 1899.00 Min: 1 Median: 2.9000 Max: 8583 Percentiles: P50: 2.90 P75: 54.12 P99: 8583.00 P99.9: 8583.00 P99.99: 8583.00 ------------------------------------------------------ [ 0, 1 ] 2 5.714% 5.714% # ( 1, 2 ] 11 31.429% 37.143% ###### ( 2, 3 ] 5 14.286% 51.429% ### ( 4, 6 ] 2 5.714% 57.143% # ( 10, 15 ] 3 8.571% 65.714% ## ( 15, 22 ] 1 2.857% 68.571% # ( 22, 34 ] 2 5.714% 74.286% # ( 51, 76 ] 2 5.714% 80.000% # ( 250, 380 ] 3 8.571% 88.571% ## ( 2900, 4400 ] 1 2.857% 91.429% # ( 4400, 6600 ] 2 5.714% 97.143% # ( 6600, 9900 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 808.1750 StdDev: 880.70 Min: 114 Median: 460.0000 Max: 3953 Percentiles: P50: 460.00 P75: 870.00 P99: 3800.00 P99.9: 3953.00 P99.99: 3953.00 ------------------------------------------------------ ( 110, 170 ] 7 17.500% 17.500% #### ( 170, 250 ] 8 20.000% 37.500% #### ( 250, 380 ] 3 7.500% 45.000% ## ( 380, 580 ] 5 12.500% 57.500% ### ( 580, 870 ] 7 17.500% 75.000% #### ( 870, 1300 ] 1 2.500% 77.500% # ( 1300, 1900 ] 5 12.500% 90.000% ### ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 15.9 total, 4.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 185.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.445 H:M:S, 9.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 208.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.358 micros/op 186628 ops/sec 20.002 seconds 3732999 operations; 180.8 MB/s Microseconds per write: Count: 3732999 Average: 5.3582 StdDev: 434.25 Min: 1 Median: 3.2304 Max: 512546 Percentiles: P50: 3.23 P75: 5.15 P99: 12.38 P99.9: 187.62 P99.99: 1078.74 ------------------------------------------------------ [ 0, 1 ] 20 0.001% 0.001% ( 1, 2 ] 173964 4.660% 4.661% # ( 2, 3 ] 1492174 39.973% 44.633% ######## ( 3, 4 ] 869504 23.292% 67.926% ##### ( 4, 6 ] 457726 12.262% 80.187% ## ( 6, 10 ] 682671 18.287% 98.475% #### ( 10, 15 ] 41187 1.103% 99.578% ( 15, 22 ] 8792 0.236% 99.814% ( 22, 34 ] 1686 0.045% 99.859% ( 34, 51 ] 465 0.012% 99.871% ( 51, 76 ] 299 0.008% 99.879% ( 76, 110 ] 25 0.001% 99.880% ( 110, 170 ] 1 0.000% 99.880% ( 170, 250 ] 3414 0.091% 99.971% ( 250, 380 ] 283 0.008% 99.979% ( 380, 580 ] 81 0.002% 99.981% ( 580, 870 ] 7 0.000% 99.981% ( 870, 1300 ] 673 0.018% 99.999% ( 1300, 1900 ] 4 0.000% 99.999% ( 1900, 2900 ] 17 0.000% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 380000, 570000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 51317 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3732999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3852454968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 131 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 2195386 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 5448399049 rocksdb.compact.write.bytes COUNT : 5395024722 rocksdb.flush.write.bytes COUNT : 3759692144 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 13 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 64 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3734898688 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6503424 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 5482554122 rocksdb.non.last.level.read.count COUNT : 1321050 rocksdb.block.checksum.compute.count COUNT : 1320801 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 2.487906 P95 : 8.350016 P99 : 9.994450 P100 : 512544.000000 COUNT : 3732999 SUM : 16965442 rocksdb.compaction.times.micros P50 : 1666666.666667 P95 : 5620000.000000 P99 : 6205908.000000 P100 : 6205908.000000 COUNT : 16 SUM : 32048415 rocksdb.compaction.times.cpu_micros P50 : 1620000.000000 P95 : 5620000.000000 P99 : 5896540.000000 P100 : 5896540.000000 COUNT : 16 SUM : 30623765 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 659.090909 P95 : 1617.000000 P99 : 1617.000000 P100 : 1617.000000 COUNT : 54 SUM : 44397 rocksdb.compaction.outfile.sync.micros P50 : 878.600000 P95 : 1375.000000 P99 : 2019.000000 P100 : 2019.000000 COUNT : 55 SUM : 48884 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 116.206897 P95 : 242.888889 P99 : 406.000000 P100 : 406.000000 COUNT : 76 SUM : 10347 rocksdb.table.open.io.micros P50 : 1858.333333 P95 : 24994.444444 P99 : 25524.000000 P100 : 25524.000000 COUNT : 131 SUM : 563488 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 5.785751 P95 : 13.072953 P99 : 21.412959 P100 : 35417.000000 COUNT : 1320509 SUM : 10058555 rocksdb.read.block.get.micros P50 : 745.714286 P95 : 7227.000000 P99 : 11851.600000 P100 : 12831.000000 COUNT : 262 SUM : 419896 rocksdb.write.raw.block.micros P50 : 0.748021 P95 : 2.350164 P99 : 8.313074 P100 : 7306.000000 COUNT : 2224463 SUM : 6670678 rocksdb.numfiles.in.singlecompaction P50 : 3.392857 P95 : 14.250000 P99 : 16.000000 P100 : 16.000000 COUNT : 23 SUM : 105 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559629 P95 : 1102.308780 P99 : 1270.699851 P100 : 512272.000000 COUNT : 6579 SUM : 2196049 rocksdb.sst.read.micros P50 : 2.795840 P95 : 7.862856 P99 : 14.173417 P100 : 12696.000000 COUNT : 1321254 SUM : 5968277 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3732999 SUM : 3852454968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226842.105263 P95 : 664250.000000 P99 : 748242.000000 P100 : 748242.000000 COUNT : 54 SUM : 15521577 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 71 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0