[2024-12-15 22:51:40.338948] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-12-15 22:51:40.339057] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1458877 ] Set seed to 1734299500336571 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 22:51:40.469764] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 22:51:40.556527] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 22:51:40.556575] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1458877' to capture a snapshot of events at runtime. [2024-12-15 22:51:40.556585] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-15 22:51:40.556596] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-15 22:51:40.556604] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1458877 for offline analysis/debug. [2024-12-15 22:51:40.556690] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 22:51:44 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-22:51:52 ... thread 0: (1000000,1000000) ops and (128939.8,128939.8) ops/second in (7.755557,7.755557) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.45 GB 63.0 0.3 0.0 0.3 1.2 0.9 0.0 1.4 45.3 171.9 6.96 3.82 13 0.535 319K 400 0.0 0.0 L1 13/13 1.30 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 957.54 MB 1.0 1.0 0.6 0.4 1.0 0.6 0.0 1.6 113.5 112.0 8.92 4.64 3 2.972 130K 0 0.0 0.0 L4 175/0 9.44 GB 1.0 5.0 2.7 2.3 5.0 2.6 0.0 1.8 111.3 109.4 46.36 24.03 32 1.449 1343K 0 0.0 0.0 L5 1124/0 92.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1343/23 106.70 GB 0.0 6.3 3.3 3.0 7.1 4.1 3.0 8.2 104.2 116.7 62.24 32.49 48 1.297 1794K 400 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 3.3 3.0 7.1 4.1 3.0 8.2 104.2 116.7 62.24 32.49 48 1.297 1794K 400 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 3.3 3.0 6.2 3.2 0.0 0.0 113.8 112.0 56.99 29.92 36 1.583 1794K 400 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 168.1 5.25 2.57 12 0.437 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.8 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.10 GB write, 913.67 MB/s write, 6.33 GB read, 815.54 MB/s read, 62.2 seconds Interval compaction: 7.10 GB write, 936.63 MB/s write, 6.33 GB read, 836.04 MB/s read, 62.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 18, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 335252 Average: 15.7020 StdDev: 153.40 Min: 1 Median: 1.8748 Max: 11993 Percentiles: P50: 1.87 P75: 2.90 P99: 309.39 P99.9: 2158.74 P99.99: 4039.66 ------------------------------------------------------ [ 0, 1 ] 20410 6.088% 6.088% # ( 1, 2 ] 168291 50.198% 56.286% ########## ( 2, 3 ] 69955 20.866% 77.153% #### ( 3, 4 ] 27841 8.304% 85.457% ## ( 4, 6 ] 30871 9.208% 94.666% ## ( 6, 10 ] 9256 2.761% 97.426% # ( 10, 15 ] 1316 0.393% 97.819% ( 15, 22 ] 213 0.064% 97.882% ( 22, 34 ] 39 0.012% 97.894% ( 34, 51 ] 18 0.005% 97.899% ( 51, 76 ] 22 0.007% 97.906% ( 76, 110 ] 419 0.125% 98.031% ( 110, 170 ] 1577 0.470% 98.501% ( 170, 250 ] 1254 0.374% 98.875% ( 250, 380 ] 916 0.273% 99.149% ( 380, 580 ] 934 0.279% 99.427% ( 580, 870 ] 711 0.212% 99.639% ( 870, 1300 ] 526 0.157% 99.796% ( 1300, 1900 ] 297 0.089% 99.885% ( 1900, 2900 ] 200 0.060% 99.945% ( 2900, 4400 ] 202 0.060% 100.005% ( 4400, 6600 ] 54 0.016% 100.021% ( 6600, 9900 ] 9 0.003% 100.024% ( 9900, 14000 ] 2 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 433 Average: 772.1062 StdDev: 1095.14 Min: 82 Median: 349.3396 Max: 6956 Percentiles: P50: 349.34 P75: 868.39 P99: 5684.25 P99.9: 6956.00 P99.99: 6956.00 ------------------------------------------------------ ( 76, 110 ] 24 5.543% 5.543% # ( 110, 170 ] 86 19.861% 25.404% #### ( 170, 250 ] 66 15.242% 40.647% ### ( 250, 380 ] 53 12.240% 52.887% ## ( 380, 580 ] 51 11.778% 64.665% ## ( 580, 870 ] 45 10.393% 75.058% ## ( 870, 1300 ] 42 9.700% 84.758% ## ( 1300, 1900 ] 24 5.543% 90.300% # ( 1900, 2900 ] 14 3.233% 93.533% # ( 2900, 4400 ] 19 4.388% 97.921% # ( 4400, 6600 ] 8 1.848% 99.769% ( 6600, 9900 ] 1 0.231% 100.000% ** Level 2 read latency histogram (micros): Count: 96147 Average: 13.7599 StdDev: 169.36 Min: 1 Median: 1.8914 Max: 7770 Percentiles: P50: 1.89 P75: 2.93 P99: 11.58 P99.9: 2678.70 P99.99: 4092.77 ------------------------------------------------------ [ 0, 1 ] 3348 3.482% 3.482% # ( 1, 2 ] 50177 52.188% 55.670% ########## ( 2, 3 ] 20067 20.871% 76.541% #### ( 3, 4 ] 9316 9.689% 86.230% ## ( 4, 6 ] 9651 10.038% 96.268% ## ( 6, 10 ] 2492 2.592% 98.860% # ( 10, 15 ] 427 0.444% 99.304% ( 15, 22 ] 69 0.072% 99.376% ( 22, 34 ] 9 0.009% 99.385% ( 34, 51 ] 5 0.005% 99.391% ( 51, 76 ] 3 0.003% 99.394% ( 76, 110 ] 2 0.002% 99.396% ( 110, 170 ] 5 0.005% 99.401% ( 170, 250 ] 10 0.010% 99.411% ( 250, 380 ] 29 0.030% 99.441% ( 380, 580 ] 45 0.047% 99.488% ( 580, 870 ] 104 0.108% 99.596% ( 870, 1300 ] 127 0.132% 99.729% ( 1300, 1900 ] 101 0.105% 99.834% ( 1900, 2900 ] 82 0.085% 99.919% ( 2900, 4400 ] 86 0.089% 100.008% ( 4400, 6600 ] 26 0.027% 100.035% ( 6600, 9900 ] 1 0.001% 100.036% ** Level 3 read latency histogram (micros): Count: 608678 Average: 9.1315 StdDev: 125.99 Min: 1 Median: 1.8892 Max: 9620 Percentiles: P50: 1.89 P75: 2.89 P99: 9.42 P99.9: 624.38 P99.99: 1016.12 ------------------------------------------------------ [ 0, 1 ] 19538 3.210% 3.210% # ( 1, 2 ] 320284 52.620% 55.830% ########### ( 2, 3 ] 131000 21.522% 77.352% #### ( 3, 4 ] 59106 9.711% 87.062% ## ( 4, 6 ] 60167 9.885% 96.947% ## ( 6, 10 ] 14618 2.402% 99.349% ( 10, 15 ] 2106 0.346% 99.695% ( 15, 22 ] 297 0.049% 99.743% ( 22, 34 ] 22 0.004% 99.747% ( 34, 51 ] 34 0.006% 99.753% ( 51, 76 ] 40 0.007% 99.759% ( 76, 110 ] 47 0.008% 99.767% ( 110, 170 ] 103 0.017% 99.784% ( 170, 250 ] 135 0.022% 99.806% ( 250, 380 ] 181 0.030% 99.836% ( 380, 580 ] 322 0.053% 99.889% ( 580, 870 ] 453 0.074% 99.963% ( 870, 1300 ] 483 0.079% 100.042% ( 1300, 1900 ] 411 0.068% 100.110% ( 1900, 2900 ] 254 0.042% 100.152% ( 2900, 4400 ] 276 0.045% 100.197% ( 4400, 6600 ] 77 0.013% 100.210% ( 6600, 9900 ] 12 0.002% 100.212% ** Level 4 read latency histogram (micros): Count: 564516 Average: 18.9983 StdDev: 195.72 Min: 0 Median: 1.9000 Max: 9818 Percentiles: P50: 1.90 P75: 2.92 P99: 247.99 P99.9: 1860.06 P99.99: 2607.49 ------------------------------------------------------ [ 0, 1 ] 18707 3.314% 3.314% # ( 1, 2 ] 292840 51.875% 55.188% ########## ( 2, 3 ] 121181 21.466% 76.655% #### ( 3, 4 ] 53895 9.547% 86.202% ## ( 4, 6 ] 53330 9.447% 95.649% ## ( 6, 10 ] 14643 2.594% 98.243% # ( 10, 15 ] 2182 0.387% 98.629% ( 15, 22 ] 328 0.058% 98.687% ( 22, 34 ] 44 0.008% 98.695% ( 34, 51 ] 35 0.006% 98.701% ( 51, 76 ] 42 0.007% 98.709% ( 76, 110 ] 203 0.036% 98.745% ( 110, 170 ] 736 0.130% 98.875% ( 170, 250 ] 723 0.128% 99.003% ( 250, 380 ] 727 0.129% 99.132% ( 380, 580 ] 977 0.173% 99.305% ( 580, 870 ] 1255 0.222% 99.527% ( 870, 1300 ] 1269 0.225% 99.752% ( 1300, 1900 ] 894 0.158% 99.911% ( 1900, 2900 ] 634 0.112% 100.023% ( 2900, 4400 ] 509 0.090% 100.113% ( 4400, 6600 ] 187 0.033% 100.146% ( 6600, 9900 ] 33 0.006% 100.152% ** Level 5 read latency histogram (micros): Count: 23892 Average: 916.3230 StdDev: 1261.34 Min: 76 Median: 406.9803 Max: 13835 Percentiles: P50: 406.98 P75: 1056.21 P99: 6216.60 P99.9: 9357.14 P99.99: 10526.07 ------------------------------------------------------ ( 51, 76 ] 1 0.004% 0.004% ( 76, 110 ] 1083 4.533% 4.537% # ( 110, 170 ] 4459 18.663% 23.200% #### ( 170, 250 ] 3421 14.319% 37.519% ### ( 250, 380 ] 2592 10.849% 48.368% ## ( 380, 580 ] 2891 12.100% 60.468% ## ( 580, 870 ] 2544 10.648% 71.116% ## ( 870, 1300 ] 2143 8.970% 80.085% ## ( 1300, 1900 ] 1493 6.249% 86.334% # ( 1900, 2900 ] 1190 4.981% 91.315% # ( 2900, 4400 ] 1320 5.525% 96.840% # ( 4400, 6600 ] 625 2.616% 99.456% # ( 6600, 9900 ] 127 0.532% 99.987% ( 9900, 14000 ] 4 0.017% 100.004% ** DB Stats ** Uptime(secs): 8.0 total, 7.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 123.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.901 H:M:S, 49.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.901 H:M:S, 50.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-22:51:56 ... thread 0: (1000000,2000000) ops and (293127.7,179098.5) ops/second in (3.411482,11.167039) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/10 3.43 GB 163.6 1.3 0.0 1.3 3.1 1.8 0.0 1.7 93.4 226.8 14.16 10.45 33 0.429 1343K 1401 0.0 0.0 L1 13/13 1.30 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 957.54 MB 1.0 1.0 0.6 0.4 1.0 0.6 0.0 1.6 113.5 112.0 8.92 4.64 3 2.972 130K 0 0.0 0.0 L4 175/0 9.44 GB 1.0 5.0 2.7 2.3 5.0 2.6 0.0 1.8 111.3 109.4 46.36 24.03 32 1.449 1343K 0 0.0 0.0 L5 1124/0 92.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/23 107.68 GB 0.0 7.3 3.3 4.0 9.1 5.1 3.0 4.9 107.9 133.6 69.44 39.12 68 1.021 2817K 1401 0.0 0.0 Int 0/0 0.00 KB 0.0 7.3 3.3 4.0 9.1 5.1 3.0 4.9 107.9 133.6 69.44 39.12 68 1.021 2817K 1401 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.3 3.3 4.0 7.2 3.2 0.0 0.0 122.9 121.2 60.96 33.79 40 1.524 2817K 1401 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 223.0 8.48 5.33 28 0.303 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.4 total, 11.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.06 GB write, 816.70 MB/s write, 7.32 GB read, 659.42 MB/s read, 69.4 seconds Interval compaction: 9.06 GB write, 830.96 MB/s write, 7.32 GB read, 670.93 MB/s read, 69.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 18, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 636771 Average: 14.5734 StdDev: 119.18 Min: 0 Median: 1.6802 Max: 11993 Percentiles: P50: 1.68 P75: 2.54 P99: 269.54 P99.9: 1155.63 P99.99: 2202.42 ------------------------------------------------------ [ 0, 1 ] 91730 14.405% 14.405% ### ( 1, 2 ] 333240 52.333% 66.738% ########## ( 2, 3 ] 97767 15.354% 82.092% ### ( 3, 4 ] 39481 6.200% 88.292% # ( 4, 6 ] 38032 5.973% 94.265% # ( 6, 10 ] 11119 1.746% 96.011% ( 10, 15 ] 1743 0.274% 96.285% ( 15, 22 ] 355 0.056% 96.340% ( 22, 34 ] 68 0.011% 96.351% ( 34, 51 ] 20 0.003% 96.354% ( 51, 76 ] 28 0.004% 96.359% ( 76, 110 ] 2586 0.406% 96.765% ( 110, 170 ] 9054 1.422% 98.186% ( 170, 250 ] 4812 0.756% 98.942% ( 250, 380 ] 2464 0.387% 99.329% ( 380, 580 ] 2129 0.334% 99.663% ( 580, 870 ] 1111 0.174% 99.838% ( 870, 1300 ] 598 0.094% 99.932% ( 1300, 1900 ] 307 0.048% 99.980% ( 1900, 2900 ] 216 0.034% 100.014% ( 2900, 4400 ] 207 0.033% 100.046% ( 4400, 6600 ] 56 0.009% 100.055% ( 6600, 9900 ] 9 0.001% 100.057% ( 9900, 14000 ] 2 0.000% 100.057% ** Level 1 read latency histogram (micros): Count: 1199 Average: 411.3978 StdDev: 722.72 Min: 82 Median: 185.2301 Max: 6956 Percentiles: P50: 185.23 P75: 370.11 P99: 4163.95 P99.9: 6545.28 P99.99: 6956.00 ------------------------------------------------------ ( 76, 110 ] 123 10.259% 10.259% ## ( 110, 170 ] 431 35.947% 46.205% ####### ( 170, 250 ] 239 19.933% 66.138% #### ( 250, 380 ] 115 9.591% 75.730% ## ( 380, 580 ] 113 9.425% 85.154% ## ( 580, 870 ] 68 5.671% 90.826% # ( 870, 1300 ] 43 3.586% 94.412% # ( 1300, 1900 ] 24 2.002% 96.414% ( 1900, 2900 ] 15 1.251% 97.665% ( 2900, 4400 ] 19 1.585% 99.249% ( 4400, 6600 ] 8 0.667% 99.917% ( 6600, 9900 ] 1 0.083% 100.000% ** Level 2 read latency histogram (micros): Count: 96147 Average: 13.7599 StdDev: 169.36 Min: 1 Median: 1.8914 Max: 7770 Percentiles: P50: 1.89 P75: 2.93 P99: 11.58 P99.9: 2678.70 P99.99: 4092.77 ------------------------------------------------------ [ 0, 1 ] 3348 3.482% 3.482% # ( 1, 2 ] 50177 52.188% 55.670% ########## ( 2, 3 ] 20067 20.871% 76.541% #### ( 3, 4 ] 9316 9.689% 86.230% ## ( 4, 6 ] 9651 10.038% 96.268% ## ( 6, 10 ] 2492 2.592% 98.860% # ( 10, 15 ] 427 0.444% 99.304% ( 15, 22 ] 69 0.072% 99.376% ( 22, 34 ] 9 0.009% 99.385% ( 34, 51 ] 5 0.005% 99.391% ( 51, 76 ] 3 0.003% 99.394% ( 76, 110 ] 2 0.002% 99.396% ( 110, 170 ] 5 0.005% 99.401% ( 170, 250 ] 10 0.010% 99.411% ( 250, 380 ] 29 0.030% 99.441% ( 380, 580 ] 45 0.047% 99.488% ( 580, 870 ] 104 0.108% 99.596% ( 870, 1300 ] 127 0.132% 99.729% ( 1300, 1900 ] 101 0.105% 99.834% ( 1900, 2900 ] 82 0.085% 99.919% ( 2900, 4400 ] 86 0.089% 100.008% ( 4400, 6600 ] 26 0.027% 100.035% ( 6600, 9900 ] 1 0.001% 100.036% ** Level 3 read latency histogram (micros): Count: 609299 Average: 9.3252 StdDev: 126.18 Min: 1 Median: 1.8902 Max: 9620 Percentiles: P50: 1.89 P75: 2.89 P99: 9.59 P99.9: 634.73 P99.99: 1018.12 ------------------------------------------------------ [ 0, 1 ] 19538 3.207% 3.207% # ( 1, 2 ] 320284 52.566% 55.773% ########### ( 2, 3 ] 131000 21.500% 77.273% #### ( 3, 4 ] 59106 9.701% 86.973% ## ( 4, 6 ] 60167 9.875% 96.848% ## ( 6, 10 ] 14618 2.399% 99.247% ( 10, 15 ] 2106 0.346% 99.593% ( 15, 22 ] 297 0.049% 99.642% ( 22, 34 ] 22 0.004% 99.645% ( 34, 51 ] 34 0.006% 99.651% ( 51, 76 ] 40 0.007% 99.657% ( 76, 110 ] 149 0.024% 99.682% ( 110, 170 ] 396 0.065% 99.747% ( 170, 250 ] 257 0.042% 99.789% ( 250, 380 ] 232 0.038% 99.827% ( 380, 580 ] 355 0.058% 99.885% ( 580, 870 ] 470 0.077% 99.963% ( 870, 1300 ] 485 0.080% 100.042% ( 1300, 1900 ] 411 0.067% 100.110% ( 1900, 2900 ] 255 0.042% 100.151% ( 2900, 4400 ] 276 0.045% 100.197% ( 4400, 6600 ] 77 0.013% 100.209% ( 6600, 9900 ] 12 0.002% 100.211% ** Level 4 read latency histogram (micros): Count: 571159 Average: 20.8051 StdDev: 195.98 Min: 0 Median: 1.9110 Max: 9818 Percentiles: P50: 1.91 P75: 2.96 P99: 350.27 P99.9: 1857.75 P99.99: 2607.82 ------------------------------------------------------ [ 0, 1 ] 18707 3.275% 3.275% # ( 1, 2 ] 292943 51.289% 54.564% ########## ( 2, 3 ] 121480 21.269% 75.834% #### ( 3, 4 ] 54113 9.474% 85.308% ## ( 4, 6 ] 53548 9.375% 94.683% ## ( 6, 10 ] 14669 2.568% 97.251% # ( 10, 15 ] 2189 0.383% 97.635% ( 15, 22 ] 329 0.058% 97.692% ( 22, 34 ] 44 0.008% 97.700% ( 34, 51 ] 35 0.006% 97.706% ( 51, 76 ] 42 0.007% 97.713% ( 76, 110 ] 977 0.171% 97.884% ( 110, 170 ] 3496 0.612% 98.497% ( 170, 250 ] 1912 0.335% 98.831% ( 250, 380 ] 1249 0.219% 99.050% ( 380, 580 ] 1365 0.239% 99.289% ( 580, 870 ] 1365 0.239% 99.528% ( 870, 1300 ] 1291 0.226% 99.754% ( 1300, 1900 ] 897 0.157% 99.911% ( 1900, 2900 ] 637 0.112% 100.023% ( 2900, 4400 ] 510 0.089% 100.112% ( 4400, 6600 ] 187 0.033% 100.145% ( 6600, 9900 ] 33 0.006% 100.150% ** Level 5 read latency histogram (micros): Count: 67364 Average: 453.9422 StdDev: 833.78 Min: 74 Median: 179.3953 Max: 13835 Percentiles: P50: 179.40 P75: 371.43 P99: 4668.79 P99.9: 8097.63 P99.99: 9672.99 ------------------------------------------------------ ( 51, 76 ] 8 0.012% 0.012% ( 76, 110 ] 7333 10.886% 10.898% ## ( 110, 170 ] 24896 36.957% 47.855% ####### ( 170, 250 ] 12304 18.265% 66.120% #### ( 250, 380 ] 6404 9.507% 75.626% ## ( 380, 580 ] 5828 8.652% 84.278% ## ( 580, 870 ] 3498 5.193% 89.471% # ( 870, 1300 ] 2294 3.405% 92.876% # ( 1300, 1900 ] 1516 2.250% 95.126% ( 1900, 2900 ] 1210 1.796% 96.923% ( 2900, 4400 ] 1323 1.964% 98.887% ( 4400, 6600 ] 625 0.928% 99.814% ( 6600, 9900 ] 127 0.189% 100.003% ( 9900, 14000 ] 4 0.006% 100.009% ** DB Stats ** Uptime(secs): 11.4 total, 3.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 173.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.901 H:M:S, 34.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-22:52:02 ... thread 0: (1000000,3000000) ops and (166898.1,174838.2) ops/second in (5.991680,17.158719) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 4.35 GB 125.9 2.5 0.0 2.5 5.3 2.8 0.0 1.9 117.5 246.4 21.98 17.80 53 0.415 2622K 2594 0.0 0.0 L1 13/13 1.30 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 957.54 MB 1.0 1.0 0.6 0.4 1.0 0.6 0.0 1.6 113.5 112.0 8.92 4.64 3 2.972 130K 0 0.0 0.0 L4 175/0 9.44 GB 1.0 5.0 2.7 2.3 5.0 2.6 0.0 1.8 111.3 109.4 46.36 24.03 32 1.449 1343K 0 0.0 0.0 L5 1124/0 92.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/26 108.61 GB 0.0 8.5 3.3 5.2 11.2 6.0 3.0 4.1 113.3 148.6 77.26 46.46 88 0.878 4096K 2594 0.0 0.0 Int 0/0 0.00 KB 0.0 8.5 3.3 5.2 11.2 6.0 3.0 4.1 113.3 148.6 77.26 46.46 88 0.878 4096K 2594 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.5 3.3 5.2 8.4 3.2 0.0 0.0 132.8 131.3 65.90 38.60 45 1.464 4096K 2594 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 249.5 11.36 7.87 43 0.264 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.4 total, 17.2 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.22 GB write, 661.72 MB/s write, 8.55 GB read, 504.37 MB/s read, 77.3 seconds Interval compaction: 11.22 GB write, 669.24 MB/s write, 8.55 GB read, 510.10 MB/s read, 77.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 18, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1067142 Average: 14.7666 StdDev: 99.92 Min: 0 Median: 1.6292 Max: 11993 Percentiles: P50: 1.63 P75: 2.43 P99: 248.44 P99.9: 804.71 P99.99: 1269.05 ------------------------------------------------------ [ 0, 1 ] 187025 17.526% 17.526% #### ( 1, 2 ] 550733 51.608% 69.134% ########## ( 2, 3 ] 144919 13.580% 82.714% ### ( 3, 4 ] 61583 5.771% 88.485% # ( 4, 6 ] 51818 4.856% 93.341% # ( 6, 10 ] 14313 1.341% 94.682% ( 10, 15 ] 2674 0.251% 94.933% ( 15, 22 ] 675 0.063% 94.996% ( 22, 34 ] 120 0.011% 95.007% ( 34, 51 ] 27 0.003% 95.010% ( 51, 76 ] 41 0.004% 95.013% ( 76, 110 ] 7721 0.724% 95.737% ( 110, 170 ] 24617 2.307% 98.044% ( 170, 250 ] 10407 0.975% 99.019% ( 250, 380 ] 4558 0.427% 99.446% ( 380, 580 ] 3656 0.343% 99.789% ( 580, 870 ] 1533 0.144% 99.932% ( 870, 1300 ] 663 0.062% 99.994% ( 1300, 1900 ] 327 0.031% 100.025% ( 1900, 2900 ] 229 0.021% 100.047% ( 2900, 4400 ] 223 0.021% 100.067% ( 4400, 6600 ] 56 0.005% 100.073% ( 6600, 9900 ] 9 0.001% 100.074% ( 9900, 14000 ] 2 0.000% 100.074% ** Level 1 read latency histogram (micros): Count: 2645 Average: 283.5444 StdDev: 511.72 Min: 78 Median: 156.0644 Max: 6956 Percentiles: P50: 156.06 P75: 235.62 P99: 3091.25 P99.9: 6147.63 P99.99: 6956.00 ------------------------------------------------------ ( 76, 110 ] 392 14.820% 14.820% ### ( 110, 170 ] 1212 45.822% 60.643% ######### ( 170, 250 ] 463 17.505% 78.147% #### ( 250, 380 ] 203 7.675% 85.822% ## ( 380, 580 ] 171 6.465% 92.287% # ( 580, 870 ] 90 3.403% 95.690% # ( 870, 1300 ] 45 1.701% 97.391% ( 1300, 1900 ] 24 0.907% 98.299% ( 1900, 2900 ] 16 0.605% 98.904% ( 2900, 4400 ] 20 0.756% 99.660% ( 4400, 6600 ] 8 0.302% 99.962% ( 6600, 9900 ] 1 0.038% 100.000% ** Level 2 read latency histogram (micros): Count: 96147 Average: 13.7599 StdDev: 169.36 Min: 1 Median: 1.8914 Max: 7770 Percentiles: P50: 1.89 P75: 2.93 P99: 11.58 P99.9: 2678.70 P99.99: 4092.77 ------------------------------------------------------ [ 0, 1 ] 3348 3.482% 3.482% # ( 1, 2 ] 50177 52.188% 55.670% ########## ( 2, 3 ] 20067 20.871% 76.541% #### ( 3, 4 ] 9316 9.689% 86.230% ## ( 4, 6 ] 9651 10.038% 96.268% ## ( 6, 10 ] 2492 2.592% 98.860% # ( 10, 15 ] 427 0.444% 99.304% ( 15, 22 ] 69 0.072% 99.376% ( 22, 34 ] 9 0.009% 99.385% ( 34, 51 ] 5 0.005% 99.391% ( 51, 76 ] 3 0.003% 99.394% ( 76, 110 ] 2 0.002% 99.396% ( 110, 170 ] 5 0.005% 99.401% ( 170, 250 ] 10 0.010% 99.411% ( 250, 380 ] 29 0.030% 99.441% ( 380, 580 ] 45 0.047% 99.488% ( 580, 870 ] 104 0.108% 99.596% ( 870, 1300 ] 127 0.132% 99.729% ( 1300, 1900 ] 101 0.105% 99.834% ( 1900, 2900 ] 82 0.085% 99.919% ( 2900, 4400 ] 86 0.089% 100.008% ( 4400, 6600 ] 26 0.027% 100.035% ( 6600, 9900 ] 1 0.001% 100.036% ** Level 3 read latency histogram (micros): Count: 610549 Average: 9.6698 StdDev: 126.40 Min: 1 Median: 1.8921 Max: 9620 Percentiles: P50: 1.89 P75: 2.90 P99: 9.93 P99.9: 644.32 P99.99: 1019.48 ------------------------------------------------------ [ 0, 1 ] 19538 3.200% 3.200% # ( 1, 2 ] 320284 52.458% 55.658% ########## ( 2, 3 ] 131000 21.456% 77.115% #### ( 3, 4 ] 59106 9.681% 86.795% ## ( 4, 6 ] 60167 9.855% 96.650% ## ( 6, 10 ] 14618 2.394% 99.044% ( 10, 15 ] 2106 0.345% 99.389% ( 15, 22 ] 297 0.049% 99.438% ( 22, 34 ] 22 0.004% 99.441% ( 34, 51 ] 34 0.006% 99.447% ( 51, 76 ] 40 0.007% 99.453% ( 76, 110 ] 403 0.066% 99.519% ( 110, 170 ] 1030 0.169% 99.688% ( 170, 250 ] 462 0.076% 99.764% ( 250, 380 ] 306 0.050% 99.814% ( 380, 580 ] 417 0.068% 99.882% ( 580, 870 ] 489 0.080% 99.962% ( 870, 1300 ] 486 0.080% 100.042% ( 1300, 1900 ] 412 0.067% 100.109% ( 1900, 2900 ] 255 0.042% 100.151% ( 2900, 4400 ] 276 0.045% 100.196% ( 4400, 6600 ] 77 0.013% 100.209% ( 6600, 9900 ] 12 0.002% 100.211% ** Level 4 read latency histogram (micros): Count: 584152 Average: 24.0467 StdDev: 195.98 Min: 0 Median: 1.9329 Max: 9818 Percentiles: P50: 1.93 P75: 3.09 P99: 410.78 P99.9: 1854.36 P99.99: 2610.09 ------------------------------------------------------ [ 0, 1 ] 18707 3.202% 3.202% # ( 1, 2 ] 293022 50.162% 53.364% ########## ( 2, 3 ] 121713 20.836% 74.200% #### ( 3, 4 ] 54341 9.303% 83.503% ## ( 4, 6 ] 53827 9.215% 92.717% ## ( 6, 10 ] 14701 2.517% 95.234% # ( 10, 15 ] 2195 0.376% 95.610% ( 15, 22 ] 330 0.056% 95.666% ( 22, 34 ] 44 0.008% 95.674% ( 34, 51 ] 35 0.006% 95.680% ( 51, 76 ] 43 0.007% 95.687% ( 76, 110 ] 3068 0.525% 96.212% ( 110, 170 ] 9976 1.708% 97.920% ( 170, 250 ] 4028 0.690% 98.610% ( 250, 380 ] 1989 0.340% 98.950% ( 380, 580 ] 1894 0.324% 99.274% ( 580, 870 ] 1496 0.256% 99.530% ( 870, 1300 ] 1319 0.226% 99.756% ( 1300, 1900 ] 909 0.156% 99.912% ( 1900, 2900 ] 643 0.110% 100.022% ( 2900, 4400 ] 511 0.087% 100.109% ( 4400, 6600 ] 187 0.032% 100.141% ( 6600, 9900 ] 33 0.006% 100.147% ** Level 5 read latency histogram (micros): Count: 151248 Average: 300.5127 StdDev: 580.99 Min: 71 Median: 155.9701 Max: 13835 Percentiles: P50: 155.97 P75: 235.38 P99: 3543.12 P99.9: 6497.05 P99.99: 9377.07 ------------------------------------------------------ ( 51, 76 ] 22 0.015% 0.015% ( 76, 110 ] 22387 14.802% 14.816% ### ( 110, 170 ] 69456 45.922% 60.738% ######### ( 170, 250 ] 26396 17.452% 78.190% ### ( 250, 380 ] 11468 7.582% 85.772% ## ( 380, 580 ] 9643 6.376% 92.148% # ( 580, 870 ] 4530 2.995% 95.143% # ( 870, 1300 ] 2454 1.623% 96.766% ( 1300, 1900 ] 1572 1.039% 97.805% ( 1900, 2900 ] 1233 0.815% 98.620% ( 2900, 4400 ] 1340 0.886% 99.506% ( 4400, 6600 ] 625 0.413% 99.919% ( 6600, 9900 ] 127 0.084% 100.003% ( 9900, 14000 ] 4 0.003% 100.006% ** DB Stats ** Uptime(secs): 17.4 total, 6.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 170.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.315 H:M:S, 36.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 164.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.413 H:M:S, 40.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 215.180 micros/op 18569 ops/sec 60.152 seconds 1116996 operations; 18.0 MB/s (268999 of 268999 found) Microseconds per read: Count: 1116996 Average: 215.1818 StdDev: 607.31 Min: 2 Median: 165.3906 Max: 67271 Percentiles: P50: 165.39 P75: 224.49 P99: 776.17 P99.9: 8653.79 P99.99: 28237.92 ------------------------------------------------------ ( 1, 2 ] 13 0.001% 0.001% ( 2, 3 ] 47 0.004% 0.005% ( 3, 4 ] 67 0.006% 0.011% ( 4, 6 ] 86 0.008% 0.019% ( 6, 10 ] 313 0.028% 0.047% ( 10, 15 ] 3663 0.328% 0.375% ( 15, 22 ] 5173 0.463% 0.838% ( 22, 34 ] 10248 0.917% 1.756% ( 34, 51 ] 2027 0.181% 1.937% ( 51, 76 ] 234 0.021% 1.958% ( 76, 110 ] 31539 2.824% 4.782% # ( 110, 170 ] 547120 48.981% 53.763% ########## ( 170, 250 ] 348296 31.181% 84.944% ###### ( 250, 380 ] 110255 9.871% 94.815% ## ( 380, 580 ] 38704 3.465% 98.280% # ( 580, 870 ] 11887 1.064% 99.344% ( 870, 1300 ] 3393 0.304% 99.648% ( 1300, 1900 ] 1183 0.106% 99.754% ( 1900, 2900 ] 711 0.064% 99.818% ( 2900, 4400 ] 591 0.053% 99.871% ( 4400, 6600 ] 212 0.019% 99.890% ( 6600, 9900 ] 188 0.017% 99.906% ( 9900, 14000 ] 409 0.037% 99.943% ( 14000, 22000 ] 434 0.039% 99.982% ( 22000, 33000 ] 161 0.014% 99.996% ( 33000, 50000 ] 32 0.003% 99.999% ( 50000, 75000 ] 10 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 15822726 rocksdb.bloom.filter.full.positive COUNT : 1270562 rocksdb.bloom.filter.full.true.positive COUNT : 1116601 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 395 rocksdb.memtable.miss COUNT : 1116601 rocksdb.l0.hit COUNT : 41812 rocksdb.l1.hit COUNT : 22932 rocksdb.l2andup.hit COUNT : 1051857 rocksdb.compaction.key.drop.new COUNT : 159288 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3286180 rocksdb.number.keys.read COUNT : 1116996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3391337760 rocksdb.bytes.read COUNT : 1116996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1542 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 47349635 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 14952930014 rocksdb.compact.write.bytes COUNT : 14784374356 rocksdb.flush.write.bytes COUNT : 3369137769 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 44 rocksdb.number.superversion_acquires COUNT : 638 rocksdb.number.superversion_releases COUNT : 612 rocksdb.number.superversion_cleanups COUNT : 156 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 191 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3341766656 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1114112 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 19665690832 rocksdb.non.last.level.read.count COUNT : 4606814 rocksdb.block.checksum.compute.count COUNT : 4902038 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 164.570203 P95 : 388.812853 P99 : 775.237104 P100 : 67268.000000 COUNT : 1116996 SUM : 239409978 rocksdb.db.write.micros P50 : 1.555632 P95 : 5.026669 P99 : 38.242975 P100 : 823666.000000 COUNT : 3286180 SUM : 55862962 rocksdb.compaction.times.micros P50 : 1258333.333333 P95 : 4113333.333333 P99 : 37397871.000000 P100 : 37397871.000000 COUNT : 48 SUM : 110113714 rocksdb.compaction.times.cpu_micros P50 : 920000.000000 P95 : 1865000.000000 P99 : 18160000.000000 P100 : 18186811.000000 COUNT : 48 SUM : 63511683 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 778.166667 P95 : 42350.000000 P99 : 216833.000000 P100 : 216833.000000 COUNT : 49 SUM : 516242 rocksdb.compaction.outfile.sync.micros P50 : 20181.818182 P95 : 229400.000000 P99 : 309366.666667 P100 : 353200.000000 COUNT : 163 SUM : 10005635 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 158.750000 P95 : 5148.000000 P99 : 8151.000000 P100 : 9834.000000 COUNT : 106 SUM : 106881 rocksdb.table.open.io.micros P50 : 8942.410714 P95 : 20272.413793 P99 : 26899.230769 P100 : 38251.000000 COUNT : 1542 SUM : 14426877 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.896223 P95 : 115.025560 P99 : 220.551497 P100 : 16328.000000 COUNT : 3620310 SUM : 67033724 rocksdb.read.block.get.micros P50 : 138.385272 P95 : 278.483723 P99 : 677.336490 P100 : 16585.000000 COUNT : 1280157 SUM : 203335506 rocksdb.write.raw.block.micros P50 : 0.555160 P95 : 1.658637 P99 : 3.938734 P100 : 12538.000000 COUNT : 4396932 SUM : 11236556 rocksdb.numfiles.in.singlecompaction P50 : 3.222222 P95 : 6.400000 P99 : 35.000000 P100 : 35.000000 COUNT : 58 SUM : 262 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.576309 P95 : 2085.918458 P99 : 2742.560750 P100 : 823481.000000 COUNT : 222257 SUM : 47368530 rocksdb.sst.read.micros P50 : 2.533007 P95 : 181.571654 P99 : 437.979882 P100 : 13835.000000 COUNT : 4606836 SUM : 255448666 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1116996 SUM : 1116996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3286180 SUM : 3391337760 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215853.658537 P95 : 794750.000000 P99 : 1061952.000000 P100 : 1061952.000000 COUNT : 49 SUM : 12627766 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 192 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0