[2024-07-13 23:07:37.255630] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... [2024-07-13 23:07:37.255744] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1376481 ] Set seed to 1720904857253334 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-13 23:07:37.357936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-13 23:07:37.577981] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-13 23:07:37.578033] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1376481' to capture a snapshot of events at runtime. [2024-07-13 23:07:37.578043] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1376481 for offline analysis/debug. [2024-07-13 23:07:37.578087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Jul 13 23:07:46 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/13-23:07:51 ... thread 0: (1000000,1000000) ops and (193529.2,193529.2) ops/second in (5.167178,5.167178) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 2.75 GB 62.9 0.6 0.0 0.6 1.5 0.9 0.0 1.7 98.5 236.3 6.40 4.81 14 0.457 639K 787 0.0 0.0 L1 8/8 488.16 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 987.84 MB 1.0 0.5 0.2 0.2 0.5 0.2 0.0 2.0 121.2 120.9 4.02 2.32 2 2.010 0 0 0.0 0.0 L4 171/0 9.64 GB 1.0 1.0 0.9 0.0 1.0 0.9 0.2 1.0 107.6 107.4 9.29 4.72 11 0.845 175K 0 0.0 0.0 L5 1112/0 91.35 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1323/25 105.19 GB 0.0 2.1 1.2 0.9 2.9 2.0 4.1 3.4 107.4 152.0 19.71 11.85 27 0.730 815K 787 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 1.2 0.9 2.9 2.0 4.1 3.4 107.4 152.0 19.71 11.85 27 0.730 815K 787 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 1.2 0.9 2.1 1.2 0.0 0.0 134.7 134.4 15.72 9.39 15 1.048 815K 787 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 221.1 3.99 2.46 12 0.332 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.3 total, 5.2 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.92 GB write, 560.08 MB/s write, 2.07 GB read, 395.94 MB/s read, 19.7 seconds Interval compaction: 2.92 GB write, 579.44 MB/s write, 2.07 GB read, 409.62 MB/s read, 19.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 7, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 283759 Average: 14.8257 StdDev: 159.95 Min: 1 Median: 1.5934 Max: 14580 Percentiles: P50: 1.59 P75: 2.00 P99: 232.92 P99.9: 1730.09 P99.99: 2821.55 ------------------------------------------------------ [ 0, 1 ] 37788 13.317% 13.317% ### ( 1, 2 ] 175414 61.818% 75.135% ############ ( 2, 3 ] 35982 12.680% 87.815% ### ( 3, 4 ] 12224 4.308% 92.123% # ( 4, 6 ] 10079 3.552% 95.675% # ( 6, 10 ] 2922 1.030% 96.705% ( 10, 15 ] 712 0.251% 96.956% ( 15, 22 ] 110 0.039% 96.995% ( 22, 34 ] 25 0.009% 97.003% ( 34, 51 ] 7 0.002% 97.006% ( 51, 76 ] 3 0.001% 97.007% ( 76, 110 ] 357 0.126% 97.133% ( 110, 170 ] 3547 1.250% 98.383% ( 170, 250 ] 2227 0.785% 99.168% ( 250, 380 ] 619 0.218% 99.386% ( 380, 580 ] 569 0.201% 99.586% ( 580, 870 ] 373 0.131% 99.718% ( 870, 1300 ] 328 0.116% 99.833% ( 1300, 1900 ] 264 0.093% 99.926% ( 1900, 2900 ] 196 0.069% 99.995% ( 2900, 4400 ] 87 0.031% 100.026% ( 4400, 6600 ] 18 0.006% 100.032% ( 6600, 9900 ] 5 0.002% 100.034% ( 9900, 14000 ] 12 0.004% 100.038% ( 14000, 22000 ] 5 0.002% 100.040% ** Level 1 read latency histogram (micros): Count: 35960 Average: 12.1503 StdDev: 171.79 Min: 1 Median: 1.7073 Max: 12917 Percentiles: P50: 1.71 P75: 2.41 P99: 161.31 P99.9: 1961.18 P99.99: 10314.10 ------------------------------------------------------ [ 0, 1 ] 2758 7.670% 7.670% ## ( 1, 2 ] 21522 59.850% 67.519% ############ ( 2, 3 ] 6496 18.065% 85.584% #### ( 3, 4 ] 1959 5.448% 91.032% # ( 4, 6 ] 1720 4.783% 95.815% # ( 6, 10 ] 765 2.127% 97.942% ( 10, 15 ] 186 0.517% 98.459% ( 15, 22 ] 24 0.067% 98.526% ( 22, 34 ] 10 0.028% 98.554% ( 34, 51 ] 4 0.011% 98.565% ( 51, 76 ] 1 0.003% 98.568% ( 76, 110 ] 22 0.061% 98.629% ( 110, 170 ] 156 0.434% 99.063% ( 170, 250 ] 100 0.278% 99.341% ( 250, 380 ] 43 0.120% 99.461% ( 380, 580 ] 52 0.145% 99.605% ( 580, 870 ] 43 0.120% 99.725% ( 870, 1300 ] 31 0.086% 99.811% ( 1300, 1900 ] 31 0.086% 99.897% ( 1900, 2900 ] 17 0.047% 99.944% ( 2900, 4400 ] 13 0.036% 99.981% ( 4400, 6600 ] 2 0.006% 99.986% ( 6600, 9900 ] 1 0.003% 99.989% ( 9900, 14000 ] 4 0.011% 100.000% ** Level 3 read latency histogram (micros): Count: 108607 Average: 10.1330 StdDev: 116.32 Min: 0 Median: 1.7727 Max: 6766 Percentiles: P50: 1.77 P75: 2.62 P99: 12.99 P99.9: 1463.33 P99.99: 2059.13 ------------------------------------------------------ [ 0, 1 ] 6265 5.769% 5.769% # ( 1, 2 ] 62168 57.241% 63.010% ########### ( 2, 3 ] 20986 19.323% 82.333% #### ( 3, 4 ] 7823 7.203% 89.536% # ( 4, 6 ] 7904 7.278% 96.813% # ( 6, 10 ] 2078 1.913% 98.727% ( 10, 15 ] 497 0.458% 99.184% ( 15, 22 ] 94 0.087% 99.271% ( 22, 34 ] 9 0.008% 99.279% ( 34, 51 ] 5 0.005% 99.284% ( 51, 76 ] 2 0.002% 99.285% ( 76, 110 ] 5 0.005% 99.290% ( 110, 170 ] 96 0.088% 99.378% ( 170, 250 ] 90 0.083% 99.461% ( 250, 380 ] 79 0.073% 99.534% ( 380, 580 ] 108 0.099% 99.634% ( 580, 870 ] 133 0.122% 99.756% ( 870, 1300 ] 124 0.114% 99.870% ( 1300, 1900 ] 119 0.110% 99.980% ( 1900, 2900 ] 70 0.064% 100.044% ( 2900, 4400 ] 21 0.019% 100.064% ( 4400, 6600 ] 5 0.005% 100.068% ( 6600, 9900 ] 3 0.003% 100.071% ** Level 4 read latency histogram (micros): Count: 8201 Average: 287.2577 StdDev: 735.42 Min: 1 Median: 3.0773 Max: 8127 Percentiles: P50: 3.08 P75: 184.97 P99: 4021.49 P99.9: 6499.12 P99.99: 8127.00 ------------------------------------------------------ [ 0, 1 ] 346 4.219% 4.219% # ( 1, 2 ] 2709 33.033% 37.252% ####### ( 2, 3 ] 1010 12.316% 49.567% ## ( 3, 4 ] 459 5.597% 55.164% # ( 4, 6 ] 331 4.036% 59.200% # ( 6, 10 ] 116 1.414% 60.615% ( 10, 15 ] 28 0.341% 60.956% ( 15, 22 ] 4 0.049% 61.005% ( 22, 34 ] 1 0.012% 61.017% ( 76, 110 ] 108 1.317% 62.334% ( 110, 170 ] 928 11.316% 73.650% ## ( 170, 250 ] 592 7.219% 80.868% # ( 250, 380 ] 266 3.244% 84.112% # ( 380, 580 ] 270 3.292% 87.404% # ( 580, 870 ] 232 2.829% 90.233% # ( 870, 1300 ] 242 2.951% 93.184% # ( 1300, 1900 ] 211 2.573% 95.757% # ( 1900, 2900 ] 183 2.231% 97.988% ( 2900, 4400 ] 111 1.353% 99.342% ( 4400, 6600 ] 48 0.585% 99.927% ( 6600, 9900 ] 6 0.073% 100.000% ** Level 5 read latency histogram (micros): Count: 23500 Average: 600.4198 StdDev: 978.89 Min: 82 Median: 211.2938 Max: 10882 Percentiles: P50: 211.29 P75: 536.81 P99: 5266.87 P99.9: 7567.24 P99.99: 10788.33 ------------------------------------------------------ ( 76, 110 ] 928 3.949% 3.949% # ( 110, 170 ] 8173 34.779% 38.728% ####### ( 170, 250 ] 5132 21.838% 60.566% #### ( 250, 380 ] 1958 8.332% 68.898% ## ( 380, 580 ] 1829 7.783% 76.681% ## ( 580, 870 ] 1507 6.413% 83.094% # ( 870, 1300 ] 1091 4.643% 87.736% # ( 1300, 1900 ] 894 3.804% 91.540% # ( 1900, 2900 ] 865 3.681% 95.221% # ( 2900, 4400 ] 756 3.217% 98.438% # ( 4400, 6600 ] 335 1.426% 99.864% ( 6600, 9900 ] 29 0.123% 99.987% ( 9900, 14000 ] 3 0.013% 100.000% ** DB Stats ** Uptime(secs): 5.3 total, 5.2 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 184.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.517 H:M:S, 28.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 190.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.517 H:M:S, 29.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-23:08:01 ... thread 0: (1000000,2000000) ops and (105452.7,136517.8) ops/second in (9.482924,14.650102) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 3.79 GB 112.8 3.0 0.0 3.0 4.9 1.9 0.0 2.5 162.3 266.8 18.62 16.36 37 0.503 3069K 6972 0.0 0.0 L1 8/8 488.16 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 987.84 MB 1.0 0.5 0.2 0.2 0.5 0.2 0.0 2.0 121.2 120.9 4.02 2.32 2 2.010 0 0 0.0 0.0 L4 171/0 9.64 GB 1.0 1.0 0.9 0.0 1.0 0.9 0.2 1.0 107.6 107.4 9.29 4.72 11 0.845 175K 0 0.0 0.0 L5 1112/0 91.35 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1322/25 106.23 GB 0.0 4.4 1.2 3.2 6.3 3.1 4.1 3.3 141.2 202.1 31.93 23.41 50 0.639 3244K 6972 0.0 0.0 Int 0/0 0.00 KB 0.0 4.4 1.2 3.2 6.3 3.1 4.1 3.3 141.2 202.1 31.93 23.41 50 0.639 3244K 6972 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.4 1.2 3.2 4.4 1.2 0.0 0.0 183.4 183.0 24.59 18.09 21 1.171 3244K 6972 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.9 1.9 0.0 0.0 0.0 265.8 7.35 5.31 29 0.253 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.8 total, 14.7 interval Flush(GB): cumulative 1.907, interval 1.907 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.30 GB write, 435.08 MB/s write, 4.40 GB read, 304.10 MB/s read, 31.9 seconds Interval compaction: 6.30 GB write, 440.39 MB/s write, 4.40 GB read, 307.81 MB/s read, 31.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 7, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 956896 Average: 18.6694 StdDev: 103.73 Min: 1 Median: 1.5091 Max: 14580 Percentiles: P50: 1.51 P75: 1.94 P99: 264.11 P99.9: 739.94 P99.99: 1206.35 ------------------------------------------------------ [ 0, 1 ] 194487 20.325% 20.325% #### ( 1, 2 ] 557782 58.291% 78.616% ############ ( 2, 3 ] 79705 8.330% 86.945% ## ( 3, 4 ] 27327 2.856% 89.801% # ( 4, 6 ] 19183 2.005% 91.806% ( 6, 10 ] 4429 0.463% 92.268% ( 10, 15 ] 1149 0.120% 92.389% ( 15, 22 ] 177 0.018% 92.407% ( 22, 34 ] 28 0.003% 92.410% ( 34, 51 ] 11 0.001% 92.411% ( 51, 76 ] 11 0.001% 92.412% ( 76, 110 ] 3167 0.331% 92.743% ( 110, 170 ] 36166 3.780% 96.523% # ( 170, 250 ] 23155 2.420% 98.943% ( 250, 380 ] 5086 0.532% 99.474% ( 380, 580 ] 3424 0.358% 99.832% ( 580, 870 ] 1186 0.124% 99.956% ( 870, 1300 ] 421 0.044% 100.000% ( 1300, 1900 ] 278 0.029% 100.029% ( 1900, 2900 ] 212 0.022% 100.051% ( 2900, 4400 ] 101 0.011% 100.062% ( 4400, 6600 ] 18 0.002% 100.063% ( 6600, 9900 ] 5 0.001% 100.064% ( 9900, 14000 ] 12 0.001% 100.065% ( 14000, 22000 ] 5 0.001% 100.066% ** Level 1 read latency histogram (micros): Count: 50704 Average: 16.9756 StdDev: 150.33 Min: 1 Median: 1.9845 Max: 12917 Percentiles: P50: 1.98 P75: 3.50 P99: 245.92 P99.9: 1615.41 P99.99: 4391.88 ------------------------------------------------------ [ 0, 1 ] 2774 5.471% 5.471% # ( 1, 2 ] 22934 45.231% 50.702% ######### ( 2, 3 ] 9751 19.231% 69.933% #### ( 3, 4 ] 5162 10.181% 80.114% ## ( 4, 6 ] 5559 10.964% 91.078% ## ( 6, 10 ] 1510 2.978% 94.056% # ( 10, 15 ] 414 0.817% 94.872% ( 15, 22 ] 141 0.278% 95.150% ( 22, 34 ] 32 0.063% 95.213% ( 34, 51 ] 6 0.012% 95.225% ( 51, 76 ] 1 0.002% 95.227% ( 76, 110 ] 104 0.205% 95.432% ( 110, 170 ] 1120 2.209% 97.641% ( 170, 250 ] 726 1.432% 99.073% ( 250, 380 ] 162 0.320% 99.393% ( 380, 580 ] 147 0.290% 99.682% ( 580, 870 ] 62 0.122% 99.805% ( 870, 1300 ] 32 0.063% 99.868% ( 1300, 1900 ] 31 0.061% 99.929% ( 1900, 2900 ] 18 0.036% 99.964% ( 2900, 4400 ] 13 0.026% 99.990% ( 4400, 6600 ] 2 0.004% 99.994% ( 6600, 9900 ] 1 0.002% 99.996% ( 9900, 14000 ] 4 0.008% 100.004% ** Level 3 read latency histogram (micros): Count: 110733 Average: 13.1408 StdDev: 118.29 Min: 0 Median: 1.7896 Max: 6766 Percentiles: P50: 1.79 P75: 2.69 P99: 214.82 P99.9: 1452.61 P99.99: 2056.10 ------------------------------------------------------ [ 0, 1 ] 6265 5.658% 5.658% # ( 1, 2 ] 62188 56.160% 61.818% ########### ( 2, 3 ] 21089 19.045% 80.863% #### ( 3, 4 ] 7876 7.113% 87.976% # ( 4, 6 ] 7999 7.224% 95.199% # ( 6, 10 ] 2086 1.884% 97.083% ( 10, 15 ] 499 0.451% 97.534% ( 15, 22 ] 94 0.085% 97.619% ( 22, 34 ] 9 0.008% 97.627% ( 34, 51 ] 5 0.005% 97.631% ( 51, 76 ] 2 0.002% 97.633% ( 76, 110 ] 86 0.078% 97.711% ( 110, 170 ] 1045 0.944% 98.654% ( 170, 250 ] 683 0.617% 99.271% ( 250, 380 ] 193 0.174% 99.446% ( 380, 580 ] 189 0.171% 99.616% ( 580, 870 ] 155 0.140% 99.756% ( 870, 1300 ] 129 0.116% 99.873% ( 1300, 1900 ] 119 0.107% 99.980% ( 1900, 2900 ] 70 0.063% 100.043% ( 2900, 4400 ] 21 0.019% 100.062% ( 4400, 6600 ] 5 0.005% 100.067% ( 6600, 9900 ] 3 0.003% 100.070% ** Level 4 read latency histogram (micros): Count: 24383 Average: 216.1743 StdDev: 439.19 Min: 1 Median: 146.6412 Max: 8127 Percentiles: P50: 146.64 P75: 210.34 P99: 2473.89 P99.9: 5757.45 P99.99: 8127.00 ------------------------------------------------------ [ 0, 1 ] 346 1.419% 1.419% ( 1, 2 ] 2760 11.319% 12.738% ## ( 2, 3 ] 1321 5.418% 18.156% # ( 3, 4 ] 667 2.736% 20.892% # ( 4, 6 ] 653 2.678% 23.570% # ( 6, 10 ] 158 0.648% 24.218% ( 10, 15 ] 43 0.176% 24.394% ( 15, 22 ] 5 0.021% 24.415% ( 22, 34 ] 1 0.004% 24.419% ( 76, 110 ] 872 3.576% 27.995% # ( 110, 170 ] 8786 36.033% 64.028% ####### ( 170, 250 ] 5305 21.757% 85.785% #### ( 250, 380 ] 1254 5.143% 90.928% # ( 380, 580 ] 947 3.884% 94.812% # ( 580, 870 ] 442 1.813% 96.625% ( 870, 1300 ] 260 1.066% 97.691% ( 1300, 1900 ] 213 0.874% 98.565% ( 1900, 2900 ] 185 0.759% 99.323% ( 2900, 4400 ] 111 0.455% 99.779% ( 4400, 6600 ] 48 0.197% 99.975% ( 6600, 9900 ] 6 0.025% 100.000% ** Level 5 read latency histogram (micros): Count: 148890 Average: 254.5738 StdDev: 428.36 Min: 80 Median: 165.0584 Max: 10882 Percentiles: P50: 165.06 P75: 226.76 P99: 2495.19 P99.9: 5832.36 P99.99: 8547.11 ------------------------------------------------------ ( 76, 110 ] 7260 4.876% 4.876% # ( 110, 170 ] 73215 49.174% 54.050% ########## ( 170, 250 ] 43961 29.526% 83.576% ###### ( 250, 380 ] 10155 6.820% 90.396% # ( 380, 580 ] 7103 4.771% 95.167% # ( 580, 870 ] 2986 2.006% 97.172% ( 870, 1300 ] 1279 0.859% 98.031% ( 1300, 1900 ] 910 0.611% 98.643% ( 1900, 2900 ] 894 0.600% 99.243% ( 2900, 4400 ] 760 0.510% 99.754% ( 4400, 6600 ] 335 0.225% 99.979% ( 6600, 9900 ] 29 0.019% 99.998% ( 9900, 14000 ] 3 0.002% 100.000% ** DB Stats ** Uptime(secs): 14.8 total, 9.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 132.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.298 H:M:S, 49.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 103.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.780 H:M:S, 61.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/07/13-23:08:13 ... thread 0: (1000000,3000000) ops and (81645.3,111531.6) ops/second in (12.248097,26.898199) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 4.71 GB 288.5 5.3 0.0 5.3 8.1 2.8 0.0 2.9 178.3 273.2 30.38 27.51 57 0.533 5498K 12K 0.0 0.0 L1 8/8 488.16 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 987.84 MB 1.0 0.5 0.2 0.2 0.5 0.2 0.0 2.0 121.2 120.9 4.02 2.32 2 2.010 0 0 0.0 0.0 L4 171/0 9.64 GB 1.0 1.0 0.9 0.0 1.0 0.9 0.2 1.0 107.6 107.4 9.29 4.72 11 0.845 175K 0 0.0 0.0 L5 1112/0 91.35 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1322/21 107.15 GB 0.0 6.7 1.2 5.6 9.6 4.0 4.1 3.4 158.0 223.9 43.69 34.56 70 0.624 5673K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.7 1.2 5.6 9.6 4.0 4.1 3.4 158.0 223.9 43.69 34.56 70 0.624 5673K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.7 1.2 5.6 6.7 1.2 0.0 0.0 206.8 206.3 33.38 26.72 26 1.284 5673K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 281.0 10.31 7.83 44 0.234 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.1 total, 26.9 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.55 GB write, 361.33 MB/s write, 6.74 GB read, 254.90 MB/s read, 43.7 seconds Interval compaction: 9.55 GB write, 363.73 MB/s write, 6.74 GB read, 256.60 MB/s read, 43.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 35, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 35, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 35, total-stops: 7, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1661717 Average: 20.9512 StdDev: 91.36 Min: 0 Median: 1.4909 Max: 14580 Percentiles: P50: 1.49 P75: 1.94 P99: 271.11 P99.9: 644.54 P99.99: 878.05 ------------------------------------------------------ [ 0, 1 ] 372314 22.405% 22.405% #### ( 1, 2 ] 934150 56.216% 78.621% ########### ( 2, 3 ] 117219 7.054% 85.675% # ( 3, 4 ] 42019 2.529% 88.204% # ( 4, 6 ] 30597 1.841% 90.045% ( 6, 10 ] 6002 0.361% 90.407% ( 10, 15 ] 1443 0.087% 90.493% ( 15, 22 ] 232 0.014% 90.507% ( 22, 34 ] 33 0.002% 90.509% ( 34, 51 ] 16 0.001% 90.510% ( 51, 76 ] 14 0.001% 90.511% ( 76, 110 ] 6993 0.421% 90.932% ( 110, 170 ] 82473 4.963% 95.895% # ( 170, 250 ] 50008 3.009% 98.905% # ( 250, 380 ] 9774 0.588% 99.493% ( 380, 580 ] 6343 0.382% 99.874% ( 580, 870 ] 1911 0.115% 99.989% ( 870, 1300 ] 525 0.032% 100.021% ( 1300, 1900 ] 298 0.018% 100.039% ( 1900, 2900 ] 245 0.015% 100.054% ( 2900, 4400 ] 115 0.007% 100.061% ( 4400, 6600 ] 18 0.001% 100.062% ( 6600, 9900 ] 5 0.000% 100.062% ( 9900, 14000 ] 12 0.001% 100.063% ( 14000, 22000 ] 5 0.000% 100.063% ** Level 1 read latency histogram (micros): Count: 67118 Average: 20.3497 StdDev: 135.80 Min: 1 Median: 2.6018 Max: 12917 Percentiles: P50: 2.60 P75: 4.48 P99: 261.66 P99.9: 1317.07 P99.99: 4216.59 ------------------------------------------------------ [ 0, 1 ] 2781 4.143% 4.143% # ( 1, 2 ] 23627 35.202% 39.346% ####### ( 2, 3 ] 11883 17.705% 57.050% #### ( 3, 4 ] 9365 13.953% 71.003% ### ( 4, 6 ] 11210 16.702% 87.705% ### ( 6, 10 ] 2371 3.533% 91.238% # ( 10, 15 ] 671 1.000% 92.238% ( 15, 22 ] 323 0.481% 92.719% ( 22, 34 ] 50 0.074% 92.793% ( 34, 51 ] 9 0.013% 92.807% ( 51, 76 ] 1 0.001% 92.808% ( 76, 110 ] 210 0.313% 93.121% ( 110, 170 ] 2453 3.655% 96.776% # ( 170, 250 ] 1466 2.184% 98.960% ( 250, 380 ] 299 0.445% 99.406% ( 380, 580 ] 215 0.320% 99.726% ( 580, 870 ] 82 0.122% 99.848% ( 870, 1300 ] 34 0.051% 99.899% ( 1300, 1900 ] 31 0.046% 99.945% ( 1900, 2900 ] 18 0.027% 99.972% ( 2900, 4400 ] 14 0.021% 99.993% ( 4400, 6600 ] 2 0.003% 99.996% ( 6600, 9900 ] 1 0.001% 99.997% ( 9900, 14000 ] 4 0.006% 100.003% ** Level 3 read latency histogram (micros): Count: 113435 Average: 17.1706 StdDev: 120.54 Min: 0 Median: 1.8113 Max: 6766 Percentiles: P50: 1.81 P75: 2.79 P99: 246.95 P99.9: 1442.83 P99.99: 2052.24 ------------------------------------------------------ [ 0, 1 ] 6265 5.523% 5.523% # ( 1, 2 ] 62188 54.823% 60.346% ########### ( 2, 3 ] 21089 18.591% 78.937% #### ( 3, 4 ] 7876 6.943% 85.880% # ( 4, 6 ] 7999 7.052% 92.932% # ( 6, 10 ] 2086 1.839% 94.771% ( 10, 15 ] 499 0.440% 95.210% ( 15, 22 ] 94 0.083% 95.293% ( 22, 34 ] 9 0.008% 95.301% ( 34, 51 ] 5 0.004% 95.306% ( 51, 76 ] 2 0.002% 95.307% ( 76, 110 ] 201 0.177% 95.485% ( 110, 170 ] 2543 2.242% 97.726% ( 170, 250 ] 1502 1.324% 99.051% ( 250, 380 ] 350 0.309% 99.359% ( 380, 580 ] 275 0.242% 99.602% ( 580, 870 ] 180 0.159% 99.760% ( 870, 1300 ] 130 0.115% 99.875% ( 1300, 1900 ] 120 0.106% 99.981% ( 1900, 2900 ] 70 0.062% 100.042% ( 2900, 4400 ] 21 0.019% 100.061% ( 4400, 6600 ] 5 0.004% 100.065% ( 6600, 9900 ] 3 0.003% 100.068% ** Level 4 read latency histogram (micros): Count: 45870 Average: 199.1142 StdDev: 327.56 Min: 1 Median: 153.2935 Max: 8127 Percentiles: P50: 153.29 P75: 209.08 P99: 1610.41 P99.9: 4772.63 P99.99: 7377.15 ------------------------------------------------------ [ 0, 1 ] 346 0.754% 0.754% ( 1, 2 ] 2771 6.041% 6.795% # ( 2, 3 ] 1388 3.026% 9.821% # ( 3, 4 ] 709 1.546% 11.367% ( 4, 6 ] 738 1.609% 12.976% ( 6, 10 ] 169 0.368% 13.344% ( 10, 15 ] 46 0.100% 13.445% ( 15, 22 ] 6 0.013% 13.458% ( 22, 34 ] 1 0.002% 13.460% ( 76, 110 ] 1920 4.186% 17.646% # ( 110, 170 ] 20568 44.840% 62.485% ######### ( 170, 250 ] 11750 25.616% 88.101% ##### ( 250, 380 ] 2332 5.084% 93.185% # ( 380, 580 ] 1644 3.584% 96.769% # ( 580, 870 ] 632 1.378% 98.147% ( 870, 1300 ] 278 0.606% 98.753% ( 1300, 1900 ] 219 0.477% 99.230% ( 1900, 2900 ] 188 0.410% 99.640% ( 2900, 4400 ] 111 0.242% 99.882% ( 4400, 6600 ] 48 0.105% 99.987% ( 6600, 9900 ] 6 0.013% 100.000% ** Level 5 read latency histogram (micros): Count: 315371 Average: 216.0054 StdDev: 305.15 Min: 79 Median: 161.4679 Max: 10882 Percentiles: P50: 161.47 P75: 217.14 P99: 1255.42 P99.9: 4725.92 P99.99: 6589.91 ------------------------------------------------------ ( 76, 110 ] 15743 4.992% 4.992% # ( 110, 170 ] 165474 52.470% 57.462% ########## ( 170, 250 ] 93869 29.765% 87.226% ###### ( 250, 380 ] 18828 5.970% 93.196% # ( 380, 580 ] 12595 3.994% 97.190% # ( 580, 870 ] 4415 1.400% 98.590% ( 870, 1300 ] 1444 0.458% 99.048% ( 1300, 1900 ] 943 0.299% 99.347% ( 1900, 2900 ] 931 0.295% 99.642% ( 2900, 4400 ] 765 0.243% 99.885% ( 4400, 6600 ] 335 0.106% 99.991% ( 6600, 9900 ] 29 0.009% 100.000% ( 9900, 14000 ] 3 0.001% 100.001% ** DB Stats ** Uptime(secs): 27.1 total, 12.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 109.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.701 H:M:S, 58.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 80.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.404 H:M:S, 68.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 241.345 micros/op 16551 ops/sec 60.174 seconds 995996 operations; 16.0 MB/s (249999 of 249999 found) Microseconds per read: Count: 995996 Average: 241.3472 StdDev: 519.63 Min: 2 Median: 202.3842 Max: 63017 Percentiles: P50: 202.38 P75: 245.61 P99: 788.35 P99.9: 7042.39 P99.99: 23760.07 ------------------------------------------------------ ( 1, 2 ] 14 0.001% 0.001% ( 2, 3 ] 62 0.006% 0.008% ( 3, 4 ] 56 0.006% 0.013% ( 4, 6 ] 87 0.009% 0.022% ( 6, 10 ] 476 0.048% 0.070% ( 10, 15 ] 5704 0.573% 0.642% ( 15, 22 ] 4131 0.415% 1.057% ( 22, 34 ] 8539 0.857% 1.915% ( 34, 51 ] 1620 0.163% 2.077% ( 51, 76 ] 176 0.018% 2.095% ( 76, 110 ] 2939 0.295% 2.390% ( 110, 170 ] 287644 28.880% 31.270% ###### ( 170, 250 ] 460842 46.269% 77.539% ######### ( 250, 380 ] 137915 13.847% 91.386% ### ( 380, 580 ] 64471 6.473% 97.859% # ( 580, 870 ] 15812 1.588% 99.447% ( 870, 1300 ] 3134 0.315% 99.762% ( 1300, 1900 ] 526 0.053% 99.814% ( 1900, 2900 ] 393 0.039% 99.854% ( 2900, 4400 ] 234 0.023% 99.877% ( 4400, 6600 ] 175 0.018% 99.895% ( 6600, 9900 ] 373 0.037% 99.932% ( 9900, 14000 ] 371 0.037% 99.970% ( 14000, 22000 ] 192 0.019% 99.989% ( 22000, 33000 ] 65 0.007% 99.995% ( 33000, 50000 ] 42 0.004% 100.000% ( 50000, 75000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 21178003 rocksdb.bloom.filter.full.positive COUNT : 1201303 rocksdb.bloom.filter.full.true.positive COUNT : 995627 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 369 rocksdb.memtable.miss COUNT : 995627 rocksdb.l0.hit COUNT : 47559 rocksdb.l1.hit COUNT : 4659 rocksdb.l2andup.hit COUNT : 943409 rocksdb.compaction.key.drop.new COUNT : 37591 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3596895 rocksdb.number.keys.read COUNT : 995996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3711995640 rocksdb.bytes.read COUNT : 995996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1416 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 46051865 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9965681881 rocksdb.compact.write.bytes COUNT : 9929400759 rocksdb.flush.write.bytes COUNT : 3699405111 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 72 rocksdb.number.superversion_acquires COUNT : 576 rocksdb.number.superversion_releases COUNT : 546 rocksdb.number.superversion_cleanups COUNT : 143 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3669405696 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1278976 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 14533542626 rocksdb.non.last.level.read.count COUNT : 3366277 rocksdb.block.checksum.compute.count COUNT : 3627865 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 201.593967 P95 : 490.422906 P99 : 787.486263 P100 : 63014.000000 COUNT : 995996 SUM : 239626008 rocksdb.db.write.micros P50 : 1.510051 P95 : 4.962952 P99 : 16.158408 P100 : 454307.000000 COUNT : 3596895 SUM : 55065897 rocksdb.compaction.times.micros P50 : 1047894.736842 P95 : 3623333.333333 P99 : 4158423.000000 P100 : 4158423.000000 COUNT : 29 SUM : 36194003 rocksdb.compaction.times.cpu_micros P50 : 925384.615385 P95 : 3623333.333333 P99 : 4096680.000000 P100 : 4096680.000000 COUNT : 29 SUM : 29484224 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 810.000000 P95 : 3125.000000 P99 : 15520.000000 P100 : 15520.000000 COUNT : 54 SUM : 70133 rocksdb.compaction.outfile.sync.micros P50 : 1857.142857 P95 : 10105.000000 P99 : 13221.000000 P100 : 13244.000000 COUNT : 57 SUM : 165441 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 170.000000 P95 : 2100.000000 P99 : 3647.000000 P100 : 3647.000000 COUNT : 88 SUM : 40168 rocksdb.table.open.io.micros P50 : 7731.428571 P95 : 17526.530612 P99 : 23265.000000 P100 : 32235.000000 COUNT : 1416 SUM : 11521395 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.606220 P95 : 165.173301 P99 : 246.800182 P100 : 16001.000000 COUNT : 2413792 SUM : 62167775 rocksdb.read.block.get.micros P50 : 153.826180 P95 : 287.722451 P99 : 575.635617 P100 : 15800.000000 COUNT : 1212623 SUM : 206955498 rocksdb.write.raw.block.micros P50 : 0.543915 P95 : 1.503093 P99 : 3.162692 P100 : 11392.000000 COUNT : 3300378 SUM : 8076281 rocksdb.numfiles.in.singlecompaction P50 : 3.275862 P95 : 3.958621 P99 : 18.920000 P100 : 21.000000 COUNT : 44 SUM : 165 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.591644 P95 : 2160.123287 P99 : 2752.330959 P100 : 454153.000000 COUNT : 193341 SUM : 46073853 rocksdb.sst.read.micros P50 : 2.491970 P95 : 233.225666 P99 : 451.811976 P100 : 14580.000000 COUNT : 3366339 SUM : 254893498 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 995996 SUM : 995996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3596895 SUM : 3711995640 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 216956.521739 P95 : 408500.000000 P99 : 677239.000000 P100 : 677239.000000 COUNT : 54 SUM : 12252152 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 99 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0