[2024-11-28 00:24:12.099071] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-11-28 00:24:12.099340] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1760040 ] Set seed to 1732749852092470 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-28 00:24:12.199480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-28 00:24:12.239318] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-28 00:24:12.239369] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1760040' to capture a snapshot of events at runtime. [2024-11-28 00:24:12.239383] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1760040 for offline analysis/debug. [2024-11-28 00:24:12.239413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Nov 28 00:24:16 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/28-00:24:24 ... thread 0: (1000000,1000000) ops and (129455.4,129455.4) ops/second in (7.724668,7.724668) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 2.70 GB 62.9 0.6 0.0 0.6 1.4 0.9 0.0 1.6 91.9 234.7 6.17 4.70 15 0.411 575K 610 0.0 0.0 L1 13/13 1.52 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 89.37 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/0 940.22 MB 0.9 1.3 0.7 0.6 1.3 0.7 0.0 1.8 105.0 103.8 12.62 6.24 8 1.577 179K 0 0.0 0.0 L4 165/0 9.66 GB 1.0 4.3 2.4 1.9 4.3 2.3 0.0 1.8 121.7 120.2 36.28 20.49 26 1.395 1536K 0 0.0 0.0 L5 1116/0 91.91 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1327/21 106.80 GB 0.0 6.2 3.1 3.1 7.0 3.9 2.3 8.1 114.5 129.3 55.07 31.44 49 1.124 2291K 610 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 3.1 3.1 7.0 3.9 2.3 8.1 114.5 129.3 55.07 31.44 49 1.124 2291K 610 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 3.1 3.1 6.1 3.0 0.0 0.0 123.3 121.9 51.16 28.90 36 1.421 2291K 610 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 225.2 3.92 2.53 13 0.301 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.7 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.95 GB write, 904.93 MB/s write, 6.16 GB read, 801.57 MB/s read, 55.1 seconds Interval compaction: 6.95 GB write, 921.33 MB/s write, 6.16 GB read, 816.08 MB/s read, 55.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 20, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 3, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 422536 Average: 9.5484 StdDev: 107.05 Min: 1 Median: 1.8120 Max: 10711 Percentiles: P50: 1.81 P75: 2.77 P99: 137.51 P99.9: 847.83 P99.99: 1554.30 ------------------------------------------------------ [ 0, 1 ] 36368 8.607% 8.607% ## ( 1, 2 ] 215408 50.980% 59.587% ########## ( 2, 3 ] 84205 19.928% 79.515% #### ( 3, 4 ] 33421 7.910% 87.425% ## ( 4, 6 ] 35573 8.419% 95.844% ## ( 6, 10 ] 9598 2.272% 98.115% ( 10, 15 ] 2154 0.510% 98.625% ( 15, 22 ] 367 0.087% 98.712% ( 22, 34 ] 44 0.010% 98.722% ( 34, 51 ] 27 0.006% 98.729% ( 51, 76 ] 24 0.006% 98.735% ( 76, 110 ] 392 0.093% 98.827% ( 110, 170 ] 1598 0.378% 99.206% ( 170, 250 ] 1133 0.268% 99.474% ( 250, 380 ] 708 0.168% 99.641% ( 380, 580 ] 655 0.155% 99.796% ( 580, 870 ] 478 0.113% 99.909% ( 870, 1300 ] 270 0.064% 99.973% ( 1300, 1900 ] 174 0.041% 100.014% ( 1900, 2900 ] 115 0.027% 100.042% ( 2900, 4400 ] 142 0.034% 100.075% ( 4400, 6600 ] 28 0.007% 100.082% ( 6600, 9900 ] 6 0.001% 100.083% ( 9900, 14000 ] 2 0.000% 100.084% ** Level 1 read latency histogram (micros): Count: 639 Average: 648.7825 StdDev: 1412.35 Min: 78 Median: 228.4615 Max: 10742 Percentiles: P50: 228.46 P75: 540.14 P99: 9135.50 P99.9: 10742.00 P99.99: 10742.00 ------------------------------------------------------ ( 76, 110 ] 46 7.199% 7.199% # ( 110, 170 ] 188 29.421% 36.620% ###### ( 170, 250 ] 117 18.310% 54.930% #### ( 250, 380 ] 73 11.424% 66.354% ## ( 380, 580 ] 69 10.798% 77.152% ## ( 580, 870 ] 53 8.294% 85.446% ## ( 870, 1300 ] 43 6.729% 92.175% # ( 1300, 1900 ] 11 1.721% 93.897% ( 1900, 2900 ] 10 1.565% 95.462% ( 2900, 4400 ] 9 1.408% 96.870% ( 4400, 6600 ] 9 1.408% 98.279% ( 6600, 9900 ] 6 0.939% 99.218% ( 9900, 14000 ] 5 0.782% 100.000% ** Level 2 read latency histogram (micros): Count: 45342 Average: 9.7238 StdDev: 118.57 Min: 1 Median: 1.8852 Max: 6285 Percentiles: P50: 1.89 P75: 3.06 P99: 13.30 P99.9: 1889.74 P99.99: 4295.40 ------------------------------------------------------ [ 0, 1 ] 2640 5.822% 5.822% # ( 1, 2 ] 22628 49.905% 55.728% ########## ( 2, 3 ] 8468 18.676% 74.403% #### ( 3, 4 ] 4650 10.255% 84.659% ## ( 4, 6 ] 5002 11.032% 95.691% ## ( 6, 10 ] 1314 2.898% 98.589% # ( 10, 15 ] 283 0.624% 99.213% ( 15, 22 ] 36 0.079% 99.292% ( 22, 34 ] 4 0.009% 99.301% ( 34, 51 ] 4 0.009% 99.310% ( 51, 76 ] 3 0.007% 99.316% ( 76, 110 ] 3 0.007% 99.323% ( 110, 170 ] 20 0.044% 99.367% ( 170, 250 ] 31 0.068% 99.435% ( 250, 380 ] 42 0.093% 99.528% ( 380, 580 ] 49 0.108% 99.636% ( 580, 870 ] 51 0.112% 99.749% ( 870, 1300 ] 49 0.108% 99.857% ( 1300, 1900 ] 20 0.044% 99.901% ( 1900, 2900 ] 20 0.044% 99.945% ( 2900, 4400 ] 22 0.049% 99.993% ( 4400, 6600 ] 3 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 601951 Average: 9.7003 StdDev: 128.79 Min: 1 Median: 1.9307 Max: 11225 Percentiles: P50: 1.93 P75: 3.12 P99: 9.94 P99.9: 777.78 P99.99: 1178.46 ------------------------------------------------------ [ 0, 1 ] 23818 3.957% 3.957% # ( 1, 2 ] 297787 49.470% 53.427% ########## ( 2, 3 ] 121806 20.235% 73.662% #### ( 3, 4 ] 65947 10.956% 84.618% ## ( 4, 6 ] 71395 11.861% 96.478% ## ( 6, 10 ] 15425 2.563% 99.041% # ( 10, 15 ] 3347 0.556% 99.597% ( 15, 22 ] 441 0.073% 99.670% ( 22, 34 ] 63 0.010% 99.681% ( 34, 51 ] 41 0.007% 99.688% ( 51, 76 ] 58 0.010% 99.697% ( 76, 110 ] 44 0.007% 99.704% ( 110, 170 ] 169 0.028% 99.733% ( 170, 250 ] 150 0.025% 99.757% ( 250, 380 ] 198 0.033% 99.790% ( 380, 580 ] 332 0.055% 99.846% ( 580, 870 ] 481 0.080% 99.925% ( 870, 1300 ] 542 0.090% 100.015% ( 1300, 1900 ] 393 0.065% 100.081% ( 1900, 2900 ] 286 0.048% 100.128% ( 2900, 4400 ] 316 0.052% 100.181% ( 4400, 6600 ] 73 0.012% 100.193% ( 6600, 9900 ] 12 0.002% 100.195% ( 9900, 14000 ] 1 0.000% 100.195% ** Level 4 read latency histogram (micros): Count: 499540 Average: 20.4247 StdDev: 200.64 Min: 0 Median: 1.9195 Max: 10274 Percentiles: P50: 1.92 P75: 3.13 P99: 325.20 P99.9: 2151.19 P99.99: 2902.78 ------------------------------------------------------ [ 0, 1 ] 21141 4.232% 4.232% # ( 1, 2 ] 248655 49.777% 54.009% ########## ( 2, 3 ] 98012 19.620% 73.629% #### ( 3, 4 ] 53084 10.627% 84.256% ## ( 4, 6 ] 54589 10.928% 95.184% ## ( 6, 10 ] 13122 2.627% 97.811% # ( 10, 15 ] 2828 0.566% 98.377% ( 15, 22 ] 321 0.064% 98.441% ( 22, 34 ] 54 0.011% 98.452% ( 34, 51 ] 32 0.006% 98.458% ( 51, 76 ] 56 0.011% 98.469% ( 76, 110 ] 267 0.053% 98.523% ( 110, 170 ] 1127 0.226% 98.748% ( 170, 250 ] 854 0.171% 98.919% ( 250, 380 ] 696 0.139% 99.059% ( 380, 580 ] 950 0.190% 99.249% ( 580, 870 ] 1113 0.223% 99.472% ( 870, 1300 ] 1185 0.237% 99.709% ( 1300, 1900 ] 804 0.161% 99.870% ( 1900, 2900 ] 599 0.120% 99.990% ( 2900, 4400 ] 564 0.113% 100.103% ( 4400, 6600 ] 179 0.036% 100.139% ( 6600, 9900 ] 18 0.004% 100.142% ( 9900, 14000 ] 1 0.000% 100.142% ** Level 5 read latency histogram (micros): Count: 31372 Average: 700.3277 StdDev: 1090.63 Min: 78 Median: 250.4882 Max: 9901 Percentiles: P50: 250.49 P75: 684.98 P99: 5778.42 P99.9: 8754.27 P99.99: 9695.43 ------------------------------------------------------ ( 76, 110 ] 2124 6.770% 6.770% # ( 110, 170 ] 8252 26.304% 33.074% ##### ( 170, 250 ] 5297 16.884% 49.959% ### ( 250, 380 ] 3462 11.035% 60.994% ## ( 380, 580 ] 3472 11.067% 72.061% ## ( 580, 870 ] 2547 8.119% 80.180% ## ( 870, 1300 ] 1825 5.817% 85.997% # ( 1300, 1900 ] 1296 4.131% 90.128% # ( 1900, 2900 ] 1127 3.592% 93.721% # ( 2900, 4400 ] 1291 4.115% 97.836% # ( 4400, 6600 ] 583 1.858% 99.694% ( 6600, 9900 ] 99 0.316% 100.010% ( 9900, 14000 ] 1 0.003% 100.013% ** DB Stats ** Uptime(secs): 7.9 total, 7.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 125.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.955 H:M:S, 50.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.955 H:M:S, 51.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-00:24:57 ... thread 0: (1000000,2000000) ops and (29974.9,48678.4) ops/second in (33.361288,41.085956) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 3/3 1.83 GB 0.0 3.3 0.0 3.3 5.1 1.8 0.0 2.8 167.1 261.1 19.97 17.91 37 0.540 3388K 11K 0.0 0.0 L1 14/14 1.62 GB 0.0 3.4 1.8 1.5 3.3 1.8 0.0 1.8 84.8 83.9 40.67 24.62 1 40.669 3502K 35K 0.0 0.0 L2 12/8 1.16 GB 5.2 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 27/9 1.56 GB 1.2 1.3 0.7 0.6 1.3 0.7 0.6 1.8 105.0 103.8 12.62 6.24 8 1.577 179K 0 0.0 0.0 L4 165/0 9.66 GB 1.0 4.3 2.4 1.9 4.3 2.3 0.0 1.8 121.7 120.2 36.28 20.49 26 1.395 1536K 0 0.0 0.0 L5 1116/0 91.91 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1337/34 107.74 GB 0.0 12.2 4.9 7.3 14.0 6.6 4.7 7.6 114.3 130.5 109.54 69.26 72 1.521 8606K 47K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.2 4.9 7.3 14.0 6.6 4.7 7.6 114.3 130.5 109.54 69.26 72 1.521 8606K 47K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.2 4.9 7.3 12.1 4.8 0.0 0.0 122.3 121.2 102.40 63.91 43 2.381 8606K 47K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 264.6 7.14 5.35 29 0.246 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.2 total, 41.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.96 GB write, 346.83 MB/s write, 12.23 GB read, 303.78 MB/s read, 109.5 seconds Interval compaction: 13.96 GB write, 348.01 MB/s write, 12.23 GB read, 304.82 MB/s read, 109.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 32, pending-compaction-bytes-stops: 0, total-delays: 32, total-stops: 3, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1428348 Average: 20.6243 StdDev: 85.32 Min: 0 Median: 1.6733 Max: 10711 Percentiles: P50: 1.67 P75: 2.77 P99: 236.43 P99.9: 577.95 P99.99: 852.33 ------------------------------------------------------ [ 0, 1 ] 258790 18.118% 18.118% #### ( 1, 2 ] 676316 47.350% 65.468% ######### ( 2, 3 ] 176274 12.341% 77.809% ## ( 3, 4 ] 73668 5.158% 82.966% # ( 4, 6 ] 66380 4.647% 87.614% # ( 6, 10 ] 16220 1.136% 88.749% ( 10, 15 ] 3402 0.238% 88.987% ( 15, 22 ] 753 0.053% 89.040% ( 22, 34 ] 109 0.008% 89.048% ( 34, 51 ] 34 0.002% 89.050% ( 51, 76 ] 86 0.006% 89.056% ( 76, 110 ] 34364 2.406% 91.462% ( 110, 170 ] 90961 6.368% 97.830% # ( 170, 250 ] 20121 1.409% 99.239% ( 250, 380 ] 5639 0.395% 99.634% ( 380, 580 ] 3842 0.269% 99.903% ( 580, 870 ] 1327 0.093% 99.996% ( 870, 1300 ] 423 0.030% 100.025% ( 1300, 1900 ] 230 0.016% 100.041% ( 1900, 2900 ] 169 0.012% 100.053% ( 2900, 4400 ] 227 0.016% 100.069% ( 4400, 6600 ] 31 0.002% 100.071% ( 6600, 9900 ] 6 0.000% 100.072% ( 9900, 14000 ] 2 0.000% 100.072% ** Level 1 read latency histogram (micros): Count: 445877 Average: 10.1349 StdDev: 80.76 Min: 1 Median: 3.3305 Max: 10742 Percentiles: P50: 3.33 P75: 4.27 P99: 157.74 P99.9: 569.99 P99.99: 1701.25 ------------------------------------------------------ [ 0, 1 ] 8166 1.831% 1.831% ( 1, 2 ] 75426 16.916% 18.748% ### ( 2, 3 ] 90367 20.267% 39.015% #### ( 3, 4 ] 148192 33.236% 72.251% ####### ( 4, 6 ] 89953 20.174% 92.425% #### ( 6, 10 ] 12953 2.905% 95.331% # ( 10, 15 ] 4097 0.919% 96.249% ( 15, 22 ] 2744 0.615% 96.865% ( 22, 34 ] 117 0.026% 96.891% ( 34, 51 ] 15 0.003% 96.894% ( 51, 76 ] 12 0.003% 96.897% ( 76, 110 ] 3136 0.703% 97.600% ( 110, 170 ] 7842 1.759% 99.359% ( 170, 250 ] 1520 0.341% 99.700% ( 250, 380 ] 514 0.115% 99.815% ( 380, 580 ] 397 0.089% 99.904% ( 580, 870 ] 233 0.052% 99.957% ( 870, 1300 ] 123 0.028% 99.984% ( 1300, 1900 ] 38 0.009% 99.993% ( 1900, 2900 ] 43 0.010% 100.002% ( 2900, 4400 ] 46 0.010% 100.013% ( 4400, 6600 ] 16 0.004% 100.016% ( 6600, 9900 ] 6 0.001% 100.018% ( 9900, 14000 ] 5 0.001% 100.019% ** Level 2 read latency histogram (micros): Count: 56804 Average: 11.8952 StdDev: 120.74 Min: 1 Median: 1.9241 Max: 6285 Percentiles: P50: 1.92 P75: 3.21 P99: 162.27 P99.9: 1987.84 P99.99: 4270.30 ------------------------------------------------------ [ 0, 1 ] 3060 5.387% 5.387% # ( 1, 2 ] 27422 48.275% 53.662% ########## ( 2, 3 ] 10920 19.224% 72.886% #### ( 3, 4 ] 5767 10.152% 83.038% ## ( 4, 6 ] 6233 10.973% 94.011% ## ( 6, 10 ] 1701 2.995% 97.005% # ( 10, 15 ] 376 0.662% 97.667% ( 15, 22 ] 49 0.086% 97.754% ( 22, 34 ] 7 0.012% 97.766% ( 34, 51 ] 8 0.014% 97.780% ( 51, 76 ] 3 0.005% 97.785% ( 76, 110 ] 190 0.334% 98.120% ( 110, 170 ] 575 1.012% 99.132% ( 170, 250 ] 142 0.250% 99.382% ( 250, 380 ] 84 0.148% 99.530% ( 380, 580 ] 74 0.130% 99.660% ( 580, 870 ] 57 0.100% 99.761% ( 870, 1300 ] 53 0.093% 99.854% ( 1300, 1900 ] 25 0.044% 99.898% ( 1900, 2900 ] 25 0.044% 99.942% ( 2900, 4400 ] 31 0.055% 99.996% ( 4400, 6600 ] 3 0.005% 100.002% ** Level 3 read latency histogram (micros): Count: 630860 Average: 11.8491 StdDev: 130.71 Min: 1 Median: 1.9462 Max: 11225 Percentiles: P50: 1.95 P75: 3.22 P99: 137.95 P99.9: 806.31 P99.99: 1209.05 ------------------------------------------------------ [ 0, 1 ] 24327 3.856% 3.856% # ( 1, 2 ] 307647 48.766% 52.622% ########## ( 2, 3 ] 126188 20.003% 72.625% #### ( 3, 4 ] 68103 10.795% 83.420% ## ( 4, 6 ] 73535 11.656% 95.077% ## ( 6, 10 ] 15969 2.531% 97.608% # ( 10, 15 ] 3484 0.552% 98.160% ( 15, 22 ] 457 0.072% 98.233% ( 22, 34 ] 65 0.010% 98.243% ( 34, 51 ] 53 0.008% 98.251% ( 51, 76 ] 63 0.010% 98.261% ( 76, 110 ] 2046 0.324% 98.586% ( 110, 170 ] 5614 0.890% 99.475% ( 170, 250 ] 1201 0.190% 99.666% ( 250, 380 ] 492 0.078% 99.744% ( 380, 580 ] 546 0.087% 99.830% ( 580, 870 ] 564 0.089% 99.920% ( 870, 1300 ] 563 0.089% 100.009% ( 1300, 1900 ] 407 0.065% 100.074% ( 1900, 2900 ] 296 0.047% 100.120% ( 2900, 4400 ] 339 0.054% 100.174% ( 4400, 6600 ] 76 0.012% 100.186% ( 6600, 9900 ] 13 0.002% 100.188% ( 9900, 14000 ] 1 0.000% 100.188% ** Level 4 read latency histogram (micros): Count: 584596 Average: 38.7932 StdDev: 194.54 Min: 0 Median: 2.2272 Max: 10274 Percentiles: P50: 2.23 P75: 4.59 P99: 442.60 P99.9: 2062.47 P99.99: 2922.09 ------------------------------------------------------ [ 0, 1 ] 21141 3.616% 3.616% # ( 1, 2 ] 248750 42.551% 46.167% ######### ( 2, 3 ] 98643 16.874% 63.041% ### ( 3, 4 ] 53534 9.157% 72.198% ## ( 4, 6 ] 55315 9.462% 81.660% ## ( 6, 10 ] 13189 2.256% 83.916% ( 10, 15 ] 2860 0.489% 84.406% ( 15, 22 ] 323 0.055% 84.461% ( 22, 34 ] 54 0.009% 84.470% ( 34, 51 ] 32 0.005% 84.476% ( 51, 76 ] 73 0.012% 84.488% ( 76, 110 ] 19257 3.294% 87.782% # ( 110, 170 ] 51809 8.862% 96.645% ## ( 170, 250 ] 10128 1.732% 98.377% ( 250, 380 ] 2925 0.500% 98.877% ( 380, 580 ] 2291 0.392% 99.269% ( 580, 870 ] 1509 0.258% 99.527% ( 870, 1300 ] 1251 0.214% 99.741% ( 1300, 1900 ] 827 0.141% 99.883% ( 1900, 2900 ] 618 0.106% 99.989% ( 2900, 4400 ] 580 0.099% 100.088% ( 4400, 6600 ] 181 0.031% 100.119% ( 6600, 9900 ] 18 0.003% 100.122% ( 9900, 14000 ] 1 0.000% 100.122% ** Level 5 read latency histogram (micros): Count: 614188 Average: 178.3274 StdDev: 290.05 Min: 73 Median: 138.2183 Max: 9901 Percentiles: P50: 138.22 P75: 163.72 P99: 1037.24 P99.9: 4661.83 P99.99: 7543.18 ------------------------------------------------------ ( 51, 76 ] 77 0.013% 0.013% ( 76, 110 ] 137139 22.329% 22.341% #### ( 110, 170 ] 361208 58.811% 81.152% ############ ( 170, 250 ] 70171 11.425% 92.577% ## ( 250, 380 ] 19440 3.165% 95.742% # ( 380, 580 ] 13871 2.258% 98.000% ( 580, 870 ] 5244 0.854% 98.854% ( 870, 1300 ] 2304 0.375% 99.229% ( 1300, 1900 ] 1446 0.235% 99.465% ( 1900, 2900 ] 1239 0.202% 99.666% ( 2900, 4400 ] 1364 0.222% 99.888% ( 4400, 6600 ] 595 0.097% 99.985% ( 6600, 9900 ] 100 0.016% 100.002% ( 9900, 14000 ] 1 0.000% 100.002% ** DB Stats ** Uptime(secs): 41.2 total, 33.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 47.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:33.121 H:M:S, 80.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 29.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:29.166 H:M:S, 87.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/28-00:25:05 ... thread 0: (1000000,3000000) ops and (120351.3,60734.9) ops/second in (8.309006,49.394962) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/3 2.76 GB 94.4 3.8 0.0 3.8 6.6 2.8 0.0 2.4 132.6 228.5 29.44 23.22 51 0.577 3964K 12K 0.0 0.0 L1 14/14 1.62 GB 0.0 3.4 1.8 1.5 3.3 1.8 0.0 1.8 84.8 83.9 40.67 24.62 1 40.669 3502K 35K 0.0 0.0 L3 18/0 963.62 MB 1.0 3.5 1.8 1.6 3.5 1.8 0.6 1.9 114.6 113.7 31.22 17.95 20 1.561 1830K 4065 0.0 0.0 L4 173/0 9.68 GB 1.0 8.8 4.1 4.7 8.6 4.0 0.0 2.1 121.3 119.5 74.09 43.22 51 1.453 4206K 12K 0.0 0.0 L5 1136/0 93.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1350/17 108.56 GB 0.0 19.5 7.8 11.6 22.0 10.4 4.7 8.0 113.5 128.5 175.42 109.01 123 1.426 13M 64K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.5 7.8 11.6 22.0 10.4 4.7 8.0 113.5 128.5 175.42 109.01 123 1.426 13M 64K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.5 7.8 11.6 19.2 7.6 0.0 0.0 122.8 121.5 162.16 100.87 82 1.978 13M 64K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 213.8 13.26 8.14 41 0.323 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.5 total, 49.4 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.01 GB write, 455.01 MB/s write, 19.45 GB read, 402.08 MB/s read, 175.4 seconds Interval compaction: 22.01 GB write, 456.30 MB/s write, 19.45 GB read, 403.22 MB/s read, 175.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 48, pending-compaction-bytes-stops: 0, total-delays: 48, total-stops: 19, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1804731 Average: 19.7484 StdDev: 152.47 Min: 0 Median: 1.7232 Max: 46157 Percentiles: P50: 1.72 P75: 2.83 P99: 233.81 P99.9: 822.05 P99.99: 1623.83 ------------------------------------------------------ [ 0, 1 ] 281451 15.595% 15.595% ### ( 1, 2 ] 858573 47.573% 63.169% ########## ( 2, 3 ] 256453 14.210% 77.379% ### ( 3, 4 ] 108301 6.001% 83.380% # ( 4, 6 ] 106377 5.894% 89.274% # ( 6, 10 ] 26157 1.449% 90.723% ( 10, 15 ] 5272 0.292% 91.015% ( 15, 22 ] 970 0.054% 91.069% ( 22, 34 ] 128 0.007% 91.076% ( 34, 51 ] 74 0.004% 91.080% ( 51, 76 ] 131 0.007% 91.088% ( 76, 110 ] 34634 1.919% 93.007% ( 110, 170 ] 91745 5.084% 98.090% # ( 170, 250 ] 20583 1.141% 99.231% ( 250, 380 ] 6037 0.335% 99.565% ( 380, 580 ] 4392 0.243% 99.809% ( 580, 870 ] 1976 0.109% 99.918% ( 870, 1300 ] 1005 0.056% 99.974% ( 1300, 1900 ] 542 0.030% 100.004% ( 1900, 2900 ] 378 0.021% 100.025% ( 2900, 4400 ] 506 0.028% 100.053% ( 4400, 6600 ] 110 0.006% 100.059% ( 6600, 9900 ] 28 0.002% 100.061% ( 9900, 14000 ] 12 0.001% 100.061% ( 14000, 22000 ] 13 0.001% 100.062% ( 22000, 33000 ] 13 0.001% 100.063% ( 33000, 50000 ] 4 0.000% 100.063% ** Level 1 read latency histogram (micros): Count: 803744 Average: 11.2597 StdDev: 201.37 Min: 1 Median: 2.7915 Max: 46321 Percentiles: P50: 2.79 P75: 3.89 P99: 142.25 P99.9: 897.59 P99.99: 2154.15 ------------------------------------------------------ [ 0, 1 ] 17997 2.239% 2.239% ( 1, 2 ] 250603 31.179% 33.419% ###### ( 2, 3 ] 168387 20.950% 54.369% #### ( 3, 4 ] 186898 23.253% 77.622% ##### ( 4, 6 ] 132054 16.430% 94.052% ### ( 6, 10 ] 22829 2.840% 96.893% # ( 10, 15 ] 6229 0.775% 97.668% ( 15, 22 ] 2979 0.371% 98.038% ( 22, 34 ] 131 0.016% 98.054% ( 34, 51 ] 48 0.006% 98.060% ( 51, 76 ] 54 0.007% 98.067% ( 76, 110 ] 3181 0.396% 98.463% ( 110, 170 ] 8031 0.999% 99.462% ( 170, 250 ] 1645 0.205% 99.667% ( 250, 380 ] 653 0.081% 99.748% ( 380, 580 ] 628 0.078% 99.826% ( 580, 870 ] 564 0.070% 99.896% ( 870, 1300 ] 456 0.057% 99.953% ( 1300, 1900 ] 243 0.030% 99.983% ( 1900, 2900 ] 211 0.026% 100.010% ( 2900, 4400 ] 224 0.028% 100.037% ( 4400, 6600 ] 59 0.007% 100.045% ( 6600, 9900 ] 22 0.003% 100.048% ( 9900, 14000 ] 16 0.002% 100.050% ( 14000, 22000 ] 10 0.001% 100.051% ( 22000, 33000 ] 20 0.002% 100.053% ( 33000, 50000 ] 3 0.000% 100.054% ** Level 2 read latency histogram (micros): Count: 68897 Average: 13.3319 StdDev: 257.82 Min: 1 Median: 1.9119 Max: 30576 Percentiles: P50: 1.91 P75: 3.11 P99: 153.52 P99.9: 2258.16 P99.99: 10126.12 ------------------------------------------------------ [ 0, 1 ] 3447 5.003% 5.003% # ( 1, 2 ] 33998 49.346% 54.349% ########## ( 2, 3 ] 13488 19.577% 73.926% #### ( 3, 4 ] 6873 9.976% 83.902% ## ( 4, 6 ] 7285 10.574% 94.476% ## ( 6, 10 ] 1981 2.875% 97.351% # ( 10, 15 ] 453 0.658% 98.009% ( 15, 22 ] 53 0.077% 98.086% ( 22, 34 ] 7 0.010% 98.096% ( 34, 51 ] 11 0.016% 98.112% ( 51, 76 ] 5 0.007% 98.119% ( 76, 110 ] 190 0.276% 98.395% ( 110, 170 ] 575 0.835% 99.229% ( 170, 250 ] 143 0.208% 99.437% ( 250, 380 ] 88 0.128% 99.565% ( 380, 580 ] 76 0.110% 99.675% ( 580, 870 ] 58 0.084% 99.759% ( 870, 1300 ] 57 0.083% 99.842% ( 1300, 1900 ] 29 0.042% 99.884% ( 1900, 2900 ] 31 0.045% 99.929% ( 2900, 4400 ] 37 0.054% 99.983% ( 4400, 6600 ] 5 0.007% 99.990% ( 9900, 14000 ] 2 0.003% 99.993% ( 14000, 22000 ] 1 0.001% 99.994% ( 22000, 33000 ] 4 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 1237250 Average: 10.2253 StdDev: 164.74 Min: 0 Median: 1.9318 Max: 41091 Percentiles: P50: 1.93 P75: 3.12 P99: 79.20 P99.9: 793.91 P99.99: 1254.08 ------------------------------------------------------ [ 0, 1 ] 46196 3.734% 3.734% # ( 1, 2 ] 614316 49.652% 53.385% ########## ( 2, 3 ] 251000 20.287% 73.672% #### ( 3, 4 ] 132565 10.714% 84.387% ## ( 4, 6 ] 143981 11.637% 96.024% ## ( 6, 10 ] 29376 2.374% 98.398% ( 10, 15 ] 6167 0.498% 98.897% ( 15, 22 ] 749 0.061% 98.957% ( 22, 34 ] 93 0.008% 98.965% ( 34, 51 ] 114 0.009% 98.974% ( 51, 76 ] 123 0.010% 98.984% ( 76, 110 ] 2097 0.169% 99.154% ( 110, 170 ] 5746 0.464% 99.618% ( 170, 250 ] 1330 0.107% 99.725% ( 250, 380 ] 648 0.052% 99.778% ( 380, 580 ] 797 0.064% 99.842% ( 580, 870 ] 969 0.078% 99.921% ( 870, 1300 ] 962 0.078% 99.998% ( 1300, 1900 ] 619 0.050% 100.048% ( 1900, 2900 ] 472 0.038% 100.086% ( 2900, 4400 ] 535 0.043% 100.130% ( 4400, 6600 ] 123 0.010% 100.140% ( 6600, 9900 ] 28 0.002% 100.142% ( 9900, 14000 ] 6 0.000% 100.142% ( 14000, 22000 ] 12 0.001% 100.143% ( 22000, 33000 ] 11 0.001% 100.144% ( 33000, 50000 ] 3 0.000% 100.145% ** Level 4 read latency histogram (micros): Count: 1294674 Average: 29.0169 StdDev: 261.32 Min: 0 Median: 2.0379 Max: 51505 Percentiles: P50: 2.04 P75: 3.66 P99: 357.72 P99.9: 2028.96 P99.99: 2924.38 ------------------------------------------------------ [ 0, 1 ] 42353 3.271% 3.271% # ( 1, 2 ] 595642 46.007% 49.278% ######### ( 2, 3 ] 246792 19.062% 68.341% #### ( 3, 4 ] 130239 10.060% 78.400% ## ( 4, 6 ] 139638 10.786% 89.186% ## ( 6, 10 ] 32461 2.507% 91.693% # ( 10, 15 ] 7320 0.565% 92.258% ( 15, 22 ] 768 0.059% 92.318% ( 22, 34 ] 102 0.008% 92.326% ( 34, 51 ] 116 0.009% 92.335% ( 51, 76 ] 186 0.014% 92.349% ( 76, 110 ] 19532 1.509% 93.858% ( 110, 170 ] 52692 4.070% 97.927% # ( 170, 250 ] 10875 0.840% 98.767% ( 250, 380 ] 3634 0.281% 99.048% ( 380, 580 ] 3430 0.265% 99.313% ( 580, 870 ] 3075 0.238% 99.551% ( 870, 1300 ] 2683 0.207% 99.758% ( 1300, 1900 ] 1672 0.129% 99.887% ( 1900, 2900 ] 1313 0.101% 99.988% ( 2900, 4400 ] 1325 0.102% 100.091% ( 4400, 6600 ] 415 0.032% 100.123% ( 6600, 9900 ] 83 0.006% 100.129% ( 9900, 14000 ] 27 0.002% 100.131% ( 14000, 22000 ] 47 0.004% 100.135% ( 22000, 33000 ] 21 0.002% 100.136% ( 33000, 50000 ] 3 0.000% 100.137% ( 50000, 75000 ] 1 0.000% 100.137% ** Level 5 read latency histogram (micros): Count: 643751 Average: 209.3744 StdDev: 492.49 Min: 73 Median: 139.9097 Max: 50578 Percentiles: P50: 139.91 P75: 166.22 P99: 1822.72 P99.9: 5678.52 P99.99: 16655.14 ------------------------------------------------------ ( 51, 76 ] 77 0.012% 0.012% ( 76, 110 ] 138809 21.563% 21.574% #### ( 110, 170 ] 367084 57.023% 78.597% ########### ( 170, 250 ] 73653 11.441% 90.038% ## ( 250, 380 ] 22033 3.423% 93.461% # ( 380, 580 ] 17455 2.711% 96.172% # ( 580, 870 ] 9384 1.458% 97.630% ( 870, 1300 ] 5893 0.915% 98.546% ( 1300, 1900 ] 3358 0.522% 99.067% ( 1900, 2900 ] 2253 0.350% 99.417% ( 2900, 4400 ] 2555 0.397% 99.814% ( 4400, 6600 ] 952 0.148% 99.962% ( 6600, 9900 ] 148 0.023% 99.985% ( 9900, 14000 ] 23 0.004% 99.989% ( 14000, 22000 ] 29 0.005% 99.993% ( 22000, 33000 ] 40 0.006% 99.999% ( 33000, 50000 ] 15 0.002% 100.002% ( 50000, 75000 ] 1 0.000% 100.002% ** DB Stats ** Uptime(secs): 49.5 total, 8.3 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 59.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:37.625 H:M:S, 76.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 118.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.505 H:M:S, 54.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-00:25:09 ... thread 0: (1000000,4000000) ops and (288027.7,75661.8) ops/second in (3.471888,52.866850) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/7 3.74 GB 169.9 4.6 0.0 4.6 8.4 3.7 0.0 2.2 131.7 238.6 35.85 29.14 70 0.512 4796K 12K 0.0 0.0 L1 14/14 1.62 GB 0.0 3.4 1.8 1.5 3.3 1.8 0.0 1.8 84.8 83.9 40.67 24.62 1 40.669 3502K 35K 0.0 0.0 L3 18/0 963.62 MB 1.0 3.5 1.8 1.6 3.5 1.8 0.6 1.9 114.6 113.7 31.22 17.95 20 1.561 1830K 4065 0.0 0.0 L4 173/0 9.68 GB 1.0 8.8 4.1 4.7 8.6 4.0 0.0 2.1 121.3 119.5 74.09 43.22 51 1.453 4206K 12K 0.0 0.0 L5 1136/0 93.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1357/21 109.55 GB 0.0 20.3 7.8 12.4 23.8 11.4 4.7 6.3 114.0 134.0 181.84 114.93 142 1.281 14M 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.3 7.8 12.4 23.8 11.4 4.7 6.3 114.0 134.0 181.84 114.93 142 1.281 14M 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.3 7.8 12.4 20.0 7.6 0.0 0.0 125.4 124.1 165.42 104.06 85 1.946 14M 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 234.0 16.42 10.87 57 0.288 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.0 total, 52.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.79 GB write, 459.66 MB/s write, 20.25 GB read, 391.20 MB/s read, 181.8 seconds Interval compaction: 23.79 GB write, 460.88 MB/s write, 20.25 GB read, 392.23 MB/s read, 181.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 48, pending-compaction-bytes-stops: 0, total-delays: 48, total-stops: 19, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2216059 Average: 17.2779 StdDev: 138.72 Min: 0 Median: 1.6873 Max: 46157 Percentiles: P50: 1.69 P75: 2.66 P99: 226.06 P99.9: 727.35 P99.99: 1235.56 ------------------------------------------------------ [ 0, 1 ] 348385 15.721% 15.721% ### ( 1, 2 ] 1105231 49.874% 65.595% ########## ( 2, 3 ] 313692 14.155% 79.750% ### ( 3, 4 ] 126128 5.692% 85.442% # ( 4, 6 ] 117298 5.293% 90.735% # ( 6, 10 ] 29777 1.344% 92.078% ( 10, 15 ] 6097 0.275% 92.353% ( 15, 22 ] 1105 0.050% 92.403% ( 22, 34 ] 139 0.006% 92.410% ( 34, 51 ] 75 0.003% 92.413% ( 51, 76 ] 134 0.006% 92.419% ( 76, 110 ] 35399 1.597% 94.016% ( 110, 170 ] 94757 4.276% 98.292% # ( 170, 250 ] 22380 1.010% 99.302% ( 250, 380 ] 6975 0.315% 99.617% ( 380, 580 ] 5147 0.232% 99.849% ( 580, 870 ] 2214 0.100% 99.949% ( 870, 1300 ] 1065 0.048% 99.997% ( 1300, 1900 ] 548 0.025% 100.022% ( 1900, 2900 ] 382 0.017% 100.039% ( 2900, 4400 ] 509 0.023% 100.062% ( 4400, 6600 ] 110 0.005% 100.067% ( 6600, 9900 ] 28 0.001% 100.068% ( 9900, 14000 ] 12 0.001% 100.069% ( 14000, 22000 ] 13 0.001% 100.070% ( 22000, 33000 ] 13 0.001% 100.070% ( 33000, 50000 ] 4 0.000% 100.070% ** Level 1 read latency histogram (micros): Count: 804878 Average: 11.5565 StdDev: 201.47 Min: 1 Median: 2.7948 Max: 46321 Percentiles: P50: 2.79 P75: 3.89 P99: 147.33 P99.9: 906.10 P99.99: 2153.61 ------------------------------------------------------ [ 0, 1 ] 17997 2.236% 2.236% ( 1, 2 ] 250603 31.136% 33.372% ###### ( 2, 3 ] 168387 20.921% 54.292% #### ( 3, 4 ] 186898 23.221% 77.513% ##### ( 4, 6 ] 132054 16.407% 93.920% ### ( 6, 10 ] 22829 2.836% 96.756% # ( 10, 15 ] 6229 0.774% 97.530% ( 15, 22 ] 2979 0.370% 97.900% ( 22, 34 ] 131 0.016% 97.916% ( 34, 51 ] 48 0.006% 97.922% ( 51, 76 ] 54 0.007% 97.929% ( 76, 110 ] 3323 0.413% 98.342% ( 110, 170 ] 8514 1.058% 99.400% ( 170, 250 ] 1884 0.234% 99.634% ( 250, 380 ] 781 0.097% 99.731% ( 380, 580 ] 718 0.089% 99.820% ( 580, 870 ] 605 0.075% 99.895% ( 870, 1300 ] 466 0.058% 99.953% ( 1300, 1900 ] 244 0.030% 99.983% ( 1900, 2900 ] 211 0.026% 100.010% ( 2900, 4400 ] 224 0.028% 100.037% ( 4400, 6600 ] 59 0.007% 100.045% ( 6600, 9900 ] 22 0.003% 100.047% ( 9900, 14000 ] 16 0.002% 100.049% ( 14000, 22000 ] 10 0.001% 100.051% ( 22000, 33000 ] 20 0.002% 100.053% ( 33000, 50000 ] 3 0.000% 100.054% ** Level 2 read latency histogram (micros): Count: 68897 Average: 13.3319 StdDev: 257.82 Min: 1 Median: 1.9119 Max: 30576 Percentiles: P50: 1.91 P75: 3.11 P99: 153.52 P99.9: 2258.16 P99.99: 10126.12 ------------------------------------------------------ [ 0, 1 ] 3447 5.003% 5.003% # ( 1, 2 ] 33998 49.346% 54.349% ########## ( 2, 3 ] 13488 19.577% 73.926% #### ( 3, 4 ] 6873 9.976% 83.902% ## ( 4, 6 ] 7285 10.574% 94.476% ## ( 6, 10 ] 1981 2.875% 97.351% # ( 10, 15 ] 453 0.658% 98.009% ( 15, 22 ] 53 0.077% 98.086% ( 22, 34 ] 7 0.010% 98.096% ( 34, 51 ] 11 0.016% 98.112% ( 51, 76 ] 5 0.007% 98.119% ( 76, 110 ] 190 0.276% 98.395% ( 110, 170 ] 575 0.835% 99.229% ( 170, 250 ] 143 0.208% 99.437% ( 250, 380 ] 88 0.128% 99.565% ( 380, 580 ] 76 0.110% 99.675% ( 580, 870 ] 58 0.084% 99.759% ( 870, 1300 ] 57 0.083% 99.842% ( 1300, 1900 ] 29 0.042% 99.884% ( 1900, 2900 ] 31 0.045% 99.929% ( 2900, 4400 ] 37 0.054% 99.983% ( 4400, 6600 ] 5 0.007% 99.990% ( 9900, 14000 ] 2 0.003% 99.993% ( 14000, 22000 ] 1 0.001% 99.994% ( 22000, 33000 ] 4 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 1237744 Average: 10.3074 StdDev: 164.79 Min: 0 Median: 1.9322 Max: 41091 Percentiles: P50: 1.93 P75: 3.13 P99: 86.58 P99.9: 796.40 P99.99: 1254.70 ------------------------------------------------------ [ 0, 1 ] 46196 3.732% 3.732% # ( 1, 2 ] 614316 49.632% 53.364% ########## ( 2, 3 ] 251007 20.279% 73.644% #### ( 3, 4 ] 132568 10.710% 84.354% ## ( 4, 6 ] 143986 11.633% 95.987% ## ( 6, 10 ] 29378 2.374% 98.360% ( 10, 15 ] 6167 0.498% 98.859% ( 15, 22 ] 749 0.061% 98.919% ( 22, 34 ] 93 0.008% 98.927% ( 34, 51 ] 114 0.009% 98.936% ( 51, 76 ] 123 0.010% 98.946% ( 76, 110 ] 2152 0.174% 99.120% ( 110, 170 ] 5944 0.480% 99.600% ( 170, 250 ] 1439 0.116% 99.716% ( 250, 380 ] 705 0.057% 99.773% ( 380, 580 ] 835 0.067% 99.841% ( 580, 870 ] 984 0.079% 99.920% ( 870, 1300 ] 966 0.078% 99.998% ( 1300, 1900 ] 620 0.050% 100.048% ( 1900, 2900 ] 472 0.038% 100.086% ( 2900, 4400 ] 535 0.043% 100.130% ( 4400, 6600 ] 123 0.010% 100.140% ( 6600, 9900 ] 28 0.002% 100.142% ( 9900, 14000 ] 6 0.000% 100.142% ( 14000, 22000 ] 12 0.001% 100.143% ( 22000, 33000 ] 11 0.001% 100.144% ( 33000, 50000 ] 3 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 1301638 Average: 29.8842 StdDev: 261.13 Min: 0 Median: 2.0515 Max: 51505 Percentiles: P50: 2.05 P75: 3.70 P99: 382.76 P99.9: 2024.32 P99.99: 2923.59 ------------------------------------------------------ [ 0, 1 ] 42353 3.254% 3.254% # ( 1, 2 ] 595734 45.768% 49.022% ######### ( 2, 3 ] 247124 18.986% 68.007% #### ( 3, 4 ] 130382 10.017% 78.024% ## ( 4, 6 ] 139801 10.740% 88.765% ## ( 6, 10 ] 32486 2.496% 91.260% ( 10, 15 ] 7331 0.563% 91.824% ( 15, 22 ] 769 0.059% 91.883% ( 22, 34 ] 102 0.008% 91.891% ( 34, 51 ] 116 0.009% 91.899% ( 51, 76 ] 186 0.014% 91.914% ( 76, 110 ] 20354 1.564% 93.477% ( 110, 170 ] 55311 4.249% 97.727% # ( 170, 250 ] 12240 0.940% 98.667% ( 250, 380 ] 4278 0.329% 98.996% ( 380, 580 ] 3964 0.305% 99.300% ( 580, 870 ] 3262 0.251% 99.551% ( 870, 1300 ] 2706 0.208% 99.759% ( 1300, 1900 ] 1674 0.129% 99.887% ( 1900, 2900 ] 1314 0.101% 99.988% ( 2900, 4400 ] 1325 0.102% 100.090% ( 4400, 6600 ] 415 0.032% 100.122% ( 6600, 9900 ] 83 0.006% 100.128% ( 9900, 14000 ] 27 0.002% 100.131% ( 14000, 22000 ] 47 0.004% 100.134% ( 22000, 33000 ] 21 0.002% 100.136% ( 33000, 50000 ] 3 0.000% 100.136% ( 50000, 75000 ] 1 0.000% 100.136% ** Level 5 read latency histogram (micros): Count: 685425 Average: 209.8674 StdDev: 478.90 Min: 73 Median: 140.9377 Max: 50578 Percentiles: P50: 140.94 P75: 167.65 P99: 1753.28 P99.9: 5572.97 P99.99: 14402.07 ------------------------------------------------------ ( 51, 76 ] 79 0.012% 0.012% ( 76, 110 ] 144180 21.035% 21.047% #### ( 110, 170 ] 384877 56.152% 77.198% ########### ( 170, 250 ] 82605 12.052% 89.250% ## ( 250, 380 ] 26461 3.861% 93.110% # ( 380, 580 ] 21028 3.068% 96.178% # ( 580, 870 ] 10654 1.554% 97.733% ( 870, 1300 ] 6131 0.894% 98.627% ( 1300, 1900 ] 3383 0.494% 99.121% ( 1900, 2900 ] 2276 0.332% 99.453% ( 2900, 4400 ] 2558 0.373% 99.826% ( 4400, 6600 ] 952 0.139% 99.965% ( 6600, 9900 ] 148 0.022% 99.986% ( 9900, 14000 ] 23 0.003% 99.990% ( 14000, 22000 ] 29 0.004% 99.994% ( 22000, 33000 ] 40 0.006% 100.000% ( 33000, 50000 ] 15 0.002% 100.002% ( 50000, 75000 ] 1 0.000% 100.002% ** DB Stats ** Uptime(secs): 53.0 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 74.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:37.625 H:M:S, 71.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 283.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 252.211 micros/op 15851 ops/sec 60.182 seconds 953996 operations; 15.4 MB/s (243999 of 243999 found) Microseconds per read: Count: 953996 Average: 252.2135 StdDev: 739.25 Min: 2 Median: 170.4074 Max: 71394 Percentiles: P50: 170.41 P75: 232.85 P99: 1338.27 P99.9: 11914.07 P99.99: 30640.25 ------------------------------------------------------ ( 1, 2 ] 5 0.001% 0.001% ( 2, 3 ] 39 0.004% 0.005% ( 3, 4 ] 72 0.008% 0.012% ( 4, 6 ] 95 0.010% 0.022% ( 6, 10 ] 202 0.021% 0.043% ( 10, 15 ] 2020 0.212% 0.255% ( 15, 22 ] 3115 0.327% 0.582% ( 22, 34 ] 5762 0.604% 1.186% ( 34, 51 ] 1804 0.189% 1.375% ( 51, 76 ] 218 0.023% 1.397% ( 76, 110 ] 23502 2.464% 3.861% ( 110, 170 ] 438608 45.976% 49.837% ######### ( 170, 250 ] 305549 32.028% 81.865% ###### ( 250, 380 ] 92167 9.661% 91.526% ## ( 380, 580 ] 43951 4.607% 96.133% # ( 580, 870 ] 18903 1.981% 98.115% ( 870, 1300 ] 8219 0.862% 98.976% ( 1300, 1900 ] 3528 0.370% 99.346% ( 1900, 2900 ] 2114 0.222% 99.568% ( 2900, 4400 ] 1975 0.207% 99.775% ( 4400, 6600 ] 728 0.076% 99.851% ( 6600, 9900 ] 242 0.025% 99.877% ( 9900, 14000 ] 456 0.048% 99.924% ( 14000, 22000 ] 486 0.051% 99.975% ( 22000, 33000 ] 179 0.019% 99.994% ( 33000, 50000 ] 50 0.005% 99.999% ( 50000, 75000 ] 7 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 11430004 rocksdb.bloom.filter.full.positive COUNT : 1064769 rocksdb.bloom.filter.full.true.positive COUNT : 953567 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 429 rocksdb.memtable.miss COUNT : 953567 rocksdb.l0.hit COUNT : 34271 rocksdb.l1.hit COUNT : 14571 rocksdb.l2andup.hit COUNT : 904725 rocksdb.compaction.key.drop.new COUNT : 241945 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4280935 rocksdb.number.keys.read COUNT : 953996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4417924920 rocksdb.bytes.read COUNT : 953996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1658 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 43651523 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 26324866368 rocksdb.compact.write.bytes COUNT : 26078200545 rocksdb.flush.write.bytes COUNT : 4359945253 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 35 rocksdb.number.superversion_acquires COUNT : 936 rocksdb.number.superversion_releases COUNT : 910 rocksdb.number.superversion_cleanups COUNT : 236 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 159 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4324624384 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1532928 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30135312211 rocksdb.non.last.level.read.count COUNT : 7144445 rocksdb.block.checksum.compute.count COUNT : 7453100 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 169.347684 P95 : 529.991757 P99 : 1336.963951 P100 : 71391.000000 COUNT : 953996 SUM : 239782080 rocksdb.db.write.micros P50 : 1.570943 P95 : 4.817936 P99 : 13.042515 P100 : 593152.000000 COUNT : 4280935 SUM : 54698988 rocksdb.compaction.times.micros P50 : 1355555.555556 P95 : 2866666.666667 P99 : 34920000.000000 P100 : 40669269.000000 COUNT : 88 SUM : 168345909 rocksdb.compaction.times.cpu_micros P50 : 881250.000000 P95 : 1872000.000000 P99 : 23320000.000000 P100 : 24616730.000000 COUNT : 88 SUM : 106939331 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 776.176471 P95 : 21733.333333 P99 : 81379.000000 P100 : 81379.000000 COUNT : 62 SUM : 309637 rocksdb.compaction.outfile.sync.micros P50 : 16962.962963 P95 : 153714.285714 P99 : 251733.333333 P100 : 353902.000000 COUNT : 296 SUM : 11282946 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 205.000000 P95 : 3800.000000 P99 : 5984.000000 P100 : 6223.000000 COUNT : 168 SUM : 139278 rocksdb.table.open.io.micros P50 : 8433.333333 P95 : 19766.929134 P99 : 21855.748031 P100 : 29679.000000 COUNT : 1658 SUM : 14362697 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.922301 P95 : 9.814275 P99 : 157.581080 P100 : 46326.000000 COUNT : 6378682 SUM : 85292968 rocksdb.read.block.get.micros P50 : 142.666156 P95 : 450.853292 P99 : 1296.625678 P100 : 51510.000000 COUNT : 1072885 SUM : 208227715 rocksdb.write.raw.block.micros P50 : 0.545437 P95 : 1.537201 P99 : 3.730359 P100 : 60793.000000 COUNT : 7375099 SUM : 20830586 rocksdb.numfiles.in.singlecompaction P50 : 2.982143 P95 : 5.411111 P99 : 17.000000 P100 : 17.000000 COUNT : 113 SUM : 402 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565589 P95 : 1230.744793 P99 : 2656.707672 P100 : 592998.000000 COUNT : 251452 SUM : 43672102 rocksdb.sst.read.micros P50 : 2.008398 P95 : 163.088048 P99 : 467.847112 P100 : 51505.000000 COUNT : 7144699 SUM : 273276426 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 953996 SUM : 953996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4280935 SUM : 4417924920 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 220612.244898 P95 : 780250.000000 P99 : 1067434.000000 P100 : 1067434.000000 COUNT : 62 SUM : 17462634 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 309 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0