[2024-07-24 06:08:31.701066] Starting SPDK v24.05.1-pre git sha1 241d0f3c9 / DPDK 23.11.0 initialization... [2024-07-24 06:08:31.701188] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1127995 ] Set seed to 1721794111698195 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-24 06:08:31.801608] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-24 06:08:31.842886] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-24 06:08:31.842935] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1127995' to capture a snapshot of events at runtime. [2024-07-24 06:08:31.842945] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-24 06:08:31.842956] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-24 06:08:31.842964] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1127995 for offline analysis/debug. [2024-07-24 06:08:31.843103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 24 06:08:36 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/24-06:08:44 ... thread 0: (1000000,1000000) ops and (123004.2,123004.2) ops/second in (8.129806,8.129806) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.74 GB 44.1 0.3 0.0 0.3 1.1 0.8 0.0 1.4 32.0 115.3 9.83 3.98 10 0.983 319K 334 0.0 0.0 L1 5/5 549.86 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/1 128.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 24/8 1.68 GB 1.0 2.1 1.3 0.8 2.0 1.3 0.1 1.6 99.9 99.0 21.12 9.84 11 1.920 1416K 0 0.0 0.0 L4 170/17 10.43 GB 1.0 4.1 2.8 1.3 4.1 2.8 0.3 1.4 101.1 100.3 41.49 20.50 32 1.296 1975K 0 0.0 0.0 L5 1104/0 91.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1312/37 105.68 GB 0.0 6.5 4.1 2.4 7.2 4.9 2.4 9.0 91.4 102.0 72.44 34.32 53 1.367 3712K 334 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 4.1 2.4 7.2 4.9 2.4 9.0 91.4 102.0 72.44 34.32 53 1.367 3712K 334 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 4.1 2.4 6.4 4.1 0.0 0.0 101.6 100.8 65.15 31.86 44 1.481 3712K 334 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 112.3 7.29 2.45 9 0.810 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.3 total, 8.1 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.21 GB write, 885.66 MB/s write, 6.46 GB read, 793.70 MB/s read, 72.4 seconds Interval compaction: 7.21 GB write, 908.42 MB/s write, 6.46 GB read, 814.09 MB/s read, 72.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 41, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 353134 Average: 11.5660 StdDev: 175.33 Min: 1 Median: 1.9805 Max: 30928 Percentiles: P50: 1.98 P75: 2.98 P99: 11.94 P99.9: 2051.60 P99.99: 4135.14 ------------------------------------------------------ [ 0, 1 ] 8839 2.503% 2.503% # ( 1, 2 ] 171073 48.444% 50.947% ########## ( 2, 3 ] 86349 24.452% 75.399% ##### ( 3, 4 ] 35125 9.947% 85.346% ## ( 4, 6 ] 38937 11.026% 96.372% ## ( 6, 10 ] 8428 2.387% 98.759% ( 10, 15 ] 2199 0.623% 99.382% ( 15, 22 ] 258 0.073% 99.455% ( 22, 34 ] 32 0.009% 99.464% ( 34, 51 ] 18 0.005% 99.469% ( 51, 76 ] 14 0.004% 99.473% ( 76, 110 ] 9 0.003% 99.475% ( 110, 170 ] 34 0.010% 99.485% ( 170, 250 ] 76 0.022% 99.506% ( 250, 380 ] 122 0.035% 99.541% ( 380, 580 ] 224 0.063% 99.604% ( 580, 870 ] 388 0.110% 99.714% ( 870, 1300 ] 373 0.106% 99.820% ( 1300, 1900 ] 254 0.072% 99.892% ( 1900, 2900 ] 197 0.056% 99.948% ( 2900, 4400 ] 183 0.052% 99.999% ( 4400, 6600 ] 76 0.022% 100.021% ( 6600, 9900 ] 13 0.004% 100.025% ( 9900, 14000 ] 5 0.001% 100.026% ( 14000, 22000 ] 6 0.002% 100.028% ( 22000, 33000 ] 2 0.001% 100.028% ** Level 1 read latency histogram (micros): Count: 42021 Average: 16.4729 StdDev: 189.36 Min: 1 Median: 1.9326 Max: 7701 Percentiles: P50: 1.93 P75: 2.96 P99: 18.58 P99.9: 3384.37 P99.99: 7126.61 ------------------------------------------------------ [ 0, 1 ] 1095 2.606% 2.606% # ( 1, 2 ] 21354 50.817% 53.423% ########## ( 2, 3 ] 9472 22.541% 75.964% ##### ( 3, 4 ] 4140 9.852% 85.817% ## ( 4, 6 ] 4219 10.040% 95.857% ## ( 6, 10 ] 1031 2.454% 98.310% ( 10, 15 ] 276 0.657% 98.967% ( 15, 22 ] 27 0.064% 99.031% ( 22, 34 ] 3 0.007% 99.039% ( 34, 51 ] 3 0.007% 99.046% ( 51, 76 ] 3 0.007% 99.053% ( 76, 110 ] 2 0.005% 99.058% ( 110, 170 ] 4 0.010% 99.067% ( 170, 250 ] 6 0.014% 99.081% ( 250, 380 ] 23 0.055% 99.136% ( 380, 580 ] 56 0.133% 99.269% ( 580, 870 ] 83 0.198% 99.467% ( 870, 1300 ] 90 0.214% 99.681% ( 1300, 1900 ] 52 0.124% 99.805% ( 1900, 2900 ] 29 0.069% 99.874% ( 2900, 4400 ] 34 0.081% 99.955% ( 4400, 6600 ] 14 0.033% 99.988% ( 6600, 9900 ] 5 0.012% 100.000% ** Level 2 read latency histogram (micros): Count: 291533 Average: 12.4921 StdDev: 162.29 Min: 1 Median: 2.0790 Max: 23544 Percentiles: P50: 2.08 P75: 3.17 P99: 13.00 P99.9: 1422.54 P99.99: 2136.96 ------------------------------------------------------ [ 0, 1 ] 6170 2.116% 2.116% ( 1, 2 ] 133813 45.900% 48.016% ######### ( 2, 3 ] 73241 25.123% 73.139% ##### ( 3, 4 ] 31148 10.684% 83.823% ## ( 4, 6 ] 33965 11.650% 95.474% ## ( 6, 10 ] 8797 3.017% 98.491% # ( 10, 15 ] 2470 0.847% 99.338% ( 15, 22 ] 362 0.124% 99.462% ( 22, 34 ] 68 0.023% 99.486% ( 34, 51 ] 20 0.007% 99.493% ( 51, 76 ] 17 0.006% 99.499% ( 76, 110 ] 20 0.007% 99.505% ( 110, 170 ] 46 0.016% 99.521% ( 170, 250 ] 83 0.028% 99.550% ( 250, 380 ] 144 0.049% 99.599% ( 380, 580 ] 221 0.076% 99.675% ( 580, 870 ] 291 0.100% 99.775% ( 870, 1300 ] 314 0.108% 99.882% ( 1300, 1900 ] 252 0.086% 99.969% ( 1900, 2900 ] 261 0.090% 100.058% ( 2900, 4400 ] 181 0.062% 100.120% ( 4400, 6600 ] 51 0.017% 100.138% ( 6600, 9900 ] 9 0.003% 100.141% ( 14000, 22000 ] 1 0.000% 100.141% ( 22000, 33000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 826563 Average: 14.1883 StdDev: 233.14 Min: 1 Median: 2.0580 Max: 35975 Percentiles: P50: 2.06 P75: 3.07 P99: 11.03 P99.9: 1158.19 P99.99: 1656.09 ------------------------------------------------------ [ 0, 1 ] 12494 1.512% 1.512% ( 1, 2 ] 388439 46.994% 48.506% ######### ( 2, 3 ] 212851 25.751% 74.257% ##### ( 3, 4 ] 87848 10.628% 84.885% ## ( 4, 6 ] 94691 11.456% 96.341% ## ( 6, 10 ] 20886 2.527% 98.868% # ( 10, 15 ] 5265 0.637% 99.505% ( 15, 22 ] 624 0.075% 99.581% ( 22, 34 ] 63 0.008% 99.588% ( 34, 51 ] 32 0.004% 99.592% ( 51, 76 ] 62 0.008% 99.600% ( 76, 110 ] 23 0.003% 99.603% ( 110, 170 ] 52 0.006% 99.609% ( 170, 250 ] 109 0.013% 99.622% ( 250, 380 ] 247 0.030% 99.652% ( 380, 580 ] 562 0.068% 99.720% ( 580, 870 ] 840 0.102% 99.822% ( 870, 1300 ] 969 0.117% 99.939% ( 1300, 1900 ] 715 0.087% 100.025% ( 1900, 2900 ] 655 0.079% 100.105% ( 2900, 4400 ] 569 0.069% 100.173% ( 4400, 6600 ] 176 0.021% 100.195% ( 6600, 9900 ] 61 0.007% 100.202% ( 9900, 14000 ] 19 0.002% 100.204% ( 14000, 22000 ] 37 0.004% 100.209% ( 22000, 33000 ] 10 0.001% 100.210% ( 33000, 50000 ] 2 0.000% 100.210% ** Level 4 read latency histogram (micros): Count: 410837 Average: 24.0017 StdDev: 303.04 Min: 1 Median: 2.0569 Max: 52843 Percentiles: P50: 2.06 P75: 3.12 P99: 396.71 P99.9: 2419.00 P99.99: 3068.56 ------------------------------------------------------ [ 0, 1 ] 5660 1.378% 1.378% ( 1, 2 ] 193874 47.190% 48.568% ######### ( 2, 3 ] 103419 25.173% 73.740% ##### ( 3, 4 ] 43017 10.471% 84.211% ## ( 4, 6 ] 46851 11.404% 95.615% ## ( 6, 10 ] 10512 2.559% 98.173% # ( 10, 15 ] 2430 0.591% 98.765% ( 15, 22 ] 261 0.064% 98.828% ( 22, 34 ] 34 0.008% 98.837% ( 34, 51 ] 20 0.005% 98.842% ( 51, 76 ] 45 0.011% 98.853% ( 76, 110 ] 13 0.003% 98.856% ( 110, 170 ] 63 0.015% 98.871% ( 170, 250 ] 170 0.041% 98.912% ( 250, 380 ] 310 0.075% 98.988% ( 380, 580 ] 618 0.150% 99.138% ( 580, 870 ] 1024 0.249% 99.388% ( 870, 1300 ] 1038 0.253% 99.640% ( 1300, 1900 ] 737 0.179% 99.820% ( 1900, 2900 ] 640 0.156% 99.975% ( 2900, 4400 ] 551 0.134% 100.110% ( 4400, 6600 ] 166 0.040% 100.150% ( 6600, 9900 ] 26 0.006% 100.156% ( 9900, 14000 ] 9 0.002% 100.158% ( 14000, 22000 ] 10 0.002% 100.161% ( 22000, 33000 ] 8 0.002% 100.163% ( 33000, 50000 ] 3 0.001% 100.164% ( 50000, 75000 ] 1 0.000% 100.164% ** Level 5 read latency histogram (micros): Count: 14381 Average: 1641.0403 StdDev: 2039.43 Min: 84 Median: 1066.2686 Max: 70660 Percentiles: P50: 1066.27 P75: 2145.94 P99: 6773.00 P99.9: 29557.79 P99.99: 57023.75 ------------------------------------------------------ ( 76, 110 ] 17 0.118% 0.118% ( 110, 170 ] 130 0.904% 1.022% ( 170, 250 ] 347 2.413% 3.435% ( 250, 380 ] 909 6.321% 9.756% # ( 380, 580 ] 1845 12.829% 22.585% ### ( 580, 870 ] 2748 19.109% 41.694% #### ( 870, 1300 ] 2617 18.198% 59.892% #### ( 1300, 1900 ] 1794 12.475% 72.366% ## ( 1900, 2900 ] 1540 10.709% 83.075% ## ( 2900, 4400 ] 1629 11.327% 94.402% ## ( 4400, 6600 ] 656 4.562% 98.964% # ( 6600, 9900 ] 99 0.688% 99.652% ( 9900, 14000 ] 14 0.097% 99.750% ( 14000, 22000 ] 12 0.083% 99.833% ( 22000, 33000 ] 14 0.097% 99.930% ( 33000, 50000 ] 8 0.056% 99.986% ( 50000, 75000 ] 2 0.014% 100.000% ** DB Stats ** Uptime(secs): 8.3 total, 8.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 118.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.076 H:M:S, 48.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 121.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.076 H:M:S, 50.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/07/24-06:08:48 ... thread 0: (1000000,2000000) ops and (240555.7,162775.7) ops/second in (4.157042,12.286848) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.84 GB 163.6 1.5 0.0 1.5 3.4 1.8 0.0 1.8 78.7 172.9 20.02 11.84 30 0.667 1599K 1842 0.0 0.0 L1 12/0 1.21 GB 123.7 1.5 0.9 0.5 1.5 0.9 0.0 1.6 126.1 125.6 11.97 7.09 1 11.970 1532K 5637 0.0 0.0 L2 3/1 215.45 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/1 1007.42 MB 1.0 2.2 1.4 0.8 2.2 1.4 0.2 1.6 101.5 100.6 22.65 10.72 12 1.888 1607K 155 0.0 0.0 L4 167/0 9.61 GB 1.0 5.7 3.5 2.2 5.7 3.4 0.4 1.6 110.8 109.7 53.09 28.15 37 1.435 2391K 0 0.0 0.0 L5 1124/0 92.83 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1333/6 106.69 GB 0.0 11.0 5.9 5.1 12.8 7.6 4.6 6.9 104.6 121.3 107.74 57.81 80 1.347 7130K 7634 0.0 0.0 Int 0/0 0.00 KB 0.0 11.0 5.9 5.1 12.8 7.6 4.6 6.9 104.6 121.3 107.74 57.81 80 1.347 7130K 7634 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.0 5.9 5.1 10.9 5.8 0.0 0.0 117.1 116.2 96.18 52.34 55 1.749 7130K 7634 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 163.6 11.56 5.46 25 0.462 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.3 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.76 GB write, 1045.64 MB/s write, 11.00 GB read, 901.51 MB/s read, 107.7 seconds Interval compaction: 12.76 GB write, 1063.43 MB/s write, 11.00 GB read, 916.84 MB/s read, 107.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 43, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 668078 Average: 10.3514 StdDev: 140.69 Min: 0 Median: 1.7893 Max: 30928 Percentiles: P50: 1.79 P75: 2.68 P99: 117.29 P99.9: 1435.91 P99.99: 3310.96 ------------------------------------------------------ [ 0, 1 ] 49903 7.470% 7.470% # ( 1, 2 ] 359976 53.882% 61.352% ########### ( 2, 3 ] 134072 20.068% 81.420% #### ( 3, 4 ] 50326 7.533% 88.953% ## ( 4, 6 ] 51715 7.741% 96.694% ## ( 6, 10 ] 11332 1.696% 98.390% ( 10, 15 ] 2837 0.425% 98.815% ( 15, 22 ] 325 0.049% 98.864% ( 22, 34 ] 39 0.006% 98.869% ( 34, 51 ] 20 0.003% 98.872% ( 51, 76 ] 21 0.003% 98.876% ( 76, 110 ] 605 0.091% 98.966% ( 110, 170 ] 1871 0.280% 99.246% ( 170, 250 ] 1256 0.188% 99.434% ( 250, 380 ] 849 0.127% 99.561% ( 380, 580 ] 850 0.127% 99.689% ( 580, 870 ] 744 0.111% 99.800% ( 870, 1300 ] 592 0.089% 99.888% ( 1300, 1900 ] 344 0.051% 99.940% ( 1900, 2900 ] 273 0.041% 99.981% ( 2900, 4400 ] 227 0.034% 100.015% ( 4400, 6600 ] 87 0.013% 100.028% ( 6600, 9900 ] 16 0.002% 100.030% ( 9900, 14000 ] 5 0.001% 100.031% ( 14000, 22000 ] 6 0.001% 100.032% ( 22000, 33000 ] 2 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 142913 Average: 8.5376 StdDev: 109.54 Min: 1 Median: 1.9025 Max: 7701 Percentiles: P50: 1.90 P75: 2.81 P99: 13.71 P99.9: 1408.24 P99.99: 5237.28 ------------------------------------------------------ [ 0, 1 ] 4205 2.942% 2.942% # ( 1, 2 ] 74521 52.144% 55.087% ########## ( 2, 3 ] 35214 24.640% 79.727% ##### ( 3, 4 ] 11524 8.064% 87.790% ## ( 4, 6 ] 12022 8.412% 96.203% ## ( 6, 10 ] 3389 2.371% 98.574% ( 10, 15 ] 821 0.574% 99.148% ( 15, 22 ] 157 0.110% 99.258% ( 22, 34 ] 14 0.010% 99.268% ( 34, 51 ] 6 0.004% 99.272% ( 51, 76 ] 3 0.002% 99.274% ( 76, 110 ] 63 0.044% 99.318% ( 110, 170 ] 172 0.120% 99.439% ( 170, 250 ] 122 0.085% 99.524% ( 250, 380 ] 115 0.080% 99.605% ( 380, 580 ] 146 0.102% 99.707% ( 580, 870 ] 144 0.101% 99.808% ( 870, 1300 ] 121 0.085% 99.892% ( 1300, 1900 ] 67 0.047% 99.939% ( 1900, 2900 ] 31 0.022% 99.961% ( 2900, 4400 ] 37 0.026% 99.987% ( 4400, 6600 ] 15 0.010% 99.997% ( 6600, 9900 ] 5 0.003% 100.001% ** Level 2 read latency histogram (micros): Count: 336160 Average: 11.7821 StdDev: 156.41 Min: 1 Median: 2.0706 Max: 23544 Percentiles: P50: 2.07 P75: 3.14 P99: 12.67 P99.9: 1421.90 P99.99: 2233.52 ------------------------------------------------------ [ 0, 1 ] 6715 1.998% 1.998% ( 1, 2 ] 155363 46.217% 48.215% ######### ( 2, 3 ] 85057 25.303% 73.517% ##### ( 3, 4 ] 35428 10.539% 84.056% ## ( 4, 6 ] 38794 11.540% 95.596% ## ( 6, 10 ] 9960 2.963% 98.559% # ( 10, 15 ] 2769 0.824% 99.383% ( 15, 22 ] 396 0.118% 99.501% ( 22, 34 ] 71 0.021% 99.522% ( 34, 51 ] 25 0.007% 99.529% ( 51, 76 ] 22 0.007% 99.536% ( 76, 110 ] 20 0.006% 99.542% ( 110, 170 ] 46 0.014% 99.556% ( 170, 250 ] 85 0.025% 99.581% ( 250, 380 ] 148 0.044% 99.625% ( 380, 580 ] 239 0.071% 99.696% ( 580, 870 ] 304 0.090% 99.786% ( 870, 1300 ] 328 0.098% 99.884% ( 1300, 1900 ] 265 0.079% 99.963% ( 1900, 2900 ] 274 0.082% 100.044% ( 2900, 4400 ] 199 0.059% 100.104% ( 4400, 6600 ] 55 0.016% 100.120% ( 6600, 9900 ] 11 0.003% 100.123% ( 14000, 22000 ] 1 0.000% 100.123% ( 22000, 33000 ] 1 0.000% 100.124% ** Level 3 read latency histogram (micros): Count: 953308 Average: 13.1839 StdDev: 218.80 Min: 1 Median: 2.0490 Max: 35975 Percentiles: P50: 2.05 P75: 3.05 P99: 11.21 P99.9: 1088.03 P99.99: 1588.77 ------------------------------------------------------ [ 0, 1 ] 14604 1.532% 1.532% ( 1, 2 ] 450059 47.210% 48.742% ######### ( 2, 3 ] 244943 25.694% 74.436% ##### ( 3, 4 ] 99921 10.482% 84.918% ## ( 4, 6 ] 108434 11.374% 96.292% ## ( 6, 10 ] 24351 2.554% 98.847% # ( 10, 15 ] 6034 0.633% 99.479% ( 15, 22 ] 733 0.077% 99.556% ( 22, 34 ] 75 0.008% 99.564% ( 34, 51 ] 48 0.005% 99.569% ( 51, 76 ] 78 0.008% 99.577% ( 76, 110 ] 70 0.007% 99.585% ( 110, 170 ] 261 0.027% 99.612% ( 170, 250 ] 239 0.025% 99.637% ( 250, 380 ] 354 0.037% 99.674% ( 380, 580 ] 702 0.074% 99.748% ( 580, 870 ] 932 0.098% 99.846% ( 870, 1300 ] 1019 0.107% 99.953% ( 1300, 1900 ] 739 0.078% 100.030% ( 1900, 2900 ] 678 0.071% 100.101% ( 2900, 4400 ] 586 0.061% 100.163% ( 4400, 6600 ] 181 0.019% 100.182% ( 6600, 9900 ] 61 0.006% 100.188% ( 9900, 14000 ] 19 0.002% 100.190% ( 14000, 22000 ] 37 0.004% 100.194% ( 22000, 33000 ] 10 0.001% 100.195% ( 33000, 50000 ] 2 0.000% 100.195% ** Level 4 read latency histogram (micros): Count: 591013 Average: 21.8530 StdDev: 263.28 Min: 1 Median: 2.0301 Max: 52843 Percentiles: P50: 2.03 P75: 3.07 P99: 372.36 P99.9: 2118.24 P99.99: 2821.82 ------------------------------------------------------ [ 0, 1 ] 8304 1.405% 1.405% ( 1, 2 ] 282738 47.840% 49.245% ########## ( 2, 3 ] 148083 25.056% 74.300% ##### ( 3, 4 ] 58677 9.928% 84.229% ## ( 4, 6 ] 64392 10.895% 95.124% ## ( 6, 10 ] 14973 2.533% 97.657% # ( 10, 15 ] 3396 0.575% 98.232% ( 15, 22 ] 355 0.060% 98.292% ( 22, 34 ] 41 0.007% 98.299% ( 34, 51 ] 29 0.005% 98.304% ( 51, 76 ] 53 0.009% 98.313% ( 76, 110 ] 403 0.068% 98.381% ( 110, 170 ] 1513 0.256% 98.637% ( 170, 250 ] 1215 0.206% 98.842% ( 250, 380 ] 989 0.167% 99.010% ( 380, 580 ] 1293 0.219% 99.229% ( 580, 870 ] 1548 0.262% 99.491% ( 870, 1300 ] 1371 0.232% 99.723% ( 1300, 1900 ] 884 0.150% 99.872% ( 1900, 2900 ] 756 0.128% 100.000% ( 2900, 4400 ] 619 0.105% 100.105% ( 4400, 6600 ] 183 0.031% 100.136% ( 6600, 9900 ] 27 0.005% 100.140% ( 9900, 14000 ] 9 0.002% 100.142% ( 14000, 22000 ] 10 0.002% 100.143% ( 22000, 33000 ] 8 0.001% 100.145% ( 33000, 50000 ] 3 0.001% 100.145% ( 50000, 75000 ] 1 0.000% 100.146% ** Level 5 read latency histogram (micros): Count: 47456 Average: 742.3712 StdDev: 1324.43 Min: 75 Median: 327.9446 Max: 70660 Percentiles: P50: 327.94 P75: 799.83 P99: 5582.35 P99.9: 9885.94 P99.99: 37790.60 ------------------------------------------------------ ( 51, 76 ] 1 0.002% 0.002% ( 76, 110 ] 2902 6.115% 6.117% # ( 110, 170 ] 10767 22.688% 28.806% ##### ( 170, 250 ] 6963 14.673% 43.478% ### ( 250, 380 ] 5162 10.877% 54.356% ## ( 380, 580 ] 5831 12.287% 66.643% ## ( 580, 870 ] 5232 11.025% 77.668% ## ( 870, 1300 ] 3881 8.178% 85.846% ## ( 1300, 1900 ] 2247 4.735% 90.581% # ( 1900, 2900 ] 1812 3.818% 94.399% # ( 2900, 4400 ] 1811 3.816% 98.215% # ( 4400, 6600 ] 693 1.460% 99.675% ( 6600, 9900 ] 107 0.225% 99.901% ( 9900, 14000 ] 14 0.030% 99.930% ( 14000, 22000 ] 12 0.025% 99.956% ( 22000, 33000 ] 14 0.030% 99.985% ( 33000, 50000 ] 8 0.017% 100.002% ( 50000, 75000 ] 2 0.004% 100.006% ** DB Stats ** Uptime(secs): 12.5 total, 4.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 157.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.597 H:M:S, 36.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 236.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.521 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/24-06:08:51 ... thread 0: (1000000,3000000) ops and (284907.8,189912.4) ops/second in (3.509907,15.796755) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.83 GB 264.3 2.5 0.0 2.5 5.3 2.8 0.0 1.9 95.8 203.2 26.96 18.33 50 0.539 2622K 2803 0.0 0.0 L1 12/0 1.21 GB 123.7 1.5 0.9 0.5 1.5 0.9 0.0 1.6 126.1 125.6 11.97 7.09 1 11.970 1532K 5637 0.0 0.0 L2 2/0 86.67 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 885.56 MB 0.9 2.4 1.5 0.9 2.4 1.5 0.2 1.5 104.9 104.1 23.45 11.43 13 1.804 1771K 466 0.0 0.0 L4 167/0 9.54 GB 1.0 6.2 3.7 2.5 6.2 3.7 0.5 1.7 115.0 113.7 55.51 30.36 40 1.388 2572K 111 0.0 0.0 L5 1128/0 93.14 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1338/4 107.66 GB 0.0 12.6 6.2 6.4 15.4 8.9 4.9 5.4 109.7 133.5 117.89 67.21 104 1.134 8498K 9017 0.0 0.0 Int 0/0 0.00 KB 0.0 12.6 6.2 6.4 15.4 8.9 4.9 5.4 109.7 133.5 117.89 67.21 104 1.134 8498K 9017 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.6 6.2 6.4 12.5 6.1 0.0 0.0 125.2 124.3 103.28 59.08 63 1.639 8498K 9017 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 198.4 14.60 8.13 41 0.356 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.0 total, 15.8 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.37 GB write, 982.99 MB/s write, 12.63 GB read, 808.09 MB/s read, 117.9 seconds Interval compaction: 15.37 GB write, 995.99 MB/s write, 12.63 GB read, 818.78 MB/s read, 117.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 43, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 925205 Average: 8.7389 StdDev: 120.69 Min: 0 Median: 1.6970 Max: 30928 Percentiles: P50: 1.70 P75: 2.46 P99: 110.75 P99.9: 1149.25 P99.99: 2869.02 ------------------------------------------------------ [ 0, 1 ] 101421 10.962% 10.962% ## ( 1, 2 ] 518226 56.012% 66.974% ########### ( 2, 3 ] 162756 17.591% 84.565% #### ( 3, 4 ] 58923 6.369% 90.934% # ( 4, 6 ] 57833 6.251% 97.185% # ( 6, 10 ] 12303 1.330% 98.515% ( 10, 15 ] 3155 0.341% 98.856% ( 15, 22 ] 376 0.041% 98.896% ( 22, 34 ] 43 0.005% 98.901% ( 34, 51 ] 24 0.003% 98.903% ( 51, 76 ] 23 0.002% 98.906% ( 76, 110 ] 833 0.090% 98.996% ( 110, 170 ] 2945 0.318% 99.314% ( 170, 250 ] 1894 0.205% 99.519% ( 250, 380 ] 1157 0.125% 99.644% ( 380, 580 ] 1122 0.121% 99.765% ( 580, 870 ] 849 0.092% 99.857% ( 870, 1300 ] 611 0.066% 99.923% ( 1300, 1900 ] 352 0.038% 99.961% ( 1900, 2900 ] 275 0.030% 99.991% ( 2900, 4400 ] 228 0.025% 100.016% ( 4400, 6600 ] 87 0.009% 100.025% ( 6600, 9900 ] 16 0.002% 100.027% ( 9900, 14000 ] 5 0.001% 100.027% ( 14000, 22000 ] 6 0.001% 100.028% ( 22000, 33000 ] 2 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 174018 Average: 8.6044 StdDev: 101.22 Min: 1 Median: 1.8575 Max: 7701 Percentiles: P50: 1.86 P75: 2.73 P99: 113.31 P99.9: 1242.38 P99.99: 4781.07 ------------------------------------------------------ [ 0, 1 ] 6485 3.727% 3.727% # ( 1, 2 ] 93901 53.961% 57.687% ########### ( 2, 3 ] 41414 23.799% 81.486% ##### ( 3, 4 ] 12454 7.157% 88.643% # ( 4, 6 ] 12861 7.391% 96.033% # ( 6, 10 ] 3872 2.225% 98.258% ( 10, 15 ] 903 0.519% 98.777% ( 15, 22 ] 162 0.093% 98.870% ( 22, 34 ] 15 0.009% 98.879% ( 34, 51 ] 6 0.003% 98.882% ( 51, 76 ] 3 0.002% 98.884% ( 76, 110 ] 171 0.098% 98.982% ( 110, 170 ] 558 0.321% 99.303% ( 170, 250 ] 302 0.174% 99.476% ( 250, 380 ] 213 0.122% 99.599% ( 380, 580 ] 239 0.137% 99.736% ( 580, 870 ] 175 0.101% 99.837% ( 870, 1300 ] 127 0.073% 99.910% ( 1300, 1900 ] 69 0.040% 99.949% ( 1900, 2900 ] 31 0.018% 99.967% ( 2900, 4400 ] 37 0.021% 99.989% ( 4400, 6600 ] 15 0.009% 99.997% ( 6600, 9900 ] 5 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 336160 Average: 11.7821 StdDev: 156.41 Min: 1 Median: 2.0706 Max: 23544 Percentiles: P50: 2.07 P75: 3.14 P99: 12.67 P99.9: 1421.90 P99.99: 2233.52 ------------------------------------------------------ [ 0, 1 ] 6715 1.998% 1.998% ( 1, 2 ] 155363 46.217% 48.215% ######### ( 2, 3 ] 85057 25.303% 73.517% ##### ( 3, 4 ] 35428 10.539% 84.056% ## ( 4, 6 ] 38794 11.540% 95.596% ## ( 6, 10 ] 9960 2.963% 98.559% # ( 10, 15 ] 2769 0.824% 99.383% ( 15, 22 ] 396 0.118% 99.501% ( 22, 34 ] 71 0.021% 99.522% ( 34, 51 ] 25 0.007% 99.529% ( 51, 76 ] 22 0.007% 99.536% ( 76, 110 ] 20 0.006% 99.542% ( 110, 170 ] 46 0.014% 99.556% ( 170, 250 ] 85 0.025% 99.581% ( 250, 380 ] 148 0.044% 99.625% ( 380, 580 ] 239 0.071% 99.696% ( 580, 870 ] 304 0.090% 99.786% ( 870, 1300 ] 328 0.098% 99.884% ( 1300, 1900 ] 265 0.079% 99.963% ( 1900, 2900 ] 274 0.082% 100.044% ( 2900, 4400 ] 199 0.059% 100.104% ( 4400, 6600 ] 55 0.016% 100.120% ( 6600, 9900 ] 11 0.003% 100.123% ( 14000, 22000 ] 1 0.000% 100.123% ( 22000, 33000 ] 1 0.000% 100.124% ** Level 3 read latency histogram (micros): Count: 1014883 Average: 12.7414 StdDev: 212.27 Min: 1 Median: 2.0097 Max: 35975 Percentiles: P50: 2.01 P75: 2.99 P99: 11.51 P99.9: 1059.50 P99.99: 1570.86 ------------------------------------------------------ [ 0, 1 ] 17389 1.713% 1.713% ( 1, 2 ] 487558 48.041% 49.754% ########## ( 2, 3 ] 257823 25.404% 75.158% ##### ( 3, 4 ] 103401 10.188% 85.347% ## ( 4, 6 ] 111327 10.969% 96.316% ## ( 6, 10 ] 25359 2.499% 98.815% ( 10, 15 ] 6220 0.613% 99.428% ( 15, 22 ] 764 0.075% 99.503% ( 22, 34 ] 79 0.008% 99.511% ( 34, 51 ] 48 0.005% 99.516% ( 51, 76 ] 79 0.008% 99.523% ( 76, 110 ] 161 0.016% 99.539% ( 110, 170 ] 589 0.058% 99.597% ( 170, 250 ] 409 0.040% 99.638% ( 250, 380 ] 452 0.045% 99.682% ( 380, 580 ] 787 0.078% 99.760% ( 580, 870 ] 967 0.095% 99.855% ( 870, 1300 ] 1035 0.102% 99.957% ( 1300, 1900 ] 741 0.073% 100.030% ( 1900, 2900 ] 678 0.067% 100.097% ( 2900, 4400 ] 587 0.058% 100.155% ( 4400, 6600 ] 181 0.018% 100.173% ( 6600, 9900 ] 61 0.006% 100.179% ( 9900, 14000 ] 19 0.002% 100.180% ( 14000, 22000 ] 37 0.004% 100.184% ( 22000, 33000 ] 10 0.001% 100.185% ( 33000, 50000 ] 2 0.000% 100.185% ** Level 4 read latency histogram (micros): Count: 664609 Average: 21.9404 StdDev: 249.89 Min: 1 Median: 1.9906 Max: 52843 Percentiles: P50: 1.99 P75: 3.01 P99: 386.77 P99.9: 1997.24 P99.99: 2779.14 ------------------------------------------------------ [ 0, 1 ] 11665 1.755% 1.755% ( 1, 2 ] 323668 48.701% 50.456% ########## ( 2, 3 ] 162206 24.406% 74.862% ##### ( 3, 4 ] 62381 9.386% 84.248% ## ( 4, 6 ] 67628 10.176% 94.424% ## ( 6, 10 ] 16299 2.452% 96.876% ( 10, 15 ] 3637 0.547% 97.423% ( 15, 22 ] 388 0.058% 97.482% ( 22, 34 ] 42 0.006% 97.488% ( 34, 51 ] 29 0.004% 97.492% ( 51, 76 ] 53 0.008% 97.500% ( 76, 110 ] 1304 0.196% 97.697% ( 110, 170 ] 4333 0.652% 98.349% ( 170, 250 ] 2554 0.384% 98.733% ( 250, 380 ] 1712 0.258% 98.990% ( 380, 580 ] 1887 0.284% 99.274% ( 580, 870 ] 1774 0.267% 99.541% ( 870, 1300 ] 1414 0.213% 99.754% ( 1300, 1900 ] 896 0.135% 99.889% ( 1900, 2900 ] 765 0.115% 100.004% ( 2900, 4400 ] 621 0.093% 100.097% ( 4400, 6600 ] 183 0.028% 100.125% ( 6600, 9900 ] 27 0.004% 100.129% ( 9900, 14000 ] 9 0.001% 100.130% ( 14000, 22000 ] 10 0.002% 100.132% ( 22000, 33000 ] 8 0.001% 100.133% ( 33000, 50000 ] 3 0.000% 100.133% ( 50000, 75000 ] 1 0.000% 100.134% ** Level 5 read latency histogram (micros): Count: 89245 Average: 500.7253 StdDev: 1007.48 Min: 74 Median: 210.2230 Max: 70660 Percentiles: P50: 210.22 P75: 485.54 P99: 4359.13 P99.9: 8473.75 P99.99: 28345.04 ------------------------------------------------------ ( 51, 76 ] 4 0.004% 0.004% ( 76, 110 ] 8496 9.520% 9.524% ## ( 110, 170 ] 28365 31.783% 41.308% ###### ( 170, 250 ] 15429 17.288% 58.596% ### ( 250, 380 ] 9587 10.742% 69.338% ## ( 380, 580 ] 9575 10.729% 80.067% ## ( 580, 870 ] 6718 7.528% 87.595% ## ( 870, 1300 ] 4231 4.741% 92.336% # ( 1300, 1900 ] 2326 2.606% 94.942% # ( 1900, 2900 ] 1856 2.080% 97.022% ( 2900, 4400 ] 1815 2.034% 99.055% ( 4400, 6600 ] 693 0.777% 99.832% ( 6600, 9900 ] 107 0.120% 99.952% ( 9900, 14000 ] 14 0.016% 99.968% ( 14000, 22000 ] 12 0.013% 99.981% ( 22000, 33000 ] 14 0.016% 99.997% ( 33000, 50000 ] 8 0.009% 100.006% ( 50000, 75000 ] 2 0.002% 100.008% ** DB Stats ** Uptime(secs): 16.0 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 184.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.597 H:M:S, 28.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 280.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/07/24-06:08:55 ... thread 0: (1000000,4000000) ops and (283685.1,207020.2) ops/second in (3.525035,19.321790) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/4 3.75 GB 358.7 3.5 0.0 3.5 7.3 3.7 0.0 1.9 106.9 221.1 33.61 24.54 69 0.487 3646K 3810 0.0 0.0 L1 12/0 1.21 GB 123.7 1.5 0.9 0.5 1.5 0.9 0.0 1.6 126.1 125.6 11.97 7.09 1 11.970 1532K 5637 0.0 0.0 L2 2/0 86.67 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 885.56 MB 0.9 2.4 1.5 0.9 2.4 1.5 0.2 1.5 104.9 104.1 23.45 11.43 13 1.804 1771K 466 0.0 0.0 L4 167/0 9.54 GB 1.0 6.2 3.7 2.5 6.2 3.7 0.5 1.7 115.0 113.7 55.51 30.36 40 1.388 2572K 111 0.0 0.0 L5 1128/0 93.14 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1341/4 108.58 GB 0.0 13.6 6.2 7.4 17.3 9.9 4.9 4.6 112.0 142.0 124.53 73.42 123 1.012 9522K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.6 6.2 7.4 17.3 9.9 4.9 4.6 112.0 142.0 124.53 73.42 123 1.012 9522K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.6 6.2 7.4 13.5 6.1 0.0 0.0 130.2 129.3 107.09 62.80 67 1.598 9522K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 220.3 17.44 10.62 56 0.312 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.5 total, 19.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.27 GB write, 905.52 MB/s write, 13.62 GB read, 713.86 MB/s read, 124.5 seconds Interval compaction: 17.27 GB write, 915.31 MB/s write, 13.62 GB read, 721.58 MB/s read, 124.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 43, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1195617 Average: 7.8619 StdDev: 107.29 Min: 0 Median: 1.6162 Max: 30928 Percentiles: P50: 1.62 P75: 2.22 P99: 119.05 P99.9: 929.41 P99.99: 2557.48 ------------------------------------------------------ [ 0, 1 ] 181618 15.190% 15.190% ### ( 1, 2 ] 675455 56.494% 71.685% ########### ( 2, 3 ] 181569 15.186% 86.871% ### ( 3, 4 ] 64790 5.419% 92.290% # ( 4, 6 ] 61256 5.123% 97.413% # ( 6, 10 ] 12969 1.085% 98.498% ( 10, 15 ] 3341 0.279% 98.777% ( 15, 22 ] 395 0.033% 98.810% ( 22, 34 ] 47 0.004% 98.814% ( 34, 51 ] 25 0.002% 98.816% ( 51, 76 ] 26 0.002% 98.819% ( 76, 110 ] 1447 0.121% 98.940% ( 110, 170 ] 4792 0.401% 99.340% ( 170, 250 ] 2806 0.235% 99.575% ( 250, 380 ] 1488 0.124% 99.699% ( 380, 580 ] 1396 0.117% 99.816% ( 580, 870 ] 916 0.077% 99.893% ( 870, 1300 ] 618 0.052% 99.945% ( 1300, 1900 ] 360 0.030% 99.975% ( 1900, 2900 ] 279 0.023% 99.998% ( 2900, 4400 ] 231 0.019% 100.017% ( 4400, 6600 ] 87 0.007% 100.025% ( 6600, 9900 ] 16 0.001% 100.026% ( 9900, 14000 ] 5 0.000% 100.026% ( 14000, 22000 ] 6 0.001% 100.027% ( 22000, 33000 ] 2 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 175436 Average: 9.8576 StdDev: 102.69 Min: 1 Median: 1.8649 Max: 7701 Percentiles: P50: 1.86 P75: 2.75 P99: 162.63 P99.9: 1245.63 P99.99: 4760.27 ------------------------------------------------------ [ 0, 1 ] 6485 3.697% 3.697% # ( 1, 2 ] 93921 53.536% 57.232% ########### ( 2, 3 ] 41471 23.639% 80.871% ##### ( 3, 4 ] 12497 7.123% 87.994% # ( 4, 6 ] 12899 7.353% 95.347% # ( 6, 10 ] 3877 2.210% 97.557% ( 10, 15 ] 905 0.516% 98.073% ( 15, 22 ] 162 0.092% 98.165% ( 22, 34 ] 15 0.009% 98.174% ( 34, 51 ] 6 0.003% 98.177% ( 51, 76 ] 3 0.002% 98.179% ( 76, 110 ] 424 0.242% 98.421% ( 110, 170 ] 1159 0.661% 99.081% ( 170, 250 ] 521 0.297% 99.378% ( 250, 380 ] 304 0.173% 99.551% ( 380, 580 ] 306 0.174% 99.726% ( 580, 870 ] 192 0.109% 99.835% ( 870, 1300 ] 130 0.074% 99.909% ( 1300, 1900 ] 70 0.040% 99.949% ( 1900, 2900 ] 31 0.018% 99.967% ( 2900, 4400 ] 38 0.022% 99.989% ( 4400, 6600 ] 15 0.009% 99.997% ( 6600, 9900 ] 5 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 336160 Average: 11.7821 StdDev: 156.41 Min: 1 Median: 2.0706 Max: 23544 Percentiles: P50: 2.07 P75: 3.14 P99: 12.67 P99.9: 1421.90 P99.99: 2233.52 ------------------------------------------------------ [ 0, 1 ] 6715 1.998% 1.998% ( 1, 2 ] 155363 46.217% 48.215% ######### ( 2, 3 ] 85057 25.303% 73.517% ##### ( 3, 4 ] 35428 10.539% 84.056% ## ( 4, 6 ] 38794 11.540% 95.596% ## ( 6, 10 ] 9960 2.963% 98.559% # ( 10, 15 ] 2769 0.824% 99.383% ( 15, 22 ] 396 0.118% 99.501% ( 22, 34 ] 71 0.021% 99.522% ( 34, 51 ] 25 0.007% 99.529% ( 51, 76 ] 22 0.007% 99.536% ( 76, 110 ] 20 0.006% 99.542% ( 110, 170 ] 46 0.014% 99.556% ( 170, 250 ] 85 0.025% 99.581% ( 250, 380 ] 148 0.044% 99.625% ( 380, 580 ] 239 0.071% 99.696% ( 580, 870 ] 304 0.090% 99.786% ( 870, 1300 ] 328 0.098% 99.884% ( 1300, 1900 ] 265 0.079% 99.963% ( 1900, 2900 ] 274 0.082% 100.044% ( 2900, 4400 ] 199 0.059% 100.104% ( 4400, 6600 ] 55 0.016% 100.120% ( 6600, 9900 ] 11 0.003% 100.123% ( 14000, 22000 ] 1 0.000% 100.123% ( 22000, 33000 ] 1 0.000% 100.124% ** Level 3 read latency histogram (micros): Count: 1015728 Average: 12.8765 StdDev: 212.28 Min: 1 Median: 2.0113 Max: 35975 Percentiles: P50: 2.01 P75: 3.00 P99: 12.12 P99.9: 1060.44 P99.99: 1572.04 ------------------------------------------------------ [ 0, 1 ] 17389 1.712% 1.712% ( 1, 2 ] 487565 48.002% 49.714% ########## ( 2, 3 ] 257853 25.386% 75.100% ##### ( 3, 4 ] 103416 10.181% 85.281% ## ( 4, 6 ] 111351 10.963% 96.244% ## ( 6, 10 ] 25362 2.497% 98.741% ( 10, 15 ] 6220 0.612% 99.353% ( 15, 22 ] 764 0.075% 99.428% ( 22, 34 ] 79 0.008% 99.436% ( 34, 51 ] 48 0.005% 99.441% ( 51, 76 ] 79 0.008% 99.448% ( 76, 110 ] 305 0.030% 99.479% ( 110, 170 ] 956 0.094% 99.573% ( 170, 250 ] 539 0.053% 99.626% ( 250, 380 ] 508 0.050% 99.676% ( 380, 580 ] 840 0.083% 99.758% ( 580, 870 ] 979 0.096% 99.855% ( 870, 1300 ] 1037 0.102% 99.957% ( 1300, 1900 ] 742 0.073% 100.030% ( 1900, 2900 ] 679 0.067% 100.097% ( 2900, 4400 ] 587 0.058% 100.155% ( 4400, 6600 ] 181 0.018% 100.172% ( 6600, 9900 ] 61 0.006% 100.178% ( 9900, 14000 ] 19 0.002% 100.180% ( 14000, 22000 ] 37 0.004% 100.184% ( 22000, 33000 ] 10 0.001% 100.185% ( 33000, 50000 ] 2 0.000% 100.185% ** Level 4 read latency histogram (micros): Count: 672557 Average: 23.7684 StdDev: 249.44 Min: 1 Median: 2.0055 Max: 52843 Percentiles: P50: 2.01 P75: 3.11 P99: 429.59 P99.9: 1992.78 P99.99: 2778.89 ------------------------------------------------------ [ 0, 1 ] 11665 1.734% 1.734% ( 1, 2 ] 323717 48.132% 49.867% ########## ( 2, 3 ] 162326 24.136% 74.002% ##### ( 3, 4 ] 62474 9.289% 83.291% ## ( 4, 6 ] 67721 10.069% 93.361% ## ( 6, 10 ] 16312 2.425% 95.786% ( 10, 15 ] 3637 0.541% 96.327% ( 15, 22 ] 388 0.058% 96.384% ( 22, 34 ] 42 0.006% 96.391% ( 34, 51 ] 29 0.004% 96.395% ( 51, 76 ] 53 0.008% 96.403% ( 76, 110 ] 2832 0.421% 96.824% ( 110, 170 ] 8006 1.190% 98.014% ( 170, 250 ] 3817 0.568% 98.582% ( 250, 380 ] 2233 0.332% 98.914% ( 380, 580 ] 2337 0.347% 99.261% ( 580, 870 ] 1893 0.281% 99.543% ( 870, 1300 ] 1431 0.213% 99.756% ( 1300, 1900 ] 900 0.134% 99.889% ( 1900, 2900 ] 770 0.114% 100.004% ( 2900, 4400 ] 622 0.092% 100.096% ( 4400, 6600 ] 183 0.027% 100.124% ( 6600, 9900 ] 27 0.004% 100.128% ( 9900, 14000 ] 9 0.001% 100.129% ( 14000, 22000 ] 10 0.001% 100.130% ( 22000, 33000 ] 8 0.001% 100.132% ( 33000, 50000 ] 3 0.000% 100.132% ( 50000, 75000 ] 1 0.000% 100.132% ** Level 5 read latency histogram (micros): Count: 137958 Average: 389.2283 StdDev: 828.24 Min: 72 Median: 168.7233 Max: 70660 Percentiles: P50: 168.72 P75: 346.43 P99: 3954.71 P99.9: 6848.02 P99.99: 21469.47 ------------------------------------------------------ ( 51, 76 ] 14 0.010% 0.010% ( 76, 110 ] 17863 12.948% 12.958% ### ( 110, 170 ] 52213 37.847% 50.805% ######## ( 170, 250 ] 23652 17.144% 67.950% ### ( 250, 380 ] 13112 9.504% 77.454% ## ( 380, 580 ] 12449 9.024% 86.478% ## ( 580, 870 ] 7430 5.386% 91.863% # ( 870, 1300 ] 4320 3.131% 94.995% # ( 1300, 1900 ] 2366 1.715% 96.710% ( 1900, 2900 ] 1879 1.362% 98.072% ( 2900, 4400 ] 1821 1.320% 99.392% ( 4400, 6600 ] 693 0.502% 99.894% ( 6600, 9900 ] 107 0.078% 99.972% ( 9900, 14000 ] 14 0.010% 99.982% ( 14000, 22000 ] 12 0.009% 99.991% ( 22000, 33000 ] 14 0.010% 100.001% ( 33000, 50000 ] 8 0.006% 100.007% ( 50000, 75000 ] 2 0.001% 100.008% ** DB Stats ** Uptime(secs): 19.5 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 201.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.683 H:M:S, 24.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 279.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.087 H:M:S, 2.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 228.805 micros/op 17459 ops/sec 60.196 seconds 1050996 operations; 16.9 MB/s (265999 of 265999 found) Microseconds per read: Count: 1050996 Average: 228.8064 StdDev: 726.40 Min: 2 Median: 169.6090 Max: 214810 Percentiles: P50: 169.61 P75: 227.71 P99: 974.32 P99.9: 10413.85 P99.99: 28951.73 ------------------------------------------------------ ( 1, 2 ] 2 0.000% 0.000% ( 2, 3 ] 21 0.002% 0.002% ( 3, 4 ] 55 0.005% 0.007% ( 4, 6 ] 107 0.010% 0.018% ( 6, 10 ] 278 0.026% 0.044% ( 10, 15 ] 2799 0.266% 0.310% ( 15, 22 ] 5564 0.529% 0.840% ( 22, 34 ] 10550 1.004% 1.844% ( 34, 51 ] 4489 0.427% 2.271% ( 51, 76 ] 497 0.047% 2.318% ( 76, 110 ] 17718 1.686% 4.004% ( 110, 170 ] 486589 46.298% 50.302% ######### ( 170, 250 ] 359824 34.236% 84.538% ####### ( 250, 380 ] 102422 9.745% 94.283% ## ( 380, 580 ] 35532 3.381% 97.664% # ( 580, 870 ] 12762 1.214% 98.878% ( 870, 1300 ] 5264 0.501% 99.379% ( 1300, 1900 ] 2218 0.211% 99.590% ( 1900, 2900 ] 1523 0.145% 99.735% ( 2900, 4400 ] 1100 0.105% 99.840% ( 4400, 6600 ] 372 0.035% 99.875% ( 6600, 9900 ] 210 0.020% 99.895% ( 9900, 14000 ] 391 0.037% 99.933% ( 14000, 22000 ] 511 0.049% 99.981% ( 22000, 33000 ] 147 0.014% 99.995% ( 33000, 50000 ] 37 0.004% 99.999% ( 50000, 75000 ] 10 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 19620195 rocksdb.bloom.filter.full.positive COUNT : 1242230 rocksdb.bloom.filter.full.true.positive COUNT : 1050587 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 409 rocksdb.memtable.miss COUNT : 1050587 rocksdb.l0.hit COUNT : 40451 rocksdb.l1.hit COUNT : 12326 rocksdb.l2andup.hit COUNT : 997810 rocksdb.compaction.key.drop.new COUNT : 143035 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4241281 rocksdb.number.keys.read COUNT : 1050996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4377001992 rocksdb.bytes.read COUNT : 1050996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1549 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 43639018 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16895346826 rocksdb.compact.write.bytes COUNT : 16752363795 rocksdb.flush.write.bytes COUNT : 4359940643 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 20 rocksdb.number.superversion_acquires COUNT : 855 rocksdb.number.superversion_releases COUNT : 830 rocksdb.number.superversion_cleanups COUNT : 215 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 206 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4324677632 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1584128 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 21878528217 rocksdb.non.last.level.read.count COUNT : 5144646 rocksdb.block.checksum.compute.count COUNT : 5349232 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 168.764941 P95 : 420.815378 P99 : 972.852525 P100 : 214808.000000 COUNT : 1050996 SUM : 239619628 rocksdb.db.write.micros P50 : 1.567600 P95 : 4.672308 P99 : 12.057778 P100 : 830701.000000 COUNT : 4241281 SUM : 54555655 rocksdb.compaction.times.micros P50 : 1282352.941176 P95 : 2766666.666667 P99 : 11144000.000000 P100 : 11969639.000000 COUNT : 68 SUM : 108062269 rocksdb.compaction.times.cpu_micros P50 : 899230.769231 P95 : 1732000.000000 P99 : 7092450.000000 P100 : 7092450.000000 COUNT : 68 SUM : 63768653 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 774.714286 P95 : 49830.000000 P99 : 197058.000000 P100 : 197058.000000 COUNT : 61 SUM : 694065 rocksdb.compaction.outfile.sync.micros P50 : 38884.615385 P95 : 236750.000000 P99 : 561766.666667 P100 : 764386.000000 COUNT : 213 SUM : 16261046 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 196.666667 P95 : 3858.333333 P99 : 4358.333333 P100 : 6292.000000 COUNT : 150 SUM : 148825 rocksdb.table.open.io.micros P50 : 9130.000000 P95 : 20143.362832 P99 : 27230.500000 P100 : 142018.000000 COUNT : 1549 SUM : 14825626 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.027485 P95 : 85.635655 P99 : 169.009572 P100 : 46001.000000 COUNT : 4093122 SUM : 71174926 rocksdb.read.block.get.micros P50 : 136.196492 P95 : 279.747443 P99 : 866.463183 P100 : 70735.000000 COUNT : 1254602 SUM : 201096892 rocksdb.write.raw.block.micros P50 : 0.537782 P95 : 1.419381 P99 : 4.223330 P100 : 79870.000000 COUNT : 5113919 SUM : 16187820 rocksdb.numfiles.in.singlecompaction P50 : 2.638889 P95 : 4.775000 P99 : 23.320000 P100 : 28.000000 COUNT : 89 SUM : 298 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.600478 P95 : 2221.721966 P99 : 2765.054116 P100 : 830512.000000 COUNT : 153111 SUM : 43655770 rocksdb.sst.read.micros P50 : 2.520345 P95 : 166.791122 P99 : 441.424071 P100 : 70660.000000 COUNT : 5144739 SUM : 258488838 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1050996 SUM : 1050996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4241281 SUM : 4377001992 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 219795.918367 P95 : 992600.000000 P99 : 1072980.000000 P100 : 1072980.000000 COUNT : 61 SUM : 18438000 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 208 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0