[2024-11-18 00:19:00.957681] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 22.11.4 initialization... [2024-11-18 00:19:00.957958] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid195025 ] Set seed to 1731885540950992 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 00:19:01.060484] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 00:19:01.083917] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 00:19:01.083963] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 195025' to capture a snapshot of events at runtime. [2024-11-18 00:19:01.083974] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-18 00:19:01.083984] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-18 00:19:01.083993] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid195025 for offline analysis/debug. [2024-11-18 00:19:01.084567] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 00:19:05 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-00:19:13 ... thread 0: (1000000,1000000) ops and (129907.7,129907.7) ops/second in (7.697771,7.697771) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 566.88 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 119.7 6.84 2.44 9 0.760 0 0 0.0 0.0 L1 1/1 79.59 MB 0.0 0.5 0.3 0.2 0.5 0.3 0.0 1.7 118.8 118.7 4.43 2.49 2 2.216 534K 513 0.0 0.0 L2 8/1 437.55 MB 3.1 0.4 0.3 0.1 0.4 0.3 0.0 1.2 139.4 139.4 2.66 1.65 4 0.666 376K 131 0.0 0.0 L3 48/8 4.04 GB 3.4 3.3 2.4 0.9 3.2 2.4 0.0 1.3 97.8 96.6 34.42 16.36 14 2.459 2047K 0 0.0 0.0 L4 198/14 12.01 GB 1.2 2.8 2.3 0.5 2.8 2.3 0.1 1.2 108.9 108.2 26.57 13.65 21 1.265 1847K 908 0.0 0.0 L5 1088/0 89.51 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1349/28 106.62 GB 0.0 7.0 5.3 1.7 7.7 6.1 0.1 9.7 95.6 105.7 74.92 36.59 50 1.498 4807K 1552 0.0 0.0 Int 0/0 0.00 KB 0.0 7.0 5.3 1.7 7.7 6.1 0.1 9.7 95.6 105.7 74.92 36.59 50 1.498 4807K 1552 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.0 5.3 1.7 6.9 5.3 0.0 0.0 105.2 104.3 68.09 34.15 41 1.661 4807K 1552 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 119.7 6.84 2.44 9 0.760 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.73 GB write, 1002.79 MB/s write, 6.99 GB read, 906.90 MB/s read, 74.9 seconds Interval compaction: 7.73 GB write, 1028.27 MB/s write, 6.99 GB read, 929.95 MB/s read, 74.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 29, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 177286 Average: 8.4508 StdDev: 122.86 Min: 1 Median: 1.8572 Max: 8265 Percentiles: P50: 1.86 P75: 2.84 P99: 9.46 P99.9: 1888.94 P99.99: 5309.85 ------------------------------------------------------ [ 0, 1 ] 6727 3.794% 3.794% # ( 1, 2 ] 95560 53.902% 57.696% ########### ( 2, 3 ] 36736 20.721% 78.417% #### ( 3, 4 ] 17216 9.711% 88.128% ## ( 4, 6 ] 16461 9.285% 97.413% ## ( 6, 10 ] 3252 1.834% 99.248% ( 10, 15 ] 645 0.364% 99.611% ( 15, 22 ] 73 0.041% 99.653% ( 22, 34 ] 9 0.005% 99.658% ( 34, 51 ] 4 0.002% 99.660% ( 51, 76 ] 5 0.003% 99.663% ( 76, 110 ] 1 0.001% 99.663% ( 110, 170 ] 3 0.002% 99.665% ( 170, 250 ] 9 0.005% 99.670% ( 250, 380 ] 27 0.015% 99.685% ( 380, 580 ] 47 0.027% 99.712% ( 580, 870 ] 89 0.050% 99.762% ( 870, 1300 ] 123 0.069% 99.831% ( 1300, 1900 ] 124 0.070% 99.901% ( 1900, 2900 ] 75 0.042% 99.944% ( 2900, 4400 ] 74 0.042% 99.985% ( 4400, 6600 ] 20 0.011% 99.997% ( 6600, 9900 ] 6 0.003% 100.000% ** Level 1 read latency histogram (micros): Count: 135673 Average: 8.2879 StdDev: 116.70 Min: 1 Median: 1.9704 Max: 8012 Percentiles: P50: 1.97 P75: 2.97 P99: 9.41 P99.9: 1679.04 P99.99: 3768.73 ------------------------------------------------------ [ 0, 1 ] 2183 1.609% 1.609% ( 1, 2 ] 67658 49.868% 51.477% ########## ( 2, 3 ] 32739 24.131% 75.608% ##### ( 3, 4 ] 15052 11.094% 86.703% ## ( 4, 6 ] 14549 10.724% 97.426% ## ( 6, 10 ] 2509 1.849% 99.275% ( 10, 15 ] 477 0.352% 99.627% ( 15, 22 ] 55 0.041% 99.668% ( 22, 34 ] 6 0.004% 99.672% ( 34, 51 ] 1 0.001% 99.673% ( 51, 76 ] 12 0.009% 99.682% ( 76, 110 ] 3 0.002% 99.684% ( 110, 170 ] 6 0.004% 99.688% ( 170, 250 ] 9 0.007% 99.695% ( 250, 380 ] 25 0.018% 99.713% ( 380, 580 ] 42 0.031% 99.744% ( 580, 870 ] 82 0.060% 99.805% ( 870, 1300 ] 88 0.065% 99.870% ( 1300, 1900 ] 67 0.049% 99.919% ( 1900, 2900 ] 65 0.048% 99.967% ( 2900, 4400 ] 56 0.041% 100.008% ( 4400, 6600 ] 13 0.010% 100.018% ( 6600, 9900 ] 2 0.001% 100.019% ** Level 2 read latency histogram (micros): Count: 535660 Average: 13.0103 StdDev: 186.84 Min: 1 Median: 1.9981 Max: 43209 Percentiles: P50: 2.00 P75: 3.07 P99: 12.02 P99.9: 1359.31 P99.99: 1866.77 ------------------------------------------------------ [ 0, 1 ] 12002 2.241% 2.241% ( 1, 2 ] 256307 47.849% 50.089% ########## ( 2, 3 ] 129138 24.108% 74.198% ##### ( 3, 4 ] 57748 10.781% 84.978% ## ( 4, 6 ] 57138 10.667% 95.645% ## ( 6, 10 ] 16624 3.103% 98.749% # ( 10, 15 ] 3325 0.621% 99.369% ( 15, 22 ] 507 0.095% 99.464% ( 22, 34 ] 81 0.015% 99.479% ( 34, 51 ] 35 0.007% 99.486% ( 51, 76 ] 42 0.008% 99.494% ( 76, 110 ] 27 0.005% 99.499% ( 110, 170 ] 51 0.010% 99.508% ( 170, 250 ] 94 0.018% 99.526% ( 250, 380 ] 204 0.038% 99.564% ( 380, 580 ] 403 0.075% 99.639% ( 580, 870 ] 609 0.114% 99.753% ( 870, 1300 ] 733 0.137% 99.889% ( 1300, 1900 ] 570 0.106% 99.996% ( 1900, 2900 ] 461 0.086% 100.082% ( 2900, 4400 ] 311 0.058% 100.140% ( 4400, 6600 ] 69 0.013% 100.153% ( 6600, 9900 ] 19 0.004% 100.156% ( 9900, 14000 ] 1 0.000% 100.157% ( 14000, 22000 ] 8 0.001% 100.158% ( 22000, 33000 ] 5 0.001% 100.159% ( 33000, 50000 ] 1 0.000% 100.159% ** Level 3 read latency histogram (micros): Count: 779765 Average: 13.2284 StdDev: 169.47 Min: 1 Median: 1.9962 Max: 21794 Percentiles: P50: 2.00 P75: 3.00 P99: 10.14 P99.9: 1247.25 P99.99: 1800.73 ------------------------------------------------------ [ 0, 1 ] 12738 1.634% 1.634% ( 1, 2 ] 378593 48.552% 50.186% ########## ( 2, 3 ] 194296 24.917% 75.103% ##### ( 3, 4 ] 83958 10.767% 85.870% ## ( 4, 6 ] 81857 10.498% 96.368% ## ( 6, 10 ] 20411 2.618% 98.985% # ( 10, 15 ] 4057 0.520% 99.506% ( 15, 22 ] 500 0.064% 99.570% ( 22, 34 ] 58 0.007% 99.577% ( 34, 51 ] 54 0.007% 99.584% ( 51, 76 ] 63 0.008% 99.592% ( 76, 110 ] 19 0.002% 99.595% ( 110, 170 ] 34 0.004% 99.599% ( 170, 250 ] 67 0.009% 99.608% ( 250, 380 ] 194 0.025% 99.632% ( 380, 580 ] 476 0.061% 99.693% ( 580, 870 ] 813 0.104% 99.798% ( 870, 1300 ] 911 0.117% 99.915% ( 1300, 1900 ] 707 0.091% 100.005% ( 1900, 2900 ] 641 0.082% 100.087% ( 2900, 4400 ] 677 0.087% 100.174% ( 4400, 6600 ] 171 0.022% 100.196% ( 6600, 9900 ] 25 0.003% 100.199% ( 9900, 14000 ] 2 0.000% 100.200% ( 14000, 22000 ] 3 0.000% 100.200% ** Level 4 read latency histogram (micros): Count: 184274 Average: 39.1166 StdDev: 337.81 Min: 1 Median: 2.0066 Max: 46346 Percentiles: P50: 2.01 P75: 3.03 P99: 1223.91 P99.9: 3879.44 P99.99: 4395.56 ------------------------------------------------------ [ 0, 1 ] 2896 1.572% 1.572% ( 1, 2 ] 88940 48.265% 49.837% ########## ( 2, 3 ] 45831 24.871% 74.708% ##### ( 3, 4 ] 19964 10.834% 85.542% ## ( 4, 6 ] 17649 9.578% 95.119% ## ( 6, 10 ] 4224 2.292% 97.411% ( 10, 15 ] 805 0.437% 97.848% ( 15, 22 ] 98 0.053% 97.901% ( 22, 34 ] 13 0.007% 97.909% ( 34, 51 ] 19 0.010% 97.919% ( 51, 76 ] 15 0.008% 97.927% ( 76, 110 ] 3 0.002% 97.929% ( 110, 170 ] 29 0.016% 97.944% ( 170, 250 ] 93 0.050% 97.995% ( 250, 380 ] 163 0.088% 98.083% ( 380, 580 ] 373 0.202% 98.286% ( 580, 870 ] 644 0.349% 98.635% ( 870, 1300 ] 818 0.444% 99.079% ( 1300, 1900 ] 676 0.367% 99.446% ( 1900, 2900 ] 523 0.284% 99.730% ( 2900, 4400 ] 482 0.262% 99.991% ( 4400, 6600 ] 164 0.089% 100.080% ( 6600, 9900 ] 17 0.009% 100.090% ( 14000, 22000 ] 2 0.001% 100.091% ( 22000, 33000 ] 1 0.001% 100.091% ( 33000, 50000 ] 1 0.001% 100.092% ** Level 5 read latency histogram (micros): Count: 12145 Average: 1850.2373 StdDev: 1675.79 Min: 96 Median: 1289.4383 Max: 51441 Percentiles: P50: 1289.44 P75: 2635.92 P99: 6582.37 P99.9: 13413.19 P99.99: 39676.75 ------------------------------------------------------ ( 76, 110 ] 3 0.025% 0.025% ( 110, 170 ] 54 0.445% 0.469% ( 170, 250 ] 116 0.955% 1.424% ( 250, 380 ] 425 3.499% 4.924% # ( 380, 580 ] 1170 9.634% 14.557% ## ( 580, 870 ] 2021 16.641% 31.198% ### ( 870, 1300 ] 2341 19.275% 50.473% #### ( 1300, 1900 ] 1816 14.953% 65.426% ### ( 1900, 2900 ] 1580 13.009% 78.436% ### ( 2900, 4400 ] 1823 15.010% 93.446% ### ( 4400, 6600 ] 680 5.599% 99.045% # ( 6600, 9900 ] 97 0.799% 99.844% ( 9900, 14000 ] 8 0.066% 99.909% ( 14000, 22000 ] 7 0.058% 99.967% ( 22000, 33000 ] 2 0.016% 99.984% ( 33000, 50000 ] 2 0.016% 100.000% ( 50000, 75000 ] 1 0.008% 100.008% ** DB Stats ** Uptime(secs): 7.9 total, 7.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 124.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.674 H:M:S, 46.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.674 H:M:S, 47.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/18-00:19:19 ... thread 0: (1000000,2000000) ops and (156892.8,142130.8) ops/second in (6.373777,14.071548) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/5 944.52 MB 31.5 0.7 0.0 0.7 2.5 1.8 0.0 1.4 41.5 151.0 16.68 8.07 24 0.695 703K 907 0.0 0.0 L1 7/7 628.01 MB 0.0 1.1 0.9 0.2 1.1 0.9 0.0 1.2 138.3 138.1 8.36 5.40 3 2.786 1173K 1755 0.0 0.0 L2 3/1 157.42 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.0 1.5 136.7 136.5 4.24 2.63 5 0.848 457K 131 0.0 0.0 L3 28/13 2.20 GB 0.9 4.9 2.7 2.1 4.8 2.7 0.0 1.8 106.9 105.7 46.86 24.05 19 2.466 2892K 806 0.0 0.0 L4 177/11 9.87 GB 1.0 6.2 4.0 2.1 6.1 4.0 0.5 1.5 117.8 116.2 53.73 29.64 40 1.343 3438K 1738 0.0 0.0 L5 1140/0 93.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1364/37 107.51 GB 0.0 13.4 8.1 5.3 15.1 9.7 4.8 8.5 106.0 118.9 129.87 69.79 91 1.427 8665K 5337 0.0 0.0 Int 0/0 0.00 KB 0.0 13.4 8.1 5.3 15.1 9.7 4.8 8.5 106.0 118.9 129.87 69.79 91 1.427 8665K 5337 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.4 8.1 5.3 13.3 8.0 0.0 0.0 118.1 116.8 116.62 64.54 69 1.690 8665K 5337 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 137.9 13.25 5.25 22 0.602 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.3 total, 14.1 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.08 GB write, 1082.51 MB/s write, 13.45 GB read, 965.02 MB/s read, 129.9 seconds Interval compaction: 15.08 GB write, 1097.56 MB/s write, 13.45 GB read, 978.43 MB/s read, 129.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 52, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 52, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 453896 Average: 8.1482 StdDev: 115.56 Min: 1 Median: 1.8757 Max: 11566 Percentiles: P50: 1.88 P75: 2.83 P99: 9.56 P99.9: 1577.76 P99.99: 3852.72 ------------------------------------------------------ [ 0, 1 ] 15617 3.441% 3.441% # ( 1, 2 ] 241326 53.168% 56.608% ########### ( 2, 3 ] 100039 22.040% 78.648% #### ( 3, 4 ] 42797 9.429% 88.077% ## ( 4, 6 ] 41745 9.197% 97.274% ## ( 6, 10 ] 8810 1.941% 99.215% ( 10, 15 ] 1665 0.367% 99.582% ( 15, 22 ] 169 0.037% 99.619% ( 22, 34 ] 16 0.004% 99.623% ( 34, 51 ] 16 0.004% 99.626% ( 51, 76 ] 21 0.005% 99.631% ( 76, 110 ] 6 0.001% 99.632% ( 110, 170 ] 34 0.007% 99.640% ( 170, 250 ] 90 0.020% 99.660% ( 250, 380 ] 128 0.028% 99.688% ( 380, 580 ] 238 0.052% 99.740% ( 580, 870 ] 302 0.067% 99.807% ( 870, 1300 ] 312 0.069% 99.876% ( 1300, 1900 ] 240 0.053% 99.928% ( 1900, 2900 ] 171 0.038% 99.966% ( 2900, 4400 ] 171 0.038% 100.004% ( 4400, 6600 ] 47 0.010% 100.014% ( 6600, 9900 ] 8 0.002% 100.016% ( 9900, 14000 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 186931 Average: 8.8461 StdDev: 127.61 Min: 1 Median: 1.9587 Max: 8012 Percentiles: P50: 1.96 P75: 2.95 P99: 9.59 P99.9: 1857.64 P99.99: 4124.84 ------------------------------------------------------ [ 0, 1 ] 3148 1.684% 1.684% ( 1, 2 ] 94207 50.397% 52.081% ########## ( 2, 3 ] 44986 24.066% 76.146% ##### ( 3, 4 ] 19878 10.634% 86.780% ## ( 4, 6 ] 19561 10.464% 97.244% ## ( 6, 10 ] 3653 1.954% 99.199% ( 10, 15 ] 732 0.392% 99.590% ( 15, 22 ] 73 0.039% 99.629% ( 22, 34 ] 8 0.004% 99.634% ( 34, 51 ] 4 0.002% 99.636% ( 51, 76 ] 17 0.009% 99.645% ( 76, 110 ] 4 0.002% 99.647% ( 110, 170 ] 9 0.005% 99.652% ( 170, 250 ] 22 0.012% 99.664% ( 250, 380 ] 37 0.020% 99.683% ( 380, 580 ] 77 0.041% 99.724% ( 580, 870 ] 124 0.066% 99.791% ( 870, 1300 ] 126 0.067% 99.858% ( 1300, 1900 ] 84 0.045% 99.903% ( 1900, 2900 ] 88 0.047% 99.950% ( 2900, 4400 ] 91 0.049% 99.999% ( 4400, 6600 ] 20 0.011% 100.010% ( 6600, 9900 ] 7 0.004% 100.013% ** Level 2 read latency histogram (micros): Count: 633660 Average: 12.8791 StdDev: 182.11 Min: 1 Median: 2.0001 Max: 43209 Percentiles: P50: 2.00 P75: 3.06 P99: 11.93 P99.9: 1466.06 P99.99: 2092.85 ------------------------------------------------------ [ 0, 1 ] 13293 2.098% 2.098% ( 1, 2 ] 303515 47.899% 49.997% ########## ( 2, 3 ] 154068 24.314% 74.311% ##### ( 3, 4 ] 68442 10.801% 85.112% ## ( 4, 6 ] 67795 10.699% 95.811% ## ( 6, 10 ] 18757 2.960% 98.771% # ( 10, 15 ] 3771 0.595% 99.366% ( 15, 22 ] 568 0.090% 99.455% ( 22, 34 ] 82 0.013% 99.468% ( 34, 51 ] 40 0.006% 99.475% ( 51, 76 ] 53 0.008% 99.483% ( 76, 110 ] 30 0.005% 99.488% ( 110, 170 ] 58 0.009% 99.497% ( 170, 250 ] 111 0.018% 99.514% ( 250, 380 ] 229 0.036% 99.551% ( 380, 580 ] 471 0.074% 99.625% ( 580, 870 ] 716 0.113% 99.738% ( 870, 1300 ] 848 0.134% 99.872% ( 1300, 1900 ] 648 0.102% 99.974% ( 1900, 2900 ] 527 0.083% 100.057% ( 2900, 4400 ] 385 0.061% 100.118% ( 4400, 6600 ] 88 0.014% 100.132% ( 6600, 9900 ] 20 0.003% 100.135% ( 9900, 14000 ] 1 0.000% 100.135% ( 14000, 22000 ] 8 0.001% 100.136% ( 22000, 33000 ] 5 0.001% 100.137% ( 33000, 50000 ] 1 0.000% 100.137% ** Level 3 read latency histogram (micros): Count: 1724823 Average: 11.9642 StdDev: 158.82 Min: 1 Median: 1.9941 Max: 21794 Percentiles: P50: 1.99 P75: 2.98 P99: 9.91 P99.9: 1030.64 P99.99: 1532.34 ------------------------------------------------------ [ 0, 1 ] 23151 1.342% 1.342% ( 1, 2 ] 844278 48.949% 50.291% ########## ( 2, 3 ] 436326 25.297% 75.588% ##### ( 3, 4 ] 180733 10.478% 86.066% ## ( 4, 6 ] 179411 10.402% 96.468% ## ( 6, 10 ] 44701 2.592% 99.059% # ( 10, 15 ] 8823 0.512% 99.571% ( 15, 22 ] 1046 0.061% 99.632% ( 22, 34 ] 83 0.005% 99.636% ( 34, 51 ] 118 0.007% 99.643% ( 51, 76 ] 187 0.011% 99.654% ( 76, 110 ] 49 0.003% 99.657% ( 110, 170 ] 92 0.005% 99.662% ( 170, 250 ] 191 0.011% 99.673% ( 250, 380 ] 479 0.028% 99.701% ( 380, 580 ] 1084 0.063% 99.764% ( 580, 870 ] 1705 0.099% 99.863% ( 870, 1300 ] 1719 0.100% 99.962% ( 1300, 1900 ] 1228 0.071% 100.034% ( 1900, 2900 ] 1186 0.069% 100.102% ( 2900, 4400 ] 1328 0.077% 100.179% ( 4400, 6600 ] 362 0.021% 100.200% ( 6600, 9900 ] 50 0.003% 100.203% ( 9900, 14000 ] 3 0.000% 100.203% ( 14000, 22000 ] 5 0.000% 100.204% ** Level 4 read latency histogram (micros): Count: 605656 Average: 25.7449 StdDev: 254.27 Min: 1 Median: 1.9816 Max: 46346 Percentiles: P50: 1.98 P75: 2.99 P99: 625.79 P99.9: 3082.42 P99.99: 3895.18 ------------------------------------------------------ [ 0, 1 ] 10117 1.670% 1.670% ( 1, 2 ] 298211 49.238% 50.908% ########## ( 2, 3 ] 147695 24.386% 75.294% ##### ( 3, 4 ] 62716 10.355% 85.649% ## ( 4, 6 ] 59346 9.799% 95.448% ## ( 6, 10 ] 15361 2.536% 97.984% # ( 10, 15 ] 2923 0.483% 98.467% ( 15, 22 ] 359 0.059% 98.526% ( 22, 34 ] 31 0.005% 98.531% ( 34, 51 ] 48 0.008% 98.539% ( 51, 76 ] 64 0.011% 98.550% ( 76, 110 ] 22 0.004% 98.553% ( 110, 170 ] 165 0.027% 98.580% ( 170, 250 ] 399 0.066% 98.646% ( 250, 380 ] 705 0.116% 98.763% ( 380, 580 ] 1176 0.194% 98.957% ( 580, 870 ] 1662 0.274% 99.231% ( 870, 1300 ] 1669 0.276% 99.507% ( 1300, 1900 ] 1246 0.206% 99.713% ( 1900, 2900 ] 1014 0.167% 99.880% ( 2900, 4400 ] 1006 0.166% 100.046% ( 4400, 6600 ] 320 0.053% 100.099% ( 6600, 9900 ] 42 0.007% 100.106% ( 9900, 14000 ] 1 0.000% 100.106% ( 14000, 22000 ] 2 0.000% 100.106% ( 22000, 33000 ] 1 0.000% 100.106% ( 33000, 50000 ] 1 0.000% 100.107% ** Level 5 read latency histogram (micros): Count: 28639 Average: 1471.9445 StdDev: 1444.31 Min: 86 Median: 989.8676 Max: 51441 Percentiles: P50: 989.87 P75: 1882.60 P99: 6362.66 P99.9: 9821.00 P99.99: 28248.55 ------------------------------------------------------ ( 76, 110 ] 71 0.248% 0.248% ( 110, 170 ] 526 1.837% 2.085% ( 170, 250 ] 1022 3.569% 5.653% # ( 250, 380 ] 1976 6.900% 12.553% # ( 380, 580 ] 3769 13.160% 25.713% ### ( 580, 870 ] 5492 19.177% 44.890% #### ( 870, 1300 ] 5250 18.332% 63.221% #### ( 1300, 1900 ] 3474 12.130% 75.352% ## ( 1900, 2900 ] 2792 9.749% 85.101% ## ( 2900, 4400 ] 3076 10.741% 95.841% ## ( 4400, 6600 ] 1014 3.541% 99.382% # ( 6600, 9900 ] 152 0.531% 99.913% ( 9900, 14000 ] 10 0.035% 99.948% ( 14000, 22000 ] 11 0.038% 99.986% ( 22000, 33000 ] 2 0.007% 99.993% ( 33000, 50000 ] 2 0.007% 100.000% ( 50000, 75000 ] 1 0.003% 100.003% ** DB Stats ** Uptime(secs): 14.3 total, 6.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 137.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.156 H:M:S, 43.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 154.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.482 H:M:S, 38.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/11/18-00:19:24 ... thread 0: (1000000,3000000) ops and (209438.1,159183.0) ops/second in (4.774681,18.846229) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 1.91 GB 107.0 1.5 0.0 1.5 4.3 2.8 0.0 1.6 62.6 175.2 25.15 14.52 41 0.613 1599K 1931 0.0 0.0 L1 7/7 628.01 MB 0.0 1.1 0.9 0.2 1.1 0.9 0.0 1.2 138.3 138.1 8.36 5.40 3 2.786 1173K 1755 0.0 0.0 L2 2/0 95.45 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.0 1.5 136.7 136.5 4.24 2.63 5 0.848 457K 131 0.0 0.0 L3 15/0 988.47 MB 1.0 5.7 2.8 2.9 5.6 2.7 0.0 2.0 110.3 109.1 53.02 27.95 20 2.651 2955K 806 0.0 0.0 L4 179/0 9.75 GB 1.0 8.8 5.3 3.5 8.7 5.2 0.5 1.6 120.6 118.6 74.80 42.20 58 1.290 4877K 1738 0.0 0.0 L5 1156/0 95.11 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1373/16 108.43 GB 0.0 17.8 9.5 8.3 20.3 12.0 6.1 7.3 109.8 125.6 165.56 92.70 127 1.304 11M 6361 0.0 0.0 Int 0/0 0.00 KB 0.0 17.8 9.5 8.3 20.3 12.0 6.1 7.3 109.8 125.6 165.56 92.70 127 1.304 11M 6361 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.8 9.5 8.3 17.5 9.2 0.0 0.0 123.2 121.7 147.56 84.49 91 1.622 11M 6361 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 157.5 18.00 8.21 36 0.500 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.0 total, 18.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.31 GB write, 1091.91 MB/s write, 17.75 GB read, 954.54 MB/s read, 165.6 seconds Interval compaction: 20.31 GB write, 1103.25 MB/s write, 17.75 GB read, 964.45 MB/s read, 165.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 65, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 65, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 751963 Average: 10.0178 StdDev: 111.67 Min: 1 Median: 1.7773 Max: 11566 Percentiles: P50: 1.78 P75: 2.67 P99: 152.80 P99.9: 1257.99 P99.99: 2940.18 ------------------------------------------------------ [ 0, 1 ] 58280 7.750% 7.750% ## ( 1, 2 ] 408710 54.352% 62.103% ########### ( 2, 3 ] 144627 19.233% 81.336% #### ( 3, 4 ] 60388 8.031% 89.367% ## ( 4, 6 ] 55139 7.333% 96.699% # ( 6, 10 ] 11448 1.522% 98.222% ( 10, 15 ] 2205 0.293% 98.515% ( 15, 22 ] 244 0.032% 98.548% ( 22, 34 ] 34 0.005% 98.552% ( 34, 51 ] 25 0.003% 98.555% ( 51, 76 ] 30 0.004% 98.559% ( 76, 110 ] 779 0.104% 98.663% ( 110, 170 ] 3553 0.472% 99.135% ( 170, 250 ] 2067 0.275% 99.410% ( 250, 380 ] 1114 0.148% 99.558% ( 380, 580 ] 1214 0.161% 99.720% ( 580, 870 ] 828 0.110% 99.830% ( 870, 1300 ] 583 0.078% 99.908% ( 1300, 1900 ] 360 0.048% 99.955% ( 1900, 2900 ] 253 0.034% 99.989% ( 2900, 4400 ] 254 0.034% 100.023% ( 4400, 6600 ] 63 0.008% 100.031% ( 6600, 9900 ] 11 0.001% 100.033% ( 9900, 14000 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 237412 Average: 9.8505 StdDev: 134.49 Min: 1 Median: 1.9938 Max: 9189 Percentiles: P50: 1.99 P75: 3.09 P99: 11.73 P99.9: 1969.61 P99.99: 4351.62 ------------------------------------------------------ [ 0, 1 ] 4017 1.692% 1.692% ( 1, 2 ] 115406 48.610% 50.302% ########## ( 2, 3 ] 56370 23.744% 74.046% ##### ( 3, 4 ] 26193 11.033% 85.078% ## ( 4, 6 ] 27038 11.389% 96.467% ## ( 6, 10 ] 5636 2.374% 98.841% ( 10, 15 ] 1092 0.460% 99.301% ( 15, 22 ] 212 0.089% 99.390% ( 22, 34 ] 19 0.008% 99.398% ( 34, 51 ] 5 0.002% 99.400% ( 51, 76 ] 20 0.008% 99.409% ( 76, 110 ] 43 0.018% 99.427% ( 110, 170 ] 212 0.089% 99.516% ( 170, 250 ] 123 0.052% 99.568% ( 250, 380 ] 112 0.047% 99.615% ( 380, 580 ] 173 0.073% 99.688% ( 580, 870 ] 208 0.088% 99.775% ( 870, 1300 ] 176 0.074% 99.850% ( 1300, 1900 ] 112 0.047% 99.897% ( 1900, 2900 ] 109 0.046% 99.943% ( 2900, 4400 ] 116 0.049% 99.992% ( 4400, 6600 ] 35 0.015% 100.006% ( 6600, 9900 ] 10 0.004% 100.011% ** Level 2 read latency histogram (micros): Count: 635923 Average: 12.9324 StdDev: 182.07 Min: 1 Median: 2.0003 Max: 43209 Percentiles: P50: 2.00 P75: 3.06 P99: 12.12 P99.9: 1468.07 P99.99: 2097.74 ------------------------------------------------------ [ 0, 1 ] 13340 2.098% 2.098% ( 1, 2 ] 304570 47.894% 49.992% ########## ( 2, 3 ] 154648 24.319% 74.311% ##### ( 3, 4 ] 68629 10.792% 85.103% ## ( 4, 6 ] 67964 10.687% 95.790% ## ( 6, 10 ] 18809 2.958% 98.748% # ( 10, 15 ] 3780 0.594% 99.342% ( 15, 22 ] 570 0.090% 99.432% ( 22, 34 ] 82 0.013% 99.445% ( 34, 51 ] 40 0.006% 99.451% ( 51, 76 ] 53 0.008% 99.459% ( 76, 110 ] 47 0.007% 99.467% ( 110, 170 ] 127 0.020% 99.487% ( 170, 250 ] 136 0.021% 99.508% ( 250, 380 ] 241 0.038% 99.546% ( 380, 580 ] 484 0.076% 99.622% ( 580, 870 ] 730 0.115% 99.737% ( 870, 1300 ] 855 0.134% 99.871% ( 1300, 1900 ] 650 0.102% 99.974% ( 1900, 2900 ] 528 0.083% 100.057% ( 2900, 4400 ] 386 0.061% 100.117% ( 4400, 6600 ] 89 0.014% 100.131% ( 6600, 9900 ] 20 0.003% 100.134% ( 9900, 14000 ] 1 0.000% 100.135% ( 14000, 22000 ] 8 0.001% 100.136% ( 22000, 33000 ] 5 0.001% 100.137% ( 33000, 50000 ] 1 0.000% 100.137% ** Level 3 read latency histogram (micros): Count: 2051472 Average: 11.3552 StdDev: 153.10 Min: 1 Median: 1.9868 Max: 21794 Percentiles: P50: 1.99 P75: 2.97 P99: 9.88 P99.9: 943.39 P99.99: 1413.69 ------------------------------------------------------ [ 0, 1 ] 28884 1.408% 1.408% ( 1, 2 ] 1010155 49.240% 50.648% ########## ( 2, 3 ] 516042 25.155% 75.803% ##### ( 3, 4 ] 212852 10.376% 86.179% ## ( 4, 6 ] 211860 10.327% 96.506% ## ( 6, 10 ] 52719 2.570% 99.076% # ( 10, 15 ] 10155 0.495% 99.571% ( 15, 22 ] 1233 0.060% 99.631% ( 22, 34 ] 95 0.005% 99.636% ( 34, 51 ] 143 0.007% 99.643% ( 51, 76 ] 224 0.011% 99.653% ( 76, 110 ] 109 0.005% 99.659% ( 110, 170 ] 321 0.016% 99.674% ( 170, 250 ] 382 0.019% 99.693% ( 250, 380 ] 653 0.032% 99.725% ( 380, 580 ] 1314 0.064% 99.789% ( 580, 870 ] 1952 0.095% 99.884% ( 870, 1300 ] 1919 0.094% 99.978% ( 1300, 1900 ] 1345 0.066% 100.043% ( 1900, 2900 ] 1263 0.062% 100.105% ( 2900, 4400 ] 1436 0.070% 100.175% ( 4400, 6600 ] 405 0.020% 100.194% ( 6600, 9900 ] 62 0.003% 100.197% ( 9900, 14000 ] 5 0.000% 100.198% ( 14000, 22000 ] 5 0.000% 100.198% ** Level 4 read latency histogram (micros): Count: 911604 Average: 22.8988 StdDev: 230.37 Min: 0 Median: 1.9654 Max: 46346 Percentiles: P50: 1.97 P75: 2.98 P99: 460.37 P99.9: 2646.82 P99.99: 3534.37 ------------------------------------------------------ [ 0, 1 ] 16844 1.848% 1.848% ( 1, 2 ] 454678 49.877% 51.724% ########## ( 2, 3 ] 217601 23.870% 75.595% ##### ( 3, 4 ] 92159 10.110% 85.704% ## ( 4, 6 ] 87202 9.566% 95.270% ## ( 6, 10 ] 23336 2.560% 97.830% # ( 10, 15 ] 4061 0.445% 98.275% ( 15, 22 ] 513 0.056% 98.332% ( 22, 34 ] 47 0.005% 98.337% ( 34, 51 ] 74 0.008% 98.345% ( 51, 76 ] 96 0.011% 98.355% ( 76, 110 ] 410 0.045% 98.400% ( 110, 170 ] 1777 0.195% 98.595% ( 170, 250 ] 1433 0.157% 98.752% ( 250, 380 ] 1438 0.158% 98.910% ( 380, 580 ] 2038 0.224% 99.134% ( 580, 870 ] 2351 0.258% 99.392% ( 870, 1300 ] 2199 0.241% 99.633% ( 1300, 1900 ] 1531 0.168% 99.801% ( 1900, 2900 ] 1211 0.133% 99.934% ( 2900, 4400 ] 1215 0.133% 100.067% ( 4400, 6600 ] 413 0.045% 100.112% ( 6600, 9900 ] 58 0.006% 100.119% ( 9900, 14000 ] 1 0.000% 100.119% ( 14000, 22000 ] 2 0.000% 100.119% ( 22000, 33000 ] 1 0.000% 100.119% ( 33000, 50000 ] 1 0.000% 100.119% ** Level 5 read latency histogram (micros): Count: 58419 Average: 945.3618 StdDev: 1239.72 Min: 77 Median: 512.3144 Max: 51441 Percentiles: P50: 512.31 P75: 1144.36 P99: 5920.70 P99.9: 9326.35 P99.99: 19933.16 ------------------------------------------------------ ( 76, 110 ] 2293 3.925% 3.925% # ( 110, 170 ] 10367 17.746% 21.671% #### ( 170, 250 ] 6610 11.315% 32.986% ## ( 250, 380 ] 5243 8.975% 41.961% ## ( 380, 580 ] 7099 12.152% 54.113% ## ( 580, 870 ] 7889 13.504% 67.617% ### ( 870, 1300 ] 6760 11.572% 79.188% ## ( 1300, 1900 ] 4119 7.051% 86.239% # ( 1900, 2900 ] 3180 5.443% 91.683% # ( 2900, 4400 ] 3464 5.930% 97.612% # ( 4400, 6600 ] 1173 2.008% 99.620% ( 6600, 9900 ] 198 0.339% 99.959% ( 9900, 14000 ] 10 0.017% 99.976% ( 14000, 22000 ] 11 0.019% 99.995% ( 22000, 33000 ] 2 0.003% 99.998% ( 33000, 50000 ] 2 0.003% 100.002% ( 50000, 75000 ] 1 0.002% 100.003% ** DB Stats ** Uptime(secs): 19.0 total, 4.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 155.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.192 H:M:S, 37.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 206.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.036 H:M:S, 21.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-00:19:27 ... thread 0: (1000000,4000000) ops and (284807.3,178911.9) ops/second in (3.511146,22.357375) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 2.83 GB 201.4 2.5 0.0 2.5 6.2 3.7 0.0 1.7 79.5 195.9 32.47 21.28 60 0.541 2622K 2936 0.0 0.0 L1 7/7 628.01 MB 0.0 1.1 0.9 0.2 1.1 0.9 0.0 1.2 138.3 138.1 8.36 5.40 3 2.786 1173K 1755 0.0 0.0 L2 2/0 95.45 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.0 1.5 136.7 136.5 4.24 2.63 5 0.848 457K 131 0.0 0.0 L3 15/0 988.47 MB 1.0 5.7 2.8 2.9 5.6 2.7 0.0 2.0 110.3 109.1 53.02 27.95 20 2.651 2955K 806 0.0 0.0 L4 179/0 9.75 GB 1.0 8.8 5.3 3.5 8.7 5.2 0.5 1.6 120.6 118.6 74.80 42.20 58 1.290 4877K 1738 0.0 0.0 L5 1156/0 95.11 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1376/16 109.35 GB 0.0 18.7 9.5 9.3 22.2 12.9 6.1 6.0 111.0 131.6 172.88 99.46 146 1.184 12M 7366 0.0 0.0 Int 0/0 0.00 KB 0.0 18.7 9.5 9.3 22.2 12.9 6.1 6.0 111.0 131.6 172.88 99.46 146 1.184 12M 7366 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.7 9.5 9.3 18.5 9.2 0.0 0.0 126.6 125.2 151.50 88.32 95 1.595 12M 7366 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 176.8 21.38 11.15 51 0.419 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.6 total, 22.4 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.21 GB write, 1008.48 MB/s write, 18.74 GB read, 850.64 MB/s read, 172.9 seconds Interval compaction: 22.21 GB write, 1017.30 MB/s write, 18.74 GB read, 858.08 MB/s read, 172.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 65, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 65, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1023564 Average: 10.8843 StdDev: 100.65 Min: 0 Median: 1.6972 Max: 11566 Percentiles: P50: 1.70 P75: 2.51 P99: 205.27 P99.9: 979.68 P99.99: 2220.76 ------------------------------------------------------ [ 0, 1 ] 123675 12.083% 12.083% ## ( 1, 2 ] 556666 54.385% 66.468% ########### ( 2, 3 ] 169905 16.599% 83.067% ### ( 3, 4 ] 71069 6.943% 90.010% # ( 4, 6 ] 61006 5.960% 95.971% # ( 6, 10 ] 12747 1.245% 97.216% ( 10, 15 ] 2570 0.251% 97.467% ( 15, 22 ] 331 0.032% 97.499% ( 22, 34 ] 58 0.006% 97.505% ( 34, 51 ] 28 0.003% 97.508% ( 51, 76 ] 30 0.003% 97.511% ( 76, 110 ] 2406 0.235% 97.746% ( 110, 170 ] 10419 1.018% 98.764% ( 170, 250 ] 5485 0.536% 99.300% ( 250, 380 ] 2520 0.246% 99.546% ( 380, 580 ] 2317 0.226% 99.772% ( 580, 870 ] 1148 0.112% 99.884% ( 870, 1300 ] 629 0.061% 99.946% ( 1300, 1900 ] 367 0.036% 99.982% ( 1900, 2900 ] 267 0.026% 100.008% ( 2900, 4400 ] 261 0.025% 100.033% ( 4400, 6600 ] 63 0.006% 100.039% ( 6600, 9900 ] 11 0.001% 100.040% ( 9900, 14000 ] 1 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 256205 Average: 10.1576 StdDev: 130.19 Min: 1 Median: 2.1289 Max: 9189 Percentiles: P50: 2.13 P75: 3.42 P99: 18.56 P99.9: 1839.97 P99.99: 4327.32 ------------------------------------------------------ [ 0, 1 ] 4070 1.589% 1.589% ( 1, 2 ] 116472 45.460% 47.049% ######### ( 2, 3 ] 58632 22.885% 69.934% ##### ( 3, 4 ] 30885 12.055% 81.989% ## ( 4, 6 ] 34758 13.566% 95.555% ### ( 6, 10 ] 7188 2.806% 98.361% # ( 10, 15 ] 1409 0.550% 98.911% ( 15, 22 ] 450 0.176% 99.086% ( 22, 34 ] 48 0.019% 99.105% ( 34, 51 ] 8 0.003% 99.108% ( 51, 76 ] 21 0.008% 99.116% ( 76, 110 ] 141 0.055% 99.171% ( 110, 170 ] 618 0.241% 99.413% ( 170, 250 ] 312 0.122% 99.534% ( 250, 380 ] 199 0.078% 99.612% ( 380, 580 ] 226 0.088% 99.700% ( 580, 870 ] 229 0.089% 99.790% ( 870, 1300 ] 182 0.071% 99.861% ( 1300, 1900 ] 112 0.044% 99.904% ( 1900, 2900 ] 109 0.043% 99.947% ( 2900, 4400 ] 116 0.045% 99.992% ( 4400, 6600 ] 35 0.014% 100.006% ( 6600, 9900 ] 10 0.004% 100.010% ** Level 2 read latency histogram (micros): Count: 636125 Average: 12.9949 StdDev: 182.09 Min: 1 Median: 2.0010 Max: 43209 Percentiles: P50: 2.00 P75: 3.07 P99: 12.39 P99.9: 1467.88 P99.99: 2097.70 ------------------------------------------------------ [ 0, 1 ] 13340 2.097% 2.097% ( 1, 2 ] 304570 47.879% 49.976% ########## ( 2, 3 ] 154648 24.311% 74.287% ##### ( 3, 4 ] 68629 10.789% 85.076% ## ( 4, 6 ] 67964 10.684% 95.760% ## ( 6, 10 ] 18809 2.957% 98.716% # ( 10, 15 ] 3780 0.594% 99.311% ( 15, 22 ] 570 0.090% 99.400% ( 22, 34 ] 82 0.013% 99.413% ( 34, 51 ] 40 0.006% 99.419% ( 51, 76 ] 53 0.008% 99.428% ( 76, 110 ] 75 0.012% 99.440% ( 110, 170 ] 222 0.035% 99.474% ( 170, 250 ] 180 0.028% 99.503% ( 250, 380 ] 253 0.040% 99.543% ( 380, 580 ] 499 0.078% 99.621% ( 580, 870 ] 736 0.116% 99.737% ( 870, 1300 ] 857 0.135% 99.871% ( 1300, 1900 ] 650 0.102% 99.974% ( 1900, 2900 ] 528 0.083% 100.057% ( 2900, 4400 ] 386 0.061% 100.117% ( 4400, 6600 ] 89 0.014% 100.131% ( 6600, 9900 ] 20 0.003% 100.134% ( 9900, 14000 ] 1 0.000% 100.135% ( 14000, 22000 ] 8 0.001% 100.136% ( 22000, 33000 ] 5 0.001% 100.137% ( 33000, 50000 ] 1 0.000% 100.137% ** Level 3 read latency histogram (micros): Count: 2052491 Average: 11.4470 StdDev: 153.15 Min: 1 Median: 1.9873 Max: 21794 Percentiles: P50: 1.99 P75: 2.97 P99: 9.96 P99.9: 943.76 P99.99: 1414.00 ------------------------------------------------------ [ 0, 1 ] 28884 1.407% 1.407% ( 1, 2 ] 1010155 49.216% 50.623% ########## ( 2, 3 ] 516042 25.142% 75.766% ##### ( 3, 4 ] 212852 10.370% 86.136% ## ( 4, 6 ] 211862 10.322% 96.458% ## ( 6, 10 ] 52719 2.569% 99.027% # ( 10, 15 ] 10155 0.495% 99.521% ( 15, 22 ] 1233 0.060% 99.582% ( 22, 34 ] 95 0.005% 99.586% ( 34, 51 ] 143 0.007% 99.593% ( 51, 76 ] 224 0.011% 99.604% ( 76, 110 ] 225 0.011% 99.615% ( 110, 170 ] 815 0.040% 99.655% ( 170, 250 ] 618 0.030% 99.685% ( 250, 380 ] 732 0.036% 99.720% ( 380, 580 ] 1390 0.068% 99.788% ( 580, 870 ] 1965 0.096% 99.884% ( 870, 1300 ] 1921 0.094% 99.978% ( 1300, 1900 ] 1346 0.066% 100.043% ( 1900, 2900 ] 1263 0.062% 100.105% ( 2900, 4400 ] 1436 0.070% 100.175% ( 4400, 6600 ] 405 0.020% 100.194% ( 6600, 9900 ] 62 0.003% 100.197% ( 9900, 14000 ] 5 0.000% 100.198% ( 14000, 22000 ] 5 0.000% 100.198% ** Level 4 read latency histogram (micros): Count: 919232 Average: 24.2202 StdDev: 230.24 Min: 0 Median: 1.9738 Max: 46346 Percentiles: P50: 1.97 P75: 3.00 P99: 490.21 P99.9: 2641.77 P99.99: 3534.14 ------------------------------------------------------ [ 0, 1 ] 16844 1.832% 1.832% ( 1, 2 ] 454700 49.465% 51.298% ########## ( 2, 3 ] 217659 23.678% 74.976% ##### ( 3, 4 ] 92365 10.048% 85.024% ## ( 4, 6 ] 87536 9.523% 94.547% ## ( 6, 10 ] 23383 2.544% 97.091% # ( 10, 15 ] 4069 0.443% 97.533% ( 15, 22 ] 514 0.056% 97.589% ( 22, 34 ] 47 0.005% 97.594% ( 34, 51 ] 74 0.008% 97.602% ( 51, 76 ] 96 0.010% 97.613% ( 76, 110 ] 1208 0.131% 97.744% ( 110, 170 ] 5214 0.567% 98.311% ( 170, 250 ] 2937 0.320% 98.631% ( 250, 380 ] 1999 0.217% 98.848% ( 380, 580 ] 2531 0.275% 99.124% ( 580, 870 ] 2481 0.270% 99.394% ( 870, 1300 ] 2224 0.242% 99.635% ( 1300, 1900 ] 1532 0.167% 99.802% ( 1900, 2900 ] 1213 0.132% 99.934% ( 2900, 4400 ] 1216 0.132% 100.066% ( 4400, 6600 ] 413 0.045% 100.111% ( 6600, 9900 ] 58 0.006% 100.118% ( 9900, 14000 ] 1 0.000% 100.118% ( 14000, 22000 ] 2 0.000% 100.118% ( 22000, 33000 ] 1 0.000% 100.118% ( 33000, 50000 ] 1 0.000% 100.118% ** Level 5 read latency histogram (micros): Count: 98987 Average: 639.9084 StdDev: 1024.40 Min: 76 Median: 233.4196 Max: 51441 Percentiles: P50: 233.42 P75: 680.94 P99: 5157.96 P99.9: 8633.55 P99.99: 16255.49 ------------------------------------------------------ ( 51, 76 ] 1 0.001% 0.001% ( 76, 110 ] 7026 7.098% 7.099% # ( 110, 170 ] 30371 30.682% 37.781% ###### ( 170, 250 ] 15259 15.415% 53.196% ### ( 250, 380 ] 8617 8.705% 61.901% ## ( 380, 580 ] 9933 10.035% 71.936% ## ( 580, 870 ] 8717 8.806% 80.742% ## ( 870, 1300 ] 6874 6.944% 87.686% # ( 1300, 1900 ] 4129 4.171% 91.858% # ( 1900, 2900 ] 3199 3.232% 95.089% # ( 2900, 4400 ] 3468 3.503% 98.593% # ( 4400, 6600 ] 1173 1.185% 99.778% ( 6600, 9900 ] 198 0.200% 99.978% ( 9900, 14000 ] 10 0.010% 99.988% ( 14000, 22000 ] 11 0.011% 99.999% ( 22000, 33000 ] 2 0.002% 100.001% ( 33000, 50000 ] 2 0.002% 100.003% ( 50000, 75000 ] 1 0.001% 100.004% ** DB Stats ** Uptime(secs): 22.6 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 174.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.199 H:M:S, 31.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 280.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.007 H:M:S, 0.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-00:19:34 ... thread 0: (1000000,5000000) ops and (139339.6,169295.9) ops/second in (7.176710,29.534085) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.87 GB 176.2 3.8 0.0 3.8 8.5 4.7 0.0 1.8 95.3 213.5 41.00 29.29 81 0.506 3965K 4302 0.0 0.0 L1 7/7 628.01 MB 0.0 1.1 0.9 0.2 1.1 0.9 0.0 1.2 138.3 138.1 8.36 5.40 3 2.786 1173K 1755 0.0 0.0 L2 2/0 95.45 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.0 1.5 136.7 136.5 4.24 2.63 5 0.848 457K 131 0.0 0.0 L3 15/0 988.47 MB 1.0 5.7 2.8 2.9 5.6 2.7 0.0 2.0 110.3 109.1 53.02 27.95 20 2.651 2955K 806 0.0 0.0 L4 179/0 9.75 GB 1.0 8.8 5.3 3.5 8.7 5.2 0.5 1.6 120.6 118.6 74.80 42.20 58 1.290 4877K 1738 0.0 0.0 L5 1156/0 95.11 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1377/18 110.40 GB 0.0 20.0 9.5 10.6 24.5 14.0 6.1 5.2 113.1 138.6 181.41 107.48 167 1.086 13M 8732 0.0 0.0 Int 0/0 0.00 KB 0.0 20.0 9.5 10.6 24.5 14.0 6.1 5.2 113.1 138.6 181.41 107.48 167 1.086 13M 8732 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.0 9.5 10.6 19.8 9.2 0.0 0.0 131.0 129.6 156.53 93.27 100 1.565 13M 8732 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 195.0 24.88 14.20 67 0.371 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.7 total, 29.5 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.55 GB write, 845.51 MB/s write, 20.03 GB read, 689.81 MB/s read, 181.4 seconds Interval compaction: 24.55 GB write, 851.11 MB/s write, 20.03 GB read, 694.37 MB/s read, 181.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 66, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1429355 Average: 12.9207 StdDev: 91.96 Min: 0 Median: 1.6447 Max: 11566 Percentiles: P50: 1.64 P75: 2.44 P99: 229.19 P99.9: 795.43 P99.99: 1625.04 ------------------------------------------------------ [ 0, 1 ] 225672 15.788% 15.788% ### ( 1, 2 ] 758483 53.065% 68.853% ########### ( 2, 3 ] 201942 14.128% 82.981% ### ( 3, 4 ] 90467 6.329% 89.310% # ( 4, 6 ] 72442 5.068% 94.379% # ( 6, 10 ] 14508 1.015% 95.394% ( 10, 15 ] 3223 0.225% 95.619% ( 15, 22 ] 473 0.033% 95.652% ( 22, 34 ] 82 0.006% 95.658% ( 34, 51 ] 33 0.002% 95.660% ( 51, 76 ] 33 0.002% 95.663% ( 76, 110 ] 7740 0.542% 96.204% ( 110, 170 ] 30847 2.158% 98.362% ( 170, 250 ] 12323 0.862% 99.224% ( 250, 380 ] 4620 0.323% 99.548% ( 380, 580 ] 3886 0.272% 99.819% ( 580, 870 ] 1553 0.109% 99.928% ( 870, 1300 ] 685 0.048% 99.976% ( 1300, 1900 ] 373 0.026% 100.002% ( 1900, 2900 ] 291 0.020% 100.022% ( 2900, 4400 ] 274 0.019% 100.042% ( 4400, 6600 ] 64 0.004% 100.046% ( 6600, 9900 ] 11 0.001% 100.047% ( 9900, 14000 ] 1 0.000% 100.047% ** Level 1 read latency histogram (micros): Count: 293890 Average: 10.6547 StdDev: 122.68 Min: 1 Median: 2.4179 Max: 9189 Percentiles: P50: 2.42 P75: 3.88 P99: 139.99 P99.9: 1627.38 P99.99: 4239.80 ------------------------------------------------------ [ 0, 1 ] 4104 1.396% 1.396% ( 1, 2 ] 117076 39.837% 41.233% ######## ( 2, 3 ] 61651 20.978% 62.211% #### ( 3, 4 ] 42589 14.491% 76.702% ### ( 4, 6 ] 51388 17.485% 94.188% ### ( 6, 10 ] 9747 3.317% 97.504% # ( 10, 15 ] 2036 0.693% 98.197% ( 15, 22 ] 927 0.315% 98.512% ( 22, 34 ] 87 0.030% 98.542% ( 34, 51 ] 8 0.003% 98.545% ( 51, 76 ] 21 0.007% 98.552% ( 76, 110 ] 449 0.153% 98.705% ( 110, 170 ] 1737 0.591% 99.296% ( 170, 250 ] 663 0.226% 99.521% ( 250, 380 ] 309 0.105% 99.626% ( 380, 580 ] 301 0.102% 99.729% ( 580, 870 ] 257 0.087% 99.816% ( 870, 1300 ] 185 0.063% 99.879% ( 1300, 1900 ] 112 0.038% 99.917% ( 1900, 2900 ] 110 0.037% 99.955% ( 2900, 4400 ] 116 0.039% 99.994% ( 4400, 6600 ] 35 0.012% 100.006% ( 6600, 9900 ] 10 0.003% 100.010% ** Level 2 read latency histogram (micros): Count: 636644 Average: 13.1172 StdDev: 182.09 Min: 1 Median: 2.0027 Max: 43209 Percentiles: P50: 2.00 P75: 3.07 P99: 13.07 P99.9: 1467.41 P99.99: 2097.61 ------------------------------------------------------ [ 0, 1 ] 13340 2.095% 2.095% ( 1, 2 ] 304570 47.840% 49.935% ########## ( 2, 3 ] 154648 24.291% 74.226% ##### ( 3, 4 ] 68629 10.780% 85.006% ## ( 4, 6 ] 67964 10.675% 95.682% ## ( 6, 10 ] 18809 2.954% 98.636% # ( 10, 15 ] 3780 0.594% 99.230% ( 15, 22 ] 570 0.090% 99.319% ( 22, 34 ] 82 0.013% 99.332% ( 34, 51 ] 40 0.006% 99.338% ( 51, 76 ] 53 0.008% 99.347% ( 76, 110 ] 154 0.024% 99.371% ( 110, 170 ] 529 0.083% 99.454% ( 170, 250 ] 273 0.043% 99.497% ( 250, 380 ] 272 0.043% 99.540% ( 380, 580 ] 518 0.081% 99.621% ( 580, 870 ] 738 0.116% 99.737% ( 870, 1300 ] 857 0.135% 99.872% ( 1300, 1900 ] 650 0.102% 99.974% ( 1900, 2900 ] 528 0.083% 100.057% ( 2900, 4400 ] 386 0.061% 100.117% ( 4400, 6600 ] 89 0.014% 100.131% ( 6600, 9900 ] 20 0.003% 100.134% ( 9900, 14000 ] 1 0.000% 100.134% ( 14000, 22000 ] 8 0.001% 100.136% ( 22000, 33000 ] 5 0.001% 100.136% ( 33000, 50000 ] 1 0.000% 100.137% ** Level 3 read latency histogram (micros): Count: 2054793 Average: 11.6280 StdDev: 153.20 Min: 1 Median: 1.9885 Max: 21794 Percentiles: P50: 1.99 P75: 2.97 P99: 10.85 P99.9: 943.65 P99.99: 1414.35 ------------------------------------------------------ [ 0, 1 ] 28884 1.406% 1.406% ( 1, 2 ] 1010155 49.161% 50.567% ########## ( 2, 3 ] 516042 25.114% 75.681% ##### ( 3, 4 ] 212852 10.359% 86.039% ## ( 4, 6 ] 211862 10.311% 96.350% ## ( 6, 10 ] 52719 2.566% 98.916% # ( 10, 15 ] 10155 0.494% 99.410% ( 15, 22 ] 1233 0.060% 99.470% ( 22, 34 ] 95 0.005% 99.475% ( 34, 51 ] 143 0.007% 99.482% ( 51, 76 ] 224 0.011% 99.492% ( 76, 110 ] 554 0.027% 99.519% ( 110, 170 ] 2134 0.104% 99.623% ( 170, 250 ] 1030 0.050% 99.673% ( 250, 380 ] 850 0.041% 99.715% ( 380, 580 ] 1493 0.073% 99.787% ( 580, 870 ] 1984 0.097% 99.884% ( 870, 1300 ] 1922 0.094% 99.978% ( 1300, 1900 ] 1346 0.066% 100.043% ( 1900, 2900 ] 1264 0.062% 100.105% ( 2900, 4400 ] 1436 0.070% 100.174% ( 4400, 6600 ] 405 0.020% 100.194% ( 6600, 9900 ] 62 0.003% 100.197% ( 9900, 14000 ] 5 0.000% 100.197% ( 14000, 22000 ] 5 0.000% 100.198% ** Level 4 read latency histogram (micros): Count: 937129 Average: 26.9961 StdDev: 229.45 Min: 0 Median: 1.9934 Max: 46346 Percentiles: P50: 1.99 P75: 3.15 P99: 511.93 P99.9: 2630.00 P99.99: 3533.36 ------------------------------------------------------ [ 0, 1 ] 16844 1.797% 1.797% ( 1, 2 ] 454708 48.521% 50.319% ########## ( 2, 3 ] 217678 23.228% 73.547% ##### ( 3, 4 ] 92476 9.868% 83.415% ## ( 4, 6 ] 87679 9.356% 92.771% ## ( 6, 10 ] 23402 2.497% 95.268% ( 10, 15 ] 4075 0.435% 95.703% ( 15, 22 ] 514 0.055% 95.758% ( 22, 34 ] 47 0.005% 95.763% ( 34, 51 ] 74 0.008% 95.771% ( 51, 76 ] 96 0.010% 95.781% ( 76, 110 ] 3958 0.422% 96.204% ( 110, 170 ] 15358 1.639% 97.842% ( 170, 250 ] 5760 0.615% 98.457% ( 250, 380 ] 2958 0.316% 98.773% ( 380, 580 ] 3230 0.345% 99.117% ( 580, 870 ] 2667 0.285% 99.402% ( 870, 1300 ] 2243 0.239% 99.641% ( 1300, 1900 ] 1535 0.164% 99.805% ( 1900, 2900 ] 1219 0.130% 99.935% ( 2900, 4400 ] 1218 0.130% 100.065% ( 4400, 6600 ] 413 0.044% 100.109% ( 6600, 9900 ] 58 0.006% 100.115% ( 9900, 14000 ] 1 0.000% 100.115% ( 14000, 22000 ] 2 0.000% 100.116% ( 22000, 33000 ] 1 0.000% 100.116% ( 33000, 50000 ] 1 0.000% 100.116% ** Level 5 read latency histogram (micros): Count: 194884 Average: 409.2521 StdDev: 770.49 Min: 76 Median: 162.6878 Max: 51441 Percentiles: P50: 162.69 P75: 320.94 P99: 4159.36 P99.9: 7001.93 P99.99: 10519.76 ------------------------------------------------------ ( 51, 76 ] 1 0.001% 0.001% ( 76, 110 ] 22447 11.518% 11.519% ## ( 110, 170 ] 85402 43.822% 55.341% ######### ( 170, 250 ] 30955 15.884% 71.224% ### ( 250, 380 ] 13484 6.919% 78.143% # ( 380, 580 ] 13711 7.035% 85.179% # ( 580, 870 ] 9654 4.954% 90.133% # ( 870, 1300 ] 6995 3.589% 93.722% # ( 1300, 1900 ] 4142 2.125% 95.847% ( 1900, 2900 ] 3230 1.657% 97.505% ( 2900, 4400 ] 3471 1.781% 99.286% ( 4400, 6600 ] 1173 0.602% 99.888% ( 6600, 9900 ] 198 0.102% 99.989% ( 9900, 14000 ] 10 0.005% 99.994% ( 14000, 22000 ] 11 0.006% 100.000% ( 22000, 33000 ] 2 0.001% 100.001% ( 33000, 50000 ] 2 0.001% 100.002% ( 50000, 75000 ] 1 0.001% 100.003% ** DB Stats ** Uptime(secs): 29.7 total, 7.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 165.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.742 H:M:S, 36.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 137.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.544 H:M:S, 49.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 276.790 micros/op 14440 ops/sec 60.176 seconds 868996 operations; 14.0 MB/s (216999 of 216999 found) Microseconds per read: Count: 868996 Average: 276.7924 StdDev: 818.25 Min: 3 Median: 189.0160 Max: 146617 Percentiles: P50: 189.02 P75: 239.67 P99: 1898.43 P99.9: 12738.50 P99.99: 30026.48 ------------------------------------------------------ ( 2, 3 ] 4 0.000% 0.000% ( 3, 4 ] 1 0.000% 0.001% ( 4, 6 ] 21 0.002% 0.003% ( 6, 10 ] 240 0.028% 0.031% ( 10, 15 ] 130 0.015% 0.046% ( 15, 22 ] 396 0.046% 0.091% ( 22, 34 ] 16020 1.844% 1.935% ( 34, 51 ] 3597 0.414% 2.349% ( 51, 76 ] 583 0.067% 2.416% ( 76, 110 ] 351 0.040% 2.456% ( 110, 170 ] 331595 38.158% 40.614% ######## ( 170, 250 ] 343121 39.485% 80.099% ######## ( 250, 380 ] 92535 10.648% 90.748% ## ( 380, 580 ] 39727 4.572% 95.319% # ( 580, 870 ] 18182 2.092% 97.412% ( 870, 1300 ] 9254 1.065% 98.477% ( 1300, 1900 ] 4561 0.525% 99.001% ( 1900, 2900 ] 3122 0.359% 99.361% ( 2900, 4400 ] 3069 0.353% 99.714% ( 4400, 6600 ] 992 0.114% 99.828% ( 6600, 9900 ] 320 0.037% 99.865% ( 9900, 14000 ] 442 0.051% 99.916% ( 14000, 22000 ] 533 0.061% 99.977% ( 22000, 33000 ] 155 0.018% 99.995% ( 33000, 50000 ] 29 0.003% 99.998% ( 50000, 75000 ] 12 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13847139 rocksdb.bloom.filter.full.positive COUNT : 1003376 rocksdb.bloom.filter.full.true.positive COUNT : 868591 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 405 rocksdb.memtable.miss COUNT : 868591 rocksdb.l0.hit COUNT : 30456 rocksdb.l1.hit COUNT : 8691 rocksdb.l2andup.hit COUNT : 829444 rocksdb.compaction.key.drop.new COUNT : 265108 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5448906 rocksdb.number.keys.read COUNT : 868996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5623270992 rocksdb.bytes.read COUNT : 868996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1707 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 38546526 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 25992832386 rocksdb.compact.write.bytes COUNT : 25719197300 rocksdb.flush.write.bytes COUNT : 5614829846 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 32 rocksdb.number.superversion_acquires COUNT : 1150 rocksdb.number.superversion_releases COUNT : 1115 rocksdb.number.superversion_cleanups COUNT : 286 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 331 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5569629184 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2230272 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29917497299 rocksdb.non.last.level.read.count COUNT : 7086357 rocksdb.block.checksum.compute.count COUNT : 7309091 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 187.554785 P95 : 565.198985 P99 : 1897.634767 P100 : 146614.000000 COUNT : 868996 SUM : 239538621 rocksdb.db.write.micros P50 : 1.565277 P95 : 4.835178 P99 : 10.413907 P100 : 908730.000000 COUNT : 5448906 SUM : 52828806 rocksdb.compaction.times.micros P50 : 1326388.888889 P95 : 4098750.000000 P99 : 6478000.000000 P100 : 21327517.000000 COUNT : 103 SUM : 184719857 rocksdb.compaction.times.cpu_micros P50 : 801309.523810 P95 : 2825000.000000 P99 : 6434000.000000 P100 : 10287852.000000 COUNT : 103 SUM : 110330250 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 887.916667 P95 : 117500.000000 P99 : 314379.000000 P100 : 314379.000000 COUNT : 75 SUM : 1226225 rocksdb.compaction.outfile.sync.micros P50 : 18975.609756 P95 : 233333.333333 P99 : 484500.000000 P100 : 541428.000000 COUNT : 315 SUM : 17534095 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 681.500000 P95 : 4298.529412 P99 : 6103.777778 P100 : 6205.000000 COUNT : 203 SUM : 253882 rocksdb.table.open.io.micros P50 : 8821.680498 P95 : 19717.117117 P99 : 25012.777778 P100 : 92815.000000 COUNT : 1707 SUM : 15357695 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.046290 P95 : 9.909562 P99 : 167.080766 P100 : 43213.000000 COUNT : 6294800 SUM : 93143789 rocksdb.read.block.get.micros P50 : 142.140488 P95 : 466.374854 P99 : 1814.275344 P100 : 46356.000000 COUNT : 1012594 SUM : 201026550 rocksdb.write.raw.block.micros P50 : 0.548300 P95 : 1.582181 P99 : 4.098570 P100 : 60618.000000 COUNT : 7589318 SUM : 24177733 rocksdb.numfiles.in.singlecompaction P50 : 2.666667 P95 : 5.040000 P99 : 14.300000 P100 : 22.000000 COUNT : 128 SUM : 433 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.574677 P95 : 1223.766925 P99 : 2598.474124 P100 : 908563.000000 COUNT : 182414 SUM : 38568923 rocksdb.sst.read.micros P50 : 2.169407 P95 : 160.431829 P99 : 492.128835 P100 : 51441.000000 COUNT : 7086416 SUM : 274090008 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 868996 SUM : 868996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5448906 SUM : 5623270992 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 233829.787234 P95 : 987500.000000 P99 : 1157500.000000 P100 : 1170535.000000 COUNT : 75 SUM : 26610800 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 333 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0