[2024-11-29 15:19:57.421635] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-11-29 15:19:57.421899] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1866439 ] Set seed to 1732889997414905 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-29 15:19:57.532991] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-29 15:19:57.570808] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-29 15:19:57.570851] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1866439' to capture a snapshot of events at runtime. [2024-11-29 15:19:57.570861] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-29 15:19:57.570871] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-29 15:19:57.570879] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1866439 for offline analysis/debug. [2024-11-29 15:19:57.570957] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 29 15:20:01 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/29-15:20:09 ... thread 0: (1000000,1000000) ops and (137284.0,137284.0) ops/second in (7.284168,7.284168) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 566.94 MB 25.2 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 122.0 6.71 2.29 10 0.671 0 0 0.0 0.0 L1 4/2 322.91 MB 7.4 0.4 0.3 0.1 0.4 0.3 0.0 1.4 122.2 122.0 3.75 2.05 2 1.873 464K 422 0.0 0.0 L2 2/1 257.56 MB 1.3 0.3 0.2 0.1 0.3 0.2 0.0 1.5 88.5 87.6 3.20 1.34 2 1.601 287K 3027 0.0 0.0 L3 34/10 3.07 GB 2.3 2.5 1.5 1.0 2.4 1.4 0.1 1.6 100.8 98.6 25.38 11.94 13 1.952 1681K 33 0.0 0.0 L4 189/19 12.41 GB 1.2 3.4 2.4 1.0 3.4 2.4 0.3 1.4 115.7 115.0 30.36 16.41 25 1.215 1629K 55 0.0 0.0 L5 1080/0 88.89 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1316/36 105.49 GB 0.0 6.7 4.4 2.2 7.4 5.1 0.4 9.2 98.2 108.8 69.41 34.03 52 1.335 4063K 3537 0.0 0.0 Int 0/0 0.00 KB 0.0 6.7 4.4 2.2 7.4 5.1 0.4 9.2 98.2 108.8 69.41 34.03 52 1.335 4063K 3537 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.7 4.4 2.2 6.6 4.3 0.0 0.0 108.7 107.4 62.69 31.74 42 1.493 4063K 3537 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 122.0 6.71 2.29 10 0.671 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.5 total, 7.3 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.37 GB write, 1010.48 MB/s write, 6.65 GB read, 911.86 MB/s read, 69.4 seconds Interval compaction: 7.37 GB write, 1036.45 MB/s write, 6.65 GB read, 935.29 MB/s read, 69.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 31, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 128241 Average: 7.5473 StdDev: 109.42 Min: 1 Median: 1.8629 Max: 7940 Percentiles: P50: 1.86 P75: 2.85 P99: 9.44 P99.9: 1647.59 P99.99: 5111.69 ------------------------------------------------------ [ 0, 1 ] 5163 4.026% 4.026% # ( 1, 2 ] 68321 53.275% 57.301% ########### ( 2, 3 ] 26567 20.716% 78.018% #### ( 3, 4 ] 12673 9.882% 87.900% ## ( 4, 6 ] 12308 9.598% 97.498% ## ( 6, 10 ] 2241 1.747% 99.245% ( 10, 15 ] 490 0.382% 99.627% ( 15, 22 ] 58 0.045% 99.672% ( 22, 34 ] 7 0.005% 99.678% ( 34, 51 ] 2 0.002% 99.680% ( 51, 76 ] 5 0.004% 99.683% ( 76, 110 ] 1 0.001% 99.684% ( 110, 170 ] 3 0.002% 99.687% ( 170, 250 ] 17 0.013% 99.700% ( 250, 380 ] 25 0.019% 99.719% ( 380, 580 ] 40 0.031% 99.750% ( 580, 870 ] 74 0.058% 99.808% ( 870, 1300 ] 84 0.066% 99.874% ( 1300, 1900 ] 60 0.047% 99.920% ( 1900, 2900 ] 52 0.041% 99.961% ( 2900, 4400 ] 33 0.026% 99.987% ( 4400, 6600 ] 16 0.012% 99.999% ( 6600, 9900 ] 2 0.002% 100.001% ** Level 1 read latency histogram (micros): Count: 145954 Average: 7.7956 StdDev: 122.39 Min: 1 Median: 1.9159 Max: 9644 Percentiles: P50: 1.92 P75: 2.92 P99: 9.62 P99.9: 1631.18 P99.99: 4279.07 ------------------------------------------------------ [ 0, 1 ] 4333 2.969% 2.969% # ( 1, 2 ] 74947 51.350% 54.318% ########## ( 2, 3 ] 32836 22.497% 76.816% #### ( 3, 4 ] 15062 10.320% 87.136% ## ( 4, 6 ] 14814 10.150% 97.285% ## ( 6, 10 ] 2764 1.894% 99.179% ( 10, 15 ] 637 0.436% 99.616% ( 15, 22 ] 97 0.066% 99.682% ( 22, 34 ] 14 0.010% 99.692% ( 34, 51 ] 15 0.010% 99.702% ( 51, 76 ] 7 0.005% 99.707% ( 76, 110 ] 5 0.003% 99.710% ( 110, 170 ] 11 0.008% 99.718% ( 170, 250 ] 22 0.015% 99.733% ( 250, 380 ] 30 0.021% 99.753% ( 380, 580 ] 68 0.047% 99.800% ( 580, 870 ] 57 0.039% 99.839% ( 870, 1300 ] 62 0.042% 99.881% ( 1300, 1900 ] 49 0.034% 99.915% ( 1900, 2900 ] 57 0.039% 99.954% ( 2900, 4400 ] 57 0.039% 99.993% ( 4400, 6600 ] 18 0.012% 100.005% ( 6600, 9900 ] 7 0.005% 100.010% ** Level 2 read latency histogram (micros): Count: 354680 Average: 12.0842 StdDev: 165.31 Min: 1 Median: 1.9802 Max: 19208 Percentiles: P50: 1.98 P75: 3.03 P99: 11.48 P99.9: 1054.99 P99.99: 1670.11 ------------------------------------------------------ [ 0, 1 ] 10752 3.031% 3.031% # ( 1, 2 ] 169960 47.919% 50.951% ########## ( 2, 3 ] 84254 23.755% 74.706% ##### ( 3, 4 ] 37511 10.576% 85.282% ## ( 4, 6 ] 37379 10.539% 95.820% ## ( 6, 10 ] 10577 2.982% 98.803% # ( 10, 15 ] 2361 0.666% 99.468% ( 15, 22 ] 377 0.106% 99.575% ( 22, 34 ] 84 0.024% 99.598% ( 34, 51 ] 29 0.008% 99.606% ( 51, 76 ] 27 0.008% 99.614% ( 76, 110 ] 21 0.006% 99.620% ( 110, 170 ] 48 0.014% 99.633% ( 170, 250 ] 90 0.025% 99.659% ( 250, 380 ] 154 0.043% 99.702% ( 380, 580 ] 265 0.075% 99.777% ( 580, 870 ] 316 0.089% 99.866% ( 870, 1300 ] 282 0.080% 99.946% ( 1300, 1900 ] 257 0.072% 100.018% ( 1900, 2900 ] 242 0.068% 100.086% ( 2900, 4400 ] 234 0.066% 100.152% ( 4400, 6600 ] 98 0.028% 100.180% ( 6600, 9900 ] 20 0.006% 100.186% ( 14000, 22000 ] 1 0.000% 100.186% ** Level 3 read latency histogram (micros): Count: 850320 Average: 12.2718 StdDev: 168.45 Min: 1 Median: 1.9685 Max: 45962 Percentiles: P50: 1.97 P75: 2.99 P99: 9.76 P99.9: 602.06 P99.99: 847.83 ------------------------------------------------------ [ 0, 1 ] 15774 1.855% 1.855% ( 1, 2 ] 422712 49.712% 51.567% ########## ( 2, 3 ] 200994 23.637% 75.205% ##### ( 3, 4 ] 93218 10.963% 86.167% ## ( 4, 6 ] 89271 10.499% 96.666% ## ( 6, 10 ] 21127 2.485% 99.150% ( 10, 15 ] 4524 0.532% 99.682% ( 15, 22 ] 558 0.066% 99.748% ( 22, 34 ] 61 0.007% 99.755% ( 34, 51 ] 53 0.006% 99.762% ( 51, 76 ] 64 0.008% 99.769% ( 76, 110 ] 30 0.004% 99.773% ( 110, 170 ] 48 0.006% 99.778% ( 170, 250 ] 119 0.014% 99.792% ( 250, 380 ] 276 0.032% 99.825% ( 380, 580 ] 573 0.067% 99.892% ( 580, 870 ] 903 0.106% 99.998% ( 870, 1300 ] 1010 0.119% 100.117% ( 1300, 1900 ] 747 0.088% 100.205% ( 1900, 2900 ] 632 0.074% 100.279% ( 2900, 4400 ] 573 0.067% 100.347% ( 4400, 6600 ] 155 0.018% 100.365% ( 6600, 9900 ] 26 0.003% 100.368% ( 9900, 14000 ] 4 0.000% 100.368% ( 14000, 22000 ] 2 0.000% 100.369% ( 22000, 33000 ] 1 0.000% 100.369% ( 33000, 50000 ] 1 0.000% 100.369% ** Level 4 read latency histogram (micros): Count: 327232 Average: 26.3236 StdDev: 268.34 Min: 1 Median: 1.9784 Max: 27537 Percentiles: P50: 1.98 P75: 3.06 P99: 545.01 P99.9: 2504.46 P99.99: 3049.32 ------------------------------------------------------ [ 0, 1 ] 5723 1.749% 1.749% ( 1, 2 ] 161381 49.317% 51.066% ########## ( 2, 3 ] 76276 23.309% 74.375% ##### ( 3, 4 ] 35880 10.965% 85.340% ## ( 4, 6 ] 34137 10.432% 95.772% ## ( 6, 10 ] 7942 2.427% 98.199% ( 10, 15 ] 1557 0.476% 98.675% ( 15, 22 ] 187 0.057% 98.732% ( 22, 34 ] 14 0.004% 98.736% ( 34, 51 ] 20 0.006% 98.742% ( 51, 76 ] 21 0.006% 98.749% ( 76, 110 ] 15 0.005% 98.753% ( 110, 170 ] 39 0.012% 98.765% ( 170, 250 ] 114 0.035% 98.800% ( 250, 380 ] 224 0.068% 98.869% ( 380, 580 ] 522 0.160% 99.028% ( 580, 870 ] 839 0.256% 99.285% ( 870, 1300 ] 963 0.294% 99.579% ( 1300, 1900 ] 677 0.207% 99.786% ( 1900, 2900 ] 620 0.189% 99.975% ( 2900, 4400 ] 495 0.151% 100.127% ( 4400, 6600 ] 191 0.058% 100.185% ( 6600, 9900 ] 37 0.011% 100.196% ( 9900, 14000 ] 4 0.001% 100.197% ( 14000, 22000 ] 5 0.002% 100.199% ( 22000, 33000 ] 2 0.001% 100.200% ** Level 5 read latency histogram (micros): Count: 12271 Average: 1734.5442 StdDev: 1543.12 Min: 86 Median: 1219.0056 Max: 45321 Percentiles: P50: 1219.01 P75: 2463.93 P99: 6515.60 P99.9: 9780.06 P99.99: 31750.95 ------------------------------------------------------ ( 76, 110 ] 9 0.073% 0.073% ( 110, 170 ] 64 0.522% 0.595% ( 170, 250 ] 215 1.752% 2.347% ( 250, 380 ] 588 4.792% 7.139% # ( 380, 580 ] 1249 10.178% 17.317% ## ( 580, 870 ] 2121 17.285% 34.602% ### ( 870, 1300 ] 2328 18.972% 53.573% #### ( 1300, 1900 ] 1745 14.221% 67.794% ### ( 1900, 2900 ] 1568 12.778% 80.572% ### ( 2900, 4400 ] 1667 13.585% 94.157% ### ( 4400, 6600 ] 618 5.036% 99.193% # ( 6600, 9900 ] 90 0.733% 99.927% ( 9900, 14000 ] 5 0.041% 99.967% ( 14000, 22000 ] 1 0.008% 99.976% ( 22000, 33000 ] 2 0.016% 99.992% ( 33000, 50000 ] 2 0.016% 100.008% ** DB Stats ** Uptime(secs): 7.5 total, 7.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 131.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.389 H:M:S, 45.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 135.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.389 H:M:S, 46.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/29-15:20:16 ... thread 0: (1000000,2000000) ops and (140775.1,139007.7) ops/second in (7.103529,14.387697) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.54 GB 44.1 0.6 0.0 0.6 2.4 1.8 0.0 1.3 35.5 138.4 17.75 7.74 24 0.740 639K 727 0.0 0.0 L1 2/2 74.08 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 1.4 122.2 122.0 3.75 2.05 2 1.873 464K 422 0.0 0.0 L2 2/1 127.99 MB 0.6 0.5 0.4 0.1 0.5 0.4 0.0 1.2 107.1 106.5 4.97 2.50 3 1.656 540K 3027 0.0 0.0 L3 17/5 1.13 GB 0.6 3.1 1.9 1.3 3.1 1.8 0.1 1.7 103.7 101.9 30.96 14.99 17 1.821 2212K 2063 0.0 0.0 L4 183/24 11.67 GB 1.0 8.3 4.6 3.7 8.2 4.5 0.5 1.8 117.4 115.8 72.18 39.63 45 1.604 2967K 1510 0.0 0.0 L5 1116/0 91.84 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1333/42 106.38 GB 0.0 13.0 7.2 5.8 14.6 8.8 3.5 8.2 102.6 115.4 129.60 66.92 91 1.424 6825K 7749 0.0 0.0 Int 0/0 0.00 KB 0.0 13.0 7.2 5.8 14.6 8.8 3.5 8.2 102.6 115.4 129.60 66.92 91 1.424 6825K 7749 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.0 7.2 5.8 12.8 7.0 0.0 0.0 114.8 113.3 115.83 61.76 69 1.679 6825K 7749 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 132.6 13.77 5.16 22 0.626 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.6 total, 14.4 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.60 GB write, 1025.87 MB/s write, 12.99 GB read, 912.50 MB/s read, 129.6 seconds Interval compaction: 14.60 GB write, 1039.22 MB/s write, 12.99 GB read, 924.38 MB/s read, 129.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 53, interval: 53 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 461356 Average: 10.4713 StdDev: 144.31 Min: 1 Median: 1.8781 Max: 22949 Percentiles: P50: 1.88 P75: 2.86 P99: 9.96 P99.9: 1798.37 P99.99: 3743.20 ------------------------------------------------------ [ 0, 1 ] 17325 3.755% 3.755% # ( 1, 2 ] 242972 52.665% 56.420% ########### ( 2, 3 ] 99369 21.538% 77.958% #### ( 3, 4 ] 44626 9.673% 87.631% ## ( 4, 6 ] 43523 9.434% 97.065% ## ( 6, 10 ] 9016 1.954% 99.019% ( 10, 15 ] 1709 0.370% 99.390% ( 15, 22 ] 202 0.044% 99.433% ( 22, 34 ] 13 0.003% 99.436% ( 34, 51 ] 16 0.003% 99.440% ( 51, 76 ] 22 0.005% 99.444% ( 76, 110 ] 3 0.001% 99.445% ( 110, 170 ] 17 0.004% 99.449% ( 170, 250 ] 86 0.019% 99.467% ( 250, 380 ] 196 0.042% 99.510% ( 380, 580 ] 400 0.087% 99.597% ( 580, 870 ] 596 0.129% 99.726% ( 870, 1300 ] 543 0.118% 99.844% ( 1300, 1900 ] 315 0.068% 99.912% ( 1900, 2900 ] 250 0.054% 99.966% ( 2900, 4400 ] 199 0.043% 100.009% ( 4400, 6600 ] 56 0.012% 100.021% ( 6600, 9900 ] 4 0.001% 100.022% ( 9900, 14000 ] 7 0.002% 100.024% ( 14000, 22000 ] 2 0.000% 100.024% ( 22000, 33000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 158469 Average: 9.0966 StdDev: 134.67 Min: 1 Median: 1.9226 Max: 12069 Percentiles: P50: 1.92 P75: 2.94 P99: 9.85 P99.9: 2019.14 P99.99: 4362.56 ------------------------------------------------------ [ 0, 1 ] 4552 2.872% 2.872% # ( 1, 2 ] 80951 51.083% 53.956% ########## ( 2, 3 ] 35660 22.503% 76.458% ##### ( 3, 4 ] 16420 10.362% 86.820% ## ( 4, 6 ] 16287 10.278% 97.098% ## ( 6, 10 ] 3134 1.978% 99.076% ( 10, 15 ] 694 0.438% 99.513% ( 15, 22 ] 107 0.068% 99.581% ( 22, 34 ] 15 0.009% 99.590% ( 34, 51 ] 17 0.011% 99.601% ( 51, 76 ] 7 0.004% 99.606% ( 76, 110 ] 5 0.003% 99.609% ( 110, 170 ] 13 0.008% 99.617% ( 170, 250 ] 29 0.018% 99.635% ( 250, 380 ] 44 0.028% 99.663% ( 380, 580 ] 92 0.058% 99.721% ( 580, 870 ] 101 0.064% 99.785% ( 870, 1300 ] 106 0.067% 99.852% ( 1300, 1900 ] 67 0.042% 99.894% ( 1900, 2900 ] 80 0.050% 99.944% ( 2900, 4400 ] 74 0.047% 99.991% ( 4400, 6600 ] 21 0.013% 100.004% ( 6600, 9900 ] 7 0.004% 100.009% ( 9900, 14000 ] 1 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 470995 Average: 12.2421 StdDev: 163.58 Min: 1 Median: 1.9867 Max: 19208 Percentiles: P50: 1.99 P75: 3.04 P99: 11.67 P99.9: 1261.38 P99.99: 2024.33 ------------------------------------------------------ [ 0, 1 ] 12407 2.634% 2.634% # ( 1, 2 ] 226102 48.005% 50.639% ########## ( 2, 3 ] 112780 23.945% 74.584% ##### ( 3, 4 ] 49921 10.599% 85.183% ## ( 4, 6 ] 50190 10.656% 95.840% ## ( 6, 10 ] 13889 2.949% 98.789% # ( 10, 15 ] 2985 0.634% 99.422% ( 15, 22 ] 476 0.101% 99.523% ( 22, 34 ] 89 0.019% 99.542% ( 34, 51 ] 39 0.008% 99.551% ( 51, 76 ] 46 0.010% 99.560% ( 76, 110 ] 23 0.005% 99.565% ( 110, 170 ] 53 0.011% 99.576% ( 170, 250 ] 115 0.024% 99.601% ( 250, 380 ] 200 0.042% 99.643% ( 380, 580 ] 353 0.075% 99.718% ( 580, 870 ] 471 0.100% 99.818% ( 870, 1300 ] 423 0.090% 99.908% ( 1300, 1900 ] 344 0.073% 99.981% ( 1900, 2900 ] 337 0.072% 100.053% ( 2900, 4400 ] 324 0.069% 100.121% ( 4400, 6600 ] 117 0.025% 100.146% ( 6600, 9900 ] 22 0.005% 100.151% ( 9900, 14000 ] 1 0.000% 100.151% ( 14000, 22000 ] 1 0.000% 100.151% ** Level 3 read latency histogram (micros): Count: 1456022 Average: 11.1366 StdDev: 155.18 Min: 1 Median: 1.9646 Max: 45962 Percentiles: P50: 1.96 P75: 2.98 P99: 9.72 P99.9: 676.79 P99.99: 962.96 ------------------------------------------------------ [ 0, 1 ] 26882 1.846% 1.846% ( 1, 2 ] 726857 49.921% 51.767% ########## ( 2, 3 ] 343538 23.594% 75.361% ##### ( 3, 4 ] 156158 10.725% 86.086% ## ( 4, 6 ] 153178 10.520% 96.607% ## ( 6, 10 ] 37490 2.575% 99.181% # ( 10, 15 ] 6995 0.480% 99.662% ( 15, 22 ] 910 0.062% 99.724% ( 22, 34 ] 83 0.006% 99.730% ( 34, 51 ] 103 0.007% 99.737% ( 51, 76 ] 133 0.009% 99.746% ( 76, 110 ] 42 0.003% 99.749% ( 110, 170 ] 70 0.005% 99.754% ( 170, 250 ] 200 0.014% 99.768% ( 250, 380 ] 458 0.031% 99.799% ( 380, 580 ] 981 0.067% 99.866% ( 580, 870 ] 1462 0.100% 99.967% ( 870, 1300 ] 1556 0.107% 100.074% ( 1300, 1900 ] 1109 0.076% 100.150% ( 1900, 2900 ] 902 0.062% 100.212% ( 2900, 4400 ] 849 0.058% 100.270% ( 4400, 6600 ] 232 0.016% 100.286% ( 6600, 9900 ] 38 0.003% 100.289% ( 9900, 14000 ] 6 0.000% 100.289% ( 14000, 22000 ] 3 0.000% 100.289% ( 22000, 33000 ] 2 0.000% 100.289% ( 33000, 50000 ] 1 0.000% 100.290% ** Level 4 read latency histogram (micros): Count: 1293129 Average: 17.4340 StdDev: 203.32 Min: 1 Median: 1.9696 Max: 27537 Percentiles: P50: 1.97 P75: 3.00 P99: 12.69 P99.9: 1247.42 P99.99: 1629.96 ------------------------------------------------------ [ 0, 1 ] 23737 1.836% 1.836% ( 1, 2 ] 642359 49.675% 51.510% ########## ( 2, 3 ] 303991 23.508% 75.019% ##### ( 3, 4 ] 138567 10.716% 85.734% ## ( 4, 6 ] 134783 10.423% 96.157% ## ( 6, 10 ] 33683 2.605% 98.762% # ( 10, 15 ] 5721 0.442% 99.204% ( 15, 22 ] 774 0.060% 99.264% ( 22, 34 ] 62 0.005% 99.269% ( 34, 51 ] 80 0.006% 99.275% ( 51, 76 ] 111 0.009% 99.284% ( 76, 110 ] 45 0.003% 99.287% ( 110, 170 ] 124 0.010% 99.297% ( 170, 250 ] 385 0.030% 99.327% ( 250, 380 ] 802 0.062% 99.389% ( 380, 580 ] 1736 0.134% 99.523% ( 580, 870 ] 2585 0.200% 99.723% ( 870, 1300 ] 2610 0.202% 99.925% ( 1300, 1900 ] 1536 0.119% 100.043% ( 1900, 2900 ] 1378 0.107% 100.150% ( 2900, 4400 ] 1294 0.100% 100.250% ( 4400, 6600 ] 359 0.028% 100.278% ( 6600, 9900 ] 75 0.006% 100.284% ( 9900, 14000 ] 6 0.000% 100.284% ( 14000, 22000 ] 13 0.001% 100.285% ( 22000, 33000 ] 4 0.000% 100.285% ** Level 5 read latency histogram (micros): Count: 30419 Average: 1403.3782 StdDev: 1329.62 Min: 80 Median: 966.4364 Max: 45321 Percentiles: P50: 966.44 P75: 1770.05 P99: 6219.19 P99.9: 9547.54 P99.99: 26307.82 ------------------------------------------------------ ( 76, 110 ] 33 0.108% 0.108% ( 110, 170 ] 248 0.815% 0.924% ( 170, 250 ] 765 2.515% 3.439% # ( 250, 380 ] 2096 6.890% 10.329% # ( 380, 580 ] 4205 13.824% 24.153% ### ( 580, 870 ] 6494 21.348% 45.501% #### ( 870, 1300 ] 6102 20.060% 65.561% #### ( 1300, 1900 ] 3665 12.048% 77.609% ## ( 1900, 2900 ] 2895 9.517% 87.126% ## ( 2900, 4400 ] 2880 9.468% 96.594% ## ( 4400, 6600 ] 885 2.909% 99.504% # ( 6600, 9900 ] 135 0.444% 99.947% ( 9900, 14000 ] 6 0.020% 99.967% ( 14000, 22000 ] 5 0.016% 99.984% ( 22000, 33000 ] 5 0.016% 100.000% ( 33000, 50000 ] 2 0.007% 100.007% ** DB Stats ** Uptime(secs): 14.6 total, 7.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 135.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.590 H:M:S, 45.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 138.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.201 H:M:S, 45.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/29-15:20:20 ... thread 0: (1000000,3000000) ops and (253903.6,163700.1) ops/second in (3.938503,18.326200) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.78 GB 157.3 1.8 0.0 1.8 4.6 2.8 0.0 1.6 68.9 175.8 26.50 15.28 43 0.616 1854K 2160 0.0 0.0 L1 4/0 422.49 MB 42.2 1.3 1.1 0.2 1.3 1.1 0.0 1.2 129.2 128.9 9.96 5.97 3 3.320 1307K 3189 0.0 0.0 L2 1/0 41.47 MB 0.4 0.5 0.4 0.1 0.5 0.4 0.4 1.2 107.1 106.5 4.97 2.50 3 1.656 540K 3027 0.0 0.0 L3 19/3 1.16 GB 1.0 4.2 2.2 2.0 4.2 2.1 0.2 1.9 115.7 114.0 37.28 20.05 21 1.775 2939K 4942 0.0 0.0 L4 166/4 9.74 GB 1.0 10.6 4.9 5.7 10.3 4.6 0.6 2.1 124.2 120.9 87.09 49.17 49 1.777 3300K 1510 0.0 0.0 L5 1146/0 94.06 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1346/11 107.19 GB 0.0 18.3 8.6 9.8 20.8 11.0 6.4 7.5 113.3 128.2 165.80 92.98 119 1.393 9942K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.3 8.6 9.8 20.8 11.0 6.4 7.5 113.3 128.2 165.80 92.98 119 1.393 9942K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.3 8.6 9.8 18.0 8.2 0.0 0.0 126.6 124.2 148.27 85.00 82 1.808 9942K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 161.7 17.53 7.98 37 0.474 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.5 total, 18.3 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.76 GB write, 1148.02 MB/s write, 18.34 GB read, 1014.22 MB/s read, 165.8 seconds Interval compaction: 20.76 GB write, 1159.75 MB/s write, 18.34 GB read, 1024.58 MB/s read, 165.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 62, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 767196 Average: 8.4237 StdDev: 118.06 Min: 0 Median: 1.7889 Max: 22949 Percentiles: P50: 1.79 P75: 2.68 P99: 9.71 P99.9: 1298.58 P99.99: 3142.95 ------------------------------------------------------ [ 0, 1 ] 45962 5.991% 5.991% # ( 1, 2 ] 427985 55.786% 61.777% ########### ( 2, 3 ] 149858 19.533% 81.310% #### ( 3, 4 ] 65426 8.528% 89.838% ## ( 4, 6 ] 59553 7.762% 97.600% ## ( 6, 10 ] 11572 1.508% 99.108% ( 10, 15 ] 2304 0.300% 99.409% ( 15, 22 ] 265 0.035% 99.443% ( 22, 34 ] 16 0.002% 99.445% ( 34, 51 ] 31 0.004% 99.449% ( 51, 76 ] 31 0.004% 99.453% ( 76, 110 ] 67 0.009% 99.462% ( 110, 170 ] 344 0.045% 99.507% ( 170, 250 ] 388 0.051% 99.558% ( 250, 380 ] 458 0.060% 99.617% ( 380, 580 ] 697 0.091% 99.708% ( 580, 870 ] 812 0.106% 99.814% ( 870, 1300 ] 663 0.086% 99.900% ( 1300, 1900 ] 360 0.047% 99.947% ( 1900, 2900 ] 292 0.038% 99.985% ( 2900, 4400 ] 224 0.029% 100.015% ( 4400, 6600 ] 59 0.008% 100.022% ( 6600, 9900 ] 4 0.001% 100.023% ( 9900, 14000 ] 7 0.001% 100.024% ( 14000, 22000 ] 2 0.000% 100.024% ( 22000, 33000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 217901 Average: 8.6663 StdDev: 122.05 Min: 1 Median: 1.8939 Max: 12069 Percentiles: P50: 1.89 P75: 2.87 P99: 9.95 P99.9: 1731.08 P99.99: 4259.22 ------------------------------------------------------ [ 0, 1 ] 6551 3.006% 3.006% # ( 1, 2 ] 114555 52.572% 55.578% ########### ( 2, 3 ] 48479 22.248% 77.827% #### ( 3, 4 ] 21251 9.753% 87.579% ## ( 4, 6 ] 20670 9.486% 97.065% ## ( 6, 10 ] 4264 1.957% 99.022% ( 10, 15 ] 832 0.382% 99.404% ( 15, 22 ] 130 0.060% 99.464% ( 22, 34 ] 17 0.008% 99.471% ( 34, 51 ] 19 0.009% 99.480% ( 51, 76 ] 10 0.005% 99.485% ( 76, 110 ] 22 0.010% 99.495% ( 110, 170 ] 107 0.049% 99.544% ( 170, 250 ] 120 0.055% 99.599% ( 250, 380 ] 108 0.050% 99.648% ( 380, 580 ] 178 0.082% 99.730% ( 580, 870 ] 159 0.073% 99.803% ( 870, 1300 ] 145 0.067% 99.870% ( 1300, 1900 ] 92 0.042% 99.912% ( 1900, 2900 ] 95 0.044% 99.955% ( 2900, 4400 ] 83 0.038% 99.994% ( 4400, 6600 ] 22 0.010% 100.004% ( 6600, 9900 ] 7 0.003% 100.007% ( 9900, 14000 ] 1 0.000% 100.007% ** Level 2 read latency histogram (micros): Count: 501425 Average: 11.9261 StdDev: 159.82 Min: 1 Median: 1.9845 Max: 19208 Percentiles: P50: 1.98 P75: 3.02 P99: 11.54 P99.9: 1254.03 P99.99: 2045.78 ------------------------------------------------------ [ 0, 1 ] 12718 2.536% 2.536% # ( 1, 2 ] 241734 48.209% 50.746% ########## ( 2, 3 ] 120729 24.077% 74.823% ##### ( 3, 4 ] 52722 10.514% 85.337% ## ( 4, 6 ] 52950 10.560% 95.897% ## ( 6, 10 ] 14605 2.913% 98.810% # ( 10, 15 ] 3092 0.617% 99.427% ( 15, 22 ] 483 0.096% 99.523% ( 22, 34 ] 90 0.018% 99.541% ( 34, 51 ] 40 0.008% 99.549% ( 51, 76 ] 48 0.010% 99.558% ( 76, 110 ] 25 0.005% 99.563% ( 110, 170 ] 54 0.011% 99.574% ( 170, 250 ] 123 0.025% 99.599% ( 250, 380 ] 219 0.044% 99.642% ( 380, 580 ] 377 0.075% 99.718% ( 580, 870 ] 510 0.102% 99.819% ( 870, 1300 ] 453 0.090% 99.910% ( 1300, 1900 ] 353 0.070% 99.980% ( 1900, 2900 ] 342 0.068% 100.048% ( 2900, 4400 ] 329 0.066% 100.114% ( 4400, 6600 ] 118 0.024% 100.137% ( 6600, 9900 ] 22 0.004% 100.142% ( 9900, 14000 ] 1 0.000% 100.142% ( 14000, 22000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 1706345 Average: 10.4128 StdDev: 146.45 Min: 1 Median: 1.9396 Max: 45962 Percentiles: P50: 1.94 P75: 2.94 P99: 9.70 P99.9: 672.37 P99.99: 973.71 ------------------------------------------------------ [ 0, 1 ] 34193 2.004% 2.004% ( 1, 2 ] 871609 51.080% 53.084% ########## ( 2, 3 ] 397770 23.311% 76.396% ##### ( 3, 4 ] 175851 10.306% 86.701% ## ( 4, 6 ] 170472 9.990% 96.692% ## ( 6, 10 ] 42557 2.494% 99.186% ( 10, 15 ] 7617 0.446% 99.632% ( 15, 22 ] 976 0.057% 99.689% ( 22, 34 ] 89 0.005% 99.695% ( 34, 51 ] 114 0.007% 99.701% ( 51, 76 ] 141 0.008% 99.710% ( 76, 110 ] 99 0.006% 99.715% ( 110, 170 ] 272 0.016% 99.731% ( 170, 250 ] 435 0.025% 99.757% ( 250, 380 ] 701 0.041% 99.798% ( 380, 580 ] 1212 0.071% 99.869% ( 580, 870 ] 1666 0.098% 99.967% ( 870, 1300 ] 1660 0.097% 100.064% ( 1300, 1900 ] 1161 0.068% 100.132% ( 1900, 2900 ] 942 0.055% 100.187% ( 2900, 4400 ] 887 0.052% 100.239% ( 4400, 6600 ] 236 0.014% 100.253% ( 6600, 9900 ] 38 0.002% 100.255% ( 9900, 14000 ] 6 0.000% 100.255% ( 14000, 22000 ] 4 0.000% 100.256% ( 22000, 33000 ] 2 0.000% 100.256% ( 33000, 50000 ] 1 0.000% 100.256% ** Level 4 read latency histogram (micros): Count: 1513566 Average: 17.0959 StdDev: 194.11 Min: 1 Median: 1.9527 Max: 27537 Percentiles: P50: 1.95 P75: 2.98 P99: 19.36 P99.9: 1251.64 P99.99: 1667.79 ------------------------------------------------------ [ 0, 1 ] 30239 1.998% 1.998% ( 1, 2 ] 762626 50.386% 52.384% ########## ( 2, 3 ] 350955 23.187% 75.571% ##### ( 3, 4 ] 158048 10.442% 86.013% ## ( 4, 6 ] 151138 9.986% 95.999% ## ( 6, 10 ] 38603 2.550% 98.549% # ( 10, 15 ] 6288 0.415% 98.965% ( 15, 22 ] 856 0.057% 99.021% ( 22, 34 ] 69 0.005% 99.026% ( 34, 51 ] 90 0.006% 99.032% ( 51, 76 ] 127 0.008% 99.040% ( 76, 110 ] 298 0.020% 99.060% ( 110, 170 ] 1132 0.075% 99.135% ( 170, 250 ] 1481 0.098% 99.233% ( 250, 380 ] 1621 0.107% 99.340% ( 380, 580 ] 2640 0.174% 99.514% ( 580, 870 ] 3234 0.214% 99.728% ( 870, 1300 ] 2939 0.194% 99.922% ( 1300, 1900 ] 1683 0.111% 100.033% ( 1900, 2900 ] 1482 0.098% 100.131% ( 2900, 4400 ] 1386 0.092% 100.223% ( 4400, 6600 ] 369 0.024% 100.247% ( 6600, 9900 ] 75 0.005% 100.252% ( 9900, 14000 ] 6 0.000% 100.252% ( 14000, 22000 ] 14 0.001% 100.253% ( 22000, 33000 ] 4 0.000% 100.254% ** Level 5 read latency histogram (micros): Count: 55904 Average: 963.8087 StdDev: 1151.36 Min: 76 Median: 591.7517 Max: 45321 Percentiles: P50: 591.75 P75: 1164.74 P99: 5625.62 P99.9: 8993.60 P99.99: 19879.47 ------------------------------------------------------ ( 51, 76 ] 1 0.002% 0.002% ( 76, 110 ] 1429 2.556% 2.558% # ( 110, 170 ] 5980 10.697% 13.255% ## ( 170, 250 ] 5759 10.302% 23.556% ## ( 250, 380 ] 6259 11.196% 34.752% ## ( 380, 580 ] 8150 14.579% 49.331% ### ( 580, 870 ] 9254 16.553% 65.884% ### ( 870, 1300 ] 7436 13.301% 79.186% ### ( 1300, 1900 ] 4171 7.461% 86.647% # ( 1900, 2900 ] 3279 5.865% 92.512% # ( 2900, 4400 ] 3121 5.583% 98.095% # ( 4400, 6600 ] 910 1.628% 99.723% ( 6600, 9900 ] 138 0.247% 99.970% ( 9900, 14000 ] 8 0.014% 99.984% ( 14000, 22000 ] 6 0.011% 99.995% ( 22000, 33000 ] 5 0.009% 100.004% ( 33000, 50000 ] 2 0.004% 100.007% ** DB Stats ** Uptime(secs): 18.5 total, 3.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 159.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.869 H:M:S, 37.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 249.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.279 H:M:S, 7.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/29-15:20:23 ... thread 0: (1000000,4000000) ops and (290661.8,183767.6) ops/second in (3.440425,21.766625) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.77 GB 258.0 2.8 0.0 2.8 6.5 3.7 0.0 1.7 84.4 198.8 33.58 21.81 63 0.533 2878K 3108 0.0 0.0 L1 4/0 422.49 MB 42.2 1.3 1.1 0.2 1.3 1.1 0.0 1.2 129.2 128.9 9.96 5.97 3 3.320 1307K 3189 0.0 0.0 L2 1/0 41.47 MB 0.4 0.5 0.4 0.1 0.5 0.4 0.4 1.2 107.1 106.5 4.97 2.50 3 1.656 540K 3027 0.0 0.0 L3 16/0 998.05 MB 1.0 4.2 2.2 2.0 4.2 2.1 0.2 1.9 115.7 114.0 37.28 20.05 21 1.775 2939K 4942 0.0 0.0 L4 165/0 9.60 GB 1.0 10.9 5.1 5.9 10.7 4.8 0.6 2.1 125.8 122.4 89.14 51.04 52 1.714 3606K 4070 0.0 0.0 L5 1150/0 94.37 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1350/4 108.16 GB 0.0 19.7 8.7 11.0 23.1 12.1 6.7 6.2 115.3 135.2 174.93 101.38 142 1.232 11M 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.7 8.7 11.0 23.1 12.1 6.7 6.2 115.3 135.2 174.93 101.38 142 1.232 11M 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.7 8.7 11.0 19.3 8.4 0.0 0.0 130.8 128.4 154.28 90.71 89 1.734 11M 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 186.1 20.65 10.66 53 0.390 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.0 total, 21.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.10 GB write, 1077.34 MB/s write, 19.70 GB read, 919.00 MB/s read, 174.9 seconds Interval compaction: 23.10 GB write, 1086.60 MB/s write, 19.70 GB read, 926.91 MB/s read, 174.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 62, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1031486 Average: 7.3994 StdDev: 102.99 Min: 0 Median: 1.6728 Max: 22949 Percentiles: P50: 1.67 P75: 2.40 P99: 9.96 P99.9: 1091.02 P99.99: 2696.11 ------------------------------------------------------ [ 0, 1 ] 125864 12.202% 12.202% ## ( 1, 2 ] 579474 56.179% 68.381% ########### ( 2, 3 ] 169153 16.399% 84.780% ### ( 3, 4 ] 71641 6.945% 91.725% # ( 4, 6 ] 62924 6.100% 97.825% # ( 6, 10 ] 12238 1.186% 99.012% ( 10, 15 ] 2523 0.245% 99.257% ( 15, 22 ] 286 0.028% 99.284% ( 22, 34 ] 18 0.002% 99.286% ( 34, 51 ] 32 0.003% 99.289% ( 51, 76 ] 32 0.003% 99.292% ( 76, 110 ] 487 0.047% 99.339% ( 110, 170 ] 1734 0.168% 99.508% ( 170, 250 ] 1103 0.107% 99.614% ( 250, 380 ] 748 0.073% 99.687% ( 380, 580 ] 955 0.093% 99.780% ( 580, 870 ] 894 0.087% 99.866% ( 870, 1300 ] 680 0.066% 99.932% ( 1300, 1900 ] 363 0.035% 99.967% ( 1900, 2900 ] 295 0.029% 99.996% ( 2900, 4400 ] 226 0.022% 100.018% ( 4400, 6600 ] 59 0.006% 100.024% ( 6600, 9900 ] 4 0.000% 100.024% ( 9900, 14000 ] 7 0.001% 100.025% ( 14000, 22000 ] 2 0.000% 100.025% ( 22000, 33000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 218672 Average: 9.2911 StdDev: 122.54 Min: 1 Median: 1.8972 Max: 12069 Percentiles: P50: 1.90 P75: 2.88 P99: 14.24 P99.9: 1729.75 P99.99: 4257.82 ------------------------------------------------------ [ 0, 1 ] 6551 2.996% 2.996% # ( 1, 2 ] 114556 52.387% 55.383% ########## ( 2, 3 ] 48482 22.171% 77.554% #### ( 3, 4 ] 21252 9.719% 87.273% ## ( 4, 6 ] 20673 9.454% 96.727% ## ( 6, 10 ] 4264 1.950% 98.677% ( 10, 15 ] 834 0.381% 99.058% ( 15, 22 ] 130 0.059% 99.117% ( 22, 34 ] 17 0.008% 99.125% ( 34, 51 ] 19 0.009% 99.134% ( 51, 76 ] 10 0.005% 99.138% ( 76, 110 ] 163 0.075% 99.213% ( 110, 170 ] 446 0.204% 99.417% ( 170, 250 ] 278 0.127% 99.544% ( 250, 380 ] 176 0.080% 99.625% ( 380, 580 ] 222 0.102% 99.726% ( 580, 870 ] 166 0.076% 99.802% ( 870, 1300 ] 147 0.067% 99.869% ( 1300, 1900 ] 94 0.043% 99.912% ( 1900, 2900 ] 95 0.043% 99.956% ( 2900, 4400 ] 83 0.038% 99.994% ( 4400, 6600 ] 22 0.010% 100.004% ( 6600, 9900 ] 7 0.003% 100.007% ( 9900, 14000 ] 1 0.000% 100.007% ** Level 2 read latency histogram (micros): Count: 501425 Average: 11.9261 StdDev: 159.82 Min: 1 Median: 1.9845 Max: 19208 Percentiles: P50: 1.98 P75: 3.02 P99: 11.54 P99.9: 1254.03 P99.99: 2045.78 ------------------------------------------------------ [ 0, 1 ] 12718 2.536% 2.536% # ( 1, 2 ] 241734 48.209% 50.746% ########## ( 2, 3 ] 120729 24.077% 74.823% ##### ( 3, 4 ] 52722 10.514% 85.337% ## ( 4, 6 ] 52950 10.560% 95.897% ## ( 6, 10 ] 14605 2.913% 98.810% # ( 10, 15 ] 3092 0.617% 99.427% ( 15, 22 ] 483 0.096% 99.523% ( 22, 34 ] 90 0.018% 99.541% ( 34, 51 ] 40 0.008% 99.549% ( 51, 76 ] 48 0.010% 99.558% ( 76, 110 ] 25 0.005% 99.563% ( 110, 170 ] 54 0.011% 99.574% ( 170, 250 ] 123 0.025% 99.599% ( 250, 380 ] 219 0.044% 99.642% ( 380, 580 ] 377 0.075% 99.718% ( 580, 870 ] 510 0.102% 99.819% ( 870, 1300 ] 453 0.090% 99.910% ( 1300, 1900 ] 353 0.070% 99.980% ( 1900, 2900 ] 342 0.068% 100.048% ( 2900, 4400 ] 329 0.066% 100.114% ( 4400, 6600 ] 118 0.024% 100.137% ( 6600, 9900 ] 22 0.004% 100.142% ( 9900, 14000 ] 1 0.000% 100.142% ( 14000, 22000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 1723255 Average: 10.4126 StdDev: 146.72 Min: 1 Median: 1.9374 Max: 45962 Percentiles: P50: 1.94 P75: 2.94 P99: 9.74 P99.9: 669.71 P99.99: 971.59 ------------------------------------------------------ [ 0, 1 ] 35033 2.033% 2.033% ( 1, 2 ] 881818 51.172% 53.205% ########## ( 2, 3 ] 400784 23.257% 76.462% ##### ( 3, 4 ] 176944 10.268% 86.730% ## ( 4, 6 ] 171371 9.945% 96.675% ## ( 6, 10 ] 42856 2.487% 99.162% ( 10, 15 ] 7632 0.443% 99.604% ( 15, 22 ] 980 0.057% 99.661% ( 22, 34 ] 89 0.005% 99.666% ( 34, 51 ] 114 0.007% 99.673% ( 51, 76 ] 141 0.008% 99.681% ( 76, 110 ] 210 0.012% 99.693% ( 110, 170 ] 517 0.030% 99.723% ( 170, 250 ] 540 0.031% 99.755% ( 250, 380 ] 743 0.043% 99.798% ( 380, 580 ] 1241 0.072% 99.870% ( 580, 870 ] 1677 0.097% 99.967% ( 870, 1300 ] 1662 0.096% 100.064% ( 1300, 1900 ] 1161 0.067% 100.131% ( 1900, 2900 ] 942 0.055% 100.186% ( 2900, 4400 ] 887 0.051% 100.237% ( 4400, 6600 ] 236 0.014% 100.251% ( 6600, 9900 ] 38 0.002% 100.253% ( 9900, 14000 ] 6 0.000% 100.253% ( 14000, 22000 ] 6 0.000% 100.254% ( 22000, 33000 ] 2 0.000% 100.254% ( 33000, 50000 ] 1 0.000% 100.254% ** Level 4 read latency histogram (micros): Count: 1540437 Average: 17.8476 StdDev: 193.77 Min: 1 Median: 1.9545 Max: 27537 Percentiles: P50: 1.95 P75: 2.99 P99: 182.61 P99.9: 1247.02 P99.99: 1663.33 ------------------------------------------------------ [ 0, 1 ] 31079 2.018% 2.018% ( 1, 2 ] 774379 50.270% 52.288% ########## ( 2, 3 ] 354600 23.019% 75.307% ##### ( 3, 4 ] 159346 10.344% 85.651% ## ( 4, 6 ] 152223 9.882% 95.533% ## ( 6, 10 ] 38971 2.530% 98.063% # ( 10, 15 ] 6309 0.410% 98.473% ( 15, 22 ] 861 0.056% 98.528% ( 22, 34 ] 70 0.005% 98.533% ( 34, 51 ] 92 0.006% 98.539% ( 51, 76 ] 127 0.008% 98.547% ( 76, 110 ] 1683 0.109% 98.656% ( 110, 170 ] 4835 0.314% 98.970% ( 170, 250 ] 2904 0.189% 99.159% ( 250, 380 ] 2216 0.144% 99.303% ( 380, 580 ] 3184 0.207% 99.509% ( 580, 870 ] 3417 0.222% 99.731% ( 870, 1300 ] 2966 0.193% 99.924% ( 1300, 1900 ] 1686 0.109% 100.033% ( 1900, 2900 ] 1486 0.096% 100.130% ( 2900, 4400 ] 1386 0.090% 100.220% ( 4400, 6600 ] 369 0.024% 100.244% ( 6600, 9900 ] 75 0.005% 100.248% ( 9900, 14000 ] 7 0.000% 100.249% ( 14000, 22000 ] 15 0.001% 100.250% ( 22000, 33000 ] 4 0.000% 100.250% ** Level 5 read latency histogram (micros): Count: 102143 Average: 615.2578 StdDev: 942.16 Min: 75 Median: 246.7716 Max: 45321 Percentiles: P50: 246.77 P75: 691.59 P99: 4514.88 P99.9: 7916.63 P99.99: 13446.82 ------------------------------------------------------ ( 51, 76 ] 4 0.004% 0.004% ( 76, 110 ] 10230 10.015% 10.019% ## ( 110, 170 ] 27580 27.001% 37.021% ##### ( 170, 250 ] 13815 13.525% 50.546% ### ( 250, 380 ] 9827 9.621% 60.167% ## ( 380, 580 ] 11233 10.997% 71.164% ## ( 580, 870 ] 10183 9.969% 81.133% ## ( 870, 1300 ] 7571 7.412% 88.545% # ( 1300, 1900 ] 4203 4.115% 92.660% # ( 1900, 2900 ] 3300 3.231% 95.891% # ( 2900, 4400 ] 3128 3.062% 98.953% # ( 4400, 6600 ] 911 0.892% 99.845% ( 6600, 9900 ] 140 0.137% 99.982% ( 9900, 14000 ] 9 0.009% 99.991% ( 14000, 22000 ] 7 0.007% 99.998% ( 22000, 33000 ] 5 0.005% 100.003% ( 33000, 50000 ] 2 0.002% 100.005% ** DB Stats ** Uptime(secs): 22.0 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 179.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.869 H:M:S, 31.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-15:20:27 ... thread 0: (1000000,5000000) ops and (286676.1,197981.5) ops/second in (3.488257,25.254882) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/4 3.75 GB 358.7 3.8 0.0 3.8 8.5 4.7 0.0 1.8 95.2 215.2 40.37 28.14 83 0.486 3901K 4129 0.0 0.0 L1 4/0 422.49 MB 42.2 1.3 1.1 0.2 1.3 1.1 0.0 1.2 129.2 128.9 9.96 5.97 3 3.320 1307K 3189 0.0 0.0 L2 1/0 41.47 MB 0.4 0.5 0.4 0.1 0.5 0.4 0.4 1.2 107.1 106.5 4.97 2.50 3 1.656 540K 3027 0.0 0.0 L3 16/0 998.05 MB 1.0 4.2 2.2 2.0 4.2 2.1 0.2 1.9 115.7 114.0 37.28 20.05 21 1.775 2939K 4942 0.0 0.0 L4 165/0 9.60 GB 1.0 10.9 5.1 5.9 10.7 4.8 0.6 2.1 125.8 122.4 89.14 51.04 52 1.714 3606K 4070 0.0 0.0 L5 1150/0 94.37 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1354/4 109.15 GB 0.0 20.7 8.7 11.9 25.1 13.1 6.7 5.3 116.6 141.2 181.72 107.71 162 1.122 12M 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.7 8.7 11.9 25.1 13.1 6.7 5.3 116.6 141.2 181.72 107.71 162 1.122 12M 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.7 8.7 11.9 20.3 8.4 0.0 0.0 134.0 131.7 158.06 94.41 93 1.700 12M 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 205.0 23.66 13.29 69 0.343 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.4 total, 25.3 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.07 GB write, 1008.83 MB/s write, 20.69 GB read, 832.63 MB/s read, 181.7 seconds Interval compaction: 25.07 GB write, 1016.31 MB/s write, 20.69 GB read, 838.80 MB/s read, 181.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 62, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1296912 Average: 6.8988 StdDev: 92.89 Min: 0 Median: 1.6004 Max: 22949 Percentiles: P50: 1.60 P75: 2.18 P99: 12.93 P99.9: 888.10 P99.99: 2365.69 ------------------------------------------------------ [ 0, 1 ] 211659 16.320% 16.320% ### ( 1, 2 ] 727543 56.098% 72.418% ########### ( 2, 3 ] 185570 14.309% 86.727% ### ( 3, 4 ] 77869 6.004% 92.731% # ( 4, 6 ] 66682 5.142% 97.873% # ( 6, 10 ] 12972 1.000% 98.873% ( 10, 15 ] 2814 0.217% 99.090% ( 15, 22 ] 327 0.025% 99.115% ( 22, 34 ] 21 0.002% 99.117% ( 34, 51 ] 34 0.003% 99.119% ( 51, 76 ] 43 0.003% 99.123% ( 76, 110 ] 1012 0.078% 99.201% ( 110, 170 ] 3648 0.281% 99.482% ( 170, 250 ] 2088 0.161% 99.643% ( 250, 380 ] 1121 0.086% 99.729% ( 380, 580 ] 1215 0.094% 99.823% ( 580, 870 ] 968 0.075% 99.898% ( 870, 1300 ] 691 0.053% 99.951% ( 1300, 1900 ] 367 0.028% 99.979% ( 1900, 2900 ] 297 0.023% 100.002% ( 2900, 4400 ] 227 0.018% 100.020% ( 4400, 6600 ] 59 0.005% 100.024% ( 6600, 9900 ] 4 0.000% 100.025% ( 9900, 14000 ] 7 0.001% 100.025% ( 14000, 22000 ] 2 0.000% 100.025% ( 22000, 33000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 219479 Average: 9.9320 StdDev: 122.97 Min: 1 Median: 1.9008 Max: 12069 Percentiles: P50: 1.90 P75: 2.90 P99: 123.19 P99.9: 1724.60 P99.99: 4256.36 ------------------------------------------------------ [ 0, 1 ] 6551 2.985% 2.985% # ( 1, 2 ] 114556 52.195% 55.179% ########## ( 2, 3 ] 48482 22.090% 77.269% #### ( 3, 4 ] 21252 9.683% 86.952% ## ( 4, 6 ] 20673 9.419% 96.371% ## ( 6, 10 ] 4264 1.943% 98.314% ( 10, 15 ] 834 0.380% 98.694% ( 15, 22 ] 130 0.059% 98.753% ( 22, 34 ] 17 0.008% 98.761% ( 34, 51 ] 19 0.009% 98.769% ( 51, 76 ] 10 0.005% 98.774% ( 76, 110 ] 310 0.141% 98.915% ( 110, 170 ] 847 0.386% 99.301% ( 170, 250 ] 419 0.191% 99.492% ( 250, 380 ] 230 0.105% 99.597% ( 380, 580 ] 269 0.123% 99.719% ( 580, 870 ] 183 0.083% 99.803% ( 870, 1300 ] 147 0.067% 99.870% ( 1300, 1900 ] 94 0.043% 99.913% ( 1900, 2900 ] 95 0.043% 99.956% ( 2900, 4400 ] 83 0.038% 99.994% ( 4400, 6600 ] 22 0.010% 100.004% ( 6600, 9900 ] 7 0.003% 100.007% ( 9900, 14000 ] 1 0.000% 100.007% ** Level 2 read latency histogram (micros): Count: 501425 Average: 11.9261 StdDev: 159.82 Min: 1 Median: 1.9845 Max: 19208 Percentiles: P50: 1.98 P75: 3.02 P99: 11.54 P99.9: 1254.03 P99.99: 2045.78 ------------------------------------------------------ [ 0, 1 ] 12718 2.536% 2.536% # ( 1, 2 ] 241734 48.209% 50.746% ########## ( 2, 3 ] 120729 24.077% 74.823% ##### ( 3, 4 ] 52722 10.514% 85.337% ## ( 4, 6 ] 52950 10.560% 95.897% ## ( 6, 10 ] 14605 2.913% 98.810% # ( 10, 15 ] 3092 0.617% 99.427% ( 15, 22 ] 483 0.096% 99.523% ( 22, 34 ] 90 0.018% 99.541% ( 34, 51 ] 40 0.008% 99.549% ( 51, 76 ] 48 0.010% 99.558% ( 76, 110 ] 25 0.005% 99.563% ( 110, 170 ] 54 0.011% 99.574% ( 170, 250 ] 123 0.025% 99.599% ( 250, 380 ] 219 0.044% 99.642% ( 380, 580 ] 377 0.075% 99.718% ( 580, 870 ] 510 0.102% 99.819% ( 870, 1300 ] 453 0.090% 99.910% ( 1300, 1900 ] 353 0.070% 99.980% ( 1900, 2900 ] 342 0.068% 100.048% ( 2900, 4400 ] 329 0.066% 100.114% ( 4400, 6600 ] 118 0.024% 100.137% ( 6600, 9900 ] 22 0.004% 100.142% ( 9900, 14000 ] 1 0.000% 100.142% ( 14000, 22000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 1724600 Average: 10.5038 StdDev: 146.74 Min: 1 Median: 1.9381 Max: 45962 Percentiles: P50: 1.94 P75: 2.94 P99: 9.83 P99.9: 671.11 P99.99: 972.41 ------------------------------------------------------ [ 0, 1 ] 35034 2.031% 2.031% ( 1, 2 ] 881874 51.135% 53.166% ########## ( 2, 3 ] 400868 23.244% 76.411% ##### ( 3, 4 ] 177047 10.266% 86.677% ## ( 4, 6 ] 171494 9.944% 96.620% ## ( 6, 10 ] 42876 2.486% 99.107% ( 10, 15 ] 7642 0.443% 99.550% ( 15, 22 ] 980 0.057% 99.607% ( 22, 34 ] 89 0.005% 99.612% ( 34, 51 ] 114 0.007% 99.618% ( 51, 76 ] 141 0.008% 99.627% ( 76, 110 ] 404 0.023% 99.650% ( 110, 170 ] 997 0.058% 99.708% ( 170, 250 ] 692 0.040% 99.748% ( 250, 380 ] 791 0.046% 99.794% ( 380, 580 ] 1303 0.076% 99.869% ( 580, 870 ] 1685 0.098% 99.967% ( 870, 1300 ] 1665 0.097% 100.064% ( 1300, 1900 ] 1162 0.067% 100.131% ( 1900, 2900 ] 942 0.055% 100.186% ( 2900, 4400 ] 887 0.051% 100.237% ( 4400, 6600 ] 236 0.014% 100.251% ( 6600, 9900 ] 38 0.002% 100.253% ( 9900, 14000 ] 6 0.000% 100.253% ( 14000, 22000 ] 6 0.000% 100.254% ( 22000, 33000 ] 2 0.000% 100.254% ( 33000, 50000 ] 1 0.000% 100.254% ** Level 4 read latency histogram (micros): Count: 1548915 Average: 18.7162 StdDev: 193.83 Min: 1 Median: 1.9599 Max: 27537 Percentiles: P50: 1.96 P75: 3.01 P99: 225.18 P99.9: 1246.55 P99.99: 1664.24 ------------------------------------------------------ [ 0, 1 ] 31079 2.007% 2.007% ( 1, 2 ] 774422 49.998% 52.004% ########## ( 2, 3 ] 354686 22.899% 74.903% ##### ( 3, 4 ] 159454 10.295% 85.198% ## ( 4, 6 ] 152337 9.835% 95.033% ## ( 6, 10 ] 39000 2.518% 97.551% # ( 10, 15 ] 6313 0.408% 97.958% ( 15, 22 ] 862 0.056% 98.014% ( 22, 34 ] 70 0.005% 98.018% ( 34, 51 ] 92 0.006% 98.024% ( 51, 76 ] 128 0.008% 98.033% ( 76, 110 ] 3184 0.206% 98.238% ( 110, 170 ] 8833 0.570% 98.809% ( 170, 250 ] 4300 0.278% 99.086% ( 250, 380 ] 2775 0.179% 99.265% ( 380, 580 ] 3687 0.238% 99.503% ( 580, 870 ] 3538 0.228% 99.732% ( 870, 1300 ] 2976 0.192% 99.924% ( 1300, 1900 ] 1687 0.109% 100.033% ( 1900, 2900 ] 1490 0.096% 100.129% ( 2900, 4400 ] 1386 0.089% 100.218% ( 4400, 6600 ] 369 0.024% 100.242% ( 6600, 9900 ] 75 0.005% 100.247% ( 9900, 14000 ] 7 0.000% 100.248% ( 14000, 22000 ] 15 0.001% 100.249% ( 22000, 33000 ] 4 0.000% 100.249% ** Level 5 read latency histogram (micros): Count: 148881 Average: 480.1425 StdDev: 808.77 Min: 75 Median: 187.3119 Max: 45321 Percentiles: P50: 187.31 P75: 481.80 P99: 4197.79 P99.9: 6767.81 P99.99: 10406.53 ------------------------------------------------------ ( 51, 76 ] 8 0.005% 0.005% ( 76, 110 ] 18910 12.701% 12.707% ### ( 110, 170 ] 50819 34.134% 46.841% ####### ( 170, 250 ] 21740 14.602% 61.443% ### ( 250, 380 ] 13011 8.739% 70.182% ## ( 380, 580 ] 14094 9.467% 79.649% ## ( 580, 870 ] 10899 7.321% 86.969% # ( 870, 1300 ] 7671 5.152% 92.122% # ( 1300, 1900 ] 4214 2.830% 94.952% # ( 1900, 2900 ] 3320 2.230% 97.182% ( 2900, 4400 ] 3129 2.102% 99.284% ( 4400, 6600 ] 911 0.612% 99.896% ( 6600, 9900 ] 140 0.094% 99.990% ( 9900, 14000 ] 9 0.006% 99.996% ( 14000, 22000 ] 7 0.005% 100.001% ( 22000, 33000 ] 5 0.003% 100.004% ( 33000, 50000 ] 2 0.001% 100.005% ** DB Stats ** Uptime(secs): 25.4 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 193.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.941 H:M:S, 27.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 282.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.072 H:M:S, 2.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 259.737 micros/op 15385 ops/sec 60.122 seconds 924996 operations; 14.9 MB/s (228999 of 228999 found) Microseconds per read: Count: 924996 Average: 259.7390 StdDev: 734.88 Min: 2 Median: 173.4417 Max: 82354 Percentiles: P50: 173.44 P75: 233.61 P99: 1789.70 P99.9: 11630.23 P99.99: 28252.17 ------------------------------------------------------ ( 1, 2 ] 6 0.001% 0.001% ( 2, 3 ] 48 0.005% 0.006% ( 3, 4 ] 37 0.004% 0.010% ( 4, 6 ] 89 0.010% 0.019% ( 6, 10 ] 574 0.062% 0.082% ( 10, 15 ] 4063 0.439% 0.521% ( 15, 22 ] 3732 0.403% 0.924% ( 22, 34 ] 10914 1.180% 2.104% ( 34, 51 ] 3450 0.373% 2.477% ( 51, 76 ] 498 0.054% 2.531% ( 76, 110 ] 20735 2.242% 4.773% ( 110, 170 ] 405125 43.797% 48.570% ######### ( 170, 250 ] 307452 33.238% 81.808% ####### ( 250, 380 ] 91906 9.936% 91.744% ## ( 380, 580 ] 36562 3.953% 95.697% # ( 580, 870 ] 17214 1.861% 97.558% ( 870, 1300 ] 9483 1.025% 98.583% ( 1300, 1900 ] 4727 0.511% 99.094% ( 1900, 2900 ] 3431 0.371% 99.465% ( 2900, 4400 ] 2718 0.294% 99.759% ( 4400, 6600 ] 778 0.084% 99.843% ( 6600, 9900 ] 318 0.034% 99.877% ( 9900, 14000 ] 500 0.054% 99.931% ( 14000, 22000 ] 477 0.052% 99.983% ( 22000, 33000 ] 117 0.013% 99.995% ( 33000, 50000 ] 27 0.003% 99.998% ( 50000, 75000 ] 14 0.002% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 18717476 rocksdb.bloom.filter.full.positive COUNT : 1107117 rocksdb.bloom.filter.full.true.positive COUNT : 924568 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 428 rocksdb.memtable.miss COUNT : 924568 rocksdb.l0.hit COUNT : 38069 rocksdb.l1.hit COUNT : 3699 rocksdb.l2andup.hit COUNT : 882800 rocksdb.compaction.key.drop.new COUNT : 402333 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5830584 rocksdb.number.keys.read COUNT : 924996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6017162688 rocksdb.bytes.read COUNT : 924996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1690 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 38126181 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 24758675902 rocksdb.compact.write.bytes COUNT : 24347913410 rocksdb.flush.write.bytes COUNT : 6011372551 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 25 rocksdb.number.superversion_acquires COUNT : 1173 rocksdb.number.superversion_releases COUNT : 1135 rocksdb.number.superversion_cleanups COUNT : 295 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 326 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5962830848 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2256896 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29420492165 rocksdb.non.last.level.read.count COUNT : 6968443 rocksdb.block.checksum.compute.count COUNT : 7118164 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 171.837717 P95 : 543.945743 P99 : 1788.569250 P100 : 82353.000000 COUNT : 924996 SUM : 239449618 rocksdb.db.write.micros P50 : 1.547283 P95 : 4.333774 P99 : 8.818643 P100 : 876003.000000 COUNT : 5830584 SUM : 52807094 rocksdb.compaction.times.micros P50 : 1443939.393939 P95 : 3110000.000000 P99 : 5966500.000000 P100 : 6213148.000000 COUNT : 97 SUM : 161824252 rocksdb.compaction.times.cpu_micros P50 : 957878.787879 P95 : 1975000.000000 P99 : 3847333.333333 P100 : 3918715.000000 COUNT : 97 SUM : 98112952 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 833.750000 P95 : 137750.000000 P99 : 412300.000000 P100 : 541596.000000 COUNT : 83 SUM : 1668025 rocksdb.compaction.outfile.sync.micros P50 : 28531.250000 P95 : 253791.666667 P99 : 435100.000000 P100 : 794774.000000 COUNT : 313 SUM : 22256997 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 347.500000 P95 : 3684.090909 P99 : 5698.000000 P100 : 6454.000000 COUNT : 205 SUM : 195950 rocksdb.table.open.io.micros P50 : 8454.947368 P95 : 19325.714286 P99 : 26004.000000 P100 : 35532.000000 COUNT : 1690 SUM : 14286554 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.046163 P95 : 9.905230 P99 : 161.485349 P100 : 45968.000000 COUNT : 5997172 SUM : 85988176 rocksdb.read.block.get.micros P50 : 136.209925 P95 : 428.003964 P99 : 1621.170890 P100 : 45326.000000 COUNT : 1119344 SUM : 204171775 rocksdb.write.raw.block.micros P50 : 0.527864 P95 : 1.084312 P99 : 3.682763 P100 : 41807.000000 COUNT : 7353407 SUM : 22327494 rocksdb.numfiles.in.singlecompaction P50 : 2.983871 P95 : 5.875000 P99 : 9.800000 P100 : 21.000000 COUNT : 125 SUM : 445 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.578430 P95 : 2086.704323 P99 : 2738.818162 P100 : 875837.000000 COUNT : 150084 SUM : 38140221 rocksdb.sst.read.micros P50 : 2.108730 P95 : 159.544341 P99 : 485.569758 P100 : 45962.000000 COUNT : 6968545 SUM : 272875745 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 924996 SUM : 924996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5830584 SUM : 6017162688 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 228245.614035 P95 : 917800.000000 P99 : 1101548.000000 P100 : 1101548.000000 COUNT : 83 SUM : 26454425 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 334 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0