[2024-12-07 16:01:53.964749] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-07 16:01:53.964894] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid727872 ] Set seed to 1733583713961276 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-07 16:01:54.068121] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-07 16:01:54.109021] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-07 16:01:54.109059] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 727872' to capture a snapshot of events at runtime. [2024-12-07 16:01:54.109072] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid727872 for offline analysis/debug. [2024-12-07 16:01:54.109096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 7 16:01:58 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/07-16:02:05 ... thread 0: (1000000,1000000) ops and (139752.6,139752.6) ops/second in (7.155502,7.155502) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 1.66 GB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 124.4 6.58 2.34 9 0.732 0 0 0.0 0.0 L1 5/5 398.73 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 37/8 2.84 GB 2.2 1.9 1.4 0.5 1.9 1.4 0.3 1.4 90.4 89.7 21.48 9.05 14 1.534 1193K 0 0.0 0.0 L4 187/16 12.30 GB 1.2 3.5 2.3 1.2 3.5 2.3 0.3 1.5 105.3 104.5 34.36 16.45 24 1.432 1088K 0 0.0 0.0 L5 1084/0 89.08 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1324/40 106.26 GB 0.0 5.4 3.7 1.7 6.2 4.5 0.6 7.7 89.1 101.5 62.42 27.83 47 1.328 2281K 0 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 3.7 1.7 6.2 4.5 0.6 7.7 89.1 101.5 62.42 27.83 47 1.328 2281K 0 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 3.7 1.7 5.4 3.7 0.0 0.0 99.6 98.8 55.84 25.49 38 1.469 2281K 0 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 124.4 6.58 2.34 9 0.732 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.3 total, 7.2 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.19 GB write, 864.92 MB/s write, 5.43 GB read, 759.46 MB/s read, 62.4 seconds Interval compaction: 6.19 GB write, 884.96 MB/s write, 5.43 GB read, 777.06 MB/s read, 62.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 36, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 316985 Average: 13.2849 StdDev: 163.99 Min: 1 Median: 1.8530 Max: 9769 Percentiles: P50: 1.85 P75: 2.92 P99: 12.69 P99.9: 2657.63 P99.99: 4277.40 ------------------------------------------------------ [ 0, 1 ] 18563 5.856% 5.856% # ( 1, 2 ] 164049 51.753% 57.609% ########## ( 2, 3 ] 59984 18.923% 76.532% #### ( 3, 4 ] 30781 9.711% 86.243% ## ( 4, 6 ] 31682 9.995% 96.238% ## ( 6, 10 ] 7835 2.472% 98.709% ( 10, 15 ] 1712 0.540% 99.249% ( 15, 22 ] 246 0.078% 99.327% ( 22, 34 ] 42 0.013% 99.340% ( 34, 51 ] 16 0.005% 99.345% ( 51, 76 ] 18 0.006% 99.351% ( 76, 110 ] 7 0.002% 99.353% ( 110, 170 ] 19 0.006% 99.359% ( 170, 250 ] 49 0.015% 99.375% ( 250, 380 ] 104 0.033% 99.408% ( 380, 580 ] 249 0.079% 99.486% ( 580, 870 ] 392 0.124% 99.610% ( 870, 1300 ] 410 0.129% 99.739% ( 1300, 1900 ] 311 0.098% 99.837% ( 1900, 2900 ] 264 0.083% 99.921% ( 2900, 4400 ] 241 0.076% 99.997% ( 4400, 6600 ] 73 0.023% 100.020% ( 6600, 9900 ] 11 0.003% 100.023% ** Level 1 read latency histogram (micros): Count: 52 Average: 1652.5577 StdDev: 1307.51 Min: 256 Median: 1156.6667 Max: 4946 Percentiles: P50: 1156.67 P75: 2471.43 P99: 4946.00 P99.9: 4946.00 P99.99: 4946.00 ------------------------------------------------------ ( 250, 380 ] 5 9.615% 9.615% ## ( 380, 580 ] 5 9.615% 19.231% ## ( 580, 870 ] 10 19.231% 38.462% #### ( 870, 1300 ] 9 17.308% 55.769% ### ( 1300, 1900 ] 6 11.538% 67.308% ## ( 1900, 2900 ] 7 13.462% 80.769% ### ( 2900, 4400 ] 8 15.385% 96.154% ### ( 4400, 6600 ] 2 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 302947 Average: 13.3569 StdDev: 165.59 Min: 1 Median: 1.8810 Max: 8230 Percentiles: P50: 1.88 P75: 2.99 P99: 13.04 P99.9: 1757.56 P99.99: 2648.02 ------------------------------------------------------ [ 0, 1 ] 18918 6.245% 6.245% # ( 1, 2 ] 150454 49.663% 55.908% ########## ( 2, 3 ] 58489 19.307% 75.215% #### ( 3, 4 ] 30934 10.211% 85.426% ## ( 4, 6 ] 31392 10.362% 95.788% ## ( 6, 10 ] 8414 2.777% 98.565% # ( 10, 15 ] 2163 0.714% 99.279% ( 15, 22 ] 371 0.122% 99.402% ( 22, 34 ] 84 0.028% 99.430% ( 34, 51 ] 33 0.011% 99.440% ( 51, 76 ] 20 0.007% 99.447% ( 76, 110 ] 16 0.005% 99.452% ( 110, 170 ] 37 0.012% 99.465% ( 170, 250 ] 85 0.028% 99.493% ( 250, 380 ] 169 0.056% 99.548% ( 380, 580 ] 264 0.087% 99.636% ( 580, 870 ] 280 0.092% 99.728% ( 870, 1300 ] 306 0.101% 99.829% ( 1300, 1900 ] 282 0.093% 99.922% ( 1900, 2900 ] 275 0.091% 100.013% ( 2900, 4400 ] 261 0.086% 100.099% ( 4400, 6600 ] 71 0.023% 100.122% ( 6600, 9900 ] 9 0.003% 100.125% ** Level 3 read latency histogram (micros): Count: 689401 Average: 15.0763 StdDev: 182.90 Min: 1 Median: 1.8837 Max: 10168 Percentiles: P50: 1.88 P75: 2.97 P99: 12.03 P99.9: 1797.57 P99.99: 2589.83 ------------------------------------------------------ [ 0, 1 ] 30563 4.433% 4.433% # ( 1, 2 ] 355479 51.563% 55.997% ########## ( 2, 3 ] 134856 19.561% 75.558% #### ( 3, 4 ] 70898 10.284% 85.842% ## ( 4, 6 ] 72214 10.475% 96.317% ## ( 6, 10 ] 16903 2.452% 98.769% ( 10, 15 ] 3923 0.569% 99.338% ( 15, 22 ] 496 0.072% 99.410% ( 22, 34 ] 60 0.009% 99.418% ( 34, 51 ] 28 0.004% 99.423% ( 51, 76 ] 44 0.006% 99.429% ( 76, 110 ] 41 0.006% 99.435% ( 110, 170 ] 56 0.008% 99.443% ( 170, 250 ] 134 0.019% 99.462% ( 250, 380 ] 265 0.038% 99.501% ( 380, 580 ] 479 0.069% 99.570% ( 580, 870 ] 778 0.113% 99.683% ( 870, 1300 ] 901 0.131% 99.814% ( 1300, 1900 ] 717 0.104% 99.918% ( 1900, 2900 ] 722 0.105% 100.023% ( 2900, 4400 ] 704 0.102% 100.125% ( 4400, 6600 ] 206 0.030% 100.155% ( 6600, 9900 ] 24 0.003% 100.158% ( 9900, 14000 ] 2 0.000% 100.158% ** Level 4 read latency histogram (micros): Count: 394670 Average: 21.2851 StdDev: 218.38 Min: 1 Median: 1.8859 Max: 13534 Percentiles: P50: 1.89 P75: 2.98 P99: 298.96 P99.9: 2558.19 P99.99: 3328.86 ------------------------------------------------------ [ 0, 1 ] 16341 4.140% 4.140% # ( 1, 2 ] 204310 51.767% 55.908% ########## ( 2, 3 ] 77049 19.522% 75.430% #### ( 3, 4 ] 40480 10.257% 85.687% ## ( 4, 6 ] 41201 10.439% 96.126% ## ( 6, 10 ] 8918 2.260% 98.386% ( 10, 15 ] 1816 0.460% 98.846% ( 15, 22 ] 207 0.052% 98.898% ( 22, 34 ] 21 0.005% 98.904% ( 34, 51 ] 21 0.005% 98.909% ( 51, 76 ] 32 0.008% 98.917% ( 76, 110 ] 17 0.004% 98.921% ( 110, 170 ] 50 0.013% 98.934% ( 170, 250 ] 160 0.041% 98.975% ( 250, 380 ] 269 0.068% 99.043% ( 380, 580 ] 582 0.147% 99.190% ( 580, 870 ] 857 0.217% 99.407% ( 870, 1300 ] 914 0.232% 99.639% ( 1300, 1900 ] 643 0.163% 99.802% ( 1900, 2900 ] 590 0.149% 99.951% ( 2900, 4400 ] 537 0.136% 100.087% ( 4400, 6600 ] 163 0.041% 100.129% ( 6600, 9900 ] 21 0.005% 100.134% ( 9900, 14000 ] 2 0.001% 100.135% ** Level 5 read latency histogram (micros): Count: 11534 Average: 1772.9593 StdDev: 1517.32 Min: 78 Median: 1209.2844 Max: 14489 Percentiles: P50: 1209.28 P75: 2551.80 P99: 6814.22 P99.9: 9717.27 P99.99: 13842.76 ------------------------------------------------------ ( 76, 110 ] 26 0.225% 0.225% ( 110, 170 ] 95 0.824% 1.049% ( 170, 250 ] 221 1.916% 2.965% ( 250, 380 ] 594 5.150% 8.115% # ( 380, 580 ] 1264 10.959% 19.074% ## ( 580, 870 ] 1869 16.204% 35.278% ### ( 870, 1300 ] 2152 18.658% 53.936% #### ( 1300, 1900 ] 1487 12.892% 66.829% ### ( 1900, 2900 ] 1446 12.537% 79.365% ### ( 2900, 4400 ] 1551 13.447% 92.813% ### ( 4400, 6600 ] 706 6.121% 98.934% # ( 6600, 9900 ] 118 1.023% 99.957% ( 9900, 14000 ] 4 0.035% 99.991% ( 14000, 22000 ] 1 0.009% 100.000% ** DB Stats ** Uptime(secs): 7.3 total, 7.2 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 134.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.097 H:M:S, 42.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 137.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.097 H:M:S, 43.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/07-16:02:11 ... thread 0: (1000000,2000000) ops and (167773.9,152486.6) ops/second in (5.960404,13.115906) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 1.84 GB 18.9 1.4 0.0 1.4 3.3 1.8 0.0 1.8 67.0 154.2 21.63 11.34 27 0.801 1471K 2102 0.0 0.0 L1 7/7 793.81 MB 0.0 1.3 0.9 0.4 1.2 0.9 0.0 1.4 116.0 115.7 11.04 6.01 1 11.045 1301K 3843 0.0 0.0 L2 1/0 54.07 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/3 1.22 GB 0.9 2.4 1.6 0.8 2.4 1.6 0.5 1.5 102.2 101.4 24.50 11.63 17 1.441 1597K 1657 0.0 0.0 L4 165/10 9.70 GB 1.0 7.6 4.1 3.5 7.5 4.0 0.6 1.8 114.3 112.7 67.73 35.29 43 1.575 2892K 5607 0.0 0.0 L5 1140/0 93.63 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1342/27 107.22 GB 0.0 12.7 6.6 6.1 14.4 8.3 6.1 7.8 103.9 117.9 124.91 64.28 88 1.419 7262K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.7 6.6 6.1 14.4 8.3 6.1 7.8 103.9 117.9 124.91 64.28 88 1.419 7262K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.7 6.6 6.1 12.5 6.4 0.0 0.0 115.4 114.2 112.41 58.77 65 1.729 7262K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 151.2 12.50 5.50 23 0.544 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.3 total, 13.1 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.39 GB write, 1108.95 MB/s write, 12.67 GB read, 976.83 MB/s read, 124.9 seconds Interval compaction: 14.39 GB write, 1122.97 MB/s write, 12.67 GB read, 989.18 MB/s read, 124.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 63, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 628695 Average: 11.9229 StdDev: 146.38 Min: 1 Median: 1.7819 Max: 12719 Percentiles: P50: 1.78 P75: 2.77 P99: 12.80 P99.9: 2215.22 P99.99: 4094.15 ------------------------------------------------------ [ 0, 1 ] 47829 7.608% 7.608% ## ( 1, 2 ] 340861 54.217% 61.825% ########### ( 2, 3 ] 108247 17.218% 79.043% ### ( 3, 4 ] 56316 8.958% 88.000% ## ( 4, 6 ] 55334 8.801% 96.802% ## ( 6, 10 ] 12479 1.985% 98.787% ( 10, 15 ] 2398 0.381% 99.168% ( 15, 22 ] 333 0.053% 99.221% ( 22, 34 ] 48 0.008% 99.229% ( 34, 51 ] 21 0.003% 99.232% ( 51, 76 ] 32 0.005% 99.237% ( 76, 110 ] 48 0.008% 99.245% ( 110, 170 ] 334 0.053% 99.298% ( 170, 250 ] 345 0.055% 99.353% ( 250, 380 ] 411 0.065% 99.418% ( 380, 580 ] 692 0.110% 99.528% ( 580, 870 ] 878 0.140% 99.668% ( 870, 1300 ] 808 0.129% 99.796% ( 1300, 1900 ] 531 0.084% 99.881% ( 1900, 2900 ] 388 0.062% 99.942% ( 2900, 4400 ] 377 0.060% 100.002% ( 4400, 6600 ] 100 0.016% 100.018% ( 6600, 9900 ] 12 0.002% 100.020% ( 9900, 14000 ] 2 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 156743 Average: 11.2753 StdDev: 143.92 Min: 1 Median: 1.9056 Max: 18977 Percentiles: P50: 1.91 P75: 2.96 P99: 14.09 P99.9: 1806.98 P99.99: 3979.18 ------------------------------------------------------ [ 0, 1 ] 4731 3.018% 3.018% # ( 1, 2 ] 81314 51.877% 54.896% ########## ( 2, 3 ] 32847 20.956% 75.852% #### ( 3, 4 ] 15287 9.753% 85.604% ## ( 4, 6 ] 15851 10.113% 95.717% ## ( 6, 10 ] 4395 2.804% 98.521% # ( 10, 15 ] 918 0.586% 99.107% ( 15, 22 ] 112 0.071% 99.178% ( 22, 34 ] 15 0.010% 99.188% ( 34, 51 ] 17 0.011% 99.199% ( 51, 76 ] 18 0.011% 99.210% ( 76, 110 ] 15 0.010% 99.220% ( 110, 170 ] 77 0.049% 99.269% ( 170, 250 ] 104 0.066% 99.335% ( 250, 380 ] 139 0.089% 99.424% ( 380, 580 ] 211 0.135% 99.559% ( 580, 870 ] 237 0.151% 99.710% ( 870, 1300 ] 207 0.132% 99.842% ( 1300, 1900 ] 108 0.069% 99.911% ( 1900, 2900 ] 79 0.050% 99.961% ( 2900, 4400 ] 63 0.040% 100.001% ( 4400, 6600 ] 18 0.011% 100.013% ( 6600, 9900 ] 4 0.003% 100.015% ( 14000, 22000 ] 2 0.001% 100.017% ** Level 2 read latency histogram (micros): Count: 352098 Average: 12.5528 StdDev: 159.61 Min: 1 Median: 1.8789 Max: 8230 Percentiles: P50: 1.88 P75: 2.98 P99: 12.53 P99.9: 1755.80 P99.99: 2744.10 ------------------------------------------------------ [ 0, 1 ] 21072 5.985% 5.985% # ( 1, 2 ] 176331 50.080% 56.065% ########## ( 2, 3 ] 67772 19.248% 75.313% #### ( 3, 4 ] 35748 10.153% 85.466% ## ( 4, 6 ] 36714 10.427% 95.893% ## ( 6, 10 ] 9731 2.764% 98.657% # ( 10, 15 ] 2387 0.678% 99.335% ( 15, 22 ] 388 0.110% 99.445% ( 22, 34 ] 87 0.025% 99.469% ( 34, 51 ] 40 0.011% 99.481% ( 51, 76 ] 23 0.007% 99.487% ( 76, 110 ] 17 0.005% 99.492% ( 110, 170 ] 37 0.011% 99.503% ( 170, 250 ] 86 0.024% 99.527% ( 250, 380 ] 172 0.049% 99.576% ( 380, 580 ] 278 0.079% 99.655% ( 580, 870 ] 313 0.089% 99.744% ( 870, 1300 ] 322 0.091% 99.835% ( 1300, 1900 ] 300 0.085% 99.920% ( 1900, 2900 ] 290 0.082% 100.003% ( 2900, 4400 ] 283 0.080% 100.083% ( 4400, 6600 ] 78 0.022% 100.105% ( 6600, 9900 ] 9 0.003% 100.108% ** Level 3 read latency histogram (micros): Count: 1170234 Average: 11.9692 StdDev: 159.48 Min: 0 Median: 1.8669 Max: 25851 Percentiles: P50: 1.87 P75: 2.93 P99: 10.70 P99.9: 1394.36 P99.99: 2271.43 ------------------------------------------------------ [ 0, 1 ] 51809 4.427% 4.427% # ( 1, 2 ] 615167 52.568% 56.995% ########### ( 2, 3 ] 225365 19.258% 76.253% #### ( 3, 4 ] 116918 9.991% 86.244% ## ( 4, 6 ] 119495 10.211% 96.455% ## ( 6, 10 ] 28937 2.473% 98.928% ( 10, 15 ] 6062 0.518% 99.446% ( 15, 22 ] 741 0.063% 99.509% ( 22, 34 ] 78 0.007% 99.516% ( 34, 51 ] 67 0.006% 99.522% ( 51, 76 ] 89 0.008% 99.529% ( 76, 110 ] 63 0.005% 99.535% ( 110, 170 ] 181 0.015% 99.550% ( 170, 250 ] 290 0.025% 99.575% ( 250, 380 ] 478 0.041% 99.616% ( 380, 580 ] 795 0.068% 99.684% ( 580, 870 ] 1160 0.099% 99.783% ( 870, 1300 ] 1233 0.105% 99.888% ( 1300, 1900 ] 876 0.075% 99.963% ( 1900, 2900 ] 848 0.072% 100.036% ( 2900, 4400 ] 825 0.070% 100.106% ( 4400, 6600 ] 245 0.021% 100.127% ( 6600, 9900 ] 32 0.003% 100.130% ( 9900, 14000 ] 5 0.000% 100.130% ( 14000, 22000 ] 3 0.000% 100.131% ( 22000, 33000 ] 1 0.000% 100.131% ** Level 4 read latency histogram (micros): Count: 951611 Average: 16.6439 StdDev: 185.55 Min: 1 Median: 1.8739 Max: 34029 Percentiles: P50: 1.87 P75: 2.96 P99: 111.99 P99.9: 1743.07 P99.99: 2525.92 ------------------------------------------------------ [ 0, 1 ] 39140 4.113% 4.113% # ( 1, 2 ] 499675 52.508% 56.621% ########### ( 2, 3 ] 182368 19.164% 75.785% #### ( 3, 4 ] 94930 9.976% 85.761% ## ( 4, 6 ] 97986 10.297% 96.058% ## ( 6, 10 ] 22938 2.410% 98.468% ( 10, 15 ] 4262 0.448% 98.916% ( 15, 22 ] 466 0.049% 98.965% ( 22, 34 ] 44 0.005% 98.970% ( 34, 51 ] 60 0.006% 98.976% ( 51, 76 ] 85 0.009% 98.985% ( 76, 110 ] 122 0.013% 98.998% ( 110, 170 ] 570 0.060% 99.058% ( 170, 250 ] 828 0.087% 99.145% ( 250, 380 ] 916 0.096% 99.241% ( 380, 580 ] 1591 0.167% 99.408% ( 580, 870 ] 2010 0.211% 99.620% ( 870, 1300 ] 1862 0.196% 99.815% ( 1300, 1900 ] 1092 0.115% 99.930% ( 1900, 2900 ] 912 0.096% 100.026% ( 2900, 4400 ] 820 0.086% 100.112% ( 4400, 6600 ] 238 0.025% 100.137% ( 6600, 9900 ] 46 0.005% 100.142% ( 9900, 14000 ] 7 0.001% 100.143% ( 14000, 22000 ] 1 0.000% 100.143% ( 33000, 50000 ] 1 0.000% 100.143% ** Level 5 read latency histogram (micros): Count: 34979 Average: 1083.8208 StdDev: 1240.96 Min: 78 Median: 675.8691 Max: 33297 Percentiles: P50: 675.87 P75: 1260.75 P99: 6086.35 P99.9: 9366.69 P99.99: 21203.36 ------------------------------------------------------ ( 76, 110 ] 511 1.461% 1.461% ( 110, 170 ] 2778 7.942% 9.403% ## ( 170, 250 ] 3127 8.940% 18.342% ## ( 250, 380 ] 3709 10.604% 28.946% ## ( 380, 580 ] 5341 15.269% 44.215% ### ( 580, 870 ] 6121 17.499% 61.714% ### ( 870, 1300 ] 5114 14.620% 76.334% ### ( 1300, 1900 ] 2816 8.051% 84.385% ## ( 1900, 2900 ] 2253 6.441% 90.826% # ( 2900, 4400 ] 2200 6.289% 97.115% # ( 4400, 6600 ] 860 2.459% 99.574% ( 6600, 9900 ] 136 0.389% 99.963% ( 9900, 14000 ] 5 0.014% 99.977% ( 14000, 22000 ] 5 0.014% 99.991% ( 22000, 33000 ] 2 0.006% 99.997% ( 33000, 50000 ] 1 0.003% 100.000% ** DB Stats ** Uptime(secs): 13.3 total, 6.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 148.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.243 H:M:S, 39.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 165.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.146 H:M:S, 36.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/07-16:02:15 ... thread 0: (1000000,3000000) ops and (277848.6,179479.6) ops/second in (3.599082,16.714988) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.77 GB 88.1 2.2 0.0 2.2 4.9 2.8 0.0 1.8 79.8 182.2 27.64 16.87 45 0.614 2238K 2805 0.0 0.0 L1 7/7 793.81 MB 0.0 1.3 0.9 0.4 1.2 0.9 0.0 1.4 116.0 115.7 11.04 6.01 1 11.045 1301K 3843 0.0 0.0 L2 1/0 54.07 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 889.51 MB 0.9 2.4 1.6 0.8 2.4 1.6 0.5 1.5 102.2 101.4 24.50 11.63 17 1.441 1597K 1657 0.0 0.0 L4 164/0 9.67 GB 1.0 8.3 4.4 3.9 8.2 4.3 0.6 1.8 119.0 117.3 71.63 38.81 46 1.557 3141K 5607 0.0 0.0 L5 1144/0 94.00 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1348/18 108.13 GB 0.0 14.2 6.9 7.3 16.8 9.5 6.5 6.1 107.7 127.6 134.82 73.32 109 1.237 8278K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.2 6.9 7.3 16.8 9.5 6.5 6.1 107.7 127.6 134.82 73.32 109 1.237 8278K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.2 6.9 7.3 14.0 6.8 0.0 0.0 121.7 120.4 119.28 65.21 71 1.680 8278K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 182.5 15.53 8.11 38 0.409 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.9 total, 16.7 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.80 GB write, 1018.83 MB/s write, 14.18 GB read, 859.86 MB/s read, 134.8 seconds Interval compaction: 16.80 GB write, 1028.93 MB/s write, 14.18 GB read, 868.39 MB/s read, 134.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 63, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1062527 Average: 8.9587 StdDev: 115.10 Min: 0 Median: 1.6583 Max: 12719 Percentiles: P50: 1.66 P75: 2.37 P99: 13.39 P99.9: 1272.76 P99.99: 2825.18 ------------------------------------------------------ [ 0, 1 ] 128705 12.113% 12.113% ## ( 1, 2 ] 611549 57.556% 69.669% ############ ( 2, 3 ] 154299 14.522% 84.191% ### ( 3, 4 ] 73688 6.935% 91.126% # ( 4, 6 ] 66109 6.222% 97.348% # ( 6, 10 ] 15590 1.467% 98.815% ( 10, 15 ] 2899 0.273% 99.088% ( 15, 22 ] 406 0.038% 99.126% ( 22, 34 ] 54 0.005% 99.132% ( 34, 51 ] 28 0.003% 99.134% ( 51, 76 ] 36 0.003% 99.138% ( 76, 110 ] 526 0.050% 99.187% ( 110, 170 ] 2218 0.209% 99.396% ( 170, 250 ] 1435 0.135% 99.531% ( 250, 380 ] 940 0.088% 99.619% ( 380, 580 ] 1125 0.106% 99.725% ( 580, 870 ] 1067 0.100% 99.826% ( 870, 1300 ] 845 0.080% 99.905% ( 1300, 1900 ] 541 0.051% 99.956% ( 1900, 2900 ] 391 0.037% 99.993% ( 2900, 4400 ] 378 0.036% 100.028% ( 4400, 6600 ] 101 0.010% 100.038% ( 6600, 9900 ] 13 0.001% 100.039% ( 9900, 14000 ] 3 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 157572 Average: 12.5201 StdDev: 145.40 Min: 1 Median: 1.9107 Max: 18977 Percentiles: P50: 1.91 P75: 2.98 P99: 171.46 P99.9: 1814.28 P99.99: 3983.82 ------------------------------------------------------ [ 0, 1 ] 4731 3.002% 3.002% # ( 1, 2 ] 81316 51.606% 54.608% ########## ( 2, 3 ] 32858 20.853% 75.461% #### ( 3, 4 ] 15293 9.705% 85.166% ## ( 4, 6 ] 15854 10.061% 95.228% ## ( 6, 10 ] 4396 2.790% 98.017% # ( 10, 15 ] 918 0.583% 98.600% ( 15, 22 ] 112 0.071% 98.671% ( 22, 34 ] 15 0.010% 98.681% ( 34, 51 ] 17 0.011% 98.691% ( 51, 76 ] 18 0.011% 98.703% ( 76, 110 ] 101 0.064% 98.767% ( 110, 170 ] 362 0.230% 98.997% ( 170, 250 ] 289 0.183% 99.180% ( 250, 380 ] 238 0.151% 99.331% ( 380, 580 ] 316 0.201% 99.532% ( 580, 870 ] 270 0.171% 99.703% ( 870, 1300 ] 217 0.138% 99.841% ( 1300, 1900 ] 109 0.069% 99.910% ( 1900, 2900 ] 80 0.051% 99.961% ( 2900, 4400 ] 64 0.041% 100.001% ( 4400, 6600 ] 18 0.011% 100.013% ( 6600, 9900 ] 4 0.003% 100.015% ( 14000, 22000 ] 2 0.001% 100.017% ** Level 2 read latency histogram (micros): Count: 352098 Average: 12.5528 StdDev: 159.61 Min: 1 Median: 1.8789 Max: 8230 Percentiles: P50: 1.88 P75: 2.98 P99: 12.53 P99.9: 1755.80 P99.99: 2744.10 ------------------------------------------------------ [ 0, 1 ] 21072 5.985% 5.985% # ( 1, 2 ] 176331 50.080% 56.065% ########## ( 2, 3 ] 67772 19.248% 75.313% #### ( 3, 4 ] 35748 10.153% 85.466% ## ( 4, 6 ] 36714 10.427% 95.893% ## ( 6, 10 ] 9731 2.764% 98.657% # ( 10, 15 ] 2387 0.678% 99.335% ( 15, 22 ] 388 0.110% 99.445% ( 22, 34 ] 87 0.025% 99.469% ( 34, 51 ] 40 0.011% 99.481% ( 51, 76 ] 23 0.007% 99.487% ( 76, 110 ] 17 0.005% 99.492% ( 110, 170 ] 37 0.011% 99.503% ( 170, 250 ] 86 0.024% 99.527% ( 250, 380 ] 172 0.049% 99.576% ( 380, 580 ] 278 0.079% 99.655% ( 580, 870 ] 313 0.089% 99.744% ( 870, 1300 ] 322 0.091% 99.835% ( 1300, 1900 ] 300 0.085% 99.920% ( 1900, 2900 ] 290 0.082% 100.003% ( 2900, 4400 ] 283 0.080% 100.083% ( 4400, 6600 ] 78 0.022% 100.105% ( 6600, 9900 ] 9 0.003% 100.108% ** Level 3 read latency histogram (micros): Count: 1222898 Average: 11.6629 StdDev: 156.35 Min: 0 Median: 1.8607 Max: 25851 Percentiles: P50: 1.86 P75: 2.92 P99: 10.70 P99.9: 1349.33 P99.99: 2247.89 ------------------------------------------------------ [ 0, 1 ] 54757 4.478% 4.478% # ( 1, 2 ] 646799 52.891% 57.368% ########### ( 2, 3 ] 234508 19.176% 76.545% #### ( 3, 4 ] 120909 9.887% 86.432% ## ( 4, 6 ] 122955 10.054% 96.486% ## ( 6, 10 ] 29880 2.443% 98.930% ( 10, 15 ] 6177 0.505% 99.435% ( 15, 22 ] 761 0.062% 99.497% ( 22, 34 ] 79 0.006% 99.503% ( 34, 51 ] 69 0.006% 99.509% ( 51, 76 ] 89 0.007% 99.516% ( 76, 110 ] 112 0.009% 99.525% ( 110, 170 ] 345 0.028% 99.554% ( 170, 250 ] 374 0.031% 99.584% ( 250, 380 ] 527 0.043% 99.627% ( 380, 580 ] 848 0.069% 99.697% ( 580, 870 ] 1177 0.096% 99.793% ( 870, 1300 ] 1237 0.101% 99.894% ( 1300, 1900 ] 877 0.072% 99.966% ( 1900, 2900 ] 850 0.070% 100.035% ( 2900, 4400 ] 826 0.068% 100.103% ( 4400, 6600 ] 245 0.020% 100.123% ( 6600, 9900 ] 33 0.003% 100.126% ( 9900, 14000 ] 5 0.000% 100.126% ( 14000, 22000 ] 3 0.000% 100.126% ( 22000, 33000 ] 1 0.000% 100.126% ** Level 4 read latency histogram (micros): Count: 1018213 Average: 17.3869 StdDev: 182.91 Min: 1 Median: 1.8692 Max: 34029 Percentiles: P50: 1.87 P75: 2.96 P99: 246.71 P99.9: 1713.34 P99.99: 2520.73 ------------------------------------------------------ [ 0, 1 ] 42597 4.184% 4.184% # ( 1, 2 ] 536724 52.712% 56.896% ########### ( 2, 3 ] 192655 18.921% 75.817% #### ( 3, 4 ] 99262 9.749% 85.565% ## ( 4, 6 ] 101603 9.979% 95.544% ## ( 6, 10 ] 24121 2.369% 97.913% ( 10, 15 ] 4417 0.434% 98.347% ( 15, 22 ] 482 0.047% 98.394% ( 22, 34 ] 45 0.004% 98.398% ( 34, 51 ] 60 0.006% 98.404% ( 51, 76 ] 85 0.008% 98.413% ( 76, 110 ] 833 0.082% 98.495% ( 110, 170 ] 3020 0.297% 98.791% ( 170, 250 ] 2218 0.218% 99.009% ( 250, 380 ] 1776 0.174% 99.183% ( 380, 580 ] 2257 0.222% 99.405% ( 580, 870 ] 2335 0.229% 99.634% ( 870, 1300 ] 1947 0.191% 99.826% ( 1300, 1900 ] 1100 0.108% 99.934% ( 1900, 2900 ] 925 0.091% 100.024% ( 2900, 4400 ] 825 0.081% 100.105% ( 4400, 6600 ] 238 0.023% 100.129% ( 6600, 9900 ] 52 0.005% 100.134% ( 9900, 14000 ] 8 0.001% 100.135% ( 14000, 22000 ] 1 0.000% 100.135% ( 33000, 50000 ] 1 0.000% 100.135% ** Level 5 read latency histogram (micros): Count: 72945 Average: 651.8505 StdDev: 977.10 Min: 73 Median: 301.2059 Max: 33297 Percentiles: P50: 301.21 P75: 715.33 P99: 5149.20 P99.9: 8675.58 P99.99: 13913.75 ------------------------------------------------------ ( 51, 76 ] 5 0.007% 0.007% ( 76, 110 ] 4618 6.331% 6.338% # ( 110, 170 ] 17160 23.525% 29.862% ##### ( 170, 250 ] 11330 15.532% 45.394% ### ( 250, 380 ] 8529 11.692% 57.087% ## ( 380, 580 ] 9363 12.836% 69.923% ### ( 580, 870 ] 7937 10.881% 80.803% ## ( 870, 1300 ] 5565 7.629% 88.432% ## ( 1300, 1900 ] 2874 3.940% 92.372% # ( 1900, 2900 ] 2319 3.179% 95.551% # ( 2900, 4400 ] 2222 3.046% 98.598% # ( 4400, 6600 ] 862 1.182% 99.779% ( 6600, 9900 ] 140 0.192% 99.971% ( 9900, 14000 ] 14 0.019% 99.990% ( 14000, 22000 ] 5 0.007% 99.997% ( 22000, 33000 ] 2 0.003% 100.000% ( 33000, 50000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 16.9 total, 3.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 174.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.243 H:M:S, 31.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 273.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/07-16:02:19 ... thread 0: (1000000,4000000) ops and (234354.5,190639.4) ops/second in (4.267039,20.982027) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/7 3.75 GB 214.0 3.4 0.0 3.4 7.1 3.7 0.0 1.9 97.5 205.6 35.52 24.26 66 0.538 3517K 4033 0.0 0.0 L1 7/7 793.81 MB 0.0 1.3 0.9 0.4 1.2 0.9 0.0 1.4 116.0 115.7 11.04 6.01 1 11.045 1301K 3843 0.0 0.0 L2 1/0 54.07 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 889.51 MB 0.9 2.4 1.6 0.8 2.4 1.6 0.5 1.5 102.2 101.4 24.50 11.63 17 1.441 1597K 1657 0.0 0.0 L4 164/0 9.67 GB 1.0 8.3 4.4 3.9 8.2 4.3 0.6 1.8 119.0 117.3 71.63 38.81 46 1.557 3141K 5607 0.0 0.0 L5 1144/0 94.00 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1349/14 109.11 GB 0.0 15.4 6.9 8.5 19.0 10.5 6.5 5.1 110.6 136.4 142.70 80.71 130 1.098 9557K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.4 6.9 8.5 19.0 10.5 6.5 5.1 110.6 136.4 142.70 80.71 130 1.098 9557K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.4 6.9 8.5 15.3 6.8 0.0 0.0 127.2 126.0 124.03 69.87 76 1.632 9557K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 205.8 18.67 10.84 54 0.346 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.1 total, 21.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.01 GB write, 920.45 MB/s write, 15.41 GB read, 745.95 MB/s read, 142.7 seconds Interval compaction: 19.01 GB write, 927.72 MB/s write, 15.41 GB read, 751.85 MB/s read, 142.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 63, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1371515 Average: 10.9293 StdDev: 106.57 Min: 0 Median: 1.6006 Max: 12719 Percentiles: P50: 1.60 P75: 2.20 P99: 186.39 P99.9: 1055.43 P99.99: 2253.70 ------------------------------------------------------ [ 0, 1 ] 222942 16.255% 16.255% ### ( 1, 2 ] 770576 56.184% 72.439% ########### ( 2, 3 ] 171446 12.500% 84.940% ### ( 3, 4 ] 80770 5.889% 90.829% # ( 4, 6 ] 70457 5.137% 95.966% # ( 6, 10 ] 16515 1.204% 97.170% ( 10, 15 ] 3108 0.227% 97.397% ( 15, 22 ] 445 0.032% 97.429% ( 22, 34 ] 59 0.004% 97.434% ( 34, 51 ] 30 0.002% 97.436% ( 51, 76 ] 47 0.003% 97.439% ( 76, 110 ] 4659 0.340% 97.779% ( 110, 170 ] 15408 1.123% 98.902% ( 170, 250 ] 6529 0.476% 99.378% ( 250, 380 ] 2769 0.202% 99.580% ( 380, 580 ] 2512 0.183% 99.764% ( 580, 870 ] 1470 0.107% 99.871% ( 870, 1300 ] 931 0.068% 99.939% ( 1300, 1900 ] 557 0.041% 99.979% ( 1900, 2900 ] 418 0.030% 100.010% ( 2900, 4400 ] 390 0.028% 100.038% ( 4400, 6600 ] 101 0.007% 100.045% ( 6600, 9900 ] 13 0.001% 100.046% ( 9900, 14000 ] 3 0.000% 100.047% ** Level 1 read latency histogram (micros): Count: 162029 Average: 13.6050 StdDev: 144.44 Min: 1 Median: 1.9272 Max: 18977 Percentiles: P50: 1.93 P75: 3.04 P99: 224.56 P99.9: 1791.74 P99.99: 3973.37 ------------------------------------------------------ [ 0, 1 ] 4766 2.941% 2.941% # ( 1, 2 ] 82231 50.751% 53.692% ########## ( 2, 3 ] 33849 20.891% 74.583% #### ( 3, 4 ] 15876 9.798% 84.381% ## ( 4, 6 ] 16378 10.108% 94.489% ## ( 6, 10 ] 4511 2.784% 97.273% # ( 10, 15 ] 955 0.589% 97.863% ( 15, 22 ] 132 0.081% 97.944% ( 22, 34 ] 18 0.011% 97.955% ( 34, 51 ] 17 0.010% 97.966% ( 51, 76 ] 18 0.011% 97.977% ( 76, 110 ] 300 0.185% 98.162% ( 110, 170 ] 1001 0.618% 98.780% ( 170, 250 ] 523 0.323% 99.103% ( 250, 380 ] 334 0.206% 99.309% ( 380, 580 ] 372 0.230% 99.538% ( 580, 870 ] 277 0.171% 99.709% ( 870, 1300 ] 218 0.135% 99.844% ( 1300, 1900 ] 111 0.069% 99.912% ( 1900, 2900 ] 80 0.049% 99.962% ( 2900, 4400 ] 64 0.039% 100.001% ( 4400, 6600 ] 18 0.011% 100.012% ( 6600, 9900 ] 4 0.002% 100.015% ( 14000, 22000 ] 2 0.001% 100.016% ** Level 2 read latency histogram (micros): Count: 352098 Average: 12.5528 StdDev: 159.61 Min: 1 Median: 1.8789 Max: 8230 Percentiles: P50: 1.88 P75: 2.98 P99: 12.53 P99.9: 1755.80 P99.99: 2744.10 ------------------------------------------------------ [ 0, 1 ] 21072 5.985% 5.985% # ( 1, 2 ] 176331 50.080% 56.065% ########## ( 2, 3 ] 67772 19.248% 75.313% #### ( 3, 4 ] 35748 10.153% 85.466% ## ( 4, 6 ] 36714 10.427% 95.893% ## ( 6, 10 ] 9731 2.764% 98.657% # ( 10, 15 ] 2387 0.678% 99.335% ( 15, 22 ] 388 0.110% 99.445% ( 22, 34 ] 87 0.025% 99.469% ( 34, 51 ] 40 0.011% 99.481% ( 51, 76 ] 23 0.007% 99.487% ( 76, 110 ] 17 0.005% 99.492% ( 110, 170 ] 37 0.011% 99.503% ( 170, 250 ] 86 0.024% 99.527% ( 250, 380 ] 172 0.049% 99.576% ( 380, 580 ] 278 0.079% 99.655% ( 580, 870 ] 313 0.089% 99.744% ( 870, 1300 ] 322 0.091% 99.835% ( 1300, 1900 ] 300 0.085% 99.920% ( 1900, 2900 ] 290 0.082% 100.003% ( 2900, 4400 ] 283 0.080% 100.083% ( 4400, 6600 ] 78 0.022% 100.105% ( 6600, 9900 ] 9 0.003% 100.108% ** Level 3 read latency histogram (micros): Count: 1223768 Average: 11.7821 StdDev: 156.38 Min: 0 Median: 1.8614 Max: 25851 Percentiles: P50: 1.86 P75: 2.92 P99: 11.38 P99.9: 1348.73 P99.99: 2247.79 ------------------------------------------------------ [ 0, 1 ] 54757 4.474% 4.474% # ( 1, 2 ] 646801 52.853% 57.328% ########### ( 2, 3 ] 234510 19.163% 76.491% #### ( 3, 4 ] 120914 9.880% 86.371% ## ( 4, 6 ] 122967 10.048% 96.419% ## ( 6, 10 ] 29880 2.442% 98.861% ( 10, 15 ] 6177 0.505% 99.366% ( 15, 22 ] 761 0.062% 99.428% ( 22, 34 ] 79 0.006% 99.434% ( 34, 51 ] 69 0.006% 99.440% ( 51, 76 ] 89 0.007% 99.447% ( 76, 110 ] 238 0.019% 99.467% ( 110, 170 ] 799 0.065% 99.532% ( 170, 250 ] 520 0.042% 99.575% ( 250, 380 ] 589 0.048% 99.623% ( 380, 580 ] 894 0.073% 99.696% ( 580, 870 ] 1191 0.097% 99.793% ( 870, 1300 ] 1238 0.101% 99.894% ( 1300, 1900 ] 877 0.072% 99.966% ( 1900, 2900 ] 850 0.069% 100.035% ( 2900, 4400 ] 826 0.067% 100.103% ( 4400, 6600 ] 245 0.020% 100.123% ( 6600, 9900 ] 33 0.003% 100.126% ( 9900, 14000 ] 5 0.000% 100.126% ( 14000, 22000 ] 3 0.000% 100.126% ( 22000, 33000 ] 1 0.000% 100.126% ** Level 4 read latency histogram (micros): Count: 1028013 Average: 18.9384 StdDev: 183.18 Min: 1 Median: 1.8783 Max: 34029 Percentiles: P50: 1.88 P75: 2.99 P99: 311.21 P99.9: 1709.78 P99.99: 2521.16 ------------------------------------------------------ [ 0, 1 ] 42597 4.144% 4.144% # ( 1, 2 ] 536753 52.213% 56.356% ########## ( 2, 3 ] 192750 18.750% 75.106% #### ( 3, 4 ] 99332 9.663% 84.769% ## ( 4, 6 ] 101750 9.898% 94.666% ## ( 6, 10 ] 24135 2.348% 97.014% ( 10, 15 ] 4422 0.430% 97.444% ( 15, 22 ] 483 0.047% 97.491% ( 22, 34 ] 45 0.004% 97.496% ( 34, 51 ] 60 0.006% 97.501% ( 51, 76 ] 85 0.008% 97.510% ( 76, 110 ] 2205 0.214% 97.724% ( 110, 170 ] 7963 0.775% 98.499% ( 170, 250 ] 4035 0.393% 98.891% ( 250, 380 ] 2374 0.231% 99.122% ( 380, 580 ] 2758 0.268% 99.390% ( 580, 870 ] 2506 0.244% 99.634% ( 870, 1300 ] 1978 0.192% 99.827% ( 1300, 1900 ] 1104 0.107% 99.934% ( 1900, 2900 ] 926 0.090% 100.024% ( 2900, 4400 ] 826 0.080% 100.104% ( 4400, 6600 ] 238 0.023% 100.128% ( 6600, 9900 ] 52 0.005% 100.133% ( 9900, 14000 ] 8 0.001% 100.133% ( 14000, 22000 ] 1 0.000% 100.134% ( 33000, 50000 ] 1 0.000% 100.134% ** Level 5 read latency histogram (micros): Count: 129046 Average: 449.8266 StdDev: 774.92 Min: 73 Median: 190.1049 Max: 33297 Percentiles: P50: 190.10 P75: 431.56 P99: 4218.99 P99.9: 7306.06 P99.99: 11685.08 ------------------------------------------------------ ( 51, 76 ] 8 0.006% 0.006% ( 76, 110 ] 12692 9.835% 9.841% ## ( 110, 170 ] 46219 35.816% 45.657% ####### ( 170, 250 ] 22299 17.280% 62.937% ### ( 250, 380 ] 12342 9.564% 72.501% ## ( 380, 580 ] 12508 9.693% 82.194% ## ( 580, 870 ] 8789 6.811% 89.005% # ( 870, 1300 ] 5689 4.409% 93.413% # ( 1300, 1900 ] 2909 2.254% 95.667% ( 1900, 2900 ] 2337 1.811% 97.478% ( 2900, 4400 ] 2233 1.730% 99.209% ( 4400, 6600 ] 862 0.668% 99.877% ( 6600, 9900 ] 140 0.108% 99.985% ( 9900, 14000 ] 14 0.011% 99.996% ( 14000, 22000 ] 5 0.004% 100.000% ( 22000, 33000 ] 2 0.002% 100.002% ( 33000, 50000 ] 1 0.001% 100.002% ** DB Stats ** Uptime(secs): 21.1 total, 4.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 186.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.960 H:M:S, 28.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 230.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.716 H:M:S, 16.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 246.516 micros/op 16218 ops/sec 60.118 seconds 974996 operations; 15.7 MB/s (243999 of 243999 found) Microseconds per read: Count: 974996 Average: 246.5185 StdDev: 702.20 Min: 2 Median: 169.5756 Max: 95139 Percentiles: P50: 169.58 P75: 234.66 P99: 1259.63 P99.9: 10903.46 P99.99: 29302.80 ------------------------------------------------------ ( 1, 2 ] 6 0.001% 0.001% ( 2, 3 ] 43 0.004% 0.005% ( 3, 4 ] 70 0.007% 0.012% ( 4, 6 ] 78 0.008% 0.020% ( 6, 10 ] 343 0.035% 0.055% ( 10, 15 ] 2304 0.236% 0.292% ( 15, 22 ] 1904 0.195% 0.487% ( 22, 34 ] 4916 0.504% 0.991% ( 34, 51 ] 1300 0.133% 1.125% ( 51, 76 ] 186 0.019% 1.144% ( 76, 110 ] 25619 2.628% 3.771% # ( 110, 170 ] 453940 46.558% 50.329% ######### ( 170, 250 ] 297605 30.524% 80.853% ###### ( 250, 380 ] 111258 11.411% 92.264% ## ( 380, 580 ] 41856 4.293% 96.557% # ( 580, 870 ] 16936 1.737% 98.294% ( 870, 1300 ] 7595 0.779% 99.073% ( 1300, 1900 ] 3231 0.331% 99.405% ( 1900, 2900 ] 2248 0.231% 99.635% ( 2900, 4400 ] 1676 0.172% 99.807% ( 4400, 6600 ] 528 0.054% 99.861% ( 6600, 9900 ] 286 0.029% 99.890% ( 9900, 14000 ] 380 0.039% 99.929% ( 14000, 22000 ] 471 0.048% 99.978% ( 22000, 33000 ] 180 0.018% 99.996% ( 33000, 50000 ] 27 0.003% 99.999% ( 50000, 75000 ] 9 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 15793893 rocksdb.bloom.filter.full.positive COUNT : 1127895 rocksdb.bloom.filter.full.true.positive COUNT : 974561 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 435 rocksdb.memtable.miss COUNT : 974561 rocksdb.l0.hit COUNT : 40706 rocksdb.l1.hit COUNT : 7312 rocksdb.l2andup.hit COUNT : 926543 rocksdb.compaction.key.drop.new COUNT : 189423 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4648482 rocksdb.number.keys.read COUNT : 974996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4797233424 rocksdb.bytes.read COUNT : 974996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1599 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 41406027 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 21473696284 rocksdb.compact.write.bytes COUNT : 21287649203 rocksdb.flush.write.bytes COUNT : 4756109665 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 25 rocksdb.number.superversion_acquires COUNT : 943 rocksdb.number.superversion_releases COUNT : 917 rocksdb.number.superversion_cleanups COUNT : 237 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 187 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4717734912 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1812480 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 26182450762 rocksdb.non.last.level.read.count COUNT : 6185665 rocksdb.block.checksum.compute.count COUNT : 6342655 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 168.683502 P95 : 506.429448 P99 : 1258.693217 P100 : 95137.000000 COUNT : 974996 SUM : 239486050 rocksdb.db.write.micros P50 : 1.591696 P95 : 5.035372 P99 : 12.705789 P100 : 863335.000000 COUNT : 4648482 SUM : 53781133 rocksdb.compaction.times.micros P50 : 1375000.000000 P95 : 2900000.000000 P99 : 10640000.000000 P100 : 11044810.000000 COUNT : 80 SUM : 132423575 rocksdb.compaction.times.cpu_micros P50 : 849259.259259 P95 : 1792307.692308 P99 : 5620000.000000 P100 : 6005676.000000 COUNT : 80 SUM : 78169817 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 863.409091 P95 : 83750.000000 P99 : 131000.000000 P100 : 142738.000000 COUNT : 65 SUM : 696988 rocksdb.compaction.outfile.sync.micros P50 : 53240.740741 P95 : 243692.307692 P99 : 373337.500000 P100 : 1146357.000000 COUNT : 241 SUM : 20284849 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 228.000000 P95 : 3358.333333 P99 : 4785.000000 P100 : 5573.000000 COUNT : 165 SUM : 124032 rocksdb.table.open.io.micros P50 : 8721.976744 P95 : 20419.771863 P99 : 26718.214286 P100 : 29402.000000 COUNT : 1599 SUM : 14689642 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.832123 P95 : 13.533745 P99 : 184.534807 P100 : 34049.000000 COUNT : 5202730 SUM : 82935061 rocksdb.read.block.get.micros P50 : 140.264681 P95 : 371.992322 P99 : 1208.357237 P100 : 33301.000000 COUNT : 1138330 SUM : 206048615 rocksdb.write.raw.block.micros P50 : 0.534945 P95 : 1.339653 P99 : 3.514511 P100 : 26389.000000 COUNT : 6307959 SUM : 18905389 rocksdb.numfiles.in.singlecompaction P50 : 2.921053 P95 : 4.660000 P99 : 9.720000 P100 : 14.000000 COUNT : 107 SUM : 353 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.583540 P95 : 1245.663617 P99 : 2628.025065 P100 : 863165.000000 COUNT : 190205 SUM : 41427837 rocksdb.sst.read.micros P50 : 1.987951 P95 : 165.944116 P99 : 475.164986 P100 : 34029.000000 COUNT : 6185717 SUM : 273905716 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 974996 SUM : 974996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4648482 SUM : 4797233424 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 224166.666667 P95 : 923750.000000 P99 : 1106861.000000 P100 : 1106861.000000 COUNT : 65 SUM : 20891930 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 259 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0