[2024-07-15 15:12:38.180245] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 22.11.4 initialization... [2024-07-15 15:12:38.180527] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2376380 ] Set seed to 1721049158173868 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 15:12:38.277637] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 15:12:38.316323] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 15:12:38.316371] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2376380' to capture a snapshot of events at runtime. [2024-07-15 15:12:38.316381] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 15:12:38.316391] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 15:12:38.316399] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2376380 for offline analysis/debug. [2024-07-15 15:12:38.316479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 15:12:42 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/15-15:12:47 ... thread 0: (1000000,1000000) ops and (199084.7,199084.7) ops/second in (5.022988,5.022988) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 2.96 GB 31.5 0.3 0.0 0.3 1.2 0.9 0.0 1.4 57.0 216.4 5.53 3.60 13 0.425 319K 360 0.0 0.0 L1 1/1 109.60 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 949.63 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 159/0 9.44 GB 1.0 2.3 1.3 1.0 2.3 1.3 0.2 1.8 95.6 95.0 24.97 12.80 14 1.784 392K 0 0.0 0.0 L5 1116/0 92.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1309/17 105.84 GB 0.0 2.6 1.3 1.3 3.5 2.1 4.3 4.0 88.6 117.0 30.50 16.39 27 1.130 712K 360 0.0 0.0 Int 0/0 0.00 KB 0.0 2.6 1.3 1.3 3.5 2.1 4.3 4.0 88.6 117.0 30.50 16.39 27 1.130 712K 360 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.6 1.3 1.3 2.6 1.3 0.0 0.0 103.2 102.6 26.19 13.98 15 1.746 712K 360 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 204.3 4.32 2.41 12 0.360 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.2 total, 5.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.49 GB write, 688.84 MB/s write, 2.64 GB read, 521.56 MB/s read, 30.5 seconds Interval compaction: 3.49 GB write, 710.41 MB/s write, 2.64 GB read, 537.89 MB/s read, 30.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 299906 Average: 10.5066 StdDev: 221.49 Min: 0 Median: 1.6550 Max: 56033 Percentiles: P50: 1.65 P75: 2.32 P99: 161.33 P99.9: 1099.66 P99.99: 2366.11 ------------------------------------------------------ [ 0, 1 ] 37256 12.423% 12.423% ## ( 1, 2 ] 172067 57.374% 69.796% ########### ( 2, 3 ] 48905 16.307% 86.103% ### ( 3, 4 ] 16655 5.553% 91.656% # ( 4, 6 ] 15070 5.025% 96.681% # ( 6, 10 ] 4312 1.438% 98.119% ( 10, 15 ] 952 0.317% 98.437% ( 15, 22 ] 137 0.046% 98.482% ( 22, 34 ] 24 0.008% 98.490% ( 34, 51 ] 3 0.001% 98.491% ( 51, 76 ] 6 0.002% 98.493% ( 76, 110 ] 350 0.117% 98.610% ( 110, 170 ] 1371 0.457% 99.067% ( 170, 250 ] 961 0.320% 99.387% ( 250, 380 ] 580 0.193% 99.581% ( 380, 580 ] 524 0.175% 99.756% ( 580, 870 ] 325 0.108% 99.864% ( 870, 1300 ] 208 0.069% 99.933% ( 1300, 1900 ] 125 0.042% 99.975% ( 1900, 2900 ] 103 0.034% 100.009% ( 2900, 4400 ] 61 0.020% 100.030% ( 4400, 6600 ] 15 0.005% 100.035% ( 6600, 9900 ] 6 0.002% 100.037% ( 14000, 22000 ] 2 0.001% 100.037% ( 22000, 33000 ] 7 0.002% 100.040% ( 33000, 50000 ] 2 0.001% 100.040% ( 50000, 75000 ] 1 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 20967 Average: 4.8865 StdDev: 66.03 Min: 1 Median: 1.7244 Max: 5620 Percentiles: P50: 1.72 P75: 2.55 P99: 10.91 P99.9: 503.58 P99.99: 4327.47 ------------------------------------------------------ [ 0, 1 ] 1699 8.103% 8.103% ## ( 1, 2 ] 12126 57.834% 65.937% ############ ( 2, 3 ] 3482 16.607% 82.544% ### ( 3, 4 ] 1336 6.372% 88.916% # ( 4, 6 ] 1513 7.216% 96.132% # ( 6, 10 ] 585 2.790% 98.922% # ( 10, 15 ] 90 0.429% 99.351% ( 15, 22 ] 40 0.191% 99.542% ( 22, 34 ] 3 0.014% 99.556% ( 51, 76 ] 1 0.005% 99.561% ( 76, 110 ] 9 0.043% 99.604% ( 110, 170 ] 19 0.091% 99.695% ( 170, 250 ] 21 0.100% 99.795% ( 250, 380 ] 14 0.067% 99.862% ( 380, 580 ] 13 0.062% 99.924% ( 580, 870 ] 9 0.043% 99.967% ( 870, 1300 ] 2 0.010% 99.976% ( 1900, 2900 ] 1 0.005% 99.981% ( 2900, 4400 ] 2 0.010% 99.990% ( 4400, 6600 ] 2 0.010% 100.000% ** Level 2 read latency histogram (micros): Count: 25 Average: 783.8000 StdDev: 1352.62 Min: 90 Median: 226.0000 Max: 6209 Percentiles: P50: 226.00 P75: 688.75 P99: 6050.00 P99.9: 6209.00 P99.99: 6209.00 ------------------------------------------------------ ( 76, 110 ] 2 8.000% 8.000% ## ( 110, 170 ] 7 28.000% 36.000% ###### ( 170, 250 ] 5 20.000% 56.000% #### ( 250, 380 ] 3 12.000% 68.000% ## ( 380, 580 ] 1 4.000% 72.000% # ( 580, 870 ] 2 8.000% 80.000% ## ( 870, 1300 ] 1 4.000% 84.000% # ( 1900, 2900 ] 2 8.000% 92.000% ## ( 2900, 4400 ] 1 4.000% 96.000% # ( 4400, 6600 ] 1 4.000% 100.000% # ** Level 3 read latency histogram (micros): Count: 111134 Average: 14.9690 StdDev: 211.29 Min: 1 Median: 1.8858 Max: 31571 Percentiles: P50: 1.89 P75: 2.88 P99: 30.80 P99.9: 2341.92 P99.99: 3958.92 ------------------------------------------------------ [ 0, 1 ] 4240 3.815% 3.815% # ( 1, 2 ] 57942 52.137% 55.952% ########## ( 2, 3 ] 23975 21.573% 77.525% #### ( 3, 4 ] 10140 9.124% 86.649% ## ( 4, 6 ] 9972 8.973% 95.622% ## ( 6, 10 ] 2927 2.634% 98.256% # ( 10, 15 ] 700 0.630% 98.886% ( 15, 22 ] 112 0.101% 98.987% ( 22, 34 ] 20 0.018% 99.005% ( 34, 51 ] 4 0.004% 99.008% ( 51, 76 ] 3 0.003% 99.011% ( 76, 110 ] 31 0.028% 99.039% ( 110, 170 ] 91 0.082% 99.121% ( 170, 250 ] 89 0.080% 99.201% ( 250, 380 ] 112 0.101% 99.302% ( 380, 580 ] 136 0.122% 99.424% ( 580, 870 ] 154 0.139% 99.563% ( 870, 1300 ] 197 0.177% 99.740% ( 1300, 1900 ] 135 0.121% 99.861% ( 1900, 2900 ] 97 0.087% 99.949% ( 2900, 4400 ] 65 0.058% 100.007% ( 4400, 6600 ] 14 0.013% 100.020% ( 6600, 9900 ] 2 0.002% 100.022% ( 9900, 14000 ] 4 0.004% 100.025% ( 14000, 22000 ] 3 0.003% 100.028% ( 22000, 33000 ] 1 0.001% 100.029% ** Level 4 read latency histogram (micros): Count: 188806 Average: 29.7721 StdDev: 381.06 Min: 1 Median: 1.9225 Max: 80855 Percentiles: P50: 1.92 P75: 2.93 P99: 774.51 P99.9: 2851.15 P99.99: 3768.50 ------------------------------------------------------ [ 0, 1 ] 6420 3.400% 3.400% # ( 1, 2 ] 95372 50.513% 53.914% ########## ( 2, 3 ] 42810 22.674% 76.588% ##### ( 3, 4 ] 17381 9.206% 85.793% ## ( 4, 6 ] 16353 8.661% 94.455% ## ( 6, 10 ] 4781 2.532% 96.987% # ( 10, 15 ] 1187 0.629% 97.616% ( 15, 22 ] 163 0.086% 97.702% ( 22, 34 ] 22 0.012% 97.714% ( 34, 51 ] 12 0.006% 97.720% ( 51, 76 ] 4 0.002% 97.722% ( 76, 110 ] 124 0.066% 97.788% ( 110, 170 ] 568 0.301% 98.089% ( 170, 250 ] 460 0.244% 98.332% ( 250, 380 ] 394 0.209% 98.541% ( 380, 580 ] 490 0.260% 98.800% ( 580, 870 ] 562 0.298% 99.098% ( 870, 1300 ] 618 0.327% 99.425% ( 1300, 1900 ] 530 0.281% 99.706% ( 1900, 2900 ] 385 0.204% 99.910% ( 2900, 4400 ] 261 0.138% 100.048% ( 4400, 6600 ] 72 0.038% 100.086% ( 6600, 9900 ] 7 0.004% 100.090% ( 9900, 14000 ] 1 0.001% 100.091% ( 14000, 22000 ] 2 0.001% 100.092% ( 22000, 33000 ] 2 0.001% 100.093% ( 33000, 50000 ] 5 0.003% 100.095% ( 75000, 110000 ] 1 0.001% 100.096% ** Level 5 read latency histogram (micros): Count: 17931 Average: 769.7372 StdDev: 1876.78 Min: 76 Median: 264.6518 Max: 95772 Percentiles: P50: 264.65 P75: 721.44 P99: 5847.97 P99.9: 14138.00 P99.99: 63793.12 ------------------------------------------------------ ( 51, 76 ] 1 0.006% 0.006% ( 76, 110 ] 1228 6.848% 6.854% # ( 110, 170 ] 4528 25.252% 32.106% ##### ( 170, 250 ] 2969 16.558% 48.664% ### ( 250, 380 ] 2125 11.851% 60.515% ## ( 380, 580 ] 1932 10.775% 71.290% ## ( 580, 870 ] 1364 7.607% 78.897% ## ( 870, 1300 ] 978 5.454% 84.351% # ( 1300, 1900 ] 762 4.250% 88.601% # ( 1900, 2900 ] 902 5.030% 93.631% # ( 2900, 4400 ] 758 4.227% 97.858% # ( 4400, 6600 ] 311 1.734% 99.593% ( 6600, 9900 ] 53 0.296% 99.888% ( 9900, 14000 ] 2 0.011% 99.900% ( 14000, 22000 ] 4 0.022% 99.922% ( 22000, 33000 ] 6 0.033% 99.955% ( 33000, 50000 ] 4 0.022% 99.978% ( 50000, 75000 ] 4 0.022% 100.000% ( 75000, 110000 ] 2 0.011% 100.011% ** DB Stats ** Uptime(secs): 5.2 total, 5.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 189.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.257 H:M:S, 24.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 195.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.257 H:M:S, 25.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/15-15:12:51 ... thread 0: (1000000,2000000) ops and (273376.5,230389.6) ops/second in (3.657959,8.680947) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.95 GB 163.6 1.6 0.0 1.6 3.4 1.8 0.0 1.9 120.5 259.5 13.59 11.12 34 0.400 1663K 1681 0.0 0.0 L1 1/1 109.60 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 949.63 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 159/0 9.44 GB 1.0 2.3 1.3 1.0 2.3 1.3 0.2 1.8 95.6 95.0 24.97 12.80 14 1.784 392K 0 0.0 0.0 L5 1116/0 92.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1310/13 106.82 GB 0.0 3.9 1.3 2.6 5.8 3.1 4.3 3.1 104.4 153.0 38.56 23.91 48 0.803 2055K 1681 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.3 2.6 5.8 3.1 4.3 3.1 104.4 153.0 38.56 23.91 48 0.803 2055K 1681 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.3 2.6 3.9 1.3 0.0 0.0 129.3 128.8 31.13 18.79 20 1.557 2055K 1681 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 254.4 7.43 5.12 28 0.265 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.8 total, 8.7 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.76 GB write, 667.34 MB/s write, 3.93 GB read, 455.41 MB/s read, 38.6 seconds Interval compaction: 5.76 GB write, 679.43 MB/s write, 3.93 GB read, 463.66 MB/s read, 38.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 4, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 598793 Average: 13.1513 StdDev: 163.43 Min: 0 Median: 1.5444 Max: 56033 Percentiles: P50: 1.54 P75: 1.99 P99: 240.80 P99.9: 762.82 P99.99: 1276.04 ------------------------------------------------------ [ 0, 1 ] 117238 19.579% 19.579% #### ( 1, 2 ] 334600 55.879% 75.458% ########### ( 2, 3 ] 70728 11.812% 87.270% ## ( 3, 4 ] 24538 4.098% 91.368% # ( 4, 6 ] 19805 3.307% 94.675% # ( 6, 10 ] 5211 0.870% 95.546% ( 10, 15 ] 1263 0.211% 95.756% ( 15, 22 ] 206 0.034% 95.791% ( 22, 34 ] 43 0.007% 95.798% ( 34, 51 ] 5 0.001% 95.799% ( 51, 76 ] 9 0.002% 95.800% ( 76, 110 ] 3108 0.519% 96.319% ( 110, 170 ] 11319 1.890% 98.210% ( 170, 250 ] 5348 0.893% 99.103% ( 250, 380 ] 2293 0.383% 99.486% ( 380, 580 ] 1992 0.333% 99.818% ( 580, 870 ] 776 0.130% 99.948% ( 870, 1300 ] 267 0.045% 99.993% ( 1300, 1900 ] 136 0.023% 100.015% ( 1900, 2900 ] 115 0.019% 100.035% ( 2900, 4400 ] 70 0.012% 100.046% ( 4400, 6600 ] 15 0.003% 100.049% ( 6600, 9900 ] 6 0.001% 100.050% ( 14000, 22000 ] 2 0.000% 100.050% ( 22000, 33000 ] 7 0.001% 100.051% ( 33000, 50000 ] 2 0.000% 100.052% ( 50000, 75000 ] 1 0.000% 100.052% ** Level 1 read latency histogram (micros): Count: 27926 Average: 5.1895 StdDev: 58.17 Min: 1 Median: 1.9232 Max: 5620 Percentiles: P50: 1.92 P75: 3.26 P99: 15.05 P99.9: 458.60 P99.99: 3805.55 ------------------------------------------------------ [ 0, 1 ] 1732 6.202% 6.202% # ( 1, 2 ] 13248 47.440% 53.642% ######### ( 2, 3 ] 5348 19.151% 72.792% #### ( 3, 4 ] 2417 8.655% 81.447% ## ( 4, 6 ] 3608 12.920% 94.367% ### ( 6, 10 ] 1068 3.824% 98.192% # ( 10, 15 ] 225 0.806% 98.997% ( 15, 22 ] 110 0.394% 99.391% ( 22, 34 ] 8 0.029% 99.420% ( 34, 51 ] 1 0.004% 99.423% ( 51, 76 ] 1 0.004% 99.427% ( 76, 110 ] 24 0.086% 99.513% ( 110, 170 ] 54 0.193% 99.706% ( 170, 250 ] 28 0.100% 99.807% ( 250, 380 ] 19 0.068% 99.875% ( 380, 580 ] 18 0.064% 99.939% ( 580, 870 ] 10 0.036% 99.975% ( 870, 1300 ] 2 0.007% 99.982% ( 1900, 2900 ] 1 0.004% 99.986% ( 2900, 4400 ] 2 0.007% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 95 Average: 340.9684 StdDev: 750.70 Min: 88 Median: 157.8571 Max: 6209 Percentiles: P50: 157.86 P75: 231.00 P99: 4510.00 P99.9: 6209.00 P99.99: 6209.00 ------------------------------------------------------ ( 76, 110 ] 14 14.737% 14.737% ### ( 110, 170 ] 42 44.211% 58.947% ######### ( 170, 250 ] 20 21.053% 80.000% #### ( 250, 380 ] 7 7.368% 87.368% # ( 380, 580 ] 3 3.158% 90.526% # ( 580, 870 ] 3 3.158% 93.684% # ( 870, 1300 ] 2 2.105% 95.789% ( 1900, 2900 ] 2 2.105% 97.895% ( 2900, 4400 ] 1 1.053% 98.947% ( 4400, 6600 ] 1 1.053% 100.000% ** Level 3 read latency histogram (micros): Count: 111914 Average: 16.2265 StdDev: 211.35 Min: 1 Median: 1.8926 Max: 31571 Percentiles: P50: 1.89 P75: 2.91 P99: 217.70 P99.9: 2333.88 P99.99: 3957.12 ------------------------------------------------------ [ 0, 1 ] 4240 3.789% 3.789% # ( 1, 2 ] 57942 51.774% 55.562% ########## ( 2, 3 ] 23975 21.423% 76.985% #### ( 3, 4 ] 10140 9.061% 86.046% ## ( 4, 6 ] 9972 8.910% 94.956% ## ( 6, 10 ] 2927 2.615% 97.571% # ( 10, 15 ] 700 0.625% 98.197% ( 15, 22 ] 112 0.100% 98.297% ( 22, 34 ] 20 0.018% 98.315% ( 34, 51 ] 4 0.004% 98.318% ( 51, 76 ] 4 0.004% 98.322% ( 76, 110 ] 126 0.113% 98.435% ( 110, 170 ] 482 0.431% 98.865% ( 170, 250 ] 253 0.226% 99.091% ( 250, 380 ] 174 0.155% 99.247% ( 380, 580 ] 184 0.164% 99.411% ( 580, 870 ] 170 0.152% 99.563% ( 870, 1300 ] 200 0.179% 99.742% ( 1300, 1900 ] 135 0.121% 99.862% ( 1900, 2900 ] 97 0.087% 99.949% ( 2900, 4400 ] 65 0.058% 100.007% ( 4400, 6600 ] 14 0.013% 100.020% ( 6600, 9900 ] 2 0.002% 100.021% ( 9900, 14000 ] 4 0.004% 100.025% ( 14000, 22000 ] 3 0.003% 100.028% ( 22000, 33000 ] 1 0.001% 100.029% ** Level 4 read latency histogram (micros): Count: 195342 Average: 34.8463 StdDev: 376.64 Min: 1 Median: 1.9565 Max: 80855 Percentiles: P50: 1.96 P75: 3.10 P99: 775.72 P99.9: 2839.84 P99.99: 3769.58 ------------------------------------------------------ [ 0, 1 ] 6420 3.287% 3.287% # ( 1, 2 ] 95402 48.838% 52.125% ########## ( 2, 3 ] 42983 22.004% 74.129% #### ( 3, 4 ] 17516 8.967% 83.096% ## ( 4, 6 ] 16566 8.481% 91.576% ## ( 6, 10 ] 4812 2.463% 94.040% ( 10, 15 ] 1195 0.612% 94.651% ( 15, 22 ] 165 0.084% 94.736% ( 22, 34 ] 22 0.011% 94.747% ( 34, 51 ] 12 0.006% 94.753% ( 51, 76 ] 4 0.002% 94.755% ( 76, 110 ] 845 0.433% 95.188% ( 110, 170 ] 3520 1.802% 96.990% ( 170, 250 ] 1700 0.870% 97.860% ( 250, 380 ] 885 0.453% 98.313% ( 380, 580 ] 884 0.453% 98.766% ( 580, 870 ] 678 0.347% 99.113% ( 870, 1300 ] 639 0.327% 99.440% ( 1300, 1900 ] 534 0.273% 99.713% ( 1900, 2900 ] 388 0.199% 99.912% ( 2900, 4400 ] 263 0.135% 100.047% ( 4400, 6600 ] 72 0.037% 100.083% ( 6600, 9900 ] 7 0.004% 100.087% ( 9900, 14000 ] 1 0.001% 100.088% ( 14000, 22000 ] 2 0.001% 100.089% ( 22000, 33000 ] 2 0.001% 100.090% ( 33000, 50000 ] 5 0.003% 100.092% ( 75000, 110000 ] 1 0.001% 100.093% ** Level 5 read latency histogram (micros): Count: 64553 Average: 355.8770 StdDev: 1028.71 Min: 73 Median: 164.7338 Max: 95772 Percentiles: P50: 164.73 P75: 267.90 P99: 3868.73 P99.9: 6627.83 P99.99: 21089.40 ------------------------------------------------------ ( 51, 76 ] 4 0.006% 0.006% ( 76, 110 ] 7001 10.845% 10.852% ## ( 110, 170 ] 27704 42.917% 53.768% ######### ( 170, 250 ] 12911 20.001% 73.769% #### ( 250, 380 ] 5779 8.952% 82.721% ## ( 380, 580 ] 4942 7.656% 90.377% ## ( 580, 870 ] 2251 3.487% 93.864% # ( 870, 1300 ] 1117 1.730% 95.594% ( 1300, 1900 ] 787 1.219% 96.813% ( 1900, 2900 ] 921 1.427% 98.240% ( 2900, 4400 ] 761 1.179% 99.419% ( 4400, 6600 ] 311 0.482% 99.901% ( 6600, 9900 ] 53 0.082% 99.983% ( 9900, 14000 ] 2 0.003% 99.986% ( 14000, 22000 ] 4 0.006% 99.992% ( 22000, 33000 ] 6 0.009% 100.002% ( 33000, 50000 ] 4 0.006% 100.008% ( 50000, 75000 ] 4 0.006% 100.014% ( 75000, 110000 ] 2 0.003% 100.017% ** DB Stats ** Uptime(secs): 8.8 total, 3.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 222.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.497 H:M:S, 16.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 269.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.239 H:M:S, 6.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-15:13:00 ... thread 0: (1000000,3000000) ops and (111942.8,170318.3) ops/second in (8.933134,17.614081) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 4.86 GB 257.0 3.9 0.0 3.9 6.6 2.8 0.0 2.4 159.0 272.1 24.96 21.97 53 0.471 4028K 13K 0.0 0.0 L1 1/1 109.60 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 949.63 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 159/0 9.44 GB 1.0 2.3 1.3 1.0 2.3 1.3 0.2 1.8 95.6 95.0 24.97 12.80 14 1.784 392K 0 0.0 0.0 L5 1116/0 92.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1310/13 107.73 GB 0.0 6.2 1.3 4.9 8.9 4.0 4.3 3.2 127.3 183.5 49.93 34.76 67 0.745 4420K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 1.3 4.9 8.9 4.0 4.3 3.2 127.3 183.5 49.93 34.76 67 0.745 4420K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 1.3 4.9 6.2 1.3 0.0 0.0 160.1 159.4 39.71 27.22 24 1.654 4420K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 277.3 10.22 7.54 43 0.238 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.8 total, 17.6 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.95 GB write, 515.52 MB/s write, 6.21 GB read, 357.58 MB/s read, 49.9 seconds Interval compaction: 8.95 GB write, 520.12 MB/s write, 6.21 GB read, 360.77 MB/s read, 49.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 4, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1309832 Average: 15.3610 StdDev: 119.39 Min: 0 Median: 1.4684 Max: 56033 Percentiles: P50: 1.47 P75: 1.93 P99: 243.19 P99.9: 585.88 P99.99: 815.63 ------------------------------------------------------ [ 0, 1 ] 325943 24.884% 24.884% ##### ( 1, 2 ] 702394 53.625% 78.509% ########### ( 2, 3 ] 113416 8.659% 87.168% ## ( 3, 4 ] 42086 3.213% 90.381% # ( 4, 6 ] 29101 2.222% 92.603% ( 6, 10 ] 7051 0.538% 93.141% ( 10, 15 ] 1893 0.145% 93.286% ( 15, 22 ] 323 0.025% 93.310% ( 22, 34 ] 66 0.005% 93.315% ( 34, 51 ] 9 0.001% 93.316% ( 51, 76 ] 18 0.001% 93.317% ( 76, 110 ] 12926 0.987% 94.304% ( 110, 170 ] 46330 3.537% 97.841% # ( 170, 250 ] 16591 1.267% 99.108% ( 250, 380 ] 5745 0.439% 99.547% ( 380, 580 ] 4601 0.351% 99.898% ( 580, 870 ] 1488 0.114% 100.011% ( 870, 1300 ] 363 0.028% 100.039% ( 1300, 1900 ] 156 0.012% 100.051% ( 1900, 2900 ] 137 0.010% 100.061% ( 2900, 4400 ] 82 0.006% 100.068% ( 4400, 6600 ] 16 0.001% 100.069% ( 6600, 9900 ] 6 0.000% 100.069% ( 14000, 22000 ] 2 0.000% 100.070% ( 22000, 33000 ] 7 0.001% 100.070% ( 33000, 50000 ] 2 0.000% 100.070% ( 50000, 75000 ] 1 0.000% 100.070% ** Level 1 read latency histogram (micros): Count: 28169 Average: 6.5774 StdDev: 60.42 Min: 1 Median: 1.9324 Max: 5620 Percentiles: P50: 1.93 P75: 3.33 P99: 126.64 P99.9: 517.16 P99.99: 3787.32 ------------------------------------------------------ [ 0, 1 ] 1732 6.149% 6.149% # ( 1, 2 ] 13248 47.030% 53.179% ######### ( 2, 3 ] 5348 18.985% 72.164% #### ( 3, 4 ] 2417 8.580% 80.745% ## ( 4, 6 ] 3609 12.812% 93.557% ### ( 6, 10 ] 1068 3.791% 97.348% # ( 10, 15 ] 225 0.799% 98.147% ( 15, 22 ] 110 0.391% 98.537% ( 22, 34 ] 8 0.028% 98.566% ( 34, 51 ] 1 0.004% 98.569% ( 51, 76 ] 1 0.004% 98.573% ( 76, 110 ] 69 0.245% 98.818% ( 110, 170 ] 185 0.657% 99.475% ( 170, 250 ] 72 0.256% 99.730% ( 250, 380 ] 30 0.107% 99.837% ( 380, 580 ] 26 0.092% 99.929% ( 580, 870 ] 13 0.046% 99.975% ( 870, 1300 ] 2 0.007% 99.982% ( 1900, 2900 ] 1 0.004% 99.986% ( 2900, 4400 ] 2 0.007% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 320 Average: 218.7000 StdDev: 427.51 Min: 85 Median: 144.9412 Max: 6209 Percentiles: P50: 144.94 P75: 185.00 P99: 2300.00 P99.9: 5896.00 P99.99: 6209.00 ------------------------------------------------------ ( 76, 110 ] 61 19.062% 19.062% #### ( 110, 170 ] 170 53.125% 72.188% ########### ( 170, 250 ] 48 15.000% 87.188% ### ( 250, 380 ] 15 4.688% 91.875% # ( 380, 580 ] 13 4.062% 95.938% # ( 580, 870 ] 5 1.562% 97.500% ( 870, 1300 ] 4 1.250% 98.750% ( 1900, 2900 ] 2 0.625% 99.375% ( 2900, 4400 ] 1 0.312% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 3 read latency histogram (micros): Count: 113884 Average: 18.8895 StdDev: 210.91 Min: 1 Median: 1.9096 Max: 31571 Percentiles: P50: 1.91 P75: 2.97 P99: 281.26 P99.9: 2313.57 P99.99: 3952.58 ------------------------------------------------------ [ 0, 1 ] 4240 3.723% 3.723% # ( 1, 2 ] 57942 50.878% 54.601% ########## ( 2, 3 ] 23975 21.052% 75.653% #### ( 3, 4 ] 10140 8.904% 84.557% ## ( 4, 6 ] 9972 8.756% 93.313% ## ( 6, 10 ] 2927 2.570% 95.884% # ( 10, 15 ] 700 0.615% 96.498% ( 15, 22 ] 112 0.098% 96.597% ( 22, 34 ] 20 0.018% 96.614% ( 34, 51 ] 4 0.004% 96.618% ( 51, 76 ] 4 0.004% 96.621% ( 76, 110 ] 429 0.377% 96.998% ( 110, 170 ] 1613 1.416% 98.414% ( 170, 250 ] 602 0.529% 98.943% ( 250, 380 ] 271 0.238% 99.181% ( 380, 580 ] 249 0.219% 99.399% ( 580, 870 ] 191 0.168% 99.567% ( 870, 1300 ] 203 0.178% 99.745% ( 1300, 1900 ] 136 0.119% 99.865% ( 1900, 2900 ] 97 0.085% 99.950% ( 2900, 4400 ] 65 0.057% 100.007% ( 4400, 6600 ] 14 0.012% 100.019% ( 6600, 9900 ] 2 0.002% 100.021% ( 9900, 14000 ] 4 0.004% 100.025% ( 14000, 22000 ] 3 0.003% 100.027% ( 22000, 33000 ] 1 0.001% 100.028% ** Level 4 read latency histogram (micros): Count: 213639 Average: 46.4012 StdDev: 363.71 Min: 1 Median: 2.1145 Max: 80855 Percentiles: P50: 2.11 P75: 3.86 P99: 754.46 P99.9: 2798.36 P99.99: 3763.98 ------------------------------------------------------ [ 0, 1 ] 6420 3.005% 3.005% # ( 1, 2 ] 95461 44.683% 47.688% ######### ( 2, 3 ] 43124 20.185% 67.874% #### ( 3, 4 ] 17602 8.239% 76.113% ## ( 4, 6 ] 16711 7.822% 83.935% ## ( 6, 10 ] 4827 2.259% 86.194% ( 10, 15 ] 1196 0.560% 86.754% ( 15, 22 ] 165 0.077% 86.832% ( 22, 34 ] 22 0.010% 86.842% ( 34, 51 ] 12 0.006% 86.847% ( 51, 76 ] 4 0.002% 86.849% ( 76, 110 ] 3757 1.759% 88.608% ( 110, 170 ] 13432 6.287% 94.895% # ( 170, 250 ] 4809 2.251% 97.146% ( 250, 380 ] 1816 0.850% 97.996% ( 380, 580 ] 1608 0.753% 98.749% ( 580, 870 ] 892 0.418% 99.166% ( 870, 1300 ] 676 0.316% 99.483% ( 1300, 1900 ] 541 0.253% 99.736% ( 1900, 2900 ] 390 0.183% 99.919% ( 2900, 4400 ] 265 0.124% 100.043% ( 4400, 6600 ] 72 0.034% 100.076% ( 6600, 9900 ] 7 0.003% 100.080% ( 9900, 14000 ] 1 0.000% 100.080% ( 14000, 22000 ] 2 0.001% 100.081% ( 22000, 33000 ] 2 0.001% 100.082% ( 33000, 50000 ] 5 0.002% 100.084% ( 75000, 110000 ] 1 0.000% 100.085% ** Level 5 read latency histogram (micros): Count: 195040 Average: 233.1640 StdDev: 604.87 Min: 73 Median: 150.9973 Max: 95772 Percentiles: P50: 151.00 P75: 208.75 P99: 2038.67 P99.9: 5623.51 P99.99: 8934.66 ------------------------------------------------------ ( 51, 76 ] 21 0.011% 0.011% ( 76, 110 ] 29013 14.875% 14.886% ### ( 110, 170 ] 100230 51.389% 66.276% ########## ( 170, 250 ] 35134 18.014% 84.289% #### ( 250, 380 ] 12393 6.354% 90.643% # ( 380, 580 ] 10356 5.310% 95.953% # ( 580, 870 ] 3670 1.882% 97.835% ( 870, 1300 ] 1320 0.677% 98.512% ( 1300, 1900 ] 821 0.421% 98.933% ( 1900, 2900 ] 949 0.487% 99.419% ( 2900, 4400 ] 765 0.392% 99.811% ( 4400, 6600 ] 311 0.159% 99.971% ( 6600, 9900 ] 53 0.027% 99.998% ( 9900, 14000 ] 2 0.001% 99.999% ( 14000, 22000 ] 4 0.002% 100.001% ( 22000, 33000 ] 6 0.003% 100.004% ( 33000, 50000 ] 4 0.002% 100.006% ( 50000, 75000 ] 4 0.002% 100.008% ( 75000, 110000 ] 2 0.001% 100.009% ** DB Stats ** Uptime(secs): 17.8 total, 8.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 166.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.777 H:M:S, 38.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 110.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.281 H:M:S, 59.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-15:13:35 ... thread 0: (1000000,4000000) ops and (28032.6,75065.5) ops/second in (35.672716,53.286797) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 5.90 GB 388.4 6.4 0.0 6.4 10.2 3.8 0.0 2.7 173.3 276.1 37.79 34.22 76 0.497 6650K 21K 0.0 0.0 L1 1/1 109.60 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 949.63 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 159/0 9.44 GB 1.0 2.3 1.3 1.0 2.3 1.3 0.2 1.8 95.6 95.0 24.97 12.80 14 1.784 392K 0 0.0 0.0 L5 1116/0 92.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1307/9 108.77 GB 0.0 8.7 1.3 7.4 12.5 5.1 4.3 3.3 142.4 204.0 62.76 47.02 90 0.697 7042K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.7 1.3 7.4 12.5 5.1 4.3 3.3 142.4 204.0 62.76 47.02 90 0.697 7042K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.7 1.3 7.4 8.7 1.3 0.0 0.0 181.8 181.1 49.15 36.51 30 1.638 7042K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 287.0 13.61 10.51 60 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.4 total, 53.3 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.51 GB write, 239.61 MB/s write, 8.73 GB read, 167.22 MB/s read, 62.8 seconds Interval compaction: 12.51 GB write, 240.32 MB/s write, 8.73 GB read, 167.71 MB/s read, 62.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 4, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2309716 Average: 28.7864 StdDev: 106.08 Min: 0 Median: 1.5889 Max: 56033 Percentiles: P50: 1.59 P75: 2.75 P99: 246.39 P99.9: 574.13 P99.99: 795.17 ------------------------------------------------------ [ 0, 1 ] 516637 22.368% 22.368% #### ( 1, 2 ] 1083721 46.920% 69.288% ######### ( 2, 3 ] 176276 7.632% 76.920% ## ( 3, 4 ] 73654 3.189% 80.109% # ( 4, 6 ] 50006 2.165% 82.274% ( 6, 10 ] 9224 0.399% 82.673% ( 10, 15 ] 2762 0.120% 82.793% ( 15, 22 ] 491 0.021% 82.814% ( 22, 34 ] 104 0.005% 82.819% ( 34, 51 ] 15 0.001% 82.819% ( 51, 76 ] 74 0.003% 82.822% ( 76, 110 ] 80810 3.499% 86.321% # ( 110, 170 ] 245698 10.638% 96.959% ## ( 170, 250 ] 49377 2.138% 99.097% ( 250, 380 ] 10765 0.466% 99.563% ( 380, 580 ] 8029 0.348% 99.910% ( 580, 870 ] 2484 0.108% 100.018% ( 870, 1300 ] 495 0.021% 100.039% ( 1300, 1900 ] 178 0.008% 100.047% ( 1900, 2900 ] 219 0.009% 100.056% ( 2900, 4400 ] 153 0.007% 100.063% ( 4400, 6600 ] 16 0.001% 100.064% ( 6600, 9900 ] 6 0.000% 100.064% ( 14000, 22000 ] 2 0.000% 100.064% ( 22000, 33000 ] 7 0.000% 100.064% ( 33000, 50000 ] 2 0.000% 100.064% ( 50000, 75000 ] 1 0.000% 100.065% ** Level 1 read latency histogram (micros): Count: 29277 Average: 11.6089 StdDev: 65.63 Min: 1 Median: 1.9742 Max: 5620 Percentiles: P50: 1.97 P75: 3.67 P99: 168.95 P99.9: 548.36 P99.99: 3704.22 ------------------------------------------------------ [ 0, 1 ] 1732 5.916% 5.916% # ( 1, 2 ] 13248 45.251% 51.166% ######### ( 2, 3 ] 5348 18.267% 69.433% #### ( 3, 4 ] 2417 8.256% 77.689% ## ( 4, 6 ] 3609 12.327% 90.016% ## ( 6, 10 ] 1068 3.648% 93.664% # ( 10, 15 ] 225 0.769% 94.432% ( 15, 22 ] 110 0.376% 94.808% ( 22, 34 ] 8 0.027% 94.836% ( 34, 51 ] 1 0.003% 94.839% ( 51, 76 ] 1 0.003% 94.842% ( 76, 110 ] 385 1.315% 96.157% ( 110, 170 ] 847 2.893% 99.050% # ( 170, 250 ] 166 0.567% 99.617% ( 250, 380 ] 44 0.150% 99.768% ( 380, 580 ] 46 0.157% 99.925% ( 580, 870 ] 14 0.048% 99.973% ( 870, 1300 ] 3 0.010% 99.983% ( 1900, 2900 ] 1 0.003% 99.986% ( 2900, 4400 ] 2 0.007% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 1448 Average: 160.6547 StdDev: 209.75 Min: 81 Median: 138.5278 Max: 6209 Percentiles: P50: 138.53 P75: 162.21 P99: 661.20 P99.9: 3728.00 P99.99: 6209.00 ------------------------------------------------------ ( 76, 110 ] 288 19.890% 19.890% #### ( 110, 170 ] 917 63.329% 83.218% ############# ( 170, 250 ] 171 11.809% 95.028% ## ( 250, 380 ] 28 1.934% 96.961% ( 380, 580 ] 27 1.865% 98.826% ( 580, 870 ] 9 0.622% 99.448% ( 870, 1300 ] 4 0.276% 99.724% ( 1900, 2900 ] 2 0.138% 99.862% ( 2900, 4400 ] 1 0.069% 99.931% ( 4400, 6600 ] 1 0.069% 100.000% ** Level 3 read latency histogram (micros): Count: 123235 Average: 28.3550 StdDev: 206.27 Min: 1 Median: 1.9903 Max: 31571 Percentiles: P50: 1.99 P75: 3.62 P99: 325.29 P99.9: 2230.96 P99.99: 3931.00 ------------------------------------------------------ [ 0, 1 ] 4240 3.441% 3.441% # ( 1, 2 ] 57942 47.017% 50.458% ######### ( 2, 3 ] 23975 19.455% 69.913% #### ( 3, 4 ] 10140 8.228% 78.141% ## ( 4, 6 ] 9972 8.092% 86.233% ## ( 6, 10 ] 2927 2.375% 88.608% ( 10, 15 ] 700 0.568% 89.176% ( 15, 22 ] 112 0.091% 89.267% ( 22, 34 ] 20 0.016% 89.283% ( 34, 51 ] 4 0.003% 89.286% ( 51, 76 ] 6 0.005% 89.291% ( 76, 110 ] 2485 2.016% 91.308% ( 110, 170 ] 7642 6.201% 97.509% # ( 170, 250 ] 1606 1.303% 98.812% ( 250, 380 ] 400 0.325% 99.137% ( 380, 580 ] 352 0.286% 99.422% ( 580, 870 ] 215 0.174% 99.597% ( 870, 1300 ] 205 0.166% 99.763% ( 1300, 1900 ] 136 0.110% 99.873% ( 1900, 2900 ] 99 0.080% 99.954% ( 2900, 4400 ] 65 0.053% 100.006% ( 4400, 6600 ] 14 0.011% 100.018% ( 6600, 9900 ] 2 0.002% 100.019% ( 9900, 14000 ] 4 0.003% 100.023% ( 14000, 22000 ] 3 0.002% 100.025% ( 22000, 33000 ] 1 0.001% 100.026% ** Level 4 read latency histogram (micros): Count: 299216 Average: 74.0534 StdDev: 312.51 Min: 1 Median: 3.2615 Max: 80855 Percentiles: P50: 3.26 P75: 124.11 P99: 578.15 P99.9: 2587.74 P99.99: 3712.47 ------------------------------------------------------ [ 0, 1 ] 6420 2.146% 2.146% ( 1, 2 ] 95461 31.904% 34.049% ###### ( 2, 3 ] 43125 14.413% 48.462% ### ( 3, 4 ] 17603 5.883% 54.345% # ( 4, 6 ] 16711 5.585% 59.930% # ( 6, 10 ] 4827 1.613% 61.543% ( 10, 15 ] 1196 0.400% 61.943% ( 15, 22 ] 165 0.055% 61.998% ( 22, 34 ] 22 0.007% 62.005% ( 34, 51 ] 12 0.004% 62.009% ( 51, 76 ] 25 0.008% 62.018% ( 76, 110 ] 22602 7.554% 69.571% ## ( 110, 170 ] 69062 23.081% 92.652% ##### ( 170, 250 ] 13425 4.487% 97.139% # ( 250, 380 ] 3082 1.030% 98.169% ( 380, 580 ] 2510 0.839% 99.008% ( 580, 870 ] 1144 0.382% 99.390% ( 870, 1300 ] 702 0.235% 99.625% ( 1300, 1900 ] 548 0.183% 99.808% ( 1900, 2900 ] 401 0.134% 99.942% ( 2900, 4400 ] 266 0.089% 100.031% ( 4400, 6600 ] 72 0.024% 100.055% ( 6600, 9900 ] 7 0.002% 100.057% ( 9900, 14000 ] 1 0.000% 100.058% ( 14000, 22000 ] 2 0.001% 100.058% ( 22000, 33000 ] 2 0.001% 100.059% ( 33000, 50000 ] 5 0.002% 100.061% ( 75000, 110000 ] 1 0.000% 100.061% ** Level 5 read latency histogram (micros): Count: 807750 Average: 164.5609 StdDev: 305.29 Min: 71 Median: 138.7253 Max: 95772 Percentiles: P50: 138.73 P75: 163.07 P99: 677.29 P99.9: 3501.64 P99.99: 6249.02 ------------------------------------------------------ ( 51, 76 ] 113 0.014% 0.014% ( 76, 110 ] 165530 20.493% 20.507% #### ( 110, 170 ] 497610 61.604% 82.111% ############ ( 170, 250 ] 96328 11.925% 94.037% ## ( 250, 380 ] 21536 2.666% 96.703% # ( 380, 580 ] 16769 2.076% 98.779% ( 580, 870 ] 5331 0.660% 99.439% ( 870, 1300 ] 1524 0.189% 99.627% ( 1300, 1900 ] 866 0.107% 99.735% ( 1900, 2900 ] 1026 0.127% 99.862% ( 2900, 4400 ] 776 0.096% 99.958% ( 4400, 6600 ] 312 0.039% 99.996% ( 6600, 9900 ] 53 0.007% 100.003% ( 9900, 14000 ] 2 0.000% 100.003% ( 14000, 22000 ] 4 0.000% 100.004% ( 22000, 33000 ] 6 0.001% 100.004% ( 33000, 50000 ] 4 0.000% 100.005% ( 50000, 75000 ] 4 0.000% 100.005% ( 75000, 110000 ] 2 0.000% 100.006% ** DB Stats ** Uptime(secs): 53.4 total, 35.7 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 73.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:38.403 H:M:S, 71.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 27.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:31.626 H:M:S, 88.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 214.367 micros/op 18643 ops/sec 60.127 seconds 1120996 operations; 18.1 MB/s (277999 of 277999 found) Microseconds per read: Count: 1120996 Average: 214.3690 StdDev: 711.01 Min: 2 Median: 171.1898 Max: 299241 Percentiles: P50: 171.19 P75: 230.08 P99: 725.82 P99.9: 5047.98 P99.99: 24469.65 ------------------------------------------------------ ( 1, 2 ] 23 0.002% 0.002% ( 2, 3 ] 71 0.006% 0.008% ( 3, 4 ] 43 0.004% 0.012% ( 4, 6 ] 115 0.010% 0.022% ( 6, 10 ] 579 0.052% 0.074% ( 10, 15 ] 4199 0.375% 0.449% ( 15, 22 ] 2394 0.214% 0.662% ( 22, 34 ] 9821 0.876% 1.538% ( 34, 51 ] 1752 0.156% 1.695% ( 51, 76 ] 215 0.019% 1.714% ( 76, 110 ] 24152 2.155% 3.868% ( 110, 170 ] 511472 45.627% 49.495% ######### ( 170, 250 ] 380690 33.960% 83.455% ####### ( 250, 380 ] 125075 11.157% 94.612% ## ( 380, 580 ] 42827 3.820% 98.433% # ( 580, 870 ] 12645 1.128% 99.561% ( 870, 1300 ] 2654 0.237% 99.798% ( 1300, 1900 ] 456 0.041% 99.838% ( 1900, 2900 ] 357 0.032% 99.870% ( 2900, 4400 ] 249 0.022% 99.892% ( 4400, 6600 ] 292 0.026% 99.918% ( 6600, 9900 ] 277 0.025% 99.943% ( 9900, 14000 ] 207 0.018% 99.962% ( 14000, 22000 ] 296 0.026% 99.988% ( 22000, 33000 ] 102 0.009% 99.997% ( 33000, 50000 ] 20 0.002% 99.999% ( 50000, 75000 ] 7 0.001% 99.999% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 4 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 18253639 rocksdb.bloom.filter.full.positive COUNT : 1298410 rocksdb.bloom.filter.full.true.positive COUNT : 1120497 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 499 rocksdb.memtable.miss COUNT : 1120497 rocksdb.l0.hit COUNT : 62527 rocksdb.l1.hit COUNT : 1149 rocksdb.l2andup.hit COUNT : 1056821 rocksdb.compaction.key.drop.new COUNT : 54021 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4022773 rocksdb.number.keys.read COUNT : 1120996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4151501736 rocksdb.bytes.read COUNT : 1120996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1422 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 44970376 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 11535332839 rocksdb.compact.write.bytes COUNT : 11481473253 rocksdb.flush.write.bytes COUNT : 4095753876 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 64 rocksdb.number.superversion_acquires COUNT : 651 rocksdb.number.superversion_releases COUNT : 624 rocksdb.number.superversion_cleanups COUNT : 166 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4062504960 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1382400 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 16320151338 rocksdb.non.last.level.read.count COUNT : 3798221 rocksdb.block.checksum.compute.count COUNT : 4104571 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 169.746120 P95 : 398.393803 P99 : 724.666529 P100 : 299238.000000 COUNT : 1120996 SUM : 239343706 rocksdb.db.write.micros P50 : 1.528005 P95 : 4.534762 P99 : 13.921309 P100 : 796641.000000 COUNT : 4022773 SUM : 54924513 rocksdb.compaction.times.micros P50 : 1200000.000000 P95 : 4850000.000000 P99 : 5771508.000000 P100 : 5771508.000000 COUNT : 30 SUM : 49154868 rocksdb.compaction.times.cpu_micros P50 : 1021052.631579 P95 : 4850000.000000 P99 : 5664554.000000 P100 : 5664554.000000 COUNT : 30 SUM : 36506843 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 757.741935 P95 : 1900.000000 P99 : 134000.000000 P100 : 155931.000000 COUNT : 60 SUM : 221894 rocksdb.compaction.outfile.sync.micros P50 : 5133.333333 P95 : 116000.000000 P99 : 283800.000000 P100 : 323075.000000 COUNT : 74 SUM : 2172358 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 156.153846 P95 : 4965.714286 P99 : 6273.142857 P100 : 6371.000000 COUNT : 104 SUM : 91878 rocksdb.table.open.io.micros P50 : 6698.019802 P95 : 18868.750000 P99 : 28215.000000 P100 : 235170.000000 COUNT : 1422 SUM : 12220974 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.652004 P95 : 146.275630 P99 : 237.185389 P100 : 56038.000000 COUNT : 2794165 SUM : 67828765 rocksdb.read.block.get.micros P50 : 139.904115 P95 : 249.809127 P99 : 565.868350 P100 : 96197.000000 COUNT : 1309011 SUM : 203037128 rocksdb.write.raw.block.micros P50 : 0.535792 P95 : 1.345558 P99 : 3.291246 P100 : 83020.000000 COUNT : 3772698 SUM : 9489435 rocksdb.numfiles.in.singlecompaction P50 : 3.424242 P95 : 5.700000 P99 : 9.000000 P100 : 9.000000 COUNT : 46 SUM : 176 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.572556 P95 : 1266.163742 P99 : 2670.226112 P100 : 796480.000000 COUNT : 243271 SUM : 44988159 rocksdb.sst.read.micros P50 : 2.443822 P95 : 201.915759 P99 : 436.415959 P100 : 95772.000000 COUNT : 3798355 SUM : 253838757 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1120996 SUM : 1120996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4022773 SUM : 4151501736 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213636.363636 P95 : 475000.000000 P99 : 996000.000000 P100 : 1039123.000000 COUNT : 60 SUM : 13609602 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 116 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0