[2024-12-06 21:40:45.468959] Starting SPDK v25.01-pre git sha1 0354bb8e8 / DPDK 24.03.0 initialization... [2024-12-06 21:40:45.469097] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1591364 ] Set seed to 1733517645465496 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-06 21:40:45.582764] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-06 21:40:45.689986] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-06 21:40:45.690035] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1591364' to capture a snapshot of events at runtime. [2024-12-06 21:40:45.690045] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-06 21:40:45.690056] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-06 21:40:45.690063] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1591364 for offline analysis/debug. [2024-12-06 21:40:45.691487] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 6 21:40:54 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/06-21:41:01 ... thread 0: (1000000,1000000) ops and (128488.8,128488.8) ops/second in (7.782782,7.782782) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 1.47 GB 44.0 0.4 0.0 0.4 1.2 0.8 0.0 1.5 38.0 120.4 9.93 3.96 10 0.993 383K 495 0.0 0.0 L1 4/4 439.02 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 3/1 239.50 MB 1.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 45/8 2.37 GB 1.9 2.1 1.3 0.8 2.1 1.3 0.0 1.6 96.1 95.3 22.69 10.41 15 1.513 873K 0 0.0 0.0 L4 185/7 11.96 GB 1.2 3.5 2.5 1.0 3.5 2.5 0.0 1.4 99.7 99.2 36.24 17.37 22 1.647 1086K 40 0.0 0.0 L5 1090/0 90.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1337/28 106.52 GB 0.0 6.0 3.8 2.2 6.8 4.6 0.0 8.5 89.7 101.0 68.86 31.75 47 1.465 2342K 535 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 3.8 2.2 6.8 4.6 0.0 8.5 89.7 101.0 68.86 31.75 47 1.465 2342K 535 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 3.8 2.2 6.0 3.8 0.0 0.0 100.1 99.4 61.69 29.34 38 1.623 2342K 535 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 114.2 7.17 2.41 9 0.797 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.79 GB write, 871.08 MB/s write, 6.03 GB read, 773.50 MB/s read, 68.9 seconds Interval compaction: 6.79 GB write, 893.09 MB/s write, 6.03 GB read, 793.04 MB/s read, 68.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 40, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 271813 Average: 13.6590 StdDev: 182.23 Min: 1 Median: 1.9730 Max: 15928 Percentiles: P50: 1.97 P75: 2.91 P99: 10.67 P99.9: 2836.49 P99.99: 5275.01 ------------------------------------------------------ [ 0, 1 ] 6054 2.227% 2.227% ( 1, 2 ] 133453 49.097% 51.325% ########## ( 2, 3 ] 70732 26.022% 77.347% ##### ( 3, 4 ] 24887 9.156% 86.503% ## ( 4, 6 ] 26752 9.842% 96.345% ## ( 6, 10 ] 7058 2.597% 98.942% # ( 10, 15 ] 1188 0.437% 99.379% ( 15, 22 ] 139 0.051% 99.430% ( 22, 34 ] 21 0.008% 99.437% ( 34, 51 ] 4 0.001% 99.439% ( 51, 76 ] 5 0.002% 99.441% ( 76, 110 ] 1 0.000% 99.441% ( 110, 170 ] 9 0.003% 99.444% ( 170, 250 ] 35 0.013% 99.457% ( 250, 380 ] 45 0.017% 99.474% ( 380, 580 ] 123 0.045% 99.519% ( 580, 870 ] 223 0.082% 99.601% ( 870, 1300 ] 295 0.109% 99.710% ( 1300, 1900 ] 284 0.104% 99.814% ( 1900, 2900 ] 249 0.092% 99.906% ( 2900, 4400 ] 197 0.072% 99.978% ( 4400, 6600 ] 80 0.029% 100.008% ( 6600, 9900 ] 20 0.007% 100.015% ( 9900, 14000 ] 4 0.001% 100.017% ( 14000, 22000 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 43993 Average: 21.7002 StdDev: 262.47 Min: 1 Median: 2.0854 Max: 10854 Percentiles: P50: 2.09 P75: 2.93 P99: 14.53 P99.9: 4259.54 P99.99: 9108.23 ------------------------------------------------------ [ 0, 1 ] 555 1.262% 1.262% ( 1, 2 ] 20324 46.198% 47.460% ######### ( 2, 3 ] 13085 29.743% 77.203% ###### ( 3, 4 ] 3810 8.660% 85.864% ## ( 4, 6 ] 4270 9.706% 95.570% ## ( 6, 10 ] 1258 2.860% 98.429% # ( 10, 15 ] 277 0.630% 99.059% ( 15, 22 ] 43 0.098% 99.157% ( 22, 34 ] 4 0.009% 99.166% ( 34, 51 ] 1 0.002% 99.168% ( 51, 76 ] 2 0.005% 99.173% ( 76, 110 ] 1 0.002% 99.175% ( 170, 250 ] 6 0.014% 99.189% ( 250, 380 ] 12 0.027% 99.216% ( 380, 580 ] 21 0.048% 99.264% ( 580, 870 ] 51 0.116% 99.379% ( 870, 1300 ] 55 0.125% 99.504% ( 1300, 1900 ] 47 0.107% 99.611% ( 1900, 2900 ] 69 0.157% 99.768% ( 2900, 4400 ] 64 0.145% 99.914% ( 4400, 6600 ] 26 0.059% 99.973% ( 6600, 9900 ] 10 0.023% 99.995% ( 9900, 14000 ] 2 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 293714 Average: 17.2405 StdDev: 214.21 Min: 1 Median: 2.0561 Max: 10970 Percentiles: P50: 2.06 P75: 2.98 P99: 13.02 P99.9: 2407.64 P99.99: 3194.56 ------------------------------------------------------ [ 0, 1 ] 5416 1.844% 1.844% ( 1, 2 ] 136969 46.633% 48.477% ######### ( 2, 3 ] 79740 27.149% 75.626% ##### ( 3, 4 ] 28068 9.556% 85.183% ## ( 4, 6 ] 30811 10.490% 95.673% ## ( 6, 10 ] 8501 2.894% 98.567% # ( 10, 15 ] 2104 0.716% 99.283% ( 15, 22 ] 333 0.113% 99.397% ( 22, 34 ] 39 0.013% 99.410% ( 34, 51 ] 12 0.004% 99.414% ( 51, 76 ] 13 0.004% 99.418% ( 76, 110 ] 5 0.002% 99.420% ( 110, 170 ] 16 0.005% 99.426% ( 170, 250 ] 23 0.008% 99.433% ( 250, 380 ] 64 0.022% 99.455% ( 380, 580 ] 148 0.050% 99.506% ( 580, 870 ] 222 0.076% 99.581% ( 870, 1300 ] 332 0.113% 99.694% ( 1300, 1900 ] 386 0.131% 99.826% ( 1900, 2900 ] 430 0.146% 99.972% ( 2900, 4400 ] 268 0.091% 100.063% ( 4400, 6600 ] 123 0.042% 100.105% ( 6600, 9900 ] 38 0.013% 100.118% ( 9900, 14000 ] 5 0.002% 100.120% ** Level 3 read latency histogram (micros): Count: 860520 Average: 18.2725 StdDev: 218.73 Min: 1 Median: 2.1737 Max: 18844 Percentiles: P50: 2.17 P75: 2.99 P99: 11.77 P99.9: 2059.62 P99.99: 2622.87 ------------------------------------------------------ [ 0, 1 ] 9050 1.052% 1.052% ( 1, 2 ] 375371 43.621% 44.673% ######### ( 2, 3 ] 263840 30.661% 75.334% ###### ( 3, 4 ] 85704 9.960% 85.293% ## ( 4, 6 ] 92582 10.759% 96.052% ## ( 6, 10 ] 23511 2.732% 98.784% # ( 10, 15 ] 5260 0.611% 99.395% ( 15, 22 ] 694 0.081% 99.476% ( 22, 34 ] 65 0.008% 99.484% ( 34, 51 ] 30 0.003% 99.487% ( 51, 76 ] 33 0.004% 99.491% ( 76, 110 ] 15 0.002% 99.493% ( 110, 170 ] 17 0.002% 99.495% ( 170, 250 ] 74 0.009% 99.503% ( 250, 380 ] 125 0.015% 99.518% ( 380, 580 ] 307 0.036% 99.554% ( 580, 870 ] 579 0.067% 99.621% ( 870, 1300 ] 931 0.108% 99.729% ( 1300, 1900 ] 1253 0.146% 99.875% ( 1900, 2900 ] 1375 0.160% 100.034% ( 2900, 4400 ] 1044 0.121% 100.156% ( 4400, 6600 ] 371 0.043% 100.199% ( 6600, 9900 ] 68 0.008% 100.207% ( 9900, 14000 ] 5 0.001% 100.207% ( 14000, 22000 ] 4 0.000% 100.208% ** Level 4 read latency histogram (micros): Count: 332782 Average: 28.2495 StdDev: 281.23 Min: 1 Median: 2.2056 Max: 27229 Percentiles: P50: 2.21 P75: 3.04 P99: 578.66 P99.9: 3156.03 P99.99: 3913.63 ------------------------------------------------------ [ 0, 1 ] 2965 0.891% 0.891% ( 1, 2 ] 142251 42.746% 43.637% ######### ( 2, 3 ] 102994 30.949% 74.586% ###### ( 3, 4 ] 34736 10.438% 85.024% ## ( 4, 6 ] 35679 10.721% 95.746% ## ( 6, 10 ] 8322 2.501% 98.247% # ( 10, 15 ] 1727 0.519% 98.766% ( 15, 22 ] 238 0.072% 98.837% ( 22, 34 ] 27 0.008% 98.845% ( 34, 51 ] 18 0.005% 98.851% ( 51, 76 ] 19 0.006% 98.856% ( 76, 110 ] 7 0.002% 98.858% ( 110, 170 ] 21 0.006% 98.865% ( 170, 250 ] 61 0.018% 98.883% ( 250, 380 ] 122 0.037% 98.920% ( 380, 580 ] 272 0.082% 99.001% ( 580, 870 ] 496 0.149% 99.150% ( 870, 1300 ] 764 0.230% 99.380% ( 1300, 1900 ] 817 0.246% 99.626% ( 1900, 2900 ] 815 0.245% 99.870% ( 2900, 4400 ] 593 0.178% 100.049% ( 4400, 6600 ] 250 0.075% 100.124% ( 6600, 9900 ] 45 0.014% 100.137% ( 9900, 14000 ] 4 0.001% 100.139% ( 22000, 33000 ] 2 0.001% 100.139% ** Level 5 read latency histogram (micros): Count: 9139 Average: 2399.9337 StdDev: 1845.98 Min: 103 Median: 1854.4755 Max: 26759 Percentiles: P50: 1854.48 P75: 3523.08 P99: 9018.31 P99.9: 12829.20 P99.99: 22947.10 ------------------------------------------------------ ( 76, 110 ] 3 0.033% 0.033% ( 110, 170 ] 25 0.274% 0.306% ( 170, 250 ] 86 0.941% 1.247% ( 250, 380 ] 252 2.757% 4.005% # ( 380, 580 ] 560 6.128% 10.132% # ( 580, 870 ] 1017 11.128% 21.261% ## ( 870, 1300 ] 1305 14.279% 35.540% ### ( 1300, 1900 ] 1430 15.647% 51.187% ### ( 1900, 2900 ] 1500 16.413% 67.600% ### ( 2900, 4400 ] 1628 17.814% 85.414% #### ( 4400, 6600 ] 1065 11.653% 97.068% ## ( 6600, 9900 ] 241 2.637% 99.705% # ( 9900, 14000 ] 25 0.274% 99.978% ( 14000, 22000 ] 1 0.011% 99.989% ( 22000, 33000 ] 1 0.011% 100.000% ** DB Stats ** Uptime(secs): 8.0 total, 7.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 123.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.845 H:M:S, 48.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.845 H:M:S, 49.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/06-21:41:07 ... thread 0: (1000000,2000000) ops and (190208.3,153372.2) ops/second in (5.257394,13.040176) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.84 GB 138.4 1.4 0.0 1.4 3.2 1.8 0.0 1.7 67.7 159.8 20.48 11.08 28 0.732 1407K 1778 0.0 0.0 L1 16/0 1.09 GB 111.7 1.1 0.7 0.4 1.1 0.7 0.0 1.6 92.6 92.3 12.10 5.63 1 12.103 1138K 4696 0.0 0.0 L2 1/0 79.60 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 22/0 946.81 MB 0.9 2.4 1.5 1.0 2.4 1.4 0.0 1.6 97.4 96.5 25.46 11.82 17 1.498 954K 0 0.0 0.0 L4 166/0 9.57 GB 1.0 6.5 3.9 2.6 6.5 3.9 0.2 1.6 106.9 105.5 62.69 31.87 44 1.425 2596K 2346 0.0 0.0 L5 1135/0 93.98 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1352/8 107.49 GB 0.0 11.4 6.1 5.3 13.1 7.8 4.1 7.1 96.8 111.5 120.74 60.41 90 1.342 6096K 8820 0.0 0.0 Int 0/0 0.00 KB 0.0 11.4 6.1 5.3 13.1 7.8 4.1 7.1 96.8 111.5 120.74 60.41 90 1.342 6096K 8820 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.4 6.1 5.3 11.3 6.0 0.0 0.0 107.9 106.8 108.33 54.91 66 1.641 6096K 8820 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 152.3 12.41 5.50 24 0.517 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.2 total, 13.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.14 GB write, 1016.60 MB/s write, 11.42 GB read, 883.14 MB/s read, 120.7 seconds Interval compaction: 13.14 GB write, 1031.93 MB/s write, 11.42 GB read, 896.46 MB/s read, 120.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 67, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 67, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 588776 Average: 14.7485 StdDev: 167.16 Min: 1 Median: 1.7834 Max: 15928 Percentiles: P50: 1.78 P75: 2.63 P99: 221.99 P99.9: 2468.02 P99.99: 4243.00 ------------------------------------------------------ [ 0, 1 ] 43021 7.307% 7.307% # ( 1, 2 ] 320883 54.500% 61.807% ########### ( 2, 3 ] 122567 20.817% 82.624% #### ( 3, 4 ] 40866 6.941% 89.565% # ( 4, 6 ] 40965 6.958% 96.523% # ( 6, 10 ] 10283 1.747% 98.269% ( 10, 15 ] 1660 0.282% 98.551% ( 15, 22 ] 196 0.033% 98.584% ( 22, 34 ] 32 0.005% 98.590% ( 34, 51 ] 9 0.002% 98.591% ( 51, 76 ] 14 0.002% 98.594% ( 76, 110 ] 128 0.022% 98.615% ( 110, 170 ] 1398 0.237% 98.853% ( 170, 250 ] 1333 0.226% 99.079% ( 250, 380 ] 1023 0.174% 99.253% ( 380, 580 ] 1121 0.190% 99.443% ( 580, 870 ] 1066 0.181% 99.624% ( 870, 1300 ] 845 0.144% 99.768% ( 1300, 1900 ] 529 0.090% 99.858% ( 1900, 2900 ] 437 0.074% 99.932% ( 2900, 4400 ] 381 0.065% 99.997% ( 4400, 6600 ] 127 0.022% 100.018% ( 6600, 9900 ] 33 0.006% 100.024% ( 9900, 14000 ] 4 0.001% 100.025% ( 14000, 22000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 111950 Average: 13.6033 StdDev: 176.73 Min: 1 Median: 2.4198 Max: 10854 Percentiles: P50: 2.42 P75: 3.66 P99: 17.96 P99.9: 3032.19 P99.99: 6865.65 ------------------------------------------------------ [ 0, 1 ] 904 0.808% 0.808% ( 1, 2 ] 41195 36.798% 37.605% ####### ( 2, 3 ] 33052 29.524% 67.129% ###### ( 3, 4 ] 13438 12.004% 79.133% ## ( 4, 6 ] 16289 14.550% 93.683% ### ( 6, 10 ] 4912 4.388% 98.071% # ( 10, 15 ] 932 0.833% 98.903% ( 15, 22 ] 257 0.230% 99.133% ( 22, 34 ] 33 0.029% 99.162% ( 34, 51 ] 10 0.009% 99.171% ( 51, 76 ] 13 0.012% 99.183% ( 76, 110 ] 20 0.018% 99.201% ( 110, 170 ] 118 0.105% 99.306% ( 170, 250 ] 111 0.099% 99.405% ( 250, 380 ] 78 0.070% 99.475% ( 380, 580 ] 96 0.086% 99.561% ( 580, 870 ] 117 0.105% 99.665% ( 870, 1300 ] 104 0.093% 99.758% ( 1300, 1900 ] 73 0.065% 99.823% ( 1900, 2900 ] 79 0.071% 99.894% ( 2900, 4400 ] 80 0.071% 99.965% ( 4400, 6600 ] 27 0.024% 99.989% ( 6600, 9900 ] 10 0.009% 99.998% ( 9900, 14000 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 320277 Average: 16.7629 StdDev: 210.01 Min: 1 Median: 2.0714 Max: 10970 Percentiles: P50: 2.07 P75: 2.98 P99: 12.95 P99.9: 2418.56 P99.99: 3297.38 ------------------------------------------------------ [ 0, 1 ] 5629 1.758% 1.758% ( 1, 2 ] 148233 46.283% 48.040% ######### ( 2, 3 ] 87913 27.449% 75.489% ##### ( 3, 4 ] 30655 9.571% 85.061% ## ( 4, 6 ] 33984 10.611% 95.672% ## ( 6, 10 ] 9330 2.913% 98.585% # ( 10, 15 ] 2252 0.703% 99.288% ( 15, 22 ] 357 0.111% 99.399% ( 22, 34 ] 41 0.013% 99.412% ( 34, 51 ] 12 0.004% 99.416% ( 51, 76 ] 14 0.004% 99.420% ( 76, 110 ] 7 0.002% 99.422% ( 110, 170 ] 28 0.009% 99.431% ( 170, 250 ] 30 0.009% 99.440% ( 250, 380 ] 75 0.023% 99.464% ( 380, 580 ] 163 0.051% 99.515% ( 580, 870 ] 244 0.076% 99.591% ( 870, 1300 ] 358 0.112% 99.703% ( 1300, 1900 ] 402 0.126% 99.828% ( 1900, 2900 ] 443 0.138% 99.967% ( 2900, 4400 ] 283 0.088% 100.055% ( 4400, 6600 ] 132 0.041% 100.096% ( 6600, 9900 ] 39 0.012% 100.108% ( 9900, 14000 ] 5 0.002% 100.110% ** Level 3 read latency histogram (micros): Count: 1179643 Average: 15.9764 StdDev: 198.35 Min: 1 Median: 2.1529 Max: 18844 Percentiles: P50: 2.15 P75: 2.98 P99: 11.27 P99.9: 1818.68 P99.99: 2472.78 ------------------------------------------------------ [ 0, 1 ] 12729 1.079% 1.079% ( 1, 2 ] 522662 44.307% 45.386% ######### ( 2, 3 ] 356079 30.185% 75.571% ###### ( 3, 4 ] 116664 9.890% 85.461% ## ( 4, 6 ] 125968 10.678% 96.139% ## ( 6, 10 ] 32043 2.716% 98.856% # ( 10, 15 ] 6683 0.567% 99.422% ( 15, 22 ] 873 0.074% 99.496% ( 22, 34 ] 79 0.007% 99.503% ( 34, 51 ] 40 0.003% 99.506% ( 51, 76 ] 57 0.005% 99.511% ( 76, 110 ] 37 0.003% 99.514% ( 110, 170 ] 161 0.014% 99.528% ( 170, 250 ] 204 0.017% 99.545% ( 250, 380 ] 259 0.022% 99.567% ( 380, 580 ] 518 0.044% 99.611% ( 580, 870 ] 897 0.076% 99.687% ( 870, 1300 ] 1237 0.105% 99.792% ( 1300, 1900 ] 1473 0.125% 99.917% ( 1900, 2900 ] 1505 0.128% 100.045% ( 2900, 4400 ] 1174 0.100% 100.144% ( 4400, 6600 ] 423 0.036% 100.180% ( 6600, 9900 ] 74 0.006% 100.186% ( 9900, 14000 ] 5 0.000% 100.187% ( 14000, 22000 ] 4 0.000% 100.187% ** Level 4 read latency histogram (micros): Count: 681343 Average: 21.7479 StdDev: 226.34 Min: 1 Median: 2.1576 Max: 27229 Percentiles: P50: 2.16 P75: 3.00 P99: 246.49 P99.9: 2344.33 P99.99: 2985.89 ------------------------------------------------------ [ 0, 1 ] 7046 1.034% 1.034% ( 1, 2 ] 301809 44.296% 45.330% ######### ( 2, 3 ] 201843 29.624% 74.955% ###### ( 3, 4 ] 68511 10.055% 85.010% ## ( 4, 6 ] 70963 10.415% 95.425% ## ( 6, 10 ] 18096 2.656% 98.081% # ( 10, 15 ] 3313 0.486% 98.567% ( 15, 22 ] 463 0.068% 98.635% ( 22, 34 ] 43 0.006% 98.642% ( 34, 51 ] 33 0.005% 98.646% ( 51, 76 ] 50 0.007% 98.654% ( 76, 110 ] 144 0.021% 98.675% ( 110, 170 ] 1204 0.177% 98.852% ( 170, 250 ] 1058 0.155% 99.007% ( 250, 380 ] 802 0.118% 99.125% ( 380, 580 ] 1032 0.151% 99.276% ( 580, 870 ] 1251 0.184% 99.460% ( 870, 1300 ] 1378 0.202% 99.662% ( 1300, 1900 ] 1169 0.172% 99.833% ( 1900, 2900 ] 1021 0.150% 99.983% ( 2900, 4400 ] 801 0.118% 100.101% ( 4400, 6600 ] 328 0.048% 100.149% ( 6600, 9900 ] 55 0.008% 100.157% ( 9900, 14000 ] 4 0.001% 100.158% ( 22000, 33000 ] 2 0.000% 100.158% ** Level 5 read latency histogram (micros): Count: 39902 Average: 926.1413 StdDev: 1337.59 Min: 81 Median: 370.2398 Max: 26759 Percentiles: P50: 370.24 P75: 1018.30 P99: 6413.92 P99.9: 9741.72 P99.99: 13673.61 ------------------------------------------------------ ( 76, 110 ] 1010 2.531% 2.531% # ( 110, 170 ] 7931 19.876% 22.407% #### ( 170, 250 ] 6883 17.250% 39.657% ### ( 250, 380 ] 4462 11.182% 50.840% ## ( 380, 580 ] 4488 11.248% 62.087% ## ( 580, 870 ] 4072 10.205% 72.292% ## ( 870, 1300 ] 3133 7.852% 80.144% ## ( 1300, 1900 ] 2312 5.794% 85.938% # ( 1900, 2900 ] 2030 5.087% 91.026% # ( 2900, 4400 ] 2067 5.180% 96.206% # ( 4400, 6600 ] 1218 3.052% 99.258% # ( 6600, 9900 ] 269 0.674% 99.932% ( 9900, 14000 ] 25 0.063% 99.995% ( 14000, 22000 ] 1 0.003% 99.997% ( 22000, 33000 ] 1 0.003% 100.000% ** DB Stats ** Uptime(secs): 13.2 total, 5.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 148.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.510 H:M:S, 41.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 187.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.665 H:M:S, 31.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-21:41:10 ... thread 0: (1000000,3000000) ops and (290657.5,182031.6) ops/second in (3.440475,16.480651) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.77 GB 258.0 2.3 0.0 2.3 5.1 2.8 0.0 1.8 87.2 190.3 27.46 17.50 47 0.584 2430K 2730 0.0 0.0 L1 16/0 1.09 GB 111.7 1.1 0.7 0.4 1.1 0.7 0.0 1.6 92.6 92.3 12.10 5.63 1 12.103 1138K 4696 0.0 0.0 L2 1/0 79.60 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 22/0 946.81 MB 0.9 2.4 1.5 1.0 2.4 1.4 0.0 1.6 97.4 96.5 25.46 11.82 17 1.498 954K 0 0.0 0.0 L4 166/0 9.57 GB 1.0 6.5 3.9 2.6 6.5 3.9 0.2 1.6 106.9 105.5 62.69 31.87 44 1.425 2596K 2346 0.0 0.0 L5 1135/0 93.98 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1355/4 108.41 GB 0.0 12.4 6.1 6.3 15.0 8.7 4.1 5.4 99.4 120.7 127.71 66.83 109 1.172 7120K 9772 0.0 0.0 Int 0/0 0.00 KB 0.0 12.4 6.1 6.3 15.0 8.7 4.1 5.4 99.4 120.7 127.71 66.83 109 1.172 7120K 9772 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.4 6.1 6.3 12.3 6.0 0.0 0.0 113.1 112.0 112.31 58.78 70 1.604 7120K 9772 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 184.0 15.41 8.05 39 0.395 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.7 total, 16.5 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.05 GB write, 923.94 MB/s write, 12.40 GB read, 761.42 MB/s read, 127.7 seconds Interval compaction: 15.05 GB write, 934.96 MB/s write, 12.40 GB read, 770.50 MB/s read, 127.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 67, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 67, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 850581 Average: 11.5933 StdDev: 140.18 Min: 1 Median: 1.6598 Max: 15928 Percentiles: P50: 1.66 P75: 2.33 P99: 166.63 P99.9: 1807.56 P99.99: 3844.65 ------------------------------------------------------ [ 0, 1 ] 104289 12.261% 12.261% ## ( 1, 2 ] 486539 57.201% 69.462% ########### ( 2, 3 ] 144091 16.940% 86.402% ### ( 3, 4 ] 46515 5.469% 91.871% # ( 4, 6 ] 44912 5.280% 97.151% # ( 6, 10 ] 11026 1.296% 98.447% ( 10, 15 ] 1866 0.219% 98.666% ( 15, 22 ] 228 0.027% 98.693% ( 22, 34 ] 35 0.004% 98.697% ( 34, 51 ] 10 0.001% 98.699% ( 51, 76 ] 17 0.002% 98.701% ( 76, 110 ] 248 0.029% 98.730% ( 110, 170 ] 2437 0.287% 99.016% ( 170, 250 ] 2317 0.272% 99.289% ( 250, 380 ] 1406 0.165% 99.454% ( 380, 580 ] 1344 0.158% 99.612% ( 580, 870 ] 1140 0.134% 99.746% ( 870, 1300 ] 858 0.101% 99.847% ( 1300, 1900 ] 536 0.063% 99.910% ( 1900, 2900 ] 443 0.052% 99.962% ( 2900, 4400 ] 381 0.045% 100.007% ( 4400, 6600 ] 127 0.015% 100.022% ( 6600, 9900 ] 33 0.004% 100.026% ( 9900, 14000 ] 4 0.000% 100.026% ( 14000, 22000 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 113084 Average: 15.4196 StdDev: 177.42 Min: 1 Median: 2.4365 Max: 10854 Percentiles: P50: 2.44 P75: 3.72 P99: 195.26 P99.9: 3010.93 P99.99: 6828.23 ------------------------------------------------------ [ 0, 1 ] 904 0.799% 0.799% ( 1, 2 ] 41201 36.434% 37.233% ####### ( 2, 3 ] 33078 29.251% 66.484% ###### ( 3, 4 ] 13459 11.902% 78.386% ## ( 4, 6 ] 16315 14.427% 92.813% ### ( 6, 10 ] 4918 4.349% 97.162% # ( 10, 15 ] 934 0.826% 97.988% ( 15, 22 ] 257 0.227% 98.215% ( 22, 34 ] 33 0.029% 98.245% ( 34, 51 ] 10 0.009% 98.254% ( 51, 76 ] 13 0.011% 98.265% ( 76, 110 ] 106 0.094% 98.359% ( 110, 170 ] 602 0.532% 98.891% ( 170, 250 ] 390 0.345% 99.236% ( 250, 380 ] 168 0.149% 99.385% ( 380, 580 ] 172 0.152% 99.537% ( 580, 870 ] 145 0.128% 99.665% ( 870, 1300 ] 107 0.095% 99.759% ( 1300, 1900 ] 73 0.065% 99.824% ( 1900, 2900 ] 80 0.071% 99.895% ( 2900, 4400 ] 80 0.071% 99.966% ( 4400, 6600 ] 27 0.024% 99.989% ( 6600, 9900 ] 10 0.009% 99.998% ( 9900, 14000 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 320334 Average: 16.7949 StdDev: 210.01 Min: 1 Median: 2.0717 Max: 10970 Percentiles: P50: 2.07 P75: 2.98 P99: 13.08 P99.9: 2418.43 P99.99: 3297.35 ------------------------------------------------------ [ 0, 1 ] 5629 1.757% 1.757% ( 1, 2 ] 148233 46.275% 48.032% ######### ( 2, 3 ] 87913 27.444% 75.476% ##### ( 3, 4 ] 30655 9.570% 85.046% ## ( 4, 6 ] 33984 10.609% 95.655% ## ( 6, 10 ] 9330 2.913% 98.567% # ( 10, 15 ] 2252 0.703% 99.270% ( 15, 22 ] 357 0.111% 99.382% ( 22, 34 ] 41 0.013% 99.394% ( 34, 51 ] 12 0.004% 99.398% ( 51, 76 ] 14 0.004% 99.402% ( 76, 110 ] 13 0.004% 99.407% ( 110, 170 ] 56 0.017% 99.424% ( 170, 250 ] 44 0.014% 99.438% ( 250, 380 ] 79 0.025% 99.462% ( 380, 580 ] 167 0.052% 99.515% ( 580, 870 ] 245 0.076% 99.591% ( 870, 1300 ] 358 0.112% 99.703% ( 1300, 1900 ] 402 0.125% 99.828% ( 1900, 2900 ] 443 0.138% 99.967% ( 2900, 4400 ] 283 0.088% 100.055% ( 4400, 6600 ] 132 0.041% 100.096% ( 6600, 9900 ] 39 0.012% 100.108% ( 9900, 14000 ] 5 0.002% 100.110% ** Level 3 read latency histogram (micros): Count: 1180418 Average: 16.1062 StdDev: 198.42 Min: 1 Median: 2.1539 Max: 18844 Percentiles: P50: 2.15 P75: 2.98 P99: 11.84 P99.9: 1819.59 P99.99: 2473.96 ------------------------------------------------------ [ 0, 1 ] 12729 1.078% 1.078% ( 1, 2 ] 522662 44.278% 45.356% ######### ( 2, 3 ] 356082 30.166% 75.522% ###### ( 3, 4 ] 116665 9.883% 85.405% ## ( 4, 6 ] 125973 10.672% 96.077% ## ( 6, 10 ] 32043 2.715% 98.792% # ( 10, 15 ] 6683 0.566% 99.358% ( 15, 22 ] 873 0.074% 99.432% ( 22, 34 ] 79 0.007% 99.438% ( 34, 51 ] 40 0.003% 99.442% ( 51, 76 ] 57 0.005% 99.447% ( 76, 110 ] 91 0.008% 99.454% ( 110, 170 ] 530 0.045% 99.499% ( 170, 250 ] 404 0.034% 99.533% ( 250, 380 ] 332 0.028% 99.562% ( 380, 580 ] 561 0.048% 99.609% ( 580, 870 ] 917 0.078% 99.687% ( 870, 1300 ] 1241 0.105% 99.792% ( 1300, 1900 ] 1473 0.125% 99.917% ( 1900, 2900 ] 1507 0.128% 100.044% ( 2900, 4400 ] 1175 0.100% 100.144% ( 4400, 6600 ] 423 0.036% 100.180% ( 6600, 9900 ] 74 0.006% 100.186% ( 9900, 14000 ] 5 0.000% 100.186% ( 14000, 22000 ] 4 0.000% 100.187% ** Level 4 read latency histogram (micros): Count: 688734 Average: 23.5057 StdDev: 226.26 Min: 1 Median: 2.1754 Max: 27229 Percentiles: P50: 2.18 P75: 3.08 P99: 355.78 P99.9: 2338.19 P99.99: 2984.51 ------------------------------------------------------ [ 0, 1 ] 7046 1.023% 1.023% ( 1, 2 ] 301868 43.829% 44.852% ######### ( 2, 3 ] 202108 29.345% 74.197% ###### ( 3, 4 ] 68730 9.979% 84.176% ## ( 4, 6 ] 71231 10.342% 94.519% ## ( 6, 10 ] 18119 2.631% 97.150% # ( 10, 15 ] 3320 0.482% 97.632% ( 15, 22 ] 464 0.067% 97.699% ( 22, 34 ] 43 0.006% 97.705% ( 34, 51 ] 33 0.005% 97.710% ( 51, 76 ] 50 0.007% 97.717% ( 76, 110 ] 609 0.088% 97.806% ( 110, 170 ] 4339 0.630% 98.436% ( 170, 250 ] 2780 0.404% 98.839% ( 250, 380 ] 1360 0.197% 99.037% ( 380, 580 ] 1522 0.221% 99.258% ( 580, 870 ] 1402 0.204% 99.461% ( 870, 1300 ] 1400 0.203% 99.665% ( 1300, 1900 ] 1173 0.170% 99.835% ( 1900, 2900 ] 1023 0.149% 99.983% ( 2900, 4400 ] 801 0.116% 100.100% ( 4400, 6600 ] 328 0.048% 100.147% ( 6600, 9900 ] 55 0.008% 100.155% ( 9900, 14000 ] 4 0.001% 100.156% ( 22000, 33000 ] 2 0.000% 100.156% ** Level 5 read latency histogram (micros): Count: 83323 Average: 550.3916 StdDev: 998.33 Min: 81 Median: 207.6021 Max: 26759 Percentiles: P50: 207.60 P75: 453.80 P99: 5629.63 P99.9: 9209.05 P99.99: 12961.50 ------------------------------------------------------ ( 76, 110 ] 4114 4.937% 4.937% # ( 110, 170 ] 28758 34.514% 39.451% ####### ( 170, 250 ] 18701 22.444% 61.895% #### ( 250, 380 ] 8205 9.847% 71.742% ## ( 380, 580 ] 7358 8.831% 80.573% ## ( 580, 870 ] 4983 5.980% 86.554% # ( 870, 1300 ] 3242 3.891% 90.444% # ( 1300, 1900 ] 2326 2.792% 93.236% # ( 1900, 2900 ] 2048 2.458% 95.694% ( 2900, 4400 ] 2075 2.490% 98.184% ( 4400, 6600 ] 1218 1.462% 99.646% ( 6600, 9900 ] 269 0.323% 99.969% ( 9900, 14000 ] 25 0.030% 99.999% ( 14000, 22000 ] 1 0.001% 100.000% ( 22000, 33000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 16.7 total, 3.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 177.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.510 H:M:S, 33.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/06-21:41:13 ... thread 0: (1000000,4000000) ops and (293575.7,201137.1) ops/second in (3.406277,19.886928) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 3.75 GB 358.7 3.3 0.0 3.3 7.1 3.7 0.0 1.9 98.8 210.4 34.42 23.96 67 0.514 3454K 3688 0.0 0.0 L1 16/0 1.09 GB 111.7 1.1 0.7 0.4 1.1 0.7 0.0 1.6 92.6 92.3 12.10 5.63 1 12.103 1138K 4696 0.0 0.0 L2 1/0 79.60 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 22/0 946.81 MB 0.9 2.4 1.5 1.0 2.4 1.4 0.0 1.6 97.4 96.5 25.46 11.82 17 1.498 954K 0 0.0 0.0 L4 166/0 9.57 GB 1.0 6.5 3.9 2.6 6.5 3.9 0.2 1.6 106.9 105.5 62.69 31.87 44 1.425 2596K 2346 0.0 0.0 L5 1135/0 93.98 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1359/4 109.39 GB 0.0 13.4 6.1 7.3 17.0 9.7 4.1 4.5 101.8 129.4 134.68 73.28 129 1.044 8143K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.4 6.1 7.3 17.0 9.7 4.1 4.5 101.8 129.4 134.68 73.28 129 1.044 8143K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.4 6.1 7.3 13.3 6.0 0.0 0.0 118.0 116.9 116.21 62.60 74 1.570 8143K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 208.1 18.47 10.68 55 0.336 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.1 total, 19.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.02 GB write, 867.58 MB/s write, 13.39 GB read, 682.48 MB/s read, 134.7 seconds Interval compaction: 17.02 GB write, 876.16 MB/s write, 13.39 GB read, 689.23 MB/s read, 134.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 67, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 67, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1110218 Average: 9.9109 StdDev: 123.56 Min: 1 Median: 1.6022 Max: 15928 Percentiles: P50: 1.60 P75: 2.12 P99: 147.70 P99.9: 1434.57 P99.99: 3428.64 ------------------------------------------------------ [ 0, 1 ] 165411 14.899% 14.899% ### ( 1, 2 ] 647117 58.287% 73.186% ############ ( 2, 3 ] 166639 15.010% 88.196% ### ( 3, 4 ] 53132 4.786% 92.982% # ( 4, 6 ] 49773 4.483% 97.465% # ( 6, 10 ] 11850 1.067% 98.532% ( 10, 15 ] 2205 0.199% 98.731% ( 15, 22 ] 269 0.024% 98.755% ( 22, 34 ] 40 0.004% 98.759% ( 34, 51 ] 13 0.001% 98.760% ( 51, 76 ] 19 0.002% 98.762% ( 76, 110 ] 382 0.034% 98.796% ( 110, 170 ] 3608 0.325% 99.121% ( 170, 250 ] 3197 0.288% 99.409% ( 250, 380 ] 1677 0.151% 99.560% ( 380, 580 ] 1559 0.140% 99.700% ( 580, 870 ] 1218 0.110% 99.810% ( 870, 1300 ] 878 0.079% 99.889% ( 1300, 1900 ] 543 0.049% 99.938% ( 1900, 2900 ] 443 0.040% 99.978% ( 2900, 4400 ] 383 0.034% 100.012% ( 4400, 6600 ] 127 0.011% 100.024% ( 6600, 9900 ] 33 0.003% 100.027% ( 9900, 14000 ] 4 0.000% 100.027% ( 14000, 22000 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 114107 Average: 17.0512 StdDev: 177.94 Min: 1 Median: 2.4517 Max: 10854 Percentiles: P50: 2.45 P75: 3.77 P99: 238.16 P99.9: 2991.74 P99.99: 6794.47 ------------------------------------------------------ [ 0, 1 ] 904 0.792% 0.792% ( 1, 2 ] 41206 36.112% 36.904% ####### ( 2, 3 ] 33086 28.996% 65.900% ###### ( 3, 4 ] 13465 11.800% 77.700% ## ( 4, 6 ] 16326 14.308% 92.008% ### ( 6, 10 ] 4920 4.312% 96.319% # ( 10, 15 ] 934 0.819% 97.138% ( 15, 22 ] 257 0.225% 97.363% ( 22, 34 ] 33 0.029% 97.392% ( 34, 51 ] 10 0.009% 97.401% ( 51, 76 ] 13 0.011% 97.412% ( 76, 110 ] 184 0.161% 97.573% ( 110, 170 ] 1069 0.937% 98.510% ( 170, 250 ] 656 0.575% 99.085% ( 250, 380 ] 258 0.226% 99.311% ( 380, 580 ] 245 0.215% 99.526% ( 580, 870 ] 159 0.139% 99.665% ( 870, 1300 ] 109 0.096% 99.761% ( 1300, 1900 ] 73 0.064% 99.825% ( 1900, 2900 ] 81 0.071% 99.896% ( 2900, 4400 ] 80 0.070% 99.966% ( 4400, 6600 ] 27 0.024% 99.989% ( 6600, 9900 ] 10 0.009% 99.998% ( 9900, 14000 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 320411 Average: 16.8407 StdDev: 210.03 Min: 1 Median: 2.0722 Max: 10970 Percentiles: P50: 2.07 P75: 2.98 P99: 13.25 P99.9: 2418.26 P99.99: 3297.31 ------------------------------------------------------ [ 0, 1 ] 5629 1.757% 1.757% ( 1, 2 ] 148233 46.263% 48.020% ######### ( 2, 3 ] 87913 27.438% 75.458% ##### ( 3, 4 ] 30655 9.567% 85.025% ## ( 4, 6 ] 33984 10.606% 95.632% ## ( 6, 10 ] 9330 2.912% 98.543% # ( 10, 15 ] 2252 0.703% 99.246% ( 15, 22 ] 357 0.111% 99.358% ( 22, 34 ] 41 0.013% 99.370% ( 34, 51 ] 12 0.004% 99.374% ( 51, 76 ] 14 0.004% 99.379% ( 76, 110 ] 18 0.006% 99.384% ( 110, 170 ] 97 0.030% 99.415% ( 170, 250 ] 64 0.020% 99.434% ( 250, 380 ] 84 0.026% 99.461% ( 380, 580 ] 172 0.054% 99.514% ( 580, 870 ] 245 0.076% 99.591% ( 870, 1300 ] 358 0.112% 99.703% ( 1300, 1900 ] 403 0.126% 99.828% ( 1900, 2900 ] 443 0.138% 99.967% ( 2900, 4400 ] 283 0.088% 100.055% ( 4400, 6600 ] 132 0.041% 100.096% ( 6600, 9900 ] 39 0.012% 100.108% ( 9900, 14000 ] 5 0.002% 100.110% ** Level 3 read latency histogram (micros): Count: 1181166 Average: 16.2296 StdDev: 198.46 Min: 1 Median: 2.1550 Max: 18844 Percentiles: P50: 2.15 P75: 2.98 P99: 12.39 P99.9: 1819.74 P99.99: 2474.19 ------------------------------------------------------ [ 0, 1 ] 12729 1.078% 1.078% ( 1, 2 ] 522662 44.250% 45.327% ######### ( 2, 3 ] 356082 30.147% 75.474% ###### ( 3, 4 ] 116665 9.877% 85.351% ## ( 4, 6 ] 125973 10.665% 96.016% ## ( 6, 10 ] 32043 2.713% 98.729% # ( 10, 15 ] 6683 0.566% 99.295% ( 15, 22 ] 873 0.074% 99.369% ( 22, 34 ] 79 0.007% 99.375% ( 34, 51 ] 40 0.003% 99.379% ( 51, 76 ] 57 0.005% 99.384% ( 76, 110 ] 133 0.011% 99.395% ( 110, 170 ] 897 0.076% 99.471% ( 170, 250 ] 611 0.052% 99.523% ( 250, 380 ] 391 0.033% 99.556% ( 380, 580 ] 613 0.052% 99.608% ( 580, 870 ] 930 0.079% 99.686% ( 870, 1300 ] 1247 0.106% 99.792% ( 1300, 1900 ] 1474 0.125% 99.917% ( 1900, 2900 ] 1508 0.128% 100.044% ( 2900, 4400 ] 1175 0.099% 100.144% ( 4400, 6600 ] 423 0.036% 100.180% ( 6600, 9900 ] 74 0.006% 100.186% ( 9900, 14000 ] 5 0.000% 100.186% ( 14000, 22000 ] 4 0.000% 100.187% ** Level 4 read latency histogram (micros): Count: 695758 Average: 25.2538 StdDev: 226.21 Min: 1 Median: 2.1926 Max: 27229 Percentiles: P50: 2.19 P75: 3.16 P99: 410.66 P99.9: 2332.43 P99.99: 2983.19 ------------------------------------------------------ [ 0, 1 ] 7046 1.013% 1.013% ( 1, 2 ] 301896 43.391% 44.404% ######### ( 2, 3 ] 202177 29.059% 73.462% ###### ( 3, 4 ] 68800 9.888% 83.351% ## ( 4, 6 ] 71352 10.255% 93.606% ## ( 6, 10 ] 18133 2.606% 96.212% # ( 10, 15 ] 3323 0.478% 96.690% ( 15, 22 ] 464 0.067% 96.756% ( 22, 34 ] 43 0.006% 96.763% ( 34, 51 ] 33 0.005% 96.767% ( 51, 76 ] 50 0.007% 96.775% ( 76, 110 ] 1101 0.158% 96.933% ( 110, 170 ] 7588 1.091% 98.023% ( 170, 250 ] 4581 0.658% 98.682% ( 250, 380 ] 1914 0.275% 98.957% ( 380, 580 ] 1953 0.281% 99.238% ( 580, 870 ] 1573 0.226% 99.464% ( 870, 1300 ] 1417 0.204% 99.667% ( 1300, 1900 ] 1175 0.169% 99.836% ( 1900, 2900 ] 1025 0.147% 99.984% ( 2900, 4400 ] 801 0.115% 100.099% ( 4400, 6600 ] 328 0.047% 100.146% ( 6600, 9900 ] 55 0.008% 100.154% ( 9900, 14000 ] 4 0.001% 100.154% ( 22000, 33000 ] 2 0.000% 100.155% ** Level 5 read latency histogram (micros): Count: 125683 Average: 434.5289 StdDev: 833.09 Min: 81 Median: 187.3499 Max: 26759 Percentiles: P50: 187.35 P75: 337.10 P99: 4862.70 P99.9: 8677.12 P99.99: 12102.80 ------------------------------------------------------ ( 76, 110 ] 7334 5.835% 5.835% # ( 110, 170 ] 49008 38.993% 44.829% ######## ( 170, 250 ] 29969 23.845% 68.674% ##### ( 250, 380 ] 11868 9.443% 78.116% ## ( 380, 580 ] 10223 8.134% 86.250% ## ( 580, 870 ] 5885 4.682% 90.933% # ( 870, 1300 ] 3388 2.696% 93.628% # ( 1300, 1900 ] 2349 1.869% 95.497% ( 1900, 2900 ] 2066 1.644% 97.141% ( 2900, 4400 ] 2080 1.655% 98.796% ( 4400, 6600 ] 1218 0.969% 99.765% ( 6600, 9900 ] 269 0.214% 99.979% ( 9900, 14000 ] 25 0.020% 99.999% ( 14000, 22000 ] 1 0.001% 100.000% ( 22000, 33000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 20.1 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 195.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.510 H:M:S, 27.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 252.783 micros/op 15804 ops/sec 60.172 seconds 950996 operations; 15.3 MB/s (235999 of 235999 found) Microseconds per read: Count: 950996 Average: 252.7854 StdDev: 857.21 Min: 2 Median: 194.6458 Max: 103060 Percentiles: P50: 194.65 P75: 236.37 P99: 1016.32 P99.9: 15008.03 P99.99: 32820.78 ------------------------------------------------------ ( 1, 2 ] 13 0.001% 0.001% ( 2, 3 ] 44 0.005% 0.006% ( 3, 4 ] 45 0.005% 0.011% ( 4, 6 ] 68 0.007% 0.018% ( 6, 10 ] 356 0.037% 0.055% ( 10, 15 ] 4458 0.469% 0.524% ( 15, 22 ] 4483 0.471% 0.995% ( 22, 34 ] 9313 0.979% 1.975% ( 34, 51 ] 2930 0.308% 2.283% ( 51, 76 ] 423 0.044% 2.327% ( 76, 110 ] 4022 0.423% 2.750% ( 110, 170 ] 308904 32.482% 35.232% ###### ( 170, 250 ] 455864 47.935% 83.168% ########## ( 250, 380 ] 95285 10.019% 93.187% ## ( 380, 580 ] 41281 4.341% 97.528% # ( 580, 870 ] 12475 1.312% 98.840% ( 870, 1300 ] 4473 0.470% 99.310% ( 1300, 1900 ] 2021 0.213% 99.523% ( 1900, 2900 ] 1480 0.156% 99.678% ( 2900, 4400 ] 1165 0.123% 99.801% ( 4400, 6600 ] 532 0.056% 99.857% ( 6600, 9900 ] 147 0.015% 99.872% ( 9900, 14000 ] 184 0.019% 99.892% ( 14000, 22000 ] 627 0.066% 99.958% ( 22000, 33000 ] 313 0.033% 99.991% ( 33000, 50000 ] 60 0.006% 99.997% ( 50000, 75000 ] 26 0.003% 100.000% ( 75000, 110000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 17904445 rocksdb.bloom.filter.full.positive COUNT : 1125361 rocksdb.bloom.filter.full.true.positive COUNT : 950622 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 374 rocksdb.memtable.miss COUNT : 950622 rocksdb.l0.hit COUNT : 37232 rocksdb.l1.hit COUNT : 10204 rocksdb.l2andup.hit COUNT : 903186 rocksdb.compaction.key.drop.new COUNT : 172636 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4303785 rocksdb.number.keys.read COUNT : 950996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4441506120 rocksdb.bytes.read COUNT : 950996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1573 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 43813665 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16974459870 rocksdb.compact.write.bytes COUNT : 16803065560 rocksdb.flush.write.bytes COUNT : 4425951246 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 21 rocksdb.number.superversion_acquires COUNT : 854 rocksdb.number.superversion_releases COUNT : 831 rocksdb.number.superversion_cleanups COUNT : 218 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 214 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4390195200 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1644544 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 21712023088 rocksdb.non.last.level.read.count COUNT : 5102459 rocksdb.block.checksum.compute.count COUNT : 5251021 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 193.613919 P95 : 461.667524 P99 : 1015.232452 P100 : 103059.000000 COUNT : 950996 SUM : 239554613 rocksdb.db.write.micros P50 : 1.542509 P95 : 4.479452 P99 : 10.462337 P100 : 953910.000000 COUNT : 4303785 SUM : 54609130 rocksdb.compaction.times.micros P50 : 1439473.684211 P95 : 2666666.666667 P99 : 10808000.000000 P100 : 12103363.000000 COUNT : 76 SUM : 118217425 rocksdb.compaction.times.cpu_micros P50 : 766785.714286 P95 : 1410000.000000 P99 : 4828000.000000 P100 : 5633869.000000 COUNT : 76 SUM : 64575744 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 855.500000 P95 : 41075.000000 P99 : 201200.000000 P100 : 235176.000000 COUNT : 61 SUM : 546969 rocksdb.compaction.outfile.sync.micros P50 : 27761.904762 P95 : 190444.444444 P99 : 370900.000000 P100 : 666724.000000 COUNT : 214 SUM : 12846518 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 250.000000 P95 : 4160.000000 P99 : 8646.000000 P100 : 9252.000000 COUNT : 152 SUM : 161867 rocksdb.table.open.io.micros P50 : 12124.563319 P95 : 22051.333333 P99 : 31279.600000 P100 : 45091.000000 COUNT : 1573 SUM : 18859658 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.344658 P95 : 13.855666 P99 : 218.128720 P100 : 27185.000000 COUNT : 4112492 SUM : 79464735 rocksdb.read.block.get.micros P50 : 148.698622 P95 : 302.913579 P99 : 959.953691 P100 : 20542.000000 COUNT : 1136958 SUM : 201954618 rocksdb.write.raw.block.micros P50 : 0.540138 P95 : 1.458105 P99 : 3.881353 P100 : 29948.000000 COUNT : 5141874 SUM : 17450051 rocksdb.numfiles.in.singlecompaction P50 : 2.304348 P95 : 3.907143 P99 : 22.960000 P100 : 32.000000 COUNT : 92 SUM : 294 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.597647 P95 : 2261.878359 P99 : 2773.194575 P100 : 953732.000000 COUNT : 149854 SUM : 43828546 rocksdb.sst.read.micros P50 : 2.490750 P95 : 203.241966 P99 : 467.421118 P100 : 27229.000000 COUNT : 5102490 SUM : 269920473 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 950996 SUM : 950996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4303785 SUM : 4441506120 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 220833.333333 P95 : 1027166.666667 P99 : 1165433.333333 P100 : 1173571.000000 COUNT : 61 SUM : 19748557 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 220 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0