[2024-11-17 05:19:24.868877] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 23.11.0 initialization... [2024-11-17 05:19:24.869156] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid443304 ] Set seed to 1731817164862124 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 05:19:24.988956] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 05:19:25.012237] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 05:19:25.012280] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 443304' to capture a snapshot of events at runtime. [2024-11-17 05:19:25.012291] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 05:19:25.012301] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 05:19:25.012308] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid443304 for offline analysis/debug. [2024-11-17 05:19:25.012881] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 05:19:29 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-05:19:37 ... thread 0: (1000000,1000000) ops and (129954.1,129954.1) ops/second in (7.695022,7.695022) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 881.35 MB 25.2 0.4 0.0 0.4 1.2 0.9 0.0 1.4 40.7 135.7 9.28 4.00 11 0.843 383K 518 0.0 0.0 L1 7/7 446.98 MB 0.0 0.6 0.5 0.1 0.6 0.5 0.0 1.2 107.6 107.3 5.89 2.96 1 5.888 643K 1467 0.0 0.0 L2 5/1 313.53 MB 1.8 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 46/10 3.34 GB 2.4 3.6 2.5 1.1 3.5 2.5 0.0 1.4 102.0 101.0 35.96 17.27 13 2.766 1871K 0 0.0 0.0 L4 184/15 11.63 GB 1.1 2.1 1.7 0.4 2.1 1.7 0.2 1.2 110.8 109.9 19.26 9.96 16 1.204 1371K 0 0.0 0.0 L5 1092/0 89.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1341/37 106.45 GB 0.0 6.7 4.7 1.9 7.5 5.5 0.4 8.7 96.8 108.5 70.38 34.20 41 1.717 4269K 1985 0.0 0.0 Int 0/0 0.00 KB 0.0 6.7 4.7 1.9 7.5 5.5 0.4 8.7 96.8 108.5 70.38 34.20 41 1.717 4269K 1985 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.7 4.7 1.9 6.6 4.7 0.0 0.0 107.6 106.7 63.33 31.73 31 2.043 4269K 1985 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 125.0 7.05 2.47 10 0.705 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.7 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.46 GB write, 968.24 MB/s write, 6.65 GB read, 863.52 MB/s read, 70.4 seconds Interval compaction: 7.46 GB write, 992.55 MB/s write, 6.65 GB read, 885.20 MB/s read, 70.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 22, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 289163 Average: 9.9832 StdDev: 166.89 Min: 1 Median: 1.9335 Max: 44220 Percentiles: P50: 1.93 P75: 2.95 P99: 9.88 P99.9: 1889.80 P99.99: 4108.01 ------------------------------------------------------ [ 0, 1 ] 8957 3.098% 3.098% # ( 1, 2 ] 145279 50.241% 53.339% ########## ( 2, 3 ] 66119 22.866% 76.204% ##### ( 3, 4 ] 28332 9.798% 86.002% ## ( 4, 6 ] 30297 10.477% 96.480% ## ( 6, 10 ] 7508 2.596% 99.076% # ( 10, 15 ] 1212 0.419% 99.495% ( 15, 22 ] 115 0.040% 99.535% ( 22, 34 ] 14 0.005% 99.540% ( 34, 51 ] 10 0.003% 99.544% ( 51, 76 ] 11 0.004% 99.547% ( 76, 110 ] 6 0.002% 99.549% ( 110, 170 ] 20 0.007% 99.556% ( 170, 250 ] 44 0.015% 99.572% ( 250, 380 ] 72 0.025% 99.596% ( 380, 580 ] 165 0.057% 99.653% ( 580, 870 ] 248 0.086% 99.739% ( 870, 1300 ] 282 0.098% 99.837% ( 1300, 1900 ] 186 0.064% 99.901% ( 1900, 2900 ] 154 0.053% 99.954% ( 2900, 4400 ] 128 0.044% 99.999% ( 4400, 6600 ] 37 0.013% 100.011% ( 6600, 9900 ] 2 0.001% 100.012% ( 9900, 14000 ] 2 0.001% 100.013% ( 14000, 22000 ] 1 0.000% 100.013% ( 22000, 33000 ] 2 0.001% 100.014% ( 33000, 50000 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 22853 Average: 24.1763 StdDev: 237.34 Min: 1 Median: 2.2790 Max: 8664 Percentiles: P50: 2.28 P75: 3.44 P99: 642.42 P99.9: 3878.93 P99.99: 6521.54 ------------------------------------------------------ [ 0, 1 ] 164 0.718% 0.718% ( 1, 2 ] 9507 41.601% 42.318% ######## ( 2, 3 ] 6293 27.537% 69.855% ###### ( 3, 4 ] 2662 11.648% 81.504% ## ( 4, 6 ] 3042 13.311% 94.815% ### ( 6, 10 ] 737 3.225% 98.040% # ( 10, 15 ] 145 0.634% 98.674% ( 15, 22 ] 14 0.061% 98.735% ( 22, 34 ] 1 0.004% 98.740% ( 34, 51 ] 2 0.009% 98.749% ( 51, 76 ] 3 0.013% 98.762% ( 76, 110 ] 1 0.004% 98.766% ( 110, 170 ] 1 0.004% 98.770% ( 170, 250 ] 6 0.026% 98.797% ( 250, 380 ] 11 0.048% 98.845% ( 380, 580 ] 26 0.114% 98.959% ( 580, 870 ] 44 0.193% 99.151% ( 870, 1300 ] 55 0.241% 99.392% ( 1300, 1900 ] 46 0.201% 99.593% ( 1900, 2900 ] 46 0.201% 99.794% ( 2900, 4400 ] 37 0.162% 99.956% ( 4400, 6600 ] 8 0.035% 99.991% ( 6600, 9900 ] 2 0.009% 100.000% ** Level 2 read latency histogram (micros): Count: 546828 Average: 14.1214 StdDev: 169.48 Min: 1 Median: 2.0273 Max: 15303 Percentiles: P50: 2.03 P75: 3.12 P99: 12.70 P99.9: 1637.48 P99.99: 2362.04 ------------------------------------------------------ [ 0, 1 ] 12305 2.250% 2.250% ( 1, 2 ] 257460 47.082% 49.333% ######### ( 2, 3 ] 133592 24.430% 73.763% ##### ( 3, 4 ] 57336 10.485% 84.248% ## ( 4, 6 ] 61489 11.245% 95.493% ## ( 6, 10 ] 17373 3.177% 98.670% # ( 10, 15 ] 3340 0.611% 99.281% ( 15, 22 ] 534 0.098% 99.378% ( 22, 34 ] 92 0.017% 99.395% ( 34, 51 ] 40 0.007% 99.403% ( 51, 76 ] 28 0.005% 99.408% ( 76, 110 ] 19 0.003% 99.411% ( 110, 170 ] 47 0.009% 99.420% ( 170, 250 ] 130 0.024% 99.444% ( 250, 380 ] 254 0.046% 99.490% ( 380, 580 ] 436 0.080% 99.570% ( 580, 870 ] 678 0.124% 99.694% ( 870, 1300 ] 780 0.143% 99.836% ( 1300, 1900 ] 619 0.113% 99.950% ( 1900, 2900 ] 479 0.088% 100.037% ( 2900, 4400 ] 409 0.075% 100.112% ( 4400, 6600 ] 140 0.026% 100.138% ( 6600, 9900 ] 16 0.003% 100.140% ( 9900, 14000 ] 3 0.001% 100.141% ( 14000, 22000 ] 1 0.000% 100.141% ** Level 3 read latency histogram (micros): Count: 716230 Average: 13.3764 StdDev: 187.87 Min: 0 Median: 2.0173 Max: 44976 Percentiles: P50: 2.02 P75: 3.03 P99: 9.93 P99.9: 1253.98 P99.99: 1846.71 ------------------------------------------------------ [ 0, 1 ] 11006 1.537% 1.537% ( 1, 2 ] 343999 48.029% 49.566% ########## ( 2, 3 ] 179983 25.129% 74.695% ##### ( 3, 4 ] 74797 10.443% 85.138% ## ( 4, 6 ] 80346 11.218% 96.356% ## ( 6, 10 ] 19280 2.692% 99.048% # ( 10, 15 ] 3488 0.487% 99.535% ( 15, 22 ] 416 0.058% 99.593% ( 22, 34 ] 30 0.004% 99.597% ( 34, 51 ] 36 0.005% 99.602% ( 51, 76 ] 42 0.006% 99.608% ( 76, 110 ] 19 0.003% 99.611% ( 110, 170 ] 24 0.003% 99.614% ( 170, 250 ] 82 0.011% 99.626% ( 250, 380 ] 185 0.026% 99.651% ( 380, 580 ] 380 0.053% 99.704% ( 580, 870 ] 699 0.098% 99.802% ( 870, 1300 ] 787 0.110% 99.912% ( 1300, 1900 ] 615 0.086% 99.998% ( 1900, 2900 ] 663 0.093% 100.090% ( 2900, 4400 ] 597 0.083% 100.174% ( 4400, 6600 ] 152 0.021% 100.195% ( 6600, 9900 ] 25 0.003% 100.198% ( 9900, 14000 ] 5 0.001% 100.199% ( 14000, 22000 ] 4 0.001% 100.200% ( 33000, 50000 ] 2 0.000% 100.200% ** Level 4 read latency histogram (micros): Count: 197623 Average: 35.1626 StdDev: 292.53 Min: 1 Median: 1.9981 Max: 11135 Percentiles: P50: 2.00 P75: 3.10 P99: 1103.70 P99.9: 3779.09 P99.99: 4340.75 ------------------------------------------------------ [ 0, 1 ] 3535 1.789% 1.789% ( 1, 2 ] 95461 48.305% 50.093% ########## ( 2, 3 ] 47207 23.887% 73.981% ##### ( 3, 4 ] 20602 10.425% 84.406% ## ( 4, 6 ] 20511 10.379% 94.785% ## ( 6, 10 ] 5546 2.806% 97.591% # ( 10, 15 ] 938 0.475% 98.066% ( 15, 22 ] 105 0.053% 98.119% ( 22, 34 ] 8 0.004% 98.123% ( 34, 51 ] 6 0.003% 98.126% ( 51, 76 ] 11 0.006% 98.131% ( 76, 110 ] 3 0.002% 98.133% ( 110, 170 ] 19 0.010% 98.142% ( 170, 250 ] 80 0.040% 98.183% ( 250, 380 ] 165 0.083% 98.266% ( 380, 580 ] 348 0.176% 98.442% ( 580, 870 ] 661 0.334% 98.777% ( 870, 1300 ] 811 0.410% 99.187% ( 1300, 1900 ] 631 0.319% 99.507% ( 1900, 2900 ] 499 0.253% 99.759% ( 2900, 4400 ] 475 0.240% 99.999% ( 4400, 6600 ] 152 0.077% 100.076% ( 6600, 9900 ] 18 0.009% 100.086% ( 9900, 14000 ] 1 0.001% 100.086% ** Level 5 read latency histogram (micros): Count: 11596 Average: 1923.6358 StdDev: 1630.11 Min: 86 Median: 1357.9191 Max: 28805 Percentiles: P50: 1357.92 P75: 2745.57 P99: 7505.01 P99.9: 9863.93 P99.99: 28805.00 ------------------------------------------------------ ( 76, 110 ] 6 0.052% 0.052% ( 110, 170 ] 43 0.371% 0.423% ( 170, 250 ] 136 1.173% 1.595% ( 250, 380 ] 383 3.303% 4.898% # ( 380, 580 ] 1013 8.736% 13.634% ## ( 580, 870 ] 1864 16.075% 29.709% ### ( 870, 1300 ] 2186 18.851% 48.560% #### ( 1300, 1900 ] 1730 14.919% 63.479% ### ( 1900, 2900 ] 1580 13.625% 77.104% ### ( 2900, 4400 ] 1684 14.522% 91.626% ### ( 4400, 6600 ] 815 7.028% 98.655% # ( 6600, 9900 ] 146 1.259% 99.914% ( 9900, 14000 ] 2 0.017% 99.931% ( 14000, 22000 ] 1 0.009% 99.940% ( 22000, 33000 ] 7 0.060% 100.000% ** DB Stats ** Uptime(secs): 7.9 total, 7.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 124.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.713 H:M:S, 47.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.713 H:M:S, 48.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/17-05:19:43 ... thread 0: (1000000,2000000) ops and (157788.6,142525.1) ops/second in (6.337593,14.032615) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 1.84 GB 100.7 1.0 0.0 1.0 2.8 1.8 0.0 1.5 52.4 150.7 19.22 9.46 26 0.739 1023K 1222 0.0 0.0 L1 7/7 446.98 MB 0.0 0.6 0.5 0.1 0.6 0.5 0.0 1.2 107.6 107.3 5.89 2.96 1 5.888 643K 1467 0.0 0.0 L2 2/0 92.74 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 959.76 MB 1.0 4.1 2.7 1.4 4.0 2.6 0.1 1.5 103.3 102.3 40.50 19.78 15 2.700 2001K 0 0.0 0.0 L4 165/0 9.60 GB 1.0 7.3 4.1 3.2 7.2 4.0 0.5 1.8 117.7 115.9 63.29 34.78 44 1.438 3384K 0 0.0 0.0 L5 1148/0 94.43 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1353/15 107.34 GB 0.0 13.0 7.3 5.7 14.7 9.0 5.3 7.9 103.0 116.4 128.90 66.99 86 1.499 7052K 2689 0.0 0.0 Int 0/0 0.00 KB 0.0 13.0 7.3 5.7 14.7 9.0 5.3 7.9 103.0 116.4 128.90 66.99 86 1.499 7052K 2689 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.0 7.3 5.7 12.8 7.1 0.0 0.0 114.8 113.5 115.57 61.67 63 1.834 7052K 2689 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 141.8 13.33 5.32 23 0.579 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.2 total, 14.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.66 GB write, 1054.89 MB/s write, 12.96 GB read, 932.91 MB/s read, 128.9 seconds Interval compaction: 14.66 GB write, 1069.42 MB/s write, 12.96 GB read, 945.75 MB/s read, 128.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 44, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 590461 Average: 10.7209 StdDev: 160.56 Min: 1 Median: 1.8792 Max: 47408 Percentiles: P50: 1.88 P75: 2.87 P99: 13.56 P99.9: 1803.36 P99.99: 3977.11 ------------------------------------------------------ [ 0, 1 ] 29121 4.932% 4.932% # ( 1, 2 ] 302658 51.258% 56.190% ########## ( 2, 3 ] 128000 21.678% 77.868% #### ( 3, 4 ] 53045 8.984% 86.851% ## ( 4, 6 ] 56524 9.573% 96.424% ## ( 6, 10 ] 13632 2.309% 98.733% ( 10, 15 ] 2211 0.374% 99.107% ( 15, 22 ] 253 0.043% 99.150% ( 22, 34 ] 17 0.003% 99.153% ( 34, 51 ] 15 0.003% 99.156% ( 51, 76 ] 29 0.005% 99.161% ( 76, 110 ] 186 0.032% 99.192% ( 110, 170 ] 876 0.148% 99.341% ( 170, 250 ] 609 0.103% 99.444% ( 250, 380 ] 430 0.073% 99.516% ( 380, 580 ] 611 0.103% 99.620% ( 580, 870 ] 695 0.118% 99.738% ( 870, 1300 ] 628 0.106% 99.844% ( 1300, 1900 ] 394 0.067% 99.911% ( 1900, 2900 ] 287 0.049% 99.959% ( 2900, 4400 ] 252 0.043% 100.002% ( 4400, 6600 ] 75 0.013% 100.015% ( 6600, 9900 ] 7 0.001% 100.016% ( 9900, 14000 ] 2 0.000% 100.016% ( 14000, 22000 ] 1 0.000% 100.016% ( 22000, 33000 ] 2 0.000% 100.017% ( 33000, 50000 ] 2 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 140554 Average: 15.0778 StdDev: 183.91 Min: 1 Median: 1.9921 Max: 21155 Percentiles: P50: 1.99 P75: 3.13 P99: 21.52 P99.9: 3066.69 P99.99: 5702.44 ------------------------------------------------------ [ 0, 1 ] 5153 3.666% 3.666% # ( 1, 2 ] 65641 46.702% 50.368% ######### ( 2, 3 ] 32745 23.297% 73.665% ##### ( 3, 4 ] 14756 10.498% 84.163% ## ( 4, 6 ] 15673 11.151% 95.314% ## ( 6, 10 ] 4308 3.065% 98.379% # ( 10, 15 ] 757 0.539% 98.918% ( 15, 22 ] 124 0.088% 99.006% ( 22, 34 ] 11 0.008% 99.014% ( 34, 51 ] 7 0.005% 99.019% ( 51, 76 ] 15 0.011% 99.030% ( 76, 110 ] 40 0.028% 99.058% ( 110, 170 ] 131 0.093% 99.151% ( 170, 250 ] 96 0.068% 99.220% ( 250, 380 ] 101 0.072% 99.291% ( 380, 580 ] 169 0.120% 99.412% ( 580, 870 ] 217 0.154% 99.566% ( 870, 1300 ] 183 0.130% 99.696% ( 1300, 1900 ] 144 0.102% 99.799% ( 1900, 2900 ] 129 0.092% 99.890% ( 2900, 4400 ] 121 0.086% 99.977% ( 4400, 6600 ] 32 0.023% 99.999% ( 6600, 9900 ] 3 0.002% 100.001% ( 14000, 22000 ] 2 0.001% 100.003% ** Level 2 read latency histogram (micros): Count: 554582 Average: 14.1079 StdDev: 169.71 Min: 1 Median: 2.0265 Max: 15303 Percentiles: P50: 2.03 P75: 3.11 P99: 12.67 P99.9: 1650.24 P99.99: 2393.88 ------------------------------------------------------ [ 0, 1 ] 12387 2.234% 2.234% ( 1, 2 ] 261305 47.117% 49.351% ######### ( 2, 3 ] 135651 24.460% 73.811% ##### ( 3, 4 ] 58014 10.461% 84.272% ## ( 4, 6 ] 62293 11.232% 95.504% ## ( 6, 10 ] 17577 3.169% 98.674% # ( 10, 15 ] 3384 0.610% 99.284% ( 15, 22 ] 540 0.097% 99.381% ( 22, 34 ] 92 0.017% 99.398% ( 34, 51 ] 41 0.007% 99.405% ( 51, 76 ] 30 0.005% 99.411% ( 76, 110 ] 19 0.003% 99.414% ( 110, 170 ] 47 0.008% 99.423% ( 170, 250 ] 130 0.023% 99.446% ( 250, 380 ] 256 0.046% 99.492% ( 380, 580 ] 436 0.079% 99.571% ( 580, 870 ] 678 0.122% 99.693% ( 870, 1300 ] 782 0.141% 99.834% ( 1300, 1900 ] 626 0.113% 99.947% ( 1900, 2900 ] 483 0.087% 100.034% ( 2900, 4400 ] 419 0.076% 100.110% ( 4400, 6600 ] 144 0.026% 100.136% ( 6600, 9900 ] 16 0.003% 100.138% ( 9900, 14000 ] 3 0.001% 100.139% ( 14000, 22000 ] 1 0.000% 100.139% ** Level 3 read latency histogram (micros): Count: 1254977 Average: 12.2327 StdDev: 183.64 Min: 0 Median: 2.0312 Max: 47464 Percentiles: P50: 2.03 P75: 3.06 P99: 9.92 P99.9: 1130.22 P99.99: 1701.43 ------------------------------------------------------ [ 0, 1 ] 18829 1.500% 1.500% ( 1, 2 ] 598794 47.714% 49.214% ########## ( 2, 3 ] 316232 25.198% 74.412% ##### ( 3, 4 ] 130229 10.377% 84.789% ## ( 4, 6 ] 143026 11.397% 96.186% ## ( 6, 10 ] 36021 2.870% 99.056% # ( 10, 15 ] 6196 0.494% 99.550% ( 15, 22 ] 765 0.061% 99.611% ( 22, 34 ] 57 0.005% 99.615% ( 34, 51 ] 77 0.006% 99.621% ( 51, 76 ] 101 0.008% 99.629% ( 76, 110 ] 57 0.005% 99.634% ( 110, 170 ] 147 0.012% 99.646% ( 170, 250 ] 167 0.013% 99.659% ( 250, 380 ] 350 0.028% 99.687% ( 380, 580 ] 693 0.055% 99.742% ( 580, 870 ] 1181 0.094% 99.836% ( 870, 1300 ] 1322 0.105% 99.942% ( 1300, 1900 ] 908 0.072% 100.014% ( 1900, 2900 ] 916 0.073% 100.087% ( 2900, 4400 ] 884 0.070% 100.157% ( 4400, 6600 ] 250 0.020% 100.177% ( 6600, 9900 ] 44 0.004% 100.181% ( 9900, 14000 ] 6 0.000% 100.181% ( 14000, 22000 ] 7 0.001% 100.182% ( 22000, 33000 ] 5 0.000% 100.182% ( 33000, 50000 ] 3 0.000% 100.182% ** Level 4 read latency histogram (micros): Count: 837104 Average: 21.0070 StdDev: 224.93 Min: 1 Median: 2.0260 Max: 38413 Percentiles: P50: 2.03 P75: 3.11 P99: 223.82 P99.9: 2299.71 P99.99: 3070.98 ------------------------------------------------------ [ 0, 1 ] 13261 1.584% 1.584% ( 1, 2 ] 399945 47.777% 49.361% ########## ( 2, 3 ] 205544 24.554% 73.916% ##### ( 3, 4 ] 85557 10.221% 84.136% ## ( 4, 6 ] 92376 11.035% 95.171% ## ( 6, 10 ] 25533 3.050% 98.221% # ( 10, 15 ] 4274 0.511% 98.732% ( 15, 22 ] 522 0.062% 98.794% ( 22, 34 ] 42 0.005% 98.799% ( 34, 51 ] 47 0.006% 98.805% ( 51, 76 ] 93 0.011% 98.816% ( 76, 110 ] 218 0.026% 98.842% ( 110, 170 ] 883 0.105% 98.948% ( 170, 250 ] 651 0.078% 99.025% ( 250, 380 ] 683 0.082% 99.107% ( 380, 580 ] 1178 0.141% 99.248% ( 580, 870 ] 1843 0.220% 99.468% ( 870, 1300 ] 1926 0.230% 99.698% ( 1300, 1900 ] 1276 0.152% 99.850% ( 1900, 2900 ] 1038 0.124% 99.974% ( 2900, 4400 ] 1143 0.137% 100.111% ( 4400, 6600 ] 316 0.038% 100.149% ( 6600, 9900 ] 44 0.005% 100.154% ( 9900, 14000 ] 3 0.000% 100.154% ( 14000, 22000 ] 4 0.000% 100.155% ( 22000, 33000 ] 2 0.000% 100.155% ( 33000, 50000 ] 1 0.000% 100.155% ** Level 5 read latency histogram (micros): Count: 36345 Average: 1126.0420 StdDev: 1416.75 Min: 77 Median: 657.1858 Max: 47401 Percentiles: P50: 657.19 P75: 1403.44 P99: 6286.78 P99.9: 9620.23 P99.99: 35071.17 ------------------------------------------------------ ( 76, 110 ] 1494 4.111% 4.111% # ( 110, 170 ] 5627 15.482% 19.593% ### ( 170, 250 ] 3170 8.722% 28.315% ## ( 250, 380 ] 2616 7.198% 35.512% # ( 380, 580 ] 3923 10.794% 46.306% ## ( 580, 870 ] 5044 13.878% 60.184% ### ( 870, 1300 ] 4841 13.320% 73.504% ### ( 1300, 1900 ] 3154 8.678% 82.182% ## ( 1900, 2900 ] 2517 6.925% 89.107% # ( 2900, 4400 ] 2623 7.217% 96.324% # ( 4400, 6600 ] 1134 3.120% 99.444% # ( 6600, 9900 ] 181 0.498% 99.942% ( 9900, 14000 ] 4 0.011% 99.953% ( 14000, 22000 ] 5 0.014% 99.967% ( 22000, 33000 ] 8 0.022% 99.989% ( 33000, 50000 ] 3 0.008% 99.997% ** DB Stats ** Uptime(secs): 14.2 total, 6.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 138.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.301 H:M:S, 44.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 155.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.587 H:M:S, 40.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-05:19:47 ... thread 0: (1000000,3000000) ops and (261248.2,167969.4) ops/second in (3.827777,17.860392) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 2.15 GB 37.8 1.8 0.0 1.8 4.6 2.8 0.0 1.6 70.3 179.3 25.99 15.52 43 0.604 1854K 2138 0.0 0.0 L1 7/7 578.99 MB 0.0 1.7 1.1 0.5 1.7 1.1 0.0 1.5 121.0 120.6 14.13 8.28 2 7.066 1736K 5513 0.0 0.0 L2 1/1 128.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/3 1.22 GB 1.0 5.2 3.1 2.1 5.2 3.1 0.2 1.7 114.0 113.1 47.03 25.19 21 2.240 2805K 1105 0.0 0.0 L4 169/0 9.77 GB 1.0 7.3 4.1 3.2 7.2 4.0 0.6 1.8 117.7 115.9 63.29 34.78 44 1.438 3384K 0 0.0 0.0 L5 1148/0 94.43 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1361/24 108.25 GB 0.0 16.0 8.3 7.6 18.6 10.9 6.0 6.7 108.7 126.4 150.44 83.77 110 1.368 9780K 8756 0.0 0.0 Int 0/0 0.00 KB 0.0 16.0 8.3 7.6 18.6 10.9 6.0 6.7 108.7 126.4 150.44 83.77 110 1.368 9780K 8756 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.0 8.3 7.6 15.8 8.2 0.0 0.0 122.4 121.1 133.60 75.57 73 1.830 9780K 8756 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 168.3 16.85 8.20 37 0.455 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.1 total, 17.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.57 GB write, 1053.22 MB/s write, 15.96 GB read, 905.35 MB/s read, 150.4 seconds Interval compaction: 18.57 GB write, 1064.61 MB/s write, 15.96 GB read, 915.14 MB/s read, 150.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 46, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 815709 Average: 11.3294 StdDev: 141.80 Min: 1 Median: 1.8189 Max: 47408 Percentiles: P50: 1.82 P75: 2.78 P99: 192.74 P99.9: 1408.85 P99.99: 3415.40 ------------------------------------------------------ [ 0, 1 ] 55021 6.745% 6.745% # ( 1, 2 ] 430879 52.823% 59.568% ########### ( 2, 3 ] 162207 19.885% 79.453% #### ( 3, 4 ] 67945 8.330% 87.783% ## ( 4, 6 ] 67126 8.229% 96.012% ## ( 6, 10 ] 15396 1.887% 97.899% ( 10, 15 ] 2599 0.319% 98.218% ( 15, 22 ] 307 0.038% 98.256% ( 22, 34 ] 20 0.002% 98.258% ( 34, 51 ] 20 0.002% 98.261% ( 51, 76 ] 33 0.004% 98.265% ( 76, 110 ] 814 0.100% 98.364% ( 110, 170 ] 4321 0.530% 98.894% ( 170, 250 ] 3043 0.373% 99.267% ( 250, 380 ] 1702 0.209% 99.476% ( 380, 580 ] 1564 0.192% 99.668% ( 580, 870 ] 1089 0.134% 99.801% ( 870, 1300 ] 733 0.090% 99.891% ( 1300, 1900 ] 415 0.051% 99.942% ( 1900, 2900 ] 302 0.037% 99.979% ( 2900, 4400 ] 269 0.033% 100.012% ( 4400, 6600 ] 77 0.009% 100.021% ( 6600, 9900 ] 7 0.001% 100.022% ( 9900, 14000 ] 2 0.000% 100.022% ( 14000, 22000 ] 1 0.000% 100.022% ( 22000, 33000 ] 2 0.000% 100.023% ( 33000, 50000 ] 2 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 283546 Average: 11.0212 StdDev: 145.13 Min: 1 Median: 1.9070 Max: 21155 Percentiles: P50: 1.91 P75: 2.94 P99: 15.21 P99.9: 1809.50 P99.99: 3804.88 ------------------------------------------------------ [ 0, 1 ] 15111 5.329% 5.329% # ( 1, 2 ] 139644 49.249% 54.578% ########## ( 2, 3 ] 61852 21.814% 76.392% #### ( 3, 4 ] 27151 9.576% 85.968% ## ( 4, 6 ] 27578 9.726% 95.694% ## ( 6, 10 ] 8079 2.849% 98.543% # ( 10, 15 ] 1287 0.454% 98.997% ( 15, 22 ] 285 0.101% 99.098% ( 22, 34 ] 19 0.007% 99.104% ( 34, 51 ] 14 0.005% 99.109% ( 51, 76 ] 20 0.007% 99.116% ( 76, 110 ] 119 0.042% 99.158% ( 110, 170 ] 423 0.149% 99.307% ( 170, 250 ] 319 0.113% 99.420% ( 250, 380 ] 243 0.086% 99.506% ( 380, 580 ] 364 0.128% 99.634% ( 580, 870 ] 346 0.122% 99.756% ( 870, 1300 ] 259 0.091% 99.847% ( 1300, 1900 ] 176 0.062% 99.909% ( 1900, 2900 ] 146 0.051% 99.961% ( 2900, 4400 ] 137 0.048% 100.009% ( 4400, 6600 ] 36 0.013% 100.022% ( 6600, 9900 ] 4 0.001% 100.023% ( 9900, 14000 ] 3 0.001% 100.024% ( 14000, 22000 ] 2 0.001% 100.025% ** Level 2 read latency histogram (micros): Count: 554582 Average: 14.1079 StdDev: 169.71 Min: 1 Median: 2.0265 Max: 15303 Percentiles: P50: 2.03 P75: 3.11 P99: 12.67 P99.9: 1650.24 P99.99: 2393.88 ------------------------------------------------------ [ 0, 1 ] 12387 2.234% 2.234% ( 1, 2 ] 261305 47.117% 49.351% ######### ( 2, 3 ] 135651 24.460% 73.811% ##### ( 3, 4 ] 58014 10.461% 84.272% ## ( 4, 6 ] 62293 11.232% 95.504% ## ( 6, 10 ] 17577 3.169% 98.674% # ( 10, 15 ] 3384 0.610% 99.284% ( 15, 22 ] 540 0.097% 99.381% ( 22, 34 ] 92 0.017% 99.398% ( 34, 51 ] 41 0.007% 99.405% ( 51, 76 ] 30 0.005% 99.411% ( 76, 110 ] 19 0.003% 99.414% ( 110, 170 ] 47 0.008% 99.423% ( 170, 250 ] 130 0.023% 99.446% ( 250, 380 ] 256 0.046% 99.492% ( 380, 580 ] 436 0.079% 99.571% ( 580, 870 ] 678 0.122% 99.693% ( 870, 1300 ] 782 0.141% 99.834% ( 1300, 1900 ] 626 0.113% 99.947% ( 1900, 2900 ] 483 0.087% 100.034% ( 2900, 4400 ] 419 0.076% 100.110% ( 4400, 6600 ] 144 0.026% 100.136% ( 6600, 9900 ] 16 0.003% 100.138% ( 9900, 14000 ] 3 0.001% 100.139% ( 14000, 22000 ] 1 0.000% 100.139% ** Level 3 read latency histogram (micros): Count: 1424880 Average: 11.5110 StdDev: 174.26 Min: 0 Median: 1.9854 Max: 47464 Percentiles: P50: 1.99 P75: 2.98 P99: 9.90 P99.9: 1084.88 P99.99: 1668.09 ------------------------------------------------------ [ 0, 1 ] 26417 1.854% 1.854% ( 1, 2 ] 696191 48.860% 50.714% ########## ( 2, 3 ] 353835 24.833% 75.546% ##### ( 3, 4 ] 141779 9.950% 85.496% ## ( 4, 6 ] 153944 10.804% 96.300% ## ( 6, 10 ] 39412 2.766% 99.066% # ( 10, 15 ] 6617 0.464% 99.531% ( 15, 22 ] 822 0.058% 99.589% ( 22, 34 ] 60 0.004% 99.593% ( 34, 51 ] 84 0.006% 99.599% ( 51, 76 ] 104 0.007% 99.606% ( 76, 110 ] 116 0.008% 99.614% ( 110, 170 ] 402 0.028% 99.642% ( 170, 250 ] 364 0.026% 99.668% ( 250, 380 ] 486 0.034% 99.702% ( 380, 580 ] 817 0.057% 99.759% ( 580, 870 ] 1302 0.091% 99.851% ( 870, 1300 ] 1407 0.099% 99.949% ( 1300, 1900 ] 943 0.066% 100.016% ( 1900, 2900 ] 949 0.067% 100.082% ( 2900, 4400 ] 909 0.064% 100.146% ( 4400, 6600 ] 253 0.018% 100.164% ( 6600, 9900 ] 45 0.003% 100.167% ( 9900, 14000 ] 6 0.000% 100.167% ( 14000, 22000 ] 7 0.000% 100.168% ( 22000, 33000 ] 5 0.000% 100.168% ( 33000, 50000 ] 3 0.000% 100.168% ** Level 4 read latency histogram (micros): Count: 843126 Average: 22.7015 StdDev: 226.46 Min: 1 Median: 2.0405 Max: 38413 Percentiles: P50: 2.04 P75: 3.16 P99: 388.81 P99.9: 2320.79 P99.99: 3086.45 ------------------------------------------------------ [ 0, 1 ] 13261 1.573% 1.573% ( 1, 2 ] 399967 47.439% 49.011% ######### ( 2, 3 ] 205637 24.390% 73.401% ##### ( 3, 4 ] 85699 10.164% 83.566% ## ( 4, 6 ] 92548 10.977% 94.542% ## ( 6, 10 ] 25561 3.032% 97.574% # ( 10, 15 ] 4276 0.507% 98.081% ( 15, 22 ] 523 0.062% 98.143% ( 22, 34 ] 42 0.005% 98.148% ( 34, 51 ] 47 0.006% 98.154% ( 51, 76 ] 93 0.011% 98.165% ( 76, 110 ] 651 0.077% 98.242% ( 110, 170 ] 2957 0.351% 98.593% ( 170, 250 ] 1974 0.234% 98.827% ( 250, 380 ] 1381 0.164% 98.991% ( 380, 580 ] 1764 0.209% 99.200% ( 580, 870 ] 2102 0.249% 99.449% ( 870, 1300 ] 2035 0.241% 99.691% ( 1300, 1900 ] 1318 0.156% 99.847% ( 1900, 2900 ] 1062 0.126% 99.973% ( 2900, 4400 ] 1156 0.137% 100.110% ( 4400, 6600 ] 317 0.038% 100.148% ( 6600, 9900 ] 44 0.005% 100.153% ( 9900, 14000 ] 3 0.000% 100.153% ( 14000, 22000 ] 4 0.000% 100.154% ( 22000, 33000 ] 2 0.000% 100.154% ( 33000, 50000 ] 1 0.000% 100.154% ** Level 5 read latency histogram (micros): Count: 72212 Average: 709.1681 StdDev: 1130.63 Min: 77 Median: 267.9006 Max: 47401 Percentiles: P50: 267.90 P75: 768.87 P99: 5602.92 P99.9: 9007.69 P99.99: 26778.80 ------------------------------------------------------ ( 76, 110 ] 4372 6.054% 6.054% # ( 110, 170 ] 19064 26.400% 32.454% ##### ( 170, 250 ] 11698 16.200% 48.654% ### ( 250, 380 ] 7059 9.775% 58.429% ## ( 380, 580 ] 7583 10.501% 68.930% ## ( 580, 870 ] 6730 9.320% 78.250% ## ( 870, 1300 ] 5480 7.589% 85.839% ## ( 1300, 1900 ] 3426 4.744% 90.583% # ( 1900, 2900 ] 2712 3.756% 94.339% # ( 2900, 4400 ] 2742 3.797% 98.136% # ( 4400, 6600 ] 1141 1.580% 99.716% ( 6600, 9900 ] 182 0.252% 99.968% ( 9900, 14000 ] 4 0.006% 99.974% ( 14000, 22000 ] 7 0.010% 99.983% ( 22000, 33000 ] 11 0.015% 99.999% ( 33000, 50000 ] 3 0.004% 100.003% ** DB Stats ** Uptime(secs): 18.1 total, 3.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 163.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.488 H:M:S, 35.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 257.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.187 H:M:S, 4.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-05:19:51 ... thread 0: (1000000,4000000) ops and (229573.1,180048.0) ops/second in (4.355911,22.216303) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.13 GB 138.4 2.8 0.0 2.8 6.6 3.7 0.0 1.8 84.9 197.5 34.12 22.57 62 0.550 2942K 3314 0.0 0.0 L1 7/7 578.99 MB 0.0 1.7 1.1 0.5 1.7 1.1 0.0 1.5 121.0 120.6 14.13 8.28 2 7.066 1736K 5513 0.0 0.0 L3 15/0 941.74 MB 0.9 5.2 3.1 2.1 5.2 3.1 0.2 1.7 114.0 113.1 47.03 25.19 21 2.240 2805K 1105 0.0 0.0 L4 169/0 9.49 GB 1.0 8.2 4.5 3.7 8.1 4.4 0.6 1.8 119.1 117.2 70.56 39.21 52 1.357 3822K 0 0.0 0.0 L5 1156/0 95.10 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1365/20 109.21 GB 0.0 17.9 8.8 9.2 21.5 12.3 6.0 5.7 110.8 132.8 165.84 95.25 137 1.211 11M 9932 0.0 0.0 Int 0/0 0.00 KB 0.0 17.9 8.8 9.2 21.5 12.3 6.0 5.7 110.8 132.8 165.84 95.25 137 1.211 11M 9932 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.9 8.8 9.2 17.8 8.6 0.0 0.0 126.6 125.3 145.13 84.10 85 1.707 11M 9932 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 185.6 20.71 11.15 52 0.398 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.4 total, 22.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.51 GB write, 982.88 MB/s write, 17.94 GB read, 819.87 MB/s read, 165.8 seconds Interval compaction: 21.51 GB write, 991.43 MB/s write, 17.94 GB read, 827.00 MB/s read, 165.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 56, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1096301 Average: 13.2986 StdDev: 135.13 Min: 0 Median: 1.7468 Max: 47408 Percentiles: P50: 1.75 P75: 2.66 P99: 238.00 P99.9: 1244.20 P99.99: 2991.85 ------------------------------------------------------ [ 0, 1 ] 113067 10.313% 10.313% ## ( 1, 2 ] 582576 53.140% 63.454% ########### ( 2, 3 ] 191204 17.441% 80.894% ### ( 3, 4 ] 79489 7.251% 88.145% # ( 4, 6 ] 75998 6.932% 95.077% # ( 6, 10 ] 17131 1.563% 96.640% ( 10, 15 ] 2925 0.267% 96.907% ( 15, 22 ] 342 0.031% 96.938% ( 22, 34 ] 25 0.002% 96.940% ( 34, 51 ] 23 0.002% 96.942% ( 51, 76 ] 34 0.003% 96.945% ( 76, 110 ] 2792 0.255% 97.200% ( 110, 170 ] 13585 1.239% 98.439% ( 170, 250 ] 7233 0.660% 99.099% ( 250, 380 ] 3322 0.303% 99.402% ( 380, 580 ] 2946 0.269% 99.671% ( 580, 870 ] 1660 0.151% 99.822% ( 870, 1300 ] 981 0.089% 99.912% ( 1300, 1900 ] 492 0.045% 99.957% ( 1900, 2900 ] 345 0.031% 99.988% ( 2900, 4400 ] 349 0.032% 100.020% ( 4400, 6600 ] 94 0.009% 100.028% ( 6600, 9900 ] 12 0.001% 100.030% ( 9900, 14000 ] 3 0.000% 100.030% ( 14000, 22000 ] 1 0.000% 100.030% ( 22000, 33000 ] 2 0.000% 100.030% ( 33000, 50000 ] 2 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 288527 Average: 11.4599 StdDev: 144.54 Min: 1 Median: 1.9226 Max: 21155 Percentiles: P50: 1.92 P75: 2.98 P99: 121.25 P99.9: 1794.32 P99.99: 3799.42 ------------------------------------------------------ [ 0, 1 ] 15120 5.240% 5.240% # ( 1, 2 ] 139977 48.514% 53.755% ########## ( 2, 3 ] 62449 21.644% 75.399% #### ( 3, 4 ] 28139 9.753% 85.151% ## ( 4, 6 ] 29396 10.188% 95.340% ## ( 6, 10 ] 8457 2.931% 98.271% # ( 10, 15 ] 1364 0.473% 98.744% ( 15, 22 ] 335 0.116% 98.860% ( 22, 34 ] 23 0.008% 98.868% ( 34, 51 ] 16 0.006% 98.873% ( 51, 76 ] 20 0.007% 98.880% ( 76, 110 ] 206 0.071% 98.952% ( 110, 170 ] 745 0.258% 99.210% ( 170, 250 ] 481 0.167% 99.376% ( 250, 380 ] 307 0.106% 99.483% ( 380, 580 ] 419 0.145% 99.628% ( 580, 870 ] 371 0.129% 99.757% ( 870, 1300 ] 266 0.092% 99.849% ( 1300, 1900 ] 179 0.062% 99.911% ( 1900, 2900 ] 146 0.051% 99.962% ( 2900, 4400 ] 137 0.047% 100.009% ( 4400, 6600 ] 36 0.012% 100.021% ( 6600, 9900 ] 4 0.001% 100.023% ( 9900, 14000 ] 3 0.001% 100.024% ( 14000, 22000 ] 2 0.001% 100.025% ** Level 2 read latency histogram (micros): Count: 554582 Average: 14.1079 StdDev: 169.71 Min: 1 Median: 2.0265 Max: 15303 Percentiles: P50: 2.03 P75: 3.11 P99: 12.67 P99.9: 1650.24 P99.99: 2393.88 ------------------------------------------------------ [ 0, 1 ] 12387 2.234% 2.234% ( 1, 2 ] 261305 47.117% 49.351% ######### ( 2, 3 ] 135651 24.460% 73.811% ##### ( 3, 4 ] 58014 10.461% 84.272% ## ( 4, 6 ] 62293 11.232% 95.504% ## ( 6, 10 ] 17577 3.169% 98.674% # ( 10, 15 ] 3384 0.610% 99.284% ( 15, 22 ] 540 0.097% 99.381% ( 22, 34 ] 92 0.017% 99.398% ( 34, 51 ] 41 0.007% 99.405% ( 51, 76 ] 30 0.005% 99.411% ( 76, 110 ] 19 0.003% 99.414% ( 110, 170 ] 47 0.008% 99.423% ( 170, 250 ] 130 0.023% 99.446% ( 250, 380 ] 256 0.046% 99.492% ( 380, 580 ] 436 0.079% 99.571% ( 580, 870 ] 678 0.122% 99.693% ( 870, 1300 ] 782 0.141% 99.834% ( 1300, 1900 ] 626 0.113% 99.947% ( 1900, 2900 ] 483 0.087% 100.034% ( 2900, 4400 ] 419 0.076% 100.110% ( 4400, 6600 ] 144 0.026% 100.136% ( 6600, 9900 ] 16 0.003% 100.138% ( 9900, 14000 ] 3 0.001% 100.139% ( 14000, 22000 ] 1 0.000% 100.139% ** Level 3 read latency histogram (micros): Count: 1535235 Average: 11.1455 StdDev: 169.61 Min: 0 Median: 1.9837 Max: 47464 Percentiles: P50: 1.98 P75: 2.98 P99: 9.90 P99.9: 1039.96 P99.99: 1618.46 ------------------------------------------------------ [ 0, 1 ] 29558 1.925% 1.925% ( 1, 2 ] 750314 48.873% 50.798% ########## ( 2, 3 ] 380611 24.792% 75.590% ##### ( 3, 4 ] 152821 9.954% 85.544% ## ( 4, 6 ] 166014 10.814% 96.358% ## ( 6, 10 ] 41552 2.707% 99.064% # ( 10, 15 ] 7029 0.458% 99.522% ( 15, 22 ] 856 0.056% 99.578% ( 22, 34 ] 62 0.004% 99.582% ( 34, 51 ] 100 0.007% 99.588% ( 51, 76 ] 114 0.007% 99.596% ( 76, 110 ] 178 0.012% 99.607% ( 110, 170 ] 673 0.044% 99.651% ( 170, 250 ] 475 0.031% 99.682% ( 250, 380 ] 536 0.035% 99.717% ( 380, 580 ] 886 0.058% 99.775% ( 580, 870 ] 1350 0.088% 99.863% ( 870, 1300 ] 1444 0.094% 99.957% ( 1300, 1900 ] 958 0.062% 100.019% ( 1900, 2900 ] 963 0.063% 100.082% ( 2900, 4400 ] 935 0.061% 100.143% ( 4400, 6600 ] 258 0.017% 100.160% ( 6600, 9900 ] 46 0.003% 100.163% ( 9900, 14000 ] 7 0.000% 100.163% ( 14000, 22000 ] 7 0.000% 100.164% ( 22000, 33000 ] 5 0.000% 100.164% ( 33000, 50000 ] 3 0.000% 100.164% ** Level 4 read latency histogram (micros): Count: 984114 Average: 22.6306 StdDev: 220.53 Min: 0 Median: 2.0362 Max: 38413 Percentiles: P50: 2.04 P75: 3.18 P99: 367.58 P99.9: 2180.79 P99.99: 2991.25 ------------------------------------------------------ [ 0, 1 ] 17292 1.757% 1.757% ( 1, 2 ] 466180 47.371% 49.128% ######### ( 2, 3 ] 237373 24.120% 73.248% ##### ( 3, 4 ] 98347 9.993% 83.242% ## ( 4, 6 ] 106389 10.811% 94.052% ## ( 6, 10 ] 29421 2.990% 97.042% # ( 10, 15 ] 4909 0.499% 97.541% ( 15, 22 ] 597 0.061% 97.601% ( 22, 34 ] 48 0.005% 97.606% ( 34, 51 ] 55 0.006% 97.612% ( 51, 76 ] 110 0.011% 97.623% ( 76, 110 ] 1510 0.153% 97.776% ( 110, 170 ] 6556 0.666% 98.443% ( 170, 250 ] 3600 0.366% 98.808% ( 250, 380 ] 2085 0.212% 99.020% ( 380, 580 ] 2365 0.240% 99.261% ( 580, 870 ] 2396 0.243% 99.504% ( 870, 1300 ] 2185 0.222% 99.726% ( 1300, 1900 ] 1396 0.142% 99.868% ( 1900, 2900 ] 1125 0.114% 99.982% ( 2900, 4400 ] 1259 0.128% 100.110% ( 4400, 6600 ] 353 0.036% 100.146% ( 6600, 9900 ] 56 0.006% 100.152% ( 9900, 14000 ] 6 0.001% 100.152% ( 14000, 22000 ] 4 0.000% 100.153% ( 22000, 33000 ] 2 0.000% 100.153% ( 33000, 50000 ] 1 0.000% 100.153% ** Level 5 read latency histogram (micros): Count: 116946 Average: 531.1896 StdDev: 944.08 Min: 75 Median: 203.4195 Max: 47401 Percentiles: P50: 203.42 P75: 498.92 P99: 4845.05 P99.9: 8310.77 P99.99: 17777.60 ------------------------------------------------------ ( 51, 76 ] 1 0.001% 0.001% ( 76, 110 ] 9400 8.038% 8.039% ## ( 110, 170 ] 40347 34.501% 42.539% ####### ( 170, 250 ] 20886 17.860% 60.399% #### ( 250, 380 ] 10726 9.172% 69.571% ## ( 380, 580 ] 10679 9.132% 78.702% ## ( 580, 870 ] 8093 6.920% 85.622% # ( 870, 1300 ] 6085 5.203% 90.826% # ( 1300, 1900 ] 3627 3.101% 93.927% # ( 1900, 2900 ] 2823 2.414% 96.341% ( 2900, 4400 ] 2868 2.452% 98.793% ( 4400, 6600 ] 1194 1.021% 99.814% ( 6600, 9900 ] 193 0.165% 99.979% ( 9900, 14000 ] 9 0.008% 99.987% ( 14000, 22000 ] 7 0.006% 99.993% ( 22000, 33000 ] 11 0.009% 100.003% ( 33000, 50000 ] 3 0.003% 100.005% ** DB Stats ** Uptime(secs): 22.4 total, 4.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 175.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.133 H:M:S, 31.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 225.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.645 H:M:S, 14.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-05:20:01 ... thread 0: (1000000,5000000) ops and (102391.7,156334.4) ops/second in (9.766414,31.982717) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 4.05 GB 232.1 4.9 0.0 4.9 9.6 4.7 0.0 2.0 110.0 217.0 45.22 33.18 82 0.552 5052K 11K 0.0 0.0 L1 7/7 578.99 MB 0.0 1.7 1.1 0.5 1.7 1.1 0.0 1.5 121.0 120.6 14.13 8.28 2 7.066 1736K 5513 0.0 0.0 L3 15/0 941.74 MB 0.9 5.2 3.1 2.1 5.2 3.1 0.2 1.7 114.0 113.1 47.03 25.19 21 2.240 2805K 1105 0.0 0.0 L4 169/0 9.49 GB 1.0 8.2 4.5 3.7 8.1 4.4 0.6 1.8 119.1 117.2 70.56 39.21 52 1.357 3822K 0 0.0 0.0 L5 1156/0 95.10 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1366/20 110.13 GB 0.0 20.0 8.8 11.2 24.5 13.3 6.0 5.2 115.6 141.9 176.95 105.85 157 1.127 13M 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.0 8.8 11.2 24.5 13.3 6.0 5.2 115.6 141.9 176.95 105.85 157 1.127 13M 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.0 8.8 11.2 19.8 8.6 0.0 0.0 133.8 132.5 152.89 91.75 89 1.718 13M 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 201.6 24.06 14.10 68 0.354 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.2 total, 32.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.52 GB write, 780.20 MB/s write, 19.97 GB read, 635.59 MB/s read, 176.9 seconds Interval compaction: 24.52 GB write, 784.92 MB/s write, 19.97 GB read, 639.43 MB/s read, 176.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 56, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1745883 Average: 15.6722 StdDev: 114.03 Min: 0 Median: 1.6308 Max: 47408 Percentiles: P50: 1.63 P75: 2.43 P99: 243.35 P99.9: 867.71 P99.99: 1899.31 ------------------------------------------------------ [ 0, 1 ] 294486 16.867% 16.867% ### ( 1, 2 ] 917076 52.528% 69.395% ########### ( 2, 3 ] 228897 13.111% 82.506% ### ( 3, 4 ] 95621 5.477% 87.983% # ( 4, 6 ] 85455 4.895% 92.878% # ( 6, 10 ] 18784 1.076% 93.954% ( 10, 15 ] 3243 0.186% 94.139% ( 15, 22 ] 392 0.022% 94.162% ( 22, 34 ] 27 0.002% 94.163% ( 34, 51 ] 26 0.001% 94.165% ( 51, 76 ] 37 0.002% 94.167% ( 76, 110 ] 12919 0.740% 94.907% ( 110, 170 ] 54046 3.096% 98.003% # ( 170, 250 ] 18997 1.088% 99.091% ( 250, 380 ] 6470 0.371% 99.461% ( 380, 580 ] 5419 0.310% 99.772% ( 580, 870 ] 2262 0.130% 99.901% ( 870, 1300 ] 1043 0.060% 99.961% ( 1300, 1900 ] 511 0.029% 99.990% ( 1900, 2900 ] 375 0.021% 100.012% ( 2900, 4400 ] 362 0.021% 100.032% ( 4400, 6600 ] 94 0.005% 100.038% ( 6600, 9900 ] 12 0.001% 100.038% ( 9900, 14000 ] 3 0.000% 100.039% ( 14000, 22000 ] 1 0.000% 100.039% ( 22000, 33000 ] 2 0.000% 100.039% ( 33000, 50000 ] 2 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 295345 Average: 12.5379 StdDev: 143.73 Min: 1 Median: 1.9466 Max: 21155 Percentiles: P50: 1.95 P75: 3.12 P99: 167.54 P99.9: 1771.47 P99.99: 3791.96 ------------------------------------------------------ [ 0, 1 ] 15125 5.121% 5.121% # ( 1, 2 ] 140032 47.413% 52.534% ######### ( 2, 3 ] 62765 21.251% 73.786% #### ( 3, 4 ] 29672 10.047% 83.832% ## ( 4, 6 ] 31639 10.713% 94.545% ## ( 6, 10 ] 8772 2.970% 97.515% # ( 10, 15 ] 1438 0.487% 98.002% ( 15, 22 ] 406 0.137% 98.139% ( 22, 34 ] 28 0.009% 98.149% ( 34, 51 ] 17 0.006% 98.154% ( 51, 76 ] 20 0.007% 98.161% ( 76, 110 ] 545 0.185% 98.346% ( 110, 170 ] 2015 0.682% 99.028% ( 170, 250 ] 841 0.285% 99.313% ( 250, 380 ] 432 0.146% 99.459% ( 380, 580 ] 508 0.172% 99.631% ( 580, 870 ] 387 0.131% 99.762% ( 870, 1300 ] 267 0.090% 99.852% ( 1300, 1900 ] 179 0.061% 99.913% ( 1900, 2900 ] 146 0.049% 99.962% ( 2900, 4400 ] 137 0.046% 100.009% ( 4400, 6600 ] 36 0.012% 100.021% ( 6600, 9900 ] 4 0.001% 100.022% ( 9900, 14000 ] 3 0.001% 100.023% ( 14000, 22000 ] 2 0.001% 100.024% ** Level 2 read latency histogram (micros): Count: 554582 Average: 14.1079 StdDev: 169.71 Min: 1 Median: 2.0265 Max: 15303 Percentiles: P50: 2.03 P75: 3.11 P99: 12.67 P99.9: 1650.24 P99.99: 2393.88 ------------------------------------------------------ [ 0, 1 ] 12387 2.234% 2.234% ( 1, 2 ] 261305 47.117% 49.351% ######### ( 2, 3 ] 135651 24.460% 73.811% ##### ( 3, 4 ] 58014 10.461% 84.272% ## ( 4, 6 ] 62293 11.232% 95.504% ## ( 6, 10 ] 17577 3.169% 98.674% # ( 10, 15 ] 3384 0.610% 99.284% ( 15, 22 ] 540 0.097% 99.381% ( 22, 34 ] 92 0.017% 99.398% ( 34, 51 ] 41 0.007% 99.405% ( 51, 76 ] 30 0.005% 99.411% ( 76, 110 ] 19 0.003% 99.414% ( 110, 170 ] 47 0.008% 99.423% ( 170, 250 ] 130 0.023% 99.446% ( 250, 380 ] 256 0.046% 99.492% ( 380, 580 ] 436 0.079% 99.571% ( 580, 870 ] 678 0.122% 99.693% ( 870, 1300 ] 782 0.141% 99.834% ( 1300, 1900 ] 626 0.113% 99.947% ( 1900, 2900 ] 483 0.087% 100.034% ( 2900, 4400 ] 419 0.076% 100.110% ( 4400, 6600 ] 144 0.026% 100.136% ( 6600, 9900 ] 16 0.003% 100.138% ( 9900, 14000 ] 3 0.001% 100.139% ( 14000, 22000 ] 1 0.000% 100.139% ** Level 3 read latency histogram (micros): Count: 1538484 Average: 11.4690 StdDev: 169.65 Min: 0 Median: 1.9858 Max: 47464 Percentiles: P50: 1.99 P75: 2.98 P99: 11.50 P99.9: 1040.13 P99.99: 1619.18 ------------------------------------------------------ [ 0, 1 ] 29558 1.921% 1.921% ( 1, 2 ] 750314 48.770% 50.691% ########## ( 2, 3 ] 380614 24.740% 75.430% ##### ( 3, 4 ] 152884 9.937% 85.368% ## ( 4, 6 ] 166059 10.794% 96.161% ## ( 6, 10 ] 41559 2.701% 98.863% # ( 10, 15 ] 7030 0.457% 99.320% ( 15, 22 ] 856 0.056% 99.375% ( 22, 34 ] 62 0.004% 99.379% ( 34, 51 ] 100 0.006% 99.386% ( 51, 76 ] 114 0.007% 99.393% ( 76, 110 ] 643 0.042% 99.435% ( 110, 170 ] 2506 0.163% 99.598% ( 170, 250 ] 1006 0.065% 99.663% ( 250, 380 ] 689 0.045% 99.708% ( 380, 580 ] 1006 0.065% 99.774% ( 580, 870 ] 1373 0.089% 99.863% ( 870, 1300 ] 1447 0.094% 99.957% ( 1300, 1900 ] 959 0.062% 100.019% ( 1900, 2900 ] 964 0.063% 100.082% ( 2900, 4400 ] 935 0.061% 100.143% ( 4400, 6600 ] 258 0.017% 100.159% ( 6600, 9900 ] 46 0.003% 100.162% ( 9900, 14000 ] 7 0.000% 100.163% ( 14000, 22000 ] 7 0.000% 100.163% ( 22000, 33000 ] 5 0.000% 100.164% ( 33000, 50000 ] 3 0.000% 100.164% ** Level 4 read latency histogram (micros): Count: 1007597 Average: 25.7800 StdDev: 219.51 Min: 0 Median: 2.0856 Max: 38413 Percentiles: P50: 2.09 P75: 3.35 P99: 417.52 P99.9: 2161.88 P99.99: 2988.38 ------------------------------------------------------ [ 0, 1 ] 17292 1.716% 1.716% ( 1, 2 ] 466190 46.268% 47.984% ######### ( 2, 3 ] 237405 23.562% 71.545% ##### ( 3, 4 ] 98975 9.823% 81.368% ## ( 4, 6 ] 107221 10.641% 92.009% ## ( 6, 10 ] 29500 2.928% 94.937% # ( 10, 15 ] 4939 0.490% 95.427% ( 15, 22 ] 598 0.059% 95.487% ( 22, 34 ] 49 0.005% 95.491% ( 34, 51 ] 55 0.005% 95.497% ( 51, 76 ] 110 0.011% 95.508% ( 76, 110 ] 4871 0.483% 95.991% ( 110, 170 ] 19428 1.928% 97.919% ( 170, 250 ] 7207 0.715% 98.635% ( 250, 380 ] 3088 0.306% 98.941% ( 380, 580 ] 3161 0.314% 99.255% ( 580, 870 ] 2599 0.258% 99.513% ( 870, 1300 ] 2207 0.219% 99.732% ( 1300, 1900 ] 1399 0.139% 99.871% ( 1900, 2900 ] 1128 0.112% 99.983% ( 2900, 4400 ] 1260 0.125% 100.108% ( 4400, 6600 ] 353 0.035% 100.143% ( 6600, 9900 ] 56 0.006% 100.148% ( 9900, 14000 ] 6 0.001% 100.149% ( 14000, 22000 ] 4 0.000% 100.149% ( 22000, 33000 ] 2 0.000% 100.149% ( 33000, 50000 ] 1 0.000% 100.150% ** Level 5 read latency histogram (micros): Count: 248857 Average: 338.9910 StdDev: 676.11 Min: 75 Median: 158.1517 Max: 47401 Percentiles: P50: 158.15 P75: 242.97 P99: 3835.44 P99.9: 6535.77 P99.99: 9833.56 ------------------------------------------------------ ( 51, 76 ] 2 0.001% 0.001% ( 76, 110 ] 30074 12.085% 12.086% ## ( 110, 170 ] 117569 47.244% 59.329% ######### ( 170, 250 ] 42756 17.181% 76.510% ### ( 250, 380 ] 16699 6.710% 83.220% # ( 380, 580 ] 15478 6.220% 89.440% # ( 580, 870 ] 9284 3.731% 93.171% # ( 870, 1300 ] 6218 2.499% 95.669% ( 1300, 1900 ] 3647 1.466% 97.135% ( 1900, 2900 ] 2851 1.146% 98.281% ( 2900, 4400 ] 2871 1.154% 99.434% ( 4400, 6600 ] 1194 0.480% 99.914% ( 6600, 9900 ] 193 0.078% 99.992% ( 9900, 14000 ] 9 0.004% 99.995% ( 14000, 22000 ] 7 0.003% 99.998% ( 22000, 33000 ] 11 0.004% 100.002% ( 33000, 50000 ] 3 0.001% 100.004% ** DB Stats ** Uptime(secs): 32.2 total, 9.8 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 152.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.037 H:M:S, 40.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 100.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.904 H:M:S, 60.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-05:20:10 ... thread 0: (1000000,6000000) ops and (110867.4,146332.5) ops/second in (9.019787,41.002504) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 5.03 GB 332.4 6.9 0.0 6.9 12.5 5.6 0.0 2.2 125.4 228.1 56.26 43.67 102 0.552 7161K 16K 0.0 0.0 L1 7/7 578.99 MB 0.0 1.7 1.1 0.5 1.7 1.1 0.0 1.5 121.0 120.6 14.13 8.28 2 7.066 1736K 5513 0.0 0.0 L3 15/0 941.74 MB 0.9 5.2 3.1 2.1 5.2 3.1 0.2 1.7 114.0 113.1 47.03 25.19 21 2.240 2805K 1105 0.0 0.0 L4 169/0 9.49 GB 1.0 8.2 4.5 3.7 8.1 4.4 0.6 1.8 119.1 117.2 70.56 39.21 52 1.357 3822K 0 0.0 0.0 L5 1156/0 95.10 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1366/20 111.11 GB 0.0 22.0 8.8 13.2 27.5 14.2 6.0 4.9 119.9 149.6 187.98 116.34 177 1.062 15M 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.0 8.8 13.2 27.5 14.2 6.0 4.9 119.9 149.6 187.98 116.34 177 1.062 15M 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.0 8.8 13.2 21.8 8.6 0.0 0.0 140.1 138.9 160.78 99.53 94 1.710 15M 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 213.1 27.20 16.81 83 0.328 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.2 total, 41.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.46 GB write, 682.63 MB/s write, 22.00 GB read, 546.88 MB/s read, 188.0 seconds Interval compaction: 27.46 GB write, 685.85 MB/s write, 22.00 GB read, 549.45 MB/s read, 188.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 56, interval: 80 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2324573 Average: 16.8019 StdDev: 104.02 Min: 0 Median: 1.5881 Max: 47408 Percentiles: P50: 1.59 P75: 2.30 P99: 245.62 P99.9: 787.16 P99.99: 1502.53 ------------------------------------------------------ [ 0, 1 ] 445687 19.173% 19.173% #### ( 1, 2 ] 1218567 52.421% 71.594% ########## ( 2, 3 ] 266512 11.465% 83.059% ## ( 3, 4 ] 109883 4.727% 87.786% # ( 4, 6 ] 95209 4.096% 91.882% # ( 6, 10 ] 20399 0.878% 92.759% ( 10, 15 ] 3913 0.168% 92.928% ( 15, 22 ] 469 0.020% 92.948% ( 22, 34 ] 36 0.002% 92.949% ( 34, 51 ] 28 0.001% 92.951% ( 51, 76 ] 50 0.002% 92.953% ( 76, 110 ] 21990 0.946% 93.899% ( 110, 170 ] 90026 3.873% 97.771% # ( 170, 250 ] 30212 1.300% 99.071% ( 250, 380 ] 9503 0.409% 99.480% ( 380, 580 ] 7735 0.333% 99.813% ( 580, 870 ] 2841 0.122% 99.935% ( 870, 1300 ] 1104 0.047% 99.982% ( 1300, 1900 ] 523 0.022% 100.005% ( 1900, 2900 ] 400 0.017% 100.022% ( 2900, 4400 ] 375 0.016% 100.038% ( 4400, 6600 ] 94 0.004% 100.042% ( 6600, 9900 ] 12 0.001% 100.043% ( 9900, 14000 ] 3 0.000% 100.043% ( 14000, 22000 ] 1 0.000% 100.043% ( 22000, 33000 ] 2 0.000% 100.043% ( 33000, 50000 ] 2 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 308960 Average: 13.2110 StdDev: 141.33 Min: 1 Median: 1.9942 Max: 21155 Percentiles: P50: 1.99 P75: 3.39 P99: 188.38 P99.9: 1729.18 P99.99: 3777.05 ------------------------------------------------------ [ 0, 1 ] 15129 4.897% 4.897% # ( 1, 2 ] 140158 45.364% 50.261% ######### ( 2, 3 ] 63471 20.543% 70.805% #### ( 3, 4 ] 33216 10.751% 81.556% ## ( 4, 6 ] 37623 12.177% 93.733% ## ( 6, 10 ] 9720 3.146% 96.879% # ( 10, 15 ] 1666 0.539% 97.418% ( 15, 22 ] 589 0.191% 97.609% ( 22, 34 ] 47 0.015% 97.624% ( 34, 51 ] 18 0.006% 97.630% ( 51, 76 ] 20 0.006% 97.636% ( 76, 110 ] 826 0.267% 97.904% ( 110, 170 ] 3123 1.011% 98.914% ( 170, 250 ] 1151 0.373% 99.287% ( 250, 380 ] 524 0.170% 99.457% ( 380, 580 ] 568 0.184% 99.640% ( 580, 870 ] 404 0.131% 99.771% ( 870, 1300 ] 270 0.087% 99.859% ( 1300, 1900 ] 179 0.058% 99.916% ( 1900, 2900 ] 147 0.048% 99.964% ( 2900, 4400 ] 137 0.044% 100.008% ( 4400, 6600 ] 36 0.012% 100.020% ( 6600, 9900 ] 4 0.001% 100.021% ( 9900, 14000 ] 3 0.001% 100.022% ( 14000, 22000 ] 2 0.001% 100.023% ** Level 2 read latency histogram (micros): Count: 554582 Average: 14.1079 StdDev: 169.71 Min: 1 Median: 2.0265 Max: 15303 Percentiles: P50: 2.03 P75: 3.11 P99: 12.67 P99.9: 1650.24 P99.99: 2393.88 ------------------------------------------------------ [ 0, 1 ] 12387 2.234% 2.234% ( 1, 2 ] 261305 47.117% 49.351% ######### ( 2, 3 ] 135651 24.460% 73.811% ##### ( 3, 4 ] 58014 10.461% 84.272% ## ( 4, 6 ] 62293 11.232% 95.504% ## ( 6, 10 ] 17577 3.169% 98.674% # ( 10, 15 ] 3384 0.610% 99.284% ( 15, 22 ] 540 0.097% 99.381% ( 22, 34 ] 92 0.017% 99.398% ( 34, 51 ] 41 0.007% 99.405% ( 51, 76 ] 30 0.005% 99.411% ( 76, 110 ] 19 0.003% 99.414% ( 110, 170 ] 47 0.008% 99.423% ( 170, 250 ] 130 0.023% 99.446% ( 250, 380 ] 256 0.046% 99.492% ( 380, 580 ] 436 0.079% 99.571% ( 580, 870 ] 678 0.122% 99.693% ( 870, 1300 ] 782 0.141% 99.834% ( 1300, 1900 ] 626 0.113% 99.947% ( 1900, 2900 ] 483 0.087% 100.034% ( 2900, 4400 ] 419 0.076% 100.110% ( 4400, 6600 ] 144 0.026% 100.136% ( 6600, 9900 ] 16 0.003% 100.138% ( 9900, 14000 ] 3 0.001% 100.139% ( 14000, 22000 ] 1 0.000% 100.139% ** Level 3 read latency histogram (micros): Count: 1541500 Average: 11.7806 StdDev: 169.68 Min: 0 Median: 1.9878 Max: 47464 Percentiles: P50: 1.99 P75: 2.99 P99: 13.63 P99.9: 1040.07 P99.99: 1619.61 ------------------------------------------------------ [ 0, 1 ] 29558 1.917% 1.917% ( 1, 2 ] 750314 48.674% 50.592% ########## ( 2, 3 ] 380614 24.691% 75.283% ##### ( 3, 4 ] 152884 9.918% 85.201% ## ( 4, 6 ] 166059 10.773% 95.973% ## ( 6, 10 ] 41559 2.696% 98.669% # ( 10, 15 ] 7030 0.456% 99.125% ( 15, 22 ] 856 0.056% 99.181% ( 22, 34 ] 62 0.004% 99.185% ( 34, 51 ] 100 0.006% 99.191% ( 51, 76 ] 114 0.007% 99.199% ( 76, 110 ] 1143 0.074% 99.273% ( 110, 170 ] 4191 0.272% 99.545% ( 170, 250 ] 1527 0.099% 99.644% ( 250, 380 ] 862 0.056% 99.700% ( 380, 580 ] 1112 0.072% 99.772% ( 580, 870 ] 1400 0.091% 99.863% ( 870, 1300 ] 1450 0.094% 99.957% ( 1300, 1900 ] 959 0.062% 100.019% ( 1900, 2900 ] 965 0.063% 100.082% ( 2900, 4400 ] 935 0.061% 100.142% ( 4400, 6600 ] 258 0.017% 100.159% ( 6600, 9900 ] 46 0.003% 100.162% ( 9900, 14000 ] 7 0.000% 100.163% ( 14000, 22000 ] 7 0.000% 100.163% ( 22000, 33000 ] 5 0.000% 100.163% ( 33000, 50000 ] 3 0.000% 100.163% ** Level 4 read latency histogram (micros): Count: 1028384 Average: 28.6533 StdDev: 218.73 Min: 0 Median: 2.1293 Max: 38413 Percentiles: P50: 2.13 P75: 3.51 P99: 450.27 P99.9: 2147.46 P99.99: 2985.91 ------------------------------------------------------ [ 0, 1 ] 17292 1.681% 1.681% ( 1, 2 ] 466191 45.332% 47.014% ######### ( 2, 3 ] 237421 23.087% 70.101% ##### ( 3, 4 ] 99127 9.639% 79.740% ## ( 4, 6 ] 107430 10.446% 90.186% ## ( 6, 10 ] 29530 2.871% 93.058% # ( 10, 15 ] 4943 0.481% 93.538% ( 15, 22 ] 600 0.058% 93.597% ( 22, 34 ] 49 0.005% 93.602% ( 34, 51 ] 55 0.005% 93.607% ( 51, 76 ] 110 0.011% 93.618% ( 76, 110 ] 7820 0.760% 94.378% ( 110, 170 ] 31327 3.046% 97.424% # ( 170, 250 ] 10785 1.049% 98.473% ( 250, 380 ] 4046 0.393% 98.866% ( 380, 580 ] 3911 0.380% 99.247% ( 580, 870 ] 2810 0.273% 99.520% ( 870, 1300 ] 2223 0.216% 99.736% ( 1300, 1900 ] 1405 0.137% 99.873% ( 1900, 2900 ] 1134 0.110% 99.983% ( 2900, 4400 ] 1260 0.123% 100.106% ( 4400, 6600 ] 353 0.034% 100.140% ( 6600, 9900 ] 56 0.005% 100.145% ( 9900, 14000 ] 6 0.001% 100.146% ( 14000, 22000 ] 4 0.000% 100.146% ( 22000, 33000 ] 2 0.000% 100.146% ( 33000, 50000 ] 1 0.000% 100.147% ** Level 5 read latency histogram (micros): Count: 367138 Average: 284.6685 StdDev: 565.48 Min: 75 Median: 153.6504 Max: 47401 Percentiles: P50: 153.65 P75: 222.08 P99: 3219.70 P99.9: 6314.15 P99.99: 9597.12 ------------------------------------------------------ ( 51, 76 ] 2 0.001% 0.001% ( 76, 110 ] 47962 13.064% 13.064% ### ( 110, 170 ] 186397 50.770% 63.835% ########## ( 170, 250 ] 62963 17.150% 80.984% ### ( 250, 380 ] 22420 6.107% 87.091% # ( 380, 580 ] 19803 5.394% 92.485% # ( 580, 870 ] 10405 2.834% 95.319% # ( 870, 1300 ] 6339 1.727% 97.046% ( 1300, 1900 ] 3683 1.003% 98.049% ( 1900, 2900 ] 2879 0.784% 98.833% ( 2900, 4400 ] 2879 0.784% 99.617% ( 4400, 6600 ] 1194 0.325% 99.942% ( 6600, 9900 ] 193 0.053% 99.995% ( 9900, 14000 ] 9 0.002% 99.997% ( 14000, 22000 ] 7 0.002% 99.999% ( 22000, 33000 ] 11 0.003% 100.002% ( 33000, 50000 ] 3 0.001% 100.003% ** DB Stats ** Uptime(secs): 41.2 total, 9.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 143.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.313 H:M:S, 44.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 109.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.275 H:M:S, 58.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 289.333 micros/op 13809 ops/sec 60.174 seconds 830996 operations; 13.4 MB/s (207999 of 207999 found) Microseconds per read: Count: 830996 Average: 289.3354 StdDev: 837.49 Min: 3 Median: 200.8737 Max: 83120 Percentiles: P50: 200.87 P75: 249.19 P99: 1755.72 P99.9: 14520.38 P99.99: 31277.58 ------------------------------------------------------ ( 2, 3 ] 3 0.000% 0.000% ( 3, 4 ] 10 0.001% 0.002% ( 4, 6 ] 45 0.005% 0.007% ( 6, 10 ] 248 0.030% 0.037% ( 10, 15 ] 172 0.021% 0.058% ( 15, 22 ] 533 0.064% 0.122% ( 22, 34 ] 10607 1.276% 1.398% ( 34, 51 ] 5100 0.614% 2.012% ( 51, 76 ] 775 0.093% 2.105% ( 76, 110 ] 493 0.059% 2.164% ( 110, 170 ] 264768 31.862% 34.026% ###### ( 170, 250 ] 343966 41.392% 75.418% ######## ( 250, 380 ] 114383 13.765% 89.182% ### ( 380, 580 ] 50012 6.018% 95.201% # ( 580, 870 ] 19999 2.407% 97.607% ( 870, 1300 ] 8619 1.037% 98.645% ( 1300, 1900 ] 3888 0.468% 99.113% ( 1900, 2900 ] 2683 0.323% 99.435% ( 2900, 4400 ] 2337 0.281% 99.717% ( 4400, 6600 ] 883 0.106% 99.823% ( 6600, 9900 ] 238 0.029% 99.852% ( 9900, 14000 ] 363 0.044% 99.895% ( 14000, 22000 ] 615 0.074% 99.969% ( 22000, 33000 ] 205 0.025% 99.994% ( 33000, 50000 ] 35 0.004% 99.998% ( 50000, 75000 ] 15 0.002% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 15685529 rocksdb.bloom.filter.full.positive COUNT : 983140 rocksdb.bloom.filter.full.true.positive COUNT : 830544 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 452 rocksdb.memtable.miss COUNT : 830544 rocksdb.l0.hit COUNT : 36262 rocksdb.l1.hit COUNT : 4572 rocksdb.l2andup.hit COUNT : 789710 rocksdb.compaction.key.drop.new COUNT : 213773 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6128824 rocksdb.number.keys.read COUNT : 830996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6324946368 rocksdb.bytes.read COUNT : 830996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1673 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36246512 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 25208479312 rocksdb.compact.write.bytes COUNT : 24984472103 rocksdb.flush.write.bytes COUNT : 6275516262 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 31 rocksdb.number.superversion_acquires COUNT : 1235 rocksdb.number.superversion_releases COUNT : 1179 rocksdb.number.superversion_cleanups COUNT : 304 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 222 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6224836608 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2348032 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28763112904 rocksdb.non.last.level.read.count COUNT : 6805391 rocksdb.block.checksum.compute.count COUNT : 7098766 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 199.571518 P95 : 572.502322 P99 : 1754.369112 P100 : 83119.000000 COUNT : 830996 SUM : 239339880 rocksdb.db.write.micros P50 : 1.564297 P95 : 4.719612 P99 : 9.690165 P100 : 899800.000000 COUNT : 6128824 SUM : 52074672 rocksdb.compaction.times.micros P50 : 1325000.000000 P95 : 4140000.000000 P99 : 6632000.000000 P100 : 8244919.000000 COUNT : 96 SUM : 162795770 rocksdb.compaction.times.cpu_micros P50 : 892903.225806 P95 : 2100000.000000 P99 : 5314752.000000 P100 : 5314752.000000 COUNT : 96 SUM : 101508757 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 806.341463 P95 : 71250.000000 P99 : 406600.000000 P100 : 498314.000000 COUNT : 86 SUM : 1470678 rocksdb.compaction.outfile.sync.micros P50 : 20105.263158 P95 : 227750.000000 P99 : 390450.000000 P100 : 671740.000000 COUNT : 289 SUM : 16151256 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 264.444444 P95 : 4510.000000 P99 : 6358.000000 P100 : 47418.000000 COUNT : 210 SUM : 249038 rocksdb.table.open.io.micros P50 : 9589.070352 P95 : 20342.307692 P99 : 23664.666667 P100 : 56215.000000 COUNT : 1673 SUM : 15996252 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.916640 P95 : 11.885104 P99 : 200.250585 P100 : 47468.000000 COUNT : 6103889 SUM : 100653578 rocksdb.read.block.get.micros P50 : 145.540206 P95 : 465.415323 P99 : 1651.322518 P100 : 47414.000000 COUNT : 993173 SUM : 199230149 rocksdb.write.raw.block.micros P50 : 0.537027 P95 : 1.400490 P99 : 4.121434 P100 : 51140.000000 COUNT : 7571115 SUM : 22944769 rocksdb.numfiles.in.singlecompaction P50 : 2.774194 P95 : 4.933333 P99 : 13.800000 P100 : 16.000000 COUNT : 124 SUM : 413 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.571033 P95 : 1242.292207 P99 : 2643.028329 P100 : 899594.000000 COUNT : 171527 SUM : 36267173 rocksdb.sst.read.micros P50 : 1.982627 P95 : 165.189514 P99 : 499.294232 P100 : 47464.000000 COUNT : 6805397 SUM : 278390730 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 830996 SUM : 830996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6128824 SUM : 6324946368 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 227333.333333 P95 : 956333.333333 P99 : 1148911.000000 P100 : 1148911.000000 COUNT : 86 SUM : 27851782 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 312 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0