[2024-11-17 09:14:12.446657] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 24.03.0 initialization... [2024-11-17 09:14:12.446799] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1713769 ] Set seed to 1731831252443161 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 09:14:12.565062] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 09:14:12.668384] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 09:14:12.668427] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1713769' to capture a snapshot of events at runtime. [2024-11-17 09:14:12.668437] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 09:14:12.668447] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 09:14:12.668455] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1713769 for offline analysis/debug. [2024-11-17 09:14:12.669843] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 09:14:20 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-09:14:28 ... thread 0: (1000000,1000000) ops and (132820.6,132820.6) ops/second in (7.528951,7.528951) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 854.14 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 117.6 6.96 2.29 9 0.774 0 0 0.0 0.0 L2 3/1 342.90 MB 2.1 0.4 0.3 0.1 0.4 0.3 0.0 1.2 104.9 104.2 3.84 1.89 1 3.845 409K 2630 0.0 0.0 L3 56/9 4.06 GB 3.4 3.9 2.7 1.2 3.8 2.6 0.0 1.4 99.7 98.7 39.79 19.02 16 2.487 2347K 6556 0.0 0.0 L4 180/9 11.12 GB 1.1 2.2 1.7 0.5 2.1 1.7 0.0 1.3 105.6 104.6 21.03 10.30 15 1.402 1325K 0 0.0 0.0 L5 1100/0 90.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1349/28 106.84 GB 0.0 6.4 4.7 1.7 7.2 5.4 0.0 9.0 92.0 102.5 71.63 33.50 41 1.747 4083K 9186 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 4.7 1.7 7.2 5.4 0.0 9.0 92.0 102.5 71.63 33.50 41 1.747 4083K 9186 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 4.7 1.7 6.4 4.6 0.0 0.0 102.0 100.9 64.67 31.21 32 2.021 4083K 9186 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 117.6 6.96 2.29 9 0.774 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.7 total, 7.5 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.17 GB write, 953.22 MB/s write, 6.44 GB read, 855.54 MB/s read, 71.6 seconds Interval compaction: 7.17 GB write, 975.35 MB/s write, 6.44 GB read, 875.41 MB/s read, 71.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 33, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 124820 Average: 15.1361 StdDev: 192.45 Min: 1 Median: 1.9337 Max: 19689 Percentiles: P50: 1.93 P75: 2.88 P99: 10.94 P99.9: 2983.55 P99.99: 5819.46 ------------------------------------------------------ [ 0, 1 ] 2863 2.294% 2.294% ( 1, 2 ] 63777 51.095% 53.389% ########## ( 2, 3 ] 30737 24.625% 78.014% ##### ( 3, 4 ] 11879 9.517% 87.531% ## ( 4, 6 ] 11638 9.324% 96.855% ## ( 6, 10 ] 2594 2.078% 98.933% ( 10, 15 ] 448 0.359% 99.292% ( 15, 22 ] 45 0.036% 99.328% ( 22, 34 ] 1 0.001% 99.329% ( 34, 51 ] 3 0.002% 99.331% ( 51, 76 ] 1 0.001% 99.332% ( 76, 110 ] 1 0.001% 99.333% ( 110, 170 ] 1 0.001% 99.333% ( 170, 250 ] 7 0.006% 99.339% ( 250, 380 ] 16 0.013% 99.352% ( 380, 580 ] 57 0.046% 99.398% ( 580, 870 ] 100 0.080% 99.478% ( 870, 1300 ] 182 0.146% 99.623% ( 1300, 1900 ] 182 0.146% 99.769% ( 1900, 2900 ] 158 0.127% 99.896% ( 2900, 4400 ] 93 0.075% 99.970% ( 4400, 6600 ] 38 0.030% 100.001% ( 14000, 22000 ] 3 0.002% 100.003% ** Level 1 read latency histogram (micros): Count: 86746 Average: 20.6800 StdDev: 231.19 Min: 1 Median: 1.9907 Max: 10685 Percentiles: P50: 1.99 P75: 2.94 P99: 14.67 P99.9: 3829.40 P99.99: 7085.98 ------------------------------------------------------ [ 0, 1 ] 1957 2.256% 2.256% ( 1, 2 ] 41805 48.192% 50.448% ########## ( 2, 3 ] 22669 26.133% 76.581% ##### ( 3, 4 ] 8164 9.411% 85.992% ## ( 4, 6 ] 8485 9.781% 95.774% ## ( 6, 10 ] 2257 2.602% 98.376% # ( 10, 15 ] 580 0.669% 99.044% ( 15, 22 ] 91 0.105% 99.149% ( 22, 34 ] 6 0.007% 99.156% ( 34, 51 ] 3 0.003% 99.160% ( 51, 76 ] 3 0.003% 99.163% ( 76, 110 ] 2 0.002% 99.165% ( 110, 170 ] 4 0.005% 99.170% ( 170, 250 ] 2 0.002% 99.172% ( 250, 380 ] 22 0.025% 99.198% ( 380, 580 ] 28 0.032% 99.230% ( 580, 870 ] 42 0.048% 99.278% ( 870, 1300 ] 126 0.145% 99.424% ( 1300, 1900 ] 159 0.183% 99.607% ( 1900, 2900 ] 183 0.211% 99.818% ( 2900, 4400 ] 115 0.133% 99.950% ( 4400, 6600 ] 33 0.038% 99.988% ( 6600, 9900 ] 9 0.010% 99.999% ( 9900, 14000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 601994 Average: 19.1850 StdDev: 229.29 Min: 1 Median: 2.0123 Max: 26868 Percentiles: P50: 2.01 P75: 2.95 P99: 12.89 P99.9: 2499.18 P99.99: 3017.52 ------------------------------------------------------ [ 0, 1 ] 11431 1.899% 1.899% ( 1, 2 ] 287608 47.776% 49.675% ########## ( 2, 3 ] 159730 26.533% 76.208% ##### ( 3, 4 ] 59432 9.873% 86.081% ## ( 4, 6 ] 59535 9.890% 95.970% ## ( 6, 10 ] 15945 2.649% 98.619% # ( 10, 15 ] 3962 0.658% 99.277% ( 15, 22 ] 622 0.103% 99.381% ( 22, 34 ] 58 0.010% 99.390% ( 34, 51 ] 18 0.003% 99.393% ( 51, 76 ] 18 0.003% 99.396% ( 76, 110 ] 11 0.002% 99.398% ( 110, 170 ] 12 0.002% 99.400% ( 170, 250 ] 23 0.004% 99.404% ( 250, 380 ] 88 0.015% 99.418% ( 380, 580 ] 194 0.032% 99.451% ( 580, 870 ] 394 0.065% 99.516% ( 870, 1300 ] 661 0.110% 99.626% ( 1300, 1900 ] 925 0.154% 99.780% ( 1900, 2900 ] 1210 0.201% 99.981% ( 2900, 4400 ] 725 0.120% 100.101% ( 4400, 6600 ] 226 0.038% 100.139% ( 6600, 9900 ] 54 0.009% 100.148% ( 9900, 14000 ] 10 0.002% 100.149% ( 14000, 22000 ] 3 0.000% 100.150% ( 22000, 33000 ] 2 0.000% 100.150% ** Level 3 read latency histogram (micros): Count: 731627 Average: 13.7093 StdDev: 185.27 Min: 0 Median: 2.0363 Max: 27147 Percentiles: P50: 2.04 P75: 2.93 P99: 9.71 P99.9: 1476.77 P99.99: 2047.01 ------------------------------------------------------ [ 0, 1 ] 9130 1.248% 1.248% ( 1, 2 ] 349270 47.739% 48.987% ########## ( 2, 3 ] 204427 27.941% 76.928% ###### ( 3, 4 ] 73906 10.102% 87.030% ## ( 4, 6 ] 72652 9.930% 96.960% ## ( 6, 10 ] 16084 2.198% 99.158% ( 10, 15 ] 3472 0.475% 99.633% ( 15, 22 ] 480 0.066% 99.698% ( 22, 34 ] 24 0.003% 99.702% ( 34, 51 ] 14 0.002% 99.704% ( 51, 76 ] 22 0.003% 99.707% ( 76, 110 ] 11 0.002% 99.708% ( 110, 170 ] 15 0.002% 99.710% ( 170, 250 ] 42 0.006% 99.716% ( 250, 380 ] 58 0.008% 99.724% ( 380, 580 ] 142 0.019% 99.743% ( 580, 870 ] 349 0.048% 99.791% ( 870, 1300 ] 579 0.079% 99.870% ( 1300, 1900 ] 748 0.102% 99.972% ( 1900, 2900 ] 890 0.122% 100.094% ( 2900, 4400 ] 590 0.081% 100.175% ( 4400, 6600 ] 208 0.028% 100.203% ( 6600, 9900 ] 51 0.007% 100.210% ( 9900, 14000 ] 4 0.001% 100.211% ( 14000, 22000 ] 1 0.000% 100.211% ( 22000, 33000 ] 1 0.000% 100.211% ** Level 4 read latency histogram (micros): Count: 161742 Average: 45.9740 StdDev: 384.95 Min: 1 Median: 2.0865 Max: 31079 Percentiles: P50: 2.09 P75: 3.01 P99: 1672.57 P99.9: 4364.70 P99.99: 5801.98 ------------------------------------------------------ [ 0, 1 ] 2138 1.322% 1.322% ( 1, 2 ] 74916 46.318% 47.640% ######### ( 2, 3 ] 44125 27.281% 74.921% ##### ( 3, 4 ] 16584 10.253% 85.175% ## ( 4, 6 ] 15743 9.733% 94.908% ## ( 6, 10 ] 4121 2.548% 97.456% # ( 10, 15 ] 797 0.493% 97.949% ( 15, 22 ] 92 0.057% 98.005% ( 22, 34 ] 12 0.007% 98.013% ( 34, 51 ] 9 0.006% 98.018% ( 51, 76 ] 8 0.005% 98.023% ( 76, 110 ] 5 0.003% 98.026% ( 110, 170 ] 14 0.009% 98.035% ( 170, 250 ] 38 0.023% 98.059% ( 250, 380 ] 71 0.044% 98.103% ( 380, 580 ] 131 0.081% 98.184% ( 580, 870 ] 310 0.192% 98.375% ( 870, 1300 ] 602 0.372% 98.747% ( 1300, 1900 ] 658 0.407% 99.154% ( 1900, 2900 ] 719 0.445% 99.599% ( 2900, 4400 ] 499 0.309% 99.907% ( 4400, 6600 ] 210 0.130% 100.037% ( 6600, 9900 ] 26 0.016% 100.053% ( 9900, 14000 ] 3 0.002% 100.055% ( 14000, 22000 ] 7 0.004% 100.059% ( 22000, 33000 ] 2 0.001% 100.061% ** Level 5 read latency histogram (micros): Count: 8728 Average: 2429.5567 StdDev: 1820.82 Min: 96 Median: 1924.6691 Max: 34973 Percentiles: P50: 1924.67 P75: 3458.02 P99: 8921.31 P99.9: 13824.42 P99.99: 34973.00 ------------------------------------------------------ ( 76, 110 ] 3 0.034% 0.034% ( 110, 170 ] 11 0.126% 0.160% ( 170, 250 ] 58 0.665% 0.825% ( 250, 380 ] 188 2.154% 2.979% ( 380, 580 ] 392 4.491% 7.470% # ( 580, 870 ] 878 10.060% 17.530% ## ( 870, 1300 ] 1281 14.677% 32.207% ### ( 1300, 1900 ] 1512 17.324% 49.530% ### ( 1900, 2900 ] 1662 19.042% 68.572% #### ( 2900, 4400 ] 1508 17.278% 85.850% ### ( 4400, 6600 ] 1000 11.457% 97.308% ## ( 6600, 9900 ] 210 2.406% 99.714% ( 9900, 14000 ] 17 0.195% 99.908% ( 14000, 22000 ] 7 0.080% 99.989% ( 33000, 50000 ] 1 0.011% 100.000% ** DB Stats ** Uptime(secs): 7.7 total, 7.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 127.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.677 H:M:S, 47.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.677 H:M:S, 48.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/17-09:14:36 ... thread 0: (1000000,2000000) ops and (129599.0,131190.0) ops/second in (7.716111,15.245062) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.48 GB 37.8 0.7 0.0 0.7 2.5 1.8 0.0 1.4 36.4 135.5 19.05 8.22 23 0.828 703K 913 0.0 0.0 L1 1/1 128.76 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.0 1.0 113.8 113.6 3.63 1.86 1 3.630 419K 615 0.0 0.0 L2 2/0 213.99 MB 2.1 0.7 0.4 0.3 0.7 0.4 0.2 1.7 109.3 108.7 6.16 3.14 2 3.080 683K 3523 0.0 0.0 L3 19/4 1.37 GB 1.0 4.7 3.0 1.7 4.7 3.0 0.0 1.5 101.1 100.2 47.81 23.18 20 2.391 3156K 7830 0.0 0.0 L4 178/12 10.15 GB 1.0 8.0 4.5 3.5 7.8 4.4 0.3 1.7 115.1 113.0 71.10 37.94 50 1.422 3781K 5029 0.0 0.0 L5 1148/0 94.43 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1359/26 107.75 GB 0.0 14.5 8.3 6.1 16.1 10.0 4.5 8.7 100.1 111.6 147.76 74.33 96 1.539 8745K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.5 8.3 6.1 16.1 10.0 4.5 8.7 100.1 111.6 147.76 74.33 96 1.539 8745K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.5 8.3 6.1 14.3 8.1 0.0 0.0 111.1 109.7 133.15 68.93 75 1.775 8745K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 129.3 14.61 5.40 21 0.696 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.2 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.10 GB write, 1069.21 MB/s write, 14.45 GB read, 959.50 MB/s read, 147.8 seconds Interval compaction: 16.10 GB write, 1081.48 MB/s write, 14.45 GB read, 970.51 MB/s read, 147.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 62, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 440091 Average: 11.9765 StdDev: 162.61 Min: 1 Median: 1.9233 Max: 21593 Percentiles: P50: 1.92 P75: 2.85 P99: 9.99 P99.9: 2346.65 P99.99: 4380.12 ------------------------------------------------------ [ 0, 1 ] 11072 2.516% 2.516% # ( 1, 2 ] 226337 51.430% 53.945% ########## ( 2, 3 ] 109039 24.776% 78.722% ##### ( 3, 4 ] 40610 9.228% 87.950% ## ( 4, 6 ] 39602 8.999% 96.948% ## ( 6, 10 ] 9060 2.059% 99.007% ( 10, 15 ] 1494 0.339% 99.346% ( 15, 22 ] 151 0.034% 99.381% ( 22, 34 ] 6 0.001% 99.382% ( 34, 51 ] 25 0.006% 99.388% ( 51, 76 ] 22 0.005% 99.393% ( 76, 110 ] 10 0.002% 99.395% ( 110, 170 ] 21 0.005% 99.400% ( 170, 250 ] 66 0.015% 99.415% ( 250, 380 ] 149 0.034% 99.449% ( 380, 580 ] 339 0.077% 99.526% ( 580, 870 ] 486 0.110% 99.636% ( 870, 1300 ] 600 0.136% 99.772% ( 1300, 1900 ] 424 0.096% 99.869% ( 1900, 2900 ] 311 0.071% 99.939% ( 2900, 4400 ] 227 0.052% 99.991% ( 4400, 6600 ] 82 0.019% 100.010% ( 6600, 9900 ] 6 0.001% 100.011% ( 14000, 22000 ] 7 0.002% 100.012% ** Level 1 read latency histogram (micros): Count: 137444 Average: 19.9007 StdDev: 217.01 Min: 1 Median: 2.0208 Max: 10685 Percentiles: P50: 2.02 P75: 2.96 P99: 18.04 P99.9: 3668.92 P99.99: 6516.57 ------------------------------------------------------ [ 0, 1 ] 2599 1.891% 1.891% ( 1, 2 ] 65362 47.555% 49.446% ########## ( 2, 3 ] 36594 26.625% 76.071% ##### ( 3, 4 ] 13373 9.730% 85.801% ## ( 4, 6 ] 13607 9.900% 95.701% ## ( 6, 10 ] 3642 2.650% 98.351% # ( 10, 15 ] 840 0.611% 98.962% ( 15, 22 ] 121 0.088% 99.050% ( 22, 34 ] 7 0.005% 99.055% ( 34, 51 ] 4 0.003% 99.058% ( 51, 76 ] 6 0.004% 99.062% ( 76, 110 ] 2 0.001% 99.064% ( 110, 170 ] 10 0.007% 99.071% ( 170, 250 ] 10 0.007% 99.078% ( 250, 380 ] 55 0.040% 99.118% ( 380, 580 ] 100 0.073% 99.191% ( 580, 870 ] 152 0.111% 99.302% ( 870, 1300 ] 266 0.194% 99.495% ( 1300, 1900 ] 226 0.164% 99.659% ( 1900, 2900 ] 247 0.180% 99.839% ( 2900, 4400 ] 163 0.119% 99.958% ( 4400, 6600 ] 46 0.033% 99.991% ( 6600, 9900 ] 12 0.009% 100.000% ( 9900, 14000 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 740614 Average: 17.2857 StdDev: 214.88 Min: 1 Median: 2.0233 Max: 26868 Percentiles: P50: 2.02 P75: 2.95 P99: 12.29 P99.9: 2469.38 P99.99: 3121.41 ------------------------------------------------------ [ 0, 1 ] 13115 1.771% 1.771% ( 1, 2 ] 352552 47.603% 49.373% ########## ( 2, 3 ] 199352 26.917% 76.291% ##### ( 3, 4 ] 73221 9.887% 86.177% ## ( 4, 6 ] 73916 9.980% 96.158% ## ( 6, 10 ] 18932 2.556% 98.714% # ( 10, 15 ] 4626 0.625% 99.338% ( 15, 22 ] 717 0.097% 99.435% ( 22, 34 ] 61 0.008% 99.443% ( 34, 51 ] 19 0.003% 99.446% ( 51, 76 ] 21 0.003% 99.449% ( 76, 110 ] 12 0.002% 99.450% ( 110, 170 ] 19 0.003% 99.453% ( 170, 250 ] 27 0.004% 99.457% ( 250, 380 ] 108 0.015% 99.471% ( 380, 580 ] 227 0.031% 99.502% ( 580, 870 ] 484 0.065% 99.567% ( 870, 1300 ] 753 0.102% 99.669% ( 1300, 1900 ] 986 0.133% 99.802% ( 1900, 2900 ] 1274 0.172% 99.974% ( 2900, 4400 ] 799 0.108% 100.082% ( 4400, 6600 ] 247 0.033% 100.115% ( 6600, 9900 ] 56 0.008% 100.123% ( 9900, 14000 ] 10 0.001% 100.124% ( 14000, 22000 ] 4 0.001% 100.125% ( 22000, 33000 ] 2 0.000% 100.125% ** Level 3 read latency histogram (micros): Count: 1580201 Average: 12.0606 StdDev: 167.43 Min: 0 Median: 2.0525 Max: 27147 Percentiles: P50: 2.05 P75: 2.95 P99: 9.79 P99.9: 1204.88 P99.99: 1826.60 ------------------------------------------------------ [ 0, 1 ] 18171 1.150% 1.150% ( 1, 2 ] 748902 47.393% 48.543% ######### ( 2, 3 ] 438479 27.748% 76.291% ###### ( 3, 4 ] 160735 10.172% 86.463% ## ( 4, 6 ] 161932 10.248% 96.710% ## ( 6, 10 ] 38220 2.419% 99.129% ( 10, 15 ] 7664 0.485% 99.614% ( 15, 22 ] 982 0.062% 99.676% ( 22, 34 ] 49 0.003% 99.679% ( 34, 51 ] 52 0.003% 99.683% ( 51, 76 ] 102 0.006% 99.689% ( 76, 110 ] 33 0.002% 99.691% ( 110, 170 ] 38 0.002% 99.694% ( 170, 250 ] 102 0.006% 99.700% ( 250, 380 ] 232 0.015% 99.715% ( 380, 580 ] 636 0.040% 99.755% ( 580, 870 ] 1176 0.074% 99.829% ( 870, 1300 ] 1434 0.091% 99.920% ( 1300, 1900 ] 1259 0.080% 100.000% ( 1900, 2900 ] 1296 0.082% 100.082% ( 2900, 4400 ] 1094 0.069% 100.151% ( 4400, 6600 ] 353 0.022% 100.173% ( 6600, 9900 ] 83 0.005% 100.179% ( 9900, 14000 ] 7 0.000% 100.179% ( 14000, 22000 ] 7 0.000% 100.180% ( 22000, 33000 ] 1 0.000% 100.180% ** Level 4 read latency histogram (micros): Count: 1005935 Average: 20.2900 StdDev: 231.76 Min: 0 Median: 2.0553 Max: 31185 Percentiles: P50: 2.06 P75: 2.98 P99: 15.01 P99.9: 2448.04 P99.99: 3249.71 ------------------------------------------------------ [ 0, 1 ] 11735 1.167% 1.167% ( 1, 2 ] 476125 47.332% 48.498% ######### ( 2, 3 ] 273094 27.148% 75.646% ##### ( 3, 4 ] 101673 10.107% 85.754% ## ( 4, 6 ] 101561 10.096% 95.850% ## ( 6, 10 ] 26680 2.652% 98.502% # ( 10, 15 ] 5008 0.498% 99.000% ( 15, 22 ] 589 0.059% 99.059% ( 22, 34 ] 51 0.005% 99.064% ( 34, 51 ] 55 0.005% 99.069% ( 51, 76 ] 99 0.010% 99.079% ( 76, 110 ] 30 0.003% 99.082% ( 110, 170 ] 129 0.013% 99.095% ( 170, 250 ] 330 0.033% 99.128% ( 250, 380 ] 497 0.049% 99.177% ( 380, 580 ] 1065 0.106% 99.283% ( 580, 870 ] 1716 0.171% 99.453% ( 870, 1300 ] 2130 0.212% 99.665% ( 1300, 1900 ] 1598 0.159% 99.824% ( 1900, 2900 ] 1396 0.139% 99.963% ( 2900, 4400 ] 1177 0.117% 100.080% ( 4400, 6600 ] 447 0.044% 100.124% ( 6600, 9900 ] 64 0.006% 100.131% ( 9900, 14000 ] 6 0.001% 100.131% ( 14000, 22000 ] 10 0.001% 100.132% ( 22000, 33000 ] 5 0.000% 100.133% ** Level 5 read latency histogram (micros): Count: 27019 Average: 1653.6809 StdDev: 1539.74 Min: 88 Median: 1127.4320 Max: 34973 Percentiles: P50: 1127.43 P75: 2223.68 P99: 6996.12 P99.9: 11760.10 P99.99: 21027.49 ------------------------------------------------------ ( 76, 110 ] 29 0.107% 0.107% ( 110, 170 ] 285 1.055% 1.162% ( 170, 250 ] 670 2.480% 3.642% ( 250, 380 ] 1583 5.859% 9.501% # ( 380, 580 ] 3128 11.577% 21.078% ## ( 580, 870 ] 4778 17.684% 38.762% #### ( 870, 1300 ] 5072 18.772% 57.534% #### ( 1300, 1900 ] 3711 13.735% 71.268% ### ( 1900, 2900 ] 3115 11.529% 82.797% ## ( 2900, 4400 ] 2897 10.722% 93.519% ## ( 4400, 6600 ] 1449 5.363% 98.882% # ( 6600, 9900 ] 265 0.981% 99.863% ( 9900, 14000 ] 22 0.081% 99.944% ( 14000, 22000 ] 14 0.052% 99.996% ( 22000, 33000 ] 1 0.004% 100.000% ( 33000, 50000 ] 1 0.004% 100.004% ** DB Stats ** Uptime(secs): 15.4 total, 7.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 127.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.500 H:M:S, 48.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.823 H:M:S, 49.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/17-09:14:39 ... thread 0: (1000000,3000000) ops and (268618.8,158162.7) ops/second in (3.722747,18.967809) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.60 GB 25.2 1.5 0.0 1.5 4.2 2.7 0.0 1.6 60.3 166.3 26.12 14.20 40 0.653 1599K 1904 0.0 0.0 L1 4/4 407.46 MB 0.0 1.3 1.1 0.1 1.3 1.1 0.0 1.1 131.2 130.8 9.89 5.96 2 4.943 1317K 3583 0.0 0.0 L2 2/0 87.20 MB 0.9 0.7 0.4 0.3 0.7 0.4 0.7 1.7 109.3 108.7 6.16 3.14 2 3.080 683K 3523 0.0 0.0 L3 18/3 1.23 GB 1.0 5.6 3.4 2.3 5.6 3.3 0.3 1.7 109.4 108.5 52.61 27.42 23 2.287 3700K 9244 0.0 0.0 L4 176/11 9.86 GB 1.0 9.2 5.1 4.2 9.1 4.9 0.5 1.8 121.0 118.7 78.23 43.77 55 1.422 4100K 5029 0.0 0.0 L5 1160/0 95.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1371/28 108.58 GB 0.0 18.3 10.0 8.4 20.8 12.4 6.4 7.7 108.5 123.1 173.00 94.49 122 1.418 11M 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.3 10.0 8.4 20.8 12.4 6.4 7.7 108.5 123.1 173.00 94.49 122 1.418 11M 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.3 10.0 8.4 18.1 9.7 0.0 0.0 121.1 119.6 154.98 86.60 87 1.781 11M 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 153.8 18.02 7.89 35 0.515 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.1 total, 19.0 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.80 GB write, 1112.69 MB/s write, 18.33 GB read, 980.18 MB/s read, 173.0 seconds Interval compaction: 20.80 GB write, 1122.95 MB/s write, 18.33 GB read, 989.21 MB/s read, 173.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 62, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 828940 Average: 8.6627 StdDev: 129.89 Min: 1 Median: 1.8483 Max: 28992 Percentiles: P50: 1.85 P75: 2.71 P99: 9.35 P99.9: 1350.19 P99.99: 2804.14 ------------------------------------------------------ [ 0, 1 ] 28078 3.387% 3.387% # ( 1, 2 ] 455496 54.949% 58.336% ########### ( 2, 3 ] 195088 23.535% 81.871% ##### ( 3, 4 ] 67825 8.182% 90.053% ## ( 4, 6 ] 62922 7.591% 97.644% ## ( 6, 10 ] 13408 1.617% 99.261% ( 10, 15 ] 2046 0.247% 99.508% ( 15, 22 ] 209 0.025% 99.533% ( 22, 34 ] 9 0.001% 99.534% ( 34, 51 ] 50 0.006% 99.540% ( 51, 76 ] 34 0.004% 99.545% ( 76, 110 ] 32 0.004% 99.548% ( 110, 170 ] 144 0.017% 99.566% ( 170, 250 ] 277 0.033% 99.599% ( 250, 380 ] 385 0.046% 99.646% ( 380, 580 ] 615 0.074% 99.720% ( 580, 870 ] 733 0.088% 99.808% ( 870, 1300 ] 724 0.087% 99.896% ( 1300, 1900 ] 455 0.055% 99.951% ( 1900, 2900 ] 364 0.044% 99.994% ( 2900, 4400 ] 246 0.030% 100.024% ( 4400, 6600 ] 85 0.010% 100.034% ( 6600, 9900 ] 9 0.001% 100.035% ( 9900, 14000 ] 2 0.000% 100.036% ( 14000, 22000 ] 7 0.001% 100.037% ( 22000, 33000 ] 1 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 224953 Average: 14.8532 StdDev: 179.60 Min: 1 Median: 1.9470 Max: 10739 Percentiles: P50: 1.95 P75: 2.84 P99: 14.10 P99.9: 2900.42 P99.99: 5981.47 ------------------------------------------------------ [ 0, 1 ] 4020 1.787% 1.787% ( 1, 2 ] 114525 50.911% 52.698% ########## ( 2, 3 ] 59566 26.479% 79.177% ##### ( 3, 4 ] 19397 8.623% 87.800% ## ( 4, 6 ] 18786 8.351% 96.151% ## ( 6, 10 ] 5534 2.460% 98.611% ( 10, 15 ] 1067 0.474% 99.085% ( 15, 22 ] 170 0.076% 99.161% ( 22, 34 ] 10 0.004% 99.165% ( 34, 51 ] 7 0.003% 99.168% ( 51, 76 ] 12 0.005% 99.174% ( 76, 110 ] 8 0.004% 99.177% ( 110, 170 ] 50 0.022% 99.199% ( 170, 250 ] 108 0.048% 99.247% ( 250, 380 ] 177 0.079% 99.326% ( 380, 580 ] 219 0.097% 99.423% ( 580, 870 ] 258 0.115% 99.538% ( 870, 1300 ] 317 0.141% 99.679% ( 1300, 1900 ] 242 0.108% 99.787% ( 1900, 2900 ] 255 0.113% 99.900% ( 2900, 4400 ] 168 0.075% 99.975% ( 4400, 6600 ] 48 0.021% 99.996% ( 6600, 9900 ] 15 0.007% 100.003% ( 9900, 14000 ] 3 0.001% 100.004% ** Level 2 read latency histogram (micros): Count: 746025 Average: 17.2034 StdDev: 214.13 Min: 1 Median: 2.0198 Max: 26868 Percentiles: P50: 2.02 P75: 2.95 P99: 12.31 P99.9: 2465.47 P99.99: 3120.40 ------------------------------------------------------ [ 0, 1 ] 13205 1.770% 1.770% ( 1, 2 ] 355834 47.697% 49.467% ########## ( 2, 3 ] 200748 26.909% 76.376% ##### ( 3, 4 ] 73490 9.851% 86.227% ## ( 4, 6 ] 74114 9.935% 96.162% ## ( 6, 10 ] 19027 2.550% 98.712% # ( 10, 15 ] 4641 0.622% 99.334% ( 15, 22 ] 718 0.096% 99.431% ( 22, 34 ] 61 0.008% 99.439% ( 34, 51 ] 19 0.003% 99.441% ( 51, 76 ] 21 0.003% 99.444% ( 76, 110 ] 12 0.002% 99.446% ( 110, 170 ] 42 0.006% 99.451% ( 170, 250 ] 47 0.006% 99.458% ( 250, 380 ] 118 0.016% 99.473% ( 380, 580 ] 238 0.032% 99.505% ( 580, 870 ] 484 0.065% 99.570% ( 870, 1300 ] 753 0.101% 99.671% ( 1300, 1900 ] 986 0.132% 99.803% ( 1900, 2900 ] 1275 0.171% 99.974% ( 2900, 4400 ] 799 0.107% 100.081% ( 4400, 6600 ] 247 0.033% 100.114% ( 6600, 9900 ] 56 0.008% 100.122% ( 9900, 14000 ] 10 0.001% 100.123% ( 14000, 22000 ] 4 0.001% 100.124% ( 22000, 33000 ] 2 0.000% 100.124% ** Level 3 read latency histogram (micros): Count: 1814223 Average: 11.1821 StdDev: 157.95 Min: 0 Median: 2.0162 Max: 27147 Percentiles: P50: 2.02 P75: 2.92 P99: 9.73 P99.9: 1139.57 P99.99: 1796.06 ------------------------------------------------------ [ 0, 1 ] 21290 1.174% 1.174% ( 1, 2 ] 877711 48.379% 49.553% ########## ( 2, 3 ] 499884 27.554% 77.107% ###### ( 3, 4 ] 179340 9.885% 86.992% ## ( 4, 6 ] 178037 9.813% 96.805% ## ( 6, 10 ] 42647 2.351% 99.156% ( 10, 15 ] 8198 0.452% 99.608% ( 15, 22 ] 1049 0.058% 99.666% ( 22, 34 ] 57 0.003% 99.669% ( 34, 51 ] 73 0.004% 99.673% ( 51, 76 ] 119 0.007% 99.679% ( 76, 110 ] 42 0.002% 99.682% ( 110, 170 ] 180 0.010% 99.692% ( 170, 250 ] 292 0.016% 99.708% ( 250, 380 ] 408 0.022% 99.730% ( 380, 580 ] 796 0.044% 99.774% ( 580, 870 ] 1326 0.073% 99.847% ( 870, 1300 ] 1531 0.084% 99.931% ( 1300, 1900 ] 1284 0.071% 100.002% ( 1900, 2900 ] 1312 0.072% 100.075% ( 2900, 4400 ] 1112 0.061% 100.136% ( 4400, 6600 ] 355 0.020% 100.155% ( 6600, 9900 ] 86 0.005% 100.160% ( 9900, 14000 ] 8 0.000% 100.161% ( 14000, 22000 ] 7 0.000% 100.161% ( 22000, 33000 ] 1 0.000% 100.161% ** Level 4 read latency histogram (micros): Count: 1156355 Average: 20.1352 StdDev: 223.74 Min: 0 Median: 2.0394 Max: 31185 Percentiles: P50: 2.04 P75: 2.97 P99: 249.21 P99.9: 2344.06 P99.99: 3145.19 ------------------------------------------------------ [ 0, 1 ] 13485 1.166% 1.166% ( 1, 2 ] 552409 47.772% 48.938% ########## ( 2, 3 ] 312122 26.992% 75.930% ##### ( 3, 4 ] 115051 9.949% 85.879% ## ( 4, 6 ] 113430 9.809% 95.688% ## ( 6, 10 ] 30105 2.603% 98.292% # ( 10, 15 ] 5444 0.471% 98.763% ( 15, 22 ] 630 0.054% 98.817% ( 22, 34 ] 57 0.005% 98.822% ( 34, 51 ] 79 0.007% 98.829% ( 51, 76 ] 112 0.010% 98.839% ( 76, 110 ] 89 0.008% 98.846% ( 110, 170 ] 625 0.054% 98.900% ( 170, 250 ] 1166 0.101% 99.001% ( 250, 380 ] 1330 0.115% 99.116% ( 380, 580 ] 1861 0.161% 99.277% ( 580, 870 ] 2367 0.205% 99.482% ( 870, 1300 ] 2438 0.211% 99.693% ( 1300, 1900 ] 1730 0.150% 99.842% ( 1900, 2900 ] 1508 0.130% 99.973% ( 2900, 4400 ] 1238 0.107% 100.080% ( 4400, 6600 ] 454 0.039% 100.119% ( 6600, 9900 ] 69 0.006% 100.125% ( 9900, 14000 ] 7 0.001% 100.125% ( 14000, 22000 ] 10 0.001% 100.126% ( 22000, 33000 ] 6 0.001% 100.127% ** Level 5 read latency histogram (micros): Count: 47480 Average: 1167.5969 StdDev: 1353.47 Min: 85 Median: 699.9322 Max: 34973 Percentiles: P50: 699.93 P75: 1415.16 P99: 6360.97 P99.9: 9833.51 P99.99: 21001.14 ------------------------------------------------------ ( 76, 110 ] 303 0.638% 0.638% ( 110, 170 ] 2950 6.213% 6.851% # ( 170, 250 ] 4929 10.381% 17.233% ## ( 250, 380 ] 5440 11.457% 28.690% ## ( 380, 580 ] 6946 14.629% 43.319% ### ( 580, 870 ] 7670 16.154% 59.473% ### ( 870, 1300 ] 6568 13.833% 73.307% ### ( 1300, 1900 ] 4189 8.823% 82.129% ## ( 1900, 2900 ] 3586 7.553% 89.682% ## ( 2900, 4400 ] 3105 6.540% 96.222% # ( 4400, 6600 ] 1480 3.117% 99.339% # ( 6600, 9900 ] 272 0.573% 99.912% ( 9900, 14000 ] 25 0.053% 99.964% ( 14000, 22000 ] 14 0.029% 99.994% ( 22000, 33000 ] 3 0.006% 100.000% ( 33000, 50000 ] 1 0.002% 100.002% ** DB Stats ** Uptime(secs): 19.1 total, 3.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 154.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.500 H:M:S, 39.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 264.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/17-09:14:43 ... thread 0: (1000000,4000000) ops and (284114.7,177876.5) ops/second in (3.519705,22.487514) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 2.64 GB 132.2 2.5 0.0 2.5 6.3 3.7 0.0 1.7 76.7 190.7 33.69 21.01 61 0.552 2622K 2871 0.0 0.0 L1 4/4 407.46 MB 0.0 1.3 1.1 0.1 1.3 1.1 0.0 1.1 131.2 130.8 9.89 5.96 2 4.943 1317K 3583 0.0 0.0 L2 2/0 87.20 MB 0.9 0.7 0.4 0.3 0.7 0.4 0.7 1.7 109.3 108.7 6.16 3.14 2 3.080 683K 3523 0.0 0.0 L3 15/0 989.29 MB 1.0 5.6 3.4 2.3 5.6 3.3 0.3 1.7 109.4 108.5 52.61 27.42 23 2.287 3700K 9244 0.0 0.0 L4 170/0 9.61 GB 1.0 10.1 5.3 4.8 9.9 5.1 0.5 1.9 124.3 121.8 82.96 47.54 58 1.430 4671K 5029 0.0 0.0 L5 1168/0 95.90 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1375/14 109.60 GB 0.0 20.1 10.2 9.9 23.6 13.7 6.9 6.3 111.3 130.6 185.30 105.07 146 1.269 12M 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.1 10.2 9.9 23.6 13.7 6.9 6.3 111.3 130.6 185.30 105.07 146 1.269 12M 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.1 10.2 9.9 19.9 10.0 0.0 0.0 126.0 124.4 163.65 94.20 94 1.741 12M 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 177.5 21.65 10.87 52 0.416 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.7 total, 22.5 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.63 GB write, 1067.76 MB/s write, 20.14 GB read, 909.75 MB/s read, 185.3 seconds Interval compaction: 23.63 GB write, 1076.07 MB/s write, 20.14 GB read, 916.82 MB/s read, 185.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 62, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1155723 Average: 8.9376 StdDev: 113.94 Min: 0 Median: 1.7737 Max: 28992 Percentiles: P50: 1.77 P75: 2.58 P99: 131.78 P99.9: 1047.71 P99.99: 2151.10 ------------------------------------------------------ [ 0, 1 ] 72535 6.276% 6.276% # ( 1, 2 ] 653148 56.514% 62.790% ########### ( 2, 3 ] 243693 21.086% 83.876% #### ( 3, 4 ] 81987 7.094% 90.970% # ( 4, 6 ] 72611 6.283% 97.253% # ( 6, 10 ] 15522 1.343% 98.596% ( 10, 15 ] 2463 0.213% 98.809% ( 15, 22 ] 284 0.025% 98.834% ( 22, 34 ] 16 0.001% 98.835% ( 34, 51 ] 51 0.004% 98.839% ( 51, 76 ] 38 0.003% 98.843% ( 76, 110 ] 425 0.037% 98.879% ( 110, 170 ] 3840 0.332% 99.212% ( 170, 250 ] 3322 0.287% 99.499% ( 250, 380 ] 1653 0.143% 99.642% ( 380, 580 ] 1553 0.134% 99.777% ( 580, 870 ] 1095 0.095% 99.871% ( 870, 1300 ] 804 0.070% 99.941% ( 1300, 1900 ] 471 0.041% 99.982% ( 1900, 2900 ] 388 0.034% 100.015% ( 2900, 4400 ] 252 0.022% 100.037% ( 4400, 6600 ] 85 0.007% 100.044% ( 6600, 9900 ] 9 0.001% 100.045% ( 9900, 14000 ] 2 0.000% 100.045% ( 14000, 22000 ] 7 0.001% 100.046% ( 22000, 33000 ] 1 0.000% 100.046% ** Level 1 read latency histogram (micros): Count: 260571 Average: 14.0768 StdDev: 169.32 Min: 1 Median: 1.9468 Max: 10739 Percentiles: P50: 1.95 P75: 2.85 P99: 110.05 P99.9: 2766.52 P99.99: 5864.05 ------------------------------------------------------ [ 0, 1 ] 5070 1.946% 1.946% ( 1, 2 ] 132251 50.754% 52.700% ########## ( 2, 3 ] 68238 26.188% 78.888% ##### ( 3, 4 ] 22479 8.627% 87.515% ## ( 4, 6 ] 21858 8.389% 95.903% ## ( 6, 10 ] 6506 2.497% 98.400% ( 10, 15 ] 1246 0.478% 98.878% ( 15, 22 ] 240 0.092% 98.970% ( 22, 34 ] 19 0.007% 98.978% ( 34, 51 ] 8 0.003% 98.981% ( 51, 76 ] 13 0.005% 98.986% ( 76, 110 ] 37 0.014% 99.000% ( 110, 170 ] 328 0.126% 99.126% ( 170, 250 ] 323 0.124% 99.250% ( 250, 380 ] 294 0.113% 99.363% ( 380, 580 ] 303 0.116% 99.479% ( 580, 870 ] 302 0.116% 99.595% ( 870, 1300 ] 328 0.126% 99.721% ( 1300, 1900 ] 243 0.093% 99.814% ( 1900, 2900 ] 259 0.099% 99.913% ( 2900, 4400 ] 168 0.064% 99.978% ( 4400, 6600 ] 48 0.018% 99.996% ( 6600, 9900 ] 15 0.006% 100.002% ( 9900, 14000 ] 4 0.002% 100.003% ** Level 2 read latency histogram (micros): Count: 746025 Average: 17.2034 StdDev: 214.13 Min: 1 Median: 2.0198 Max: 26868 Percentiles: P50: 2.02 P75: 2.95 P99: 12.31 P99.9: 2465.47 P99.99: 3120.40 ------------------------------------------------------ [ 0, 1 ] 13205 1.770% 1.770% ( 1, 2 ] 355834 47.697% 49.467% ########## ( 2, 3 ] 200748 26.909% 76.376% ##### ( 3, 4 ] 73490 9.851% 86.227% ## ( 4, 6 ] 74114 9.935% 96.162% ## ( 6, 10 ] 19027 2.550% 98.712% # ( 10, 15 ] 4641 0.622% 99.334% ( 15, 22 ] 718 0.096% 99.431% ( 22, 34 ] 61 0.008% 99.439% ( 34, 51 ] 19 0.003% 99.441% ( 51, 76 ] 21 0.003% 99.444% ( 76, 110 ] 12 0.002% 99.446% ( 110, 170 ] 42 0.006% 99.451% ( 170, 250 ] 47 0.006% 99.458% ( 250, 380 ] 118 0.016% 99.473% ( 380, 580 ] 238 0.032% 99.505% ( 580, 870 ] 484 0.065% 99.570% ( 870, 1300 ] 753 0.101% 99.671% ( 1300, 1900 ] 986 0.132% 99.803% ( 1900, 2900 ] 1275 0.171% 99.974% ( 2900, 4400 ] 799 0.107% 100.081% ( 4400, 6600 ] 247 0.033% 100.114% ( 6600, 9900 ] 56 0.008% 100.122% ( 9900, 14000 ] 10 0.001% 100.123% ( 14000, 22000 ] 4 0.001% 100.124% ( 22000, 33000 ] 2 0.000% 100.124% ** Level 3 read latency histogram (micros): Count: 1851063 Average: 11.0870 StdDev: 156.45 Min: 0 Median: 2.0087 Max: 27147 Percentiles: P50: 2.01 P75: 2.92 P99: 9.76 P99.9: 1129.27 P99.99: 1793.49 ------------------------------------------------------ [ 0, 1 ] 22339 1.207% 1.207% ( 1, 2 ] 898786 48.555% 49.762% ########## ( 2, 3 ] 508759 27.485% 77.247% ##### ( 3, 4 ] 182076 9.836% 87.083% ## ( 4, 6 ] 180204 9.735% 96.818% ## ( 6, 10 ] 42939 2.320% 99.138% ( 10, 15 ] 8241 0.445% 99.583% ( 15, 22 ] 1060 0.057% 99.640% ( 22, 34 ] 58 0.003% 99.643% ( 34, 51 ] 74 0.004% 99.647% ( 51, 76 ] 119 0.006% 99.654% ( 76, 110 ] 59 0.003% 99.657% ( 110, 170 ] 415 0.022% 99.679% ( 170, 250 ] 473 0.026% 99.705% ( 250, 380 ] 482 0.026% 99.731% ( 380, 580 ] 857 0.046% 99.777% ( 580, 870 ] 1346 0.073% 99.850% ( 870, 1300 ] 1534 0.083% 99.933% ( 1300, 1900 ] 1285 0.069% 100.002% ( 1900, 2900 ] 1312 0.071% 100.073% ( 2900, 4400 ] 1112 0.060% 100.133% ( 4400, 6600 ] 355 0.019% 100.152% ( 6600, 9900 ] 86 0.005% 100.157% ( 9900, 14000 ] 8 0.000% 100.158% ( 14000, 22000 ] 7 0.000% 100.158% ( 22000, 33000 ] 1 0.000% 100.158% ** Level 4 read latency histogram (micros): Count: 1247195 Average: 20.1824 StdDev: 217.17 Min: 0 Median: 2.0189 Max: 31185 Percentiles: P50: 2.02 P75: 2.96 P99: 310.57 P99.9: 2268.57 P99.99: 3091.16 ------------------------------------------------------ [ 0, 1 ] 15269 1.224% 1.224% ( 1, 2 ] 602046 48.272% 49.496% ########## ( 2, 3 ] 332935 26.695% 76.191% ##### ( 3, 4 ] 121194 9.717% 85.908% ## ( 4, 6 ] 118071 9.467% 95.375% ## ( 6, 10 ] 31843 2.553% 97.928% # ( 10, 15 ] 5591 0.448% 98.377% ( 15, 22 ] 647 0.052% 98.429% ( 22, 34 ] 59 0.005% 98.433% ( 34, 51 ] 80 0.006% 98.440% ( 51, 76 ] 115 0.009% 98.449% ( 76, 110 ] 277 0.022% 98.471% ( 110, 170 ] 2624 0.210% 98.682% ( 170, 250 ] 2960 0.237% 98.919% ( 250, 380 ] 2172 0.174% 99.093% ( 380, 580 ] 2546 0.204% 99.297% ( 580, 870 ] 2664 0.214% 99.511% ( 870, 1300 ] 2553 0.205% 99.715% ( 1300, 1900 ] 1739 0.139% 99.855% ( 1900, 2900 ] 1527 0.122% 99.977% ( 2900, 4400 ] 1242 0.100% 100.077% ( 4400, 6600 ] 454 0.036% 100.113% ( 6600, 9900 ] 70 0.006% 100.119% ( 9900, 14000 ] 8 0.001% 100.120% ( 14000, 22000 ] 10 0.001% 100.120% ( 22000, 33000 ] 6 0.000% 100.121% ** Level 5 read latency histogram (micros): Count: 81053 Average: 795.6895 StdDev: 1138.71 Min: 82 Median: 370.5972 Max: 34973 Percentiles: P50: 370.60 P75: 857.88 P99: 5866.87 P99.9: 9452.11 P99.99: 19082.69 ------------------------------------------------------ ( 76, 110 ] 1464 1.806% 1.806% ( 110, 170 ] 14525 17.920% 19.727% #### ( 170, 250 ] 15271 18.841% 38.567% #### ( 250, 380 ] 9989 12.324% 50.891% ## ( 380, 580 ] 10685 13.183% 64.074% ### ( 580, 870 ] 9242 11.402% 75.477% ## ( 870, 1300 ] 6976 8.607% 84.083% ## ( 1300, 1900 ] 4269 5.267% 89.350% # ( 1900, 2900 ] 3701 4.566% 93.916% # ( 2900, 4400 ] 3133 3.865% 97.782% # ( 4400, 6600 ] 1481 1.827% 99.609% ( 6600, 9900 ] 273 0.337% 99.946% ( 9900, 14000 ] 27 0.033% 99.979% ( 14000, 22000 ] 14 0.017% 99.996% ( 22000, 33000 ] 3 0.004% 100.000% ( 33000, 50000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 22.7 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 173.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.500 H:M:S, 33.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 279.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-09:14:48 ... thread 0: (1000000,5000000) ops and (200440.3,181973.5) ops/second in (4.989017,27.476531) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/6 3.69 GB 264.3 3.8 0.0 3.8 8.5 4.8 0.0 1.8 91.6 208.7 41.93 28.63 83 0.505 3901K 4062 0.0 0.0 L1 4/4 407.46 MB 0.0 1.3 1.1 0.1 1.3 1.1 0.0 1.1 131.2 130.8 9.89 5.96 2 4.943 1317K 3583 0.0 0.0 L2 2/0 87.20 MB 0.9 0.7 0.4 0.3 0.7 0.4 0.7 1.7 109.3 108.7 6.16 3.14 2 3.080 683K 3523 0.0 0.0 L3 15/0 989.29 MB 1.0 5.6 3.4 2.3 5.6 3.3 0.3 1.7 109.4 108.5 52.61 27.42 23 2.287 3700K 9244 0.0 0.0 L4 170/0 9.61 GB 1.0 10.1 5.3 4.8 9.9 5.1 0.5 1.9 124.3 121.8 82.96 47.54 58 1.430 4671K 5029 0.0 0.0 L5 1168/0 95.90 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1377/10 110.64 GB 0.0 21.4 10.2 11.1 25.9 14.8 6.9 5.4 113.0 137.1 193.54 112.69 168 1.152 14M 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.4 10.2 11.1 25.9 14.8 6.9 5.4 113.0 137.1 193.54 112.69 168 1.152 14M 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.4 10.2 11.1 21.1 10.0 0.0 0.0 129.9 128.3 168.47 98.92 99 1.702 14M 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.8 4.8 0.0 0.0 0.0 196.0 25.08 13.77 69 0.363 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.7 total, 27.5 interval Flush(GB): cumulative 4.799, interval 4.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.91 GB write, 959.37 MB/s write, 21.37 GB read, 791.18 MB/s read, 193.5 seconds Interval compaction: 25.91 GB write, 965.48 MB/s write, 21.37 GB read, 796.22 MB/s read, 193.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 62, interval: 69 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1495968 Average: 10.9841 StdDev: 105.47 Min: 0 Median: 1.7041 Max: 28992 Percentiles: P50: 1.70 P75: 2.46 P99: 218.83 P99.9: 854.12 P99.99: 1777.27 ------------------------------------------------------ [ 0, 1 ] 151292 10.113% 10.113% ## ( 1, 2 ] 847397 56.645% 66.759% ########### ( 2, 3 ] 269655 18.025% 84.784% #### ( 3, 4 ] 90780 6.068% 90.852% # ( 4, 6 ] 78027 5.216% 96.068% # ( 6, 10 ] 16522 1.104% 97.173% ( 10, 15 ] 2766 0.185% 97.358% ( 15, 22 ] 346 0.023% 97.381% ( 22, 34 ] 19 0.001% 97.382% ( 34, 51 ] 54 0.004% 97.386% ( 51, 76 ] 40 0.003% 97.388% ( 76, 110 ] 1392 0.093% 97.481% ( 110, 170 ] 15376 1.028% 98.509% ( 170, 250 ] 12029 0.804% 99.313% ( 250, 380 ] 4059 0.271% 99.585% ( 380, 580 ] 3217 0.215% 99.800% ( 580, 870 ] 1588 0.106% 99.906% ( 870, 1300 ] 876 0.059% 99.964% ( 1300, 1900 ] 482 0.032% 99.997% ( 1900, 2900 ] 406 0.027% 100.024% ( 2900, 4400 ] 261 0.017% 100.041% ( 4400, 6600 ] 85 0.006% 100.047% ( 6600, 9900 ] 9 0.001% 100.047% ( 9900, 14000 ] 2 0.000% 100.048% ( 14000, 22000 ] 7 0.000% 100.048% ( 22000, 33000 ] 1 0.000% 100.048% ** Level 1 read latency histogram (micros): Count: 275914 Average: 14.3708 StdDev: 165.17 Min: 1 Median: 1.9923 Max: 10739 Percentiles: P50: 1.99 P75: 2.95 P99: 181.66 P99.9: 2703.42 P99.99: 5747.89 ------------------------------------------------------ [ 0, 1 ] 5099 1.848% 1.848% ( 1, 2 ] 133889 48.526% 50.374% ########## ( 2, 3 ] 71832 26.034% 76.408% ##### ( 3, 4 ] 25272 9.159% 85.567% ## ( 4, 6 ] 26709 9.680% 95.247% ## ( 6, 10 ] 7394 2.680% 97.927% # ( 10, 15 ] 1459 0.529% 98.456% ( 15, 22 ] 386 0.140% 98.596% ( 22, 34 ] 34 0.012% 98.608% ( 34, 51 ] 9 0.003% 98.612% ( 51, 76 ] 13 0.005% 98.616% ( 76, 110 ] 92 0.033% 98.650% ( 110, 170 ] 860 0.312% 98.961% ( 170, 250 ] 733 0.266% 99.227% ( 250, 380 ] 399 0.145% 99.372% ( 380, 580 ] 355 0.129% 99.500% ( 580, 870 ] 322 0.117% 99.617% ( 870, 1300 ] 329 0.119% 99.736% ( 1300, 1900 ] 244 0.088% 99.825% ( 1900, 2900 ] 259 0.094% 99.918% ( 2900, 4400 ] 168 0.061% 99.979% ( 4400, 6600 ] 48 0.017% 99.997% ( 6600, 9900 ] 15 0.005% 100.002% ( 9900, 14000 ] 4 0.001% 100.004% ** Level 2 read latency histogram (micros): Count: 746025 Average: 17.2034 StdDev: 214.13 Min: 1 Median: 2.0198 Max: 26868 Percentiles: P50: 2.02 P75: 2.95 P99: 12.31 P99.9: 2465.47 P99.99: 3120.40 ------------------------------------------------------ [ 0, 1 ] 13205 1.770% 1.770% ( 1, 2 ] 355834 47.697% 49.467% ########## ( 2, 3 ] 200748 26.909% 76.376% ##### ( 3, 4 ] 73490 9.851% 86.227% ## ( 4, 6 ] 74114 9.935% 96.162% ## ( 6, 10 ] 19027 2.550% 98.712% # ( 10, 15 ] 4641 0.622% 99.334% ( 15, 22 ] 718 0.096% 99.431% ( 22, 34 ] 61 0.008% 99.439% ( 34, 51 ] 19 0.003% 99.441% ( 51, 76 ] 21 0.003% 99.444% ( 76, 110 ] 12 0.002% 99.446% ( 110, 170 ] 42 0.006% 99.451% ( 170, 250 ] 47 0.006% 99.458% ( 250, 380 ] 118 0.016% 99.473% ( 380, 580 ] 238 0.032% 99.505% ( 580, 870 ] 484 0.065% 99.570% ( 870, 1300 ] 753 0.101% 99.671% ( 1300, 1900 ] 986 0.132% 99.803% ( 1900, 2900 ] 1275 0.171% 99.974% ( 2900, 4400 ] 799 0.107% 100.081% ( 4400, 6600 ] 247 0.033% 100.114% ( 6600, 9900 ] 56 0.008% 100.122% ( 9900, 14000 ] 10 0.001% 100.123% ( 14000, 22000 ] 4 0.001% 100.124% ( 22000, 33000 ] 2 0.000% 100.124% ** Level 3 read latency histogram (micros): Count: 1852496 Average: 11.2405 StdDev: 156.54 Min: 0 Median: 2.0101 Max: 27147 Percentiles: P50: 2.01 P75: 2.92 P99: 9.89 P99.9: 1129.71 P99.99: 1793.89 ------------------------------------------------------ [ 0, 1 ] 22339 1.206% 1.206% ( 1, 2 ] 898786 48.518% 49.723% ########## ( 2, 3 ] 508760 27.463% 77.187% ##### ( 3, 4 ] 182076 9.829% 87.016% ## ( 4, 6 ] 180204 9.728% 96.743% ## ( 6, 10 ] 42939 2.318% 99.061% ( 10, 15 ] 8241 0.445% 99.506% ( 15, 22 ] 1060 0.057% 99.563% ( 22, 34 ] 58 0.003% 99.566% ( 34, 51 ] 74 0.004% 99.570% ( 51, 76 ] 119 0.006% 99.577% ( 76, 110 ] 125 0.007% 99.584% ( 110, 170 ] 1093 0.059% 99.643% ( 170, 250 ] 909 0.049% 99.692% ( 250, 380 ] 600 0.032% 99.724% ( 380, 580 ] 958 0.052% 99.776% ( 580, 870 ] 1373 0.074% 99.850% ( 870, 1300 ] 1539 0.083% 99.933% ( 1300, 1900 ] 1285 0.069% 100.002% ( 1900, 2900 ] 1313 0.071% 100.073% ( 2900, 4400 ] 1112 0.060% 100.133% ( 4400, 6600 ] 355 0.019% 100.152% ( 6600, 9900 ] 86 0.005% 100.157% ( 9900, 14000 ] 8 0.000% 100.157% ( 14000, 22000 ] 7 0.000% 100.158% ( 22000, 33000 ] 1 0.000% 100.158% ** Level 4 read latency histogram (micros): Count: 1257929 Average: 21.7030 StdDev: 217.21 Min: 0 Median: 2.0349 Max: 31185 Percentiles: P50: 2.03 P75: 2.98 P99: 363.02 P99.9: 2264.69 P99.99: 3090.92 ------------------------------------------------------ [ 0, 1 ] 15269 1.214% 1.214% ( 1, 2 ] 602065 47.862% 49.075% ########## ( 2, 3 ] 333035 26.475% 75.550% ##### ( 3, 4 ] 121278 9.641% 85.191% ## ( 4, 6 ] 118186 9.395% 94.587% ## ( 6, 10 ] 31870 2.534% 97.120% # ( 10, 15 ] 5594 0.445% 97.565% ( 15, 22 ] 647 0.051% 97.616% ( 22, 34 ] 59 0.005% 97.621% ( 34, 51 ] 80 0.006% 97.627% ( 51, 76 ] 115 0.009% 97.637% ( 76, 110 ] 764 0.061% 97.697% ( 110, 170 ] 7527 0.598% 98.296% ( 170, 250 ] 6250 0.497% 98.792% ( 250, 380 ] 3003 0.239% 99.031% ( 380, 580 ] 3198 0.254% 99.285% ( 580, 870 ] 2856 0.227% 99.512% ( 870, 1300 ] 2574 0.205% 99.717% ( 1300, 1900 ] 1742 0.138% 99.856% ( 1900, 2900 ] 1533 0.122% 99.977% ( 2900, 4400 ] 1243 0.099% 100.076% ( 4400, 6600 ] 454 0.036% 100.112% ( 6600, 9900 ] 70 0.006% 100.118% ( 9900, 14000 ] 8 0.001% 100.119% ( 14000, 22000 ] 10 0.001% 100.119% ( 22000, 33000 ] 6 0.000% 100.120% ** Level 5 read latency histogram (micros): Count: 141026 Average: 543.7788 StdDev: 915.30 Min: 80 Median: 224.4956 Max: 34973 Percentiles: P50: 224.50 P75: 510.13 P99: 4975.98 P99.9: 8727.16 P99.99: 15655.66 ------------------------------------------------------ ( 76, 110 ] 4322 3.065% 3.065% # ( 110, 170 ] 42762 30.322% 33.387% ###### ( 170, 250 ] 34394 24.388% 57.775% ##### ( 250, 380 ] 15099 10.707% 68.482% ## ( 380, 580 ] 14128 10.018% 78.500% ## ( 580, 870 ] 10249 7.267% 85.767% # ( 870, 1300 ] 7129 5.055% 90.822% # ( 1300, 1900 ] 4284 3.038% 93.860% # ( 1900, 2900 ] 3724 2.641% 96.501% # ( 2900, 4400 ] 3137 2.224% 98.725% ( 4400, 6600 ] 1481 1.050% 99.775% ( 6600, 9900 ] 273 0.194% 99.969% ( 9900, 14000 ] 27 0.019% 99.988% ( 14000, 22000 ] 14 0.010% 99.998% ( 22000, 33000 ] 3 0.002% 100.000% ( 33000, 50000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 27.7 total, 5.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 177.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.962 H:M:S, 32.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 197.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.462 H:M:S, 29.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/17-09:15:16 ... thread 0: (1000000,6000000) ops and (35074.4,107167.0) ops/second in (28.510851,55.987382) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 3.49 GB 6.3 6.0 0.0 6.0 11.7 5.7 0.0 2.1 115.0 223.8 53.68 39.74 102 0.526 6267K 15K 0.0 0.0 L1 15/15 1.49 GB 0.0 2.8 2.2 0.5 2.8 2.2 0.0 1.2 74.2 73.9 38.23 17.52 3 12.744 2881K 13K 0.0 0.0 L2 2/0 87.20 MB 0.9 0.7 0.4 0.3 0.7 0.4 0.7 1.7 109.3 108.7 6.16 3.14 2 3.080 683K 3523 0.0 0.0 L3 15/0 989.29 MB 1.0 5.6 3.4 2.3 5.6 3.3 0.3 1.7 109.4 108.5 52.61 27.42 23 2.287 3700K 9244 0.0 0.0 L4 170/0 9.61 GB 1.0 10.1 5.3 4.8 9.9 5.1 0.5 1.9 124.3 121.8 82.96 47.54 58 1.430 4671K 5029 0.0 0.0 L5 1168/0 95.90 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1382/26 111.55 GB 0.0 25.1 11.3 13.8 30.6 16.8 6.9 5.3 110.2 134.1 233.64 135.35 188 1.243 18M 46K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.1 11.3 13.8 30.6 16.8 6.9 5.3 110.2 134.1 233.64 135.35 188 1.243 18M 46K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.1 11.3 13.8 24.9 11.0 0.0 0.0 125.3 123.9 205.57 119.05 104 1.977 18M 46K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 208.7 28.07 16.31 84 0.334 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.2 total, 56.0 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.59 GB write, 557.71 MB/s write, 25.15 GB read, 458.45 MB/s read, 233.6 seconds Interval compaction: 30.59 GB write, 559.45 MB/s write, 25.15 GB read, 459.88 MB/s read, 233.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 62, interval: 83 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2349856 Average: 21.3671 StdDev: 99.46 Min: 0 Median: 1.6874 Max: 28992 Percentiles: P50: 1.69 P75: 2.62 P99: 246.13 P99.9: 738.03 P99.99: 1296.54 ------------------------------------------------------ [ 0, 1 ] 327829 13.951% 13.951% ### ( 1, 2 ] 1232276 52.440% 66.392% ########## ( 2, 3 ] 326136 13.879% 80.270% ### ( 3, 4 ] 117888 5.017% 85.287% # ( 4, 6 ] 92555 3.939% 89.226% # ( 6, 10 ] 18546 0.789% 90.015% ( 10, 15 ] 3411 0.145% 90.160% ( 15, 22 ] 421 0.018% 90.178% ( 22, 34 ] 34 0.001% 90.180% ( 34, 51 ] 58 0.002% 90.182% ( 51, 76 ] 42 0.002% 90.184% ( 76, 110 ] 13633 0.580% 90.764% ( 110, 170 ] 131126 5.580% 96.344% # ( 170, 250 ] 65573 2.791% 99.135% # ( 250, 380 ] 10111 0.430% 99.565% ( 380, 580 ] 6515 0.277% 99.842% ( 580, 870 ] 2485 0.106% 99.948% ( 870, 1300 ] 992 0.042% 99.990% ( 1300, 1900 ] 514 0.022% 100.012% ( 1900, 2900 ] 465 0.020% 100.032% ( 2900, 4400 ] 312 0.013% 100.045% ( 4400, 6600 ] 88 0.004% 100.049% ( 6600, 9900 ] 9 0.000% 100.049% ( 9900, 14000 ] 2 0.000% 100.050% ( 14000, 22000 ] 7 0.000% 100.050% ( 22000, 33000 ] 1 0.000% 100.050% ** Level 1 read latency histogram (micros): Count: 364427 Average: 15.0823 StdDev: 146.40 Min: 1 Median: 2.2823 Max: 10739 Percentiles: P50: 2.28 P75: 3.55 P99: 217.94 P99.9: 2369.63 P99.99: 5296.38 ------------------------------------------------------ [ 0, 1 ] 5921 1.625% 1.625% ( 1, 2 ] 149532 41.032% 42.657% ######## ( 2, 3 ] 94808 26.016% 68.672% ##### ( 3, 4 ] 41817 11.475% 80.147% ## ( 4, 6 ] 48255 13.241% 93.389% ### ( 6, 10 ] 9962 2.734% 96.122% # ( 10, 15 ] 2276 0.625% 96.747% ( 15, 22 ] 958 0.263% 97.010% ( 22, 34 ] 68 0.019% 97.028% ( 34, 51 ] 14 0.004% 97.032% ( 51, 76 ] 13 0.004% 97.036% ( 76, 110 ] 558 0.153% 97.189% ( 110, 170 ] 5030 1.380% 98.569% ( 170, 250 ] 2621 0.719% 99.288% ( 250, 380 ] 653 0.179% 99.467% ( 380, 580 ] 488 0.134% 99.601% ( 580, 870 ] 368 0.101% 99.702% ( 870, 1300 ] 350 0.096% 99.798% ( 1300, 1900 ] 248 0.068% 99.866% ( 1900, 2900 ] 261 0.072% 99.938% ( 2900, 4400 ] 170 0.047% 99.985% ( 4400, 6600 ] 48 0.013% 99.998% ( 6600, 9900 ] 15 0.004% 100.002% ( 9900, 14000 ] 4 0.001% 100.003% ** Level 2 read latency histogram (micros): Count: 746025 Average: 17.2034 StdDev: 214.13 Min: 1 Median: 2.0198 Max: 26868 Percentiles: P50: 2.02 P75: 2.95 P99: 12.31 P99.9: 2465.47 P99.99: 3120.40 ------------------------------------------------------ [ 0, 1 ] 13205 1.770% 1.770% ( 1, 2 ] 355834 47.697% 49.467% ########## ( 2, 3 ] 200748 26.909% 76.376% ##### ( 3, 4 ] 73490 9.851% 86.227% ## ( 4, 6 ] 74114 9.935% 96.162% ## ( 6, 10 ] 19027 2.550% 98.712% # ( 10, 15 ] 4641 0.622% 99.334% ( 15, 22 ] 718 0.096% 99.431% ( 22, 34 ] 61 0.008% 99.439% ( 34, 51 ] 19 0.003% 99.441% ( 51, 76 ] 21 0.003% 99.444% ( 76, 110 ] 12 0.002% 99.446% ( 110, 170 ] 42 0.006% 99.451% ( 170, 250 ] 47 0.006% 99.458% ( 250, 380 ] 118 0.016% 99.473% ( 380, 580 ] 238 0.032% 99.505% ( 580, 870 ] 484 0.065% 99.570% ( 870, 1300 ] 753 0.101% 99.671% ( 1300, 1900 ] 986 0.132% 99.803% ( 1900, 2900 ] 1275 0.171% 99.974% ( 2900, 4400 ] 799 0.107% 100.081% ( 4400, 6600 ] 247 0.033% 100.114% ( 6600, 9900 ] 56 0.008% 100.122% ( 9900, 14000 ] 10 0.001% 100.123% ( 14000, 22000 ] 4 0.001% 100.124% ( 22000, 33000 ] 2 0.000% 100.124% ** Level 3 read latency histogram (micros): Count: 1862341 Average: 12.0624 StdDev: 156.66 Min: 0 Median: 2.0197 Max: 27147 Percentiles: P50: 2.02 P75: 2.93 P99: 17.46 P99.9: 1129.74 P99.99: 1796.39 ------------------------------------------------------ [ 0, 1 ] 22339 1.200% 1.200% ( 1, 2 ] 898786 48.261% 49.461% ########## ( 2, 3 ] 508760 27.318% 76.779% ##### ( 3, 4 ] 182076 9.777% 86.556% ## ( 4, 6 ] 180204 9.676% 96.232% ## ( 6, 10 ] 42939 2.306% 98.537% ( 10, 15 ] 8241 0.443% 98.980% ( 15, 22 ] 1060 0.057% 99.037% ( 22, 34 ] 58 0.003% 99.040% ( 34, 51 ] 74 0.004% 99.044% ( 51, 76 ] 119 0.006% 99.050% ( 76, 110 ] 734 0.039% 99.090% ( 110, 170 ] 7131 0.383% 99.473% ( 170, 250 ] 3648 0.196% 99.669% ( 250, 380 ] 867 0.047% 99.715% ( 380, 580 ] 1097 0.059% 99.774% ( 580, 870 ] 1413 0.076% 99.850% ( 870, 1300 ] 1544 0.083% 99.933% ( 1300, 1900 ] 1287 0.069% 100.002% ( 1900, 2900 ] 1318 0.071% 100.073% ( 2900, 4400 ] 1113 0.060% 100.132% ( 4400, 6600 ] 355 0.019% 100.152% ( 6600, 9900 ] 86 0.005% 100.156% ( 9900, 14000 ] 8 0.000% 100.157% ( 14000, 22000 ] 7 0.000% 100.157% ( 22000, 33000 ] 1 0.000% 100.157% ** Level 4 read latency histogram (micros): Count: 1334051 Average: 29.9440 StdDev: 214.39 Min: 0 Median: 2.1492 Max: 31185 Percentiles: P50: 2.15 P75: 3.41 P99: 399.86 P99.9: 2222.53 P99.99: 3083.85 ------------------------------------------------------ [ 0, 1 ] 15269 1.145% 1.145% ( 1, 2 ] 602074 45.131% 46.276% ######### ( 2, 3 ] 333061 24.966% 71.242% ##### ( 3, 4 ] 121299 9.093% 80.334% ## ( 4, 6 ] 118209 8.861% 89.195% ## ( 6, 10 ] 31872 2.389% 91.585% ( 10, 15 ] 5595 0.419% 92.004% ( 15, 22 ] 647 0.048% 92.052% ( 22, 34 ] 59 0.004% 92.057% ( 34, 51 ] 80 0.006% 92.063% ( 51, 76 ] 115 0.009% 92.071% ( 76, 110 ] 5589 0.419% 92.490% ( 110, 170 ] 54228 4.065% 96.555% # ( 170, 250 ] 27010 2.025% 98.580% ( 250, 380 ] 5167 0.387% 98.967% ( 380, 580 ] 4396 0.330% 99.297% ( 580, 870 ] 3161 0.237% 99.534% ( 870, 1300 ] 2631 0.197% 99.731% ( 1300, 1900 ] 1756 0.132% 99.863% ( 1900, 2900 ] 1547 0.116% 99.979% ( 2900, 4400 ] 1245 0.093% 100.072% ( 4400, 6600 ] 454 0.034% 100.106% ( 6600, 9900 ] 70 0.005% 100.111% ( 9900, 14000 ] 8 0.001% 100.112% ( 14000, 22000 ] 10 0.001% 100.113% ( 22000, 33000 ] 6 0.000% 100.113% ** Level 5 read latency histogram (micros): Count: 557369 Average: 261.7363 StdDev: 493.76 Min: 78 Median: 159.8013 Max: 34973 Percentiles: P50: 159.80 P75: 217.94 P99: 2737.20 P99.9: 6243.66 P99.99: 9758.13 ------------------------------------------------------ ( 76, 110 ] 30826 5.531% 5.531% # ( 110, 170 ] 298617 53.576% 59.107% ########### ( 170, 250 ] 147832 26.523% 85.630% ##### ( 250, 380 ] 26909 4.828% 90.458% # ( 380, 580 ] 20769 3.726% 94.184% # ( 580, 870 ] 11980 2.149% 96.333% ( 870, 1300 ] 7342 1.317% 97.651% ( 1300, 1900 ] 4350 0.780% 98.431% ( 1900, 2900 ] 3788 0.680% 99.111% ( 2900, 4400 ] 3156 0.566% 99.677% ( 4400, 6600 ] 1484 0.266% 99.943% ( 6600, 9900 ] 273 0.049% 99.992% ( 9900, 14000 ] 28 0.005% 99.997% ( 14000, 22000 ] 14 0.003% 100.000% ( 22000, 33000 ] 3 0.001% 100.000% ( 33000, 50000 ] 1 0.000% 100.001% ** DB Stats ** Uptime(secs): 56.2 total, 28.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 105.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.985 H:M:S, 58.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 34.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:24.023 H:M:S, 84.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 312.527 micros/op 12778 ops/sec 60.177 seconds 768996 operations; 12.4 MB/s (185999 of 185999 found) Microseconds per read: Count: 768996 Average: 312.5334 StdDev: 1010.27 Min: 2 Median: 206.9609 Max: 156085 Percentiles: P50: 206.96 P75: 251.20 P99: 2097.76 P99.9: 18005.59 P99.99: 36424.38 ------------------------------------------------------ ( 1, 2 ] 1 0.000% 0.000% ( 2, 3 ] 27 0.004% 0.004% ( 3, 4 ] 55 0.007% 0.011% ( 4, 6 ] 67 0.009% 0.020% ( 6, 10 ] 242 0.031% 0.051% ( 10, 15 ] 2062 0.268% 0.319% ( 15, 22 ] 2508 0.326% 0.645% ( 22, 34 ] 5920 0.770% 1.415% ( 34, 51 ] 1727 0.225% 1.640% ( 51, 76 ] 230 0.030% 1.670% ( 76, 110 ] 1997 0.260% 1.929% ( 110, 170 ] 205331 26.701% 28.630% ##### ( 170, 250 ] 355686 46.253% 74.884% ######### ( 250, 380 ] 97204 12.640% 87.524% ### ( 380, 580 ] 51430 6.688% 94.212% # ( 580, 870 ] 21162 2.752% 96.964% # ( 870, 1300 ] 10183 1.324% 98.288% ( 1300, 1900 ] 4790 0.623% 98.911% ( 1900, 2900 ] 3459 0.450% 99.361% ( 2900, 4400 ] 2544 0.331% 99.692% ( 4400, 6600 ] 889 0.116% 99.807% ( 6600, 9900 ] 180 0.023% 99.831% ( 9900, 14000 ] 172 0.022% 99.853% ( 14000, 22000 ] 721 0.094% 99.947% ( 22000, 33000 ] 318 0.041% 99.988% ( 33000, 50000 ] 70 0.009% 99.997% ( 50000, 75000 ] 17 0.002% 99.999% ( 75000, 110000 ] 3 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13149871 rocksdb.bloom.filter.full.positive COUNT : 896822 rocksdb.bloom.filter.full.true.positive COUNT : 768614 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 382 rocksdb.memtable.miss COUNT : 768614 rocksdb.l0.hit COUNT : 28041 rocksdb.l1.hit COUNT : 6342 rocksdb.l2andup.hit COUNT : 734231 rocksdb.compaction.key.drop.new COUNT : 296945 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6019505 rocksdb.number.keys.read COUNT : 768996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6212129160 rocksdb.bytes.read COUNT : 768996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1729 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36967133 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27537376721 rocksdb.compact.write.bytes COUNT : 27226694378 rocksdb.flush.write.bytes COUNT : 6209438991 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 1257 rocksdb.number.superversion_releases COUNT : 1223 rocksdb.number.superversion_cleanups COUNT : 312 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 346 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6159294464 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2323456 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31048539620 rocksdb.non.last.level.read.count COUNT : 7357514 rocksdb.block.checksum.compute.count COUNT : 7575630 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 206.179568 P95 : 661.344890 P99 : 2095.556841 P100 : 156081.000000 COUNT : 768996 SUM : 239673445 rocksdb.db.write.micros P50 : 1.544858 P95 : 4.519103 P99 : 9.432776 P100 : 909798.000000 COUNT : 6019505 SUM : 52190507 rocksdb.compaction.times.micros P50 : 1417241.379310 P95 : 3957777.777778 P99 : 6456000.000000 P100 : 28344600.000000 COUNT : 104 SUM : 205566588 rocksdb.compaction.times.cpu_micros P50 : 922962.962963 P95 : 1867692.307692 P99 : 6412000.000000 P100 : 11559700.000000 COUNT : 104 SUM : 119047710 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1040.208333 P95 : 68750.000000 P99 : 182000.000000 P100 : 199539.000000 COUNT : 85 SUM : 913537 rocksdb.compaction.outfile.sync.micros P50 : 21111.111111 P95 : 199866.666667 P99 : 346720.000000 P100 : 517820.000000 COUNT : 328 SUM : 16964868 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 347.500000 P95 : 4810.000000 P99 : 6562.000000 P100 : 8116.000000 COUNT : 219 SUM : 262994 rocksdb.table.open.io.micros P50 : 11815.239044 P95 : 21648.689139 P99 : 30821.228070 P100 : 52621.000000 COUNT : 1729 SUM : 19491891 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.059812 P95 : 9.877769 P99 : 205.747251 P100 : 30233.000000 COUNT : 6667985 SUM : 106622728 rocksdb.read.block.get.micros P50 : 159.171053 P95 : 532.399194 P99 : 2059.910194 P100 : 34980.000000 COUNT : 905917 SUM : 206458063 rocksdb.write.raw.block.micros P50 : 0.528643 P95 : 1.121799 P99 : 3.445896 P100 : 41702.000000 COUNT : 8098572 SUM : 26142962 rocksdb.numfiles.in.singlecompaction P50 : 2.821429 P95 : 5.514286 P99 : 9.660000 P100 : 26.000000 COUNT : 134 SUM : 460 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.572239 P95 : 1215.159863 P99 : 2583.459108 P100 : 909626.000000 COUNT : 177132 SUM : 36985994 rocksdb.sst.read.micros P50 : 2.032559 P95 : 183.835188 P99 : 509.591164 P100 : 34973.000000 COUNT : 7357564 SUM : 294193549 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 768996 SUM : 768996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6019505 SUM : 6212129160 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 225737.704918 P95 : 1019375.000000 P99 : 1138901.000000 P100 : 1138901.000000 COUNT : 85 SUM : 28284616 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 347 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0