[2024-07-10 14:21:24.349342] Starting SPDK v24.09-pre git sha1 968224f46 / DPDK 24.03.0 initialization... [2024-07-10 14:21:24.349645] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1744780 ] Set seed to 1720614084342583 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-10 14:21:24.512925] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-10 14:21:24.831111] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-10 14:21:24.831167] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1744780' to capture a snapshot of events at runtime. [2024-07-10 14:21:24.831183] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-10 14:21:24.831197] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-10 14:21:24.831209] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1744780 for offline analysis/debug. [2024-07-10 14:21:24.831335] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 10 14:21:37 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/10-14:21:44 ... thread 0: (1000000,1000000) ops and (132374.2,132374.2) ops/second in (7.554345,7.554345) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 503.97 MB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 267.9 3.53 3.16 15 0.235 0 0 0.0 0.0 L1 2/2 171.53 MB 0.0 0.4 0.2 0.1 0.4 0.2 0.2 1.5 185.3 185.1 2.04 1.97 2 1.020 383K 241 0.0 0.0 L2 6/0 33.80 MB 0.3 0.4 0.2 0.2 0.4 0.2 0.1 2.2 178.2 178.1 2.55 2.43 4 0.639 462K 262 0.0 0.0 L3 19/2 1.14 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 156/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1332/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1523/12 97.06 GB 0.0 0.8 0.4 0.4 1.7 1.4 0.6 1.9 102.6 218.9 8.12 7.56 21 0.387 846K 503 0.0 0.0 Int 0/0 0.00 KB 0.0 0.8 0.4 0.4 1.7 1.4 0.5 1.9 102.6 218.9 8.12 7.56 21 0.387 846K 503 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.8 0.4 0.4 0.8 0.4 0.0 0.0 181.3 181.2 4.59 4.40 6 0.766 846K 503 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 267.9 3.53 3.16 15 0.235 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.6 interval Flush(GB): cumulative 0.923, interval 0.923 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.74 GB write, 221.90 MB/s write, 0.81 GB read, 104.01 MB/s read, 8.1 seconds Interval compaction: 1.74 GB write, 235.22 MB/s write, 0.81 GB read, 110.26 MB/s read, 8.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 153042 Average: 2.5723 StdDev: 22.36 Min: 1 Median: 1.7043 Max: 3569 Percentiles: P50: 1.70 P75: 2.16 P99: 5.41 P99.9: 10.97 P99.99: 428.45 ------------------------------------------------------ [ 0, 1 ] 193 0.126% 0.126% ( 1, 2 ] 108382 70.818% 70.945% ############## ( 2, 3 ] 39337 25.703% 96.648% ##### ( 3, 4 ] 2050 1.340% 97.987% ( 4, 6 ] 2206 1.441% 99.429% ( 6, 10 ] 703 0.459% 99.888% ( 10, 15 ] 124 0.081% 99.969% ( 15, 22 ] 16 0.010% 99.980% ( 22, 34 ] 3 0.002% 99.982% ( 34, 51 ] 2 0.001% 99.983% ( 51, 76 ] 2 0.001% 99.984% ( 170, 250 ] 13 0.008% 99.993% ( 380, 580 ] 7 0.005% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 2900, 4400 ] 6 0.004% 100.004% ** Level 1 read latency histogram (micros): Count: 90467 Average: 2.6127 StdDev: 37.96 Min: 1 Median: 1.7003 Max: 9906 Percentiles: P50: 1.70 P75: 2.14 P99: 5.20 P99.9: 9.71 P99.99: 527.66 ------------------------------------------------------ [ 0, 1 ] 119 0.132% 0.132% ( 1, 2 ] 64418 71.206% 71.338% ############## ( 2, 3 ] 23218 25.665% 97.002% ##### ( 3, 4 ] 1015 1.122% 98.124% ( 4, 6 ] 1321 1.460% 99.584% ( 6, 10 ] 308 0.340% 99.925% ( 10, 15 ] 46 0.051% 99.976% ( 15, 22 ] 6 0.007% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 2 0.002% 99.986% ( 250, 380 ] 1 0.001% 99.987% ( 380, 580 ] 4 0.004% 99.991% ( 580, 870 ] 2 0.002% 99.993% ( 870, 1300 ] 2 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 9900, 14000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 49004 Average: 2.7495 StdDev: 40.15 Min: 1 Median: 1.6997 Max: 8019 Percentiles: P50: 1.70 P75: 2.15 P99: 5.51 P99.9: 12.61 P99.99: 891.41 ------------------------------------------------------ [ 0, 1 ] 146 0.298% 0.298% ( 1, 2 ] 34811 71.037% 71.335% ############## ( 2, 3 ] 12329 25.159% 96.494% ##### ( 3, 4 ] 696 1.420% 97.914% ( 4, 6 ] 704 1.437% 99.351% ( 6, 10 ] 246 0.502% 99.853% ( 10, 15 ] 44 0.090% 99.943% ( 15, 22 ] 11 0.022% 99.965% ( 22, 34 ] 2 0.004% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 170, 250 ] 1 0.002% 99.976% ( 250, 380 ] 1 0.002% 99.978% ( 380, 580 ] 4 0.008% 99.986% ( 580, 870 ] 2 0.004% 99.990% ( 870, 1300 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 65 Average: 4940.2308 StdDev: 4117.40 Min: 319 Median: 3050.0000 Max: 13196 Percentiles: P50: 3050.00 P75: 8839.29 P99: 13196.00 P99.9: 13196.00 P99.99: 13196.00 ------------------------------------------------------ ( 250, 380 ] 1 1.538% 1.538% ( 580, 870 ] 1 1.538% 3.077% ( 870, 1300 ] 15 23.077% 26.154% ##### ( 1300, 1900 ] 10 15.385% 41.538% ### ( 1900, 2900 ] 5 7.692% 49.231% ## ( 2900, 4400 ] 5 7.692% 56.923% ## ( 4400, 6600 ] 7 10.769% 67.692% ## ( 6600, 9900 ] 7 10.769% 78.462% ## ( 9900, 14000 ] 14 21.538% 100.000% #### ** Level 4 read latency histogram (micros): Count: 5 Average: 5462.2000 StdDev: 2717.52 Min: 1758 Median: 7150.0000 Max: 8401 Percentiles: P50: 7150.00 P75: 8401.00 P99: 8401.00 P99.9: 8401.00 P99.99: 8401.00 ------------------------------------------------------ ( 1300, 1900 ] 1 20.000% 20.000% #### ( 1900, 2900 ] 1 20.000% 40.000% #### ( 6600, 9900 ] 3 60.000% 100.000% ############ ** DB Stats ** Uptime(secs): 8.0 total, 7.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 122.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 0 2024/07/10-14:21:52 ... thread 0: (1000000,2000000) ops and (131942.3,132157.9) ops/second in (7.579073,15.133418) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 755.47 MB 12.6 0.7 0.0 0.7 2.6 1.8 0.0 1.4 70.5 246.8 10.72 9.90 33 0.325 767K 762 0.0 0.0 L1 4/4 345.75 MB 0.0 1.6 0.9 0.7 1.6 0.9 0.2 1.8 178.5 178.1 9.33 9.10 4 2.332 1690K 3487 0.0 0.0 L2 6/0 33.80 MB 0.3 0.4 0.2 0.2 0.4 0.2 0.6 2.2 178.2 178.1 2.55 2.43 4 0.639 462K 262 0.0 0.0 L3 13/0 955.77 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 208/0 9.57 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 126.9 127.0 1.74 1.34 1 1.740 224K 0 0.0 0.0 L5 1344/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1581/8 97.98 GB 0.0 3.0 1.3 1.7 4.9 3.2 2.9 2.6 127.2 204.7 24.34 22.78 42 0.580 3144K 4511 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 1.3 1.7 4.9 3.2 2.8 2.6 127.2 204.7 24.34 22.78 42 0.580 3144K 4511 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 1.3 1.7 3.0 1.3 0.0 0.0 177.3 177.0 17.47 16.64 12 1.456 3144K 4511 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 275.1 6.87 6.14 30 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.87 GB write, 319.59 MB/s write, 3.02 GB read, 198.66 MB/s read, 24.3 seconds Interval compaction: 4.87 GB write, 329.16 MB/s write, 3.02 GB read, 204.61 MB/s read, 24.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 525092 Average: 2.7362 StdDev: 15.04 Min: 1 Median: 1.9467 Max: 3569 Percentiles: P50: 1.95 P75: 2.55 P99: 5.96 P99.9: 12.25 P99.99: 26.58 ------------------------------------------------------ [ 0, 1 ] 314 0.060% 0.060% ( 1, 2 ] 277010 52.755% 52.814% ########### ( 2, 3 ] 211388 40.257% 93.072% ######## ( 3, 4 ] 15805 3.010% 96.082% # ( 4, 6 ] 15622 2.975% 99.057% # ( 6, 10 ] 4118 0.784% 99.841% ( 10, 15 ] 689 0.131% 99.972% ( 15, 22 ] 87 0.017% 99.989% ( 22, 34 ] 17 0.003% 99.992% ( 34, 51 ] 5 0.001% 99.993% ( 51, 76 ] 4 0.001% 99.994% ( 76, 110 ] 2 0.000% 99.994% ( 170, 250 ] 28 0.005% 99.999% ( 250, 380 ] 1 0.000% 100.000% ( 380, 580 ] 14 0.003% 100.002% ( 580, 870 ] 6 0.001% 100.003% ( 870, 1300 ] 6 0.001% 100.005% ( 1300, 1900 ] 2 0.000% 100.005% ( 1900, 2900 ] 1 0.000% 100.005% ( 2900, 4400 ] 8 0.002% 100.007% ** Level 1 read latency histogram (micros): Count: 203327 Average: 2.7264 StdDev: 26.99 Min: 1 Median: 1.8436 Max: 9906 Percentiles: P50: 1.84 P75: 2.44 P99: 5.71 P99.9: 11.46 P99.99: 559.50 ------------------------------------------------------ [ 0, 1 ] 173 0.085% 0.085% ( 1, 2 ] 120308 59.170% 59.255% ############ ( 2, 3 ] 72180 35.499% 94.754% ####### ( 3, 4 ] 4629 2.277% 97.031% ( 4, 6 ] 4682 2.303% 99.334% ( 6, 10 ] 1097 0.540% 99.873% ( 10, 15 ] 187 0.092% 99.965% ( 15, 22 ] 23 0.011% 99.976% ( 22, 34 ] 6 0.003% 99.979% ( 51, 76 ] 1 0.000% 99.980% ( 110, 170 ] 4 0.002% 99.982% ( 170, 250 ] 3 0.001% 99.983% ( 250, 380 ] 2 0.001% 99.984% ( 380, 580 ] 13 0.006% 99.991% ( 580, 870 ] 5 0.002% 99.993% ( 870, 1300 ] 7 0.003% 99.997% ( 1300, 1900 ] 5 0.002% 99.999% ( 4400, 6600 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 103388 Average: 2.8713 StdDev: 27.65 Min: 1 Median: 1.9882 Max: 8019 Percentiles: P50: 1.99 P75: 2.59 P99: 7.32 P99.9: 13.78 P99.99: 413.06 ------------------------------------------------------ [ 0, 1 ] 165 0.160% 0.160% ( 1, 2 ] 52145 50.436% 50.596% ########## ( 2, 3 ] 42522 41.129% 91.724% ######## ( 3, 4 ] 3544 3.428% 95.152% # ( 4, 6 ] 3593 3.475% 98.628% # ( 6, 10 ] 1163 1.125% 99.752% ( 10, 15 ] 202 0.195% 99.948% ( 15, 22 ] 35 0.034% 99.982% ( 22, 34 ] 3 0.003% 99.985% ( 34, 51 ] 1 0.001% 99.985% ( 51, 76 ] 2 0.002% 99.987% ( 170, 250 ] 1 0.001% 99.988% ( 250, 380 ] 1 0.001% 99.989% ( 380, 580 ] 4 0.004% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 65 Average: 4940.2308 StdDev: 4117.40 Min: 319 Median: 3050.0000 Max: 13196 Percentiles: P50: 3050.00 P75: 8839.29 P99: 13196.00 P99.9: 13196.00 P99.99: 13196.00 ------------------------------------------------------ ( 250, 380 ] 1 1.538% 1.538% ( 580, 870 ] 1 1.538% 3.077% ( 870, 1300 ] 15 23.077% 26.154% ##### ( 1300, 1900 ] 10 15.385% 41.538% ### ( 1900, 2900 ] 5 7.692% 49.231% ## ( 2900, 4400 ] 5 7.692% 56.923% ## ( 4400, 6600 ] 7 10.769% 67.692% ## ( 6600, 9900 ] 7 10.769% 78.462% ## ( 9900, 14000 ] 14 21.538% 100.000% #### ** Level 4 read latency histogram (micros): Count: 285 Average: 108.0246 StdDev: 802.63 Min: 1 Median: 1.6844 Max: 8401 Percentiles: P50: 1.68 P75: 4.69 P99: 6765.00 P99.9: 8401.00 P99.99: 8401.00 ------------------------------------------------------ [ 0, 1 ] 59 20.702% 20.702% #### ( 1, 2 ] 122 42.807% 63.509% ######### ( 2, 3 ] 24 8.421% 71.930% ## ( 3, 4 ] 6 2.105% 74.035% ( 4, 6 ] 8 2.807% 76.842% # ( 6, 10 ] 34 11.930% 88.772% ## ( 10, 15 ] 11 3.860% 92.632% # ( 15, 22 ] 1 0.351% 92.982% ( 22, 34 ] 6 2.105% 95.088% ( 110, 170 ] 1 0.351% 95.439% ( 170, 250 ] 4 1.404% 96.842% ( 250, 380 ] 3 1.053% 97.895% ( 580, 870 ] 1 0.351% 98.246% ( 1300, 1900 ] 1 0.351% 98.596% ( 1900, 2900 ] 1 0.351% 98.947% ( 6600, 9900 ] 3 1.053% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 722.9333 StdDev: 875.00 Min: 91 Median: 186.0000 Max: 3124 Percentiles: P50: 186.00 P75: 790.91 P99: 3124.00 P99.9: 3124.00 P99.99: 3124.00 ------------------------------------------------------ ( 76, 110 ] 3 5.000% 5.000% # ( 110, 170 ] 26 43.333% 48.333% ######### ( 170, 250 ] 5 8.333% 56.667% ## ( 250, 380 ] 1 1.667% 58.333% ( 380, 580 ] 2 3.333% 61.667% # ( 580, 870 ] 11 18.333% 80.000% #### ( 1300, 1900 ] 2 3.333% 83.333% # ( 1900, 2900 ] 9 15.000% 98.333% ### ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 15.6 total, 7.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 126.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 129.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/10-14:21:59 ... thread 0: (1000000,3000000) ops and (131257.7,131856.4) ops/second in (7.618599,22.752017) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/9 1.11 GB 0.0 1.5 0.0 1.5 4.3 2.8 0.0 1.5 86.5 252.1 17.49 16.18 52 0.336 1535K 1560 0.0 0.0 L1 6/6 456.45 MB 0.0 2.6 1.5 1.0 2.6 1.5 0.2 1.7 177.9 177.4 14.84 14.51 5 2.968 2680K 7085 0.0 0.0 L2 1/1 128.77 MB 0.0 0.4 0.2 0.2 0.4 0.2 1.1 2.2 178.2 178.1 2.55 2.43 4 0.639 462K 262 0.0 0.0 L3 25/5 1.05 GB 0.8 1.2 0.3 0.9 1.2 0.3 1.0 4.6 166.7 166.1 7.22 6.86 3 2.406 1222K 3995 0.0 0.0 L4 207/0 9.61 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 126.9 127.0 1.74 1.34 1 1.740 224K 0 0.0 0.0 L5 1348/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1596/21 98.95 GB 0.0 5.9 2.2 3.7 8.7 5.0 4.1 3.1 137.6 203.4 43.84 41.33 65 0.674 6124K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 2.2 3.7 8.7 5.0 4.0 3.1 137.6 203.4 43.84 41.33 65 0.674 6124K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 2.2 3.7 5.9 2.2 0.0 0.0 180.5 180.1 33.41 32.06 19 1.759 6124K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 277.9 10.43 9.26 46 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.2 total, 22.8 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.71 GB write, 384.18 MB/s write, 5.89 GB read, 259.88 MB/s read, 43.8 seconds Interval compaction: 8.71 GB write, 391.84 MB/s write, 5.89 GB read, 265.06 MB/s read, 43.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 932818 Average: 2.7771 StdDev: 14.17 Min: 0 Median: 1.9942 Max: 3613 Percentiles: P50: 1.99 P75: 2.61 P99: 6.58 P99.9: 12.00 P99.99: 18.91 ------------------------------------------------------ [ 0, 1 ] 15560 1.668% 1.668% ( 1, 2 ] 453476 48.614% 50.282% ########## ( 2, 3 ] 379291 40.661% 90.942% ######## ( 3, 4 ] 36508 3.914% 94.856% # ( 4, 6 ] 37318 4.001% 98.857% # ( 6, 10 ] 9226 0.989% 99.846% ( 10, 15 ] 1271 0.136% 99.982% ( 15, 22 ] 139 0.015% 99.997% ( 22, 34 ] 22 0.002% 99.999% ( 34, 51 ] 8 0.001% 100.000% ( 51, 76 ] 10 0.001% 100.001% ( 76, 110 ] 2 0.000% 100.001% ( 170, 250 ] 41 0.004% 100.006% ( 250, 380 ] 2 0.000% 100.006% ( 380, 580 ] 20 0.002% 100.008% ( 580, 870 ] 14 0.002% 100.010% ( 870, 1300 ] 10 0.001% 100.011% ( 1300, 1900 ] 2 0.000% 100.011% ( 1900, 2900 ] 3 0.000% 100.011% ( 2900, 4400 ] 12 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 512309 Average: 3.0797 StdDev: 18.52 Min: 1 Median: 2.2503 Max: 9906 Percentiles: P50: 2.25 P75: 2.77 P99: 8.21 P99.9: 13.83 P99.99: 74.56 ------------------------------------------------------ [ 0, 1 ] 1471 0.287% 0.287% ( 1, 2 ] 193329 37.737% 38.024% ######## ( 2, 3 ] 245140 47.850% 85.874% ########## ( 3, 4 ] 30231 5.901% 91.775% # ( 4, 6 ] 32371 6.319% 98.094% # ( 6, 10 ] 8418 1.643% 99.737% ( 10, 15 ] 1093 0.213% 99.950% ( 15, 22 ] 184 0.036% 99.986% ( 22, 34 ] 17 0.003% 99.989% ( 51, 76 ] 4 0.001% 99.990% ( 110, 170 ] 30 0.006% 99.996% ( 170, 250 ] 24 0.005% 100.001% ( 250, 380 ] 9 0.002% 100.002% ( 380, 580 ] 28 0.005% 100.008% ( 580, 870 ] 12 0.002% 100.010% ( 870, 1300 ] 9 0.002% 100.012% ( 1300, 1900 ] 8 0.002% 100.013% ( 1900, 2900 ] 2 0.000% 100.014% ( 4400, 6600 ] 1 0.000% 100.014% ( 9900, 14000 ] 1 0.000% 100.014% ** Level 2 read latency histogram (micros): Count: 120428 Average: 3.1067 StdDev: 26.43 Min: 1 Median: 2.1236 Max: 8019 Percentiles: P50: 2.12 P75: 2.69 P99: 8.52 P99.9: 16.94 P99.99: 578.93 ------------------------------------------------------ [ 0, 1 ] 165 0.137% 0.137% ( 1, 2 ] 53466 44.397% 44.534% ######### ( 2, 3 ] 53277 44.240% 88.773% ######### ( 3, 4 ] 5505 4.571% 93.345% # ( 4, 6 ] 5559 4.616% 97.961% # ( 6, 10 ] 1987 1.650% 99.611% ( 10, 15 ] 335 0.278% 99.889% ( 15, 22 ] 49 0.041% 99.929% ( 22, 34 ] 4 0.003% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 2 0.002% 99.935% ( 76, 110 ] 5 0.004% 99.939% ( 110, 170 ] 29 0.024% 99.963% ( 170, 250 ] 15 0.012% 99.976% ( 250, 380 ] 9 0.007% 99.983% ( 380, 580 ] 8 0.007% 99.990% ( 580, 870 ] 7 0.006% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 105228 Average: 7.3058 StdDev: 160.98 Min: 1 Median: 2.5112 Max: 13196 Percentiles: P50: 2.51 P75: 2.98 P99: 12.09 P99.9: 499.85 P99.99: 10918.32 ------------------------------------------------------ [ 0, 1 ] 1906 1.811% 1.811% ( 1, 2 ] 21913 20.824% 22.636% #### ( 2, 3 ] 56325 53.527% 76.162% ########### ( 3, 4 ] 9664 9.184% 85.346% ## ( 4, 6 ] 10197 9.690% 95.036% ## ( 6, 10 ] 3832 3.642% 98.678% # ( 10, 15 ] 813 0.773% 99.451% ( 15, 22 ] 146 0.139% 99.589% ( 22, 34 ] 10 0.010% 99.599% ( 34, 51 ] 1 0.001% 99.600% ( 76, 110 ] 26 0.025% 99.625% ( 110, 170 ] 141 0.134% 99.759% ( 170, 250 ] 82 0.078% 99.837% ( 250, 380 ] 45 0.043% 99.879% ( 380, 580 ] 38 0.036% 99.915% ( 580, 870 ] 18 0.017% 99.933% ( 870, 1300 ] 21 0.020% 99.952% ( 1300, 1900 ] 13 0.012% 99.965% ( 1900, 2900 ] 5 0.005% 99.970% ( 2900, 4400 ] 5 0.005% 99.974% ( 4400, 6600 ] 7 0.007% 99.981% ( 6600, 9900 ] 7 0.007% 99.988% ( 9900, 14000 ] 14 0.013% 100.001% ** Level 4 read latency histogram (micros): Count: 285 Average: 108.0246 StdDev: 802.63 Min: 1 Median: 1.6844 Max: 8401 Percentiles: P50: 1.68 P75: 4.69 P99: 6765.00 P99.9: 8401.00 P99.99: 8401.00 ------------------------------------------------------ [ 0, 1 ] 59 20.702% 20.702% #### ( 1, 2 ] 122 42.807% 63.509% ######### ( 2, 3 ] 24 8.421% 71.930% ## ( 3, 4 ] 6 2.105% 74.035% ( 4, 6 ] 8 2.807% 76.842% # ( 6, 10 ] 34 11.930% 88.772% ## ( 10, 15 ] 11 3.860% 92.632% # ( 15, 22 ] 1 0.351% 92.982% ( 22, 34 ] 6 2.105% 95.088% ( 110, 170 ] 1 0.351% 95.439% ( 170, 250 ] 4 1.404% 96.842% ( 250, 380 ] 3 1.053% 97.895% ( 580, 870 ] 1 0.351% 98.246% ( 1300, 1900 ] 1 0.351% 98.596% ( 1900, 2900 ] 1 0.351% 98.947% ( 6600, 9900 ] 3 1.053% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 747.1500 StdDev: 928.52 Min: 91 Median: 170.0000 Max: 3172 Percentiles: P50: 170.00 P75: 803.08 P99: 3172.00 P99.9: 3172.00 P99.99: 3172.00 ------------------------------------------------------ ( 76, 110 ] 6 7.500% 7.500% ## ( 110, 170 ] 34 42.500% 50.000% ######### ( 170, 250 ] 5 6.250% 56.250% # ( 250, 380 ] 1 1.250% 57.500% ( 380, 580 ] 4 5.000% 62.500% # ( 580, 870 ] 13 16.250% 78.750% ### ( 870, 1300 ] 1 1.250% 80.000% ( 1300, 1900 ] 3 3.750% 83.750% # ( 1900, 2900 ] 9 11.250% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 23.2 total, 7.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 127.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 129.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 0 2024/07/10-14:22:04 ... thread 0: (1000000,4000000) ops and (241007.1,148691.9) ops/second in (4.149255,26.901272) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 2.03 GB 94.4 2.2 0.0 2.2 6.0 3.8 0.0 1.6 91.7 247.1 24.72 22.75 70 0.353 2302K 2351 0.0 0.0 L1 6/6 456.45 MB 0.0 2.6 1.5 1.0 2.6 1.5 0.2 1.7 177.9 177.4 14.84 14.51 5 2.968 2680K 7085 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.1 2.2 178.2 178.1 2.55 2.43 4 0.639 462K 262 0.0 0.0 L3 23/0 949.98 MB 0.9 1.6 0.4 1.2 1.6 0.4 1.0 4.1 178.3 177.7 9.00 8.57 4 2.250 1629K 5239 0.0 0.0 L4 208/0 9.61 GB 1.0 0.5 0.5 0.0 0.5 0.5 0.8 1.1 117.2 117.1 4.27 3.19 6 0.711 501K 378 0.0 0.0 L5 1352/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1604/15 99.87 GB 0.0 7.3 2.6 4.7 11.0 6.3 4.3 2.9 134.9 204.0 55.38 51.45 89 0.622 7577K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.3 2.6 4.7 11.0 6.3 4.2 2.9 134.9 204.0 55.38 51.45 89 0.622 7577K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.3 2.6 4.7 7.3 2.6 0.0 0.0 179.8 179.4 41.55 39.33 28 1.484 7577K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 277.7 13.84 12.12 61 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.4 total, 26.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.03 GB write, 412.89 MB/s write, 7.29 GB read, 272.99 MB/s read, 55.4 seconds Interval compaction: 11.03 GB write, 419.85 MB/s write, 7.29 GB read, 277.59 MB/s read, 55.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1242039 Average: 2.9758 StdDev: 15.39 Min: 0 Median: 2.1439 Max: 5013 Percentiles: P50: 2.14 P75: 2.72 P99: 7.86 P99.9: 13.13 P99.99: 37.39 ------------------------------------------------------ [ 0, 1 ] 16026 1.290% 1.290% ( 1, 2 ] 527435 42.465% 43.756% ######## ( 2, 3 ] 538813 43.381% 87.137% ######### ( 3, 4 ] 68393 5.507% 92.643% # ( 4, 6 ] 70461 5.673% 98.316% # ( 6, 10 ] 18271 1.471% 99.787% ( 10, 15 ] 2236 0.180% 99.967% ( 15, 22 ] 243 0.020% 99.987% ( 22, 34 ] 35 0.003% 99.990% ( 34, 51 ] 9 0.001% 99.991% ( 51, 76 ] 16 0.001% 99.992% ( 76, 110 ] 19 0.002% 99.993% ( 110, 170 ] 90 0.007% 100.001% ( 170, 250 ] 102 0.008% 100.009% ( 250, 380 ] 29 0.002% 100.011% ( 380, 580 ] 48 0.004% 100.015% ( 580, 870 ] 28 0.002% 100.017% ( 870, 1300 ] 19 0.002% 100.019% ( 1300, 1900 ] 6 0.000% 100.019% ( 1900, 2900 ] 5 0.000% 100.020% ( 2900, 4400 ] 14 0.001% 100.021% ( 4400, 6600 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 603447 Average: 3.1297 StdDev: 17.47 Min: 1 Median: 2.2712 Max: 9906 Percentiles: P50: 2.27 P75: 2.79 P99: 8.50 P99.9: 14.42 P99.99: 181.33 ------------------------------------------------------ [ 0, 1 ] 2579 0.427% 0.427% ( 1, 2 ] 219993 36.456% 36.883% ####### ( 2, 3 ] 291843 48.363% 85.246% ########## ( 3, 4 ] 37857 6.273% 91.520% # ( 4, 6 ] 38269 6.342% 97.861% # ( 6, 10 ] 10978 1.819% 99.681% ( 10, 15 ] 1500 0.249% 99.929% ( 15, 22 ] 210 0.035% 99.964% ( 22, 34 ] 22 0.004% 99.968% ( 51, 76 ] 5 0.001% 99.968% ( 76, 110 ] 29 0.005% 99.973% ( 110, 170 ] 95 0.016% 99.989% ( 170, 250 ] 47 0.008% 99.997% ( 250, 380 ] 17 0.003% 100.000% ( 380, 580 ] 37 0.006% 100.006% ( 580, 870 ] 18 0.003% 100.009% ( 870, 1300 ] 9 0.001% 100.010% ( 1300, 1900 ] 8 0.001% 100.011% ( 1900, 2900 ] 2 0.000% 100.012% ( 4400, 6600 ] 1 0.000% 100.012% ( 9900, 14000 ] 1 0.000% 100.012% ** Level 2 read latency histogram (micros): Count: 120428 Average: 3.1067 StdDev: 26.43 Min: 1 Median: 2.1236 Max: 8019 Percentiles: P50: 2.12 P75: 2.69 P99: 8.52 P99.9: 16.94 P99.99: 578.93 ------------------------------------------------------ [ 0, 1 ] 165 0.137% 0.137% ( 1, 2 ] 53466 44.397% 44.534% ######### ( 2, 3 ] 53277 44.240% 88.773% ######### ( 3, 4 ] 5505 4.571% 93.345% # ( 4, 6 ] 5559 4.616% 97.961% # ( 6, 10 ] 1987 1.650% 99.611% ( 10, 15 ] 335 0.278% 99.889% ( 15, 22 ] 49 0.041% 99.929% ( 22, 34 ] 4 0.003% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 2 0.002% 99.935% ( 76, 110 ] 5 0.004% 99.939% ( 110, 170 ] 29 0.024% 99.963% ( 170, 250 ] 15 0.012% 99.976% ( 250, 380 ] 9 0.007% 99.983% ( 380, 580 ] 8 0.007% 99.990% ( 580, 870 ] 7 0.006% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 212413 Average: 5.5917 StdDev: 115.67 Min: 1 Median: 2.5083 Max: 13196 Percentiles: P50: 2.51 P75: 3.38 P99: 10.19 P99.9: 90.59 P99.99: 193.58 ------------------------------------------------------ [ 0, 1 ] 4199 1.977% 1.977% ( 1, 2 ] 54935 25.862% 27.839% ##### ( 2, 3 ] 92606 43.597% 71.436% ######### ( 3, 4 ] 20122 9.473% 80.909% ## ( 4, 6 ] 27372 12.886% 93.796% ### ( 6, 10 ] 10991 5.174% 98.970% # ( 10, 15 ] 1656 0.780% 99.750% ( 15, 22 ] 282 0.133% 99.882% ( 22, 34 ] 21 0.010% 99.892% ( 34, 51 ] 4 0.002% 99.894% ( 51, 76 ] 1 0.000% 99.895% ( 76, 110 ] 27 0.013% 99.907% ( 110, 170 ] 151 0.071% 99.978% ( 170, 250 ] 84 0.040% 100.018% ( 250, 380 ] 46 0.022% 100.040% ( 380, 580 ] 41 0.019% 100.059% ( 580, 870 ] 21 0.010% 100.069% ( 870, 1300 ] 22 0.010% 100.079% ( 1300, 1900 ] 15 0.007% 100.086% ( 1900, 2900 ] 9 0.004% 100.090% ( 2900, 4400 ] 10 0.005% 100.095% ( 4400, 6600 ] 7 0.003% 100.098% ( 6600, 9900 ] 7 0.003% 100.102% ( 9900, 14000 ] 14 0.007% 100.108% ** Level 4 read latency histogram (micros): Count: 7923 Average: 49.1638 StdDev: 279.88 Min: 0 Median: 2.9704 Max: 8401 Percentiles: P50: 2.97 P75: 5.17 P99: 820.05 P99.9: 4011.34 P99.99: 6828.47 ------------------------------------------------------ [ 0, 1 ] 98 1.237% 1.237% ( 1, 2 ] 1321 16.673% 17.910% ### ( 2, 3 ] 2620 33.068% 50.978% ####### ( 3, 4 ] 1068 13.480% 64.458% ### ( 4, 6 ] 1424 17.973% 82.431% #### ( 6, 10 ] 561 7.081% 89.512% # ( 10, 15 ] 121 1.527% 91.039% ( 15, 22 ] 30 0.379% 91.417% ( 22, 34 ] 12 0.151% 91.569% ( 34, 51 ] 1 0.013% 91.581% ( 76, 110 ] 9 0.114% 91.695% ( 110, 170 ] 97 1.224% 92.919% ( 170, 250 ] 176 2.221% 95.141% ( 250, 380 ] 129 1.628% 96.769% ( 380, 580 ] 118 1.489% 98.258% ( 580, 870 ] 71 0.896% 99.154% ( 870, 1300 ] 25 0.316% 99.470% ( 1300, 1900 ] 8 0.101% 99.571% ( 1900, 2900 ] 12 0.151% 99.722% ( 2900, 4400 ] 19 0.240% 99.962% ( 4400, 6600 ] 2 0.025% 99.987% ( 6600, 9900 ] 3 0.038% 100.025% ** Level 5 read latency histogram (micros): Count: 100 Average: 768.0600 StdDev: 943.68 Min: 88 Median: 205.5556 Max: 3302 Percentiles: P50: 205.56 P75: 847.69 P99: 3302.00 P99.9: 3302.00 P99.99: 3302.00 ------------------------------------------------------ ( 76, 110 ] 11 11.000% 11.000% ## ( 110, 170 ] 35 35.000% 46.000% ####### ( 170, 250 ] 9 9.000% 55.000% ## ( 250, 380 ] 2 2.000% 57.000% ( 380, 580 ] 6 6.000% 63.000% # ( 580, 870 ] 13 13.000% 76.000% ### ( 870, 1300 ] 2 2.000% 78.000% ( 1300, 1900 ] 5 5.000% 83.000% # ( 1900, 2900 ] 12 12.000% 95.000% ## ( 2900, 4400 ] 5 5.000% 100.000% # ** DB Stats ** Uptime(secs): 27.4 total, 4.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 143.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 237.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/10-14:22:07 ... thread 0: (1000000,5000000) ops and (254912.8,162210.3) ops/second in (3.922910,30.824182) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.15 GB 195.1 3.2 0.0 3.2 7.9 4.7 0.0 1.7 96.2 238.4 34.07 31.52 90 0.379 3326K 3306 0.0 0.0 L1 9/0 969.25 MB 96.9 3.9 2.4 1.5 3.9 2.4 0.2 1.6 173.6 172.9 22.92 22.26 6 3.819 4039K 14K 0.0 0.0 L2 3/2 309.88 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.5 2.2 178.2 178.1 2.55 2.43 4 0.639 462K 262 0.0 0.0 L3 24/7 1001.02 MB 0.6 1.7 0.4 1.2 1.7 0.4 1.0 3.9 176.9 176.3 9.64 9.17 5 1.929 1732K 5435 0.0 0.0 L4 208/0 9.61 GB 1.0 0.5 0.5 0.0 0.5 0.5 0.8 1.1 117.2 117.1 4.27 3.19 6 0.711 501K 378 0.0 0.0 L5 1352/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1610/13 100.85 GB 0.0 9.7 3.5 6.2 14.4 8.2 4.7 3.0 135.0 200.7 73.45 68.58 111 0.662 10M 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.7 3.5 6.2 14.4 8.2 4.6 3.0 135.0 200.7 73.45 68.58 111 0.662 10M 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.7 3.5 6.2 9.7 3.5 0.0 0.0 176.7 176.3 56.10 53.39 34 1.650 10M 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 279.6 17.35 15.19 77 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.3 total, 30.8 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.40 GB write, 471.28 MB/s write, 9.68 GB read, 316.98 MB/s read, 73.5 seconds Interval compaction: 14.40 GB write, 478.22 MB/s write, 9.68 GB read, 321.65 MB/s read, 73.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1541092 Average: 3.0590 StdDev: 14.72 Min: 0 Median: 2.1999 Max: 5013 Percentiles: P50: 2.20 P75: 2.78 P99: 8.48 P99.9: 13.08 P99.99: 15.97 ------------------------------------------------------ [ 0, 1 ] 22197 1.440% 1.440% ( 1, 2 ] 616642 40.013% 41.454% ######## ( 2, 3 ] 658983 42.761% 84.214% ######### ( 3, 4 ] 99499 6.456% 90.671% # ( 4, 6 ] 109283 7.091% 97.762% # ( 6, 10 ] 30813 1.999% 99.762% ( 10, 15 ] 3462 0.225% 99.986% ( 15, 22 ] 423 0.027% 100.014% ( 22, 34 ] 41 0.003% 100.016% ( 34, 51 ] 12 0.001% 100.017% ( 51, 76 ] 16 0.001% 100.018% ( 76, 110 ] 19 0.001% 100.019% ( 110, 170 ] 92 0.006% 100.025% ( 170, 250 ] 114 0.007% 100.033% ( 250, 380 ] 29 0.002% 100.035% ( 380, 580 ] 55 0.004% 100.038% ( 580, 870 ] 34 0.002% 100.040% ( 870, 1300 ] 26 0.002% 100.042% ( 1300, 1900 ] 11 0.001% 100.043% ( 1900, 2900 ] 5 0.000% 100.043% ( 2900, 4400 ] 15 0.001% 100.044% ( 4400, 6600 ] 1 0.000% 100.044% ** Level 1 read latency histogram (micros): Count: 711122 Average: 3.3625 StdDev: 19.01 Min: 1 Median: 2.3205 Max: 9906 Percentiles: P50: 2.32 P75: 2.85 P99: 9.23 P99.9: 19.06 P99.99: 320.11 ------------------------------------------------------ [ 0, 1 ] 4114 0.579% 0.579% ( 1, 2 ] 244478 34.379% 34.958% ####### ( 2, 3 ] 333719 46.929% 81.886% ######### ( 3, 4 ] 48481 6.818% 88.704% # ( 4, 6 ] 58392 8.211% 96.915% ## ( 6, 10 ] 18341 2.579% 99.494% # ( 10, 15 ] 2600 0.366% 99.860% ( 15, 22 ] 493 0.069% 99.929% ( 22, 34 ] 45 0.006% 99.935% ( 34, 51 ] 1 0.000% 99.936% ( 51, 76 ] 6 0.001% 99.936% ( 76, 110 ] 40 0.006% 99.942% ( 110, 170 ] 196 0.028% 99.970% ( 170, 250 ] 119 0.017% 99.986% ( 250, 380 ] 48 0.007% 99.993% ( 380, 580 ] 67 0.009% 100.003% ( 580, 870 ] 51 0.007% 100.010% ( 870, 1300 ] 15 0.002% 100.012% ( 1300, 1900 ] 16 0.002% 100.014% ( 1900, 2900 ] 3 0.000% 100.014% ( 2900, 4400 ] 1 0.000% 100.015% ( 4400, 6600 ] 1 0.000% 100.015% ( 9900, 14000 ] 1 0.000% 100.015% ** Level 2 read latency histogram (micros): Count: 120428 Average: 3.1067 StdDev: 26.43 Min: 1 Median: 2.1236 Max: 8019 Percentiles: P50: 2.12 P75: 2.69 P99: 8.52 P99.9: 16.94 P99.99: 578.93 ------------------------------------------------------ [ 0, 1 ] 165 0.137% 0.137% ( 1, 2 ] 53466 44.397% 44.534% ######### ( 2, 3 ] 53277 44.240% 88.773% ######### ( 3, 4 ] 5505 4.571% 93.345% # ( 4, 6 ] 5559 4.616% 97.961% # ( 6, 10 ] 1987 1.650% 99.611% ( 10, 15 ] 335 0.278% 99.889% ( 15, 22 ] 49 0.041% 99.929% ( 22, 34 ] 4 0.003% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 2 0.002% 99.935% ( 76, 110 ] 5 0.004% 99.939% ( 110, 170 ] 29 0.024% 99.963% ( 170, 250 ] 15 0.012% 99.976% ( 250, 380 ] 9 0.007% 99.983% ( 380, 580 ] 8 0.007% 99.990% ( 580, 870 ] 7 0.006% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 281671 Average: 5.4415 StdDev: 100.90 Min: 1 Median: 2.5397 Max: 13196 Percentiles: P50: 2.54 P75: 3.73 P99: 11.64 P99.9: 146.46 P99.99: 226.74 ------------------------------------------------------ [ 0, 1 ] 6083 2.160% 2.160% ( 1, 2 ] 75383 26.763% 28.922% ##### ( 2, 3 ] 110009 39.056% 67.978% ######## ( 3, 4 ] 26977 9.577% 77.556% ## ( 4, 6 ] 43267 15.361% 92.917% ### ( 6, 10 ] 16364 5.810% 98.726% # ( 10, 15 ] 2354 0.836% 99.562% ( 15, 22 ] 622 0.221% 99.783% ( 22, 34 ] 51 0.018% 99.801% ( 34, 51 ] 4 0.001% 99.802% ( 51, 76 ] 1 0.000% 99.803% ( 76, 110 ] 43 0.015% 99.818% ( 110, 170 ] 384 0.136% 99.954% ( 170, 250 ] 145 0.051% 100.006% ( 250, 380 ] 80 0.028% 100.034% ( 380, 580 ] 68 0.024% 100.058% ( 580, 870 ] 35 0.012% 100.071% ( 870, 1300 ] 25 0.009% 100.080% ( 1300, 1900 ] 15 0.005% 100.085% ( 1900, 2900 ] 9 0.003% 100.088% ( 2900, 4400 ] 10 0.004% 100.092% ( 4400, 6600 ] 7 0.002% 100.094% ( 6600, 9900 ] 7 0.002% 100.097% ( 9900, 14000 ] 14 0.005% 100.102% ** Level 4 read latency histogram (micros): Count: 7923 Average: 49.1638 StdDev: 279.88 Min: 0 Median: 2.9704 Max: 8401 Percentiles: P50: 2.97 P75: 5.17 P99: 820.05 P99.9: 4011.34 P99.99: 6828.47 ------------------------------------------------------ [ 0, 1 ] 98 1.237% 1.237% ( 1, 2 ] 1321 16.673% 17.910% ### ( 2, 3 ] 2620 33.068% 50.978% ####### ( 3, 4 ] 1068 13.480% 64.458% ### ( 4, 6 ] 1424 17.973% 82.431% #### ( 6, 10 ] 561 7.081% 89.512% # ( 10, 15 ] 121 1.527% 91.039% ( 15, 22 ] 30 0.379% 91.417% ( 22, 34 ] 12 0.151% 91.569% ( 34, 51 ] 1 0.013% 91.581% ( 76, 110 ] 9 0.114% 91.695% ( 110, 170 ] 97 1.224% 92.919% ( 170, 250 ] 176 2.221% 95.141% ( 250, 380 ] 129 1.628% 96.769% ( 380, 580 ] 118 1.489% 98.258% ( 580, 870 ] 71 0.896% 99.154% ( 870, 1300 ] 25 0.316% 99.470% ( 1300, 1900 ] 8 0.101% 99.571% ( 1900, 2900 ] 12 0.151% 99.722% ( 2900, 4400 ] 19 0.240% 99.962% ( 4400, 6600 ] 2 0.025% 99.987% ( 6600, 9900 ] 3 0.038% 100.025% ** Level 5 read latency histogram (micros): Count: 100 Average: 768.0600 StdDev: 943.68 Min: 88 Median: 205.5556 Max: 3302 Percentiles: P50: 205.56 P75: 847.69 P99: 3302.00 P99.9: 3302.00 P99.99: 3302.00 ------------------------------------------------------ ( 76, 110 ] 11 11.000% 11.000% ## ( 110, 170 ] 35 35.000% 46.000% ####### ( 170, 250 ] 9 9.000% 55.000% ## ( 250, 380 ] 2 2.000% 57.000% ( 380, 580 ] 6 6.000% 63.000% # ( 580, 870 ] 13 13.000% 76.000% ### ( 870, 1300 ] 2 2.000% 78.000% ( 1300, 1900 ] 5 5.000% 83.000% # ( 1900, 2900 ] 12 12.000% 95.000% ## ( 2900, 4400 ] 5 5.000% 100.000% # ** DB Stats ** Uptime(secs): 31.3 total, 3.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 157.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 250.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/10-14:22:11 ... thread 0: (1000000,6000000) ops and (263205.6,173292.7) ops/second in (3.799311,34.623493) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.07 GB 251.7 3.9 0.0 3.9 9.6 5.7 0.0 1.7 96.8 235.7 41.67 38.37 106 0.393 4093K 4055 0.0 0.0 L1 9/0 969.25 MB 96.9 3.9 2.4 1.5 3.9 2.4 0.2 1.6 173.6 172.9 22.92 22.26 6 3.819 4039K 14K 0.0 0.0 L2 1/0 52.34 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.5 2.2 178.2 178.1 2.55 2.43 4 0.639 462K 262 0.0 0.0 L3 23/0 985.13 MB 1.0 2.3 0.7 1.6 2.3 0.7 1.0 3.3 163.4 162.9 14.21 13.43 7 2.030 2358K 8055 0.0 0.0 L4 210/0 9.63 GB 1.0 0.8 0.7 0.0 0.8 0.7 0.8 1.1 116.1 115.9 6.83 5.05 12 0.569 798K 922 0.0 0.0 L5 1356/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1617/8 101.77 GB 0.0 11.3 4.0 7.3 16.9 9.6 4.9 3.0 131.3 196.7 88.18 81.54 135 0.653 11M 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.3 4.0 7.3 16.9 9.6 4.8 3.0 131.3 196.7 88.18 81.54 135 0.653 11M 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.3 4.0 7.3 11.3 4.0 0.0 0.0 171.9 171.5 67.37 63.40 45 1.497 11M 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 278.5 20.81 18.14 90 0.231 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.1 total, 34.6 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.94 GB write, 494.51 MB/s write, 11.31 GB read, 330.09 MB/s read, 88.2 seconds Interval compaction: 16.94 GB write, 500.99 MB/s write, 11.31 GB read, 334.42 MB/s read, 88.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1758745 Average: 3.0670 StdDev: 16.92 Min: 0 Median: 2.1864 Max: 5013 Percentiles: P50: 2.19 P75: 2.78 P99: 8.50 P99.9: 13.18 P99.99: 17.34 ------------------------------------------------------ [ 0, 1 ] 22275 1.267% 1.267% ( 1, 2 ] 718002 40.825% 42.091% ######## ( 2, 3 ] 746185 42.427% 84.518% ######## ( 3, 4 ] 111306 6.329% 90.847% # ( 4, 6 ] 121035 6.882% 97.729% # ( 6, 10 ] 35711 2.030% 99.759% ( 10, 15 ] 3886 0.221% 99.980% ( 15, 22 ] 510 0.029% 100.009% ( 22, 34 ] 56 0.003% 100.013% ( 34, 51 ] 15 0.001% 100.013% ( 51, 76 ] 19 0.001% 100.014% ( 76, 110 ] 21 0.001% 100.016% ( 110, 170 ] 92 0.005% 100.021% ( 170, 250 ] 125 0.007% 100.028% ( 250, 380 ] 29 0.002% 100.030% ( 380, 580 ] 61 0.003% 100.033% ( 580, 870 ] 40 0.002% 100.035% ( 870, 1300 ] 32 0.002% 100.037% ( 1300, 1900 ] 11 0.001% 100.038% ( 1900, 2900 ] 9 0.001% 100.038% ( 2900, 4400 ] 24 0.001% 100.040% ( 4400, 6600 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 726365 Average: 3.3923 StdDev: 18.82 Min: 1 Median: 2.3329 Max: 9906 Percentiles: P50: 2.33 P75: 2.87 P99: 9.37 P99.9: 19.73 P99.99: 299.73 ------------------------------------------------------ [ 0, 1 ] 4440 0.611% 0.611% ( 1, 2 ] 247208 34.034% 34.645% ####### ( 2, 3 ] 335084 46.132% 80.776% ######### ( 3, 4 ] 50461 6.947% 87.724% # ( 4, 6 ] 64971 8.945% 96.668% ## ( 6, 10 ] 20131 2.771% 99.440% # ( 10, 15 ] 2896 0.399% 99.838% ( 15, 22 ] 663 0.091% 99.930% ( 22, 34 ] 57 0.008% 99.937% ( 34, 51 ] 2 0.000% 99.938% ( 51, 76 ] 6 0.001% 99.939% ( 76, 110 ] 40 0.006% 99.944% ( 110, 170 ] 196 0.027% 99.971% ( 170, 250 ] 119 0.016% 99.987% ( 250, 380 ] 48 0.007% 99.994% ( 380, 580 ] 67 0.009% 100.003% ( 580, 870 ] 51 0.007% 100.010% ( 870, 1300 ] 15 0.002% 100.012% ( 1300, 1900 ] 16 0.002% 100.015% ( 1900, 2900 ] 3 0.000% 100.015% ( 2900, 4400 ] 1 0.000% 100.015% ( 4400, 6600 ] 1 0.000% 100.015% ( 9900, 14000 ] 1 0.000% 100.015% ** Level 2 read latency histogram (micros): Count: 120428 Average: 3.1067 StdDev: 26.43 Min: 1 Median: 2.1236 Max: 8019 Percentiles: P50: 2.12 P75: 2.69 P99: 8.52 P99.9: 16.94 P99.99: 578.93 ------------------------------------------------------ [ 0, 1 ] 165 0.137% 0.137% ( 1, 2 ] 53466 44.397% 44.534% ######### ( 2, 3 ] 53277 44.240% 88.773% ######### ( 3, 4 ] 5505 4.571% 93.345% # ( 4, 6 ] 5559 4.616% 97.961% # ( 6, 10 ] 1987 1.650% 99.611% ( 10, 15 ] 335 0.278% 99.889% ( 15, 22 ] 49 0.041% 99.929% ( 22, 34 ] 4 0.003% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 2 0.002% 99.935% ( 76, 110 ] 5 0.004% 99.939% ( 110, 170 ] 29 0.024% 99.963% ( 170, 250 ] 15 0.012% 99.976% ( 250, 380 ] 9 0.007% 99.983% ( 380, 580 ] 8 0.007% 99.990% ( 580, 870 ] 7 0.006% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 384389 Average: 5.2148 StdDev: 87.72 Min: 1 Median: 2.6480 Max: 13196 Percentiles: P50: 2.65 P75: 4.14 P99: 11.63 P99.9: 27.94 P99.99: 146.13 ------------------------------------------------------ [ 0, 1 ] 6856 1.784% 1.784% ( 1, 2 ] 92149 23.973% 25.756% ##### ( 2, 3 ] 143806 37.412% 63.168% ####### ( 3, 4 ] 40711 10.591% 73.759% ## ( 4, 6 ] 70162 18.253% 92.012% #### ( 6, 10 ] 25707 6.688% 98.700% # ( 10, 15 ] 3542 0.921% 99.621% ( 15, 22 ] 1034 0.269% 99.890% ( 22, 34 ] 76 0.020% 99.910% ( 34, 51 ] 4 0.001% 99.911% ( 51, 76 ] 1 0.000% 99.911% ( 76, 110 ] 43 0.011% 99.922% ( 110, 170 ] 431 0.112% 100.035% ( 170, 250 ] 158 0.041% 100.076% ( 250, 380 ] 87 0.023% 100.098% ( 380, 580 ] 81 0.021% 100.119% ( 580, 870 ] 38 0.010% 100.129% ( 870, 1300 ] 29 0.008% 100.137% ( 1300, 1900 ] 15 0.004% 100.141% ( 1900, 2900 ] 11 0.003% 100.144% ( 2900, 4400 ] 14 0.004% 100.147% ( 4400, 6600 ] 7 0.002% 100.149% ( 6600, 9900 ] 7 0.002% 100.151% ( 9900, 14000 ] 14 0.004% 100.155% ** Level 4 read latency histogram (micros): Count: 13369 Average: 47.3011 StdDev: 248.46 Min: 0 Median: 2.9414 Max: 8401 Percentiles: P50: 2.94 P75: 5.10 P99: 811.03 P99.9: 3744.10 P99.99: 5129.41 ------------------------------------------------------ [ 0, 1 ] 115 0.860% 0.860% ( 1, 2 ] 2208 16.516% 17.376% ### ( 2, 3 ] 4633 34.655% 52.031% ####### ( 3, 4 ] 1776 13.284% 65.315% ### ( 4, 6 ] 2359 17.645% 82.961% #### ( 6, 10 ] 892 6.672% 89.633% # ( 10, 15 ] 191 1.429% 91.061% ( 15, 22 ] 52 0.389% 91.450% ( 22, 34 ] 13 0.097% 91.548% ( 34, 51 ] 3 0.022% 91.570% ( 76, 110 ] 10 0.075% 91.645% ( 110, 170 ] 153 1.144% 92.789% ( 170, 250 ] 261 1.952% 94.742% ( 250, 380 ] 230 1.720% 96.462% ( 380, 580 ] 223 1.668% 98.130% ( 580, 870 ] 146 1.092% 99.222% ( 870, 1300 ] 48 0.359% 99.581% ( 1300, 1900 ] 11 0.082% 99.663% ( 1900, 2900 ] 17 0.127% 99.791% ( 2900, 4400 ] 26 0.194% 99.985% ( 4400, 6600 ] 2 0.015% 100.000% ( 6600, 9900 ] 3 0.022% 100.022% ** Level 5 read latency histogram (micros): Count: 120 Average: 787.4667 StdDev: 993.80 Min: 88 Median: 206.3636 Max: 4813 Percentiles: P50: 206.36 P75: 870.00 P99: 4340.00 P99.9: 4813.00 P99.99: 4813.00 ------------------------------------------------------ ( 76, 110 ] 14 11.667% 11.667% ## ( 110, 170 ] 41 34.167% 45.833% ####### ( 170, 250 ] 11 9.167% 55.000% ## ( 250, 380 ] 2 1.667% 56.667% ( 380, 580 ] 7 5.833% 62.500% # ( 580, 870 ] 15 12.500% 75.000% ### ( 870, 1300 ] 3 2.500% 77.500% # ( 1300, 1900 ] 7 5.833% 83.333% # ( 1900, 2900 ] 14 11.667% 95.000% ## ( 2900, 4400 ] 5 4.167% 99.167% # ( 4400, 6600 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 35.1 total, 3.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 168.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.653 H:M:S, 1.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 259.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.653 H:M:S, 17.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/10-14:22:16 ... thread 0: (1000000,7000000) ops and (196160.6,176227.6) ops/second in (5.097864,39.721357) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 4.06 GB 18.9 5.2 0.0 5.2 11.9 6.6 0.0 1.8 101.1 229.4 52.97 49.18 122 0.434 5437K 5729 0.0 0.0 L1 9/9 969.25 MB 0.0 3.9 2.4 1.5 3.9 2.4 0.2 1.6 173.6 172.9 22.92 22.26 6 3.819 4039K 14K 0.0 0.0 L2 1/0 52.34 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.5 2.2 178.2 178.1 2.55 2.43 4 0.639 462K 262 0.0 0.0 L3 23/0 985.13 MB 1.0 2.3 0.7 1.6 2.3 0.7 1.0 3.3 163.4 162.9 14.21 13.43 7 2.030 2358K 8055 0.0 0.0 L4 210/0 9.63 GB 1.0 0.8 0.7 0.0 0.8 0.7 0.8 1.1 116.1 115.9 6.83 5.05 12 0.569 798K 922 0.0 0.0 L5 1356/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1617/25 102.75 GB 0.0 12.6 4.0 8.6 19.2 10.6 4.9 2.9 129.7 197.8 99.48 92.35 151 0.659 13M 29K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.6 4.0 8.6 19.2 10.6 4.8 2.9 129.7 197.8 99.48 92.35 151 0.659 13M 29K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.6 4.0 8.6 12.6 4.0 0.0 0.0 171.6 171.2 75.17 71.06 49 1.534 13M 29K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 279.9 24.31 21.30 102 0.238 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.2 total, 39.7 interval Flush(GB): cumulative 6.645, interval 6.645 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.22 GB write, 489.73 MB/s write, 12.60 GB read, 321.13 MB/s read, 99.5 seconds Interval compaction: 19.22 GB write, 495.33 MB/s write, 12.60 GB read, 324.80 MB/s read, 99.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 10, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2055710 Average: 3.1421 StdDev: 16.66 Min: 0 Median: 2.2115 Max: 5013 Percentiles: P50: 2.21 P75: 2.83 P99: 8.62 P99.9: 13.66 P99.99: 21.32 ------------------------------------------------------ [ 0, 1 ] 22369 1.088% 1.088% ( 1, 2 ] 828730 40.314% 41.402% ######## ( 2, 3 ] 835723 40.654% 82.055% ######## ( 3, 4 ] 162931 7.926% 89.981% ## ( 4, 6 ] 156983 7.636% 97.618% ## ( 6, 10 ] 43423 2.112% 99.730% ( 10, 15 ] 4777 0.232% 99.962% ( 15, 22 ] 630 0.031% 99.993% ( 22, 34 ] 68 0.003% 99.996% ( 34, 51 ] 18 0.001% 99.997% ( 51, 76 ] 20 0.001% 99.998% ( 76, 110 ] 44 0.002% 100.000% ( 110, 170 ] 357 0.017% 100.018% ( 170, 250 ] 211 0.010% 100.028% ( 250, 380 ] 61 0.003% 100.031% ( 380, 580 ] 90 0.004% 100.035% ( 580, 870 ] 48 0.002% 100.038% ( 870, 1300 ] 42 0.002% 100.040% ( 1300, 1900 ] 14 0.001% 100.040% ( 1900, 2900 ] 10 0.000% 100.041% ( 2900, 4400 ] 26 0.001% 100.042% ( 4400, 6600 ] 1 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 726366 Average: 3.3926 StdDev: 18.82 Min: 1 Median: 2.3329 Max: 9906 Percentiles: P50: 2.33 P75: 2.87 P99: 9.37 P99.9: 19.74 P99.99: 299.73 ------------------------------------------------------ [ 0, 1 ] 4440 0.611% 0.611% ( 1, 2 ] 247208 34.034% 34.645% ####### ( 2, 3 ] 335084 46.132% 80.776% ######### ( 3, 4 ] 50461 6.947% 87.723% # ( 4, 6 ] 64971 8.945% 96.668% ## ( 6, 10 ] 20131 2.771% 99.440% # ( 10, 15 ] 2896 0.399% 99.838% ( 15, 22 ] 663 0.091% 99.930% ( 22, 34 ] 57 0.008% 99.937% ( 34, 51 ] 2 0.000% 99.938% ( 51, 76 ] 6 0.001% 99.938% ( 76, 110 ] 40 0.006% 99.944% ( 110, 170 ] 196 0.027% 99.971% ( 170, 250 ] 120 0.017% 99.987% ( 250, 380 ] 48 0.007% 99.994% ( 380, 580 ] 67 0.009% 100.003% ( 580, 870 ] 51 0.007% 100.010% ( 870, 1300 ] 15 0.002% 100.012% ( 1300, 1900 ] 16 0.002% 100.015% ( 1900, 2900 ] 3 0.000% 100.015% ( 2900, 4400 ] 1 0.000% 100.015% ( 4400, 6600 ] 1 0.000% 100.015% ( 9900, 14000 ] 1 0.000% 100.015% ** Level 2 read latency histogram (micros): Count: 120428 Average: 3.1067 StdDev: 26.43 Min: 1 Median: 2.1236 Max: 8019 Percentiles: P50: 2.12 P75: 2.69 P99: 8.52 P99.9: 16.94 P99.99: 578.93 ------------------------------------------------------ [ 0, 1 ] 165 0.137% 0.137% ( 1, 2 ] 53466 44.397% 44.534% ######### ( 2, 3 ] 53277 44.240% 88.773% ######### ( 3, 4 ] 5505 4.571% 93.345% # ( 4, 6 ] 5559 4.616% 97.961% # ( 6, 10 ] 1987 1.650% 99.611% ( 10, 15 ] 335 0.278% 99.889% ( 15, 22 ] 49 0.041% 99.929% ( 22, 34 ] 4 0.003% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 2 0.002% 99.935% ( 76, 110 ] 5 0.004% 99.939% ( 110, 170 ] 29 0.024% 99.963% ( 170, 250 ] 15 0.012% 99.976% ( 250, 380 ] 9 0.007% 99.983% ( 380, 580 ] 8 0.007% 99.990% ( 580, 870 ] 7 0.006% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 384389 Average: 5.2148 StdDev: 87.72 Min: 1 Median: 2.6480 Max: 13196 Percentiles: P50: 2.65 P75: 4.14 P99: 11.63 P99.9: 27.94 P99.99: 146.13 ------------------------------------------------------ [ 0, 1 ] 6856 1.784% 1.784% ( 1, 2 ] 92149 23.973% 25.756% ##### ( 2, 3 ] 143806 37.412% 63.168% ####### ( 3, 4 ] 40711 10.591% 73.759% ## ( 4, 6 ] 70162 18.253% 92.012% #### ( 6, 10 ] 25707 6.688% 98.700% # ( 10, 15 ] 3542 0.921% 99.621% ( 15, 22 ] 1034 0.269% 99.890% ( 22, 34 ] 76 0.020% 99.910% ( 34, 51 ] 4 0.001% 99.911% ( 51, 76 ] 1 0.000% 99.911% ( 76, 110 ] 43 0.011% 99.922% ( 110, 170 ] 431 0.112% 100.035% ( 170, 250 ] 158 0.041% 100.076% ( 250, 380 ] 87 0.023% 100.098% ( 380, 580 ] 81 0.021% 100.119% ( 580, 870 ] 38 0.010% 100.129% ( 870, 1300 ] 29 0.008% 100.137% ( 1300, 1900 ] 15 0.004% 100.141% ( 1900, 2900 ] 11 0.003% 100.144% ( 2900, 4400 ] 14 0.004% 100.147% ( 4400, 6600 ] 7 0.002% 100.149% ( 6600, 9900 ] 7 0.002% 100.151% ( 9900, 14000 ] 14 0.004% 100.155% ** Level 4 read latency histogram (micros): Count: 13369 Average: 47.3011 StdDev: 248.46 Min: 0 Median: 2.9414 Max: 8401 Percentiles: P50: 2.94 P75: 5.10 P99: 811.03 P99.9: 3744.10 P99.99: 5129.41 ------------------------------------------------------ [ 0, 1 ] 115 0.860% 0.860% ( 1, 2 ] 2208 16.516% 17.376% ### ( 2, 3 ] 4633 34.655% 52.031% ####### ( 3, 4 ] 1776 13.284% 65.315% ### ( 4, 6 ] 2359 17.645% 82.961% #### ( 6, 10 ] 892 6.672% 89.633% # ( 10, 15 ] 191 1.429% 91.061% ( 15, 22 ] 52 0.389% 91.450% ( 22, 34 ] 13 0.097% 91.548% ( 34, 51 ] 3 0.022% 91.570% ( 76, 110 ] 10 0.075% 91.645% ( 110, 170 ] 153 1.144% 92.789% ( 170, 250 ] 261 1.952% 94.742% ( 250, 380 ] 230 1.720% 96.462% ( 380, 580 ] 223 1.668% 98.130% ( 580, 870 ] 146 1.092% 99.222% ( 870, 1300 ] 48 0.359% 99.581% ( 1300, 1900 ] 11 0.082% 99.663% ( 1900, 2900 ] 17 0.127% 99.791% ( 2900, 4400 ] 26 0.194% 99.985% ( 4400, 6600 ] 2 0.015% 100.000% ( 6600, 9900 ] 3 0.022% 100.022% ** Level 5 read latency histogram (micros): Count: 120 Average: 787.4667 StdDev: 993.80 Min: 88 Median: 206.3636 Max: 4813 Percentiles: P50: 206.36 P75: 870.00 P99: 4340.00 P99.9: 4813.00 P99.99: 4813.00 ------------------------------------------------------ ( 76, 110 ] 14 11.667% 11.667% ## ( 110, 170 ] 41 34.167% 45.833% ####### ( 170, 250 ] 11 9.167% 55.000% ## ( 250, 380 ] 2 1.667% 56.667% ( 380, 580 ] 7 5.833% 62.500% # ( 580, 870 ] 15 12.500% 75.000% ### ( 870, 1300 ] 3 2.500% 77.500% # ( 1300, 1900 ] 7 5.833% 83.333% # ( 1900, 2900 ] 14 11.667% 95.000% ## ( 2900, 4400 ] 5 4.167% 99.167% # ( 4400, 6600 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 40.2 total, 5.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 171.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.228 H:M:S, 8.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 193.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.574 H:M:S, 50.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 8.251 micros/op 121198 ops/sec 60.174 seconds 7292999 operations; 117.4 MB/s Microseconds per write: Count: 7292999 Average: 8.2509 StdDev: 275.62 Min: 1 Median: 4.0626 Max: 305297 Percentiles: P50: 4.06 P75: 5.69 P99: 14.92 P99.9: 1218.57 P99.99: 2778.52 ------------------------------------------------------ [ 0, 1 ] 268214 3.678% 3.678% # ( 1, 2 ] 1292163 17.718% 21.396% #### ( 2, 3 ] 1358420 18.626% 40.022% #### ( 3, 4 ] 657459 9.015% 49.037% ## ( 4, 6 ] 2244642 30.778% 79.815% ###### ( 6, 10 ] 1056261 14.483% 94.298% ### ( 10, 15 ] 348724 4.782% 99.080% # ( 15, 22 ] 38763 0.532% 99.611% ( 22, 34 ] 5775 0.079% 99.690% ( 34, 51 ] 883 0.012% 99.703% ( 51, 76 ] 121 0.002% 99.704% ( 76, 110 ] 1321 0.018% 99.722% ( 110, 170 ] 2626 0.036% 99.758% ( 170, 250 ] 2397 0.033% 99.791% ( 250, 380 ] 991 0.014% 99.805% ( 380, 580 ] 52 0.001% 99.805% ( 580, 870 ] 15 0.000% 99.806% ( 870, 1300 ] 8486 0.116% 99.922% ( 1300, 1900 ] 8 0.000% 99.922% ( 1900, 2900 ] 5633 0.077% 99.999% ( 2900, 4400 ] 29 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 250000, 380000 ] 6 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 107821 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 7292999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 7526374968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 350 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 22711261 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 17611848720 rocksdb.compact.write.bytes COUNT : 17518510397 rocksdb.flush.write.bytes COUNT : 7464736054 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 29 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 192 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 7404302336 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2664448 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 17671699040 rocksdb.non.last.level.read.count COUNT : 4271082 rocksdb.block.checksum.compute.count COUNT : 4270411 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 3.060236 P95 : 9.135674 P99 : 14.114976 P100 : 305296.000000 COUNT : 7292999 SUM : 53140565 rocksdb.compaction.times.micros P50 : 1375000.000000 P95 : 4850000.000000 P99 : 8076884.000000 P100 : 8076884.000000 COUNT : 50 SUM : 76705851 rocksdb.compaction.times.cpu_micros P50 : 1347368.421053 P95 : 4850000.000000 P99 : 7755460.000000 P100 : 7755460.000000 COUNT : 50 SUM : 72564371 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 773.333333 P95 : 1260.440000 P99 : 1662.000000 P100 : 1662.000000 COUNT : 106 SUM : 84895 rocksdb.compaction.outfile.sync.micros P50 : 852.277778 P95 : 1729.130435 P99 : 3245.000000 P100 : 4378.000000 COUNT : 231 SUM : 218634 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 136.707317 P95 : 464.166667 P99 : 640.900000 P100 : 2563.000000 COUNT : 179 SUM : 31729 rocksdb.table.open.io.micros P50 : 1246.986301 P95 : 6490.000000 P99 : 27867.000000 P100 : 27867.000000 COUNT : 350 SUM : 911123 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 5.062675 P95 : 9.316597 P99 : 14.059577 P100 : 7619.000000 COUNT : 4269349 SUM : 26449250 rocksdb.read.block.get.micros P50 : 435.696203 P95 : 4053.846154 P99 : 12086.666667 P100 : 13332.000000 COUNT : 700 SUM : 724196 rocksdb.write.raw.block.micros P50 : 0.542520 P95 : 1.507414 P99 : 3.985810 P100 : 10742.000000 COUNT : 6050835 SUM : 14159765 rocksdb.numfiles.in.singlecompaction P50 : 3.222222 P95 : 7.733333 P99 : 25.000000 P100 : 25.000000 COUNT : 74 SUM : 288 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558047 P95 : 1241.517567 P99 : 2660.341273 P100 : 305107.000000 COUNT : 135832 SUM : 22716967 rocksdb.sst.read.micros P50 : 2.181523 P95 : 5.467223 P99 : 9.255356 P100 : 13196.000000 COUNT : 4271110 SUM : 15195206 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 7292999 SUM : 7526374968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215106.382979 P95 : 444125.000000 P99 : 451474.000000 P100 : 451474.000000 COUNT : 106 SUM : 25438900 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 198 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0