[2024-12-10 22:38:40.722870] Starting SPDK v25.01-pre git sha1 2104eacf0 / DPDK 24.03.0 initialization... [2024-12-10 22:38:40.723185] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid884205 ] Set seed to 1733866720715974 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-10 22:38:40.848941] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-10 22:38:40.921248] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-10 22:38:40.921283] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 884205' to capture a snapshot of events at runtime. [2024-12-10 22:38:40.921292] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-10 22:38:40.921301] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-10 22:38:40.921309] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid884205 for offline analysis/debug. [2024-12-10 22:38:40.922249] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Dec 10 22:38:42 2024 CPU: 144 * Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz CPUCache: 55296 KB 2024/12/10-22:38:45 ... thread 0: (1000000,1000000) ops and (362998.7,362998.7) ops/second in (2.754831,2.754831) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 503.27 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 403.1 2.19 2.05 14 0.156 0 0 0.0 0.0 L1 4/3 312.46 MB 1.4 0.4 0.3 0.1 0.4 0.3 0.1 1.4 263.6 262.4 1.67 1.64 2 0.835 446K 2029 0.0 0.0 L2 2/1 97.82 MB 0.4 0.1 0.1 0.0 0.1 0.1 0.0 1.6 250.7 250.5 0.39 0.37 1 0.391 99K 107 0.0 0.0 L3 10/0 818.91 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 140/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 120/0 8.74 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 284/9 20.09 GB 0.0 0.5 0.4 0.2 1.4 1.2 0.1 1.6 126.8 333.7 4.24 4.06 17 0.250 546K 2136 0.0 0.0 Int 0/0 0.00 KB 0.0 0.5 0.4 0.2 1.4 1.2 0.1 1.6 126.8 333.7 4.24 4.06 17 0.250 546K 2136 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.5 0.4 0.2 0.5 0.4 0.0 0.0 261.2 260.1 2.06 2.01 3 0.687 546K 2136 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 403.1 2.19 2.05 14 0.156 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.8 total, 2.8 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.38 GB write, 498.05 MB/s write, 0.53 GB read, 189.17 MB/s read, 4.2 seconds Interval compaction: 1.38 GB write, 513.55 MB/s write, 0.53 GB read, 195.06 MB/s read, 4.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 138212 Average: 1.9151 StdDev: 3.74 Min: 0 Median: 1.3570 Max: 384 Percentiles: P50: 1.36 P75: 1.74 P99: 4.07 P99.9: 9.23 P99.99: 29.16 ------------------------------------------------------ [ 0, 1 ] 36711 26.561% 26.561% ##### ( 1, 2 ] 90734 65.648% 92.210% ############# ( 2, 3 ] 6943 5.023% 97.233% # ( 3, 4 ] 2411 1.744% 98.978% ( 4, 6 ] 946 0.684% 99.662% ( 6, 10 ] 407 0.294% 99.957% ( 10, 15 ] 35 0.025% 99.982% ( 15, 22 ] 7 0.005% 99.987% ( 22, 34 ] 7 0.005% 99.992% ( 34, 51 ] 2 0.001% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 110, 170 ] 14 0.010% 100.004% ( 250, 380 ] 13 0.009% 100.014% ( 380, 580 ] 1 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 33981 Average: 1.9666 StdDev: 5.97 Min: 1 Median: 1.3611 Max: 599 Percentiles: P50: 1.36 P75: 1.74 P99: 4.39 P99.9: 9.92 P99.99: 362.75 ------------------------------------------------------ [ 0, 1 ] 8964 26.379% 26.379% ##### ( 1, 2 ] 22230 65.419% 91.798% ############# ( 2, 3 ] 1754 5.162% 96.960% # ( 3, 4 ] 646 1.901% 98.861% ( 4, 6 ] 255 0.750% 99.612% ( 6, 10 ] 102 0.300% 99.912% ( 10, 15 ] 18 0.053% 99.965% ( 15, 22 ] 2 0.006% 99.971% ( 22, 34 ] 1 0.003% 99.974% ( 34, 51 ] 1 0.003% 99.976% ( 76, 110 ] 1 0.003% 99.979% ( 110, 170 ] 3 0.009% 99.988% ( 250, 380 ] 3 0.009% 99.997% ( 380, 580 ] 2 0.006% 100.003% ( 580, 870 ] 1 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 9320 Average: 3.3167 StdDev: 36.43 Min: 1 Median: 1.2593 Max: 3011 Percentiles: P50: 1.26 P75: 1.70 P99: 9.84 P99.9: 221.20 P99.99: 3002.00 ------------------------------------------------------ [ 0, 1 ] 3273 35.118% 35.118% ####### ( 1, 2 ] 5348 57.382% 92.500% ########### ( 2, 3 ] 323 3.466% 95.966% # ( 3, 4 ] 89 0.955% 96.921% ( 4, 6 ] 119 1.277% 98.197% ( 6, 10 ] 78 0.837% 99.034% ( 10, 15 ] 17 0.182% 99.217% ( 15, 22 ] 1 0.011% 99.227% ( 76, 110 ] 44 0.472% 99.700% ( 110, 170 ] 11 0.118% 99.818% ( 170, 250 ] 12 0.129% 99.946% ( 250, 380 ] 1 0.011% 99.957% ( 580, 870 ] 2 0.021% 99.979% ( 870, 1300 ] 1 0.011% 99.989% ( 2900, 4400 ] 1 0.011% 100.000% ** Level 3 read latency histogram (micros): Count: 50 Average: 1332.5200 StdDev: 711.24 Min: 94 Median: 1300.0000 Max: 3180 Percentiles: P50: 1300.00 P75: 1941.67 P99: 3180.00 P99.9: 3180.00 P99.99: 3180.00 ------------------------------------------------------ ( 76, 110 ] 3 6.000% 6.000% # ( 380, 580 ] 2 4.000% 10.000% # ( 580, 870 ] 14 28.000% 38.000% ###### ( 870, 1300 ] 6 12.000% 50.000% ## ( 1300, 1900 ] 12 24.000% 74.000% ##### ( 1900, 2900 ] 12 24.000% 98.000% ##### ( 2900, 4400 ] 1 2.000% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 1218.8000 StdDev: 813.39 Min: 94 Median: 1085.0000 Max: 2881 Percentiles: P50: 1085.00 P75: 1850.00 P99: 2858.33 P99.9: 2881.00 P99.99: 2881.00 ------------------------------------------------------ ( 76, 110 ] 2 8.000% 8.000% ## ( 110, 170 ] 2 8.000% 16.000% ## ( 380, 580 ] 1 4.000% 20.000% # ( 580, 870 ] 4 16.000% 36.000% ### ( 870, 1300 ] 7 28.000% 64.000% ###### ( 1300, 1900 ] 3 12.000% 76.000% ## ( 1900, 2900 ] 6 24.000% 100.000% ##### ** DB Stats ** Uptime(secs): 2.8 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 345.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 356.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/10-22:38:48 ... thread 0: (1000000,2000000) ops and (355370.2,359143.9) ops/second in (2.813967,5.568798) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.47 GB 125.2 1.1 0.0 1.1 2.9 1.8 0.0 1.6 132.1 351.4 8.57 8.17 33 0.260 1149K 6241 0.0 0.0 L1 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.1 1.4 263.6 262.4 1.67 1.64 2 0.835 446K 2029 0.0 0.0 L2 2/0 67.35 MB 0.7 0.5 0.4 0.1 0.5 0.4 0.0 1.3 247.8 247.0 2.05 2.00 3 0.684 516K 1698 0.0 0.0 L3 16/0 990.40 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 142/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 244.3 244.3 0.70 0.68 1 0.695 172K 0 0.0 0.0 L5 124/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 294/4 21.06 GB 0.0 2.2 0.8 1.4 4.0 2.7 0.6 2.2 173.3 317.8 12.99 12.49 39 0.333 2285K 9968 0.0 0.0 Int 0/0 0.00 KB 0.0 2.2 0.8 1.4 4.0 2.7 0.6 2.2 173.3 317.8 12.99 12.49 39 0.333 2285K 9968 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.2 0.8 1.4 2.2 0.8 0.0 0.0 268.0 266.8 8.40 8.22 10 0.840 2285K 9968 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 410.8 4.59 4.27 29 0.158 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.7 total, 5.6 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.03 GB write, 729.45 MB/s write, 2.20 GB read, 397.72 MB/s read, 13.0 seconds Interval compaction: 4.03 GB write, 740.69 MB/s write, 2.20 GB read, 403.84 MB/s read, 13.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 423052 Average: 2.0113 StdDev: 5.12 Min: 0 Median: 1.3967 Max: 1263 Percentiles: P50: 1.40 P75: 1.79 P99: 5.23 P99.9: 9.32 P99.99: 13.06 ------------------------------------------------------ [ 0, 1 ] 105625 24.967% 24.967% ##### ( 1, 2 ] 266940 63.099% 88.066% ############# ( 2, 3 ] 29398 6.949% 95.015% # ( 3, 4 ] 13108 3.098% 98.113% # ( 4, 6 ] 6083 1.438% 99.551% ( 6, 10 ] 1776 0.420% 99.971% ( 10, 15 ] 132 0.031% 100.002% ( 15, 22 ] 23 0.005% 100.008% ( 22, 34 ] 13 0.003% 100.011% ( 34, 51 ] 3 0.001% 100.012% ( 51, 76 ] 5 0.001% 100.013% ( 76, 110 ] 3 0.001% 100.013% ( 110, 170 ] 24 0.006% 100.019% ( 170, 250 ] 4 0.001% 100.020% ( 250, 380 ] 22 0.005% 100.025% ( 380, 580 ] 9 0.002% 100.027% ( 580, 870 ] 3 0.001% 100.028% ( 870, 1300 ] 4 0.001% 100.029% ** Level 1 read latency histogram (micros): Count: 111262 Average: 2.0622 StdDev: 3.40 Min: 1 Median: 1.4448 Max: 599 Percentiles: P50: 1.44 P75: 1.83 P99: 5.47 P99.9: 9.68 P99.99: 33.50 ------------------------------------------------------ [ 0, 1 ] 23246 20.893% 20.893% #### ( 1, 2 ] 72814 65.444% 86.337% ############# ( 2, 3 ] 8412 7.561% 93.897% ## ( 3, 4 ] 4241 3.812% 97.709% # ( 4, 6 ] 1949 1.752% 99.461% ( 6, 10 ] 531 0.477% 99.938% ( 10, 15 ] 51 0.046% 99.984% ( 15, 22 ] 4 0.004% 99.987% ( 22, 34 ] 3 0.003% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 1 0.001% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 110, 170 ] 3 0.003% 99.996% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 2 0.002% 100.000% ( 580, 870 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 76922 Average: 2.3405 StdDev: 13.22 Min: 1 Median: 1.4854 Max: 3011 Percentiles: P50: 1.49 P75: 1.88 P99: 5.82 P99.9: 82.85 P99.99: 260.00 ------------------------------------------------------ [ 0, 1 ] 14670 19.071% 19.071% #### ( 1, 2 ] 49010 63.714% 82.785% ############# ( 2, 3 ] 7142 9.285% 92.070% ## ( 3, 4 ] 3668 4.768% 96.838% # ( 4, 6 ] 1826 2.374% 99.212% ( 6, 10 ] 456 0.593% 99.805% ( 10, 15 ] 51 0.066% 99.871% ( 15, 22 ] 10 0.013% 99.884% ( 22, 34 ] 2 0.003% 99.887% ( 76, 110 ] 50 0.065% 99.952% ( 110, 170 ] 15 0.020% 99.971% ( 170, 250 ] 14 0.018% 99.990% ( 250, 380 ] 4 0.005% 99.995% ( 580, 870 ] 3 0.004% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 50 Average: 1332.5200 StdDev: 711.24 Min: 94 Median: 1300.0000 Max: 3180 Percentiles: P50: 1300.00 P75: 1941.67 P99: 3180.00 P99.9: 3180.00 P99.99: 3180.00 ------------------------------------------------------ ( 76, 110 ] 3 6.000% 6.000% # ( 380, 580 ] 2 4.000% 10.000% # ( 580, 870 ] 14 28.000% 38.000% ###### ( 870, 1300 ] 6 12.000% 50.000% ## ( 1300, 1900 ] 12 24.000% 74.000% ##### ( 1900, 2900 ] 12 24.000% 98.000% ##### ( 2900, 4400 ] 1 2.000% 100.000% ** Level 4 read latency histogram (micros): Count: 55 Average: 571.1636 StdDev: 807.23 Min: 0 Median: 95.1250 Max: 2881 Percentiles: P50: 95.12 P75: 1008.21 P99: 2808.33 P99.9: 2881.00 P99.99: 2881.00 ------------------------------------------------------ [ 0, 1 ] 11 20.000% 20.000% #### ( 1, 2 ] 3 5.455% 25.455% # ( 3, 4 ] 1 1.818% 27.273% ( 4, 6 ] 3 5.455% 32.727% # ( 15, 22 ] 1 1.818% 34.545% ( 22, 34 ] 4 7.273% 41.818% # ( 76, 110 ] 8 14.545% 56.364% ### ( 110, 170 ] 2 3.636% 60.000% # ( 170, 250 ] 1 1.818% 61.818% ( 380, 580 ] 1 1.818% 63.636% ( 580, 870 ] 4 7.273% 70.909% # ( 870, 1300 ] 7 12.727% 83.636% ### ( 1300, 1900 ] 3 5.455% 89.091% # ( 1900, 2900 ] 6 10.909% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 252.8000 StdDev: 186.13 Min: 100 Median: 186.0000 Max: 657 Percentiles: P50: 186.00 P75: 315.00 P99: 657.00 P99.9: 657.00 P99.99: 657.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 3 15.000% 45.000% ### ( 170, 250 ] 5 25.000% 70.000% ##### ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 1 5.000% 85.000% # ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 5.7 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 347.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.192 H:M:S, 3.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 349.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.192 H:M:S, 6.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/10-22:38:51 ... thread 0: (1000000,3000000) ops and (387207.9,368035.4) ops/second in (2.582592,8.151390) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.39 GB 56.3 1.9 0.0 1.9 4.7 2.8 0.0 1.7 147.1 359.9 13.25 12.64 49 0.270 1980K 10K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.1 1.4 263.6 262.4 1.67 1.64 2 0.835 446K 2029 0.0 0.0 L2 2/0 67.35 MB 0.7 0.5 0.4 0.1 0.5 0.4 0.0 1.3 247.8 247.0 2.05 2.00 3 0.684 516K 1698 0.0 0.0 L3 16/0 990.40 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 142/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 244.3 244.3 0.70 0.68 1 0.695 172K 0 0.0 0.0 L5 124/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 298/12 21.98 GB 0.0 3.0 0.8 2.2 5.7 3.6 0.6 2.1 173.6 333.0 17.67 16.96 55 0.321 3115K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 0.8 2.2 5.7 3.6 0.6 2.1 173.6 333.0 17.67 16.96 55 0.321 3115K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 0.8 2.2 3.0 0.8 0.0 0.0 283.8 282.5 10.81 10.59 13 0.832 3115K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 412.7 6.86 6.36 42 0.163 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.2 total, 8.2 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.75 GB write, 714.03 MB/s write, 3.00 GB read, 372.31 MB/s read, 17.7 seconds Interval compaction: 5.75 GB write, 721.55 MB/s write, 3.00 GB read, 376.23 MB/s read, 17.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 749847 Average: 2.0030 StdDev: 6.22 Min: 0 Median: 1.3631 Max: 1682 Percentiles: P50: 1.36 P75: 1.77 P99: 5.11 P99.9: 9.34 P99.99: 13.94 ------------------------------------------------------ [ 0, 1 ] 209157 27.893% 27.893% ###### ( 1, 2 ] 456539 60.884% 88.778% ############ ( 2, 3 ] 49930 6.659% 95.436% # ( 3, 4 ] 21317 2.843% 98.279% # ( 4, 6 ] 9722 1.297% 99.576% ( 6, 10 ] 2912 0.388% 99.964% ( 10, 15 ] 249 0.033% 99.997% ( 15, 22 ] 38 0.005% 100.002% ( 22, 34 ] 18 0.002% 100.005% ( 34, 51 ] 4 0.001% 100.005% ( 51, 76 ] 7 0.001% 100.006% ( 76, 110 ] 21 0.003% 100.009% ( 110, 170 ] 130 0.017% 100.026% ( 170, 250 ] 48 0.006% 100.033% ( 250, 380 ] 46 0.006% 100.039% ( 380, 580 ] 15 0.002% 100.041% ( 580, 870 ] 8 0.001% 100.042% ( 870, 1300 ] 7 0.001% 100.043% ( 1300, 1900 ] 1 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 111262 Average: 2.0622 StdDev: 3.40 Min: 1 Median: 1.4448 Max: 599 Percentiles: P50: 1.44 P75: 1.83 P99: 5.47 P99.9: 9.68 P99.99: 33.50 ------------------------------------------------------ [ 0, 1 ] 23246 20.893% 20.893% #### ( 1, 2 ] 72814 65.444% 86.337% ############# ( 2, 3 ] 8412 7.561% 93.897% ## ( 3, 4 ] 4241 3.812% 97.709% # ( 4, 6 ] 1949 1.752% 99.461% ( 6, 10 ] 531 0.477% 99.938% ( 10, 15 ] 51 0.046% 99.984% ( 15, 22 ] 4 0.004% 99.987% ( 22, 34 ] 3 0.003% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 1 0.001% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 110, 170 ] 3 0.003% 99.996% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 2 0.002% 100.000% ( 580, 870 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 76922 Average: 2.3405 StdDev: 13.22 Min: 1 Median: 1.4854 Max: 3011 Percentiles: P50: 1.49 P75: 1.88 P99: 5.82 P99.9: 82.85 P99.99: 260.00 ------------------------------------------------------ [ 0, 1 ] 14670 19.071% 19.071% #### ( 1, 2 ] 49010 63.714% 82.785% ############# ( 2, 3 ] 7142 9.285% 92.070% ## ( 3, 4 ] 3668 4.768% 96.838% # ( 4, 6 ] 1826 2.374% 99.212% ( 6, 10 ] 456 0.593% 99.805% ( 10, 15 ] 51 0.066% 99.871% ( 15, 22 ] 10 0.013% 99.884% ( 22, 34 ] 2 0.003% 99.887% ( 76, 110 ] 50 0.065% 99.952% ( 110, 170 ] 15 0.020% 99.971% ( 170, 250 ] 14 0.018% 99.990% ( 250, 380 ] 4 0.005% 99.995% ( 580, 870 ] 3 0.004% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 50 Average: 1332.5200 StdDev: 711.24 Min: 94 Median: 1300.0000 Max: 3180 Percentiles: P50: 1300.00 P75: 1941.67 P99: 3180.00 P99.9: 3180.00 P99.99: 3180.00 ------------------------------------------------------ ( 76, 110 ] 3 6.000% 6.000% # ( 380, 580 ] 2 4.000% 10.000% # ( 580, 870 ] 14 28.000% 38.000% ###### ( 870, 1300 ] 6 12.000% 50.000% ## ( 1300, 1900 ] 12 24.000% 74.000% ##### ( 1900, 2900 ] 12 24.000% 98.000% ##### ( 2900, 4400 ] 1 2.000% 100.000% ** Level 4 read latency histogram (micros): Count: 55 Average: 571.1636 StdDev: 807.23 Min: 0 Median: 95.1250 Max: 2881 Percentiles: P50: 95.12 P75: 1008.21 P99: 2808.33 P99.9: 2881.00 P99.99: 2881.00 ------------------------------------------------------ [ 0, 1 ] 11 20.000% 20.000% #### ( 1, 2 ] 3 5.455% 25.455% # ( 3, 4 ] 1 1.818% 27.273% ( 4, 6 ] 3 5.455% 32.727% # ( 15, 22 ] 1 1.818% 34.545% ( 22, 34 ] 4 7.273% 41.818% # ( 76, 110 ] 8 14.545% 56.364% ### ( 110, 170 ] 2 3.636% 60.000% # ( 170, 250 ] 1 1.818% 61.818% ( 380, 580 ] 1 1.818% 63.636% ( 580, 870 ] 4 7.273% 70.909% # ( 870, 1300 ] 7 12.727% 83.636% ### ( 1300, 1900 ] 3 5.455% 89.091% # ( 1900, 2900 ] 6 10.909% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 252.8000 StdDev: 186.13 Min: 100 Median: 186.0000 Max: 657 Percentiles: P50: 186.00 P75: 315.00 P99: 657.00 P99.9: 657.00 P99.99: 657.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 3 15.000% 45.000% ### ( 170, 250 ] 5 25.000% 70.000% ##### ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 1 5.000% 85.000% # ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 8.2 total, 2.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 358.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.554 H:M:S, 6.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 381.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.362 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/10-22:38:53 ... thread 0: (1000000,4000000) ops and (347209.1,362598.0) ops/second in (2.880109,11.031499) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 3.36 GB 100.1 3.0 0.0 3.0 6.7 3.7 0.0 1.8 159.7 357.7 19.29 18.41 68 0.284 3129K 16K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.1 1.4 263.6 262.4 1.67 1.64 2 0.835 446K 2029 0.0 0.0 L2 2/0 67.35 MB 0.7 0.5 0.4 0.1 0.5 0.4 0.0 1.3 247.8 247.0 2.05 2.00 3 0.684 516K 1698 0.0 0.0 L3 16/0 990.40 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 142/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 244.3 244.3 0.70 0.68 1 0.695 172K 0 0.0 0.0 L5 124/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 301/12 22.95 GB 0.0 4.1 0.8 3.3 7.8 4.6 0.6 2.1 177.1 338.1 23.71 22.73 74 0.320 4265K 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.1 0.8 3.3 7.8 4.6 0.6 2.1 177.1 338.1 23.71 22.73 74 0.320 4265K 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.1 0.8 3.3 4.1 0.8 0.0 0.0 286.7 285.3 14.65 14.35 17 0.862 4265K 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 423.5 9.06 8.38 57 0.159 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.1 total, 11.0 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.83 GB write, 720.73 MB/s write, 4.10 GB read, 377.62 MB/s read, 23.7 seconds Interval compaction: 7.83 GB write, 726.33 MB/s write, 4.10 GB read, 380.56 MB/s read, 23.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 6, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1259815 Average: 2.1209 StdDev: 8.67 Min: 0 Median: 1.3393 Max: 2784 Percentiles: P50: 1.34 P75: 1.77 P99: 5.17 P99.9: 9.67 P99.99: 121.92 ------------------------------------------------------ [ 0, 1 ] 382609 30.370% 30.370% ###### ( 1, 2 ] 728811 57.851% 88.221% ############ ( 2, 3 ] 86910 6.899% 95.120% # ( 3, 4 ] 38447 3.052% 98.171% # ( 4, 6 ] 17835 1.416% 99.587% ( 6, 10 ] 4309 0.342% 99.929% ( 10, 15 ] 366 0.029% 99.958% ( 15, 22 ] 66 0.005% 99.963% ( 22, 34 ] 23 0.002% 99.965% ( 34, 51 ] 11 0.001% 99.966% ( 51, 76 ] 8 0.001% 99.967% ( 76, 110 ] 216 0.017% 99.984% ( 110, 170 ] 428 0.034% 100.018% ( 170, 250 ] 430 0.034% 100.052% ( 250, 380 ] 167 0.013% 100.065% ( 380, 580 ] 64 0.005% 100.070% ( 580, 870 ] 26 0.002% 100.072% ( 870, 1300 ] 9 0.001% 100.073% ( 1300, 1900 ] 2 0.000% 100.073% ( 1900, 2900 ] 1 0.000% 100.073% ** Level 1 read latency histogram (micros): Count: 111262 Average: 2.0622 StdDev: 3.40 Min: 1 Median: 1.4448 Max: 599 Percentiles: P50: 1.44 P75: 1.83 P99: 5.47 P99.9: 9.68 P99.99: 33.50 ------------------------------------------------------ [ 0, 1 ] 23246 20.893% 20.893% #### ( 1, 2 ] 72814 65.444% 86.337% ############# ( 2, 3 ] 8412 7.561% 93.897% ## ( 3, 4 ] 4241 3.812% 97.709% # ( 4, 6 ] 1949 1.752% 99.461% ( 6, 10 ] 531 0.477% 99.938% ( 10, 15 ] 51 0.046% 99.984% ( 15, 22 ] 4 0.004% 99.987% ( 22, 34 ] 3 0.003% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 1 0.001% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 110, 170 ] 3 0.003% 99.996% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 2 0.002% 100.000% ( 580, 870 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 76922 Average: 2.3405 StdDev: 13.22 Min: 1 Median: 1.4854 Max: 3011 Percentiles: P50: 1.49 P75: 1.88 P99: 5.82 P99.9: 82.85 P99.99: 260.00 ------------------------------------------------------ [ 0, 1 ] 14670 19.071% 19.071% #### ( 1, 2 ] 49010 63.714% 82.785% ############# ( 2, 3 ] 7142 9.285% 92.070% ## ( 3, 4 ] 3668 4.768% 96.838% # ( 4, 6 ] 1826 2.374% 99.212% ( 6, 10 ] 456 0.593% 99.805% ( 10, 15 ] 51 0.066% 99.871% ( 15, 22 ] 10 0.013% 99.884% ( 22, 34 ] 2 0.003% 99.887% ( 76, 110 ] 50 0.065% 99.952% ( 110, 170 ] 15 0.020% 99.971% ( 170, 250 ] 14 0.018% 99.990% ( 250, 380 ] 4 0.005% 99.995% ( 580, 870 ] 3 0.004% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 50 Average: 1332.5200 StdDev: 711.24 Min: 94 Median: 1300.0000 Max: 3180 Percentiles: P50: 1300.00 P75: 1941.67 P99: 3180.00 P99.9: 3180.00 P99.99: 3180.00 ------------------------------------------------------ ( 76, 110 ] 3 6.000% 6.000% # ( 380, 580 ] 2 4.000% 10.000% # ( 580, 870 ] 14 28.000% 38.000% ###### ( 870, 1300 ] 6 12.000% 50.000% ## ( 1300, 1900 ] 12 24.000% 74.000% ##### ( 1900, 2900 ] 12 24.000% 98.000% ##### ( 2900, 4400 ] 1 2.000% 100.000% ** Level 4 read latency histogram (micros): Count: 55 Average: 571.1636 StdDev: 807.23 Min: 0 Median: 95.1250 Max: 2881 Percentiles: P50: 95.12 P75: 1008.21 P99: 2808.33 P99.9: 2881.00 P99.99: 2881.00 ------------------------------------------------------ [ 0, 1 ] 11 20.000% 20.000% #### ( 1, 2 ] 3 5.455% 25.455% # ( 3, 4 ] 1 1.818% 27.273% ( 4, 6 ] 3 5.455% 32.727% # ( 15, 22 ] 1 1.818% 34.545% ( 22, 34 ] 4 7.273% 41.818% # ( 76, 110 ] 8 14.545% 56.364% ### ( 110, 170 ] 2 3.636% 60.000% # ( 170, 250 ] 1 1.818% 61.818% ( 380, 580 ] 1 1.818% 63.636% ( 580, 870 ] 4 7.273% 70.909% # ( 870, 1300 ] 7 12.727% 83.636% ### ( 1300, 1900 ] 3 5.455% 89.091% # ( 1900, 2900 ] 6 10.909% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 252.8000 StdDev: 186.13 Min: 100 Median: 186.0000 Max: 657 Percentiles: P50: 186.00 P75: 315.00 P99: 657.00 P99.9: 657.00 P99.99: 657.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 3 15.000% 45.000% ### ( 170, 250 ] 5 25.000% 70.000% ##### ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 1 5.000% 85.000% # ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 11.1 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 353.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.246 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 341.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.693 H:M:S, 24.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/10-22:38:56 ... thread 0: (1000000,5000000) ops and (366630.5,363397.4) ops/second in (2.727542,13.759041) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.74 GB 249.0 4.4 0.0 4.4 9.1 4.6 0.0 1.9 172.0 352.5 26.30 24.91 84 0.313 4594K 33K 0.0 0.0 L1 5/0 483.48 MB 48.3 2.0 1.8 0.1 1.9 1.8 0.1 1.0 276.8 269.4 7.24 6.94 3 2.415 2036K 53K 0.0 0.0 L2 1/1 50.56 MB 0.0 0.5 0.4 0.1 0.5 0.4 1.0 1.3 247.8 247.0 2.05 2.00 3 0.684 516K 1698 0.0 0.0 L3 28/13 1.98 GB 0.9 0.6 0.4 0.2 0.6 0.4 1.0 1.5 246.7 243.9 2.32 2.19 3 0.773 581K 6546 0.0 0.0 L4 142/4 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 244.3 244.3 0.70 0.68 1 0.695 172K 0 0.0 0.0 L5 124/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 313/22 23.80 GB 0.0 7.6 2.7 4.9 12.2 7.3 2.3 2.6 201.5 322.9 38.61 36.71 94 0.411 7900K 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.6 2.7 4.9 12.2 7.3 2.3 2.6 201.5 322.9 38.61 36.71 94 0.411 7900K 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.6 2.7 4.9 7.5 2.7 0.0 0.0 286.8 283.3 27.13 26.15 24 1.130 7900K 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 416.5 11.48 10.57 70 0.164 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.8 total, 13.8 interval Flush(GB): cumulative 4.668, interval 4.668 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.17 GB write, 900.09 MB/s write, 7.60 GB read, 561.78 MB/s read, 38.6 seconds Interval compaction: 12.17 GB write, 905.71 MB/s write, 7.60 GB read, 565.28 MB/s read, 38.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 11, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1683421 Average: 2.2140 StdDev: 11.01 Min: 0 Median: 1.3439 Max: 3226 Percentiles: P50: 1.34 P75: 1.80 P99: 5.36 P99.9: 9.73 P99.99: 144.19 ------------------------------------------------------ [ 0, 1 ] 521924 31.004% 31.004% ###### ( 1, 2 ] 929956 55.242% 86.246% ########### ( 2, 3 ] 131113 7.788% 94.034% ## ( 3, 4 ] 63282 3.759% 97.793% # ( 4, 6 ] 29957 1.780% 99.573% ( 6, 10 ] 5903 0.351% 99.924% ( 10, 15 ] 422 0.025% 99.949% ( 15, 22 ] 81 0.005% 99.953% ( 22, 34 ] 26 0.002% 99.955% ( 34, 51 ] 13 0.001% 99.956% ( 51, 76 ] 8 0.000% 99.956% ( 76, 110 ] 244 0.014% 99.971% ( 110, 170 ] 568 0.034% 100.005% ( 170, 250 ] 643 0.038% 100.043% ( 250, 380 ] 350 0.021% 100.064% ( 380, 580 ] 151 0.009% 100.072% ( 580, 870 ] 53 0.003% 100.076% ( 870, 1300 ] 16 0.001% 100.077% ( 1300, 1900 ] 7 0.000% 100.077% ( 1900, 2900 ] 3 0.000% 100.077% ( 2900, 4400 ] 2 0.000% 100.077% ** Level 1 read latency histogram (micros): Count: 274816 Average: 2.4557 StdDev: 18.29 Min: 0 Median: 1.4555 Max: 4131 Percentiles: P50: 1.46 P75: 1.91 P99: 5.84 P99.9: 14.66 P99.99: 466.21 ------------------------------------------------------ [ 0, 1 ] 68098 24.779% 24.779% ##### ( 1, 2 ] 152173 55.373% 80.152% ########### ( 2, 3 ] 28056 10.209% 90.361% ## ( 3, 4 ] 16139 5.873% 96.234% # ( 4, 6 ] 8263 3.007% 99.241% # ( 6, 10 ] 1690 0.615% 99.856% ( 10, 15 ] 131 0.048% 99.903% ( 15, 22 ] 15 0.005% 99.909% ( 22, 34 ] 8 0.003% 99.912% ( 34, 51 ] 4 0.001% 99.913% ( 51, 76 ] 3 0.001% 99.914% ( 76, 110 ] 7 0.003% 99.917% ( 110, 170 ] 62 0.023% 99.939% ( 170, 250 ] 65 0.024% 99.963% ( 250, 380 ] 59 0.021% 99.984% ( 380, 580 ] 36 0.013% 99.997% ( 580, 870 ] 15 0.005% 100.003% ( 870, 1300 ] 3 0.001% 100.004% ( 1300, 1900 ] 5 0.002% 100.006% ( 1900, 2900 ] 2 0.001% 100.007% ( 2900, 4400 ] 3 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 102008 Average: 3.1253 StdDev: 19.77 Min: 1 Median: 1.5038 Max: 3011 Percentiles: P50: 1.50 P75: 1.92 P99: 7.08 P99.9: 320.30 P99.99: 579.15 ------------------------------------------------------ [ 0, 1 ] 20384 19.983% 19.983% #### ( 1, 2 ] 60782 59.586% 79.568% ############ ( 2, 3 ] 10631 10.422% 89.990% ## ( 3, 4 ] 5865 5.750% 95.740% # ( 4, 6 ] 3122 3.061% 98.800% # ( 6, 10 ] 753 0.738% 99.538% ( 10, 15 ] 77 0.075% 99.614% ( 15, 22 ] 15 0.015% 99.628% ( 22, 34 ] 2 0.002% 99.630% ( 34, 51 ] 2 0.002% 99.632% ( 76, 110 ] 55 0.054% 99.686% ( 110, 170 ] 66 0.065% 99.751% ( 170, 250 ] 99 0.097% 99.848% ( 250, 380 ] 98 0.096% 99.944% ( 380, 580 ] 47 0.046% 99.990% ( 580, 870 ] 9 0.009% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 193327 Average: 3.0789 StdDev: 29.31 Min: 0 Median: 1.3076 Max: 3180 Percentiles: P50: 1.31 P75: 1.88 P99: 5.86 P99.9: 301.03 P99.99: 1333.36 ------------------------------------------------------ [ 0, 1 ] 70712 36.576% 36.576% ####### ( 1, 2 ] 84360 43.636% 80.212% ######### ( 2, 3 ] 20652 10.682% 90.895% ## ( 3, 4 ] 10632 5.499% 96.394% # ( 4, 6 ] 5431 2.809% 99.203% # ( 6, 10 ] 768 0.397% 99.601% ( 10, 15 ] 44 0.023% 99.623% ( 15, 22 ] 10 0.005% 99.629% ( 22, 34 ] 15 0.008% 99.636% ( 34, 51 ] 59 0.031% 99.667% ( 51, 76 ] 23 0.012% 99.679% ( 76, 110 ] 16 0.008% 99.687% ( 110, 170 ] 154 0.080% 99.767% ( 170, 250 ] 209 0.108% 99.875% ( 250, 380 ] 124 0.064% 99.939% ( 380, 580 ] 66 0.034% 99.973% ( 580, 870 ] 25 0.013% 99.986% ( 870, 1300 ] 7 0.004% 99.990% ( 1300, 1900 ] 12 0.006% 99.996% ( 1900, 2900 ] 14 0.007% 100.003% ( 2900, 4400 ] 1 0.001% 100.004% ** Level 4 read latency histogram (micros): Count: 24045 Average: 6.8208 StdDev: 58.41 Min: 0 Median: 1.4742 Max: 2881 Percentiles: P50: 1.47 P75: 2.14 P99: 180.05 P99.9: 633.56 P99.99: 1619.10 ------------------------------------------------------ [ 0, 1 ] 6957 28.933% 28.933% ###### ( 1, 2 ] 10682 44.425% 73.358% ######### ( 2, 3 ] 2896 12.044% 85.402% ## ( 3, 4 ] 1705 7.091% 92.493% # ( 4, 6 ] 1151 4.787% 97.280% # ( 6, 10 ] 328 1.364% 98.644% ( 10, 15 ] 28 0.116% 98.761% ( 15, 22 ] 9 0.037% 98.798% ( 22, 34 ] 6 0.025% 98.823% ( 34, 51 ] 1 0.004% 98.827% ( 76, 110 ] 9 0.037% 98.865% ( 110, 170 ] 23 0.096% 98.960% ( 170, 250 ] 84 0.349% 99.310% ( 250, 380 ] 77 0.320% 99.630% ( 380, 580 ] 63 0.262% 99.892% ( 580, 870 ] 16 0.067% 99.958% ( 870, 1300 ] 7 0.029% 99.988% ( 1300, 1900 ] 3 0.012% 100.000% ( 1900, 2900 ] 6 0.025% 100.025% ** Level 5 read latency histogram (micros): Count: 20 Average: 252.8000 StdDev: 186.13 Min: 100 Median: 186.0000 Max: 657 Percentiles: P50: 186.00 P75: 315.00 P99: 657.00 P99.9: 657.00 P99.99: 657.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 3 15.000% 45.000% ### ( 170, 250 ] 5 25.000% 70.000% ##### ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 1 5.000% 85.000% # ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 13.8 total, 2.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 355.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.683 H:M:S, 12.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 361.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.437 H:M:S, 16.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/10-22:38:59 ... thread 0: (1000000,6000000) ops and (394893.1,368293.1) ops/second in (2.532331,16.291372) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 3.66 GB 37.6 5.2 0.0 5.2 10.8 5.6 0.0 1.9 170.4 351.7 31.35 29.69 100 0.314 5424K 37K 0.0 0.0 L1 5/5 483.48 MB 0.0 2.0 1.8 0.1 1.9 1.8 0.1 1.0 276.8 269.4 7.24 6.94 3 2.415 2036K 53K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.5 0.4 0.1 0.5 0.4 1.0 1.3 247.8 247.0 2.05 2.00 3 0.684 516K 1698 0.0 0.0 L3 15/0 911.54 MB 0.9 1.4 0.4 1.0 1.4 0.4 1.0 3.2 274.0 269.8 5.26 4.91 4 1.315 1464K 22K 0.0 0.0 L4 137/0 9.71 GB 1.0 0.8 0.6 0.2 0.7 0.6 0.7 1.3 266.9 264.1 2.88 2.63 4 0.720 781K 8143 0.0 0.0 L5 140/0 9.97 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 314/20 24.70 GB 0.0 9.8 3.2 6.6 15.3 8.7 4.0 2.7 206.3 321.1 48.79 46.17 114 0.428 10M 123K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.8 3.2 6.6 15.3 8.7 4.0 2.7 206.3 321.1 48.79 46.17 114 0.428 10M 123K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.8 3.2 6.6 9.7 3.1 0.0 0.0 287.2 283.7 35.04 33.52 31 1.130 10M 123K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 416.4 13.75 12.65 83 0.166 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.4 total, 16.3 interval Flush(GB): cumulative 5.589, interval 5.589 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.30 GB write, 956.40 MB/s write, 9.83 GB read, 614.50 MB/s read, 48.8 seconds Interval compaction: 15.30 GB write, 961.44 MB/s write, 9.83 GB read, 617.74 MB/s read, 48.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 16, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1988373 Average: 2.2168 StdDev: 11.00 Min: 0 Median: 1.3300 Max: 3226 Percentiles: P50: 1.33 P75: 1.79 P99: 5.32 P99.9: 9.93 P99.99: 156.13 ------------------------------------------------------ [ 0, 1 ] 635046 31.938% 31.938% ###### ( 1, 2 ] 1088187 54.728% 86.665% ########### ( 2, 3 ] 150678 7.578% 94.243% ## ( 3, 4 ] 72191 3.631% 97.874% # ( 4, 6 ] 33850 1.702% 99.576% ( 6, 10 ] 6549 0.329% 99.906% ( 10, 15 ] 561 0.028% 99.934% ( 15, 22 ] 95 0.005% 99.939% ( 22, 34 ] 40 0.002% 99.941% ( 34, 51 ] 18 0.001% 99.942% ( 51, 76 ] 9 0.000% 99.942% ( 76, 110 ] 289 0.015% 99.957% ( 110, 170 ] 860 0.043% 100.000% ( 170, 250 ] 777 0.039% 100.039% ( 250, 380 ] 466 0.023% 100.063% ( 380, 580 ] 180 0.009% 100.072% ( 580, 870 ] 61 0.003% 100.075% ( 870, 1300 ] 19 0.001% 100.076% ( 1300, 1900 ] 8 0.000% 100.076% ( 1900, 2900 ] 3 0.000% 100.076% ( 2900, 4400 ] 2 0.000% 100.076% ** Level 1 read latency histogram (micros): Count: 307521 Average: 2.4293 StdDev: 17.94 Min: 0 Median: 1.4096 Max: 4131 Percentiles: P50: 1.41 P75: 1.88 P99: 5.81 P99.9: 36.04 P99.99: 488.99 ------------------------------------------------------ [ 0, 1 ] 86895 28.257% 28.257% ###### ( 1, 2 ] 163245 53.084% 81.341% ########### ( 2, 3 ] 29374 9.552% 90.893% ## ( 3, 4 ] 16915 5.500% 96.393% # ( 4, 6 ] 8856 2.880% 99.273% # ( 6, 10 ] 1753 0.570% 99.843% ( 10, 15 ] 142 0.046% 99.889% ( 15, 22 ] 22 0.007% 99.896% ( 22, 34 ] 11 0.004% 99.900% ( 34, 51 ] 4 0.001% 99.901% ( 51, 76 ] 3 0.001% 99.902% ( 76, 110 ] 7 0.002% 99.904% ( 110, 170 ] 70 0.023% 99.927% ( 170, 250 ] 76 0.025% 99.952% ( 250, 380 ] 90 0.029% 99.981% ( 380, 580 ] 50 0.016% 99.997% ( 580, 870 ] 16 0.005% 100.003% ( 870, 1300 ] 3 0.001% 100.004% ( 1300, 1900 ] 5 0.002% 100.005% ( 1900, 2900 ] 2 0.001% 100.006% ( 2900, 4400 ] 3 0.001% 100.007% ** Level 2 read latency histogram (micros): Count: 111663 Average: 3.0763 StdDev: 19.48 Min: 1 Median: 1.4716 Max: 3011 Percentiles: P50: 1.47 P75: 1.90 P99: 6.81 P99.9: 318.45 P99.99: 575.43 ------------------------------------------------------ [ 0, 1 ] 25405 22.751% 22.751% ##### ( 1, 2 ] 64524 57.785% 80.536% ############ ( 2, 3 ] 11100 9.941% 90.477% ## ( 3, 4 ] 6097 5.460% 95.937% # ( 4, 6 ] 3266 2.925% 98.862% # ( 6, 10 ] 764 0.684% 99.546% ( 10, 15 ] 77 0.069% 99.615% ( 15, 22 ] 15 0.013% 99.628% ( 22, 34 ] 2 0.002% 99.630% ( 34, 51 ] 2 0.002% 99.632% ( 76, 110 ] 55 0.049% 99.681% ( 110, 170 ] 69 0.062% 99.743% ( 170, 250 ] 119 0.107% 99.850% ( 250, 380 ] 107 0.096% 99.945% ( 380, 580 ] 51 0.046% 99.991% ( 580, 870 ] 9 0.008% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 244335 Average: 2.8999 StdDev: 26.88 Min: 0 Median: 1.2629 Max: 3180 Percentiles: P50: 1.26 P75: 1.85 P99: 5.78 P99.9: 274.76 P99.99: 1023.36 ------------------------------------------------------ [ 0, 1 ] 94608 38.721% 38.721% ######## ( 1, 2 ] 104837 42.907% 81.628% ######### ( 2, 3 ] 24275 9.935% 91.563% ## ( 3, 4 ] 12381 5.067% 96.630% # ( 4, 6 ] 6494 2.658% 99.288% # ( 6, 10 ] 852 0.349% 99.637% ( 10, 15 ] 50 0.020% 99.657% ( 15, 22 ] 11 0.005% 99.662% ( 22, 34 ] 15 0.006% 99.668% ( 34, 51 ] 80 0.033% 99.700% ( 51, 76 ] 26 0.011% 99.711% ( 76, 110 ] 36 0.015% 99.726% ( 110, 170 ] 167 0.068% 99.794% ( 170, 250 ] 232 0.095% 99.889% ( 250, 380 ] 140 0.057% 99.946% ( 380, 580 ] 75 0.031% 99.977% ( 580, 870 ] 28 0.011% 99.989% ( 870, 1300 ] 10 0.004% 99.993% ( 1300, 1900 ] 12 0.005% 99.998% ( 1900, 2900 ] 14 0.006% 100.003% ( 2900, 4400 ] 1 0.000% 100.004% ** Level 4 read latency histogram (micros): Count: 43238 Average: 5.2526 StdDev: 45.74 Min: 0 Median: 1.2664 Max: 2881 Percentiles: P50: 1.27 P75: 1.87 P99: 44.54 P99.9: 539.89 P99.99: 1280.11 ------------------------------------------------------ [ 0, 1 ] 16810 38.878% 38.878% ######## ( 1, 2 ] 18055 41.757% 80.635% ######## ( 2, 3 ] 3918 9.061% 89.697% ## ( 3, 4 ] 2154 4.982% 94.678% # ( 4, 6 ] 1474 3.409% 98.087% # ( 6, 10 ] 347 0.803% 98.890% ( 10, 15 ] 32 0.074% 98.964% ( 15, 22 ] 9 0.021% 98.985% ( 22, 34 ] 6 0.014% 98.999% ( 34, 51 ] 1 0.002% 99.001% ( 76, 110 ] 13 0.030% 99.031% ( 110, 170 ] 75 0.173% 99.204% ( 170, 250 ] 142 0.328% 99.533% ( 250, 380 ] 102 0.236% 99.769% ( 380, 580 ] 71 0.164% 99.933% ( 580, 870 ] 18 0.042% 99.975% ( 870, 1300 ] 7 0.016% 99.991% ( 1300, 1900 ] 3 0.007% 99.998% ( 1900, 2900 ] 6 0.014% 100.012% ** Level 5 read latency histogram (micros): Count: 100 Average: 378.0600 StdDev: 248.37 Min: 92 Median: 312.5926 Max: 1150 Percentiles: P50: 312.59 P75: 537.14 P99: 1150.00 P99.9: 1150.00 P99.99: 1150.00 ------------------------------------------------------ ( 76, 110 ] 11 11.000% 11.000% ## ( 110, 170 ] 11 11.000% 22.000% ## ( 170, 250 ] 15 15.000% 37.000% ### ( 250, 380 ] 27 27.000% 64.000% ##### ( 380, 580 ] 14 14.000% 78.000% ### ( 580, 870 ] 17 17.000% 95.000% ### ( 870, 1300 ] 5 5.000% 100.000% # ** DB Stats ** Uptime(secs): 16.4 total, 2.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 360.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.066 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 388.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.383 H:M:S, 15.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 2.972 micros/op 336501 ops/sec 20.003 seconds 6730999 operations; 326.0 MB/s Microseconds per write: Count: 6730999 Average: 2.9717 StdDev: 206.21 Min: 0 Median: 1.5598 Max: 210432 Percentiles: P50: 1.56 P75: 2.30 P99: 6.37 P99.9: 82.50 P99.99: 1176.00 ------------------------------------------------------ [ 0, 1 ] 1706055 25.346% 25.346% ##### ( 1, 2 ] 2964131 44.037% 69.383% ######### ( 2, 3 ] 1267500 18.831% 88.214% #### ( 3, 4 ] 537197 7.981% 96.195% ## ( 4, 6 ] 184912 2.747% 98.942% # ( 6, 10 ] 42424 0.630% 99.572% ( 10, 15 ] 11354 0.169% 99.741% ( 15, 22 ] 5694 0.085% 99.826% ( 22, 34 ] 2281 0.034% 99.860% ( 34, 51 ] 350 0.005% 99.865% ( 51, 76 ] 1496 0.022% 99.887% ( 76, 110 ] 4571 0.068% 99.955% ( 110, 170 ] 633 0.009% 99.964% ( 170, 250 ] 166 0.002% 99.967% ( 250, 380 ] 60 0.001% 99.968% ( 380, 580 ] 13 0.000% 99.968% ( 580, 870 ] 8 0.000% 99.968% ( 870, 1300 ] 2081 0.031% 99.999% ( 1300, 1900 ] 2 0.000% 99.999% ( 1900, 2900 ] 47 0.001% 100.000% ( 2900, 4400 ] 7 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 7 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 238287 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6730999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6946390968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 219 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3992255 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 13379909031 rocksdb.compact.write.bytes COUNT : 13141647678 rocksdb.flush.write.bytes COUNT : 6924848743 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 29 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 117 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6880129024 rocksdb.memtable.garbage.bytes.at.flush COUNT : 12876800 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 13436768961 rocksdb.non.last.level.read.count COUNT : 3243423 rocksdb.block.checksum.compute.count COUNT : 3243014 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.154493 P95 : 3.431793 P99 : 5.690130 P100 : 210429.000000 COUNT : 6730999 SUM : 17415993 rocksdb.compaction.times.micros P50 : 896428.571429 P95 : 3250000.000000 P99 : 5574368.000000 P100 : 5574368.000000 COUNT : 35 SUM : 38032924 rocksdb.compaction.times.cpu_micros P50 : 872142.857143 P95 : 2525000.000000 P99 : 5299990.000000 P100 : 5299990.000000 COUNT : 35 SUM : 36415920 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 430.000000 P95 : 1042.000000 P99 : 1079.000000 P100 : 1079.000000 COUNT : 96 SUM : 48239 rocksdb.compaction.outfile.sync.micros P50 : 562.608696 P95 : 1128.000000 P99 : 2900.000000 P100 : 8297.000000 COUNT : 100 SUM : 67785 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 99.000000 P95 : 263.000000 P99 : 322.000000 P100 : 322.000000 COUNT : 144 SUM : 17465 rocksdb.table.open.io.micros P50 : 809.949495 P95 : 7163.750000 P99 : 9572.750000 P100 : 9927.000000 COUNT : 219 SUM : 340415 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 2.609956 P95 : 5.266309 P99 : 8.570418 P100 : 7016.000000 COUNT : 3242648 SUM : 12034261 rocksdb.read.block.get.micros P50 : 354.320988 P95 : 1723.000000 P99 : 2793.846154 P100 : 3157.000000 COUNT : 438 SUM : 232189 rocksdb.write.raw.block.micros P50 : 0.509365 P95 : 0.967794 P99 : 2.298742 P100 : 7065.000000 COUNT : 4860491 SUM : 6917139 rocksdb.numfiles.in.singlecompaction P50 : 3.378788 P95 : 7.800000 P99 : 16.000000 P100 : 16.000000 COUNT : 51 SUM : 204 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.600476 P95 : 1125.293128 P99 : 1275.307544 P100 : 210213.000000 COUNT : 18150 SUM : 3996783 rocksdb.sst.read.micros P50 : 1.291692 P95 : 3.293675 P99 : 5.530562 P100 : 4131.000000 COUNT : 3243922 SUM : 7639906 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6730999 SUM : 6946390968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 143488.372093 P95 : 317600.000000 P99 : 348062.000000 P100 : 348062.000000 COUNT : 96 SUM : 15577303 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 139 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0