[2024-12-16 14:19:15.830906] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-16 14:19:15.831007] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1947583 ] Set seed to 1734355155828494 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-16 14:19:15.935800] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-16 14:19:16.142501] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-16 14:19:16.142549] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1947583' to capture a snapshot of events at runtime. [2024-12-16 14:19:16.142559] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1947583 for offline analysis/debug. [2024-12-16 14:19:16.142589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 16 14:19:24 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/16-14:19:27 ... thread 0: (1000000,1000000) ops and (338328.0,338328.0) ops/second in (2.955712,2.955712) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 630.06 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 355.6 2.48 2.24 12 0.207 0 0 0.0 0.0 L2 3/2 251.77 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 255.3 255.1 1.48 1.45 2 0.740 383K 188 0.0 0.0 L3 10/0 804.38 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/8 97.00 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.4 95.4 318.0 3.96 3.68 14 0.283 383K 188 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.4 95.4 318.0 3.96 3.68 14 0.283 383K 188 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 255.3 255.1 1.48 1.45 2 0.740 383K 188 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 355.6 2.48 2.24 12 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 393.29 MB/s write, 0.37 GB read, 117.99 MB/s read, 4.0 seconds Interval compaction: 1.23 GB write, 425.94 MB/s write, 0.37 GB read, 127.79 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 113357 Average: 1.9758 StdDev: 20.53 Min: 1 Median: 1.2847 Max: 3746 Percentiles: P50: 1.28 P75: 1.70 P99: 3.98 P99.9: 10.78 P99.99: 365.45 ------------------------------------------------------ [ 0, 1 ] 37100 32.728% 32.728% ####### ( 1, 2 ] 68780 60.676% 93.404% ############ ( 2, 3 ] 4790 4.226% 97.630% # ( 3, 4 ] 1585 1.398% 99.028% ( 4, 6 ] 697 0.615% 99.643% ( 6, 10 ] 281 0.248% 99.891% ( 10, 15 ] 81 0.071% 99.962% ( 15, 22 ] 17 0.015% 99.977% ( 22, 34 ] 1 0.001% 99.978% ( 51, 76 ] 3 0.003% 99.981% ( 110, 170 ] 7 0.006% 99.987% ( 170, 250 ] 3 0.003% 99.989% ( 250, 380 ] 3 0.003% 99.992% ( 380, 580 ] 3 0.003% 99.995% ( 870, 1300 ] 4 0.004% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 3 0.003% 100.002% ** Level 2 read latency histogram (micros): Count: 61593 Average: 2.4111 StdDev: 63.23 Min: 1 Median: 1.3065 Max: 9099 Percentiles: P50: 1.31 P75: 1.71 P99: 4.83 P99.9: 9.95 P99.99: 1050.75 ------------------------------------------------------ [ 0, 1 ] 19088 30.991% 30.991% ###### ( 1, 2 ] 38197 62.015% 93.006% ############ ( 2, 3 ] 2396 3.890% 96.896% # ( 3, 4 ] 1055 1.713% 98.609% ( 4, 6 ] 579 0.940% 99.549% ( 6, 10 ] 219 0.356% 99.904% ( 10, 15 ] 34 0.055% 99.959% ( 15, 22 ] 8 0.013% 99.972% ( 22, 34 ] 1 0.002% 99.974% ( 250, 380 ] 4 0.006% 99.981% ( 380, 580 ] 3 0.005% 99.985% ( 580, 870 ] 2 0.003% 99.989% ( 870, 1300 ] 2 0.003% 99.992% ( 1300, 1900 ] 2 0.003% 99.995% ( 6600, 9900 ] 3 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 40 Average: 4217.2500 StdDev: 4299.39 Min: 85 Median: 2233.3333 Max: 12648 Percentiles: P50: 2233.33 P75: 7920.00 P99: 12648.00 P99.9: 12648.00 P99.99: 12648.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 1 2.500% 5.000% # ( 250, 380 ] 5 12.500% 17.500% ### ( 380, 580 ] 5 12.500% 30.000% ### ( 580, 870 ] 1 2.500% 32.500% # ( 870, 1300 ] 6 15.000% 47.500% ### ( 1900, 2900 ] 3 7.500% 55.000% ## ( 2900, 4400 ] 2 5.000% 60.000% # ( 4400, 6600 ] 4 10.000% 70.000% ## ( 6600, 9900 ] 5 12.500% 82.500% ### ( 9900, 14000 ] 7 17.500% 100.000% #### ** Level 4 read latency histogram (micros): Count: 30 Average: 3674.5667 StdDev: 4023.76 Min: 200 Median: 1085.0000 Max: 12942 Percentiles: P50: 1085.00 P75: 6380.00 P99: 12942.00 P99.9: 12942.00 P99.99: 12942.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 4 13.333% 16.667% ### ( 380, 580 ] 7 23.333% 40.000% ##### ( 580, 870 ] 2 6.667% 46.667% # ( 870, 1300 ] 2 6.667% 53.333% # ( 1900, 2900 ] 2 6.667% 60.000% # ( 4400, 6600 ] 5 16.667% 76.667% ### ( 6600, 9900 ] 4 13.333% 90.000% ### ( 9900, 14000 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 307.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.402 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.402 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-14:19:30 ... thread 0: (1000000,2000000) ops and (324114.4,331068.7) ops/second in (3.085330,6.041042) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 1.17 GB 88.1 0.9 0.0 0.9 2.7 1.8 0.0 1.5 100.0 314.3 8.82 8.16 29 0.304 895K 984 0.0 0.0 L1 1/0 3.03 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.5 240.1 1.57 1.52 1 1.572 383K 554 0.0 0.0 L2 2/1 55.49 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.3 255.1 1.48 1.45 2 0.740 383K 188 0.0 0.0 L3 20/10 1.12 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 231.7 231.7 1.08 1.01 1 1.078 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 150.3 150.3 1.50 1.11 1 1.495 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/15 97.92 GB 0.0 2.1 1.0 1.0 3.9 2.9 1.1 2.1 146.3 277.0 14.44 13.25 34 0.425 2144K 1726 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 1.0 1.0 3.9 2.9 1.0 2.1 146.3 277.0 14.44 13.25 34 0.425 2144K 1726 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 1.0 1.0 2.1 1.0 0.0 0.0 233.8 233.6 9.04 8.43 8 1.130 2144K 1726 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.6 5.41 4.81 26 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.91 GB write, 636.19 MB/s write, 2.06 GB read, 335.93 MB/s read, 14.4 seconds Interval compaction: 3.91 GB write, 662.04 MB/s write, 2.06 GB read, 349.58 MB/s read, 14.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 395493 Average: 2.2580 StdDev: 14.26 Min: 1 Median: 1.5008 Max: 3746 Percentiles: P50: 1.50 P75: 1.89 P99: 5.77 P99.9: 11.29 P99.99: 19.81 ------------------------------------------------------ [ 0, 1 ] 70303 17.776% 17.776% #### ( 1, 2 ] 254462 64.340% 82.116% ############# ( 2, 3 ] 41419 10.473% 92.589% ## ( 3, 4 ] 15298 3.868% 96.457% # ( 4, 6 ] 11387 2.879% 99.337% # ( 6, 10 ] 2122 0.537% 99.873% ( 10, 15 ] 413 0.104% 99.977% ( 15, 22 ] 72 0.018% 99.996% ( 22, 34 ] 8 0.002% 99.998% ( 34, 51 ] 1 0.000% 99.998% ( 51, 76 ] 7 0.002% 100.000% ( 110, 170 ] 12 0.003% 100.003% ( 170, 250 ] 8 0.002% 100.005% ( 250, 380 ] 6 0.002% 100.006% ( 380, 580 ] 10 0.003% 100.009% ( 580, 870 ] 1 0.000% 100.009% ( 870, 1300 ] 12 0.003% 100.012% ( 1300, 1900 ] 3 0.001% 100.013% ( 1900, 2900 ] 3 0.001% 100.014% ( 2900, 4400 ] 3 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 25 Average: 228.4000 StdDev: 475.13 Min: 1 Median: 1.6500 Max: 1955 Percentiles: P50: 1.65 P75: 240.00 P99: 1955.00 P99.9: 1955.00 P99.99: 1955.00 ------------------------------------------------------ [ 0, 1 ] 6 24.000% 24.000% ##### ( 1, 2 ] 10 40.000% 64.000% ######## ( 6, 10 ] 1 4.000% 68.000% # ( 170, 250 ] 2 8.000% 76.000% ## ( 250, 380 ] 2 8.000% 84.000% ## ( 380, 580 ] 1 4.000% 88.000% # ( 580, 870 ] 1 4.000% 92.000% # ( 1300, 1900 ] 1 4.000% 96.000% # ( 1900, 2900 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 95738 Average: 2.3633 StdDev: 50.72 Min: 1 Median: 1.4051 Max: 9099 Percentiles: P50: 1.41 P75: 1.80 P99: 5.58 P99.9: 9.88 P99.99: 541.75 ------------------------------------------------------ [ 0, 1 ] 23353 24.393% 24.393% ##### ( 1, 2 ] 60511 63.205% 87.597% ############# ( 2, 3 ] 6672 6.969% 94.566% # ( 3, 4 ] 2694 2.814% 97.380% # ( 4, 6 ] 1962 2.049% 99.430% ( 6, 10 ] 464 0.485% 99.914% ( 10, 15 ] 50 0.052% 99.967% ( 15, 22 ] 12 0.013% 99.979% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 250, 380 ] 4 0.004% 99.987% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 2 0.002% 99.993% ( 870, 1300 ] 2 0.002% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 6600, 9900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 189092 Average: 3.9150 StdDev: 88.85 Min: 1 Median: 1.6238 Max: 12648 Percentiles: P50: 1.62 P75: 2.09 P99: 8.98 P99.9: 189.05 P99.99: 468.79 ------------------------------------------------------ [ 0, 1 ] 20283 10.727% 10.727% ## ( 1, 2 ] 119048 62.958% 73.684% ############# ( 2, 3 ] 27962 14.788% 88.472% ### ( 3, 4 ] 9354 4.947% 93.419% # ( 4, 6 ] 8325 4.403% 97.821% # ( 6, 10 ] 2995 1.584% 99.405% ( 10, 15 ] 580 0.307% 99.712% ( 15, 22 ] 75 0.040% 99.751% ( 22, 34 ] 9 0.005% 99.756% ( 34, 51 ] 2 0.001% 99.757% ( 51, 76 ] 1 0.001% 99.758% ( 76, 110 ] 33 0.017% 99.775% ( 110, 170 ] 215 0.114% 99.889% ( 170, 250 ] 92 0.049% 99.938% ( 250, 380 ] 81 0.043% 99.980% ( 380, 580 ] 43 0.023% 100.003% ( 580, 870 ] 17 0.009% 100.012% ( 870, 1300 ] 16 0.008% 100.021% ( 1900, 2900 ] 3 0.002% 100.022% ( 2900, 4400 ] 2 0.001% 100.023% ( 4400, 6600 ] 4 0.002% 100.025% ( 6600, 9900 ] 5 0.003% 100.028% ( 9900, 14000 ] 7 0.004% 100.032% ** Level 4 read latency histogram (micros): Count: 320 Average: 352.2781 StdDev: 1631.09 Min: 1 Median: 2.8205 Max: 12942 Percentiles: P50: 2.82 P75: 10.42 P99: 9735.00 P99.9: 12942.00 P99.99: 12942.00 ------------------------------------------------------ [ 0, 1 ] 20 6.250% 6.250% # ( 1, 2 ] 76 23.750% 30.000% ##### ( 2, 3 ] 78 24.375% 54.375% ##### ( 3, 4 ] 36 11.250% 65.625% ## ( 4, 6 ] 23 7.188% 72.812% # ( 6, 10 ] 6 1.875% 74.688% ( 10, 15 ] 12 3.750% 78.438% # ( 15, 22 ] 24 7.500% 85.938% ## ( 22, 34 ] 11 3.438% 89.375% # ( 34, 51 ] 1 0.312% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 1 0.312% 90.312% ( 250, 380 ] 6 1.875% 92.188% ( 380, 580 ] 7 2.188% 94.375% ( 580, 870 ] 2 0.625% 95.000% ( 870, 1300 ] 2 0.625% 95.625% ( 1900, 2900 ] 2 0.625% 96.250% ( 4400, 6600 ] 5 1.562% 97.812% ( 6600, 9900 ] 4 1.250% 99.062% ( 9900, 14000 ] 3 0.938% 100.000% ** DB Stats ** Uptime(secs): 6.3 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 313.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.825 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.423 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-14:19:33 ... thread 0: (1000000,3000000) ops and (356343.2,339085.5) ops/second in (2.806283,8.847325) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.09 GB 188.8 1.7 0.0 1.7 4.4 2.7 0.0 1.6 120.5 309.6 14.64 13.63 45 0.325 1790K 1966 0.0 0.0 L1 1/0 3.03 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.5 240.1 1.57 1.52 1 1.572 383K 554 0.0 0.0 L2 1/0 53.41 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.3 255.1 1.48 1.45 2 0.740 383K 188 0.0 0.0 L3 19/0 892.77 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 238.4 238.0 4.43 4.06 2 2.215 1072K 2109 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 150.3 150.3 1.50 1.11 1 1.495 228K 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/4 98.84 GB 0.0 3.7 1.0 2.7 6.4 3.7 1.7 2.4 160.9 278.0 23.62 21.77 51 0.463 3859K 4817 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.0 2.7 6.4 3.7 1.6 2.4 160.9 278.0 23.62 21.77 51 0.463 3859K 4817 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.0 2.7 3.7 1.0 0.0 0.0 240.9 240.6 15.77 14.81 12 1.315 3859K 4817 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 353.3 7.85 6.96 39 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.41 GB write, 722.16 MB/s write, 3.71 GB read, 417.91 MB/s read, 23.6 seconds Interval compaction: 6.41 GB write, 742.20 MB/s write, 3.71 GB read, 429.51 MB/s read, 23.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 641376 Average: 2.2121 StdDev: 14.33 Min: 1 Median: 1.4806 Max: 4754 Percentiles: P50: 1.48 P75: 1.86 P99: 5.68 P99.9: 11.15 P99.99: 17.58 ------------------------------------------------------ [ 0, 1 ] 119909 18.696% 18.696% #### ( 1, 2 ] 417747 65.133% 83.829% ############# ( 2, 3 ] 61189 9.540% 93.369% ## ( 3, 4 ] 22551 3.516% 96.885% # ( 4, 6 ] 16179 2.523% 99.407% # ( 6, 10 ] 2999 0.468% 99.875% ( 10, 15 ] 701 0.109% 99.984% ( 15, 22 ] 100 0.016% 100.000% ( 22, 34 ] 8 0.001% 100.001% ( 34, 51 ] 1 0.000% 100.001% ( 51, 76 ] 12 0.002% 100.003% ( 110, 170 ] 18 0.003% 100.006% ( 170, 250 ] 13 0.002% 100.008% ( 250, 380 ] 8 0.001% 100.009% ( 380, 580 ] 16 0.002% 100.012% ( 580, 870 ] 5 0.001% 100.012% ( 870, 1300 ] 15 0.002% 100.015% ( 1300, 1900 ] 6 0.001% 100.016% ( 1900, 2900 ] 4 0.001% 100.016% ( 2900, 4400 ] 4 0.001% 100.017% ( 4400, 6600 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 25 Average: 228.4000 StdDev: 475.13 Min: 1 Median: 1.6500 Max: 1955 Percentiles: P50: 1.65 P75: 240.00 P99: 1955.00 P99.9: 1955.00 P99.99: 1955.00 ------------------------------------------------------ [ 0, 1 ] 6 24.000% 24.000% ##### ( 1, 2 ] 10 40.000% 64.000% ######## ( 6, 10 ] 1 4.000% 68.000% # ( 170, 250 ] 2 8.000% 76.000% ## ( 250, 380 ] 2 8.000% 84.000% ## ( 380, 580 ] 1 4.000% 88.000% # ( 580, 870 ] 1 4.000% 92.000% # ( 1300, 1900 ] 1 4.000% 96.000% # ( 1900, 2900 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 124231 Average: 2.6785 StdDev: 46.61 Min: 1 Median: 1.4461 Max: 9099 Percentiles: P50: 1.45 P75: 1.84 P99: 6.03 P99.9: 135.12 P99.99: 993.12 ------------------------------------------------------ [ 0, 1 ] 26794 21.568% 21.568% #### ( 1, 2 ] 79184 63.739% 85.307% ############# ( 2, 3 ] 10038 8.080% 93.387% ## ( 3, 4 ] 4080 3.284% 96.672% # ( 4, 6 ] 2885 2.322% 98.994% ( 6, 10 ] 965 0.777% 99.771% ( 10, 15 ] 108 0.087% 99.858% ( 15, 22 ] 18 0.014% 99.872% ( 22, 34 ] 2 0.002% 99.874% ( 34, 51 ] 2 0.002% 99.875% ( 51, 76 ] 1 0.001% 99.876% ( 76, 110 ] 8 0.006% 99.882% ( 110, 170 ] 52 0.042% 99.924% ( 170, 250 ] 32 0.026% 99.950% ( 250, 380 ] 23 0.019% 99.969% ( 380, 580 ] 16 0.013% 99.981% ( 580, 870 ] 8 0.006% 99.988% ( 870, 1300 ] 9 0.007% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 6600, 9900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 233020 Average: 3.7160 StdDev: 80.42 Min: 1 Median: 1.6010 Max: 12648 Percentiles: P50: 1.60 P75: 1.99 P99: 8.89 P99.9: 195.07 P99.99: 521.62 ------------------------------------------------------ [ 0, 1 ] 26898 11.543% 11.543% ## ( 1, 2 ] 149093 63.983% 75.526% ############# ( 2, 3 ] 31974 13.722% 89.248% ### ( 3, 4 ] 10752 4.614% 93.862% # ( 4, 6 ] 9249 3.969% 97.831% # ( 6, 10 ] 3769 1.617% 99.449% ( 10, 15 ] 629 0.270% 99.718% ( 15, 22 ] 82 0.035% 99.754% ( 22, 34 ] 10 0.004% 99.758% ( 34, 51 ] 2 0.001% 99.759% ( 51, 76 ] 1 0.000% 99.759% ( 76, 110 ] 37 0.016% 99.775% ( 110, 170 ] 254 0.109% 99.884% ( 170, 250 ] 118 0.051% 99.935% ( 250, 380 ] 94 0.040% 99.975% ( 380, 580 ] 49 0.021% 99.996% ( 580, 870 ] 29 0.012% 100.009% ( 870, 1300 ] 17 0.007% 100.016% ( 1300, 1900 ] 1 0.000% 100.016% ( 1900, 2900 ] 3 0.001% 100.018% ( 2900, 4400 ] 2 0.001% 100.018% ( 4400, 6600 ] 4 0.002% 100.020% ( 6600, 9900 ] 5 0.002% 100.022% ( 9900, 14000 ] 7 0.003% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 352.2781 StdDev: 1631.09 Min: 1 Median: 2.8205 Max: 12942 Percentiles: P50: 2.82 P75: 10.42 P99: 9735.00 P99.9: 12942.00 P99.99: 12942.00 ------------------------------------------------------ [ 0, 1 ] 20 6.250% 6.250% # ( 1, 2 ] 76 23.750% 30.000% ##### ( 2, 3 ] 78 24.375% 54.375% ##### ( 3, 4 ] 36 11.250% 65.625% ## ( 4, 6 ] 23 7.188% 72.812% # ( 6, 10 ] 6 1.875% 74.688% ( 10, 15 ] 12 3.750% 78.438% # ( 15, 22 ] 24 7.500% 85.938% ## ( 22, 34 ] 11 3.438% 89.375% # ( 34, 51 ] 1 0.312% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 1 0.312% 90.312% ( 250, 380 ] 6 1.875% 92.188% ( 380, 580 ] 7 2.188% 94.375% ( 580, 870 ] 2 0.625% 95.000% ( 870, 1300 ] 2 0.625% 95.625% ( 1900, 2900 ] 2 0.625% 96.250% ( 4400, 6600 ] 5 1.562% 97.812% ( 6600, 9900 ] 4 1.250% 99.062% ( 9900, 14000 ] 3 0.938% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1027.1500 StdDev: 1136.31 Min: 105 Median: 380.0000 Max: 3614 Percentiles: P50: 380.00 P75: 1600.00 P99: 3614.00 P99.9: 3614.00 P99.99: 3614.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 5 25.000% 30.000% ##### ( 170, 250 ] 3 15.000% 45.000% ### ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 2 10.000% 60.000% ## ( 870, 1300 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.1 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.046 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 350.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.221 H:M:S, 7.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/16-14:19:36 ... thread 0: (1000000,4000000) ops and (331256.6,337093.8) ops/second in (3.018808,11.866133) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 3.07 GB 6.3 2.5 0.0 2.5 6.2 3.7 0.0 1.7 125.6 309.3 20.56 19.20 62 0.332 2622K 2804 0.0 0.0 L1 1/1 3.03 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.5 240.1 1.57 1.52 1 1.572 383K 554 0.0 0.0 L2 1/0 53.41 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.3 255.1 1.48 1.45 2 0.740 383K 188 0.0 0.0 L3 19/0 892.77 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 238.4 238.0 4.43 4.06 2 2.215 1072K 2109 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 150.3 150.3 1.50 1.11 1 1.495 228K 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/17 99.82 GB 0.0 4.5 1.0 3.5 8.2 4.7 1.7 2.2 156.4 284.1 29.54 27.34 68 0.434 4691K 5655 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 1.0 3.5 8.2 4.7 1.6 2.2 156.4 284.1 29.54 27.34 68 0.434 4691K 5655 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 1.0 3.5 4.5 1.0 0.0 0.0 244.9 244.6 18.86 17.83 15 1.257 4691K 5655 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 353.9 10.68 9.51 53 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.20 GB write, 692.93 MB/s write, 4.51 GB read, 381.37 MB/s read, 29.5 seconds Interval compaction: 8.20 GB write, 707.26 MB/s write, 4.51 GB read, 389.26 MB/s read, 29.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 884209 Average: 2.1822 StdDev: 14.74 Min: 0 Median: 1.4502 Max: 4754 Percentiles: P50: 1.45 P75: 1.83 P99: 5.60 P99.9: 11.84 P99.99: 102.72 ------------------------------------------------------ [ 0, 1 ] 183036 20.701% 20.701% #### ( 1, 2 ] 575441 65.080% 85.780% ############# ( 2, 3 ] 74395 8.414% 94.194% ## ( 3, 4 ] 27469 3.107% 97.301% # ( 4, 6 ] 18765 2.122% 99.423% ( 6, 10 ] 3863 0.437% 99.860% ( 10, 15 ] 969 0.110% 99.969% ( 15, 22 ] 122 0.014% 99.983% ( 22, 34 ] 10 0.001% 99.984% ( 34, 51 ] 3 0.000% 99.985% ( 51, 76 ] 14 0.002% 99.986% ( 76, 110 ] 44 0.005% 99.991% ( 110, 170 ] 82 0.009% 100.000% ( 170, 250 ] 31 0.004% 100.004% ( 250, 380 ] 18 0.002% 100.006% ( 380, 580 ] 26 0.003% 100.009% ( 580, 870 ] 11 0.001% 100.010% ( 870, 1300 ] 20 0.002% 100.012% ( 1300, 1900 ] 8 0.001% 100.013% ( 1900, 2900 ] 6 0.001% 100.014% ( 2900, 4400 ] 6 0.001% 100.015% ( 4400, 6600 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 26 Average: 227.4615 StdDev: 465.92 Min: 1 Median: 1.7000 Max: 1955 Percentiles: P50: 1.70 P75: 236.67 P99: 1955.00 P99.9: 1955.00 P99.99: 1955.00 ------------------------------------------------------ [ 0, 1 ] 6 23.077% 23.077% ##### ( 1, 2 ] 10 38.462% 61.538% ######## ( 6, 10 ] 1 3.846% 65.385% # ( 170, 250 ] 3 11.538% 76.923% ## ( 250, 380 ] 2 7.692% 84.615% ## ( 380, 580 ] 1 3.846% 88.462% # ( 580, 870 ] 1 3.846% 92.308% # ( 1300, 1900 ] 1 3.846% 96.154% # ( 1900, 2900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 124231 Average: 2.6785 StdDev: 46.61 Min: 1 Median: 1.4461 Max: 9099 Percentiles: P50: 1.45 P75: 1.84 P99: 6.03 P99.9: 135.12 P99.99: 993.12 ------------------------------------------------------ [ 0, 1 ] 26794 21.568% 21.568% #### ( 1, 2 ] 79184 63.739% 85.307% ############# ( 2, 3 ] 10038 8.080% 93.387% ## ( 3, 4 ] 4080 3.284% 96.672% # ( 4, 6 ] 2885 2.322% 98.994% ( 6, 10 ] 965 0.777% 99.771% ( 10, 15 ] 108 0.087% 99.858% ( 15, 22 ] 18 0.014% 99.872% ( 22, 34 ] 2 0.002% 99.874% ( 34, 51 ] 2 0.002% 99.875% ( 51, 76 ] 1 0.001% 99.876% ( 76, 110 ] 8 0.006% 99.882% ( 110, 170 ] 52 0.042% 99.924% ( 170, 250 ] 32 0.026% 99.950% ( 250, 380 ] 23 0.019% 99.969% ( 380, 580 ] 16 0.013% 99.981% ( 580, 870 ] 8 0.006% 99.988% ( 870, 1300 ] 9 0.007% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 6600, 9900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 233020 Average: 3.7160 StdDev: 80.42 Min: 1 Median: 1.6010 Max: 12648 Percentiles: P50: 1.60 P75: 1.99 P99: 8.89 P99.9: 195.07 P99.99: 521.62 ------------------------------------------------------ [ 0, 1 ] 26898 11.543% 11.543% ## ( 1, 2 ] 149093 63.983% 75.526% ############# ( 2, 3 ] 31974 13.722% 89.248% ### ( 3, 4 ] 10752 4.614% 93.862% # ( 4, 6 ] 9249 3.969% 97.831% # ( 6, 10 ] 3769 1.617% 99.449% ( 10, 15 ] 629 0.270% 99.718% ( 15, 22 ] 82 0.035% 99.754% ( 22, 34 ] 10 0.004% 99.758% ( 34, 51 ] 2 0.001% 99.759% ( 51, 76 ] 1 0.000% 99.759% ( 76, 110 ] 37 0.016% 99.775% ( 110, 170 ] 254 0.109% 99.884% ( 170, 250 ] 118 0.051% 99.935% ( 250, 380 ] 94 0.040% 99.975% ( 380, 580 ] 49 0.021% 99.996% ( 580, 870 ] 29 0.012% 100.009% ( 870, 1300 ] 17 0.007% 100.016% ( 1300, 1900 ] 1 0.000% 100.016% ( 1900, 2900 ] 3 0.001% 100.018% ( 2900, 4400 ] 2 0.001% 100.018% ( 4400, 6600 ] 4 0.002% 100.020% ( 6600, 9900 ] 5 0.002% 100.022% ( 9900, 14000 ] 7 0.003% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 352.2781 StdDev: 1631.09 Min: 1 Median: 2.8205 Max: 12942 Percentiles: P50: 2.82 P75: 10.42 P99: 9735.00 P99.9: 12942.00 P99.99: 12942.00 ------------------------------------------------------ [ 0, 1 ] 20 6.250% 6.250% # ( 1, 2 ] 76 23.750% 30.000% ##### ( 2, 3 ] 78 24.375% 54.375% ##### ( 3, 4 ] 36 11.250% 65.625% ## ( 4, 6 ] 23 7.188% 72.812% # ( 6, 10 ] 6 1.875% 74.688% ( 10, 15 ] 12 3.750% 78.438% # ( 15, 22 ] 24 7.500% 85.938% ## ( 22, 34 ] 11 3.438% 89.375% # ( 34, 51 ] 1 0.312% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 1 0.312% 90.312% ( 250, 380 ] 6 1.875% 92.188% ( 380, 580 ] 7 2.188% 94.375% ( 580, 870 ] 2 0.625% 95.000% ( 870, 1300 ] 2 0.625% 95.625% ( 1900, 2900 ] 2 0.625% 96.250% ( 4400, 6600 ] 5 1.562% 97.812% ( 6600, 9900 ] 4 1.250% 99.062% ( 9900, 14000 ] 3 0.938% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1027.1500 StdDev: 1136.31 Min: 105 Median: 380.0000 Max: 3614 Percentiles: P50: 380.00 P75: 1600.00 P99: 3614.00 P99.9: 3614.00 P99.99: 3614.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 5 25.000% 30.000% ##### ( 170, 250 ] 3 15.000% 45.000% ### ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 2 10.000% 60.000% ## ( 870, 1300 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.492 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.447 H:M:S, 14.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-14:19:41 ... thread 0: (1000000,5000000) ops and (194420.1,293951.1) ops/second in (5.143500,17.009633) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 4.12 GB 56.6 3.8 0.0 3.8 8.5 4.7 0.0 1.8 136.7 306.2 28.58 26.80 83 0.344 3965K 4146 0.0 0.0 L1 1/1 3.03 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.5 240.1 1.57 1.52 1 1.572 383K 554 0.0 0.0 L2 1/0 53.41 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.3 255.1 1.48 1.45 2 0.740 383K 188 0.0 0.0 L3 19/0 892.77 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 238.4 238.0 4.43 4.06 2 2.215 1072K 2109 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 150.3 150.3 1.50 1.11 1 1.495 228K 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/17 100.87 GB 0.0 5.8 1.0 4.8 10.5 5.7 1.7 2.2 158.2 287.2 37.56 34.94 89 0.422 6034K 6997 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 1.0 4.8 10.5 5.7 1.6 2.2 158.2 287.2 37.56 34.94 89 0.422 6034K 6997 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 1.0 4.8 5.8 1.0 0.0 0.0 249.6 249.3 23.80 22.69 20 1.190 6034K 6997 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 352.7 13.75 12.25 69 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.3 total, 17.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.53 GB write, 625.04 MB/s write, 5.80 GB read, 344.37 MB/s read, 37.6 seconds Interval compaction: 10.53 GB write, 634.06 MB/s write, 5.80 GB read, 349.34 MB/s read, 37.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 15, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1506345 Average: 2.1860 StdDev: 12.75 Min: 0 Median: 1.4716 Max: 4754 Percentiles: P50: 1.47 P75: 1.85 P99: 5.66 P99.9: 11.23 P99.99: 18.86 ------------------------------------------------------ [ 0, 1 ] 278955 18.519% 18.519% #### ( 1, 2 ] 1005493 66.751% 85.269% ############# ( 2, 3 ] 133799 8.882% 94.152% ## ( 3, 4 ] 46382 3.079% 97.231% # ( 4, 6 ] 32080 2.130% 99.360% ( 6, 10 ] 7719 0.512% 99.873% ( 10, 15 ] 1667 0.111% 99.983% ( 15, 22 ] 182 0.012% 99.995% ( 22, 34 ] 17 0.001% 99.997% ( 34, 51 ] 5 0.000% 99.997% ( 51, 76 ] 17 0.001% 99.998% ( 76, 110 ] 81 0.005% 100.003% ( 110, 170 ] 111 0.007% 100.011% ( 170, 250 ] 46 0.003% 100.014% ( 250, 380 ] 26 0.002% 100.016% ( 380, 580 ] 34 0.002% 100.018% ( 580, 870 ] 24 0.002% 100.019% ( 870, 1300 ] 28 0.002% 100.021% ( 1300, 1900 ] 8 0.001% 100.022% ( 1900, 2900 ] 8 0.001% 100.022% ( 2900, 4400 ] 8 0.001% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 26 Average: 227.4615 StdDev: 465.92 Min: 1 Median: 1.7000 Max: 1955 Percentiles: P50: 1.70 P75: 236.67 P99: 1955.00 P99.9: 1955.00 P99.99: 1955.00 ------------------------------------------------------ [ 0, 1 ] 6 23.077% 23.077% ##### ( 1, 2 ] 10 38.462% 61.538% ######## ( 6, 10 ] 1 3.846% 65.385% # ( 170, 250 ] 3 11.538% 76.923% ## ( 250, 380 ] 2 7.692% 84.615% ## ( 380, 580 ] 1 3.846% 88.462% # ( 580, 870 ] 1 3.846% 92.308% # ( 1300, 1900 ] 1 3.846% 96.154% # ( 1900, 2900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 124231 Average: 2.6785 StdDev: 46.61 Min: 1 Median: 1.4461 Max: 9099 Percentiles: P50: 1.45 P75: 1.84 P99: 6.03 P99.9: 135.12 P99.99: 993.12 ------------------------------------------------------ [ 0, 1 ] 26794 21.568% 21.568% #### ( 1, 2 ] 79184 63.739% 85.307% ############# ( 2, 3 ] 10038 8.080% 93.387% ## ( 3, 4 ] 4080 3.284% 96.672% # ( 4, 6 ] 2885 2.322% 98.994% ( 6, 10 ] 965 0.777% 99.771% ( 10, 15 ] 108 0.087% 99.858% ( 15, 22 ] 18 0.014% 99.872% ( 22, 34 ] 2 0.002% 99.874% ( 34, 51 ] 2 0.002% 99.875% ( 51, 76 ] 1 0.001% 99.876% ( 76, 110 ] 8 0.006% 99.882% ( 110, 170 ] 52 0.042% 99.924% ( 170, 250 ] 32 0.026% 99.950% ( 250, 380 ] 23 0.019% 99.969% ( 380, 580 ] 16 0.013% 99.981% ( 580, 870 ] 8 0.006% 99.988% ( 870, 1300 ] 9 0.007% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 6600, 9900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 233020 Average: 3.7160 StdDev: 80.42 Min: 1 Median: 1.6010 Max: 12648 Percentiles: P50: 1.60 P75: 1.99 P99: 8.89 P99.9: 195.07 P99.99: 521.62 ------------------------------------------------------ [ 0, 1 ] 26898 11.543% 11.543% ## ( 1, 2 ] 149093 63.983% 75.526% ############# ( 2, 3 ] 31974 13.722% 89.248% ### ( 3, 4 ] 10752 4.614% 93.862% # ( 4, 6 ] 9249 3.969% 97.831% # ( 6, 10 ] 3769 1.617% 99.449% ( 10, 15 ] 629 0.270% 99.718% ( 15, 22 ] 82 0.035% 99.754% ( 22, 34 ] 10 0.004% 99.758% ( 34, 51 ] 2 0.001% 99.759% ( 51, 76 ] 1 0.000% 99.759% ( 76, 110 ] 37 0.016% 99.775% ( 110, 170 ] 254 0.109% 99.884% ( 170, 250 ] 118 0.051% 99.935% ( 250, 380 ] 94 0.040% 99.975% ( 380, 580 ] 49 0.021% 99.996% ( 580, 870 ] 29 0.012% 100.009% ( 870, 1300 ] 17 0.007% 100.016% ( 1300, 1900 ] 1 0.000% 100.016% ( 1900, 2900 ] 3 0.001% 100.018% ( 2900, 4400 ] 2 0.001% 100.018% ( 4400, 6600 ] 4 0.002% 100.020% ( 6600, 9900 ] 5 0.002% 100.022% ( 9900, 14000 ] 7 0.003% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 352.2781 StdDev: 1631.09 Min: 1 Median: 2.8205 Max: 12942 Percentiles: P50: 2.82 P75: 10.42 P99: 9735.00 P99.9: 12942.00 P99.99: 12942.00 ------------------------------------------------------ [ 0, 1 ] 20 6.250% 6.250% # ( 1, 2 ] 76 23.750% 30.000% ##### ( 2, 3 ] 78 24.375% 54.375% ##### ( 3, 4 ] 36 11.250% 65.625% ## ( 4, 6 ] 23 7.188% 72.812% # ( 6, 10 ] 6 1.875% 74.688% ( 10, 15 ] 12 3.750% 78.438% # ( 15, 22 ] 24 7.500% 85.938% ## ( 22, 34 ] 11 3.438% 89.375% # ( 34, 51 ] 1 0.312% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 1 0.312% 90.312% ( 250, 380 ] 6 1.875% 92.188% ( 380, 580 ] 7 2.188% 94.375% ( 580, 870 ] 2 0.625% 95.000% ( 870, 1300 ] 2 0.625% 95.625% ( 1900, 2900 ] 2 0.625% 96.250% ( 4400, 6600 ] 5 1.562% 97.812% ( 6600, 9900 ] 4 1.250% 99.062% ( 9900, 14000 ] 3 0.938% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1027.1500 StdDev: 1136.31 Min: 105 Median: 380.0000 Max: 3614 Percentiles: P50: 380.00 P75: 1600.00 P99: 3614.00 P99.9: 3614.00 P99.99: 3614.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 5 25.000% 30.000% ##### ( 170, 250 ] 3 15.000% 45.000% ### ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 2 10.000% 60.000% ## ( 870, 1300 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 17.3 total, 5.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 285.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.943 H:M:S, 22.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 191.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.450 H:M:S, 47.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-14:19:49 ... thread 0: (1000000,6000000) ops and (137431.6,247056.1) ops/second in (7.276347,24.285980) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 2.27 GB 6.3 5.4 0.0 5.4 11.0 5.7 0.0 1.9 147.2 302.6 37.24 35.06 102 0.365 5564K 7327 0.0 0.0 L1 15/15 1.73 GB 0.0 3.1 3.1 0.0 3.1 3.1 0.2 1.0 228.1 225.4 14.08 13.60 2 7.042 3262K 37K 0.0 0.0 L2 8/4 1.01 GB 5.2 0.4 0.2 0.2 0.4 0.2 1.4 2.0 255.3 255.1 1.48 1.45 2 0.740 383K 188 0.0 0.0 L3 19/1 946.08 MB 0.8 1.1 0.3 0.8 1.1 0.3 0.4 3.7 230.0 229.6 4.93 4.41 3 1.644 1152K 2211 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 150.3 150.3 1.50 1.11 1 1.495 228K 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/28 101.75 GB 0.0 10.2 3.8 6.3 15.8 9.4 2.7 2.8 176.1 273.1 59.23 55.62 110 0.538 10M 47K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 3.8 6.3 15.8 9.4 2.6 2.8 176.1 273.1 59.23 55.62 110 0.538 10M 47K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 3.8 6.3 10.1 3.8 0.0 0.0 244.1 243.0 42.73 40.95 26 1.643 10M 47K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 351.1 16.51 14.68 84 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.5 total, 24.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.80 GB write, 659.43 MB/s write, 10.19 GB read, 425.15 MB/s read, 59.2 seconds Interval compaction: 15.80 GB write, 666.10 MB/s write, 10.19 GB read, 429.44 MB/s read, 59.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 15, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2269229 Average: 2.2782 StdDev: 13.48 Min: 0 Median: 1.4725 Max: 4754 Percentiles: P50: 1.47 P75: 1.84 P99: 5.82 P99.9: 13.60 P99.99: 153.71 ------------------------------------------------------ [ 0, 1 ] 411738 18.144% 18.144% #### ( 1, 2 ] 1529778 67.414% 85.558% ############# ( 2, 3 ] 195249 8.604% 94.163% ## ( 3, 4 ] 68004 2.997% 97.159% # ( 4, 6 ] 45801 2.018% 99.178% ( 6, 10 ] 14481 0.638% 99.816% ( 10, 15 ] 2649 0.117% 99.933% ( 15, 22 ] 462 0.020% 99.953% ( 22, 34 ] 29 0.001% 99.954% ( 34, 51 ] 9 0.000% 99.955% ( 51, 76 ] 20 0.001% 99.956% ( 76, 110 ] 334 0.015% 99.970% ( 110, 170 ] 615 0.027% 99.997% ( 170, 250 ] 213 0.009% 100.007% ( 250, 380 ] 136 0.006% 100.013% ( 380, 580 ] 116 0.005% 100.018% ( 580, 870 ] 71 0.003% 100.021% ( 870, 1300 ] 50 0.002% 100.023% ( 1300, 1900 ] 13 0.001% 100.024% ( 1900, 2900 ] 12 0.001% 100.024% ( 2900, 4400 ] 11 0.000% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 51949 Average: 4.5851 StdDev: 41.45 Min: 1 Median: 1.6216 Max: 3091 Percentiles: P50: 1.62 P75: 2.01 P99: 9.82 P99.9: 526.22 P99.99: 1214.10 ------------------------------------------------------ [ 0, 1 ] 4736 9.117% 9.117% ## ( 1, 2 ] 34169 65.774% 74.891% ############# ( 2, 3 ] 7495 14.428% 89.318% ### ( 3, 4 ] 2224 4.281% 93.599% # ( 4, 6 ] 2085 4.014% 97.613% # ( 6, 10 ] 754 1.451% 99.064% ( 10, 15 ] 147 0.283% 99.347% ( 15, 22 ] 10 0.019% 99.367% ( 22, 34 ] 2 0.004% 99.371% ( 76, 110 ] 93 0.179% 99.550% ( 110, 170 ] 66 0.127% 99.677% ( 170, 250 ] 50 0.096% 99.773% ( 250, 380 ] 39 0.075% 99.848% ( 380, 580 ] 37 0.071% 99.919% ( 580, 870 ] 20 0.038% 99.958% ( 870, 1300 ] 21 0.040% 99.998% ( 1300, 1900 ] 8 0.015% 100.013% ( 1900, 2900 ] 3 0.006% 100.019% ( 2900, 4400 ] 1 0.002% 100.021% ** Level 2 read latency histogram (micros): Count: 124231 Average: 2.6785 StdDev: 46.61 Min: 1 Median: 1.4461 Max: 9099 Percentiles: P50: 1.45 P75: 1.84 P99: 6.03 P99.9: 135.12 P99.99: 993.12 ------------------------------------------------------ [ 0, 1 ] 26794 21.568% 21.568% #### ( 1, 2 ] 79184 63.739% 85.307% ############# ( 2, 3 ] 10038 8.080% 93.387% ## ( 3, 4 ] 4080 3.284% 96.672% # ( 4, 6 ] 2885 2.322% 98.994% ( 6, 10 ] 965 0.777% 99.771% ( 10, 15 ] 108 0.087% 99.858% ( 15, 22 ] 18 0.014% 99.872% ( 22, 34 ] 2 0.002% 99.874% ( 34, 51 ] 2 0.002% 99.875% ( 51, 76 ] 1 0.001% 99.876% ( 76, 110 ] 8 0.006% 99.882% ( 110, 170 ] 52 0.042% 99.924% ( 170, 250 ] 32 0.026% 99.950% ( 250, 380 ] 23 0.019% 99.969% ( 380, 580 ] 16 0.013% 99.981% ( 580, 870 ] 8 0.006% 99.988% ( 870, 1300 ] 9 0.007% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 6600, 9900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 239387 Average: 4.0550 StdDev: 80.11 Min: 1 Median: 1.6022 Max: 12648 Percentiles: P50: 1.60 P75: 1.99 P99: 9.34 P99.9: 253.67 P99.99: 587.89 ------------------------------------------------------ [ 0, 1 ] 27474 11.477% 11.477% ## ( 1, 2 ] 153140 63.972% 75.449% ############# ( 2, 3 ] 32683 13.653% 89.101% ### ( 3, 4 ] 11067 4.623% 93.724% # ( 4, 6 ] 9397 3.925% 97.650% # ( 6, 10 ] 3872 1.617% 99.267% ( 10, 15 ] 642 0.268% 99.535% ( 15, 22 ] 87 0.036% 99.572% ( 22, 34 ] 11 0.005% 99.576% ( 34, 51 ] 2 0.001% 99.577% ( 51, 76 ] 1 0.000% 99.578% ( 76, 110 ] 163 0.068% 99.646% ( 110, 170 ] 430 0.180% 99.825% ( 170, 250 ] 175 0.073% 99.898% ( 250, 380 ] 128 0.053% 99.952% ( 380, 580 ] 90 0.038% 99.990% ( 580, 870 ] 39 0.016% 100.006% ( 870, 1300 ] 23 0.010% 100.015% ( 1300, 1900 ] 1 0.000% 100.016% ( 1900, 2900 ] 3 0.001% 100.017% ( 2900, 4400 ] 2 0.001% 100.018% ( 4400, 6600 ] 4 0.002% 100.020% ( 6600, 9900 ] 5 0.002% 100.022% ( 9900, 14000 ] 7 0.003% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 352.2781 StdDev: 1631.09 Min: 1 Median: 2.8205 Max: 12942 Percentiles: P50: 2.82 P75: 10.42 P99: 9735.00 P99.9: 12942.00 P99.99: 12942.00 ------------------------------------------------------ [ 0, 1 ] 20 6.250% 6.250% # ( 1, 2 ] 76 23.750% 30.000% ##### ( 2, 3 ] 78 24.375% 54.375% ##### ( 3, 4 ] 36 11.250% 65.625% ## ( 4, 6 ] 23 7.188% 72.812% # ( 6, 10 ] 6 1.875% 74.688% ( 10, 15 ] 12 3.750% 78.438% # ( 15, 22 ] 24 7.500% 85.938% ## ( 22, 34 ] 11 3.438% 89.375% # ( 34, 51 ] 1 0.312% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 1 0.312% 90.312% ( 250, 380 ] 6 1.875% 92.188% ( 380, 580 ] 7 2.188% 94.375% ( 580, 870 ] 2 0.625% 95.000% ( 870, 1300 ] 2 0.625% 95.625% ( 1900, 2900 ] 2 0.625% 96.250% ( 4400, 6600 ] 5 1.562% 97.812% ( 6600, 9900 ] 4 1.250% 99.062% ( 9900, 14000 ] 3 0.938% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1027.1500 StdDev: 1136.31 Min: 105 Median: 380.0000 Max: 3614 Percentiles: P50: 380.00 P75: 1600.00 P99: 3614.00 P99.9: 3614.00 P99.99: 3614.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 5 25.000% 30.000% ##### ( 170, 250 ] 3 15.000% 45.000% ### ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 2 10.000% 60.000% ## ( 870, 1300 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 24.5 total, 7.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 240.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.573 H:M:S, 34.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 135.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.630 H:M:S, 63.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-14:19:53 ... thread 0: (1000000,7000000) ops and (202645.9,239556.2) ops/second in (4.934715,29.220695) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 3.32 GB 113.3 6.1 0.0 6.1 12.8 6.7 0.0 1.9 143.6 301.6 43.42 40.78 120 0.362 6331K 8049 0.0 0.0 L1 15/15 1.73 GB 0.0 3.1 3.1 0.0 3.1 3.1 0.2 1.0 228.1 225.4 14.08 13.60 2 7.042 3262K 37K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.4 2.0 255.3 255.1 1.48 1.45 2 0.740 383K 188 0.0 0.0 L3 33/9 1.39 GB 1.0 2.5 1.3 1.2 2.5 1.3 0.4 1.9 222.9 222.4 11.57 10.64 7 1.653 2620K 6219 0.0 0.0 L4 175/9 9.56 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 150.3 150.3 1.50 1.11 1 1.495 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1294/41 102.79 GB 0.0 12.3 4.8 7.5 19.0 11.5 3.9 2.8 175.3 269.9 72.06 67.57 132 0.546 12M 52K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.3 4.8 7.5 19.0 11.5 3.8 2.8 175.3 269.9 72.06 67.57 132 0.546 12M 52K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.3 4.8 7.5 12.3 4.8 0.0 0.0 240.9 239.9 52.43 50.16 33 1.589 12M 52K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 349.9 19.63 17.41 99 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.5 total, 29.2 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.99 GB write, 659.88 MB/s write, 12.34 GB read, 428.65 MB/s read, 72.1 seconds Interval compaction: 18.99 GB write, 665.42 MB/s write, 12.34 GB read, 432.25 MB/s read, 72.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 20, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2701726 Average: 2.3348 StdDev: 13.44 Min: 0 Median: 1.4971 Max: 4754 Percentiles: P50: 1.50 P75: 1.87 P99: 5.93 P99.9: 13.63 P99.99: 152.53 ------------------------------------------------------ [ 0, 1 ] 449080 16.622% 16.622% ### ( 1, 2 ] 1814139 67.147% 83.769% ############# ( 2, 3 ] 259702 9.612% 93.382% ## ( 3, 4 ] 89497 3.313% 96.694% # ( 4, 6 ] 64681 2.394% 99.088% ( 6, 10 ] 19511 0.722% 99.811% ( 10, 15 ] 3330 0.123% 99.934% ( 15, 22 ] 540 0.020% 99.954% ( 22, 34 ] 35 0.001% 99.955% ( 34, 51 ] 13 0.000% 99.956% ( 51, 76 ] 23 0.001% 99.957% ( 76, 110 ] 381 0.014% 99.971% ( 110, 170 ] 739 0.027% 99.998% ( 170, 250 ] 282 0.010% 100.008% ( 250, 380 ] 174 0.006% 100.015% ( 380, 580 ] 160 0.006% 100.021% ( 580, 870 ] 88 0.003% 100.024% ( 870, 1300 ] 61 0.002% 100.026% ( 1300, 1900 ] 15 0.001% 100.027% ( 1900, 2900 ] 13 0.000% 100.027% ( 2900, 4400 ] 13 0.000% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 361226 Average: 3.1371 StdDev: 19.48 Min: 1 Median: 1.6492 Max: 3091 Percentiles: P50: 1.65 P75: 2.12 P99: 8.97 P99.9: 165.80 P99.99: 493.06 ------------------------------------------------------ [ 0, 1 ] 26100 7.225% 7.225% # ( 1, 2 ] 238015 65.891% 73.116% ############# ( 2, 3 ] 56306 15.587% 88.704% ### ( 3, 4 ] 16806 4.652% 93.356% # ( 4, 6 ] 15605 4.320% 97.676% # ( 6, 10 ] 6432 1.781% 99.457% ( 10, 15 ] 998 0.276% 99.733% ( 15, 22 ] 93 0.026% 99.759% ( 22, 34 ] 8 0.002% 99.761% ( 34, 51 ] 2 0.001% 99.762% ( 76, 110 ] 272 0.075% 99.837% ( 110, 170 ] 246 0.068% 99.905% ( 170, 250 ] 145 0.040% 99.945% ( 250, 380 ] 112 0.031% 99.976% ( 380, 580 ] 90 0.025% 100.001% ( 580, 870 ] 34 0.009% 100.011% ( 870, 1300 ] 33 0.009% 100.020% ( 1300, 1900 ] 8 0.002% 100.022% ( 1900, 2900 ] 3 0.001% 100.023% ( 2900, 4400 ] 1 0.000% 100.023% ** Level 2 read latency histogram (micros): Count: 124231 Average: 2.6785 StdDev: 46.61 Min: 1 Median: 1.4461 Max: 9099 Percentiles: P50: 1.45 P75: 1.84 P99: 6.03 P99.9: 135.12 P99.99: 993.12 ------------------------------------------------------ [ 0, 1 ] 26794 21.568% 21.568% #### ( 1, 2 ] 79184 63.739% 85.307% ############# ( 2, 3 ] 10038 8.080% 93.387% ## ( 3, 4 ] 4080 3.284% 96.672% # ( 4, 6 ] 2885 2.322% 98.994% ( 6, 10 ] 965 0.777% 99.771% ( 10, 15 ] 108 0.087% 99.858% ( 15, 22 ] 18 0.014% 99.872% ( 22, 34 ] 2 0.002% 99.874% ( 34, 51 ] 2 0.002% 99.875% ( 51, 76 ] 1 0.001% 99.876% ( 76, 110 ] 8 0.006% 99.882% ( 110, 170 ] 52 0.042% 99.924% ( 170, 250 ] 32 0.026% 99.950% ( 250, 380 ] 23 0.019% 99.969% ( 380, 580 ] 16 0.013% 99.981% ( 580, 870 ] 8 0.006% 99.988% ( 870, 1300 ] 9 0.007% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 6600, 9900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 309865 Average: 3.9360 StdDev: 71.99 Min: 1 Median: 1.6414 Max: 12648 Percentiles: P50: 1.64 P75: 2.17 P99: 9.09 P99.9: 235.77 P99.99: 548.36 ------------------------------------------------------ [ 0, 1 ] 30818 9.946% 9.946% ## ( 1, 2 ] 193519 62.453% 72.398% ############ ( 2, 3 ] 47257 15.251% 87.649% ### ( 3, 4 ] 16629 5.367% 93.016% # ( 4, 6 ] 14734 4.755% 97.771% # ( 6, 10 ] 4943 1.595% 99.366% ( 10, 15 ] 755 0.244% 99.610% ( 15, 22 ] 108 0.035% 99.644% ( 22, 34 ] 13 0.004% 99.649% ( 34, 51 ] 3 0.001% 99.650% ( 51, 76 ] 1 0.000% 99.650% ( 76, 110 ] 165 0.053% 99.703% ( 110, 170 ] 453 0.146% 99.849% ( 170, 250 ] 196 0.063% 99.913% ( 250, 380 ] 143 0.046% 99.959% ( 380, 580 ] 120 0.039% 99.997% ( 580, 870 ] 56 0.018% 100.015% ( 870, 1300 ] 30 0.010% 100.025% ( 1300, 1900 ] 2 0.001% 100.026% ( 1900, 2900 ] 4 0.001% 100.027% ( 2900, 4400 ] 5 0.002% 100.029% ( 4400, 6600 ] 4 0.001% 100.030% ( 6600, 9900 ] 5 0.002% 100.032% ( 9900, 14000 ] 7 0.002% 100.034% ** Level 4 read latency histogram (micros): Count: 1412 Average: 223.9023 StdDev: 855.94 Min: 1 Median: 3.2745 Max: 12942 Percentiles: P50: 3.27 P75: 163.21 P99: 3980.00 P99.9: 12070.27 P99.99: 12942.00 ------------------------------------------------------ [ 0, 1 ] 36 2.550% 2.550% # ( 1, 2 ] 384 27.195% 29.745% ##### ( 2, 3 ] 258 18.272% 48.017% #### ( 3, 4 ] 103 7.295% 55.312% # ( 4, 6 ] 83 5.878% 61.190% # ( 6, 10 ] 18 1.275% 62.465% ( 10, 15 ] 22 1.558% 64.023% ( 15, 22 ] 25 1.771% 65.793% ( 22, 34 ] 11 0.779% 66.572% ( 34, 51 ] 1 0.071% 66.643% ( 76, 110 ] 25 1.771% 68.414% ( 110, 170 ] 106 7.507% 75.921% ## ( 170, 250 ] 64 4.533% 80.453% # ( 250, 380 ] 72 5.099% 85.552% # ( 380, 580 ] 81 5.737% 91.289% # ( 580, 870 ] 58 4.108% 95.397% # ( 870, 1300 ] 32 2.266% 97.663% ( 1300, 1900 ] 10 0.708% 98.371% ( 1900, 2900 ] 7 0.496% 98.867% ( 2900, 4400 ] 4 0.283% 99.150% ( 4400, 6600 ] 6 0.425% 99.575% ( 6600, 9900 ] 4 0.283% 99.858% ( 9900, 14000 ] 3 0.212% 100.071% ** Level 5 read latency histogram (micros): Count: 60 Average: 904.1333 StdDev: 1160.51 Min: 92 Median: 240.0000 Max: 4688 Percentiles: P50: 240.00 P75: 1300.00 P99: 4688.00 P99.9: 4688.00 P99.99: 4688.00 ------------------------------------------------------ ( 76, 110 ] 8 13.333% 13.333% ### ( 110, 170 ] 15 25.000% 38.333% ##### ( 170, 250 ] 8 13.333% 51.667% ### ( 250, 380 ] 1 1.667% 53.333% ( 380, 580 ] 6 10.000% 63.333% ## ( 580, 870 ] 5 8.333% 71.667% ## ( 870, 1300 ] 2 3.333% 75.000% # ( 1300, 1900 ] 4 6.667% 81.667% # ( 1900, 2900 ] 6 10.000% 91.667% ## ( 2900, 4400 ] 4 6.667% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 29.5 total, 4.9 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 233.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.776 H:M:S, 36.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 199.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.203 H:M:S, 44.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 0 2024/12/16-14:20:04 ... thread 0: (1000000,8000000) ops and (98281.0,203068.3) ops/second in (10.174910,39.395605) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 4.30 GB 214.0 7.2 0.0 7.2 14.9 7.7 0.0 1.9 145.0 299.7 50.83 47.62 139 0.366 7483K 9285 0.0 0.0 L1 15/15 1.73 GB 0.0 3.1 3.1 0.0 3.1 3.1 0.2 1.0 228.1 225.4 14.08 13.60 2 7.042 3262K 37K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.4 2.0 255.3 255.1 1.48 1.45 2 0.740 383K 188 0.0 0.0 L3 24/0 984.74 MB 1.0 2.5 1.3 1.2 2.5 1.3 0.4 1.9 222.9 222.4 11.57 10.64 7 1.653 2620K 6219 0.0 0.0 L4 180/0 9.62 GB 1.0 0.7 0.6 0.0 0.7 0.6 0.8 1.1 130.0 129.8 5.39 3.36 10 0.539 707K 1021 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/23 103.77 GB 0.0 13.9 5.3 8.6 21.5 12.9 4.2 2.8 170.8 264.6 83.36 76.66 160 0.521 14M 54K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 5.3 8.6 21.5 12.9 4.1 2.8 170.8 264.6 83.36 76.66 160 0.521 14M 54K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 5.3 8.6 13.9 5.2 0.0 0.0 234.9 234.0 60.63 56.64 46 1.318 14M 54K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.7 7.7 0.0 0.0 0.0 346.5 22.73 20.02 114 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.6 total, 39.4 interval Flush(GB): cumulative 7.690, interval 7.690 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.54 GB write, 556.47 MB/s write, 13.91 GB read, 359.22 MB/s read, 83.4 seconds Interval compaction: 21.54 GB write, 559.94 MB/s write, 13.91 GB read, 361.46 MB/s read, 83.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 35, total-stops: 21, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3254804 Average: 2.3288 StdDev: 13.32 Min: 0 Median: 1.4914 Max: 4754 Percentiles: P50: 1.49 P75: 1.86 P99: 5.95 P99.9: 13.89 P99.99: 155.69 ------------------------------------------------------ [ 0, 1 ] 552803 16.984% 16.984% ### ( 1, 2 ] 2186639 67.182% 84.166% ############# ( 2, 3 ] 304206 9.346% 93.512% ## ( 3, 4 ] 104693 3.217% 96.729% # ( 4, 6 ] 75795 2.329% 99.058% ( 6, 10 ] 24234 0.745% 99.802% ( 10, 15 ] 4089 0.126% 99.928% ( 15, 22 ] 661 0.020% 99.948% ( 22, 34 ] 43 0.001% 99.950% ( 34, 51 ] 15 0.000% 99.950% ( 51, 76 ] 23 0.001% 99.951% ( 76, 110 ] 545 0.017% 99.967% ( 110, 170 ] 962 0.030% 99.997% ( 170, 250 ] 353 0.011% 100.008% ( 250, 380 ] 200 0.006% 100.014% ( 380, 580 ] 195 0.006% 100.020% ( 580, 870 ] 105 0.003% 100.023% ( 870, 1300 ] 68 0.002% 100.025% ( 1300, 1900 ] 17 0.001% 100.026% ( 1900, 2900 ] 16 0.000% 100.026% ( 2900, 4400 ] 15 0.000% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 689110 Average: 2.7912 StdDev: 20.91 Min: 1 Median: 1.5305 Max: 5812 Percentiles: P50: 1.53 P75: 1.92 P99: 8.70 P99.9: 140.85 P99.99: 485.52 ------------------------------------------------------ [ 0, 1 ] 107504 15.600% 15.600% ### ( 1, 2 ] 446864 64.847% 80.447% ############# ( 2, 3 ] 75625 10.974% 91.421% ## ( 3, 4 ] 23598 3.424% 94.846% # ( 4, 6 ] 20878 3.030% 97.875% # ( 6, 10 ] 11467 1.664% 99.539% ( 10, 15 ] 1457 0.211% 99.751% ( 15, 22 ] 188 0.027% 99.778% ( 22, 34 ] 11 0.002% 99.780% ( 34, 51 ] 2 0.000% 99.780% ( 51, 76 ] 1 0.000% 99.780% ( 76, 110 ] 575 0.083% 99.864% ( 110, 170 ] 488 0.071% 99.934% ( 170, 250 ] 191 0.028% 99.962% ( 250, 380 ] 133 0.019% 99.981% ( 380, 580 ] 112 0.016% 99.998% ( 580, 870 ] 42 0.006% 100.004% ( 870, 1300 ] 33 0.005% 100.009% ( 1300, 1900 ] 9 0.001% 100.010% ( 1900, 2900 ] 5 0.001% 100.011% ( 2900, 4400 ] 7 0.001% 100.012% ( 4400, 6600 ] 2 0.000% 100.012% ** Level 2 read latency histogram (micros): Count: 124231 Average: 2.6785 StdDev: 46.61 Min: 1 Median: 1.4461 Max: 9099 Percentiles: P50: 1.45 P75: 1.84 P99: 6.03 P99.9: 135.12 P99.99: 993.12 ------------------------------------------------------ [ 0, 1 ] 26794 21.568% 21.568% #### ( 1, 2 ] 79184 63.739% 85.307% ############# ( 2, 3 ] 10038 8.080% 93.387% ## ( 3, 4 ] 4080 3.284% 96.672% # ( 4, 6 ] 2885 2.322% 98.994% ( 6, 10 ] 965 0.777% 99.771% ( 10, 15 ] 108 0.087% 99.858% ( 15, 22 ] 18 0.014% 99.872% ( 22, 34 ] 2 0.002% 99.874% ( 34, 51 ] 2 0.002% 99.875% ( 51, 76 ] 1 0.001% 99.876% ( 76, 110 ] 8 0.006% 99.882% ( 110, 170 ] 52 0.042% 99.924% ( 170, 250 ] 32 0.026% 99.950% ( 250, 380 ] 23 0.019% 99.969% ( 380, 580 ] 16 0.013% 99.981% ( 580, 870 ] 8 0.006% 99.988% ( 870, 1300 ] 9 0.007% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 6600, 9900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 407112 Average: 4.2483 StdDev: 79.73 Min: 1 Median: 1.7128 Max: 12648 Percentiles: P50: 1.71 P75: 2.46 P99: 8.94 P99.9: 152.26 P99.99: 276.59 ------------------------------------------------------ [ 0, 1 ] 32383 7.954% 7.954% ## ( 1, 2 ] 240155 58.990% 66.944% ############ ( 2, 3 ] 71245 17.500% 84.444% #### ( 3, 4 ] 27048 6.644% 91.088% # ( 4, 6 ] 27179 6.676% 97.764% # ( 6, 10 ] 6836 1.679% 99.443% ( 10, 15 ] 1210 0.297% 99.741% ( 15, 22 ] 137 0.034% 99.774% ( 22, 34 ] 17 0.004% 99.778% ( 34, 51 ] 6 0.001% 99.780% ( 51, 76 ] 2 0.000% 99.780% ( 76, 110 ] 165 0.041% 99.821% ( 110, 170 ] 457 0.112% 99.933% ( 170, 250 ] 200 0.049% 99.982% ( 250, 380 ] 153 0.038% 100.020% ( 380, 580 ] 137 0.034% 100.054% ( 580, 870 ] 60 0.015% 100.068% ( 870, 1300 ] 40 0.010% 100.078% ( 1300, 1900 ] 3 0.001% 100.079% ( 1900, 2900 ] 17 0.004% 100.083% ( 2900, 4400 ] 29 0.007% 100.090% ( 4400, 6600 ] 14 0.003% 100.094% ( 6600, 9900 ] 7 0.002% 100.095% ( 9900, 14000 ] 8 0.002% 100.097% ** Level 4 read latency histogram (micros): Count: 9197 Average: 56.4125 StdDev: 408.56 Min: 1 Median: 2.0107 Max: 12942 Percentiles: P50: 2.01 P75: 3.40 P99: 1138.08 P99.9: 5909.51 P99.99: 10009.74 ------------------------------------------------------ [ 0, 1 ] 324 3.523% 3.523% # ( 1, 2 ] 4254 46.254% 49.777% ######### ( 2, 3 ] 1916 20.833% 70.610% #### ( 3, 4 ] 1002 10.895% 81.505% ## ( 4, 6 ] 778 8.459% 89.964% ## ( 6, 10 ] 172 1.870% 91.834% ( 10, 15 ] 83 0.902% 92.737% ( 15, 22 ] 30 0.326% 93.063% ( 22, 34 ] 12 0.130% 93.193% ( 34, 51 ] 1 0.011% 93.204% ( 76, 110 ] 25 0.272% 93.476% ( 110, 170 ] 113 1.229% 94.705% ( 170, 250 ] 72 0.783% 95.488% ( 250, 380 ] 86 0.935% 96.423% ( 380, 580 ] 109 1.185% 97.608% ( 580, 870 ] 90 0.979% 98.586% ( 870, 1300 ] 61 0.663% 99.250% ( 1300, 1900 ] 21 0.228% 99.478% ( 1900, 2900 ] 21 0.228% 99.706% ( 2900, 4400 ] 13 0.141% 99.848% ( 4400, 6600 ] 7 0.076% 99.924% ( 6600, 9900 ] 6 0.065% 99.989% ( 9900, 14000 ] 3 0.033% 100.022% ** Level 5 read latency histogram (micros): Count: 80 Average: 1031.6875 StdDev: 1311.37 Min: 92 Median: 380.0000 Max: 5499 Percentiles: P50: 380.00 P75: 1420.00 P99: 5499.00 P99.9: 5499.00 P99.99: 5499.00 ------------------------------------------------------ ( 76, 110 ] 8 10.000% 10.000% ## ( 110, 170 ] 15 18.750% 28.750% #### ( 170, 250 ] 10 12.500% 41.250% ### ( 250, 380 ] 7 8.750% 50.000% ## ( 380, 580 ] 6 7.500% 57.500% ## ( 580, 870 ] 9 11.250% 68.750% ## ( 870, 1300 ] 4 5.000% 73.750% # ( 1300, 1900 ] 5 6.250% 80.000% # ( 1900, 2900 ] 8 10.000% 90.000% ## ( 2900, 4400 ] 5 6.250% 96.250% # ( 4400, 6600 ] 3 3.750% 100.000% # ** DB Stats ** Uptime(secs): 39.6 total, 10.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 198.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.130 H:M:S, 45.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 96.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.354 H:M:S, 72.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/16-14:20:14 ... thread 0: (1000000,9000000) ops and (96246.3,180775.1) ops/second in (10.390011,49.785616) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 2.95 GB 56.6 7.8 0.0 7.8 16.3 8.5 0.0 1.9 142.3 299.2 55.76 52.09 153 0.364 8059K 9912 0.0 0.0 L1 17/17 2.06 GB 0.0 7.1 5.3 1.7 7.0 5.2 0.2 1.3 222.3 219.2 32.59 30.70 3 10.864 7060K 37K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.2 2.0 255.3 255.1 1.48 1.45 2 0.740 383K 188 0.0 0.0 L3 19/0 999.75 MB 1.0 5.9 3.1 2.8 5.9 3.1 0.4 1.9 195.4 194.5 30.83 26.53 19 1.623 6119K 27K 0.0 0.0 L4 178/0 9.42 GB 1.0 2.5 2.4 0.1 2.5 2.4 0.8 1.0 153.0 152.7 17.04 12.26 32 0.533 2593K 2978 0.0 0.0 L5 1084/0 89.14 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1314/31 104.55 GB 0.0 23.6 11.1 12.5 32.0 19.5 8.0 3.7 175.7 238.2 137.71 123.02 209 0.659 24M 77K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.6 11.1 12.5 32.0 19.5 7.9 3.7 175.7 238.2 137.71 123.02 209 0.659 24M 77K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.6 11.1 12.5 23.5 10.9 0.0 0.0 215.5 214.2 112.27 100.71 83 1.353 24M 77K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 344.3 25.44 22.31 126 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.0 total, 49.8 interval Flush(GB): cumulative 8.552, interval 8.552 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.04 GB write, 655.67 MB/s write, 23.62 GB read, 483.50 MB/s read, 137.7 seconds Interval compaction: 32.04 GB write, 658.90 MB/s write, 23.62 GB read, 485.89 MB/s read, 137.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 38, pending-compaction-bytes-stops: 0, total-delays: 59, total-stops: 25, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3784058 Average: 2.6469 StdDev: 17.97 Min: 0 Median: 1.5193 Max: 4754 Percentiles: P50: 1.52 P75: 1.90 P99: 7.10 P99.9: 109.87 P99.99: 326.66 ------------------------------------------------------ [ 0, 1 ] 600362 15.866% 15.866% ### ( 1, 2 ] 2487260 65.730% 81.596% ############# ( 2, 3 ] 392259 10.366% 91.962% ## ( 3, 4 ] 139647 3.690% 95.652% # ( 4, 6 ] 117147 3.096% 98.748% # ( 6, 10 ] 34838 0.921% 99.668% ( 10, 15 ] 5950 0.157% 99.826% ( 15, 22 ] 881 0.023% 99.849% ( 22, 34 ] 77 0.002% 99.851% ( 34, 51 ] 17 0.000% 99.851% ( 51, 76 ] 26 0.001% 99.852% ( 76, 110 ] 1817 0.048% 99.900% ( 110, 170 ] 2422 0.064% 99.964% ( 170, 250 ] 667 0.018% 99.982% ( 250, 380 ] 525 0.014% 99.996% ( 380, 580 ] 521 0.014% 100.009% ( 580, 870 ] 345 0.009% 100.019% ( 870, 1300 ] 186 0.005% 100.023% ( 1300, 1900 ] 62 0.002% 100.025% ( 1900, 2900 ] 34 0.001% 100.026% ( 2900, 4400 ] 19 0.001% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1287332 Average: 3.7777 StdDev: 43.93 Min: 1 Median: 1.6648 Max: 14526 Percentiles: P50: 1.66 P75: 2.36 P99: 9.44 P99.9: 162.44 P99.99: 448.73 ------------------------------------------------------ [ 0, 1 ] 145076 11.270% 11.270% ## ( 1, 2 ] 749967 58.257% 69.527% ############ ( 2, 3 ] 194973 15.146% 84.672% ### ( 3, 4 ] 78136 6.070% 90.742% # ( 4, 6 ] 83318 6.472% 97.214% # ( 6, 10 ] 26767 2.079% 99.294% ( 10, 15 ] 4920 0.382% 99.676% ( 15, 22 ] 549 0.043% 99.718% ( 22, 34 ] 55 0.004% 99.723% ( 34, 51 ] 6 0.000% 99.723% ( 51, 76 ] 43 0.003% 99.726% ( 76, 110 ] 1178 0.092% 99.818% ( 110, 170 ] 1209 0.094% 99.912% ( 170, 250 ] 414 0.032% 99.944% ( 250, 380 ] 439 0.034% 99.978% ( 380, 580 ] 446 0.035% 100.013% ( 580, 870 ] 283 0.022% 100.035% ( 870, 1300 ] 210 0.016% 100.051% ( 1300, 1900 ] 68 0.005% 100.056% ( 1900, 2900 ] 38 0.003% 100.059% ( 2900, 4400 ] 41 0.003% 100.062% ( 4400, 6600 ] 14 0.001% 100.064% ( 6600, 9900 ] 4 0.000% 100.064% ( 9900, 14000 ] 2 0.000% 100.064% ( 14000, 22000 ] 1 0.000% 100.064% ** Level 2 read latency histogram (micros): Count: 124231 Average: 2.6785 StdDev: 46.61 Min: 1 Median: 1.4461 Max: 9099 Percentiles: P50: 1.45 P75: 1.84 P99: 6.03 P99.9: 135.12 P99.99: 993.12 ------------------------------------------------------ [ 0, 1 ] 26794 21.568% 21.568% #### ( 1, 2 ] 79184 63.739% 85.307% ############# ( 2, 3 ] 10038 8.080% 93.387% ## ( 3, 4 ] 4080 3.284% 96.672% # ( 4, 6 ] 2885 2.322% 98.994% ( 6, 10 ] 965 0.777% 99.771% ( 10, 15 ] 108 0.087% 99.858% ( 15, 22 ] 18 0.014% 99.872% ( 22, 34 ] 2 0.002% 99.874% ( 34, 51 ] 2 0.002% 99.875% ( 51, 76 ] 1 0.001% 99.876% ( 76, 110 ] 8 0.006% 99.882% ( 110, 170 ] 52 0.042% 99.924% ( 170, 250 ] 32 0.026% 99.950% ( 250, 380 ] 23 0.019% 99.969% ( 380, 580 ] 16 0.013% 99.981% ( 580, 870 ] 8 0.006% 99.988% ( 870, 1300 ] 9 0.007% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 6600, 9900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1236273 Average: 4.1921 StdDev: 56.19 Min: 1 Median: 1.9099 Max: 12648 Percentiles: P50: 1.91 P75: 2.92 P99: 8.93 P99.9: 16.65 P99.99: 149.51 ------------------------------------------------------ [ 0, 1 ] 43358 3.507% 3.507% # ( 1, 2 ] 631675 51.095% 54.602% ########## ( 2, 3 ] 273957 22.160% 76.762% #### ( 3, 4 ] 119697 9.682% 86.444% ## ( 4, 6 ] 136676 11.055% 97.500% ## ( 6, 10 ] 25284 2.045% 99.545% ( 10, 15 ] 4264 0.345% 99.890% ( 15, 22 ] 534 0.043% 99.933% ( 22, 34 ] 56 0.005% 99.938% ( 34, 51 ] 11 0.001% 99.938% ( 51, 76 ] 27 0.002% 99.941% ( 76, 110 ] 212 0.017% 99.958% ( 110, 170 ] 605 0.049% 100.007% ( 170, 250 ] 420 0.034% 100.041% ( 250, 380 ] 423 0.034% 100.075% ( 380, 580 ] 399 0.032% 100.107% ( 580, 870 ] 322 0.026% 100.133% ( 870, 1300 ] 199 0.016% 100.149% ( 1300, 1900 ] 58 0.005% 100.154% ( 1900, 2900 ] 45 0.004% 100.158% ( 2900, 4400 ] 54 0.004% 100.162% ( 4400, 6600 ] 19 0.002% 100.164% ( 6600, 9900 ] 9 0.001% 100.164% ( 9900, 14000 ] 8 0.001% 100.165% ** Level 4 read latency histogram (micros): Count: 31361 Average: 52.3165 StdDev: 314.71 Min: 0 Median: 2.1417 Max: 12942 Percentiles: P50: 2.14 P75: 3.45 P99: 1154.97 P99.9: 4167.75 P99.99: 8892.98 ------------------------------------------------------ [ 0, 1 ] 777 2.478% 2.478% ( 1, 2 ] 13884 44.272% 46.749% ######### ( 2, 3 ] 7196 22.946% 69.695% ##### ( 3, 4 ] 3675 11.718% 81.413% ## ( 4, 6 ] 2806 8.947% 90.361% ## ( 6, 10 ] 580 1.849% 92.210% ( 10, 15 ] 266 0.848% 93.058% ( 15, 22 ] 52 0.166% 93.224% ( 22, 34 ] 18 0.057% 93.281% ( 34, 51 ] 3 0.010% 93.291% ( 51, 76 ] 12 0.038% 93.329% ( 76, 110 ] 53 0.169% 93.498% ( 110, 170 ] 219 0.698% 94.197% ( 170, 250 ] 274 0.874% 95.070% ( 250, 380 ] 306 0.976% 96.046% ( 380, 580 ] 390 1.244% 97.290% ( 580, 870 ] 378 1.205% 98.495% ( 870, 1300 ] 239 0.762% 99.257% ( 1300, 1900 ] 94 0.300% 99.557% ( 1900, 2900 ] 62 0.198% 99.754% ( 2900, 4400 ] 54 0.172% 99.927% ( 4400, 6600 ] 15 0.048% 99.974% ( 6600, 9900 ] 7 0.022% 99.997% ( 9900, 14000 ] 3 0.010% 100.006% ** Level 5 read latency histogram (micros): Count: 200 Average: 1131.2500 StdDev: 1289.24 Min: 92 Median: 560.0000 Max: 6118 Percentiles: P50: 560.00 P75: 1652.94 P99: 5866.67 P99.9: 6118.00 P99.99: 6118.00 ------------------------------------------------------ ( 76, 110 ] 9 4.500% 4.500% # ( 110, 170 ] 31 15.500% 20.000% ### ( 170, 250 ] 23 11.500% 31.500% ## ( 250, 380 ] 19 9.500% 41.000% ## ( 380, 580 ] 20 10.000% 51.000% ## ( 580, 870 ] 23 11.500% 62.500% ## ( 870, 1300 ] 15 7.500% 70.000% ## ( 1300, 1900 ] 17 8.500% 78.500% ## ( 1900, 2900 ] 23 11.500% 90.000% ## ( 2900, 4400 ] 14 7.000% 97.000% # ( 4400, 6600 ] 6 3.000% 100.000% # ** DB Stats ** Uptime(secs): 50.0 total, 10.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 177.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.617 H:M:S, 51.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 94.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.487 H:M:S, 72.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.046 micros/op 165407 ops/sec 60.058 seconds 9933999 operations; 160.3 MB/s Microseconds per write: Count: 9933999 Average: 6.0457 StdDev: 260.18 Min: 0 Median: 1.7263 Max: 268323 Percentiles: P50: 1.73 P75: 2.72 P99: 8.65 P99.9: 1188.68 P99.99: 2724.22 ------------------------------------------------------ [ 0, 1 ] 1414370 14.238% 14.238% ### ( 1, 2 ] 4891109 49.236% 63.474% ########## ( 2, 3 ] 1598445 16.091% 79.564% ### ( 3, 4 ] 1358338 13.674% 93.238% ### ( 4, 6 ] 507903 5.113% 98.351% # ( 6, 10 ] 97167 0.978% 99.329% ( 10, 15 ] 24370 0.245% 99.574% ( 15, 22 ] 7261 0.073% 99.647% ( 22, 34 ] 1322 0.013% 99.661% ( 34, 51 ] 200 0.002% 99.663% ( 51, 76 ] 30 0.000% 99.663% ( 76, 110 ] 6961 0.070% 99.733% ( 110, 170 ] 2746 0.028% 99.761% ( 170, 250 ] 272 0.003% 99.763% ( 250, 380 ] 104 0.001% 99.764% ( 380, 580 ] 25 0.000% 99.765% ( 580, 870 ] 16 0.000% 99.765% ( 870, 1300 ] 18116 0.182% 99.947% ( 1300, 1900 ] 85 0.001% 99.948% ( 1900, 2900 ] 5054 0.051% 99.999% ( 2900, 4400 ] 67 0.001% 100.000% ( 4400, 6600 ] 15 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 200566 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9933999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10251886968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 518 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33261122 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30404570626 rocksdb.compact.write.bytes COUNT : 30215166831 rocksdb.flush.write.bytes COUNT : 10239180046 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 50 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 206 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10156322816 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3665920 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30495179724 rocksdb.non.last.level.read.count COUNT : 7370021 rocksdb.block.checksum.compute.count COUNT : 7369035 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.372917 P95 : 3.865197 P99 : 7.147210 P100 : 268321.000000 COUNT : 9933999 SUM : 55558175 rocksdb.compaction.times.micros P50 : 984230.769231 P95 : 3477500.000000 P99 : 15040000.000000 P100 : 18506364.000000 COUNT : 87 SUM : 116625719 rocksdb.compaction.times.cpu_micros P50 : 940750.000000 P95 : 2725000.000000 P99 : 15040000.000000 P100 : 17100761.000000 COUNT : 87 SUM : 104990600 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 694.294118 P95 : 1191.156250 P99 : 1453.000000 P100 : 1453.000000 COUNT : 141 SUM : 96176 rocksdb.compaction.outfile.sync.micros P50 : 921.896552 P95 : 40650.000000 P99 : 78937.500000 P100 : 93354.000000 COUNT : 355 SUM : 1960360 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.908333 P95 : 600.300000 P99 : 2370.000000 P100 : 5096.000000 COUNT : 253 SUM : 55774 rocksdb.table.open.io.micros P50 : 1416.666667 P95 : 7640.769231 P99 : 23898.000000 P100 : 23898.000000 COUNT : 518 SUM : 1234524 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.627262 P95 : 7.808472 P99 : 11.397979 P100 : 14530.000000 COUNT : 7367680 SUM : 39115308 rocksdb.read.block.get.micros P50 : 482.985075 P95 : 3800.000000 P99 : 9801.000000 P100 : 13103.000000 COUNT : 1036 SUM : 1040854 rocksdb.write.raw.block.micros P50 : 0.512802 P95 : 0.974323 P99 : 2.905516 P100 : 15680.000000 COUNT : 9798303 SUM : 18295362 rocksdb.numfiles.in.singlecompaction P50 : 3.136364 P95 : 5.700000 P99 : 27.000000 P100 : 27.000000 COUNT : 115 SUM : 432 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558310 P95 : 1157.942868 P99 : 2473.313504 P100 : 268132.000000 COUNT : 223878 SUM : 33276820 rocksdb.sst.read.micros P50 : 1.587073 P95 : 4.707573 P99 : 8.489271 P100 : 14526.000000 COUNT : 7370387 SUM : 24395785 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9933999 SUM : 10251886968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211090.909091 P95 : 336233.333333 P99 : 397613.000000 P100 : 397613.000000 COUNT : 141 SUM : 28341380 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 328 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0