[2024-12-06 10:47:04.514583] Starting SPDK v25.01-pre git sha1 eec618948 / DPDK 24.03.0 initialization... [2024-12-06 10:47:04.514857] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid302931 ] Set seed to 1733478424507811 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-06 10:47:04.656176] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-06 10:47:04.763807] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-06 10:47:04.763854] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 302931' to capture a snapshot of events at runtime. [2024-12-06 10:47:04.763864] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-06 10:47:04.763875] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-06 10:47:04.763883] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid302931 for offline analysis/debug. [2024-12-06 10:47:04.765455] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 6 10:47:10 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/06-10:47:13 ... thread 0: (1000000,1000000) ops and (365262.6,365262.6) ops/second in (2.737756,2.737756) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 566.21 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 356.6 2.29 2.08 12 0.191 0 0 0.0 0.0 L2 3/2 250.42 MB 0.1 0.4 0.2 0.2 0.4 0.2 0.1 2.0 259.6 258.9 1.45 1.41 2 0.726 382K 1014 0.0 0.0 L3 10/0 853.84 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 246/8 20.02 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 100.7 318.7 3.75 3.50 14 0.268 382K 1014 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 100.7 318.7 3.75 3.50 14 0.268 382K 1014 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 259.6 258.9 1.45 1.41 2 0.726 382K 1014 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 356.6 2.29 2.08 12 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.8 total, 2.7 interval Flush(GB): cumulative 0.799, interval 0.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 419.98 MB/s write, 0.37 GB read, 132.66 MB/s read, 3.7 seconds Interval compaction: 1.17 GB write, 435.48 MB/s write, 0.37 GB read, 137.56 MB/s read, 3.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 103762 Average: 1.9131 StdDev: 6.31 Min: 0 Median: 1.3215 Max: 726 Percentiles: P50: 1.32 P75: 1.72 P99: 4.28 P99.9: 9.66 P99.99: 432.47 ------------------------------------------------------ [ 0, 1 ] 30949 29.827% 29.827% ###### ( 1, 2 ] 65116 62.755% 92.582% ############# ( 2, 3 ] 4981 4.800% 97.382% # ( 3, 4 ] 1569 1.512% 98.895% ( 4, 6 ] 790 0.761% 99.656% ( 6, 10 ] 278 0.268% 99.924% ( 10, 15 ] 36 0.035% 99.959% ( 15, 22 ] 16 0.015% 99.974% ( 22, 34 ] 2 0.002% 99.976% ( 51, 76 ] 1 0.001% 99.977% ( 110, 170 ] 8 0.008% 99.985% ( 170, 250 ] 3 0.003% 99.987% ( 250, 380 ] 1 0.001% 99.988% ( 380, 580 ] 10 0.010% 99.998% ( 580, 870 ] 3 0.003% 100.001% ** Level 2 read latency histogram (micros): Count: 50416 Average: 2.2820 StdDev: 38.03 Min: 0 Median: 1.3525 Max: 7430 Percentiles: P50: 1.35 P75: 1.75 P99: 5.18 P99.9: 9.89 P99.99: 1291.06 ------------------------------------------------------ [ 0, 1 ] 13946 27.662% 27.662% ###### ( 1, 2 ] 31948 63.369% 91.031% ############# ( 2, 3 ] 2582 5.121% 96.152% # ( 3, 4 ] 1069 2.120% 98.272% ( 4, 6 ] 624 1.238% 99.510% ( 6, 10 ] 203 0.403% 99.913% ( 10, 15 ] 24 0.048% 99.960% ( 15, 22 ] 4 0.008% 99.968% ( 51, 76 ] 3 0.006% 99.974% ( 110, 170 ] 1 0.002% 99.976% ( 250, 380 ] 4 0.008% 99.984% ( 580, 870 ] 2 0.004% 99.988% ( 870, 1300 ] 2 0.004% 99.992% ( 1300, 1900 ] 3 0.006% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ( 6600, 9900 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 40 Average: 3328.9250 StdDev: 3389.84 Min: 92 Median: 1177.1429 Max: 10233 Percentiles: P50: 1177.14 P75: 6050.00 P99: 10233.00 P99.9: 10233.00 P99.99: 10233.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 170, 250 ] 2 5.000% 10.000% # ( 250, 380 ] 2 5.000% 15.000% # ( 380, 580 ] 2 5.000% 20.000% # ( 580, 870 ] 7 17.500% 37.500% #### ( 870, 1300 ] 7 17.500% 55.000% #### ( 1300, 1900 ] 1 2.500% 57.500% # ( 2900, 4400 ] 4 10.000% 67.500% ## ( 4400, 6600 ] 4 10.000% 77.500% ## ( 6600, 9900 ] 8 20.000% 97.500% #### ( 9900, 14000 ] 1 2.500% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 3178.8667 StdDev: 3430.11 Min: 55 Median: 1450.0000 Max: 10686 Percentiles: P50: 1450.00 P75: 5500.00 P99: 10686.00 P99.9: 10686.00 P99.99: 10686.00 ------------------------------------------------------ ( 51, 76 ] 2 6.667% 6.667% # ( 110, 170 ] 1 3.333% 10.000% # ( 170, 250 ] 2 6.667% 16.667% # ( 380, 580 ] 3 10.000% 26.667% ## ( 580, 870 ] 2 6.667% 33.333% # ( 870, 1300 ] 4 13.333% 46.667% ### ( 1300, 1900 ] 4 13.333% 60.000% ### ( 1900, 2900 ] 1 3.333% 63.333% # ( 2900, 4400 ] 3 10.000% 73.333% ## ( 4400, 6600 ] 1 3.333% 76.667% # ( 6600, 9900 ] 5 16.667% 93.333% ### ( 9900, 14000 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 2.8 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 346.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.204 H:M:S, 7.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 358.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.204 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-10:47:16 ... thread 0: (1000000,2000000) ops and (326019.1,344527.0) ops/second in (3.067305,5.805061) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.16 GB 12.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 99.3 320.4 8.23 7.64 29 0.284 830K 4164 0.0 0.0 L1 0/0 0.00 KB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 247.7 245.7 1.52 1.49 1 1.524 383K 3105 0.0 0.0 L2 1/0 58.65 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.4 1.8 248.3 247.5 1.78 1.72 3 0.592 447K 1266 0.0 0.0 L3 16/0 982.37 MB 1.0 0.7 0.4 0.3 0.7 0.4 0.3 1.7 233.5 231.3 3.17 2.99 4 0.794 752K 7077 0.0 0.0 L4 122/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 213.7 213.7 0.54 0.50 1 0.540 117K 0 0.0 0.0 L5 112/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 259/6 20.99 GB 0.0 2.4 1.1 1.3 4.2 2.9 1.6 2.4 163.5 282.1 15.24 14.34 38 0.401 2531K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.4 1.1 1.3 4.2 2.9 1.4 2.4 163.5 282.1 15.24 14.34 38 0.401 2531K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.4 1.1 1.3 2.4 1.1 0.0 0.0 245.8 244.3 10.14 9.76 12 0.845 2531K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 357.3 5.10 4.58 26 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.8 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.20 GB write, 727.79 MB/s write, 2.43 GB read, 421.80 MB/s read, 15.2 seconds Interval compaction: 4.20 GB write, 740.46 MB/s write, 2.43 GB read, 429.15 MB/s read, 15.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 384931 Average: 2.3223 StdDev: 6.66 Min: 0 Median: 1.5566 Max: 1161 Percentiles: P50: 1.56 P75: 1.95 P99: 5.89 P99.9: 11.90 P99.99: 28.76 ------------------------------------------------------ [ 0, 1 ] 57004 14.809% 14.809% ### ( 1, 2 ] 243380 63.227% 78.036% ############# ( 2, 3 ] 52420 13.618% 91.654% ### ( 3, 4 ] 16497 4.286% 95.940% # ( 4, 6 ] 12456 3.236% 99.175% # ( 6, 10 ] 2616 0.680% 99.855% ( 10, 15 ] 458 0.119% 99.974% ( 15, 22 ] 58 0.015% 99.989% ( 22, 34 ] 8 0.002% 99.991% ( 34, 51 ] 3 0.001% 99.992% ( 51, 76 ] 15 0.004% 99.996% ( 76, 110 ] 14 0.004% 99.999% ( 110, 170 ] 27 0.007% 100.006% ( 170, 250 ] 29 0.008% 100.014% ( 250, 380 ] 7 0.002% 100.016% ( 380, 580 ] 17 0.004% 100.020% ( 580, 870 ] 11 0.003% 100.023% ( 870, 1300 ] 5 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 62355 Average: 2.7618 StdDev: 7.36 Min: 1 Median: 1.8004 Max: 1068 Percentiles: P50: 1.80 P75: 2.59 P99: 8.10 P99.9: 14.39 P99.99: 155.17 ------------------------------------------------------ [ 0, 1 ] 2559 4.104% 4.104% # ( 1, 2 ] 35757 57.344% 61.448% ########### ( 2, 3 ] 14234 22.827% 84.276% ##### ( 3, 4 ] 4565 7.321% 91.597% # ( 4, 6 ] 4182 6.707% 98.303% # ( 6, 10 ] 828 1.328% 99.631% ( 10, 15 ] 191 0.306% 99.937% ( 15, 22 ] 17 0.027% 99.965% ( 34, 51 ] 3 0.005% 99.970% ( 51, 76 ] 6 0.010% 99.979% ( 76, 110 ] 3 0.005% 99.984% ( 110, 170 ] 5 0.008% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 4 0.006% 100.000% ( 380, 580 ] 2 0.003% 100.003% ( 870, 1300 ] 2 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 137678 Average: 2.7134 StdDev: 25.86 Min: 0 Median: 1.5491 Max: 7430 Percentiles: P50: 1.55 P75: 1.94 P99: 7.45 P99.9: 132.37 P99.99: 748.59 ------------------------------------------------------ [ 0, 1 ] 20619 14.976% 14.976% ### ( 1, 2 ] 87820 63.787% 78.763% ############# ( 2, 3 ] 17049 12.383% 91.146% ## ( 3, 4 ] 5957 4.327% 95.473% # ( 4, 6 ] 4348 3.158% 98.631% # ( 6, 10 ] 1403 1.019% 99.650% ( 10, 15 ] 254 0.184% 99.834% ( 15, 22 ] 45 0.033% 99.867% ( 22, 34 ] 2 0.001% 99.869% ( 34, 51 ] 1 0.001% 99.869% ( 51, 76 ] 20 0.015% 99.884% ( 76, 110 ] 13 0.009% 99.893% ( 110, 170 ] 25 0.018% 99.911% ( 170, 250 ] 27 0.020% 99.931% ( 250, 380 ] 57 0.041% 99.972% ( 380, 580 ] 19 0.014% 99.986% ( 580, 870 ] 9 0.007% 99.993% ( 870, 1300 ] 3 0.002% 99.995% ( 1300, 1900 ] 5 0.004% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 65762 Average: 4.8487 StdDev: 117.84 Min: 0 Median: 1.7890 Max: 10233 Percentiles: P50: 1.79 P75: 2.57 P99: 7.97 P99.9: 31.36 P99.99: 4633.09 ------------------------------------------------------ [ 0, 1 ] 3117 4.740% 4.740% # ( 1, 2 ] 37725 57.366% 62.106% ########### ( 2, 3 ] 14874 22.618% 84.724% ##### ( 3, 4 ] 4544 6.910% 91.633% # ( 4, 6 ] 4425 6.729% 98.362% # ( 6, 10 ] 850 1.293% 99.655% ( 10, 15 ] 133 0.202% 99.857% ( 15, 22 ] 22 0.033% 99.891% ( 22, 34 ] 8 0.012% 99.903% ( 51, 76 ] 3 0.005% 99.907% ( 76, 110 ] 4 0.006% 99.913% ( 110, 170 ] 6 0.009% 99.922% ( 170, 250 ] 5 0.008% 99.930% ( 250, 380 ] 6 0.009% 99.939% ( 380, 580 ] 9 0.014% 99.953% ( 580, 870 ] 9 0.014% 99.967% ( 870, 1300 ] 9 0.014% 99.980% ( 1300, 1900 ] 1 0.002% 99.982% ( 1900, 2900 ] 1 0.002% 99.983% ( 2900, 4400 ] 4 0.006% 99.989% ( 4400, 6600 ] 4 0.006% 99.995% ( 6600, 9900 ] 8 0.012% 100.008% ( 9900, 14000 ] 1 0.002% 100.009% ** Level 4 read latency histogram (micros): Count: 60 Average: 1644.7667 StdDev: 2880.64 Min: 1 Median: 170.0000 Max: 10686 Percentiles: P50: 170.00 P75: 1540.00 P99: 10686.00 P99.9: 10686.00 P99.99: 10686.00 ------------------------------------------------------ [ 0, 1 ] 4 6.667% 6.667% # ( 1, 2 ] 12 20.000% 26.667% #### ( 2, 3 ] 1 1.667% 28.333% ( 3, 4 ] 1 1.667% 30.000% ( 4, 6 ] 1 1.667% 31.667% ( 6, 10 ] 1 1.667% 33.333% ( 15, 22 ] 1 1.667% 35.000% ( 22, 34 ] 1 1.667% 36.667% ( 34, 51 ] 1 1.667% 38.333% ( 51, 76 ] 6 10.000% 48.333% ## ( 110, 170 ] 1 1.667% 50.000% ( 170, 250 ] 2 3.333% 53.333% # ( 380, 580 ] 4 6.667% 60.000% # ( 580, 870 ] 3 5.000% 65.000% # ( 870, 1300 ] 4 6.667% 71.667% # ( 1300, 1900 ] 5 8.333% 80.000% ## ( 1900, 2900 ] 1 1.667% 81.667% ( 2900, 4400 ] 3 5.000% 86.667% # ( 4400, 6600 ] 1 1.667% 88.333% ( 6600, 9900 ] 5 8.333% 96.667% ## ( 9900, 14000 ] 2 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 575.7000 StdDev: 697.66 Min: 55 Median: 230.0000 Max: 2374 Percentiles: P50: 230.00 P75: 1013.33 P99: 2374.00 P99.9: 2374.00 P99.99: 2374.00 ------------------------------------------------------ ( 51, 76 ] 7 35.000% 35.000% ####### ( 170, 250 ] 4 20.000% 55.000% #### ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 3 15.000% 85.000% ### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 5.9 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 333.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.639 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.436 H:M:S, 14.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/06-10:47:19 ... thread 0: (1000000,3000000) ops and (330277.9,339642.6) ops/second in (3.027753,8.832814) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 2.14 GB 81.5 1.3 0.0 1.3 4.0 2.8 0.0 1.5 101.9 319.8 12.96 12.05 45 0.288 1341K 6573 0.0 0.0 L1 0/0 0.00 KB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 247.7 245.7 1.52 1.49 1 1.524 383K 3105 0.0 0.0 L2 1/0 58.65 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.4 1.8 248.3 247.5 1.78 1.72 3 0.592 447K 1266 0.0 0.0 L3 16/0 982.37 MB 1.0 0.7 0.4 0.3 0.7 0.4 0.3 1.7 233.5 231.3 3.17 2.99 4 0.794 752K 7077 0.0 0.0 L4 122/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 213.7 213.7 0.54 0.50 1 0.540 117K 0 0.0 0.0 L5 112/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 267/10 21.97 GB 0.0 2.9 1.1 1.8 5.7 3.9 1.6 2.1 150.0 290.8 19.97 18.75 54 0.370 3042K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 1.1 1.8 5.7 3.9 1.4 2.1 150.0 290.8 19.97 18.75 54 0.370 3042K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 1.1 1.8 2.9 1.1 0.0 0.0 249.4 247.9 12.01 11.60 14 0.858 3042K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 355.5 7.96 7.15 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.8 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.67 GB write, 649.85 MB/s write, 2.93 GB read, 335.22 MB/s read, 20.0 seconds Interval compaction: 5.67 GB write, 657.29 MB/s write, 2.93 GB read, 339.06 MB/s read, 20.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 736313 Average: 2.3535 StdDev: 8.02 Min: 0 Median: 1.5564 Max: 2105 Percentiles: P50: 1.56 P75: 1.94 P99: 5.95 P99.9: 12.94 P99.99: 144.05 ------------------------------------------------------ [ 0, 1 ] 100041 13.587% 13.587% ### ( 1, 2 ] 481908 65.449% 79.036% ############# ( 2, 3 ] 102284 13.891% 92.927% ### ( 3, 4 ] 26340 3.577% 96.504% # ( 4, 6 ] 18852 2.560% 99.065% # ( 6, 10 ] 5577 0.757% 99.822% ( 10, 15 ] 980 0.133% 99.955% ( 15, 22 ] 94 0.013% 99.968% ( 22, 34 ] 10 0.001% 99.969% ( 34, 51 ] 8 0.001% 99.970% ( 51, 76 ] 67 0.009% 99.979% ( 76, 110 ] 30 0.004% 99.983% ( 110, 170 ] 87 0.012% 99.995% ( 170, 250 ] 97 0.013% 100.008% ( 250, 380 ] 48 0.007% 100.015% ( 380, 580 ] 48 0.007% 100.021% ( 580, 870 ] 18 0.002% 100.024% ( 870, 1300 ] 8 0.001% 100.025% ( 1300, 1900 ] 3 0.000% 100.025% ( 1900, 2900 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 62355 Average: 2.7618 StdDev: 7.36 Min: 1 Median: 1.8004 Max: 1068 Percentiles: P50: 1.80 P75: 2.59 P99: 8.10 P99.9: 14.39 P99.99: 155.17 ------------------------------------------------------ [ 0, 1 ] 2559 4.104% 4.104% # ( 1, 2 ] 35757 57.344% 61.448% ########### ( 2, 3 ] 14234 22.827% 84.276% ##### ( 3, 4 ] 4565 7.321% 91.597% # ( 4, 6 ] 4182 6.707% 98.303% # ( 6, 10 ] 828 1.328% 99.631% ( 10, 15 ] 191 0.306% 99.937% ( 15, 22 ] 17 0.027% 99.965% ( 34, 51 ] 3 0.005% 99.970% ( 51, 76 ] 6 0.010% 99.979% ( 76, 110 ] 3 0.005% 99.984% ( 110, 170 ] 5 0.008% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 4 0.006% 100.000% ( 380, 580 ] 2 0.003% 100.003% ( 870, 1300 ] 2 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 137678 Average: 2.7134 StdDev: 25.86 Min: 0 Median: 1.5491 Max: 7430 Percentiles: P50: 1.55 P75: 1.94 P99: 7.45 P99.9: 132.37 P99.99: 748.59 ------------------------------------------------------ [ 0, 1 ] 20619 14.976% 14.976% ### ( 1, 2 ] 87820 63.787% 78.763% ############# ( 2, 3 ] 17049 12.383% 91.146% ## ( 3, 4 ] 5957 4.327% 95.473% # ( 4, 6 ] 4348 3.158% 98.631% # ( 6, 10 ] 1403 1.019% 99.650% ( 10, 15 ] 254 0.184% 99.834% ( 15, 22 ] 45 0.033% 99.867% ( 22, 34 ] 2 0.001% 99.869% ( 34, 51 ] 1 0.001% 99.869% ( 51, 76 ] 20 0.015% 99.884% ( 76, 110 ] 13 0.009% 99.893% ( 110, 170 ] 25 0.018% 99.911% ( 170, 250 ] 27 0.020% 99.931% ( 250, 380 ] 57 0.041% 99.972% ( 380, 580 ] 19 0.014% 99.986% ( 580, 870 ] 9 0.007% 99.993% ( 870, 1300 ] 3 0.002% 99.995% ( 1300, 1900 ] 5 0.004% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 65762 Average: 4.8487 StdDev: 117.84 Min: 0 Median: 1.7890 Max: 10233 Percentiles: P50: 1.79 P75: 2.57 P99: 7.97 P99.9: 31.36 P99.99: 4633.09 ------------------------------------------------------ [ 0, 1 ] 3117 4.740% 4.740% # ( 1, 2 ] 37725 57.366% 62.106% ########### ( 2, 3 ] 14874 22.618% 84.724% ##### ( 3, 4 ] 4544 6.910% 91.633% # ( 4, 6 ] 4425 6.729% 98.362% # ( 6, 10 ] 850 1.293% 99.655% ( 10, 15 ] 133 0.202% 99.857% ( 15, 22 ] 22 0.033% 99.891% ( 22, 34 ] 8 0.012% 99.903% ( 51, 76 ] 3 0.005% 99.907% ( 76, 110 ] 4 0.006% 99.913% ( 110, 170 ] 6 0.009% 99.922% ( 170, 250 ] 5 0.008% 99.930% ( 250, 380 ] 6 0.009% 99.939% ( 380, 580 ] 9 0.014% 99.953% ( 580, 870 ] 9 0.014% 99.967% ( 870, 1300 ] 9 0.014% 99.980% ( 1300, 1900 ] 1 0.002% 99.982% ( 1900, 2900 ] 1 0.002% 99.983% ( 2900, 4400 ] 4 0.006% 99.989% ( 4400, 6600 ] 4 0.006% 99.995% ( 6600, 9900 ] 8 0.012% 100.008% ( 9900, 14000 ] 1 0.002% 100.009% ** Level 4 read latency histogram (micros): Count: 60 Average: 1644.7667 StdDev: 2880.64 Min: 1 Median: 170.0000 Max: 10686 Percentiles: P50: 170.00 P75: 1540.00 P99: 10686.00 P99.9: 10686.00 P99.99: 10686.00 ------------------------------------------------------ [ 0, 1 ] 4 6.667% 6.667% # ( 1, 2 ] 12 20.000% 26.667% #### ( 2, 3 ] 1 1.667% 28.333% ( 3, 4 ] 1 1.667% 30.000% ( 4, 6 ] 1 1.667% 31.667% ( 6, 10 ] 1 1.667% 33.333% ( 15, 22 ] 1 1.667% 35.000% ( 22, 34 ] 1 1.667% 36.667% ( 34, 51 ] 1 1.667% 38.333% ( 51, 76 ] 6 10.000% 48.333% ## ( 110, 170 ] 1 1.667% 50.000% ( 170, 250 ] 2 3.333% 53.333% # ( 380, 580 ] 4 6.667% 60.000% # ( 580, 870 ] 3 5.000% 65.000% # ( 870, 1300 ] 4 6.667% 71.667% # ( 1300, 1900 ] 5 8.333% 80.000% ## ( 1900, 2900 ] 1 1.667% 81.667% ( 2900, 4400 ] 3 5.000% 86.667% # ( 4400, 6600 ] 1 1.667% 88.333% ( 6600, 9900 ] 5 8.333% 96.667% ## ( 9900, 14000 ] 2 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 575.7000 StdDev: 697.66 Min: 55 Median: 230.0000 Max: 2374 Percentiles: P50: 230.00 P75: 1013.33 P99: 2374.00 P99.9: 2374.00 P99.99: 2374.00 ------------------------------------------------------ ( 51, 76 ] 7 35.000% 35.000% ####### ( 170, 250 ] 4 20.000% 55.000% #### ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 3 15.000% 85.000% ### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 8.9 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 330.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.054 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.415 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-10:47:22 ... thread 0: (1000000,4000000) ops and (330670.1,337354.1) ops/second in (3.024162,11.856976) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/17 2.02 GB 0.0 1.8 0.0 1.8 5.5 3.7 0.0 1.5 106.4 318.5 17.74 16.52 60 0.296 1916K 9578 0.0 0.0 L1 9/9 1.02 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 239.9 235.7 6.01 5.80 2 3.006 1464K 25K 0.0 0.0 L2 1/0 58.65 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.4 1.8 248.3 247.5 1.78 1.72 3 0.592 447K 1266 0.0 0.0 L3 16/0 982.37 MB 1.0 0.7 0.4 0.3 0.7 0.4 0.3 1.7 233.5 231.3 3.17 2.99 4 0.794 752K 7077 0.0 0.0 L4 122/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 213.7 213.7 0.54 0.50 1 0.540 117K 0 0.0 0.0 L5 112/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 277/26 22.87 GB 0.0 4.5 2.2 2.3 8.2 5.8 1.6 2.2 158.2 285.7 29.24 27.53 70 0.418 4698K 43K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 2.2 2.3 8.2 5.8 1.4 2.2 158.2 285.7 29.24 27.53 70 0.418 4698K 43K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 2.2 2.3 4.5 2.1 0.0 0.0 247.8 245.4 18.67 18.04 17 1.098 4698K 43K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 356.9 10.57 9.50 53 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.9 interval Flush(GB): cumulative 3.685, interval 3.685 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.16 GB write, 698.61 MB/s write, 4.52 GB read, 386.81 MB/s read, 29.2 seconds Interval compaction: 8.16 GB write, 704.57 MB/s write, 4.52 GB read, 390.11 MB/s read, 29.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1045884 Average: 2.4240 StdDev: 9.14 Min: 0 Median: 1.5705 Max: 2804 Percentiles: P50: 1.57 P75: 1.95 P99: 6.09 P99.9: 13.54 P99.99: 153.04 ------------------------------------------------------ [ 0, 1 ] 131482 12.571% 12.571% ### ( 1, 2 ] 686198 65.609% 78.181% ############# ( 2, 3 ] 152387 14.570% 92.751% ### ( 3, 4 ] 37799 3.614% 96.365% # ( 4, 6 ] 27361 2.616% 98.981% # ( 6, 10 ] 8505 0.813% 99.794% ( 10, 15 ] 1565 0.150% 99.944% ( 15, 22 ] 149 0.014% 99.958% ( 22, 34 ] 21 0.002% 99.960% ( 34, 51 ] 11 0.001% 99.961% ( 51, 76 ] 105 0.010% 99.971% ( 76, 110 ] 69 0.007% 99.978% ( 110, 170 ] 179 0.017% 99.995% ( 170, 250 ] 225 0.022% 100.016% ( 250, 380 ] 112 0.011% 100.027% ( 380, 580 ] 68 0.007% 100.034% ( 580, 870 ] 25 0.002% 100.036% ( 870, 1300 ] 15 0.001% 100.037% ( 1300, 1900 ] 4 0.000% 100.038% ( 1900, 2900 ] 2 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 105128 Average: 2.9177 StdDev: 15.72 Min: 1 Median: 1.6789 Max: 2096 Percentiles: P50: 1.68 P75: 2.31 P99: 8.52 P99.9: 149.79 P99.99: 600.18 ------------------------------------------------------ [ 0, 1 ] 9643 9.173% 9.173% ## ( 1, 2 ] 63222 60.138% 69.311% ############ ( 2, 3 ] 19361 18.417% 87.727% #### ( 3, 4 ] 5793 5.510% 93.238% # ( 4, 6 ] 5114 4.865% 98.102% # ( 6, 10 ] 1498 1.425% 99.527% ( 10, 15 ] 288 0.274% 99.801% ( 15, 22 ] 32 0.030% 99.832% ( 22, 34 ] 5 0.005% 99.836% ( 34, 51 ] 4 0.004% 99.840% ( 51, 76 ] 24 0.023% 99.863% ( 76, 110 ] 15 0.014% 99.877% ( 110, 170 ] 36 0.034% 99.912% ( 170, 250 ] 45 0.043% 99.954% ( 250, 380 ] 25 0.024% 99.978% ( 380, 580 ] 12 0.011% 99.990% ( 580, 870 ] 7 0.007% 99.996% ( 870, 1300 ] 6 0.006% 100.002% ( 1300, 1900 ] 1 0.001% 100.003% ( 1900, 2900 ] 1 0.001% 100.004% ** Level 2 read latency histogram (micros): Count: 137678 Average: 2.7134 StdDev: 25.86 Min: 0 Median: 1.5491 Max: 7430 Percentiles: P50: 1.55 P75: 1.94 P99: 7.45 P99.9: 132.37 P99.99: 748.59 ------------------------------------------------------ [ 0, 1 ] 20619 14.976% 14.976% ### ( 1, 2 ] 87820 63.787% 78.763% ############# ( 2, 3 ] 17049 12.383% 91.146% ## ( 3, 4 ] 5957 4.327% 95.473% # ( 4, 6 ] 4348 3.158% 98.631% # ( 6, 10 ] 1403 1.019% 99.650% ( 10, 15 ] 254 0.184% 99.834% ( 15, 22 ] 45 0.033% 99.867% ( 22, 34 ] 2 0.001% 99.869% ( 34, 51 ] 1 0.001% 99.869% ( 51, 76 ] 20 0.015% 99.884% ( 76, 110 ] 13 0.009% 99.893% ( 110, 170 ] 25 0.018% 99.911% ( 170, 250 ] 27 0.020% 99.931% ( 250, 380 ] 57 0.041% 99.972% ( 380, 580 ] 19 0.014% 99.986% ( 580, 870 ] 9 0.007% 99.993% ( 870, 1300 ] 3 0.002% 99.995% ( 1300, 1900 ] 5 0.004% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 65762 Average: 4.8487 StdDev: 117.84 Min: 0 Median: 1.7890 Max: 10233 Percentiles: P50: 1.79 P75: 2.57 P99: 7.97 P99.9: 31.36 P99.99: 4633.09 ------------------------------------------------------ [ 0, 1 ] 3117 4.740% 4.740% # ( 1, 2 ] 37725 57.366% 62.106% ########### ( 2, 3 ] 14874 22.618% 84.724% ##### ( 3, 4 ] 4544 6.910% 91.633% # ( 4, 6 ] 4425 6.729% 98.362% # ( 6, 10 ] 850 1.293% 99.655% ( 10, 15 ] 133 0.202% 99.857% ( 15, 22 ] 22 0.033% 99.891% ( 22, 34 ] 8 0.012% 99.903% ( 51, 76 ] 3 0.005% 99.907% ( 76, 110 ] 4 0.006% 99.913% ( 110, 170 ] 6 0.009% 99.922% ( 170, 250 ] 5 0.008% 99.930% ( 250, 380 ] 6 0.009% 99.939% ( 380, 580 ] 9 0.014% 99.953% ( 580, 870 ] 9 0.014% 99.967% ( 870, 1300 ] 9 0.014% 99.980% ( 1300, 1900 ] 1 0.002% 99.982% ( 1900, 2900 ] 1 0.002% 99.983% ( 2900, 4400 ] 4 0.006% 99.989% ( 4400, 6600 ] 4 0.006% 99.995% ( 6600, 9900 ] 8 0.012% 100.008% ( 9900, 14000 ] 1 0.002% 100.009% ** Level 4 read latency histogram (micros): Count: 60 Average: 1644.7667 StdDev: 2880.64 Min: 1 Median: 170.0000 Max: 10686 Percentiles: P50: 170.00 P75: 1540.00 P99: 10686.00 P99.9: 10686.00 P99.99: 10686.00 ------------------------------------------------------ [ 0, 1 ] 4 6.667% 6.667% # ( 1, 2 ] 12 20.000% 26.667% #### ( 2, 3 ] 1 1.667% 28.333% ( 3, 4 ] 1 1.667% 30.000% ( 4, 6 ] 1 1.667% 31.667% ( 6, 10 ] 1 1.667% 33.333% ( 15, 22 ] 1 1.667% 35.000% ( 22, 34 ] 1 1.667% 36.667% ( 34, 51 ] 1 1.667% 38.333% ( 51, 76 ] 6 10.000% 48.333% ## ( 110, 170 ] 1 1.667% 50.000% ( 170, 250 ] 2 3.333% 53.333% # ( 380, 580 ] 4 6.667% 60.000% # ( 580, 870 ] 3 5.000% 65.000% # ( 870, 1300 ] 4 6.667% 71.667% # ( 1300, 1900 ] 5 8.333% 80.000% ## ( 1900, 2900 ] 1 1.667% 81.667% ( 2900, 4400 ] 3 5.000% 86.667% # ( 4400, 6600 ] 1 1.667% 88.333% ( 6600, 9900 ] 5 8.333% 96.667% ## ( 9900, 14000 ] 2 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 575.7000 StdDev: 697.66 Min: 55 Median: 230.0000 Max: 2374 Percentiles: P50: 230.00 P75: 1013.33 P99: 2374.00 P99.9: 2374.00 P99.99: 2374.00 ------------------------------------------------------ ( 51, 76 ] 7 35.000% 35.000% ####### ( 170, 250 ] 4 20.000% 55.000% #### ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 3 15.000% 85.000% ### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 329.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.459 H:M:S, 12.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/06-10:47:25 ... thread 0: (1000000,5000000) ops and (308523.1,331164.8) ops/second in (3.241248,15.098224) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.00 GB 125.2 2.9 0.0 2.9 7.5 4.7 0.0 1.6 120.3 314.3 24.56 22.97 78 0.315 3001K 15K 0.0 0.0 L1 9/9 1.02 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 239.9 235.7 6.01 5.80 2 3.006 1464K 25K 0.0 0.0 L2 1/0 58.65 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.4 1.8 248.3 247.5 1.78 1.72 3 0.592 447K 1266 0.0 0.0 L3 16/0 982.37 MB 1.0 0.7 0.4 0.3 0.7 0.4 0.3 1.7 233.5 231.3 3.17 2.99 4 0.794 752K 7077 0.0 0.0 L4 122/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 213.7 213.7 0.54 0.50 1 0.540 117K 0 0.0 0.0 L5 112/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 279/22 23.85 GB 0.0 5.6 2.2 3.4 10.2 6.8 1.6 2.2 157.9 289.1 36.07 33.98 88 0.410 5784K 49K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 2.2 3.4 10.2 6.8 1.4 2.2 157.9 289.1 36.07 33.98 88 0.410 5784K 49K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 2.2 3.4 5.5 2.1 0.0 0.0 251.1 249.0 22.68 21.98 21 1.080 5784K 49K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.1 13.39 12.01 67 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.1 interval Flush(GB): cumulative 4.667, interval 4.667 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.18 GB write, 685.82 MB/s write, 5.56 GB read, 374.67 MB/s read, 36.1 seconds Interval compaction: 10.18 GB write, 690.41 MB/s write, 5.56 GB read, 377.18 MB/s read, 36.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 17, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1386974 Average: 2.4520 StdDev: 9.48 Min: 0 Median: 1.5777 Max: 2804 Percentiles: P50: 1.58 P75: 1.96 P99: 6.07 P99.9: 13.75 P99.99: 175.62 ------------------------------------------------------ [ 0, 1 ] 166998 12.040% 12.040% ## ( 1, 2 ] 911284 65.703% 77.743% ############# ( 2, 3 ] 209363 15.095% 92.838% ### ( 3, 4 ] 49456 3.566% 96.404% # ( 4, 6 ] 35802 2.581% 98.985% # ( 6, 10 ] 11203 0.808% 99.793% ( 10, 15 ] 1975 0.142% 99.936% ( 15, 22 ] 175 0.013% 99.948% ( 22, 34 ] 25 0.002% 99.950% ( 34, 51 ] 14 0.001% 99.951% ( 51, 76 ] 157 0.011% 99.962% ( 76, 110 ] 95 0.007% 99.969% ( 110, 170 ] 266 0.019% 99.988% ( 170, 250 ] 332 0.024% 100.012% ( 250, 380 ] 172 0.012% 100.025% ( 380, 580 ] 103 0.007% 100.032% ( 580, 870 ] 34 0.002% 100.035% ( 870, 1300 ] 22 0.002% 100.036% ( 1300, 1900 ] 6 0.000% 100.037% ( 1900, 2900 ] 2 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 181962 Average: 2.8608 StdDev: 14.98 Min: 1 Median: 1.6564 Max: 2096 Percentiles: P50: 1.66 P75: 2.20 P99: 8.44 P99.9: 167.97 P99.99: 549.56 ------------------------------------------------------ [ 0, 1 ] 16705 9.180% 9.180% ## ( 1, 2 ] 113149 62.183% 71.363% ############ ( 2, 3 ] 33071 18.175% 89.538% #### ( 3, 4 ] 8177 4.494% 94.032% # ( 4, 6 ] 7320 4.023% 98.055% # ( 6, 10 ] 2815 1.547% 99.602% ( 10, 15 ] 375 0.206% 99.808% ( 15, 22 ] 42 0.023% 99.831% ( 22, 34 ] 7 0.004% 99.835% ( 34, 51 ] 4 0.002% 99.837% ( 51, 76 ] 41 0.023% 99.859% ( 76, 110 ] 18 0.010% 99.869% ( 110, 170 ] 58 0.032% 99.901% ( 170, 250 ] 79 0.043% 99.944% ( 250, 380 ] 65 0.036% 99.980% ( 380, 580 ] 21 0.012% 99.992% ( 580, 870 ] 8 0.004% 99.996% ( 870, 1300 ] 7 0.004% 100.000% ( 1300, 1900 ] 3 0.002% 100.002% ( 1900, 2900 ] 1 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 137678 Average: 2.7134 StdDev: 25.86 Min: 0 Median: 1.5491 Max: 7430 Percentiles: P50: 1.55 P75: 1.94 P99: 7.45 P99.9: 132.37 P99.99: 748.59 ------------------------------------------------------ [ 0, 1 ] 20619 14.976% 14.976% ### ( 1, 2 ] 87820 63.787% 78.763% ############# ( 2, 3 ] 17049 12.383% 91.146% ## ( 3, 4 ] 5957 4.327% 95.473% # ( 4, 6 ] 4348 3.158% 98.631% # ( 6, 10 ] 1403 1.019% 99.650% ( 10, 15 ] 254 0.184% 99.834% ( 15, 22 ] 45 0.033% 99.867% ( 22, 34 ] 2 0.001% 99.869% ( 34, 51 ] 1 0.001% 99.869% ( 51, 76 ] 20 0.015% 99.884% ( 76, 110 ] 13 0.009% 99.893% ( 110, 170 ] 25 0.018% 99.911% ( 170, 250 ] 27 0.020% 99.931% ( 250, 380 ] 57 0.041% 99.972% ( 380, 580 ] 19 0.014% 99.986% ( 580, 870 ] 9 0.007% 99.993% ( 870, 1300 ] 3 0.002% 99.995% ( 1300, 1900 ] 5 0.004% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 65762 Average: 4.8487 StdDev: 117.84 Min: 0 Median: 1.7890 Max: 10233 Percentiles: P50: 1.79 P75: 2.57 P99: 7.97 P99.9: 31.36 P99.99: 4633.09 ------------------------------------------------------ [ 0, 1 ] 3117 4.740% 4.740% # ( 1, 2 ] 37725 57.366% 62.106% ########### ( 2, 3 ] 14874 22.618% 84.724% ##### ( 3, 4 ] 4544 6.910% 91.633% # ( 4, 6 ] 4425 6.729% 98.362% # ( 6, 10 ] 850 1.293% 99.655% ( 10, 15 ] 133 0.202% 99.857% ( 15, 22 ] 22 0.033% 99.891% ( 22, 34 ] 8 0.012% 99.903% ( 51, 76 ] 3 0.005% 99.907% ( 76, 110 ] 4 0.006% 99.913% ( 110, 170 ] 6 0.009% 99.922% ( 170, 250 ] 5 0.008% 99.930% ( 250, 380 ] 6 0.009% 99.939% ( 380, 580 ] 9 0.014% 99.953% ( 580, 870 ] 9 0.014% 99.967% ( 870, 1300 ] 9 0.014% 99.980% ( 1300, 1900 ] 1 0.002% 99.982% ( 1900, 2900 ] 1 0.002% 99.983% ( 2900, 4400 ] 4 0.006% 99.989% ( 4400, 6600 ] 4 0.006% 99.995% ( 6600, 9900 ] 8 0.012% 100.008% ( 9900, 14000 ] 1 0.002% 100.009% ** Level 4 read latency histogram (micros): Count: 60 Average: 1644.7667 StdDev: 2880.64 Min: 1 Median: 170.0000 Max: 10686 Percentiles: P50: 170.00 P75: 1540.00 P99: 10686.00 P99.9: 10686.00 P99.99: 10686.00 ------------------------------------------------------ [ 0, 1 ] 4 6.667% 6.667% # ( 1, 2 ] 12 20.000% 26.667% #### ( 2, 3 ] 1 1.667% 28.333% ( 3, 4 ] 1 1.667% 30.000% ( 4, 6 ] 1 1.667% 31.667% ( 6, 10 ] 1 1.667% 33.333% ( 15, 22 ] 1 1.667% 35.000% ( 22, 34 ] 1 1.667% 36.667% ( 34, 51 ] 1 1.667% 38.333% ( 51, 76 ] 6 10.000% 48.333% ## ( 110, 170 ] 1 1.667% 50.000% ( 170, 250 ] 2 3.333% 53.333% # ( 380, 580 ] 4 6.667% 60.000% # ( 580, 870 ] 3 5.000% 65.000% # ( 870, 1300 ] 4 6.667% 71.667% # ( 1300, 1900 ] 5 8.333% 80.000% ## ( 1900, 2900 ] 1 1.667% 81.667% ( 2900, 4400 ] 3 5.000% 86.667% # ( 4400, 6600 ] 1 1.667% 88.333% ( 6600, 9900 ] 5 8.333% 96.667% ## ( 9900, 14000 ] 2 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 575.7000 StdDev: 697.66 Min: 55 Median: 230.0000 Max: 2374 Percentiles: P50: 230.00 P75: 1013.33 P99: 2374.00 P99.9: 2374.00 P99.99: 2374.00 ------------------------------------------------------ ( 51, 76 ] 7 35.000% 35.000% ####### ( 170, 250 ] 4 20.000% 55.000% #### ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 3 15.000% 85.000% ### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 15.2 total, 3.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 323.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.054 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 303.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.596 H:M:S, 18.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.583 micros/op 279065 ops/sec 20.060 seconds 5597999 operations; 270.4 MB/s Microseconds per write: Count: 5597999 Average: 3.5834 StdDev: 256.40 Min: 0 Median: 1.7117 Max: 223120 Percentiles: P50: 1.71 P75: 2.64 P99: 7.20 P99.9: 98.45 P99.99: 1920.14 ------------------------------------------------------ [ 0, 1 ] 811061 14.488% 14.488% ### ( 1, 2 ] 2793368 49.899% 64.388% ########## ( 2, 3 ] 930443 16.621% 81.009% ### ( 3, 4 ] 737987 13.183% 94.192% ### ( 4, 6 ] 256310 4.579% 98.770% # ( 6, 10 ] 42803 0.765% 99.535% ( 10, 15 ] 12818 0.229% 99.764% ( 15, 22 ] 4079 0.073% 99.837% ( 22, 34 ] 633 0.011% 99.848% ( 34, 51 ] 100 0.002% 99.850% ( 51, 76 ] 14 0.000% 99.850% ( 76, 110 ] 4217 0.075% 99.926% ( 110, 170 ] 1254 0.022% 99.948% ( 170, 250 ] 159 0.003% 99.951% ( 250, 380 ] 42 0.001% 99.952% ( 380, 580 ] 9 0.000% 99.952% ( 580, 870 ] 5 0.000% 99.952% ( 870, 1300 ] 2126 0.038% 99.990% ( 1900, 2900 ] 556 0.010% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 170000, 250000 ] 9 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 167306 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5597999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5777134968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 157 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5304630 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9428856527 rocksdb.compact.write.bytes COUNT : 9266338511 rocksdb.flush.write.bytes COUNT : 5737342682 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 14 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 63 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5700686848 rocksdb.memtable.garbage.bytes.at.flush COUNT : 11044864 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9475367722 rocksdb.non.last.level.read.count COUNT : 2287983 rocksdb.block.checksum.compute.count COUNT : 2287683 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.342710 P95 : 3.763887 P99 : 5.883312 P100 : 223115.000000 COUNT : 5597999 SUM : 17520349 rocksdb.compaction.times.micros P50 : 1008750.000000 P95 : 1830000.000000 P99 : 4487808.000000 P100 : 4487808.000000 COUNT : 24 SUM : 25711937 rocksdb.compaction.times.cpu_micros P50 : 1000000.000000 P95 : 1760000.000000 P99 : 4313909.000000 P100 : 4313909.000000 COUNT : 24 SUM : 24962980 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 681.500000 P95 : 1250.120000 P99 : 1317.000000 P100 : 1317.000000 COUNT : 78 SUM : 56984 rocksdb.compaction.outfile.sync.micros P50 : 779.375000 P95 : 1285.340909 P99 : 1750.000000 P100 : 1875.000000 COUNT : 75 SUM : 59299 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 89.161290 P95 : 267.333333 P99 : 568.000000 P100 : 851.000000 COUNT : 112 SUM : 13566 rocksdb.table.open.io.micros P50 : 1147.545455 P95 : 17169.230769 P99 : 20154.000000 P100 : 20154.000000 COUNT : 157 SUM : 428486 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.587517 P95 : 6.203007 P99 : 9.826526 P100 : 8740.000000 COUNT : 2287686 SUM : 10562674 rocksdb.read.block.get.micros P50 : 491.111111 P95 : 6292.000000 P99 : 9861.500000 P100 : 10835.000000 COUNT : 314 SUM : 344300 rocksdb.write.raw.block.micros P50 : 0.511560 P95 : 0.971964 P99 : 2.773610 P100 : 3657.000000 COUNT : 3635584 SUM : 6541713 rocksdb.numfiles.in.singlecompaction P50 : 3.205882 P95 : 7.000000 P99 : 18.000000 P100 : 18.000000 COUNT : 35 SUM : 130 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559842 P95 : 1157.570085 P99 : 2466.834532 P100 : 222821.000000 COUNT : 25484 SUM : 5307547 rocksdb.sst.read.micros P50 : 1.581883 P95 : 3.736124 P99 : 7.205801 P100 : 10686.000000 COUNT : 2288692 SUM : 6212398 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5597999 SUM : 5777134968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 202653.061224 P95 : 329300.000000 P99 : 369051.000000 P100 : 369051.000000 COUNT : 78 SUM : 15326029 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 97 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0