[2024-12-17 06:27:30.122822] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-12-17 06:27:30.123113] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2753907 ] Set seed to 1734413250116204 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-17 06:27:30.218529] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-17 06:27:30.254790] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-17 06:27:30.254833] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2753907' to capture a snapshot of events at runtime. [2024-12-17 06:27:30.254845] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2753907 for offline analysis/debug. [2024-12-17 06:27:30.254868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Dec 17 06:27:34 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/17-06:27:37 ... thread 0: (1000000,1000000) ops and (356899.0,356899.0) ops/second in (2.801913,2.801913) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/6 441.01 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 354.0 2.31 2.09 12 0.193 0 0 0.0 0.0 L1 4/0 314.55 MB 31.5 0.4 0.3 0.1 0.4 0.3 0.1 1.4 245.6 245.4 1.79 1.73 2 0.897 447K 373 0.0 0.0 L2 1/0 48.70 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 230.7 230.6 0.48 0.46 1 0.482 112K 33 0.0 0.0 L3 16/0 755.43 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 189.6 189.6 0.33 0.28 1 0.330 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/6 96.94 GB 0.0 0.6 0.4 0.2 1.4 1.2 0.1 1.8 124.9 291.3 4.92 4.56 16 0.308 624K 406 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.4 0.2 1.4 1.2 0.1 1.8 124.9 291.3 4.92 4.56 16 0.308 624K 406 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.4 0.2 0.6 0.4 0.0 0.0 235.8 235.6 2.61 2.47 4 0.652 624K 406 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 354.0 2.31 2.09 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.40 GB write, 475.70 MB/s write, 0.60 GB read, 204.01 MB/s read, 4.9 seconds Interval compaction: 1.40 GB write, 511.11 MB/s write, 0.60 GB read, 219.20 MB/s read, 4.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 117452 Average: 1.9001 StdDev: 13.79 Min: 0 Median: 1.2571 Max: 2967 Percentiles: P50: 1.26 P75: 1.69 P99: 4.81 P99.9: 9.63 P99.99: 256.62 ------------------------------------------------------ [ 0, 1 ] 41364 35.218% 35.218% ####### ( 1, 2 ] 67535 57.500% 92.718% ############ ( 2, 3 ] 4850 4.129% 96.847% # ( 3, 4 ] 2051 1.746% 98.593% ( 4, 6 ] 1182 1.006% 99.600% ( 6, 10 ] 389 0.331% 99.931% ( 10, 15 ] 41 0.035% 99.966% ( 15, 22 ] 13 0.011% 99.977% ( 22, 34 ] 1 0.001% 99.978% ( 34, 51 ] 1 0.001% 99.979% ( 51, 76 ] 1 0.001% 99.980% ( 110, 170 ] 9 0.008% 99.987% ( 170, 250 ] 3 0.003% 99.990% ( 250, 380 ] 5 0.004% 99.994% ( 380, 580 ] 1 0.001% 99.995% ( 580, 870 ] 3 0.003% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 32005 Average: 1.8147 StdDev: 8.61 Min: 0 Median: 1.2029 Max: 812 Percentiles: P50: 1.20 P75: 1.64 P99: 3.75 P99.9: 8.62 P99.99: 559.95 ------------------------------------------------------ [ 0, 1 ] 12307 38.453% 38.453% ######## ( 1, 2 ] 18210 56.897% 95.351% ########### ( 2, 3 ] 904 2.825% 98.175% # ( 3, 4 ] 354 1.106% 99.281% ( 4, 6 ] 160 0.500% 99.781% ( 6, 10 ] 58 0.181% 99.963% ( 10, 15 ] 4 0.012% 99.975% ( 170, 250 ] 2 0.006% 99.981% ( 250, 380 ] 1 0.003% 99.984% ( 380, 580 ] 2 0.006% 99.991% ( 580, 870 ] 3 0.009% 100.000% ** Level 2 read latency histogram (micros): Count: 28134 Average: 2.6529 StdDev: 37.29 Min: 1 Median: 1.3544 Max: 5131 Percentiles: P50: 1.35 P75: 1.81 P99: 8.10 P99.9: 74.11 P99.99: 791.37 ------------------------------------------------------ [ 0, 1 ] 8538 30.348% 30.348% ###### ( 1, 2 ] 15601 55.452% 85.800% ########### ( 2, 3 ] 2199 7.816% 93.616% ## ( 3, 4 ] 842 2.993% 96.609% # ( 4, 6 ] 526 1.870% 98.479% ( 6, 10 ] 280 0.995% 99.474% ( 10, 15 ] 57 0.203% 99.677% ( 15, 22 ] 6 0.021% 99.698% ( 22, 34 ] 5 0.018% 99.716% ( 34, 51 ] 38 0.135% 99.851% ( 51, 76 ] 15 0.053% 99.904% ( 76, 110 ] 2 0.007% 99.911% ( 110, 170 ] 2 0.007% 99.918% ( 170, 250 ] 10 0.036% 99.954% ( 250, 380 ] 2 0.007% 99.961% ( 380, 580 ] 6 0.021% 99.982% ( 580, 870 ] 3 0.011% 99.993% ( 2900, 4400 ] 1 0.004% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 936.9625 StdDev: 1509.71 Min: 2 Median: 250.0000 Max: 6038 Percentiles: P50: 250.00 P75: 870.00 P99: 6038.00 P99.9: 6038.00 P99.99: 6038.00 ------------------------------------------------------ ( 1, 2 ] 15 18.750% 18.750% #### ( 2, 3 ] 18 22.500% 41.250% ##### ( 3, 4 ] 4 5.000% 46.250% # ( 4, 6 ] 1 1.250% 47.500% ( 51, 76 ] 1 1.250% 48.750% ( 170, 250 ] 1 1.250% 50.000% ( 250, 380 ] 5 6.250% 56.250% # ( 380, 580 ] 7 8.750% 65.000% ## ( 580, 870 ] 8 10.000% 75.000% ## ( 870, 1300 ] 2 2.500% 77.500% # ( 1300, 1900 ] 3 3.750% 81.250% # ( 1900, 2900 ] 3 3.750% 85.000% # ( 2900, 4400 ] 8 10.000% 95.000% ## ( 4400, 6600 ] 4 5.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1893.3143 StdDev: 1756.67 Min: 286 Median: 1031.2500 Max: 7084 Percentiles: P50: 1031.25 P75: 3212.50 P99: 7084.00 P99.9: 7084.00 P99.99: 7084.00 ------------------------------------------------------ ( 250, 380 ] 4 11.429% 11.429% ## ( 380, 580 ] 7 20.000% 31.429% #### ( 580, 870 ] 5 14.286% 45.714% ### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 3 8.571% 97.143% ## ( 6600, 9900 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 326.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.199 H:M:S, 6.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 350.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.199 H:M:S, 7.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/17-06:27:40 ... thread 0: (1000000,2000000) ops and (317617.4,336114.4) ops/second in (3.148442,5.950355) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.41 GB 119.6 0.9 0.0 0.9 2.7 1.8 0.0 1.5 106.1 311.0 8.91 8.27 29 0.307 959K 1234 0.0 0.0 L1 1/0 2.41 MB 0.2 0.4 0.3 0.1 0.4 0.3 0.1 1.4 245.6 245.4 1.79 1.73 2 0.897 447K 373 0.0 0.0 L2 2/1 103.32 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.3 1.8 230.7 230.6 0.48 0.46 1 0.482 112K 33 0.0 0.0 L3 73/8 1012.80 MB 0.3 0.4 0.3 0.1 0.4 0.3 0.0 1.2 164.7 164.7 2.28 1.81 2 1.142 382K 178 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1246/13 97.92 GB 0.0 1.8 0.7 1.1 3.6 2.5 0.4 2.0 139.1 274.6 13.47 12.26 34 0.396 1902K 1818 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.7 1.1 3.6 2.5 0.4 2.0 139.1 274.6 13.47 12.26 34 0.396 1902K 1818 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.7 1.1 1.8 0.7 0.0 0.0 227.0 226.8 8.25 7.62 8 1.032 1902K 1818 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.1 5.22 4.65 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.61 GB write, 600.29 MB/s write, 1.83 GB read, 304.08 MB/s read, 13.5 seconds Interval compaction: 3.61 GB write, 621.34 MB/s write, 1.83 GB read, 314.74 MB/s read, 13.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 394726 Average: 2.2247 StdDev: 13.37 Min: 0 Median: 1.4712 Max: 3303 Percentiles: P50: 1.47 P75: 1.87 P99: 5.84 P99.9: 12.19 P99.99: 20.23 ------------------------------------------------------ [ 0, 1 ] 81123 20.552% 20.552% #### ( 1, 2 ] 246691 62.497% 83.048% ############ ( 2, 3 ] 34841 8.827% 91.875% ## ( 3, 4 ] 16790 4.254% 96.129% # ( 4, 6 ] 12325 3.122% 99.251% # ( 6, 10 ] 2323 0.589% 99.840% ( 10, 15 ] 545 0.138% 99.978% ( 15, 22 ] 65 0.016% 99.994% ( 22, 34 ] 8 0.002% 99.996% ( 34, 51 ] 6 0.002% 99.998% ( 51, 76 ] 5 0.001% 99.999% ( 110, 170 ] 14 0.004% 100.003% ( 170, 250 ] 11 0.003% 100.005% ( 250, 380 ] 8 0.002% 100.007% ( 380, 580 ] 3 0.001% 100.008% ( 580, 870 ] 8 0.002% 100.010% ( 870, 1300 ] 6 0.002% 100.012% ( 1300, 1900 ] 2 0.001% 100.012% ( 1900, 2900 ] 2 0.001% 100.013% ( 2900, 4400 ] 4 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 97383 Average: 2.3000 StdDev: 5.05 Min: 0 Median: 1.5500 Max: 812 Percentiles: P50: 1.55 P75: 1.97 P99: 5.94 P99.9: 12.05 P99.99: 21.70 ------------------------------------------------------ [ 0, 1 ] 16608 17.054% 17.054% ### ( 1, 2 ] 58336 59.904% 76.958% ############ ( 2, 3 ] 12468 12.803% 89.761% ### ( 3, 4 ] 4618 4.742% 94.503% # ( 4, 6 ] 4505 4.626% 99.129% # ( 6, 10 ] 701 0.720% 99.849% ( 10, 15 ] 121 0.124% 99.973% ( 15, 22 ] 17 0.017% 99.991% ( 51, 76 ] 1 0.001% 99.992% ( 170, 250 ] 2 0.002% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 2 0.002% 99.997% ( 580, 870 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40501 Average: 2.4362 StdDev: 31.09 Min: 1 Median: 1.3696 Max: 5131 Percentiles: P50: 1.37 P75: 1.80 P99: 6.77 P99.9: 54.90 P99.99: 671.82 ------------------------------------------------------ [ 0, 1 ] 11464 28.305% 28.305% ###### ( 1, 2 ] 23771 58.692% 86.998% ############ ( 2, 3 ] 2915 7.197% 94.195% # ( 3, 4 ] 1202 2.968% 97.163% # ( 4, 6 ] 684 1.689% 98.852% ( 6, 10 ] 313 0.773% 99.625% ( 10, 15 ] 59 0.146% 99.770% ( 15, 22 ] 7 0.017% 99.788% ( 22, 34 ] 5 0.012% 99.800% ( 34, 51 ] 38 0.094% 99.894% ( 51, 76 ] 16 0.040% 99.933% ( 76, 110 ] 2 0.005% 99.938% ( 110, 170 ] 2 0.005% 99.943% ( 170, 250 ] 10 0.025% 99.968% ( 250, 380 ] 2 0.005% 99.973% ( 380, 580 ] 6 0.015% 99.988% ( 580, 870 ] 3 0.007% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 190577 Average: 3.4646 StdDev: 39.66 Min: 1 Median: 1.6043 Max: 6038 Percentiles: P50: 1.60 P75: 2.07 P99: 9.42 P99.9: 215.57 P99.99: 676.16 ------------------------------------------------------ [ 0, 1 ] 25176 13.210% 13.210% ### ( 1, 2 ] 116019 60.878% 74.088% ############ ( 2, 3 ] 25841 13.559% 87.648% ### ( 3, 4 ] 10294 5.401% 93.049% # ( 4, 6 ] 8263 4.336% 97.385% # ( 6, 10 ] 3596 1.887% 99.272% ( 10, 15 ] 607 0.319% 99.590% ( 15, 22 ] 131 0.069% 99.659% ( 22, 34 ] 53 0.028% 99.687% ( 34, 51 ] 6 0.003% 99.690% ( 51, 76 ] 4 0.002% 99.692% ( 76, 110 ] 164 0.086% 99.778% ( 110, 170 ] 184 0.097% 99.875% ( 170, 250 ] 85 0.045% 99.919% ( 250, 380 ] 64 0.034% 99.953% ( 380, 580 ] 60 0.031% 99.984% ( 580, 870 ] 33 0.017% 100.002% ( 870, 1300 ] 7 0.004% 100.005% ( 1300, 1900 ] 4 0.002% 100.007% ( 1900, 2900 ] 3 0.002% 100.009% ( 2900, 4400 ] 8 0.004% 100.013% ( 4400, 6600 ] 4 0.002% 100.015% ** Level 4 read latency histogram (micros): Count: 35 Average: 1893.3143 StdDev: 1756.67 Min: 286 Median: 1031.2500 Max: 7084 Percentiles: P50: 1031.25 P75: 3212.50 P99: 7084.00 P99.9: 7084.00 P99.99: 7084.00 ------------------------------------------------------ ( 250, 380 ] 4 11.429% 11.429% ## ( 380, 580 ] 7 20.000% 31.429% #### ( 580, 870 ] 5 14.286% 45.714% ### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 3 8.571% 97.143% ## ( 6600, 9900 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 319.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.620 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 312.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.420 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-06:27:43 ... thread 0: (1000000,3000000) ops and (323257.6,331716.7) ops/second in (3.093508,9.043863) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.40 GB 62.9 1.7 0.0 1.7 4.5 2.8 0.0 1.6 118.2 308.0 14.92 13.92 46 0.324 1791K 2095 0.0 0.0 L1 1/1 2.41 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.1 1.4 245.6 245.4 1.79 1.73 2 0.897 447K 373 0.0 0.0 L2 1/0 54.63 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.3 1.8 230.7 230.6 0.48 0.46 1 0.482 112K 33 0.0 0.0 L3 65/0 989.93 MB 1.0 1.1 0.4 0.7 1.1 0.4 0.0 3.0 207.9 207.8 5.38 4.65 3 1.793 1135K 639 0.0 0.0 L4 128/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/13 98.90 GB 0.0 3.4 0.7 2.6 6.1 3.5 0.4 2.2 152.1 277.5 22.58 20.76 52 0.434 3487K 3140 0.0 0.0 Int 0/0 0.00 KB 0.0 3.4 0.7 2.6 6.1 3.5 0.4 2.2 152.1 277.5 22.58 20.76 52 0.434 3487K 3140 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.4 0.7 2.6 3.4 0.7 0.0 0.0 236.8 236.6 14.50 13.55 12 1.208 3487K 3140 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 351.0 8.08 7.22 40 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.12 GB write, 677.03 MB/s write, 3.35 GB read, 371.07 MB/s read, 22.6 seconds Interval compaction: 6.12 GB write, 692.65 MB/s write, 3.35 GB read, 379.63 MB/s read, 22.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 743974 Average: 2.1827 StdDev: 12.78 Min: 0 Median: 1.4612 Max: 3646 Percentiles: P50: 1.46 P75: 1.85 P99: 5.73 P99.9: 11.36 P99.99: 15.04 ------------------------------------------------------ [ 0, 1 ] 151104 20.310% 20.310% #### ( 1, 2 ] 478911 64.372% 84.682% ############# ( 2, 3 ] 62174 8.357% 93.039% ## ( 3, 4 ] 27778 3.734% 96.773% # ( 4, 6 ] 19102 2.568% 99.341% # ( 6, 10 ] 3912 0.526% 99.867% ( 10, 15 ] 920 0.124% 99.990% ( 15, 22 ] 101 0.014% 100.004% ( 22, 34 ] 12 0.002% 100.005% ( 34, 51 ] 7 0.001% 100.006% ( 51, 76 ] 6 0.001% 100.007% ( 76, 110 ] 9 0.001% 100.008% ( 110, 170 ] 25 0.003% 100.012% ( 170, 250 ] 28 0.004% 100.015% ( 250, 380 ] 16 0.002% 100.018% ( 380, 580 ] 8 0.001% 100.019% ( 580, 870 ] 12 0.002% 100.020% ( 870, 1300 ] 10 0.001% 100.022% ( 1300, 1900 ] 5 0.001% 100.022% ( 1900, 2900 ] 4 0.001% 100.023% ( 2900, 4400 ] 6 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 97384 Average: 2.3000 StdDev: 5.05 Min: 0 Median: 1.5500 Max: 812 Percentiles: P50: 1.55 P75: 1.97 P99: 5.94 P99.9: 12.05 P99.99: 21.70 ------------------------------------------------------ [ 0, 1 ] 16608 17.054% 17.054% ### ( 1, 2 ] 58336 59.903% 76.957% ############ ( 2, 3 ] 12468 12.803% 89.760% ### ( 3, 4 ] 4619 4.743% 94.503% # ( 4, 6 ] 4505 4.626% 99.129% # ( 6, 10 ] 701 0.720% 99.849% ( 10, 15 ] 121 0.124% 99.973% ( 15, 22 ] 17 0.017% 99.991% ( 51, 76 ] 1 0.001% 99.992% ( 170, 250 ] 2 0.002% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 2 0.002% 99.997% ( 580, 870 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40501 Average: 2.4362 StdDev: 31.09 Min: 1 Median: 1.3696 Max: 5131 Percentiles: P50: 1.37 P75: 1.80 P99: 6.77 P99.9: 54.90 P99.99: 671.82 ------------------------------------------------------ [ 0, 1 ] 11464 28.305% 28.305% ###### ( 1, 2 ] 23771 58.692% 86.998% ############ ( 2, 3 ] 2915 7.197% 94.195% # ( 3, 4 ] 1202 2.968% 97.163% # ( 4, 6 ] 684 1.689% 98.852% ( 6, 10 ] 313 0.773% 99.625% ( 10, 15 ] 59 0.146% 99.770% ( 15, 22 ] 7 0.017% 99.788% ( 22, 34 ] 5 0.012% 99.800% ( 34, 51 ] 38 0.094% 99.894% ( 51, 76 ] 16 0.040% 99.933% ( 76, 110 ] 2 0.005% 99.938% ( 110, 170 ] 2 0.005% 99.943% ( 170, 250 ] 10 0.025% 99.968% ( 250, 380 ] 2 0.005% 99.973% ( 380, 580 ] 6 0.015% 99.988% ( 580, 870 ] 3 0.007% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 190637 Average: 3.5129 StdDev: 39.99 Min: 0 Median: 1.6043 Max: 6038 Percentiles: P50: 1.60 P75: 2.07 P99: 9.45 P99.9: 229.47 P99.99: 708.38 ------------------------------------------------------ [ 0, 1 ] 25198 13.218% 13.218% ### ( 1, 2 ] 116030 60.864% 74.082% ############ ( 2, 3 ] 25843 13.556% 87.638% ### ( 3, 4 ] 10294 5.400% 93.038% # ( 4, 6 ] 8263 4.334% 97.372% # ( 6, 10 ] 3597 1.887% 99.259% ( 10, 15 ] 607 0.318% 99.578% ( 15, 22 ] 131 0.069% 99.646% ( 22, 34 ] 53 0.028% 99.674% ( 34, 51 ] 6 0.003% 99.677% ( 51, 76 ] 4 0.002% 99.679% ( 76, 110 ] 164 0.086% 99.766% ( 110, 170 ] 185 0.097% 99.863% ( 170, 250 ] 96 0.050% 99.913% ( 250, 380 ] 68 0.036% 99.949% ( 380, 580 ] 63 0.033% 99.982% ( 580, 870 ] 36 0.019% 100.001% ( 870, 1300 ] 9 0.005% 100.005% ( 1300, 1900 ] 4 0.002% 100.007% ( 1900, 2900 ] 3 0.002% 100.009% ( 2900, 4400 ] 8 0.004% 100.013% ( 4400, 6600 ] 4 0.002% 100.015% ** Level 4 read latency histogram (micros): Count: 35 Average: 1893.3143 StdDev: 1756.67 Min: 286 Median: 1031.2500 Max: 7084 Percentiles: P50: 1031.25 P75: 3212.50 P99: 7084.00 P99.9: 7084.00 P99.99: 7084.00 ------------------------------------------------------ ( 250, 380 ] 4 11.429% 11.429% ## ( 380, 580 ] 7 20.000% 31.429% #### ( 580, 870 ] 5 14.286% 45.714% ### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 3 8.571% 97.143% ## ( 6600, 9900 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 9.3 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 319.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.058 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.439 H:M:S, 14.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-06:27:46 ... thread 0: (1000000,4000000) ops and (301337.8,323561.8) ops/second in (3.318535,12.362398) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/8 3.38 GB 195.1 2.8 0.0 2.8 6.6 3.7 0.0 1.8 130.7 303.8 22.18 20.80 64 0.347 2942K 3272 0.0 0.0 L1 1/1 2.41 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.1 1.4 245.6 245.4 1.79 1.73 2 0.897 447K 373 0.0 0.0 L2 1/0 54.63 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.3 1.8 230.7 230.6 0.48 0.46 1 0.482 112K 33 0.0 0.0 L3 65/0 989.93 MB 1.0 1.1 0.4 0.7 1.1 0.4 0.0 3.0 207.9 207.8 5.38 4.65 3 1.793 1135K 639 0.0 0.0 L4 128/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/9 99.88 GB 0.0 4.5 0.7 3.7 8.2 4.5 0.4 2.2 153.1 281.8 29.83 27.64 70 0.426 4638K 4317 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 0.7 3.7 8.2 4.5 0.4 2.2 153.1 281.8 29.83 27.64 70 0.426 4638K 4317 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 0.7 3.7 4.5 0.7 0.0 0.0 242.7 242.5 18.82 17.79 16 1.176 4638K 4317 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 349.0 11.01 9.85 54 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.6 total, 12.4 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.21 GB write, 668.59 MB/s write, 4.46 GB read, 363.32 MB/s read, 29.8 seconds Interval compaction: 8.21 GB write, 679.88 MB/s write, 4.46 GB read, 369.45 MB/s read, 29.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 12, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1202022 Average: 2.2262 StdDev: 12.40 Min: 0 Median: 1.4758 Max: 3822 Percentiles: P50: 1.48 P75: 1.86 P99: 5.77 P99.9: 11.38 P99.99: 16.24 ------------------------------------------------------ [ 0, 1 ] 225098 18.727% 18.727% #### ( 1, 2 ] 790111 65.732% 84.458% ############# ( 2, 3 ] 103786 8.634% 93.093% ## ( 3, 4 ] 44638 3.714% 96.806% # ( 4, 6 ] 29832 2.482% 99.288% ( 6, 10 ] 6952 0.578% 99.866% ( 10, 15 ] 1462 0.122% 99.988% ( 15, 22 ] 134 0.011% 99.999% ( 22, 34 ] 18 0.001% 100.001% ( 34, 51 ] 9 0.001% 100.001% ( 51, 76 ] 7 0.001% 100.002% ( 76, 110 ] 50 0.004% 100.006% ( 110, 170 ] 111 0.009% 100.015% ( 170, 250 ] 71 0.006% 100.021% ( 250, 380 ] 53 0.004% 100.026% ( 380, 580 ] 40 0.003% 100.029% ( 580, 870 ] 27 0.002% 100.031% ( 870, 1300 ] 16 0.001% 100.033% ( 1300, 1900 ] 5 0.000% 100.033% ( 1900, 2900 ] 4 0.000% 100.033% ( 2900, 4400 ] 9 0.001% 100.034% ** Level 1 read latency histogram (micros): Count: 97384 Average: 2.3000 StdDev: 5.05 Min: 0 Median: 1.5500 Max: 812 Percentiles: P50: 1.55 P75: 1.97 P99: 5.94 P99.9: 12.05 P99.99: 21.70 ------------------------------------------------------ [ 0, 1 ] 16608 17.054% 17.054% ### ( 1, 2 ] 58336 59.903% 76.957% ############ ( 2, 3 ] 12468 12.803% 89.760% ### ( 3, 4 ] 4619 4.743% 94.503% # ( 4, 6 ] 4505 4.626% 99.129% # ( 6, 10 ] 701 0.720% 99.849% ( 10, 15 ] 121 0.124% 99.973% ( 15, 22 ] 17 0.017% 99.991% ( 51, 76 ] 1 0.001% 99.992% ( 170, 250 ] 2 0.002% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 2 0.002% 99.997% ( 580, 870 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40501 Average: 2.4362 StdDev: 31.09 Min: 1 Median: 1.3696 Max: 5131 Percentiles: P50: 1.37 P75: 1.80 P99: 6.77 P99.9: 54.90 P99.99: 671.82 ------------------------------------------------------ [ 0, 1 ] 11464 28.305% 28.305% ###### ( 1, 2 ] 23771 58.692% 86.998% ############ ( 2, 3 ] 2915 7.197% 94.195% # ( 3, 4 ] 1202 2.968% 97.163% # ( 4, 6 ] 684 1.689% 98.852% ( 6, 10 ] 313 0.773% 99.625% ( 10, 15 ] 59 0.146% 99.770% ( 15, 22 ] 7 0.017% 99.788% ( 22, 34 ] 5 0.012% 99.800% ( 34, 51 ] 38 0.094% 99.894% ( 51, 76 ] 16 0.040% 99.933% ( 76, 110 ] 2 0.005% 99.938% ( 110, 170 ] 2 0.005% 99.943% ( 170, 250 ] 10 0.025% 99.968% ( 250, 380 ] 2 0.005% 99.973% ( 380, 580 ] 6 0.015% 99.988% ( 580, 870 ] 3 0.007% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 190637 Average: 3.5129 StdDev: 39.99 Min: 0 Median: 1.6043 Max: 6038 Percentiles: P50: 1.60 P75: 2.07 P99: 9.45 P99.9: 229.47 P99.99: 708.38 ------------------------------------------------------ [ 0, 1 ] 25198 13.218% 13.218% ### ( 1, 2 ] 116030 60.864% 74.082% ############ ( 2, 3 ] 25843 13.556% 87.638% ### ( 3, 4 ] 10294 5.400% 93.038% # ( 4, 6 ] 8263 4.334% 97.372% # ( 6, 10 ] 3597 1.887% 99.259% ( 10, 15 ] 607 0.318% 99.578% ( 15, 22 ] 131 0.069% 99.646% ( 22, 34 ] 53 0.028% 99.674% ( 34, 51 ] 6 0.003% 99.677% ( 51, 76 ] 4 0.002% 99.679% ( 76, 110 ] 164 0.086% 99.766% ( 110, 170 ] 185 0.097% 99.863% ( 170, 250 ] 96 0.050% 99.913% ( 250, 380 ] 68 0.036% 99.949% ( 380, 580 ] 63 0.033% 99.982% ( 580, 870 ] 36 0.019% 100.001% ( 870, 1300 ] 9 0.005% 100.005% ( 1300, 1900 ] 4 0.002% 100.007% ( 1900, 2900 ] 3 0.002% 100.009% ( 2900, 4400 ] 8 0.004% 100.013% ( 4400, 6600 ] 4 0.002% 100.015% ** Level 4 read latency histogram (micros): Count: 35 Average: 1893.3143 StdDev: 1756.67 Min: 286 Median: 1031.2500 Max: 7084 Percentiles: P50: 1031.25 P75: 3212.50 P99: 7084.00 P99.9: 7084.00 P99.99: 7084.00 ------------------------------------------------------ ( 250, 380 ] 4 11.429% 11.429% ## ( 380, 580 ] 7 20.000% 31.429% #### ( 580, 870 ] 5 14.286% 45.714% ### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 3 8.571% 97.143% ## ( 6600, 9900 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 12.6 total, 3.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 313.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.694 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 296.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.636 H:M:S, 19.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/17-06:27:49 ... thread 0: (1000000,5000000) ops and (326953.1,324234.4) ops/second in (3.058543,15.420941) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.89 GB 69.2 3.4 0.0 3.4 8.1 4.7 0.0 1.7 127.8 306.7 27.10 25.38 81 0.335 3518K 3868 0.0 0.0 L1 13/13 1.47 GB 0.0 1.9 1.8 0.1 1.9 1.8 0.1 1.1 234.1 232.8 8.35 8.06 3 2.782 1983K 10K 0.0 0.0 L2 1/0 54.63 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.3 1.8 230.7 230.6 0.48 0.46 1 0.482 112K 33 0.0 0.0 L3 65/0 989.93 MB 1.0 1.1 0.4 0.7 1.1 0.4 0.0 3.0 207.9 207.8 5.38 4.65 3 1.793 1135K 639 0.0 0.0 L4 128/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/27 100.86 GB 0.0 6.5 2.2 4.3 11.2 6.9 0.4 2.4 160.9 278.0 41.31 38.55 88 0.469 6750K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 2.2 4.3 11.2 6.9 0.4 2.4 160.9 278.0 41.31 38.55 88 0.469 6750K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 2.2 4.3 6.5 2.2 0.0 0.0 241.6 241.0 27.52 26.23 19 1.448 6750K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 351.7 13.79 12.32 69 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.21 GB write, 734.62 MB/s write, 6.49 GB read, 425.28 MB/s read, 41.3 seconds Interval compaction: 11.21 GB write, 744.57 MB/s write, 6.49 GB read, 431.03 MB/s read, 41.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 14, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1477708 Average: 2.2290 StdDev: 12.10 Min: 0 Median: 1.4725 Max: 3822 Percentiles: P50: 1.47 P75: 1.85 P99: 5.75 P99.9: 11.37 P99.99: 20.68 ------------------------------------------------------ [ 0, 1 ] 278723 18.862% 18.862% #### ( 1, 2 ] 973836 65.902% 84.764% ############# ( 2, 3 ] 125780 8.512% 93.275% ## ( 3, 4 ] 53872 3.646% 96.921% # ( 4, 6 ] 35122 2.377% 99.298% ( 6, 10 ] 8444 0.571% 99.869% ( 10, 15 ] 1662 0.112% 99.982% ( 15, 22 ] 152 0.010% 99.992% ( 22, 34 ] 26 0.002% 99.994% ( 34, 51 ] 10 0.001% 99.995% ( 51, 76 ] 11 0.001% 99.995% ( 76, 110 ] 72 0.005% 100.000% ( 110, 170 ] 176 0.012% 100.012% ( 170, 250 ] 114 0.008% 100.020% ( 250, 380 ] 74 0.005% 100.025% ( 380, 580 ] 52 0.004% 100.028% ( 580, 870 ] 42 0.003% 100.031% ( 870, 1300 ] 21 0.001% 100.033% ( 1300, 1900 ] 6 0.000% 100.033% ( 1900, 2900 ] 5 0.000% 100.033% ( 2900, 4400 ] 9 0.001% 100.034% ** Level 1 read latency histogram (micros): Count: 164470 Average: 2.6622 StdDev: 14.36 Min: 0 Median: 1.5218 Max: 1526 Percentiles: P50: 1.52 P75: 1.92 P99: 7.53 P99.9: 150.78 P99.99: 742.96 ------------------------------------------------------ [ 0, 1 ] 28309 17.212% 17.212% ### ( 1, 2 ] 103341 62.833% 80.045% ############# ( 2, 3 ] 17935 10.905% 90.950% ## ( 3, 4 ] 6760 4.110% 95.060% # ( 4, 6 ] 5803 3.528% 98.588% # ( 6, 10 ] 1766 1.074% 99.662% ( 10, 15 ] 231 0.140% 99.802% ( 15, 22 ] 31 0.019% 99.821% ( 22, 34 ] 2 0.001% 99.822% ( 34, 51 ] 1 0.001% 99.823% ( 51, 76 ] 4 0.002% 99.826% ( 76, 110 ] 60 0.036% 99.862% ( 110, 170 ] 92 0.056% 99.918% ( 170, 250 ] 48 0.029% 99.947% ( 250, 380 ] 32 0.019% 99.967% ( 380, 580 ] 29 0.018% 99.984% ( 580, 870 ] 17 0.010% 99.995% ( 870, 1300 ] 7 0.004% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 40501 Average: 2.4362 StdDev: 31.09 Min: 1 Median: 1.3696 Max: 5131 Percentiles: P50: 1.37 P75: 1.80 P99: 6.77 P99.9: 54.90 P99.99: 671.82 ------------------------------------------------------ [ 0, 1 ] 11464 28.305% 28.305% ###### ( 1, 2 ] 23771 58.692% 86.998% ############ ( 2, 3 ] 2915 7.197% 94.195% # ( 3, 4 ] 1202 2.968% 97.163% # ( 4, 6 ] 684 1.689% 98.852% ( 6, 10 ] 313 0.773% 99.625% ( 10, 15 ] 59 0.146% 99.770% ( 15, 22 ] 7 0.017% 99.788% ( 22, 34 ] 5 0.012% 99.800% ( 34, 51 ] 38 0.094% 99.894% ( 51, 76 ] 16 0.040% 99.933% ( 76, 110 ] 2 0.005% 99.938% ( 110, 170 ] 2 0.005% 99.943% ( 170, 250 ] 10 0.025% 99.968% ( 250, 380 ] 2 0.005% 99.973% ( 380, 580 ] 6 0.015% 99.988% ( 580, 870 ] 3 0.007% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 190637 Average: 3.5129 StdDev: 39.99 Min: 0 Median: 1.6043 Max: 6038 Percentiles: P50: 1.60 P75: 2.07 P99: 9.45 P99.9: 229.47 P99.99: 708.38 ------------------------------------------------------ [ 0, 1 ] 25198 13.218% 13.218% ### ( 1, 2 ] 116030 60.864% 74.082% ############ ( 2, 3 ] 25843 13.556% 87.638% ### ( 3, 4 ] 10294 5.400% 93.038% # ( 4, 6 ] 8263 4.334% 97.372% # ( 6, 10 ] 3597 1.887% 99.259% ( 10, 15 ] 607 0.318% 99.578% ( 15, 22 ] 131 0.069% 99.646% ( 22, 34 ] 53 0.028% 99.674% ( 34, 51 ] 6 0.003% 99.677% ( 51, 76 ] 4 0.002% 99.679% ( 76, 110 ] 164 0.086% 99.766% ( 110, 170 ] 185 0.097% 99.863% ( 170, 250 ] 96 0.050% 99.913% ( 250, 380 ] 68 0.036% 99.949% ( 380, 580 ] 63 0.033% 99.982% ( 580, 870 ] 36 0.019% 100.001% ( 870, 1300 ] 9 0.005% 100.005% ( 1300, 1900 ] 4 0.002% 100.007% ( 1900, 2900 ] 3 0.002% 100.009% ( 2900, 4400 ] 8 0.004% 100.013% ( 4400, 6600 ] 4 0.002% 100.015% ** Level 4 read latency histogram (micros): Count: 35 Average: 1893.3143 StdDev: 1756.67 Min: 286 Median: 1031.2500 Max: 7084 Percentiles: P50: 1031.25 P75: 3212.50 P99: 7084.00 P99.9: 7084.00 P99.99: 7084.00 ------------------------------------------------------ ( 250, 380 ] 4 11.429% 11.429% ## ( 380, 580 ] 7 20.000% 31.429% #### ( 580, 870 ] 5 14.286% 45.714% ### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 3 8.571% 97.143% ## ( 6600, 9900 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 15.6 total, 3.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.112 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.418 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-06:28:03 ... thread 0: (1000000,6000000) ops and (74892.5,208525.8) ops/second in (13.352478,28.773419) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/4 1.90 GB 0.0 5.9 0.0 5.9 11.6 5.7 0.0 2.0 151.8 298.5 39.84 37.42 103 0.387 6139K 12K 0.0 0.0 L1 16/16 1.88 GB 0.0 5.3 3.7 1.6 5.3 3.7 0.1 1.4 224.9 222.4 24.33 23.08 4 6.082 5555K 59K 0.0 0.0 L2 8/4 956.08 MB 5.2 0.1 0.1 0.0 0.1 0.1 1.8 1.8 230.7 230.6 0.48 0.46 1 0.482 112K 33 0.0 0.0 L3 31/23 935.35 MB 0.8 1.1 0.4 0.7 1.1 0.4 0.6 3.0 207.9 207.8 5.38 4.65 3 1.793 1135K 639 0.0 0.0 L4 167/8 10.29 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/55 101.79 GB 0.0 12.4 4.2 8.3 18.1 9.8 3.3 3.2 182.0 264.6 70.03 65.61 111 0.631 12M 72K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.4 4.2 8.3 18.1 9.8 3.3 3.2 182.0 264.6 70.03 65.61 111 0.631 12M 72K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.4 4.2 8.3 12.4 4.1 0.0 0.0 238.7 237.3 53.40 50.77 26 2.054 12M 72K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 352.3 16.63 14.83 85 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.0 total, 28.8 interval Flush(GB): cumulative 5.722, interval 5.722 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.10 GB write, 639.37 MB/s write, 12.45 GB read, 439.77 MB/s read, 70.0 seconds Interval compaction: 18.10 GB write, 644.01 MB/s write, 12.45 GB read, 442.96 MB/s read, 70.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 14, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2524255 Average: 2.4730 StdDev: 14.83 Min: 0 Median: 1.4516 Max: 4189 Percentiles: P50: 1.45 P75: 1.83 P99: 5.97 P99.9: 119.49 P99.99: 254.76 ------------------------------------------------------ [ 0, 1 ] 509308 20.177% 20.177% #### ( 1, 2 ] 1666844 66.033% 86.210% ############# ( 2, 3 ] 190627 7.552% 93.761% ## ( 3, 4 ] 83273 3.299% 97.060% # ( 4, 6 ] 49786 1.972% 99.033% ( 6, 10 ] 17175 0.680% 99.713% ( 10, 15 ] 2364 0.094% 99.807% ( 15, 22 ] 252 0.010% 99.817% ( 22, 34 ] 36 0.001% 99.818% ( 34, 51 ] 13 0.001% 99.819% ( 51, 76 ] 28 0.001% 99.820% ( 76, 110 ] 1710 0.068% 99.888% ( 110, 170 ] 1991 0.079% 99.966% ( 170, 250 ] 580 0.023% 99.989% ( 250, 380 ] 425 0.017% 100.006% ( 380, 580 ] 318 0.013% 100.019% ( 580, 870 ] 143 0.006% 100.024% ( 870, 1300 ] 46 0.002% 100.026% ( 1300, 1900 ] 14 0.001% 100.027% ( 1900, 2900 ] 7 0.000% 100.027% ( 2900, 4400 ] 15 0.001% 100.028% ** Level 1 read latency histogram (micros): Count: 484065 Average: 2.6862 StdDev: 17.85 Min: 0 Median: 1.4543 Max: 3414 Percentiles: P50: 1.45 P75: 1.84 P99: 8.13 P99.9: 157.18 P99.99: 805.20 ------------------------------------------------------ [ 0, 1 ] 101232 20.913% 20.913% #### ( 1, 2 ] 309918 64.024% 84.937% ############# ( 2, 3 ] 37999 7.850% 92.787% ## ( 3, 4 ] 15644 3.232% 96.019% # ( 4, 6 ] 11159 2.305% 98.324% ( 6, 10 ] 6151 1.271% 99.595% ( 10, 15 ] 586 0.121% 99.716% ( 15, 22 ] 95 0.020% 99.735% ( 22, 34 ] 7 0.001% 99.737% ( 34, 51 ] 2 0.000% 99.737% ( 51, 76 ] 16 0.003% 99.741% ( 76, 110 ] 402 0.083% 99.824% ( 110, 170 ] 473 0.098% 99.921% ( 170, 250 ] 124 0.026% 99.947% ( 250, 380 ] 87 0.018% 99.965% ( 380, 580 ] 77 0.016% 99.981% ( 580, 870 ] 60 0.012% 99.993% ( 870, 1300 ] 34 0.007% 100.000% ( 1300, 1900 ] 6 0.001% 100.001% ( 2900, 4400 ] 3 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 40501 Average: 2.4362 StdDev: 31.09 Min: 1 Median: 1.3696 Max: 5131 Percentiles: P50: 1.37 P75: 1.80 P99: 6.77 P99.9: 54.90 P99.99: 671.82 ------------------------------------------------------ [ 0, 1 ] 11464 28.305% 28.305% ###### ( 1, 2 ] 23771 58.692% 86.998% ############ ( 2, 3 ] 2915 7.197% 94.195% # ( 3, 4 ] 1202 2.968% 97.163% # ( 4, 6 ] 684 1.689% 98.852% ( 6, 10 ] 313 0.773% 99.625% ( 10, 15 ] 59 0.146% 99.770% ( 15, 22 ] 7 0.017% 99.788% ( 22, 34 ] 5 0.012% 99.800% ( 34, 51 ] 38 0.094% 99.894% ( 51, 76 ] 16 0.040% 99.933% ( 76, 110 ] 2 0.005% 99.938% ( 110, 170 ] 2 0.005% 99.943% ( 170, 250 ] 10 0.025% 99.968% ( 250, 380 ] 2 0.005% 99.973% ( 380, 580 ] 6 0.015% 99.988% ( 580, 870 ] 3 0.007% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 192204 Average: 3.8813 StdDev: 41.53 Min: 0 Median: 1.6093 Max: 6038 Percentiles: P50: 1.61 P75: 2.10 P99: 9.77 P99.9: 337.91 P99.99: 772.00 ------------------------------------------------------ [ 0, 1 ] 25237 13.130% 13.130% ### ( 1, 2 ] 116311 60.514% 73.645% ############ ( 2, 3 ] 26151 13.606% 87.251% ### ( 3, 4 ] 10568 5.498% 92.749% # ( 4, 6 ] 8554 4.450% 97.199% # ( 6, 10 ] 3674 1.912% 99.111% ( 10, 15 ] 633 0.329% 99.440% ( 15, 22 ] 145 0.075% 99.516% ( 22, 34 ] 54 0.028% 99.544% ( 34, 51 ] 6 0.003% 99.547% ( 51, 76 ] 4 0.002% 99.549% ( 76, 110 ] 174 0.091% 99.639% ( 110, 170 ] 257 0.134% 99.773% ( 170, 250 ] 164 0.085% 99.858% ( 250, 380 ] 118 0.061% 99.920% ( 380, 580 ] 103 0.054% 99.973% ( 580, 870 ] 48 0.025% 99.998% ( 870, 1300 ] 13 0.007% 100.005% ( 1300, 1900 ] 4 0.002% 100.007% ( 1900, 2900 ] 3 0.002% 100.009% ( 2900, 4400 ] 8 0.004% 100.013% ( 4400, 6600 ] 4 0.002% 100.015% ** Level 4 read latency histogram (micros): Count: 35 Average: 1893.3143 StdDev: 1756.67 Min: 286 Median: 1031.2500 Max: 7084 Percentiles: P50: 1031.25 P75: 3212.50 P99: 7084.00 P99.9: 7084.00 P99.99: 7084.00 ------------------------------------------------------ ( 250, 380 ] 4 11.429% 11.429% ## ( 380, 580 ] 7 20.000% 31.429% #### ( 580, 870 ] 5 14.286% 45.714% ### ( 870, 1300 ] 4 11.429% 57.143% ## ( 1300, 1900 ] 1 2.857% 60.000% # ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 3 8.571% 97.143% ## ( 6600, 9900 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 3 Average: 1096.0000 StdDev: 128.97 Min: 921 Median: 1085.0000 Max: 1228 Percentiles: P50: 1085.00 P75: 1192.50 P99: 1228.00 P99.9: 1228.00 P99.99: 1228.00 ------------------------------------------------------ ( 870, 1300 ] 3 100.000% 100.000% #################### ** DB Stats ** Uptime(secs): 29.0 total, 13.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 203.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.248 H:M:S, 42.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 73.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.137 H:M:S, 75.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 0 2024/12/17-06:28:06 ... thread 0: (1000000,7000000) ops and (270378.4,215570.7) ops/second in (3.698520,32.471939) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 2.76 GB 25.2 6.2 0.0 6.2 12.7 6.6 0.0 1.9 142.3 294.2 44.28 40.83 116 0.382 6395K 12K 0.0 0.0 L1 16/16 1.88 GB 0.0 5.3 3.7 1.6 5.3 3.7 0.1 1.4 224.9 222.4 24.33 23.08 4 6.082 5555K 59K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.8 1.8 230.7 230.6 0.48 0.46 1 0.482 112K 33 0.0 0.0 L3 15/0 950.40 MB 1.0 2.4 1.3 1.1 2.4 1.3 0.6 1.8 191.8 191.6 12.69 10.64 11 1.153 2428K 1451 0.0 0.0 L4 167/0 9.54 GB 1.0 0.6 0.6 0.0 0.6 0.6 1.1 1.1 151.3 151.1 3.95 2.70 10 0.395 607K 984 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/28 102.64 GB 0.0 14.6 5.7 8.9 21.1 12.2 5.3 3.2 173.9 251.7 85.73 77.71 142 0.604 15M 74K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 5.7 8.9 21.1 12.2 5.3 3.2 173.9 251.7 85.73 77.71 142 0.604 15M 74K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 5.7 8.9 14.5 5.6 0.0 0.0 226.5 225.3 65.83 60.49 45 1.463 15M 74K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 338.9 19.89 17.22 97 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.7 total, 32.5 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.07 GB write, 660.16 MB/s write, 14.56 GB read, 456.25 MB/s read, 85.7 seconds Interval compaction: 21.07 GB write, 664.40 MB/s write, 14.56 GB read, 459.18 MB/s read, 85.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 33, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2843596 Average: 2.5354 StdDev: 18.93 Min: 0 Median: 1.4756 Max: 11782 Percentiles: P50: 1.48 P75: 1.86 P99: 6.50 P99.9: 112.34 P99.99: 254.74 ------------------------------------------------------ [ 0, 1 ] 540329 19.002% 19.002% #### ( 1, 2 ] 1853291 65.174% 84.176% ############# ( 2, 3 ] 240395 8.454% 92.630% ## ( 3, 4 ] 105038 3.694% 96.324% # ( 4, 6 ] 73274 2.577% 98.900% # ( 6, 10 ] 22833 0.803% 99.703% ( 10, 15 ] 3364 0.118% 99.822% ( 15, 22 ] 354 0.012% 99.834% ( 22, 34 ] 46 0.002% 99.836% ( 34, 51 ] 13 0.000% 99.836% ( 51, 76 ] 29 0.001% 99.837% ( 76, 110 ] 1711 0.060% 99.897% ( 110, 170 ] 2007 0.071% 99.968% ( 170, 250 ] 614 0.022% 99.990% ( 250, 380 ] 456 0.016% 100.006% ( 380, 580 ] 338 0.012% 100.017% ( 580, 870 ] 172 0.006% 100.023% ( 870, 1300 ] 54 0.002% 100.025% ( 1300, 1900 ] 19 0.001% 100.026% ( 1900, 2900 ] 13 0.000% 100.027% ( 2900, 4400 ] 24 0.001% 100.027% ( 4400, 6600 ] 2 0.000% 100.027% ( 6600, 9900 ] 1 0.000% 100.027% ( 9900, 14000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 721548 Average: 3.1361 StdDev: 29.32 Min: 0 Median: 1.5725 Max: 4673 Percentiles: P50: 1.57 P75: 1.98 P99: 8.58 P99.9: 115.69 P99.99: 281.10 ------------------------------------------------------ [ 0, 1 ] 108942 15.098% 15.098% ### ( 1, 2 ] 439879 60.963% 76.062% ############ ( 2, 3 ] 84807 11.753% 87.815% ## ( 3, 4 ] 39316 5.449% 93.264% # ( 4, 6 ] 34241 4.745% 98.009% # ( 6, 10 ] 11080 1.536% 99.545% ( 10, 15 ] 1822 0.253% 99.798% ( 15, 22 ] 244 0.034% 99.831% ( 22, 34 ] 12 0.002% 99.833% ( 34, 51 ] 4 0.001% 99.834% ( 51, 76 ] 18 0.002% 99.836% ( 76, 110 ] 414 0.057% 99.893% ( 110, 170 ] 500 0.069% 99.963% ( 170, 250 ] 160 0.022% 99.985% ( 250, 380 ] 154 0.021% 100.006% ( 380, 580 ] 156 0.022% 100.028% ( 580, 870 ] 117 0.016% 100.044% ( 870, 1300 ] 66 0.009% 100.053% ( 1300, 1900 ] 23 0.003% 100.056% ( 1900, 2900 ] 28 0.004% 100.060% ( 2900, 4400 ] 15 0.002% 100.062% ( 4400, 6600 ] 2 0.000% 100.063% ** Level 2 read latency histogram (micros): Count: 40501 Average: 2.4362 StdDev: 31.09 Min: 1 Median: 1.3696 Max: 5131 Percentiles: P50: 1.37 P75: 1.80 P99: 6.77 P99.9: 54.90 P99.99: 671.82 ------------------------------------------------------ [ 0, 1 ] 11464 28.305% 28.305% ###### ( 1, 2 ] 23771 58.692% 86.998% ############ ( 2, 3 ] 2915 7.197% 94.195% # ( 3, 4 ] 1202 2.968% 97.163% # ( 4, 6 ] 684 1.689% 98.852% ( 6, 10 ] 313 0.773% 99.625% ( 10, 15 ] 59 0.146% 99.770% ( 15, 22 ] 7 0.017% 99.788% ( 22, 34 ] 5 0.012% 99.800% ( 34, 51 ] 38 0.094% 99.894% ( 51, 76 ] 16 0.040% 99.933% ( 76, 110 ] 2 0.005% 99.938% ( 110, 170 ] 2 0.005% 99.943% ( 170, 250 ] 10 0.025% 99.968% ( 250, 380 ] 2 0.005% 99.973% ( 380, 580 ] 6 0.015% 99.988% ( 580, 870 ] 3 0.007% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 432436 Average: 5.2790 StdDev: 70.08 Min: 0 Median: 1.7536 Max: 10198 Percentiles: P50: 1.75 P75: 2.65 P99: 9.62 P99.9: 307.82 P99.99: 469.29 ------------------------------------------------------ [ 0, 1 ] 33073 7.648% 7.648% ## ( 1, 2 ] 243040 56.203% 63.851% ########### ( 2, 3 ] 73833 17.074% 80.924% ### ( 3, 4 ] 37447 8.660% 89.584% ## ( 4, 6 ] 33860 7.830% 97.414% ## ( 6, 10 ] 7589 1.755% 99.169% ( 10, 15 ] 1393 0.322% 99.491% ( 15, 22 ] 236 0.055% 99.546% ( 22, 34 ] 58 0.013% 99.559% ( 34, 51 ] 6 0.001% 99.560% ( 51, 76 ] 6 0.001% 99.562% ( 76, 110 ] 288 0.067% 99.628% ( 110, 170 ] 551 0.127% 99.756% ( 170, 250 ] 447 0.103% 99.859% ( 250, 380 ] 397 0.092% 99.951% ( 380, 580 ] 378 0.087% 100.038% ( 580, 870 ] 218 0.050% 100.089% ( 870, 1300 ] 83 0.019% 100.108% ( 1300, 1900 ] 33 0.008% 100.116% ( 1900, 2900 ] 24 0.006% 100.121% ( 2900, 4400 ] 39 0.009% 100.130% ( 4400, 6600 ] 17 0.004% 100.134% ( 6600, 9900 ] 4 0.001% 100.135% ( 9900, 14000 ] 3 0.001% 100.136% ** Level 4 read latency histogram (micros): Count: 125 Average: 670.4160 StdDev: 1329.58 Min: 1 Median: 3.6250 Max: 7084 Percentiles: P50: 3.62 P75: 607.19 P99: 6462.50 P99.9: 7084.00 P99.99: 7084.00 ------------------------------------------------------ [ 0, 1 ] 21 16.800% 16.800% ### ( 1, 2 ] 29 23.200% 40.000% ##### ( 2, 3 ] 10 8.000% 48.000% ## ( 3, 4 ] 4 3.200% 51.200% # ( 6, 10 ] 3 2.400% 53.600% ( 10, 15 ] 3 2.400% 56.000% ( 110, 170 ] 2 1.600% 57.600% ( 170, 250 ] 9 7.200% 64.800% # ( 250, 380 ] 5 4.000% 68.800% # ( 380, 580 ] 7 5.600% 74.400% # ( 580, 870 ] 8 6.400% 80.800% # ( 870, 1300 ] 5 4.000% 84.800% # ( 1300, 1900 ] 2 1.600% 86.400% ( 1900, 2900 ] 5 4.000% 90.400% # ( 2900, 4400 ] 7 5.600% 96.000% # ( 4400, 6600 ] 4 3.200% 99.200% # ( 6600, 9900 ] 1 0.800% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 1118.5400 StdDev: 1150.91 Min: 107 Median: 652.5000 Max: 4874 Percentiles: P50: 652.50 P75: 1600.00 P99: 4874.00 P99.9: 4874.00 P99.99: 4874.00 ------------------------------------------------------ ( 76, 110 ] 2 2.000% 2.000% ( 110, 170 ] 10 10.000% 12.000% ## ( 170, 250 ] 15 15.000% 27.000% ### ( 250, 380 ] 10 10.000% 37.000% ## ( 380, 580 ] 10 10.000% 47.000% ## ( 580, 870 ] 12 12.000% 59.000% ## ( 870, 1300 ] 13 13.000% 72.000% ### ( 1300, 1900 ] 6 6.000% 78.000% # ( 1900, 2900 ] 11 11.000% 89.000% ## ( 2900, 4400 ] 9 9.000% 98.000% ## ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 32.7 total, 3.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 210.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.198 H:M:S, 40.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 266.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.950 H:M:S, 25.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/17-06:28:10 ... thread 0: (1000000,8000000) ops and (325371.8,225064.6) ops/second in (3.073407,35.545346) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.74 GB 132.2 7.0 0.0 7.0 14.6 7.6 0.0 1.9 142.3 295.6 50.45 46.65 133 0.379 7290K 13K 0.0 0.0 L1 16/16 1.88 GB 0.0 5.3 3.7 1.6 5.3 3.7 0.1 1.4 224.9 222.4 24.33 23.08 4 6.082 5555K 59K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.8 1.8 230.7 230.6 0.48 0.46 1 0.482 112K 33 0.0 0.0 L3 15/0 950.40 MB 1.0 2.4 1.3 1.1 2.4 1.3 0.6 1.8 191.8 191.6 12.69 10.64 11 1.153 2428K 1451 0.0 0.0 L4 167/0 9.54 GB 1.0 0.6 0.6 0.0 0.6 0.6 1.1 1.1 151.3 151.1 3.95 2.70 10 0.395 607K 984 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1280/28 103.63 GB 0.0 15.4 5.7 9.8 22.9 13.2 5.3 3.0 171.9 255.3 91.90 83.53 159 0.578 15M 75K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.4 5.7 9.8 22.9 13.2 5.3 3.0 171.9 255.3 91.90 83.53 159 0.578 15M 75K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.4 5.7 9.8 15.3 5.6 0.0 0.0 228.3 227.2 69.17 63.77 48 1.441 15M 75K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 340.9 22.73 19.76 111 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.8 total, 35.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.91 GB write, 656.24 MB/s write, 15.42 GB read, 441.70 MB/s read, 91.9 seconds Interval compaction: 22.91 GB write, 660.09 MB/s write, 15.42 GB read, 444.29 MB/s read, 91.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 37, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3164477 Average: 2.5131 StdDev: 18.17 Min: 0 Median: 1.4811 Max: 11782 Percentiles: P50: 1.48 P75: 1.86 P99: 6.37 P99.9: 104.57 P99.99: 234.80 ------------------------------------------------------ [ 0, 1 ] 587018 18.550% 18.550% #### ( 1, 2 ] 2068559 65.368% 83.918% ############# ( 2, 3 ] 274634 8.679% 92.597% ## ( 3, 4 ] 118417 3.742% 96.339% # ( 4, 6 ] 81856 2.587% 98.926% # ( 6, 10 ] 25110 0.793% 99.719% ( 10, 15 ] 3753 0.119% 99.838% ( 15, 22 ] 388 0.012% 99.850% ( 22, 34 ] 47 0.001% 99.852% ( 34, 51 ] 14 0.000% 99.852% ( 51, 76 ] 37 0.001% 99.853% ( 76, 110 ] 1763 0.056% 99.909% ( 110, 170 ] 2053 0.065% 99.974% ( 170, 250 ] 634 0.020% 99.994% ( 250, 380 ] 470 0.015% 100.009% ( 380, 580 ] 346 0.011% 100.020% ( 580, 870 ] 183 0.006% 100.025% ( 870, 1300 ] 59 0.002% 100.027% ( 1300, 1900 ] 21 0.001% 100.028% ( 1900, 2900 ] 14 0.000% 100.028% ( 2900, 4400 ] 24 0.001% 100.029% ( 4400, 6600 ] 2 0.000% 100.029% ( 6600, 9900 ] 1 0.000% 100.029% ( 9900, 14000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 817049 Average: 3.0645 StdDev: 27.73 Min: 0 Median: 1.5655 Max: 4673 Percentiles: P50: 1.57 P75: 1.97 P99: 8.56 P99.9: 115.48 P99.99: 291.52 ------------------------------------------------------ [ 0, 1 ] 122673 15.014% 15.014% ### ( 1, 2 ] 505449 61.863% 76.877% ############ ( 2, 3 ] 93890 11.491% 88.368% ## ( 3, 4 ] 42396 5.189% 93.557% # ( 4, 6 ] 36380 4.453% 98.010% # ( 6, 10 ] 12649 1.548% 99.558% ( 10, 15 ] 1945 0.238% 99.796% ( 15, 22 ] 255 0.031% 99.827% ( 22, 34 ] 13 0.002% 99.829% ( 34, 51 ] 6 0.001% 99.830% ( 51, 76 ] 19 0.002% 99.832% ( 76, 110 ] 506 0.062% 99.894% ( 110, 170 ] 558 0.068% 99.962% ( 170, 250 ] 174 0.021% 99.983% ( 250, 380 ] 170 0.021% 100.004% ( 380, 580 ] 163 0.020% 100.024% ( 580, 870 ] 121 0.015% 100.039% ( 870, 1300 ] 66 0.008% 100.047% ( 1300, 1900 ] 23 0.003% 100.050% ( 1900, 2900 ] 28 0.003% 100.053% ( 2900, 4400 ] 15 0.002% 100.055% ( 4400, 6600 ] 2 0.000% 100.055% ** Level 2 read latency histogram (micros): Count: 40501 Average: 2.4362 StdDev: 31.09 Min: 1 Median: 1.3696 Max: 5131 Percentiles: P50: 1.37 P75: 1.80 P99: 6.77 P99.9: 54.90 P99.99: 671.82 ------------------------------------------------------ [ 0, 1 ] 11464 28.305% 28.305% ###### ( 1, 2 ] 23771 58.692% 86.998% ############ ( 2, 3 ] 2915 7.197% 94.195% # ( 3, 4 ] 1202 2.968% 97.163% # ( 4, 6 ] 684 1.689% 98.852% ( 6, 10 ] 313 0.773% 99.625% ( 10, 15 ] 59 0.146% 99.770% ( 15, 22 ] 7 0.017% 99.788% ( 22, 34 ] 5 0.012% 99.800% ( 34, 51 ] 38 0.094% 99.894% ( 51, 76 ] 16 0.040% 99.933% ( 76, 110 ] 2 0.005% 99.938% ( 110, 170 ] 2 0.005% 99.943% ( 170, 250 ] 10 0.025% 99.968% ( 250, 380 ] 2 0.005% 99.973% ( 380, 580 ] 6 0.015% 99.988% ( 580, 870 ] 3 0.007% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 432436 Average: 5.2790 StdDev: 70.08 Min: 0 Median: 1.7536 Max: 10198 Percentiles: P50: 1.75 P75: 2.65 P99: 9.62 P99.9: 307.82 P99.99: 469.29 ------------------------------------------------------ [ 0, 1 ] 33073 7.648% 7.648% ## ( 1, 2 ] 243040 56.203% 63.851% ########### ( 2, 3 ] 73833 17.074% 80.924% ### ( 3, 4 ] 37447 8.660% 89.584% ## ( 4, 6 ] 33860 7.830% 97.414% ## ( 6, 10 ] 7589 1.755% 99.169% ( 10, 15 ] 1393 0.322% 99.491% ( 15, 22 ] 236 0.055% 99.546% ( 22, 34 ] 58 0.013% 99.559% ( 34, 51 ] 6 0.001% 99.560% ( 51, 76 ] 6 0.001% 99.562% ( 76, 110 ] 288 0.067% 99.628% ( 110, 170 ] 551 0.127% 99.756% ( 170, 250 ] 447 0.103% 99.859% ( 250, 380 ] 397 0.092% 99.951% ( 380, 580 ] 378 0.087% 100.038% ( 580, 870 ] 218 0.050% 100.089% ( 870, 1300 ] 83 0.019% 100.108% ( 1300, 1900 ] 33 0.008% 100.116% ( 1900, 2900 ] 24 0.006% 100.121% ( 2900, 4400 ] 39 0.009% 100.130% ( 4400, 6600 ] 17 0.004% 100.134% ( 6600, 9900 ] 4 0.001% 100.135% ( 9900, 14000 ] 3 0.001% 100.136% ** Level 4 read latency histogram (micros): Count: 125 Average: 670.4160 StdDev: 1329.58 Min: 1 Median: 3.6250 Max: 7084 Percentiles: P50: 3.62 P75: 607.19 P99: 6462.50 P99.9: 7084.00 P99.99: 7084.00 ------------------------------------------------------ [ 0, 1 ] 21 16.800% 16.800% ### ( 1, 2 ] 29 23.200% 40.000% ##### ( 2, 3 ] 10 8.000% 48.000% ## ( 3, 4 ] 4 3.200% 51.200% # ( 6, 10 ] 3 2.400% 53.600% ( 10, 15 ] 3 2.400% 56.000% ( 110, 170 ] 2 1.600% 57.600% ( 170, 250 ] 9 7.200% 64.800% # ( 250, 380 ] 5 4.000% 68.800% # ( 380, 580 ] 7 5.600% 74.400% # ( 580, 870 ] 8 6.400% 80.800% # ( 870, 1300 ] 5 4.000% 84.800% # ( 1300, 1900 ] 2 1.600% 86.400% ( 1900, 2900 ] 5 4.000% 90.400% # ( 2900, 4400 ] 7 5.600% 96.000% # ( 4400, 6600 ] 4 3.200% 99.200% # ( 6600, 9900 ] 1 0.800% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 1118.5400 StdDev: 1150.91 Min: 107 Median: 652.5000 Max: 4874 Percentiles: P50: 652.50 P75: 1600.00 P99: 4874.00 P99.9: 4874.00 P99.99: 4874.00 ------------------------------------------------------ ( 76, 110 ] 2 2.000% 2.000% ( 110, 170 ] 10 10.000% 12.000% ## ( 170, 250 ] 15 15.000% 27.000% ### ( 250, 380 ] 10 10.000% 37.000% ## ( 380, 580 ] 10 10.000% 47.000% ## ( 580, 870 ] 12 12.000% 59.000% ## ( 870, 1300 ] 13 13.000% 72.000% ### ( 1300, 1900 ] 6 6.000% 78.000% # ( 1900, 2900 ] 11 11.000% 89.000% ## ( 2900, 4400 ] 9 9.000% 98.000% ## ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 35.8 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 220.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.593 H:M:S, 38.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.395 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/17-06:28:27 ... thread 0: (1000000,9000000) ops and (58362.4,170843.9) ops/second in (17.134322,52.679668) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 2.82 GB 18.9 9.6 0.0 9.6 18.1 8.5 0.0 2.1 148.0 279.4 66.41 59.60 151 0.440 9975K 24K 0.0 0.0 L1 4/4 456.04 MB 0.0 9.1 5.6 3.5 9.0 5.5 0.1 1.6 221.1 218.6 42.22 39.58 5 8.443 8575K 59K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.1 1.8 230.7 230.6 0.48 0.46 1 0.482 112K 33 0.0 0.0 L3 16/1 1.07 GB 1.0 4.3 2.4 1.9 4.3 2.3 2.8 1.8 159.9 159.1 27.41 19.64 21 1.305 3885K 17K 0.0 0.0 L4 170/7 10.01 GB 1.0 4.0 3.3 0.8 4.0 3.3 1.5 1.2 121.1 120.7 34.16 20.51 38 0.899 4201K 14K 0.0 0.0 L5 1096/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/20 104.52 GB 0.0 27.1 11.3 15.8 35.5 19.7 13.8 4.2 162.8 213.2 170.68 139.78 216 0.790 26M 116K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.1 11.3 15.8 35.5 19.7 13.8 4.2 162.8 213.2 170.68 139.78 216 0.790 26M 116K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.1 11.3 15.8 27.0 11.2 0.0 0.0 194.0 192.9 143.23 117.24 92 1.557 26M 116K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 319.0 27.45 22.54 124 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.9 total, 52.7 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.53 GB write, 687.85 MB/s write, 27.14 GB read, 525.45 MB/s read, 170.7 seconds Interval compaction: 35.53 GB write, 690.58 MB/s write, 27.14 GB read, 527.53 MB/s read, 170.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 50, total-stops: 58, interval: 108 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4211814 Average: 3.0215 StdDev: 38.31 Min: 0 Median: 1.5014 Max: 15461 Percentiles: P50: 1.50 P75: 1.89 P99: 7.84 P99.9: 153.41 P99.99: 406.73 ------------------------------------------------------ [ 0, 1 ] 742819 17.637% 17.637% #### ( 1, 2 ] 2718458 64.544% 82.180% ############# ( 2, 3 ] 391583 9.297% 91.477% ## ( 3, 4 ] 169624 4.027% 95.505% # ( 4, 6 ] 128475 3.050% 98.555% # ( 6, 10 ] 40729 0.967% 99.522% ( 10, 15 ] 6405 0.152% 99.674% ( 15, 22 ] 766 0.018% 99.692% ( 22, 34 ] 65 0.002% 99.694% ( 34, 51 ] 23 0.001% 99.695% ( 51, 76 ] 54 0.001% 99.696% ( 76, 110 ] 4763 0.113% 99.809% ( 110, 170 ] 5306 0.126% 99.935% ( 170, 250 ] 1274 0.030% 99.965% ( 250, 380 ] 952 0.023% 99.988% ( 380, 580 ] 732 0.017% 100.005% ( 580, 870 ] 406 0.010% 100.015% ( 870, 1300 ] 169 0.004% 100.019% ( 1300, 1900 ] 84 0.002% 100.021% ( 1900, 2900 ] 77 0.002% 100.023% ( 2900, 4400 ] 95 0.002% 100.025% ( 4400, 6600 ] 27 0.001% 100.025% ( 6600, 9900 ] 21 0.000% 100.026% ( 9900, 14000 ] 5 0.000% 100.026% ( 14000, 22000 ] 4 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 2069394 Average: 5.5616 StdDev: 104.61 Min: 0 Median: 1.6817 Max: 21028 Percentiles: P50: 1.68 P75: 2.46 P99: 9.35 P99.9: 160.18 P99.99: 540.80 ------------------------------------------------------ [ 0, 1 ] 221046 10.682% 10.682% ## ( 1, 2 ] 1193506 57.674% 68.356% ############ ( 2, 3 ] 300141 14.504% 82.860% ### ( 3, 4 ] 152083 7.349% 90.209% # ( 4, 6 ] 146935 7.100% 97.309% # ( 6, 10 ] 41831 2.021% 99.331% ( 10, 15 ] 8057 0.389% 99.720% ( 15, 22 ] 1040 0.050% 99.770% ( 22, 34 ] 66 0.003% 99.773% ( 34, 51 ] 25 0.001% 99.775% ( 51, 76 ] 69 0.003% 99.778% ( 76, 110 ] 1292 0.062% 99.840% ( 110, 170 ] 1475 0.071% 99.912% ( 170, 250 ] 492 0.024% 99.935% ( 250, 380 ] 592 0.029% 99.964% ( 380, 580 ] 668 0.032% 99.996% ( 580, 870 ] 703 0.034% 100.030% ( 870, 1300 ] 567 0.027% 100.058% ( 1300, 1900 ] 281 0.014% 100.071% ( 1900, 2900 ] 369 0.018% 100.089% ( 2900, 4400 ] 382 0.018% 100.108% ( 4400, 6600 ] 95 0.005% 100.112% ( 6600, 9900 ] 65 0.003% 100.115% ( 9900, 14000 ] 15 0.001% 100.116% ( 14000, 22000 ] 23 0.001% 100.117% ** Level 2 read latency histogram (micros): Count: 40501 Average: 2.4362 StdDev: 31.09 Min: 1 Median: 1.3696 Max: 5131 Percentiles: P50: 1.37 P75: 1.80 P99: 6.77 P99.9: 54.90 P99.99: 671.82 ------------------------------------------------------ [ 0, 1 ] 11464 28.305% 28.305% ###### ( 1, 2 ] 23771 58.692% 86.998% ############ ( 2, 3 ] 2915 7.197% 94.195% # ( 3, 4 ] 1202 2.968% 97.163% # ( 4, 6 ] 684 1.689% 98.852% ( 6, 10 ] 313 0.773% 99.625% ( 10, 15 ] 59 0.146% 99.770% ( 15, 22 ] 7 0.017% 99.788% ( 22, 34 ] 5 0.012% 99.800% ( 34, 51 ] 38 0.094% 99.894% ( 51, 76 ] 16 0.040% 99.933% ( 76, 110 ] 2 0.005% 99.938% ( 110, 170 ] 2 0.005% 99.943% ( 170, 250 ] 10 0.025% 99.968% ( 250, 380 ] 2 0.005% 99.973% ( 380, 580 ] 6 0.015% 99.988% ( 580, 870 ] 3 0.007% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 890717 Average: 8.9277 StdDev: 141.58 Min: 0 Median: 1.8538 Max: 36420 Percentiles: P50: 1.85 P75: 2.91 P99: 9.96 P99.9: 673.75 P99.99: 1038.83 ------------------------------------------------------ [ 0, 1 ] 44742 5.023% 5.023% # ( 1, 2 ] 469196 52.676% 57.699% ########### ( 2, 3 ] 169283 19.005% 76.705% #### ( 3, 4 ] 91971 10.326% 87.030% ## ( 4, 6 ] 89214 10.016% 97.046% ## ( 6, 10 ] 17575 1.973% 99.019% ( 10, 15 ] 3666 0.412% 99.431% ( 15, 22 ] 501 0.056% 99.487% ( 22, 34 ] 86 0.010% 99.497% ( 34, 51 ] 15 0.002% 99.498% ( 51, 76 ] 21 0.002% 99.501% ( 76, 110 ] 314 0.035% 99.536% ( 110, 170 ] 657 0.074% 99.610% ( 170, 250 ] 652 0.073% 99.683% ( 250, 380 ] 753 0.085% 99.767% ( 380, 580 ] 911 0.102% 99.870% ( 580, 870 ] 833 0.094% 99.963% ( 870, 1300 ] 606 0.068% 100.031% ( 1300, 1900 ] 328 0.037% 100.068% ( 1900, 2900 ] 276 0.031% 100.099% ( 2900, 4400 ] 344 0.039% 100.138% ( 4400, 6600 ] 75 0.008% 100.146% ( 6600, 9900 ] 28 0.003% 100.149% ( 9900, 14000 ] 4 0.000% 100.150% ( 14000, 22000 ] 12 0.001% 100.151% ( 22000, 33000 ] 1 0.000% 100.151% ( 33000, 50000 ] 1 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 110591 Average: 9.3239 StdDev: 137.88 Min: 1 Median: 1.8937 Max: 9574 Percentiles: P50: 1.89 P75: 2.96 P99: 10.08 P99.9: 1620.11 P99.99: 3866.90 ------------------------------------------------------ [ 0, 1 ] 2979 2.694% 2.694% # ( 1, 2 ] 58538 52.932% 55.626% ########### ( 2, 3 ] 22264 20.132% 75.758% #### ( 3, 4 ] 11610 10.498% 86.256% ## ( 4, 6 ] 11715 10.593% 96.849% ## ( 6, 10 ] 2372 2.145% 98.994% ( 10, 15 ] 504 0.456% 99.449% ( 15, 22 ] 44 0.040% 99.489% ( 22, 34 ] 11 0.010% 99.499% ( 34, 51 ] 3 0.003% 99.502% ( 51, 76 ] 4 0.004% 99.505% ( 76, 110 ] 12 0.011% 99.516% ( 110, 170 ] 33 0.030% 99.546% ( 170, 250 ] 85 0.077% 99.623% ( 250, 380 ] 51 0.046% 99.669% ( 380, 580 ] 85 0.077% 99.746% ( 580, 870 ] 85 0.077% 99.823% ( 870, 1300 ] 64 0.058% 99.881% ( 1300, 1900 ] 42 0.038% 99.919% ( 1900, 2900 ] 49 0.044% 99.963% ( 2900, 4400 ] 48 0.043% 100.006% ( 4400, 6600 ] 17 0.015% 100.022% ( 6600, 9900 ] 9 0.008% 100.030% ** Level 5 read latency histogram (micros): Count: 268 Average: 1635.6007 StdDev: 1564.86 Min: 107 Median: 992.8571 Max: 6814 Percentiles: P50: 992.86 P75: 2594.44 P99: 6382.59 P99.9: 6814.00 P99.99: 6814.00 ------------------------------------------------------ ( 76, 110 ] 2 0.746% 0.746% ( 110, 170 ] 15 5.597% 6.343% # ( 170, 250 ] 21 7.836% 14.179% ## ( 250, 380 ] 21 7.836% 22.015% ## ( 380, 580 ] 30 11.194% 33.209% ## ( 580, 870 ] 37 13.806% 47.015% ### ( 870, 1300 ] 28 10.448% 57.463% ## ( 1300, 1900 ] 22 8.209% 65.672% ## ( 1900, 2900 ] 36 13.433% 79.104% ### ( 2900, 4400 ] 38 14.179% 93.284% ### ( 4400, 6600 ] 17 6.343% 99.627% # ( 6600, 9900 ] 1 0.373% 100.000% ** DB Stats ** Uptime(secs): 52.9 total, 17.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 167.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.392 H:M:S, 51.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 57.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.798 H:M:S, 80.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/17-06:28:30 ... thread 0: (1000000,10000000) ops and (322049.5,179260.4) ops/second in (3.105113,55.784781) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 3.74 GB 113.3 10.5 0.0 10.5 19.9 9.4 0.0 2.1 147.1 280.1 72.78 65.49 167 0.436 10M 25K 0.0 0.0 L1 4/4 456.04 MB 0.0 9.1 5.6 3.5 9.0 5.5 0.1 1.6 221.1 218.6 42.22 39.58 5 8.443 8575K 59K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.1 1.8 230.7 230.6 0.48 0.46 1 0.482 112K 33 0.0 0.0 L3 15/0 968.41 MB 1.0 4.3 2.4 1.9 4.3 2.3 2.8 1.8 159.9 159.1 27.41 19.64 21 1.305 3885K 17K 0.0 0.0 L4 163/0 9.52 GB 1.0 4.2 3.4 0.9 4.2 3.4 1.5 1.2 122.2 121.8 35.61 21.52 39 0.913 4420K 14K 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1300/12 105.45 GB 0.0 28.2 11.5 16.8 37.5 20.8 14.5 4.0 161.8 215.3 178.49 146.68 233 0.766 27M 117K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.2 11.5 16.8 37.5 20.8 14.5 4.0 161.8 215.3 178.49 146.68 233 0.766 27M 117K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.2 11.5 16.8 28.0 11.3 0.0 0.0 194.8 193.7 148.29 121.68 96 1.545 27M 117K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 321.2 30.21 25.01 137 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.0 total, 55.8 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.52 GB write, 686.15 MB/s write, 28.21 GB read, 515.90 MB/s read, 178.5 seconds Interval compaction: 37.52 GB write, 688.71 MB/s write, 28.21 GB read, 517.83 MB/s read, 178.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 50, total-stops: 62, interval: 112 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4596902 Average: 2.9619 StdDev: 36.82 Min: 0 Median: 1.5029 Max: 15461 Percentiles: P50: 1.50 P75: 1.89 P99: 7.74 P99.9: 148.80 P99.99: 376.98 ------------------------------------------------------ [ 0, 1 ] 798840 17.378% 17.378% ### ( 1, 2 ] 2981826 64.866% 82.244% ############# ( 2, 3 ] 430528 9.366% 91.609% ## ( 3, 4 ] 183554 3.993% 95.602% # ( 4, 6 ] 136777 2.975% 98.578% # ( 6, 10 ] 44676 0.972% 99.550% ( 10, 15 ] 6880 0.150% 99.699% ( 15, 22 ] 810 0.018% 99.717% ( 22, 34 ] 71 0.002% 99.719% ( 34, 51 ] 27 0.001% 99.719% ( 51, 76 ] 57 0.001% 99.720% ( 76, 110 ] 4803 0.104% 99.825% ( 110, 170 ] 5346 0.116% 99.941% ( 170, 250 ] 1295 0.028% 99.969% ( 250, 380 ] 976 0.021% 99.991% ( 380, 580 ] 745 0.016% 100.007% ( 580, 870 ] 421 0.009% 100.016% ( 870, 1300 ] 176 0.004% 100.020% ( 1300, 1900 ] 85 0.002% 100.022% ( 1900, 2900 ] 77 0.002% 100.023% ( 2900, 4400 ] 97 0.002% 100.025% ( 4400, 6600 ] 27 0.001% 100.026% ( 6600, 9900 ] 21 0.000% 100.026% ( 9900, 14000 ] 5 0.000% 100.026% ( 14000, 22000 ] 4 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 2069394 Average: 5.5616 StdDev: 104.61 Min: 0 Median: 1.6817 Max: 21028 Percentiles: P50: 1.68 P75: 2.46 P99: 9.35 P99.9: 160.18 P99.99: 540.80 ------------------------------------------------------ [ 0, 1 ] 221046 10.682% 10.682% ## ( 1, 2 ] 1193506 57.674% 68.356% ############ ( 2, 3 ] 300141 14.504% 82.860% ### ( 3, 4 ] 152083 7.349% 90.209% # ( 4, 6 ] 146935 7.100% 97.309% # ( 6, 10 ] 41831 2.021% 99.331% ( 10, 15 ] 8057 0.389% 99.720% ( 15, 22 ] 1040 0.050% 99.770% ( 22, 34 ] 66 0.003% 99.773% ( 34, 51 ] 25 0.001% 99.775% ( 51, 76 ] 69 0.003% 99.778% ( 76, 110 ] 1292 0.062% 99.840% ( 110, 170 ] 1475 0.071% 99.912% ( 170, 250 ] 492 0.024% 99.935% ( 250, 380 ] 592 0.029% 99.964% ( 380, 580 ] 668 0.032% 99.996% ( 580, 870 ] 703 0.034% 100.030% ( 870, 1300 ] 567 0.027% 100.058% ( 1300, 1900 ] 281 0.014% 100.071% ( 1900, 2900 ] 369 0.018% 100.089% ( 2900, 4400 ] 382 0.018% 100.108% ( 4400, 6600 ] 95 0.005% 100.112% ( 6600, 9900 ] 65 0.003% 100.115% ( 9900, 14000 ] 15 0.001% 100.116% ( 14000, 22000 ] 23 0.001% 100.117% ** Level 2 read latency histogram (micros): Count: 40501 Average: 2.4362 StdDev: 31.09 Min: 1 Median: 1.3696 Max: 5131 Percentiles: P50: 1.37 P75: 1.80 P99: 6.77 P99.9: 54.90 P99.99: 671.82 ------------------------------------------------------ [ 0, 1 ] 11464 28.305% 28.305% ###### ( 1, 2 ] 23771 58.692% 86.998% ############ ( 2, 3 ] 2915 7.197% 94.195% # ( 3, 4 ] 1202 2.968% 97.163% # ( 4, 6 ] 684 1.689% 98.852% ( 6, 10 ] 313 0.773% 99.625% ( 10, 15 ] 59 0.146% 99.770% ( 15, 22 ] 7 0.017% 99.788% ( 22, 34 ] 5 0.012% 99.800% ( 34, 51 ] 38 0.094% 99.894% ( 51, 76 ] 16 0.040% 99.933% ( 76, 110 ] 2 0.005% 99.938% ( 110, 170 ] 2 0.005% 99.943% ( 170, 250 ] 10 0.025% 99.968% ( 250, 380 ] 2 0.005% 99.973% ( 380, 580 ] 6 0.015% 99.988% ( 580, 870 ] 3 0.007% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 890717 Average: 8.9277 StdDev: 141.58 Min: 0 Median: 1.8538 Max: 36420 Percentiles: P50: 1.85 P75: 2.91 P99: 9.96 P99.9: 673.75 P99.99: 1038.83 ------------------------------------------------------ [ 0, 1 ] 44742 5.023% 5.023% # ( 1, 2 ] 469196 52.676% 57.699% ########### ( 2, 3 ] 169283 19.005% 76.705% #### ( 3, 4 ] 91971 10.326% 87.030% ## ( 4, 6 ] 89214 10.016% 97.046% ## ( 6, 10 ] 17575 1.973% 99.019% ( 10, 15 ] 3666 0.412% 99.431% ( 15, 22 ] 501 0.056% 99.487% ( 22, 34 ] 86 0.010% 99.497% ( 34, 51 ] 15 0.002% 99.498% ( 51, 76 ] 21 0.002% 99.501% ( 76, 110 ] 314 0.035% 99.536% ( 110, 170 ] 657 0.074% 99.610% ( 170, 250 ] 652 0.073% 99.683% ( 250, 380 ] 753 0.085% 99.767% ( 380, 580 ] 911 0.102% 99.870% ( 580, 870 ] 833 0.094% 99.963% ( 870, 1300 ] 606 0.068% 100.031% ( 1300, 1900 ] 328 0.037% 100.068% ( 1900, 2900 ] 276 0.031% 100.099% ( 2900, 4400 ] 344 0.039% 100.138% ( 4400, 6600 ] 75 0.008% 100.146% ( 6600, 9900 ] 28 0.003% 100.149% ( 9900, 14000 ] 4 0.000% 100.150% ( 14000, 22000 ] 12 0.001% 100.151% ( 22000, 33000 ] 1 0.000% 100.151% ( 33000, 50000 ] 1 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 124510 Average: 8.5874 StdDev: 130.01 Min: 1 Median: 1.8613 Max: 9574 Percentiles: P50: 1.86 P75: 2.89 P99: 9.86 P99.9: 1421.29 P99.99: 3823.41 ------------------------------------------------------ [ 0, 1 ] 3653 2.934% 2.934% # ( 1, 2 ] 68040 54.646% 57.580% ########### ( 2, 3 ] 24290 19.508% 77.089% #### ( 3, 4 ] 12391 9.952% 87.040% ## ( 4, 6 ] 12346 9.916% 96.956% ## ( 6, 10 ] 2639 2.120% 99.076% ( 10, 15 ] 531 0.426% 99.502% ( 15, 22 ] 44 0.035% 99.537% ( 22, 34 ] 11 0.009% 99.546% ( 34, 51 ] 3 0.002% 99.549% ( 51, 76 ] 4 0.003% 99.552% ( 76, 110 ] 12 0.010% 99.561% ( 110, 170 ] 34 0.027% 99.589% ( 170, 250 ] 88 0.071% 99.659% ( 250, 380 ] 54 0.043% 99.703% ( 380, 580 ] 86 0.069% 99.772% ( 580, 870 ] 87 0.070% 99.842% ( 870, 1300 ] 64 0.051% 99.893% ( 1300, 1900 ] 42 0.034% 99.927% ( 1900, 2900 ] 49 0.039% 99.966% ( 2900, 4400 ] 48 0.039% 100.005% ( 4400, 6600 ] 17 0.014% 100.018% ( 6600, 9900 ] 9 0.007% 100.026% ** Level 5 read latency histogram (micros): Count: 300 Average: 1566.5267 StdDev: 1533.07 Min: 89 Median: 914.4828 Max: 6814 Percentiles: P50: 914.48 P75: 2519.05 P99: 6341.18 P99.9: 6814.00 P99.99: 6814.00 ------------------------------------------------------ ( 76, 110 ] 4 1.333% 1.333% ( 110, 170 ] 24 8.000% 9.333% ## ( 170, 250 ] 22 7.333% 16.667% # ( 250, 380 ] 25 8.333% 25.000% ## ( 380, 580 ] 34 11.333% 36.333% ## ( 580, 870 ] 38 12.667% 49.000% ### ( 870, 1300 ] 29 9.667% 58.667% ## ( 1300, 1900 ] 23 7.667% 66.333% ## ( 1900, 2900 ] 42 14.000% 80.333% ### ( 2900, 4400 ] 41 13.667% 94.000% ### ( 4400, 6600 ] 17 5.667% 99.667% # ( 6600, 9900 ] 1 0.333% 100.000% ** DB Stats ** Uptime(secs): 56.0 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 175.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.840 H:M:S, 49.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.449 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-06:28:33 ... thread 0: (1000000,11000000) ops and (325956.5,186907.4) ops/second in (3.067894,58.852675) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 4.66 GB 207.7 11.3 0.0 11.3 21.6 10.4 0.0 2.1 146.4 281.3 78.72 71.06 183 0.430 11M 26K 0.0 0.0 L1 4/4 456.04 MB 0.0 9.1 5.6 3.5 9.0 5.5 0.1 1.6 221.1 218.6 42.22 39.58 5 8.443 8575K 59K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.1 1.8 230.7 230.6 0.48 0.46 1 0.482 112K 33 0.0 0.0 L3 15/0 968.41 MB 1.0 4.3 2.4 1.9 4.3 2.3 2.8 1.8 159.9 159.1 27.41 19.64 21 1.305 3885K 17K 0.0 0.0 L4 163/0 9.52 GB 1.0 4.2 3.4 0.9 4.2 3.4 1.5 1.2 122.2 121.8 35.61 21.52 39 0.913 4420K 14K 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/12 106.37 GB 0.0 29.0 11.5 17.6 39.2 21.7 14.5 3.8 161.1 217.9 184.43 152.25 249 0.741 28M 118K 0.0 0.0 Int 0/0 0.00 KB 0.0 29.0 11.5 17.6 39.2 21.7 14.5 3.8 161.1 217.9 184.43 152.25 249 0.741 28M 118K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 29.0 11.5 17.6 28.8 11.3 0.0 0.0 196.1 195.0 151.46 124.78 99 1.530 28M 118K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.4 10.4 0.0 0.0 0.0 322.9 32.97 27.47 150 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.1 total, 58.9 interval Flush(GB): cumulative 10.397, interval 10.397 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 39.24 GB write, 680.35 MB/s write, 29.01 GB read, 502.97 MB/s read, 184.4 seconds Interval compaction: 39.24 GB write, 682.77 MB/s write, 29.01 GB read, 504.75 MB/s read, 184.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 65, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 50, total-stops: 65, interval: 115 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4988324 Average: 2.9049 StdDev: 35.50 Min: 0 Median: 1.5039 Max: 15461 Percentiles: P50: 1.50 P75: 1.89 P99: 7.62 P99.9: 142.92 P99.99: 352.25 ------------------------------------------------------ [ 0, 1 ] 857341 17.187% 17.187% ### ( 1, 2 ] 3248070 65.113% 82.300% ############# ( 2, 3 ] 470148 9.425% 91.725% ## ( 3, 4 ] 197996 3.969% 95.695% # ( 4, 6 ] 145307 2.913% 98.608% # ( 6, 10 ] 48341 0.969% 99.577% ( 10, 15 ] 7374 0.148% 99.724% ( 15, 22 ] 859 0.017% 99.742% ( 22, 34 ] 74 0.001% 99.743% ( 34, 51 ] 27 0.001% 99.744% ( 51, 76 ] 61 0.001% 99.745% ( 76, 110 ] 4803 0.096% 99.841% ( 110, 170 ] 5351 0.107% 99.948% ( 170, 250 ] 1301 0.026% 99.975% ( 250, 380 ] 983 0.020% 99.994% ( 380, 580 ] 747 0.015% 100.009% ( 580, 870 ] 426 0.009% 100.018% ( 870, 1300 ] 179 0.004% 100.021% ( 1300, 1900 ] 86 0.002% 100.023% ( 1900, 2900 ] 78 0.002% 100.025% ( 2900, 4400 ] 100 0.002% 100.027% ( 4400, 6600 ] 27 0.001% 100.027% ( 6600, 9900 ] 21 0.000% 100.028% ( 9900, 14000 ] 5 0.000% 100.028% ( 14000, 22000 ] 4 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 2069394 Average: 5.5616 StdDev: 104.61 Min: 0 Median: 1.6817 Max: 21028 Percentiles: P50: 1.68 P75: 2.46 P99: 9.35 P99.9: 160.18 P99.99: 540.80 ------------------------------------------------------ [ 0, 1 ] 221046 10.682% 10.682% ## ( 1, 2 ] 1193506 57.674% 68.356% ############ ( 2, 3 ] 300141 14.504% 82.860% ### ( 3, 4 ] 152083 7.349% 90.209% # ( 4, 6 ] 146935 7.100% 97.309% # ( 6, 10 ] 41831 2.021% 99.331% ( 10, 15 ] 8057 0.389% 99.720% ( 15, 22 ] 1040 0.050% 99.770% ( 22, 34 ] 66 0.003% 99.773% ( 34, 51 ] 25 0.001% 99.775% ( 51, 76 ] 69 0.003% 99.778% ( 76, 110 ] 1292 0.062% 99.840% ( 110, 170 ] 1475 0.071% 99.912% ( 170, 250 ] 492 0.024% 99.935% ( 250, 380 ] 592 0.029% 99.964% ( 380, 580 ] 668 0.032% 99.996% ( 580, 870 ] 703 0.034% 100.030% ( 870, 1300 ] 567 0.027% 100.058% ( 1300, 1900 ] 281 0.014% 100.071% ( 1900, 2900 ] 369 0.018% 100.089% ( 2900, 4400 ] 382 0.018% 100.108% ( 4400, 6600 ] 95 0.005% 100.112% ( 6600, 9900 ] 65 0.003% 100.115% ( 9900, 14000 ] 15 0.001% 100.116% ( 14000, 22000 ] 23 0.001% 100.117% ** Level 2 read latency histogram (micros): Count: 40501 Average: 2.4362 StdDev: 31.09 Min: 1 Median: 1.3696 Max: 5131 Percentiles: P50: 1.37 P75: 1.80 P99: 6.77 P99.9: 54.90 P99.99: 671.82 ------------------------------------------------------ [ 0, 1 ] 11464 28.305% 28.305% ###### ( 1, 2 ] 23771 58.692% 86.998% ############ ( 2, 3 ] 2915 7.197% 94.195% # ( 3, 4 ] 1202 2.968% 97.163% # ( 4, 6 ] 684 1.689% 98.852% ( 6, 10 ] 313 0.773% 99.625% ( 10, 15 ] 59 0.146% 99.770% ( 15, 22 ] 7 0.017% 99.788% ( 22, 34 ] 5 0.012% 99.800% ( 34, 51 ] 38 0.094% 99.894% ( 51, 76 ] 16 0.040% 99.933% ( 76, 110 ] 2 0.005% 99.938% ( 110, 170 ] 2 0.005% 99.943% ( 170, 250 ] 10 0.025% 99.968% ( 250, 380 ] 2 0.005% 99.973% ( 380, 580 ] 6 0.015% 99.988% ( 580, 870 ] 3 0.007% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 890717 Average: 8.9277 StdDev: 141.58 Min: 0 Median: 1.8538 Max: 36420 Percentiles: P50: 1.85 P75: 2.91 P99: 9.96 P99.9: 673.75 P99.99: 1038.83 ------------------------------------------------------ [ 0, 1 ] 44742 5.023% 5.023% # ( 1, 2 ] 469196 52.676% 57.699% ########### ( 2, 3 ] 169283 19.005% 76.705% #### ( 3, 4 ] 91971 10.326% 87.030% ## ( 4, 6 ] 89214 10.016% 97.046% ## ( 6, 10 ] 17575 1.973% 99.019% ( 10, 15 ] 3666 0.412% 99.431% ( 15, 22 ] 501 0.056% 99.487% ( 22, 34 ] 86 0.010% 99.497% ( 34, 51 ] 15 0.002% 99.498% ( 51, 76 ] 21 0.002% 99.501% ( 76, 110 ] 314 0.035% 99.536% ( 110, 170 ] 657 0.074% 99.610% ( 170, 250 ] 652 0.073% 99.683% ( 250, 380 ] 753 0.085% 99.767% ( 380, 580 ] 911 0.102% 99.870% ( 580, 870 ] 833 0.094% 99.963% ( 870, 1300 ] 606 0.068% 100.031% ( 1300, 1900 ] 328 0.037% 100.068% ( 1900, 2900 ] 276 0.031% 100.099% ( 2900, 4400 ] 344 0.039% 100.138% ( 4400, 6600 ] 75 0.008% 100.146% ( 6600, 9900 ] 28 0.003% 100.149% ( 9900, 14000 ] 4 0.000% 100.150% ( 14000, 22000 ] 12 0.001% 100.151% ( 22000, 33000 ] 1 0.000% 100.151% ( 33000, 50000 ] 1 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 124510 Average: 8.5874 StdDev: 130.01 Min: 1 Median: 1.8613 Max: 9574 Percentiles: P50: 1.86 P75: 2.89 P99: 9.86 P99.9: 1421.29 P99.99: 3823.41 ------------------------------------------------------ [ 0, 1 ] 3653 2.934% 2.934% # ( 1, 2 ] 68040 54.646% 57.580% ########### ( 2, 3 ] 24290 19.508% 77.089% #### ( 3, 4 ] 12391 9.952% 87.040% ## ( 4, 6 ] 12346 9.916% 96.956% ## ( 6, 10 ] 2639 2.120% 99.076% ( 10, 15 ] 531 0.426% 99.502% ( 15, 22 ] 44 0.035% 99.537% ( 22, 34 ] 11 0.009% 99.546% ( 34, 51 ] 3 0.002% 99.549% ( 51, 76 ] 4 0.003% 99.552% ( 76, 110 ] 12 0.010% 99.561% ( 110, 170 ] 34 0.027% 99.589% ( 170, 250 ] 88 0.071% 99.659% ( 250, 380 ] 54 0.043% 99.703% ( 380, 580 ] 86 0.069% 99.772% ( 580, 870 ] 87 0.070% 99.842% ( 870, 1300 ] 64 0.051% 99.893% ( 1300, 1900 ] 42 0.034% 99.927% ( 1900, 2900 ] 49 0.039% 99.966% ( 2900, 4400 ] 48 0.039% 100.005% ( 4400, 6600 ] 17 0.014% 100.018% ( 6600, 9900 ] 9 0.007% 100.026% ** Level 5 read latency histogram (micros): Count: 300 Average: 1566.5267 StdDev: 1533.07 Min: 89 Median: 914.4828 Max: 6814 Percentiles: P50: 914.48 P75: 2519.05 P99: 6341.18 P99.9: 6814.00 P99.99: 6814.00 ------------------------------------------------------ ( 76, 110 ] 4 1.333% 1.333% ( 110, 170 ] 24 8.000% 9.333% ## ( 170, 250 ] 22 7.333% 16.667% # ( 250, 380 ] 25 8.333% 25.000% ## ( 380, 580 ] 34 11.333% 36.333% ## ( 580, 870 ] 38 12.667% 49.000% ### ( 870, 1300 ] 29 9.667% 58.667% ## ( 1300, 1900 ] 23 7.667% 66.333% ## ( 1900, 2900 ] 42 14.000% 80.333% ### ( 2900, 4400 ] 41 13.667% 94.000% ### ( 4400, 6600 ] 17 5.667% 99.667% # ( 6600, 9900 ] 1 0.333% 100.000% ** DB Stats ** Uptime(secs): 59.1 total, 3.1 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 183.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.267 H:M:S, 47.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.427 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.322 micros/op 187908 ops/sec 60.003 seconds 11274999 operations; 182.1 MB/s Microseconds per write: Count: 11274999 Average: 5.3217 StdDev: 406.78 Min: 1 Median: 1.7582 Max: 646856 Percentiles: P50: 1.76 P75: 2.77 P99: 9.27 P99.9: 1071.20 P99.99: 2554.59 ------------------------------------------------------ [ 0, 1 ] 1333735 11.829% 11.829% ## ( 1, 2 ] 5675988 50.341% 62.170% ########## ( 2, 3 ] 1869699 16.583% 78.753% ### ( 3, 4 ] 1561353 13.848% 92.601% ### ( 4, 6 ] 610376 5.414% 98.015% # ( 6, 10 ] 135779 1.204% 99.219% ( 10, 15 ] 45828 0.406% 99.625% ( 15, 22 ] 10144 0.090% 99.715% ( 22, 34 ] 1865 0.017% 99.732% ( 34, 51 ] 244 0.002% 99.734% ( 51, 76 ] 26 0.000% 99.734% ( 76, 110 ] 7969 0.071% 99.805% ( 110, 170 ] 2944 0.026% 99.831% ( 170, 250 ] 318 0.003% 99.834% ( 250, 380 ] 197 0.002% 99.836% ( 380, 580 ] 22 0.000% 99.836% ( 580, 870 ] 19 0.000% 99.836% ( 870, 1300 ] 15426 0.137% 99.973% ( 1300, 1900 ] 51 0.000% 99.973% ( 1900, 2900 ] 2885 0.026% 99.999% ( 2900, 4400 ] 75 0.001% 100.000% ( 4400, 6600 ] 18 0.000% 100.000% ( 6600, 9900 ] 9 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 189393 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11274999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11635798968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 587 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 28685933 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 34185939047 rocksdb.compact.write.bytes COUNT : 33999881526 rocksdb.flush.write.bytes COUNT : 11494036679 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 71 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 253 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11401351168 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4417536 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 34294802071 rocksdb.non.last.level.read.count COUNT : 8284301 rocksdb.block.checksum.compute.count COUNT : 8283199 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.403541 P95 : 3.905503 P99 : 7.716475 P100 : 646854.000000 COUNT : 11274999 SUM : 54525621 rocksdb.compaction.times.micros P50 : 1067777.777778 P95 : 4300000.000000 P99 : 17890826.000000 P100 : 17890826.000000 COUNT : 100 SUM : 152646418 rocksdb.compaction.times.cpu_micros P50 : 877894.736842 P95 : 2900000.000000 P99 : 16501605.000000 P100 : 16501605.000000 COUNT : 100 SUM : 125943930 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 690.000000 P95 : 1281.187500 P99 : 27060.000000 P100 : 33522.000000 COUNT : 154 SUM : 204538 rocksdb.compaction.outfile.sync.micros P50 : 1131.265823 P95 : 125000.000000 P99 : 219600.000000 P100 : 238413.000000 COUNT : 380 SUM : 6926629 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 111.764706 P95 : 2325.000000 P99 : 4196.428571 P100 : 6283.000000 COUNT : 295 SUM : 123967 rocksdb.table.open.io.micros P50 : 1467.045455 P95 : 10170.600000 P99 : 14173.333333 P100 : 20409.000000 COUNT : 587 SUM : 1427762 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.645080 P95 : 7.951236 P99 : 12.062227 P100 : 36423.000000 COUNT : 8281782 SUM : 53092312 rocksdb.read.block.get.micros P50 : 482.083333 P95 : 3941.549296 P99 : 6084.000000 P100 : 9469.000000 COUNT : 1174 SUM : 1140005 rocksdb.write.raw.block.micros P50 : 0.512879 P95 : 0.974470 P99 : 2.896359 P100 : 54669.000000 COUNT : 11032356 SUM : 22989392 rocksdb.numfiles.in.singlecompaction P50 : 3.204545 P95 : 5.000000 P99 : 17.800000 P100 : 23.000000 COUNT : 160 SUM : 587 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559381 P95 : 1140.558730 P99 : 2329.113660 P100 : 646654.000000 COUNT : 174744 SUM : 28705300 rocksdb.sst.read.micros P50 : 1.582887 P95 : 4.750325 P99 : 8.860630 P100 : 36420.000000 COUNT : 8284887 SUM : 36114022 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11274999 SUM : 11635798968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213571.428571 P95 : 375210.526316 P99 : 711133.333333 P100 : 785808.000000 COUNT : 154 SUM : 33908324 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 376 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0