[2024-12-15 14:27:21.861152] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-15 14:27:21.861420] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid962679 ] Set seed to 1734269241854456 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 14:27:21.974535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 14:27:22.014053] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 14:27:22.014103] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 962679' to capture a snapshot of events at runtime. [2024-12-15 14:27:22.014115] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid962679 for offline analysis/debug. [2024-12-15 14:27:22.014139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 14:27:26 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-14:27:29 ... thread 0: (1000000,1000000) ops and (337552.6,337552.6) ops/second in (2.962501,2.962501) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.94 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 343.9 2.56 2.32 12 0.214 0 0 0.0 0.0 L1 4/0 251.74 MB 25.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 244.3 244.0 1.03 1.00 1 1.032 255K 252 0.0 0.0 L2 3/2 188.87 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 244.4 244.3 0.77 0.74 1 0.773 191K 86 0.0 0.0 L3 10/0 804.22 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1183/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 100.9 302.7 4.37 4.05 14 0.312 447K 338 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 100.9 302.7 4.37 4.05 14 0.312 447K 338 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 244.4 244.2 1.80 1.74 2 0.902 447K 338 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 343.9 2.56 2.32 12 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.29 GB write, 416.44 MB/s write, 0.43 GB read, 138.85 MB/s read, 4.4 seconds Interval compaction: 1.29 GB write, 446.19 MB/s write, 0.43 GB read, 148.77 MB/s read, 4.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 140049 Average: 1.9283 StdDev: 14.50 Min: 0 Median: 1.2748 Max: 4066 Percentiles: P50: 1.27 P75: 1.71 P99: 5.07 P99.9: 9.66 P99.99: 75.87 ------------------------------------------------------ [ 0, 1 ] 47856 34.171% 34.171% ####### ( 1, 2 ] 80684 57.611% 91.782% ############ ( 2, 3 ] 6386 4.560% 96.342% # ( 3, 4 ] 2822 2.015% 98.357% ( 4, 6 ] 1692 1.208% 99.565% ( 6, 10 ] 515 0.368% 99.933% ( 10, 15 ] 62 0.044% 99.977% ( 15, 22 ] 16 0.011% 99.989% ( 22, 34 ] 2 0.001% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 1 0.001% 99.991% ( 76, 110 ] 1 0.001% 99.992% ( 110, 170 ] 3 0.002% 99.994% ( 170, 250 ] 5 0.004% 99.998% ( 250, 380 ] 7 0.005% 100.003% ( 380, 580 ] 2 0.001% 100.004% ( 580, 870 ] 2 0.001% 100.006% ( 870, 1300 ] 2 0.001% 100.007% ( 1300, 1900 ] 1 0.001% 100.008% ( 1900, 2900 ] 1 0.001% 100.009% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 20 Average: 158.4500 StdDev: 333.66 Min: 1 Median: 1.8000 Max: 1256 Percentiles: P50: 1.80 P75: 140.00 P99: 1256.00 P99.9: 1256.00 P99.99: 1256.00 ------------------------------------------------------ [ 0, 1 ] 6 30.000% 30.000% ###### ( 1, 2 ] 5 25.000% 55.000% ##### ( 2, 3 ] 1 5.000% 60.000% # ( 6, 10 ] 1 5.000% 65.000% # ( 15, 22 ] 1 5.000% 70.000% # ( 110, 170 ] 2 10.000% 80.000% ## ( 170, 250 ] 1 5.000% 85.000% # ( 380, 580 ] 1 5.000% 90.000% # ( 870, 1300 ] 2 10.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 47359 Average: 2.3047 StdDev: 21.88 Min: 0 Median: 1.4251 Max: 2775 Percentiles: P50: 1.43 P75: 1.82 P99: 5.69 P99.9: 11.66 P99.99: 926.78 ------------------------------------------------------ [ 0, 1 ] 10919 23.056% 23.056% ##### ( 1, 2 ] 30020 63.388% 86.444% ############# ( 2, 3 ] 3310 6.989% 93.433% # ( 3, 4 ] 1796 3.792% 97.225% # ( 4, 6 ] 992 2.095% 99.320% ( 6, 10 ] 262 0.553% 99.873% ( 10, 15 ] 38 0.080% 99.954% ( 15, 22 ] 6 0.013% 99.966% ( 22, 34 ] 2 0.004% 99.970% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 2 0.004% 99.977% ( 380, 580 ] 4 0.008% 99.985% ( 580, 870 ] 2 0.004% 99.989% ( 870, 1300 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 39 Average: 1591.8462 StdDev: 1258.07 Min: 128 Median: 845.8333 Max: 4136 Percentiles: P50: 845.83 P75: 2681.25 P99: 4136.00 P99.9: 4136.00 P99.99: 4136.00 ------------------------------------------------------ ( 110, 170 ] 1 2.564% 2.564% # ( 170, 250 ] 1 2.564% 5.128% # ( 250, 380 ] 4 10.256% 15.385% ## ( 380, 580 ] 8 20.513% 35.897% #### ( 580, 870 ] 6 15.385% 51.282% ### ( 1300, 1900 ] 3 7.692% 58.974% ## ( 1900, 2900 ] 8 20.513% 79.487% #### ( 2900, 4400 ] 8 20.513% 100.000% #### ** Level 4 read latency histogram (micros): Count: 30 Average: 1781.5000 StdDev: 1218.97 Min: 307 Median: 1300.0000 Max: 4743 Percentiles: P50: 1300.00 P75: 2400.00 P99: 4743.00 P99.9: 4743.00 P99.99: 4743.00 ------------------------------------------------------ ( 250, 380 ] 2 6.667% 6.667% # ( 380, 580 ] 1 3.333% 10.000% # ( 580, 870 ] 4 13.333% 23.333% ### ( 870, 1300 ] 8 26.667% 50.000% ##### ( 1300, 1900 ] 6 20.000% 70.000% #### ( 1900, 2900 ] 3 10.000% 80.000% ## ( 2900, 4400 ] 5 16.667% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 309.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.408 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.408 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-14:27:32 ... thread 0: (1000000,2000000) ops and (332428.9,334971.2) ops/second in (3.008162,5.970663) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 0.9 0.0 0.9 2.6 1.8 0.0 1.5 102.6 315.0 8.60 7.99 28 0.307 895K 980 0.0 0.0 L1 1/0 2.01 MB 0.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 244.3 244.0 1.03 1.00 1 1.032 255K 252 0.0 0.0 L2 1/0 1.57 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 244.4 244.3 0.77 0.74 1 0.773 191K 86 0.0 0.0 L3 26/0 994.74 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 199.9 199.7 3.12 2.72 3 1.041 633K 504 0.0 0.0 L4 148/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1234/4 97.92 GB 0.0 1.9 0.8 1.1 3.7 2.6 1.1 2.1 144.0 278.9 13.52 12.45 33 0.410 1977K 1822 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 0.8 1.1 3.7 2.6 1.1 2.1 144.0 278.9 13.52 12.45 33 0.410 1977K 1822 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 0.8 1.1 1.9 0.8 0.0 0.0 234.9 234.7 8.29 7.76 8 1.036 1977K 1822 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 348.9 5.24 4.69 25 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.68 GB write, 610.00 MB/s write, 1.90 GB read, 314.89 MB/s read, 13.5 seconds Interval compaction: 3.68 GB write, 631.63 MB/s write, 1.90 GB read, 326.05 MB/s read, 13.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 396242 Average: 2.0265 StdDev: 15.40 Min: 0 Median: 1.3520 Max: 6116 Percentiles: P50: 1.35 P75: 1.77 P99: 5.50 P99.9: 9.95 P99.99: 20.38 ------------------------------------------------------ [ 0, 1 ] 114333 28.854% 28.854% ###### ( 1, 2 ] 238062 60.080% 88.934% ############ ( 2, 3 ] 23519 5.936% 94.870% # ( 3, 4 ] 11139 2.811% 97.681% # ( 4, 6 ] 6978 1.761% 99.442% ( 6, 10 ] 1837 0.464% 99.906% ( 10, 15 ] 290 0.073% 99.979% ( 15, 22 ] 59 0.015% 99.994% ( 22, 34 ] 4 0.001% 99.995% ( 34, 51 ] 6 0.002% 99.996% ( 51, 76 ] 3 0.001% 99.997% ( 76, 110 ] 1 0.000% 99.997% ( 110, 170 ] 6 0.002% 99.999% ( 170, 250 ] 12 0.003% 100.002% ( 250, 380 ] 16 0.004% 100.006% ( 380, 580 ] 4 0.001% 100.007% ( 580, 870 ] 5 0.001% 100.008% ( 870, 1300 ] 6 0.002% 100.010% ( 1300, 1900 ] 1 0.000% 100.010% ( 1900, 2900 ] 3 0.001% 100.011% ( 2900, 4400 ] 2 0.001% 100.011% ( 4400, 6600 ] 1 0.000% 100.011% ** Level 1 read latency histogram (micros): Count: 63381 Average: 2.3652 StdDev: 6.65 Min: 1 Median: 1.5833 Max: 1256 Percentiles: P50: 1.58 P75: 1.97 P99: 5.98 P99.9: 12.41 P99.99: 16.28 ------------------------------------------------------ [ 0, 1 ] 7903 12.469% 12.469% ## ( 1, 2 ] 40784 64.347% 76.816% ############# ( 2, 3 ] 7966 12.568% 89.385% ### ( 3, 4 ] 3314 5.229% 94.614% # ( 4, 6 ] 2803 4.422% 99.036% # ( 6, 10 ] 498 0.786% 99.822% ( 10, 15 ] 103 0.163% 99.984% ( 15, 22 ] 20 0.032% 100.016% ( 22, 34 ] 1 0.002% 100.017% ( 110, 170 ] 2 0.003% 100.021% ( 170, 250 ] 1 0.002% 100.022% ( 380, 580 ] 1 0.002% 100.024% ( 870, 1300 ] 2 0.003% 100.027% ** Level 2 read latency histogram (micros): Count: 47574 Average: 2.3047 StdDev: 21.83 Min: 0 Median: 1.4258 Max: 2775 Percentiles: P50: 1.43 P75: 1.82 P99: 5.70 P99.9: 11.64 P99.99: 922.16 ------------------------------------------------------ [ 0, 1 ] 10938 22.992% 22.992% ##### ( 1, 2 ] 30176 63.430% 86.421% ############# ( 2, 3 ] 3333 7.006% 93.427% # ( 3, 4 ] 1800 3.784% 97.211% # ( 4, 6 ] 1002 2.106% 99.317% ( 6, 10 ] 265 0.557% 99.874% ( 10, 15 ] 38 0.080% 99.954% ( 15, 22 ] 6 0.013% 99.966% ( 22, 34 ] 2 0.004% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 2 0.004% 99.977% ( 380, 580 ] 4 0.008% 99.985% ( 580, 870 ] 2 0.004% 99.989% ( 870, 1300 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47883 Average: 3.6924 StdDev: 58.24 Min: 0 Median: 1.5702 Max: 4136 Percentiles: P50: 1.57 P75: 1.96 P99: 6.67 P99.9: 111.76 P99.99: 2939.69 ------------------------------------------------------ [ 0, 1 ] 6565 13.711% 13.711% ### ( 1, 2 ] 30476 63.647% 77.357% ############# ( 2, 3 ] 5848 12.213% 89.570% ## ( 3, 4 ] 2501 5.223% 94.794% # ( 4, 6 ] 1953 4.079% 98.872% # ( 6, 10 ] 364 0.760% 99.632% ( 10, 15 ] 76 0.159% 99.791% ( 15, 22 ] 27 0.056% 99.848% ( 22, 34 ] 24 0.050% 99.898% ( 34, 51 ] 1 0.002% 99.900% ( 110, 170 ] 4 0.008% 99.908% ( 170, 250 ] 1 0.002% 99.910% ( 250, 380 ] 8 0.017% 99.927% ( 380, 580 ] 12 0.025% 99.952% ( 580, 870 ] 6 0.013% 99.964% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 3 0.006% 99.973% ( 1900, 2900 ] 8 0.017% 99.990% ( 2900, 4400 ] 8 0.017% 100.006% ** Level 4 read latency histogram (micros): Count: 30 Average: 1781.5000 StdDev: 1218.97 Min: 307 Median: 1300.0000 Max: 4743 Percentiles: P50: 1300.00 P75: 2400.00 P99: 4743.00 P99.9: 4743.00 P99.99: 4743.00 ------------------------------------------------------ ( 250, 380 ] 2 6.667% 6.667% # ( 380, 580 ] 1 3.333% 10.000% # ( 580, 870 ] 4 13.333% 23.333% ### ( 870, 1300 ] 8 26.667% 50.000% ##### ( 1300, 1900 ] 6 20.000% 70.000% #### ( 1900, 2900 ] 3 10.000% 80.000% ## ( 2900, 4400 ] 5 16.667% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 528.6500 StdDev: 595.72 Min: 92 Median: 162.5000 Max: 2114 Percentiles: P50: 162.50 P75: 773.33 P99: 2114.00 P99.9: 2114.00 P99.99: 2114.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 8 40.000% 55.000% ######## ( 250, 380 ] 2 10.000% 65.000% ## ( 580, 870 ] 3 15.000% 80.000% ### ( 870, 1300 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.802 H:M:S, 13.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.394 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-14:27:35 ... thread 0: (1000000,3000000) ops and (333584.1,334507.5) ops/second in (2.997745,8.968408) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.34 GB 62.9 1.6 0.0 1.6 4.4 2.8 0.0 1.6 114.9 313.6 14.25 13.31 45 0.317 1663K 1779 0.0 0.0 L1 1/1 2.01 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 244.3 244.0 1.03 1.00 1 1.032 255K 252 0.0 0.0 L2 1/0 1.57 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 244.4 244.3 0.77 0.74 1 0.773 191K 86 0.0 0.0 L3 26/0 994.74 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 199.9 199.7 3.12 2.72 3 1.041 633K 504 0.0 0.0 L4 148/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1239/13 98.90 GB 0.0 2.6 0.8 1.8 5.4 3.6 1.1 2.0 140.9 288.6 19.18 17.77 50 0.384 2744K 2621 0.0 0.0 Int 0/0 0.00 KB 0.0 2.6 0.8 1.8 5.4 3.6 1.1 2.0 140.9 288.6 19.18 17.77 50 0.384 2744K 2621 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.6 0.8 1.8 2.6 0.8 0.0 0.0 243.6 243.4 11.10 10.52 11 1.009 2744K 2621 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 350.5 8.09 7.25 39 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.41 GB write, 602.86 MB/s write, 2.64 GB read, 294.42 MB/s read, 19.2 seconds Interval compaction: 5.41 GB write, 617.10 MB/s write, 2.64 GB read, 301.37 MB/s read, 19.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 707861 Average: 2.0306 StdDev: 13.83 Min: 0 Median: 1.3795 Max: 6116 Percentiles: P50: 1.38 P75: 1.78 P99: 5.32 P99.9: 9.70 P99.99: 15.97 ------------------------------------------------------ [ 0, 1 ] 185676 26.231% 26.231% ##### ( 1, 2 ] 443304 62.626% 88.856% ############# ( 2, 3 ] 44921 6.346% 95.202% # ( 3, 4 ] 19420 2.743% 97.946% # ( 4, 6 ] 11281 1.594% 99.540% ( 6, 10 ] 2758 0.390% 99.929% ( 10, 15 ] 421 0.059% 99.989% ( 15, 22 ] 74 0.010% 99.999% ( 22, 34 ] 7 0.001% 100.000% ( 34, 51 ] 7 0.001% 100.001% ( 51, 76 ] 5 0.001% 100.002% ( 76, 110 ] 1 0.000% 100.002% ( 110, 170 ] 9 0.001% 100.003% ( 170, 250 ] 23 0.003% 100.006% ( 250, 380 ] 21 0.003% 100.009% ( 380, 580 ] 6 0.001% 100.010% ( 580, 870 ] 10 0.001% 100.012% ( 870, 1300 ] 8 0.001% 100.013% ( 1300, 1900 ] 4 0.001% 100.013% ( 1900, 2900 ] 3 0.000% 100.014% ( 2900, 4400 ] 5 0.001% 100.015% ( 4400, 6600 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 63382 Average: 2.3652 StdDev: 6.65 Min: 1 Median: 1.5833 Max: 1256 Percentiles: P50: 1.58 P75: 1.97 P99: 5.98 P99.9: 12.41 P99.99: 16.28 ------------------------------------------------------ [ 0, 1 ] 7903 12.469% 12.469% ## ( 1, 2 ] 40785 64.348% 76.817% ############# ( 2, 3 ] 7966 12.568% 89.385% ### ( 3, 4 ] 3314 5.229% 94.614% # ( 4, 6 ] 2803 4.422% 99.036% # ( 6, 10 ] 498 0.786% 99.822% ( 10, 15 ] 103 0.163% 99.984% ( 15, 22 ] 20 0.032% 100.016% ( 22, 34 ] 1 0.002% 100.017% ( 110, 170 ] 2 0.003% 100.021% ( 170, 250 ] 1 0.002% 100.022% ( 380, 580 ] 1 0.002% 100.024% ( 870, 1300 ] 2 0.003% 100.027% ** Level 2 read latency histogram (micros): Count: 47574 Average: 2.3047 StdDev: 21.83 Min: 0 Median: 1.4258 Max: 2775 Percentiles: P50: 1.43 P75: 1.82 P99: 5.70 P99.9: 11.64 P99.99: 922.16 ------------------------------------------------------ [ 0, 1 ] 10938 22.992% 22.992% ##### ( 1, 2 ] 30176 63.430% 86.421% ############# ( 2, 3 ] 3333 7.006% 93.427% # ( 3, 4 ] 1800 3.784% 97.211% # ( 4, 6 ] 1002 2.106% 99.317% ( 6, 10 ] 265 0.557% 99.874% ( 10, 15 ] 38 0.080% 99.954% ( 15, 22 ] 6 0.013% 99.966% ( 22, 34 ] 2 0.004% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 2 0.004% 99.977% ( 380, 580 ] 4 0.008% 99.985% ( 580, 870 ] 2 0.004% 99.989% ( 870, 1300 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47883 Average: 3.6924 StdDev: 58.24 Min: 0 Median: 1.5702 Max: 4136 Percentiles: P50: 1.57 P75: 1.96 P99: 6.67 P99.9: 111.76 P99.99: 2939.69 ------------------------------------------------------ [ 0, 1 ] 6565 13.711% 13.711% ### ( 1, 2 ] 30476 63.647% 77.357% ############# ( 2, 3 ] 5848 12.213% 89.570% ## ( 3, 4 ] 2501 5.223% 94.794% # ( 4, 6 ] 1953 4.079% 98.872% # ( 6, 10 ] 364 0.760% 99.632% ( 10, 15 ] 76 0.159% 99.791% ( 15, 22 ] 27 0.056% 99.848% ( 22, 34 ] 24 0.050% 99.898% ( 34, 51 ] 1 0.002% 99.900% ( 110, 170 ] 4 0.008% 99.908% ( 170, 250 ] 1 0.002% 99.910% ( 250, 380 ] 8 0.017% 99.927% ( 380, 580 ] 12 0.025% 99.952% ( 580, 870 ] 6 0.013% 99.964% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 3 0.006% 99.973% ( 1900, 2900 ] 8 0.017% 99.990% ( 2900, 4400 ] 8 0.017% 100.006% ** Level 4 read latency histogram (micros): Count: 30 Average: 1781.5000 StdDev: 1218.97 Min: 307 Median: 1300.0000 Max: 4743 Percentiles: P50: 1300.00 P75: 2400.00 P99: 4743.00 P99.9: 4743.00 P99.99: 4743.00 ------------------------------------------------------ ( 250, 380 ] 2 6.667% 6.667% # ( 380, 580 ] 1 3.333% 10.000% # ( 580, 870 ] 4 13.333% 23.333% ### ( 870, 1300 ] 8 26.667% 50.000% ##### ( 1300, 1900 ] 6 20.000% 70.000% #### ( 1900, 2900 ] 3 10.000% 80.000% ## ( 2900, 4400 ] 5 16.667% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 528.6500 StdDev: 595.72 Min: 92 Median: 162.5000 Max: 2114 Percentiles: P50: 162.50 P75: 773.33 P99: 2114.00 P99.9: 2114.00 P99.99: 2114.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 8 40.000% 55.000% ######## ( 250, 380 ] 2 10.000% 65.000% ## ( 580, 870 ] 3 15.000% 80.000% ### ( 870, 1300 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 321.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.208 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.406 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-14:27:38 ... thread 0: (1000000,4000000) ops and (282440.9,319770.5) ops/second in (3.540564,12.508972) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 1.91 GB 169.9 2.5 0.0 2.5 6.2 3.7 0.0 1.7 122.9 310.1 20.51 19.20 63 0.326 2558K 2768 0.0 0.0 L1 12/0 1.41 GB 144.0 1.7 1.7 0.0 1.7 1.7 0.2 1.0 232.9 231.6 7.31 7.04 2 3.653 1727K 9191 0.0 0.0 L2 1/0 1.57 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 244.4 244.3 0.77 0.74 1 0.773 191K 86 0.0 0.0 L3 26/0 994.74 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 199.9 199.7 3.12 2.72 3 1.041 633K 504 0.0 0.0 L4 148/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/4 99.88 GB 0.0 4.9 2.2 2.7 8.7 5.9 1.1 2.3 158.8 279.5 31.71 29.70 69 0.460 5112K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 2.2 2.7 8.7 5.9 1.1 2.3 158.8 279.5 31.71 29.70 69 0.460 5112K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 2.2 2.7 4.9 2.2 0.0 0.0 243.3 242.7 20.69 19.82 15 1.379 5112K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 348.6 11.02 9.88 54 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.7 total, 12.5 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.66 GB write, 696.78 MB/s write, 4.92 GB read, 395.75 MB/s read, 31.7 seconds Interval compaction: 8.66 GB write, 708.58 MB/s write, 4.92 GB read, 402.45 MB/s read, 31.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 12, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1175363 Average: 2.1284 StdDev: 12.96 Min: 0 Median: 1.4195 Max: 6116 Percentiles: P50: 1.42 P75: 1.81 P99: 5.43 P99.9: 9.88 P99.99: 95.60 ------------------------------------------------------ [ 0, 1 ] 269521 22.931% 22.931% ##### ( 1, 2 ] 758492 64.533% 87.463% ############# ( 2, 3 ] 85389 7.265% 94.728% # ( 3, 4 ] 35370 3.009% 97.738% # ( 4, 6 ] 20727 1.763% 99.501% ( 6, 10 ] 4836 0.411% 99.913% ( 10, 15 ] 749 0.064% 99.976% ( 15, 22 ] 86 0.007% 99.984% ( 22, 34 ] 9 0.001% 99.984% ( 34, 51 ] 8 0.001% 99.985% ( 51, 76 ] 7 0.001% 99.986% ( 76, 110 ] 91 0.008% 99.993% ( 110, 170 ] 147 0.013% 100.006% ( 170, 250 ] 77 0.007% 100.012% ( 250, 380 ] 53 0.005% 100.017% ( 380, 580 ] 41 0.003% 100.020% ( 580, 870 ] 27 0.002% 100.023% ( 870, 1300 ] 12 0.001% 100.024% ( 1300, 1900 ] 10 0.001% 100.025% ( 1900, 2900 ] 4 0.000% 100.025% ( 2900, 4400 ] 6 0.001% 100.025% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 63950 Average: 2.8228 StdDev: 20.66 Min: 1 Median: 1.5831 Max: 1778 Percentiles: P50: 1.58 P75: 1.97 P99: 6.53 P99.9: 84.76 P99.99: 481.40 ------------------------------------------------------ [ 0, 1 ] 8018 12.538% 12.538% ### ( 1, 2 ] 41086 64.247% 76.785% ############# ( 2, 3 ] 8007 12.521% 89.306% ### ( 3, 4 ] 3327 5.203% 94.508% # ( 4, 6 ] 2806 4.388% 98.896% # ( 6, 10 ] 506 0.791% 99.687% ( 10, 15 ] 104 0.163% 99.850% ( 15, 22 ] 20 0.031% 99.881% ( 22, 34 ] 1 0.002% 99.883% ( 34, 51 ] 1 0.002% 99.884% ( 76, 110 ] 39 0.061% 99.945% ( 110, 170 ] 11 0.017% 99.962% ( 170, 250 ] 4 0.006% 99.969% ( 250, 380 ] 6 0.009% 99.978% ( 380, 580 ] 15 0.023% 100.002% ( 580, 870 ] 4 0.006% 100.008% ( 870, 1300 ] 6 0.009% 100.017% ( 1300, 1900 ] 6 0.009% 100.027% ** Level 2 read latency histogram (micros): Count: 47574 Average: 2.3047 StdDev: 21.83 Min: 0 Median: 1.4258 Max: 2775 Percentiles: P50: 1.43 P75: 1.82 P99: 5.70 P99.9: 11.64 P99.99: 922.16 ------------------------------------------------------ [ 0, 1 ] 10938 22.992% 22.992% ##### ( 1, 2 ] 30176 63.430% 86.421% ############# ( 2, 3 ] 3333 7.006% 93.427% # ( 3, 4 ] 1800 3.784% 97.211% # ( 4, 6 ] 1002 2.106% 99.317% ( 6, 10 ] 265 0.557% 99.874% ( 10, 15 ] 38 0.080% 99.954% ( 15, 22 ] 6 0.013% 99.966% ( 22, 34 ] 2 0.004% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 2 0.004% 99.977% ( 380, 580 ] 4 0.008% 99.985% ( 580, 870 ] 2 0.004% 99.989% ( 870, 1300 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47883 Average: 3.6924 StdDev: 58.24 Min: 0 Median: 1.5702 Max: 4136 Percentiles: P50: 1.57 P75: 1.96 P99: 6.67 P99.9: 111.76 P99.99: 2939.69 ------------------------------------------------------ [ 0, 1 ] 6565 13.711% 13.711% ### ( 1, 2 ] 30476 63.647% 77.357% ############# ( 2, 3 ] 5848 12.213% 89.570% ## ( 3, 4 ] 2501 5.223% 94.794% # ( 4, 6 ] 1953 4.079% 98.872% # ( 6, 10 ] 364 0.760% 99.632% ( 10, 15 ] 76 0.159% 99.791% ( 15, 22 ] 27 0.056% 99.848% ( 22, 34 ] 24 0.050% 99.898% ( 34, 51 ] 1 0.002% 99.900% ( 110, 170 ] 4 0.008% 99.908% ( 170, 250 ] 1 0.002% 99.910% ( 250, 380 ] 8 0.017% 99.927% ( 380, 580 ] 12 0.025% 99.952% ( 580, 870 ] 6 0.013% 99.964% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 3 0.006% 99.973% ( 1900, 2900 ] 8 0.017% 99.990% ( 2900, 4400 ] 8 0.017% 100.006% ** Level 4 read latency histogram (micros): Count: 30 Average: 1781.5000 StdDev: 1218.97 Min: 307 Median: 1300.0000 Max: 4743 Percentiles: P50: 1300.00 P75: 2400.00 P99: 4743.00 P99.9: 4743.00 P99.99: 4743.00 ------------------------------------------------------ ( 250, 380 ] 2 6.667% 6.667% # ( 380, 580 ] 1 3.333% 10.000% # ( 580, 870 ] 4 13.333% 23.333% ### ( 870, 1300 ] 8 26.667% 50.000% ##### ( 1300, 1900 ] 6 20.000% 70.000% #### ( 1900, 2900 ] 3 10.000% 80.000% ## ( 2900, 4400 ] 5 16.667% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 528.6500 StdDev: 595.72 Min: 92 Median: 162.5000 Max: 2114 Percentiles: P50: 162.50 P75: 773.33 P99: 2114.00 P99.9: 2114.00 P99.99: 2114.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 8 40.000% 55.000% ######## ( 250, 380 ] 2 10.000% 65.000% ## ( 580, 870 ] 3 15.000% 80.000% ### ( 870, 1300 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.7 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 309.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.150 H:M:S, 16.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 277.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.942 H:M:S, 26.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-14:27:41 ... thread 0: (1000000,5000000) ops and (334756.2,322659.3) ops/second in (2.987249,15.496221) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 2.83 GB 12.6 3.2 0.0 3.2 7.9 4.7 0.0 1.7 126.0 310.1 25.99 24.36 79 0.329 3326K 3517 0.0 0.0 L1 12/12 1.41 GB 0.0 1.7 1.7 0.0 1.7 1.7 0.2 1.0 232.9 231.6 7.31 7.04 2 3.653 1727K 9191 0.0 0.0 L2 1/0 1.57 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 244.4 244.3 0.77 0.74 1 0.773 191K 86 0.0 0.0 L3 26/0 994.74 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 199.9 199.7 3.12 2.72 3 1.041 633K 504 0.0 0.0 L4 148/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/28 100.80 GB 0.0 5.7 2.2 3.4 10.3 6.9 1.1 2.2 155.7 284.1 37.19 34.86 85 0.438 5879K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 2.2 3.4 10.3 6.9 1.1 2.2 155.7 284.1 37.19 34.86 85 0.438 5879K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 2.2 3.4 5.6 2.2 0.0 0.0 246.1 245.5 23.53 22.61 18 1.307 5879K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 350.3 13.67 12.25 67 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.7 total, 15.5 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.32 GB write, 672.52 MB/s write, 5.66 GB read, 368.62 MB/s read, 37.2 seconds Interval compaction: 10.32 GB write, 681.71 MB/s write, 5.66 GB read, 373.66 MB/s read, 37.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 15, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1390060 Average: 2.1173 StdDev: 12.89 Min: 0 Median: 1.4041 Max: 6116 Percentiles: P50: 1.40 P75: 1.79 P99: 5.37 P99.9: 9.98 P99.99: 131.73 ------------------------------------------------------ [ 0, 1 ] 335110 24.108% 24.108% ##### ( 1, 2 ] 890731 64.079% 88.186% ############# ( 2, 3 ] 95425 6.865% 95.051% # ( 3, 4 ] 39379 2.833% 97.884% # ( 4, 6 ] 22615 1.627% 99.511% ( 6, 10 ] 5436 0.391% 99.902% ( 10, 15 ] 871 0.063% 99.965% ( 15, 22 ] 107 0.008% 99.972% ( 22, 34 ] 13 0.001% 99.973% ( 34, 51 ] 8 0.001% 99.974% ( 51, 76 ] 10 0.001% 99.974% ( 76, 110 ] 126 0.009% 99.984% ( 110, 170 ] 254 0.018% 100.002% ( 170, 250 ] 102 0.007% 100.009% ( 250, 380 ] 65 0.005% 100.014% ( 380, 580 ] 52 0.004% 100.018% ( 580, 870 ] 34 0.002% 100.020% ( 870, 1300 ] 14 0.001% 100.021% ( 1300, 1900 ] 13 0.001% 100.022% ( 1900, 2900 ] 5 0.000% 100.022% ( 2900, 4400 ] 7 0.001% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 88106 Average: 2.7493 StdDev: 21.48 Min: 1 Median: 1.5340 Max: 3183 Percentiles: P50: 1.53 P75: 1.92 P99: 7.38 P99.9: 98.62 P99.99: 504.33 ------------------------------------------------------ [ 0, 1 ] 13898 15.774% 15.774% ### ( 1, 2 ] 56466 64.089% 79.863% ############# ( 2, 3 ] 9618 10.916% 90.779% ## ( 3, 4 ] 3832 4.349% 95.129% # ( 4, 6 ] 3103 3.522% 98.650% # ( 6, 10 ] 894 1.015% 99.665% ( 10, 15 ] 125 0.142% 99.807% ( 15, 22 ] 29 0.033% 99.840% ( 22, 34 ] 1 0.001% 99.841% ( 34, 51 ] 2 0.002% 99.843% ( 76, 110 ] 75 0.085% 99.928% ( 110, 170 ] 28 0.032% 99.960% ( 170, 250 ] 8 0.009% 99.969% ( 250, 380 ] 7 0.008% 99.977% ( 380, 580 ] 18 0.020% 99.998% ( 580, 870 ] 5 0.006% 100.003% ( 870, 1300 ] 7 0.008% 100.011% ( 1300, 1900 ] 6 0.007% 100.018% ( 2900, 4400 ] 1 0.001% 100.019% ** Level 2 read latency histogram (micros): Count: 47574 Average: 2.3047 StdDev: 21.83 Min: 0 Median: 1.4258 Max: 2775 Percentiles: P50: 1.43 P75: 1.82 P99: 5.70 P99.9: 11.64 P99.99: 922.16 ------------------------------------------------------ [ 0, 1 ] 10938 22.992% 22.992% ##### ( 1, 2 ] 30176 63.430% 86.421% ############# ( 2, 3 ] 3333 7.006% 93.427% # ( 3, 4 ] 1800 3.784% 97.211% # ( 4, 6 ] 1002 2.106% 99.317% ( 6, 10 ] 265 0.557% 99.874% ( 10, 15 ] 38 0.080% 99.954% ( 15, 22 ] 6 0.013% 99.966% ( 22, 34 ] 2 0.004% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 2 0.004% 99.977% ( 380, 580 ] 4 0.008% 99.985% ( 580, 870 ] 2 0.004% 99.989% ( 870, 1300 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47883 Average: 3.6924 StdDev: 58.24 Min: 0 Median: 1.5702 Max: 4136 Percentiles: P50: 1.57 P75: 1.96 P99: 6.67 P99.9: 111.76 P99.99: 2939.69 ------------------------------------------------------ [ 0, 1 ] 6565 13.711% 13.711% ### ( 1, 2 ] 30476 63.647% 77.357% ############# ( 2, 3 ] 5848 12.213% 89.570% ## ( 3, 4 ] 2501 5.223% 94.794% # ( 4, 6 ] 1953 4.079% 98.872% # ( 6, 10 ] 364 0.760% 99.632% ( 10, 15 ] 76 0.159% 99.791% ( 15, 22 ] 27 0.056% 99.848% ( 22, 34 ] 24 0.050% 99.898% ( 34, 51 ] 1 0.002% 99.900% ( 110, 170 ] 4 0.008% 99.908% ( 170, 250 ] 1 0.002% 99.910% ( 250, 380 ] 8 0.017% 99.927% ( 380, 580 ] 12 0.025% 99.952% ( 580, 870 ] 6 0.013% 99.964% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 3 0.006% 99.973% ( 1900, 2900 ] 8 0.017% 99.990% ( 2900, 4400 ] 8 0.017% 100.006% ** Level 4 read latency histogram (micros): Count: 30 Average: 1781.5000 StdDev: 1218.97 Min: 307 Median: 1300.0000 Max: 4743 Percentiles: P50: 1300.00 P75: 2400.00 P99: 4743.00 P99.9: 4743.00 P99.99: 4743.00 ------------------------------------------------------ ( 250, 380 ] 2 6.667% 6.667% # ( 380, 580 ] 1 3.333% 10.000% # ( 580, 870 ] 4 13.333% 23.333% ### ( 870, 1300 ] 8 26.667% 50.000% ##### ( 1300, 1900 ] 6 20.000% 70.000% #### ( 1900, 2900 ] 3 10.000% 80.000% ## ( 2900, 4400 ] 5 16.667% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 528.6500 StdDev: 595.72 Min: 92 Median: 162.5000 Max: 2114 Percentiles: P50: 162.50 P75: 773.33 P99: 2114.00 P99.9: 2114.00 P99.99: 2114.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 8 40.000% 55.000% ######## ( 250, 380 ] 2 10.000% 65.000% ## ( 580, 870 ] 3 15.000% 80.000% ### ( 870, 1300 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 15.7 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 313.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.577 H:M:S, 16.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.427 H:M:S, 14.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-14:27:50 ... thread 0: (1000000,6000000) ops and (120833.9,252397.3) ops/second in (8.275825,23.772046) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 3.87 GB 144.4 5.2 0.0 5.2 10.9 5.7 0.0 1.9 145.4 304.2 36.83 34.76 100 0.368 5436K 8490 0.0 0.0 L1 12/12 1.41 GB 0.0 1.7 1.7 0.0 1.7 1.7 0.2 1.0 232.9 231.6 7.31 7.04 2 3.653 1727K 9191 0.0 0.0 L2 1/0 1.57 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 244.4 244.3 0.77 0.74 1 0.773 191K 86 0.0 0.0 L3 26/0 994.74 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 199.9 199.7 3.12 2.72 3 1.041 633K 504 0.0 0.0 L4 148/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/24 101.84 GB 0.0 7.7 2.2 5.5 13.4 7.9 1.1 2.3 163.8 285.4 48.03 45.26 106 0.453 7989K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.7 2.2 5.5 13.4 7.9 1.1 2.3 163.8 285.4 48.03 45.26 106 0.453 7989K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.7 2.2 5.5 7.7 2.2 0.0 0.0 251.5 250.9 31.29 30.25 23 1.360 7989K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 350.0 16.74 15.01 83 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.0 total, 23.8 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.39 GB write, 571.54 MB/s write, 7.68 GB read, 328.06 MB/s read, 48.0 seconds Interval compaction: 13.39 GB write, 576.63 MB/s write, 7.68 GB read, 330.99 MB/s read, 48.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 17, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2185042 Average: 2.1461 StdDev: 12.36 Min: 0 Median: 1.4151 Max: 6116 Percentiles: P50: 1.42 P75: 1.80 P99: 5.44 P99.9: 11.95 P99.99: 148.51 ------------------------------------------------------ [ 0, 1 ] 499269 22.849% 22.849% ##### ( 1, 2 ] 1429015 65.400% 88.249% ############# ( 2, 3 ] 149142 6.826% 95.075% # ( 3, 4 ] 61792 2.828% 97.903% # ( 4, 6 ] 33246 1.522% 99.424% ( 6, 10 ] 9791 0.448% 99.872% ( 10, 15 ] 1551 0.071% 99.943% ( 15, 22 ] 275 0.013% 99.956% ( 22, 34 ] 15 0.001% 99.957% ( 34, 51 ] 9 0.000% 99.957% ( 51, 76 ] 16 0.001% 99.958% ( 76, 110 ] 382 0.017% 99.975% ( 110, 170 ] 504 0.023% 99.998% ( 170, 250 ] 190 0.009% 100.007% ( 250, 380 ] 112 0.005% 100.012% ( 380, 580 ] 99 0.005% 100.017% ( 580, 870 ] 53 0.002% 100.019% ( 870, 1300 ] 20 0.001% 100.020% ( 1300, 1900 ] 16 0.001% 100.021% ( 1900, 2900 ] 9 0.000% 100.021% ( 2900, 4400 ] 10 0.000% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 263081 Average: 2.5386 StdDev: 15.90 Min: 1 Median: 1.4858 Max: 3183 Percentiles: P50: 1.49 P75: 1.86 P99: 8.05 P99.9: 109.06 P99.99: 451.79 ------------------------------------------------------ [ 0, 1 ] 46086 17.518% 17.518% #### ( 1, 2 ] 175890 66.858% 84.376% ############# ( 2, 3 ] 22160 8.423% 92.799% ## ( 3, 4 ] 8662 3.293% 96.091% # ( 4, 6 ] 5859 2.227% 98.318% ( 6, 10 ] 3496 1.329% 99.647% ( 10, 15 ] 327 0.124% 99.772% ( 15, 22 ] 74 0.028% 99.800% ( 22, 34 ] 4 0.002% 99.801% ( 34, 51 ] 2 0.001% 99.802% ( 51, 76 ] 11 0.004% 99.806% ( 76, 110 ] 255 0.097% 99.903% ( 110, 170 ] 161 0.061% 99.964% ( 170, 250 ] 35 0.013% 99.978% ( 250, 380 ] 24 0.009% 99.987% ( 380, 580 ] 27 0.010% 99.997% ( 580, 870 ] 8 0.003% 100.000% ( 870, 1300 ] 9 0.003% 100.003% ( 1300, 1900 ] 7 0.003% 100.006% ( 2900, 4400 ] 2 0.001% 100.007% ** Level 2 read latency histogram (micros): Count: 47574 Average: 2.3047 StdDev: 21.83 Min: 0 Median: 1.4258 Max: 2775 Percentiles: P50: 1.43 P75: 1.82 P99: 5.70 P99.9: 11.64 P99.99: 922.16 ------------------------------------------------------ [ 0, 1 ] 10938 22.992% 22.992% ##### ( 1, 2 ] 30176 63.430% 86.421% ############# ( 2, 3 ] 3333 7.006% 93.427% # ( 3, 4 ] 1800 3.784% 97.211% # ( 4, 6 ] 1002 2.106% 99.317% ( 6, 10 ] 265 0.557% 99.874% ( 10, 15 ] 38 0.080% 99.954% ( 15, 22 ] 6 0.013% 99.966% ( 22, 34 ] 2 0.004% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 2 0.004% 99.977% ( 380, 580 ] 4 0.008% 99.985% ( 580, 870 ] 2 0.004% 99.989% ( 870, 1300 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47883 Average: 3.6924 StdDev: 58.24 Min: 0 Median: 1.5702 Max: 4136 Percentiles: P50: 1.57 P75: 1.96 P99: 6.67 P99.9: 111.76 P99.99: 2939.69 ------------------------------------------------------ [ 0, 1 ] 6565 13.711% 13.711% ### ( 1, 2 ] 30476 63.647% 77.357% ############# ( 2, 3 ] 5848 12.213% 89.570% ## ( 3, 4 ] 2501 5.223% 94.794% # ( 4, 6 ] 1953 4.079% 98.872% # ( 6, 10 ] 364 0.760% 99.632% ( 10, 15 ] 76 0.159% 99.791% ( 15, 22 ] 27 0.056% 99.848% ( 22, 34 ] 24 0.050% 99.898% ( 34, 51 ] 1 0.002% 99.900% ( 110, 170 ] 4 0.008% 99.908% ( 170, 250 ] 1 0.002% 99.910% ( 250, 380 ] 8 0.017% 99.927% ( 380, 580 ] 12 0.025% 99.952% ( 580, 870 ] 6 0.013% 99.964% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 3 0.006% 99.973% ( 1900, 2900 ] 8 0.017% 99.990% ( 2900, 4400 ] 8 0.017% 100.006% ** Level 4 read latency histogram (micros): Count: 30 Average: 1781.5000 StdDev: 1218.97 Min: 307 Median: 1300.0000 Max: 4743 Percentiles: P50: 1300.00 P75: 2400.00 P99: 4743.00 P99.9: 4743.00 P99.99: 4743.00 ------------------------------------------------------ ( 250, 380 ] 2 6.667% 6.667% # ( 380, 580 ] 1 3.333% 10.000% # ( 580, 870 ] 4 13.333% 23.333% ### ( 870, 1300 ] 8 26.667% 50.000% ##### ( 1300, 1900 ] 6 20.000% 70.000% #### ( 1900, 2900 ] 3 10.000% 80.000% ## ( 2900, 4400 ] 5 16.667% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 528.6500 StdDev: 595.72 Min: 92 Median: 162.5000 Max: 2114 Percentiles: P50: 162.50 P75: 773.33 P99: 2114.00 P99.9: 2114.00 P99.99: 2114.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 8 40.000% 55.000% ######## ( 250, 380 ] 2 10.000% 65.000% ## ( 580, 870 ] 3 15.000% 80.000% ### ( 870, 1300 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 24.0 total, 8.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 246.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.236 H:M:S, 34.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 118.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.658 H:M:S, 68.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/15-14:28:02 ... thread 0: (1000000,7000000) ops and (79971.8,192962.6) ops/second in (12.504415,36.276461) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 2.27 GB 0.0 5.5 0.0 5.5 12.0 6.6 0.0 1.8 133.7 294.3 41.92 38.08 113 0.371 5692K 8727 0.0 0.0 L1 11/11 1.29 GB 0.0 5.5 4.1 1.4 5.5 4.0 0.2 1.3 223.7 220.7 25.30 23.81 3 8.434 5747K 75K 0.0 0.0 L2 1/1 1.57 MB 0.0 0.2 0.1 0.1 0.2 0.1 2.8 1.5 244.4 244.3 0.77 0.74 1 0.773 191K 86 0.0 0.0 L3 25/10 1.75 GB 1.0 1.1 0.8 0.2 1.1 0.8 2.2 1.3 168.1 167.9 6.41 4.73 6 1.069 1066K 637 0.0 0.0 L4 163/0 9.54 GB 1.0 1.9 1.6 0.3 1.9 1.6 0.4 1.2 115.4 115.0 17.10 9.40 15 1.140 1941K 5381 0.0 0.0 L5 1068/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/36 102.63 GB 0.0 14.2 6.6 7.5 20.7 13.1 7.6 3.1 158.5 231.2 91.51 76.76 138 0.663 14M 90K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.2 6.6 7.5 20.7 13.1 7.6 3.1 158.5 231.2 91.51 76.76 138 0.663 14M 90K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.2 6.6 7.5 14.1 6.6 0.0 0.0 205.3 204.0 70.64 59.37 43 1.643 14M 90K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 323.0 20.87 17.38 95 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.5 total, 36.3 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.66 GB write, 579.70 MB/s write, 14.16 GB read, 397.50 MB/s read, 91.5 seconds Interval compaction: 20.66 GB write, 583.08 MB/s write, 14.16 GB read, 399.82 MB/s read, 91.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 41, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2753030 Average: 2.5959 StdDev: 24.62 Min: 0 Median: 1.4252 Max: 7603 Percentiles: P50: 1.43 P75: 1.82 P99: 5.95 P99.9: 129.96 P99.99: 367.82 ------------------------------------------------------ [ 0, 1 ] 625891 22.735% 22.735% ##### ( 1, 2 ] 1765444 64.127% 86.862% ############# ( 2, 3 ] 197814 7.185% 94.047% # ( 3, 4 ] 84333 3.063% 97.111% # ( 4, 6 ] 53229 1.933% 99.044% ( 6, 10 ] 16749 0.608% 99.652% ( 10, 15 ] 2896 0.105% 99.758% ( 15, 22 ] 494 0.018% 99.776% ( 22, 34 ] 22 0.001% 99.776% ( 34, 51 ] 13 0.000% 99.777% ( 51, 76 ] 37 0.001% 99.778% ( 76, 110 ] 2568 0.093% 99.871% ( 110, 170 ] 2372 0.086% 99.958% ( 170, 250 ] 534 0.019% 99.977% ( 250, 380 ] 398 0.014% 99.991% ( 380, 580 ] 384 0.014% 100.005% ( 580, 870 ] 186 0.007% 100.012% ( 870, 1300 ] 64 0.002% 100.014% ( 1300, 1900 ] 50 0.002% 100.016% ( 1900, 2900 ] 63 0.002% 100.019% ( 2900, 4400 ] 44 0.002% 100.020% ( 4400, 6600 ] 6 0.000% 100.020% ( 6600, 9900 ] 2 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 852676 Average: 4.9851 StdDev: 79.85 Min: 1 Median: 1.6405 Max: 9649 Percentiles: P50: 1.64 P75: 2.34 P99: 9.30 P99.9: 126.78 P99.99: 437.25 ------------------------------------------------------ [ 0, 1 ] 118457 13.892% 13.892% ### ( 1, 2 ] 480686 56.374% 70.266% ########### ( 2, 3 ] 118828 13.936% 84.202% ### ( 3, 4 ] 57173 6.705% 90.907% # ( 4, 6 ] 55913 6.557% 97.465% # ( 6, 10 ] 15857 1.860% 99.324% ( 10, 15 ] 3330 0.391% 99.715% ( 15, 22 ] 547 0.064% 99.779% ( 22, 34 ] 41 0.005% 99.784% ( 34, 51 ] 7 0.001% 99.785% ( 51, 76 ] 72 0.008% 99.793% ( 76, 110 ] 775 0.091% 99.884% ( 110, 170 ] 491 0.058% 99.941% ( 170, 250 ] 158 0.019% 99.960% ( 250, 380 ] 171 0.020% 99.980% ( 380, 580 ] 296 0.035% 100.015% ( 580, 870 ] 244 0.029% 100.043% ( 870, 1300 ] 155 0.018% 100.062% ( 1300, 1900 ] 120 0.014% 100.076% ( 1900, 2900 ] 133 0.016% 100.091% ( 2900, 4400 ] 170 0.020% 100.111% ( 4400, 6600 ] 49 0.006% 100.117% ( 6600, 9900 ] 9 0.001% 100.118% ** Level 2 read latency histogram (micros): Count: 47874 Average: 3.9006 StdDev: 62.98 Min: 0 Median: 1.4298 Max: 4009 Percentiles: P50: 1.43 P75: 1.83 P99: 5.84 P99.9: 520.40 P99.99: 3602.10 ------------------------------------------------------ [ 0, 1 ] 10941 22.854% 22.854% ##### ( 1, 2 ] 30237 63.160% 86.013% ############# ( 2, 3 ] 3440 7.186% 93.199% # ( 3, 4 ] 1830 3.823% 97.021% # ( 4, 6 ] 1030 2.151% 99.173% ( 6, 10 ] 268 0.560% 99.733% ( 10, 15 ] 42 0.088% 99.820% ( 15, 22 ] 6 0.013% 99.833% ( 22, 34 ] 2 0.004% 99.837% ( 110, 170 ] 4 0.008% 99.845% ( 170, 250 ] 7 0.015% 99.860% ( 250, 380 ] 10 0.021% 99.881% ( 380, 580 ] 13 0.027% 99.908% ( 580, 870 ] 10 0.021% 99.929% ( 870, 1300 ] 13 0.027% 99.956% ( 1300, 1900 ] 5 0.010% 99.967% ( 1900, 2900 ] 7 0.015% 99.981% ( 2900, 4400 ] 9 0.019% 100.000% ** Level 3 read latency histogram (micros): Count: 368040 Average: 11.4994 StdDev: 135.73 Min: 0 Median: 1.7952 Max: 9169 Percentiles: P50: 1.80 P75: 2.80 P99: 14.15 P99.9: 1227.59 P99.99: 2180.98 ------------------------------------------------------ [ 0, 1 ] 25132 6.829% 6.829% # ( 1, 2 ] 199815 54.292% 61.120% ########### ( 2, 3 ] 64015 17.393% 78.514% ### ( 3, 4 ] 34086 9.261% 87.775% ## ( 4, 6 ] 31595 8.585% 96.360% ## ( 6, 10 ] 8296 2.254% 98.614% ( 10, 15 ] 1711 0.465% 99.079% ( 15, 22 ] 307 0.083% 99.162% ( 22, 34 ] 56 0.015% 99.178% ( 34, 51 ] 3 0.001% 99.178% ( 51, 76 ] 9 0.002% 99.181% ( 76, 110 ] 77 0.021% 99.202% ( 110, 170 ] 220 0.060% 99.261% ( 170, 250 ] 346 0.094% 99.356% ( 250, 380 ] 458 0.124% 99.480% ( 380, 580 ] 610 0.166% 99.646% ( 580, 870 ] 595 0.162% 99.807% ( 870, 1300 ] 410 0.111% 99.919% ( 1300, 1900 ] 206 0.056% 99.975% ( 1900, 2900 ] 200 0.054% 100.029% ( 2900, 4400 ] 222 0.060% 100.089% ( 4400, 6600 ] 36 0.010% 100.099% ( 6600, 9900 ] 7 0.002% 100.101% ** Level 4 read latency histogram (micros): Count: 22725 Average: 6.7057 StdDev: 88.82 Min: 1 Median: 1.8381 Max: 4743 Percentiles: P50: 1.84 P75: 2.79 P99: 9.44 P99.9: 1422.81 P99.99: 4018.25 ------------------------------------------------------ [ 0, 1 ] 870 3.828% 3.828% # ( 1, 2 ] 12520 55.094% 58.922% ########### ( 2, 3 ] 4653 20.475% 79.397% #### ( 3, 4 ] 2083 9.166% 88.563% ## ( 4, 6 ] 2107 9.272% 97.835% ## ( 6, 10 ] 308 1.355% 99.190% ( 10, 15 ] 60 0.264% 99.454% ( 15, 22 ] 13 0.057% 99.512% ( 22, 34 ] 17 0.075% 99.586% ( 34, 51 ] 4 0.018% 99.604% ( 51, 76 ] 1 0.004% 99.608% ( 76, 110 ] 1 0.004% 99.613% ( 110, 170 ] 4 0.018% 99.630% ( 170, 250 ] 23 0.101% 99.732% ( 250, 380 ] 6 0.026% 99.758% ( 380, 580 ] 8 0.035% 99.793% ( 580, 870 ] 9 0.040% 99.833% ( 870, 1300 ] 12 0.053% 99.886% ( 1300, 1900 ] 16 0.070% 99.956% ( 1900, 2900 ] 4 0.018% 99.974% ( 2900, 4400 ] 5 0.022% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 1200.6667 StdDev: 1298.25 Min: 92 Median: 669.2308 Max: 5697 Percentiles: P50: 669.23 P75: 1750.00 P99: 5697.00 P99.9: 5697.00 P99.99: 5697.00 ------------------------------------------------------ ( 76, 110 ] 4 3.333% 3.333% # ( 110, 170 ] 19 15.833% 19.167% ### ( 170, 250 ] 9 7.500% 26.667% ## ( 250, 380 ] 15 12.500% 39.167% ### ( 380, 580 ] 9 7.500% 46.667% ## ( 580, 870 ] 13 10.833% 57.500% ## ( 870, 1300 ] 12 10.000% 67.500% ## ( 1300, 1900 ] 12 10.000% 77.500% ## ( 1900, 2900 ] 12 10.000% 87.500% ## ( 2900, 4400 ] 11 9.167% 96.667% ## ( 4400, 6600 ] 4 3.333% 100.000% # ** DB Stats ** Uptime(secs): 36.5 total, 12.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 188.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.524 H:M:S, 48.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 78.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.288 H:M:S, 74.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/15-14:28:05 ... thread 0: (1000000,8000000) ops and (302156.6,202091.6) ops/second in (3.309542,39.586003) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 3.32 GB 144.7 6.7 0.0 6.7 14.3 7.6 0.0 1.9 137.6 294.0 49.89 45.61 131 0.381 6971K 10K 0.0 0.0 L1 11/11 1.29 GB 0.0 5.5 4.1 1.4 5.5 4.0 0.2 1.3 223.7 220.7 25.30 23.81 3 8.434 5747K 75K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 2.8 1.5 244.4 244.3 0.77 0.74 1 0.773 191K 86 0.0 0.0 L3 14/0 980.50 MB 1.0 1.8 0.8 1.0 1.8 0.8 2.2 2.3 169.3 169.1 11.13 7.99 7 1.589 1885K 2230 0.0 0.0 L4 169/0 9.65 GB 1.0 1.9 1.6 0.3 1.9 1.6 1.2 1.2 115.4 115.0 17.10 9.40 15 1.140 1941K 5381 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/21 103.67 GB 0.0 16.2 6.6 9.5 23.7 14.2 9.1 3.1 159.0 233.1 104.19 87.55 157 0.664 16M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.2 6.6 9.5 23.7 14.2 9.1 3.1 159.0 233.1 104.19 87.55 157 0.664 16M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.2 6.6 9.5 16.1 6.6 0.0 0.0 206.6 205.4 80.22 67.40 48 1.671 16M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 325.8 23.97 20.15 109 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.8 total, 39.6 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.72 GB write, 610.21 MB/s write, 16.18 GB read, 416.34 MB/s read, 104.2 seconds Interval compaction: 23.72 GB write, 613.48 MB/s write, 16.18 GB read, 418.56 MB/s read, 104.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 46, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3198479 Average: 2.5554 StdDev: 23.02 Min: 0 Median: 1.4431 Max: 7603 Percentiles: P50: 1.44 P75: 1.83 P99: 5.97 P99.9: 112.94 P99.99: 273.42 ------------------------------------------------------ [ 0, 1 ] 685822 21.442% 21.442% #### ( 1, 2 ] 2061563 64.454% 85.897% ############# ( 2, 3 ] 247128 7.726% 93.623% ## ( 3, 4 ] 104909 3.280% 96.903% # ( 4, 6 ] 68159 2.131% 99.034% ( 6, 10 ] 20780 0.650% 99.684% ( 10, 15 ] 3621 0.113% 99.797% ( 15, 22 ] 541 0.017% 99.814% ( 22, 34 ] 25 0.001% 99.815% ( 34, 51 ] 14 0.000% 99.815% ( 51, 76 ] 42 0.001% 99.816% ( 76, 110 ] 2568 0.080% 99.897% ( 110, 170 ] 2374 0.074% 99.971% ( 170, 250 ] 548 0.017% 99.988% ( 250, 380 ] 406 0.013% 100.001% ( 380, 580 ] 387 0.012% 100.013% ( 580, 870 ] 192 0.006% 100.019% ( 870, 1300 ] 74 0.002% 100.021% ( 1300, 1900 ] 51 0.002% 100.023% ( 1900, 2900 ] 64 0.002% 100.025% ( 2900, 4400 ] 44 0.001% 100.026% ( 4400, 6600 ] 6 0.000% 100.026% ( 6600, 9900 ] 2 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 885806 Average: 4.9143 StdDev: 78.41 Min: 1 Median: 1.6390 Max: 9649 Percentiles: P50: 1.64 P75: 2.32 P99: 9.30 P99.9: 130.51 P99.99: 442.78 ------------------------------------------------------ [ 0, 1 ] 121403 13.705% 13.705% ### ( 1, 2 ] 503138 56.800% 70.505% ########### ( 2, 3 ] 123323 13.922% 84.428% ### ( 3, 4 ] 58598 6.615% 91.043% # ( 4, 6 ] 56955 6.430% 97.472% # ( 6, 10 ] 16425 1.854% 99.327% ( 10, 15 ] 3405 0.384% 99.711% ( 15, 22 ] 550 0.062% 99.773% ( 22, 34 ] 41 0.005% 99.778% ( 34, 51 ] 7 0.001% 99.779% ( 51, 76 ] 73 0.008% 99.787% ( 76, 110 ] 824 0.093% 99.880% ( 110, 170 ] 533 0.060% 99.940% ( 170, 250 ] 170 0.019% 99.959% ( 250, 380 ] 181 0.020% 99.980% ( 380, 580 ] 304 0.034% 100.014% ( 580, 870 ] 248 0.028% 100.042% ( 870, 1300 ] 156 0.018% 100.060% ( 1300, 1900 ] 121 0.014% 100.073% ( 1900, 2900 ] 133 0.015% 100.088% ( 2900, 4400 ] 170 0.019% 100.107% ( 4400, 6600 ] 49 0.006% 100.113% ( 6600, 9900 ] 9 0.001% 100.114% ** Level 2 read latency histogram (micros): Count: 76235 Average: 3.8268 StdDev: 52.04 Min: 0 Median: 1.4930 Max: 4009 Percentiles: P50: 1.49 P75: 1.89 P99: 7.87 P99.9: 443.00 P99.99: 3129.42 ------------------------------------------------------ [ 0, 1 ] 14441 18.943% 18.943% #### ( 1, 2 ] 48028 63.000% 81.943% ############# ( 2, 3 ] 6970 9.143% 91.085% ## ( 3, 4 ] 3423 4.490% 95.576% # ( 4, 6 ] 2253 2.955% 98.531% # ( 6, 10 ] 766 1.005% 99.536% ( 10, 15 ] 118 0.155% 99.690% ( 15, 22 ] 8 0.010% 99.701% ( 22, 34 ] 2 0.003% 99.704% ( 51, 76 ] 1 0.001% 99.705% ( 76, 110 ] 47 0.062% 99.767% ( 110, 170 ] 31 0.041% 99.807% ( 170, 250 ] 29 0.038% 99.845% ( 250, 380 ] 32 0.042% 99.887% ( 380, 580 ] 31 0.041% 99.928% ( 580, 870 ] 17 0.022% 99.950% ( 870, 1300 ] 16 0.021% 99.971% ( 1300, 1900 ] 6 0.008% 99.979% ( 1900, 2900 ] 7 0.009% 99.988% ( 2900, 4400 ] 9 0.012% 100.000% ** Level 3 read latency histogram (micros): Count: 391760 Average: 11.0120 StdDev: 131.70 Min: 0 Median: 1.7871 Max: 9169 Percentiles: P50: 1.79 P75: 2.78 P99: 13.67 P99.9: 1204.69 P99.99: 2169.12 ------------------------------------------------------ [ 0, 1 ] 27425 7.000% 7.000% # ( 1, 2 ] 214031 54.633% 61.634% ########### ( 2, 3 ] 67237 17.163% 78.796% ### ( 3, 4 ] 36052 9.203% 87.999% ## ( 4, 6 ] 33003 8.424% 96.423% ## ( 6, 10 ] 8791 2.244% 98.667% ( 10, 15 ] 1776 0.453% 99.121% ( 15, 22 ] 313 0.080% 99.201% ( 22, 34 ] 56 0.014% 99.215% ( 34, 51 ] 3 0.001% 99.216% ( 51, 76 ] 9 0.002% 99.218% ( 76, 110 ] 78 0.020% 99.238% ( 110, 170 ] 227 0.058% 99.296% ( 170, 250 ] 357 0.091% 99.387% ( 250, 380 ] 468 0.119% 99.506% ( 380, 580 ] 616 0.157% 99.664% ( 580, 870 ] 604 0.154% 99.818% ( 870, 1300 ] 414 0.106% 99.923% ( 1300, 1900 ] 207 0.053% 99.976% ( 1900, 2900 ] 200 0.051% 100.027% ( 2900, 4400 ] 222 0.057% 100.084% ( 4400, 6600 ] 36 0.009% 100.093% ( 6600, 9900 ] 7 0.002% 100.095% ** Level 4 read latency histogram (micros): Count: 22725 Average: 6.7057 StdDev: 88.82 Min: 1 Median: 1.8381 Max: 4743 Percentiles: P50: 1.84 P75: 2.79 P99: 9.44 P99.9: 1422.81 P99.99: 4018.25 ------------------------------------------------------ [ 0, 1 ] 870 3.828% 3.828% # ( 1, 2 ] 12520 55.094% 58.922% ########### ( 2, 3 ] 4653 20.475% 79.397% #### ( 3, 4 ] 2083 9.166% 88.563% ## ( 4, 6 ] 2107 9.272% 97.835% ## ( 6, 10 ] 308 1.355% 99.190% ( 10, 15 ] 60 0.264% 99.454% ( 15, 22 ] 13 0.057% 99.512% ( 22, 34 ] 17 0.075% 99.586% ( 34, 51 ] 4 0.018% 99.604% ( 51, 76 ] 1 0.004% 99.608% ( 76, 110 ] 1 0.004% 99.613% ( 110, 170 ] 4 0.018% 99.630% ( 170, 250 ] 23 0.101% 99.732% ( 250, 380 ] 6 0.026% 99.758% ( 380, 580 ] 8 0.035% 99.793% ( 580, 870 ] 9 0.040% 99.833% ( 870, 1300 ] 12 0.053% 99.886% ( 1300, 1900 ] 16 0.070% 99.956% ( 1900, 2900 ] 4 0.018% 99.974% ( 2900, 4400 ] 5 0.022% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1111.8875 StdDev: 1252.59 Min: 85 Median: 543.6364 Max: 5697 Percentiles: P50: 543.64 P75: 1642.86 P99: 5697.00 P99.9: 5697.00 P99.99: 5697.00 ------------------------------------------------------ ( 76, 110 ] 10 6.250% 6.250% # ( 110, 170 ] 28 17.500% 23.750% #### ( 170, 250 ] 15 9.375% 33.125% ## ( 250, 380 ] 18 11.250% 44.375% ## ( 380, 580 ] 11 6.875% 51.250% # ( 580, 870 ] 14 8.750% 60.000% ## ( 870, 1300 ] 16 10.000% 70.000% ## ( 1300, 1900 ] 14 8.750% 78.750% ## ( 1900, 2900 ] 16 10.000% 88.750% ## ( 2900, 4400 ] 14 8.750% 97.500% ## ( 4400, 6600 ] 4 2.500% 100.000% # ** DB Stats ** Uptime(secs): 39.8 total, 3.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 197.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.130 H:M:S, 45.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 297.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.606 H:M:S, 18.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-14:28:09 ... thread 0: (1000000,9000000) ops and (290148.3,209144.2) ops/second in (3.446513,43.032516) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 4.24 GB 239.1 7.8 0.0 7.8 16.4 8.5 0.0 1.9 140.3 293.7 57.02 52.33 149 0.383 8122K 11K 0.0 0.0 L1 11/11 1.29 GB 0.0 5.5 4.1 1.4 5.5 4.0 0.2 1.3 223.7 220.7 25.30 23.81 3 8.434 5747K 75K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 2.8 1.5 244.4 244.3 0.77 0.74 1 0.773 191K 86 0.0 0.0 L3 14/0 980.50 MB 1.0 1.8 0.8 1.0 1.8 0.8 2.2 2.3 169.3 169.1 11.13 7.99 7 1.589 1885K 2230 0.0 0.0 L4 169/0 9.65 GB 1.0 1.9 1.6 0.3 1.9 1.6 1.2 1.2 115.4 115.0 17.10 9.40 15 1.140 1941K 5381 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1288/21 104.59 GB 0.0 17.3 6.6 10.6 25.7 15.1 9.1 3.0 159.0 236.8 111.31 94.27 175 0.636 17M 94K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.3 6.6 10.6 25.7 15.1 9.1 3.0 159.0 236.8 111.31 94.27 175 0.636 17M 94K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.3 6.6 10.6 17.2 6.6 0.0 0.0 209.4 208.3 84.54 71.63 52 1.626 17M 94K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 327.0 26.78 22.64 123 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.2 total, 43.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.75 GB write, 609.64 MB/s write, 17.29 GB read, 409.39 MB/s read, 111.3 seconds Interval compaction: 25.75 GB write, 612.64 MB/s write, 17.29 GB read, 411.40 MB/s read, 111.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 48, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3514841 Average: 2.5360 StdDev: 22.22 Min: 0 Median: 1.4472 Max: 7603 Percentiles: P50: 1.45 P75: 1.83 P99: 5.95 P99.9: 109.47 P99.99: 264.73 ------------------------------------------------------ [ 0, 1 ] 739572 21.041% 21.041% #### ( 1, 2 ] 2276161 64.759% 85.800% ############# ( 2, 3 ] 275048 7.825% 93.625% ## ( 3, 4 ] 116179 3.305% 96.931% # ( 4, 6 ] 74702 2.125% 99.056% ( 6, 10 ] 22499 0.640% 99.696% ( 10, 15 ] 3917 0.111% 99.808% ( 15, 22 ] 564 0.016% 99.824% ( 22, 34 ] 25 0.001% 99.824% ( 34, 51 ] 16 0.000% 99.825% ( 51, 76 ] 46 0.001% 99.826% ( 76, 110 ] 2638 0.075% 99.901% ( 110, 170 ] 2465 0.070% 99.971% ( 170, 250 ] 608 0.017% 99.989% ( 250, 380 ] 437 0.012% 100.001% ( 380, 580 ] 415 0.012% 100.013% ( 580, 870 ] 212 0.006% 100.019% ( 870, 1300 ] 78 0.002% 100.021% ( 1300, 1900 ] 52 0.001% 100.023% ( 1900, 2900 ] 65 0.002% 100.024% ( 2900, 4400 ] 44 0.001% 100.026% ( 4400, 6600 ] 6 0.000% 100.026% ( 6600, 9900 ] 2 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1020656 Average: 4.6056 StdDev: 73.12 Min: 1 Median: 1.6252 Max: 9649 Percentiles: P50: 1.63 P75: 2.23 P99: 9.19 P99.9: 130.87 P99.99: 442.42 ------------------------------------------------------ [ 0, 1 ] 137789 13.500% 13.500% ### ( 1, 2 ] 595864 58.380% 71.881% ############ ( 2, 3 ] 138465 13.566% 85.447% ### ( 3, 4 ] 63248 6.197% 91.644% # ( 4, 6 ] 60199 5.898% 97.542% # ( 6, 10 ] 18655 1.828% 99.369% ( 10, 15 ] 3596 0.352% 99.722% ( 15, 22 ] 557 0.055% 99.776% ( 22, 34 ] 43 0.004% 99.781% ( 34, 51 ] 7 0.001% 99.781% ( 51, 76 ] 76 0.007% 99.789% ( 76, 110 ] 914 0.090% 99.878% ( 110, 170 ] 642 0.063% 99.941% ( 170, 250 ] 196 0.019% 99.960% ( 250, 380 ] 205 0.020% 99.980% ( 380, 580 ] 317 0.031% 100.011% ( 580, 870 ] 252 0.025% 100.036% ( 870, 1300 ] 156 0.015% 100.051% ( 1300, 1900 ] 121 0.012% 100.063% ( 1900, 2900 ] 133 0.013% 100.076% ( 2900, 4400 ] 170 0.017% 100.093% ( 4400, 6600 ] 49 0.005% 100.098% ( 6600, 9900 ] 9 0.001% 100.099% ** Level 2 read latency histogram (micros): Count: 76235 Average: 3.8268 StdDev: 52.04 Min: 0 Median: 1.4930 Max: 4009 Percentiles: P50: 1.49 P75: 1.89 P99: 7.87 P99.9: 443.00 P99.99: 3129.42 ------------------------------------------------------ [ 0, 1 ] 14441 18.943% 18.943% #### ( 1, 2 ] 48028 63.000% 81.943% ############# ( 2, 3 ] 6970 9.143% 91.085% ## ( 3, 4 ] 3423 4.490% 95.576% # ( 4, 6 ] 2253 2.955% 98.531% # ( 6, 10 ] 766 1.005% 99.536% ( 10, 15 ] 118 0.155% 99.690% ( 15, 22 ] 8 0.010% 99.701% ( 22, 34 ] 2 0.003% 99.704% ( 51, 76 ] 1 0.001% 99.705% ( 76, 110 ] 47 0.062% 99.767% ( 110, 170 ] 31 0.041% 99.807% ( 170, 250 ] 29 0.038% 99.845% ( 250, 380 ] 32 0.042% 99.887% ( 380, 580 ] 31 0.041% 99.928% ( 580, 870 ] 17 0.022% 99.950% ( 870, 1300 ] 16 0.021% 99.971% ( 1300, 1900 ] 6 0.008% 99.979% ( 1900, 2900 ] 7 0.009% 99.988% ( 2900, 4400 ] 9 0.012% 100.000% ** Level 3 read latency histogram (micros): Count: 391760 Average: 11.0120 StdDev: 131.70 Min: 0 Median: 1.7871 Max: 9169 Percentiles: P50: 1.79 P75: 2.78 P99: 13.67 P99.9: 1204.69 P99.99: 2169.12 ------------------------------------------------------ [ 0, 1 ] 27425 7.000% 7.000% # ( 1, 2 ] 214031 54.633% 61.634% ########### ( 2, 3 ] 67237 17.163% 78.796% ### ( 3, 4 ] 36052 9.203% 87.999% ## ( 4, 6 ] 33003 8.424% 96.423% ## ( 6, 10 ] 8791 2.244% 98.667% ( 10, 15 ] 1776 0.453% 99.121% ( 15, 22 ] 313 0.080% 99.201% ( 22, 34 ] 56 0.014% 99.215% ( 34, 51 ] 3 0.001% 99.216% ( 51, 76 ] 9 0.002% 99.218% ( 76, 110 ] 78 0.020% 99.238% ( 110, 170 ] 227 0.058% 99.296% ( 170, 250 ] 357 0.091% 99.387% ( 250, 380 ] 468 0.119% 99.506% ( 380, 580 ] 616 0.157% 99.664% ( 580, 870 ] 604 0.154% 99.818% ( 870, 1300 ] 414 0.106% 99.923% ( 1300, 1900 ] 207 0.053% 99.976% ( 1900, 2900 ] 200 0.051% 100.027% ( 2900, 4400 ] 222 0.057% 100.084% ( 4400, 6600 ] 36 0.009% 100.093% ( 6600, 9900 ] 7 0.002% 100.095% ** Level 4 read latency histogram (micros): Count: 22725 Average: 6.7057 StdDev: 88.82 Min: 1 Median: 1.8381 Max: 4743 Percentiles: P50: 1.84 P75: 2.79 P99: 9.44 P99.9: 1422.81 P99.99: 4018.25 ------------------------------------------------------ [ 0, 1 ] 870 3.828% 3.828% # ( 1, 2 ] 12520 55.094% 58.922% ########### ( 2, 3 ] 4653 20.475% 79.397% #### ( 3, 4 ] 2083 9.166% 88.563% ## ( 4, 6 ] 2107 9.272% 97.835% ## ( 6, 10 ] 308 1.355% 99.190% ( 10, 15 ] 60 0.264% 99.454% ( 15, 22 ] 13 0.057% 99.512% ( 22, 34 ] 17 0.075% 99.586% ( 34, 51 ] 4 0.018% 99.604% ( 51, 76 ] 1 0.004% 99.608% ( 76, 110 ] 1 0.004% 99.613% ( 110, 170 ] 4 0.018% 99.630% ( 170, 250 ] 23 0.101% 99.732% ( 250, 380 ] 6 0.026% 99.758% ( 380, 580 ] 8 0.035% 99.793% ( 580, 870 ] 9 0.040% 99.833% ( 870, 1300 ] 12 0.053% 99.886% ( 1300, 1900 ] 16 0.070% 99.956% ( 1900, 2900 ] 4 0.018% 99.974% ( 2900, 4400 ] 5 0.022% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1111.8875 StdDev: 1252.59 Min: 85 Median: 543.6364 Max: 5697 Percentiles: P50: 543.64 P75: 1642.86 P99: 5697.00 P99.9: 5697.00 P99.99: 5697.00 ------------------------------------------------------ ( 76, 110 ] 10 6.250% 6.250% # ( 110, 170 ] 28 17.500% 23.750% #### ( 170, 250 ] 15 9.375% 33.125% ## ( 250, 380 ] 18 11.250% 44.375% ## ( 380, 580 ] 11 6.875% 51.250% # ( 580, 870 ] 14 8.750% 60.000% ## ( 870, 1300 ] 16 10.000% 70.000% ## ( 1300, 1900 ] 14 8.750% 78.750% ## ( 1900, 2900 ] 16 10.000% 88.750% ## ( 2900, 4400 ] 14 8.750% 97.500% ## ( 4400, 6600 ] 4 2.500% 100.000% # ** DB Stats ** Uptime(secs): 43.2 total, 3.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 204.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.854 H:M:S, 43.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 285.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.725 H:M:S, 21.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.400 micros/op 156249 ops/sec 60.154 seconds 9398999 operations; 151.4 MB/s Microseconds per write: Count: 9398999 Average: 6.4000 StdDev: 412.63 Min: 0 Median: 1.7348 Max: 828663 Percentiles: P50: 1.73 P75: 2.74 P99: 9.31 P99.9: 1201.71 P99.99: 2730.12 ------------------------------------------------------ [ 0, 1 ] 1254266 13.345% 13.345% ### ( 1, 2 ] 4688723 49.885% 63.230% ########## ( 2, 3 ] 1504802 16.010% 79.240% ### ( 3, 4 ] 1288513 13.709% 92.949% ### ( 4, 6 ] 485234 5.163% 98.112% # ( 6, 10 ] 100940 1.074% 99.186% ( 10, 15 ] 33669 0.358% 99.544% ( 15, 22 ] 8324 0.089% 99.633% ( 22, 34 ] 1663 0.018% 99.650% ( 34, 51 ] 216 0.002% 99.653% ( 51, 76 ] 31 0.000% 99.653% ( 76, 110 ] 6472 0.069% 99.722% ( 110, 170 ] 2682 0.029% 99.750% ( 170, 250 ] 272 0.003% 99.753% ( 250, 380 ] 153 0.002% 99.755% ( 380, 580 ] 16 0.000% 99.755% ( 580, 870 ] 16 0.000% 99.755% ( 870, 1300 ] 17640 0.188% 99.943% ( 1300, 1900 ] 20 0.000% 99.943% ( 1900, 2900 ] 5309 0.056% 100.000% ( 2900, 4400 ] 9 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 189106 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9398999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9699766968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 442 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34460372 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 25422434801 rocksdb.compact.write.bytes COUNT : 25240639913 rocksdb.flush.write.bytes COUNT : 9644479091 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 42 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 256 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9566614528 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3617792 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 25505190424 rocksdb.non.last.level.read.count COUNT : 6162047 rocksdb.block.checksum.compute.count COUNT : 6161206 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.376965 P95 : 3.899214 P99 : 7.844257 P100 : 828660.000000 COUNT : 9398999 SUM : 55785287 rocksdb.compaction.times.micros P50 : 1128076.923077 P95 : 5675000.000000 P99 : 17997307.000000 P100 : 17997307.000000 COUNT : 55 SUM : 101059987 rocksdb.compaction.times.cpu_micros P50 : 963214.285714 P95 : 4850000.000000 P99 : 16762802.000000 P100 : 16762802.000000 COUNT : 55 SUM : 86387761 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 677.922078 P95 : 1228.333333 P99 : 44900.000000 P100 : 466757.000000 COUNT : 130 SUM : 605236 rocksdb.compaction.outfile.sync.micros P50 : 901.272727 P95 : 96000.000000 P99 : 211600.000000 P100 : 250662.000000 COUNT : 292 SUM : 4116833 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 98.139535 P95 : 1171.000000 P99 : 1891.428571 P100 : 5554.000000 COUNT : 210 SUM : 52616 rocksdb.table.open.io.micros P50 : 1277.948718 P95 : 6991.875000 P99 : 11734.750000 P100 : 13779.000000 COUNT : 442 SUM : 841296 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.464537 P95 : 6.476891 P99 : 9.994022 P100 : 11562.000000 COUNT : 6160079 SUM : 33215482 rocksdb.read.block.get.micros P50 : 372.479339 P95 : 2851.111111 P99 : 4444.000000 P100 : 6606.000000 COUNT : 884 SUM : 678348 rocksdb.write.raw.block.micros P50 : 0.512475 P95 : 0.973702 P99 : 2.880360 P100 : 11836.000000 COUNT : 8449307 SUM : 16092243 rocksdb.numfiles.in.singlecompaction P50 : 3.424242 P95 : 8.400000 P99 : 34.680000 P100 : 48.000000 COUNT : 96 SUM : 436 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564125 P95 : 1182.969361 P99 : 2522.225368 P100 : 828488.000000 COUNT : 202645 SUM : 34477789 rocksdb.sst.read.micros P50 : 1.463085 P95 : 3.856802 P99 : 7.862849 P100 : 9649.000000 COUNT : 6162404 SUM : 21082391 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9398999 SUM : 9699766968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214271.844660 P95 : 366071.428571 P99 : 773000.000000 P100 : 975468.000000 COUNT : 130 SUM : 28064476 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 275 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0