[2024-12-05 08:23:07.734540] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-05 08:23:07.734641] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid952763 ] Set seed to 1733383387732184 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-05 08:23:07.830549] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-05 08:23:07.866853] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-05 08:23:07.866895] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 952763' to capture a snapshot of events at runtime. [2024-12-05 08:23:07.866907] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid952763 for offline analysis/debug. [2024-12-05 08:23:07.866930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Dec 5 08:23:12 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/05-08:23:15 ... thread 0: (1000000,1000000) ops and (339979.4,339979.4) ops/second in (2.941355,2.941355) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 566.96 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 354.8 2.49 2.25 12 0.207 0 0 0.0 0.0 L1 1/0 2.39 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 245.3 245.1 1.03 0.99 1 1.027 255K 211 0.0 0.0 L2 3/2 298.12 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.2 1.8 229.4 229.4 0.48 0.46 1 0.485 112K 28 0.0 0.0 L3 18/11 944.35 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 193.6 193.7 0.32 0.26 1 0.322 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1186/19 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.4 1.5 98.5 302.6 4.32 3.97 15 0.288 432K 239 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.4 1.5 98.5 302.6 4.32 3.97 15 0.288 432K 239 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 232.0 231.9 1.83 1.72 3 0.611 432K 239 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 354.8 2.49 2.25 12 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 418.49 MB/s write, 0.42 GB read, 136.24 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 444.19 MB/s write, 0.42 GB read, 144.61 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 124485 Average: 1.8789 StdDev: 15.20 Min: 1 Median: 1.2216 Max: 3172 Percentiles: P50: 1.22 P75: 1.67 P99: 4.56 P99.9: 9.64 P99.99: 286.85 ------------------------------------------------------ [ 0, 1 ] 46777 37.576% 37.576% ######## ( 1, 2 ] 69786 56.060% 93.636% ########### ( 2, 3 ] 4517 3.629% 97.265% # ( 3, 4 ] 1868 1.501% 98.765% ( 4, 6 ] 1045 0.839% 99.605% ( 6, 10 ] 405 0.325% 99.930% ( 10, 15 ] 51 0.041% 99.971% ( 15, 22 ] 5 0.004% 99.975% ( 22, 34 ] 2 0.002% 99.977% ( 34, 51 ] 1 0.001% 99.978% ( 51, 76 ] 6 0.005% 99.982% ( 110, 170 ] 4 0.003% 99.986% ( 170, 250 ] 4 0.003% 99.989% ( 250, 380 ] 9 0.007% 99.996% ( 870, 1300 ] 3 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 2 0.002% 100.001% ( 2900, 4400 ] 1 0.001% 100.002% ** Level 1 read latency histogram (micros): Count: 8639 Average: 2.8309 StdDev: 16.71 Min: 0 Median: 1.6577 Max: 1176 Percentiles: P50: 1.66 P75: 2.30 P99: 8.52 P99.9: 14.51 P99.99: 1114.26 ------------------------------------------------------ [ 0, 1 ] 900 10.418% 10.418% ## ( 1, 2 ] 5199 60.181% 70.598% ############ ( 2, 3 ] 1269 14.689% 85.288% ### ( 3, 4 ] 535 6.193% 91.480% # ( 4, 6 ] 559 6.471% 97.951% # ( 6, 10 ] 144 1.667% 99.618% ( 10, 15 ] 27 0.313% 99.931% ( 15, 22 ] 2 0.023% 99.954% ( 250, 380 ] 2 0.023% 99.977% ( 870, 1300 ] 2 0.023% 100.000% ** Level 2 read latency histogram (micros): Count: 28118 Average: 2.2019 StdDev: 12.88 Min: 0 Median: 1.2435 Max: 1107 Percentiles: P50: 1.24 P75: 1.71 P99: 7.16 P99.9: 88.80 P99.99: 752.29 ------------------------------------------------------ [ 0, 1 ] 10354 36.823% 36.823% ####### ( 1, 2 ] 15218 54.122% 90.945% ########### ( 2, 3 ] 1567 5.573% 96.518% # ( 3, 4 ] 338 1.202% 97.720% ( 4, 6 ] 293 1.042% 98.762% ( 6, 10 ] 231 0.822% 99.584% ( 10, 15 ] 30 0.107% 99.691% ( 15, 22 ] 13 0.046% 99.737% ( 22, 34 ] 1 0.004% 99.740% ( 34, 51 ] 32 0.114% 99.854% ( 51, 76 ] 11 0.039% 99.893% ( 76, 110 ] 5 0.018% 99.911% ( 110, 170 ] 7 0.025% 99.936% ( 170, 250 ] 7 0.025% 99.961% ( 250, 380 ] 5 0.018% 99.979% ( 380, 580 ] 2 0.007% 99.986% ( 580, 870 ] 2 0.007% 99.993% ( 870, 1300 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 18755 Average: 8.3855 StdDev: 115.48 Min: 1 Median: 1.5987 Max: 4953 Percentiles: P50: 1.60 P75: 2.14 P99: 21.73 P99.9: 1216.15 P99.99: 3837.44 ------------------------------------------------------ [ 0, 1 ] 2931 15.628% 15.628% ### ( 1, 2 ] 10767 57.409% 73.037% ########### ( 2, 3 ] 2605 13.890% 86.926% ### ( 3, 4 ] 952 5.076% 92.002% # ( 4, 6 ] 854 4.553% 96.556% # ( 6, 10 ] 346 1.845% 98.400% ( 10, 15 ] 99 0.528% 98.928% ( 15, 22 ] 14 0.075% 99.003% ( 22, 34 ] 1 0.005% 99.008% ( 51, 76 ] 1 0.005% 99.014% ( 76, 110 ] 70 0.373% 99.387% ( 110, 170 ] 30 0.160% 99.547% ( 170, 250 ] 11 0.059% 99.605% ( 250, 380 ] 14 0.075% 99.680% ( 380, 580 ] 20 0.107% 99.787% ( 580, 870 ] 14 0.075% 99.861% ( 870, 1300 ] 9 0.048% 99.909% ( 1300, 1900 ] 1 0.005% 99.915% ( 1900, 2900 ] 6 0.032% 99.947% ( 2900, 4400 ] 13 0.069% 100.016% ( 4400, 6600 ] 1 0.005% 100.021% ** Level 4 read latency histogram (micros): Count: 25 Average: 1504.6400 StdDev: 1465.02 Min: 81 Median: 999.0000 Max: 5648 Percentiles: P50: 999.00 P75: 2150.00 P99: 5648.00 P99.9: 5648.00 P99.99: 5648.00 ------------------------------------------------------ ( 76, 110 ] 3 12.000% 12.000% ## ( 380, 580 ] 3 12.000% 24.000% ## ( 580, 870 ] 5 20.000% 44.000% #### ( 870, 1300 ] 5 20.000% 64.000% #### ( 1300, 1900 ] 2 8.000% 72.000% ## ( 1900, 2900 ] 3 12.000% 84.000% ## ( 2900, 4400 ] 2 8.000% 92.000% ## ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 315.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.377 H:M:S, 12.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.377 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/05-08:23:18 ... thread 0: (1000000,2000000) ops and (328262.9,334018.4) ops/second in (3.046339,5.987694) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.54 GB 100.7 1.0 0.0 1.0 2.8 1.8 0.0 1.5 109.4 314.3 9.22 8.57 29 0.318 1023K 1347 0.0 0.0 L1 1/0 2.39 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 245.3 245.1 1.03 0.99 1 1.027 255K 211 0.0 0.0 L2 2/1 169.36 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.2 1.8 229.4 229.4 0.48 0.46 1 0.485 112K 28 0.0 0.0 L3 75/10 1.05 GB 0.2 0.2 0.2 0.1 0.2 0.2 0.0 1.3 146.1 146.1 1.69 1.27 2 0.847 251K 66 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/19 97.98 GB 0.0 1.6 0.4 1.1 3.4 2.3 0.4 1.9 130.3 282.3 12.42 11.29 33 0.376 1643K 1652 0.0 0.0 Int 0/0 0.00 KB 0.0 1.6 0.4 1.1 3.4 2.3 0.4 1.9 130.3 282.3 12.42 11.29 33 0.376 1643K 1652 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.6 0.4 1.1 1.6 0.4 0.0 0.0 229.3 229.0 7.06 6.51 7 1.008 1643K 1652 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.4 5.36 4.79 26 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.42 GB write, 568.34 MB/s write, 1.58 GB read, 262.32 MB/s read, 12.4 seconds Interval compaction: 3.42 GB write, 585.49 MB/s write, 1.58 GB read, 270.24 MB/s read, 12.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 399787 Average: 2.1334 StdDev: 10.44 Min: 1 Median: 1.4378 Max: 3172 Percentiles: P50: 1.44 P75: 1.84 P99: 5.64 P99.9: 9.80 P99.99: 14.94 ------------------------------------------------------ [ 0, 1 ] 90502 22.638% 22.638% ##### ( 1, 2 ] 249852 62.496% 85.134% ############ ( 2, 3 ] 32102 8.030% 93.164% ## ( 3, 4 ] 15094 3.776% 96.939% # ( 4, 6 ] 10028 2.508% 99.447% # ( 6, 10 ] 1906 0.477% 99.924% ( 10, 15 ] 266 0.067% 99.991% ( 15, 22 ] 33 0.008% 99.999% ( 22, 34 ] 2 0.001% 99.999% ( 34, 51 ] 4 0.001% 100.001% ( 51, 76 ] 10 0.003% 100.003% ( 110, 170 ] 7 0.002% 100.005% ( 170, 250 ] 13 0.003% 100.008% ( 250, 380 ] 15 0.004% 100.012% ( 380, 580 ] 3 0.001% 100.013% ( 580, 870 ] 7 0.002% 100.014% ( 870, 1300 ] 7 0.002% 100.016% ( 1300, 1900 ] 3 0.001% 100.017% ( 1900, 2900 ] 2 0.001% 100.017% ( 2900, 4400 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 32703 Average: 2.6144 StdDev: 8.66 Min: 0 Median: 1.6975 Max: 1176 Percentiles: P50: 1.70 P75: 2.40 P99: 7.33 P99.9: 13.25 P99.99: 297.43 ------------------------------------------------------ [ 0, 1 ] 2587 7.911% 7.911% ## ( 1, 2 ] 19734 60.343% 68.254% ############ ( 2, 3 ] 5564 17.014% 85.267% ### ( 3, 4 ] 2239 6.846% 92.114% # ( 4, 6 ] 2126 6.501% 98.615% # ( 6, 10 ] 380 1.162% 99.777% ( 10, 15 ] 62 0.190% 99.966% ( 15, 22 ] 6 0.018% 99.985% ( 51, 76 ] 1 0.003% 99.988% ( 250, 380 ] 2 0.006% 99.994% ( 870, 1300 ] 2 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 28234 Average: 2.2049 StdDev: 12.85 Min: 0 Median: 1.2467 Max: 1107 Percentiles: P50: 1.25 P75: 1.71 P99: 7.15 P99.9: 88.01 P99.99: 750.61 ------------------------------------------------------ [ 0, 1 ] 10354 36.672% 36.672% ####### ( 1, 2 ] 15253 54.024% 90.696% ########### ( 2, 3 ] 1633 5.784% 96.479% # ( 3, 4 ] 347 1.229% 97.708% ( 4, 6 ] 298 1.055% 98.764% ( 6, 10 ] 232 0.822% 99.586% ( 10, 15 ] 30 0.106% 99.692% ( 15, 22 ] 13 0.046% 99.738% ( 22, 34 ] 1 0.004% 99.741% ( 34, 51 ] 32 0.113% 99.855% ( 51, 76 ] 11 0.039% 99.894% ( 76, 110 ] 5 0.018% 99.911% ( 110, 170 ] 7 0.025% 99.936% ( 170, 250 ] 7 0.025% 99.961% ( 250, 380 ] 5 0.018% 99.979% ( 380, 580 ] 2 0.007% 99.986% ( 580, 870 ] 2 0.007% 99.993% ( 870, 1300 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 220140 Average: 3.4093 StdDev: 36.39 Min: 1 Median: 1.5802 Max: 4953 Percentiles: P50: 1.58 P75: 2.00 P99: 9.26 P99.9: 215.21 P99.99: 716.83 ------------------------------------------------------ [ 0, 1 ] 33266 15.111% 15.111% ### ( 1, 2 ] 132366 60.128% 75.239% ############ ( 2, 3 ] 29559 13.427% 88.667% ### ( 3, 4 ] 10936 4.968% 93.635% # ( 4, 6 ] 8465 3.845% 97.480% # ( 6, 10 ] 4106 1.865% 99.345% ( 10, 15 ] 546 0.248% 99.593% ( 15, 22 ] 127 0.058% 99.651% ( 22, 34 ] 39 0.018% 99.668% ( 34, 51 ] 11 0.005% 99.673% ( 51, 76 ] 5 0.002% 99.676% ( 76, 110 ] 174 0.079% 99.755% ( 110, 170 ] 270 0.123% 99.877% ( 170, 250 ] 90 0.041% 99.918% ( 250, 380 ] 69 0.031% 99.950% ( 380, 580 ] 73 0.033% 99.983% ( 580, 870 ] 36 0.016% 99.999% ( 870, 1300 ] 12 0.005% 100.005% ( 1300, 1900 ] 2 0.001% 100.005% ( 1900, 2900 ] 6 0.003% 100.008% ( 2900, 4400 ] 13 0.006% 100.014% ( 4400, 6600 ] 1 0.000% 100.015% ** Level 4 read latency histogram (micros): Count: 25 Average: 1504.6400 StdDev: 1465.02 Min: 81 Median: 999.0000 Max: 5648 Percentiles: P50: 999.00 P75: 2150.00 P99: 5648.00 P99.9: 5648.00 P99.99: 5648.00 ------------------------------------------------------ ( 76, 110 ] 3 12.000% 12.000% ## ( 380, 580 ] 3 12.000% 24.000% ## ( 580, 870 ] 5 20.000% 44.000% #### ( 870, 1300 ] 5 20.000% 64.000% #### ( 1300, 1900 ] 2 8.000% 72.000% ## ( 1900, 2900 ] 3 12.000% 84.000% ## ( 2900, 4400 ] 2 8.000% 92.000% ## ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 319.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.779 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.402 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/05-08:23:21 ... thread 0: (1000000,3000000) ops and (330252.6,332753.6) ops/second in (3.027985,9.015679) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 2.46 GB 18.9 1.8 0.0 1.8 4.6 2.8 0.0 1.6 121.6 310.1 15.02 14.02 45 0.334 1854K 2204 0.0 0.0 L1 1/1 2.39 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 245.3 245.1 1.03 0.99 1 1.027 255K 211 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 229.4 229.4 0.48 0.46 1 0.485 112K 28 0.0 0.0 L3 21/0 961.48 MB 1.0 1.4 0.4 1.0 1.4 0.4 0.0 3.9 215.7 215.6 6.48 5.72 4 1.620 1390K 613 0.0 0.0 L4 170/0 9.56 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.2 1.0 151.6 151.7 0.82 0.60 1 0.818 125K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/14 98.90 GB 0.0 3.6 0.7 2.9 6.4 3.5 0.8 2.3 155.7 274.6 23.83 21.79 52 0.458 3740K 3056 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 0.7 2.9 6.4 3.5 0.8 2.3 155.7 274.6 23.83 21.79 52 0.458 3740K 3056 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 0.7 2.9 3.6 0.7 0.0 0.0 235.0 234.8 15.79 14.63 13 1.215 3740K 3056 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.6 8.04 7.17 39 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.39 GB write, 711.40 MB/s write, 3.62 GB read, 403.56 MB/s read, 23.8 seconds Interval compaction: 6.39 GB write, 725.66 MB/s write, 3.62 GB read, 411.65 MB/s read, 23.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 668117 Average: 2.1631 StdDev: 11.55 Min: 0 Median: 1.4487 Max: 4980 Percentiles: P50: 1.45 P75: 1.84 P99: 5.61 P99.9: 9.85 P99.99: 21.88 ------------------------------------------------------ [ 0, 1 ] 141496 21.178% 21.178% #### ( 1, 2 ] 429133 64.230% 85.409% ############# ( 2, 3 ] 54013 8.084% 93.493% ## ( 3, 4 ] 24203 3.623% 97.115% # ( 4, 6 ] 15683 2.347% 99.463% ( 6, 10 ] 3036 0.454% 99.917% ( 10, 15 ] 439 0.066% 99.983% ( 15, 22 ] 49 0.007% 99.990% ( 22, 34 ] 6 0.001% 99.991% ( 34, 51 ] 5 0.001% 99.992% ( 51, 76 ] 10 0.001% 99.993% ( 76, 110 ] 5 0.001% 99.994% ( 110, 170 ] 25 0.004% 99.998% ( 170, 250 ] 39 0.006% 100.004% ( 250, 380 ] 33 0.005% 100.009% ( 380, 580 ] 14 0.002% 100.011% ( 580, 870 ] 19 0.003% 100.014% ( 870, 1300 ] 12 0.002% 100.015% ( 1300, 1900 ] 4 0.001% 100.016% ( 1900, 2900 ] 2 0.000% 100.016% ( 2900, 4400 ] 1 0.000% 100.016% ( 4400, 6600 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 63321 Average: 2.4430 StdDev: 6.26 Min: 0 Median: 1.6331 Max: 1176 Percentiles: P50: 1.63 P75: 2.11 P99: 5.97 P99.9: 11.99 P99.99: 20.45 ------------------------------------------------------ [ 0, 1 ] 6058 9.567% 9.567% ## ( 1, 2 ] 40442 63.868% 73.435% ############# ( 2, 3 ] 9174 14.488% 87.923% ### ( 3, 4 ] 3646 5.758% 93.681% # ( 4, 6 ] 3411 5.387% 99.068% # ( 6, 10 ] 492 0.777% 99.845% ( 10, 15 ] 87 0.137% 99.983% ( 15, 22 ] 6 0.009% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.003% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40489 Average: 2.1379 StdDev: 10.74 Min: 0 Median: 1.3126 Max: 1107 Percentiles: P50: 1.31 P75: 1.74 P99: 5.88 P99.9: 52.16 P99.99: 575.11 ------------------------------------------------------ [ 0, 1 ] 12866 31.777% 31.777% ###### ( 1, 2 ] 23604 58.297% 90.074% ############ ( 2, 3 ] 2427 5.994% 96.068% # ( 3, 4 ] 750 1.852% 97.920% ( 4, 6 ] 465 1.148% 99.069% ( 6, 10 ] 253 0.625% 99.694% ( 10, 15 ] 37 0.091% 99.785% ( 15, 22 ] 13 0.032% 99.817% ( 22, 34 ] 1 0.002% 99.820% ( 34, 51 ] 32 0.079% 99.899% ( 51, 76 ] 11 0.027% 99.926% ( 76, 110 ] 5 0.012% 99.938% ( 110, 170 ] 7 0.017% 99.956% ( 170, 250 ] 7 0.017% 99.973% ( 250, 380 ] 5 0.012% 99.985% ( 380, 580 ] 2 0.005% 99.990% ( 580, 870 ] 2 0.005% 99.995% ( 870, 1300 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 295352 Average: 3.1402 StdDev: 31.88 Min: 0 Median: 1.5643 Max: 4953 Percentiles: P50: 1.56 P75: 1.97 P99: 8.81 P99.9: 175.77 P99.99: 711.27 ------------------------------------------------------ [ 0, 1 ] 44947 15.218% 15.218% ### ( 1, 2 ] 182042 61.636% 76.854% ############ ( 2, 3 ] 38257 12.953% 89.807% ### ( 3, 4 ] 13579 4.598% 94.404% # ( 4, 6 ] 10269 3.477% 97.881% # ( 6, 10 ] 4707 1.594% 99.475% ( 10, 15 ] 612 0.207% 99.682% ( 15, 22 ] 132 0.045% 99.727% ( 22, 34 ] 42 0.014% 99.741% ( 34, 51 ] 11 0.004% 99.745% ( 51, 76 ] 6 0.002% 99.747% ( 76, 110 ] 174 0.059% 99.806% ( 110, 170 ] 271 0.092% 99.897% ( 170, 250 ] 106 0.036% 99.933% ( 250, 380 ] 72 0.024% 99.958% ( 380, 580 ] 76 0.026% 99.983% ( 580, 870 ] 43 0.015% 99.998% ( 870, 1300 ] 15 0.005% 100.003% ( 1300, 1900 ] 2 0.001% 100.004% ( 1900, 2900 ] 6 0.002% 100.006% ( 2900, 4400 ] 13 0.004% 100.010% ( 4400, 6600 ] 1 0.000% 100.010% ** Level 4 read latency histogram (micros): Count: 155 Average: 250.6452 StdDev: 805.82 Min: 0 Median: 1.6714 Max: 5648 Percentiles: P50: 1.67 P75: 12.40 P99: 4895.00 P99.9: 5648.00 P99.99: 5648.00 ------------------------------------------------------ [ 0, 1 ] 54 34.839% 34.839% ####### ( 1, 2 ] 35 22.581% 57.419% ##### ( 2, 3 ] 4 2.581% 60.000% # ( 3, 4 ] 5 3.226% 63.226% # ( 4, 6 ] 5 3.226% 66.452% # ( 6, 10 ] 7 4.516% 70.968% # ( 10, 15 ] 13 8.387% 79.355% ## ( 15, 22 ] 2 1.290% 80.645% ( 76, 110 ] 3 1.935% 82.581% ( 110, 170 ] 3 1.935% 84.516% ( 170, 250 ] 2 1.290% 85.806% ( 380, 580 ] 3 1.935% 87.742% ( 580, 870 ] 5 3.226% 90.968% # ( 870, 1300 ] 5 3.226% 94.194% # ( 1300, 1900 ] 2 1.290% 95.484% ( 1900, 2900 ] 3 1.935% 97.419% ( 2900, 4400 ] 2 1.290% 98.710% ( 4400, 6600 ] 2 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 739.6000 StdDev: 1119.94 Min: 135 Median: 170.0000 Max: 4861 Percentiles: P50: 170.00 P75: 580.00 P99: 4861.00 P99.9: 4861.00 P99.99: 4861.00 ------------------------------------------------------ ( 110, 170 ] 10 50.000% 50.000% ########## ( 170, 250 ] 1 5.000% 55.000% # ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 320.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.187 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.408 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/05-08:23:24 ... thread 0: (1000000,4000000) ops and (307583.4,326082.6) ops/second in (3.251151,12.266830) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 3.44 GB 144.8 2.8 0.0 2.8 6.6 3.7 0.0 1.8 132.4 307.9 21.88 20.50 63 0.347 2942K 3306 0.0 0.0 L1 1/1 2.39 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 245.3 245.1 1.03 0.99 1 1.027 255K 211 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 229.4 229.4 0.48 0.46 1 0.485 112K 28 0.0 0.0 L3 21/0 961.48 MB 1.0 1.4 0.4 1.0 1.4 0.4 0.0 3.9 215.7 215.6 6.48 5.72 4 1.620 1390K 613 0.0 0.0 L4 170/0 9.56 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.2 1.0 151.6 151.7 0.82 0.60 1 0.818 125K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/10 99.89 GB 0.0 4.7 0.7 4.0 8.4 4.5 0.8 2.2 155.8 280.9 30.69 28.27 70 0.438 4827K 4158 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 0.7 4.0 8.4 4.5 0.8 2.2 155.8 280.9 30.69 28.27 70 0.438 4827K 4158 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 0.7 4.0 4.7 0.7 0.0 0.0 242.1 241.9 19.76 18.52 17 1.162 4827K 4158 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 351.4 10.93 9.75 53 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.42 GB write, 692.52 MB/s write, 4.67 GB read, 384.20 MB/s read, 30.7 seconds Interval compaction: 8.42 GB write, 702.72 MB/s write, 4.67 GB read, 389.86 MB/s read, 30.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 17, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1081240 Average: 2.1651 StdDev: 11.27 Min: 0 Median: 1.4551 Max: 4980 Percentiles: P50: 1.46 P75: 1.84 P99: 5.57 P99.9: 9.75 P99.99: 14.98 ------------------------------------------------------ [ 0, 1 ] 217760 20.140% 20.140% #### ( 1, 2 ] 709494 65.619% 85.758% ############# ( 2, 3 ] 87567 8.099% 93.857% ## ( 3, 4 ] 37737 3.490% 97.347% # ( 4, 6 ] 22694 2.099% 99.446% ( 6, 10 ] 5233 0.484% 99.930% ( 10, 15 ] 650 0.060% 99.990% ( 15, 22 ] 75 0.007% 99.997% ( 22, 34 ] 9 0.001% 99.998% ( 34, 51 ] 7 0.001% 99.999% ( 51, 76 ] 12 0.001% 100.000% ( 76, 110 ] 7 0.001% 100.000% ( 110, 170 ] 82 0.008% 100.008% ( 170, 250 ] 60 0.006% 100.014% ( 250, 380 ] 47 0.004% 100.018% ( 380, 580 ] 29 0.003% 100.021% ( 580, 870 ] 28 0.003% 100.023% ( 870, 1300 ] 16 0.001% 100.025% ( 1300, 1900 ] 9 0.001% 100.026% ( 1900, 2900 ] 4 0.000% 100.026% ( 2900, 4400 ] 2 0.000% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 63321 Average: 2.4430 StdDev: 6.26 Min: 0 Median: 1.6331 Max: 1176 Percentiles: P50: 1.63 P75: 2.11 P99: 5.97 P99.9: 11.99 P99.99: 20.45 ------------------------------------------------------ [ 0, 1 ] 6058 9.567% 9.567% ## ( 1, 2 ] 40442 63.868% 73.435% ############# ( 2, 3 ] 9174 14.488% 87.923% ### ( 3, 4 ] 3646 5.758% 93.681% # ( 4, 6 ] 3411 5.387% 99.068% # ( 6, 10 ] 492 0.777% 99.845% ( 10, 15 ] 87 0.137% 99.983% ( 15, 22 ] 6 0.009% 99.992% ( 51, 76 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.003% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40489 Average: 2.1379 StdDev: 10.74 Min: 0 Median: 1.3126 Max: 1107 Percentiles: P50: 1.31 P75: 1.74 P99: 5.88 P99.9: 52.16 P99.99: 575.11 ------------------------------------------------------ [ 0, 1 ] 12866 31.777% 31.777% ###### ( 1, 2 ] 23604 58.297% 90.074% ############ ( 2, 3 ] 2427 5.994% 96.068% # ( 3, 4 ] 750 1.852% 97.920% ( 4, 6 ] 465 1.148% 99.069% ( 6, 10 ] 253 0.625% 99.694% ( 10, 15 ] 37 0.091% 99.785% ( 15, 22 ] 13 0.032% 99.817% ( 22, 34 ] 1 0.002% 99.820% ( 34, 51 ] 32 0.079% 99.899% ( 51, 76 ] 11 0.027% 99.926% ( 76, 110 ] 5 0.012% 99.938% ( 110, 170 ] 7 0.017% 99.956% ( 170, 250 ] 7 0.017% 99.973% ( 250, 380 ] 5 0.012% 99.985% ( 380, 580 ] 2 0.005% 99.990% ( 580, 870 ] 2 0.005% 99.995% ( 870, 1300 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 295352 Average: 3.1402 StdDev: 31.88 Min: 0 Median: 1.5643 Max: 4953 Percentiles: P50: 1.56 P75: 1.97 P99: 8.81 P99.9: 175.77 P99.99: 711.27 ------------------------------------------------------ [ 0, 1 ] 44947 15.218% 15.218% ### ( 1, 2 ] 182042 61.636% 76.854% ############ ( 2, 3 ] 38257 12.953% 89.807% ### ( 3, 4 ] 13579 4.598% 94.404% # ( 4, 6 ] 10269 3.477% 97.881% # ( 6, 10 ] 4707 1.594% 99.475% ( 10, 15 ] 612 0.207% 99.682% ( 15, 22 ] 132 0.045% 99.727% ( 22, 34 ] 42 0.014% 99.741% ( 34, 51 ] 11 0.004% 99.745% ( 51, 76 ] 6 0.002% 99.747% ( 76, 110 ] 174 0.059% 99.806% ( 110, 170 ] 271 0.092% 99.897% ( 170, 250 ] 106 0.036% 99.933% ( 250, 380 ] 72 0.024% 99.958% ( 380, 580 ] 76 0.026% 99.983% ( 580, 870 ] 43 0.015% 99.998% ( 870, 1300 ] 15 0.005% 100.003% ( 1300, 1900 ] 2 0.001% 100.004% ( 1900, 2900 ] 6 0.002% 100.006% ( 2900, 4400 ] 13 0.004% 100.010% ( 4400, 6600 ] 1 0.000% 100.010% ** Level 4 read latency histogram (micros): Count: 155 Average: 250.6452 StdDev: 805.82 Min: 0 Median: 1.6714 Max: 5648 Percentiles: P50: 1.67 P75: 12.40 P99: 4895.00 P99.9: 5648.00 P99.99: 5648.00 ------------------------------------------------------ [ 0, 1 ] 54 34.839% 34.839% ####### ( 1, 2 ] 35 22.581% 57.419% ##### ( 2, 3 ] 4 2.581% 60.000% # ( 3, 4 ] 5 3.226% 63.226% # ( 4, 6 ] 5 3.226% 66.452% # ( 6, 10 ] 7 4.516% 70.968% # ( 10, 15 ] 13 8.387% 79.355% ## ( 15, 22 ] 2 1.290% 80.645% ( 76, 110 ] 3 1.935% 82.581% ( 110, 170 ] 3 1.935% 84.516% ( 170, 250 ] 2 1.290% 85.806% ( 380, 580 ] 3 1.935% 87.742% ( 580, 870 ] 5 3.226% 90.968% # ( 870, 1300 ] 5 3.226% 94.194% # ( 1300, 1900 ] 2 1.290% 95.484% ( 1900, 2900 ] 3 1.935% 97.419% ( 2900, 4400 ] 2 1.290% 98.710% ( 4400, 6600 ] 2 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 739.6000 StdDev: 1119.94 Min: 135 Median: 170.0000 Max: 4861 Percentiles: P50: 170.00 P75: 580.00 P99: 4861.00 P99.9: 4861.00 P99.99: 4861.00 ------------------------------------------------------ ( 110, 170 ] 10 50.000% 50.000% ########## ( 170, 250 ] 1 5.000% 55.000% # ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 316.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.802 H:M:S, 14.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.615 H:M:S, 18.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/05-08:23:30 ... thread 0: (1000000,5000000) ops and (176761.7,278953.0) ops/second in (5.657335,17.924165) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 2.33 GB 188.7 4.0 0.0 4.0 8.7 4.7 0.0 1.9 141.3 306.2 28.99 27.24 81 0.358 4157K 5498 0.0 0.0 L1 11/0 1.02 GB 104.0 2.3 2.2 0.1 2.3 2.2 0.1 1.0 230.2 228.2 10.13 9.79 2 5.064 2366K 19K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.2 1.8 229.4 229.4 0.48 0.46 1 0.485 112K 28 0.0 0.0 L3 14/0 997.16 MB 1.0 1.4 0.4 1.0 1.4 0.4 1.0 3.9 215.7 215.6 6.48 5.72 4 1.620 1390K 613 0.0 0.0 L4 172/0 9.54 GB 1.0 0.3 0.2 0.0 0.3 0.2 1.0 1.1 172.9 172.6 1.51 1.22 2 0.756 265K 395 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/8 100.79 GB 0.0 8.0 2.9 5.1 12.7 7.5 4.6 2.7 172.2 272.3 47.59 44.42 90 0.529 8293K 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.0 2.9 5.1 12.7 7.5 4.6 2.7 172.2 272.3 47.59 44.42 90 0.529 8293K 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.0 2.9 5.1 8.0 2.8 0.0 0.0 240.9 240.1 34.02 32.34 22 1.546 8293K 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 352.8 13.57 12.08 68 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.1 total, 17.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.65 GB write, 715.61 MB/s write, 8.00 GB read, 452.64 MB/s read, 47.6 seconds Interval compaction: 12.65 GB write, 722.83 MB/s write, 8.00 GB read, 457.21 MB/s read, 47.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 17, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1700478 Average: 2.1477 StdDev: 11.05 Min: 0 Median: 1.4443 Max: 4980 Percentiles: P50: 1.44 P75: 1.82 P99: 5.61 P99.9: 9.83 P99.99: 20.98 ------------------------------------------------------ [ 0, 1 ] 351360 20.662% 20.662% #### ( 1, 2 ] 1122834 66.030% 86.693% ############# ( 2, 3 ] 128717 7.569% 94.262% ## ( 3, 4 ] 55150 3.243% 97.506% # ( 4, 6 ] 31552 1.855% 99.361% ( 6, 10 ] 9566 0.563% 99.924% ( 10, 15 ] 1036 0.061% 99.985% ( 15, 22 ] 110 0.006% 99.991% ( 22, 34 ] 14 0.001% 99.992% ( 34, 51 ] 8 0.000% 99.992% ( 51, 76 ] 13 0.001% 99.993% ( 76, 110 ] 77 0.005% 99.998% ( 110, 170 ] 169 0.010% 100.008% ( 170, 250 ] 98 0.006% 100.013% ( 250, 380 ] 80 0.005% 100.018% ( 380, 580 ] 45 0.003% 100.021% ( 580, 870 ] 37 0.002% 100.023% ( 870, 1300 ] 18 0.001% 100.024% ( 1300, 1900 ] 12 0.001% 100.025% ( 1900, 2900 ] 7 0.000% 100.025% ( 2900, 4400 ] 5 0.000% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 94036 Average: 2.7519 StdDev: 16.76 Min: 0 Median: 1.6218 Max: 1406 Percentiles: P50: 1.62 P75: 2.03 P99: 5.96 P99.9: 87.29 P99.99: 994.05 ------------------------------------------------------ [ 0, 1 ] 9060 9.635% 9.635% ## ( 1, 2 ] 61048 64.920% 74.554% ############# ( 2, 3 ] 13812 14.688% 89.242% ### ( 3, 4 ] 4942 5.255% 94.498% # ( 4, 6 ] 4314 4.588% 99.085% # ( 6, 10 ] 631 0.671% 99.756% ( 10, 15 ] 115 0.122% 99.879% ( 15, 22 ] 9 0.010% 99.888% ( 51, 76 ] 1 0.001% 99.889% ( 76, 110 ] 30 0.032% 99.921% ( 110, 170 ] 24 0.026% 99.947% ( 170, 250 ] 3 0.003% 99.950% ( 250, 380 ] 16 0.017% 99.967% ( 380, 580 ] 12 0.013% 99.980% ( 580, 870 ] 7 0.007% 99.987% ( 870, 1300 ] 9 0.010% 99.997% ( 1300, 1900 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40489 Average: 2.1379 StdDev: 10.74 Min: 0 Median: 1.3126 Max: 1107 Percentiles: P50: 1.31 P75: 1.74 P99: 5.88 P99.9: 52.16 P99.99: 575.11 ------------------------------------------------------ [ 0, 1 ] 12866 31.777% 31.777% ###### ( 1, 2 ] 23604 58.297% 90.074% ############ ( 2, 3 ] 2427 5.994% 96.068% # ( 3, 4 ] 750 1.852% 97.920% ( 4, 6 ] 465 1.148% 99.069% ( 6, 10 ] 253 0.625% 99.694% ( 10, 15 ] 37 0.091% 99.785% ( 15, 22 ] 13 0.032% 99.817% ( 22, 34 ] 1 0.002% 99.820% ( 34, 51 ] 32 0.079% 99.899% ( 51, 76 ] 11 0.027% 99.926% ( 76, 110 ] 5 0.012% 99.938% ( 110, 170 ] 7 0.017% 99.956% ( 170, 250 ] 7 0.017% 99.973% ( 250, 380 ] 5 0.012% 99.985% ( 380, 580 ] 2 0.005% 99.990% ( 580, 870 ] 2 0.005% 99.995% ( 870, 1300 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 300249 Average: 3.2875 StdDev: 32.37 Min: 0 Median: 1.5644 Max: 4953 Percentiles: P50: 1.56 P75: 1.97 P99: 9.02 P99.9: 219.86 P99.99: 736.01 ------------------------------------------------------ [ 0, 1 ] 45726 15.229% 15.229% ### ( 1, 2 ] 184986 61.611% 76.840% ############ ( 2, 3 ] 38792 12.920% 89.760% ### ( 3, 4 ] 13778 4.589% 94.349% # ( 4, 6 ] 10358 3.450% 97.799% # ( 6, 10 ] 4778 1.591% 99.390% ( 10, 15 ] 635 0.211% 99.602% ( 15, 22 ] 133 0.044% 99.646% ( 22, 34 ] 42 0.014% 99.660% ( 34, 51 ] 11 0.004% 99.664% ( 51, 76 ] 7 0.002% 99.666% ( 76, 110 ] 253 0.084% 99.750% ( 110, 170 ] 360 0.120% 99.870% ( 170, 250 ] 144 0.048% 99.918% ( 250, 380 ] 92 0.031% 99.949% ( 380, 580 ] 96 0.032% 99.981% ( 580, 870 ] 52 0.017% 99.998% ( 870, 1300 ] 15 0.005% 100.003% ( 1300, 1900 ] 2 0.001% 100.004% ( 1900, 2900 ] 6 0.002% 100.006% ( 2900, 4400 ] 13 0.004% 100.010% ( 4400, 6600 ] 1 0.000% 100.010% ** Level 4 read latency histogram (micros): Count: 175 Average: 237.4057 StdDev: 765.12 Min: 0 Median: 1.6707 Max: 5648 Percentiles: P50: 1.67 P75: 13.56 P99: 4675.00 P99.9: 5648.00 P99.99: 5648.00 ------------------------------------------------------ [ 0, 1 ] 60 34.286% 34.286% ####### ( 1, 2 ] 41 23.429% 57.714% ##### ( 2, 3 ] 4 2.286% 60.000% ( 3, 4 ] 5 2.857% 62.857% # ( 4, 6 ] 5 2.857% 65.714% # ( 6, 10 ] 7 4.000% 69.714% # ( 10, 15 ] 13 7.429% 77.143% # ( 15, 22 ] 2 1.143% 78.286% ( 76, 110 ] 4 2.286% 80.571% ( 110, 170 ] 6 3.429% 84.000% # ( 170, 250 ] 4 2.286% 86.286% ( 380, 580 ] 3 1.714% 88.000% ( 580, 870 ] 6 3.429% 91.429% # ( 870, 1300 ] 6 3.429% 94.857% # ( 1300, 1900 ] 2 1.143% 96.000% ( 1900, 2900 ] 3 1.714% 97.714% ( 2900, 4400 ] 2 1.143% 98.857% ( 4400, 6600 ] 2 1.143% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 638.1000 StdDev: 895.60 Min: 73 Median: 164.0000 Max: 4861 Percentiles: P50: 164.00 P75: 870.00 P99: 4840.00 P99.9: 4861.00 P99.99: 4861.00 ------------------------------------------------------ ( 51, 76 ] 2 2.500% 2.500% # ( 76, 110 ] 20 25.000% 27.500% ##### ( 110, 170 ] 20 25.000% 52.500% ##### ( 170, 250 ] 4 5.000% 57.500% # ( 250, 380 ] 4 5.000% 62.500% # ( 380, 580 ] 8 10.000% 72.500% ## ( 580, 870 ] 2 2.500% 75.000% # ( 870, 1300 ] 6 7.500% 82.500% ## ( 1300, 1900 ] 6 7.500% 90.000% ## ( 1900, 2900 ] 6 7.500% 97.500% ## ( 2900, 4400 ] 1 1.250% 98.750% ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 18.1 total, 5.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 271.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.754 H:M:S, 26.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 173.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.951 H:M:S, 52.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/05-08:23:33 ... thread 0: (1000000,6000000) ops and (337328.0,287237.5) ops/second in (2.964474,20.888639) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 3.26 GB 6.3 5.0 0.0 5.0 10.6 5.6 0.0 1.9 144.8 305.3 35.67 33.60 98 0.364 5244K 6565 0.0 0.0 L1 11/11 1.02 GB 0.0 2.3 2.2 0.1 2.3 2.2 0.1 1.0 230.2 228.2 10.13 9.79 2 5.064 2366K 19K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.2 1.8 229.4 229.4 0.48 0.46 1 0.485 112K 28 0.0 0.0 L3 14/0 997.16 MB 1.0 1.4 0.4 1.0 1.4 0.4 1.0 3.9 215.7 215.6 6.48 5.72 4 1.620 1390K 613 0.0 0.0 L4 172/0 9.54 GB 1.0 0.3 0.2 0.0 0.3 0.2 1.0 1.1 172.9 172.6 1.51 1.22 2 0.756 265K 395 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/25 101.71 GB 0.0 9.0 2.9 6.2 14.6 8.4 4.6 2.6 170.7 275.8 54.28 50.78 107 0.507 9380K 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.0 2.9 6.2 14.6 8.4 4.6 2.6 170.7 275.8 54.28 50.78 107 0.507 9380K 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.0 2.9 6.2 9.0 2.8 0.0 0.0 243.5 242.7 38.06 36.32 26 1.464 9380K 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 353.5 16.22 14.46 81 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.1 total, 20.9 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.62 GB write, 710.55 MB/s write, 9.05 GB read, 439.79 MB/s read, 54.3 seconds Interval compaction: 14.62 GB write, 716.70 MB/s write, 9.05 GB read, 443.59 MB/s read, 54.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 21, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1929327 Average: 2.1462 StdDev: 11.48 Min: 0 Median: 1.4277 Max: 4980 Percentiles: P50: 1.43 P75: 1.81 P99: 5.56 P99.9: 9.96 P99.99: 120.83 ------------------------------------------------------ [ 0, 1 ] 425586 22.059% 22.059% #### ( 1, 2 ] 1260465 65.332% 87.391% ############# ( 2, 3 ] 138197 7.163% 94.554% # ( 3, 4 ] 59776 3.098% 97.652% # ( 4, 6 ] 33429 1.733% 99.385% ( 6, 10 ] 10042 0.520% 99.905% ( 10, 15 ] 1199 0.062% 99.967% ( 15, 22 ] 134 0.007% 99.974% ( 22, 34 ] 19 0.001% 99.975% ( 34, 51 ] 10 0.001% 99.976% ( 51, 76 ] 22 0.001% 99.977% ( 76, 110 ] 202 0.010% 99.987% ( 110, 170 ] 294 0.015% 100.002% ( 170, 250 ] 133 0.007% 100.009% ( 250, 380 ] 106 0.005% 100.015% ( 380, 580 ] 60 0.003% 100.018% ( 580, 870 ] 52 0.003% 100.021% ( 870, 1300 ] 21 0.001% 100.022% ( 1300, 1900 ] 14 0.001% 100.022% ( 1900, 2900 ] 9 0.000% 100.023% ( 2900, 4400 ] 6 0.000% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 94037 Average: 2.7519 StdDev: 16.76 Min: 0 Median: 1.6218 Max: 1406 Percentiles: P50: 1.62 P75: 2.03 P99: 5.96 P99.9: 87.29 P99.99: 994.05 ------------------------------------------------------ [ 0, 1 ] 9060 9.635% 9.635% ## ( 1, 2 ] 61048 64.919% 74.554% ############# ( 2, 3 ] 13812 14.688% 89.241% ### ( 3, 4 ] 4943 5.256% 94.498% # ( 4, 6 ] 4314 4.588% 99.085% # ( 6, 10 ] 631 0.671% 99.756% ( 10, 15 ] 115 0.122% 99.879% ( 15, 22 ] 9 0.010% 99.888% ( 51, 76 ] 1 0.001% 99.889% ( 76, 110 ] 30 0.032% 99.921% ( 110, 170 ] 24 0.026% 99.947% ( 170, 250 ] 3 0.003% 99.950% ( 250, 380 ] 16 0.017% 99.967% ( 380, 580 ] 12 0.013% 99.980% ( 580, 870 ] 7 0.007% 99.987% ( 870, 1300 ] 9 0.010% 99.997% ( 1300, 1900 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40489 Average: 2.1379 StdDev: 10.74 Min: 0 Median: 1.3126 Max: 1107 Percentiles: P50: 1.31 P75: 1.74 P99: 5.88 P99.9: 52.16 P99.99: 575.11 ------------------------------------------------------ [ 0, 1 ] 12866 31.777% 31.777% ###### ( 1, 2 ] 23604 58.297% 90.074% ############ ( 2, 3 ] 2427 5.994% 96.068% # ( 3, 4 ] 750 1.852% 97.920% ( 4, 6 ] 465 1.148% 99.069% ( 6, 10 ] 253 0.625% 99.694% ( 10, 15 ] 37 0.091% 99.785% ( 15, 22 ] 13 0.032% 99.817% ( 22, 34 ] 1 0.002% 99.820% ( 34, 51 ] 32 0.079% 99.899% ( 51, 76 ] 11 0.027% 99.926% ( 76, 110 ] 5 0.012% 99.938% ( 110, 170 ] 7 0.017% 99.956% ( 170, 250 ] 7 0.017% 99.973% ( 250, 380 ] 5 0.012% 99.985% ( 380, 580 ] 2 0.005% 99.990% ( 580, 870 ] 2 0.005% 99.995% ( 870, 1300 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 300249 Average: 3.2875 StdDev: 32.37 Min: 0 Median: 1.5644 Max: 4953 Percentiles: P50: 1.56 P75: 1.97 P99: 9.02 P99.9: 219.86 P99.99: 736.01 ------------------------------------------------------ [ 0, 1 ] 45726 15.229% 15.229% ### ( 1, 2 ] 184986 61.611% 76.840% ############ ( 2, 3 ] 38792 12.920% 89.760% ### ( 3, 4 ] 13778 4.589% 94.349% # ( 4, 6 ] 10358 3.450% 97.799% # ( 6, 10 ] 4778 1.591% 99.390% ( 10, 15 ] 635 0.211% 99.602% ( 15, 22 ] 133 0.044% 99.646% ( 22, 34 ] 42 0.014% 99.660% ( 34, 51 ] 11 0.004% 99.664% ( 51, 76 ] 7 0.002% 99.666% ( 76, 110 ] 253 0.084% 99.750% ( 110, 170 ] 360 0.120% 99.870% ( 170, 250 ] 144 0.048% 99.918% ( 250, 380 ] 92 0.031% 99.949% ( 380, 580 ] 96 0.032% 99.981% ( 580, 870 ] 52 0.017% 99.998% ( 870, 1300 ] 15 0.005% 100.003% ( 1300, 1900 ] 2 0.001% 100.004% ( 1900, 2900 ] 6 0.002% 100.006% ( 2900, 4400 ] 13 0.004% 100.010% ( 4400, 6600 ] 1 0.000% 100.010% ** Level 4 read latency histogram (micros): Count: 175 Average: 237.4057 StdDev: 765.12 Min: 0 Median: 1.6707 Max: 5648 Percentiles: P50: 1.67 P75: 13.56 P99: 4675.00 P99.9: 5648.00 P99.99: 5648.00 ------------------------------------------------------ [ 0, 1 ] 60 34.286% 34.286% ####### ( 1, 2 ] 41 23.429% 57.714% ##### ( 2, 3 ] 4 2.286% 60.000% ( 3, 4 ] 5 2.857% 62.857% # ( 4, 6 ] 5 2.857% 65.714% # ( 6, 10 ] 7 4.000% 69.714% # ( 10, 15 ] 13 7.429% 77.143% # ( 15, 22 ] 2 1.143% 78.286% ( 76, 110 ] 4 2.286% 80.571% ( 110, 170 ] 6 3.429% 84.000% # ( 170, 250 ] 4 2.286% 86.286% ( 380, 580 ] 3 1.714% 88.000% ( 580, 870 ] 6 3.429% 91.429% # ( 870, 1300 ] 6 3.429% 94.857% # ( 1300, 1900 ] 2 1.143% 96.000% ( 1900, 2900 ] 3 1.714% 97.714% ( 2900, 4400 ] 2 1.143% 98.857% ( 4400, 6600 ] 2 1.143% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 638.1000 StdDev: 895.60 Min: 73 Median: 164.0000 Max: 4861 Percentiles: P50: 164.00 P75: 870.00 P99: 4840.00 P99.9: 4861.00 P99.99: 4861.00 ------------------------------------------------------ ( 51, 76 ] 2 2.500% 2.500% # ( 76, 110 ] 20 25.000% 27.500% ##### ( 110, 170 ] 20 25.000% 52.500% ##### ( 170, 250 ] 4 5.000% 57.500% # ( 250, 380 ] 4 5.000% 62.500% # ( 380, 580 ] 8 10.000% 72.500% ## ( 580, 870 ] 2 2.500% 75.000% # ( 870, 1300 ] 6 7.500% 82.500% ## ( 1300, 1900 ] 6 7.500% 90.000% ## ( 1900, 2900 ] 6 7.500% 97.500% ## ( 2900, 4400 ] 1 1.250% 98.750% ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 21.1 total, 3.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 280.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.127 H:M:S, 24.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.373 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/05-08:23:39 ... thread 0: (1000000,7000000) ops and (157824.1,257118.5) ops/second in (6.336167,27.224806) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/18 4.30 GB 6.3 6.1 0.0 6.1 12.7 6.6 0.0 1.9 146.0 305.1 42.71 40.24 118 0.362 6332K 7684 0.0 0.0 L1 11/11 1.02 GB 0.0 2.3 2.2 0.1 2.3 2.2 0.1 1.0 230.2 228.2 10.13 9.79 2 5.064 2366K 19K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.2 1.8 229.4 229.4 0.48 0.46 1 0.485 112K 28 0.0 0.0 L3 14/0 997.16 MB 1.0 1.4 0.4 1.0 1.4 0.4 1.0 3.9 215.7 215.6 6.48 5.72 4 1.620 1390K 613 0.0 0.0 L4 172/0 9.54 GB 1.0 0.3 0.2 0.0 0.3 0.2 1.0 1.1 172.9 172.6 1.51 1.22 2 0.756 265K 395 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/29 102.75 GB 0.0 10.1 2.9 7.2 16.7 9.5 4.6 2.5 168.6 279.1 61.31 57.43 127 0.483 10M 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.1 2.9 7.2 16.7 9.5 4.6 2.5 168.6 279.1 61.31 57.43 127 0.483 10M 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.1 2.9 7.2 10.1 2.8 0.0 0.0 246.0 245.3 42.03 40.22 30 1.401 10M 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.8 19.29 17.20 97 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.4 total, 27.2 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.71 GB write, 624.39 MB/s write, 10.10 GB read, 377.19 MB/s read, 61.3 seconds Interval compaction: 16.71 GB write, 628.53 MB/s write, 10.10 GB read, 379.70 MB/s read, 61.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 22, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2588588 Average: 2.1203 StdDev: 10.53 Min: 0 Median: 1.4261 Max: 4980 Percentiles: P50: 1.43 P75: 1.81 P99: 5.54 P99.9: 9.91 P99.99: 103.56 ------------------------------------------------------ [ 0, 1 ] 567811 21.935% 21.935% #### ( 1, 2 ] 1704884 65.862% 87.797% ############# ( 2, 3 ] 180926 6.989% 94.786% # ( 3, 4 ] 76882 2.970% 97.756% # ( 4, 6 ] 41889 1.618% 99.374% ( 6, 10 ] 13908 0.537% 99.912% ( 10, 15 ] 1596 0.062% 99.973% ( 15, 22 ] 179 0.007% 99.980% ( 22, 34 ] 25 0.001% 99.981% ( 34, 51 ] 12 0.000% 99.982% ( 51, 76 ] 22 0.001% 99.982% ( 76, 110 ] 242 0.009% 99.992% ( 110, 170 ] 357 0.014% 100.006% ( 170, 250 ] 155 0.006% 100.012% ( 250, 380 ] 113 0.004% 100.016% ( 380, 580 ] 67 0.003% 100.019% ( 580, 870 ] 60 0.002% 100.021% ( 870, 1300 ] 24 0.001% 100.022% ( 1300, 1900 ] 17 0.001% 100.022% ( 1900, 2900 ] 11 0.000% 100.023% ( 2900, 4400 ] 6 0.000% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 94037 Average: 2.7519 StdDev: 16.76 Min: 0 Median: 1.6218 Max: 1406 Percentiles: P50: 1.62 P75: 2.03 P99: 5.96 P99.9: 87.29 P99.99: 994.05 ------------------------------------------------------ [ 0, 1 ] 9060 9.635% 9.635% ## ( 1, 2 ] 61048 64.919% 74.554% ############# ( 2, 3 ] 13812 14.688% 89.241% ### ( 3, 4 ] 4943 5.256% 94.498% # ( 4, 6 ] 4314 4.588% 99.085% # ( 6, 10 ] 631 0.671% 99.756% ( 10, 15 ] 115 0.122% 99.879% ( 15, 22 ] 9 0.010% 99.888% ( 51, 76 ] 1 0.001% 99.889% ( 76, 110 ] 30 0.032% 99.921% ( 110, 170 ] 24 0.026% 99.947% ( 170, 250 ] 3 0.003% 99.950% ( 250, 380 ] 16 0.017% 99.967% ( 380, 580 ] 12 0.013% 99.980% ( 580, 870 ] 7 0.007% 99.987% ( 870, 1300 ] 9 0.010% 99.997% ( 1300, 1900 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40489 Average: 2.1379 StdDev: 10.74 Min: 0 Median: 1.3126 Max: 1107 Percentiles: P50: 1.31 P75: 1.74 P99: 5.88 P99.9: 52.16 P99.99: 575.11 ------------------------------------------------------ [ 0, 1 ] 12866 31.777% 31.777% ###### ( 1, 2 ] 23604 58.297% 90.074% ############ ( 2, 3 ] 2427 5.994% 96.068% # ( 3, 4 ] 750 1.852% 97.920% ( 4, 6 ] 465 1.148% 99.069% ( 6, 10 ] 253 0.625% 99.694% ( 10, 15 ] 37 0.091% 99.785% ( 15, 22 ] 13 0.032% 99.817% ( 22, 34 ] 1 0.002% 99.820% ( 34, 51 ] 32 0.079% 99.899% ( 51, 76 ] 11 0.027% 99.926% ( 76, 110 ] 5 0.012% 99.938% ( 110, 170 ] 7 0.017% 99.956% ( 170, 250 ] 7 0.017% 99.973% ( 250, 380 ] 5 0.012% 99.985% ( 380, 580 ] 2 0.005% 99.990% ( 580, 870 ] 2 0.005% 99.995% ( 870, 1300 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 300249 Average: 3.2875 StdDev: 32.37 Min: 0 Median: 1.5644 Max: 4953 Percentiles: P50: 1.56 P75: 1.97 P99: 9.02 P99.9: 219.86 P99.99: 736.01 ------------------------------------------------------ [ 0, 1 ] 45726 15.229% 15.229% ### ( 1, 2 ] 184986 61.611% 76.840% ############ ( 2, 3 ] 38792 12.920% 89.760% ### ( 3, 4 ] 13778 4.589% 94.349% # ( 4, 6 ] 10358 3.450% 97.799% # ( 6, 10 ] 4778 1.591% 99.390% ( 10, 15 ] 635 0.211% 99.602% ( 15, 22 ] 133 0.044% 99.646% ( 22, 34 ] 42 0.014% 99.660% ( 34, 51 ] 11 0.004% 99.664% ( 51, 76 ] 7 0.002% 99.666% ( 76, 110 ] 253 0.084% 99.750% ( 110, 170 ] 360 0.120% 99.870% ( 170, 250 ] 144 0.048% 99.918% ( 250, 380 ] 92 0.031% 99.949% ( 380, 580 ] 96 0.032% 99.981% ( 580, 870 ] 52 0.017% 99.998% ( 870, 1300 ] 15 0.005% 100.003% ( 1300, 1900 ] 2 0.001% 100.004% ( 1900, 2900 ] 6 0.002% 100.006% ( 2900, 4400 ] 13 0.004% 100.010% ( 4400, 6600 ] 1 0.000% 100.010% ** Level 4 read latency histogram (micros): Count: 175 Average: 237.4057 StdDev: 765.12 Min: 0 Median: 1.6707 Max: 5648 Percentiles: P50: 1.67 P75: 13.56 P99: 4675.00 P99.9: 5648.00 P99.99: 5648.00 ------------------------------------------------------ [ 0, 1 ] 60 34.286% 34.286% ####### ( 1, 2 ] 41 23.429% 57.714% ##### ( 2, 3 ] 4 2.286% 60.000% ( 3, 4 ] 5 2.857% 62.857% # ( 4, 6 ] 5 2.857% 65.714% # ( 6, 10 ] 7 4.000% 69.714% # ( 10, 15 ] 13 7.429% 77.143% # ( 15, 22 ] 2 1.143% 78.286% ( 76, 110 ] 4 2.286% 80.571% ( 110, 170 ] 6 3.429% 84.000% # ( 170, 250 ] 4 2.286% 86.286% ( 380, 580 ] 3 1.714% 88.000% ( 580, 870 ] 6 3.429% 91.429% # ( 870, 1300 ] 6 3.429% 94.857% # ( 1300, 1900 ] 2 1.143% 96.000% ( 1900, 2900 ] 3 1.714% 97.714% ( 2900, 4400 ] 2 1.143% 98.857% ( 4400, 6600 ] 2 1.143% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 638.1000 StdDev: 895.60 Min: 73 Median: 164.0000 Max: 4861 Percentiles: P50: 164.00 P75: 870.00 P99: 4840.00 P99.9: 4861.00 P99.99: 4861.00 ------------------------------------------------------ ( 51, 76 ] 2 2.500% 2.500% # ( 76, 110 ] 20 25.000% 27.500% ##### ( 110, 170 ] 20 25.000% 52.500% ##### ( 170, 250 ] 4 5.000% 57.500% # ( 250, 380 ] 4 5.000% 62.500% # ( 380, 580 ] 8 10.000% 72.500% ## ( 580, 870 ] 2 2.500% 75.000% # ( 870, 1300 ] 6 7.500% 82.500% ## ( 1300, 1900 ] 6 7.500% 90.000% ## ( 1900, 2900 ] 6 7.500% 97.500% ## ( 2900, 4400 ] 1 1.250% 98.750% ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 27.4 total, 6.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 251.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.687 H:M:S, 31.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 155.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.560 H:M:S, 56.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/05-08:23:59 ... thread 0: (1000000,8000000) ops and (50647.8,170325.1) ops/second in (19.744201,46.969007) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/2 2.02 GB 18.9 8.7 0.0 8.7 16.2 7.6 0.0 2.1 155.4 290.7 57.14 52.57 137 0.417 9016K 15K 0.0 0.0 L1 11/11 1015.06 MB 0.0 6.5 5.4 1.1 6.4 5.3 0.1 1.2 209.2 205.9 31.76 29.03 3 10.586 6744K 102K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.4 1.8 229.4 229.4 0.48 0.46 1 0.485 112K 28 0.0 0.0 L3 35/13 2.24 GB 1.6 3.6 1.7 1.9 3.6 1.7 2.8 2.1 140.2 139.1 26.45 16.67 11 2.405 3738K 30K 0.0 0.0 L4 193/9 11.37 GB 1.2 2.2 2.1 0.1 2.2 2.1 1.0 1.1 123.0 122.6 18.42 11.06 23 0.801 2301K 6530 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/35 103.55 GB 0.0 21.1 9.3 11.8 28.5 16.7 9.5 3.8 160.9 217.5 134.27 109.79 175 0.767 21M 155K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.1 9.3 11.8 28.5 16.7 9.5 3.8 160.9 217.5 134.27 109.79 175 0.767 21M 155K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.1 9.3 11.8 21.0 9.1 0.0 0.0 193.7 192.3 111.56 90.11 64 1.743 21M 155K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 341.3 22.70 19.68 111 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.2 total, 47.0 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.52 GB write, 619.33 MB/s write, 21.10 GB read, 458.29 MB/s read, 134.3 seconds Interval compaction: 28.52 GB write, 621.71 MB/s write, 21.10 GB read, 460.05 MB/s read, 134.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 27, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 27, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 42, total-stops: 34, interval: 76 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3797876 Average: 2.8562 StdDev: 31.54 Min: 0 Median: 1.4411 Max: 15841 Percentiles: P50: 1.44 P75: 1.83 P99: 7.28 P99.9: 156.17 P99.99: 372.79 ------------------------------------------------------ [ 0, 1 ] 814846 21.455% 21.455% #### ( 1, 2 ] 2457620 64.710% 86.166% ############# ( 2, 3 ] 280315 7.381% 93.547% # ( 3, 4 ] 121660 3.203% 96.750% # ( 4, 6 ] 76346 2.010% 98.760% ( 6, 10 ] 28432 0.749% 99.509% ( 10, 15 ] 3310 0.087% 99.596% ( 15, 22 ] 493 0.013% 99.609% ( 22, 34 ] 33 0.001% 99.610% ( 34, 51 ] 100 0.003% 99.612% ( 51, 76 ] 216 0.006% 99.618% ( 76, 110 ] 6379 0.168% 99.786% ( 110, 170 ] 5624 0.148% 99.934% ( 170, 250 ] 1308 0.034% 99.969% ( 250, 380 ] 862 0.023% 99.991% ( 380, 580 ] 641 0.017% 100.008% ( 580, 870 ] 282 0.007% 100.016% ( 870, 1300 ] 74 0.002% 100.018% ( 1300, 1900 ] 39 0.001% 100.019% ( 1900, 2900 ] 35 0.001% 100.019% ( 2900, 4400 ] 71 0.002% 100.021% ( 4400, 6600 ] 17 0.000% 100.022% ( 6600, 9900 ] 11 0.000% 100.022% ( 14000, 22000 ] 3 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1068117 Average: 6.7077 StdDev: 111.90 Min: 0 Median: 1.8055 Max: 18055 Percentiles: P50: 1.81 P75: 2.88 P99: 9.65 P99.9: 87.85 P99.99: 118.74 ------------------------------------------------------ [ 0, 1 ] 88438 8.280% 8.280% ## ( 1, 2 ] 553219 51.794% 60.074% ########## ( 2, 3 ] 181490 16.992% 77.065% ### ( 3, 4 ] 98675 9.238% 86.303% ## ( 4, 6 ] 109304 10.233% 96.537% ## ( 6, 10 ] 28864 2.702% 99.239% # ( 10, 15 ] 5695 0.533% 99.772% ( 15, 22 ] 749 0.070% 99.842% ( 22, 34 ] 38 0.004% 99.846% ( 34, 51 ] 16 0.001% 99.847% ( 51, 76 ] 121 0.011% 99.859% ( 76, 110 ] 1262 0.118% 99.977% ( 110, 170 ] 955 0.089% 100.066% ( 170, 250 ] 375 0.035% 100.101% ( 250, 380 ] 357 0.033% 100.135% ( 380, 580 ] 456 0.043% 100.178% ( 580, 870 ] 347 0.032% 100.210% ( 870, 1300 ] 291 0.027% 100.237% ( 1300, 1900 ] 140 0.013% 100.250% ( 1900, 2900 ] 172 0.016% 100.267% ( 2900, 4400 ] 401 0.038% 100.304% ( 4400, 6600 ] 116 0.011% 100.315% ( 6600, 9900 ] 30 0.003% 100.318% ( 9900, 14000 ] 3 0.000% 100.318% ( 14000, 22000 ] 3 0.000% 100.318% ** Level 2 read latency histogram (micros): Count: 40489 Average: 2.1379 StdDev: 10.74 Min: 0 Median: 1.3126 Max: 1107 Percentiles: P50: 1.31 P75: 1.74 P99: 5.88 P99.9: 52.16 P99.99: 575.11 ------------------------------------------------------ [ 0, 1 ] 12866 31.777% 31.777% ###### ( 1, 2 ] 23604 58.297% 90.074% ############ ( 2, 3 ] 2427 5.994% 96.068% # ( 3, 4 ] 750 1.852% 97.920% ( 4, 6 ] 465 1.148% 99.069% ( 6, 10 ] 253 0.625% 99.694% ( 10, 15 ] 37 0.091% 99.785% ( 15, 22 ] 13 0.032% 99.817% ( 22, 34 ] 1 0.002% 99.820% ( 34, 51 ] 32 0.079% 99.899% ( 51, 76 ] 11 0.027% 99.926% ( 76, 110 ] 5 0.012% 99.938% ( 110, 170 ] 7 0.017% 99.956% ( 170, 250 ] 7 0.017% 99.973% ( 250, 380 ] 5 0.012% 99.985% ( 380, 580 ] 2 0.005% 99.990% ( 580, 870 ] 2 0.005% 99.995% ( 870, 1300 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 769867 Average: 6.4747 StdDev: 108.83 Min: 0 Median: 1.8001 Max: 23221 Percentiles: P50: 1.80 P75: 2.76 P99: 8.80 P99.9: 136.90 P99.99: 316.20 ------------------------------------------------------ [ 0, 1 ] 54468 7.075% 7.075% # ( 1, 2 ] 413015 53.648% 60.723% ########### ( 2, 3 ] 143729 18.669% 79.392% #### ( 3, 4 ] 71044 9.228% 88.620% ## ( 4, 6 ] 71069 9.231% 97.851% ## ( 6, 10 ] 12642 1.642% 99.493% ( 10, 15 ] 2292 0.298% 99.791% ( 15, 22 ] 268 0.035% 99.826% ( 22, 34 ] 66 0.009% 99.835% ( 34, 51 ] 16 0.002% 99.837% ( 51, 76 ] 9 0.001% 99.838% ( 76, 110 ] 281 0.036% 99.874% ( 110, 170 ] 453 0.059% 99.933% ( 170, 250 ] 277 0.036% 99.969% ( 250, 380 ] 326 0.042% 100.011% ( 380, 580 ] 444 0.058% 100.069% ( 580, 870 ] 430 0.056% 100.125% ( 870, 1300 ] 323 0.042% 100.167% ( 1300, 1900 ] 171 0.022% 100.189% ( 1900, 2900 ] 147 0.019% 100.208% ( 2900, 4400 ] 219 0.028% 100.237% ( 4400, 6600 ] 29 0.004% 100.240% ( 6600, 9900 ] 18 0.002% 100.243% ( 14000, 22000 ] 4 0.001% 100.243% ( 22000, 33000 ] 3 0.000% 100.244% ** Level 4 read latency histogram (micros): Count: 10389 Average: 58.7294 StdDev: 338.10 Min: 0 Median: 1.9681 Max: 7418 Percentiles: P50: 1.97 P75: 3.34 P99: 1477.22 P99.9: 4878.68 P99.99: 6592.87 ------------------------------------------------------ [ 0, 1 ] 692 6.661% 6.661% # ( 1, 2 ] 4651 44.769% 51.429% ######### ( 2, 3 ] 2079 20.012% 71.441% #### ( 3, 4 ] 1098 10.569% 82.010% ## ( 4, 6 ] 849 8.172% 90.182% ## ( 6, 10 ] 292 2.811% 92.993% # ( 10, 15 ] 70 0.674% 93.666% ( 15, 22 ] 18 0.173% 93.840% ( 22, 34 ] 2 0.019% 93.859% ( 34, 51 ] 2 0.019% 93.878% ( 51, 76 ] 11 0.106% 93.984% ( 76, 110 ] 14 0.135% 94.119% ( 110, 170 ] 48 0.462% 94.581% ( 170, 250 ] 89 0.857% 95.437% ( 250, 380 ] 78 0.751% 96.188% ( 380, 580 ] 83 0.799% 96.987% ( 580, 870 ] 94 0.905% 97.892% ( 870, 1300 ] 103 0.991% 98.883% ( 1300, 1900 ] 41 0.395% 99.278% ( 1900, 2900 ] 33 0.318% 99.596% ( 2900, 4400 ] 29 0.279% 99.875% ( 4400, 6600 ] 12 0.116% 99.990% ( 6600, 9900 ] 1 0.010% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 638.1000 StdDev: 895.60 Min: 73 Median: 164.0000 Max: 4861 Percentiles: P50: 164.00 P75: 870.00 P99: 4840.00 P99.9: 4861.00 P99.99: 4861.00 ------------------------------------------------------ ( 51, 76 ] 2 2.500% 2.500% # ( 76, 110 ] 20 25.000% 27.500% ##### ( 110, 170 ] 20 25.000% 52.500% ##### ( 170, 250 ] 4 5.000% 57.500% # ( 250, 380 ] 4 5.000% 62.500% # ( 380, 580 ] 8 10.000% 72.500% ## ( 580, 870 ] 2 2.500% 75.000% # ( 870, 1300 ] 6 7.500% 82.500% ## ( 1300, 1900 ] 6 7.500% 90.000% ## ( 1900, 2900 ] 6 7.500% 97.500% ## ( 2900, 4400 ] 1 1.250% 98.750% ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 47.2 total, 19.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 166.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.778 H:M:S, 52.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 49.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:16.091 H:M:S, 81.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/05-08:24:02 ... thread 0: (1000000,9000000) ops and (291332.9,178566.1) ops/second in (3.432499,50.401506) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/6 2.94 GB 88.1 9.3 0.0 9.3 17.8 8.5 0.0 2.1 151.5 288.8 63.19 57.71 152 0.416 9720K 16K 0.0 0.0 L1 11/11 1015.06 MB 0.0 6.5 5.4 1.1 6.4 5.3 0.1 1.2 209.2 205.9 31.76 29.03 3 10.586 6744K 102K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.4 1.8 229.4 229.4 0.48 0.46 1 0.485 112K 28 0.0 0.0 L3 13/0 881.56 MB 0.9 3.6 1.7 1.9 3.6 1.7 2.8 2.1 140.2 139.1 26.45 16.67 11 2.405 3738K 30K 0.0 0.0 L4 167/0 9.43 GB 1.0 3.8 3.5 0.3 3.8 3.4 1.0 1.1 129.2 128.8 29.93 18.37 38 0.788 3927K 11K 0.0 0.0 L5 1096/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/17 104.47 GB 0.0 23.3 10.7 12.7 31.7 19.0 12.9 3.7 157.4 213.6 151.82 122.25 205 0.741 24M 160K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.3 10.7 12.7 31.7 19.0 12.9 3.7 157.4 213.6 151.82 122.25 205 0.741 24M 160K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.3 10.7 12.7 23.2 10.5 0.0 0.0 190.0 188.7 125.82 100.08 81 1.553 24M 160K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 334.4 26.00 22.17 124 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.6 total, 50.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.68 GB write, 641.22 MB/s write, 23.34 GB read, 472.53 MB/s read, 151.8 seconds Interval compaction: 31.68 GB write, 643.52 MB/s write, 23.34 GB read, 474.23 MB/s read, 151.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 27, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 27, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 47, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 42, total-stops: 47, interval: 89 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4207088 Average: 2.8537 StdDev: 31.06 Min: 0 Median: 1.4593 Max: 15841 Percentiles: P50: 1.46 P75: 1.85 P99: 7.33 P99.9: 151.69 P99.99: 355.88 ------------------------------------------------------ [ 0, 1 ] 855422 20.333% 20.333% #### ( 1, 2 ] 2717458 64.592% 84.925% ############# ( 2, 3 ] 338749 8.052% 92.977% ## ( 3, 4 ] 145554 3.460% 96.437% # ( 4, 6 ] 96580 2.296% 98.732% ( 6, 10 ] 33787 0.803% 99.536% ( 10, 15 ] 4087 0.097% 99.633% ( 15, 22 ] 565 0.013% 99.646% ( 22, 34 ] 42 0.001% 99.647% ( 34, 51 ] 102 0.002% 99.650% ( 51, 76 ] 223 0.005% 99.655% ( 76, 110 ] 6387 0.152% 99.807% ( 110, 170 ] 5651 0.134% 99.941% ( 170, 250 ] 1335 0.032% 99.973% ( 250, 380 ] 893 0.021% 99.994% ( 380, 580 ] 681 0.016% 100.010% ( 580, 870 ] 307 0.007% 100.017% ( 870, 1300 ] 94 0.002% 100.020% ( 1300, 1900 ] 51 0.001% 100.021% ( 1900, 2900 ] 54 0.001% 100.022% ( 2900, 4400 ] 79 0.002% 100.024% ( 4400, 6600 ] 17 0.000% 100.024% ( 6600, 9900 ] 11 0.000% 100.025% ( 14000, 22000 ] 3 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1198507 Average: 6.6920 StdDev: 109.56 Min: 0 Median: 1.8153 Max: 18055 Percentiles: P50: 1.82 P75: 2.88 P99: 9.64 P99.9: 92.03 P99.99: 135.33 ------------------------------------------------------ [ 0, 1 ] 91106 7.602% 7.602% ## ( 1, 2 ] 623248 52.002% 59.604% ########## ( 2, 3 ] 209938 17.517% 77.120% #### ( 3, 4 ] 111405 9.295% 86.416% ## ( 4, 6 ] 121612 10.147% 96.563% ## ( 6, 10 ] 32145 2.682% 99.245% # ( 10, 15 ] 6255 0.522% 99.767% ( 15, 22 ] 823 0.069% 99.835% ( 22, 34 ] 42 0.004% 99.839% ( 34, 51 ] 16 0.001% 99.840% ( 51, 76 ] 121 0.010% 99.850% ( 76, 110 ] 1267 0.106% 99.956% ( 110, 170 ] 969 0.081% 100.037% ( 170, 250 ] 403 0.034% 100.070% ( 250, 380 ] 416 0.035% 100.105% ( 380, 580 ] 547 0.046% 100.151% ( 580, 870 ] 439 0.037% 100.187% ( 870, 1300 ] 349 0.029% 100.216% ( 1300, 1900 ] 175 0.015% 100.231% ( 1900, 2900 ] 200 0.017% 100.248% ( 2900, 4400 ] 438 0.037% 100.284% ( 4400, 6600 ] 120 0.010% 100.294% ( 6600, 9900 ] 31 0.003% 100.297% ( 9900, 14000 ] 3 0.000% 100.297% ( 14000, 22000 ] 3 0.000% 100.297% ** Level 2 read latency histogram (micros): Count: 40489 Average: 2.1379 StdDev: 10.74 Min: 0 Median: 1.3126 Max: 1107 Percentiles: P50: 1.31 P75: 1.74 P99: 5.88 P99.9: 52.16 P99.99: 575.11 ------------------------------------------------------ [ 0, 1 ] 12866 31.777% 31.777% ###### ( 1, 2 ] 23604 58.297% 90.074% ############ ( 2, 3 ] 2427 5.994% 96.068% # ( 3, 4 ] 750 1.852% 97.920% ( 4, 6 ] 465 1.148% 99.069% ( 6, 10 ] 253 0.625% 99.694% ( 10, 15 ] 37 0.091% 99.785% ( 15, 22 ] 13 0.032% 99.817% ( 22, 34 ] 1 0.002% 99.820% ( 34, 51 ] 32 0.079% 99.899% ( 51, 76 ] 11 0.027% 99.926% ( 76, 110 ] 5 0.012% 99.938% ( 110, 170 ] 7 0.017% 99.956% ( 170, 250 ] 7 0.017% 99.973% ( 250, 380 ] 5 0.012% 99.985% ( 380, 580 ] 2 0.005% 99.990% ( 580, 870 ] 2 0.005% 99.995% ( 870, 1300 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 904533 Average: 6.9730 StdDev: 114.95 Min: 0 Median: 1.8184 Max: 23221 Percentiles: P50: 1.82 P75: 2.80 P99: 8.91 P99.9: 151.19 P99.99: 377.78 ------------------------------------------------------ [ 0, 1 ] 57265 6.331% 6.331% # ( 1, 2 ] 482643 53.358% 59.689% ########### ( 2, 3 ] 173307 19.160% 78.849% #### ( 3, 4 ] 85496 9.452% 88.301% ## ( 4, 6 ] 85538 9.457% 97.758% ## ( 6, 10 ] 15433 1.706% 99.464% ( 10, 15 ] 2916 0.322% 99.786% ( 15, 22 ] 325 0.036% 99.822% ( 22, 34 ] 75 0.008% 99.830% ( 34, 51 ] 21 0.002% 99.833% ( 51, 76 ] 12 0.001% 99.834% ( 76, 110 ] 281 0.031% 99.865% ( 110, 170 ] 461 0.051% 99.916% ( 170, 250 ] 298 0.033% 99.949% ( 250, 380 ] 378 0.042% 99.991% ( 380, 580 ] 501 0.055% 100.046% ( 580, 870 ] 537 0.059% 100.105% ( 870, 1300 ] 418 0.046% 100.152% ( 1300, 1900 ] 236 0.026% 100.178% ( 1900, 2900 ] 216 0.024% 100.202% ( 2900, 4400 ] 292 0.032% 100.234% ( 4400, 6600 ] 50 0.006% 100.239% ( 6600, 9900 ] 26 0.003% 100.242% ( 9900, 14000 ] 2 0.000% 100.243% ( 14000, 22000 ] 4 0.000% 100.243% ( 22000, 33000 ] 3 0.000% 100.243% ** Level 4 read latency histogram (micros): Count: 44767 Average: 29.0097 StdDev: 218.01 Min: 0 Median: 1.8543 Max: 7418 Percentiles: P50: 1.85 P75: 2.87 P99: 853.38 P99.9: 3454.80 P99.99: 5373.60 ------------------------------------------------------ [ 0, 1 ] 1819 4.063% 4.063% # ( 1, 2 ] 24072 53.772% 57.835% ########### ( 2, 3 ] 8786 19.626% 77.461% #### ( 3, 4 ] 3976 8.882% 86.343% ## ( 4, 6 ] 3445 7.695% 94.038% ## ( 6, 10 ] 1067 2.383% 96.421% ( 10, 15 ] 196 0.438% 96.859% ( 15, 22 ] 32 0.071% 96.931% ( 22, 34 ] 9 0.020% 96.951% ( 34, 51 ] 5 0.011% 96.962% ( 51, 76 ] 12 0.027% 96.989% ( 76, 110 ] 34 0.076% 97.065% ( 110, 170 ] 90 0.201% 97.266% ( 170, 250 ] 162 0.362% 97.628% ( 250, 380 ] 162 0.362% 97.990% ( 380, 580 ] 211 0.471% 98.461% ( 580, 870 ] 256 0.572% 99.033% ( 870, 1300 ] 207 0.462% 99.495% ( 1300, 1900 ] 100 0.223% 99.719% ( 1900, 2900 ] 62 0.138% 99.857% ( 2900, 4400 ] 52 0.116% 99.973% ( 4400, 6600 ] 17 0.038% 100.011% ( 6600, 9900 ] 1 0.002% 100.013% ** Level 5 read latency histogram (micros): Count: 280 Average: 1371.2393 StdDev: 1525.03 Min: 73 Median: 673.2143 Max: 7069 Percentiles: P50: 673.21 P75: 2175.86 P99: 6496.47 P99.9: 7069.00 P99.99: 7069.00 ------------------------------------------------------ ( 51, 76 ] 2 0.714% 0.714% ( 76, 110 ] 26 9.286% 10.000% ## ( 110, 170 ] 30 10.714% 20.714% ## ( 170, 250 ] 8 2.857% 23.571% # ( 250, 380 ] 25 8.929% 32.500% ## ( 380, 580 ] 40 14.286% 46.786% ### ( 580, 870 ] 28 10.000% 56.786% ## ( 870, 1300 ] 26 9.286% 66.071% ## ( 1300, 1900 ] 17 6.071% 72.143% # ( 1900, 2900 ] 29 10.357% 82.500% ## ( 2900, 4400 ] 30 10.714% 93.214% ## ( 4400, 6600 ] 17 6.071% 99.286% # ( 6600, 9900 ] 2 0.714% 100.000% ** DB Stats ** Uptime(secs): 50.6 total, 3.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 175.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.462 H:M:S, 50.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.684 H:M:S, 19.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/05-08:24:05 ... thread 0: (1000000,10000000) ops and (298653.0,186046.9) ops/second in (3.348368,53.749874) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/2 3.93 GB 214.0 10.4 0.0 10.4 19.9 9.5 0.0 2.1 151.2 288.8 70.38 64.50 169 0.416 10M 17K 0.0 0.0 L1 11/11 1015.06 MB 0.0 6.5 5.4 1.1 6.4 5.3 0.1 1.2 209.2 205.9 31.76 29.03 3 10.586 6744K 102K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.4 1.8 229.4 229.4 0.48 0.46 1 0.485 112K 28 0.0 0.0 L3 13/0 881.56 MB 0.9 3.6 1.7 1.9 3.6 1.7 2.8 2.1 140.2 139.1 26.45 16.67 11 2.405 3738K 30K 0.0 0.0 L4 167/0 9.43 GB 1.0 3.8 3.5 0.3 3.8 3.4 1.0 1.1 129.2 128.8 29.93 18.37 38 0.788 3927K 11K 0.0 0.0 L5 1096/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/13 105.45 GB 0.0 24.4 10.7 13.7 33.7 20.0 12.9 3.6 157.1 217.1 159.00 129.04 222 0.716 25M 161K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.4 10.7 13.7 33.7 20.0 12.9 3.6 157.1 217.1 159.00 129.04 222 0.716 25M 161K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.4 10.7 13.7 24.2 10.5 0.0 0.0 192.1 190.9 130.00 104.19 85 1.529 25M 161K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 334.5 29.01 24.85 137 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.9 total, 53.8 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.70 GB write, 639.93 MB/s write, 24.39 GB read, 463.05 MB/s read, 159.0 seconds Interval compaction: 33.70 GB write, 642.08 MB/s write, 24.39 GB read, 464.61 MB/s read, 159.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 27, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 27, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 42, total-stops: 53, interval: 95 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4550550 Average: 2.8049 StdDev: 29.95 Min: 0 Median: 1.4634 Max: 15841 Percentiles: P50: 1.46 P75: 1.85 P99: 7.15 P99.9: 147.34 P99.99: 338.82 ------------------------------------------------------ [ 0, 1 ] 907743 19.948% 19.948% #### ( 1, 2 ] 2951082 64.851% 84.799% ############# ( 2, 3 ] 373699 8.212% 93.011% ## ( 3, 4 ] 158268 3.478% 96.489% # ( 4, 6 ] 103809 2.281% 98.771% ( 6, 10 ] 36225 0.796% 99.567% ( 10, 15 ] 4298 0.094% 99.661% ( 15, 22 ] 585 0.013% 99.674% ( 22, 34 ] 45 0.001% 99.675% ( 34, 51 ] 104 0.002% 99.677% ( 51, 76 ] 224 0.005% 99.682% ( 76, 110 ] 6395 0.141% 99.823% ( 110, 170 ] 5660 0.124% 99.947% ( 170, 250 ] 1341 0.029% 99.976% ( 250, 380 ] 903 0.020% 99.996% ( 380, 580 ] 683 0.015% 100.011% ( 580, 870 ] 314 0.007% 100.018% ( 870, 1300 ] 98 0.002% 100.020% ( 1300, 1900 ] 53 0.001% 100.022% ( 1900, 2900 ] 56 0.001% 100.023% ( 2900, 4400 ] 79 0.002% 100.024% ( 4400, 6600 ] 17 0.000% 100.025% ( 6600, 9900 ] 11 0.000% 100.025% ( 14000, 22000 ] 3 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1277346 Average: 6.4379 StdDev: 106.17 Min: 0 Median: 1.7896 Max: 18055 Percentiles: P50: 1.79 P75: 2.82 P99: 9.59 P99.9: 94.46 P99.99: 140.86 ------------------------------------------------------ [ 0, 1 ] 104004 8.142% 8.142% ## ( 1, 2 ] 677178 53.014% 61.157% ########### ( 2, 3 ] 216845 16.976% 78.133% ### ( 3, 4 ] 113632 8.896% 87.029% ## ( 4, 6 ] 123015 9.631% 96.659% ## ( 6, 10 ] 33358 2.612% 99.271% # ( 10, 15 ] 6319 0.495% 99.766% ( 15, 22 ] 826 0.065% 99.830% ( 22, 34 ] 42 0.003% 99.833% ( 34, 51 ] 16 0.001% 99.835% ( 51, 76 ] 122 0.010% 99.844% ( 76, 110 ] 1311 0.103% 99.947% ( 110, 170 ] 1070 0.084% 100.031% ( 170, 250 ] 424 0.033% 100.064% ( 250, 380 ] 427 0.033% 100.097% ( 380, 580 ] 557 0.044% 100.141% ( 580, 870 ] 444 0.035% 100.176% ( 870, 1300 ] 349 0.027% 100.203% ( 1300, 1900 ] 176 0.014% 100.217% ( 1900, 2900 ] 200 0.016% 100.232% ( 2900, 4400 ] 438 0.034% 100.267% ( 4400, 6600 ] 120 0.009% 100.276% ( 6600, 9900 ] 31 0.002% 100.279% ( 9900, 14000 ] 3 0.000% 100.279% ( 14000, 22000 ] 3 0.000% 100.279% ** Level 2 read latency histogram (micros): Count: 40489 Average: 2.1379 StdDev: 10.74 Min: 0 Median: 1.3126 Max: 1107 Percentiles: P50: 1.31 P75: 1.74 P99: 5.88 P99.9: 52.16 P99.99: 575.11 ------------------------------------------------------ [ 0, 1 ] 12866 31.777% 31.777% ###### ( 1, 2 ] 23604 58.297% 90.074% ############ ( 2, 3 ] 2427 5.994% 96.068% # ( 3, 4 ] 750 1.852% 97.920% ( 4, 6 ] 465 1.148% 99.069% ( 6, 10 ] 253 0.625% 99.694% ( 10, 15 ] 37 0.091% 99.785% ( 15, 22 ] 13 0.032% 99.817% ( 22, 34 ] 1 0.002% 99.820% ( 34, 51 ] 32 0.079% 99.899% ( 51, 76 ] 11 0.027% 99.926% ( 76, 110 ] 5 0.012% 99.938% ( 110, 170 ] 7 0.017% 99.956% ( 170, 250 ] 7 0.017% 99.973% ( 250, 380 ] 5 0.012% 99.985% ( 380, 580 ] 2 0.005% 99.990% ( 580, 870 ] 2 0.005% 99.995% ( 870, 1300 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 904533 Average: 6.9730 StdDev: 114.95 Min: 0 Median: 1.8184 Max: 23221 Percentiles: P50: 1.82 P75: 2.80 P99: 8.91 P99.9: 151.19 P99.99: 377.78 ------------------------------------------------------ [ 0, 1 ] 57265 6.331% 6.331% # ( 1, 2 ] 482643 53.358% 59.689% ########### ( 2, 3 ] 173307 19.160% 78.849% #### ( 3, 4 ] 85496 9.452% 88.301% ## ( 4, 6 ] 85538 9.457% 97.758% ## ( 6, 10 ] 15433 1.706% 99.464% ( 10, 15 ] 2916 0.322% 99.786% ( 15, 22 ] 325 0.036% 99.822% ( 22, 34 ] 75 0.008% 99.830% ( 34, 51 ] 21 0.002% 99.833% ( 51, 76 ] 12 0.001% 99.834% ( 76, 110 ] 281 0.031% 99.865% ( 110, 170 ] 461 0.051% 99.916% ( 170, 250 ] 298 0.033% 99.949% ( 250, 380 ] 378 0.042% 99.991% ( 380, 580 ] 501 0.055% 100.046% ( 580, 870 ] 537 0.059% 100.105% ( 870, 1300 ] 418 0.046% 100.152% ( 1300, 1900 ] 236 0.026% 100.178% ( 1900, 2900 ] 216 0.024% 100.202% ( 2900, 4400 ] 292 0.032% 100.234% ( 4400, 6600 ] 50 0.006% 100.239% ( 6600, 9900 ] 26 0.003% 100.242% ( 9900, 14000 ] 2 0.000% 100.243% ( 14000, 22000 ] 4 0.000% 100.243% ( 22000, 33000 ] 3 0.000% 100.243% ** Level 4 read latency histogram (micros): Count: 44767 Average: 29.0097 StdDev: 218.01 Min: 0 Median: 1.8543 Max: 7418 Percentiles: P50: 1.85 P75: 2.87 P99: 853.38 P99.9: 3454.80 P99.99: 5373.60 ------------------------------------------------------ [ 0, 1 ] 1819 4.063% 4.063% # ( 1, 2 ] 24072 53.772% 57.835% ########### ( 2, 3 ] 8786 19.626% 77.461% #### ( 3, 4 ] 3976 8.882% 86.343% ## ( 4, 6 ] 3445 7.695% 94.038% ## ( 6, 10 ] 1067 2.383% 96.421% ( 10, 15 ] 196 0.438% 96.859% ( 15, 22 ] 32 0.071% 96.931% ( 22, 34 ] 9 0.020% 96.951% ( 34, 51 ] 5 0.011% 96.962% ( 51, 76 ] 12 0.027% 96.989% ( 76, 110 ] 34 0.076% 97.065% ( 110, 170 ] 90 0.201% 97.266% ( 170, 250 ] 162 0.362% 97.628% ( 250, 380 ] 162 0.362% 97.990% ( 380, 580 ] 211 0.471% 98.461% ( 580, 870 ] 256 0.572% 99.033% ( 870, 1300 ] 207 0.462% 99.495% ( 1300, 1900 ] 100 0.223% 99.719% ( 1900, 2900 ] 62 0.138% 99.857% ( 2900, 4400 ] 52 0.116% 99.973% ( 4400, 6600 ] 17 0.038% 100.011% ( 6600, 9900 ] 1 0.002% 100.013% ** Level 5 read latency histogram (micros): Count: 280 Average: 1371.2393 StdDev: 1525.03 Min: 73 Median: 673.2143 Max: 7069 Percentiles: P50: 673.21 P75: 2175.86 P99: 6496.47 P99.9: 7069.00 P99.99: 7069.00 ------------------------------------------------------ ( 51, 76 ] 2 0.714% 0.714% ( 76, 110 ] 26 9.286% 10.000% ## ( 110, 170 ] 30 10.714% 20.714% ## ( 170, 250 ] 8 2.857% 23.571% # ( 250, 380 ] 25 8.929% 32.500% ## ( 380, 580 ] 40 14.286% 46.786% ### ( 580, 870 ] 28 10.000% 56.786% ## ( 870, 1300 ] 26 9.286% 66.071% ## ( 1300, 1900 ] 17 6.071% 72.143% # ( 1900, 2900 ] 29 10.357% 82.500% ## ( 2900, 4400 ] 30 10.714% 93.214% ## ( 4400, 6600 ] 17 6.071% 99.286% # ( 6600, 9900 ] 2 0.714% 100.000% ** DB Stats ** Uptime(secs): 53.9 total, 3.3 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 182.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.142 H:M:S, 48.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 293.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.680 H:M:S, 20.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/05-08:24:08 ... thread 0: (1000000,11000000) ops and (325597.7,193589.9) ops/second in (3.071275,56.821149) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/10 4.85 GB 251.7 11.0 0.0 11.0 21.4 10.4 0.0 2.1 148.9 290.2 75.69 69.47 185 0.409 11M 18K 0.0 0.0 L1 11/11 1015.06 MB 0.0 6.5 5.4 1.1 6.4 5.3 0.1 1.2 209.2 205.9 31.76 29.03 3 10.586 6744K 102K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.4 1.8 229.4 229.4 0.48 0.46 1 0.485 112K 28 0.0 0.0 L3 13/0 881.56 MB 0.9 3.6 1.7 1.9 3.6 1.7 2.8 2.1 140.2 139.1 26.45 16.67 11 2.405 3738K 30K 0.0 0.0 L4 167/0 9.43 GB 1.0 3.8 3.5 0.3 3.8 3.4 1.0 1.1 129.2 128.8 29.93 18.37 38 0.788 3927K 11K 0.0 0.0 L5 1096/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/21 106.37 GB 0.0 25.0 10.7 14.4 35.3 21.0 12.9 3.4 155.8 220.0 164.32 134.00 238 0.690 25M 162K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.0 10.7 14.4 35.3 21.0 12.9 3.4 155.8 220.0 164.32 134.00 238 0.690 25M 162K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.0 10.7 14.4 24.8 10.5 0.0 0.0 193.4 192.2 132.37 106.51 87 1.522 25M 162K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 335.2 31.95 27.49 151 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.0 total, 56.8 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.30 GB write, 634.17 MB/s write, 25.00 GB read, 449.16 MB/s read, 164.3 seconds Interval compaction: 35.30 GB write, 636.19 MB/s write, 25.00 GB read, 450.58 MB/s read, 164.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 27, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 27, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 42, total-stops: 56, interval: 98 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4834011 Average: 2.7697 StdDev: 29.15 Min: 0 Median: 1.4652 Max: 15841 Percentiles: P50: 1.47 P75: 1.85 P99: 6.98 P99.9: 144.26 P99.99: 329.14 ------------------------------------------------------ [ 0, 1 ] 954658 19.749% 19.749% #### ( 1, 2 ] 3143589 65.031% 84.779% ############# ( 2, 3 ] 399621 8.267% 93.046% ## ( 3, 4 ] 168598 3.488% 96.534% # ( 4, 6 ] 109940 2.274% 98.808% ( 6, 10 ] 37645 0.779% 99.587% ( 10, 15 ] 4484 0.093% 99.680% ( 15, 22 ] 615 0.013% 99.693% ( 22, 34 ] 46 0.001% 99.694% ( 34, 51 ] 104 0.002% 99.696% ( 51, 76 ] 226 0.005% 99.700% ( 76, 110 ] 6412 0.133% 99.833% ( 110, 170 ] 5676 0.117% 99.950% ( 170, 250 ] 1361 0.028% 99.979% ( 250, 380 ] 911 0.019% 99.997% ( 380, 580 ] 688 0.014% 100.012% ( 580, 870 ] 321 0.007% 100.018% ( 870, 1300 ] 104 0.002% 100.020% ( 1300, 1900 ] 54 0.001% 100.022% ( 1900, 2900 ] 56 0.001% 100.023% ( 2900, 4400 ] 80 0.002% 100.024% ( 4400, 6600 ] 17 0.000% 100.025% ( 6600, 9900 ] 11 0.000% 100.025% ( 14000, 22000 ] 3 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1407264 Average: 6.1055 StdDev: 101.29 Min: 0 Median: 1.7620 Max: 18055 Percentiles: P50: 1.76 P75: 2.73 P99: 9.53 P99.9: 98.54 P99.99: 149.17 ------------------------------------------------------ [ 0, 1 ] 118712 8.436% 8.436% ## ( 1, 2 ] 767652 54.549% 62.985% ########### ( 2, 3 ] 231310 16.437% 79.422% ### ( 3, 4 ] 118077 8.391% 87.812% ## ( 4, 6 ] 126132 8.963% 96.775% ## ( 6, 10 ] 35525 2.524% 99.300% # ( 10, 15 ] 6460 0.459% 99.759% ( 15, 22 ] 835 0.059% 99.818% ( 22, 34 ] 43 0.003% 99.821% ( 34, 51 ] 16 0.001% 99.822% ( 51, 76 ] 131 0.009% 99.832% ( 76, 110 ] 1455 0.103% 99.935% ( 110, 170 ] 1189 0.084% 100.019% ( 170, 250 ] 473 0.034% 100.053% ( 250, 380 ] 462 0.033% 100.086% ( 380, 580 ] 575 0.041% 100.127% ( 580, 870 ] 454 0.032% 100.159% ( 870, 1300 ] 356 0.025% 100.184% ( 1300, 1900 ] 176 0.013% 100.197% ( 1900, 2900 ] 200 0.014% 100.211% ( 2900, 4400 ] 439 0.031% 100.242% ( 4400, 6600 ] 120 0.009% 100.251% ( 6600, 9900 ] 31 0.002% 100.253% ( 9900, 14000 ] 3 0.000% 100.253% ( 14000, 22000 ] 3 0.000% 100.253% ** Level 2 read latency histogram (micros): Count: 40489 Average: 2.1379 StdDev: 10.74 Min: 0 Median: 1.3126 Max: 1107 Percentiles: P50: 1.31 P75: 1.74 P99: 5.88 P99.9: 52.16 P99.99: 575.11 ------------------------------------------------------ [ 0, 1 ] 12866 31.777% 31.777% ###### ( 1, 2 ] 23604 58.297% 90.074% ############ ( 2, 3 ] 2427 5.994% 96.068% # ( 3, 4 ] 750 1.852% 97.920% ( 4, 6 ] 465 1.148% 99.069% ( 6, 10 ] 253 0.625% 99.694% ( 10, 15 ] 37 0.091% 99.785% ( 15, 22 ] 13 0.032% 99.817% ( 22, 34 ] 1 0.002% 99.820% ( 34, 51 ] 32 0.079% 99.899% ( 51, 76 ] 11 0.027% 99.926% ( 76, 110 ] 5 0.012% 99.938% ( 110, 170 ] 7 0.017% 99.956% ( 170, 250 ] 7 0.017% 99.973% ( 250, 380 ] 5 0.012% 99.985% ( 380, 580 ] 2 0.005% 99.990% ( 580, 870 ] 2 0.005% 99.995% ( 870, 1300 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 904533 Average: 6.9730 StdDev: 114.95 Min: 0 Median: 1.8184 Max: 23221 Percentiles: P50: 1.82 P75: 2.80 P99: 8.91 P99.9: 151.19 P99.99: 377.78 ------------------------------------------------------ [ 0, 1 ] 57265 6.331% 6.331% # ( 1, 2 ] 482643 53.358% 59.689% ########### ( 2, 3 ] 173307 19.160% 78.849% #### ( 3, 4 ] 85496 9.452% 88.301% ## ( 4, 6 ] 85538 9.457% 97.758% ## ( 6, 10 ] 15433 1.706% 99.464% ( 10, 15 ] 2916 0.322% 99.786% ( 15, 22 ] 325 0.036% 99.822% ( 22, 34 ] 75 0.008% 99.830% ( 34, 51 ] 21 0.002% 99.833% ( 51, 76 ] 12 0.001% 99.834% ( 76, 110 ] 281 0.031% 99.865% ( 110, 170 ] 461 0.051% 99.916% ( 170, 250 ] 298 0.033% 99.949% ( 250, 380 ] 378 0.042% 99.991% ( 380, 580 ] 501 0.055% 100.046% ( 580, 870 ] 537 0.059% 100.105% ( 870, 1300 ] 418 0.046% 100.152% ( 1300, 1900 ] 236 0.026% 100.178% ( 1900, 2900 ] 216 0.024% 100.202% ( 2900, 4400 ] 292 0.032% 100.234% ( 4400, 6600 ] 50 0.006% 100.239% ( 6600, 9900 ] 26 0.003% 100.242% ( 9900, 14000 ] 2 0.000% 100.243% ( 14000, 22000 ] 4 0.000% 100.243% ( 22000, 33000 ] 3 0.000% 100.243% ** Level 4 read latency histogram (micros): Count: 44767 Average: 29.0097 StdDev: 218.01 Min: 0 Median: 1.8543 Max: 7418 Percentiles: P50: 1.85 P75: 2.87 P99: 853.38 P99.9: 3454.80 P99.99: 5373.60 ------------------------------------------------------ [ 0, 1 ] 1819 4.063% 4.063% # ( 1, 2 ] 24072 53.772% 57.835% ########### ( 2, 3 ] 8786 19.626% 77.461% #### ( 3, 4 ] 3976 8.882% 86.343% ## ( 4, 6 ] 3445 7.695% 94.038% ## ( 6, 10 ] 1067 2.383% 96.421% ( 10, 15 ] 196 0.438% 96.859% ( 15, 22 ] 32 0.071% 96.931% ( 22, 34 ] 9 0.020% 96.951% ( 34, 51 ] 5 0.011% 96.962% ( 51, 76 ] 12 0.027% 96.989% ( 76, 110 ] 34 0.076% 97.065% ( 110, 170 ] 90 0.201% 97.266% ( 170, 250 ] 162 0.362% 97.628% ( 250, 380 ] 162 0.362% 97.990% ( 380, 580 ] 211 0.471% 98.461% ( 580, 870 ] 256 0.572% 99.033% ( 870, 1300 ] 207 0.462% 99.495% ( 1300, 1900 ] 100 0.223% 99.719% ( 1900, 2900 ] 62 0.138% 99.857% ( 2900, 4400 ] 52 0.116% 99.973% ( 4400, 6600 ] 17 0.038% 100.011% ( 6600, 9900 ] 1 0.002% 100.013% ** Level 5 read latency histogram (micros): Count: 280 Average: 1371.2393 StdDev: 1525.03 Min: 73 Median: 673.2143 Max: 7069 Percentiles: P50: 673.21 P75: 2175.86 P99: 6496.47 P99.9: 7069.00 P99.99: 7069.00 ------------------------------------------------------ ( 51, 76 ] 2 0.714% 0.714% ( 76, 110 ] 26 9.286% 10.000% ## ( 110, 170 ] 30 10.714% 20.714% ## ( 170, 250 ] 8 2.857% 23.571% # ( 250, 380 ] 25 8.929% 32.500% ## ( 380, 580 ] 40 14.286% 46.786% ### ( 580, 870 ] 28 10.000% 56.786% ## ( 870, 1300 ] 26 9.286% 66.071% ## ( 1300, 1900 ] 17 6.071% 72.143% # ( 1900, 2900 ] 29 10.357% 82.500% ## ( 2900, 4400 ] 30 10.714% 93.214% ## ( 4400, 6600 ] 17 6.071% 99.286% # ( 6600, 9900 ] 2 0.714% 100.000% ** DB Stats ** Uptime(secs): 57.0 total, 3.1 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 189.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.571 H:M:S, 46.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.429 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.449 micros/op 183511 ops/sec 60.084 seconds 11025999 operations; 177.8 MB/s Microseconds per write: Count: 11025999 Average: 5.4493 StdDev: 329.80 Min: 0 Median: 1.7267 Max: 563146 Percentiles: P50: 1.73 P75: 2.73 P99: 9.53 P99.9: 1105.20 P99.99: 2612.74 ------------------------------------------------------ [ 0, 1 ] 1563488 14.180% 14.180% ### ( 1, 2 ] 5435046 49.293% 63.473% ########## ( 2, 3 ] 1740558 15.786% 79.259% ### ( 3, 4 ] 1474815 13.376% 92.635% ### ( 4, 6 ] 577871 5.241% 97.876% # ( 6, 10 ] 140360 1.273% 99.149% ( 10, 15 ] 48185 0.437% 99.586% ( 15, 22 ] 11382 0.103% 99.689% ( 22, 34 ] 2448 0.022% 99.711% ( 34, 51 ] 251 0.002% 99.713% ( 51, 76 ] 29 0.000% 99.714% ( 76, 110 ] 7613 0.069% 99.783% ( 110, 170 ] 3011 0.027% 99.810% ( 170, 250 ] 341 0.003% 99.813% ( 250, 380 ] 228 0.002% 99.815% ( 380, 580 ] 49 0.000% 99.816% ( 580, 870 ] 19 0.000% 99.816% ( 870, 1300 ] 16964 0.154% 99.970% ( 1300, 1900 ] 56 0.001% 99.970% ( 1900, 2900 ] 3062 0.028% 99.998% ( 2900, 4400 ] 163 0.001% 99.999% ( 4400, 6600 ] 16 0.000% 100.000% ( 6600, 9900 ] 16 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 4 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 201791 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11025999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11378830968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 589 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29600138 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30962607714 rocksdb.compact.write.bytes COUNT : 30752392464 rocksdb.flush.write.bytes COUNT : 11361718867 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 65 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 364 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11270213632 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4484096 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31067667950 rocksdb.non.last.level.read.count COUNT : 7500164 rocksdb.block.checksum.compute.count COUNT : 7499051 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.379943 P95 : 3.924510 P99 : 8.137765 P100 : 563139.000000 COUNT : 11025999 SUM : 54972544 rocksdb.compaction.times.micros P50 : 1002580.645161 P95 : 3600000.000000 P99 : 18400000.000000 P100 : 21630117.000000 COUNT : 90 SUM : 148671781 rocksdb.compaction.times.cpu_micros P50 : 914838.709677 P95 : 3600000.000000 P99 : 14800000.000000 P100 : 19239014.000000 COUNT : 90 SUM : 120974831 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 679.382022 P95 : 1240.875000 P99 : 2370.000000 P100 : 5751.000000 COUNT : 153 SUM : 110063 rocksdb.compaction.outfile.sync.micros P50 : 1064.843750 P95 : 173058.823529 P99 : 242141.176471 P100 : 645036.000000 COUNT : 367 SUM : 7651404 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 93.226667 P95 : 815.625000 P99 : 2333.333333 P100 : 3390.000000 COUNT : 270 SUM : 54309 rocksdb.table.open.io.micros P50 : 1460.606061 P95 : 8148.870968 P99 : 13139.000000 P100 : 23666.000000 COUNT : 589 SUM : 1293320 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.592622 P95 : 7.715154 P99 : 11.645088 P100 : 23226.000000 COUNT : 7497298 SUM : 46409254 rocksdb.read.block.get.micros P50 : 445.384615 P95 : 3685.820896 P99 : 5739.360000 P100 : 7149.000000 COUNT : 1178 SUM : 1045048 rocksdb.write.raw.block.micros P50 : 0.513624 P95 : 0.975885 P99 : 2.908472 P100 : 46158.000000 COUNT : 10199432 SUM : 20417379 rocksdb.numfiles.in.singlecompaction P50 : 3.220779 P95 : 5.200000 P99 : 39.440000 P100 : 44.000000 COUNT : 136 SUM : 573 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561374 P95 : 1146.240813 P99 : 2339.836280 P100 : 562963.000000 COUNT : 186174 SUM : 29620104 rocksdb.sst.read.micros P50 : 1.551172 P95 : 4.581035 P99 : 8.698043 P100 : 23221.000000 COUNT : 7500286 SUM : 30988126 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11025999 SUM : 11378830968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211785.714286 P95 : 355026.315789 P99 : 638150.000000 P100 : 726166.000000 COUNT : 153 SUM : 32303264 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 366 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0