[2024-11-17 16:42:56.772554] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-17 16:42:56.772654] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1985376 ] Set seed to 1731858176770074 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 16:42:56.880162] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 16:42:57.093631] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 16:42:57.093674] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1985376' to capture a snapshot of events at runtime. [2024-11-17 16:42:57.093684] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1985376 for offline analysis/debug. [2024-11-17 16:42:57.093709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 16:43:05 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-16:43:08 ... thread 0: (1000000,1000000) ops and (362641.4,362641.4) ops/second in (2.757545,2.757545) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 504.02 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 357.5 2.29 2.07 12 0.191 0 0 0.0 0.0 L1 1/0 1.75 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 248.4 248.2 1.01 0.98 1 1.014 255K 197 0.0 0.0 L2 3/2 298.96 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.3 1.8 243.7 243.7 0.46 0.44 1 0.458 113K 30 0.0 0.0 L3 16/9 692.50 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 194.6 194.6 0.32 0.27 1 0.322 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/17 96.94 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 104.3 304.8 4.08 3.76 15 0.272 432K 227 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 104.3 304.8 4.08 3.76 15 0.272 432K 227 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 237.5 237.4 1.79 1.69 3 0.598 432K 227 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 357.5 2.29 2.07 12 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.22 GB write, 418.53 MB/s write, 0.42 GB read, 143.26 MB/s read, 4.1 seconds Interval compaction: 1.22 GB write, 451.18 MB/s write, 0.42 GB read, 154.43 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 112207 Average: 1.8892 StdDev: 12.07 Min: 1 Median: 1.2636 Max: 2839 Percentiles: P50: 1.26 P75: 1.68 P99: 4.45 P99.9: 9.84 P99.99: 327.10 ------------------------------------------------------ [ 0, 1 ] 38329 34.159% 34.159% ####### ( 1, 2 ] 67430 60.094% 94.253% ############ ( 2, 3 ] 3325 2.963% 97.217% # ( 3, 4 ] 1799 1.603% 98.820% ( 4, 6 ] 897 0.799% 99.619% ( 6, 10 ] 331 0.295% 99.914% ( 10, 15 ] 57 0.051% 99.965% ( 15, 22 ] 11 0.010% 99.975% ( 22, 34 ] 4 0.004% 99.979% ( 34, 51 ] 2 0.002% 99.980% ( 51, 76 ] 1 0.001% 99.981% ( 110, 170 ] 9 0.008% 99.989% ( 170, 250 ] 2 0.002% 99.991% ( 250, 380 ] 3 0.003% 99.994% ( 380, 580 ] 3 0.003% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ( 1300, 1900 ] 2 0.002% 100.002% ( 1900, 2900 ] 1 0.001% 100.003% ** Level 1 read latency histogram (micros): Count: 15734 Average: 3.1274 StdDev: 43.54 Min: 0 Median: 1.3316 Max: 4534 Percentiles: P50: 1.33 P75: 1.77 P99: 9.95 P99.9: 215.32 P99.99: 2326.60 ------------------------------------------------------ [ 0, 1 ] 4914 31.232% 31.232% ###### ( 1, 2 ] 8904 56.591% 87.823% ########### ( 2, 3 ] 824 5.237% 93.060% # ( 3, 4 ] 354 2.250% 95.310% ( 4, 6 ] 336 2.136% 97.445% ( 6, 10 ] 248 1.576% 99.021% ( 10, 15 ] 70 0.445% 99.466% ( 15, 22 ] 9 0.057% 99.523% ( 22, 34 ] 2 0.013% 99.536% ( 51, 76 ] 46 0.292% 99.828% ( 76, 110 ] 8 0.051% 99.879% ( 110, 170 ] 1 0.006% 99.886% ( 170, 250 ] 4 0.025% 99.911% ( 250, 380 ] 2 0.013% 99.924% ( 380, 580 ] 6 0.038% 99.962% ( 580, 870 ] 2 0.013% 99.975% ( 870, 1300 ] 2 0.013% 99.987% ( 1900, 2900 ] 1 0.006% 99.994% ( 4400, 6600 ] 1 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 15899 Average: 1.8602 StdDev: 4.38 Min: 1 Median: 1.2769 Max: 359 Percentiles: P50: 1.28 P75: 1.70 P99: 3.99 P99.9: 12.18 P99.99: 276.66 ------------------------------------------------------ [ 0, 1 ] 5372 33.788% 33.788% ####### ( 1, 2 ] 9308 58.545% 92.333% ############ ( 2, 3 ] 787 4.950% 97.283% # ( 3, 4 ] 276 1.736% 99.019% ( 4, 6 ] 78 0.491% 99.509% ( 6, 10 ] 56 0.352% 99.862% ( 10, 15 ] 14 0.088% 99.950% ( 15, 22 ] 3 0.019% 99.969% ( 22, 34 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 8178 Average: 17.3468 StdDev: 236.38 Min: 1 Median: 1.5597 Max: 8004 Percentiles: P50: 1.56 P75: 1.96 P99: 131.53 P99.9: 3952.36 P99.99: 7900.42 ------------------------------------------------------ [ 0, 1 ] 1195 14.612% 14.612% ### ( 1, 2 ] 5171 63.231% 77.843% ############# ( 2, 3 ] 729 8.914% 86.757% ## ( 3, 4 ] 404 4.940% 91.697% # ( 4, 6 ] 375 4.585% 96.283% # ( 6, 10 ] 132 1.614% 97.897% ( 10, 15 ] 60 0.734% 98.630% ( 15, 22 ] 5 0.061% 98.692% ( 22, 34 ] 2 0.024% 98.716% ( 76, 110 ] 6 0.073% 98.789% ( 110, 170 ] 48 0.587% 99.376% ( 170, 250 ] 7 0.086% 99.462% ( 250, 380 ] 3 0.037% 99.499% ( 380, 580 ] 5 0.061% 99.560% ( 580, 870 ] 3 0.037% 99.596% ( 870, 1300 ] 4 0.049% 99.645% ( 1300, 1900 ] 6 0.073% 99.719% ( 1900, 2900 ] 5 0.061% 99.780% ( 2900, 4400 ] 14 0.171% 99.951% ( 4400, 6600 ] 2 0.024% 99.976% ( 6600, 9900 ] 3 0.037% 100.012% ** Level 4 read latency histogram (micros): Count: 35 Average: 3574.4000 StdDev: 1917.79 Min: 138 Median: 3050.0000 Max: 7896 Percentiles: P50: 3050.00 P75: 5335.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 870, 1300 ] 2 5.714% 11.429% # ( 1300, 1900 ] 2 5.714% 17.143% # ( 1900, 2900 ] 11 31.429% 48.571% ###### ( 2900, 4400 ] 5 14.286% 62.857% ### ( 4400, 6600 ] 10 28.571% 91.429% ###### ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 330.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.172 H:M:S, 5.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 356.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.172 H:M:S, 6.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-16:43:11 ... thread 0: (1000000,2000000) ops and (321599.8,340889.7) ops/second in (3.109455,5.867000) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.48 GB 6.3 0.9 0.0 0.9 2.7 1.8 0.0 1.5 106.7 312.7 8.86 8.21 29 0.305 959K 1245 0.0 0.0 L1 1/1 1.75 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 248.4 248.2 1.01 0.98 1 1.014 255K 197 0.0 0.0 L2 1/1 121.25 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 243.7 243.7 0.46 0.44 1 0.458 113K 30 0.0 0.0 L3 76/34 869.78 MB 0.8 0.9 0.2 0.7 0.9 0.2 0.0 3.9 205.9 205.8 4.50 3.83 3 1.500 941K 475 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/46 97.92 GB 0.0 2.2 0.5 1.7 4.0 2.3 0.4 2.2 150.7 273.7 14.83 13.46 34 0.436 2269K 1947 0.0 0.0 Int 0/0 0.00 KB 0.0 2.2 0.5 1.7 4.0 2.3 0.4 2.2 150.7 273.7 14.83 13.46 34 0.436 2269K 1947 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.2 0.5 1.7 2.2 0.5 0.0 0.0 232.6 232.4 9.61 8.82 8 1.201 2269K 1947 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.9 5.22 4.64 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.96 GB write, 667.35 MB/s write, 2.18 GB read, 367.38 MB/s read, 14.8 seconds Interval compaction: 3.96 GB write, 691.83 MB/s write, 2.18 GB read, 380.86 MB/s read, 14.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 386287 Average: 2.2808 StdDev: 12.86 Min: 1 Median: 1.5145 Max: 4152 Percentiles: P50: 1.51 P75: 1.91 P99: 5.85 P99.9: 10.27 P99.99: 14.89 ------------------------------------------------------ [ 0, 1 ] 66433 17.198% 17.198% ### ( 1, 2 ] 246302 63.761% 80.959% ############# ( 2, 3 ] 42011 10.876% 91.835% ## ( 3, 4 ] 15094 3.907% 95.742% # ( 4, 6 ] 13618 3.525% 99.268% # ( 6, 10 ] 2423 0.627% 99.895% ( 10, 15 ] 377 0.098% 99.992% ( 15, 22 ] 46 0.012% 100.004% ( 22, 34 ] 9 0.002% 100.007% ( 34, 51 ] 3 0.001% 100.008% ( 51, 76 ] 1 0.000% 100.008% ( 110, 170 ] 15 0.004% 100.012% ( 170, 250 ] 8 0.002% 100.014% ( 250, 380 ] 6 0.002% 100.015% ( 380, 580 ] 6 0.002% 100.017% ( 580, 870 ] 10 0.003% 100.019% ( 870, 1300 ] 6 0.002% 100.021% ( 1300, 1900 ] 4 0.001% 100.022% ( 1900, 2900 ] 2 0.001% 100.023% ( 2900, 4400 ] 2 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 61606 Average: 2.6946 StdDev: 22.03 Min: 0 Median: 1.6233 Max: 4534 Percentiles: P50: 1.62 P75: 2.17 P99: 8.18 P99.9: 57.19 P99.99: 574.65 ------------------------------------------------------ [ 0, 1 ] 7961 12.922% 12.922% ### ( 1, 2 ] 36645 59.483% 72.405% ############ ( 2, 3 ] 9593 15.572% 87.977% ### ( 3, 4 ] 3034 4.925% 92.902% # ( 4, 6 ] 3343 5.426% 98.328% # ( 6, 10 ] 763 1.239% 99.567% ( 10, 15 ] 173 0.281% 99.847% ( 15, 22 ] 20 0.032% 99.880% ( 22, 34 ] 2 0.003% 99.883% ( 51, 76 ] 46 0.075% 99.958% ( 76, 110 ] 8 0.013% 99.971% ( 110, 170 ] 1 0.002% 99.972% ( 170, 250 ] 4 0.006% 99.979% ( 250, 380 ] 2 0.003% 99.982% ( 380, 580 ] 6 0.010% 99.992% ( 580, 870 ] 2 0.003% 99.995% ( 870, 1300 ] 2 0.003% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ( 4400, 6600 ] 1 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 28324 Average: 1.9370 StdDev: 3.32 Min: 1 Median: 1.3666 Max: 359 Percentiles: P50: 1.37 P75: 1.76 P99: 4.91 P99.9: 9.93 P99.99: 183.41 ------------------------------------------------------ [ 0, 1 ] 7622 26.910% 26.910% ##### ( 1, 2 ] 17842 62.993% 89.903% ############# ( 2, 3 ] 1769 6.246% 96.148% # ( 3, 4 ] 662 2.337% 98.485% ( 4, 6 ] 322 1.137% 99.622% ( 6, 10 ] 80 0.282% 99.905% ( 10, 15 ] 19 0.067% 99.972% ( 15, 22 ] 3 0.011% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 179861 Average: 3.7792 StdDev: 53.09 Min: 0 Median: 1.5963 Max: 8004 Percentiles: P50: 1.60 P75: 1.99 P99: 9.39 P99.9: 209.65 P99.99: 697.94 ------------------------------------------------------ [ 0, 1 ] 22446 12.480% 12.480% ## ( 1, 2 ] 113176 62.924% 75.404% ############# ( 2, 3 ] 21635 12.029% 87.433% ## ( 3, 4 ] 9699 5.392% 92.825% # ( 4, 6 ] 8270 4.598% 97.423% # ( 6, 10 ] 3347 1.861% 99.284% ( 10, 15 ] 608 0.338% 99.622% ( 15, 22 ] 66 0.037% 99.659% ( 22, 34 ] 10 0.006% 99.664% ( 34, 51 ] 3 0.002% 99.666% ( 51, 76 ] 2 0.001% 99.667% ( 76, 110 ] 114 0.063% 99.730% ( 110, 170 ] 265 0.147% 99.878% ( 170, 250 ] 83 0.046% 99.924% ( 250, 380 ] 58 0.032% 99.956% ( 380, 580 ] 49 0.027% 99.983% ( 580, 870 ] 32 0.018% 100.001% ( 870, 1300 ] 13 0.007% 100.008% ( 1300, 1900 ] 7 0.004% 100.012% ( 1900, 2900 ] 5 0.003% 100.015% ( 2900, 4400 ] 14 0.008% 100.023% ( 4400, 6600 ] 2 0.001% 100.024% ( 6600, 9900 ] 3 0.002% 100.026% ** Level 4 read latency histogram (micros): Count: 35 Average: 3574.4000 StdDev: 1917.79 Min: 138 Median: 3050.0000 Max: 7896 Percentiles: P50: 3050.00 P75: 5335.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 870, 1300 ] 2 5.714% 11.429% # ( 1300, 1900 ] 2 5.714% 17.143% # ( 1900, 2900 ] 11 31.429% 48.571% ###### ( 2900, 4400 ] 5 14.286% 62.857% ### ( 4400, 6600 ] 10 28.571% 91.429% ###### ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.569 H:M:S, 9.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-16:43:14 ... thread 0: (1000000,3000000) ops and (325455.5,335584.8) ops/second in (3.072617,8.939617) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.40 GB 94.4 1.7 0.0 1.7 4.5 2.8 0.0 1.6 117.9 307.2 14.96 13.94 46 0.325 1790K 2110 0.0 0.0 L1 1/1 1.75 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 248.4 248.2 1.01 0.98 1 1.014 255K 197 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 243.7 243.7 0.46 0.44 1 0.458 113K 30 0.0 0.0 L3 50/0 990.92 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 206.4 206.3 5.55 4.81 4 1.389 1135K 475 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1226/11 98.84 GB 0.0 3.2 0.6 2.6 6.0 3.4 0.4 2.2 148.9 277.7 21.99 20.17 52 0.423 3296K 2812 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 0.6 2.6 6.0 3.4 0.4 2.2 148.9 277.7 21.99 20.17 52 0.423 3296K 2812 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 0.6 2.6 3.2 0.6 0.0 0.0 236.0 235.8 13.87 12.95 12 1.156 3296K 2812 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 349.3 8.12 7.22 40 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.96 GB write, 666.85 MB/s write, 3.20 GB read, 357.58 MB/s read, 22.0 seconds Interval compaction: 5.96 GB write, 682.90 MB/s write, 3.20 GB read, 366.19 MB/s read, 22.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 800056 Average: 2.2786 StdDev: 10.20 Min: 1 Median: 1.5408 Max: 4152 Percentiles: P50: 1.54 P75: 1.92 P99: 5.80 P99.9: 9.93 P99.99: 14.01 ------------------------------------------------------ [ 0, 1 ] 113263 14.157% 14.157% ### ( 1, 2 ] 530267 66.279% 80.436% ############# ( 2, 3 ] 94476 11.809% 92.244% ## ( 3, 4 ] 30207 3.776% 96.020% # ( 4, 6 ] 26493 3.311% 99.331% # ( 6, 10 ] 4628 0.578% 99.910% ( 10, 15 ] 802 0.100% 100.010% ( 15, 22 ] 75 0.009% 100.019% ( 22, 34 ] 12 0.001% 100.021% ( 34, 51 ] 5 0.001% 100.021% ( 51, 76 ] 2 0.000% 100.022% ( 76, 110 ] 2 0.000% 100.022% ( 110, 170 ] 20 0.002% 100.024% ( 170, 250 ] 16 0.002% 100.026% ( 250, 380 ] 9 0.001% 100.028% ( 380, 580 ] 15 0.002% 100.029% ( 580, 870 ] 16 0.002% 100.031% ( 870, 1300 ] 11 0.001% 100.033% ( 1300, 1900 ] 5 0.001% 100.033% ( 1900, 2900 ] 3 0.000% 100.034% ( 2900, 4400 ] 2 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 75818 Average: 2.6452 StdDev: 19.86 Min: 0 Median: 1.6333 Max: 4534 Percentiles: P50: 1.63 P75: 2.17 P99: 7.81 P99.9: 21.71 P99.99: 527.27 ------------------------------------------------------ [ 0, 1 ] 8834 11.652% 11.652% ## ( 1, 2 ] 45911 60.554% 72.206% ############ ( 2, 3 ] 12159 16.037% 88.243% ### ( 3, 4 ] 3678 4.851% 93.094% # ( 4, 6 ] 4085 5.388% 98.482% # ( 6, 10 ] 870 1.147% 99.629% ( 10, 15 ] 186 0.245% 99.875% ( 15, 22 ] 20 0.026% 99.901% ( 22, 34 ] 2 0.003% 99.904% ( 51, 76 ] 46 0.061% 99.964% ( 76, 110 ] 8 0.011% 99.975% ( 110, 170 ] 1 0.001% 99.976% ( 170, 250 ] 4 0.005% 99.982% ( 250, 380 ] 2 0.003% 99.984% ( 380, 580 ] 6 0.008% 99.992% ( 580, 870 ] 2 0.003% 99.995% ( 870, 1300 ] 2 0.003% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28324 Average: 1.9370 StdDev: 3.32 Min: 1 Median: 1.3666 Max: 359 Percentiles: P50: 1.37 P75: 1.76 P99: 4.91 P99.9: 9.93 P99.99: 183.41 ------------------------------------------------------ [ 0, 1 ] 7622 26.910% 26.910% ##### ( 1, 2 ] 17842 62.993% 89.903% ############# ( 2, 3 ] 1769 6.246% 96.148% # ( 3, 4 ] 662 2.337% 98.485% ( 4, 6 ] 322 1.137% 99.622% ( 6, 10 ] 80 0.282% 99.905% ( 10, 15 ] 19 0.067% 99.972% ( 15, 22 ] 3 0.011% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 199788 Average: 3.6507 StdDev: 50.51 Min: 0 Median: 1.5998 Max: 8004 Percentiles: P50: 1.60 P75: 1.99 P99: 9.22 P99.9: 194.96 P99.99: 688.94 ------------------------------------------------------ [ 0, 1 ] 24058 12.042% 12.042% ## ( 1, 2 ] 126439 63.287% 75.328% ############# ( 2, 3 ] 24725 12.376% 87.704% ## ( 3, 4 ] 10685 5.348% 93.052% # ( 4, 6 ] 9087 4.548% 97.600% # ( 6, 10 ] 3473 1.738% 99.339% ( 10, 15 ] 632 0.316% 99.655% ( 15, 22 ] 68 0.034% 99.689% ( 22, 34 ] 11 0.006% 99.695% ( 34, 51 ] 3 0.002% 99.696% ( 51, 76 ] 2 0.001% 99.697% ( 76, 110 ] 114 0.057% 99.754% ( 110, 170 ] 265 0.133% 99.887% ( 170, 250 ] 84 0.042% 99.929% ( 250, 380 ] 61 0.031% 99.959% ( 380, 580 ] 49 0.025% 99.984% ( 580, 870 ] 32 0.016% 100.000% ( 870, 1300 ] 13 0.007% 100.007% ( 1300, 1900 ] 8 0.004% 100.011% ( 1900, 2900 ] 5 0.003% 100.013% ( 2900, 4400 ] 14 0.007% 100.020% ( 4400, 6600 ] 2 0.001% 100.021% ( 6600, 9900 ] 3 0.002% 100.023% ** Level 4 read latency histogram (micros): Count: 35 Average: 3574.4000 StdDev: 1917.79 Min: 138 Median: 3050.0000 Max: 7896 Percentiles: P50: 3050.00 P75: 5335.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 870, 1300 ] 2 5.714% 11.429% # ( 1300, 1900 ] 2 5.714% 17.143% # ( 1900, 2900 ] 11 31.429% 48.571% ###### ( 2900, 4400 ] 5 14.286% 62.857% ### ( 4400, 6600 ] 10 28.571% 91.429% ###### ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.975 H:M:S, 10.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.406 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-16:43:17 ... thread 0: (1000000,4000000) ops and (324016.1,332615.9) ops/second in (3.086266,12.025883) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/17 2.21 GB 0.0 2.3 0.0 2.3 6.0 3.7 0.0 1.6 117.6 308.1 19.82 18.47 61 0.325 2366K 2685 0.0 0.0 L1 11/11 1.16 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.1 1.0 229.8 228.8 6.31 6.08 2 3.154 1471K 5862 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 243.7 243.7 0.46 0.44 1 0.458 113K 30 0.0 0.0 L3 50/0 990.92 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 206.4 206.3 5.55 4.81 4 1.389 1135K 475 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1238/28 99.82 GB 0.0 4.9 1.8 3.2 8.6 5.4 0.4 2.3 156.8 274.1 32.14 29.79 68 0.473 5087K 9052 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 1.8 3.2 8.6 5.4 0.4 2.3 156.8 274.1 32.14 29.79 68 0.473 5087K 9052 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 1.8 3.2 4.9 1.8 0.0 0.0 236.5 236.0 21.31 20.14 15 1.420 5087K 9052 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 348.8 10.83 9.65 53 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.60 GB write, 719.51 MB/s write, 4.92 GB read, 411.55 MB/s read, 32.1 seconds Interval compaction: 8.60 GB write, 732.39 MB/s write, 4.92 GB read, 418.91 MB/s read, 32.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1099232 Average: 2.3203 StdDev: 11.38 Min: 1 Median: 1.5395 Max: 4152 Percentiles: P50: 1.54 P75: 1.91 P99: 5.80 P99.9: 10.46 P99.99: 14.96 ------------------------------------------------------ [ 0, 1 ] 153772 13.989% 13.989% ### ( 1, 2 ] 733715 66.748% 80.737% ############# ( 2, 3 ] 129147 11.749% 92.486% ## ( 3, 4 ] 40187 3.656% 96.142% # ( 4, 6 ] 34889 3.174% 99.316% # ( 6, 10 ] 6322 0.575% 99.891% ( 10, 15 ] 1099 0.100% 99.991% ( 15, 22 ] 104 0.009% 100.000% ( 22, 34 ] 13 0.001% 100.001% ( 34, 51 ] 7 0.001% 100.002% ( 51, 76 ] 2 0.000% 100.002% ( 76, 110 ] 49 0.004% 100.007% ( 110, 170 ] 110 0.010% 100.017% ( 170, 250 ] 61 0.006% 100.022% ( 250, 380 ] 31 0.003% 100.025% ( 380, 580 ] 47 0.004% 100.029% ( 580, 870 ] 26 0.002% 100.032% ( 870, 1300 ] 17 0.002% 100.033% ( 1300, 1900 ] 7 0.001% 100.034% ( 1900, 2900 ] 5 0.000% 100.034% ( 2900, 4400 ] 4 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 115451 Average: 2.9274 StdDev: 23.29 Min: 0 Median: 1.5700 Max: 4534 Percentiles: P50: 1.57 P75: 1.97 P99: 8.45 P99.9: 161.90 P99.99: 1061.56 ------------------------------------------------------ [ 0, 1 ] 16538 14.325% 14.325% ### ( 1, 2 ] 72258 62.588% 76.912% ############# ( 2, 3 ] 15217 13.180% 90.093% ### ( 3, 4 ] 4535 3.928% 94.021% # ( 4, 6 ] 4801 4.158% 98.179% # ( 6, 10 ] 1546 1.339% 99.518% ( 10, 15 ] 261 0.226% 99.744% ( 15, 22 ] 25 0.022% 99.766% ( 22, 34 ] 3 0.003% 99.769% ( 51, 76 ] 49 0.042% 99.811% ( 76, 110 ] 42 0.036% 99.848% ( 110, 170 ] 70 0.061% 99.908% ( 170, 250 ] 33 0.029% 99.937% ( 250, 380 ] 28 0.024% 99.961% ( 380, 580 ] 23 0.020% 99.981% ( 580, 870 ] 6 0.005% 99.986% ( 870, 1300 ] 10 0.009% 99.995% ( 1300, 1900 ] 3 0.003% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28324 Average: 1.9370 StdDev: 3.32 Min: 1 Median: 1.3666 Max: 359 Percentiles: P50: 1.37 P75: 1.76 P99: 4.91 P99.9: 9.93 P99.99: 183.41 ------------------------------------------------------ [ 0, 1 ] 7622 26.910% 26.910% ##### ( 1, 2 ] 17842 62.993% 89.903% ############# ( 2, 3 ] 1769 6.246% 96.148% # ( 3, 4 ] 662 2.337% 98.485% ( 4, 6 ] 322 1.137% 99.622% ( 6, 10 ] 80 0.282% 99.905% ( 10, 15 ] 19 0.067% 99.972% ( 15, 22 ] 3 0.011% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 199788 Average: 3.6507 StdDev: 50.51 Min: 0 Median: 1.5998 Max: 8004 Percentiles: P50: 1.60 P75: 1.99 P99: 9.22 P99.9: 194.96 P99.99: 688.94 ------------------------------------------------------ [ 0, 1 ] 24058 12.042% 12.042% ## ( 1, 2 ] 126439 63.287% 75.328% ############# ( 2, 3 ] 24725 12.376% 87.704% ## ( 3, 4 ] 10685 5.348% 93.052% # ( 4, 6 ] 9087 4.548% 97.600% # ( 6, 10 ] 3473 1.738% 99.339% ( 10, 15 ] 632 0.316% 99.655% ( 15, 22 ] 68 0.034% 99.689% ( 22, 34 ] 11 0.006% 99.695% ( 34, 51 ] 3 0.002% 99.696% ( 51, 76 ] 2 0.001% 99.697% ( 76, 110 ] 114 0.057% 99.754% ( 110, 170 ] 265 0.133% 99.887% ( 170, 250 ] 84 0.042% 99.929% ( 250, 380 ] 61 0.031% 99.959% ( 380, 580 ] 49 0.025% 99.984% ( 580, 870 ] 32 0.016% 100.000% ( 870, 1300 ] 13 0.007% 100.007% ( 1300, 1900 ] 8 0.004% 100.011% ( 1900, 2900 ] 5 0.003% 100.013% ( 2900, 4400 ] 14 0.007% 100.020% ( 4400, 6600 ] 2 0.001% 100.021% ( 6600, 9900 ] 3 0.002% 100.023% ** Level 4 read latency histogram (micros): Count: 35 Average: 3574.4000 StdDev: 1917.79 Min: 138 Median: 3050.0000 Max: 7896 Percentiles: P50: 3050.00 P75: 5335.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 870, 1300 ] 2 5.714% 11.429% # ( 1300, 1900 ] 2 5.714% 17.143% # ( 1900, 2900 ] 11 31.429% 48.571% ###### ( 2900, 4400 ] 5 14.286% 62.857% ### ( 4400, 6600 ] 10 28.571% 91.429% ###### ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 12.2 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.404 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.429 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-16:43:21 ... thread 0: (1000000,5000000) ops and (274458.7,319092.9) ops/second in (3.643535,15.669418) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.26 GB 138.4 3.6 0.0 3.6 8.4 4.7 0.0 1.8 131.7 303.4 28.22 26.43 82 0.344 3773K 4206 0.0 0.0 L1 11/11 1.16 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.1 1.0 229.8 228.8 6.31 6.08 2 3.154 1471K 5862 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 243.7 243.7 0.46 0.44 1 0.458 113K 30 0.0 0.0 L3 50/0 990.92 MB 1.0 1.1 0.4 0.8 1.1 0.4 0.0 3.2 206.4 206.3 5.55 4.81 4 1.389 1135K 475 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1239/24 100.86 GB 0.0 6.3 1.8 4.5 11.0 6.5 0.4 2.3 158.5 277.8 40.54 37.76 89 0.456 6494K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 1.8 4.5 11.0 6.5 0.4 2.3 158.5 277.8 40.54 37.76 89 0.456 6494K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 1.8 4.5 6.3 1.8 0.0 0.0 240.7 240.3 26.69 25.42 20 1.335 6494K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 350.2 13.85 12.34 69 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.9 total, 15.7 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.00 GB write, 709.05 MB/s write, 6.27 GB read, 404.40 MB/s read, 40.5 seconds Interval compaction: 11.00 GB write, 718.78 MB/s write, 6.27 GB read, 409.96 MB/s read, 40.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 14, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1518468 Average: 2.3395 StdDev: 11.32 Min: 1 Median: 1.5466 Max: 4152 Percentiles: P50: 1.55 P75: 1.92 P99: 5.83 P99.9: 10.83 P99.99: 14.99 ------------------------------------------------------ [ 0, 1 ] 202913 13.363% 13.363% ### ( 1, 2 ] 1017751 67.025% 80.388% ############# ( 2, 3 ] 183150 12.061% 92.449% ## ( 3, 4 ] 55064 3.626% 96.076% # ( 4, 6 ] 48656 3.204% 99.280% # ( 6, 10 ] 9144 0.602% 99.882% ( 10, 15 ] 1643 0.108% 99.990% ( 15, 22 ] 145 0.010% 100.000% ( 22, 34 ] 14 0.001% 100.001% ( 34, 51 ] 10 0.001% 100.001% ( 51, 76 ] 6 0.000% 100.002% ( 76, 110 ] 77 0.005% 100.007% ( 110, 170 ] 185 0.012% 100.019% ( 170, 250 ] 94 0.006% 100.025% ( 250, 380 ] 41 0.003% 100.028% ( 380, 580 ] 62 0.004% 100.032% ( 580, 870 ] 44 0.003% 100.035% ( 870, 1300 ] 24 0.002% 100.037% ( 1300, 1900 ] 11 0.001% 100.037% ( 1900, 2900 ] 6 0.000% 100.038% ( 2900, 4400 ] 5 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 198353 Average: 2.8249 StdDev: 18.85 Min: 0 Median: 1.5838 Max: 4534 Percentiles: P50: 1.58 P75: 1.97 P99: 8.57 P99.9: 147.40 P99.99: 746.42 ------------------------------------------------------ [ 0, 1 ] 24036 12.118% 12.118% ## ( 1, 2 ] 128706 64.887% 77.005% ############# ( 2, 3 ] 26753 13.488% 90.493% ### ( 3, 4 ] 7246 3.653% 94.146% # ( 4, 6 ] 7686 3.875% 98.021% # ( 6, 10 ] 3022 1.524% 99.544% ( 10, 15 ] 458 0.231% 99.775% ( 15, 22 ] 45 0.023% 99.798% ( 22, 34 ] 5 0.003% 99.800% ( 51, 76 ] 49 0.025% 99.825% ( 76, 110 ] 62 0.031% 99.856% ( 110, 170 ] 139 0.070% 99.926% ( 170, 250 ] 44 0.022% 99.949% ( 250, 380 ] 38 0.019% 99.968% ( 380, 580 ] 39 0.020% 99.987% ( 580, 870 ] 9 0.005% 99.992% ( 870, 1300 ] 10 0.005% 99.997% ( 1300, 1900 ] 3 0.002% 99.998% ( 1900, 2900 ] 2 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28324 Average: 1.9370 StdDev: 3.32 Min: 1 Median: 1.3666 Max: 359 Percentiles: P50: 1.37 P75: 1.76 P99: 4.91 P99.9: 9.93 P99.99: 183.41 ------------------------------------------------------ [ 0, 1 ] 7622 26.910% 26.910% ##### ( 1, 2 ] 17842 62.993% 89.903% ############# ( 2, 3 ] 1769 6.246% 96.148% # ( 3, 4 ] 662 2.337% 98.485% ( 4, 6 ] 322 1.137% 99.622% ( 6, 10 ] 80 0.282% 99.905% ( 10, 15 ] 19 0.067% 99.972% ( 15, 22 ] 3 0.011% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 199788 Average: 3.6507 StdDev: 50.51 Min: 0 Median: 1.5998 Max: 8004 Percentiles: P50: 1.60 P75: 1.99 P99: 9.22 P99.9: 194.96 P99.99: 688.94 ------------------------------------------------------ [ 0, 1 ] 24058 12.042% 12.042% ## ( 1, 2 ] 126439 63.287% 75.328% ############# ( 2, 3 ] 24725 12.376% 87.704% ## ( 3, 4 ] 10685 5.348% 93.052% # ( 4, 6 ] 9087 4.548% 97.600% # ( 6, 10 ] 3473 1.738% 99.339% ( 10, 15 ] 632 0.316% 99.655% ( 15, 22 ] 68 0.034% 99.689% ( 22, 34 ] 11 0.006% 99.695% ( 34, 51 ] 3 0.002% 99.696% ( 51, 76 ] 2 0.001% 99.697% ( 76, 110 ] 114 0.057% 99.754% ( 110, 170 ] 265 0.133% 99.887% ( 170, 250 ] 84 0.042% 99.929% ( 250, 380 ] 61 0.031% 99.959% ( 380, 580 ] 49 0.025% 99.984% ( 580, 870 ] 32 0.016% 100.000% ( 870, 1300 ] 13 0.007% 100.007% ( 1300, 1900 ] 8 0.004% 100.011% ( 1900, 2900 ] 5 0.003% 100.013% ( 2900, 4400 ] 14 0.007% 100.020% ( 4400, 6600 ] 2 0.001% 100.021% ( 6600, 9900 ] 3 0.002% 100.023% ** Level 4 read latency histogram (micros): Count: 35 Average: 3574.4000 StdDev: 1917.79 Min: 138 Median: 3050.0000 Max: 7896 Percentiles: P50: 3050.00 P75: 5335.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 870, 1300 ] 2 5.714% 11.429% # ( 1300, 1900 ] 2 5.714% 17.143% # ( 1900, 2900 ] 11 31.429% 48.571% ###### ( 2900, 4400 ] 5 14.286% 62.857% ### ( 4400, 6600 ] 10 28.571% 91.429% ###### ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 15.9 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 309.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.329 H:M:S, 14.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 270.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.925 H:M:S, 25.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-16:43:31 ... thread 0: (1000000,6000000) ops and (96680.0,230655.5) ops/second in (10.343398,26.012816) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 2.51 GB 232.2 5.7 0.0 5.7 11.3 5.6 0.0 2.0 141.7 283.1 40.89 37.08 100 0.409 5883K 11K 0.0 0.0 L1 8/0 402.19 MB 40.2 4.2 3.0 1.2 4.2 3.0 0.1 1.4 213.0 211.1 20.37 18.48 3 6.791 4407K 39K 0.0 0.0 L2 23/9 1.65 GB 12.9 0.1 0.1 0.0 0.1 0.1 2.7 1.8 243.7 243.7 0.46 0.44 1 0.458 113K 30 0.0 0.0 L3 67/9 1.71 GB 1.7 1.9 1.1 0.8 1.9 1.1 0.0 1.8 137.2 137.0 14.53 8.99 21 0.692 1773K 1742 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/22 101.74 GB 0.0 12.0 4.2 7.8 17.6 9.8 2.8 3.1 160.5 235.8 76.25 65.00 125 0.610 12M 52K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.0 4.2 7.8 17.6 9.8 2.8 3.1 160.5 235.8 76.25 65.00 125 0.610 12M 52K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.0 4.2 7.8 11.9 4.1 0.0 0.0 207.4 206.5 59.02 50.19 42 1.405 12M 52K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 336.2 17.24 14.81 83 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.2 total, 26.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.56 GB write, 685.49 MB/s write, 11.95 GB read, 466.61 MB/s read, 76.3 seconds Interval compaction: 17.56 GB write, 691.16 MB/s write, 11.95 GB read, 470.47 MB/s read, 76.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 29, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2329641 Average: 3.1932 StdDev: 22.73 Min: 1 Median: 1.5480 Max: 10417 Percentiles: P50: 1.55 P75: 1.92 P99: 8.26 P99.9: 166.81 P99.99: 375.22 ------------------------------------------------------ [ 0, 1 ] 315913 13.561% 13.561% ### ( 1, 2 ] 1549087 66.495% 80.055% ############# ( 2, 3 ] 270771 11.623% 91.678% ## ( 3, 4 ] 85356 3.664% 95.342% # ( 4, 6 ] 74090 3.180% 98.522% # ( 6, 10 ] 19735 0.847% 99.369% ( 10, 15 ] 2921 0.125% 99.495% ( 15, 22 ] 379 0.016% 99.511% ( 22, 34 ] 25 0.001% 99.512% ( 34, 51 ] 13 0.001% 99.513% ( 51, 76 ] 15 0.001% 99.513% ( 76, 110 ] 3381 0.145% 99.659% ( 110, 170 ] 5941 0.255% 99.914% ( 170, 250 ] 1127 0.048% 99.962% ( 250, 380 ] 679 0.029% 99.991% ( 380, 580 ] 525 0.023% 100.014% ( 580, 870 ] 246 0.011% 100.024% ( 870, 1300 ] 87 0.004% 100.028% ( 1300, 1900 ] 28 0.001% 100.029% ( 1900, 2900 ] 30 0.001% 100.030% ( 2900, 4400 ] 18 0.001% 100.031% ( 4400, 6600 ] 3 0.000% 100.031% ( 9900, 14000 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 647922 Average: 7.5910 StdDev: 116.14 Min: 0 Median: 1.7359 Max: 13533 Percentiles: P50: 1.74 P75: 2.56 P99: 11.07 P99.9: 514.30 P99.99: 858.19 ------------------------------------------------------ [ 0, 1 ] 53167 8.206% 8.206% ## ( 1, 2 ] 368000 56.797% 65.003% ########### ( 2, 3 ] 115839 17.879% 82.881% #### ( 3, 4 ] 40315 6.222% 89.103% # ( 4, 6 ] 48561 7.495% 96.598% # ( 6, 10 ] 14818 2.287% 98.885% ( 10, 15 ] 3484 0.538% 99.423% ( 15, 22 ] 484 0.075% 99.498% ( 22, 34 ] 49 0.008% 99.505% ( 34, 51 ] 10 0.002% 99.507% ( 51, 76 ] 52 0.008% 99.515% ( 76, 110 ] 700 0.108% 99.623% ( 110, 170 ] 743 0.115% 99.738% ( 170, 250 ] 298 0.046% 99.784% ( 250, 380 ] 420 0.065% 99.848% ( 380, 580 ] 499 0.077% 99.925% ( 580, 870 ] 437 0.067% 99.993% ( 870, 1300 ] 258 0.040% 100.033% ( 1300, 1900 ] 118 0.018% 100.051% ( 1900, 2900 ] 168 0.026% 100.077% ( 2900, 4400 ] 231 0.036% 100.113% ( 4400, 6600 ] 86 0.013% 100.126% ( 6600, 9900 ] 15 0.002% 100.128% ( 9900, 14000 ] 6 0.001% 100.129% ** Level 2 read latency histogram (micros): Count: 28324 Average: 1.9370 StdDev: 3.32 Min: 1 Median: 1.3666 Max: 359 Percentiles: P50: 1.37 P75: 1.76 P99: 4.91 P99.9: 9.93 P99.99: 183.41 ------------------------------------------------------ [ 0, 1 ] 7622 26.910% 26.910% ##### ( 1, 2 ] 17842 62.993% 89.903% ############# ( 2, 3 ] 1769 6.246% 96.148% # ( 3, 4 ] 662 2.337% 98.485% ( 4, 6 ] 322 1.137% 99.622% ( 6, 10 ] 80 0.282% 99.905% ( 10, 15 ] 19 0.067% 99.972% ( 15, 22 ] 3 0.011% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 229540 Average: 10.1786 StdDev: 129.83 Min: 0 Median: 1.6418 Max: 15086 Percentiles: P50: 1.64 P75: 2.23 P99: 79.45 P99.9: 1312.72 P99.99: 3500.86 ------------------------------------------------------ [ 0, 1 ] 24974 10.880% 10.880% ## ( 1, 2 ] 139916 60.955% 71.835% ############ ( 2, 3 ] 31424 13.690% 85.525% ### ( 3, 4 ] 14062 6.126% 91.651% # ( 4, 6 ] 11702 5.098% 96.749% # ( 6, 10 ] 4188 1.825% 98.574% ( 10, 15 ] 850 0.370% 98.944% ( 15, 22 ] 93 0.041% 98.984% ( 22, 34 ] 17 0.007% 98.992% ( 34, 51 ] 4 0.002% 98.994% ( 51, 76 ] 2 0.001% 98.995% ( 76, 110 ] 124 0.054% 99.049% ( 110, 170 ] 334 0.146% 99.194% ( 170, 250 ] 220 0.096% 99.290% ( 250, 380 ] 285 0.124% 99.414% ( 380, 580 ] 429 0.187% 99.601% ( 580, 870 ] 447 0.195% 99.796% ( 870, 1300 ] 237 0.103% 99.899% ( 1300, 1900 ] 116 0.051% 99.949% ( 1900, 2900 ] 61 0.027% 99.976% ( 2900, 4400 ] 80 0.035% 100.011% ( 4400, 6600 ] 18 0.008% 100.019% ( 6600, 9900 ] 7 0.003% 100.022% ( 9900, 14000 ] 2 0.001% 100.023% ( 14000, 22000 ] 2 0.001% 100.024% ** Level 4 read latency histogram (micros): Count: 35 Average: 3574.4000 StdDev: 1917.79 Min: 138 Median: 3050.0000 Max: 7896 Percentiles: P50: 3050.00 P75: 5335.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 870, 1300 ] 2 5.714% 11.429% # ( 1300, 1900 ] 2 5.714% 17.143% # ( 1900, 2900 ] 11 31.429% 48.571% ###### ( 2900, 4400 ] 5 14.286% 62.857% ### ( 4400, 6600 ] 10 28.571% 91.429% ###### ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 26.2 total, 10.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 225.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.613 H:M:S, 36.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 95.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.283 H:M:S, 70.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/17-16:43:35 ... thread 0: (1000000,7000000) ops and (304442.0,238928.1) ops/second in (3.284698,29.297514) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 3.44 GB 56.7 6.2 0.0 6.2 12.7 6.6 0.0 1.9 136.1 281.4 46.29 41.53 115 0.403 6395K 12K 0.0 0.0 L1 8/8 402.19 MB 0.0 4.2 3.0 1.2 4.2 3.0 0.1 1.4 213.0 211.1 20.37 18.48 3 6.791 4407K 39K 0.0 0.0 L2 8/8 1.01 GB 0.0 0.1 0.1 0.0 0.1 0.1 2.7 1.8 243.7 243.7 0.46 0.44 1 0.458 113K 30 0.0 0.0 L3 28/1 1.05 GB 1.0 2.7 1.7 0.9 2.7 1.7 0.0 1.5 123.7 123.5 22.05 12.72 36 0.613 2319K 3373 0.0 0.0 L4 154/0 9.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1060/0 87.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1274/28 102.66 GB 0.0 13.2 4.8 8.3 19.7 11.3 5.5 3.0 151.1 226.1 89.18 73.17 155 0.575 13M 55K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.2 4.8 8.3 19.7 11.3 5.4 3.0 151.1 226.1 89.18 73.17 155 0.575 13M 55K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.2 4.8 8.3 13.1 4.8 0.0 0.0 195.8 194.9 68.85 55.95 59 1.167 13M 55K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 331.6 20.33 17.22 96 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.5 total, 29.3 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.69 GB write, 683.12 MB/s write, 13.16 GB read, 456.69 MB/s read, 89.2 seconds Interval compaction: 19.69 GB write, 688.14 MB/s write, 13.16 GB read, 460.04 MB/s read, 89.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 46, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2605283 Average: 3.2004 StdDev: 24.51 Min: 1 Median: 1.5609 Max: 10417 Percentiles: P50: 1.56 P75: 1.94 P99: 8.19 P99.9: 165.53 P99.99: 386.78 ------------------------------------------------------ [ 0, 1 ] 334101 12.824% 12.824% ### ( 1, 2 ] 1726818 66.281% 79.105% ############# ( 2, 3 ] 320600 12.306% 91.411% ## ( 3, 4 ] 97343 3.736% 95.148% # ( 4, 6 ] 87685 3.366% 98.513% # ( 6, 10 ] 23195 0.890% 99.403% ( 10, 15 ] 3542 0.136% 99.539% ( 15, 22 ] 419 0.016% 99.556% ( 22, 34 ] 28 0.001% 99.557% ( 34, 51 ] 13 0.000% 99.557% ( 51, 76 ] 17 0.001% 99.558% ( 76, 110 ] 3396 0.130% 99.688% ( 110, 170 ] 5967 0.229% 99.917% ( 170, 250 ] 1156 0.044% 99.962% ( 250, 380 ] 725 0.028% 99.989% ( 380, 580 ] 574 0.022% 100.011% ( 580, 870 ] 298 0.011% 100.023% ( 870, 1300 ] 131 0.005% 100.028% ( 1300, 1900 ] 40 0.002% 100.029% ( 1900, 2900 ] 41 0.002% 100.031% ( 2900, 4400 ] 24 0.001% 100.032% ( 4400, 6600 ] 7 0.000% 100.032% ( 9900, 14000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 885068 Average: 7.2472 StdDev: 109.95 Min: 0 Median: 1.7499 Max: 13533 Percentiles: P50: 1.75 P75: 2.57 P99: 10.63 P99.9: 496.11 P99.99: 824.30 ------------------------------------------------------ [ 0, 1 ] 63245 7.146% 7.146% # ( 1, 2 ] 505786 57.147% 64.292% ########### ( 2, 3 ] 166423 18.803% 83.096% #### ( 3, 4 ] 54733 6.184% 89.280% # ( 4, 6 ] 65281 7.376% 96.656% # ( 6, 10 ] 20138 2.275% 98.931% ( 10, 15 ] 4842 0.547% 99.478% ( 15, 22 ] 663 0.075% 99.553% ( 22, 34 ] 60 0.007% 99.560% ( 34, 51 ] 13 0.001% 99.561% ( 51, 76 ] 53 0.006% 99.567% ( 76, 110 ] 775 0.088% 99.655% ( 110, 170 ] 848 0.096% 99.751% ( 170, 250 ] 395 0.045% 99.795% ( 250, 380 ] 533 0.060% 99.855% ( 380, 580 ] 682 0.077% 99.932% ( 580, 870 ] 606 0.068% 100.001% ( 870, 1300 ] 321 0.036% 100.037% ( 1300, 1900 ] 155 0.018% 100.055% ( 1900, 2900 ] 223 0.025% 100.080% ( 2900, 4400 ] 292 0.033% 100.113% ( 4400, 6600 ] 99 0.011% 100.124% ( 6600, 9900 ] 18 0.002% 100.126% ( 9900, 14000 ] 6 0.001% 100.127% ** Level 2 read latency histogram (micros): Count: 28324 Average: 1.9370 StdDev: 3.32 Min: 1 Median: 1.3666 Max: 359 Percentiles: P50: 1.37 P75: 1.76 P99: 4.91 P99.9: 9.93 P99.99: 183.41 ------------------------------------------------------ [ 0, 1 ] 7622 26.910% 26.910% ##### ( 1, 2 ] 17842 62.993% 89.903% ############# ( 2, 3 ] 1769 6.246% 96.148% # ( 3, 4 ] 662 2.337% 98.485% ( 4, 6 ] 322 1.137% 99.622% ( 6, 10 ] 80 0.282% 99.905% ( 10, 15 ] 19 0.067% 99.972% ( 15, 22 ] 3 0.011% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 256007 Average: 10.5615 StdDev: 127.67 Min: 0 Median: 1.6523 Max: 15086 Percentiles: P50: 1.65 P75: 2.27 P99: 126.20 P99.9: 1348.62 P99.99: 3418.81 ------------------------------------------------------ [ 0, 1 ] 26627 10.401% 10.401% ## ( 1, 2 ] 155407 60.704% 71.105% ############ ( 2, 3 ] 36455 14.240% 85.345% ### ( 3, 4 ] 15760 6.156% 91.501% # ( 4, 6 ] 13156 5.139% 96.640% # ( 6, 10 ] 4741 1.852% 98.492% ( 10, 15 ] 950 0.371% 98.863% ( 15, 22 ] 105 0.041% 98.904% ( 22, 34 ] 18 0.007% 98.911% ( 34, 51 ] 4 0.002% 98.913% ( 51, 76 ] 2 0.001% 98.913% ( 76, 110 ] 125 0.049% 98.962% ( 110, 170 ] 359 0.140% 99.102% ( 170, 250 ] 283 0.111% 99.213% ( 250, 380 ] 364 0.142% 99.355% ( 380, 580 ] 547 0.214% 99.569% ( 580, 870 ] 554 0.216% 99.785% ( 870, 1300 ] 282 0.110% 99.895% ( 1300, 1900 ] 148 0.058% 99.953% ( 1900, 2900 ] 65 0.025% 99.979% ( 2900, 4400 ] 85 0.033% 100.012% ( 4400, 6600 ] 18 0.007% 100.019% ( 6600, 9900 ] 7 0.003% 100.021% ( 9900, 14000 ] 2 0.001% 100.022% ( 14000, 22000 ] 2 0.001% 100.023% ** Level 4 read latency histogram (micros): Count: 35 Average: 3574.4000 StdDev: 1917.79 Min: 138 Median: 3050.0000 Max: 7896 Percentiles: P50: 3050.00 P75: 5335.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 870, 1300 ] 2 5.714% 11.429% # ( 1300, 1900 ] 2 5.714% 17.143% # ( 1900, 2900 ] 11 31.429% 48.571% ###### ( 2900, 4400 ] 5 14.286% 62.857% ### ( 4400, 6600 ] 10 28.571% 91.429% ###### ( 6600, 9900 ] 3 8.571% 100.000% ## ** Level 5 read latency histogram (micros): Count: 80 Average: 1955.3500 StdDev: 1873.96 Min: 81 Median: 1192.5000 Max: 7567 Percentiles: P50: 1192.50 P75: 3341.18 P99: 7567.00 P99.9: 7567.00 P99.99: 7567.00 ------------------------------------------------------ ( 76, 110 ] 3 3.750% 3.750% # ( 110, 170 ] 6 7.500% 11.250% ## ( 170, 250 ] 4 5.000% 16.250% # ( 250, 380 ] 7 8.750% 25.000% ## ( 380, 580 ] 8 10.000% 35.000% ## ( 580, 870 ] 9 11.250% 46.250% ## ( 870, 1300 ] 4 5.000% 51.250% # ( 1300, 1900 ] 7 8.750% 60.000% ## ( 1900, 2900 ] 7 8.750% 68.750% ## ( 2900, 4400 ] 17 21.250% 90.000% #### ( 4400, 6600 ] 6 7.500% 97.500% ## ( 6600, 9900 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 29.5 total, 3.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 233.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.177 H:M:S, 34.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.565 H:M:S, 17.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-16:43:39 ... thread 0: (1000000,8000000) ops and (229343.7,237686.5) ops/second in (4.360268,33.657782) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/7 4.48 GB 195.1 7.2 0.0 7.2 14.8 7.6 0.0 1.9 137.3 282.5 53.68 48.48 133 0.404 7482K 13K 0.0 0.0 L1 8/8 402.19 MB 0.0 4.2 3.0 1.2 4.2 3.0 0.1 1.4 213.0 211.1 20.37 18.48 3 6.791 4407K 39K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.7 1.8 243.7 243.7 0.46 0.44 1 0.458 113K 30 0.0 0.0 L3 23/0 895.28 MB 0.9 3.8 2.8 1.0 3.8 2.7 0.0 1.4 140.6 140.3 27.62 17.78 37 0.747 3492K 6632 0.0 0.0 L4 172/0 9.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1072/0 88.21 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/15 103.70 GB 0.0 15.3 5.8 9.5 22.9 13.4 7.6 3.0 153.8 229.6 102.13 85.18 174 0.587 15M 59K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.3 5.8 9.5 22.9 13.4 7.6 3.0 153.8 229.6 102.13 85.18 174 0.587 15M 59K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.3 5.8 9.5 15.3 5.8 0.0 0.0 199.7 198.9 78.63 65.15 64 1.229 15M 59K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 332.4 23.50 20.03 110 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.9 total, 33.7 interval Flush(GB): cumulative 7.628, interval 7.628 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.90 GB write, 692.37 MB/s write, 15.34 GB read, 463.60 MB/s read, 102.1 seconds Interval compaction: 22.90 GB write, 696.80 MB/s write, 15.34 GB read, 466.56 MB/s read, 102.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 50, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 50, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3080644 Average: 3.1020 StdDev: 23.36 Min: 1 Median: 1.5685 Max: 10417 Percentiles: P50: 1.57 P75: 1.95 P99: 7.98 P99.9: 160.11 P99.99: 347.36 ------------------------------------------------------ [ 0, 1 ] 381618 12.388% 12.388% ## ( 1, 2 ] 2038106 66.158% 78.546% ############# ( 2, 3 ] 390417 12.673% 91.219% ### ( 3, 4 ] 117446 3.812% 95.032% # ( 4, 6 ] 108029 3.507% 98.538% # ( 6, 10 ] 28733 0.933% 99.471% ( 10, 15 ] 4155 0.135% 99.606% ( 15, 22 ] 473 0.015% 99.621% ( 22, 34 ] 35 0.001% 99.622% ( 34, 51 ] 16 0.001% 99.623% ( 51, 76 ] 19 0.001% 99.624% ( 76, 110 ] 3457 0.112% 99.736% ( 110, 170 ] 6058 0.197% 99.932% ( 170, 250 ] 1204 0.039% 99.971% ( 250, 380 ] 761 0.025% 99.996% ( 380, 580 ] 606 0.020% 100.016% ( 580, 870 ] 317 0.010% 100.026% ( 870, 1300 ] 140 0.005% 100.031% ( 1300, 1900 ] 43 0.001% 100.032% ( 1900, 2900 ] 41 0.001% 100.033% ( 2900, 4400 ] 27 0.001% 100.034% ( 4400, 6600 ] 8 0.000% 100.035% ( 9900, 14000 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 1000023 Average: 6.7633 StdDev: 103.54 Min: 0 Median: 1.7476 Max: 13533 Percentiles: P50: 1.75 P75: 2.55 P99: 10.07 P99.9: 469.80 P99.99: 820.96 ------------------------------------------------------ [ 0, 1 ] 67485 6.748% 6.748% # ( 1, 2 ] 578581 57.857% 64.605% ############ ( 2, 3 ] 189488 18.948% 83.553% #### ( 3, 4 ] 60630 6.063% 89.616% # ( 4, 6 ] 71414 7.141% 96.758% # ( 6, 10 ] 22355 2.235% 98.993% ( 10, 15 ] 5232 0.523% 99.516% ( 15, 22 ] 683 0.068% 99.585% ( 22, 34 ] 60 0.006% 99.591% ( 34, 51 ] 13 0.001% 99.592% ( 51, 76 ] 54 0.005% 99.597% ( 76, 110 ] 800 0.080% 99.677% ( 110, 170 ] 906 0.091% 99.768% ( 170, 250 ] 440 0.044% 99.812% ( 250, 380 ] 565 0.056% 99.868% ( 380, 580 ] 706 0.071% 99.939% ( 580, 870 ] 615 0.061% 100.000% ( 870, 1300 ] 324 0.032% 100.033% ( 1300, 1900 ] 155 0.015% 100.048% ( 1900, 2900 ] 223 0.022% 100.071% ( 2900, 4400 ] 292 0.029% 100.100% ( 4400, 6600 ] 99 0.010% 100.110% ( 6600, 9900 ] 18 0.002% 100.111% ( 9900, 14000 ] 6 0.001% 100.112% ** Level 2 read latency histogram (micros): Count: 28324 Average: 1.9370 StdDev: 3.32 Min: 1 Median: 1.3666 Max: 359 Percentiles: P50: 1.37 P75: 1.76 P99: 4.91 P99.9: 9.93 P99.99: 183.41 ------------------------------------------------------ [ 0, 1 ] 7622 26.910% 26.910% ##### ( 1, 2 ] 17842 62.993% 89.903% ############# ( 2, 3 ] 1769 6.246% 96.148% # ( 3, 4 ] 662 2.337% 98.485% ( 4, 6 ] 322 1.137% 99.622% ( 6, 10 ] 80 0.282% 99.905% ( 10, 15 ] 19 0.067% 99.972% ( 15, 22 ] 3 0.011% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 271557 Average: 10.1747 StdDev: 124.13 Min: 0 Median: 1.6552 Max: 15086 Percentiles: P50: 1.66 P75: 2.28 P99: 109.31 P99.9: 1296.11 P99.99: 3391.37 ------------------------------------------------------ [ 0, 1 ] 27578 10.156% 10.156% ## ( 1, 2 ] 165146 60.814% 70.970% ############ ( 2, 3 ] 39377 14.500% 85.470% ### ( 3, 4 ] 16494 6.074% 91.544% # ( 4, 6 ] 13952 5.138% 96.682% # ( 6, 10 ] 5043 1.857% 98.539% ( 10, 15 ] 996 0.367% 98.906% ( 15, 22 ] 106 0.039% 98.945% ( 22, 34 ] 18 0.007% 98.952% ( 34, 51 ] 5 0.002% 98.953% ( 51, 76 ] 2 0.001% 98.954% ( 76, 110 ] 127 0.047% 99.001% ( 110, 170 ] 375 0.138% 99.139% ( 170, 250 ] 295 0.109% 99.248% ( 250, 380 ] 373 0.137% 99.385% ( 380, 580 ] 559 0.206% 99.591% ( 580, 870 ] 559 0.206% 99.797% ( 870, 1300 ] 283 0.104% 99.901% ( 1300, 1900 ] 149 0.055% 99.956% ( 1900, 2900 ] 65 0.024% 99.980% ( 2900, 4400 ] 85 0.031% 100.011% ( 4400, 6600 ] 18 0.007% 100.018% ( 6600, 9900 ] 7 0.003% 100.020% ( 9900, 14000 ] 2 0.001% 100.021% ( 14000, 22000 ] 2 0.001% 100.022% ** Level 4 read latency histogram (micros): Count: 35 Average: 3574.4000 StdDev: 1917.79 Min: 138 Median: 3050.0000 Max: 7896 Percentiles: P50: 3050.00 P75: 5335.00 P99: 7896.00 P99.9: 7896.00 P99.99: 7896.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 870, 1300 ] 2 5.714% 11.429% # ( 1300, 1900 ] 2 5.714% 17.143% # ( 1900, 2900 ] 11 31.429% 48.571% ###### ( 2900, 4400 ] 5 14.286% 62.857% ### ( 4400, 6600 ] 10 28.571% 91.429% ###### ( 6600, 9900 ] 3 8.571% 100.000% ## ** Level 5 read latency histogram (micros): Count: 140 Average: 1404.9000 StdDev: 1659.76 Min: 75 Median: 621.4286 Max: 7567 Percentiles: P50: 621.43 P75: 2328.57 P99: 7567.00 P99.9: 7567.00 P99.99: 7567.00 ------------------------------------------------------ ( 51, 76 ] 2 1.429% 1.429% ( 76, 110 ] 19 13.571% 15.000% ### ( 110, 170 ] 21 15.000% 30.000% ### ( 170, 250 ] 7 5.000% 35.000% # ( 250, 380 ] 7 5.000% 40.000% # ( 380, 580 ] 12 8.571% 48.571% ## ( 580, 870 ] 14 10.000% 58.571% ## ( 870, 1300 ] 9 6.429% 65.000% # ( 1300, 1900 ] 8 5.714% 70.714% # ( 1900, 2900 ] 14 10.000% 80.714% ## ( 2900, 4400 ] 19 13.571% 94.286% ### ( 4400, 6600 ] 6 4.286% 98.571% # ( 6600, 9900 ] 2 1.429% 100.000% ** DB Stats ** Uptime(secs): 33.9 total, 4.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 232.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.804 H:M:S, 34.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 225.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.627 H:M:S, 37.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-16:43:49 ... thread 0: (1000000,9000000) ops and (96522.7,204461.7) ops/second in (10.360252,44.018034) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 2.82 GB 12.6 9.3 0.0 9.3 17.9 8.5 0.0 2.1 136.5 261.1 70.12 59.77 150 0.467 9720K 22K 0.0 0.0 L1 5/5 628.48 MB 0.0 7.2 5.6 1.6 7.1 5.5 0.1 1.3 214.4 212.2 34.42 31.48 4 8.605 7084K 39K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.0 1.8 243.7 243.7 0.46 0.44 1 0.458 113K 30 0.0 0.0 L3 18/5 1.47 GB 0.9 3.8 2.8 1.0 3.8 2.7 2.3 1.4 140.6 140.3 27.62 17.78 37 0.747 3492K 6632 0.0 0.0 L4 179/30 10.76 GB 1.0 2.0 0.9 1.0 2.0 0.9 3.3 2.1 101.5 100.1 20.06 10.02 12 1.671 2067K 27K 0.0 0.0 L5 1080/0 88.89 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/48 104.56 GB 0.0 22.4 9.3 13.1 30.9 17.8 13.7 3.6 150.5 207.0 152.67 119.49 204 0.748 22M 96K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.4 9.3 13.1 30.9 17.8 13.7 3.6 150.5 207.0 152.67 119.49 204 0.748 22M 96K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.4 9.3 13.1 22.3 9.2 0.0 0.0 184.8 183.7 124.36 96.85 81 1.535 22M 96K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 309.3 28.31 22.64 123 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.2 total, 44.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.86 GB write, 714.46 MB/s write, 22.44 GB read, 519.55 MB/s read, 152.7 seconds Interval compaction: 30.86 GB write, 717.95 MB/s write, 22.44 GB read, 522.09 MB/s read, 152.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 66, interval: 92 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3911699 Average: 3.2557 StdDev: 28.89 Min: 1 Median: 1.5709 Max: 14421 Percentiles: P50: 1.57 P75: 1.95 P99: 8.42 P99.9: 165.44 P99.99: 422.16 ------------------------------------------------------ [ 0, 1 ] 482762 12.341% 12.341% ## ( 1, 2 ] 2580453 65.968% 78.309% ############# ( 2, 3 ] 492752 12.597% 90.906% ### ( 3, 4 ] 149390 3.819% 94.725% # ( 4, 6 ] 142292 3.638% 98.363% # ( 6, 10 ] 41196 1.053% 99.416% ( 10, 15 ] 5701 0.146% 99.561% ( 15, 22 ] 728 0.019% 99.580% ( 22, 34 ] 52 0.001% 99.581% ( 34, 51 ] 18 0.000% 99.582% ( 51, 76 ] 22 0.001% 99.582% ( 76, 110 ] 5017 0.128% 99.711% ( 110, 170 ] 8014 0.205% 99.916% ( 170, 250 ] 1651 0.042% 99.958% ( 250, 380 ] 1076 0.028% 99.985% ( 380, 580 ] 872 0.022% 100.008% ( 580, 870 ] 491 0.013% 100.020% ( 870, 1300 ] 211 0.005% 100.026% ( 1300, 1900 ] 85 0.002% 100.028% ( 1900, 2900 ] 75 0.002% 100.030% ( 2900, 4400 ] 58 0.001% 100.031% ( 4400, 6600 ] 13 0.000% 100.031% ( 6600, 9900 ] 4 0.000% 100.032% ( 9900, 14000 ] 1 0.000% 100.032% ( 14000, 22000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 1433474 Average: 6.8149 StdDev: 105.40 Min: 0 Median: 1.7857 Max: 16692 Percentiles: P50: 1.79 P75: 2.66 P99: 10.43 P99.9: 445.04 P99.99: 795.87 ------------------------------------------------------ [ 0, 1 ] 86173 6.011% 6.011% # ( 1, 2 ] 802504 55.983% 61.995% ########### ( 2, 3 ] 282056 19.676% 81.671% #### ( 3, 4 ] 96104 6.704% 88.375% # ( 4, 6 ] 116176 8.105% 96.480% ## ( 6, 10 ] 35425 2.471% 98.951% ( 10, 15 ] 8098 0.565% 99.516% ( 15, 22 ] 1099 0.077% 99.593% ( 22, 34 ] 92 0.006% 99.599% ( 34, 51 ] 24 0.002% 99.601% ( 51, 76 ] 69 0.005% 99.606% ( 76, 110 ] 1165 0.081% 99.687% ( 110, 170 ] 1343 0.094% 99.781% ( 170, 250 ] 606 0.042% 99.823% ( 250, 380 ] 794 0.055% 99.878% ( 380, 580 ] 961 0.067% 99.945% ( 580, 870 ] 862 0.060% 100.005% ( 870, 1300 ] 486 0.034% 100.039% ( 1300, 1900 ] 232 0.016% 100.055% ( 1900, 2900 ] 287 0.020% 100.075% ( 2900, 4400 ] 408 0.028% 100.104% ( 4400, 6600 ] 133 0.009% 100.113% ( 6600, 9900 ] 37 0.003% 100.116% ( 9900, 14000 ] 9 0.001% 100.116% ( 14000, 22000 ] 1 0.000% 100.117% ** Level 2 read latency histogram (micros): Count: 28324 Average: 1.9370 StdDev: 3.32 Min: 1 Median: 1.3666 Max: 359 Percentiles: P50: 1.37 P75: 1.76 P99: 4.91 P99.9: 9.93 P99.99: 183.41 ------------------------------------------------------ [ 0, 1 ] 7622 26.910% 26.910% ##### ( 1, 2 ] 17842 62.993% 89.903% ############# ( 2, 3 ] 1769 6.246% 96.148% # ( 3, 4 ] 662 2.337% 98.485% ( 4, 6 ] 322 1.137% 99.622% ( 6, 10 ] 80 0.282% 99.905% ( 10, 15 ] 19 0.067% 99.972% ( 15, 22 ] 3 0.011% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 668569 Average: 13.2335 StdDev: 161.48 Min: 0 Median: 1.8583 Max: 20321 Percentiles: P50: 1.86 P75: 2.87 P99: 19.53 P99.9: 1174.43 P99.99: 1712.11 ------------------------------------------------------ [ 0, 1 ] 35648 5.332% 5.332% # ( 1, 2 ] 347927 52.041% 57.373% ########## ( 2, 3 ] 136129 20.361% 77.734% #### ( 3, 4 ] 55296 8.271% 86.005% ## ( 4, 6 ] 63358 9.477% 95.481% ## ( 6, 10 ] 18628 2.786% 98.267% # ( 10, 15 ] 4546 0.680% 98.947% ( 15, 22 ] 543 0.081% 99.029% ( 22, 34 ] 62 0.009% 99.038% ( 34, 51 ] 19 0.003% 99.041% ( 51, 76 ] 9 0.001% 99.042% ( 76, 110 ] 144 0.022% 99.064% ( 110, 170 ] 494 0.074% 99.138% ( 170, 250 ] 601 0.090% 99.227% ( 250, 380 ] 877 0.131% 99.359% ( 380, 580 ] 1408 0.211% 99.569% ( 580, 870 ] 1507 0.225% 99.795% ( 870, 1300 ] 995 0.149% 99.943% ( 1300, 1900 ] 453 0.068% 100.011% ( 1900, 2900 ] 254 0.038% 100.049% ( 2900, 4400 ] 346 0.052% 100.101% ( 4400, 6600 ] 133 0.020% 100.121% ( 6600, 9900 ] 37 0.006% 100.126% ( 9900, 14000 ] 5 0.001% 100.127% ( 14000, 22000 ] 6 0.001% 100.128% ** Level 4 read latency histogram (micros): Count: 4701 Average: 43.3331 StdDev: 384.54 Min: 1 Median: 2.3676 Max: 7896 Percentiles: P50: 2.37 P75: 3.65 P99: 1299.77 P99.9: 6445.78 P99.99: 7896.00 ------------------------------------------------------ [ 0, 1 ] 54 1.149% 1.149% ( 1, 2 ] 1808 38.460% 39.609% ######## ( 2, 3 ] 1329 28.271% 67.879% ###### ( 3, 4 ] 516 10.976% 78.856% ## ( 4, 6 ] 638 13.572% 92.427% ### ( 6, 10 ] 208 4.425% 96.852% # ( 10, 15 ] 29 0.617% 97.469% ( 15, 22 ] 8 0.170% 97.639% ( 22, 34 ] 2 0.043% 97.681% ( 34, 51 ] 1 0.021% 97.703% ( 51, 76 ] 1 0.021% 97.724% ( 76, 110 ] 3 0.064% 97.788% ( 110, 170 ] 4 0.085% 97.873% ( 170, 250 ] 21 0.447% 98.320% ( 250, 380 ] 7 0.149% 98.468% ( 380, 580 ] 4 0.085% 98.553% ( 580, 870 ] 2 0.043% 98.596% ( 870, 1300 ] 19 0.404% 99.000% ( 1300, 1900 ] 14 0.298% 99.298% ( 1900, 2900 ] 12 0.255% 99.553% ( 2900, 4400 ] 7 0.149% 99.702% ( 4400, 6600 ] 10 0.213% 99.915% ( 6600, 9900 ] 4 0.085% 100.000% ** Level 5 read latency histogram (micros): Count: 194 Average: 1457.9021 StdDev: 1669.55 Min: 75 Median: 662.8571 Max: 7567 Percentiles: P50: 662.86 P75: 2375.00 P99: 6699.00 P99.9: 7567.00 P99.99: 7567.00 ------------------------------------------------------ ( 51, 76 ] 2 1.031% 1.031% ( 76, 110 ] 19 9.794% 10.825% ## ( 110, 170 ] 23 11.856% 22.680% ## ( 170, 250 ] 13 6.701% 29.381% # ( 250, 380 ] 14 7.216% 36.598% # ( 380, 580 ] 20 10.309% 46.907% ## ( 580, 870 ] 21 10.825% 57.732% ## ( 870, 1300 ] 12 6.186% 63.918% # ( 1300, 1900 ] 12 6.186% 70.103% # ( 1900, 2900 ] 20 10.309% 80.412% ## ( 2900, 4400 ] 23 11.856% 92.268% ## ( 4400, 6600 ] 13 6.701% 98.969% # ( 6600, 9900 ] 2 1.031% 100.000% ** DB Stats ** Uptime(secs): 44.2 total, 10.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 200.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.275 H:M:S, 43.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 95.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.472 H:M:S, 72.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/11/17-16:43:52 ... thread 0: (1000000,10000000) ops and (315244.4,211908.5) ops/second in (3.172142,47.190176) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 3.74 GB 75.5 10.0 0.0 10.0 19.4 9.5 0.0 2.0 135.1 263.2 75.53 64.66 165 0.458 10M 23K 0.0 0.0 L1 5/5 628.48 MB 0.0 7.2 5.6 1.6 7.1 5.5 0.1 1.3 214.4 212.2 34.42 31.48 4 8.605 7084K 39K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.0 1.8 243.7 243.7 0.46 0.44 1 0.458 113K 30 0.0 0.0 L3 13/0 891.42 MB 0.9 3.8 2.8 1.0 3.8 2.7 2.3 1.4 140.6 140.3 27.62 17.78 37 0.747 3492K 6632 0.0 0.0 L4 162/0 9.74 GB 1.0 3.5 1.5 2.0 3.5 1.5 3.3 2.2 116.3 114.7 30.84 17.33 17 1.814 3445K 43K 0.0 0.0 L5 1100/0 90.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/17 105.46 GB 0.0 24.6 9.9 14.6 33.9 19.3 15.3 3.6 149.0 205.5 168.86 131.69 224 0.754 24M 112K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.6 9.9 14.6 33.9 19.3 15.3 3.6 149.0 205.5 168.86 131.69 224 0.754 24M 112K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.6 9.9 14.6 24.4 9.8 0.0 0.0 182.8 181.7 137.62 106.57 88 1.564 24M 112K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 310.5 31.24 25.12 136 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.4 total, 47.2 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.89 GB write, 732.12 MB/s write, 24.57 GB read, 530.75 MB/s read, 168.9 seconds Interval compaction: 33.89 GB write, 735.46 MB/s write, 24.57 GB read, 533.17 MB/s read, 168.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 75, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 75, interval: 101 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4265986 Average: 3.2417 StdDev: 29.21 Min: 1 Median: 1.5773 Max: 14421 Percentiles: P50: 1.58 P75: 1.96 P99: 8.36 P99.9: 163.41 P99.99: 404.71 ------------------------------------------------------ [ 0, 1 ] 511979 12.001% 12.001% ## ( 1, 2 ] 2807905 65.821% 77.822% ############# ( 2, 3 ] 553619 12.978% 90.800% ### ( 3, 4 ] 164674 3.860% 94.660% # ( 4, 6 ] 158422 3.714% 98.373% # ( 6, 10 ] 45358 1.063% 99.437% ( 10, 15 ] 6674 0.156% 99.593% ( 15, 22 ] 790 0.019% 99.612% ( 22, 34 ] 55 0.001% 99.613% ( 34, 51 ] 20 0.000% 99.613% ( 51, 76 ] 24 0.001% 99.614% ( 76, 110 ] 5025 0.118% 99.732% ( 110, 170 ] 8062 0.189% 99.921% ( 170, 250 ] 1713 0.040% 99.961% ( 250, 380 ] 1126 0.026% 99.987% ( 380, 580 ] 926 0.022% 100.009% ( 580, 870 ] 541 0.013% 100.022% ( 870, 1300 ] 241 0.006% 100.027% ( 1300, 1900 ] 95 0.002% 100.030% ( 1900, 2900 ] 99 0.002% 100.032% ( 2900, 4400 ] 67 0.002% 100.033% ( 4400, 6600 ] 13 0.000% 100.034% ( 6600, 9900 ] 4 0.000% 100.034% ( 9900, 14000 ] 1 0.000% 100.034% ( 14000, 22000 ] 1 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 1500446 Average: 6.6425 StdDev: 103.02 Min: 0 Median: 1.7904 Max: 16692 Percentiles: P50: 1.79 P75: 2.67 P99: 10.30 P99.9: 416.54 P99.99: 770.07 ------------------------------------------------------ [ 0, 1 ] 88213 5.879% 5.879% # ( 1, 2 ] 837543 55.820% 61.699% ########### ( 2, 3 ] 297526 19.829% 81.528% #### ( 3, 4 ] 101441 6.761% 88.289% # ( 4, 6 ] 122950 8.194% 96.483% ## ( 6, 10 ] 37245 2.482% 98.965% ( 10, 15 ] 8605 0.573% 99.539% ( 15, 22 ] 1148 0.077% 99.615% ( 22, 34 ] 95 0.006% 99.621% ( 34, 51 ] 25 0.002% 99.623% ( 51, 76 ] 71 0.005% 99.628% ( 76, 110 ] 1165 0.078% 99.705% ( 110, 170 ] 1343 0.090% 99.795% ( 170, 250 ] 606 0.040% 99.835% ( 250, 380 ] 794 0.053% 99.888% ( 380, 580 ] 961 0.064% 99.952% ( 580, 870 ] 862 0.057% 100.010% ( 870, 1300 ] 486 0.032% 100.042% ( 1300, 1900 ] 232 0.015% 100.058% ( 1900, 2900 ] 287 0.019% 100.077% ( 2900, 4400 ] 408 0.027% 100.104% ( 4400, 6600 ] 133 0.009% 100.113% ( 6600, 9900 ] 37 0.002% 100.115% ( 9900, 14000 ] 9 0.001% 100.116% ( 14000, 22000 ] 1 0.000% 100.116% ** Level 2 read latency histogram (micros): Count: 28324 Average: 1.9370 StdDev: 3.32 Min: 1 Median: 1.3666 Max: 359 Percentiles: P50: 1.37 P75: 1.76 P99: 4.91 P99.9: 9.93 P99.99: 183.41 ------------------------------------------------------ [ 0, 1 ] 7622 26.910% 26.910% ##### ( 1, 2 ] 17842 62.993% 89.903% ############# ( 2, 3 ] 1769 6.246% 96.148% # ( 3, 4 ] 662 2.337% 98.485% ( 4, 6 ] 322 1.137% 99.622% ( 6, 10 ] 80 0.282% 99.905% ( 10, 15 ] 19 0.067% 99.972% ( 15, 22 ] 3 0.011% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 775833 Average: 12.1866 StdDev: 151.22 Min: 0 Median: 1.8641 Max: 20321 Percentiles: P50: 1.86 P75: 2.86 P99: 14.72 P99.9: 1090.40 P99.99: 1538.24 ------------------------------------------------------ [ 0, 1 ] 38318 4.939% 4.939% # ( 1, 2 ] 404582 52.148% 57.087% ########## ( 2, 3 ] 161610 20.831% 77.918% #### ( 3, 4 ] 63507 8.186% 86.103% ## ( 4, 6 ] 73619 9.489% 95.592% ## ( 6, 10 ] 21437 2.763% 98.355% # ( 10, 15 ] 5295 0.682% 99.038% ( 15, 22 ] 610 0.079% 99.116% ( 22, 34 ] 68 0.009% 99.125% ( 34, 51 ] 20 0.003% 99.128% ( 51, 76 ] 9 0.001% 99.129% ( 76, 110 ] 149 0.019% 99.148% ( 110, 170 ] 533 0.069% 99.217% ( 170, 250 ] 683 0.088% 99.305% ( 250, 380 ] 960 0.124% 99.429% ( 380, 580 ] 1521 0.196% 99.625% ( 580, 870 ] 1599 0.206% 99.831% ( 870, 1300 ] 1048 0.135% 99.966% ( 1300, 1900 ] 472 0.061% 100.027% ( 1900, 2900 ] 267 0.034% 100.061% ( 2900, 4400 ] 349 0.045% 100.106% ( 4400, 6600 ] 133 0.017% 100.123% ( 6600, 9900 ] 37 0.005% 100.128% ( 9900, 14000 ] 5 0.001% 100.129% ( 14000, 22000 ] 6 0.001% 100.129% ** Level 4 read latency histogram (micros): Count: 4846 Average: 47.8069 StdDev: 387.39 Min: 1 Median: 2.3661 Max: 7896 Percentiles: P50: 2.37 P75: 3.70 P99: 1395.25 P99.9: 6413.88 P99.99: 7896.00 ------------------------------------------------------ [ 0, 1 ] 84 1.733% 1.733% ( 1, 2 ] 1848 38.135% 39.868% ######## ( 2, 3 ] 1341 27.672% 67.540% ###### ( 3, 4 ] 520 10.730% 78.271% ## ( 4, 6 ] 640 13.207% 91.478% ### ( 6, 10 ] 210 4.333% 95.811% # ( 10, 15 ] 29 0.598% 96.409% ( 15, 22 ] 10 0.206% 96.616% ( 22, 34 ] 4 0.083% 96.698% ( 34, 51 ] 1 0.021% 96.719% ( 51, 76 ] 1 0.021% 96.740% ( 76, 110 ] 4 0.083% 96.822% ( 110, 170 ] 6 0.124% 96.946% ( 170, 250 ] 46 0.949% 97.895% ( 250, 380 ] 7 0.144% 98.040% ( 380, 580 ] 11 0.227% 98.267% ( 580, 870 ] 8 0.165% 98.432% ( 870, 1300 ] 25 0.516% 98.948% ( 1300, 1900 ] 16 0.330% 99.278% ( 1900, 2900 ] 13 0.268% 99.546% ( 2900, 4400 ] 8 0.165% 99.711% ( 4400, 6600 ] 10 0.206% 99.917% ( 6600, 9900 ] 4 0.083% 100.000% ** Level 5 read latency histogram (micros): Count: 280 Average: 1386.5143 StdDev: 1538.21 Min: 75 Median: 673.5484 Max: 7567 Percentiles: P50: 673.55 P75: 2150.00 P99: 6474.29 P99.9: 7567.00 P99.99: 7567.00 ------------------------------------------------------ ( 51, 76 ] 2 0.714% 0.714% ( 76, 110 ] 21 7.500% 8.214% ## ( 110, 170 ] 30 10.714% 18.929% ## ( 170, 250 ] 21 7.500% 26.429% ## ( 250, 380 ] 22 7.857% 34.286% ## ( 380, 580 ] 34 12.143% 46.429% ## ( 580, 870 ] 31 11.071% 57.500% ## ( 870, 1300 ] 19 6.786% 64.286% # ( 1300, 1900 ] 23 8.214% 72.500% ## ( 1900, 2900 ] 28 10.000% 82.500% ## ( 2900, 4400 ] 33 11.786% 94.286% ## ( 4400, 6600 ] 14 5.000% 99.286% # ( 6600, 9900 ] 2 0.714% 100.000% ** DB Stats ** Uptime(secs): 47.4 total, 3.2 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 207.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.761 H:M:S, 41.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 310.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.485 H:M:S, 15.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-16:43:56 ... thread 0: (1000000,11000000) ops and (268058.6,216022.2) ops/second in (3.730528,50.920704) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 4.79 GB 214.0 11.1 0.0 11.1 21.6 10.5 0.0 2.1 136.5 265.9 83.05 71.75 183 0.454 11M 24K 0.0 0.0 L1 5/5 628.48 MB 0.0 7.2 5.6 1.6 7.1 5.5 0.1 1.3 214.4 212.2 34.42 31.48 4 8.605 7084K 39K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.0 1.8 243.7 243.7 0.46 0.44 1 0.458 113K 30 0.0 0.0 L3 13/0 891.42 MB 0.9 3.8 2.8 1.0 3.8 2.7 2.3 1.4 140.6 140.3 27.62 17.78 37 0.747 3492K 6632 0.0 0.0 L4 162/0 9.74 GB 1.0 3.5 1.5 2.0 3.5 1.5 3.3 2.2 116.3 114.7 30.84 17.33 17 1.814 3445K 43K 0.0 0.0 L5 1100/0 90.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/13 106.50 GB 0.0 25.7 9.9 15.7 36.0 20.3 15.3 3.4 149.1 209.3 176.39 138.78 242 0.729 25M 114K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.7 9.9 15.7 36.0 20.3 15.3 3.4 149.1 209.3 176.39 138.78 242 0.729 25M 114K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.7 9.9 15.7 25.5 9.8 0.0 0.0 185.1 184.0 142.07 110.91 92 1.544 25M 114K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 313.9 34.32 27.87 150 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.1 total, 50.9 interval Flush(GB): cumulative 10.520, interval 10.520 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.05 GB write, 721.80 MB/s write, 25.68 GB read, 514.20 MB/s read, 176.4 seconds Interval compaction: 36.05 GB write, 724.86 MB/s write, 25.68 GB read, 516.38 MB/s read, 176.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 79, interval: 108 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4727112 Average: 3.1628 StdDev: 27.94 Min: 1 Median: 1.5776 Max: 14421 Percentiles: P50: 1.58 P75: 1.96 P99: 8.20 P99.9: 159.59 P99.99: 371.03 ------------------------------------------------------ [ 0, 1 ] 562275 11.895% 11.895% ## ( 1, 2 ] 3118549 65.972% 77.866% ############# ( 2, 3 ] 618742 13.089% 90.955% ### ( 3, 4 ] 180292 3.814% 94.769% # ( 4, 6 ] 172438 3.648% 98.417% # ( 6, 10 ] 50000 1.058% 99.475% ( 10, 15 ] 7315 0.155% 99.630% ( 15, 22 ] 839 0.018% 99.648% ( 22, 34 ] 59 0.001% 99.649% ( 34, 51 ] 23 0.000% 99.649% ( 51, 76 ] 28 0.001% 99.650% ( 76, 110 ] 5074 0.107% 99.757% ( 110, 170 ] 8169 0.173% 99.930% ( 170, 250 ] 1762 0.037% 99.967% ( 250, 380 ] 1155 0.024% 99.992% ( 380, 580 ] 952 0.020% 100.012% ( 580, 870 ] 551 0.012% 100.024% ( 870, 1300 ] 249 0.005% 100.029% ( 1300, 1900 ] 96 0.002% 100.031% ( 1900, 2900 ] 101 0.002% 100.033% ( 2900, 4400 ] 68 0.001% 100.034% ( 4400, 6600 ] 13 0.000% 100.035% ( 6600, 9900 ] 4 0.000% 100.035% ( 9900, 14000 ] 1 0.000% 100.035% ( 14000, 22000 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 1500446 Average: 6.6425 StdDev: 103.02 Min: 0 Median: 1.7904 Max: 16692 Percentiles: P50: 1.79 P75: 2.67 P99: 10.30 P99.9: 416.54 P99.99: 770.07 ------------------------------------------------------ [ 0, 1 ] 88213 5.879% 5.879% # ( 1, 2 ] 837543 55.820% 61.699% ########### ( 2, 3 ] 297526 19.829% 81.528% #### ( 3, 4 ] 101441 6.761% 88.289% # ( 4, 6 ] 122950 8.194% 96.483% ## ( 6, 10 ] 37245 2.482% 98.965% ( 10, 15 ] 8605 0.573% 99.539% ( 15, 22 ] 1148 0.077% 99.615% ( 22, 34 ] 95 0.006% 99.621% ( 34, 51 ] 25 0.002% 99.623% ( 51, 76 ] 71 0.005% 99.628% ( 76, 110 ] 1165 0.078% 99.705% ( 110, 170 ] 1343 0.090% 99.795% ( 170, 250 ] 606 0.040% 99.835% ( 250, 380 ] 794 0.053% 99.888% ( 380, 580 ] 961 0.064% 99.952% ( 580, 870 ] 862 0.057% 100.010% ( 870, 1300 ] 486 0.032% 100.042% ( 1300, 1900 ] 232 0.015% 100.058% ( 1900, 2900 ] 287 0.019% 100.077% ( 2900, 4400 ] 408 0.027% 100.104% ( 4400, 6600 ] 133 0.009% 100.113% ( 6600, 9900 ] 37 0.002% 100.115% ( 9900, 14000 ] 9 0.001% 100.116% ( 14000, 22000 ] 1 0.000% 100.116% ** Level 2 read latency histogram (micros): Count: 28324 Average: 1.9370 StdDev: 3.32 Min: 1 Median: 1.3666 Max: 359 Percentiles: P50: 1.37 P75: 1.76 P99: 4.91 P99.9: 9.93 P99.99: 183.41 ------------------------------------------------------ [ 0, 1 ] 7622 26.910% 26.910% ##### ( 1, 2 ] 17842 62.993% 89.903% ############# ( 2, 3 ] 1769 6.246% 96.148% # ( 3, 4 ] 662 2.337% 98.485% ( 4, 6 ] 322 1.137% 99.622% ( 6, 10 ] 80 0.282% 99.905% ( 10, 15 ] 19 0.067% 99.972% ( 15, 22 ] 3 0.011% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 775833 Average: 12.1866 StdDev: 151.22 Min: 0 Median: 1.8641 Max: 20321 Percentiles: P50: 1.86 P75: 2.86 P99: 14.72 P99.9: 1090.40 P99.99: 1538.24 ------------------------------------------------------ [ 0, 1 ] 38318 4.939% 4.939% # ( 1, 2 ] 404582 52.148% 57.087% ########## ( 2, 3 ] 161610 20.831% 77.918% #### ( 3, 4 ] 63507 8.186% 86.103% ## ( 4, 6 ] 73619 9.489% 95.592% ## ( 6, 10 ] 21437 2.763% 98.355% # ( 10, 15 ] 5295 0.682% 99.038% ( 15, 22 ] 610 0.079% 99.116% ( 22, 34 ] 68 0.009% 99.125% ( 34, 51 ] 20 0.003% 99.128% ( 51, 76 ] 9 0.001% 99.129% ( 76, 110 ] 149 0.019% 99.148% ( 110, 170 ] 533 0.069% 99.217% ( 170, 250 ] 683 0.088% 99.305% ( 250, 380 ] 960 0.124% 99.429% ( 380, 580 ] 1521 0.196% 99.625% ( 580, 870 ] 1599 0.206% 99.831% ( 870, 1300 ] 1048 0.135% 99.966% ( 1300, 1900 ] 472 0.061% 100.027% ( 1900, 2900 ] 267 0.034% 100.061% ( 2900, 4400 ] 349 0.045% 100.106% ( 4400, 6600 ] 133 0.017% 100.123% ( 6600, 9900 ] 37 0.005% 100.128% ( 9900, 14000 ] 5 0.001% 100.129% ( 14000, 22000 ] 6 0.001% 100.129% ** Level 4 read latency histogram (micros): Count: 4846 Average: 47.8069 StdDev: 387.39 Min: 1 Median: 2.3661 Max: 7896 Percentiles: P50: 2.37 P75: 3.70 P99: 1395.25 P99.9: 6413.88 P99.99: 7896.00 ------------------------------------------------------ [ 0, 1 ] 84 1.733% 1.733% ( 1, 2 ] 1848 38.135% 39.868% ######## ( 2, 3 ] 1341 27.672% 67.540% ###### ( 3, 4 ] 520 10.730% 78.271% ## ( 4, 6 ] 640 13.207% 91.478% ### ( 6, 10 ] 210 4.333% 95.811% # ( 10, 15 ] 29 0.598% 96.409% ( 15, 22 ] 10 0.206% 96.616% ( 22, 34 ] 4 0.083% 96.698% ( 34, 51 ] 1 0.021% 96.719% ( 51, 76 ] 1 0.021% 96.740% ( 76, 110 ] 4 0.083% 96.822% ( 110, 170 ] 6 0.124% 96.946% ( 170, 250 ] 46 0.949% 97.895% ( 250, 380 ] 7 0.144% 98.040% ( 380, 580 ] 11 0.227% 98.267% ( 580, 870 ] 8 0.165% 98.432% ( 870, 1300 ] 25 0.516% 98.948% ( 1300, 1900 ] 16 0.330% 99.278% ( 1900, 2900 ] 13 0.268% 99.546% ( 2900, 4400 ] 8 0.165% 99.711% ( 4400, 6600 ] 10 0.206% 99.917% ( 6600, 9900 ] 4 0.083% 100.000% ** Level 5 read latency histogram (micros): Count: 280 Average: 1386.5143 StdDev: 1538.21 Min: 75 Median: 673.5484 Max: 7567 Percentiles: P50: 673.55 P75: 2150.00 P99: 6474.29 P99.9: 7567.00 P99.99: 7567.00 ------------------------------------------------------ ( 51, 76 ] 2 0.714% 0.714% ( 76, 110 ] 21 7.500% 8.214% ## ( 110, 170 ] 30 10.714% 18.929% ## ( 170, 250 ] 21 7.500% 26.429% ## ( 250, 380 ] 22 7.857% 34.286% ## ( 380, 580 ] 34 12.143% 46.429% ## ( 580, 870 ] 31 11.071% 57.500% ## ( 870, 1300 ] 19 6.786% 64.286% # ( 1300, 1900 ] 23 8.214% 72.500% ## ( 1900, 2900 ] 28 10.000% 82.500% ## ( 2900, 4400 ] 33 11.786% 94.286% ## ( 4400, 6600 ] 14 5.000% 99.286% # ( 6600, 9900 ] 2 0.714% 100.000% ** DB Stats ** Uptime(secs): 51.1 total, 3.7 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 211.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.875 H:M:S, 40.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 263.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.114 H:M:S, 29.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.270 micros/op 189740 ops/sec 60.108 seconds 11404999 operations; 183.8 MB/s Microseconds per write: Count: 11404999 Average: 5.2703 StdDev: 494.20 Min: 0 Median: 1.7556 Max: 1017869 Percentiles: P50: 1.76 P75: 2.75 P99: 8.22 P99.9: 1056.25 P99.99: 2662.96 ------------------------------------------------------ [ 0, 1 ] 1366407 11.981% 11.981% ## ( 1, 2 ] 5738315 50.314% 62.295% ########## ( 2, 3 ] 1940286 17.013% 79.307% ### ( 3, 4 ] 1584849 13.896% 93.203% ### ( 4, 6 ] 603884 5.295% 98.498% # ( 6, 10 ] 103029 0.903% 99.402% ( 10, 15 ] 29389 0.258% 99.659% ( 15, 22 ] 8678 0.076% 99.736% ( 22, 34 ] 1791 0.016% 99.751% ( 34, 51 ] 187 0.002% 99.753% ( 51, 76 ] 28 0.000% 99.753% ( 76, 110 ] 8263 0.072% 99.826% ( 110, 170 ] 2902 0.025% 99.851% ( 170, 250 ] 269 0.002% 99.853% ( 250, 380 ] 111 0.001% 99.854% ( 380, 580 ] 25 0.000% 99.855% ( 580, 870 ] 14 0.000% 99.855% ( 870, 1300 ] 11929 0.105% 99.959% ( 1300, 1900 ] 28 0.000% 99.960% ( 1900, 2900 ] 4554 0.040% 99.999% ( 2900, 4400 ] 24 0.000% 100.000% ( 4400, 6600 ] 3 0.000% 100.000% ( 6600, 9900 ] 7 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 208140 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11404999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11769958968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 632 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 28932714 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 33061921800 rocksdb.compact.write.bytes COUNT : 32838295341 rocksdb.flush.write.bytes COUNT : 11758040736 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 67 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 363 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11663367168 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4656128 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33172454070 rocksdb.non.last.level.read.count COUNT : 8008702 rocksdb.block.checksum.compute.count COUNT : 8007505 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.417016 P95 : 3.863172 P99 : 6.370904 P100 : 1017867.000000 COUNT : 11404999 SUM : 54885402 rocksdb.compaction.times.micros P50 : 1024137.931034 P95 : 6060000.000000 P99 : 16051476.000000 P100 : 16051476.000000 COUNT : 96 SUM : 165420259 rocksdb.compaction.times.cpu_micros P50 : 942424.242424 P95 : 5708000.000000 P99 : 14320000.000000 P100 : 14909094.000000 COUNT : 96 SUM : 132742731 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 703.631579 P95 : 1622.500000 P99 : 90050.000000 P100 : 345818.000000 COUNT : 157 SUM : 619813 rocksdb.compaction.outfile.sync.micros P50 : 1046.683168 P95 : 123153.846154 P99 : 229700.000000 P100 : 1277529.000000 COUNT : 403 SUM : 8757484 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 121.400000 P95 : 1455.454545 P99 : 2694.000000 P100 : 4309.000000 COUNT : 303 SUM : 95264 rocksdb.table.open.io.micros P50 : 1402.857143 P95 : 8855.000000 P99 : 18130.909091 P100 : 22513.000000 COUNT : 632 SUM : 1497562 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.686404 P95 : 8.216750 P99 : 13.409097 P100 : 20325.000000 COUNT : 8005707 SUM : 54577235 rocksdb.read.block.get.micros P50 : 480.000000 P95 : 3784.745763 P99 : 6547.851852 P100 : 12935.000000 COUNT : 1264 SUM : 1196125 rocksdb.write.raw.block.micros P50 : 0.514471 P95 : 0.977494 P99 : 3.197011 P100 : 28740.000000 COUNT : 10802382 SUM : 22884257 rocksdb.numfiles.in.singlecompaction P50 : 3.306452 P95 : 8.288889 P99 : 24.760000 P100 : 35.000000 COUNT : 177 SUM : 726 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.557155 P95 : 1173.723093 P99 : 2551.191105 P100 : 1017656.000000 COUNT : 161829 SUM : 28944343 rocksdb.sst.read.micros P50 : 1.630922 P95 : 4.922607 P99 : 9.503258 P100 : 20321.000000 COUNT : 8009017 SUM : 38348566 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11404999 SUM : 11769958968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214705.882353 P95 : 448083.333333 P99 : 804900.000000 P100 : 1183127.000000 COUNT : 157 SUM : 35597173 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 419 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0