[2024-11-29 02:19:20.911868] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-29 02:19:20.912133] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1631385 ] Set seed to 1732843160905233 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-29 02:19:21.031009] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-29 02:19:21.243128] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-29 02:19:21.243169] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1631385' to capture a snapshot of events at runtime. [2024-11-29 02:19:21.243180] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1631385 for offline analysis/debug. [2024-11-29 02:19:21.243207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 29 02:19:29 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/29-02:19:32 ... thread 0: (1000000,1000000) ops and (361752.4,361752.4) ops/second in (2.764322,2.764322) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 504.01 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 359.1 2.28 2.03 12 0.190 0 0 0.0 0.0 L1 1/0 2.07 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 248.7 248.4 1.01 0.98 1 1.013 255K 235 0.0 0.0 L2 3/2 298.54 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.3 1.8 239.5 239.4 0.47 0.43 1 0.465 113K 35 0.0 0.0 L3 17/10 818.41 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 209.7 209.7 0.30 0.25 1 0.298 63K 0 0.0 0.0 L4 116/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/18 96.94 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 105.0 306.7 4.06 3.70 15 0.271 432K 270 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 105.0 306.7 4.06 3.70 15 0.271 432K 270 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 239.7 239.6 1.78 1.67 3 0.592 432K 270 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 359.1 2.28 2.03 12 0.190 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.22 GB write, 414.66 MB/s write, 0.42 GB read, 141.89 MB/s read, 4.1 seconds Interval compaction: 1.22 GB write, 450.01 MB/s write, 0.42 GB read, 153.99 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 112546 Average: 1.9387 StdDev: 20.03 Min: 1 Median: 1.2526 Max: 3525 Percentiles: P50: 1.25 P75: 1.67 P99: 4.45 P99.9: 10.17 P99.99: 325.63 ------------------------------------------------------ [ 0, 1 ] 39364 34.976% 34.976% ####### ( 1, 2 ] 66951 59.488% 94.464% ############ ( 2, 3 ] 3543 3.148% 97.612% # ( 3, 4 ] 1384 1.230% 98.841% ( 4, 6 ] 796 0.707% 99.549% ( 6, 10 ] 395 0.351% 99.900% ( 10, 15 ] 71 0.063% 99.963% ( 15, 22 ] 13 0.012% 99.974% ( 34, 51 ] 5 0.004% 99.979% ( 51, 76 ] 2 0.002% 99.980% ( 110, 170 ] 10 0.009% 99.989% ( 170, 250 ] 1 0.001% 99.990% ( 250, 380 ] 3 0.003% 99.993% ( 380, 580 ] 3 0.003% 99.996% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 3 0.003% 100.002% ** Level 1 read latency histogram (micros): Count: 16295 Average: 3.6450 StdDev: 63.05 Min: 0 Median: 1.3194 Max: 7053 Percentiles: P50: 1.32 P75: 1.75 P99: 9.68 P99.9: 350.17 P99.99: 2270.50 ------------------------------------------------------ [ 0, 1 ] 5109 31.353% 31.353% ###### ( 1, 2 ] 9513 58.380% 89.733% ############ ( 2, 3 ] 783 4.805% 94.538% # ( 3, 4 ] 295 1.810% 96.349% ( 4, 6 ] 274 1.681% 98.030% ( 6, 10 ] 172 1.056% 99.086% ( 10, 15 ] 46 0.282% 99.368% ( 15, 22 ] 4 0.025% 99.392% ( 34, 51 ] 1 0.006% 99.399% ( 51, 76 ] 47 0.288% 99.687% ( 76, 110 ] 5 0.031% 99.718% ( 110, 170 ] 1 0.006% 99.724% ( 170, 250 ] 21 0.129% 99.853% ( 250, 380 ] 10 0.061% 99.914% ( 380, 580 ] 5 0.031% 99.945% ( 580, 870 ] 6 0.037% 99.982% ( 870, 1300 ] 1 0.006% 99.988% ( 1900, 2900 ] 1 0.006% 99.994% ( 6600, 9900 ] 1 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 15878 Average: 1.8241 StdDev: 5.84 Min: 1 Median: 1.2071 Max: 600 Percentiles: P50: 1.21 P75: 1.66 P99: 5.07 P99.9: 10.88 P99.99: 303.59 ------------------------------------------------------ [ 0, 1 ] 6116 38.519% 38.519% ######## ( 1, 2 ] 8801 55.429% 93.948% ########### ( 2, 3 ] 484 3.048% 96.996% # ( 3, 4 ] 232 1.461% 98.457% ( 4, 6 ] 161 1.014% 99.471% ( 6, 10 ] 66 0.416% 99.887% ( 10, 15 ] 12 0.076% 99.962% ( 15, 22 ] 1 0.006% 99.969% ( 51, 76 ] 1 0.006% 99.975% ( 170, 250 ] 2 0.013% 99.987% ( 250, 380 ] 1 0.006% 99.994% ( 580, 870 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 6929 Average: 30.3615 StdDev: 424.13 Min: 1 Median: 1.6718 Max: 11217 Percentiles: P50: 1.67 P75: 2.49 P99: 155.79 P99.9: 8121.30 P99.99: 10529.55 ------------------------------------------------------ [ 0, 1 ] 823 11.878% 11.878% ## ( 1, 2 ] 3932 56.747% 68.625% ########### ( 2, 3 ] 898 12.960% 81.585% ### ( 3, 4 ] 504 7.274% 88.858% # ( 4, 6 ] 425 6.134% 94.992% # ( 6, 10 ] 168 2.425% 97.417% ( 10, 15 ] 50 0.722% 98.138% ( 15, 22 ] 11 0.159% 98.297% ( 22, 34 ] 4 0.058% 98.355% ( 34, 51 ] 1 0.014% 98.369% ( 51, 76 ] 1 0.014% 98.384% ( 76, 110 ] 16 0.231% 98.615% ( 110, 170 ] 35 0.505% 99.120% ( 170, 250 ] 7 0.101% 99.221% ( 250, 380 ] 5 0.072% 99.293% ( 380, 580 ] 11 0.159% 99.452% ( 580, 870 ] 9 0.130% 99.581% ( 870, 1300 ] 4 0.058% 99.639% ( 1900, 2900 ] 3 0.043% 99.682% ( 2900, 4400 ] 2 0.029% 99.711% ( 4400, 6600 ] 8 0.115% 99.827% ( 6600, 9900 ] 11 0.159% 99.986% ( 9900, 14000 ] 2 0.029% 100.014% ** Level 4 read latency histogram (micros): Count: 30 Average: 3601.6000 StdDev: 3623.86 Min: 245 Median: 2233.3333 Max: 13900 Percentiles: P50: 2233.33 P75: 6325.00 P99: 13385.00 P99.9: 13900.00 P99.99: 13900.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 7 23.333% 26.667% ##### ( 580, 870 ] 3 10.000% 36.667% ## ( 870, 1300 ] 3 10.000% 46.667% ## ( 1900, 2900 ] 3 10.000% 56.667% ## ( 2900, 4400 ] 2 6.667% 63.333% # ( 4400, 6600 ] 4 13.333% 76.667% ### ( 6600, 9900 ] 5 16.667% 93.333% ### ( 9900, 14000 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 327.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.180 H:M:S, 6.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 355.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.180 H:M:S, 6.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/29-02:19:35 ... thread 0: (1000000,2000000) ops and (324298.5,342003.1) ops/second in (3.083579,5.847901) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.48 GB 94.4 0.9 0.0 0.9 2.7 1.8 0.0 1.5 107.5 315.2 8.79 8.12 29 0.303 959K 1236 0.0 0.0 L1 1/0 2.07 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 248.7 248.4 1.01 0.98 1 1.013 255K 235 0.0 0.0 L2 1/1 48.90 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 239.5 239.4 0.47 0.43 1 0.465 113K 35 0.0 0.0 L3 49/9 1.04 GB 0.3 0.4 0.3 0.1 0.4 0.3 0.0 1.3 165.0 165.0 2.44 1.93 3 0.813 380K 63 0.0 0.0 L4 116/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1222/18 97.92 GB 0.0 1.7 0.6 1.1 3.5 2.3 0.4 1.9 134.6 278.2 12.71 11.46 34 0.374 1708K 1569 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.6 1.1 3.5 2.3 0.4 1.9 134.6 278.2 12.71 11.46 34 0.374 1708K 1569 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.6 1.1 1.7 0.5 0.0 0.0 226.8 226.6 7.54 6.90 8 0.943 1708K 1569 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.6 5.17 4.57 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.45 GB write, 581.13 MB/s write, 1.67 GB read, 281.18 MB/s read, 12.7 seconds Interval compaction: 3.45 GB write, 604.55 MB/s write, 1.67 GB read, 292.51 MB/s read, 12.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 381826 Average: 2.2854 StdDev: 13.24 Min: 1 Median: 1.5161 Max: 3525 Percentiles: P50: 1.52 P75: 1.91 P99: 5.85 P99.9: 10.08 P99.99: 20.05 ------------------------------------------------------ [ 0, 1 ] 65901 17.259% 17.259% ### ( 1, 2 ] 242250 63.445% 80.705% ############# ( 2, 3 ] 42279 11.073% 91.777% ## ( 3, 4 ] 15669 4.104% 95.881% # ( 4, 6 ] 12868 3.370% 99.251% # ( 6, 10 ] 2475 0.648% 99.899% ( 10, 15 ] 307 0.080% 99.980% ( 15, 22 ] 58 0.015% 99.995% ( 22, 34 ] 5 0.001% 99.996% ( 34, 51 ] 6 0.002% 99.998% ( 51, 76 ] 3 0.001% 99.999% ( 110, 170 ] 14 0.004% 100.002% ( 170, 250 ] 7 0.002% 100.004% ( 250, 380 ] 5 0.001% 100.005% ( 380, 580 ] 13 0.003% 100.009% ( 580, 870 ] 3 0.001% 100.010% ( 870, 1300 ] 9 0.002% 100.012% ( 1300, 1900 ] 1 0.000% 100.012% ( 1900, 2900 ] 3 0.001% 100.013% ( 2900, 4400 ] 3 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 75692 Average: 2.8135 StdDev: 29.28 Min: 0 Median: 1.6477 Max: 7053 Percentiles: P50: 1.65 P75: 2.23 P99: 7.90 P99.9: 62.87 P99.99: 649.16 ------------------------------------------------------ [ 0, 1 ] 8173 10.798% 10.798% ## ( 1, 2 ] 45810 60.522% 71.319% ############ ( 2, 3 ] 12082 15.962% 87.281% ### ( 3, 4 ] 4146 5.477% 92.759% # ( 4, 6 ] 4309 5.693% 98.452% # ( 6, 10 ] 872 1.152% 99.604% ( 10, 15 ] 186 0.246% 99.849% ( 15, 22 ] 13 0.017% 99.867% ( 22, 34 ] 2 0.003% 99.869% ( 34, 51 ] 1 0.001% 99.871% ( 51, 76 ] 47 0.062% 99.933% ( 76, 110 ] 5 0.007% 99.939% ( 110, 170 ] 1 0.001% 99.941% ( 170, 250 ] 21 0.028% 99.968% ( 250, 380 ] 10 0.013% 99.982% ( 380, 580 ] 5 0.007% 99.988% ( 580, 870 ] 6 0.008% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 20741 Average: 1.9449 StdDev: 5.13 Min: 1 Median: 1.3200 Max: 600 Percentiles: P50: 1.32 P75: 1.75 P99: 5.46 P99.9: 9.97 P99.99: 247.03 ------------------------------------------------------ [ 0, 1 ] 6546 31.561% 31.561% ###### ( 1, 2 ] 11951 57.620% 89.181% ############ ( 2, 3 ] 1310 6.316% 95.497% # ( 3, 4 ] 462 2.227% 97.724% ( 4, 6 ] 364 1.755% 99.479% ( 6, 10 ] 89 0.429% 99.908% ( 10, 15 ] 14 0.067% 99.976% ( 15, 22 ] 1 0.005% 99.981% ( 51, 76 ] 1 0.005% 99.986% ( 170, 250 ] 2 0.010% 99.995% ( 250, 380 ] 1 0.005% 100.000% ( 580, 870 ] 1 0.005% 100.005% ** Level 3 read latency histogram (micros): Count: 215250 Average: 4.0158 StdDev: 78.10 Min: 1 Median: 1.6294 Max: 11217 Percentiles: P50: 1.63 P75: 2.13 P99: 9.41 P99.9: 214.16 P99.99: 557.86 ------------------------------------------------------ [ 0, 1 ] 22592 10.496% 10.496% ## ( 1, 2 ] 135112 62.770% 73.266% ############# ( 2, 3 ] 29653 13.776% 87.042% ### ( 3, 4 ] 12338 5.732% 92.774% # ( 4, 6 ] 9845 4.574% 97.347% # ( 6, 10 ] 4178 1.941% 99.288% ( 10, 15 ] 758 0.352% 99.640% ( 15, 22 ] 105 0.049% 99.689% ( 22, 34 ] 22 0.010% 99.699% ( 34, 51 ] 3 0.001% 99.701% ( 51, 76 ] 2 0.001% 99.702% ( 76, 110 ] 115 0.053% 99.755% ( 110, 170 ] 256 0.119% 99.874% ( 170, 250 ] 101 0.047% 99.921% ( 250, 380 ] 80 0.037% 99.958% ( 380, 580 ] 77 0.036% 99.994% ( 580, 870 ] 32 0.015% 100.009% ( 870, 1300 ] 13 0.006% 100.015% ( 1900, 2900 ] 3 0.001% 100.016% ( 2900, 4400 ] 3 0.001% 100.018% ( 4400, 6600 ] 8 0.004% 100.021% ( 6600, 9900 ] 11 0.005% 100.026% ( 9900, 14000 ] 2 0.001% 100.027% ** Level 4 read latency histogram (micros): Count: 30 Average: 3601.6000 StdDev: 3623.86 Min: 245 Median: 2233.3333 Max: 13900 Percentiles: P50: 2233.33 P75: 6325.00 P99: 13385.00 P99.9: 13900.00 P99.99: 13900.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 7 23.333% 26.667% ##### ( 580, 870 ] 3 10.000% 36.667% ## ( 870, 1300 ] 3 10.000% 46.667% ## ( 1900, 2900 ] 3 10.000% 56.667% ## ( 2900, 4400 ] 2 6.667% 63.333% # ( 4400, 6600 ] 4 13.333% 76.667% ### ( 6600, 9900 ] 5 16.667% 93.333% ### ( 9900, 14000 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.583 H:M:S, 9.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.403 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/29-02:19:38 ... thread 0: (1000000,3000000) ops and (332815.7,338884.8) ops/second in (3.004666,8.852567) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.46 GB 220.2 2.0 0.0 2.0 4.8 2.8 0.0 1.7 131.5 310.6 15.81 14.75 47 0.336 2110K 2444 0.0 0.0 L1 1/0 2.07 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 248.7 248.4 1.01 0.98 1 1.013 255K 235 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 239.5 239.4 0.47 0.43 1 0.465 113K 35 0.0 0.0 L3 29/0 999.10 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 210.0 209.9 5.75 4.99 4 1.437 1197K 546 0.0 0.0 L4 140/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1227/4 98.90 GB 0.0 3.6 0.6 3.0 6.3 3.4 0.5 2.3 158.4 281.3 23.04 21.16 53 0.435 3677K 3260 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 0.6 3.0 6.3 3.4 0.5 2.3 158.4 281.3 23.04 21.16 53 0.435 3677K 3260 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 0.6 3.0 3.6 0.6 0.0 0.0 241.5 241.3 15.11 14.14 13 1.162 3677K 3260 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 357.6 7.93 7.02 40 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.33 GB write, 713.02 MB/s write, 3.56 GB read, 401.53 MB/s read, 23.0 seconds Interval compaction: 6.33 GB write, 732.00 MB/s write, 3.56 GB read, 412.22 MB/s read, 23.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 638644 Average: 2.1877 StdDev: 14.60 Min: 1 Median: 1.4609 Max: 3891 Percentiles: P50: 1.46 P75: 1.85 P99: 5.68 P99.9: 10.16 P99.99: 20.36 ------------------------------------------------------ [ 0, 1 ] 129633 20.298% 20.298% #### ( 1, 2 ] 411535 64.439% 84.737% ############# ( 2, 3 ] 57120 8.944% 93.681% ## ( 3, 4 ] 20701 3.241% 96.922% # ( 4, 6 ] 15778 2.471% 99.393% ( 6, 10 ] 3221 0.504% 99.897% ( 10, 15 ] 527 0.083% 99.980% ( 15, 22 ] 85 0.013% 99.993% ( 22, 34 ] 9 0.001% 99.995% ( 34, 51 ] 9 0.001% 99.996% ( 51, 76 ] 6 0.001% 99.997% ( 110, 170 ] 20 0.003% 100.000% ( 170, 250 ] 11 0.002% 100.002% ( 250, 380 ] 8 0.001% 100.003% ( 380, 580 ] 19 0.003% 100.006% ( 580, 870 ] 9 0.001% 100.007% ( 870, 1300 ] 14 0.002% 100.010% ( 1300, 1900 ] 1 0.000% 100.010% ( 1900, 2900 ] 6 0.001% 100.011% ( 2900, 4400 ] 6 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 75692 Average: 2.8135 StdDev: 29.28 Min: 0 Median: 1.6477 Max: 7053 Percentiles: P50: 1.65 P75: 2.23 P99: 7.90 P99.9: 62.87 P99.99: 649.16 ------------------------------------------------------ [ 0, 1 ] 8173 10.798% 10.798% ## ( 1, 2 ] 45810 60.522% 71.319% ############ ( 2, 3 ] 12082 15.962% 87.281% ### ( 3, 4 ] 4146 5.477% 92.759% # ( 4, 6 ] 4309 5.693% 98.452% # ( 6, 10 ] 872 1.152% 99.604% ( 10, 15 ] 186 0.246% 99.849% ( 15, 22 ] 13 0.017% 99.867% ( 22, 34 ] 2 0.003% 99.869% ( 34, 51 ] 1 0.001% 99.871% ( 51, 76 ] 47 0.062% 99.933% ( 76, 110 ] 5 0.007% 99.939% ( 110, 170 ] 1 0.001% 99.941% ( 170, 250 ] 21 0.028% 99.968% ( 250, 380 ] 10 0.013% 99.982% ( 380, 580 ] 5 0.007% 99.988% ( 580, 870 ] 6 0.008% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28294 Average: 2.0429 StdDev: 4.43 Min: 1 Median: 1.4084 Max: 600 Percentiles: P50: 1.41 P75: 1.82 P99: 5.55 P99.9: 9.88 P99.99: 216.82 ------------------------------------------------------ [ 0, 1 ] 7158 25.299% 25.299% ##### ( 1, 2 ] 17115 60.490% 85.789% ############ ( 2, 3 ] 2363 8.352% 94.140% ## ( 3, 4 ] 852 3.011% 97.151% # ( 4, 6 ] 673 2.379% 99.530% ( 6, 10 ] 108 0.382% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 170, 250 ] 2 0.007% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 580, 870 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 215315 Average: 4.0681 StdDev: 78.28 Min: 1 Median: 1.6294 Max: 11217 Percentiles: P50: 1.63 P75: 2.13 P99: 9.43 P99.9: 228.87 P99.99: 578.70 ------------------------------------------------------ [ 0, 1 ] 22608 10.500% 10.500% ## ( 1, 2 ] 135126 62.757% 73.257% ############# ( 2, 3 ] 29662 13.776% 87.033% ### ( 3, 4 ] 12338 5.730% 92.764% # ( 4, 6 ] 9845 4.572% 97.336% # ( 6, 10 ] 4178 1.940% 99.276% ( 10, 15 ] 758 0.352% 99.628% ( 15, 22 ] 105 0.049% 99.677% ( 22, 34 ] 22 0.010% 99.687% ( 34, 51 ] 3 0.001% 99.689% ( 51, 76 ] 2 0.001% 99.690% ( 76, 110 ] 115 0.053% 99.743% ( 110, 170 ] 256 0.119% 99.862% ( 170, 250 ] 111 0.052% 99.914% ( 250, 380 ] 83 0.039% 99.952% ( 380, 580 ] 82 0.038% 99.990% ( 580, 870 ] 39 0.018% 100.008% ( 870, 1300 ] 14 0.007% 100.015% ( 1900, 2900 ] 3 0.001% 100.016% ( 2900, 4400 ] 3 0.001% 100.018% ( 4400, 6600 ] 8 0.004% 100.021% ( 6600, 9900 ] 11 0.005% 100.026% ( 9900, 14000 ] 2 0.001% 100.027% ** Level 4 read latency histogram (micros): Count: 30 Average: 3601.6000 StdDev: 3623.86 Min: 245 Median: 2233.3333 Max: 13900 Percentiles: P50: 2233.33 P75: 6325.00 P99: 13385.00 P99.9: 13900.00 P99.99: 13900.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 7 23.333% 26.667% ##### ( 580, 870 ] 3 10.000% 36.667% ## ( 870, 1300 ] 3 10.000% 46.667% ## ( 1900, 2900 ] 3 10.000% 56.667% ## ( 2900, 4400 ] 2 6.667% 63.333% # ( 4400, 6600 ] 4 13.333% 76.667% ### ( 6600, 9900 ] 5 16.667% 93.333% ### ( 9900, 14000 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.987 H:M:S, 10.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.404 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-02:19:41 ... thread 0: (1000000,4000000) ops and (332229.2,337196.0) ops/second in (3.009970,11.862537) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 3.44 GB 320.9 3.1 0.0 3.1 6.9 3.7 0.0 1.8 140.5 308.4 22.87 21.44 65 0.352 3262K 3702 0.0 0.0 L1 1/0 2.07 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 248.7 248.4 1.01 0.98 1 1.013 255K 235 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 239.5 239.4 0.47 0.43 1 0.465 113K 35 0.0 0.0 L3 29/0 999.10 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 210.0 209.9 5.75 4.99 4 1.437 1197K 546 0.0 0.0 L4 140/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1229/4 99.88 GB 0.0 4.7 0.6 4.1 8.4 4.3 0.5 2.2 159.0 286.5 30.09 27.85 71 0.424 4829K 4518 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 0.6 4.1 8.4 4.3 0.5 2.2 159.0 286.5 30.09 27.85 71 0.424 4829K 4518 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 0.6 4.1 4.7 0.6 0.0 0.0 246.5 246.2 19.41 18.34 17 1.142 4829K 4518 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 359.6 10.69 9.51 54 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.42 GB write, 712.56 MB/s write, 4.67 GB read, 395.36 MB/s read, 30.1 seconds Interval compaction: 8.42 GB write, 726.72 MB/s write, 4.67 GB read, 403.21 MB/s read, 30.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 898069 Average: 2.1331 StdDev: 13.37 Min: 0 Median: 1.4403 Max: 3891 Percentiles: P50: 1.44 P75: 1.82 P99: 5.54 P99.9: 10.00 P99.99: 20.15 ------------------------------------------------------ [ 0, 1 ] 191971 21.376% 21.376% #### ( 1, 2 ] 583902 65.017% 86.393% ############# ( 2, 3 ] 73258 8.157% 94.551% ## ( 3, 4 ] 25582 2.849% 97.399% # ( 4, 6 ] 18649 2.077% 99.476% ( 6, 10 ] 3810 0.424% 99.900% ( 10, 15 ] 724 0.081% 99.981% ( 15, 22 ] 113 0.013% 99.993% ( 22, 34 ] 13 0.001% 99.995% ( 34, 51 ] 13 0.001% 99.996% ( 51, 76 ] 9 0.001% 99.997% ( 110, 170 ] 24 0.003% 100.000% ( 170, 250 ] 19 0.002% 100.002% ( 250, 380 ] 10 0.001% 100.003% ( 380, 580 ] 26 0.003% 100.006% ( 580, 870 ] 17 0.002% 100.008% ( 870, 1300 ] 20 0.002% 100.010% ( 1300, 1900 ] 1 0.000% 100.010% ( 1900, 2900 ] 6 0.001% 100.011% ( 2900, 4400 ] 7 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 75692 Average: 2.8135 StdDev: 29.28 Min: 0 Median: 1.6477 Max: 7053 Percentiles: P50: 1.65 P75: 2.23 P99: 7.90 P99.9: 62.87 P99.99: 649.16 ------------------------------------------------------ [ 0, 1 ] 8173 10.798% 10.798% ## ( 1, 2 ] 45810 60.522% 71.319% ############ ( 2, 3 ] 12082 15.962% 87.281% ### ( 3, 4 ] 4146 5.477% 92.759% # ( 4, 6 ] 4309 5.693% 98.452% # ( 6, 10 ] 872 1.152% 99.604% ( 10, 15 ] 186 0.246% 99.849% ( 15, 22 ] 13 0.017% 99.867% ( 22, 34 ] 2 0.003% 99.869% ( 34, 51 ] 1 0.001% 99.871% ( 51, 76 ] 47 0.062% 99.933% ( 76, 110 ] 5 0.007% 99.939% ( 110, 170 ] 1 0.001% 99.941% ( 170, 250 ] 21 0.028% 99.968% ( 250, 380 ] 10 0.013% 99.982% ( 380, 580 ] 5 0.007% 99.988% ( 580, 870 ] 6 0.008% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28294 Average: 2.0429 StdDev: 4.43 Min: 1 Median: 1.4084 Max: 600 Percentiles: P50: 1.41 P75: 1.82 P99: 5.55 P99.9: 9.88 P99.99: 216.82 ------------------------------------------------------ [ 0, 1 ] 7158 25.299% 25.299% ##### ( 1, 2 ] 17115 60.490% 85.789% ############ ( 2, 3 ] 2363 8.352% 94.140% ## ( 3, 4 ] 852 3.011% 97.151% # ( 4, 6 ] 673 2.379% 99.530% ( 6, 10 ] 108 0.382% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 170, 250 ] 2 0.007% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 580, 870 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 215315 Average: 4.0681 StdDev: 78.28 Min: 1 Median: 1.6294 Max: 11217 Percentiles: P50: 1.63 P75: 2.13 P99: 9.43 P99.9: 228.87 P99.99: 578.70 ------------------------------------------------------ [ 0, 1 ] 22608 10.500% 10.500% ## ( 1, 2 ] 135126 62.757% 73.257% ############# ( 2, 3 ] 29662 13.776% 87.033% ### ( 3, 4 ] 12338 5.730% 92.764% # ( 4, 6 ] 9845 4.572% 97.336% # ( 6, 10 ] 4178 1.940% 99.276% ( 10, 15 ] 758 0.352% 99.628% ( 15, 22 ] 105 0.049% 99.677% ( 22, 34 ] 22 0.010% 99.687% ( 34, 51 ] 3 0.001% 99.689% ( 51, 76 ] 2 0.001% 99.690% ( 76, 110 ] 115 0.053% 99.743% ( 110, 170 ] 256 0.119% 99.862% ( 170, 250 ] 111 0.052% 99.914% ( 250, 380 ] 83 0.039% 99.952% ( 380, 580 ] 82 0.038% 99.990% ( 580, 870 ] 39 0.018% 100.008% ( 870, 1300 ] 14 0.007% 100.015% ( 1900, 2900 ] 3 0.001% 100.016% ( 2900, 4400 ] 3 0.001% 100.018% ( 4400, 6600 ] 8 0.004% 100.021% ( 6600, 9900 ] 11 0.005% 100.026% ( 9900, 14000 ] 2 0.001% 100.027% ** Level 4 read latency histogram (micros): Count: 30 Average: 3601.6000 StdDev: 3623.86 Min: 245 Median: 2233.3333 Max: 13900 Percentiles: P50: 2233.33 P75: 6325.00 P99: 13385.00 P99.9: 13900.00 P99.99: 13900.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 7 23.333% 26.667% ##### ( 580, 870 ] 3 10.000% 36.667% ## ( 870, 1300 ] 3 10.000% 46.667% ## ( 1900, 2900 ] 3 10.000% 56.667% ## ( 2900, 4400 ] 2 6.667% 63.333% # ( 4400, 6600 ] 4 13.333% 76.667% ### ( 6600, 9900 ] 5 16.667% 93.333% ### ( 9900, 14000 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.380 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.394 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-02:19:45 ... thread 0: (1000000,5000000) ops and (283156.6,324798.7) ops/second in (3.531615,15.394152) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/18 4.42 GB 6.3 4.2 0.0 4.2 8.9 4.7 0.0 1.9 144.7 308.4 29.60 27.80 85 0.348 4349K 4829 0.0 0.0 L1 1/1 2.07 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 248.7 248.4 1.01 0.98 1 1.013 255K 235 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 239.5 239.4 0.47 0.43 1 0.465 113K 35 0.0 0.0 L3 29/0 999.10 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 210.0 209.9 5.75 4.99 4 1.437 1197K 546 0.0 0.0 L4 140/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1233/19 100.87 GB 0.0 5.7 0.6 5.1 10.4 5.3 0.5 2.2 159.0 290.5 36.83 34.21 91 0.405 5916K 5645 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 0.6 5.1 10.4 5.3 0.5 2.2 159.0 290.5 36.83 34.21 91 0.405 5916K 5645 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 0.6 5.1 5.7 0.6 0.0 0.0 250.0 249.8 23.42 22.28 21 1.115 5916K 5645 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 361.6 13.42 11.93 70 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.45 GB write, 684.49 MB/s write, 5.72 GB read, 374.55 MB/s read, 36.8 seconds Interval compaction: 10.45 GB write, 694.97 MB/s write, 5.72 GB read, 380.28 MB/s read, 36.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 14, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1182168 Average: 2.1262 StdDev: 13.32 Min: 0 Median: 1.4187 Max: 3891 Percentiles: P50: 1.42 P75: 1.80 P99: 5.43 P99.9: 10.89 P99.99: 138.95 ------------------------------------------------------ [ 0, 1 ] 268643 22.725% 22.725% ##### ( 1, 2 ] 770020 65.136% 87.861% ############# ( 2, 3 ] 86206 7.292% 95.153% # ( 3, 4 ] 30528 2.582% 97.735% # ( 4, 6 ] 20972 1.774% 99.509% ( 6, 10 ] 4476 0.379% 99.888% ( 10, 15 ] 801 0.068% 99.956% ( 15, 22 ] 142 0.012% 99.968% ( 22, 34 ] 16 0.001% 99.969% ( 34, 51 ] 16 0.001% 99.971% ( 51, 76 ] 13 0.001% 99.972% ( 76, 110 ] 143 0.012% 99.984% ( 110, 170 ] 155 0.013% 99.997% ( 170, 250 ] 36 0.003% 100.000% ( 250, 380 ] 19 0.002% 100.002% ( 380, 580 ] 41 0.003% 100.005% ( 580, 870 ] 26 0.002% 100.007% ( 870, 1300 ] 26 0.002% 100.009% ( 1300, 1900 ] 5 0.000% 100.010% ( 1900, 2900 ] 8 0.001% 100.010% ( 2900, 4400 ] 8 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 75693 Average: 2.8153 StdDev: 29.28 Min: 0 Median: 1.6478 Max: 7053 Percentiles: P50: 1.65 P75: 2.23 P99: 7.91 P99.9: 63.40 P99.99: 649.15 ------------------------------------------------------ [ 0, 1 ] 8173 10.798% 10.798% ## ( 1, 2 ] 45810 60.521% 71.318% ############ ( 2, 3 ] 12082 15.962% 87.280% ### ( 3, 4 ] 4146 5.477% 92.758% # ( 4, 6 ] 4309 5.693% 98.450% # ( 6, 10 ] 872 1.152% 99.602% ( 10, 15 ] 186 0.246% 99.848% ( 15, 22 ] 13 0.017% 99.865% ( 22, 34 ] 2 0.003% 99.868% ( 34, 51 ] 1 0.001% 99.869% ( 51, 76 ] 47 0.062% 99.931% ( 76, 110 ] 5 0.007% 99.938% ( 110, 170 ] 2 0.003% 99.941% ( 170, 250 ] 21 0.028% 99.968% ( 250, 380 ] 10 0.013% 99.982% ( 380, 580 ] 5 0.007% 99.988% ( 580, 870 ] 6 0.008% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28294 Average: 2.0429 StdDev: 4.43 Min: 1 Median: 1.4084 Max: 600 Percentiles: P50: 1.41 P75: 1.82 P99: 5.55 P99.9: 9.88 P99.99: 216.82 ------------------------------------------------------ [ 0, 1 ] 7158 25.299% 25.299% ##### ( 1, 2 ] 17115 60.490% 85.789% ############ ( 2, 3 ] 2363 8.352% 94.140% ## ( 3, 4 ] 852 3.011% 97.151% # ( 4, 6 ] 673 2.379% 99.530% ( 6, 10 ] 108 0.382% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 170, 250 ] 2 0.007% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 580, 870 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 215315 Average: 4.0681 StdDev: 78.28 Min: 1 Median: 1.6294 Max: 11217 Percentiles: P50: 1.63 P75: 2.13 P99: 9.43 P99.9: 228.87 P99.99: 578.70 ------------------------------------------------------ [ 0, 1 ] 22608 10.500% 10.500% ## ( 1, 2 ] 135126 62.757% 73.257% ############# ( 2, 3 ] 29662 13.776% 87.033% ### ( 3, 4 ] 12338 5.730% 92.764% # ( 4, 6 ] 9845 4.572% 97.336% # ( 6, 10 ] 4178 1.940% 99.276% ( 10, 15 ] 758 0.352% 99.628% ( 15, 22 ] 105 0.049% 99.677% ( 22, 34 ] 22 0.010% 99.687% ( 34, 51 ] 3 0.001% 99.689% ( 51, 76 ] 2 0.001% 99.690% ( 76, 110 ] 115 0.053% 99.743% ( 110, 170 ] 256 0.119% 99.862% ( 170, 250 ] 111 0.052% 99.914% ( 250, 380 ] 83 0.039% 99.952% ( 380, 580 ] 82 0.038% 99.990% ( 580, 870 ] 39 0.018% 100.008% ( 870, 1300 ] 14 0.007% 100.015% ( 1900, 2900 ] 3 0.001% 100.016% ( 2900, 4400 ] 3 0.001% 100.018% ( 4400, 6600 ] 8 0.004% 100.021% ( 6600, 9900 ] 11 0.005% 100.026% ( 9900, 14000 ] 2 0.001% 100.027% ** Level 4 read latency histogram (micros): Count: 30 Average: 3601.6000 StdDev: 3623.86 Min: 245 Median: 2233.3333 Max: 13900 Percentiles: P50: 2233.33 P75: 6325.00 P99: 13385.00 P99.9: 13900.00 P99.99: 13900.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 7 23.333% 26.667% ##### ( 580, 870 ] 3 10.000% 36.667% ## ( 870, 1300 ] 3 10.000% 46.667% ## ( 1900, 2900 ] 3 10.000% 56.667% ## ( 2900, 4400 ] 2 6.667% 63.333% # ( 4400, 6600 ] 4 13.333% 76.667% ### ( 6600, 9900 ] 5 16.667% 93.333% ### ( 9900, 14000 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 15.6 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.271 H:M:S, 14.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 278.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.891 H:M:S, 25.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-02:20:08 ... thread 0: (1000000,6000000) ops and (43132.0,155525.8) ops/second in (23.184651,38.578803) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1007.65 MB 18.9 4.4 0.0 4.4 10.1 5.7 0.0 1.8 132.8 302.3 34.16 31.21 99 0.345 4605K 5091 0.0 0.0 L1 7/7 399.03 MB 0.0 4.6 4.5 0.1 4.5 4.5 0.1 1.0 220.2 215.8 21.44 19.35 2 10.719 4794K 94K 0.0 0.0 L2 14/14 1.69 GB 0.0 0.1 0.1 0.0 0.1 0.1 4.2 1.8 239.5 239.4 0.47 0.43 1 0.465 113K 35 0.0 0.0 L3 16/1 1.06 GB 1.0 1.8 1.0 0.9 1.8 1.0 1.6 1.9 164.7 164.4 11.37 8.22 13 0.875 1762K 546 0.0 0.0 L4 151/0 9.73 GB 1.0 0.8 0.8 0.1 0.8 0.8 1.5 1.1 125.9 125.5 6.76 4.04 6 1.127 864K 2597 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/30 101.69 GB 0.0 11.8 6.3 5.5 17.4 11.9 9.3 3.1 163.0 239.7 74.19 63.25 121 0.613 12M 103K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.8 6.3 5.5 17.4 11.9 9.3 3.1 163.0 239.7 74.19 63.25 121 0.613 12M 103K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.8 6.3 5.5 11.7 6.2 0.0 0.0 211.6 209.7 57.15 48.82 38 1.504 12M 103K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 340.1 17.04 14.43 83 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.8 total, 38.6 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.37 GB write, 458.14 MB/s write, 11.81 GB read, 311.54 MB/s read, 74.2 seconds Interval compaction: 17.37 GB write, 460.93 MB/s write, 11.81 GB read, 313.45 MB/s read, 74.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 32, interval: 47 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2514284 Average: 2.8052 StdDev: 24.21 Min: 0 Median: 1.3940 Max: 13110 Percentiles: P50: 1.39 P75: 1.78 P99: 7.88 P99.9: 158.81 P99.99: 517.77 ------------------------------------------------------ [ 0, 1 ] 613537 24.402% 24.402% ##### ( 1, 2 ] 1633407 64.965% 89.367% ############# ( 2, 3 ] 139457 5.547% 94.914% # ( 3, 4 ] 55117 2.192% 97.106% ( 4, 6 ] 39626 1.576% 98.682% ( 6, 10 ] 17058 0.678% 99.360% ( 10, 15 ] 2451 0.097% 99.458% ( 15, 22 ] 695 0.028% 99.485% ( 22, 34 ] 38 0.002% 99.487% ( 34, 51 ] 20 0.001% 99.488% ( 51, 76 ] 27 0.001% 99.489% ( 76, 110 ] 6397 0.254% 99.743% ( 110, 170 ] 4844 0.193% 99.936% ( 170, 250 ] 637 0.025% 99.961% ( 250, 380 ] 436 0.017% 99.979% ( 380, 580 ] 416 0.017% 99.995% ( 580, 870 ] 149 0.006% 100.001% ( 870, 1300 ] 58 0.002% 100.003% ( 1300, 1900 ] 21 0.001% 100.004% ( 1900, 2900 ] 21 0.001% 100.005% ( 2900, 4400 ] 31 0.001% 100.006% ( 4400, 6600 ] 2 0.000% 100.006% ( 6600, 9900 ] 2 0.000% 100.006% ( 9900, 14000 ] 2 0.000% 100.007% ** Level 1 read latency histogram (micros): Count: 553416 Average: 5.4233 StdDev: 76.81 Min: 0 Median: 1.9335 Max: 7647 Percentiles: P50: 1.93 P75: 2.89 P99: 9.40 P99.9: 14.98 P99.99: 71.23 ------------------------------------------------------ [ 0, 1 ] 16459 2.974% 2.974% # ( 1, 2 ] 278786 50.375% 53.350% ########## ( 2, 3 ] 134724 24.344% 77.694% ##### ( 3, 4 ] 49348 8.917% 86.611% ## ( 4, 6 ] 57574 10.403% 97.014% ## ( 6, 10 ] 12938 2.338% 99.352% ( 10, 15 ] 3045 0.550% 99.902% ( 15, 22 ] 401 0.072% 99.975% ( 22, 34 ] 44 0.008% 99.982% ( 34, 51 ] 3 0.001% 99.983% ( 51, 76 ] 49 0.009% 99.992% ( 76, 110 ] 66 0.012% 100.004% ( 110, 170 ] 181 0.033% 100.037% ( 170, 250 ] 126 0.023% 100.059% ( 250, 380 ] 156 0.028% 100.087% ( 380, 580 ] 194 0.035% 100.123% ( 580, 870 ] 203 0.037% 100.159% ( 870, 1300 ] 137 0.025% 100.184% ( 1300, 1900 ] 88 0.016% 100.200% ( 1900, 2900 ] 108 0.020% 100.219% ( 2900, 4400 ] 100 0.018% 100.237% ( 4400, 6600 ] 21 0.004% 100.241% ( 6600, 9900 ] 5 0.001% 100.242% ** Level 2 read latency histogram (micros): Count: 28294 Average: 2.0429 StdDev: 4.43 Min: 1 Median: 1.4084 Max: 600 Percentiles: P50: 1.41 P75: 1.82 P99: 5.55 P99.9: 9.88 P99.99: 216.82 ------------------------------------------------------ [ 0, 1 ] 7158 25.299% 25.299% ##### ( 1, 2 ] 17115 60.490% 85.789% ############ ( 2, 3 ] 2363 8.352% 94.140% ## ( 3, 4 ] 852 3.011% 97.151% # ( 4, 6 ] 673 2.379% 99.530% ( 6, 10 ] 108 0.382% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 170, 250 ] 2 0.007% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 580, 870 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 253674 Average: 8.5567 StdDev: 109.65 Min: 0 Median: 1.6693 Max: 11217 Percentiles: P50: 1.67 P75: 2.33 P99: 14.94 P99.9: 1025.72 P99.99: 2310.06 ------------------------------------------------------ [ 0, 1 ] 23809 9.386% 9.386% ## ( 1, 2 ] 153928 60.679% 70.065% ############ ( 2, 3 ] 38503 15.178% 85.243% ### ( 3, 4 ] 16103 6.348% 91.591% # ( 4, 6 ] 12770 5.034% 96.625% # ( 6, 10 ] 5016 1.977% 98.603% ( 10, 15 ] 1021 0.402% 99.005% ( 15, 22 ] 140 0.055% 99.060% ( 22, 34 ] 30 0.012% 99.072% ( 34, 51 ] 5 0.002% 99.074% ( 51, 76 ] 4 0.002% 99.076% ( 76, 110 ] 136 0.054% 99.129% ( 110, 170 ] 366 0.144% 99.273% ( 170, 250 ] 280 0.110% 99.384% ( 250, 380 ] 348 0.137% 99.521% ( 380, 580 ] 507 0.200% 99.721% ( 580, 870 ] 379 0.149% 99.870% ( 870, 1300 ] 208 0.082% 99.952% ( 1300, 1900 ] 78 0.031% 99.983% ( 1900, 2900 ] 43 0.017% 100.000% ( 2900, 4400 ] 47 0.019% 100.019% ( 4400, 6600 ] 12 0.005% 100.023% ( 6600, 9900 ] 13 0.005% 100.028% ( 9900, 14000 ] 2 0.001% 100.029% ** Level 4 read latency histogram (micros): Count: 140 Average: 977.0286 StdDev: 2282.84 Min: 1 Median: 3.3333 Max: 13900 Percentiles: P50: 3.33 P75: 580.00 P99: 11130.00 P99.9: 13713.00 P99.99: 13900.00 ------------------------------------------------------ [ 0, 1 ] 24 17.143% 17.143% ### ( 1, 2 ] 33 23.571% 40.714% ##### ( 2, 3 ] 12 8.571% 49.286% ## ( 3, 4 ] 3 2.143% 51.429% ( 6, 10 ] 3 2.143% 53.571% ( 10, 15 ] 1 0.714% 54.286% ( 15, 22 ] 1 0.714% 55.000% ( 22, 34 ] 1 0.714% 55.714% ( 34, 51 ] 2 1.429% 57.143% ( 76, 110 ] 2 1.429% 58.571% ( 110, 170 ] 2 1.429% 60.000% ( 170, 250 ] 12 8.571% 68.571% ## ( 380, 580 ] 9 6.429% 75.000% # ( 580, 870 ] 7 5.000% 80.000% # ( 870, 1300 ] 6 4.286% 84.286% # ( 1300, 1900 ] 2 1.429% 85.714% ( 1900, 2900 ] 4 2.857% 88.571% # ( 2900, 4400 ] 3 2.143% 90.714% ( 4400, 6600 ] 6 4.286% 95.000% # ( 6600, 9900 ] 5 3.571% 98.571% # ( 9900, 14000 ] 2 1.429% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 1589.2333 StdDev: 1853.20 Min: 84 Median: 841.0000 Max: 11977 Percentiles: P50: 841.00 P75: 2361.54 P99: 9240.00 P99.9: 11977.00 P99.99: 11977.00 ------------------------------------------------------ ( 76, 110 ] 2 1.667% 1.667% ( 110, 170 ] 10 8.333% 10.000% ## ( 170, 250 ] 11 9.167% 19.167% ## ( 250, 380 ] 14 11.667% 30.833% ## ( 380, 580 ] 14 11.667% 42.500% ## ( 580, 870 ] 10 8.333% 50.833% ## ( 870, 1300 ] 9 7.500% 58.333% ## ( 1300, 1900 ] 14 11.667% 70.000% ## ( 1900, 2900 ] 13 10.833% 80.833% ## ( 2900, 4400 ] 15 12.500% 93.333% ### ( 4400, 6600 ] 6 5.000% 98.333% # ( 6600, 9900 ] 1 0.833% 99.167% ( 9900, 14000 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 38.8 total, 23.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 152.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.033 H:M:S, 56.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 42.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:19.761 H:M:S, 85.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/29-02:20:12 ... thread 0: (1000000,7000000) ops and (260970.1,165052.8) ops/second in (3.831856,42.410659) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 1.54 GB 25.2 5.6 0.0 5.6 12.2 6.6 0.0 1.8 134.7 294.4 42.56 38.61 116 0.367 5820K 6519 0.0 0.0 L1 4/4 324.59 MB 0.0 5.4 5.0 0.5 5.3 4.9 0.1 1.1 214.6 210.8 25.92 23.05 3 8.639 5242K 94K 0.0 0.0 L2 16/16 1.87 GB 0.0 0.1 0.1 0.0 0.1 0.1 4.7 1.8 239.5 239.4 0.47 0.43 1 0.465 113K 35 0.0 0.0 L3 23/8 1.36 GB 0.8 2.6 1.3 1.3 2.6 1.3 1.6 2.1 166.4 166.1 16.09 11.93 17 0.946 2580K 3237 0.0 0.0 L4 151/0 9.73 GB 1.0 0.8 0.8 0.1 0.8 0.8 1.5 1.1 125.9 125.5 6.76 4.04 6 1.127 864K 2597 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/33 102.67 GB 0.0 14.6 7.1 7.5 21.1 13.6 9.8 3.2 162.7 235.6 91.79 78.06 143 0.642 14M 107K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 7.1 7.5 21.1 13.6 9.8 3.2 162.7 235.6 91.79 78.06 143 0.642 14M 107K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 7.1 7.5 14.5 7.0 0.0 0.0 209.5 208.0 71.28 60.96 47 1.517 14M 107K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 331.7 20.51 17.11 96 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.6 total, 42.4 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.12 GB write, 507.09 MB/s write, 14.58 GB read, 350.19 MB/s read, 91.8 seconds Interval compaction: 21.12 GB write, 509.91 MB/s write, 14.58 GB read, 352.14 MB/s read, 91.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 39, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2819685 Average: 2.8195 StdDev: 23.76 Min: 0 Median: 1.4308 Max: 13110 Percentiles: P50: 1.43 P75: 1.82 P99: 7.75 P99.9: 156.17 P99.99: 504.34 ------------------------------------------------------ [ 0, 1 ] 628865 22.303% 22.303% #### ( 1, 2 ] 1812857 64.293% 86.596% ############# ( 2, 3 ] 198841 7.052% 93.647% # ( 3, 4 ] 78360 2.779% 96.426% # ( 4, 6 ] 63690 2.259% 98.685% ( 6, 10 ] 20301 0.720% 99.405% ( 10, 15 ] 2943 0.104% 99.510% ( 15, 22 ] 755 0.027% 99.536% ( 22, 34 ] 45 0.002% 99.538% ( 34, 51 ] 22 0.001% 99.539% ( 51, 76 ] 27 0.001% 99.540% ( 76, 110 ] 6406 0.227% 99.767% ( 110, 170 ] 4879 0.173% 99.940% ( 170, 250 ] 676 0.024% 99.964% ( 250, 380 ] 461 0.016% 99.980% ( 380, 580 ] 444 0.016% 99.996% ( 580, 870 ] 170 0.006% 100.002% ( 870, 1300 ] 74 0.003% 100.005% ( 1300, 1900 ] 25 0.001% 100.006% ( 1900, 2900 ] 25 0.001% 100.006% ( 2900, 4400 ] 33 0.001% 100.008% ( 4400, 6600 ] 3 0.000% 100.008% ( 6600, 9900 ] 2 0.000% 100.008% ( 9900, 14000 ] 2 0.000% 100.008% ** Level 1 read latency histogram (micros): Count: 1117504 Average: 4.9618 StdDev: 66.31 Min: 0 Median: 1.9299 Max: 7647 Percentiles: P50: 1.93 P75: 2.86 P99: 9.40 P99.9: 19.39 P99.99: 160.39 ------------------------------------------------------ [ 0, 1 ] 25076 2.244% 2.244% ( 1, 2 ] 573881 51.354% 53.598% ########## ( 2, 3 ] 277779 24.857% 78.455% ##### ( 3, 4 ] 97274 8.705% 87.159% ## ( 4, 6 ] 110459 9.884% 97.044% ## ( 6, 10 ] 25699 2.300% 99.344% ( 10, 15 ] 5781 0.517% 99.861% ( 15, 22 ] 700 0.063% 99.923% ( 22, 34 ] 65 0.006% 99.929% ( 34, 51 ] 13 0.001% 99.930% ( 51, 76 ] 50 0.004% 99.935% ( 76, 110 ] 178 0.016% 99.951% ( 110, 170 ] 523 0.047% 99.998% ( 170, 250 ] 363 0.032% 100.030% ( 250, 380 ] 400 0.036% 100.066% ( 380, 580 ] 410 0.037% 100.103% ( 580, 870 ] 358 0.032% 100.135% ( 870, 1300 ] 231 0.021% 100.155% ( 1300, 1900 ] 126 0.011% 100.167% ( 1900, 2900 ] 162 0.014% 100.181% ( 2900, 4400 ] 146 0.013% 100.194% ( 4400, 6600 ] 29 0.003% 100.197% ( 6600, 9900 ] 8 0.001% 100.197% ** Level 2 read latency histogram (micros): Count: 28294 Average: 2.0429 StdDev: 4.43 Min: 1 Median: 1.4084 Max: 600 Percentiles: P50: 1.41 P75: 1.82 P99: 5.55 P99.9: 9.88 P99.99: 216.82 ------------------------------------------------------ [ 0, 1 ] 7158 25.299% 25.299% ##### ( 1, 2 ] 17115 60.490% 85.789% ############ ( 2, 3 ] 2363 8.352% 94.140% ## ( 3, 4 ] 852 3.011% 97.151% # ( 4, 6 ] 673 2.379% 99.530% ( 6, 10 ] 108 0.382% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 170, 250 ] 2 0.007% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 580, 870 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 283514 Average: 8.8113 StdDev: 110.00 Min: 0 Median: 1.6912 Max: 11217 Percentiles: P50: 1.69 P75: 2.40 P99: 18.87 P99.9: 1077.78 P99.99: 2689.79 ------------------------------------------------------ [ 0, 1 ] 24530 8.652% 8.652% ## ( 1, 2 ] 169603 59.822% 68.474% ############ ( 2, 3 ] 45863 16.177% 84.650% ### ( 3, 4 ] 18657 6.581% 91.231% # ( 4, 6 ] 15262 5.383% 96.614% # ( 6, 10 ] 5558 1.960% 98.575% ( 10, 15 ] 1123 0.396% 98.971% ( 15, 22 ] 150 0.053% 99.024% ( 22, 34 ] 31 0.011% 99.035% ( 34, 51 ] 6 0.002% 99.037% ( 51, 76 ] 4 0.001% 99.038% ( 76, 110 ] 141 0.050% 99.088% ( 110, 170 ] 424 0.150% 99.237% ( 170, 250 ] 344 0.121% 99.359% ( 250, 380 ] 418 0.147% 99.506% ( 380, 580 ] 575 0.203% 99.709% ( 580, 870 ] 426 0.150% 99.859% ( 870, 1300 ] 239 0.084% 99.944% ( 1300, 1900 ] 89 0.031% 99.975% ( 1900, 2900 ] 54 0.019% 99.994% ( 2900, 4400 ] 64 0.023% 100.017% ( 4400, 6600 ] 12 0.004% 100.021% ( 6600, 9900 ] 13 0.005% 100.025% ( 9900, 14000 ] 2 0.001% 100.026% ** Level 4 read latency histogram (micros): Count: 140 Average: 977.0286 StdDev: 2282.84 Min: 1 Median: 3.3333 Max: 13900 Percentiles: P50: 3.33 P75: 580.00 P99: 11130.00 P99.9: 13713.00 P99.99: 13900.00 ------------------------------------------------------ [ 0, 1 ] 24 17.143% 17.143% ### ( 1, 2 ] 33 23.571% 40.714% ##### ( 2, 3 ] 12 8.571% 49.286% ## ( 3, 4 ] 3 2.143% 51.429% ( 6, 10 ] 3 2.143% 53.571% ( 10, 15 ] 1 0.714% 54.286% ( 15, 22 ] 1 0.714% 55.000% ( 22, 34 ] 1 0.714% 55.714% ( 34, 51 ] 2 1.429% 57.143% ( 76, 110 ] 2 1.429% 58.571% ( 110, 170 ] 2 1.429% 60.000% ( 170, 250 ] 12 8.571% 68.571% ## ( 380, 580 ] 9 6.429% 75.000% # ( 580, 870 ] 7 5.000% 80.000% # ( 870, 1300 ] 6 4.286% 84.286% # ( 1300, 1900 ] 2 1.429% 85.714% ( 1900, 2900 ] 4 2.857% 88.571% # ( 2900, 4400 ] 3 2.143% 90.714% ( 4400, 6600 ] 6 4.286% 95.000% # ( 6600, 9900 ] 5 3.571% 98.571% # ( 9900, 14000 ] 2 1.429% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 1589.2333 StdDev: 1853.20 Min: 84 Median: 841.0000 Max: 11977 Percentiles: P50: 841.00 P75: 2361.54 P99: 9240.00 P99.9: 11977.00 P99.99: 11977.00 ------------------------------------------------------ ( 76, 110 ] 2 1.667% 1.667% ( 110, 170 ] 10 8.333% 10.000% ## ( 170, 250 ] 11 9.167% 19.167% ## ( 250, 380 ] 14 11.667% 30.833% ## ( 380, 580 ] 14 11.667% 42.500% ## ( 580, 870 ] 10 8.333% 50.833% ## ( 870, 1300 ] 9 7.500% 58.333% ## ( 1300, 1900 ] 14 11.667% 70.000% ## ( 1900, 2900 ] 13 10.833% 80.833% ## ( 2900, 4400 ] 15 12.500% 93.333% ### ( 4400, 6600 ] 6 5.000% 98.333% # ( 6600, 9900 ] 1 0.833% 99.167% ( 9900, 14000 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 42.6 total, 3.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 161.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.124 H:M:S, 54.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 256.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.091 H:M:S, 28.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/29-02:20:15 ... thread 0: (1000000,8000000) ops and (288470.1,174378.5) ops/second in (3.466564,45.877223) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/5 2.46 GB 119.6 6.5 0.0 6.5 14.0 7.6 0.0 1.9 134.1 291.1 49.32 44.59 132 0.374 6716K 7494 0.0 0.0 L1 4/4 324.59 MB 0.0 5.4 5.0 0.5 5.3 4.9 0.1 1.1 214.6 210.8 25.92 23.05 3 8.639 5242K 94K 0.0 0.0 L2 14/14 1.69 GB 0.0 0.1 0.1 0.0 0.1 0.1 4.7 1.8 239.5 239.4 0.47 0.43 1 0.465 113K 35 0.0 0.0 L3 19/1 1019.83 MB 0.9 3.3 1.5 1.8 3.3 1.5 1.6 2.2 171.5 171.1 19.64 14.99 19 1.034 3281K 5389 0.0 0.0 L4 148/0 9.67 GB 1.0 1.4 1.2 0.2 1.4 1.2 1.5 1.1 129.7 129.3 11.14 6.77 12 0.928 1466K 4287 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/24 103.59 GB 0.0 16.7 7.7 9.0 24.2 15.2 10.5 3.2 160.6 232.3 106.48 89.84 167 0.638 16M 112K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.7 7.7 9.0 24.2 15.2 10.5 3.2 160.6 232.3 106.48 89.84 167 0.638 16M 112K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.7 7.7 9.0 16.6 7.6 0.0 0.0 206.5 205.1 82.80 70.25 58 1.428 16M 112K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 327.3 23.67 19.59 109 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.1 total, 45.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.15 GB write, 536.28 MB/s write, 16.70 GB read, 370.80 MB/s read, 106.5 seconds Interval compaction: 24.15 GB write, 539.04 MB/s write, 16.70 GB read, 372.70 MB/s read, 106.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 47, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 47, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3205245 Average: 2.8251 StdDev: 22.96 Min: 0 Median: 1.4676 Max: 13110 Percentiles: P50: 1.47 P75: 1.86 P99: 7.82 P99.9: 150.95 P99.99: 434.48 ------------------------------------------------------ [ 0, 1 ] 647744 20.209% 20.209% #### ( 1, 2 ] 2042253 63.716% 83.925% ############# ( 2, 3 ] 274264 8.557% 92.482% ## ( 3, 4 ] 105469 3.291% 95.772% # ( 4, 6 ] 91749 2.862% 98.635% # ( 6, 10 ] 25811 0.805% 99.440% ( 10, 15 ] 4027 0.126% 99.565% ( 15, 22 ] 849 0.026% 99.592% ( 22, 34 ] 52 0.002% 99.594% ( 34, 51 ] 23 0.001% 99.594% ( 51, 76 ] 28 0.001% 99.595% ( 76, 110 ] 6423 0.200% 99.796% ( 110, 170 ] 4905 0.153% 99.949% ( 170, 250 ] 712 0.022% 99.971% ( 250, 380 ] 488 0.015% 99.986% ( 380, 580 ] 468 0.015% 100.001% ( 580, 870 ] 191 0.006% 100.007% ( 870, 1300 ] 85 0.003% 100.009% ( 1300, 1900 ] 31 0.001% 100.010% ( 1900, 2900 ] 31 0.001% 100.011% ( 2900, 4400 ] 34 0.001% 100.012% ( 4400, 6600 ] 3 0.000% 100.012% ( 6600, 9900 ] 2 0.000% 100.012% ( 9900, 14000 ] 2 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 1329457 Average: 4.8143 StdDev: 63.88 Min: 0 Median: 1.9110 Max: 8055 Percentiles: P50: 1.91 P75: 2.83 P99: 9.40 P99.9: 26.89 P99.99: 204.30 ------------------------------------------------------ [ 0, 1 ] 29935 2.252% 2.252% ( 1, 2 ] 696776 52.411% 54.662% ########## ( 2, 3 ] 326278 24.542% 79.204% ##### ( 3, 4 ] 111681 8.400% 87.605% ## ( 4, 6 ] 125702 9.455% 97.060% ## ( 6, 10 ] 30330 2.281% 99.341% ( 10, 15 ] 6640 0.499% 99.841% ( 15, 22 ] 757 0.057% 99.898% ( 22, 34 ] 70 0.005% 99.903% ( 34, 51 ] 14 0.001% 99.904% ( 51, 76 ] 51 0.004% 99.908% ( 76, 110 ] 228 0.017% 99.925% ( 110, 170 ] 670 0.050% 99.976% ( 170, 250 ] 448 0.034% 100.009% ( 250, 380 ] 471 0.035% 100.045% ( 380, 580 ] 467 0.035% 100.080% ( 580, 870 ] 396 0.030% 100.110% ( 870, 1300 ] 254 0.019% 100.129% ( 1300, 1900 ] 140 0.011% 100.139% ( 1900, 2900 ] 176 0.013% 100.152% ( 2900, 4400 ] 160 0.012% 100.165% ( 4400, 6600 ] 32 0.002% 100.167% ( 6600, 9900 ] 9 0.001% 100.168% ** Level 2 read latency histogram (micros): Count: 28294 Average: 2.0429 StdDev: 4.43 Min: 1 Median: 1.4084 Max: 600 Percentiles: P50: 1.41 P75: 1.82 P99: 5.55 P99.9: 9.88 P99.99: 216.82 ------------------------------------------------------ [ 0, 1 ] 7158 25.299% 25.299% ##### ( 1, 2 ] 17115 60.490% 85.789% ############ ( 2, 3 ] 2363 8.352% 94.140% ## ( 3, 4 ] 852 3.011% 97.151% # ( 4, 6 ] 673 2.379% 99.530% ( 6, 10 ] 108 0.382% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 170, 250 ] 2 0.007% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 580, 870 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 441438 Average: 7.7725 StdDev: 100.46 Min: 0 Median: 1.7974 Max: 11217 Percentiles: P50: 1.80 P75: 2.70 P99: 11.32 P99.9: 817.75 P99.99: 1388.54 ------------------------------------------------------ [ 0, 1 ] 26434 5.988% 5.988% # ( 1, 2 ] 243659 55.197% 61.185% ########### ( 2, 3 ] 87707 19.868% 81.053% #### ( 3, 4 ] 35438 8.028% 89.081% ## ( 4, 6 ] 34898 7.906% 96.987% ## ( 6, 10 ] 8475 1.920% 98.907% ( 10, 15 ] 1559 0.353% 99.260% ( 15, 22 ] 205 0.046% 99.306% ( 22, 34 ] 35 0.008% 99.314% ( 34, 51 ] 8 0.002% 99.316% ( 51, 76 ] 5 0.001% 99.317% ( 76, 110 ] 149 0.034% 99.351% ( 110, 170 ] 484 0.110% 99.460% ( 170, 250 ] 403 0.091% 99.552% ( 250, 380 ] 481 0.109% 99.661% ( 380, 580 ] 645 0.146% 99.807% ( 580, 870 ] 502 0.114% 99.920% ( 870, 1300 ] 289 0.065% 99.986% ( 1300, 1900 ] 121 0.027% 100.013% ( 1900, 2900 ] 81 0.018% 100.032% ( 2900, 4400 ] 99 0.022% 100.054% ( 4400, 6600 ] 18 0.004% 100.058% ( 6600, 9900 ] 14 0.003% 100.061% ( 9900, 14000 ] 2 0.000% 100.062% ** Level 4 read latency histogram (micros): Count: 19079 Average: 30.1471 StdDev: 294.98 Min: 1 Median: 2.3212 Max: 13900 Percentiles: P50: 2.32 P75: 3.62 P99: 748.76 P99.9: 4584.20 P99.99: 10088.80 ------------------------------------------------------ [ 0, 1 ] 149 0.781% 0.781% ( 1, 2 ] 7768 40.715% 41.496% ######## ( 2, 3 ] 5052 26.479% 67.975% ##### ( 3, 4 ] 2156 11.300% 79.276% ## ( 4, 6 ] 2764 14.487% 93.763% ### ( 6, 10 ] 536 2.809% 96.572% # ( 10, 15 ] 191 1.001% 97.573% ( 15, 22 ] 17 0.089% 97.662% ( 22, 34 ] 2 0.010% 97.673% ( 34, 51 ] 2 0.010% 97.683% ( 51, 76 ] 3 0.016% 97.699% ( 76, 110 ] 2 0.010% 97.710% ( 110, 170 ] 10 0.052% 97.762% ( 170, 250 ] 37 0.194% 97.956% ( 250, 380 ] 54 0.283% 98.239% ( 380, 580 ] 94 0.493% 98.732% ( 580, 870 ] 88 0.461% 99.193% ( 870, 1300 ] 60 0.314% 99.507% ( 1300, 1900 ] 29 0.152% 99.659% ( 1900, 2900 ] 21 0.110% 99.769% ( 2900, 4400 ] 24 0.126% 99.895% ( 4400, 6600 ] 11 0.058% 99.953% ( 6600, 9900 ] 7 0.037% 99.990% ( 9900, 14000 ] 2 0.010% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1455.7938 StdDev: 1734.76 Min: 84 Median: 725.0000 Max: 11977 Percentiles: P50: 725.00 P75: 2076.47 P99: 7920.00 P99.9: 11977.00 P99.99: 11977.00 ------------------------------------------------------ ( 76, 110 ] 3 1.875% 1.875% ( 110, 170 ] 14 8.750% 10.625% ## ( 170, 250 ] 16 10.000% 20.625% ## ( 250, 380 ] 21 13.125% 33.750% ### ( 380, 580 ] 19 11.875% 45.625% ## ( 580, 870 ] 14 8.750% 54.375% ## ( 870, 1300 ] 11 6.875% 61.250% # ( 1300, 1900 ] 19 11.875% 73.125% ## ( 1900, 2900 ] 17 10.625% 83.750% ## ( 2900, 4400 ] 17 10.625% 94.375% ## ( 4400, 6600 ] 7 4.375% 98.750% # ( 6600, 9900 ] 1 0.625% 99.375% ( 9900, 14000 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 46.1 total, 3.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 170.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.846 H:M:S, 51.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 283.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.722 H:M:S, 20.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-02:20:18 ... thread 0: (1000000,9000000) ops and (313550.2,183424.5) ops/second in (3.189282,49.066505) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/9 3.38 GB 182.5 7.0 0.0 7.0 15.4 8.5 0.0 1.8 132.1 293.2 53.90 48.85 147 0.367 7227K 7997 0.0 0.0 L1 4/4 324.59 MB 0.0 5.4 5.0 0.5 5.3 4.9 0.1 1.1 214.6 210.8 25.92 23.05 3 8.639 5242K 94K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.7 1.8 239.5 239.4 0.47 0.43 1 0.465 113K 35 0.0 0.0 L3 18/0 895.86 MB 0.9 5.1 3.1 2.0 5.1 3.1 1.6 1.6 178.1 177.6 29.31 23.31 20 1.465 3799K 5389 0.0 0.0 L4 155/0 9.50 GB 1.0 1.4 1.2 0.2 1.4 1.2 3.3 1.1 129.7 129.3 11.14 6.77 12 0.928 1466K 4287 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/13 104.51 GB 0.0 19.0 9.4 9.6 27.4 17.8 14.3 3.2 161.1 232.1 120.73 102.41 183 0.660 17M 112K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.0 9.4 9.6 27.4 17.8 14.2 3.2 161.1 232.1 120.73 102.41 183 0.660 17M 112K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.0 9.4 9.6 18.9 9.3 0.0 0.0 206.2 204.9 94.34 80.41 61 1.547 17M 112K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 329.5 26.38 22.00 122 0.216 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.3 total, 49.1 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.37 GB write, 568.41 MB/s write, 19.00 GB read, 394.58 MB/s read, 120.7 seconds Interval compaction: 27.37 GB write, 571.14 MB/s write, 19.00 GB read, 396.48 MB/s read, 120.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 53, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3497406 Average: 2.7752 StdDev: 22.11 Min: 0 Median: 1.4712 Max: 13110 Percentiles: P50: 1.47 P75: 1.86 P99: 7.64 P99.9: 147.29 P99.99: 406.00 ------------------------------------------------------ [ 0, 1 ] 690678 19.748% 19.748% #### ( 1, 2 ] 2245189 64.196% 83.944% ############# ( 2, 3 ] 304343 8.702% 92.646% ## ( 3, 4 ] 113419 3.243% 95.889% # ( 4, 6 ] 97253 2.781% 98.670% # ( 6, 10 ] 28190 0.806% 99.476% ( 10, 15 ] 4337 0.124% 99.600% ( 15, 22 ] 880 0.025% 99.625% ( 22, 34 ] 53 0.002% 99.626% ( 34, 51 ] 23 0.001% 99.627% ( 51, 76 ] 30 0.001% 99.628% ( 76, 110 ] 6450 0.184% 99.812% ( 110, 170 ] 4931 0.141% 99.953% ( 170, 250 ] 724 0.021% 99.974% ( 250, 380 ] 495 0.014% 99.988% ( 380, 580 ] 479 0.014% 100.002% ( 580, 870 ] 195 0.006% 100.008% ( 870, 1300 ] 89 0.003% 100.010% ( 1300, 1900 ] 33 0.001% 100.011% ( 1900, 2900 ] 32 0.001% 100.012% ( 2900, 4400 ] 34 0.001% 100.013% ( 4400, 6600 ] 3 0.000% 100.013% ( 6600, 9900 ] 2 0.000% 100.013% ( 9900, 14000 ] 2 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 1394821 Average: 4.7129 StdDev: 62.41 Min: 0 Median: 1.8890 Max: 8055 Percentiles: P50: 1.89 P75: 2.80 P99: 9.37 P99.9: 56.48 P99.99: 210.17 ------------------------------------------------------ [ 0, 1 ] 37731 2.705% 2.705% # ( 1, 2 ] 742007 53.197% 55.902% ########### ( 2, 3 ] 334313 23.968% 79.871% ##### ( 3, 4 ] 113359 8.127% 87.998% ## ( 4, 6 ] 127040 9.108% 97.106% ## ( 6, 10 ] 31390 2.250% 99.356% ( 10, 15 ] 6724 0.482% 99.838% ( 15, 22 ] 766 0.055% 99.893% ( 22, 34 ] 71 0.005% 99.898% ( 34, 51 ] 14 0.001% 99.899% ( 51, 76 ] 51 0.004% 99.903% ( 76, 110 ] 253 0.018% 99.921% ( 110, 170 ] 725 0.052% 99.973% ( 170, 250 ] 473 0.034% 100.007% ( 250, 380 ] 481 0.034% 100.041% ( 380, 580 ] 480 0.034% 100.076% ( 580, 870 ] 400 0.029% 100.104% ( 870, 1300 ] 254 0.018% 100.123% ( 1300, 1900 ] 140 0.010% 100.133% ( 1900, 2900 ] 176 0.013% 100.145% ( 2900, 4400 ] 160 0.011% 100.157% ( 4400, 6600 ] 32 0.002% 100.159% ( 6600, 9900 ] 9 0.001% 100.160% ** Level 2 read latency histogram (micros): Count: 28294 Average: 2.0429 StdDev: 4.43 Min: 1 Median: 1.4084 Max: 600 Percentiles: P50: 1.41 P75: 1.82 P99: 5.55 P99.9: 9.88 P99.99: 216.82 ------------------------------------------------------ [ 0, 1 ] 7158 25.299% 25.299% ##### ( 1, 2 ] 17115 60.490% 85.789% ############ ( 2, 3 ] 2363 8.352% 94.140% ## ( 3, 4 ] 852 3.011% 97.151% # ( 4, 6 ] 673 2.379% 99.530% ( 6, 10 ] 108 0.382% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 170, 250 ] 2 0.007% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 580, 870 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 441670 Average: 7.8970 StdDev: 101.20 Min: 0 Median: 1.7976 Max: 11217 Percentiles: P50: 1.80 P75: 2.70 P99: 11.62 P99.9: 829.16 P99.99: 1422.05 ------------------------------------------------------ [ 0, 1 ] 26441 5.987% 5.987% # ( 1, 2 ] 243721 55.182% 61.168% ########### ( 2, 3 ] 87746 19.867% 81.035% #### ( 3, 4 ] 35456 8.028% 89.063% ## ( 4, 6 ] 34906 7.903% 96.966% ## ( 6, 10 ] 8478 1.920% 98.886% ( 10, 15 ] 1559 0.353% 99.239% ( 15, 22 ] 205 0.046% 99.285% ( 22, 34 ] 35 0.008% 99.293% ( 34, 51 ] 9 0.002% 99.295% ( 51, 76 ] 5 0.001% 99.296% ( 76, 110 ] 157 0.036% 99.332% ( 110, 170 ] 499 0.113% 99.445% ( 170, 250 ] 407 0.092% 99.537% ( 250, 380 ] 488 0.110% 99.647% ( 380, 580 ] 673 0.152% 99.800% ( 580, 870 ] 516 0.117% 99.916% ( 870, 1300 ] 299 0.068% 99.984% ( 1300, 1900 ] 127 0.029% 100.013% ( 1900, 2900 ] 82 0.019% 100.031% ( 2900, 4400 ] 99 0.022% 100.054% ( 4400, 6600 ] 19 0.004% 100.058% ( 6600, 9900 ] 14 0.003% 100.061% ( 9900, 14000 ] 2 0.000% 100.062% ** Level 4 read latency histogram (micros): Count: 19079 Average: 30.1471 StdDev: 294.98 Min: 1 Median: 2.3212 Max: 13900 Percentiles: P50: 2.32 P75: 3.62 P99: 748.76 P99.9: 4584.20 P99.99: 10088.80 ------------------------------------------------------ [ 0, 1 ] 149 0.781% 0.781% ( 1, 2 ] 7768 40.715% 41.496% ######## ( 2, 3 ] 5052 26.479% 67.975% ##### ( 3, 4 ] 2156 11.300% 79.276% ## ( 4, 6 ] 2764 14.487% 93.763% ### ( 6, 10 ] 536 2.809% 96.572% # ( 10, 15 ] 191 1.001% 97.573% ( 15, 22 ] 17 0.089% 97.662% ( 22, 34 ] 2 0.010% 97.673% ( 34, 51 ] 2 0.010% 97.683% ( 51, 76 ] 3 0.016% 97.699% ( 76, 110 ] 2 0.010% 97.710% ( 110, 170 ] 10 0.052% 97.762% ( 170, 250 ] 37 0.194% 97.956% ( 250, 380 ] 54 0.283% 98.239% ( 380, 580 ] 94 0.493% 98.732% ( 580, 870 ] 88 0.461% 99.193% ( 870, 1300 ] 60 0.314% 99.507% ( 1300, 1900 ] 29 0.152% 99.659% ( 1900, 2900 ] 21 0.110% 99.769% ( 2900, 4400 ] 24 0.126% 99.895% ( 4400, 6600 ] 11 0.058% 99.953% ( 6600, 9900 ] 7 0.037% 99.990% ( 9900, 14000 ] 2 0.010% 100.000% ** Level 5 read latency histogram (micros): Count: 280 Average: 1254.9214 StdDev: 1533.04 Min: 84 Median: 538.8235 Max: 11977 Percentiles: P50: 538.82 P75: 1847.83 P99: 6380.00 P99.9: 11977.00 P99.99: 11977.00 ------------------------------------------------------ ( 76, 110 ] 7 2.500% 2.500% # ( 110, 170 ] 34 12.143% 14.643% ## ( 170, 250 ] 34 12.143% 26.786% ## ( 250, 380 ] 38 13.571% 40.357% ### ( 380, 580 ] 34 12.143% 52.500% ## ( 580, 870 ] 22 7.857% 60.357% ## ( 870, 1300 ] 20 7.143% 67.500% # ( 1300, 1900 ] 23 8.214% 75.714% ## ( 1900, 2900 ] 29 10.357% 86.071% ## ( 2900, 4400 ] 29 10.357% 96.429% ## ( 4400, 6600 ] 8 2.857% 99.286% # ( 6600, 9900 ] 1 0.357% 99.643% ( 9900, 14000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 49.3 total, 3.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 179.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.403 H:M:S, 49.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 308.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.557 H:M:S, 17.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-02:20:22 ... thread 0: (1000000,10000000) ops and (311492.4,191289.2) ops/second in (3.210351,52.276856) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 3.07 GB 44.1 7.8 0.0 7.8 17.2 9.5 0.0 1.8 132.5 294.3 59.91 54.49 164 0.365 8059K 8851 0.0 0.0 L1 23/23 1.60 GB 0.0 7.0 6.3 0.8 6.9 6.2 0.1 1.1 214.3 211.1 33.63 30.26 4 8.407 6913K 106K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.7 1.8 239.5 239.4 0.47 0.43 1 0.465 113K 35 0.0 0.0 L3 18/0 895.86 MB 0.9 5.1 3.1 2.0 5.1 3.1 1.6 1.6 178.1 177.6 29.31 23.31 20 1.465 3799K 5389 0.0 0.0 L4 155/0 9.50 GB 1.0 1.4 1.2 0.2 1.4 1.2 3.3 1.1 129.7 129.3 11.14 6.77 12 0.928 1466K 4287 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1315/39 105.48 GB 0.0 21.4 10.7 10.7 30.7 20.1 14.3 3.2 163.0 234.2 134.44 115.26 201 0.669 20M 125K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.4 10.7 10.7 30.7 20.1 14.2 3.2 163.0 234.2 134.44 115.26 201 0.669 20M 125K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.4 10.7 10.7 21.3 10.6 0.0 0.0 208.5 207.2 105.14 90.63 65 1.617 20M 125K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 331.0 29.31 24.62 136 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.5 total, 52.3 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.75 GB write, 599.55 MB/s write, 21.41 GB read, 417.40 MB/s read, 134.4 seconds Interval compaction: 30.75 GB write, 602.25 MB/s write, 21.41 GB read, 419.28 MB/s read, 134.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 57, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 57, interval: 73 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3763673 Average: 2.7491 StdDev: 21.76 Min: 0 Median: 1.4734 Max: 13110 Percentiles: P50: 1.47 P75: 1.86 P99: 7.46 P99.9: 145.04 P99.99: 374.44 ------------------------------------------------------ [ 0, 1 ] 733367 19.485% 19.485% #### ( 1, 2 ] 2426122 64.462% 83.947% ############# ( 2, 3 ] 331835 8.817% 92.764% ## ( 3, 4 ] 121735 3.234% 95.998% # ( 4, 6 ] 102206 2.716% 98.714% # ( 6, 10 ] 29598 0.786% 99.500% ( 10, 15 ] 4586 0.122% 99.622% ( 15, 22 ] 916 0.024% 99.646% ( 22, 34 ] 57 0.002% 99.648% ( 34, 51 ] 23 0.001% 99.649% ( 51, 76 ] 32 0.001% 99.649% ( 76, 110 ] 6471 0.172% 99.821% ( 110, 170 ] 5071 0.135% 99.956% ( 170, 250 ] 777 0.021% 99.977% ( 250, 380 ] 523 0.014% 99.991% ( 380, 580 ] 496 0.013% 100.004% ( 580, 870 ] 205 0.005% 100.009% ( 870, 1300 ] 94 0.002% 100.012% ( 1300, 1900 ] 37 0.001% 100.013% ( 1900, 2900 ] 34 0.001% 100.014% ( 2900, 4400 ] 35 0.001% 100.015% ( 4400, 6600 ] 4 0.000% 100.015% ( 6600, 9900 ] 2 0.000% 100.015% ( 9900, 14000 ] 2 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 1434696 Average: 4.6783 StdDev: 61.74 Min: 0 Median: 1.8752 Max: 8055 Percentiles: P50: 1.88 P75: 2.78 P99: 9.36 P99.9: 87.86 P99.99: 220.54 ------------------------------------------------------ [ 0, 1 ] 44485 3.101% 3.101% # ( 1, 2 ] 768817 53.587% 56.688% ########### ( 2, 3 ] 338114 23.567% 80.255% ##### ( 3, 4 ] 114392 7.973% 88.228% ## ( 4, 6 ] 127634 8.896% 97.125% ## ( 6, 10 ] 32029 2.232% 99.357% ( 10, 15 ] 6778 0.472% 99.829% ( 15, 22 ] 779 0.054% 99.884% ( 22, 34 ] 72 0.005% 99.889% ( 34, 51 ] 14 0.001% 99.890% ( 51, 76 ] 51 0.004% 99.893% ( 76, 110 ] 276 0.019% 99.913% ( 110, 170 ] 790 0.055% 99.968% ( 170, 250 ] 509 0.035% 100.003% ( 250, 380 ] 491 0.034% 100.037% ( 380, 580 ] 501 0.035% 100.072% ( 580, 870 ] 411 0.029% 100.101% ( 870, 1300 ] 259 0.018% 100.119% ( 1300, 1900 ] 143 0.010% 100.129% ( 1900, 2900 ] 178 0.012% 100.141% ( 2900, 4400 ] 160 0.011% 100.152% ( 4400, 6600 ] 32 0.002% 100.155% ( 6600, 9900 ] 9 0.001% 100.155% ** Level 2 read latency histogram (micros): Count: 28294 Average: 2.0429 StdDev: 4.43 Min: 1 Median: 1.4084 Max: 600 Percentiles: P50: 1.41 P75: 1.82 P99: 5.55 P99.9: 9.88 P99.99: 216.82 ------------------------------------------------------ [ 0, 1 ] 7158 25.299% 25.299% ##### ( 1, 2 ] 17115 60.490% 85.789% ############ ( 2, 3 ] 2363 8.352% 94.140% ## ( 3, 4 ] 852 3.011% 97.151% # ( 4, 6 ] 673 2.379% 99.530% ( 6, 10 ] 108 0.382% 99.912% ( 10, 15 ] 19 0.067% 99.979% ( 15, 22 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 170, 250 ] 2 0.007% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 580, 870 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 441670 Average: 7.8970 StdDev: 101.20 Min: 0 Median: 1.7976 Max: 11217 Percentiles: P50: 1.80 P75: 2.70 P99: 11.62 P99.9: 829.16 P99.99: 1422.05 ------------------------------------------------------ [ 0, 1 ] 26441 5.987% 5.987% # ( 1, 2 ] 243721 55.182% 61.168% ########### ( 2, 3 ] 87746 19.867% 81.035% #### ( 3, 4 ] 35456 8.028% 89.063% ## ( 4, 6 ] 34906 7.903% 96.966% ## ( 6, 10 ] 8478 1.920% 98.886% ( 10, 15 ] 1559 0.353% 99.239% ( 15, 22 ] 205 0.046% 99.285% ( 22, 34 ] 35 0.008% 99.293% ( 34, 51 ] 9 0.002% 99.295% ( 51, 76 ] 5 0.001% 99.296% ( 76, 110 ] 157 0.036% 99.332% ( 110, 170 ] 499 0.113% 99.445% ( 170, 250 ] 407 0.092% 99.537% ( 250, 380 ] 488 0.110% 99.647% ( 380, 580 ] 673 0.152% 99.800% ( 580, 870 ] 516 0.117% 99.916% ( 870, 1300 ] 299 0.068% 99.984% ( 1300, 1900 ] 127 0.029% 100.013% ( 1900, 2900 ] 82 0.019% 100.031% ( 2900, 4400 ] 99 0.022% 100.054% ( 4400, 6600 ] 19 0.004% 100.058% ( 6600, 9900 ] 14 0.003% 100.061% ( 9900, 14000 ] 2 0.000% 100.062% ** Level 4 read latency histogram (micros): Count: 19079 Average: 30.1471 StdDev: 294.98 Min: 1 Median: 2.3212 Max: 13900 Percentiles: P50: 2.32 P75: 3.62 P99: 748.76 P99.9: 4584.20 P99.99: 10088.80 ------------------------------------------------------ [ 0, 1 ] 149 0.781% 0.781% ( 1, 2 ] 7768 40.715% 41.496% ######## ( 2, 3 ] 5052 26.479% 67.975% ##### ( 3, 4 ] 2156 11.300% 79.276% ## ( 4, 6 ] 2764 14.487% 93.763% ### ( 6, 10 ] 536 2.809% 96.572% # ( 10, 15 ] 191 1.001% 97.573% ( 15, 22 ] 17 0.089% 97.662% ( 22, 34 ] 2 0.010% 97.673% ( 34, 51 ] 2 0.010% 97.683% ( 51, 76 ] 3 0.016% 97.699% ( 76, 110 ] 2 0.010% 97.710% ( 110, 170 ] 10 0.052% 97.762% ( 170, 250 ] 37 0.194% 97.956% ( 250, 380 ] 54 0.283% 98.239% ( 380, 580 ] 94 0.493% 98.732% ( 580, 870 ] 88 0.461% 99.193% ( 870, 1300 ] 60 0.314% 99.507% ( 1300, 1900 ] 29 0.152% 99.659% ( 1900, 2900 ] 21 0.110% 99.769% ( 2900, 4400 ] 24 0.126% 99.895% ( 4400, 6600 ] 11 0.058% 99.953% ( 6600, 9900 ] 7 0.037% 99.990% ( 9900, 14000 ] 2 0.010% 100.000% ** Level 5 read latency histogram (micros): Count: 280 Average: 1254.9214 StdDev: 1533.04 Min: 84 Median: 538.8235 Max: 11977 Percentiles: P50: 538.82 P75: 1847.83 P99: 6380.00 P99.9: 11977.00 P99.99: 11977.00 ------------------------------------------------------ ( 76, 110 ] 7 2.500% 2.500% # ( 110, 170 ] 34 12.143% 14.643% ## ( 170, 250 ] 34 12.143% 26.786% ## ( 250, 380 ] 38 13.571% 40.357% ### ( 380, 580 ] 34 12.143% 52.500% ## ( 580, 870 ] 22 7.857% 60.357% ## ( 870, 1300 ] 20 7.143% 67.500% # ( 1300, 1900 ] 23 8.214% 75.714% ## ( 1900, 2900 ] 29 10.357% 86.071% ## ( 2900, 4400 ] 29 10.357% 96.429% ## ( 4400, 6600 ] 8 2.857% 99.286% # ( 6600, 9900 ] 1 0.357% 99.643% ( 9900, 14000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 52.5 total, 3.2 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 187.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.002 H:M:S, 47.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 306.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.599 H:M:S, 18.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.634 micros/op 177503 ops/sec 60.117 seconds 10670999 operations; 172.0 MB/s Microseconds per write: Count: 10670999 Average: 5.6337 StdDev: 390.44 Min: 1 Median: 1.7364 Max: 628811 Percentiles: P50: 1.74 P75: 2.73 P99: 9.06 P99.9: 1146.77 P99.99: 2754.01 ------------------------------------------------------ [ 0, 1 ] 1432009 13.420% 13.420% ### ( 1, 2 ] 5300955 49.676% 63.096% ########## ( 2, 3 ] 1748340 16.384% 79.480% ### ( 3, 4 ] 1443471 13.527% 93.007% ### ( 4, 6 ] 548198 5.137% 98.144% # ( 6, 10 ] 119277 1.118% 99.262% ( 10, 15 ] 39446 0.370% 99.632% ( 15, 22 ] 9267 0.087% 99.719% ( 22, 34 ] 1687 0.016% 99.734% ( 34, 51 ] 192 0.002% 99.736% ( 51, 76 ] 25 0.000% 99.736% ( 76, 110 ] 7543 0.071% 99.807% ( 110, 170 ] 2800 0.026% 99.833% ( 170, 250 ] 291 0.003% 99.836% ( 250, 380 ] 161 0.002% 99.838% ( 380, 580 ] 17 0.000% 99.838% ( 580, 870 ] 13 0.000% 99.838% ( 870, 1300 ] 10310 0.097% 99.934% ( 1300, 1900 ] 15 0.000% 99.935% ( 1900, 2900 ] 6926 0.065% 99.999% ( 2900, 4400 ] 19 0.000% 100.000% ( 4400, 6600 ] 7 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 178041 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10670999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11012470968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 528 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30941057 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27331321083 rocksdb.compact.write.bytes COUNT : 27155574858 rocksdb.flush.write.bytes COUNT : 10965492704 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 66 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 294 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10877119488 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4263936 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27434081738 rocksdb.non.last.level.read.count COUNT : 6625082 rocksdb.block.checksum.compute.count COUNT : 6624092 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.370666 P95 : 3.888221 P99 : 7.441393 P100 : 628807.000000 COUNT : 10670999 SUM : 55077192 rocksdb.compaction.times.micros P50 : 1024848.484848 P95 : 5620000.000000 P99 : 16560000.000000 P100 : 20425150.000000 COUNT : 68 SUM : 108270174 rocksdb.compaction.times.cpu_micros P50 : 953793.103448 P95 : 4020000.000000 P99 : 16560000.000000 P100 : 18367572.000000 COUNT : 68 SUM : 93721478 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 704.529412 P95 : 1231.404762 P99 : 12073.000000 P100 : 196705.000000 COUNT : 147 SUM : 310346 rocksdb.compaction.outfile.sync.micros P50 : 942.471910 P95 : 61458.333333 P99 : 98450.000000 P100 : 104147.000000 COUNT : 330 SUM : 2438769 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 100.469697 P95 : 761.250000 P99 : 2787.500000 P100 : 4693.000000 COUNT : 245 SUM : 55430 rocksdb.table.open.io.micros P50 : 1346.666667 P95 : 9198.750000 P99 : 21776.000000 P100 : 25287.000000 COUNT : 528 SUM : 1333416 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.607936 P95 : 7.580656 P99 : 11.778109 P100 : 16005.000000 COUNT : 6622873 SUM : 36844275 rocksdb.read.block.get.micros P50 : 496.959064 P95 : 4055.319149 P99 : 8880.666667 P100 : 14171.000000 COUNT : 1056 SUM : 1080893 rocksdb.write.raw.block.micros P50 : 0.512292 P95 : 0.973354 P99 : 2.906774 P100 : 22902.000000 COUNT : 9234864 SUM : 18335634 rocksdb.numfiles.in.singlecompaction P50 : 3.303797 P95 : 7.000000 P99 : 30.400000 P100 : 35.000000 COUNT : 130 SUM : 552 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566042 P95 : 1280.236258 P99 : 2689.732543 P100 : 628617.000000 COUNT : 148542 SUM : 30958234 rocksdb.sst.read.micros P50 : 1.573433 P95 : 4.501163 P99 : 8.614648 P100 : 13900.000000 COUNT : 6625667 SUM : 23781343 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10670999 SUM : 11012470968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 207419.354839 P95 : 370250.000000 P99 : 646850.000000 P100 : 795936.000000 COUNT : 147 SUM : 31432485 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 318 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0