[2024-07-16 01:01:26.131256] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 23.11.0 initialization... [2024-07-16 01:01:26.131395] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid162112 ] Set seed to 1721084486127810 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-16 01:01:26.233508] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-16 01:01:26.274585] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-16 01:01:26.274637] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 162112' to capture a snapshot of events at runtime. [2024-07-16 01:01:26.274647] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-16 01:01:26.274673] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-16 01:01:26.274681] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid162112 for offline analysis/debug. [2024-07-16 01:01:26.274773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Jul 16 01:01:30 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/16-01:01:33 ... thread 0: (1000000,1000000) ops and (365064.0,365064.0) ops/second in (2.739246,2.739246) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 630.03 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 357.1 2.29 2.07 12 0.191 0 0 0.0 0.0 L2 3/2 237.16 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 252.5 252.4 1.38 1.32 2 0.690 354K 181 0.0 0.0 L3 8/0 629.91 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/11 96.94 GB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 94.9 317.7 3.67 3.38 14 0.262 354K 181 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 94.9 317.7 3.67 3.38 14 0.262 354K 181 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 252.5 252.4 1.38 1.32 2 0.690 354K 181 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 357.1 2.29 2.07 12 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.9 total, 2.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.14 GB write, 402.05 MB/s write, 0.34 GB read, 120.08 MB/s read, 3.7 seconds Interval compaction: 1.14 GB write, 426.02 MB/s write, 0.34 GB read, 127.24 MB/s read, 3.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 119176 Average: 1.9630 StdDev: 12.57 Min: 1 Median: 1.3016 Max: 2835 Percentiles: P50: 1.30 P75: 1.73 P99: 5.21 P99.9: 9.70 P99.99: 64.01 ------------------------------------------------------ [ 0, 1 ] 38848 32.597% 32.597% ####### ( 1, 2 ] 68782 57.715% 90.312% ############ ( 2, 3 ] 6427 5.393% 95.705% # ( 3, 4 ] 2874 2.412% 98.116% ( 4, 6 ] 1743 1.463% 99.579% ( 6, 10 ] 417 0.350% 99.929% ( 10, 15 ] 54 0.045% 99.974% ( 15, 22 ] 14 0.012% 99.986% ( 22, 34 ] 5 0.004% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 4 0.003% 99.994% ( 110, 170 ] 10 0.008% 100.003% ( 170, 250 ] 1 0.001% 100.003% ( 250, 380 ] 7 0.006% 100.009% ( 580, 870 ] 2 0.002% 100.011% ( 870, 1300 ] 1 0.001% 100.012% ( 1300, 1900 ] 1 0.001% 100.013% ( 1900, 2900 ] 2 0.002% 100.014% ** Level 1 read latency histogram (micros): Count: 12292 Average: 3.0316 StdDev: 28.30 Min: 1 Median: 1.2624 Max: 1686 Percentiles: P50: 1.26 P75: 1.73 P99: 10.74 P99.9: 247.40 P99.99: 1275.36 ------------------------------------------------------ [ 0, 1 ] 4413 35.901% 35.901% ####### ( 1, 2 ] 6604 53.726% 89.627% ########### ( 2, 3 ] 756 6.150% 95.778% # ( 3, 4 ] 113 0.919% 96.697% ( 4, 6 ] 119 0.968% 97.665% ( 6, 10 ] 158 1.285% 98.951% ( 10, 15 ] 41 0.334% 99.284% ( 15, 22 ] 6 0.049% 99.333% ( 22, 34 ] 2 0.016% 99.349% ( 34, 51 ] 36 0.293% 99.642% ( 51, 76 ] 15 0.122% 99.764% ( 76, 110 ] 5 0.041% 99.805% ( 110, 170 ] 3 0.024% 99.829% ( 170, 250 ] 9 0.073% 99.902% ( 250, 380 ] 3 0.024% 99.927% ( 380, 580 ] 4 0.033% 99.959% ( 870, 1300 ] 4 0.033% 99.992% ( 1300, 1900 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 55695 Average: 1.9477 StdDev: 4.62 Min: 0 Median: 1.3300 Max: 829 Percentiles: P50: 1.33 P75: 1.75 P99: 5.50 P99.9: 11.16 P99.99: 208.89 ------------------------------------------------------ [ 0, 1 ] 17029 30.575% 30.575% ###### ( 1, 2 ] 32787 58.869% 89.444% ############ ( 2, 3 ] 3120 5.602% 95.046% # ( 3, 4 ] 1489 2.673% 97.720% # ( 4, 6 ] 953 1.711% 99.431% ( 6, 10 ] 254 0.456% 99.887% ( 10, 15 ] 40 0.072% 99.959% ( 15, 22 ] 9 0.016% 99.975% ( 22, 34 ] 3 0.005% 99.980% ( 34, 51 ] 1 0.002% 99.982% ( 51, 76 ] 2 0.004% 99.986% ( 110, 170 ] 2 0.004% 99.989% ( 170, 250 ] 5 0.009% 99.998% ( 250, 380 ] 2 0.004% 100.002% ( 580, 870 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 40 Average: 1417.3750 StdDev: 1029.70 Min: 161 Median: 1013.3333 Max: 4878 Percentiles: P50: 1013.33 P75: 2025.00 P99: 4878.00 P99.9: 4878.00 P99.99: 4878.00 ------------------------------------------------------ ( 110, 170 ] 1 2.500% 2.500% # ( 250, 380 ] 1 2.500% 5.000% # ( 380, 580 ] 5 12.500% 17.500% ### ( 580, 870 ] 10 25.000% 42.500% ##### ( 870, 1300 ] 9 22.500% 65.000% ##### ( 1300, 1900 ] 3 7.500% 72.500% ## ( 1900, 2900 ] 8 20.000% 92.500% #### ( 2900, 4400 ] 2 5.000% 97.500% # ( 4400, 6600 ] 1 2.500% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1667.7714 StdDev: 1428.50 Min: 178 Median: 1120.8333 Max: 6432 Percentiles: P50: 1120.83 P75: 2212.50 P99: 6215.00 P99.9: 6432.00 P99.99: 6432.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 10 28.571% 40.000% ###### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 5 14.286% 71.429% ### ( 1900, 2900 ] 4 11.429% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 2.9 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 338.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.216 H:M:S, 7.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 359.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.216 H:M:S, 7.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/16-01:01:36 ... thread 0: (1000000,2000000) ops and (331611.1,347534.3) ops/second in (3.015581,5.754827) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 1.29 GB 0.0 0.8 0.0 0.8 2.6 1.8 0.0 1.4 99.7 321.9 8.22 7.64 29 0.283 831K 837 0.0 0.0 L1 1/1 2.16 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 242.0 241.6 1.30 1.26 1 1.302 319K 408 0.0 0.0 L2 1/0 49.61 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 252.5 252.4 1.38 1.32 2 0.690 354K 181 0.0 0.0 L3 40/0 971.06 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 202.1 201.9 3.40 2.98 3 1.134 698K 574 0.0 0.0 L4 136/0 9.69 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1232/11 97.92 GB 0.0 2.1 1.0 1.1 3.9 2.8 0.7 2.2 151.8 279.4 14.30 13.20 35 0.409 2203K 2000 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 1.0 1.1 3.9 2.8 0.6 2.2 151.8 279.4 14.30 13.20 35 0.409 2203K 2000 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 1.0 1.1 2.1 1.0 0.0 0.0 236.3 236.1 9.18 8.61 9 1.020 2203K 2000 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 357.1 5.12 4.59 26 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.90 GB write, 674.90 MB/s write, 2.12 GB read, 366.62 MB/s read, 14.3 seconds Interval compaction: 3.90 GB write, 694.06 MB/s write, 2.12 GB read, 377.03 MB/s read, 14.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 375381 Average: 2.1057 StdDev: 11.48 Min: 1 Median: 1.4264 Max: 3553 Percentiles: P50: 1.43 P75: 1.82 P99: 5.46 P99.9: 9.73 P99.99: 15.33 ------------------------------------------------------ [ 0, 1 ] 86796 23.122% 23.122% ##### ( 1, 2 ] 236616 63.034% 86.156% ############# ( 2, 3 ] 30334 8.081% 94.237% ## ( 3, 4 ] 12449 3.316% 97.553% # ( 4, 6 ] 7448 1.984% 99.537% ( 6, 10 ] 1461 0.389% 99.926% ( 10, 15 ] 239 0.064% 99.990% ( 15, 22 ] 31 0.008% 99.998% ( 22, 34 ] 9 0.002% 100.001% ( 34, 51 ] 1 0.000% 100.001% ( 51, 76 ] 8 0.002% 100.003% ( 110, 170 ] 19 0.005% 100.008% ( 170, 250 ] 5 0.001% 100.009% ( 250, 380 ] 11 0.003% 100.012% ( 380, 580 ] 1 0.000% 100.013% ( 580, 870 ] 8 0.002% 100.015% ( 870, 1300 ] 9 0.002% 100.017% ( 1300, 1900 ] 1 0.000% 100.017% ( 1900, 2900 ] 3 0.001% 100.018% ( 2900, 4400 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 91592 Average: 2.4677 StdDev: 11.77 Min: 1 Median: 1.5754 Max: 1686 Percentiles: P50: 1.58 P75: 1.96 P99: 6.54 P99.9: 15.19 P99.99: 186.36 ------------------------------------------------------ [ 0, 1 ] 11872 12.962% 12.962% ### ( 1, 2 ] 58961 64.374% 77.335% ############# ( 2, 3 ] 12529 13.679% 91.014% ### ( 3, 4 ] 4029 4.399% 95.413% # ( 4, 6 ] 3179 3.471% 98.884% # ( 6, 10 ] 782 0.854% 99.738% ( 10, 15 ] 148 0.162% 99.900% ( 15, 22 ] 15 0.016% 99.916% ( 22, 34 ] 5 0.005% 99.921% ( 34, 51 ] 37 0.040% 99.962% ( 51, 76 ] 16 0.017% 99.979% ( 76, 110 ] 5 0.005% 99.985% ( 110, 170 ] 3 0.003% 99.988% ( 170, 250 ] 9 0.010% 99.998% ( 250, 380 ] 7 0.008% 100.005% ( 380, 580 ] 5 0.005% 100.011% ( 870, 1300 ] 4 0.004% 100.015% ( 1300, 1900 ] 2 0.002% 100.017% ** Level 2 read latency histogram (micros): Count: 75907 Average: 2.0422 StdDev: 3.99 Min: 0 Median: 1.4089 Max: 829 Percentiles: P50: 1.41 P75: 1.82 P99: 5.65 P99.9: 10.77 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 18930 24.938% 24.938% ##### ( 1, 2 ] 46527 61.295% 86.233% ############ ( 2, 3 ] 5756 7.583% 93.816% ## ( 3, 4 ] 2554 3.365% 97.181% # ( 4, 6 ] 1670 2.200% 99.381% ( 6, 10 ] 385 0.507% 99.888% ( 10, 15 ] 59 0.078% 99.966% ( 15, 22 ] 10 0.013% 99.979% ( 22, 34 ] 3 0.004% 99.983% ( 34, 51 ] 1 0.001% 99.984% ( 51, 76 ] 2 0.003% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 5 0.007% 99.996% ( 250, 380 ] 2 0.003% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47953 Average: 3.6100 StdDev: 51.00 Min: 0 Median: 1.5997 Max: 4878 Percentiles: P50: 1.60 P75: 1.98 P99: 6.67 P99.9: 158.56 P99.99: 2425.59 ------------------------------------------------------ [ 0, 1 ] 5155 10.750% 10.750% ## ( 1, 2 ] 31384 65.447% 76.198% ############# ( 2, 3 ] 6748 14.072% 90.270% ### ( 3, 4 ] 2454 5.118% 95.387% # ( 4, 6 ] 1677 3.497% 98.884% # ( 6, 10 ] 333 0.694% 99.579% ( 10, 15 ] 99 0.206% 99.785% ( 15, 22 ] 23 0.048% 99.833% ( 22, 34 ] 26 0.054% 99.887% ( 34, 51 ] 2 0.004% 99.892% ( 110, 170 ] 5 0.010% 99.902% ( 170, 250 ] 4 0.008% 99.910% ( 250, 380 ] 3 0.006% 99.917% ( 380, 580 ] 6 0.013% 99.929% ( 580, 870 ] 13 0.027% 99.956% ( 870, 1300 ] 9 0.019% 99.975% ( 1300, 1900 ] 3 0.006% 99.981% ( 1900, 2900 ] 8 0.017% 99.998% ( 2900, 4400 ] 2 0.004% 100.002% ( 4400, 6600 ] 1 0.002% 100.004% ** Level 4 read latency histogram (micros): Count: 35 Average: 1667.7714 StdDev: 1428.50 Min: 178 Median: 1120.8333 Max: 6432 Percentiles: P50: 1120.83 P75: 2212.50 P99: 6215.00 P99.9: 6432.00 P99.99: 6432.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 10 28.571% 40.000% ###### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 5 14.286% 71.429% ### ( 1900, 2900 ] 4 11.429% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 5.9 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 332.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.639 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.423 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/16-01:01:39 ... thread 0: (1000000,3000000) ops and (339165.4,344699.2) ops/second in (2.948414,8.703241) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.21 GB 62.9 1.3 0.0 1.3 4.0 2.7 0.0 1.5 104.5 323.3 12.66 11.76 44 0.288 1343K 1314 0.0 0.0 L1 1/1 2.16 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 242.0 241.6 1.30 1.26 1 1.302 319K 408 0.0 0.0 L2 1/0 49.61 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 252.5 252.4 1.38 1.32 2 0.690 354K 181 0.0 0.0 L3 40/0 971.06 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 202.1 201.9 3.40 2.98 3 1.134 698K 574 0.0 0.0 L4 136/0 9.69 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1239/15 98.84 GB 0.0 2.6 1.0 1.6 5.3 3.7 0.7 2.0 142.6 290.4 18.75 17.33 50 0.375 2715K 2477 0.0 0.0 Int 0/0 0.00 KB 0.0 2.6 1.0 1.6 5.3 3.7 0.6 2.0 142.6 290.4 18.75 17.33 50 0.375 2715K 2477 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.6 1.0 1.6 2.6 1.0 0.0 0.0 243.0 242.7 11.01 10.40 11 1.001 2715K 2477 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 358.1 7.74 6.93 39 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.7 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.32 GB write, 613.84 MB/s write, 2.61 GB read, 301.56 MB/s read, 18.7 seconds Interval compaction: 5.32 GB write, 625.36 MB/s write, 2.61 GB read, 307.22 MB/s read, 18.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 745553 Average: 2.1018 StdDev: 9.98 Min: 1 Median: 1.4516 Max: 3553 Percentiles: P50: 1.45 P75: 1.83 P99: 5.32 P99.9: 9.51 P99.99: 14.28 ------------------------------------------------------ [ 0, 1 ] 151099 20.267% 20.267% #### ( 1, 2 ] 490857 65.838% 86.105% ############# ( 2, 3 ] 64406 8.639% 94.743% ## ( 3, 4 ] 23193 3.111% 97.854% # ( 4, 6 ] 12994 1.743% 99.597% ( 6, 10 ] 2574 0.345% 99.942% ( 10, 15 ] 418 0.056% 99.998% ( 15, 22 ] 54 0.007% 100.006% ( 22, 34 ] 14 0.002% 100.008% ( 34, 51 ] 2 0.000% 100.008% ( 51, 76 ] 10 0.001% 100.009% ( 110, 170 ] 25 0.003% 100.012% ( 170, 250 ] 9 0.001% 100.014% ( 250, 380 ] 17 0.002% 100.016% ( 380, 580 ] 4 0.001% 100.016% ( 580, 870 ] 13 0.002% 100.018% ( 870, 1300 ] 11 0.001% 100.020% ( 1300, 1900 ] 3 0.000% 100.020% ( 1900, 2900 ] 4 0.001% 100.021% ( 2900, 4400 ] 2 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 91592 Average: 2.4677 StdDev: 11.77 Min: 1 Median: 1.5754 Max: 1686 Percentiles: P50: 1.58 P75: 1.96 P99: 6.54 P99.9: 15.19 P99.99: 186.36 ------------------------------------------------------ [ 0, 1 ] 11872 12.962% 12.962% ### ( 1, 2 ] 58961 64.374% 77.335% ############# ( 2, 3 ] 12529 13.679% 91.014% ### ( 3, 4 ] 4029 4.399% 95.413% # ( 4, 6 ] 3179 3.471% 98.884% # ( 6, 10 ] 782 0.854% 99.738% ( 10, 15 ] 148 0.162% 99.900% ( 15, 22 ] 15 0.016% 99.916% ( 22, 34 ] 5 0.005% 99.921% ( 34, 51 ] 37 0.040% 99.962% ( 51, 76 ] 16 0.017% 99.979% ( 76, 110 ] 5 0.005% 99.985% ( 110, 170 ] 3 0.003% 99.988% ( 170, 250 ] 9 0.010% 99.998% ( 250, 380 ] 7 0.008% 100.005% ( 380, 580 ] 5 0.005% 100.011% ( 870, 1300 ] 4 0.004% 100.015% ( 1300, 1900 ] 2 0.002% 100.017% ** Level 2 read latency histogram (micros): Count: 75907 Average: 2.0422 StdDev: 3.99 Min: 0 Median: 1.4089 Max: 829 Percentiles: P50: 1.41 P75: 1.82 P99: 5.65 P99.9: 10.77 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 18930 24.938% 24.938% ##### ( 1, 2 ] 46527 61.295% 86.233% ############ ( 2, 3 ] 5756 7.583% 93.816% ## ( 3, 4 ] 2554 3.365% 97.181% # ( 4, 6 ] 1670 2.200% 99.381% ( 6, 10 ] 385 0.507% 99.888% ( 10, 15 ] 59 0.078% 99.966% ( 15, 22 ] 10 0.013% 99.979% ( 22, 34 ] 3 0.004% 99.983% ( 34, 51 ] 1 0.001% 99.984% ( 51, 76 ] 2 0.003% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 5 0.007% 99.996% ( 250, 380 ] 2 0.003% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47953 Average: 3.6100 StdDev: 51.00 Min: 0 Median: 1.5997 Max: 4878 Percentiles: P50: 1.60 P75: 1.98 P99: 6.67 P99.9: 158.56 P99.99: 2425.59 ------------------------------------------------------ [ 0, 1 ] 5155 10.750% 10.750% ## ( 1, 2 ] 31384 65.447% 76.198% ############# ( 2, 3 ] 6748 14.072% 90.270% ### ( 3, 4 ] 2454 5.118% 95.387% # ( 4, 6 ] 1677 3.497% 98.884% # ( 6, 10 ] 333 0.694% 99.579% ( 10, 15 ] 99 0.206% 99.785% ( 15, 22 ] 23 0.048% 99.833% ( 22, 34 ] 26 0.054% 99.887% ( 34, 51 ] 2 0.004% 99.892% ( 110, 170 ] 5 0.010% 99.902% ( 170, 250 ] 4 0.008% 99.910% ( 250, 380 ] 3 0.006% 99.917% ( 380, 580 ] 6 0.013% 99.929% ( 580, 870 ] 13 0.027% 99.956% ( 870, 1300 ] 9 0.019% 99.975% ( 1300, 1900 ] 3 0.006% 99.981% ( 1900, 2900 ] 8 0.017% 99.998% ( 2900, 4400 ] 2 0.004% 100.002% ( 4400, 6600 ] 1 0.002% 100.004% ** Level 4 read latency histogram (micros): Count: 35 Average: 1667.7714 StdDev: 1428.50 Min: 178 Median: 1120.8333 Max: 6432 Percentiles: P50: 1120.83 P75: 2212.50 P99: 6215.00 P99.9: 6432.00 P99.99: 6432.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 10 28.571% 40.000% ###### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 5 14.286% 71.429% ### ( 1900, 2900 ] 4 11.429% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 8.9 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 332.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.030 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.391 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/16-01:01:42 ... thread 0: (1000000,4000000) ops and (316391.0,337157.6) ops/second in (3.160646,11.863887) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.21 GB 201.4 2.4 0.0 2.4 6.1 3.8 0.0 1.6 123.0 315.3 19.97 18.68 62 0.322 2494K 2518 0.0 0.0 L1 10/0 1.04 GB 106.7 1.4 1.4 0.0 1.3 1.3 0.2 1.0 234.9 234.0 5.90 5.74 2 2.952 1408K 5060 0.0 0.0 L2 1/0 49.61 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 252.5 252.4 1.38 1.32 2 0.690 354K 181 0.0 0.0 L3 40/0 971.06 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 202.1 201.9 3.40 2.98 3 1.134 698K 574 0.0 0.0 L4 136/0 9.69 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/4 99.88 GB 0.0 4.8 2.0 2.7 8.5 5.8 0.7 2.3 159.2 284.2 30.66 28.72 69 0.444 4955K 8333 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 2.0 2.7 8.5 5.8 0.6 2.3 159.2 284.2 30.66 28.72 69 0.444 4955K 8333 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 2.0 2.7 4.8 2.0 0.0 0.0 244.8 244.3 19.94 19.10 16 1.246 4955K 8333 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 358.4 10.72 9.62 53 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.51 GB write, 724.48 MB/s write, 4.77 GB read, 405.73 MB/s read, 30.7 seconds Interval compaction: 8.51 GB write, 734.46 MB/s write, 4.77 GB read, 411.32 MB/s read, 30.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1054853 Average: 2.0847 StdDev: 9.70 Min: 1 Median: 1.4409 Max: 3553 Percentiles: P50: 1.44 P75: 1.82 P99: 5.28 P99.9: 9.56 P99.99: 14.12 ------------------------------------------------------ [ 0, 1 ] 223700 21.207% 21.207% #### ( 1, 2 ] 688839 65.302% 86.509% ############# ( 2, 3 ] 89188 8.455% 94.964% ## ( 3, 4 ] 31198 2.958% 97.921% # ( 4, 6 ] 17771 1.685% 99.606% ( 6, 10 ] 3486 0.330% 99.936% ( 10, 15 ] 687 0.065% 100.002% ( 15, 22 ] 71 0.007% 100.008% ( 22, 34 ] 16 0.002% 100.010% ( 34, 51 ] 4 0.000% 100.010% ( 51, 76 ] 12 0.001% 100.011% ( 110, 170 ] 34 0.003% 100.015% ( 170, 250 ] 12 0.001% 100.016% ( 250, 380 ] 23 0.002% 100.018% ( 380, 580 ] 8 0.001% 100.019% ( 580, 870 ] 20 0.002% 100.020% ( 870, 1300 ] 15 0.001% 100.022% ( 1300, 1900 ] 4 0.000% 100.022% ( 1900, 2900 ] 6 0.001% 100.023% ( 2900, 4400 ] 2 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 92190 Average: 2.6118 StdDev: 16.90 Min: 1 Median: 1.5745 Max: 1792 Percentiles: P50: 1.57 P75: 1.96 P99: 6.64 P99.9: 33.54 P99.99: 365.59 ------------------------------------------------------ [ 0, 1 ] 12009 13.026% 13.026% ### ( 1, 2 ] 59330 64.356% 77.383% ############# ( 2, 3 ] 12576 13.641% 91.024% ### ( 3, 4 ] 4046 4.389% 95.413% # ( 4, 6 ] 3182 3.452% 98.864% # ( 6, 10 ] 786 0.853% 99.717% ( 10, 15 ] 149 0.162% 99.879% ( 15, 22 ] 15 0.016% 99.895% ( 22, 34 ] 5 0.005% 99.900% ( 34, 51 ] 38 0.041% 99.941% ( 51, 76 ] 16 0.017% 99.959% ( 76, 110 ] 5 0.005% 99.964% ( 110, 170 ] 4 0.004% 99.969% ( 170, 250 ] 10 0.011% 99.979% ( 250, 380 ] 11 0.012% 99.991% ( 380, 580 ] 9 0.010% 100.001% ( 580, 870 ] 2 0.002% 100.003% ( 870, 1300 ] 8 0.009% 100.012% ( 1300, 1900 ] 5 0.005% 100.017% ** Level 2 read latency histogram (micros): Count: 75907 Average: 2.0422 StdDev: 3.99 Min: 0 Median: 1.4089 Max: 829 Percentiles: P50: 1.41 P75: 1.82 P99: 5.65 P99.9: 10.77 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 18930 24.938% 24.938% ##### ( 1, 2 ] 46527 61.295% 86.233% ############ ( 2, 3 ] 5756 7.583% 93.816% ## ( 3, 4 ] 2554 3.365% 97.181% # ( 4, 6 ] 1670 2.200% 99.381% ( 6, 10 ] 385 0.507% 99.888% ( 10, 15 ] 59 0.078% 99.966% ( 15, 22 ] 10 0.013% 99.979% ( 22, 34 ] 3 0.004% 99.983% ( 34, 51 ] 1 0.001% 99.984% ( 51, 76 ] 2 0.003% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 5 0.007% 99.996% ( 250, 380 ] 2 0.003% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47953 Average: 3.6100 StdDev: 51.00 Min: 0 Median: 1.5997 Max: 4878 Percentiles: P50: 1.60 P75: 1.98 P99: 6.67 P99.9: 158.56 P99.99: 2425.59 ------------------------------------------------------ [ 0, 1 ] 5155 10.750% 10.750% ## ( 1, 2 ] 31384 65.447% 76.198% ############# ( 2, 3 ] 6748 14.072% 90.270% ### ( 3, 4 ] 2454 5.118% 95.387% # ( 4, 6 ] 1677 3.497% 98.884% # ( 6, 10 ] 333 0.694% 99.579% ( 10, 15 ] 99 0.206% 99.785% ( 15, 22 ] 23 0.048% 99.833% ( 22, 34 ] 26 0.054% 99.887% ( 34, 51 ] 2 0.004% 99.892% ( 110, 170 ] 5 0.010% 99.902% ( 170, 250 ] 4 0.008% 99.910% ( 250, 380 ] 3 0.006% 99.917% ( 380, 580 ] 6 0.013% 99.929% ( 580, 870 ] 13 0.027% 99.956% ( 870, 1300 ] 9 0.019% 99.975% ( 1300, 1900 ] 3 0.006% 99.981% ( 1900, 2900 ] 8 0.017% 99.998% ( 2900, 4400 ] 2 0.004% 100.002% ( 4400, 6600 ] 1 0.002% 100.004% ** Level 4 read latency histogram (micros): Count: 35 Average: 1667.7714 StdDev: 1428.50 Min: 178 Median: 1120.8333 Max: 6432 Percentiles: P50: 1120.83 P75: 2212.50 P99: 6215.00 P99.9: 6432.00 P99.99: 6432.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 10 28.571% 40.000% ###### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 5 14.286% 71.429% ### ( 1900, 2900 ] 4 11.429% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 327.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.603 H:M:S, 13.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 311.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.573 H:M:S, 18.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/16-01:01:45 ... thread 0: (1000000,5000000) ops and (300935.8,329232.1) ops/second in (3.322968,15.186855) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.20 GB 88.1 3.1 0.0 3.1 7.9 4.7 0.0 1.7 125.7 315.3 25.56 23.92 79 0.324 3262K 3230 0.0 0.0 L1 10/10 1.04 GB 0.0 1.4 1.4 0.0 1.3 1.3 0.2 1.0 234.9 234.0 5.90 5.74 2 2.952 1408K 5060 0.0 0.0 L2 1/0 49.61 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 252.5 252.4 1.38 1.32 2 0.690 354K 181 0.0 0.0 L3 40/0 971.06 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 202.1 201.9 3.40 2.98 3 1.134 698K 574 0.0 0.0 L4 136/0 9.69 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/22 100.86 GB 0.0 5.5 2.0 3.5 10.2 6.8 0.7 2.2 155.5 289.1 36.25 33.96 86 0.421 5723K 9045 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 2.0 3.5 10.2 6.8 0.6 2.2 155.5 289.1 36.25 33.96 86 0.421 5723K 9045 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 2.0 3.5 5.5 2.0 0.0 0.0 248.0 247.6 22.73 21.84 19 1.196 5723K 9045 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 358.8 13.52 12.12 67 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.2 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.23 GB write, 682.51 MB/s write, 5.50 GB read, 367.16 MB/s read, 36.2 seconds Interval compaction: 10.23 GB write, 689.86 MB/s write, 5.50 GB read, 371.11 MB/s read, 36.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 15, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1330352 Average: 2.0874 StdDev: 10.46 Min: 0 Median: 1.4358 Max: 3553 Percentiles: P50: 1.44 P75: 1.82 P99: 5.25 P99.9: 9.63 P99.99: 14.66 ------------------------------------------------------ [ 0, 1 ] 285743 21.479% 21.479% #### ( 1, 2 ] 870746 65.452% 86.931% ############# ( 2, 3 ] 109823 8.255% 95.186% ## ( 3, 4 ] 37686 2.833% 98.019% # ( 4, 6 ] 20879 1.569% 99.588% ( 6, 10 ] 4571 0.344% 99.932% ( 10, 15 ] 828 0.062% 99.994% ( 15, 22 ] 97 0.007% 100.002% ( 22, 34 ] 19 0.001% 100.003% ( 34, 51 ] 5 0.000% 100.003% ( 51, 76 ] 14 0.001% 100.004% ( 76, 110 ] 35 0.003% 100.007% ( 110, 170 ] 53 0.004% 100.011% ( 170, 250 ] 20 0.002% 100.013% ( 250, 380 ] 34 0.003% 100.015% ( 380, 580 ] 16 0.001% 100.016% ( 580, 870 ] 28 0.002% 100.018% ( 870, 1300 ] 19 0.001% 100.020% ( 1300, 1900 ] 4 0.000% 100.020% ( 1900, 2900 ] 9 0.001% 100.021% ( 2900, 4400 ] 4 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 143654 Average: 2.5664 StdDev: 17.33 Min: 1 Median: 1.5236 Max: 3625 Percentiles: P50: 1.52 P75: 1.91 P99: 7.53 P99.9: 86.94 P99.99: 370.66 ------------------------------------------------------ [ 0, 1 ] 23103 16.082% 16.082% ### ( 1, 2 ] 93050 64.774% 80.856% ############# ( 2, 3 ] 16412 11.425% 92.281% ## ( 3, 4 ] 5243 3.650% 95.930% # ( 4, 6 ] 3818 2.658% 98.588% # ( 6, 10 ] 1547 1.077% 99.665% ( 10, 15 ] 233 0.162% 99.827% ( 15, 22 ] 22 0.015% 99.843% ( 22, 34 ] 6 0.004% 99.847% ( 34, 51 ] 38 0.026% 99.873% ( 51, 76 ] 20 0.014% 99.887% ( 76, 110 ] 57 0.040% 99.927% ( 110, 170 ] 51 0.036% 99.962% ( 170, 250 ] 22 0.015% 99.978% ( 250, 380 ] 19 0.013% 99.991% ( 380, 580 ] 12 0.008% 99.999% ( 580, 870 ] 3 0.002% 100.001% ( 870, 1300 ] 8 0.006% 100.007% ( 1300, 1900 ] 5 0.003% 100.010% ( 2900, 4400 ] 1 0.001% 100.011% ** Level 2 read latency histogram (micros): Count: 75907 Average: 2.0422 StdDev: 3.99 Min: 0 Median: 1.4089 Max: 829 Percentiles: P50: 1.41 P75: 1.82 P99: 5.65 P99.9: 10.77 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 18930 24.938% 24.938% ##### ( 1, 2 ] 46527 61.295% 86.233% ############ ( 2, 3 ] 5756 7.583% 93.816% ## ( 3, 4 ] 2554 3.365% 97.181% # ( 4, 6 ] 1670 2.200% 99.381% ( 6, 10 ] 385 0.507% 99.888% ( 10, 15 ] 59 0.078% 99.966% ( 15, 22 ] 10 0.013% 99.979% ( 22, 34 ] 3 0.004% 99.983% ( 34, 51 ] 1 0.001% 99.984% ( 51, 76 ] 2 0.003% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 5 0.007% 99.996% ( 250, 380 ] 2 0.003% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47953 Average: 3.6100 StdDev: 51.00 Min: 0 Median: 1.5997 Max: 4878 Percentiles: P50: 1.60 P75: 1.98 P99: 6.67 P99.9: 158.56 P99.99: 2425.59 ------------------------------------------------------ [ 0, 1 ] 5155 10.750% 10.750% ## ( 1, 2 ] 31384 65.447% 76.198% ############# ( 2, 3 ] 6748 14.072% 90.270% ### ( 3, 4 ] 2454 5.118% 95.387% # ( 4, 6 ] 1677 3.497% 98.884% # ( 6, 10 ] 333 0.694% 99.579% ( 10, 15 ] 99 0.206% 99.785% ( 15, 22 ] 23 0.048% 99.833% ( 22, 34 ] 26 0.054% 99.887% ( 34, 51 ] 2 0.004% 99.892% ( 110, 170 ] 5 0.010% 99.902% ( 170, 250 ] 4 0.008% 99.910% ( 250, 380 ] 3 0.006% 99.917% ( 380, 580 ] 6 0.013% 99.929% ( 580, 870 ] 13 0.027% 99.956% ( 870, 1300 ] 9 0.019% 99.975% ( 1300, 1900 ] 3 0.006% 99.981% ( 1900, 2900 ] 8 0.017% 99.998% ( 2900, 4400 ] 2 0.004% 100.002% ( 4400, 6600 ] 1 0.002% 100.004% ** Level 4 read latency histogram (micros): Count: 35 Average: 1667.7714 StdDev: 1428.50 Min: 178 Median: 1120.8333 Max: 6432 Percentiles: P50: 1120.83 P75: 2212.50 P99: 6215.00 P99.9: 6432.00 P99.99: 6432.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 10 28.571% 40.000% ###### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 5 14.286% 71.429% ### ( 1900, 2900 ] 4 11.429% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 15.4 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 320.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.378 H:M:S, 15.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 296.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.775 H:M:S, 23.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/16-01:01:54 ... thread 0: (1000000,6000000) ops and (108928.0,246232.4) ops/second in (9.180373,24.367228) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 4.11 GB 156.7 5.2 0.0 5.2 10.8 5.6 0.0 1.9 146.3 306.2 36.17 33.95 98 0.369 5372K 10K 0.0 0.0 L1 10/10 1.04 GB 0.0 1.4 1.4 0.0 1.3 1.3 0.2 1.0 234.9 234.0 5.90 5.74 2 2.952 1408K 5060 0.0 0.0 L2 1/0 49.61 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 252.5 252.4 1.38 1.32 2 0.690 354K 181 0.0 0.0 L3 40/0 971.06 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 202.1 201.9 3.40 2.98 3 1.134 698K 574 0.0 0.0 L4 136/0 9.69 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/26 101.78 GB 0.0 7.5 2.0 5.5 13.2 7.7 0.7 2.3 164.6 287.9 46.86 43.99 105 0.446 7832K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.5 2.0 5.5 13.2 7.7 0.6 2.3 164.6 287.9 46.86 43.99 105 0.446 7832K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.5 2.0 5.5 7.5 2.0 0.0 0.0 251.4 250.8 30.69 29.51 23 1.334 7832K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 358.4 16.17 14.48 82 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.5 total, 24.4 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.18 GB write, 550.02 MB/s write, 7.53 GB read, 314.45 MB/s read, 46.9 seconds Interval compaction: 13.18 GB write, 553.71 MB/s write, 7.53 GB read, 316.56 MB/s read, 46.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 15, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2250523 Average: 2.3510 StdDev: 13.06 Min: 0 Median: 1.4498 Max: 3553 Percentiles: P50: 1.45 P75: 1.83 P99: 5.68 P99.9: 101.76 P99.99: 204.63 ------------------------------------------------------ [ 0, 1 ] 452065 20.087% 20.087% #### ( 1, 2 ] 1496550 66.498% 86.585% ############# ( 2, 3 ] 186102 8.269% 94.854% ## ( 3, 4 ] 64981 2.887% 97.742% # ( 4, 6 ] 33752 1.500% 99.241% ( 6, 10 ] 11841 0.526% 99.768% ( 10, 15 ] 1479 0.066% 99.833% ( 15, 22 ] 189 0.008% 99.842% ( 22, 34 ] 27 0.001% 99.843% ( 34, 51 ] 6 0.000% 99.843% ( 51, 76 ] 40 0.002% 99.845% ( 76, 110 ] 1637 0.073% 99.918% ( 110, 170 ] 1477 0.066% 99.983% ( 170, 250 ] 351 0.016% 99.999% ( 250, 380 ] 223 0.010% 100.009% ( 380, 580 ] 178 0.008% 100.017% ( 580, 870 ] 75 0.003% 100.020% ( 870, 1300 ] 33 0.001% 100.021% ( 1300, 1900 ] 6 0.000% 100.022% ( 1900, 2900 ] 13 0.001% 100.022% ( 2900, 4400 ] 11 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 303618 Average: 2.6146 StdDev: 14.51 Min: 1 Median: 1.5058 Max: 3625 Percentiles: P50: 1.51 P75: 1.88 P99: 8.12 P99.9: 132.44 P99.99: 472.43 ------------------------------------------------------ [ 0, 1 ] 49225 16.213% 16.213% ### ( 1, 2 ] 202819 66.801% 83.014% ############# ( 2, 3 ] 30383 10.007% 93.021% ## ( 3, 4 ] 9772 3.219% 96.239% # ( 4, 6 ] 6328 2.084% 98.323% ( 6, 10 ] 3879 1.278% 99.601% ( 10, 15 ] 371 0.122% 99.723% ( 15, 22 ] 49 0.016% 99.739% ( 22, 34 ] 7 0.002% 99.741% ( 34, 51 ] 38 0.013% 99.754% ( 51, 76 ] 24 0.008% 99.762% ( 76, 110 ] 333 0.110% 99.872% ( 110, 170 ] 231 0.076% 99.948% ( 170, 250 ] 65 0.021% 99.969% ( 250, 380 ] 47 0.015% 99.985% ( 380, 580 ] 36 0.012% 99.996% ( 580, 870 ] 12 0.004% 100.000% ( 870, 1300 ] 9 0.003% 100.003% ( 1300, 1900 ] 5 0.002% 100.005% ( 2900, 4400 ] 1 0.000% 100.005% ** Level 2 read latency histogram (micros): Count: 75907 Average: 2.0422 StdDev: 3.99 Min: 0 Median: 1.4089 Max: 829 Percentiles: P50: 1.41 P75: 1.82 P99: 5.65 P99.9: 10.77 P99.99: 176.55 ------------------------------------------------------ [ 0, 1 ] 18930 24.938% 24.938% ##### ( 1, 2 ] 46527 61.295% 86.233% ############ ( 2, 3 ] 5756 7.583% 93.816% ## ( 3, 4 ] 2554 3.365% 97.181% # ( 4, 6 ] 1670 2.200% 99.381% ( 6, 10 ] 385 0.507% 99.888% ( 10, 15 ] 59 0.078% 99.966% ( 15, 22 ] 10 0.013% 99.979% ( 22, 34 ] 3 0.004% 99.983% ( 34, 51 ] 1 0.001% 99.984% ( 51, 76 ] 2 0.003% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 5 0.007% 99.996% ( 250, 380 ] 2 0.003% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47953 Average: 3.6100 StdDev: 51.00 Min: 0 Median: 1.5997 Max: 4878 Percentiles: P50: 1.60 P75: 1.98 P99: 6.67 P99.9: 158.56 P99.99: 2425.59 ------------------------------------------------------ [ 0, 1 ] 5155 10.750% 10.750% ## ( 1, 2 ] 31384 65.447% 76.198% ############# ( 2, 3 ] 6748 14.072% 90.270% ### ( 3, 4 ] 2454 5.118% 95.387% # ( 4, 6 ] 1677 3.497% 98.884% # ( 6, 10 ] 333 0.694% 99.579% ( 10, 15 ] 99 0.206% 99.785% ( 15, 22 ] 23 0.048% 99.833% ( 22, 34 ] 26 0.054% 99.887% ( 34, 51 ] 2 0.004% 99.892% ( 110, 170 ] 5 0.010% 99.902% ( 170, 250 ] 4 0.008% 99.910% ( 250, 380 ] 3 0.006% 99.917% ( 380, 580 ] 6 0.013% 99.929% ( 580, 870 ] 13 0.027% 99.956% ( 870, 1300 ] 9 0.019% 99.975% ( 1300, 1900 ] 3 0.006% 99.981% ( 1900, 2900 ] 8 0.017% 99.998% ( 2900, 4400 ] 2 0.004% 100.002% ( 4400, 6600 ] 1 0.002% 100.004% ** Level 4 read latency histogram (micros): Count: 35 Average: 1667.7714 StdDev: 1428.50 Min: 178 Median: 1120.8333 Max: 6432 Percentiles: P50: 1120.83 P75: 2212.50 P99: 6215.00 P99.9: 6432.00 P99.99: 6432.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 10 28.571% 40.000% ###### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 5 14.286% 71.429% ### ( 1900, 2900 ] 4 11.429% 82.857% ## ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 24.5 total, 9.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 240.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.689 H:M:S, 35.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 107.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.310 H:M:S, 68.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/16-01:02:01 ... thread 0: (1000000,7000000) ops and (153338.0,226619.6) ops/second in (6.521542,30.888770) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.70 GB 50.4 5.7 0.0 5.7 12.4 6.6 0.0 1.9 140.6 303.6 41.66 38.67 114 0.365 5947K 11K 0.0 0.0 L1 15/15 1.82 GB 0.0 4.7 3.7 1.0 4.7 3.6 0.2 1.3 228.9 226.1 21.17 20.18 3 7.058 4921K 57K 0.0 0.0 L2 1/1 49.61 MB 0.0 0.3 0.2 0.2 0.3 0.2 1.9 1.8 252.5 252.4 1.38 1.32 2 0.690 354K 181 0.0 0.0 L3 24/8 1.58 GB 1.0 1.3 1.0 0.4 1.3 1.0 1.0 1.4 201.0 200.7 6.86 6.07 7 0.981 1362K 799 0.0 0.0 L4 166/0 9.58 GB 1.0 0.6 0.6 0.1 0.6 0.6 0.4 1.1 171.0 170.5 3.78 2.96 7 0.539 635K 1741 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1276/34 102.65 GB 0.0 12.8 5.4 7.3 19.3 12.0 4.5 2.9 174.7 264.6 74.86 69.19 133 0.563 13M 71K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.8 5.4 7.3 19.3 12.0 4.4 2.9 174.7 264.6 74.86 69.19 133 0.563 13M 71K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.8 5.4 7.3 12.7 5.4 0.0 0.0 235.8 234.5 55.46 52.20 37 1.499 13M 71K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 350.8 19.39 16.99 96 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.1 total, 30.9 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.34 GB write, 637.88 MB/s write, 12.77 GB read, 421.15 MB/s read, 74.9 seconds Interval compaction: 19.34 GB write, 641.26 MB/s write, 12.77 GB read, 423.38 MB/s read, 74.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 24, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2709738 Average: 2.4502 StdDev: 14.78 Min: 0 Median: 1.4764 Max: 3832 Percentiles: P50: 1.48 P75: 1.86 P99: 5.95 P99.9: 102.91 P99.99: 226.94 ------------------------------------------------------ [ 0, 1 ] 515599 19.028% 19.028% #### ( 1, 2 ] 1761657 65.012% 84.040% ############# ( 2, 3 ] 254819 9.404% 93.444% ## ( 3, 4 ] 91745 3.386% 96.829% # ( 4, 6 ] 60226 2.223% 99.052% ( 6, 10 ] 18569 0.685% 99.737% ( 10, 15 ] 2545 0.094% 99.831% ( 15, 22 ] 309 0.011% 99.842% ( 22, 34 ] 39 0.001% 99.844% ( 34, 51 ] 15 0.001% 99.844% ( 51, 76 ] 69 0.003% 99.847% ( 76, 110 ] 1815 0.067% 99.914% ( 110, 170 ] 1749 0.065% 99.979% ( 170, 250 ] 437 0.016% 99.995% ( 250, 380 ] 294 0.011% 100.005% ( 380, 580 ] 237 0.009% 100.014% ( 580, 870 ] 124 0.005% 100.019% ( 870, 1300 ] 62 0.002% 100.021% ( 1300, 1900 ] 16 0.001% 100.022% ( 1900, 2900 ] 19 0.001% 100.022% ( 2900, 4400 ] 16 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 526612 Average: 2.9267 StdDev: 22.15 Min: 0 Median: 1.5818 Max: 4089 Percentiles: P50: 1.58 P75: 1.99 P99: 8.47 P99.9: 115.25 P99.99: 409.07 ------------------------------------------------------ [ 0, 1 ] 75106 14.262% 14.262% ### ( 1, 2 ] 323457 61.422% 75.684% ############ ( 2, 3 ] 68858 13.076% 88.760% ### ( 3, 4 ] 27032 5.133% 93.893% # ( 4, 6 ] 22194 4.214% 98.108% # ( 6, 10 ] 7621 1.447% 99.555% ( 10, 15 ] 1101 0.209% 99.764% ( 15, 22 ] 171 0.032% 99.796% ( 22, 34 ] 17 0.003% 99.800% ( 34, 51 ] 39 0.007% 99.807% ( 51, 76 ] 57 0.011% 99.818% ( 76, 110 ] 407 0.077% 99.895% ( 110, 170 ] 290 0.055% 99.950% ( 170, 250 ] 99 0.019% 99.969% ( 250, 380 ] 99 0.019% 99.988% ( 380, 580 ] 78 0.015% 100.003% ( 580, 870 ] 49 0.009% 100.012% ( 870, 1300 ] 38 0.007% 100.019% ( 1300, 1900 ] 20 0.004% 100.023% ( 1900, 2900 ] 8 0.002% 100.024% ( 2900, 4400 ] 5 0.001% 100.025% ** Level 2 read latency histogram (micros): Count: 88141 Average: 2.6626 StdDev: 28.25 Min: 0 Median: 1.4429 Max: 3117 Percentiles: P50: 1.44 P75: 1.85 P99: 5.89 P99.9: 17.25 P99.99: 1562.30 ------------------------------------------------------ [ 0, 1 ] 19974 22.661% 22.661% ##### ( 1, 2 ] 54408 61.728% 84.390% ############ ( 2, 3 ] 7640 8.668% 93.058% ## ( 3, 4 ] 3246 3.683% 96.740% # ( 4, 6 ] 2105 2.388% 99.129% ( 6, 10 ] 591 0.671% 99.799% ( 10, 15 ] 86 0.098% 99.897% ( 15, 22 ] 12 0.014% 99.910% ( 22, 34 ] 3 0.003% 99.914% ( 34, 51 ] 1 0.001% 99.915% ( 51, 76 ] 2 0.002% 99.917% ( 110, 170 ] 7 0.008% 99.925% ( 170, 250 ] 11 0.012% 99.938% ( 250, 380 ] 12 0.014% 99.951% ( 380, 580 ] 12 0.014% 99.965% ( 580, 870 ] 15 0.017% 99.982% ( 870, 1300 ] 6 0.007% 99.989% ( 1300, 1900 ] 5 0.006% 99.994% ( 1900, 2900 ] 5 0.006% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 383434 Average: 5.0737 StdDev: 51.56 Min: 0 Median: 1.8233 Max: 5321 Percentiles: P50: 1.82 P75: 2.74 P99: 9.55 P99.9: 374.16 P99.99: 643.72 ------------------------------------------------------ [ 0, 1 ] 14785 3.856% 3.856% # ( 1, 2 ] 214918 56.051% 59.907% ########### ( 2, 3 ] 77713 20.268% 80.174% #### ( 3, 4 ] 34757 9.065% 89.239% ## ( 4, 6 ] 31152 8.124% 97.364% ## ( 6, 10 ] 7061 1.842% 99.205% ( 10, 15 ] 1387 0.362% 99.567% ( 15, 22 ] 177 0.046% 99.613% ( 22, 34 ] 37 0.010% 99.623% ( 34, 51 ] 6 0.002% 99.624% ( 51, 76 ] 7 0.002% 99.626% ( 76, 110 ] 132 0.034% 99.660% ( 110, 170 ] 311 0.081% 99.742% ( 170, 250 ] 322 0.084% 99.826% ( 250, 380 ] 299 0.078% 99.904% ( 380, 580 ] 282 0.074% 99.977% ( 580, 870 ] 226 0.059% 100.036% ( 870, 1300 ] 119 0.031% 100.067% ( 1300, 1900 ] 35 0.009% 100.076% ( 1900, 2900 ] 58 0.015% 100.091% ( 2900, 4400 ] 14 0.004% 100.095% ( 4400, 6600 ] 3 0.001% 100.096% ** Level 4 read latency histogram (micros): Count: 185 Average: 361.3189 StdDev: 899.82 Min: 1 Median: 2.9615 Max: 6432 Percentiles: P50: 2.96 P75: 224.29 P99: 4565.00 P99.9: 6396.50 P99.99: 6432.00 ------------------------------------------------------ [ 0, 1 ] 22 11.892% 11.892% ## ( 1, 2 ] 58 31.351% 43.243% ###### ( 2, 3 ] 13 7.027% 50.270% # ( 3, 4 ] 11 5.946% 56.216% # ( 4, 6 ] 5 2.703% 58.919% # ( 6, 10 ] 4 2.162% 61.081% ( 10, 15 ] 6 3.243% 64.324% # ( 15, 22 ] 3 1.622% 65.946% ( 22, 34 ] 9 4.865% 70.811% # ( 110, 170 ] 3 1.622% 72.432% ( 170, 250 ] 7 3.784% 76.216% # ( 250, 380 ] 3 1.622% 77.838% ( 380, 580 ] 7 3.784% 81.622% # ( 580, 870 ] 12 6.486% 88.108% # ( 870, 1300 ] 6 3.243% 91.351% # ( 1300, 1900 ] 6 3.243% 94.595% # ( 1900, 2900 ] 4 2.162% 96.757% ( 2900, 4400 ] 4 2.162% 98.919% ( 4400, 6600 ] 2 1.081% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 1102.9667 StdDev: 1263.37 Min: 84 Median: 580.0000 Max: 5920 Percentiles: P50: 580.00 P75: 1900.00 P99: 5920.00 P99.9: 5920.00 P99.99: 5920.00 ------------------------------------------------------ ( 76, 110 ] 5 8.333% 8.333% ## ( 110, 170 ] 5 8.333% 16.667% ## ( 170, 250 ] 4 6.667% 23.333% # ( 250, 380 ] 10 16.667% 40.000% ### ( 380, 580 ] 6 10.000% 50.000% ## ( 580, 870 ] 7 11.667% 61.667% ## ( 870, 1300 ] 6 10.000% 71.667% ## ( 1300, 1900 ] 2 3.333% 75.000% # ( 1900, 2900 ] 8 13.333% 88.333% ### ( 2900, 4400 ] 5 8.333% 96.667% ## ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 31.1 total, 6.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 221.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.294 H:M:S, 39.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 150.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.606 H:M:S, 55.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/16-01:02:04 ... thread 0: (1000000,8000000) ops and (329613.6,235830.8) ops/second in (3.033855,33.922625) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 3.68 GB 151.0 6.8 0.0 6.8 14.3 7.6 0.0 1.9 143.0 302.7 48.45 45.07 131 0.370 7035K 12K 0.0 0.0 L1 15/15 1.82 GB 0.0 4.7 3.7 1.0 4.7 3.6 0.2 1.3 228.9 226.1 21.17 20.18 3 7.058 4921K 57K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 1.9 1.8 252.5 252.4 1.38 1.32 2 0.690 354K 181 0.0 0.0 L3 16/0 991.67 MB 1.0 2.0 1.0 1.0 2.0 1.0 1.0 1.9 204.2 203.9 10.09 8.73 8 1.261 2052K 2046 0.0 0.0 L4 169/0 9.62 GB 1.0 0.6 0.6 0.1 0.6 0.6 1.1 1.1 171.0 170.5 3.78 2.96 7 0.539 635K 1741 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1280/25 103.63 GB 0.0 14.5 5.5 9.0 22.0 13.0 5.8 2.9 174.7 265.1 84.87 78.26 151 0.562 14M 74K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.5 5.5 9.0 22.0 13.0 5.7 2.9 174.7 265.1 84.87 78.26 151 0.562 14M 74K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.5 5.5 9.0 14.4 5.4 0.0 0.0 236.1 234.9 62.80 58.90 42 1.495 14M 74K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 351.2 22.07 19.36 109 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.1 total, 33.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.97 GB write, 660.11 MB/s write, 14.48 GB read, 435.02 MB/s read, 84.9 seconds Interval compaction: 21.97 GB write, 663.29 MB/s write, 14.48 GB read, 437.12 MB/s read, 84.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 29, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3036081 Average: 2.4394 StdDev: 14.42 Min: 0 Median: 1.4858 Max: 3832 Percentiles: P50: 1.49 P75: 1.87 P99: 5.94 P99.9: 95.50 P99.99: 198.03 ------------------------------------------------------ [ 0, 1 ] 555770 18.306% 18.306% #### ( 1, 2 ] 1980977 65.248% 83.553% ############# ( 2, 3 ] 297121 9.786% 93.340% ## ( 3, 4 ] 104763 3.451% 96.790% # ( 4, 6 ] 68998 2.273% 99.063% ( 6, 10 ] 21034 0.693% 99.756% ( 10, 15 ] 2852 0.094% 99.850% ( 15, 22 ] 335 0.011% 99.861% ( 22, 34 ] 42 0.001% 99.862% ( 34, 51 ] 17 0.001% 99.863% ( 51, 76 ] 70 0.002% 99.865% ( 76, 110 ] 1859 0.061% 99.926% ( 110, 170 ] 1781 0.059% 99.985% ( 170, 250 ] 452 0.015% 100.000% ( 250, 380 ] 306 0.010% 100.010% ( 380, 580 ] 247 0.008% 100.018% ( 580, 870 ] 130 0.004% 100.022% ( 870, 1300 ] 69 0.002% 100.024% ( 1300, 1900 ] 16 0.001% 100.025% ( 1900, 2900 ] 20 0.001% 100.026% ( 2900, 4400 ] 18 0.001% 100.026% ** Level 1 read latency histogram (micros): Count: 602538 Average: 2.8823 StdDev: 21.03 Min: 0 Median: 1.5713 Max: 4089 Percentiles: P50: 1.57 P75: 1.97 P99: 8.44 P99.9: 123.40 P99.99: 414.29 ------------------------------------------------------ [ 0, 1 ] 86833 14.411% 14.411% ### ( 1, 2 ] 375363 62.297% 76.708% ############ ( 2, 3 ] 76287 12.661% 89.369% ### ( 3, 4 ] 29127 4.834% 94.203% # ( 4, 6 ] 23522 3.904% 98.107% # ( 6, 10 ] 8805 1.461% 99.568% ( 10, 15 ] 1155 0.192% 99.760% ( 15, 22 ] 176 0.029% 99.789% ( 22, 34 ] 17 0.003% 99.792% ( 34, 51 ] 40 0.007% 99.799% ( 51, 76 ] 59 0.010% 99.808% ( 76, 110 ] 465 0.077% 99.886% ( 110, 170 ] 387 0.064% 99.950% ( 170, 250 ] 113 0.019% 99.969% ( 250, 380 ] 114 0.019% 99.988% ( 380, 580 ] 86 0.014% 100.002% ( 580, 870 ] 51 0.008% 100.010% ( 870, 1300 ] 39 0.006% 100.017% ( 1300, 1900 ] 20 0.003% 100.020% ( 1900, 2900 ] 8 0.001% 100.021% ( 2900, 4400 ] 5 0.001% 100.022% ** Level 2 read latency histogram (micros): Count: 88506 Average: 2.6617 StdDev: 28.19 Min: 0 Median: 1.4438 Max: 3117 Percentiles: P50: 1.44 P75: 1.85 P99: 5.90 P99.9: 17.04 P99.99: 1557.93 ------------------------------------------------------ [ 0, 1 ] 19995 22.592% 22.592% ##### ( 1, 2 ] 54663 61.762% 84.354% ############ ( 2, 3 ] 7684 8.682% 93.036% ## ( 3, 4 ] 3268 3.692% 96.728% # ( 4, 6 ] 2120 2.395% 99.123% ( 6, 10 ] 598 0.676% 99.799% ( 10, 15 ] 86 0.097% 99.896% ( 15, 22 ] 12 0.014% 99.910% ( 22, 34 ] 3 0.003% 99.913% ( 34, 51 ] 1 0.001% 99.914% ( 51, 76 ] 2 0.002% 99.916% ( 110, 170 ] 7 0.008% 99.924% ( 170, 250 ] 11 0.012% 99.937% ( 250, 380 ] 12 0.014% 99.950% ( 380, 580 ] 12 0.014% 99.964% ( 580, 870 ] 15 0.017% 99.981% ( 870, 1300 ] 6 0.007% 99.988% ( 1300, 1900 ] 5 0.006% 99.993% ( 1900, 2900 ] 5 0.006% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 383489 Average: 5.0927 StdDev: 51.64 Min: 0 Median: 1.8233 Max: 5321 Percentiles: P50: 1.82 P75: 2.74 P99: 9.57 P99.9: 377.22 P99.99: 645.99 ------------------------------------------------------ [ 0, 1 ] 14799 3.859% 3.859% # ( 1, 2 ] 214930 56.046% 59.905% ########### ( 2, 3 ] 77718 20.266% 80.171% #### ( 3, 4 ] 34759 9.064% 89.235% ## ( 4, 6 ] 31152 8.123% 97.358% ## ( 6, 10 ] 7061 1.841% 99.199% ( 10, 15 ] 1387 0.362% 99.561% ( 15, 22 ] 177 0.046% 99.607% ( 22, 34 ] 37 0.010% 99.617% ( 34, 51 ] 6 0.002% 99.619% ( 51, 76 ] 7 0.002% 99.620% ( 76, 110 ] 132 0.034% 99.655% ( 110, 170 ] 312 0.081% 99.736% ( 170, 250 ] 332 0.087% 99.823% ( 250, 380 ] 303 0.079% 99.902% ( 380, 580 ] 287 0.075% 99.977% ( 580, 870 ] 227 0.059% 100.036% ( 870, 1300 ] 120 0.031% 100.067% ( 1300, 1900 ] 35 0.009% 100.076% ( 1900, 2900 ] 58 0.015% 100.091% ( 2900, 4400 ] 14 0.004% 100.095% ( 4400, 6600 ] 3 0.001% 100.096% ** Level 4 read latency histogram (micros): Count: 185 Average: 361.3189 StdDev: 899.82 Min: 1 Median: 2.9615 Max: 6432 Percentiles: P50: 2.96 P75: 224.29 P99: 4565.00 P99.9: 6396.50 P99.99: 6432.00 ------------------------------------------------------ [ 0, 1 ] 22 11.892% 11.892% ## ( 1, 2 ] 58 31.351% 43.243% ###### ( 2, 3 ] 13 7.027% 50.270% # ( 3, 4 ] 11 5.946% 56.216% # ( 4, 6 ] 5 2.703% 58.919% # ( 6, 10 ] 4 2.162% 61.081% ( 10, 15 ] 6 3.243% 64.324% # ( 15, 22 ] 3 1.622% 65.946% ( 22, 34 ] 9 4.865% 70.811% # ( 110, 170 ] 3 1.622% 72.432% ( 170, 250 ] 7 3.784% 76.216% # ( 250, 380 ] 3 1.622% 77.838% ( 380, 580 ] 7 3.784% 81.622% # ( 580, 870 ] 12 6.486% 88.108% # ( 870, 1300 ] 6 3.243% 91.351% # ( 1300, 1900 ] 6 3.243% 94.595% # ( 1900, 2900 ] 4 2.162% 96.757% ( 2900, 4400 ] 4 2.162% 98.919% ( 4400, 6600 ] 2 1.081% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 989.7100 StdDev: 1180.73 Min: 84 Median: 480.0000 Max: 5920 Percentiles: P50: 480.00 P75: 1500.00 P99: 5500.00 P99.9: 5920.00 P99.99: 5920.00 ------------------------------------------------------ ( 76, 110 ] 12 12.000% 12.000% ## ( 110, 170 ] 13 13.000% 25.000% ### ( 170, 250 ] 9 9.000% 34.000% ## ( 250, 380 ] 11 11.000% 45.000% ## ( 380, 580 ] 10 10.000% 55.000% ## ( 580, 870 ] 10 10.000% 65.000% ## ( 870, 1300 ] 8 8.000% 73.000% ## ( 1300, 1900 ] 6 6.000% 79.000% # ( 1900, 2900 ] 11 11.000% 90.000% ## ( 2900, 4400 ] 8 8.000% 98.000% ## ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 34.1 total, 3.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 230.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.742 H:M:S, 37.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.447 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/16-01:02:19 ... thread 0: (1000000,9000000) ops and (64623.1,182197.4) ops/second in (15.474335,49.396960) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 2.69 GB 18.9 8.9 0.0 8.9 17.4 8.5 0.0 2.0 150.1 292.6 60.83 56.09 147 0.414 9272K 23K 0.0 0.0 L1 15/15 1.81 GB 0.0 8.4 5.6 2.9 8.3 5.5 0.2 1.5 225.4 222.6 38.39 36.11 4 9.597 7942K 57K 0.0 0.0 L2 1/0 72.53 MB 0.7 0.3 0.2 0.2 0.3 0.2 3.7 1.8 252.5 252.4 1.38 1.32 2 0.690 354K 181 0.0 0.0 L3 19/0 914.78 MB 0.9 3.4 1.6 1.8 3.4 1.6 2.2 2.1 171.4 170.5 20.17 15.19 16 1.261 3472K 18K 0.0 0.0 L4 164/0 9.50 GB 1.0 2.8 2.4 0.4 2.8 2.4 1.1 1.2 149.2 148.6 19.41 13.23 26 0.746 2920K 11K 0.0 0.0 L5 1088/0 89.51 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/23 104.47 GB 0.0 23.9 9.8 14.1 32.2 18.1 10.8 3.8 174.7 235.5 140.18 121.94 195 0.719 23M 111K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.9 9.8 14.1 32.2 18.1 10.8 3.8 174.7 235.5 140.18 121.94 195 0.719 23M 111K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.9 9.8 14.1 23.8 9.6 0.0 0.0 212.8 211.4 115.05 100.16 73 1.576 23M 111K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 345.9 25.13 21.78 122 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.6 total, 49.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.24 GB write, 666.21 MB/s write, 23.91 GB read, 494.05 MB/s read, 140.2 seconds Interval compaction: 32.24 GB write, 668.42 MB/s write, 23.91 GB read, 495.68 MB/s read, 140.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 29, pending-compaction-bytes-stops: 0, total-delays: 43, total-stops: 37, interval: 80 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4053145 Average: 2.8334 StdDev: 24.10 Min: 0 Median: 1.5053 Max: 8377 Percentiles: P50: 1.51 P75: 1.89 P99: 7.37 P99.9: 147.75 P99.99: 357.45 ------------------------------------------------------ [ 0, 1 ] 698576 17.235% 17.235% ### ( 1, 2 ] 2628321 64.846% 82.082% ############# ( 2, 3 ] 420284 10.369% 92.451% ## ( 3, 4 ] 149536 3.689% 96.141% # ( 4, 6 ] 104077 2.568% 98.708% # ( 6, 10 ] 34553 0.852% 99.561% ( 10, 15 ] 4940 0.122% 99.683% ( 15, 22 ] 626 0.015% 99.698% ( 22, 34 ] 60 0.001% 99.700% ( 34, 51 ] 25 0.001% 99.700% ( 51, 76 ] 108 0.003% 99.703% ( 76, 110 ] 4862 0.120% 99.823% ( 110, 170 ] 4968 0.123% 99.945% ( 170, 250 ] 1142 0.028% 99.974% ( 250, 380 ] 803 0.020% 99.993% ( 380, 580 ] 614 0.015% 100.009% ( 580, 870 ] 298 0.007% 100.016% ( 870, 1300 ] 128 0.003% 100.019% ( 1300, 1900 ] 52 0.001% 100.020% ( 1900, 2900 ] 60 0.001% 100.022% ( 2900, 4400 ] 76 0.002% 100.024% ( 4400, 6600 ] 6 0.000% 100.024% ( 6600, 9900 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1537375 Average: 4.6820 StdDev: 69.97 Min: 0 Median: 1.6648 Max: 10630 Percentiles: P50: 1.66 P75: 2.36 P99: 9.27 P99.9: 153.93 P99.99: 434.22 ------------------------------------------------------ [ 0, 1 ] 173677 11.297% 11.297% ## ( 1, 2 ] 895087 58.222% 69.519% ############ ( 2, 3 ] 230962 15.023% 84.542% ### ( 3, 4 ] 101174 6.581% 91.123% # ( 4, 6 ] 95866 6.236% 97.359% # ( 6, 10 ] 30904 2.010% 99.369% ( 10, 15 ] 5275 0.343% 99.712% ( 15, 22 ] 680 0.044% 99.756% ( 22, 34 ] 49 0.003% 99.759% ( 34, 51 ] 55 0.004% 99.763% ( 51, 76 ] 126 0.008% 99.771% ( 76, 110 ] 1159 0.075% 99.846% ( 110, 170 ] 1125 0.073% 99.920% ( 170, 250 ] 416 0.027% 99.947% ( 250, 380 ] 528 0.034% 99.981% ( 380, 580 ] 510 0.033% 100.014% ( 580, 870 ] 455 0.030% 100.044% ( 870, 1300 ] 294 0.019% 100.063% ( 1300, 1900 ] 167 0.011% 100.074% ( 1900, 2900 ] 164 0.011% 100.084% ( 2900, 4400 ] 248 0.016% 100.101% ( 4400, 6600 ] 67 0.004% 100.105% ( 6600, 9900 ] 9 0.001% 100.106% ( 9900, 14000 ] 1 0.000% 100.106% ** Level 2 read latency histogram (micros): Count: 88506 Average: 2.6617 StdDev: 28.19 Min: 0 Median: 1.4438 Max: 3117 Percentiles: P50: 1.44 P75: 1.85 P99: 5.90 P99.9: 17.04 P99.99: 1557.93 ------------------------------------------------------ [ 0, 1 ] 19995 22.592% 22.592% ##### ( 1, 2 ] 54663 61.762% 84.354% ############ ( 2, 3 ] 7684 8.682% 93.036% ## ( 3, 4 ] 3268 3.692% 96.728% # ( 4, 6 ] 2120 2.395% 99.123% ( 6, 10 ] 598 0.676% 99.799% ( 10, 15 ] 86 0.097% 99.896% ( 15, 22 ] 12 0.014% 99.910% ( 22, 34 ] 3 0.003% 99.913% ( 34, 51 ] 1 0.001% 99.914% ( 51, 76 ] 2 0.002% 99.916% ( 110, 170 ] 7 0.008% 99.924% ( 170, 250 ] 11 0.012% 99.937% ( 250, 380 ] 12 0.014% 99.950% ( 380, 580 ] 12 0.014% 99.964% ( 580, 870 ] 15 0.017% 99.981% ( 870, 1300 ] 6 0.007% 99.988% ( 1300, 1900 ] 5 0.006% 99.993% ( 1900, 2900 ] 5 0.006% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 742332 Average: 6.5771 StdDev: 79.45 Min: 0 Median: 1.9080 Max: 8012 Percentiles: P50: 1.91 P75: 2.93 P99: 9.57 P99.9: 463.94 P99.99: 711.20 ------------------------------------------------------ [ 0, 1 ] 19374 2.610% 2.610% # ( 1, 2 ] 387432 52.191% 54.801% ########## ( 2, 3 ] 162052 21.830% 76.631% #### ( 3, 4 ] 79604 10.724% 87.355% ## ( 4, 6 ] 74198 9.995% 97.350% ## ( 6, 10 ] 13738 1.851% 99.201% ( 10, 15 ] 2836 0.382% 99.583% ( 15, 22 ] 326 0.044% 99.627% ( 22, 34 ] 48 0.006% 99.633% ( 34, 51 ] 16 0.002% 99.635% ( 51, 76 ] 18 0.002% 99.638% ( 76, 110 ] 154 0.021% 99.658% ( 110, 170 ] 430 0.058% 99.716% ( 170, 250 ] 515 0.069% 99.786% ( 250, 380 ] 570 0.077% 99.862% ( 380, 580 ] 664 0.089% 99.952% ( 580, 870 ] 625 0.084% 100.036% ( 870, 1300 ] 397 0.053% 100.090% ( 1300, 1900 ] 167 0.022% 100.112% ( 1900, 2900 ] 143 0.019% 100.131% ( 2900, 4400 ] 134 0.018% 100.149% ( 4400, 6600 ] 26 0.004% 100.153% ( 6600, 9900 ] 2 0.000% 100.153% ** Level 4 read latency histogram (micros): Count: 25364 Average: 16.4556 StdDev: 190.75 Min: 0 Median: 2.0660 Max: 7775 Percentiles: P50: 2.07 P75: 3.19 P99: 199.75 P99.9: 3127.25 P99.99: 5002.21 ------------------------------------------------------ [ 0, 1 ] 328 1.293% 1.293% ( 1, 2 ] 11948 47.106% 48.399% ######### ( 2, 3 ] 6148 24.239% 72.638% ##### ( 3, 4 ] 3087 12.171% 84.809% ## ( 4, 6 ] 2859 11.272% 96.081% ## ( 6, 10 ] 482 1.900% 97.981% ( 10, 15 ] 176 0.694% 98.675% ( 15, 22 ] 20 0.079% 98.754% ( 22, 34 ] 19 0.075% 98.829% ( 76, 110 ] 9 0.035% 98.865% ( 110, 170 ] 18 0.071% 98.935% ( 170, 250 ] 44 0.173% 99.109% ( 250, 380 ] 34 0.134% 99.243% ( 380, 580 ] 44 0.173% 99.416% ( 580, 870 ] 52 0.205% 99.622% ( 870, 1300 ] 26 0.103% 99.724% ( 1300, 1900 ] 19 0.075% 99.799% ( 1900, 2900 ] 22 0.087% 99.886% ( 2900, 4400 ] 24 0.095% 99.980% ( 4400, 6600 ] 9 0.035% 100.016% ( 6600, 9900 ] 1 0.004% 100.020% ** Level 5 read latency histogram (micros): Count: 220 Average: 1220.5818 StdDev: 1368.82 Min: 76 Median: 662.8571 Max: 5920 Percentiles: P50: 662.86 P75: 1941.67 P99: 5920.00 P99.9: 5920.00 P99.99: 5920.00 ------------------------------------------------------ ( 51, 76 ] 1 0.455% 0.455% ( 76, 110 ] 21 9.545% 10.000% ## ( 110, 170 ] 25 11.364% 21.364% ## ( 170, 250 ] 12 5.455% 26.818% # ( 250, 380 ] 21 9.545% 36.364% ## ( 380, 580 ] 22 10.000% 46.364% ## ( 580, 870 ] 28 12.727% 59.091% ### ( 870, 1300 ] 24 10.909% 70.000% ## ( 1300, 1900 ] 10 4.545% 74.545% # ( 1900, 2900 ] 24 10.909% 85.455% ## ( 2900, 4400 ] 24 10.909% 96.364% ## ( 4400, 6600 ] 8 3.636% 100.000% # ** DB Stats ** Uptime(secs): 49.6 total, 15.5 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 178.72 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.039 H:M:S, 50.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 63.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.297 H:M:S, 79.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.173 micros/op 162008 ops/sec 60.114 seconds 9738999 operations; 157.0 MB/s Microseconds per write: Count: 9738999 Average: 6.1725 StdDev: 310.90 Min: 1 Median: 1.7252 Max: 383796 Percentiles: P50: 1.73 P75: 2.69 P99: 9.88 P99.9: 1164.87 P99.99: 2608.11 ------------------------------------------------------ [ 0, 1 ] 1418049 14.561% 14.561% ### ( 1, 2 ] 4759445 48.870% 63.430% ########## ( 2, 3 ] 1634490 16.783% 80.213% ### ( 3, 4 ] 1243022 12.763% 92.977% ### ( 4, 6 ] 451805 4.639% 97.616% # ( 6, 10 ] 139145 1.429% 99.045% ( 10, 15 ] 47027 0.483% 99.528% ( 15, 22 ] 9499 0.098% 99.625% ( 22, 34 ] 1885 0.019% 99.644% ( 34, 51 ] 235 0.002% 99.647% ( 51, 76 ] 18 0.000% 99.647% ( 76, 110 ] 7074 0.073% 99.720% ( 110, 170 ] 2297 0.024% 99.743% ( 170, 250 ] 287 0.003% 99.746% ( 250, 380 ] 205 0.002% 99.748% ( 380, 580 ] 20 0.000% 99.748% ( 580, 870 ] 19 0.000% 99.749% ( 870, 1300 ] 21492 0.221% 99.969% ( 1300, 1900 ] 73 0.001% 99.970% ( 1900, 2900 ] 2737 0.028% 99.998% ( 2900, 4400 ] 115 0.001% 99.999% ( 4400, 6600 ] 23 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 5 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 203454 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9738999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10050646968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 489 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33415657 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30384482390 rocksdb.compact.write.bytes COUNT : 30190127033 rocksdb.flush.write.bytes COUNT : 10040584197 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 55 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 218 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9959743488 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3979264 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30474711313 rocksdb.non.last.level.read.count COUNT : 7364130 rocksdb.block.checksum.compute.count COUNT : 7363207 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.360625 P95 : 3.899065 P99 : 8.628039 P100 : 383794.000000 COUNT : 9738999 SUM : 55506370 rocksdb.compaction.times.micros P50 : 1024333.333333 P95 : 5565000.000000 P99 : 17213912.000000 P100 : 17213912.000000 COUNT : 77 SUM : 119576191 rocksdb.compaction.times.cpu_micros P50 : 915000.000000 P95 : 5143333.333333 P99 : 15928799.000000 P100 : 15928799.000000 COUNT : 77 SUM : 104588227 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 662.297297 P95 : 1131.583333 P99 : 2560.000000 P100 : 5724.000000 COUNT : 134 SUM : 94427 rocksdb.compaction.outfile.sync.micros P50 : 899.318182 P95 : 36116.666667 P99 : 143924.000000 P100 : 143924.000000 COUNT : 329 SUM : 2595678 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 104.031915 P95 : 615.214286 P99 : 2185.000000 P100 : 3650.000000 COUNT : 243 SUM : 47835 rocksdb.table.open.io.micros P50 : 1414.432990 P95 : 7472.142857 P99 : 12307.285714 P100 : 14441.000000 COUNT : 489 SUM : 998545 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.608024 P95 : 7.454270 P99 : 11.400798 P100 : 11918.000000 COUNT : 7361749 SUM : 41596137 rocksdb.read.block.get.micros P50 : 437.391304 P95 : 3422.115385 P99 : 5220.285714 P100 : 6720.000000 COUNT : 978 SUM : 820383 rocksdb.write.raw.block.micros P50 : 0.511402 P95 : 0.971665 P99 : 2.693895 P100 : 9996.000000 COUNT : 9743416 SUM : 17685320 rocksdb.numfiles.in.singlecompaction P50 : 3.223881 P95 : 6.900000 P99 : 19.153333 P100 : 22.000000 COUNT : 122 SUM : 471 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559345 P95 : 1127.176345 P99 : 2107.704138 P100 : 383591.000000 COUNT : 231476 SUM : 33439324 rocksdb.sst.read.micros P50 : 1.558684 P95 : 4.386421 P99 : 8.507751 P100 : 10630.000000 COUNT : 7364237 SUM : 26517747 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9738999 SUM : 10050646968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 208651.685393 P95 : 359352.941176 P99 : 506350.000000 P100 : 525192.000000 COUNT : 134 SUM : 27633468 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 310 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0