[2024-11-18 01:56:53.436768] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-11-18 01:56:53.436912] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid706144 ] Set seed to 1731891413433229 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 01:56:53.526602] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 01:56:53.563601] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 01:56:53.563646] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 706144' to capture a snapshot of events at runtime. [2024-11-18 01:56:53.563664] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid706144 for offline analysis/debug. [2024-11-18 01:56:53.563687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 01:56:57 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-01:57:06 ... thread 0: (1000000,1000000) ops and (110403.3,110403.3) ops/second in (9.057701,9.057701) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 1.74 GB 44.0 0.4 0.0 0.4 1.2 0.8 0.0 1.5 37.2 117.7 10.16 4.05 10 1.016 383K 533 0.0 0.0 L1 7/7 714.79 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 28/8 2.06 GB 1.2 2.0 1.4 0.6 2.0 1.4 0.2 1.4 100.3 99.1 20.80 9.58 7 2.972 942K 0 0.0 0.0 L4 202/26 12.64 GB 1.2 5.1 3.1 2.0 5.0 3.0 0.0 1.6 106.8 105.1 49.17 24.81 31 1.586 2249K 4357 0.0 0.0 L5 1088/0 89.51 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1334/48 106.64 GB 0.0 7.5 4.5 3.0 8.2 5.2 0.2 10.3 96.3 105.1 80.13 38.44 48 1.669 3576K 4890 0.0 0.0 Int 0/0 0.00 KB 0.0 7.5 4.5 3.0 8.2 5.2 0.2 10.3 96.3 105.1 80.13 38.44 48 1.669 3576K 4890 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.5 4.5 3.0 7.4 4.4 0.0 0.0 105.8 104.2 72.97 35.98 39 1.871 3576K 4890 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 114.5 7.15 2.46 9 0.795 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.1 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.23 GB write, 911.54 MB/s write, 7.54 GB read, 835.10 MB/s read, 80.1 seconds Interval compaction: 8.23 GB write, 929.78 MB/s write, 7.54 GB read, 851.81 MB/s read, 80.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 23, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 350509 Average: 15.7084 StdDev: 205.71 Min: 1 Median: 1.8811 Max: 25064 Percentiles: P50: 1.88 P75: 2.99 P99: 14.07 P99.9: 3304.75 P99.99: 5289.98 ------------------------------------------------------ [ 0, 1 ] 18695 5.334% 5.334% # ( 1, 2 ] 177686 50.694% 56.027% ########## ( 2, 3 ] 66940 19.098% 75.125% #### ( 3, 4 ] 34509 9.845% 84.971% ## ( 4, 6 ] 38078 10.864% 95.834% ## ( 6, 10 ] 9263 2.643% 98.477% # ( 10, 15 ] 2255 0.643% 99.120% ( 15, 22 ] 316 0.090% 99.211% ( 22, 34 ] 29 0.008% 99.219% ( 34, 51 ] 21 0.006% 99.225% ( 51, 76 ] 40 0.011% 99.236% ( 76, 110 ] 16 0.005% 99.241% ( 110, 170 ] 35 0.010% 99.251% ( 170, 250 ] 70 0.020% 99.271% ( 250, 380 ] 149 0.043% 99.313% ( 380, 580 ] 312 0.089% 99.402% ( 580, 870 ] 539 0.154% 99.556% ( 870, 1300 ] 526 0.150% 99.706% ( 1300, 1900 ] 329 0.094% 99.800% ( 1900, 2900 ] 253 0.072% 99.872% ( 2900, 4400 ] 365 0.104% 99.976% ( 4400, 6600 ] 121 0.035% 100.011% ( 6600, 9900 ] 22 0.006% 100.017% ( 9900, 14000 ] 1 0.000% 100.017% ( 22000, 33000 ] 4 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 18478 Average: 28.7571 StdDev: 290.70 Min: 1 Median: 1.9685 Max: 7934 Percentiles: P50: 1.97 P75: 3.08 P99: 721.10 P99.9: 4985.20 P99.99: 7934.00 ------------------------------------------------------ [ 0, 1 ] 418 2.262% 2.262% ( 1, 2 ] 9108 49.291% 51.553% ########## ( 2, 3 ] 4182 22.632% 74.186% ##### ( 3, 4 ] 1776 9.611% 83.797% ## ( 4, 6 ] 2054 11.116% 94.913% ## ( 6, 10 ] 468 2.533% 97.446% # ( 10, 15 ] 167 0.904% 98.349% ( 15, 22 ] 18 0.097% 98.447% ( 22, 34 ] 2 0.011% 98.458% ( 34, 51 ] 6 0.032% 98.490% ( 51, 76 ] 6 0.032% 98.523% ( 76, 110 ] 1 0.005% 98.528% ( 110, 170 ] 1 0.005% 98.533% ( 170, 250 ] 11 0.060% 98.593% ( 250, 380 ] 16 0.087% 98.680% ( 380, 580 ] 31 0.168% 98.847% ( 580, 870 ] 58 0.314% 99.161% ( 870, 1300 ] 51 0.276% 99.437% ( 1300, 1900 ] 22 0.119% 99.556% ( 1900, 2900 ] 18 0.097% 99.654% ( 2900, 4400 ] 41 0.222% 99.876% ( 4400, 6600 ] 17 0.092% 99.968% ( 6600, 9900 ] 6 0.032% 100.000% ** Level 2 read latency histogram (micros): Count: 260327 Average: 12.7349 StdDev: 155.73 Min: 1 Median: 1.8920 Max: 8556 Percentiles: P50: 1.89 P75: 3.07 P99: 13.68 P99.9: 2156.17 P99.99: 3882.05 ------------------------------------------------------ [ 0, 1 ] 13435 5.161% 5.161% # ( 1, 2 ] 130865 50.269% 55.430% ########## ( 2, 3 ] 49140 18.876% 74.307% #### ( 3, 4 ] 26183 10.058% 84.364% ## ( 4, 6 ] 28931 11.113% 95.478% ## ( 6, 10 ] 7781 2.989% 98.467% # ( 10, 15 ] 1886 0.724% 99.191% ( 15, 22 ] 293 0.113% 99.304% ( 22, 34 ] 47 0.018% 99.322% ( 34, 51 ] 25 0.010% 99.331% ( 51, 76 ] 17 0.007% 99.338% ( 76, 110 ] 10 0.004% 99.342% ( 110, 170 ] 37 0.014% 99.356% ( 170, 250 ] 64 0.025% 99.380% ( 250, 380 ] 109 0.042% 99.422% ( 380, 580 ] 234 0.090% 99.512% ( 580, 870 ] 331 0.127% 99.639% ( 870, 1300 ] 374 0.144% 99.783% ( 1300, 1900 ] 256 0.098% 99.881% ( 1900, 2900 ] 190 0.073% 99.954% ( 2900, 4400 ] 142 0.055% 100.009% ( 4400, 6600 ] 60 0.023% 100.032% ( 6600, 9900 ] 11 0.004% 100.036% ** Level 3 read latency histogram (micros): Count: 865261 Average: 11.4835 StdDev: 185.09 Min: 1 Median: 1.9096 Max: 43223 Percentiles: P50: 1.91 P75: 3.05 P99: 10.75 P99.9: 1073.99 P99.99: 1736.59 ------------------------------------------------------ [ 0, 1 ] 33547 3.877% 3.877% # ( 1, 2 ] 438763 50.709% 54.586% ########## ( 2, 3 ] 172515 19.938% 74.524% #### ( 3, 4 ] 88218 10.196% 84.719% ## ( 4, 6 ] 99335 11.480% 96.200% ## ( 6, 10 ] 23404 2.705% 98.904% # ( 10, 15 ] 5473 0.633% 99.537% ( 15, 22 ] 672 0.078% 99.615% ( 22, 34 ] 60 0.007% 99.622% ( 34, 51 ] 61 0.007% 99.629% ( 51, 76 ] 101 0.012% 99.640% ( 76, 110 ] 40 0.005% 99.645% ( 110, 170 ] 73 0.008% 99.653% ( 170, 250 ] 130 0.015% 99.668% ( 250, 380 ] 305 0.035% 99.704% ( 380, 580 ] 554 0.064% 99.768% ( 580, 870 ] 788 0.091% 99.859% ( 870, 1300 ] 752 0.087% 99.946% ( 1300, 1900 ] 527 0.061% 100.007% ( 1900, 2900 ] 438 0.051% 100.057% ( 2900, 4400 ] 564 0.065% 100.122% ( 4400, 6600 ] 191 0.022% 100.144% ( 6600, 9900 ] 46 0.005% 100.150% ( 9900, 14000 ] 7 0.001% 100.151% ( 14000, 22000 ] 6 0.001% 100.151% ( 22000, 33000 ] 8 0.001% 100.152% ( 33000, 50000 ] 1 0.000% 100.152% ** Level 4 read latency histogram (micros): Count: 600114 Average: 21.0118 StdDev: 235.80 Min: 1 Median: 1.9147 Max: 28995 Percentiles: P50: 1.91 P75: 3.11 P99: 308.92 P99.9: 2486.14 P99.99: 3465.31 ------------------------------------------------------ [ 0, 1 ] 24700 4.116% 4.116% # ( 1, 2 ] 301028 50.162% 54.278% ########## ( 2, 3 ] 117299 19.546% 73.824% #### ( 3, 4 ] 62240 10.371% 84.195% ## ( 4, 6 ] 67582 11.262% 95.457% ## ( 6, 10 ] 16555 2.759% 98.215% # ( 10, 15 ] 3589 0.598% 98.813% ( 15, 22 ] 477 0.079% 98.893% ( 22, 34 ] 49 0.008% 98.901% ( 34, 51 ] 39 0.006% 98.908% ( 51, 76 ] 72 0.012% 98.920% ( 76, 110 ] 17 0.003% 98.922% ( 110, 170 ] 84 0.014% 98.936% ( 170, 250 ] 177 0.029% 98.966% ( 250, 380 ] 452 0.075% 99.041% ( 380, 580 ] 934 0.156% 99.197% ( 580, 870 ] 1409 0.235% 99.432% ( 870, 1300 ] 1488 0.248% 99.680% ( 1300, 1900 ] 946 0.158% 99.837% ( 1900, 2900 ] 643 0.107% 99.944% ( 2900, 4400 ] 727 0.121% 100.065% ( 4400, 6600 ] 271 0.045% 100.111% ( 6600, 9900 ] 45 0.007% 100.118% ( 9900, 14000 ] 5 0.001% 100.119% ( 14000, 22000 ] 5 0.001% 100.120% ( 22000, 33000 ] 5 0.001% 100.121% ** Level 5 read latency histogram (micros): Count: 16361 Average: 1606.9771 StdDev: 1708.98 Min: 85 Median: 1076.0192 Max: 55223 Percentiles: P50: 1076.02 P75: 2107.91 P99: 6479.82 P99.9: 14568.00 P99.99: 55223.00 ------------------------------------------------------ ( 76, 110 ] 16 0.098% 0.098% ( 110, 170 ] 122 0.746% 0.843% ( 170, 250 ] 350 2.139% 2.983% ( 250, 380 ] 982 6.002% 8.985% # ( 380, 580 ] 2031 12.414% 21.398% ## ( 580, 870 ] 3154 19.278% 40.676% #### ( 870, 1300 ] 3184 19.461% 60.137% #### ( 1300, 1900 ] 2086 12.750% 72.887% ### ( 1900, 2900 ] 1663 10.164% 83.051% ## ( 2900, 4400 ] 1872 11.442% 94.493% ## ( 4400, 6600 ] 780 4.767% 99.260% # ( 6600, 9900 ] 101 0.617% 99.878% ( 9900, 14000 ] 3 0.018% 99.896% ( 14000, 22000 ] 9 0.055% 99.951% ( 22000, 33000 ] 3 0.018% 99.969% ( 33000, 50000 ] 2 0.012% 99.982% ( 50000, 75000 ] 3 0.018% 100.000% ** DB Stats ** Uptime(secs): 9.2 total, 9.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 106.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.056 H:M:S, 54.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 108.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.056 H:M:S, 55.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/18-01:57:12 ... thread 0: (1000000,2000000) ops and (180720.2,137069.7) ops/second in (5.533417,14.591118) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/7 2.78 GB 163.6 1.5 0.0 1.5 3.4 1.8 0.0 1.8 72.8 160.1 21.62 12.42 30 0.721 1599K 1929 0.0 0.0 L1 7/7 714.79 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 913.53 MB 0.9 2.0 1.4 0.6 2.0 1.4 0.2 1.4 100.3 99.1 20.80 9.58 7 2.972 942K 0 0.0 0.0 L4 160/0 9.46 GB 1.0 7.6 4.3 3.4 7.5 4.1 0.0 1.8 102.3 100.7 76.20 39.90 42 1.814 3541K 9171 0.0 0.0 L5 1140/0 93.81 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1336/14 107.65 GB 0.0 11.2 5.7 5.5 12.9 7.4 4.5 7.0 96.6 111.2 118.62 61.90 79 1.502 6083K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.2 5.7 5.5 12.9 7.4 4.5 7.0 96.6 111.2 118.62 61.90 79 1.502 6083K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.2 5.7 5.5 11.0 5.5 0.0 0.0 107.9 106.5 106.16 56.18 54 1.966 6083K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 151.7 12.46 5.72 25 0.498 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.8 total, 14.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.89 GB write, 893.14 MB/s write, 11.19 GB read, 775.57 MB/s read, 118.6 seconds Interval compaction: 12.89 GB write, 904.24 MB/s write, 11.19 GB read, 785.20 MB/s read, 118.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 36, interval: 47 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 667738 Average: 15.1585 StdDev: 250.04 Min: 1 Median: 1.7197 Max: 48331 Percentiles: P50: 1.72 P75: 2.62 P99: 179.15 P99.9: 2476.66 P99.99: 4394.29 ------------------------------------------------------ [ 0, 1 ] 72127 10.802% 10.802% ## ( 1, 2 ] 363685 54.465% 65.267% ########### ( 2, 3 ] 104605 15.666% 80.932% ### ( 3, 4 ] 50398 7.548% 88.480% ## ( 4, 6 ] 51685 7.740% 96.220% ## ( 6, 10 ] 11917 1.785% 98.005% ( 10, 15 ] 2897 0.434% 98.439% ( 15, 22 ] 407 0.061% 98.500% ( 22, 34 ] 36 0.005% 98.505% ( 34, 51 ] 21 0.003% 98.508% ( 51, 76 ] 43 0.006% 98.515% ( 76, 110 ] 642 0.096% 98.611% ( 110, 170 ] 2416 0.362% 98.973% ( 170, 250 ] 1588 0.238% 99.211% ( 250, 380 ] 1080 0.162% 99.372% ( 380, 580 ] 1131 0.169% 99.542% ( 580, 870 ] 1007 0.151% 99.693% ( 870, 1300 ] 744 0.111% 99.804% ( 1300, 1900 ] 455 0.068% 99.872% ( 1900, 2900 ] 323 0.048% 99.920% ( 2900, 4400 ] 466 0.070% 99.990% ( 4400, 6600 ] 156 0.023% 100.014% ( 6600, 9900 ] 39 0.006% 100.019% ( 9900, 14000 ] 8 0.001% 100.021% ( 14000, 22000 ] 19 0.003% 100.024% ( 22000, 33000 ] 21 0.003% 100.027% ( 33000, 50000 ] 3 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 158846 Average: 10.9334 StdDev: 257.30 Min: 1 Median: 1.8824 Max: 34832 Percentiles: P50: 1.88 P75: 2.85 P99: 13.18 P99.9: 1812.60 P99.99: 12068.28 ------------------------------------------------------ [ 0, 1 ] 6499 4.091% 4.091% # ( 1, 2 ] 82643 52.027% 56.119% ########## ( 2, 3 ] 35136 22.120% 78.238% #### ( 3, 4 ] 13921 8.764% 87.002% ## ( 4, 6 ] 14096 8.874% 95.876% ## ( 6, 10 ] 4294 2.703% 98.579% # ( 10, 15 ] 1050 0.661% 99.240% ( 15, 22 ] 210 0.132% 99.372% ( 22, 34 ] 26 0.016% 99.389% ( 34, 51 ] 11 0.007% 99.396% ( 51, 76 ] 11 0.007% 99.403% ( 76, 110 ] 44 0.028% 99.430% ( 110, 170 ] 192 0.121% 99.551% ( 170, 250 ] 136 0.086% 99.637% ( 250, 380 ] 98 0.062% 99.698% ( 380, 580 ] 87 0.055% 99.753% ( 580, 870 ] 113 0.071% 99.824% ( 870, 1300 ] 80 0.050% 99.875% ( 1300, 1900 ] 47 0.030% 99.904% ( 1900, 2900 ] 30 0.019% 99.923% ( 2900, 4400 ] 61 0.038% 99.962% ( 4400, 6600 ] 21 0.013% 99.975% ( 6600, 9900 ] 22 0.014% 99.989% ( 9900, 14000 ] 4 0.003% 99.991% ( 14000, 22000 ] 6 0.004% 99.995% ( 22000, 33000 ] 7 0.004% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 293054 Average: 11.8937 StdDev: 148.49 Min: 1 Median: 1.8660 Max: 8556 Percentiles: P50: 1.87 P75: 2.97 P99: 13.21 P99.9: 2028.59 P99.99: 3872.89 ------------------------------------------------------ [ 0, 1 ] 15448 5.271% 5.271% # ( 1, 2 ] 151366 51.651% 56.923% ########## ( 2, 3 ] 54356 18.548% 75.471% #### ( 3, 4 ] 28258 9.643% 85.113% ## ( 4, 6 ] 30956 10.563% 95.677% ## ( 6, 10 ] 8449 2.883% 98.560% # ( 10, 15 ] 2008 0.685% 99.245% ( 15, 22 ] 307 0.105% 99.350% ( 22, 34 ] 48 0.016% 99.366% ( 34, 51 ] 25 0.009% 99.375% ( 51, 76 ] 19 0.006% 99.381% ( 76, 110 ] 10 0.003% 99.384% ( 110, 170 ] 41 0.014% 99.398% ( 170, 250 ] 71 0.024% 99.423% ( 250, 380 ] 117 0.040% 99.463% ( 380, 580 ] 247 0.084% 99.547% ( 580, 870 ] 354 0.121% 99.668% ( 870, 1300 ] 395 0.135% 99.802% ( 1300, 1900 ] 261 0.089% 99.891% ( 1900, 2900 ] 194 0.066% 99.958% ( 2900, 4400 ] 146 0.050% 100.008% ( 4400, 6600 ] 61 0.021% 100.028% ( 6600, 9900 ] 11 0.004% 100.032% ** Level 3 read latency histogram (micros): Count: 1044258 Average: 14.1792 StdDev: 297.87 Min: 1 Median: 1.9052 Max: 55624 Percentiles: P50: 1.91 P75: 3.04 P99: 11.04 P99.9: 1137.05 P99.99: 2008.97 ------------------------------------------------------ [ 0, 1 ] 41501 3.974% 3.974% # ( 1, 2 ] 530967 50.846% 54.821% ########## ( 2, 3 ] 206850 19.808% 74.629% #### ( 3, 4 ] 105996 10.150% 84.779% ## ( 4, 6 ] 119041 11.400% 96.179% ## ( 6, 10 ] 28070 2.688% 98.867% # ( 10, 15 ] 6662 0.638% 99.505% ( 15, 22 ] 791 0.076% 99.581% ( 22, 34 ] 77 0.007% 99.588% ( 34, 51 ] 67 0.006% 99.594% ( 51, 76 ] 133 0.013% 99.607% ( 76, 110 ] 99 0.009% 99.617% ( 110, 170 ] 274 0.026% 99.643% ( 170, 250 ] 231 0.022% 99.665% ( 250, 380 ] 392 0.038% 99.702% ( 380, 580 ] 664 0.064% 99.766% ( 580, 870 ] 887 0.085% 99.851% ( 870, 1300 ] 824 0.079% 99.930% ( 1300, 1900 ] 572 0.055% 99.985% ( 1900, 2900 ] 510 0.049% 100.034% ( 2900, 4400 ] 663 0.063% 100.097% ( 4400, 6600 ] 248 0.024% 100.121% ( 6600, 9900 ] 129 0.012% 100.133% ( 9900, 14000 ] 37 0.004% 100.137% ( 14000, 22000 ] 79 0.008% 100.144% ( 22000, 33000 ] 37 0.004% 100.148% ( 33000, 50000 ] 5 0.000% 100.148% ( 50000, 75000 ] 1 0.000% 100.148% ** Level 4 read latency histogram (micros): Count: 855721 Average: 21.4862 StdDev: 285.94 Min: 1 Median: 1.9030 Max: 40131 Percentiles: P50: 1.90 P75: 3.08 P99: 284.34 P99.9: 2248.71 P99.99: 3379.50 ------------------------------------------------------ [ 0, 1 ] 34998 4.090% 4.090% # ( 1, 2 ] 435056 50.841% 54.931% ########## ( 2, 3 ] 165287 19.316% 74.246% #### ( 3, 4 ] 85778 10.024% 84.270% ## ( 4, 6 ] 93162 10.887% 95.157% ## ( 6, 10 ] 22659 2.648% 97.805% # ( 10, 15 ] 5061 0.591% 98.397% ( 15, 22 ] 652 0.076% 98.473% ( 22, 34 ] 63 0.007% 98.480% ( 34, 51 ] 47 0.005% 98.486% ( 51, 76 ] 96 0.011% 98.497% ( 76, 110 ] 576 0.067% 98.564% ( 110, 170 ] 1986 0.232% 98.796% ( 170, 250 ] 1411 0.165% 98.961% ( 250, 380 ] 1256 0.147% 99.108% ( 380, 580 ] 1650 0.193% 99.301% ( 580, 870 ] 1919 0.224% 99.525% ( 870, 1300 ] 1821 0.213% 99.738% ( 1300, 1900 ] 1124 0.131% 99.869% ( 1900, 2900 ] 755 0.088% 99.957% ( 2900, 4400 ] 871 0.102% 100.059% ( 4400, 6600 ] 327 0.038% 100.097% ( 6600, 9900 ] 114 0.013% 100.111% ( 9900, 14000 ] 20 0.002% 100.113% ( 14000, 22000 ] 38 0.004% 100.118% ( 22000, 33000 ] 24 0.003% 100.120% ( 33000, 50000 ] 3 0.000% 100.121% ** Level 5 read latency histogram (micros): Count: 54811 Average: 772.0485 StdDev: 1615.09 Min: 75 Median: 303.1406 Max: 55223 Percentiles: P50: 303.14 P75: 788.61 P99: 5840.92 P99.9: 24246.20 P99.99: 46518.90 ------------------------------------------------------ ( 51, 76 ] 2 0.004% 0.004% ( 76, 110 ] 3536 6.451% 6.455% # ( 110, 170 ] 13073 23.851% 30.306% ##### ( 170, 250 ] 8451 15.418% 45.724% ### ( 250, 380 ] 5733 10.460% 56.184% ## ( 380, 580 ] 6341 11.569% 67.753% ## ( 580, 870 ] 5522 10.075% 77.827% ## ( 870, 1300 ] 4327 7.894% 85.722% ## ( 1300, 1900 ] 2558 4.667% 90.389% # ( 1900, 2900 ] 1948 3.554% 93.943% # ( 2900, 4400 ] 2206 4.025% 97.968% # ( 4400, 6600 ] 864 1.576% 99.544% ( 6600, 9900 ] 114 0.208% 99.752% ( 9900, 14000 ] 13 0.024% 99.776% ( 14000, 22000 ] 59 0.108% 99.883% ( 22000, 33000 ] 45 0.082% 99.965% ( 33000, 50000 ] 17 0.031% 99.996% ( 50000, 75000 ] 3 0.005% 100.002% ** DB Stats ** Uptime(secs): 14.8 total, 5.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 133.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.040 H:M:S, 47.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 177.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.984 H:M:S, 35.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-01:57:15 ... thread 0: (1000000,3000000) ops and (291387.9,166454.3) ops/second in (3.431851,18.022969) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.77 GB 258.0 2.5 0.0 2.5 5.3 2.8 0.0 1.9 89.9 190.6 28.73 19.00 50 0.575 2622K 2939 0.0 0.0 L1 18/0 1.63 GB 166.8 1.6 0.9 0.7 1.6 0.9 0.0 1.7 105.9 105.4 15.83 8.71 1 15.826 1701K 7770 0.0 0.0 L3 16/0 913.53 MB 0.9 2.0 1.4 0.6 2.0 1.4 0.2 1.4 100.3 99.1 20.80 9.58 7 2.972 942K 0 0.0 0.0 L4 160/0 9.46 GB 1.0 7.6 4.3 3.4 7.5 4.1 0.0 1.8 102.3 100.7 76.20 39.90 42 1.814 3541K 9171 0.0 0.0 L5 1140/0 93.81 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/4 108.56 GB 0.0 13.8 6.6 7.2 16.5 9.3 4.5 5.8 99.9 119.2 141.56 77.19 100 1.416 8809K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.8 6.6 7.2 16.5 9.3 4.5 5.8 99.9 119.2 141.56 77.19 100 1.416 8809K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.8 6.6 7.2 13.7 6.4 0.0 0.0 112.3 111.0 125.91 68.73 59 2.134 8809K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 185.2 15.65 8.46 41 0.382 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.2 total, 18.0 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.48 GB write, 927.07 MB/s write, 13.81 GB read, 776.78 MB/s read, 141.6 seconds Interval compaction: 16.48 GB write, 936.39 MB/s write, 13.81 GB read, 784.59 MB/s read, 141.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 36, interval: 47 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 929739 Average: 12.7559 StdDev: 213.03 Min: 0 Median: 1.6162 Max: 48331 Percentiles: P50: 1.62 P75: 2.29 P99: 173.76 P99.9: 1689.42 P99.99: 4019.49 ------------------------------------------------------ [ 0, 1 ] 148657 15.989% 15.989% ### ( 1, 2 ] 513127 55.190% 71.180% ########### ( 2, 3 ] 123104 13.241% 84.420% ### ( 3, 4 ] 56910 6.121% 90.541% # ( 4, 6 ] 55841 6.006% 96.547% # ( 6, 10 ] 12794 1.376% 97.924% ( 10, 15 ] 3291 0.354% 98.277% ( 15, 22 ] 472 0.051% 98.328% ( 22, 34 ] 39 0.004% 98.332% ( 34, 51 ] 23 0.002% 98.335% ( 51, 76 ] 54 0.006% 98.341% ( 76, 110 ] 1183 0.127% 98.468% ( 110, 170 ] 4810 0.517% 98.985% ( 170, 250 ] 2928 0.315% 99.300% ( 250, 380 ] 1702 0.183% 99.483% ( 380, 580 ] 1636 0.176% 99.659% ( 580, 870 ] 1170 0.126% 99.785% ( 870, 1300 ] 772 0.083% 99.868% ( 1300, 1900 ] 458 0.049% 99.917% ( 1900, 2900 ] 326 0.035% 99.952% ( 2900, 4400 ] 469 0.050% 100.003% ( 4400, 6600 ] 156 0.017% 100.020% ( 6600, 9900 ] 39 0.004% 100.024% ( 9900, 14000 ] 8 0.001% 100.025% ( 14000, 22000 ] 19 0.002% 100.027% ( 22000, 33000 ] 21 0.002% 100.029% ( 33000, 50000 ] 3 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 183125 Average: 11.2697 StdDev: 241.08 Min: 1 Median: 1.9411 Max: 34832 Percentiles: P50: 1.94 P75: 2.98 P99: 97.78 P99.9: 1587.50 P99.99: 9853.12 ------------------------------------------------------ [ 0, 1 ] 7026 3.837% 3.837% # ( 1, 2 ] 89830 49.054% 52.891% ########## ( 2, 3 ] 41516 22.671% 75.562% ##### ( 3, 4 ] 18148 9.910% 85.472% ## ( 4, 6 ] 17586 9.603% 95.075% ## ( 6, 10 ] 5380 2.938% 98.013% # ( 10, 15 ] 1295 0.707% 98.720% ( 15, 22 ] 342 0.187% 98.907% ( 22, 34 ] 35 0.019% 98.926% ( 34, 51 ] 11 0.006% 98.932% ( 51, 76 ] 12 0.007% 98.938% ( 76, 110 ] 176 0.096% 99.035% ( 110, 170 ] 627 0.342% 99.377% ( 170, 250 ] 321 0.175% 99.552% ( 250, 380 ] 189 0.103% 99.655% ( 380, 580 ] 176 0.096% 99.752% ( 580, 870 ] 149 0.081% 99.833% ( 870, 1300 ] 97 0.053% 99.886% ( 1300, 1900 ] 54 0.029% 99.915% ( 1900, 2900 ] 31 0.017% 99.932% ( 2900, 4400 ] 63 0.034% 99.967% ( 4400, 6600 ] 21 0.011% 99.978% ( 6600, 9900 ] 22 0.012% 99.990% ( 9900, 14000 ] 4 0.002% 99.992% ( 14000, 22000 ] 6 0.003% 99.996% ( 22000, 33000 ] 7 0.004% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 293054 Average: 11.8937 StdDev: 148.49 Min: 1 Median: 1.8660 Max: 8556 Percentiles: P50: 1.87 P75: 2.97 P99: 13.21 P99.9: 2028.59 P99.99: 3872.89 ------------------------------------------------------ [ 0, 1 ] 15448 5.271% 5.271% # ( 1, 2 ] 151366 51.651% 56.923% ########## ( 2, 3 ] 54356 18.548% 75.471% #### ( 3, 4 ] 28258 9.643% 85.113% ## ( 4, 6 ] 30956 10.563% 95.677% ## ( 6, 10 ] 8449 2.883% 98.560% # ( 10, 15 ] 2008 0.685% 99.245% ( 15, 22 ] 307 0.105% 99.350% ( 22, 34 ] 48 0.016% 99.366% ( 34, 51 ] 25 0.009% 99.375% ( 51, 76 ] 19 0.006% 99.381% ( 76, 110 ] 10 0.003% 99.384% ( 110, 170 ] 41 0.014% 99.398% ( 170, 250 ] 71 0.024% 99.423% ( 250, 380 ] 117 0.040% 99.463% ( 380, 580 ] 247 0.084% 99.547% ( 580, 870 ] 354 0.121% 99.668% ( 870, 1300 ] 395 0.135% 99.802% ( 1300, 1900 ] 261 0.089% 99.891% ( 1900, 2900 ] 194 0.066% 99.958% ( 2900, 4400 ] 146 0.050% 100.008% ( 4400, 6600 ] 61 0.021% 100.028% ( 6600, 9900 ] 11 0.004% 100.032% ** Level 3 read latency histogram (micros): Count: 1044829 Average: 14.2792 StdDev: 297.83 Min: 1 Median: 1.9057 Max: 55624 Percentiles: P50: 1.91 P75: 3.04 P99: 11.47 P99.9: 1136.95 P99.99: 2008.86 ------------------------------------------------------ [ 0, 1 ] 41501 3.972% 3.972% # ( 1, 2 ] 530967 50.819% 54.791% ########## ( 2, 3 ] 206850 19.797% 74.588% #### ( 3, 4 ] 105996 10.145% 84.733% ## ( 4, 6 ] 119041 11.393% 96.126% ## ( 6, 10 ] 28070 2.687% 98.813% # ( 10, 15 ] 6662 0.638% 99.450% ( 15, 22 ] 791 0.076% 99.526% ( 22, 34 ] 77 0.007% 99.534% ( 34, 51 ] 67 0.006% 99.540% ( 51, 76 ] 133 0.013% 99.553% ( 76, 110 ] 198 0.019% 99.572% ( 110, 170 ] 539 0.052% 99.623% ( 170, 250 ] 321 0.031% 99.654% ( 250, 380 ] 451 0.043% 99.697% ( 380, 580 ] 708 0.068% 99.765% ( 580, 870 ] 900 0.086% 99.851% ( 870, 1300 ] 825 0.079% 99.930% ( 1300, 1900 ] 572 0.055% 99.985% ( 1900, 2900 ] 510 0.049% 100.033% ( 2900, 4400 ] 663 0.063% 100.097% ( 4400, 6600 ] 248 0.024% 100.121% ( 6600, 9900 ] 129 0.012% 100.133% ( 9900, 14000 ] 37 0.004% 100.137% ( 14000, 22000 ] 79 0.008% 100.144% ( 22000, 33000 ] 37 0.004% 100.148% ( 33000, 50000 ] 5 0.000% 100.148% ( 50000, 75000 ] 1 0.000% 100.148% ** Level 4 read latency histogram (micros): Count: 863109 Average: 22.9558 StdDev: 285.51 Min: 1 Median: 1.9114 Max: 40131 Percentiles: P50: 1.91 P75: 3.14 P99: 365.81 P99.9: 2240.68 P99.99: 3378.22 ------------------------------------------------------ [ 0, 1 ] 34998 4.055% 4.055% # ( 1, 2 ] 435097 50.410% 54.465% ########## ( 2, 3 ] 165504 19.175% 73.641% #### ( 3, 4 ] 85876 9.950% 83.590% ## ( 4, 6 ] 93326 10.813% 94.403% ## ( 6, 10 ] 22686 2.628% 97.031% # ( 10, 15 ] 5065 0.587% 97.618% ( 15, 22 ] 653 0.076% 97.694% ( 22, 34 ] 63 0.007% 97.701% ( 34, 51 ] 47 0.005% 97.707% ( 51, 76 ] 96 0.011% 97.718% ( 76, 110 ] 1624 0.188% 97.906% ( 110, 170 ] 5009 0.580% 98.486% ( 170, 250 ] 2760 0.320% 98.806% ( 250, 380 ] 1879 0.218% 99.024% ( 380, 580 ] 2212 0.256% 99.280% ( 580, 870 ] 2115 0.245% 99.525% ( 870, 1300 ] 1849 0.214% 99.739% ( 1300, 1900 ] 1129 0.131% 99.870% ( 1900, 2900 ] 757 0.088% 99.958% ( 2900, 4400 ] 871 0.101% 100.059% ( 4400, 6600 ] 327 0.038% 100.097% ( 6600, 9900 ] 114 0.013% 100.110% ( 9900, 14000 ] 20 0.002% 100.112% ( 14000, 22000 ] 38 0.004% 100.117% ( 22000, 33000 ] 24 0.003% 100.119% ( 33000, 50000 ] 3 0.000% 100.120% ** Level 5 read latency histogram (micros): Count: 98354 Average: 521.4811 StdDev: 1242.30 Min: 75 Median: 198.3686 Max: 55223 Percentiles: P50: 198.37 P75: 466.26 P99: 4724.55 P99.9: 16935.05 P99.99: 39164.60 ------------------------------------------------------ ( 51, 76 ] 5 0.005% 0.005% ( 76, 110 ] 10246 10.417% 10.423% ## ( 110, 170 ] 33053 33.606% 44.029% ####### ( 170, 250 ] 16562 16.839% 60.868% ### ( 250, 380 ] 9744 9.907% 70.775% ## ( 380, 580 ] 9635 9.796% 80.571% ## ( 580, 870 ] 6691 6.803% 87.374% # ( 870, 1300 ] 4549 4.625% 91.999% # ( 1300, 1900 ] 2581 2.624% 94.624% # ( 1900, 2900 ] 1967 2.000% 96.623% ( 2900, 4400 ] 2210 2.247% 98.870% ( 4400, 6600 ] 864 0.878% 99.749% ( 6600, 9900 ] 114 0.116% 99.865% ( 9900, 14000 ] 13 0.013% 99.878% ( 14000, 22000 ] 59 0.060% 99.938% ( 22000, 33000 ] 45 0.046% 99.984% ( 33000, 50000 ] 17 0.017% 100.001% ( 50000, 75000 ] 3 0.003% 100.004% ** DB Stats ** Uptime(secs): 18.2 total, 3.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 162.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.040 H:M:S, 38.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/18-01:57:19 ... thread 0: (1000000,4000000) ops and (285060.0,185778.6) ops/second in (3.508033,21.531002) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/4 3.81 GB 365.0 3.5 0.0 3.5 7.3 3.8 0.0 1.9 100.3 209.3 35.79 25.54 70 0.511 3646K 3904 0.0 0.0 L1 18/0 1.63 GB 166.8 1.6 0.9 0.7 1.6 0.9 0.0 1.7 105.9 105.4 15.83 8.71 1 15.826 1701K 7770 0.0 0.0 L3 16/0 913.53 MB 0.9 2.0 1.4 0.6 2.0 1.4 0.2 1.4 100.3 99.1 20.80 9.58 7 2.972 942K 0 0.0 0.0 L4 160/0 9.46 GB 1.0 7.6 4.3 3.4 7.5 4.1 0.0 1.8 102.3 100.7 76.20 39.90 42 1.814 3541K 9171 0.0 0.0 L5 1140/0 93.81 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1352/4 109.61 GB 0.0 14.8 6.6 8.2 18.5 10.3 4.5 4.8 101.9 127.1 148.61 83.73 120 1.238 9832K 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.8 6.6 8.2 18.5 10.3 4.5 4.8 101.9 127.1 148.61 83.73 120 1.238 9832K 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.8 6.6 8.2 14.6 6.4 0.0 0.0 116.7 115.5 129.79 72.50 63 2.060 9832K 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 207.5 18.82 11.23 57 0.330 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.7 total, 21.5 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.45 GB write, 870.09 MB/s write, 14.80 GB read, 697.71 MB/s read, 148.6 seconds Interval compaction: 18.45 GB write, 877.42 MB/s write, 14.80 GB read, 703.58 MB/s read, 148.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 36, interval: 48 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1196028 Average: 10.9409 StdDev: 188.42 Min: 0 Median: 1.5505 Max: 48331 Percentiles: P50: 1.55 P75: 2.01 P99: 159.27 P99.9: 1261.30 P99.99: 3578.17 ------------------------------------------------------ [ 0, 1 ] 232763 19.461% 19.461% #### ( 1, 2 ] 663463 55.472% 74.934% ########### ( 2, 3 ] 140107 11.714% 86.648% ## ( 3, 4 ] 63158 5.281% 91.929% # ( 4, 6 ] 59765 4.997% 96.925% # ( 6, 10 ] 13695 1.145% 98.071% ( 10, 15 ] 3549 0.297% 98.367% ( 15, 22 ] 521 0.044% 98.411% ( 22, 34 ] 46 0.004% 98.415% ( 34, 51 ] 26 0.002% 98.417% ( 51, 76 ] 64 0.005% 98.422% ( 76, 110 ] 1578 0.132% 98.554% ( 110, 170 ] 6494 0.543% 99.097% ( 170, 250 ] 3773 0.315% 99.413% ( 250, 380 ] 2014 0.168% 99.581% ( 380, 580 ] 1864 0.156% 99.737% ( 580, 870 ] 1244 0.104% 99.841% ( 870, 1300 ] 778 0.065% 99.906% ( 1300, 1900 ] 463 0.039% 99.945% ( 1900, 2900 ] 330 0.028% 99.972% ( 2900, 4400 ] 472 0.039% 100.012% ( 4400, 6600 ] 156 0.013% 100.025% ( 6600, 9900 ] 39 0.003% 100.028% ( 9900, 14000 ] 8 0.001% 100.029% ( 14000, 22000 ] 19 0.002% 100.030% ( 22000, 33000 ] 21 0.002% 100.032% ( 33000, 50000 ] 3 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 184670 Average: 12.4583 StdDev: 240.73 Min: 1 Median: 1.9493 Max: 34832 Percentiles: P50: 1.95 P75: 3.00 P99: 155.54 P99.9: 1576.33 P99.99: 9829.95 ------------------------------------------------------ [ 0, 1 ] 7026 3.805% 3.805% # ( 1, 2 ] 89865 48.662% 52.467% ########## ( 2, 3 ] 41634 22.545% 75.012% ##### ( 3, 4 ] 18196 9.853% 84.865% ## ( 4, 6 ] 17658 9.562% 94.427% ## ( 6, 10 ] 5386 2.917% 97.344% # ( 10, 15 ] 1299 0.703% 98.047% ( 15, 22 ] 342 0.185% 98.233% ( 22, 34 ] 35 0.019% 98.251% ( 34, 51 ] 11 0.006% 98.257% ( 51, 76 ] 12 0.006% 98.264% ( 76, 110 ] 412 0.223% 98.487% ( 110, 170 ] 1248 0.676% 99.163% ( 170, 250 ] 532 0.288% 99.451% ( 250, 380 ] 281 0.152% 99.603% ( 380, 580 ] 248 0.134% 99.737% ( 580, 870 ] 176 0.095% 99.833% ( 870, 1300 ] 99 0.054% 99.886% ( 1300, 1900 ] 55 0.030% 99.916% ( 1900, 2900 ] 31 0.017% 99.933% ( 2900, 4400 ] 63 0.034% 99.967% ( 4400, 6600 ] 21 0.011% 99.978% ( 6600, 9900 ] 22 0.012% 99.990% ( 9900, 14000 ] 4 0.002% 99.992% ( 14000, 22000 ] 6 0.003% 99.996% ( 22000, 33000 ] 7 0.004% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 293054 Average: 11.8937 StdDev: 148.49 Min: 1 Median: 1.8660 Max: 8556 Percentiles: P50: 1.87 P75: 2.97 P99: 13.21 P99.9: 2028.59 P99.99: 3872.89 ------------------------------------------------------ [ 0, 1 ] 15448 5.271% 5.271% # ( 1, 2 ] 151366 51.651% 56.923% ########## ( 2, 3 ] 54356 18.548% 75.471% #### ( 3, 4 ] 28258 9.643% 85.113% ## ( 4, 6 ] 30956 10.563% 95.677% ## ( 6, 10 ] 8449 2.883% 98.560% # ( 10, 15 ] 2008 0.685% 99.245% ( 15, 22 ] 307 0.105% 99.350% ( 22, 34 ] 48 0.016% 99.366% ( 34, 51 ] 25 0.009% 99.375% ( 51, 76 ] 19 0.006% 99.381% ( 76, 110 ] 10 0.003% 99.384% ( 110, 170 ] 41 0.014% 99.398% ( 170, 250 ] 71 0.024% 99.423% ( 250, 380 ] 117 0.040% 99.463% ( 380, 580 ] 247 0.084% 99.547% ( 580, 870 ] 354 0.121% 99.668% ( 870, 1300 ] 395 0.135% 99.802% ( 1300, 1900 ] 261 0.089% 99.891% ( 1900, 2900 ] 194 0.066% 99.958% ( 2900, 4400 ] 146 0.050% 100.008% ( 4400, 6600 ] 61 0.021% 100.028% ( 6600, 9900 ] 11 0.004% 100.032% ** Level 3 read latency histogram (micros): Count: 1045508 Average: 14.3872 StdDev: 297.78 Min: 1 Median: 1.9064 Max: 55624 Percentiles: P50: 1.91 P75: 3.05 P99: 11.97 P99.9: 1136.79 P99.99: 2008.72 ------------------------------------------------------ [ 0, 1 ] 41501 3.969% 3.969% # ( 1, 2 ] 530967 50.786% 54.755% ########## ( 2, 3 ] 206850 19.785% 74.540% #### ( 3, 4 ] 105996 10.138% 84.678% ## ( 4, 6 ] 119041 11.386% 96.064% ## ( 6, 10 ] 28070 2.685% 98.749% # ( 10, 15 ] 6662 0.637% 99.386% ( 15, 22 ] 791 0.076% 99.462% ( 22, 34 ] 77 0.007% 99.469% ( 34, 51 ] 67 0.006% 99.475% ( 51, 76 ] 133 0.013% 99.488% ( 76, 110 ] 338 0.032% 99.520% ( 110, 170 ] 873 0.084% 99.604% ( 170, 250 ] 426 0.041% 99.645% ( 250, 380 ] 498 0.048% 99.692% ( 380, 580 ] 750 0.072% 99.764% ( 580, 870 ] 910 0.087% 99.851% ( 870, 1300 ] 826 0.079% 99.930% ( 1300, 1900 ] 572 0.055% 99.985% ( 1900, 2900 ] 510 0.049% 100.033% ( 2900, 4400 ] 663 0.063% 100.097% ( 4400, 6600 ] 248 0.024% 100.121% ( 6600, 9900 ] 129 0.012% 100.133% ( 9900, 14000 ] 37 0.004% 100.136% ( 14000, 22000 ] 79 0.008% 100.144% ( 22000, 33000 ] 37 0.004% 100.148% ( 33000, 50000 ] 5 0.000% 100.148% ( 50000, 75000 ] 1 0.000% 100.148% ** Level 4 read latency histogram (micros): Count: 871235 Average: 24.4742 StdDev: 284.97 Min: 1 Median: 1.9207 Max: 40131 Percentiles: P50: 1.92 P75: 3.21 P99: 408.74 P99.9: 2237.39 P99.99: 3378.00 ------------------------------------------------------ [ 0, 1 ] 34998 4.017% 4.017% # ( 1, 2 ] 435119 49.943% 53.960% ########## ( 2, 3 ] 165572 19.004% 72.964% #### ( 3, 4 ] 85903 9.860% 82.824% ## ( 4, 6 ] 93375 10.718% 93.542% ## ( 6, 10 ] 22697 2.605% 96.147% # ( 10, 15 ] 5067 0.582% 96.728% ( 15, 22 ] 653 0.075% 96.803% ( 22, 34 ] 63 0.007% 96.811% ( 34, 51 ] 47 0.005% 96.816% ( 51, 76 ] 97 0.011% 96.827% ( 76, 110 ] 3061 0.351% 97.178% ( 110, 170 ] 8924 1.024% 98.203% ( 170, 250 ] 4143 0.476% 98.678% ( 250, 380 ] 2414 0.277% 98.955% ( 380, 580 ] 2712 0.311% 99.267% ( 580, 870 ] 2248 0.258% 99.525% ( 870, 1300 ] 1879 0.216% 99.740% ( 1300, 1900 ] 1134 0.130% 99.870% ( 1900, 2900 ] 764 0.088% 99.958% ( 2900, 4400 ] 872 0.100% 100.058% ( 4400, 6600 ] 327 0.038% 100.096% ( 6600, 9900 ] 114 0.013% 100.109% ( 9900, 14000 ] 20 0.002% 100.111% ( 14000, 22000 ] 38 0.004% 100.115% ( 22000, 33000 ] 24 0.003% 100.118% ( 33000, 50000 ] 3 0.000% 100.119% ** Level 5 read latency histogram (micros): Count: 146287 Average: 411.4668 StdDev: 1033.67 Min: 75 Median: 166.8131 Max: 55223 Percentiles: P50: 166.81 P75: 340.24 P99: 4161.50 P99.9: 9515.38 P99.99: 34371.30 ------------------------------------------------------ ( 51, 76 ] 8 0.005% 0.005% ( 76, 110 ] 19414 13.271% 13.277% ### ( 110, 170 ] 56735 38.783% 52.060% ######## ( 170, 250 ] 24469 16.727% 68.787% ### ( 250, 380 ] 13094 8.951% 77.738% ## ( 380, 580 ] 12464 8.520% 86.258% ## ( 580, 870 ] 7537 5.152% 91.410% # ( 870, 1300 ] 4649 3.178% 94.588% # ( 1300, 1900 ] 2599 1.777% 96.365% ( 1900, 2900 ] 1994 1.363% 97.728% ( 2900, 4400 ] 2213 1.513% 99.241% ( 4400, 6600 ] 864 0.591% 99.831% ( 6600, 9900 ] 114 0.078% 99.909% ( 9900, 14000 ] 13 0.009% 99.918% ( 14000, 22000 ] 59 0.040% 99.958% ( 22000, 33000 ] 45 0.031% 99.989% ( 33000, 50000 ] 17 0.012% 100.001% ( 50000, 75000 ] 3 0.002% 100.003% ** DB Stats ** Uptime(secs): 21.7 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 181.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.136 H:M:S, 32.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 280.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.096 H:M:S, 2.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 232.594 micros/op 17178 ops/sec 60.191 seconds 1033996 operations; 16.6 MB/s (270999 of 270999 found) Microseconds per read: Count: 1033996 Average: 232.5959 StdDev: 726.34 Min: 2 Median: 165.4188 Max: 96476 Percentiles: P50: 165.42 P75: 224.81 P99: 1134.27 P99.9: 11101.31 P99.99: 30695.88 ------------------------------------------------------ ( 1, 2 ] 19 0.002% 0.002% ( 2, 3 ] 62 0.006% 0.008% ( 3, 4 ] 54 0.005% 0.013% ( 4, 6 ] 98 0.009% 0.023% ( 6, 10 ] 578 0.056% 0.078% ( 10, 15 ] 5453 0.527% 0.606% ( 15, 22 ] 5980 0.578% 1.184% ( 22, 34 ] 9639 0.932% 2.116% ( 34, 51 ] 2668 0.258% 2.374% ( 51, 76 ] 372 0.036% 2.410% ( 76, 110 ] 28382 2.745% 5.155% # ( 110, 170 ] 502024 48.552% 53.707% ########## ( 170, 250 ] 321374 31.081% 84.788% ###### ( 250, 380 ] 96249 9.308% 94.096% ## ( 380, 580 ] 34240 3.311% 97.408% # ( 580, 870 ] 13015 1.259% 98.666% ( 870, 1300 ] 5612 0.543% 99.209% ( 1300, 1900 ] 2616 0.253% 99.462% ( 1900, 2900 ] 1642 0.159% 99.621% ( 2900, 4400 ] 1715 0.166% 99.787% ( 4400, 6600 ] 684 0.066% 99.853% ( 6600, 9900 ] 348 0.034% 99.887% ( 9900, 14000 ] 471 0.046% 99.932% ( 14000, 22000 ] 464 0.045% 99.977% ( 22000, 33000 ] 169 0.016% 99.993% ( 33000, 50000 ] 54 0.005% 99.999% ( 50000, 75000 ] 11 0.001% 100.000% ( 75000, 110000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 20258338 rocksdb.bloom.filter.full.positive COUNT : 1231166 rocksdb.bloom.filter.full.true.positive COUNT : 1033552 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 444 rocksdb.memtable.miss COUNT : 1033552 rocksdb.l0.hit COUNT : 41887 rocksdb.l1.hit COUNT : 15985 rocksdb.l2andup.hit COUNT : 975680 rocksdb.compaction.key.drop.new COUNT : 205700 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4509299 rocksdb.number.keys.read COUNT : 1033996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4653596568 rocksdb.bytes.read COUNT : 1033996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1585 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 43057668 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 18253165171 rocksdb.compact.write.bytes COUNT : 18042404644 rocksdb.flush.write.bytes COUNT : 4624182391 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 40 rocksdb.number.superversion_acquires COUNT : 864 rocksdb.number.superversion_releases COUNT : 831 rocksdb.number.superversion_cleanups COUNT : 215 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 227 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4586757120 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1658880 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 22726129000 rocksdb.non.last.level.read.count COUNT : 5347847 rocksdb.block.checksum.compute.count COUNT : 5666542 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 164.668060 P95 : 433.033127 P99 : 1133.293491 P100 : 96474.000000 COUNT : 1033996 SUM : 239663111 rocksdb.db.write.micros P50 : 1.532135 P95 : 4.611954 P99 : 10.925879 P100 : 1650564.000000 COUNT : 4509299 SUM : 54446011 rocksdb.compaction.times.micros P50 : 1637500.000000 P95 : 4154166.666667 P99 : 15825632.000000 P100 : 15825632.000000 COUNT : 65 SUM : 131672800 rocksdb.compaction.times.cpu_micros P50 : 989200.000000 P95 : 1887500.000000 P99 : 7655000.000000 P100 : 8710549.000000 COUNT : 65 SUM : 74353751 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 761.250000 P95 : 31625.000000 P99 : 198000.000000 P100 : 245963.000000 COUNT : 65 SUM : 614323 rocksdb.compaction.outfile.sync.micros P50 : 58593.750000 P95 : 338931.818182 P99 : 494633.333333 P100 : 723724.000000 COUNT : 219 SUM : 21110623 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 167.073171 P95 : 3350.000000 P99 : 6116.000000 P100 : 6681.000000 COUNT : 144 SUM : 106160 rocksdb.table.open.io.micros P50 : 8512.802419 P95 : 19337.016575 P99 : 24038.235294 P100 : 93264.000000 COUNT : 1585 SUM : 13921675 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.919962 P95 : 13.728014 P99 : 169.488214 P100 : 55627.000000 COUNT : 4421129 SUM : 77941375 rocksdb.read.block.get.micros P50 : 134.138825 P95 : 300.440128 P99 : 1039.132521 P100 : 55300.000000 COUNT : 1243831 SUM : 204562988 rocksdb.write.raw.block.micros P50 : 0.544194 P95 : 1.527470 P99 : 4.040909 P100 : 66930.000000 COUNT : 5490250 SUM : 19106347 rocksdb.numfiles.in.singlecompaction P50 : 3.125000 P95 : 5.414286 P99 : 35.000000 P100 : 35.000000 COUNT : 81 SUM : 321 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.576272 P95 : 2069.641905 P99 : 2740.681535 P100 : 1650381.000000 COUNT : 188797 SUM : 43075882 rocksdb.sst.read.micros P50 : 2.395741 P95 : 166.004706 P99 : 465.091302 P100 : 55624.000000 COUNT : 5347918 SUM : 266797552 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1033996 SUM : 1033996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4509299 SUM : 4653596568 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 220000.000000 P95 : 1008750.000000 P99 : 1445000.000000 P100 : 1878195.000000 COUNT : 65 SUM : 20391720 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 236 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0