[2024-11-17 04:29:12.471909] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 22.11.4 initialization... [2024-11-17 04:29:12.472176] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid192400 ] Set seed to 1731814152465241 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 04:29:12.585539] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 04:29:12.606991] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 04:29:12.607033] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 192400' to capture a snapshot of events at runtime. [2024-11-17 04:29:12.607043] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 04:29:12.607070] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 04:29:12.607078] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid192400 for offline analysis/debug. [2024-11-17 04:29:12.607619] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 04:29:16 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-04:29:24 ... thread 0: (1000000,1000000) ops and (127352.5,127352.5) ops/second in (7.852223,7.852223) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.60 GB 44.0 0.4 0.0 0.4 1.2 0.8 0.0 1.5 36.7 116.1 10.30 4.04 10 1.030 383K 535 0.0 0.0 L1 7/7 570.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 32/8 2.50 GB 1.6 1.6 1.1 0.6 1.6 1.0 0.3 1.5 104.2 102.7 15.96 7.65 5 3.192 795K 0 0.0 0.0 L4 218/29 12.52 GB 1.2 4.3 2.9 1.4 4.2 2.8 0.0 1.5 101.8 100.2 43.09 21.01 25 1.723 1554K 3664 0.0 0.0 L5 1084/0 89.08 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1353/54 106.25 GB 0.0 6.3 4.0 2.3 7.0 4.7 0.3 8.7 92.7 103.2 69.35 32.69 40 1.734 2733K 4199 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 4.0 2.3 7.0 4.7 0.3 8.7 92.7 103.2 69.35 32.69 40 1.734 2733K 4199 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 4.0 2.3 6.2 3.9 0.0 0.0 103.4 101.9 62.17 30.18 31 2.005 2733K 4199 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 114.1 7.18 2.51 9 0.798 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.99 GB write, 889.90 MB/s write, 6.28 GB read, 799.65 MB/s read, 69.3 seconds Interval compaction: 6.99 GB write, 910.86 MB/s write, 6.28 GB read, 818.49 MB/s read, 69.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 22, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 308924 Average: 14.1905 StdDev: 202.04 Min: 1 Median: 1.9022 Max: 54968 Percentiles: P50: 1.90 P75: 2.89 P99: 13.16 P99.9: 2480.95 P99.99: 4167.77 ------------------------------------------------------ [ 0, 1 ] 10332 3.345% 3.345% # ( 1, 2 ] 159753 51.713% 55.057% ########## ( 2, 3 ] 69463 22.485% 77.543% #### ( 3, 4 ] 28612 9.262% 86.805% ## ( 4, 6 ] 29417 9.522% 96.327% ## ( 6, 10 ] 7441 2.409% 98.736% ( 10, 15 ] 1292 0.418% 99.154% ( 15, 22 ] 143 0.046% 99.200% ( 22, 34 ] 16 0.005% 99.205% ( 34, 51 ] 11 0.004% 99.209% ( 51, 76 ] 14 0.005% 99.213% ( 76, 110 ] 2 0.001% 99.214% ( 110, 170 ] 35 0.011% 99.225% ( 170, 250 ] 79 0.026% 99.251% ( 250, 380 ] 173 0.056% 99.307% ( 380, 580 ] 330 0.107% 99.414% ( 580, 870 ] 487 0.158% 99.571% ( 870, 1300 ] 526 0.170% 99.742% ( 1300, 1900 ] 346 0.112% 99.854% ( 1900, 2900 ] 248 0.080% 99.934% ( 2900, 4400 ] 206 0.067% 100.001% ( 4400, 6600 ] 54 0.017% 100.018% ( 6600, 9900 ] 9 0.003% 100.021% ( 9900, 14000 ] 5 0.002% 100.023% ( 22000, 33000 ] 2 0.001% 100.023% ( 50000, 75000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 22576 Average: 12.9841 StdDev: 152.19 Min: 1 Median: 2.0659 Max: 7450 Percentiles: P50: 2.07 P75: 3.14 P99: 14.50 P99.9: 2426.50 P99.99: 5216.64 ------------------------------------------------------ [ 0, 1 ] 242 1.072% 1.072% ( 1, 2 ] 10674 47.280% 48.352% ######### ( 2, 3 ] 5649 25.022% 73.374% ##### ( 3, 4 ] 2574 11.401% 84.776% ## ( 4, 6 ] 2406 10.657% 95.433% ## ( 6, 10 ] 717 3.176% 98.609% # ( 10, 15 ] 98 0.434% 99.043% ( 15, 22 ] 17 0.075% 99.119% ( 22, 34 ] 2 0.009% 99.127% ( 34, 51 ] 3 0.013% 99.141% ( 51, 76 ] 2 0.009% 99.150% ( 76, 110 ] 3 0.013% 99.163% ( 110, 170 ] 6 0.027% 99.189% ( 170, 250 ] 13 0.058% 99.247% ( 250, 380 ] 20 0.089% 99.336% ( 380, 580 ] 24 0.106% 99.442% ( 580, 870 ] 42 0.186% 99.628% ( 870, 1300 ] 29 0.128% 99.756% ( 1300, 1900 ] 24 0.106% 99.863% ( 1900, 2900 ] 16 0.071% 99.934% ( 2900, 4400 ] 12 0.053% 99.987% ( 4400, 6600 ] 2 0.009% 99.996% ( 6600, 9900 ] 2 0.009% 100.004% ** Level 2 read latency histogram (micros): Count: 161429 Average: 10.6841 StdDev: 124.60 Min: 1 Median: 1.9177 Max: 7649 Percentiles: P50: 1.92 P75: 2.88 P99: 11.06 P99.9: 1452.45 P99.99: 2300.56 ------------------------------------------------------ [ 0, 1 ] 4033 2.498% 2.498% ( 1, 2 ] 83560 51.763% 54.261% ########## ( 2, 3 ] 38039 23.564% 77.825% ##### ( 3, 4 ] 14953 9.263% 87.088% ## ( 4, 6 ] 14891 9.224% 96.312% ## ( 6, 10 ] 4195 2.599% 98.911% # ( 10, 15 ] 680 0.421% 99.332% ( 15, 22 ] 94 0.058% 99.390% ( 22, 34 ] 8 0.005% 99.395% ( 34, 51 ] 8 0.005% 99.400% ( 51, 76 ] 8 0.005% 99.405% ( 76, 110 ] 9 0.006% 99.411% ( 110, 170 ] 22 0.014% 99.425% ( 170, 250 ] 38 0.024% 99.448% ( 250, 380 ] 87 0.054% 99.502% ( 380, 580 ] 131 0.081% 99.583% ( 580, 870 ] 236 0.146% 99.729% ( 870, 1300 ] 240 0.149% 99.878% ( 1300, 1900 ] 140 0.087% 99.965% ( 1900, 2900 ] 102 0.063% 100.028% ( 2900, 4400 ] 51 0.032% 100.059% ( 4400, 6600 ] 15 0.009% 100.069% ( 6600, 9900 ] 3 0.002% 100.071% ** Level 3 read latency histogram (micros): Count: 707808 Average: 11.2454 StdDev: 171.55 Min: 1 Median: 2.0222 Max: 58824 Percentiles: P50: 2.02 P75: 3.04 P99: 9.89 P99.9: 853.23 P99.99: 1180.61 ------------------------------------------------------ [ 0, 1 ] 11508 1.626% 1.626% ( 1, 2 ] 338462 47.818% 49.444% ########## ( 2, 3 ] 177541 25.083% 74.527% ##### ( 3, 4 ] 74895 10.581% 85.109% ## ( 4, 6 ] 77717 10.980% 96.089% ## ( 6, 10 ] 21192 2.994% 99.083% # ( 10, 15 ] 3510 0.496% 99.579% ( 15, 22 ] 548 0.077% 99.656% ( 22, 34 ] 51 0.007% 99.663% ( 34, 51 ] 39 0.006% 99.669% ( 51, 76 ] 51 0.007% 99.676% ( 76, 110 ] 41 0.006% 99.682% ( 110, 170 ] 61 0.009% 99.690% ( 170, 250 ] 101 0.014% 99.705% ( 250, 380 ] 248 0.035% 99.740% ( 380, 580 ] 456 0.064% 99.804% ( 580, 870 ] 723 0.102% 99.906% ( 870, 1300 ] 824 0.116% 100.023% ( 1300, 1900 ] 569 0.080% 100.103% ( 1900, 2900 ] 422 0.060% 100.163% ( 2900, 4400 ] 389 0.055% 100.218% ( 4400, 6600 ] 86 0.012% 100.230% ( 6600, 9900 ] 17 0.002% 100.232% ( 9900, 14000 ] 5 0.001% 100.233% ( 14000, 22000 ] 4 0.001% 100.233% ( 22000, 33000 ] 3 0.000% 100.234% ( 50000, 75000 ] 1 0.000% 100.234% ** Level 4 read latency histogram (micros): Count: 405391 Average: 26.6935 StdDev: 281.41 Min: 1 Median: 1.9822 Max: 51392 Percentiles: P50: 1.98 P75: 3.03 P99: 751.00 P99.9: 2743.49 P99.99: 3626.19 ------------------------------------------------------ [ 0, 1 ] 8785 2.167% 2.167% ( 1, 2 ] 197421 48.699% 50.866% ########## ( 2, 3 ] 96481 23.799% 74.665% ##### ( 3, 4 ] 42320 10.439% 85.105% ## ( 4, 6 ] 40794 10.063% 95.168% ## ( 6, 10 ] 11185 2.759% 97.927% # ( 10, 15 ] 1814 0.447% 98.374% ( 15, 22 ] 260 0.064% 98.438% ( 22, 34 ] 19 0.005% 98.443% ( 34, 51 ] 26 0.006% 98.449% ( 51, 76 ] 35 0.009% 98.458% ( 76, 110 ] 20 0.005% 98.463% ( 110, 170 ] 70 0.017% 98.480% ( 170, 250 ] 187 0.046% 98.526% ( 250, 380 ] 407 0.100% 98.627% ( 380, 580 ] 792 0.195% 98.822% ( 580, 870 ] 1228 0.303% 99.125% ( 870, 1300 ] 1452 0.358% 99.483% ( 1300, 1900 ] 1130 0.279% 99.762% ( 1900, 2900 ] 667 0.165% 99.926% ( 2900, 4400 ] 538 0.133% 100.059% ( 4400, 6600 ] 165 0.041% 100.100% ( 6600, 9900 ] 23 0.006% 100.106% ( 9900, 14000 ] 9 0.002% 100.108% ( 14000, 22000 ] 6 0.001% 100.109% ( 22000, 33000 ] 4 0.001% 100.110% ( 33000, 50000 ] 1 0.000% 100.111% ( 50000, 75000 ] 1 0.000% 100.111% ** Level 5 read latency histogram (micros): Count: 13740 Average: 1608.2565 StdDev: 1796.98 Min: 88 Median: 1102.6624 Max: 71624 Percentiles: P50: 1102.66 P75: 2085.39 P99: 6513.04 P99.9: 9843.71 P99.99: 63550.00 ------------------------------------------------------ ( 76, 110 ] 17 0.124% 0.124% ( 110, 170 ] 112 0.815% 0.939% ( 170, 250 ] 283 2.060% 2.999% ( 250, 380 ] 761 5.539% 8.537% # ( 380, 580 ] 1657 12.060% 20.597% ## ( 580, 870 ] 2591 18.857% 39.454% #### ( 870, 1300 ] 2678 19.491% 58.945% #### ( 1300, 1900 ] 1932 14.061% 73.006% ### ( 1900, 2900 ] 1478 10.757% 83.763% ## ( 2900, 4400 ] 1525 11.099% 94.862% ## ( 4400, 6600 ] 592 4.309% 99.170% # ( 6600, 9900 ] 102 0.742% 99.913% ( 9900, 14000 ] 2 0.015% 99.927% ( 14000, 22000 ] 3 0.022% 99.949% ( 22000, 33000 ] 3 0.022% 99.971% ( 33000, 50000 ] 1 0.007% 99.978% ( 50000, 75000 ] 3 0.022% 100.000% ** DB Stats ** Uptime(secs): 8.0 total, 7.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 122.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.902 H:M:S, 48.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 125.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.902 H:M:S, 49.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/17-04:29:29 ... thread 0: (1000000,2000000) ops and (217025.0,160513.8) ops/second in (4.607765,12.459988) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.58 GB 157.3 1.5 0.0 1.5 3.3 1.8 0.0 1.9 77.0 166.2 20.46 11.70 29 0.705 1599K 1912 0.0 0.0 L1 7/7 570.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 961.02 MB 1.0 1.6 1.1 0.6 1.6 1.0 0.3 1.5 104.2 102.7 15.96 7.65 5 3.192 795K 0 0.0 0.0 L4 167/0 9.48 GB 1.0 7.3 4.4 2.9 7.2 4.3 0.1 1.6 111.5 109.8 67.11 35.44 38 1.766 2810K 7408 0.0 0.0 L5 1140/0 93.63 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1344/17 107.19 GB 0.0 10.5 5.4 5.0 12.1 7.1 4.9 6.8 103.5 119.9 103.53 54.80 72 1.438 5204K 9320 0.0 0.0 Int 0/0 0.00 KB 0.0 10.5 5.4 5.0 12.1 7.1 4.9 6.8 103.5 119.9 103.53 54.80 72 1.438 5204K 9320 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.5 5.4 5.0 10.3 5.3 0.0 0.0 116.8 115.3 91.81 49.40 48 1.913 5204K 9320 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 156.0 11.71 5.40 24 0.488 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.6 total, 12.5 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.12 GB write, 981.20 MB/s write, 10.47 GB read, 847.59 MB/s read, 103.5 seconds Interval compaction: 12.12 GB write, 995.77 MB/s write, 10.47 GB read, 860.17 MB/s read, 103.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 30, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 616256 Average: 15.7581 StdDev: 178.92 Min: 1 Median: 1.7740 Max: 54968 Percentiles: P50: 1.77 P75: 2.67 P99: 285.70 P99.9: 2231.38 P99.99: 3915.80 ------------------------------------------------------ [ 0, 1 ] 49601 8.049% 8.049% ## ( 1, 2 ] 334003 54.199% 62.248% ########### ( 2, 3 ] 116850 18.961% 81.209% #### ( 3, 4 ] 46436 7.535% 88.744% ## ( 4, 6 ] 45381 7.364% 96.108% # ( 6, 10 ] 10212 1.657% 97.765% ( 10, 15 ] 1773 0.288% 98.053% ( 15, 22 ] 210 0.034% 98.087% ( 22, 34 ] 19 0.003% 98.090% ( 34, 51 ] 18 0.003% 98.093% ( 51, 76 ] 17 0.003% 98.096% ( 76, 110 ] 654 0.106% 98.202% ( 110, 170 ] 2789 0.453% 98.654% ( 170, 250 ] 1769 0.287% 98.941% ( 250, 380 ] 1316 0.214% 99.155% ( 380, 580 ] 1465 0.238% 99.393% ( 580, 870 ] 1308 0.212% 99.605% ( 870, 1300 ] 1034 0.168% 99.773% ( 1300, 1900 ] 628 0.102% 99.875% ( 1900, 2900 ] 473 0.077% 99.951% ( 2900, 4400 ] 352 0.057% 100.008% ( 4400, 6600 ] 109 0.018% 100.026% ( 6600, 9900 ] 13 0.002% 100.028% ( 9900, 14000 ] 6 0.001% 100.029% ( 22000, 33000 ] 2 0.000% 100.030% ( 50000, 75000 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 74821 Average: 10.4575 StdDev: 119.85 Min: 1 Median: 2.7134 Max: 7450 Percentiles: P50: 2.71 P75: 4.27 P99: 19.81 P99.9: 1812.92 P99.99: 4373.22 ------------------------------------------------------ [ 0, 1 ] 493 0.659% 0.659% ( 1, 2 ] 24254 32.416% 33.075% ###### ( 2, 3 ] 17750 23.723% 56.798% ##### ( 3, 4 ] 11561 15.452% 72.250% ### ( 4, 6 ] 15477 20.685% 92.935% #### ( 6, 10 ] 3716 4.967% 97.902% # ( 10, 15 ] 637 0.851% 98.753% ( 15, 22 ] 269 0.360% 99.113% ( 22, 34 ] 26 0.035% 99.147% ( 34, 51 ] 8 0.011% 99.158% ( 51, 76 ] 4 0.005% 99.163% ( 76, 110 ] 49 0.065% 99.229% ( 110, 170 ] 128 0.171% 99.400% ( 170, 250 ] 59 0.079% 99.479% ( 250, 380 ] 58 0.078% 99.556% ( 380, 580 ] 63 0.084% 99.640% ( 580, 870 ] 86 0.115% 99.755% ( 870, 1300 ] 68 0.091% 99.846% ( 1300, 1900 ] 47 0.063% 99.909% ( 1900, 2900 ] 34 0.045% 99.955% ( 2900, 4400 ] 27 0.036% 99.991% ( 4400, 6600 ] 6 0.008% 99.999% ( 6600, 9900 ] 2 0.003% 100.001% ** Level 2 read latency histogram (micros): Count: 194160 Average: 10.8848 StdDev: 130.55 Min: 1 Median: 1.9370 Max: 7649 Percentiles: P50: 1.94 P75: 2.91 P99: 10.96 P99.9: 1629.40 P99.99: 2659.88 ------------------------------------------------------ [ 0, 1 ] 4423 2.278% 2.278% ( 1, 2 ] 98885 50.930% 53.208% ########## ( 2, 3 ] 46248 23.820% 77.027% ##### ( 3, 4 ] 18573 9.566% 86.593% ## ( 4, 6 ] 18787 9.676% 96.269% ## ( 6, 10 ] 5143 2.649% 98.918% # ( 10, 15 ] 830 0.427% 99.345% ( 15, 22 ] 116 0.060% 99.405% ( 22, 34 ] 9 0.005% 99.410% ( 34, 51 ] 9 0.005% 99.414% ( 51, 76 ] 12 0.006% 99.421% ( 76, 110 ] 11 0.006% 99.426% ( 110, 170 ] 26 0.013% 99.440% ( 170, 250 ] 47 0.024% 99.464% ( 250, 380 ] 95 0.049% 99.513% ( 380, 580 ] 147 0.076% 99.588% ( 580, 870 ] 255 0.131% 99.720% ( 870, 1300 ] 262 0.135% 99.855% ( 1300, 1900 ] 160 0.082% 99.937% ( 1900, 2900 ] 135 0.070% 100.007% ( 2900, 4400 ] 77 0.040% 100.046% ( 4400, 6600 ] 20 0.010% 100.057% ( 6600, 9900 ] 4 0.002% 100.059% ** Level 3 read latency histogram (micros): Count: 957369 Average: 10.6873 StdDev: 161.05 Min: 1 Median: 2.0006 Max: 58824 Percentiles: P50: 2.00 P75: 3.00 P99: 9.84 P99.9: 829.49 P99.99: 1196.03 ------------------------------------------------------ [ 0, 1 ] 14989 1.566% 1.566% ( 1, 2 ] 463544 48.419% 49.984% ########## ( 2, 3 ] 239808 25.049% 75.033% ##### ( 3, 4 ] 99645 10.408% 85.441% ## ( 4, 6 ] 103151 10.774% 96.215% ## ( 6, 10 ] 27778 2.901% 99.117% # ( 10, 15 ] 4520 0.472% 99.589% ( 15, 22 ] 660 0.069% 99.658% ( 22, 34 ] 55 0.006% 99.664% ( 34, 51 ] 51 0.005% 99.669% ( 51, 76 ] 81 0.008% 99.678% ( 76, 110 ] 87 0.009% 99.687% ( 110, 170 ] 208 0.022% 99.708% ( 170, 250 ] 189 0.020% 99.728% ( 250, 380 ] 332 0.035% 99.763% ( 380, 580 ] 560 0.058% 99.821% ( 580, 870 ] 876 0.092% 99.913% ( 870, 1300 ] 975 0.102% 100.015% ( 1300, 1900 ] 682 0.071% 100.086% ( 1900, 2900 ] 544 0.057% 100.143% ( 2900, 4400 ] 531 0.055% 100.198% ( 4400, 6600 ] 117 0.012% 100.210% ( 6600, 9900 ] 19 0.002% 100.212% ( 9900, 14000 ] 5 0.001% 100.213% ( 14000, 22000 ] 4 0.000% 100.213% ( 22000, 33000 ] 3 0.000% 100.214% ( 50000, 75000 ] 1 0.000% 100.214% ** Level 4 read latency histogram (micros): Count: 731620 Average: 22.2824 StdDev: 236.33 Min: 0 Median: 1.9909 Max: 51392 Percentiles: P50: 1.99 P75: 3.00 P99: 472.37 P99.9: 2100.64 P99.99: 2825.01 ------------------------------------------------------ [ 0, 1 ] 12343 1.687% 1.687% ( 1, 2 ] 356718 48.757% 50.444% ########## ( 2, 3 ] 180095 24.616% 75.060% ##### ( 3, 4 ] 74561 10.191% 85.251% ## ( 4, 6 ] 73005 9.979% 95.230% ## ( 6, 10 ] 19143 2.617% 97.847% # ( 10, 15 ] 3174 0.434% 98.280% ( 15, 22 ] 424 0.058% 98.338% ( 22, 34 ] 37 0.005% 98.343% ( 34, 51 ] 46 0.006% 98.350% ( 51, 76 ] 62 0.008% 98.358% ( 76, 110 ] 363 0.050% 98.408% ( 110, 170 ] 1454 0.199% 98.607% ( 170, 250 ] 1074 0.147% 98.753% ( 250, 380 ] 1082 0.148% 98.901% ( 380, 580 ] 1565 0.214% 99.115% ( 580, 870 ] 2029 0.277% 99.392% ( 870, 1300 ] 2050 0.280% 99.673% ( 1300, 1900 ] 1481 0.202% 99.875% ( 1900, 2900 ] 909 0.124% 99.999% ( 2900, 4400 ] 796 0.109% 100.108% ( 4400, 6600 ] 223 0.030% 100.139% ( 6600, 9900 ] 25 0.003% 100.142% ( 9900, 14000 ] 10 0.001% 100.143% ( 14000, 22000 ] 7 0.001% 100.144% ( 22000, 33000 ] 4 0.001% 100.145% ( 33000, 50000 ] 1 0.000% 100.145% ( 50000, 75000 ] 1 0.000% 100.145% ** Level 5 read latency histogram (micros): Count: 42280 Average: 816.5792 StdDev: 1274.67 Min: 75 Median: 386.5400 Max: 71624 Percentiles: P50: 386.54 P75: 960.81 P99: 5639.71 P99.9: 8922.72 P99.99: 18725.33 ------------------------------------------------------ ( 51, 76 ] 1 0.002% 0.002% ( 76, 110 ] 2413 5.707% 5.710% # ( 110, 170 ] 9619 22.751% 28.460% ##### ( 170, 250 ] 5297 12.528% 40.989% ### ( 250, 380 ] 3650 8.633% 49.622% ## ( 380, 580 ] 4893 11.573% 61.194% ## ( 580, 870 ] 4972 11.760% 72.954% ## ( 870, 1300 ] 4096 9.688% 82.642% ## ( 1300, 1900 ] 2622 6.202% 88.843% # ( 1900, 2900 ] 1996 4.721% 93.564% # ( 2900, 4400 ] 1906 4.508% 98.072% # ( 4400, 6600 ] 696 1.646% 99.719% ( 6600, 9900 ] 109 0.258% 99.976% ( 9900, 14000 ] 4 0.009% 99.986% ( 14000, 22000 ] 3 0.007% 99.993% ( 22000, 33000 ] 3 0.007% 100.000% ( 33000, 50000 ] 1 0.002% 100.002% ( 50000, 75000 ] 3 0.007% 100.009% ** DB Stats ** Uptime(secs): 12.6 total, 4.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 155.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.960 H:M:S, 39.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 213.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.058 H:M:S, 23.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-04:29:33 ... thread 0: (1000000,3000000) ops and (217681.6,175913.3) ops/second in (4.593866,17.053854) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 20/10 3.62 GB 264.3 2.5 0.0 2.5 5.3 2.8 0.0 1.9 92.0 195.1 28.07 18.76 50 0.561 2622K 2869 0.0 0.0 L1 7/7 570.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 961.02 MB 1.0 1.6 1.1 0.6 1.6 1.0 0.3 1.5 104.2 102.7 15.96 7.65 5 3.192 795K 0 0.0 0.0 L4 167/0 9.48 GB 1.0 7.3 4.4 2.9 7.2 4.3 0.1 1.6 111.5 109.8 67.11 35.44 38 1.766 2810K 7408 0.0 0.0 L5 1140/0 93.63 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1349/17 108.23 GB 0.0 11.5 5.4 6.0 14.1 8.1 4.9 5.0 105.5 130.3 111.14 61.85 93 1.195 6228K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.5 5.4 6.0 14.1 8.1 4.9 5.0 105.5 130.3 111.14 61.85 93 1.195 6228K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.5 5.4 6.0 11.3 5.3 0.0 0.0 122.5 121.1 95.70 53.21 52 1.840 6228K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 187.7 15.44 8.65 41 0.377 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.2 total, 17.1 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.15 GB write, 840.26 MB/s write, 11.45 GB read, 680.19 MB/s read, 111.1 seconds Interval compaction: 14.15 GB write, 849.38 MB/s write, 11.45 GB read, 687.57 MB/s read, 111.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 30, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 926145 Average: 14.8166 StdDev: 149.82 Min: 0 Median: 1.6729 Max: 54968 Percentiles: P50: 1.67 P75: 2.45 P99: 261.80 P99.9: 1645.95 P99.99: 3232.62 ------------------------------------------------------ [ 0, 1 ] 123502 13.335% 13.335% ### ( 1, 2 ] 504606 54.485% 67.820% ########### ( 2, 3 ] 146939 15.866% 83.685% ### ( 3, 4 ] 56184 6.066% 89.752% # ( 4, 6 ] 52869 5.709% 95.460% # ( 6, 10 ] 11423 1.233% 96.694% ( 10, 15 ] 1965 0.212% 96.906% ( 15, 22 ] 241 0.026% 96.932% ( 22, 34 ] 25 0.003% 96.934% ( 34, 51 ] 21 0.002% 96.937% ( 51, 76 ] 19 0.002% 96.939% ( 76, 110 ] 2746 0.296% 97.235% ( 110, 170 ] 10660 1.151% 98.386% ( 170, 250 ] 5428 0.586% 98.972% ( 250, 380 ] 2816 0.304% 99.276% ( 380, 580 ] 2641 0.285% 99.562% ( 580, 870 ] 1686 0.182% 99.744% ( 870, 1300 ] 1080 0.117% 99.860% ( 1300, 1900 ] 638 0.069% 99.929% ( 1900, 2900 ] 484 0.052% 99.981% ( 2900, 4400 ] 358 0.039% 100.020% ( 4400, 6600 ] 109 0.012% 100.032% ( 6600, 9900 ] 13 0.001% 100.033% ( 9900, 14000 ] 6 0.001% 100.034% ( 22000, 33000 ] 2 0.000% 100.034% ( 50000, 75000 ] 1 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 143803 Average: 8.5627 StdDev: 88.10 Min: 1 Median: 3.3998 Max: 7450 Percentiles: P50: 3.40 P75: 4.82 P99: 21.76 P99.9: 1124.19 P99.99: 3934.43 ------------------------------------------------------ [ 0, 1 ] 588 0.409% 0.409% ( 1, 2 ] 27825 19.349% 19.758% #### ( 2, 3 ] 30130 20.952% 40.711% #### ( 3, 4 ] 33412 23.235% 63.945% ##### ( 4, 6 ] 38925 27.068% 91.013% ##### ( 6, 10 ] 8917 6.201% 97.214% # ( 10, 15 ] 1757 1.222% 98.436% ( 15, 22 ] 841 0.585% 99.021% ( 22, 34 ] 90 0.063% 99.083% ( 34, 51 ] 13 0.009% 99.093% ( 51, 76 ] 5 0.003% 99.096% ( 76, 110 ] 155 0.108% 99.204% ( 110, 170 ] 471 0.328% 99.531% ( 170, 250 ] 192 0.134% 99.665% ( 250, 380 ] 102 0.071% 99.736% ( 380, 580 ] 96 0.067% 99.803% ( 580, 870 ] 101 0.070% 99.873% ( 870, 1300 ] 68 0.047% 99.920% ( 1300, 1900 ] 48 0.033% 99.953% ( 1900, 2900 ] 35 0.024% 99.978% ( 2900, 4400 ] 27 0.019% 99.997% ( 4400, 6600 ] 6 0.004% 100.001% ( 6600, 9900 ] 2 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 194211 Average: 10.9349 StdDev: 130.58 Min: 1 Median: 1.9373 Max: 7649 Percentiles: P50: 1.94 P75: 2.92 P99: 11.26 P99.9: 1629.21 P99.99: 2659.84 ------------------------------------------------------ [ 0, 1 ] 4423 2.277% 2.277% ( 1, 2 ] 98885 50.916% 53.194% ########## ( 2, 3 ] 46248 23.813% 77.007% ##### ( 3, 4 ] 18573 9.563% 86.570% ## ( 4, 6 ] 18787 9.673% 96.244% ## ( 6, 10 ] 5143 2.648% 98.892% # ( 10, 15 ] 830 0.427% 99.319% ( 15, 22 ] 116 0.060% 99.379% ( 22, 34 ] 9 0.005% 99.384% ( 34, 51 ] 9 0.005% 99.388% ( 51, 76 ] 12 0.006% 99.394% ( 76, 110 ] 21 0.011% 99.405% ( 110, 170 ] 43 0.022% 99.427% ( 170, 250 ] 61 0.031% 99.459% ( 250, 380 ] 100 0.051% 99.510% ( 380, 580 ] 151 0.078% 99.588% ( 580, 870 ] 256 0.132% 99.720% ( 870, 1300 ] 262 0.135% 99.855% ( 1300, 1900 ] 160 0.082% 99.937% ( 1900, 2900 ] 135 0.070% 100.007% ( 2900, 4400 ] 77 0.040% 100.046% ( 4400, 6600 ] 20 0.010% 100.057% ( 6600, 9900 ] 4 0.002% 100.059% ** Level 3 read latency histogram (micros): Count: 958224 Average: 10.8516 StdDev: 161.12 Min: 1 Median: 2.0024 Max: 58824 Percentiles: P50: 2.00 P75: 3.00 P99: 9.96 P99.9: 831.48 P99.99: 1196.53 ------------------------------------------------------ [ 0, 1 ] 14989 1.564% 1.564% ( 1, 2 ] 463544 48.375% 49.940% ########## ( 2, 3 ] 239808 25.026% 74.966% ##### ( 3, 4 ] 99645 10.399% 85.365% ## ( 4, 6 ] 103151 10.765% 96.130% ## ( 6, 10 ] 27778 2.899% 99.029% # ( 10, 15 ] 4520 0.472% 99.500% ( 15, 22 ] 660 0.069% 99.569% ( 22, 34 ] 55 0.006% 99.575% ( 34, 51 ] 51 0.005% 99.580% ( 51, 76 ] 81 0.008% 99.589% ( 76, 110 ] 206 0.021% 99.610% ( 110, 170 ] 618 0.064% 99.675% ( 170, 250 ] 379 0.040% 99.714% ( 250, 380 ] 397 0.041% 99.756% ( 380, 580 ] 612 0.064% 99.819% ( 580, 870 ] 890 0.093% 99.912% ( 870, 1300 ] 980 0.102% 100.015% ( 1300, 1900 ] 682 0.071% 100.086% ( 1900, 2900 ] 544 0.057% 100.143% ( 2900, 4400 ] 531 0.055% 100.198% ( 4400, 6600 ] 117 0.012% 100.210% ( 6600, 9900 ] 19 0.002% 100.212% ( 9900, 14000 ] 5 0.001% 100.213% ( 14000, 22000 ] 4 0.000% 100.213% ( 22000, 33000 ] 3 0.000% 100.213% ( 50000, 75000 ] 1 0.000% 100.214% ** Level 4 read latency histogram (micros): Count: 741238 Average: 24.3088 StdDev: 236.03 Min: 0 Median: 2.0085 Max: 51392 Percentiles: P50: 2.01 P75: 3.09 P99: 512.22 P99.9: 2096.03 P99.99: 2823.53 ------------------------------------------------------ [ 0, 1 ] 12343 1.665% 1.665% ( 1, 2 ] 356743 48.128% 49.793% ########## ( 2, 3 ] 180206 24.311% 74.105% ##### ( 3, 4 ] 74877 10.102% 84.206% ## ( 4, 6 ] 73351 9.896% 94.102% ## ( 6, 10 ] 19182 2.588% 96.690% # ( 10, 15 ] 3190 0.430% 97.120% ( 15, 22 ] 428 0.058% 97.178% ( 22, 34 ] 37 0.005% 97.183% ( 34, 51 ] 46 0.006% 97.189% ( 51, 76 ] 62 0.008% 97.198% ( 76, 110 ] 1547 0.209% 97.406% ( 110, 170 ] 5881 0.793% 98.200% ( 170, 250 ] 2786 0.376% 98.575% ( 250, 380 ] 1752 0.236% 98.812% ( 380, 580 ] 2111 0.285% 99.097% ( 580, 870 ] 2227 0.300% 99.397% ( 870, 1300 ] 2065 0.279% 99.676% ( 1300, 1900 ] 1484 0.200% 99.876% ( 1900, 2900 ] 917 0.124% 100.000% ( 2900, 4400 ] 796 0.107% 100.107% ( 4400, 6600 ] 223 0.030% 100.137% ( 6600, 9900 ] 25 0.003% 100.140% ( 9900, 14000 ] 10 0.001% 100.142% ( 14000, 22000 ] 7 0.001% 100.143% ( 22000, 33000 ] 4 0.001% 100.143% ( 33000, 50000 ] 1 0.000% 100.143% ( 50000, 75000 ] 1 0.000% 100.144% ** Level 5 read latency histogram (micros): Count: 98577 Average: 460.7175 StdDev: 896.12 Min: 75 Median: 176.1058 Max: 71624 Percentiles: P50: 176.11 P75: 410.22 P99: 4266.24 P99.9: 7218.31 P99.99: 10045.86 ------------------------------------------------------ ( 51, 76 ] 3 0.003% 0.003% ( 76, 110 ] 9727 9.867% 9.870% ## ( 110, 170 ] 38294 38.847% 48.717% ######## ( 170, 250 ] 16581 16.820% 65.538% ### ( 250, 380 ] 8069 8.185% 73.723% ## ( 380, 580 ] 8338 8.458% 82.181% ## ( 580, 870 ] 5924 6.010% 88.191% # ( 870, 1300 ] 4246 4.307% 92.498% # ( 1300, 1900 ] 2642 2.680% 95.178% # ( 1900, 2900 ] 2024 2.053% 97.232% ( 2900, 4400 ] 1915 1.943% 99.174% ( 4400, 6600 ] 696 0.706% 99.880% ( 6600, 9900 ] 109 0.111% 99.991% ( 9900, 14000 ] 4 0.004% 99.995% ( 14000, 22000 ] 3 0.003% 99.998% ( 22000, 33000 ] 3 0.003% 100.001% ( 33000, 50000 ] 1 0.001% 100.002% ( 50000, 75000 ] 3 0.003% 100.005% ** DB Stats ** Uptime(secs): 17.2 total, 4.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 171.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.963 H:M:S, 34.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 214.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.003 H:M:S, 21.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/17-04:29:37 ... thread 0: (1000000,4000000) ops and (251390.9,190188.9) ops/second in (3.977868,21.031722) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.81 GB 75.5 3.5 0.0 3.5 7.3 3.8 0.0 1.9 101.5 211.8 35.37 25.53 70 0.505 3645K 3822 0.0 0.0 L1 14/14 1.35 GB 0.0 1.4 0.8 0.6 1.3 0.8 0.0 1.7 80.8 80.4 17.17 8.60 1 17.170 1408K 7374 0.0 0.0 L3 15/0 961.02 MB 1.0 1.6 1.1 0.6 1.6 1.0 0.3 1.5 104.2 102.7 15.96 7.65 5 3.192 795K 0 0.0 0.0 L4 167/0 9.48 GB 1.0 7.3 4.4 2.9 7.2 4.3 0.1 1.6 111.5 109.8 67.11 35.44 38 1.766 2810K 7408 0.0 0.0 L5 1140/0 93.63 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1354/29 109.21 GB 0.0 13.8 6.2 7.6 17.5 9.9 4.9 4.6 104.1 131.9 135.61 77.23 114 1.190 8660K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.8 6.2 7.6 17.5 9.9 4.9 4.6 104.1 131.9 135.61 77.23 114 1.190 8660K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.8 6.2 7.6 13.6 6.1 0.0 0.0 121.0 119.7 116.76 65.62 57 2.048 8660K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 207.2 18.85 11.61 57 0.331 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.2 total, 21.0 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.46 GB write, 842.74 MB/s write, 13.79 GB read, 665.57 MB/s read, 135.6 seconds Interval compaction: 17.46 GB write, 850.16 MB/s write, 13.79 GB read, 671.43 MB/s read, 135.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 30, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1192733 Average: 14.4436 StdDev: 134.92 Min: 0 Median: 1.6385 Max: 54968 Percentiles: P50: 1.64 P75: 2.39 P99: 255.01 P99.9: 1272.92 P99.99: 2621.32 ------------------------------------------------------ [ 0, 1 ] 186792 15.661% 15.661% ### ( 1, 2 ] 641504 53.784% 69.445% ########### ( 2, 3 ] 170846 14.324% 83.769% ### ( 3, 4 ] 73893 6.195% 89.964% # ( 4, 6 ] 61287 5.138% 95.103% # ( 6, 10 ] 13135 1.101% 96.204% ( 10, 15 ] 2434 0.204% 96.408% ( 15, 22 ] 315 0.026% 96.434% ( 22, 34 ] 33 0.003% 96.437% ( 34, 51 ] 23 0.002% 96.439% ( 51, 76 ] 25 0.002% 96.441% ( 76, 110 ] 4375 0.367% 96.808% ( 110, 170 ] 17352 1.455% 98.263% ( 170, 250 ] 8634 0.724% 98.987% ( 250, 380 ] 4114 0.345% 99.332% ( 380, 580 ] 3702 0.310% 99.642% ( 580, 870 ] 2025 0.170% 99.812% ( 870, 1300 ] 1123 0.094% 99.906% ( 1300, 1900 ] 650 0.054% 99.961% ( 1900, 2900 ] 489 0.041% 100.002% ( 2900, 4400 ] 364 0.031% 100.032% ( 4400, 6600 ] 109 0.009% 100.041% ( 6600, 9900 ] 13 0.001% 100.042% ( 9900, 14000 ] 6 0.001% 100.043% ( 22000, 33000 ] 2 0.000% 100.043% ( 50000, 75000 ] 1 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 155175 Average: 10.0261 StdDev: 88.82 Min: 1 Median: 3.4784 Max: 7450 Percentiles: P50: 3.48 P75: 4.91 P99: 148.71 P99.9: 1135.29 P99.99: 3871.25 ------------------------------------------------------ [ 0, 1 ] 627 0.404% 0.404% ( 1, 2 ] 28301 18.238% 18.642% #### ( 2, 3 ] 31128 20.060% 38.702% #### ( 3, 4 ] 36643 23.614% 62.316% ##### ( 4, 6 ] 43193 27.835% 90.151% ###### ( 6, 10 ] 9801 6.316% 96.467% # ( 10, 15 ] 1921 1.238% 97.705% ( 15, 22 ] 955 0.615% 98.321% ( 22, 34 ] 111 0.072% 98.392% ( 34, 51 ] 13 0.008% 98.401% ( 51, 76 ] 5 0.003% 98.404% ( 76, 110 ] 284 0.183% 98.587% ( 110, 170 ] 994 0.641% 99.227% ( 170, 250 ] 441 0.284% 99.512% ( 250, 380 ] 216 0.139% 99.651% ( 380, 580 ] 196 0.126% 99.777% ( 580, 870 ] 139 0.090% 99.867% ( 870, 1300 ] 84 0.054% 99.921% ( 1300, 1900 ] 53 0.034% 99.955% ( 1900, 2900 ] 37 0.024% 99.979% ( 2900, 4400 ] 27 0.017% 99.996% ( 4400, 6600 ] 6 0.004% 100.000% ( 6600, 9900 ] 2 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 194243 Average: 10.9644 StdDev: 130.60 Min: 1 Median: 1.9374 Max: 7649 Percentiles: P50: 1.94 P75: 2.92 P99: 11.46 P99.9: 1629.09 P99.99: 2659.82 ------------------------------------------------------ [ 0, 1 ] 4423 2.277% 2.277% ( 1, 2 ] 98885 50.908% 53.185% ########## ( 2, 3 ] 46248 23.809% 76.994% ##### ( 3, 4 ] 18573 9.562% 86.556% ## ( 4, 6 ] 18787 9.672% 96.228% ## ( 6, 10 ] 5143 2.648% 98.876% # ( 10, 15 ] 830 0.427% 99.303% ( 15, 22 ] 116 0.060% 99.363% ( 22, 34 ] 9 0.005% 99.367% ( 34, 51 ] 9 0.005% 99.372% ( 51, 76 ] 12 0.006% 99.378% ( 76, 110 ] 23 0.012% 99.390% ( 110, 170 ] 59 0.030% 99.420% ( 170, 250 ] 70 0.036% 99.456% ( 250, 380 ] 104 0.054% 99.510% ( 380, 580 ] 152 0.078% 99.588% ( 580, 870 ] 256 0.132% 99.720% ( 870, 1300 ] 262 0.135% 99.855% ( 1300, 1900 ] 160 0.082% 99.937% ( 1900, 2900 ] 135 0.070% 100.007% ( 2900, 4400 ] 77 0.040% 100.046% ( 4400, 6600 ] 20 0.010% 100.057% ( 6600, 9900 ] 4 0.002% 100.059% ** Level 3 read latency histogram (micros): Count: 958932 Average: 10.9931 StdDev: 161.18 Min: 1 Median: 2.0039 Max: 58824 Percentiles: P50: 2.00 P75: 3.01 P99: 10.47 P99.9: 832.61 P99.99: 1196.71 ------------------------------------------------------ [ 0, 1 ] 14989 1.563% 1.563% ( 1, 2 ] 463544 48.340% 49.903% ########## ( 2, 3 ] 239808 25.008% 74.911% ##### ( 3, 4 ] 99645 10.391% 85.302% ## ( 4, 6 ] 103151 10.757% 96.059% ## ( 6, 10 ] 27778 2.897% 98.955% # ( 10, 15 ] 4520 0.471% 99.427% ( 15, 22 ] 660 0.069% 99.496% ( 22, 34 ] 55 0.006% 99.501% ( 34, 51 ] 51 0.005% 99.507% ( 51, 76 ] 81 0.008% 99.515% ( 76, 110 ] 285 0.030% 99.545% ( 110, 170 ] 987 0.103% 99.648% ( 170, 250 ] 496 0.052% 99.699% ( 250, 380 ] 465 0.048% 99.748% ( 380, 580 ] 668 0.070% 99.818% ( 580, 870 ] 907 0.095% 99.912% ( 870, 1300 ] 982 0.102% 100.015% ( 1300, 1900 ] 682 0.071% 100.086% ( 1900, 2900 ] 544 0.057% 100.142% ( 2900, 4400 ] 531 0.055% 100.198% ( 4400, 6600 ] 117 0.012% 100.210% ( 6600, 9900 ] 19 0.002% 100.212% ( 9900, 14000 ] 5 0.001% 100.213% ( 14000, 22000 ] 4 0.000% 100.213% ( 22000, 33000 ] 3 0.000% 100.213% ( 50000, 75000 ] 1 0.000% 100.213% ** Level 4 read latency histogram (micros): Count: 749602 Average: 26.2348 StdDev: 235.89 Min: 0 Median: 2.0317 Max: 51392 Percentiles: P50: 2.03 P75: 3.17 P99: 537.74 P99.9: 2088.68 P99.99: 2822.79 ------------------------------------------------------ [ 0, 1 ] 12343 1.647% 1.647% ( 1, 2 ] 356749 47.592% 49.238% ########## ( 2, 3 ] 180218 24.042% 73.280% ##### ( 3, 4 ] 74980 10.003% 83.283% ## ( 4, 6 ] 73468 9.801% 93.084% ## ( 6, 10 ] 19201 2.561% 95.645% # ( 10, 15 ] 3194 0.426% 96.071% ( 15, 22 ] 430 0.057% 96.129% ( 22, 34 ] 37 0.005% 96.134% ( 34, 51 ] 46 0.006% 96.140% ( 51, 76 ] 62 0.008% 96.148% ( 76, 110 ] 2501 0.334% 96.482% ( 110, 170 ] 9816 1.309% 97.791% ( 170, 250 ] 4488 0.599% 98.390% ( 250, 380 ] 2464 0.329% 98.719% ( 380, 580 ] 2674 0.357% 99.075% ( 580, 870 ] 2425 0.324% 99.399% ( 870, 1300 ] 2094 0.279% 99.678% ( 1300, 1900 ] 1489 0.199% 99.877% ( 1900, 2900 ] 919 0.123% 99.999% ( 2900, 4400 ] 796 0.106% 100.106% ( 4400, 6600 ] 223 0.030% 100.135% ( 6600, 9900 ] 25 0.003% 100.139% ( 9900, 14000 ] 10 0.001% 100.140% ( 14000, 22000 ] 7 0.001% 100.141% ( 22000, 33000 ] 4 0.001% 100.142% ( 33000, 50000 ] 1 0.000% 100.142% ( 50000, 75000 ] 1 0.000% 100.142% ** Level 5 read latency histogram (micros): Count: 146734 Average: 375.5168 StdDev: 749.17 Min: 75 Median: 166.0338 Max: 71624 Percentiles: P50: 166.03 P75: 312.89 P99: 3888.53 P99.9: 6506.01 P99.99: 9697.96 ------------------------------------------------------ ( 51, 76 ] 4 0.003% 0.003% ( 76, 110 ] 15482 10.551% 10.554% ## ( 110, 170 ] 61979 42.239% 52.793% ######## ( 170, 250 ] 26690 18.189% 70.982% #### ( 250, 380 ] 12186 8.305% 79.287% ## ( 380, 580 ] 11543 7.867% 87.154% ## ( 580, 870 ] 6974 4.753% 91.906% # ( 870, 1300 ] 4422 3.014% 94.920% # ( 1300, 1900 ] 2676 1.824% 96.744% ( 1900, 2900 ] 2047 1.395% 98.139% ( 2900, 4400 ] 1919 1.308% 99.447% ( 4400, 6600 ] 696 0.474% 99.921% ( 6600, 9900 ] 109 0.074% 99.995% ( 9900, 14000 ] 4 0.003% 99.998% ( 14000, 22000 ] 3 0.002% 100.000% ( 22000, 33000 ] 3 0.002% 100.002% ( 33000, 50000 ] 1 0.001% 100.003% ( 50000, 75000 ] 3 0.002% 100.005% ** DB Stats ** Uptime(secs): 21.2 total, 4.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 185.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.446 H:M:S, 30.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 247.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.482 H:M:S, 12.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 249.711 micros/op 16002 ops/sec 60.177 seconds 962996 operations; 15.5 MB/s (240999 of 240999 found) Microseconds per read: Count: 962996 Average: 249.7158 StdDev: 721.15 Min: 3 Median: 189.9561 Max: 92648 Percentiles: P50: 189.96 P75: 237.53 P99: 1154.86 P99.9: 11552.82 P99.99: 29545.89 ------------------------------------------------------ ( 2, 3 ] 1 0.000% 0.000% ( 3, 4 ] 7 0.001% 0.001% ( 4, 6 ] 108 0.011% 0.012% ( 6, 10 ] 249 0.026% 0.038% ( 10, 15 ] 127 0.013% 0.051% ( 15, 22 ] 536 0.056% 0.107% ( 22, 34 ] 16257 1.688% 1.795% ( 34, 51 ] 4691 0.487% 2.282% ( 51, 76 ] 693 0.072% 2.354% ( 76, 110 ] 407 0.042% 2.396% ( 110, 170 ] 357432 37.117% 39.513% ####### ( 170, 250 ] 404849 42.041% 81.554% ######## ( 250, 380 ] 107931 11.208% 92.761% ## ( 380, 580 ] 41475 4.307% 97.068% # ( 580, 870 ] 14727 1.529% 98.598% ( 870, 1300 ] 5851 0.608% 99.205% ( 1300, 1900 ] 2724 0.283% 99.488% ( 1900, 2900 ] 1792 0.186% 99.674% ( 2900, 4400 ] 1330 0.138% 99.812% ( 4400, 6600 ] 463 0.048% 99.860% ( 6600, 9900 ] 202 0.021% 99.881% ( 9900, 14000 ] 449 0.047% 99.928% ( 14000, 22000 ] 491 0.051% 99.979% ( 22000, 33000 ] 157 0.016% 99.995% ( 33000, 50000 ] 32 0.003% 99.998% ( 50000, 75000 ] 9 0.001% 99.999% ( 75000, 110000 ] 6 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 16860629 rocksdb.bloom.filter.full.positive COUNT : 1127599 rocksdb.bloom.filter.full.true.positive COUNT : 962522 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 474 rocksdb.memtable.miss COUNT : 962522 rocksdb.l0.hit COUNT : 41016 rocksdb.l1.hit COUNT : 11683 rocksdb.l2andup.hit COUNT : 909823 rocksdb.compaction.key.drop.new COUNT : 179345 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4796472 rocksdb.number.keys.read COUNT : 962996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4949959104 rocksdb.bytes.read COUNT : 962996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1600 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 41384816 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 18432298351 rocksdb.compact.write.bytes COUNT : 18243028037 rocksdb.flush.write.bytes COUNT : 4888393395 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 44 rocksdb.number.superversion_acquires COUNT : 887 rocksdb.number.superversion_releases COUNT : 856 rocksdb.number.superversion_cleanups COUNT : 220 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 219 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4848792576 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1717248 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 21971580280 rocksdb.non.last.level.read.count COUNT : 5164033 rocksdb.block.checksum.compute.count COUNT : 5602974 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 188.586946 P95 : 482.449019 P99 : 1153.841318 P100 : 92647.000000 COUNT : 962996 SUM : 239332216 rocksdb.db.write.micros P50 : 1.559188 P95 : 5.019619 P99 : 12.570904 P100 : 928650.000000 COUNT : 4796472 SUM : 53953499 rocksdb.compaction.times.micros P50 : 1672500.000000 P95 : 4006000.000000 P99 : 17120000.000000 P100 : 17169616.000000 COUNT : 61 SUM : 124613434 rocksdb.compaction.times.cpu_micros P50 : 1041724.137931 P95 : 1897500.000000 P99 : 7787000.000000 P100 : 8601629.000000 COUNT : 61 SUM : 73378314 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 763.382353 P95 : 63750.000000 P99 : 438900.000000 P100 : 479040.000000 COUNT : 69 SUM : 1014295 rocksdb.compaction.outfile.sync.micros P50 : 43093.750000 P95 : 323125.000000 P99 : 520125.000000 P100 : 1106046.000000 COUNT : 205 SUM : 18514726 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 212.222222 P95 : 4337.500000 P99 : 6435.000000 P100 : 6696.000000 COUNT : 145 SUM : 133402 rocksdb.table.open.io.micros P50 : 9000.000000 P95 : 19972.850679 P99 : 26400.000000 P100 : 88802.000000 COUNT : 1600 SUM : 15051579 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.013072 P95 : 31.267078 P99 : 208.888078 P100 : 58830.000000 COUNT : 4462835 SUM : 79507037 rocksdb.read.block.get.micros P50 : 141.564808 P95 : 337.891972 P99 : 1075.871123 P100 : 81683.000000 COUNT : 1138516 SUM : 196920766 rocksdb.write.raw.block.micros P50 : 0.558065 P95 : 1.679053 P99 : 4.709456 P100 : 83869.000000 COUNT : 5602458 SUM : 17124379 rocksdb.numfiles.in.singlecompaction P50 : 3.345238 P95 : 6.100000 P99 : 24.520000 P100 : 25.000000 COUNT : 79 SUM : 336 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.584481 P95 : 1252.706700 P99 : 2641.368101 P100 : 928492.000000 COUNT : 188965 SUM : 41408558 rocksdb.sst.read.micros P50 : 2.435658 P95 : 169.197754 P99 : 497.282134 P100 : 71624.000000 COUNT : 5164068 SUM : 257242404 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 962996 SUM : 962996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4796472 SUM : 4949959104 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 220181.818182 P95 : 965400.000000 P99 : 1153080.000000 P100 : 1158292.000000 COUNT : 69 SUM : 21400660 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 252 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0