[2024-07-24 21:12:29.347878] Starting SPDK v24.09-pre git sha1 d005e023b / DPDK 23.11.0 initialization... [2024-07-24 21:12:29.348200] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3381433 ] Set seed to 1721848349340661 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-24 21:12:29.496888] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-24 21:12:29.542410] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-24 21:12:29.542462] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3381433' to capture a snapshot of events at runtime. [2024-07-24 21:12:29.542480] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-24 21:12:29.542504] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-24 21:12:29.542516] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3381433 for offline analysis/debug. [2024-07-24 21:12:29.542642] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 24 21:12:33 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/24-21:12:42 ... thread 0: (1000000,1000000) ops and (117495.8,117495.8) ops/second in (8.510946,8.510946) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/4 440.90 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 108.1 7.58 2.70 9 0.842 0 0 0.0 0.0 L1 7/0 562.21 MB 56.2 0.8 0.4 0.4 0.8 0.4 0.0 1.8 121.1 120.8 6.71 4.20 2 3.354 824K 1412 0.0 0.0 L2 2/0 161.71 MB 1.6 0.2 0.1 0.0 0.2 0.1 0.0 1.4 114.0 113.0 1.43 0.82 1 1.431 165K 1463 0.0 0.0 L3 42/8 3.18 GB 2.8 3.3 2.0 1.3 3.3 2.0 0.3 1.6 102.4 101.5 32.82 17.44 15 2.188 2030K 234 0.0 0.0 L4 196/13 12.11 GB 1.2 3.4 2.3 1.0 3.3 2.3 0.2 1.4 102.6 101.4 33.74 18.11 22 1.534 1791K 1222 0.0 0.0 L5 1100/0 90.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1352/25 106.74 GB 0.0 7.6 4.9 2.7 8.3 5.6 0.4 10.4 94.8 103.9 82.28 43.26 49 1.679 4812K 4331 0.0 0.0 Int 0/0 0.00 KB 0.0 7.6 4.9 2.7 8.3 5.6 0.4 10.4 94.8 103.9 82.28 43.26 49 1.679 4812K 4331 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.6 4.9 2.7 7.5 4.8 0.0 0.0 104.4 103.4 74.70 40.56 40 1.868 4812K 4331 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 108.1 7.58 2.70 9 0.842 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.7 total, 8.5 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.34 GB write, 985.13 MB/s write, 7.62 GB read, 899.09 MB/s read, 82.3 seconds Interval compaction: 8.34 GB write, 1003.79 MB/s write, 7.62 GB read, 916.12 MB/s read, 82.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 34, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 190379 Average: 11.2496 StdDev: 215.60 Min: 1 Median: 2.1559 Max: 39417 Percentiles: P50: 2.16 P75: 3.00 P99: 10.21 P99.9: 2385.32 P99.99: 4375.54 ------------------------------------------------------ [ 0, 1 ] 3982 2.092% 2.092% ( 1, 2 ] 82387 43.275% 45.367% ######### ( 2, 3 ] 56579 29.719% 75.086% ###### ( 3, 4 ] 19757 10.378% 85.464% ## ( 4, 6 ] 21272 11.174% 96.637% ## ( 6, 10 ] 4455 2.340% 98.977% ( 10, 15 ] 1072 0.563% 99.540% ( 15, 22 ] 125 0.066% 99.606% ( 22, 34 ] 14 0.007% 99.613% ( 34, 51 ] 6 0.003% 99.617% ( 51, 76 ] 15 0.008% 99.624% ( 76, 110 ] 7 0.004% 99.628% ( 110, 170 ] 4 0.002% 99.630% ( 170, 250 ] 13 0.007% 99.637% ( 250, 380 ] 18 0.009% 99.646% ( 380, 580 ] 61 0.032% 99.679% ( 580, 870 ] 113 0.059% 99.738% ( 870, 1300 ] 135 0.071% 99.809% ( 1300, 1900 ] 130 0.068% 99.877% ( 1900, 2900 ] 94 0.049% 99.926% ( 2900, 4400 ] 125 0.066% 99.992% ( 4400, 6600 ] 36 0.019% 100.011% ( 6600, 9900 ] 4 0.002% 100.013% ( 9900, 14000 ] 1 0.001% 100.014% ( 14000, 22000 ] 3 0.002% 100.015% ( 22000, 33000 ] 4 0.002% 100.017% ( 33000, 50000 ] 1 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 121683 Average: 15.4276 StdDev: 257.03 Min: 1 Median: 2.2510 Max: 31522 Percentiles: P50: 2.25 P75: 3.22 P99: 12.07 P99.9: 3708.64 P99.99: 9471.62 ------------------------------------------------------ [ 0, 1 ] 1992 1.637% 1.637% ( 1, 2 ] 49728 40.867% 42.504% ######## ( 2, 3 ] 36334 29.860% 72.363% ###### ( 3, 4 ] 14334 11.780% 84.143% ## ( 4, 6 ] 14343 11.787% 95.930% ## ( 6, 10 ] 3432 2.820% 98.751% # ( 10, 15 ] 733 0.602% 99.353% ( 15, 22 ] 104 0.085% 99.439% ( 22, 34 ] 13 0.011% 99.449% ( 34, 51 ] 10 0.008% 99.458% ( 51, 76 ] 12 0.010% 99.467% ( 76, 110 ] 6 0.005% 99.472% ( 110, 170 ] 5 0.004% 99.477% ( 170, 250 ] 19 0.016% 99.492% ( 250, 380 ] 16 0.013% 99.505% ( 380, 580 ] 59 0.048% 99.554% ( 580, 870 ] 88 0.072% 99.626% ( 870, 1300 ] 90 0.074% 99.700% ( 1300, 1900 ] 76 0.062% 99.762% ( 1900, 2900 ] 94 0.077% 99.840% ( 2900, 4400 ] 136 0.112% 99.952% ( 4400, 6600 ] 39 0.032% 99.984% ( 6600, 9900 ] 9 0.007% 99.991% ( 9900, 14000 ] 4 0.003% 99.994% ( 14000, 22000 ] 4 0.003% 99.998% ( 22000, 33000 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 367275 Average: 19.4246 StdDev: 291.82 Min: 1 Median: 2.2936 Max: 43175 Percentiles: P50: 2.29 P75: 3.35 P99: 13.39 P99.9: 2383.74 P99.99: 3252.25 ------------------------------------------------------ [ 0, 1 ] 5824 1.586% 1.586% ( 1, 2 ] 146324 39.840% 41.426% ######## ( 2, 3 ] 107266 29.206% 70.632% ###### ( 3, 4 ] 45732 12.452% 83.084% ## ( 4, 6 ] 44504 12.117% 95.201% ## ( 6, 10 ] 11780 3.207% 98.409% # ( 10, 15 ] 3200 0.871% 99.280% ( 15, 22 ] 507 0.138% 99.418% ( 22, 34 ] 99 0.027% 99.445% ( 34, 51 ] 49 0.013% 99.458% ( 51, 76 ] 40 0.011% 99.469% ( 76, 110 ] 20 0.005% 99.475% ( 110, 170 ] 48 0.013% 99.488% ( 170, 250 ] 63 0.017% 99.505% ( 250, 380 ] 115 0.031% 99.536% ( 380, 580 ] 200 0.054% 99.590% ( 580, 870 ] 316 0.086% 99.677% ( 870, 1300 ] 343 0.093% 99.770% ( 1300, 1900 ] 291 0.079% 99.849% ( 1900, 2900 ] 386 0.105% 99.954% ( 2900, 4400 ] 559 0.152% 100.106% ( 4400, 6600 ] 170 0.046% 100.153% ( 6600, 9900 ] 38 0.010% 100.163% ( 9900, 14000 ] 7 0.002% 100.165% ( 14000, 22000 ] 22 0.006% 100.171% ( 22000, 33000 ] 7 0.002% 100.173% ( 33000, 50000 ] 2 0.001% 100.173% ** Level 3 read latency histogram (micros): Count: 896853 Average: 16.2711 StdDev: 265.89 Min: 1 Median: 2.2737 Max: 51171 Percentiles: P50: 2.27 P75: 3.18 P99: 10.40 P99.9: 1449.67 P99.99: 2295.36 ------------------------------------------------------ [ 0, 1 ] 10261 1.144% 1.144% ( 1, 2 ] 360435 40.189% 41.333% ######## ( 2, 3 ] 283985 31.665% 72.998% ###### ( 3, 4 ] 101782 11.349% 84.346% ## ( 4, 6 ] 107243 11.958% 96.304% ## ( 6, 10 ] 23728 2.646% 98.950% # ( 10, 15 ] 5598 0.624% 99.574% ( 15, 22 ] 643 0.072% 99.646% ( 22, 34 ] 64 0.007% 99.653% ( 34, 51 ] 70 0.008% 99.661% ( 51, 76 ] 84 0.009% 99.670% ( 76, 110 ] 63 0.007% 99.677% ( 110, 170 ] 49 0.005% 99.682% ( 170, 250 ] 65 0.007% 99.690% ( 250, 380 ] 136 0.015% 99.705% ( 380, 580 ] 310 0.035% 99.739% ( 580, 870 ] 521 0.058% 99.798% ( 870, 1300 ] 761 0.085% 99.882% ( 1300, 1900 ] 634 0.071% 99.953% ( 1900, 2900 ] 838 0.093% 100.046% ( 2900, 4400 ] 1097 0.122% 100.169% ( 4400, 6600 ] 337 0.038% 100.206% ( 6600, 9900 ] 68 0.008% 100.214% ( 9900, 14000 ] 13 0.001% 100.215% ( 14000, 22000 ] 21 0.002% 100.218% ( 22000, 33000 ] 23 0.003% 100.220% ( 33000, 50000 ] 2 0.000% 100.221% ( 50000, 75000 ] 1 0.000% 100.221% ** Level 4 read latency histogram (micros): Count: 350022 Average: 30.6593 StdDev: 389.40 Min: 1 Median: 2.2829 Max: 59948 Percentiles: P50: 2.28 P75: 3.21 P99: 499.36 P99.9: 3669.15 P99.99: 4218.60 ------------------------------------------------------ [ 0, 1 ] 4368 1.248% 1.248% ( 1, 2 ] 139388 39.823% 41.071% ######## ( 2, 3 ] 110477 31.563% 72.633% ###### ( 3, 4 ] 39515 11.289% 83.923% ## ( 4, 6 ] 40228 11.493% 95.416% ## ( 6, 10 ] 9674 2.764% 98.180% # ( 10, 15 ] 2058 0.588% 98.768% ( 15, 22 ] 227 0.065% 98.832% ( 22, 34 ] 22 0.006% 98.839% ( 34, 51 ] 32 0.009% 98.848% ( 51, 76 ] 41 0.012% 98.860% ( 76, 110 ] 26 0.007% 98.867% ( 110, 170 ] 32 0.009% 98.876% ( 170, 250 ] 81 0.023% 98.899% ( 250, 380 ] 166 0.047% 98.947% ( 380, 580 ] 318 0.091% 99.037% ( 580, 870 ] 618 0.177% 99.214% ( 870, 1300 ] 768 0.219% 99.433% ( 1300, 1900 ] 645 0.184% 99.618% ( 1900, 2900 ] 550 0.157% 99.775% ( 2900, 4400 ] 860 0.246% 100.021% ( 4400, 6600 ] 302 0.086% 100.107% ( 6600, 9900 ] 48 0.014% 100.121% ( 9900, 14000 ] 4 0.001% 100.122% ( 14000, 22000 ] 11 0.003% 100.125% ( 22000, 33000 ] 14 0.004% 100.129% ( 33000, 50000 ] 5 0.001% 100.130% ( 50000, 75000 ] 1 0.000% 100.131% ** Level 5 read latency histogram (micros): Count: 9763 Average: 2497.3401 StdDev: 3181.68 Min: 80 Median: 1762.0000 Max: 102379 Percentiles: P50: 1762.00 P75: 3552.17 P99: 9511.23 P99.9: 44781.00 P99.99: 86943.17 ------------------------------------------------------ ( 76, 110 ] 4 0.041% 0.041% ( 110, 170 ] 46 0.471% 0.512% ( 170, 250 ] 84 0.860% 1.373% ( 250, 380 ] 261 2.673% 4.046% # ( 380, 580 ] 697 7.139% 11.185% # ( 580, 870 ] 1158 11.861% 23.046% ## ( 870, 1300 ] 1592 16.306% 39.353% ### ( 1300, 1900 ] 1350 13.828% 53.180% ### ( 1900, 2900 ] 1312 13.438% 66.619% ### ( 2900, 4400 ] 1882 19.277% 85.896% #### ( 4400, 6600 ] 1050 10.755% 96.651% ## ( 6600, 9900 ] 260 2.663% 99.314% # ( 9900, 14000 ] 21 0.215% 99.529% ( 14000, 22000 ] 15 0.154% 99.682% ( 22000, 33000 ] 15 0.154% 99.836% ( 33000, 50000 ] 9 0.092% 99.928% ( 50000, 75000 ] 5 0.051% 99.980% ( 75000, 110000 ] 3 0.031% 100.010% ** DB Stats ** Uptime(secs): 8.7 total, 8.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 113.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.539 H:M:S, 40.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 115.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.539 H:M:S, 41.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/24-21:12:50 ... thread 0: (1000000,2000000) ops and (128735.8,122859.2) ops/second in (7.767848,16.278794) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/5 1007.35 MB 31.5 0.7 0.0 0.7 2.5 1.8 0.0 1.4 35.7 129.7 19.42 8.88 23 0.844 703K 896 0.0 0.0 L1 2/2 170.21 MB 0.0 1.3 0.9 0.5 1.3 0.9 0.0 1.5 122.6 122.3 11.24 7.24 3 3.746 1398K 2417 0.0 0.0 L2 2/1 170.86 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.7 1.7 136.1 135.4 3.08 2.09 2 1.538 425K 2022 0.0 0.0 L3 31/11 1.71 GB 1.0 5.1 2.5 2.7 5.1 2.4 0.6 2.1 108.4 107.6 48.63 27.24 22 2.211 3317K 3887 0.0 0.0 L4 169/12 9.65 GB 0.9 8.5 4.3 4.2 8.4 4.2 0.5 1.9 106.5 104.5 82.02 45.51 45 1.823 3717K 8949 0.0 0.0 L5 1156/0 94.92 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1369/31 107.59 GB 0.0 16.1 7.9 8.2 17.7 9.5 6.4 9.9 100.3 110.2 164.38 90.95 95 1.730 9562K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.1 7.9 8.2 17.7 9.5 6.4 9.9 100.3 110.2 164.38 90.95 95 1.730 9562K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.1 7.9 8.2 15.9 7.7 0.0 0.0 110.7 109.3 149.00 85.15 74 2.014 9562K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 118.8 15.38 5.80 21 0.732 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.4 total, 16.3 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.69 GB write, 1101.88 MB/s write, 16.11 GB read, 1003.13 MB/s read, 164.4 seconds Interval compaction: 17.69 GB write, 1112.80 MB/s write, 16.11 GB read, 1013.07 MB/s read, 164.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 59, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 442888 Average: 12.5585 StdDev: 235.76 Min: 1 Median: 2.1799 Max: 58053 Percentiles: P50: 2.18 P75: 3.01 P99: 11.84 P99.9: 2584.49 P99.99: 4742.22 ------------------------------------------------------ [ 0, 1 ] 8746 1.975% 1.975% ( 1, 2 ] 188498 42.561% 44.536% ######### ( 2, 3 ] 134543 30.379% 74.914% ###### ( 3, 4 ] 45321 10.233% 85.147% ## ( 4, 6 ] 49163 11.101% 96.248% ## ( 6, 10 ] 11240 2.538% 98.786% # ( 10, 15 ] 2584 0.583% 99.369% ( 15, 22 ] 301 0.068% 99.437% ( 22, 34 ] 25 0.006% 99.443% ( 34, 51 ] 28 0.006% 99.449% ( 51, 76 ] 58 0.013% 99.462% ( 76, 110 ] 24 0.005% 99.468% ( 110, 170 ] 32 0.007% 99.475% ( 170, 250 ] 92 0.021% 99.496% ( 250, 380 ] 153 0.035% 99.530% ( 380, 580 ] 351 0.079% 99.610% ( 580, 870 ] 462 0.104% 99.714% ( 870, 1300 ] 408 0.092% 99.806% ( 1300, 1900 ] 273 0.062% 99.868% ( 1900, 2900 ] 212 0.048% 99.916% ( 2900, 4400 ] 316 0.071% 99.987% ( 4400, 6600 ] 101 0.023% 100.010% ( 6600, 9900 ] 12 0.003% 100.012% ( 9900, 14000 ] 3 0.001% 100.013% ( 14000, 22000 ] 5 0.001% 100.014% ( 22000, 33000 ] 11 0.002% 100.017% ( 33000, 50000 ] 2 0.000% 100.017% ( 50000, 75000 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 339337 Average: 12.4526 StdDev: 209.68 Min: 1 Median: 2.2321 Max: 31522 Percentiles: P50: 2.23 P75: 3.10 P99: 11.27 P99.9: 2250.86 P99.99: 3970.98 ------------------------------------------------------ [ 0, 1 ] 4126 1.216% 1.216% ( 1, 2 ] 140958 41.539% 42.755% ######## ( 2, 3 ] 105919 31.214% 73.969% ###### ( 3, 4 ] 36737 10.826% 84.795% ## ( 4, 6 ] 38282 11.281% 96.076% ## ( 6, 10 ] 9404 2.771% 98.847% # ( 10, 15 ] 2045 0.603% 99.450% ( 15, 22 ] 232 0.068% 99.518% ( 22, 34 ] 26 0.008% 99.526% ( 34, 51 ] 22 0.006% 99.533% ( 51, 76 ] 50 0.015% 99.547% ( 76, 110 ] 11 0.003% 99.551% ( 110, 170 ] 27 0.008% 99.559% ( 170, 250 ] 53 0.016% 99.574% ( 250, 380 ] 82 0.024% 99.598% ( 380, 580 ] 194 0.057% 99.656% ( 580, 870 ] 276 0.081% 99.737% ( 870, 1300 ] 271 0.080% 99.817% ( 1300, 1900 ] 216 0.064% 99.880% ( 1900, 2900 ] 190 0.056% 99.936% ( 2900, 4400 ] 255 0.075% 100.011% ( 4400, 6600 ] 76 0.022% 100.034% ( 6600, 9900 ] 15 0.004% 100.038% ( 9900, 14000 ] 5 0.001% 100.040% ( 14000, 22000 ] 10 0.003% 100.043% ( 22000, 33000 ] 4 0.001% 100.044% ** Level 2 read latency histogram (micros): Count: 509118 Average: 16.5397 StdDev: 277.98 Min: 1 Median: 2.2811 Max: 43175 Percentiles: P50: 2.28 P75: 3.29 P99: 12.53 P99.9: 2169.41 P99.99: 3275.22 ------------------------------------------------------ [ 0, 1 ] 7375 1.449% 1.449% ( 1, 2 ] 204364 40.141% 41.589% ######## ( 2, 3 ] 152322 29.919% 71.508% ###### ( 3, 4 ] 60862 11.954% 83.463% ## ( 4, 6 ] 61355 12.051% 95.514% ## ( 6, 10 ] 15736 3.091% 98.605% # ( 10, 15 ] 3985 0.783% 99.387% ( 15, 22 ] 591 0.116% 99.503% ( 22, 34 ] 107 0.021% 99.524% ( 34, 51 ] 66 0.013% 99.537% ( 51, 76 ] 68 0.013% 99.551% ( 76, 110 ] 31 0.006% 99.557% ( 110, 170 ] 56 0.011% 99.568% ( 170, 250 ] 76 0.015% 99.583% ( 250, 380 ] 153 0.030% 99.613% ( 380, 580 ] 234 0.046% 99.659% ( 580, 870 ] 382 0.075% 99.734% ( 870, 1300 ] 409 0.080% 99.814% ( 1300, 1900 ] 324 0.064% 99.878% ( 1900, 2900 ] 419 0.082% 99.960% ( 2900, 4400 ] 608 0.119% 100.080% ( 4400, 6600 ] 186 0.037% 100.116% ( 6600, 9900 ] 43 0.008% 100.125% ( 9900, 14000 ] 9 0.002% 100.126% ( 14000, 22000 ] 30 0.006% 100.132% ( 22000, 33000 ] 8 0.002% 100.134% ( 33000, 50000 ] 4 0.001% 100.135% ** Level 3 read latency histogram (micros): Count: 1576864 Average: 14.5994 StdDev: 266.10 Min: 1 Median: 2.2721 Max: 64557 Percentiles: P50: 2.27 P75: 3.16 P99: 10.66 P99.9: 1248.39 P99.99: 2142.41 ------------------------------------------------------ [ 0, 1 ] 16582 1.052% 1.052% ( 1, 2 ] 634810 40.258% 41.309% ######## ( 2, 3 ] 503616 31.938% 73.247% ###### ( 3, 4 ] 174630 11.075% 84.322% ## ( 4, 6 ] 186035 11.798% 96.119% ## ( 6, 10 ] 44112 2.797% 98.917% # ( 10, 15 ] 9887 0.627% 99.544% ( 15, 22 ] 1163 0.074% 99.618% ( 22, 34 ] 112 0.007% 99.625% ( 34, 51 ] 165 0.010% 99.635% ( 51, 76 ] 243 0.015% 99.651% ( 76, 110 ] 123 0.008% 99.658% ( 110, 170 ] 116 0.007% 99.666% ( 170, 250 ] 202 0.013% 99.679% ( 250, 380 ] 367 0.023% 99.702% ( 380, 580 ] 772 0.049% 99.751% ( 580, 870 ] 1181 0.075% 99.826% ( 870, 1300 ] 1332 0.084% 99.910% ( 1300, 1900 ] 982 0.062% 99.972% ( 1900, 2900 ] 1144 0.073% 100.045% ( 2900, 4400 ] 1560 0.099% 100.144% ( 4400, 6600 ] 471 0.030% 100.174% ( 6600, 9900 ] 105 0.007% 100.180% ( 9900, 14000 ] 24 0.002% 100.182% ( 14000, 22000 ] 31 0.002% 100.184% ( 22000, 33000 ] 31 0.002% 100.186% ( 33000, 50000 ] 8 0.001% 100.186% ( 50000, 75000 ] 5 0.000% 100.187% ** Level 4 read latency histogram (micros): Count: 1099917 Average: 24.6644 StdDev: 332.94 Min: 1 Median: 2.2885 Max: 66375 Percentiles: P50: 2.29 P75: 3.22 P99: 21.05 P99.9: 2753.95 P99.99: 3526.46 ------------------------------------------------------ [ 0, 1 ] 12205 1.110% 1.110% ( 1, 2 ] 436946 39.725% 40.835% ######## ( 2, 3 ] 349439 31.770% 72.605% ###### ( 3, 4 ] 121536 11.050% 83.654% ## ( 4, 6 ] 128753 11.706% 95.360% ## ( 6, 10 ] 32093 2.918% 98.278% # ( 10, 15 ] 7266 0.661% 98.938% ( 15, 22 ] 786 0.071% 99.010% ( 22, 34 ] 60 0.005% 99.015% ( 34, 51 ] 105 0.010% 99.025% ( 51, 76 ] 192 0.017% 99.042% ( 76, 110 ] 92 0.008% 99.050% ( 110, 170 ] 114 0.010% 99.061% ( 170, 250 ] 268 0.024% 99.085% ( 250, 380 ] 676 0.061% 99.147% ( 380, 580 ] 1245 0.113% 99.260% ( 580, 870 ] 2150 0.195% 99.455% ( 870, 1300 ] 2178 0.198% 99.653% ( 1300, 1900 ] 1550 0.141% 99.794% ( 1900, 2900 ] 1362 0.124% 99.918% ( 2900, 4400 ] 1894 0.172% 100.090% ( 4400, 6600 ] 675 0.061% 100.152% ( 6600, 9900 ] 124 0.011% 100.163% ( 9900, 14000 ] 20 0.002% 100.165% ( 14000, 22000 ] 38 0.003% 100.168% ( 22000, 33000 ] 31 0.003% 100.171% ( 33000, 50000 ] 7 0.001% 100.172% ( 50000, 75000 ] 2 0.000% 100.172% ** Level 5 read latency histogram (micros): Count: 27671 Average: 1754.5502 StdDev: 2498.06 Min: 80 Median: 1063.2929 Max: 102379 Percentiles: P50: 1063.29 P75: 2328.33 P99: 8168.64 P99.9: 32407.06 P99.99: 70091.39 ------------------------------------------------------ ( 76, 110 ] 39 0.141% 0.141% ( 110, 170 ] 346 1.250% 1.391% ( 170, 250 ] 825 2.981% 4.373% # ( 250, 380 ] 1819 6.574% 10.946% # ( 380, 580 ] 3586 12.959% 23.906% ### ( 580, 870 ] 4981 18.001% 41.907% #### ( 870, 1300 ] 4982 18.004% 59.911% #### ( 1300, 1900 ] 3116 11.261% 71.172% ## ( 1900, 2900 ] 2473 8.937% 80.109% ## ( 2900, 4400 ] 3406 12.309% 92.418% ## ( 4400, 6600 ] 1663 6.010% 98.428% # ( 6600, 9900 ] 333 1.203% 99.631% ( 9900, 14000 ] 25 0.090% 99.722% ( 14000, 22000 ] 20 0.072% 99.794% ( 22000, 33000 ] 31 0.112% 99.906% ( 33000, 50000 ] 16 0.058% 99.964% ( 50000, 75000 ] 9 0.033% 99.996% ( 75000, 110000 ] 3 0.011% 100.007% ** DB Stats ** Uptime(secs): 16.4 total, 7.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 119.72 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.615 H:M:S, 40.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.076 H:M:S, 39.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/24-21:12:55 ... thread 0: (1000000,3000000) ops and (195761.3,140271.8) ops/second in (5.108261,21.387055) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 1.97 GB 107.0 1.5 0.0 1.5 4.4 2.8 0.0 1.5 55.3 156.9 28.50 16.01 41 0.695 1599K 1868 0.0 0.0 L1 2/2 170.21 MB 0.0 1.3 0.9 0.5 1.3 0.9 0.0 1.5 122.6 122.3 11.24 7.24 3 3.746 1398K 2417 0.0 0.0 L2 1/0 55.45 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.7 1.7 136.1 135.4 3.08 2.09 2 1.538 425K 2022 0.0 0.0 L3 17/0 927.25 MB 0.9 5.5 2.6 3.0 5.5 2.5 0.6 2.1 110.5 109.7 51.37 29.16 23 2.233 3595K 3887 0.0 0.0 L4 171/0 9.53 GB 1.0 10.6 5.1 5.5 10.4 4.9 0.6 2.1 111.1 109.0 97.91 56.12 58 1.688 5209K 21K 0.0 0.0 L5 1168/0 95.90 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1373/11 108.53 GB 0.0 19.5 8.8 10.7 22.0 11.3 7.5 7.8 103.7 117.5 192.10 110.62 127 1.513 12M 31K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.5 8.8 10.7 22.0 11.3 7.5 7.8 103.7 117.5 192.10 110.62 127 1.513 12M 31K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.5 8.8 10.7 19.2 8.5 0.0 0.0 116.0 114.6 171.73 101.46 91 1.887 12M 31K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 142.3 20.36 9.16 36 0.566 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.5 total, 21.4 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.04 GB write, 1047.36 MB/s write, 19.46 GB read, 924.67 MB/s read, 192.1 seconds Interval compaction: 22.04 GB write, 1055.25 MB/s write, 19.46 GB read, 931.64 MB/s read, 192.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 74, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 74, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 802154 Average: 12.6142 StdDev: 192.47 Min: 1 Median: 1.9690 Max: 58053 Percentiles: P50: 1.97 P75: 2.88 P99: 173.52 P99.9: 1483.99 P99.99: 3575.84 ------------------------------------------------------ [ 0, 1 ] 34946 4.357% 4.357% # ( 1, 2 ] 377860 47.106% 51.462% ######### ( 2, 3 ] 213933 26.670% 78.132% ##### ( 3, 4 ] 70581 8.799% 86.931% ## ( 4, 6 ] 71300 8.889% 95.820% ## ( 6, 10 ] 16038 1.999% 97.819% ( 10, 15 ] 3929 0.490% 98.309% ( 15, 22 ] 484 0.060% 98.369% ( 22, 34 ] 61 0.008% 98.377% ( 34, 51 ] 45 0.006% 98.382% ( 51, 76 ] 68 0.008% 98.391% ( 76, 110 ] 896 0.112% 98.502% ( 110, 170 ] 3890 0.485% 98.987% ( 170, 250 ] 2374 0.296% 99.283% ( 250, 380 ] 1529 0.191% 99.474% ( 380, 580 ] 1587 0.198% 99.672% ( 580, 870 ] 1064 0.133% 99.804% ( 870, 1300 ] 657 0.082% 99.886% ( 1300, 1900 ] 368 0.046% 99.932% ( 1900, 2900 ] 278 0.035% 99.967% ( 2900, 4400 ] 419 0.052% 100.019% ( 4400, 6600 ] 122 0.015% 100.034% ( 6600, 9900 ] 19 0.002% 100.037% ( 9900, 14000 ] 3 0.000% 100.037% ( 14000, 22000 ] 5 0.001% 100.038% ( 22000, 33000 ] 12 0.001% 100.039% ( 33000, 50000 ] 2 0.000% 100.039% ( 50000, 75000 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 385218 Average: 12.5189 StdDev: 207.26 Min: 1 Median: 2.2454 Max: 31522 Percentiles: P50: 2.25 P75: 3.13 P99: 12.04 P99.9: 2281.28 P99.99: 4085.37 ------------------------------------------------------ [ 0, 1 ] 4737 1.230% 1.230% ( 1, 2 ] 158326 41.100% 42.330% ######## ( 2, 3 ] 120402 31.256% 73.586% ###### ( 3, 4 ] 41774 10.844% 84.430% ## ( 4, 6 ] 44175 11.468% 95.897% ## ( 6, 10 ] 10979 2.850% 98.747% # ( 10, 15 ] 2380 0.618% 99.365% ( 15, 22 ] 292 0.076% 99.441% ( 22, 34 ] 36 0.009% 99.450% ( 34, 51 ] 22 0.006% 99.456% ( 51, 76 ] 50 0.013% 99.469% ( 76, 110 ] 39 0.010% 99.479% ( 110, 170 ] 176 0.046% 99.525% ( 170, 250 ] 128 0.033% 99.558% ( 250, 380 ] 144 0.037% 99.596% ( 380, 580 ] 250 0.065% 99.660% ( 580, 870 ] 319 0.083% 99.743% ( 870, 1300 ] 292 0.076% 99.819% ( 1300, 1900 ] 234 0.061% 99.880% ( 1900, 2900 ] 204 0.053% 99.933% ( 2900, 4400 ] 279 0.072% 100.005% ( 4400, 6600 ] 96 0.025% 100.030% ( 6600, 9900 ] 20 0.005% 100.035% ( 9900, 14000 ] 6 0.002% 100.037% ( 14000, 22000 ] 11 0.003% 100.040% ( 22000, 33000 ] 4 0.001% 100.041% ** Level 2 read latency histogram (micros): Count: 509237 Average: 16.5938 StdDev: 277.99 Min: 1 Median: 2.2815 Max: 43175 Percentiles: P50: 2.28 P75: 3.29 P99: 12.66 P99.9: 2169.12 P99.99: 3275.19 ------------------------------------------------------ [ 0, 1 ] 7375 1.448% 1.448% ( 1, 2 ] 204364 40.131% 41.580% ######## ( 2, 3 ] 152326 29.913% 71.492% ###### ( 3, 4 ] 60865 11.952% 83.444% ## ( 4, 6 ] 61358 12.049% 95.493% ## ( 6, 10 ] 15737 3.090% 98.584% # ( 10, 15 ] 3985 0.783% 99.366% ( 15, 22 ] 591 0.116% 99.482% ( 22, 34 ] 107 0.021% 99.503% ( 34, 51 ] 66 0.013% 99.516% ( 51, 76 ] 68 0.013% 99.530% ( 76, 110 ] 41 0.008% 99.538% ( 110, 170 ] 88 0.017% 99.555% ( 170, 250 ] 107 0.021% 99.576% ( 250, 380 ] 166 0.033% 99.609% ( 380, 580 ] 249 0.049% 99.658% ( 580, 870 ] 386 0.076% 99.733% ( 870, 1300 ] 411 0.081% 99.814% ( 1300, 1900 ] 325 0.064% 99.878% ( 1900, 2900 ] 419 0.082% 99.960% ( 2900, 4400 ] 608 0.119% 100.080% ( 4400, 6600 ] 186 0.037% 100.116% ( 6600, 9900 ] 43 0.008% 100.124% ( 9900, 14000 ] 9 0.002% 100.126% ( 14000, 22000 ] 30 0.006% 100.132% ( 22000, 33000 ] 8 0.002% 100.134% ( 33000, 50000 ] 4 0.001% 100.135% ** Level 3 read latency histogram (micros): Count: 1829411 Average: 13.4822 StdDev: 249.80 Min: 1 Median: 2.2431 Max: 64557 Percentiles: P50: 2.24 P75: 3.11 P99: 10.59 P99.9: 1128.06 P99.99: 1966.26 ------------------------------------------------------ [ 0, 1 ] 24136 1.319% 1.319% ( 1, 2 ] 750416 41.020% 42.339% ######## ( 2, 3 ] 576565 31.516% 73.855% ###### ( 3, 4 ] 197556 10.799% 84.654% ## ( 4, 6 ] 210582 11.511% 96.165% ## ( 6, 10 ] 50552 2.763% 98.928% # ( 10, 15 ] 11094 0.606% 99.535% ( 15, 22 ] 1286 0.070% 99.605% ( 22, 34 ] 132 0.007% 99.612% ( 34, 51 ] 192 0.010% 99.623% ( 51, 76 ] 288 0.016% 99.639% ( 76, 110 ] 209 0.011% 99.650% ( 110, 170 ] 481 0.026% 99.676% ( 170, 250 ] 472 0.026% 99.702% ( 250, 380 ] 556 0.030% 99.732% ( 380, 580 ] 953 0.052% 99.785% ( 580, 870 ] 1281 0.070% 99.855% ( 870, 1300 ] 1384 0.076% 99.930% ( 1300, 1900 ] 1016 0.056% 99.986% ( 1900, 2900 ] 1163 0.064% 100.049% ( 2900, 4400 ] 1619 0.088% 100.138% ( 4400, 6600 ] 489 0.027% 100.165% ( 6600, 9900 ] 117 0.006% 100.171% ( 9900, 14000 ] 24 0.001% 100.172% ( 14000, 22000 ] 31 0.002% 100.174% ( 22000, 33000 ] 31 0.002% 100.176% ( 33000, 50000 ] 8 0.000% 100.176% ( 50000, 75000 ] 5 0.000% 100.176% ** Level 4 read latency histogram (micros): Count: 1449471 Average: 22.6490 StdDev: 312.31 Min: 1 Median: 2.2619 Max: 66375 Percentiles: P50: 2.26 P75: 3.17 P99: 191.24 P99.9: 2363.83 P99.99: 3255.38 ------------------------------------------------------ [ 0, 1 ] 17485 1.206% 1.206% ( 1, 2 ] 588174 40.579% 41.785% ######## ( 2, 3 ] 454681 31.369% 73.154% ###### ( 3, 4 ] 154746 10.676% 83.830% ## ( 4, 6 ] 163581 11.286% 95.115% ## ( 6, 10 ] 41947 2.894% 98.009% # ( 10, 15 ] 9256 0.639% 98.648% ( 15, 22 ] 964 0.067% 98.714% ( 22, 34 ] 77 0.005% 98.720% ( 34, 51 ] 146 0.010% 98.730% ( 51, 76 ] 263 0.018% 98.748% ( 76, 110 ] 617 0.043% 98.790% ( 110, 170 ] 2555 0.176% 98.967% ( 170, 250 ] 1824 0.126% 99.092% ( 250, 380 ] 1765 0.122% 99.214% ( 380, 580 ] 2265 0.156% 99.370% ( 580, 870 ] 2762 0.191% 99.561% ( 870, 1300 ] 2510 0.173% 99.734% ( 1300, 1900 ] 1705 0.118% 99.852% ( 1900, 2900 ] 1506 0.104% 99.956% ( 2900, 4400 ] 2098 0.145% 100.100% ( 4400, 6600 ] 767 0.053% 100.153% ( 6600, 9900 ] 148 0.010% 100.164% ( 9900, 14000 ] 25 0.002% 100.165% ( 14000, 22000 ] 41 0.003% 100.168% ( 22000, 33000 ] 35 0.002% 100.171% ( 33000, 50000 ] 11 0.001% 100.171% ( 50000, 75000 ] 2 0.000% 100.171% ** Level 5 read latency histogram (micros): Count: 66496 Average: 941.8402 StdDev: 1818.05 Min: 75 Median: 392.0515 Max: 102379 Percentiles: P50: 392.05 P75: 999.35 P99: 6373.91 P99.9: 15914.43 P99.99: 43997.30 ------------------------------------------------------ ( 51, 76 ] 2 0.003% 0.003% ( 76, 110 ] 3249 4.886% 4.889% # ( 110, 170 ] 14217 21.380% 26.269% #### ( 170, 250 ] 8732 13.132% 39.401% ### ( 250, 380 ] 6566 9.874% 49.275% ## ( 380, 580 ] 7999 12.029% 61.304% ## ( 580, 870 ] 7269 10.931% 72.236% ## ( 870, 1300 ] 6110 9.189% 81.424% ## ( 1300, 1900 ] 3539 5.322% 86.747% # ( 1900, 2900 ] 2733 4.110% 90.857% # ( 2900, 4400 ] 3774 5.676% 96.532% # ( 4400, 6600 ] 1829 2.751% 99.283% # ( 6600, 9900 ] 375 0.564% 99.847% ( 9900, 14000 ] 30 0.045% 99.892% ( 14000, 22000 ] 23 0.035% 99.926% ( 22000, 33000 ] 32 0.048% 99.974% ( 33000, 50000 ] 16 0.024% 99.998% ( 50000, 75000 ] 9 0.014% 100.012% ( 75000, 110000 ] 3 0.005% 100.017% ** DB Stats ** Uptime(secs): 21.6 total, 5.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 137.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.416 H:M:S, 34.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 192.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.801 H:M:S, 15.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-21:12:59 ... thread 0: (1000000,4000000) ops and (260187.9,158538.7) ops/second in (3.843377,25.230432) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 2.95 GB 207.7 2.5 0.0 2.5 6.3 3.7 0.0 1.7 72.7 180.7 35.54 22.55 60 0.592 2622K 2845 0.0 0.0 L1 2/2 170.21 MB 0.0 1.3 0.9 0.5 1.3 0.9 0.0 1.5 122.6 122.3 11.24 7.24 3 3.746 1398K 2417 0.0 0.0 L2 1/0 55.45 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.7 1.7 136.1 135.4 3.08 2.09 2 1.538 425K 2022 0.0 0.0 L3 17/0 927.25 MB 0.9 5.5 2.6 3.0 5.5 2.5 0.6 2.1 110.5 109.7 51.37 29.16 23 2.233 3595K 3887 0.0 0.0 L4 171/0 9.53 GB 1.0 10.6 5.1 5.5 10.4 4.9 0.6 2.1 111.1 109.0 97.91 56.12 58 1.688 5209K 21K 0.0 0.0 L5 1168/0 95.90 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1377/11 109.51 GB 0.0 20.4 8.8 11.7 23.9 12.3 7.5 6.4 105.1 123.1 199.14 117.17 146 1.364 13M 32K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.4 8.8 11.7 23.9 12.3 7.5 6.4 105.1 123.1 199.14 117.17 146 1.364 13M 32K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.4 8.8 11.7 20.2 8.5 0.0 0.0 119.2 117.7 175.69 105.33 95 1.849 13M 32K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 163.9 23.45 11.84 51 0.460 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.4 total, 25.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.95 GB write, 965.70 MB/s write, 20.44 GB read, 824.41 MB/s read, 199.1 seconds Interval compaction: 23.95 GB write, 971.88 MB/s write, 20.44 GB read, 829.68 MB/s read, 199.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 74, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 74, interval: 75 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1090155 Average: 13.2911 StdDev: 167.78 Min: 1 Median: 1.8268 Max: 58053 Percentiles: P50: 1.83 P75: 2.75 P99: 224.06 P99.9: 1088.37 P99.99: 2878.67 ------------------------------------------------------ [ 0, 1 ] 99356 9.114% 9.114% ## ( 1, 2 ] 539061 49.448% 58.562% ########## ( 2, 3 ] 240080 22.023% 80.585% #### ( 3, 4 ] 79657 7.307% 87.892% # ( 4, 6 ] 76442 7.012% 94.904% # ( 6, 10 ] 17465 1.602% 96.506% ( 10, 15 ] 4243 0.389% 96.895% ( 15, 22 ] 575 0.053% 96.948% ( 22, 34 ] 96 0.009% 96.956% ( 34, 51 ] 53 0.005% 96.961% ( 51, 76 ] 86 0.008% 96.969% ( 76, 110 ] 3597 0.330% 97.299% ( 110, 170 ] 14015 1.286% 98.585% ( 170, 250 ] 6700 0.615% 99.199% ( 250, 380 ] 3164 0.290% 99.490% ( 380, 580 ] 2873 0.264% 99.753% ( 580, 870 ] 1256 0.115% 99.868% ( 870, 1300 ] 681 0.062% 99.931% ( 1300, 1900 ] 370 0.034% 99.965% ( 1900, 2900 ] 282 0.026% 99.991% ( 2900, 4400 ] 426 0.039% 100.030% ( 4400, 6600 ] 122 0.011% 100.041% ( 6600, 9900 ] 19 0.002% 100.043% ( 9900, 14000 ] 3 0.000% 100.043% ( 14000, 22000 ] 5 0.000% 100.043% ( 22000, 33000 ] 12 0.001% 100.044% ( 33000, 50000 ] 2 0.000% 100.045% ( 50000, 75000 ] 1 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 401871 Average: 12.2959 StdDev: 202.99 Min: 1 Median: 2.2719 Max: 31522 Percentiles: P50: 2.27 P75: 3.22 P99: 12.94 P99.9: 2199.65 P99.99: 4076.41 ------------------------------------------------------ [ 0, 1 ] 4983 1.240% 1.240% ( 1, 2 ] 162144 40.347% 41.587% ######## ( 2, 3 ] 124332 30.938% 72.526% ###### ( 3, 4 ] 44907 11.174% 83.700% ## ( 4, 6 ] 48152 11.982% 95.682% ## ( 6, 10 ] 11788 2.933% 98.615% # ( 10, 15 ] 2629 0.654% 99.269% ( 15, 22 ] 426 0.106% 99.375% ( 22, 34 ] 72 0.018% 99.393% ( 34, 51 ] 25 0.006% 99.400% ( 51, 76 ] 50 0.012% 99.412% ( 76, 110 ] 93 0.023% 99.435% ( 110, 170 ] 352 0.088% 99.523% ( 170, 250 ] 186 0.046% 99.569% ( 250, 380 ] 165 0.041% 99.610% ( 380, 580 ] 257 0.064% 99.674% ( 580, 870 ] 320 0.080% 99.754% ( 870, 1300 ] 293 0.073% 99.827% ( 1300, 1900 ] 234 0.058% 99.885% ( 1900, 2900 ] 204 0.051% 99.936% ( 2900, 4400 ] 279 0.069% 100.005% ( 4400, 6600 ] 96 0.024% 100.029% ( 6600, 9900 ] 20 0.005% 100.034% ( 9900, 14000 ] 6 0.001% 100.035% ( 14000, 22000 ] 11 0.003% 100.038% ( 22000, 33000 ] 4 0.001% 100.039% ** Level 2 read latency histogram (micros): Count: 509413 Average: 16.6526 StdDev: 277.97 Min: 1 Median: 2.2821 Max: 43175 Percentiles: P50: 2.28 P75: 3.30 P99: 12.88 P99.9: 2168.70 P99.99: 3275.14 ------------------------------------------------------ [ 0, 1 ] 7375 1.448% 1.448% ( 1, 2 ] 204364 40.118% 41.565% ######## ( 2, 3 ] 152326 29.902% 71.468% ###### ( 3, 4 ] 60865 11.948% 83.416% ## ( 4, 6 ] 61358 12.045% 95.460% ## ( 6, 10 ] 15737 3.089% 98.550% # ( 10, 15 ] 3985 0.782% 99.332% ( 15, 22 ] 591 0.116% 99.448% ( 22, 34 ] 107 0.021% 99.469% ( 34, 51 ] 66 0.013% 99.482% ( 51, 76 ] 68 0.013% 99.495% ( 76, 110 ] 70 0.014% 99.509% ( 110, 170 ] 179 0.035% 99.544% ( 170, 250 ] 137 0.027% 99.571% ( 250, 380 ] 178 0.035% 99.606% ( 380, 580 ] 259 0.051% 99.657% ( 580, 870 ] 389 0.076% 99.733% ( 870, 1300 ] 412 0.081% 99.814% ( 1300, 1900 ] 325 0.064% 99.878% ( 1900, 2900 ] 419 0.082% 99.960% ( 2900, 4400 ] 608 0.119% 100.080% ( 4400, 6600 ] 186 0.037% 100.116% ( 6600, 9900 ] 43 0.008% 100.124% ( 9900, 14000 ] 9 0.002% 100.126% ( 14000, 22000 ] 30 0.006% 100.132% ( 22000, 33000 ] 8 0.002% 100.134% ( 33000, 50000 ] 4 0.001% 100.134% ** Level 3 read latency histogram (micros): Count: 1830788 Average: 13.5967 StdDev: 249.77 Min: 1 Median: 2.2442 Max: 64557 Percentiles: P50: 2.24 P75: 3.11 P99: 11.15 P99.9: 1127.94 P99.99: 1966.94 ------------------------------------------------------ [ 0, 1 ] 24136 1.318% 1.318% ( 1, 2 ] 750429 40.989% 42.308% ######## ( 2, 3 ] 576601 31.495% 73.802% ###### ( 3, 4 ] 197572 10.792% 84.594% ## ( 4, 6 ] 210635 11.505% 96.099% ## ( 6, 10 ] 50553 2.761% 98.860% # ( 10, 15 ] 11095 0.606% 99.467% ( 15, 22 ] 1286 0.070% 99.537% ( 22, 34 ] 132 0.007% 99.544% ( 34, 51 ] 192 0.010% 99.554% ( 51, 76 ] 288 0.016% 99.570% ( 76, 110 ] 421 0.023% 99.593% ( 110, 170 ] 1140 0.062% 99.655% ( 170, 250 ] 673 0.037% 99.692% ( 250, 380 ] 653 0.036% 99.728% ( 380, 580 ] 1030 0.056% 99.784% ( 580, 870 ] 1291 0.071% 99.855% ( 870, 1300 ] 1384 0.076% 99.930% ( 1300, 1900 ] 1016 0.055% 99.986% ( 1900, 2900 ] 1164 0.064% 100.049% ( 2900, 4400 ] 1619 0.088% 100.138% ( 4400, 6600 ] 489 0.027% 100.164% ( 6600, 9900 ] 117 0.006% 100.171% ( 9900, 14000 ] 24 0.001% 100.172% ( 14000, 22000 ] 31 0.002% 100.174% ( 22000, 33000 ] 31 0.002% 100.176% ( 33000, 50000 ] 8 0.000% 100.176% ( 50000, 75000 ] 5 0.000% 100.176% ** Level 4 read latency histogram (micros): Count: 1458823 Average: 23.5468 StdDev: 311.63 Min: 1 Median: 2.2719 Max: 66375 Percentiles: P50: 2.27 P75: 3.22 P99: 242.48 P99.9: 2357.98 P99.99: 3254.71 ------------------------------------------------------ [ 0, 1 ] 17485 1.199% 1.199% ( 1, 2 ] 588237 40.323% 41.521% ######## ( 2, 3 ] 454982 31.188% 72.710% ###### ( 3, 4 ] 154877 10.617% 83.326% ## ( 4, 6 ] 163874 11.233% 94.559% ## ( 6, 10 ] 41979 2.878% 97.437% # ( 10, 15 ] 9265 0.635% 98.072% ( 15, 22 ] 969 0.066% 98.139% ( 22, 34 ] 78 0.005% 98.144% ( 34, 51 ] 146 0.010% 98.154% ( 51, 76 ] 263 0.018% 98.172% ( 76, 110 ] 1908 0.131% 98.303% ( 110, 170 ] 7116 0.488% 98.791% ( 170, 250 ] 3373 0.231% 99.022% ( 250, 380 ] 2346 0.161% 99.183% ( 380, 580 ] 2732 0.187% 99.370% ( 580, 870 ] 2822 0.193% 99.563% ( 870, 1300 ] 2515 0.172% 99.736% ( 1300, 1900 ] 1707 0.117% 99.853% ( 1900, 2900 ] 1507 0.103% 99.956% ( 2900, 4400 ] 2098 0.144% 100.100% ( 4400, 6600 ] 767 0.053% 100.152% ( 6600, 9900 ] 148 0.010% 100.163% ( 9900, 14000 ] 25 0.002% 100.164% ( 14000, 22000 ] 41 0.003% 100.167% ( 22000, 33000 ] 35 0.002% 100.169% ( 33000, 50000 ] 11 0.001% 100.170% ( 50000, 75000 ] 2 0.000% 100.170% ** Level 5 read latency histogram (micros): Count: 119080 Average: 604.9865 StdDev: 1412.23 Min: 72 Median: 196.7682 Max: 102379 Percentiles: P50: 196.77 P75: 514.75 P99: 5710.14 P99.9: 9520.90 P99.99: 25812.87 ------------------------------------------------------ ( 51, 76 ] 6 0.005% 0.005% ( 76, 110 ] 11596 9.738% 9.743% ## ( 110, 170 ] 41877 35.167% 44.910% ####### ( 170, 250 ] 18114 15.212% 60.122% ### ( 250, 380 ] 10323 8.669% 68.791% ## ( 380, 580 ] 10974 9.216% 78.006% ## ( 580, 870 ] 7699 6.465% 84.472% # ( 870, 1300 ] 6148 5.163% 89.635% # ( 1300, 1900 ] 3547 2.979% 92.613% # ( 1900, 2900 ] 2741 2.302% 94.915% ( 2900, 4400 ] 3775 3.170% 98.085% # ( 4400, 6600 ] 1829 1.536% 99.621% ( 6600, 9900 ] 375 0.315% 99.936% ( 9900, 14000 ] 30 0.025% 99.961% ( 14000, 22000 ] 23 0.019% 99.981% ( 22000, 33000 ] 32 0.027% 100.008% ( 33000, 50000 ] 16 0.013% 100.021% ( 50000, 75000 ] 9 0.008% 100.029% ( 75000, 110000 ] 3 0.003% 100.031% ** DB Stats ** Uptime(secs): 25.4 total, 3.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 155.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.453 H:M:S, 29.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 256.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.037 H:M:S, 1.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-21:13:03 ... thread 0: (1000000,5000000) ops and (204817.8,166042.2) ops/second in (4.882389,30.112821) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 3.26 GB 69.3 3.5 0.0 3.5 8.2 4.7 0.0 1.7 83.8 196.8 42.87 29.35 80 0.536 3646K 3760 0.0 0.0 L1 11/11 859.69 MB 0.0 2.2 1.5 0.6 2.2 1.5 0.0 1.4 96.2 96.0 23.27 12.82 4 5.818 2274K 5194 0.0 0.0 L2 1/0 55.45 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.7 1.7 136.1 135.4 3.08 2.09 2 1.538 425K 2022 0.0 0.0 L3 17/0 927.25 MB 0.9 5.5 2.6 3.0 5.5 2.5 0.6 2.1 110.5 109.7 51.37 29.16 23 2.233 3595K 3887 0.0 0.0 L4 171/0 9.53 GB 1.0 10.6 5.1 5.5 10.4 4.9 0.6 2.1 111.1 109.0 97.91 56.12 58 1.688 5209K 21K 0.0 0.0 L5 1168/0 95.90 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1385/23 110.49 GB 0.0 22.3 9.4 12.8 26.8 13.9 7.5 5.6 104.4 125.4 218.50 129.54 167 1.308 15M 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.3 9.4 12.8 26.8 13.9 7.5 5.6 104.4 125.4 218.50 129.54 167 1.308 15M 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.3 9.4 12.8 22.0 9.2 0.0 0.0 119.0 117.6 191.67 114.78 100 1.917 15M 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 180.8 26.83 14.76 67 0.400 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.3 total, 30.1 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.75 GB write, 904.92 MB/s write, 22.27 GB read, 753.25 MB/s read, 218.5 seconds Interval compaction: 26.75 GB write, 909.77 MB/s write, 22.27 GB read, 757.28 MB/s read, 218.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 74, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 74, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1389746 Average: 13.6870 StdDev: 150.98 Min: 0 Median: 1.7650 Max: 58053 Percentiles: P50: 1.77 P75: 2.67 P99: 231.46 P99.9: 854.62 P99.99: 2088.24 ------------------------------------------------------ [ 0, 1 ] 160662 11.561% 11.561% ## ( 1, 2 ] 698283 50.245% 61.806% ########## ( 2, 3 ] 272678 19.621% 81.427% #### ( 3, 4 ] 94586 6.806% 88.233% # ( 4, 6 ] 83938 6.040% 94.272% # ( 6, 10 ] 19239 1.384% 95.657% ( 10, 15 ] 4694 0.338% 95.995% ( 15, 22 ] 722 0.052% 96.046% ( 22, 34 ] 148 0.011% 96.057% ( 34, 51 ] 59 0.004% 96.061% ( 51, 76 ] 100 0.007% 96.069% ( 76, 110 ] 7292 0.525% 96.593% ( 110, 170 ] 25158 1.810% 98.404% ( 170, 250 ] 10790 0.776% 99.180% ( 250, 380 ] 4628 0.333% 99.513% ( 380, 580 ] 3973 0.286% 99.799% ( 580, 870 ] 1485 0.107% 99.906% ( 870, 1300 ] 745 0.054% 99.959% ( 1300, 1900 ] 373 0.027% 99.986% ( 1900, 2900 ] 287 0.021% 100.007% ( 2900, 4400 ] 430 0.031% 100.038% ( 4400, 6600 ] 122 0.009% 100.046% ( 6600, 9900 ] 19 0.001% 100.048% ( 9900, 14000 ] 3 0.000% 100.048% ( 14000, 22000 ] 5 0.000% 100.048% ( 22000, 33000 ] 12 0.001% 100.049% ( 33000, 50000 ] 2 0.000% 100.049% ( 50000, 75000 ] 1 0.000% 100.050% ** Level 1 read latency histogram (micros): Count: 420065 Average: 12.3061 StdDev: 198.86 Min: 1 Median: 2.2871 Max: 31522 Percentiles: P50: 2.29 P75: 3.28 P99: 14.48 P99.9: 2110.47 P99.99: 4066.63 ------------------------------------------------------ [ 0, 1 ] 5537 1.318% 1.318% ( 1, 2 ] 167560 39.889% 41.207% ######## ( 2, 3 ] 128643 30.625% 71.832% ###### ( 3, 4 ] 48078 11.445% 83.277% ## ( 4, 6 ] 51120 12.170% 95.447% ## ( 6, 10 ] 12411 2.955% 98.401% # ( 10, 15 ] 2810 0.669% 99.070% ( 15, 22 ] 539 0.128% 99.198% ( 22, 34 ] 96 0.023% 99.221% ( 34, 51 ] 31 0.007% 99.229% ( 51, 76 ] 50 0.012% 99.241% ( 76, 110 ] 227 0.054% 99.295% ( 110, 170 ] 771 0.184% 99.478% ( 170, 250 ] 319 0.076% 99.554% ( 250, 380 ] 220 0.052% 99.606% ( 380, 580 ] 316 0.075% 99.682% ( 580, 870 ] 338 0.080% 99.762% ( 870, 1300 ] 301 0.072% 99.834% ( 1300, 1900 ] 235 0.056% 99.890% ( 1900, 2900 ] 204 0.049% 99.938% ( 2900, 4400 ] 279 0.066% 100.005% ( 4400, 6600 ] 96 0.023% 100.028% ( 6600, 9900 ] 20 0.005% 100.032% ( 9900, 14000 ] 6 0.001% 100.034% ( 14000, 22000 ] 11 0.003% 100.036% ( 22000, 33000 ] 4 0.001% 100.037% ** Level 2 read latency histogram (micros): Count: 509606 Average: 16.7121 StdDev: 277.95 Min: 1 Median: 2.2827 Max: 43175 Percentiles: P50: 2.28 P75: 3.30 P99: 13.12 P99.9: 2168.24 P99.99: 3275.10 ------------------------------------------------------ [ 0, 1 ] 7375 1.447% 1.447% ( 1, 2 ] 204364 40.102% 41.550% ######## ( 2, 3 ] 152326 29.891% 71.440% ###### ( 3, 4 ] 60865 11.944% 83.384% ## ( 4, 6 ] 61358 12.040% 95.424% ## ( 6, 10 ] 15737 3.088% 98.512% # ( 10, 15 ] 3985 0.782% 99.294% ( 15, 22 ] 591 0.116% 99.410% ( 22, 34 ] 107 0.021% 99.431% ( 34, 51 ] 66 0.013% 99.444% ( 51, 76 ] 68 0.013% 99.458% ( 76, 110 ] 107 0.021% 99.479% ( 110, 170 ] 284 0.056% 99.534% ( 170, 250 ] 168 0.033% 99.567% ( 250, 380 ] 187 0.037% 99.604% ( 380, 580 ] 265 0.052% 99.656% ( 580, 870 ] 393 0.077% 99.733% ( 870, 1300 ] 413 0.081% 99.814% ( 1300, 1900 ] 325 0.064% 99.878% ( 1900, 2900 ] 419 0.082% 99.960% ( 2900, 4400 ] 608 0.119% 100.079% ( 4400, 6600 ] 186 0.036% 100.116% ( 6600, 9900 ] 43 0.008% 100.124% ( 9900, 14000 ] 9 0.002% 100.126% ( 14000, 22000 ] 30 0.006% 100.132% ( 22000, 33000 ] 8 0.002% 100.134% ( 33000, 50000 ] 4 0.001% 100.134% ** Level 3 read latency histogram (micros): Count: 1832628 Average: 13.7556 StdDev: 249.72 Min: 1 Median: 2.2458 Max: 64557 Percentiles: P50: 2.25 P75: 3.12 P99: 11.97 P99.9: 1128.05 P99.99: 1967.59 ------------------------------------------------------ [ 0, 1 ] 24136 1.317% 1.317% ( 1, 2 ] 750429 40.948% 42.265% ######## ( 2, 3 ] 576601 31.463% 73.728% ###### ( 3, 4 ] 197572 10.781% 84.509% ## ( 4, 6 ] 210635 11.494% 96.003% ## ( 6, 10 ] 50553 2.758% 98.761% # ( 10, 15 ] 11095 0.605% 99.367% ( 15, 22 ] 1286 0.070% 99.437% ( 22, 34 ] 132 0.007% 99.444% ( 34, 51 ] 192 0.010% 99.454% ( 51, 76 ] 288 0.016% 99.470% ( 76, 110 ] 798 0.044% 99.514% ( 110, 170 ] 2121 0.116% 99.629% ( 170, 250 ] 942 0.051% 99.681% ( 250, 380 ] 756 0.041% 99.722% ( 380, 580 ] 1124 0.061% 99.783% ( 580, 870 ] 1303 0.071% 99.855% ( 870, 1300 ] 1387 0.076% 99.930% ( 1300, 1900 ] 1016 0.055% 99.986% ( 1900, 2900 ] 1165 0.064% 100.049% ( 2900, 4400 ] 1619 0.088% 100.138% ( 4400, 6600 ] 489 0.027% 100.164% ( 6600, 9900 ] 117 0.006% 100.171% ( 9900, 14000 ] 24 0.001% 100.172% ( 14000, 22000 ] 31 0.002% 100.174% ( 22000, 33000 ] 31 0.002% 100.175% ( 33000, 50000 ] 8 0.000% 100.176% ( 50000, 75000 ] 5 0.000% 100.176% ** Level 4 read latency histogram (micros): Count: 1471406 Average: 24.7840 StdDev: 310.77 Min: 1 Median: 2.2855 Max: 66375 Percentiles: P50: 2.29 P75: 3.28 P99: 293.05 P99.9: 2349.70 P99.99: 3253.09 ------------------------------------------------------ [ 0, 1 ] 17485 1.188% 1.188% ( 1, 2 ] 588280 39.981% 41.169% ######## ( 2, 3 ] 455165 30.934% 72.103% ###### ( 3, 4 ] 154980 10.533% 82.636% ## ( 4, 6 ] 164047 11.149% 93.785% ## ( 6, 10 ] 41997 2.854% 96.639% # ( 10, 15 ] 9270 0.630% 97.269% ( 15, 22 ] 970 0.066% 97.335% ( 22, 34 ] 78 0.005% 97.340% ( 34, 51 ] 146 0.010% 97.350% ( 51, 76 ] 263 0.018% 97.368% ( 76, 110 ] 4042 0.275% 97.643% ( 110, 170 ] 13683 0.930% 98.573% ( 170, 250 ] 5278 0.359% 98.931% ( 250, 380 ] 3044 0.207% 99.138% ( 380, 580 ] 3340 0.227% 99.365% ( 580, 870 ] 2926 0.199% 99.564% ( 870, 1300 ] 2554 0.174% 99.738% ( 1300, 1900 ] 1708 0.116% 99.854% ( 1900, 2900 ] 1509 0.103% 99.956% ( 2900, 4400 ] 2098 0.143% 100.099% ( 4400, 6600 ] 767 0.052% 100.151% ( 6600, 9900 ] 148 0.010% 100.161% ( 9900, 14000 ] 25 0.002% 100.163% ( 14000, 22000 ] 41 0.003% 100.166% ( 22000, 33000 ] 35 0.002% 100.168% ( 33000, 50000 ] 11 0.001% 100.169% ( 50000, 75000 ] 2 0.000% 100.169% ** Level 5 read latency histogram (micros): Count: 188703 Average: 445.8208 StdDev: 1143.09 Min: 72 Median: 162.5323 Max: 102379 Percentiles: P50: 162.53 P75: 327.16 P99: 4848.62 P99.9: 8732.21 P99.99: 16479.90 ------------------------------------------------------ ( 51, 76 ] 16 0.008% 0.008% ( 76, 110 ] 24521 12.994% 13.003% ### ( 110, 170 ] 79739 42.256% 55.259% ######## ( 170, 250 ] 28713 15.216% 70.475% ### ( 250, 380 ] 14386 7.624% 78.099% ## ( 380, 580 ] 14314 7.585% 85.684% ## ( 580, 870 ] 8325 4.412% 90.096% # ( 870, 1300 ] 6334 3.357% 93.453% # ( 1300, 1900 ] 3566 1.890% 95.342% ( 1900, 2900 ] 2752 1.458% 96.801% ( 2900, 4400 ] 3777 2.002% 98.802% ( 4400, 6600 ] 1829 0.969% 99.772% ( 6600, 9900 ] 375 0.199% 99.970% ( 9900, 14000 ] 30 0.016% 99.986% ( 14000, 22000 ] 23 0.012% 99.998% ( 22000, 33000 ] 32 0.017% 100.015% ( 33000, 50000 ] 16 0.008% 100.024% ( 50000, 75000 ] 9 0.005% 100.029% ( 75000, 110000 ] 3 0.002% 100.030% ** DB Stats ** Uptime(secs): 30.3 total, 4.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 162.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.416 H:M:S, 27.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 201.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.962 H:M:S, 19.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/24-21:13:21 ... thread 0: (1000000,6000000) ops and (55982.1,125063.4) ops/second in (17.862842,47.975663) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 4.24 GB 169.5 5.5 0.0 5.5 11.2 5.7 0.0 2.0 104.4 212.2 54.29 40.14 101 0.537 5756K 9248 0.0 0.0 L1 11/11 859.69 MB 0.0 2.2 1.5 0.6 2.2 1.5 0.0 1.4 96.2 96.0 23.27 12.82 4 5.818 2274K 5194 0.0 0.0 L2 1/0 55.45 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.7 1.7 136.1 135.4 3.08 2.09 2 1.538 425K 2022 0.0 0.0 L3 17/0 927.25 MB 0.9 5.5 2.6 3.0 5.5 2.5 0.6 2.1 110.5 109.7 51.37 29.16 23 2.233 3595K 3887 0.0 0.0 L4 171/0 9.53 GB 1.0 10.6 5.1 5.5 10.4 4.9 0.6 2.1 111.1 109.0 97.91 56.12 58 1.688 5209K 21K 0.0 0.0 L5 1168/0 95.90 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1385/23 111.47 GB 0.0 24.3 9.4 14.9 29.8 14.9 7.5 5.2 108.2 132.6 229.92 140.33 188 1.223 17M 42K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.3 9.4 14.9 29.8 14.9 7.5 5.2 108.2 132.6 229.92 140.33 188 1.223 17M 42K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.3 9.4 14.9 24.0 9.2 0.0 0.0 124.6 123.3 199.71 122.67 105 1.902 17M 42K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 194.0 30.21 17.66 83 0.364 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.1 total, 48.0 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.76 GB write, 633.12 MB/s write, 24.30 GB read, 516.90 MB/s read, 229.9 seconds Interval compaction: 29.76 GB write, 635.24 MB/s write, 24.30 GB read, 518.64 MB/s read, 229.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 74, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 74, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2133886 Average: 17.5743 StdDev: 127.78 Min: 0 Median: 1.7446 Max: 58053 Percentiles: P50: 1.74 P75: 2.77 P99: 233.15 P99.9: 645.22 P99.99: 1185.86 ------------------------------------------------------ [ 0, 1 ] 288633 13.526% 13.526% ### ( 1, 2 ] 1045247 48.983% 62.509% ########## ( 2, 3 ] 347245 16.273% 78.782% ### ( 3, 4 ] 141708 6.641% 85.423% # ( 4, 6 ] 112722 5.282% 90.706% # ( 6, 10 ] 23570 1.105% 91.810% ( 10, 15 ] 5597 0.262% 92.072% ( 15, 22 ] 918 0.043% 92.116% ( 22, 34 ] 223 0.010% 92.126% ( 34, 51 ] 63 0.003% 92.129% ( 51, 76 ] 136 0.006% 92.135% ( 76, 110 ] 30031 1.407% 93.543% ( 110, 170 ] 96987 4.545% 98.088% # ( 170, 250 ] 24662 1.156% 99.243% ( 250, 380 ] 7493 0.351% 99.595% ( 380, 580 ] 6125 0.287% 99.882% ( 580, 870 ] 1748 0.082% 99.964% ( 870, 1300 ] 770 0.036% 100.000% ( 1300, 1900 ] 379 0.018% 100.017% ( 1900, 2900 ] 316 0.015% 100.032% ( 2900, 4400 ] 463 0.022% 100.054% ( 4400, 6600 ] 122 0.006% 100.060% ( 6600, 9900 ] 19 0.001% 100.060% ( 9900, 14000 ] 3 0.000% 100.061% ( 14000, 22000 ] 5 0.000% 100.061% ( 22000, 33000 ] 12 0.001% 100.061% ( 33000, 50000 ] 2 0.000% 100.062% ( 50000, 75000 ] 1 0.000% 100.062% ** Level 1 read latency histogram (micros): Count: 462704 Average: 13.2122 StdDev: 190.20 Min: 1 Median: 2.3950 Max: 31522 Percentiles: P50: 2.40 P75: 3.56 P99: 145.76 P99.9: 1906.32 P99.99: 4043.71 ------------------------------------------------------ [ 0, 1 ] 5980 1.292% 1.292% ( 1, 2 ] 172079 37.190% 38.482% ####### ( 2, 3 ] 134912 29.157% 67.640% ###### ( 3, 4 ] 60327 13.038% 80.677% ### ( 4, 6 ] 62506 13.509% 94.186% ### ( 6, 10 ] 13933 3.011% 97.198% # ( 10, 15 ] 3228 0.698% 97.895% ( 15, 22 ] 968 0.209% 98.104% ( 22, 34 ] 156 0.034% 98.138% ( 34, 51 ] 34 0.007% 98.145% ( 51, 76 ] 54 0.012% 98.157% ( 76, 110 ] 1405 0.304% 98.461% ( 110, 170 ] 4186 0.905% 99.365% ( 170, 250 ] 832 0.180% 99.545% ( 250, 380 ] 325 0.070% 99.616% ( 380, 580 ] 426 0.092% 99.708% ( 580, 870 ] 352 0.076% 99.784% ( 870, 1300 ] 302 0.065% 99.849% ( 1300, 1900 ] 235 0.051% 99.900% ( 1900, 2900 ] 205 0.044% 99.944% ( 2900, 4400 ] 279 0.060% 100.004% ( 4400, 6600 ] 96 0.021% 100.025% ( 6600, 9900 ] 20 0.004% 100.029% ( 9900, 14000 ] 6 0.001% 100.031% ( 14000, 22000 ] 11 0.002% 100.033% ( 22000, 33000 ] 4 0.001% 100.034% ** Level 2 read latency histogram (micros): Count: 510483 Average: 16.9382 StdDev: 277.78 Min: 1 Median: 2.2856 Max: 43175 Percentiles: P50: 2.29 P75: 3.31 P99: 14.21 P99.9: 2166.15 P99.99: 3274.88 ------------------------------------------------------ [ 0, 1 ] 7375 1.445% 1.445% ( 1, 2 ] 204364 40.033% 41.478% ######## ( 2, 3 ] 152326 29.840% 71.318% ###### ( 3, 4 ] 60865 11.923% 83.241% ## ( 4, 6 ] 61358 12.020% 95.260% ## ( 6, 10 ] 15737 3.083% 98.343% # ( 10, 15 ] 3985 0.781% 99.124% ( 15, 22 ] 591 0.116% 99.240% ( 22, 34 ] 107 0.021% 99.261% ( 34, 51 ] 66 0.013% 99.273% ( 51, 76 ] 68 0.013% 99.287% ( 76, 110 ] 296 0.058% 99.345% ( 110, 170 ] 839 0.164% 99.509% ( 170, 250 ] 259 0.051% 99.560% ( 250, 380 ] 210 0.041% 99.601% ( 380, 580 ] 282 0.055% 99.656% ( 580, 870 ] 395 0.077% 99.734% ( 870, 1300 ] 413 0.081% 99.814% ( 1300, 1900 ] 325 0.064% 99.878% ( 1900, 2900 ] 419 0.082% 99.960% ( 2900, 4400 ] 608 0.119% 100.079% ( 4400, 6600 ] 186 0.036% 100.116% ( 6600, 9900 ] 43 0.008% 100.124% ( 9900, 14000 ] 9 0.002% 100.126% ( 14000, 22000 ] 30 0.006% 100.132% ( 22000, 33000 ] 8 0.002% 100.133% ( 33000, 50000 ] 4 0.001% 100.134% ** Level 3 read latency histogram (micros): Count: 1840370 Average: 14.3099 StdDev: 249.39 Min: 1 Median: 2.2525 Max: 64557 Percentiles: P50: 2.25 P75: 3.15 P99: 20.15 P99.9: 1126.27 P99.99: 1968.58 ------------------------------------------------------ [ 0, 1 ] 24136 1.311% 1.311% ( 1, 2 ] 750429 40.776% 42.087% ######## ( 2, 3 ] 576601 31.331% 73.418% ###### ( 3, 4 ] 197572 10.735% 84.154% ## ( 4, 6 ] 210635 11.445% 95.599% ## ( 6, 10 ] 50553 2.747% 98.346% # ( 10, 15 ] 11095 0.603% 98.949% ( 15, 22 ] 1286 0.070% 99.019% ( 22, 34 ] 132 0.007% 99.026% ( 34, 51 ] 192 0.010% 99.036% ( 51, 76 ] 291 0.016% 99.052% ( 76, 110 ] 2723 0.148% 99.200% ( 110, 170 ] 6831 0.371% 99.571% ( 170, 250 ] 1683 0.091% 99.663% ( 250, 380 ] 945 0.051% 99.714% ( 380, 580 ] 1278 0.069% 99.783% ( 580, 870 ] 1321 0.072% 99.855% ( 870, 1300 ] 1387 0.075% 99.930% ( 1300, 1900 ] 1016 0.055% 99.986% ( 1900, 2900 ] 1166 0.063% 100.049% ( 2900, 4400 ] 1620 0.088% 100.137% ( 4400, 6600 ] 489 0.027% 100.164% ( 6600, 9900 ] 117 0.006% 100.170% ( 9900, 14000 ] 24 0.001% 100.171% ( 14000, 22000 ] 31 0.002% 100.173% ( 22000, 33000 ] 31 0.002% 100.175% ( 33000, 50000 ] 8 0.000% 100.175% ( 50000, 75000 ] 5 0.000% 100.175% ** Level 4 read latency histogram (micros): Count: 1524147 Average: 28.9927 StdDev: 306.43 Min: 1 Median: 2.3434 Max: 66375 Percentiles: P50: 2.34 P75: 3.53 P99: 335.85 P99.9: 2314.70 P99.99: 3247.18 ------------------------------------------------------ [ 0, 1 ] 17485 1.147% 1.147% ( 1, 2 ] 588282 38.597% 39.745% ######## ( 2, 3 ] 455184 29.865% 69.609% ###### ( 3, 4 ] 154994 10.169% 79.779% ## ( 4, 6 ] 164072 10.765% 90.544% ## ( 6, 10 ] 42000 2.756% 93.299% # ( 10, 15 ] 9271 0.608% 93.907% ( 15, 22 ] 970 0.064% 93.971% ( 22, 34 ] 78 0.005% 93.976% ( 34, 51 ] 146 0.010% 93.986% ( 51, 76 ] 266 0.017% 94.003% ( 76, 110 ] 15758 1.034% 95.037% ( 110, 170 ] 46744 3.067% 98.104% # ( 170, 250 ] 10876 0.714% 98.818% ( 250, 380 ] 4209 0.276% 99.094% ( 380, 580 ] 4335 0.284% 99.378% ( 580, 870 ] 3056 0.201% 99.579% ( 870, 1300 ] 2559 0.168% 99.747% ( 1300, 1900 ] 1710 0.112% 99.859% ( 1900, 2900 ] 1514 0.099% 99.958% ( 2900, 4400 ] 2098 0.138% 100.096% ( 4400, 6600 ] 767 0.050% 100.146% ( 6600, 9900 ] 148 0.010% 100.156% ( 9900, 14000 ] 25 0.002% 100.157% ( 14000, 22000 ] 41 0.003% 100.160% ( 22000, 33000 ] 35 0.002% 100.162% ( 33000, 50000 ] 11 0.001% 100.163% ( 50000, 75000 ] 2 0.000% 100.163% ** Level 5 read latency histogram (micros): Count: 481192 Average: 263.3167 StdDev: 732.71 Min: 71 Median: 143.9794 Max: 102379 Percentiles: P50: 143.98 P75: 178.48 P99: 3347.57 P99.9: 6415.73 P99.99: 9062.95 ------------------------------------------------------ ( 51, 76 ] 60 0.012% 0.012% ( 76, 110 ] 91532 19.022% 19.034% #### ( 110, 170 ] 263109 54.679% 73.713% ########### ( 170, 250 ] 58434 12.144% 85.857% ## ( 250, 380 ] 20846 4.332% 90.189% # ( 380, 580 ] 19551 4.063% 94.252% # ( 580, 870 ] 8977 1.866% 96.117% ( 870, 1300 ] 6383 1.326% 97.444% ( 1300, 1900 ] 3585 0.745% 98.189% ( 1900, 2900 ] 2775 0.577% 98.766% ( 2900, 4400 ] 3784 0.786% 99.552% ( 4400, 6600 ] 1829 0.380% 99.932% ( 6600, 9900 ] 375 0.078% 100.010% ( 9900, 14000 ] 30 0.006% 100.016% ( 14000, 22000 ] 23 0.005% 100.021% ( 22000, 33000 ] 32 0.007% 100.028% ( 33000, 50000 ] 16 0.003% 100.031% ( 50000, 75000 ] 9 0.002% 100.033% ( 75000, 110000 ] 3 0.001% 100.033% ** DB Stats ** Uptime(secs): 48.1 total, 17.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 122.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.040 H:M:S, 45.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 55.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.624 H:M:S, 76.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 279.724 micros/op 14289 ops/sec 60.185 seconds 859996 operations; 13.8 MB/s (217999 of 217999 found) Microseconds per read: Count: 859996 Average: 279.7275 StdDev: 1115.35 Min: 2 Median: 175.6128 Max: 201082 Percentiles: P50: 175.61 P75: 236.88 P99: 1882.13 P99.9: 17157.95 P99.99: 42288.73 ------------------------------------------------------ ( 1, 2 ] 10 0.001% 0.001% ( 2, 3 ] 38 0.004% 0.006% ( 3, 4 ] 48 0.006% 0.011% ( 4, 6 ] 83 0.010% 0.021% ( 6, 10 ] 322 0.037% 0.058% ( 10, 15 ] 4355 0.506% 0.565% ( 15, 22 ] 3708 0.431% 0.996% ( 22, 34 ] 8466 0.984% 1.980% ( 34, 51 ] 3069 0.357% 2.337% ( 51, 76 ] 544 0.063% 2.400% ( 76, 110 ] 18193 2.115% 4.516% ( 110, 170 ] 371464 43.194% 47.710% ######### ( 170, 250 ] 280759 32.647% 80.356% ####### ( 250, 380 ] 92090 10.708% 91.064% ## ( 380, 580 ] 40683 4.731% 95.795% # ( 580, 870 ] 15913 1.850% 97.645% ( 870, 1300 ] 7873 0.915% 98.561% ( 1300, 1900 ] 3894 0.453% 99.013% ( 1900, 2900 ] 2509 0.292% 99.305% ( 2900, 4400 ] 2949 0.343% 99.648% ( 4400, 6600 ] 1379 0.160% 99.808% ( 6600, 9900 ] 318 0.037% 99.845% ( 9900, 14000 ] 244 0.028% 99.874% ( 14000, 22000 ] 570 0.066% 99.940% ( 22000, 33000 ] 376 0.044% 99.984% ( 33000, 50000 ] 97 0.011% 99.995% ( 50000, 75000 ] 27 0.003% 99.998% ( 75000, 110000 ] 6 0.001% 99.999% ( 110000, 170000 ] 8 0.001% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 16248870 rocksdb.bloom.filter.full.positive COUNT : 1017417 rocksdb.bloom.filter.full.true.positive COUNT : 859552 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 444 rocksdb.memtable.miss COUNT : 859552 rocksdb.l0.hit COUNT : 32554 rocksdb.l1.hit COUNT : 6099 rocksdb.l2andup.hit COUNT : 820899 rocksdb.compaction.key.drop.new COUNT : 288250 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6046246 rocksdb.number.keys.read COUNT : 859996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6239725872 rocksdb.bytes.read COUNT : 859996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1750 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33821753 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27467417481 rocksdb.compact.write.bytes COUNT : 27169144787 rocksdb.flush.write.bytes COUNT : 6209383094 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 1253 rocksdb.number.superversion_releases COUNT : 1205 rocksdb.number.superversion_cleanups COUNT : 313 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 336 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6159300608 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2380800 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31223896761 rocksdb.non.last.level.read.count COUNT : 7402197 rocksdb.block.checksum.compute.count COUNT : 7681777 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 174.223152 P95 : 545.629388 P99 : 1881.005149 P100 : 201082.000000 COUNT : 859996 SUM : 239900276 rocksdb.db.write.micros P50 : 1.676724 P95 : 5.358739 P99 : 9.417500 P100 : 933425.000000 COUNT : 6046246 SUM : 51424779 rocksdb.compaction.times.micros P50 : 1582812.500000 P95 : 4075000.000000 P99 : 6445000.000000 P100 : 12033556.000000 COUNT : 105 SUM : 199708664 rocksdb.compaction.times.cpu_micros P50 : 975161.290323 P95 : 2675000.000000 P99 : 4265000.000000 P100 : 5578243.000000 COUNT : 105 SUM : 122668152 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 783.000000 P95 : 9805.714286 P99 : 19390.000000 P100 : 19390.000000 COUNT : 84 SUM : 212218 rocksdb.compaction.outfile.sync.micros P50 : 6078.947368 P95 : 21232.000000 P99 : 48368.000000 P100 : 114784.000000 COUNT : 348 SUM : 2813932 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 420.000000 P95 : 5420.000000 P99 : 9702.000000 P100 : 35360.000000 COUNT : 218 SUM : 293906 rocksdb.table.open.io.micros P50 : 11053.452685 P95 : 23437.500000 P99 : 32187.500000 P100 : 170539.000000 COUNT : 1750 SUM : 20028071 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.586202 P95 : 11.128568 P99 : 168.573609 P100 : 66380.000000 COUNT : 6651886 SUM : 117384861 rocksdb.read.block.get.micros P50 : 139.013752 P95 : 436.629176 P99 : 1808.819076 P100 : 102529.000000 COUNT : 1028125 SUM : 202802203 rocksdb.write.raw.block.micros P50 : 0.580143 P95 : 1.793141 P99 : 4.480329 P100 : 129612.000000 COUNT : 8084720 SUM : 32300760 rocksdb.numfiles.in.singlecompaction P50 : 2.794118 P95 : 5.600000 P99 : 9.466667 P100 : 23.000000 COUNT : 140 SUM : 479 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.576979 P95 : 1289.019211 P99 : 2693.233597 P100 : 933253.000000 COUNT : 138235 SUM : 33832321 rocksdb.sst.read.micros P50 : 2.345284 P95 : 159.074383 P99 : 465.731418 P100 : 102379.000000 COUNT : 7402215 SUM : 298808843 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 859996 SUM : 859996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6046246 SUM : 6239725872 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 228947.368421 P95 : 1044571.428571 P99 : 1264705.000000 P100 : 1264705.000000 COUNT : 84 SUM : 30450490 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 366 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0