[2024-12-08 02:16:47.142524] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-08 02:16:47.142631] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1743797 ] Set seed to 1733620607140105 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-08 02:16:47.245955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-08 02:16:47.454869] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-08 02:16:47.454918] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1743797' to capture a snapshot of events at runtime. [2024-12-08 02:16:47.454928] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1743797 for offline analysis/debug. [2024-12-08 02:16:47.454968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 8 02:16:56 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/08-02:16:59 ... thread 0: (1000000,1000000) ops and (334808.4,334808.4) ops/second in (2.986783,2.986783) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 692.96 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 351.8 2.51 2.24 12 0.209 0 0 0.0 0.0 L1 1/1 63.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 1.29 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 251.7 251.5 0.50 0.48 1 0.501 127K 49 0.0 0.0 L3 16/1 803.09 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.1 1.0 218.9 218.9 0.57 0.49 1 0.569 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1187/9 97.00 GB 0.0 0.2 0.2 0.1 1.1 1.0 1.1 1.3 70.1 316.6 3.58 3.21 14 0.256 254K 49 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.2 0.1 1.1 1.0 1.0 1.3 70.1 316.6 3.58 3.21 14 0.256 254K 49 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.2 0.1 0.2 0.2 0.0 0.0 234.2 234.2 1.07 0.97 2 0.535 254K 49 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 351.8 2.51 2.24 12 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 350.69 MB/s write, 0.24 GB read, 77.62 MB/s read, 3.6 seconds Interval compaction: 1.11 GB write, 379.01 MB/s write, 0.24 GB read, 83.89 MB/s read, 3.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 143950 Average: 2.0785 StdDev: 20.99 Min: 0 Median: 1.3535 Max: 3635 Percentiles: P50: 1.35 P75: 1.75 P99: 5.33 P99.9: 9.57 P99.99: 21.77 ------------------------------------------------------ [ 0, 1 ] 40151 27.892% 27.892% ###### ( 1, 2 ] 90023 62.538% 90.430% ############# ( 2, 3 ] 7496 5.207% 95.637% # ( 3, 4 ] 3250 2.258% 97.895% ( 4, 6 ] 2396 1.664% 99.560% ( 6, 10 ] 550 0.382% 99.942% ( 10, 15 ] 59 0.041% 99.983% ( 15, 22 ] 12 0.008% 99.991% ( 22, 34 ] 1 0.001% 99.992% ( 51, 76 ] 1 0.001% 99.992% ( 110, 170 ] 5 0.003% 99.996% ( 170, 250 ] 3 0.002% 99.998% ( 250, 380 ] 4 0.003% 100.001% ( 380, 580 ] 3 0.002% 100.003% ( 580, 870 ] 1 0.001% 100.003% ( 870, 1300 ] 1 0.001% 100.004% ( 1300, 1900 ] 1 0.001% 100.005% ( 1900, 2900 ] 3 0.002% 100.007% ( 2900, 4400 ] 3 0.002% 100.009% ** Level 1 read latency histogram (micros): Count: 5 Average: 4178.6000 StdDev: 3068.11 Min: 706 Median: 3650.0000 Max: 9296 Percentiles: P50: 3650.00 P75: 6050.00 P99: 9296.00 P99.9: 9296.00 P99.99: 9296.00 ------------------------------------------------------ ( 580, 870 ] 1 20.000% 20.000% #### ( 1300, 1900 ] 1 20.000% 40.000% #### ( 2900, 4400 ] 1 20.000% 60.000% #### ( 4400, 6600 ] 1 20.000% 80.000% #### ( 6600, 9900 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 31657 Average: 1.7218 StdDev: 5.10 Min: 0 Median: 1.1722 Max: 828 Percentiles: P50: 1.17 P75: 1.62 P99: 4.28 P99.9: 9.43 P99.99: 19.96 ------------------------------------------------------ [ 0, 1 ] 12800 40.433% 40.433% ######## ( 1, 2 ] 17587 55.555% 95.988% ########### ( 2, 3 ] 581 1.835% 97.824% ( 3, 4 ] 344 1.087% 98.910% ( 4, 6 ] 202 0.638% 99.548% ( 6, 10 ] 130 0.411% 99.959% ( 10, 15 ] 7 0.022% 99.981% ( 15, 22 ] 4 0.013% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 13359 Average: 17.3752 StdDev: 305.56 Min: 0 Median: 1.8948 Max: 10073 Percentiles: P50: 1.89 P75: 2.71 P99: 9.60 P99.9: 6776.28 P99.99: 10073.00 ------------------------------------------------------ [ 0, 1 ] 484 3.623% 3.623% # ( 1, 2 ] 6924 51.830% 55.453% ########## ( 2, 3 ] 3664 27.427% 82.880% ##### ( 3, 4 ] 842 6.303% 89.183% # ( 4, 6 ] 1015 7.598% 96.781% ## ( 6, 10 ] 329 2.463% 99.244% ( 10, 15 ] 33 0.247% 99.491% ( 15, 22 ] 8 0.060% 99.551% ( 22, 34 ] 2 0.015% 99.566% ( 34, 51 ] 1 0.007% 99.573% ( 170, 250 ] 2 0.015% 99.588% ( 250, 380 ] 1 0.007% 99.596% ( 380, 580 ] 4 0.030% 99.626% ( 580, 870 ] 7 0.052% 99.678% ( 870, 1300 ] 13 0.097% 99.775% ( 1300, 1900 ] 4 0.030% 99.805% ( 1900, 2900 ] 3 0.022% 99.828% ( 2900, 4400 ] 4 0.030% 99.858% ( 4400, 6600 ] 5 0.037% 99.895% ( 6600, 9900 ] 12 0.090% 99.985% ( 9900, 14000 ] 2 0.015% 100.000% ** Level 4 read latency histogram (micros): Count: 20 Average: 4437.9500 StdDev: 2732.92 Min: 793 Median: 3900.0000 Max: 9366 Percentiles: P50: 3900.00 P75: 6600.00 P99: 9366.00 P99.9: 9366.00 P99.99: 9366.00 ------------------------------------------------------ ( 580, 870 ] 1 5.000% 5.000% # ( 870, 1300 ] 2 10.000% 15.000% ## ( 1300, 1900 ] 2 10.000% 25.000% ## ( 1900, 2900 ] 3 15.000% 40.000% ### ( 2900, 4400 ] 3 15.000% 55.000% ### ( 4400, 6600 ] 4 20.000% 75.000% #### ( 6600, 9900 ] 5 25.000% 100.000% ##### ** Level 5 read latency histogram (micros): Count: 20 Average: 846.8500 StdDev: 986.82 Min: 91 Median: 170.0000 Max: 2969 Percentiles: P50: 170.00 P75: 1600.00 P99: 2969.00 P99.9: 2969.00 P99.99: 2969.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 4 20.000% 50.000% #### ( 170, 250 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 304.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.407 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.407 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/08-02:17:02 ... thread 0: (1000000,2000000) ops and (330077.9,332426.3) ops/second in (3.029588,6.016371) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 1.41 GB 0.0 0.8 0.0 0.8 2.6 1.8 0.0 1.4 96.3 318.5 8.50 7.82 29 0.293 831K 876 0.0 0.0 L1 1/1 3.19 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 244.4 244.1 1.29 1.25 1 1.289 319K 363 0.0 0.0 L2 2/1 55.18 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 251.7 251.5 0.50 0.48 1 0.501 127K 49 0.0 0.0 L3 17/8 948.67 MB 0.3 0.1 0.1 0.0 0.1 0.1 0.4 1.0 218.9 218.9 0.57 0.49 1 0.569 126K 0 0.0 0.0 L4 173/0 9.64 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 105.3 105.3 1.06 0.69 1 1.063 113K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/21 97.98 GB 0.0 1.5 0.5 0.9 3.3 2.4 1.7 1.8 125.5 283.9 11.93 10.74 33 0.361 1519K 1288 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.5 0.9 3.3 2.4 1.6 1.8 125.5 283.9 11.93 10.74 33 0.361 1519K 1288 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.5 0.9 1.5 0.5 0.0 0.0 228.8 228.5 6.54 5.98 7 0.935 1519K 1288 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.1 5.38 4.76 26 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.31 GB write, 540.83 MB/s write, 1.46 GB read, 239.10 MB/s read, 11.9 seconds Interval compaction: 3.31 GB write, 562.52 MB/s write, 1.46 GB read, 248.69 MB/s read, 11.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 378040 Average: 2.2121 StdDev: 17.16 Min: 0 Median: 1.4659 Max: 3635 Percentiles: P50: 1.47 P75: 1.84 P99: 5.60 P99.9: 9.76 P99.99: 24.05 ------------------------------------------------------ [ 0, 1 ] 72838 19.267% 19.267% #### ( 1, 2 ] 249383 65.967% 85.235% ############# ( 2, 3 ] 33029 8.737% 93.972% ## ( 3, 4 ] 12005 3.176% 97.147% # ( 4, 6 ] 8731 2.310% 99.457% ( 6, 10 ] 1785 0.472% 99.929% ( 10, 15 ] 199 0.053% 99.981% ( 15, 22 ] 31 0.008% 99.990% ( 22, 34 ] 7 0.002% 99.992% ( 34, 51 ] 3 0.001% 99.992% ( 51, 76 ] 2 0.001% 99.993% ( 110, 170 ] 9 0.002% 99.995% ( 170, 250 ] 9 0.002% 99.998% ( 250, 380 ] 7 0.002% 99.999% ( 380, 580 ] 9 0.002% 100.002% ( 580, 870 ] 5 0.001% 100.003% ( 870, 1300 ] 4 0.001% 100.004% ( 1300, 1900 ] 4 0.001% 100.005% ( 1900, 2900 ] 7 0.002% 100.007% ( 2900, 4400 ] 4 0.001% 100.008% ** Level 1 read latency histogram (micros): Count: 11755 Average: 5.3089 StdDev: 109.71 Min: 1 Median: 1.5617 Max: 9296 Percentiles: P50: 1.56 P75: 1.94 P99: 9.56 P99.9: 404.50 P99.99: 6213.90 ------------------------------------------------------ [ 0, 1 ] 1460 12.420% 12.420% ## ( 1, 2 ] 7865 66.908% 79.328% ############# ( 2, 3 ] 1442 12.267% 91.595% ## ( 3, 4 ] 412 3.505% 95.100% # ( 4, 6 ] 276 2.348% 97.448% ( 6, 10 ] 205 1.744% 99.192% ( 10, 15 ] 19 0.162% 99.353% ( 34, 51 ] 1 0.009% 99.362% ( 76, 110 ] 17 0.145% 99.507% ( 110, 170 ] 37 0.315% 99.821% ( 170, 250 ] 5 0.043% 99.864% ( 250, 380 ] 4 0.034% 99.898% ( 380, 580 ] 2 0.017% 99.915% ( 580, 870 ] 2 0.017% 99.932% ( 870, 1300 ] 3 0.026% 99.957% ( 1300, 1900 ] 2 0.017% 99.974% ( 2900, 4400 ] 1 0.009% 99.983% ( 4400, 6600 ] 1 0.009% 99.991% ( 6600, 9900 ] 1 0.009% 100.000% ** Level 2 read latency histogram (micros): Count: 31965 Average: 1.7409 StdDev: 5.09 Min: 0 Median: 1.1801 Max: 828 Percentiles: P50: 1.18 P75: 1.63 P99: 4.69 P99.9: 9.57 P99.99: 31.64 ------------------------------------------------------ [ 0, 1 ] 12800 40.044% 40.044% ######## ( 1, 2 ] 17668 55.273% 95.317% ########### ( 2, 3 ] 700 2.190% 97.507% ( 3, 4 ] 396 1.239% 98.746% ( 4, 6 ] 237 0.741% 99.487% ( 6, 10 ] 148 0.463% 99.950% ( 10, 15 ] 8 0.025% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 172459 Average: 4.1206 StdDev: 86.87 Min: 0 Median: 1.6146 Max: 10073 Percentiles: P50: 1.61 P75: 2.02 P99: 9.11 P99.9: 229.49 P99.99: 1713.11 ------------------------------------------------------ [ 0, 1 ] 18403 10.671% 10.671% ## ( 1, 2 ] 110367 63.996% 74.667% ############# ( 2, 3 ] 26107 15.138% 89.805% ### ( 3, 4 ] 7094 4.113% 93.919% # ( 4, 6 ] 6339 3.676% 97.594% # ( 6, 10 ] 3115 1.806% 99.400% ( 10, 15 ] 467 0.271% 99.671% ( 15, 22 ] 52 0.030% 99.701% ( 22, 34 ] 9 0.005% 99.707% ( 34, 51 ] 3 0.002% 99.708% ( 51, 76 ] 1 0.001% 99.709% ( 76, 110 ] 136 0.079% 99.788% ( 110, 170 ] 140 0.081% 99.869% ( 170, 250 ] 72 0.042% 99.911% ( 250, 380 ] 52 0.030% 99.941% ( 380, 580 ] 37 0.021% 99.962% ( 580, 870 ] 28 0.016% 99.979% ( 870, 1300 ] 17 0.010% 99.988% ( 1300, 1900 ] 4 0.002% 99.991% ( 1900, 2900 ] 5 0.003% 99.994% ( 2900, 4400 ] 5 0.003% 99.997% ( 4400, 6600 ] 5 0.003% 99.999% ( 6600, 9900 ] 12 0.007% 100.006% ( 9900, 14000 ] 2 0.001% 100.008% ** Level 4 read latency histogram (micros): Count: 305 Average: 295.6852 StdDev: 1302.03 Min: 0 Median: 1.6890 Max: 9366 Percentiles: P50: 1.69 P75: 3.21 P99: 7887.00 P99.9: 9366.00 P99.99: 9366.00 ------------------------------------------------------ [ 0, 1 ] 65 21.311% 21.311% #### ( 1, 2 ] 127 41.639% 62.951% ######## ( 2, 3 ] 34 11.148% 74.098% ## ( 3, 4 ] 13 4.262% 78.361% # ( 4, 6 ] 23 7.541% 85.902% ## ( 6, 10 ] 21 6.885% 92.787% # ( 10, 15 ] 1 0.328% 93.115% ( 580, 870 ] 2 0.656% 93.770% ( 870, 1300 ] 2 0.656% 94.426% ( 1300, 1900 ] 2 0.656% 95.082% ( 1900, 2900 ] 3 0.984% 96.066% ( 2900, 4400 ] 3 0.984% 97.049% ( 4400, 6600 ] 4 1.311% 98.361% ( 6600, 9900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 846.8500 StdDev: 986.82 Min: 91 Median: 170.0000 Max: 2969 Percentiles: P50: 170.00 P75: 1600.00 P99: 2969.00 P99.9: 2969.00 P99.99: 2969.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 4 20.000% 50.000% #### ( 170, 250 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.3 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 314.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.813 H:M:S, 13.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.406 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/08-02:17:05 ... thread 0: (1000000,3000000) ops and (330190.1,331677.6) ops/second in (3.028558,9.044929) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.34 GB 94.4 1.7 0.0 1.7 4.4 2.8 0.0 1.6 116.8 311.4 14.56 13.52 45 0.324 1727K 1850 0.0 0.0 L1 1/1 3.19 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 244.4 244.1 1.29 1.25 1 1.289 319K 363 0.0 0.0 L2 1/0 53.89 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 251.7 251.5 0.50 0.48 1 0.501 127K 49 0.0 0.0 L3 15/0 949.08 MB 0.9 0.8 0.1 0.7 0.8 0.1 0.4 6.4 222.7 222.5 3.61 3.35 2 1.806 817K 885 0.0 0.0 L4 173/0 9.64 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 105.3 105.3 1.06 0.69 1 1.063 113K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/12 98.90 GB 0.0 3.0 0.5 2.4 5.8 3.3 1.7 2.1 145.4 280.1 21.03 19.29 50 0.421 3105K 3147 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 0.5 2.4 5.8 3.3 1.6 2.1 145.4 280.1 21.03 19.29 50 0.421 3105K 3147 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 0.5 2.4 3.0 0.5 0.0 0.0 235.9 235.7 12.96 12.15 11 1.178 3105K 3147 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 351.6 8.06 7.13 39 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.75 GB write, 634.14 MB/s write, 2.99 GB read, 329.27 MB/s read, 21.0 seconds Interval compaction: 5.75 GB write, 651.06 MB/s write, 2.99 GB read, 338.06 MB/s read, 21.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 799469 Average: 2.2391 StdDev: 13.27 Min: 0 Median: 1.5134 Max: 3635 Percentiles: P50: 1.51 P75: 1.88 P99: 5.59 P99.9: 9.52 P99.99: 13.59 ------------------------------------------------------ [ 0, 1 ] 122653 15.342% 15.342% ### ( 1, 2 ] 539665 67.503% 82.845% ############## ( 2, 3 ] 84507 10.570% 93.415% ## ( 3, 4 ] 27980 3.500% 96.915% # ( 4, 6 ] 20977 2.624% 99.539% # ( 6, 10 ] 3284 0.411% 99.950% ( 10, 15 ] 451 0.056% 100.006% ( 15, 22 ] 54 0.007% 100.013% ( 22, 34 ] 10 0.001% 100.014% ( 34, 51 ] 5 0.001% 100.015% ( 51, 76 ] 3 0.000% 100.015% ( 110, 170 ] 32 0.004% 100.019% ( 170, 250 ] 21 0.003% 100.022% ( 250, 380 ] 14 0.002% 100.023% ( 380, 580 ] 17 0.002% 100.026% ( 580, 870 ] 9 0.001% 100.027% ( 870, 1300 ] 8 0.001% 100.028% ( 1300, 1900 ] 7 0.001% 100.029% ( 1900, 2900 ] 9 0.001% 100.030% ( 2900, 4400 ] 4 0.001% 100.030% ** Level 1 read latency histogram (micros): Count: 28336 Average: 3.6567 StdDev: 70.68 Min: 1 Median: 1.6175 Max: 9296 Percentiles: P50: 1.62 P75: 2.00 P99: 8.79 P99.9: 158.10 P99.99: 3149.60 ------------------------------------------------------ [ 0, 1 ] 2632 9.289% 9.289% ## ( 1, 2 ] 18683 65.934% 75.222% ############# ( 2, 3 ] 4068 14.356% 89.579% ### ( 3, 4 ] 1260 4.447% 94.025% # ( 4, 6 ] 1064 3.755% 97.780% # ( 6, 10 ] 495 1.747% 99.527% ( 10, 15 ] 57 0.201% 99.728% ( 34, 51 ] 1 0.004% 99.732% ( 51, 76 ] 1 0.004% 99.735% ( 76, 110 ] 17 0.060% 99.795% ( 110, 170 ] 37 0.131% 99.926% ( 170, 250 ] 5 0.018% 99.944% ( 250, 380 ] 4 0.014% 99.958% ( 380, 580 ] 2 0.007% 99.965% ( 580, 870 ] 2 0.007% 99.972% ( 870, 1300 ] 3 0.011% 99.982% ( 1300, 1900 ] 2 0.007% 99.989% ( 2900, 4400 ] 1 0.004% 99.993% ( 4400, 6600 ] 1 0.004% 99.996% ( 6600, 9900 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 31985 Average: 1.7418 StdDev: 5.08 Min: 0 Median: 1.1806 Max: 828 Percentiles: P50: 1.18 P75: 1.63 P99: 4.70 P99.9: 9.57 P99.99: 31.62 ------------------------------------------------------ [ 0, 1 ] 12800 40.019% 40.019% ######## ( 1, 2 ] 17673 55.254% 95.273% ########### ( 2, 3 ] 713 2.229% 97.502% ( 3, 4 ] 396 1.238% 98.740% ( 4, 6 ] 238 0.744% 99.484% ( 6, 10 ] 149 0.466% 99.950% ( 10, 15 ] 8 0.025% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 172489 Average: 4.1767 StdDev: 87.31 Min: 0 Median: 1.6146 Max: 10073 Percentiles: P50: 1.61 P75: 2.02 P99: 9.13 P99.9: 240.57 P99.99: 1875.11 ------------------------------------------------------ [ 0, 1 ] 18411 10.674% 10.674% ## ( 1, 2 ] 110372 63.988% 74.662% ############# ( 2, 3 ] 26112 15.138% 89.800% ### ( 3, 4 ] 7094 4.113% 93.913% # ( 4, 6 ] 6339 3.675% 97.588% # ( 6, 10 ] 3115 1.806% 99.394% ( 10, 15 ] 467 0.271% 99.664% ( 15, 22 ] 52 0.030% 99.694% ( 22, 34 ] 10 0.006% 99.700% ( 34, 51 ] 3 0.002% 99.702% ( 51, 76 ] 1 0.001% 99.703% ( 76, 110 ] 136 0.079% 99.781% ( 110, 170 ] 141 0.082% 99.863% ( 170, 250 ] 72 0.042% 99.905% ( 250, 380 ] 52 0.030% 99.935% ( 380, 580 ] 42 0.024% 99.959% ( 580, 870 ] 28 0.016% 99.976% ( 870, 1300 ] 19 0.011% 99.987% ( 1300, 1900 ] 6 0.003% 99.990% ( 1900, 2900 ] 6 0.003% 99.994% ( 2900, 4400 ] 5 0.003% 99.997% ( 4400, 6600 ] 5 0.003% 99.999% ( 6600, 9900 ] 12 0.007% 100.006% ( 9900, 14000 ] 2 0.001% 100.008% ** Level 4 read latency histogram (micros): Count: 305 Average: 295.6852 StdDev: 1302.03 Min: 0 Median: 1.6890 Max: 9366 Percentiles: P50: 1.69 P75: 3.21 P99: 7887.00 P99.9: 9366.00 P99.99: 9366.00 ------------------------------------------------------ [ 0, 1 ] 65 21.311% 21.311% #### ( 1, 2 ] 127 41.639% 62.951% ######## ( 2, 3 ] 34 11.148% 74.098% ## ( 3, 4 ] 13 4.262% 78.361% # ( 4, 6 ] 23 7.541% 85.902% ## ( 6, 10 ] 21 6.885% 92.787% # ( 10, 15 ] 1 0.328% 93.115% ( 580, 870 ] 2 0.656% 93.770% ( 870, 1300 ] 2 0.656% 94.426% ( 1300, 1900 ] 2 0.656% 95.082% ( 1900, 2900 ] 3 0.984% 96.066% ( 2900, 4400 ] 3 0.984% 97.049% ( 4400, 6600 ] 4 1.311% 98.361% ( 6600, 9900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 846.8500 StdDev: 986.82 Min: 91 Median: 170.0000 Max: 2969 Percentiles: P50: 170.00 P75: 1600.00 P99: 2969.00 P99.9: 2969.00 P99.99: 2969.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 4 20.000% 50.000% #### ( 170, 250 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.3 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 317.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.200 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.387 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/08-02:17:08 ... thread 0: (1000000,4000000) ops and (338287.6,333305.7) ops/second in (2.956065,12.000994) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.15 GB 188.8 2.5 0.0 2.5 6.2 3.7 0.0 1.7 125.0 307.8 20.66 19.25 61 0.339 2622K 2804 0.0 0.0 L1 10/0 1.10 GB 113.1 1.4 1.4 0.1 1.4 1.3 0.2 1.0 232.7 231.8 6.24 6.05 2 3.118 1473K 5617 0.0 0.0 L2 1/0 53.89 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 251.7 251.5 0.50 0.48 1 0.501 127K 49 0.0 0.0 L3 15/0 949.08 MB 0.9 0.8 0.1 0.7 0.8 0.1 0.4 6.4 222.7 222.5 3.61 3.35 2 1.806 817K 885 0.0 0.0 L4 173/0 9.64 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 105.3 105.3 1.06 0.69 1 1.063 113K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/4 99.82 GB 0.0 5.0 1.6 3.3 8.6 5.3 1.7 2.3 158.3 275.8 32.07 29.82 67 0.479 5154K 9355 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 1.6 3.3 8.6 5.3 1.6 2.3 158.3 275.8 32.07 29.82 67 0.479 5154K 9355 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 1.6 3.3 4.9 1.6 0.0 0.0 237.9 237.4 21.34 20.32 15 1.423 5154K 9355 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 352.2 10.73 9.51 52 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.64 GB write, 722.52 MB/s write, 4.96 GB read, 414.60 MB/s read, 32.1 seconds Interval compaction: 8.64 GB write, 737.05 MB/s write, 4.96 GB read, 422.94 MB/s read, 32.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1089712 Average: 2.2063 StdDev: 12.20 Min: 0 Median: 1.4980 Max: 3635 Percentiles: P50: 1.50 P75: 1.87 P99: 5.58 P99.9: 9.58 P99.99: 13.61 ------------------------------------------------------ [ 0, 1 ] 180610 16.574% 16.574% ### ( 1, 2 ] 731375 67.116% 83.690% ############# ( 2, 3 ] 109543 10.052% 93.743% ## ( 3, 4 ] 36180 3.320% 97.063% # ( 4, 6 ] 26784 2.458% 99.521% ( 6, 10 ] 4620 0.424% 99.945% ( 10, 15 ] 681 0.062% 100.007% ( 15, 22 ] 91 0.008% 100.016% ( 22, 34 ] 15 0.001% 100.017% ( 34, 51 ] 8 0.001% 100.018% ( 51, 76 ] 5 0.000% 100.018% ( 110, 170 ] 37 0.003% 100.022% ( 170, 250 ] 30 0.003% 100.025% ( 250, 380 ] 20 0.002% 100.026% ( 380, 580 ] 22 0.002% 100.028% ( 580, 870 ] 16 0.001% 100.030% ( 870, 1300 ] 11 0.001% 100.031% ( 1300, 1900 ] 9 0.001% 100.032% ( 1900, 2900 ] 10 0.001% 100.033% ( 2900, 4400 ] 4 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 29194 Average: 4.5807 StdDev: 74.66 Min: 0 Median: 1.6212 Max: 9296 Percentiles: P50: 1.62 P75: 2.01 P99: 9.45 P99.9: 436.12 P99.99: 3020.90 ------------------------------------------------------ [ 0, 1 ] 2717 9.307% 9.307% ## ( 1, 2 ] 19125 65.510% 74.817% ############# ( 2, 3 ] 4206 14.407% 89.224% ### ( 3, 4 ] 1323 4.532% 93.756% # ( 4, 6 ] 1090 3.734% 97.489% # ( 6, 10 ] 511 1.750% 99.240% ( 10, 15 ] 62 0.212% 99.452% ( 22, 34 ] 1 0.003% 99.455% ( 34, 51 ] 1 0.003% 99.459% ( 51, 76 ] 1 0.003% 99.462% ( 76, 110 ] 40 0.137% 99.599% ( 110, 170 ] 54 0.185% 99.784% ( 170, 250 ] 15 0.051% 99.836% ( 250, 380 ] 16 0.055% 99.890% ( 380, 580 ] 10 0.034% 99.925% ( 580, 870 ] 5 0.017% 99.942% ( 870, 1300 ] 9 0.031% 99.973% ( 1300, 1900 ] 5 0.017% 99.990% ( 2900, 4400 ] 1 0.003% 99.993% ( 4400, 6600 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31985 Average: 1.7418 StdDev: 5.08 Min: 0 Median: 1.1806 Max: 828 Percentiles: P50: 1.18 P75: 1.63 P99: 4.70 P99.9: 9.57 P99.99: 31.62 ------------------------------------------------------ [ 0, 1 ] 12800 40.019% 40.019% ######## ( 1, 2 ] 17673 55.254% 95.273% ########### ( 2, 3 ] 713 2.229% 97.502% ( 3, 4 ] 396 1.238% 98.740% ( 4, 6 ] 238 0.744% 99.484% ( 6, 10 ] 149 0.466% 99.950% ( 10, 15 ] 8 0.025% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 172489 Average: 4.1767 StdDev: 87.31 Min: 0 Median: 1.6146 Max: 10073 Percentiles: P50: 1.61 P75: 2.02 P99: 9.13 P99.9: 240.57 P99.99: 1875.11 ------------------------------------------------------ [ 0, 1 ] 18411 10.674% 10.674% ## ( 1, 2 ] 110372 63.988% 74.662% ############# ( 2, 3 ] 26112 15.138% 89.800% ### ( 3, 4 ] 7094 4.113% 93.913% # ( 4, 6 ] 6339 3.675% 97.588% # ( 6, 10 ] 3115 1.806% 99.394% ( 10, 15 ] 467 0.271% 99.664% ( 15, 22 ] 52 0.030% 99.694% ( 22, 34 ] 10 0.006% 99.700% ( 34, 51 ] 3 0.002% 99.702% ( 51, 76 ] 1 0.001% 99.703% ( 76, 110 ] 136 0.079% 99.781% ( 110, 170 ] 141 0.082% 99.863% ( 170, 250 ] 72 0.042% 99.905% ( 250, 380 ] 52 0.030% 99.935% ( 380, 580 ] 42 0.024% 99.959% ( 580, 870 ] 28 0.016% 99.976% ( 870, 1300 ] 19 0.011% 99.987% ( 1300, 1900 ] 6 0.003% 99.990% ( 1900, 2900 ] 6 0.003% 99.994% ( 2900, 4400 ] 5 0.003% 99.997% ( 4400, 6600 ] 5 0.003% 99.999% ( 6600, 9900 ] 12 0.007% 100.006% ( 9900, 14000 ] 2 0.001% 100.008% ** Level 4 read latency histogram (micros): Count: 305 Average: 295.6852 StdDev: 1302.03 Min: 0 Median: 1.6890 Max: 9366 Percentiles: P50: 1.69 P75: 3.21 P99: 7887.00 P99.9: 9366.00 P99.99: 9366.00 ------------------------------------------------------ [ 0, 1 ] 65 21.311% 21.311% #### ( 1, 2 ] 127 41.639% 62.951% ######## ( 2, 3 ] 34 11.148% 74.098% ## ( 3, 4 ] 13 4.262% 78.361% # ( 4, 6 ] 23 7.541% 85.902% ## ( 6, 10 ] 21 6.885% 92.787% # ( 10, 15 ] 1 0.328% 93.115% ( 580, 870 ] 2 0.656% 93.770% ( 870, 1300 ] 2 0.656% 94.426% ( 1300, 1900 ] 2 0.656% 95.082% ( 1900, 2900 ] 3 0.984% 96.066% ( 2900, 4400 ] 3 0.984% 97.049% ( 4400, 6600 ] 4 1.311% 98.361% ( 6600, 9900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 846.8500 StdDev: 986.82 Min: 91 Median: 170.0000 Max: 2969 Percentiles: P50: 170.00 P75: 1600.00 P99: 2969.00 P99.9: 2969.00 P99.99: 2969.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 4 20.000% 50.000% #### ( 170, 250 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.580 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.380 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/08-02:17:11 ... thread 0: (1000000,5000000) ops and (331605.0,332964.2) ops/second in (3.015636,15.016630) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 3.13 GB 0.0 3.6 0.0 3.6 8.3 4.7 0.0 1.8 133.8 306.0 27.78 25.99 79 0.352 3773K 4067 0.0 0.0 L1 10/10 1.10 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.2 1.0 232.7 231.8 6.24 6.05 2 3.118 1473K 5617 0.0 0.0 L2 1/0 53.89 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 251.7 251.5 0.50 0.48 1 0.501 127K 49 0.0 0.0 L3 15/0 949.08 MB 0.9 0.8 0.1 0.7 0.8 0.1 0.4 6.4 222.7 222.5 3.61 3.35 2 1.806 817K 885 0.0 0.0 L4 173/0 9.64 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 105.3 105.3 1.06 0.69 1 1.063 113K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/24 100.80 GB 0.0 6.1 1.6 4.4 10.7 6.3 1.7 2.3 158.5 280.4 39.19 36.56 85 0.461 6305K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 1.6 4.4 10.7 6.3 1.6 2.3 158.5 280.4 39.19 36.56 85 0.461 6305K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 1.6 4.4 6.1 1.6 0.0 0.0 242.2 241.7 25.65 24.54 19 1.350 6305K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.5 13.54 12.01 66 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.0 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.73 GB write, 720.00 MB/s write, 6.06 GB read, 406.98 MB/s read, 39.2 seconds Interval compaction: 10.73 GB write, 731.58 MB/s write, 6.06 GB read, 413.52 MB/s read, 39.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 22, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1342784 Average: 2.1925 StdDev: 14.02 Min: 0 Median: 1.4765 Max: 4251 Percentiles: P50: 1.48 P75: 1.85 P99: 5.51 P99.9: 9.76 P99.99: 14.58 ------------------------------------------------------ [ 0, 1 ] 242360 18.049% 18.049% #### ( 1, 2 ] 900440 67.058% 85.107% ############# ( 2, 3 ] 123083 9.166% 94.273% ## ( 3, 4 ] 41231 3.071% 97.344% # ( 4, 6 ] 29419 2.191% 99.534% ( 6, 10 ] 5223 0.389% 99.923% ( 10, 15 ] 977 0.073% 99.996% ( 15, 22 ] 119 0.009% 100.005% ( 22, 34 ] 18 0.001% 100.006% ( 34, 51 ] 8 0.001% 100.007% ( 51, 76 ] 10 0.001% 100.008% ( 76, 110 ] 2 0.000% 100.008% ( 110, 170 ] 107 0.008% 100.016% ( 170, 250 ] 45 0.003% 100.019% ( 250, 380 ] 28 0.002% 100.021% ( 380, 580 ] 31 0.002% 100.024% ( 580, 870 ] 25 0.002% 100.025% ( 870, 1300 ] 15 0.001% 100.027% ( 1300, 1900 ] 12 0.001% 100.027% ( 1900, 2900 ] 11 0.001% 100.028% ( 2900, 4400 ] 9 0.001% 100.029% ** Level 1 read latency histogram (micros): Count: 29379 Average: 5.0100 StdDev: 75.22 Min: 0 Median: 1.6260 Max: 9296 Percentiles: P50: 1.63 P75: 2.05 P99: 9.96 P99.9: 516.72 P99.99: 2993.15 ------------------------------------------------------ [ 0, 1 ] 2717 9.248% 9.248% ## ( 1, 2 ] 19125 65.098% 74.346% ############# ( 2, 3 ] 4217 14.354% 88.699% ### ( 3, 4 ] 1415 4.816% 93.516% # ( 4, 6 ] 1104 3.758% 97.274% # ( 6, 10 ] 512 1.743% 99.016% ( 10, 15 ] 63 0.214% 99.231% ( 15, 22 ] 2 0.007% 99.238% ( 22, 34 ] 1 0.003% 99.241% ( 34, 51 ] 1 0.003% 99.244% ( 51, 76 ] 1 0.003% 99.248% ( 76, 110 ] 41 0.140% 99.387% ( 110, 170 ] 99 0.337% 99.724% ( 170, 250 ] 24 0.082% 99.806% ( 250, 380 ] 16 0.054% 99.860% ( 380, 580 ] 17 0.058% 99.918% ( 580, 870 ] 7 0.024% 99.942% ( 870, 1300 ] 9 0.031% 99.973% ( 1300, 1900 ] 5 0.017% 99.990% ( 2900, 4400 ] 1 0.003% 99.993% ( 4400, 6600 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31985 Average: 1.7418 StdDev: 5.08 Min: 0 Median: 1.1806 Max: 828 Percentiles: P50: 1.18 P75: 1.63 P99: 4.70 P99.9: 9.57 P99.99: 31.62 ------------------------------------------------------ [ 0, 1 ] 12800 40.019% 40.019% ######## ( 1, 2 ] 17673 55.254% 95.273% ########### ( 2, 3 ] 713 2.229% 97.502% ( 3, 4 ] 396 1.238% 98.740% ( 4, 6 ] 238 0.744% 99.484% ( 6, 10 ] 149 0.466% 99.950% ( 10, 15 ] 8 0.025% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 172489 Average: 4.1767 StdDev: 87.31 Min: 0 Median: 1.6146 Max: 10073 Percentiles: P50: 1.61 P75: 2.02 P99: 9.13 P99.9: 240.57 P99.99: 1875.11 ------------------------------------------------------ [ 0, 1 ] 18411 10.674% 10.674% ## ( 1, 2 ] 110372 63.988% 74.662% ############# ( 2, 3 ] 26112 15.138% 89.800% ### ( 3, 4 ] 7094 4.113% 93.913% # ( 4, 6 ] 6339 3.675% 97.588% # ( 6, 10 ] 3115 1.806% 99.394% ( 10, 15 ] 467 0.271% 99.664% ( 15, 22 ] 52 0.030% 99.694% ( 22, 34 ] 10 0.006% 99.700% ( 34, 51 ] 3 0.002% 99.702% ( 51, 76 ] 1 0.001% 99.703% ( 76, 110 ] 136 0.079% 99.781% ( 110, 170 ] 141 0.082% 99.863% ( 170, 250 ] 72 0.042% 99.905% ( 250, 380 ] 52 0.030% 99.935% ( 380, 580 ] 42 0.024% 99.959% ( 580, 870 ] 28 0.016% 99.976% ( 870, 1300 ] 19 0.011% 99.987% ( 1300, 1900 ] 6 0.003% 99.990% ( 1900, 2900 ] 6 0.003% 99.994% ( 2900, 4400 ] 5 0.003% 99.997% ( 4400, 6600 ] 5 0.003% 99.999% ( 6600, 9900 ] 12 0.007% 100.006% ( 9900, 14000 ] 2 0.001% 100.008% ** Level 4 read latency histogram (micros): Count: 305 Average: 295.6852 StdDev: 1302.03 Min: 0 Median: 1.6890 Max: 9366 Percentiles: P50: 1.69 P75: 3.21 P99: 7887.00 P99.9: 9366.00 P99.99: 9366.00 ------------------------------------------------------ [ 0, 1 ] 65 21.311% 21.311% #### ( 1, 2 ] 127 41.639% 62.951% ######## ( 2, 3 ] 34 11.148% 74.098% ## ( 3, 4 ] 13 4.262% 78.361% # ( 4, 6 ] 23 7.541% 85.902% ## ( 6, 10 ] 21 6.885% 92.787% # ( 10, 15 ] 1 0.328% 93.115% ( 580, 870 ] 2 0.656% 93.770% ( 870, 1300 ] 2 0.656% 94.426% ( 1300, 1900 ] 2 0.656% 95.082% ( 1900, 2900 ] 3 0.984% 96.066% ( 2900, 4400 ] 3 0.984% 97.049% ( 4400, 6600 ] 4 1.311% 98.361% ( 6600, 9900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 846.8500 StdDev: 986.82 Min: 91 Median: 170.0000 Max: 2969 Percentiles: P50: 170.00 P75: 1600.00 P99: 2969.00 P99.9: 2969.00 P99.99: 2969.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 4 20.000% 50.000% #### ( 170, 250 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.3 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 322.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.001 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.421 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/08-02:17:19 ... thread 0: (1000000,6000000) ops and (115262.5,253245.0) ops/second in (8.675845,23.692475) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/18 4.18 GB 0.0 4.7 0.0 4.7 10.4 5.7 0.0 1.8 137.5 305.6 34.82 32.63 99 0.352 4861K 5220 0.0 0.0 L1 10/10 1.10 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.2 1.0 232.7 231.8 6.24 6.05 2 3.118 1473K 5617 0.0 0.0 L2 1/0 53.89 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 251.7 251.5 0.50 0.48 1 0.501 127K 49 0.0 0.0 L3 15/0 949.08 MB 0.9 0.8 0.1 0.7 0.8 0.1 0.4 6.4 222.7 222.5 3.61 3.35 2 1.806 817K 885 0.0 0.0 L4 173/0 9.64 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 105.3 105.3 1.06 0.69 1 1.063 113K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/28 101.85 GB 0.0 7.1 1.6 5.5 12.8 7.4 1.7 2.2 157.5 284.0 46.23 43.20 105 0.440 7393K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.1 1.6 5.5 12.8 7.4 1.6 2.2 157.5 284.0 46.23 43.20 105 0.440 7393K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.1 1.6 5.5 7.1 1.6 0.0 0.0 245.1 244.7 29.71 28.55 23 1.292 7393K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.7 16.52 14.65 82 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.9 total, 23.7 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.82 GB write, 548.45 MB/s write, 7.11 GB read, 304.20 MB/s read, 46.2 seconds Interval compaction: 12.82 GB write, 554.04 MB/s write, 7.11 GB read, 307.30 MB/s read, 46.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 23, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2148746 Average: 2.1579 StdDev: 11.92 Min: 0 Median: 1.4686 Max: 4251 Percentiles: P50: 1.47 P75: 1.84 P99: 5.51 P99.9: 9.80 P99.99: 14.85 ------------------------------------------------------ [ 0, 1 ] 390007 18.150% 18.150% #### ( 1, 2 ] 1460595 67.974% 86.125% ############## ( 2, 3 ] 182276 8.483% 94.608% ## ( 3, 4 ] 63163 2.940% 97.547% # ( 4, 6 ] 41379 1.926% 99.473% ( 6, 10 ] 9651 0.449% 99.922% ( 10, 15 ] 1505 0.070% 99.992% ( 15, 22 ] 166 0.008% 100.000% ( 22, 34 ] 22 0.001% 100.001% ( 34, 51 ] 10 0.000% 100.001% ( 51, 76 ] 12 0.001% 100.002% ( 76, 110 ] 33 0.002% 100.003% ( 110, 170 ] 179 0.008% 100.012% ( 170, 250 ] 74 0.003% 100.015% ( 250, 380 ] 38 0.002% 100.017% ( 380, 580 ] 48 0.002% 100.019% ( 580, 870 ] 40 0.002% 100.021% ( 870, 1300 ] 19 0.001% 100.022% ( 1300, 1900 ] 17 0.001% 100.023% ( 1900, 2900 ] 12 0.001% 100.023% ( 2900, 4400 ] 9 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 159256 Average: 2.8473 StdDev: 33.63 Min: 0 Median: 1.5013 Max: 9296 Percentiles: P50: 1.50 P75: 1.87 P99: 8.54 P99.9: 153.71 P99.99: 969.11 ------------------------------------------------------ [ 0, 1 ] 25282 15.875% 15.875% ### ( 1, 2 ] 108400 68.067% 83.942% ############## ( 2, 3 ] 14493 9.100% 93.042% ## ( 3, 4 ] 4727 2.968% 96.010% # ( 4, 6 ] 3105 1.950% 97.960% ( 6, 10 ] 2611 1.639% 99.599% ( 10, 15 ] 203 0.127% 99.727% ( 15, 22 ] 16 0.010% 99.737% ( 22, 34 ] 3 0.002% 99.739% ( 34, 51 ] 1 0.001% 99.739% ( 51, 76 ] 2 0.001% 99.741% ( 76, 110 ] 143 0.090% 99.830% ( 110, 170 ] 152 0.095% 99.926% ( 170, 250 ] 39 0.024% 99.950% ( 250, 380 ] 24 0.015% 99.965% ( 380, 580 ] 28 0.018% 99.983% ( 580, 870 ] 9 0.006% 99.989% ( 870, 1300 ] 9 0.006% 99.994% ( 1300, 1900 ] 5 0.003% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31985 Average: 1.7418 StdDev: 5.08 Min: 0 Median: 1.1806 Max: 828 Percentiles: P50: 1.18 P75: 1.63 P99: 4.70 P99.9: 9.57 P99.99: 31.62 ------------------------------------------------------ [ 0, 1 ] 12800 40.019% 40.019% ######## ( 1, 2 ] 17673 55.254% 95.273% ########### ( 2, 3 ] 713 2.229% 97.502% ( 3, 4 ] 396 1.238% 98.740% ( 4, 6 ] 238 0.744% 99.484% ( 6, 10 ] 149 0.466% 99.950% ( 10, 15 ] 8 0.025% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 172489 Average: 4.1767 StdDev: 87.31 Min: 0 Median: 1.6146 Max: 10073 Percentiles: P50: 1.61 P75: 2.02 P99: 9.13 P99.9: 240.57 P99.99: 1875.11 ------------------------------------------------------ [ 0, 1 ] 18411 10.674% 10.674% ## ( 1, 2 ] 110372 63.988% 74.662% ############# ( 2, 3 ] 26112 15.138% 89.800% ### ( 3, 4 ] 7094 4.113% 93.913% # ( 4, 6 ] 6339 3.675% 97.588% # ( 6, 10 ] 3115 1.806% 99.394% ( 10, 15 ] 467 0.271% 99.664% ( 15, 22 ] 52 0.030% 99.694% ( 22, 34 ] 10 0.006% 99.700% ( 34, 51 ] 3 0.002% 99.702% ( 51, 76 ] 1 0.001% 99.703% ( 76, 110 ] 136 0.079% 99.781% ( 110, 170 ] 141 0.082% 99.863% ( 170, 250 ] 72 0.042% 99.905% ( 250, 380 ] 52 0.030% 99.935% ( 380, 580 ] 42 0.024% 99.959% ( 580, 870 ] 28 0.016% 99.976% ( 870, 1300 ] 19 0.011% 99.987% ( 1300, 1900 ] 6 0.003% 99.990% ( 1900, 2900 ] 6 0.003% 99.994% ( 2900, 4400 ] 5 0.003% 99.997% ( 4400, 6600 ] 5 0.003% 99.999% ( 6600, 9900 ] 12 0.007% 100.006% ( 9900, 14000 ] 2 0.001% 100.008% ** Level 4 read latency histogram (micros): Count: 305 Average: 295.6852 StdDev: 1302.03 Min: 0 Median: 1.6890 Max: 9366 Percentiles: P50: 1.69 P75: 3.21 P99: 7887.00 P99.9: 9366.00 P99.99: 9366.00 ------------------------------------------------------ [ 0, 1 ] 65 21.311% 21.311% #### ( 1, 2 ] 127 41.639% 62.951% ######## ( 2, 3 ] 34 11.148% 74.098% ## ( 3, 4 ] 13 4.262% 78.361% # ( 4, 6 ] 23 7.541% 85.902% ## ( 6, 10 ] 21 6.885% 92.787% # ( 10, 15 ] 1 0.328% 93.115% ( 580, 870 ] 2 0.656% 93.770% ( 870, 1300 ] 2 0.656% 94.426% ( 1300, 1900 ] 2 0.656% 95.082% ( 1900, 2900 ] 3 0.984% 96.066% ( 2900, 4400 ] 3 0.984% 97.049% ( 4400, 6600 ] 4 1.311% 98.361% ( 6600, 9900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 846.8500 StdDev: 986.82 Min: 91 Median: 170.0000 Max: 2969 Percentiles: P50: 170.00 P75: 1600.00 P99: 2969.00 P99.9: 2969.00 P99.99: 2969.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 4 20.000% 50.000% #### ( 170, 250 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 23.9 total, 8.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 246.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.812 H:M:S, 32.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 113.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.811 H:M:S, 67.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/12/08-02:17:36 ... thread 0: (1000000,7000000) ops and (59320.2,172625.8) ops/second in (16.857654,40.550129) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/2 1.90 GB 81.8 6.3 0.0 6.3 12.8 6.6 0.0 2.0 144.2 295.2 44.57 41.22 114 0.391 6523K 10K 0.0 0.0 L1 7/7 778.26 MB 0.0 5.7 4.5 1.2 5.6 4.4 0.2 1.2 216.5 213.1 26.75 24.84 3 8.916 5880K 90K 0.0 0.0 L2 19/18 2.39 GB 1.3 0.1 0.1 0.1 0.1 0.1 3.9 2.0 251.7 251.5 0.50 0.48 1 0.501 127K 49 0.0 0.0 L3 26/6 1.45 GB 1.0 2.1 1.2 0.9 2.1 1.2 0.4 1.7 202.3 201.9 10.45 9.28 6 1.741 2146K 4292 0.0 0.0 L4 170/2 9.50 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 105.3 105.3 1.06 0.69 1 1.063 113K 0 0.0 0.0 L5 1052/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1281/35 102.62 GB 0.0 14.2 5.8 8.4 20.7 12.3 6.3 3.1 174.8 254.4 83.33 76.51 125 0.667 14M 105K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.2 5.8 8.4 20.7 12.3 6.2 3.1 174.8 254.4 83.33 76.51 125 0.667 14M 105K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.2 5.8 8.4 14.1 5.7 0.0 0.0 229.5 227.9 63.46 59.43 31 2.047 14M 105K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 339.3 19.86 17.08 94 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.8 total, 40.6 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.70 GB write, 519.74 MB/s write, 14.23 GB read, 357.09 MB/s read, 83.3 seconds Interval compaction: 20.70 GB write, 522.83 MB/s write, 14.23 GB read, 359.22 MB/s read, 83.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 27, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3081971 Average: 2.6979 StdDev: 18.07 Min: 0 Median: 1.4873 Max: 8015 Percentiles: P50: 1.49 P75: 1.87 P99: 6.98 P99.9: 145.50 P99.99: 305.17 ------------------------------------------------------ [ 0, 1 ] 567726 18.421% 18.421% #### ( 1, 2 ] 1997445 64.811% 83.232% ############# ( 2, 3 ] 294608 9.559% 92.791% ## ( 3, 4 ] 103655 3.363% 96.154% # ( 4, 6 ] 81923 2.658% 98.812% # ( 6, 10 ] 23531 0.764% 99.575% ( 10, 15 ] 3682 0.119% 99.695% ( 15, 22 ] 516 0.017% 99.712% ( 22, 34 ] 51 0.002% 99.713% ( 34, 51 ] 16 0.001% 99.714% ( 51, 76 ] 15 0.000% 99.714% ( 76, 110 ] 2908 0.094% 99.809% ( 110, 170 ] 4755 0.154% 99.963% ( 170, 250 ] 637 0.021% 99.984% ( 250, 380 ] 459 0.015% 99.999% ( 380, 580 ] 384 0.012% 100.011% ( 580, 870 ] 174 0.006% 100.017% ( 870, 1300 ] 74 0.002% 100.019% ( 1300, 1900 ] 32 0.001% 100.020% ( 1900, 2900 ] 33 0.001% 100.021% ( 2900, 4400 ] 17 0.001% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ( 6600, 9900 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 984633 Average: 3.7782 StdDev: 34.01 Min: 0 Median: 1.6934 Max: 9296 Percentiles: P50: 1.69 P75: 2.42 P99: 9.53 P99.9: 160.49 P99.99: 366.32 ------------------------------------------------------ [ 0, 1 ] 89683 9.108% 9.108% ## ( 1, 2 ] 580672 58.973% 68.082% ############ ( 2, 3 ] 162862 16.540% 84.622% ### ( 3, 4 ] 63340 6.433% 91.055% # ( 4, 6 ] 60962 6.191% 97.246% # ( 6, 10 ] 19581 1.989% 99.235% ( 10, 15 ] 4249 0.432% 99.666% ( 15, 22 ] 451 0.046% 99.712% ( 22, 34 ] 52 0.005% 99.718% ( 34, 51 ] 9 0.001% 99.718% ( 51, 76 ] 3 0.000% 99.719% ( 76, 110 ] 847 0.086% 99.805% ( 110, 170 ] 1114 0.113% 99.918% ( 170, 250 ] 374 0.038% 99.956% ( 250, 380 ] 375 0.038% 99.994% ( 380, 580 ] 340 0.035% 100.029% ( 580, 870 ] 273 0.028% 100.056% ( 870, 1300 ] 170 0.017% 100.074% ( 1300, 1900 ] 49 0.005% 100.079% ( 1900, 2900 ] 42 0.004% 100.083% ( 2900, 4400 ] 11 0.001% 100.084% ( 4400, 6600 ] 4 0.000% 100.084% ( 6600, 9900 ] 1 0.000% 100.084% ** Level 2 read latency histogram (micros): Count: 31985 Average: 1.7418 StdDev: 5.08 Min: 0 Median: 1.1806 Max: 828 Percentiles: P50: 1.18 P75: 1.63 P99: 4.70 P99.9: 9.57 P99.99: 31.62 ------------------------------------------------------ [ 0, 1 ] 12800 40.019% 40.019% ######## ( 1, 2 ] 17673 55.254% 95.273% ########### ( 2, 3 ] 713 2.229% 97.502% ( 3, 4 ] 396 1.238% 98.740% ( 4, 6 ] 238 0.744% 99.484% ( 6, 10 ] 149 0.466% 99.950% ( 10, 15 ] 8 0.025% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 226537 Average: 5.1366 StdDev: 83.60 Min: 0 Median: 1.6885 Max: 10073 Percentiles: P50: 1.69 P75: 2.35 P99: 9.69 P99.9: 525.34 P99.99: 1405.67 ------------------------------------------------------ [ 0, 1 ] 19220 8.484% 8.484% ## ( 1, 2 ] 136608 60.303% 68.787% ############ ( 2, 3 ] 39680 17.516% 86.303% #### ( 3, 4 ] 12517 5.525% 91.828% # ( 4, 6 ] 12369 5.460% 97.288% # ( 6, 10 ] 4209 1.858% 99.146% ( 10, 15 ] 675 0.298% 99.444% ( 15, 22 ] 85 0.038% 99.482% ( 22, 34 ] 19 0.008% 99.490% ( 34, 51 ] 6 0.003% 99.493% ( 51, 76 ] 1 0.000% 99.493% ( 76, 110 ] 175 0.077% 99.570% ( 110, 170 ] 289 0.128% 99.698% ( 170, 250 ] 195 0.086% 99.784% ( 250, 380 ] 153 0.068% 99.852% ( 380, 580 ] 152 0.067% 99.919% ( 580, 870 ] 103 0.045% 99.964% ( 870, 1300 ] 56 0.025% 99.989% ( 1300, 1900 ] 19 0.008% 99.997% ( 1900, 2900 ] 14 0.006% 100.004% ( 2900, 4400 ] 11 0.005% 100.008% ( 4400, 6600 ] 5 0.002% 100.011% ( 6600, 9900 ] 12 0.005% 100.016% ( 9900, 14000 ] 2 0.001% 100.017% ** Level 4 read latency histogram (micros): Count: 791 Average: 226.2630 StdDev: 884.37 Min: 0 Median: 2.2638 Max: 9366 Percentiles: P50: 2.26 P75: 5.55 P99: 4999.50 P99.9: 9366.00 P99.99: 9366.00 ------------------------------------------------------ [ 0, 1 ] 70 8.850% 8.850% ## ( 1, 2 ] 292 36.915% 45.765% ####### ( 2, 3 ] 127 16.056% 61.820% ### ( 3, 4 ] 57 7.206% 69.027% # ( 4, 6 ] 61 7.712% 76.738% ## ( 6, 10 ] 29 3.666% 80.405% # ( 10, 15 ] 5 0.632% 81.037% ( 15, 22 ] 1 0.126% 81.163% ( 110, 170 ] 7 0.885% 82.048% ( 170, 250 ] 13 1.643% 83.692% ( 250, 380 ] 30 3.793% 87.484% # ( 380, 580 ] 27 3.413% 90.898% # ( 580, 870 ] 24 3.034% 93.932% # ( 870, 1300 ] 19 2.402% 96.334% ( 1300, 1900 ] 9 1.138% 97.472% ( 1900, 2900 ] 5 0.632% 98.104% ( 2900, 4400 ] 6 0.759% 98.862% ( 4400, 6600 ] 4 0.506% 99.368% ( 6600, 9900 ] 5 0.632% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 919.0333 StdDev: 1081.92 Min: 91 Median: 315.0000 Max: 3986 Percentiles: P50: 315.00 P75: 1420.00 P99: 3986.00 P99.9: 3986.00 P99.99: 3986.00 ------------------------------------------------------ ( 76, 110 ] 8 13.333% 13.333% ### ( 110, 170 ] 9 15.000% 28.333% ### ( 170, 250 ] 11 18.333% 46.667% #### ( 250, 380 ] 4 6.667% 53.333% # ( 380, 580 ] 3 5.000% 58.333% # ( 580, 870 ] 4 6.667% 65.000% # ( 870, 1300 ] 5 8.333% 73.333% ## ( 1300, 1900 ] 5 8.333% 81.667% ## ( 1900, 2900 ] 6 10.000% 91.667% ## ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 40.8 total, 16.9 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 168.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.324 H:M:S, 52.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 58.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.512 H:M:S, 80.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/08-02:17:41 ... thread 0: (1000000,8000000) ops and (222765.3,177623.2) ops/second in (4.489030,45.039159) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/2 2.88 GB 182.5 7.2 0.0 7.2 14.8 7.6 0.0 1.9 141.3 289.7 52.14 47.61 130 0.401 7482K 11K 0.0 0.0 L1 7/7 778.26 MB 0.0 5.7 4.5 1.2 5.6 4.4 0.2 1.2 216.5 213.1 26.75 24.84 3 8.916 5880K 90K 0.0 0.0 L2 1/0 128.78 MB 1.3 0.1 0.1 0.1 0.1 0.1 3.9 2.0 251.7 251.5 0.50 0.48 1 0.501 127K 49 0.0 0.0 L3 46/9 2.72 GB 2.2 4.7 3.4 1.2 4.7 3.4 0.4 1.4 197.1 196.6 24.23 21.21 9 2.692 4457K 6395 0.0 0.0 L4 172/9 9.50 GB 1.0 1.1 1.1 0.0 1.1 1.1 0.8 1.0 120.2 120.1 9.50 5.63 15 0.634 1158K 1194 0.0 0.0 L5 1064/0 87.60 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1301/27 103.59 GB 0.0 18.8 9.1 9.7 26.2 16.5 7.3 3.5 169.8 237.2 113.12 99.77 158 0.716 19M 109K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.8 9.1 9.7 26.2 16.5 7.2 3.5 169.8 237.2 113.12 99.77 158 0.716 19M 109K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.8 9.1 9.7 18.6 9.0 0.0 0.0 214.0 212.7 89.75 80.09 51 1.760 19M 109K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 331.6 23.37 19.68 107 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.3 total, 45.0 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.21 GB write, 592.67 MB/s write, 18.75 GB read, 424.10 MB/s read, 113.1 seconds Interval compaction: 26.21 GB write, 595.84 MB/s write, 18.75 GB read, 426.38 MB/s read, 113.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 39, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3367179 Average: 2.8110 StdDev: 20.34 Min: 0 Median: 1.5090 Max: 8015 Percentiles: P50: 1.51 P75: 1.90 P99: 7.43 P99.9: 149.80 P99.99: 364.33 ------------------------------------------------------ [ 0, 1 ] 582940 17.312% 17.312% ### ( 1, 2 ] 2162308 64.217% 81.530% ############# ( 2, 3 ] 349486 10.379% 91.909% ## ( 3, 4 ] 124342 3.693% 95.602% # ( 4, 6 ] 104147 3.093% 98.695% # ( 6, 10 ] 28858 0.857% 99.552% ( 10, 15 ] 4801 0.143% 99.694% ( 15, 22 ] 627 0.019% 99.713% ( 22, 34 ] 61 0.002% 99.715% ( 34, 51 ] 16 0.000% 99.715% ( 51, 76 ] 28 0.001% 99.716% ( 76, 110 ] 2934 0.087% 99.803% ( 110, 170 ] 4920 0.146% 99.949% ( 170, 250 ] 829 0.025% 99.974% ( 250, 380 ] 620 0.018% 99.992% ( 380, 580 ] 521 0.015% 100.008% ( 580, 870 ] 277 0.008% 100.016% ( 870, 1300 ] 116 0.003% 100.019% ( 1300, 1900 ] 53 0.002% 100.021% ( 1900, 2900 ] 40 0.001% 100.022% ( 2900, 4400 ] 26 0.001% 100.023% ( 4400, 6600 ] 2 0.000% 100.023% ( 6600, 9900 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1429811 Average: 4.0978 StdDev: 43.27 Min: 0 Median: 1.7455 Max: 10477 Percentiles: P50: 1.75 P75: 2.56 P99: 9.58 P99.9: 173.64 P99.99: 455.10 ------------------------------------------------------ [ 0, 1 ] 99245 6.941% 6.941% # ( 1, 2 ] 825845 57.759% 64.700% ############ ( 2, 3 ] 265328 18.557% 83.257% #### ( 3, 4 ] 97935 6.850% 90.107% # ( 4, 6 ] 100173 7.006% 97.113% # ( 6, 10 ] 30150 2.109% 99.221% ( 10, 15 ] 6742 0.472% 99.693% ( 15, 22 ] 676 0.047% 99.740% ( 22, 34 ] 65 0.005% 99.745% ( 34, 51 ] 11 0.001% 99.745% ( 51, 76 ] 9 0.001% 99.746% ( 76, 110 ] 889 0.062% 99.808% ( 110, 170 ] 1288 0.090% 99.898% ( 170, 250 ] 553 0.039% 99.937% ( 250, 380 ] 566 0.040% 99.977% ( 380, 580 ] 514 0.036% 100.012% ( 580, 870 ] 498 0.035% 100.047% ( 870, 1300 ] 289 0.020% 100.067% ( 1300, 1900 ] 101 0.007% 100.075% ( 1900, 2900 ] 81 0.006% 100.080% ( 2900, 4400 ] 53 0.004% 100.084% ( 4400, 6600 ] 14 0.001% 100.085% ( 6600, 9900 ] 1 0.000% 100.085% ( 9900, 14000 ] 1 0.000% 100.085% ** Level 2 read latency histogram (micros): Count: 31985 Average: 1.7418 StdDev: 5.08 Min: 0 Median: 1.1806 Max: 828 Percentiles: P50: 1.18 P75: 1.63 P99: 4.70 P99.9: 9.57 P99.99: 31.62 ------------------------------------------------------ [ 0, 1 ] 12800 40.019% 40.019% ######## ( 1, 2 ] 17673 55.254% 95.273% ########### ( 2, 3 ] 713 2.229% 97.502% ( 3, 4 ] 396 1.238% 98.740% ( 4, 6 ] 238 0.744% 99.484% ( 6, 10 ] 149 0.466% 99.950% ( 10, 15 ] 8 0.025% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 532270 Average: 7.0199 StdDev: 105.37 Min: 0 Median: 1.8643 Max: 10073 Percentiles: P50: 1.86 P75: 2.80 P99: 10.05 P99.9: 448.63 P99.99: 811.06 ------------------------------------------------------ [ 0, 1 ] 22985 4.318% 4.318% # ( 1, 2 ] 281315 52.852% 57.170% ########### ( 2, 3 ] 118553 22.273% 79.443% #### ( 3, 4 ] 43449 8.163% 87.606% ## ( 4, 6 ] 48748 9.159% 96.765% ## ( 6, 10 ] 11870 2.230% 98.995% ( 10, 15 ] 3004 0.564% 99.559% ( 15, 22 ] 354 0.067% 99.626% ( 22, 34 ] 39 0.007% 99.633% ( 34, 51 ] 12 0.002% 99.635% ( 51, 76 ] 6 0.001% 99.636% ( 76, 110 ] 213 0.040% 99.676% ( 110, 170 ] 395 0.074% 99.751% ( 170, 250 ] 341 0.064% 99.815% ( 250, 380 ] 337 0.063% 99.878% ( 380, 580 ] 346 0.065% 99.943% ( 580, 870 ] 316 0.059% 100.002% ( 870, 1300 ] 187 0.035% 100.038% ( 1300, 1900 ] 130 0.024% 100.062% ( 1900, 2900 ] 122 0.023% 100.085% ( 2900, 4400 ] 153 0.029% 100.114% ( 4400, 6600 ] 32 0.006% 100.120% ( 6600, 9900 ] 23 0.004% 100.124% ( 9900, 14000 ] 2 0.000% 100.124% ** Level 4 read latency histogram (micros): Count: 8119 Average: 177.0360 StdDev: 570.32 Min: 0 Median: 2.4598 Max: 9366 Percentiles: P50: 2.46 P75: 4.89 P99: 2993.69 P99.9: 6238.85 P99.99: 9364.15 ------------------------------------------------------ [ 0, 1 ] 202 2.488% 2.488% ( 1, 2 ] 3010 37.074% 39.562% ####### ( 2, 3 ] 1843 22.700% 62.261% ##### ( 3, 4 ] 767 9.447% 71.708% ## ( 4, 6 ] 602 7.415% 79.123% # ( 6, 10 ] 164 2.020% 81.143% ( 10, 15 ] 52 0.640% 81.783% ( 15, 22 ] 14 0.172% 81.956% ( 22, 34 ] 4 0.049% 82.005% ( 34, 51 ] 2 0.025% 82.030% ( 76, 110 ] 8 0.099% 82.128% ( 110, 170 ] 66 0.813% 82.941% ( 170, 250 ] 117 1.441% 84.382% ( 250, 380 ] 181 2.229% 86.612% ( 380, 580 ] 257 3.165% 89.777% # ( 580, 870 ] 287 3.535% 93.312% # ( 870, 1300 ] 261 3.215% 96.527% # ( 1300, 1900 ] 117 1.441% 97.968% ( 1900, 2900 ] 80 0.985% 98.953% ( 2900, 4400 ] 61 0.751% 99.704% ( 4400, 6600 ] 19 0.234% 99.938% ( 6600, 9900 ] 5 0.062% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 1034.6167 StdDev: 1209.07 Min: 91 Median: 424.4444 Max: 4787 Percentiles: P50: 424.44 P75: 1525.00 P99: 4787.00 P99.9: 4787.00 P99.99: 4787.00 ------------------------------------------------------ ( 76, 110 ] 10 8.333% 8.333% ## ( 110, 170 ] 13 10.833% 19.167% ## ( 170, 250 ] 22 18.333% 37.500% #### ( 250, 380 ] 13 10.833% 48.333% ## ( 380, 580 ] 9 7.500% 55.833% ## ( 580, 870 ] 10 8.333% 64.167% ## ( 870, 1300 ] 10 8.333% 72.500% ## ( 1300, 1900 ] 8 6.667% 79.167% # ( 1900, 2900 ] 11 9.167% 88.333% ## ( 2900, 4400 ] 12 10.000% 98.333% ## ( 4400, 6600 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 45.3 total, 4.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 173.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.007 H:M:S, 50.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 219.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.683 H:M:S, 37.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/08-02:17:45 ... thread 0: (1000000,9000000) ops and (231726.5,182353.9) ops/second in (4.315433,49.354592) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 2.70 GB 6.3 7.4 0.0 7.4 15.9 8.5 0.0 1.9 133.1 284.8 57.24 51.11 143 0.400 7738K 11K 0.0 0.0 L1 18/18 1.59 GB 0.0 7.5 5.6 1.9 7.4 5.5 0.2 1.3 210.1 207.4 36.64 33.43 4 9.160 7026K 90K 0.0 0.0 L2 1/0 68.25 MB 0.7 0.1 0.1 0.1 0.1 0.1 4.1 2.0 251.7 251.5 0.50 0.48 1 0.501 127K 49 0.0 0.0 L3 19/0 989.09 MB 1.0 5.0 3.6 1.4 5.0 3.6 0.5 1.4 191.2 190.8 26.81 22.88 11 2.437 4815K 7286 0.0 0.0 L4 179/0 9.61 GB 1.0 3.2 3.2 0.1 3.2 3.2 0.9 1.0 121.5 121.4 27.36 16.07 45 0.608 3113K 1669 0.0 0.0 L5 1088/0 89.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1323/35 104.50 GB 0.0 23.3 12.5 10.9 31.7 20.8 9.7 3.7 160.9 218.5 148.55 123.97 204 0.728 22M 111K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.3 12.5 10.9 31.7 20.8 9.6 3.7 160.9 218.5 148.55 123.97 204 0.728 22M 111K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.3 12.5 10.9 23.2 12.3 0.0 0.0 197.1 196.0 121.27 101.77 85 1.427 22M 111K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 318.6 27.28 22.19 119 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.6 total, 49.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.70 GB write, 654.49 MB/s write, 23.34 GB read, 481.82 MB/s read, 148.6 seconds Interval compaction: 31.70 GB write, 657.69 MB/s write, 23.34 GB read, 484.18 MB/s read, 148.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 66, interval: 89 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3657392 Average: 2.8677 StdDev: 22.19 Min: 0 Median: 1.5185 Max: 8015 Percentiles: P50: 1.52 P75: 1.91 P99: 7.48 P99.9: 150.52 P99.99: 423.09 ------------------------------------------------------ [ 0, 1 ] 613170 16.765% 16.765% ### ( 1, 2 ] 2344373 64.100% 80.865% ############# ( 2, 3 ] 392421 10.730% 91.594% ## ( 3, 4 ] 139136 3.804% 95.399% # ( 4, 6 ] 119761 3.274% 98.673% # ( 6, 10 ] 32326 0.884% 99.557% ( 10, 15 ] 5486 0.150% 99.707% ( 15, 22 ] 680 0.019% 99.726% ( 22, 34 ] 63 0.002% 99.727% ( 34, 51 ] 17 0.000% 99.728% ( 51, 76 ] 29 0.001% 99.728% ( 76, 110 ] 2939 0.080% 99.809% ( 110, 170 ] 4939 0.135% 99.944% ( 170, 250 ] 879 0.024% 99.968% ( 250, 380 ] 680 0.019% 99.987% ( 380, 580 ] 600 0.016% 100.003% ( 580, 870 ] 384 0.010% 100.013% ( 870, 1300 ] 188 0.005% 100.019% ( 1300, 1900 ] 76 0.002% 100.021% ( 1900, 2900 ] 54 0.001% 100.022% ( 2900, 4400 ] 35 0.001% 100.023% ( 4400, 6600 ] 2 0.000% 100.023% ( 6600, 9900 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1490621 Average: 4.4361 StdDev: 53.75 Min: 0 Median: 1.7562 Max: 10477 Percentiles: P50: 1.76 P75: 2.59 P99: 9.65 P99.9: 211.86 P99.99: 547.23 ------------------------------------------------------ [ 0, 1 ] 99898 6.702% 6.702% # ( 1, 2 ] 853498 57.258% 63.960% ########### ( 2, 3 ] 281106 18.858% 82.818% #### ( 3, 4 ] 104361 7.001% 89.819% # ( 4, 6 ] 107871 7.237% 97.056% # ( 6, 10 ] 31781 2.132% 99.188% ( 10, 15 ] 7278 0.488% 99.676% ( 15, 22 ] 749 0.050% 99.726% ( 22, 34 ] 70 0.005% 99.731% ( 34, 51 ] 12 0.001% 99.732% ( 51, 76 ] 9 0.001% 99.732% ( 76, 110 ] 889 0.060% 99.792% ( 110, 170 ] 1308 0.088% 99.880% ( 170, 250 ] 574 0.039% 99.918% ( 250, 380 ] 593 0.040% 99.958% ( 380, 580 ] 568 0.038% 99.996% ( 580, 870 ] 542 0.036% 100.033% ( 870, 1300 ] 338 0.023% 100.055% ( 1300, 1900 ] 139 0.009% 100.065% ( 1900, 2900 ] 128 0.009% 100.073% ( 2900, 4400 ] 104 0.007% 100.080% ( 4400, 6600 ] 24 0.002% 100.082% ( 6600, 9900 ] 5 0.000% 100.082% ( 9900, 14000 ] 2 0.000% 100.082% ** Level 2 read latency histogram (micros): Count: 31985 Average: 1.7418 StdDev: 5.08 Min: 0 Median: 1.1806 Max: 828 Percentiles: P50: 1.18 P75: 1.63 P99: 4.70 P99.9: 9.57 P99.99: 31.62 ------------------------------------------------------ [ 0, 1 ] 12800 40.019% 40.019% ######## ( 1, 2 ] 17673 55.254% 95.273% ########### ( 2, 3 ] 713 2.229% 97.502% ( 3, 4 ] 396 1.238% 98.740% ( 4, 6 ] 238 0.744% 99.484% ( 6, 10 ] 149 0.466% 99.950% ( 10, 15 ] 8 0.025% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1079714 Average: 7.6243 StdDev: 109.36 Min: 0 Median: 1.9506 Max: 10558 Percentiles: P50: 1.95 P75: 2.93 P99: 9.94 P99.9: 328.55 P99.99: 602.44 ------------------------------------------------------ [ 0, 1 ] 28622 2.651% 2.651% # ( 1, 2 ] 537802 49.810% 52.461% ########## ( 2, 3 ] 261996 24.265% 76.726% ##### ( 3, 4 ] 102357 9.480% 86.206% ## ( 4, 6 ] 114055 10.563% 96.769% ## ( 6, 10 ] 24466 2.266% 99.035% ( 10, 15 ] 6995 0.648% 99.683% ( 15, 22 ] 780 0.072% 99.755% ( 22, 34 ] 79 0.007% 99.763% ( 34, 51 ] 20 0.002% 99.765% ( 51, 76 ] 9 0.001% 99.765% ( 76, 110 ] 219 0.020% 99.786% ( 110, 170 ] 455 0.042% 99.828% ( 170, 250 ] 450 0.042% 99.870% ( 250, 380 ] 545 0.050% 99.920% ( 380, 580 ] 699 0.065% 99.985% ( 580, 870 ] 737 0.068% 100.053% ( 870, 1300 ] 534 0.049% 100.102% ( 1300, 1900 ] 360 0.033% 100.136% ( 1900, 2900 ] 330 0.031% 100.166% ( 2900, 4400 ] 358 0.033% 100.199% ( 4400, 6600 ] 79 0.007% 100.207% ( 6600, 9900 ] 36 0.003% 100.210% ( 9900, 14000 ] 3 0.000% 100.210% ** Level 4 read latency histogram (micros): Count: 22559 Average: 135.1880 StdDev: 499.11 Min: 0 Median: 2.3627 Max: 9387 Percentiles: P50: 2.36 P75: 3.91 P99: 2585.93 P99.9: 5637.75 P99.99: 8623.23 ------------------------------------------------------ [ 0, 1 ] 478 2.119% 2.119% ( 1, 2 ] 8803 39.022% 41.141% ######## ( 2, 3 ] 5510 24.425% 65.566% ##### ( 3, 4 ] 2343 10.386% 75.952% ## ( 4, 6 ] 1820 8.068% 84.020% ## ( 6, 10 ] 449 1.990% 86.010% ( 10, 15 ] 157 0.696% 86.706% ( 15, 22 ] 44 0.195% 86.901% ( 22, 34 ] 10 0.044% 86.945% ( 34, 51 ] 7 0.031% 86.976% ( 76, 110 ] 15 0.066% 87.043% ( 110, 170 ] 97 0.430% 87.473% ( 170, 250 ] 209 0.926% 88.399% ( 250, 380 ] 315 1.396% 89.796% ( 380, 580 ] 497 2.203% 91.999% ( 580, 870 ] 632 2.802% 94.800% # ( 870, 1300 ] 554 2.456% 97.256% ( 1300, 1900 ] 272 1.206% 98.462% ( 1900, 2900 ] 177 0.785% 99.246% ( 2900, 4400 ] 130 0.576% 99.823% ( 4400, 6600 ] 31 0.137% 99.960% ( 6600, 9900 ] 11 0.049% 100.009% ** Level 5 read latency histogram (micros): Count: 240 Average: 1176.7458 StdDev: 1299.09 Min: 91 Median: 558.9474 Max: 5544 Percentiles: P50: 558.95 P75: 1820.00 P99: 5544.00 P99.9: 5544.00 P99.99: 5544.00 ------------------------------------------------------ ( 76, 110 ] 11 4.583% 4.583% # ( 110, 170 ] 20 8.333% 12.917% ## ( 170, 250 ] 39 16.250% 29.167% ### ( 250, 380 ] 33 13.750% 42.917% ### ( 380, 580 ] 19 7.917% 50.833% ## ( 580, 870 ] 23 9.583% 60.417% ## ( 870, 1300 ] 22 9.167% 69.583% ## ( 1300, 1900 ] 15 6.250% 75.833% # ( 1900, 2900 ] 22 9.167% 85.000% ## ( 2900, 4400 ] 30 12.500% 97.500% ### ( 4400, 6600 ] 6 2.500% 100.000% # ** DB Stats ** Uptime(secs): 49.6 total, 4.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 178.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.598 H:M:S, 49.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 228.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.591 H:M:S, 36.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.124 micros/op 163303 ops/sec 60.115 seconds 9816999 operations; 158.2 MB/s Microseconds per write: Count: 9816999 Average: 6.1231 StdDev: 415.65 Min: 0 Median: 1.7392 Max: 593968 Percentiles: P50: 1.74 P75: 2.75 P99: 9.91 P99.9: 1151.78 P99.99: 2631.93 ------------------------------------------------------ [ 0, 1 ] 1349814 13.750% 13.750% ### ( 1, 2 ] 4813973 49.037% 62.787% ########## ( 2, 3 ] 1589948 16.196% 78.983% ### ( 3, 4 ] 1310123 13.345% 92.328% ### ( 4, 6 ] 519029 5.287% 97.615% # ( 6, 10 ] 139144 1.417% 99.033% ( 10, 15 ] 49700 0.506% 99.539% ( 15, 22 ] 11247 0.115% 99.653% ( 22, 34 ] 1928 0.020% 99.673% ( 34, 51 ] 285 0.003% 99.676% ( 51, 76 ] 35 0.000% 99.676% ( 76, 110 ] 6910 0.070% 99.747% ( 110, 170 ] 2469 0.025% 99.772% ( 170, 250 ] 309 0.003% 99.775% ( 250, 380 ] 218 0.002% 99.777% ( 380, 580 ] 39 0.000% 99.778% ( 580, 870 ] 32 0.000% 99.778% ( 870, 1300 ] 18280 0.186% 99.964% ( 1300, 1900 ] 56 0.001% 99.965% ( 1900, 2900 ] 3386 0.034% 99.999% ( 2900, 4400 ] 29 0.000% 100.000% ( 4400, 6600 ] 10 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 4 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 4 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 175944 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9816999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10131142968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 526 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32771821 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30954480707 rocksdb.compact.write.bytes COUNT : 30786444845 rocksdb.flush.write.bytes COUNT : 10106389911 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 56 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 260 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10025283584 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4251648 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31048856196 rocksdb.non.last.level.read.count COUNT : 7501800 rocksdb.block.checksum.compute.count COUNT : 7500804 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.396213 P95 : 3.954904 P99 : 8.696203 P100 : 593964.000000 COUNT : 9816999 SUM : 55524641 rocksdb.compaction.times.micros P50 : 845500.000000 P95 : 4795000.000000 P99 : 14720000.000000 P100 : 20510445.000000 COUNT : 91 SUM : 131551186 rocksdb.compaction.times.cpu_micros P50 : 498750.000000 P95 : 4795000.000000 P99 : 14720000.000000 P100 : 18783446.000000 COUNT : 91 SUM : 111903883 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 711.818182 P95 : 3800.000000 P99 : 29480.000000 P100 : 58164.000000 COUNT : 132 SUM : 233884 rocksdb.compaction.outfile.sync.micros P50 : 1094.052632 P95 : 36329.166667 P99 : 72350.000000 P100 : 134760.000000 COUNT : 353 SUM : 2325122 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 107.000000 P95 : 916.583333 P99 : 2743.333333 P100 : 4484.000000 COUNT : 247 SUM : 62201 rocksdb.table.open.io.micros P50 : 1614.634146 P95 : 8281.428571 P99 : 21083.636364 P100 : 24298.000000 COUNT : 526 SUM : 1364610 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.689027 P95 : 8.025505 P99 : 12.383028 P100 : 10563.000000 COUNT : 7499231 SUM : 47019223 rocksdb.read.block.get.micros P50 : 530.000000 P95 : 4050.000000 P99 : 8246.117647 P100 : 10217.000000 COUNT : 1052 SUM : 1122031 rocksdb.write.raw.block.micros P50 : 0.513780 P95 : 0.976182 P99 : 2.907635 P100 : 11210.000000 COUNT : 9903800 SUM : 20418923 rocksdb.numfiles.in.singlecompaction P50 : 2.750000 P95 : 6.750000 P99 : 26.500000 P100 : 27.000000 COUNT : 125 SUM : 442 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565713 P95 : 1159.905313 P99 : 2358.470903 P100 : 593754.000000 COUNT : 188087 SUM : 32793858 rocksdb.sst.read.micros P50 : 1.611048 P95 : 4.792563 P99 : 8.967733 P100 : 10558.000000 COUNT : 7501900 SUM : 31678392 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9816999 SUM : 10131142968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217311.827957 P95 : 424333.333333 P99 : 668600.000000 P100 : 725304.000000 COUNT : 132 SUM : 29988465 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 326 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0