[2024-12-03 15:18:34.165279] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-03 15:18:34.165381] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1012964 ] Set seed to 1733235514162919 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-03 15:18:34.262813] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-03 15:18:34.298981] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-03 15:18:34.299027] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1012964' to capture a snapshot of events at runtime. [2024-12-03 15:18:34.299039] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1012964 for offline analysis/debug. [2024-12-03 15:18:34.299081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Dec 3 15:18:38 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/03-15:18:41 ... thread 0: (1000000,1000000) ops and (355378.2,355378.2) ops/second in (2.813904,2.813904) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 503.99 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 351.9 2.33 2.11 12 0.194 0 0 0.0 0.0 L1 3/3 188.86 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 258.3 258.2 0.73 0.70 1 0.732 191K 82 0.0 0.0 L2 2/1 125.97 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 231.0 230.9 0.55 0.53 1 0.546 127K 39 0.0 0.0 L3 11/0 930.58 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/12 96.94 GB 0.0 0.3 0.2 0.1 1.1 1.0 0.4 1.4 87.4 314.6 3.60 3.34 14 0.257 319K 121 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.4 1.4 87.4 314.6 3.60 3.34 14 0.257 319K 121 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 246.6 246.5 1.28 1.23 2 0.639 319K 121 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 351.9 2.33 2.11 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 378.14 MB/s write, 0.31 GB read, 105.04 MB/s read, 3.6 seconds Interval compaction: 1.11 GB write, 402.64 MB/s write, 0.31 GB read, 111.85 MB/s read, 3.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 119341 Average: 1.7975 StdDev: 11.82 Min: 1 Median: 1.1603 Max: 2517 Percentiles: P50: 1.16 P75: 1.63 P99: 4.41 P99.9: 10.00 P99.99: 251.71 ------------------------------------------------------ [ 0, 1 ] 49472 41.454% 41.454% ######## ( 1, 2 ] 63616 53.306% 94.760% ########### ( 2, 3 ] 3401 2.850% 97.610% # ( 3, 4 ] 1469 1.231% 98.841% ( 4, 6 ] 952 0.798% 99.639% ( 6, 10 ] 316 0.265% 99.904% ( 10, 15 ] 74 0.062% 99.966% ( 15, 22 ] 16 0.013% 99.979% ( 22, 34 ] 3 0.003% 99.982% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 11 0.009% 99.992% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 5 0.004% 99.997% ( 580, 870 ] 3 0.003% 100.000% ( 870, 1300 ] 1 0.001% 100.001% ( 1300, 1900 ] 1 0.001% 100.002% ( 1900, 2900 ] 2 0.002% 100.003% ** Level 1 read latency histogram (micros): Count: 23171 Average: 2.1949 StdDev: 40.68 Min: 0 Median: 1.1932 Max: 4305 Percentiles: P50: 1.19 P75: 1.64 P99: 3.97 P99.9: 9.59 P99.99: 824.02 ------------------------------------------------------ [ 0, 1 ] 9098 39.265% 39.265% ######## ( 1, 2 ] 12875 55.565% 94.830% ########### ( 2, 3 ] 672 2.900% 97.730% # ( 3, 4 ] 302 1.303% 99.033% ( 4, 6 ] 173 0.747% 99.780% ( 6, 10 ] 31 0.134% 99.914% ( 10, 15 ] 8 0.035% 99.948% ( 15, 22 ] 2 0.009% 99.957% ( 34, 51 ] 1 0.004% 99.961% ( 170, 250 ] 2 0.009% 99.970% ( 250, 380 ] 2 0.009% 99.978% ( 380, 580 ] 1 0.004% 99.983% ( 580, 870 ] 2 0.009% 99.991% ( 2900, 4400 ] 2 0.009% 100.000% ** Level 2 read latency histogram (micros): Count: 6653 Average: 2.5994 StdDev: 9.43 Min: 0 Median: 1.5897 Max: 658 Percentiles: P50: 1.59 P75: 2.15 P99: 8.69 P99.9: 18.14 P99.99: 658.00 ------------------------------------------------------ [ 0, 1 ] 1099 16.519% 16.519% ### ( 1, 2 ] 3779 56.801% 73.320% ########### ( 2, 3 ] 766 11.514% 84.834% ## ( 3, 4 ] 478 7.185% 92.019% # ( 4, 6 ] 389 5.847% 97.866% # ( 6, 10 ] 115 1.729% 99.594% ( 10, 15 ] 21 0.316% 99.910% ( 15, 22 ] 3 0.045% 99.955% ( 22, 34 ] 1 0.015% 99.970% ( 34, 51 ] 1 0.015% 99.985% ( 51, 76 ] 1 0.015% 100.000% ( 380, 580 ] 1 0.015% 100.015% ( 580, 870 ] 1 0.015% 100.030% ** Level 3 read latency histogram (micros): Count: 50 Average: 1923.3200 StdDev: 1620.56 Min: 81 Median: 1300.0000 Max: 5057 Percentiles: P50: 1300.00 P75: 3275.00 P99: 5057.00 P99.9: 5057.00 P99.99: 5057.00 ------------------------------------------------------ ( 76, 110 ] 1 2.000% 2.000% ( 110, 170 ] 1 2.000% 4.000% ( 170, 250 ] 4 8.000% 12.000% ## ( 250, 380 ] 5 10.000% 22.000% ## ( 380, 580 ] 5 10.000% 32.000% ## ( 580, 870 ] 4 8.000% 40.000% ## ( 870, 1300 ] 5 10.000% 50.000% ## ( 1300, 1900 ] 4 8.000% 58.000% ## ( 1900, 2900 ] 6 12.000% 70.000% ## ( 2900, 4400 ] 10 20.000% 90.000% #### ( 4400, 6600 ] 5 10.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 25 Average: 1440.8400 StdDev: 1418.77 Min: 76 Median: 821.6667 Max: 5212 Percentiles: P50: 821.67 P75: 1850.00 P99: 5212.00 P99.9: 5212.00 P99.99: 5212.00 ------------------------------------------------------ ( 51, 76 ] 1 4.000% 4.000% # ( 76, 110 ] 1 4.000% 8.000% # ( 110, 170 ] 2 8.000% 16.000% ## ( 170, 250 ] 1 4.000% 20.000% # ( 250, 380 ] 4 16.000% 36.000% ### ( 380, 580 ] 1 4.000% 40.000% # ( 580, 870 ] 3 12.000% 52.000% ## ( 870, 1300 ] 3 12.000% 64.000% ## ( 1300, 1900 ] 3 12.000% 76.000% ## ( 1900, 2900 ] 1 4.000% 80.000% # ( 2900, 4400 ] 4 16.000% 96.000% ### ( 4400, 6600 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 328.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.198 H:M:S, 6.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 349.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.198 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/03-15:18:44 ... thread 0: (1000000,2000000) ops and (325715.6,339901.0) ops/second in (3.070163,5.884067) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.23 GB 94.4 0.8 0.0 0.8 2.6 1.8 0.0 1.4 99.9 322.5 8.20 7.59 29 0.283 831K 780 0.0 0.0 L1 1/0 4.19 MB 0.4 0.6 0.4 0.2 0.6 0.4 0.1 1.4 242.8 242.4 2.59 2.52 2 1.297 639K 811 0.0 0.0 L2 2/1 50.84 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 231.0 230.9 0.55 0.53 1 0.546 127K 39 0.0 0.0 L3 21/11 1.30 GB 0.4 0.1 0.1 0.0 0.1 0.1 0.5 1.0 212.7 212.8 0.59 0.53 1 0.586 126K 0 0.0 0.0 L4 173/0 9.71 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 116.6 116.6 0.96 0.64 1 0.960 113K 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1246/16 97.92 GB 0.0 1.8 0.7 1.0 3.6 2.5 1.2 2.0 140.6 282.2 12.89 11.79 34 0.379 1839K 1630 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.7 1.0 3.6 2.5 1.2 2.0 140.6 282.2 12.89 11.79 34 0.379 1839K 1630 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.7 1.0 1.8 0.7 0.0 0.0 233.5 233.2 7.76 7.22 8 0.970 1839K 1630 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.2 5.13 4.58 26 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.55 GB write, 599.28 MB/s write, 1.77 GB read, 298.51 MB/s read, 12.9 seconds Interval compaction: 3.55 GB write, 617.85 MB/s write, 1.77 GB read, 307.76 MB/s read, 12.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389257 Average: 2.0626 StdDev: 9.03 Min: 1 Median: 1.3959 Max: 2517 Percentiles: P50: 1.40 P75: 1.81 P99: 5.57 P99.9: 9.93 P99.99: 40.09 ------------------------------------------------------ [ 0, 1 ] 100564 25.835% 25.835% ##### ( 1, 2 ] 237621 61.045% 86.880% ############ ( 2, 3 ] 27443 7.050% 93.930% # ( 3, 4 ] 12959 3.329% 97.259% # ( 4, 6 ] 8645 2.221% 99.480% ( 6, 10 ] 1668 0.429% 99.908% ( 10, 15 ] 277 0.071% 99.979% ( 15, 22 ] 35 0.009% 99.988% ( 22, 34 ] 6 0.002% 99.990% ( 34, 51 ] 3 0.001% 99.991% ( 51, 76 ] 1 0.000% 99.991% ( 110, 170 ] 13 0.003% 99.994% ( 170, 250 ] 12 0.003% 99.997% ( 250, 380 ] 9 0.002% 100.000% ( 380, 580 ] 3 0.001% 100.001% ( 580, 870 ] 11 0.003% 100.003% ( 870, 1300 ] 5 0.001% 100.005% ( 1300, 1900 ] 3 0.001% 100.005% ( 1900, 2900 ] 2 0.001% 100.006% ** Level 1 read latency histogram (micros): Count: 47989 Average: 2.3156 StdDev: 30.16 Min: 0 Median: 1.3838 Max: 4305 Percentiles: P50: 1.38 P75: 1.79 P99: 5.51 P99.9: 11.63 P99.99: 913.24 ------------------------------------------------------ [ 0, 1 ] 12779 26.629% 26.629% ##### ( 1, 2 ] 29225 60.899% 87.528% ############ ( 2, 3 ] 3162 6.589% 94.117% # ( 3, 4 ] 1481 3.086% 97.204% # ( 4, 6 ] 1145 2.386% 99.589% ( 6, 10 ] 136 0.283% 99.873% ( 10, 15 ] 40 0.083% 99.956% ( 15, 22 ] 3 0.006% 99.962% ( 34, 51 ] 1 0.002% 99.965% ( 110, 170 ] 1 0.002% 99.967% ( 170, 250 ] 2 0.004% 99.971% ( 250, 380 ] 5 0.010% 99.981% ( 380, 580 ] 2 0.004% 99.985% ( 580, 870 ] 2 0.004% 99.990% ( 870, 1300 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 2900, 4400 ] 2 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 31838 Average: 2.3202 StdDev: 4.43 Min: 0 Median: 1.5486 Max: 658 Percentiles: P50: 1.55 P75: 1.96 P99: 6.82 P99.9: 12.86 P99.99: 47.88 ------------------------------------------------------ [ 0, 1 ] 5198 16.326% 16.326% ### ( 1, 2 ] 19543 61.383% 77.709% ############ ( 2, 3 ] 3443 10.814% 88.523% ## ( 3, 4 ] 1852 5.817% 94.340% # ( 4, 6 ] 1417 4.451% 98.791% # ( 6, 10 ] 324 1.018% 99.808% ( 10, 15 ] 51 0.160% 99.969% ( 15, 22 ] 4 0.013% 99.981% ( 22, 34 ] 2 0.006% 99.987% ( 34, 51 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 153727 Average: 3.5367 StdDev: 49.61 Min: 1 Median: 1.5565 Max: 5057 Percentiles: P50: 1.56 P75: 1.97 P99: 9.06 P99.9: 169.43 P99.99: 1091.08 ------------------------------------------------------ [ 0, 1 ] 25518 16.600% 16.600% ### ( 1, 2 ] 92259 60.015% 76.614% ############ ( 2, 3 ] 20192 13.135% 89.749% ### ( 3, 4 ] 6792 4.418% 94.168% # ( 4, 6 ] 5453 3.547% 97.715% # ( 6, 10 ] 2583 1.680% 99.395% ( 10, 15 ] 397 0.258% 99.653% ( 15, 22 ] 78 0.051% 99.704% ( 22, 34 ] 25 0.016% 99.720% ( 34, 51 ] 2 0.001% 99.722% ( 51, 76 ] 4 0.003% 99.724% ( 76, 110 ] 92 0.060% 99.784% ( 110, 170 ] 181 0.118% 99.902% ( 170, 250 ] 48 0.031% 99.933% ( 250, 380 ] 24 0.016% 99.949% ( 380, 580 ] 45 0.029% 99.978% ( 580, 870 ] 15 0.010% 99.988% ( 870, 1300 ] 9 0.006% 99.993% ( 1300, 1900 ] 6 0.004% 99.997% ( 1900, 2900 ] 10 0.007% 100.004% ( 2900, 4400 ] 11 0.007% 100.011% ( 4400, 6600 ] 5 0.003% 100.014% ** Level 4 read latency histogram (micros): Count: 310 Average: 122.8806 StdDev: 562.36 Min: 1 Median: 1.6614 Max: 5212 Percentiles: P50: 1.66 P75: 3.44 P99: 3612.50 P99.9: 5212.00 P99.99: 5212.00 ------------------------------------------------------ [ 0, 1 ] 71 22.903% 22.903% ##### ( 1, 2 ] 127 40.968% 63.871% ######## ( 2, 3 ] 23 7.419% 71.290% # ( 3, 4 ] 26 8.387% 79.677% ## ( 4, 6 ] 23 7.419% 87.097% # ( 6, 10 ] 10 3.226% 90.323% # ( 10, 15 ] 1 0.323% 90.645% ( 51, 76 ] 1 0.323% 90.968% ( 76, 110 ] 1 0.323% 91.290% ( 110, 170 ] 2 0.645% 91.935% ( 170, 250 ] 2 0.645% 92.581% ( 250, 380 ] 5 1.613% 94.194% ( 380, 580 ] 3 0.968% 95.161% ( 580, 870 ] 3 0.968% 96.129% ( 870, 1300 ] 3 0.968% 97.097% ( 1300, 1900 ] 3 0.968% 98.065% ( 1900, 2900 ] 1 0.323% 98.387% ( 2900, 4400 ] 4 1.290% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.572 H:M:S, 9.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.374 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/03-15:18:47 ... thread 0: (1000000,3000000) ops and (357436.3,345551.7) ops/second in (2.797701,8.681768) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 2.15 GB 0.0 1.6 0.0 1.6 4.3 2.7 0.0 1.6 118.2 318.2 13.85 12.89 46 0.301 1663K 1658 0.0 0.0 L1 1/1 4.19 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 242.8 242.4 2.59 2.52 2 1.297 639K 811 0.0 0.0 L2 1/0 49.60 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 231.0 230.9 0.55 0.53 1 0.546 127K 39 0.0 0.0 L3 17/0 814.51 MB 0.8 1.0 0.1 0.9 1.0 0.1 0.5 8.4 240.2 239.9 4.40 4.05 2 2.199 1073K 1256 0.0 0.0 L4 173/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 116.6 116.6 0.96 0.64 1 0.960 113K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/15 98.84 GB 0.0 3.5 0.7 2.8 6.2 3.4 2.4 2.3 159.4 283.2 22.35 20.61 52 0.430 3617K 3764 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 0.7 2.8 6.2 3.4 2.4 2.3 159.4 283.2 22.35 20.61 52 0.430 3617K 3764 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 0.7 2.8 3.5 0.7 0.0 0.0 242.8 242.6 14.67 13.77 12 1.222 3617K 3764 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 360.9 7.68 6.84 40 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.7 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.18 GB write, 713.98 MB/s write, 3.48 GB read, 401.78 MB/s read, 22.4 seconds Interval compaction: 6.18 GB write, 728.99 MB/s write, 3.48 GB read, 410.23 MB/s read, 22.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 623824 Average: 2.0805 StdDev: 9.29 Min: 1 Median: 1.4094 Max: 2810 Percentiles: P50: 1.41 P75: 1.81 P99: 5.56 P99.9: 10.32 P99.99: 32.16 ------------------------------------------------------ [ 0, 1 ] 153173 24.554% 24.554% ##### ( 1, 2 ] 387740 62.155% 86.709% ############ ( 2, 3 ] 45217 7.248% 93.958% # ( 3, 4 ] 21179 3.395% 97.353% # ( 4, 6 ] 13184 2.113% 99.466% ( 6, 10 ] 2674 0.429% 99.895% ( 10, 15 ] 533 0.085% 99.980% ( 15, 22 ] 55 0.009% 99.989% ( 22, 34 ] 9 0.001% 99.990% ( 34, 51 ] 5 0.001% 99.991% ( 51, 76 ] 3 0.000% 99.992% ( 76, 110 ] 10 0.002% 99.993% ( 110, 170 ] 17 0.003% 99.996% ( 170, 250 ] 24 0.004% 100.000% ( 250, 380 ] 15 0.002% 100.002% ( 380, 580 ] 10 0.002% 100.004% ( 580, 870 ] 16 0.003% 100.006% ( 870, 1300 ] 6 0.001% 100.007% ( 1300, 1900 ] 5 0.001% 100.008% ( 1900, 2900 ] 4 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 76349 Average: 2.3935 StdDev: 24.57 Min: 0 Median: 1.4007 Max: 4305 Percentiles: P50: 1.40 P75: 1.80 P99: 6.35 P99.9: 101.59 P99.99: 615.29 ------------------------------------------------------ [ 0, 1 ] 19102 25.019% 25.019% ##### ( 1, 2 ] 47593 62.336% 87.355% ############ ( 2, 3 ] 5035 6.595% 93.950% # ( 3, 4 ] 2291 3.001% 96.951% # ( 4, 6 ] 1511 1.979% 98.930% ( 6, 10 ] 610 0.799% 99.729% ( 10, 15 ] 78 0.102% 99.831% ( 15, 22 ] 6 0.008% 99.839% ( 22, 34 ] 1 0.001% 99.840% ( 34, 51 ] 1 0.001% 99.842% ( 51, 76 ] 1 0.001% 99.843% ( 76, 110 ] 58 0.076% 99.919% ( 110, 170 ] 34 0.045% 99.963% ( 170, 250 ] 5 0.007% 99.970% ( 250, 380 ] 10 0.013% 99.983% ( 380, 580 ] 5 0.007% 99.990% ( 580, 870 ] 3 0.004% 99.993% ( 870, 1300 ] 2 0.003% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4863 StdDev: 8.09 Min: 0 Median: 1.5510 Max: 658 Percentiles: P50: 1.55 P75: 1.96 P99: 7.08 P99.9: 14.90 P99.99: 433.42 ------------------------------------------------------ [ 0, 1 ] 5198 16.250% 16.250% ### ( 1, 2 ] 19592 61.250% 77.500% ############ ( 2, 3 ] 3507 10.964% 88.464% ## ( 3, 4 ] 1863 5.824% 94.288% # ( 4, 6 ] 1419 4.436% 98.724% # ( 6, 10 ] 326 1.019% 99.744% ( 10, 15 ] 51 0.159% 99.903% ( 15, 22 ] 4 0.013% 99.916% ( 22, 34 ] 2 0.006% 99.922% ( 34, 51 ] 1 0.003% 99.925% ( 51, 76 ] 1 0.003% 99.928% ( 110, 170 ] 4 0.013% 99.941% ( 170, 250 ] 8 0.025% 99.966% ( 250, 380 ] 7 0.022% 99.987% ( 380, 580 ] 3 0.009% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 236521 Average: 3.3375 StdDev: 41.26 Min: 1 Median: 1.5336 Max: 5057 Percentiles: P50: 1.53 P75: 1.94 P99: 9.02 P99.9: 206.10 P99.99: 883.60 ------------------------------------------------------ [ 0, 1 ] 40747 17.228% 17.228% ### ( 1, 2 ] 145267 61.418% 78.646% ############ ( 2, 3 ] 27220 11.508% 90.154% ## ( 3, 4 ] 10390 4.393% 94.547% # ( 4, 6 ] 7494 3.168% 97.716% # ( 6, 10 ] 4029 1.703% 99.419% ( 10, 15 ] 523 0.221% 99.640% ( 15, 22 ] 86 0.036% 99.677% ( 22, 34 ] 26 0.011% 99.688% ( 34, 51 ] 2 0.001% 99.688% ( 51, 76 ] 6 0.003% 99.691% ( 76, 110 ] 179 0.076% 99.767% ( 110, 170 ] 269 0.114% 99.880% ( 170, 250 ] 103 0.044% 99.924% ( 250, 380 ] 67 0.028% 99.952% ( 380, 580 ] 64 0.027% 99.979% ( 580, 870 ] 25 0.011% 99.990% ( 870, 1300 ] 11 0.005% 99.995% ( 1300, 1900 ] 8 0.003% 99.998% ( 1900, 2900 ] 10 0.004% 100.002% ( 2900, 4400 ] 11 0.005% 100.007% ( 4400, 6600 ] 5 0.002% 100.009% ** Level 4 read latency histogram (micros): Count: 310 Average: 122.8806 StdDev: 562.36 Min: 1 Median: 1.6614 Max: 5212 Percentiles: P50: 1.66 P75: 3.44 P99: 3612.50 P99.9: 5212.00 P99.99: 5212.00 ------------------------------------------------------ [ 0, 1 ] 71 22.903% 22.903% ##### ( 1, 2 ] 127 40.968% 63.871% ######## ( 2, 3 ] 23 7.419% 71.290% # ( 3, 4 ] 26 8.387% 79.677% ## ( 4, 6 ] 23 7.419% 87.097% # ( 6, 10 ] 10 3.226% 90.323% # ( 10, 15 ] 1 0.323% 90.645% ( 51, 76 ] 1 0.323% 90.968% ( 76, 110 ] 1 0.323% 91.290% ( 110, 170 ] 2 0.645% 91.935% ( 170, 250 ] 2 0.645% 92.581% ( 250, 380 ] 5 1.613% 94.194% ( 380, 580 ] 3 0.968% 95.161% ( 580, 870 ] 3 0.968% 96.129% ( 870, 1300 ] 3 0.968% 97.097% ( 1300, 1900 ] 3 0.968% 98.065% ( 1900, 2900 ] 1 0.323% 98.387% ( 2900, 4400 ] 4 1.290% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 686.6500 StdDev: 844.27 Min: 77 Median: 293.3333 Max: 3599 Percentiles: P50: 293.33 P75: 870.00 P99: 3599.00 P99.9: 3599.00 P99.99: 3599.00 ------------------------------------------------------ ( 76, 110 ] 8 20.000% 20.000% #### ( 110, 170 ] 10 25.000% 45.000% ##### ( 170, 250 ] 1 2.500% 47.500% # ( 250, 380 ] 3 7.500% 55.000% ## ( 380, 580 ] 1 2.500% 57.500% # ( 580, 870 ] 7 17.500% 75.000% #### ( 870, 1300 ] 4 10.000% 85.000% ## ( 1300, 1900 ] 1 2.500% 87.500% # ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.9 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 333.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.742 H:M:S, 8.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.170 H:M:S, 6.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/03-15:18:50 ... thread 0: (1000000,4000000) ops and (281642.9,327001.4) ops/second in (3.550596,12.232364) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 3.20 GB 132.2 2.7 0.0 2.7 6.5 3.7 0.0 1.7 131.0 312.4 21.16 19.80 65 0.326 2814K 2871 0.0 0.0 L1 1/1 4.19 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 242.8 242.4 2.59 2.52 2 1.297 639K 811 0.0 0.0 L2 1/0 49.60 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 231.0 230.9 0.55 0.53 1 0.546 127K 39 0.0 0.0 L3 17/0 814.51 MB 0.8 1.0 0.1 0.9 1.0 0.1 0.5 8.4 240.2 239.9 4.40 4.05 2 2.199 1073K 1256 0.0 0.0 L4 173/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 116.6 116.6 0.96 0.64 1 0.960 113K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/11 99.88 GB 0.0 4.6 0.7 3.9 8.3 4.5 2.4 2.2 158.3 287.7 29.66 27.52 71 0.418 4768K 4977 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 0.7 3.9 8.3 4.5 2.4 2.2 158.3 287.7 29.66 27.52 71 0.418 4768K 4977 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 0.7 3.9 4.6 0.7 0.0 0.0 248.3 248.1 18.91 17.92 16 1.182 4768K 4977 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 357.4 10.75 9.60 55 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.33 GB write, 687.28 MB/s write, 4.59 GB read, 378.22 MB/s read, 29.7 seconds Interval compaction: 8.33 GB write, 697.53 MB/s write, 4.59 GB read, 383.86 MB/s read, 29.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 12, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1109883 Average: 2.1086 StdDev: 8.83 Min: 1 Median: 1.4366 Max: 2889 Percentiles: P50: 1.44 P75: 1.83 P99: 5.55 P99.9: 9.87 P99.99: 14.81 ------------------------------------------------------ [ 0, 1 ] 243465 21.936% 21.936% #### ( 1, 2 ] 713388 64.276% 86.212% ############# ( 2, 3 ] 85561 7.709% 93.921% ## ( 3, 4 ] 38780 3.494% 97.415% # ( 4, 6 ] 22684 2.044% 99.459% ( 6, 10 ] 5055 0.455% 99.914% ( 10, 15 ] 874 0.079% 99.993% ( 15, 22 ] 91 0.008% 100.001% ( 22, 34 ] 17 0.002% 100.003% ( 34, 51 ] 9 0.001% 100.004% ( 51, 76 ] 9 0.001% 100.005% ( 76, 110 ] 40 0.004% 100.008% ( 110, 170 ] 39 0.004% 100.012% ( 170, 250 ] 35 0.003% 100.015% ( 250, 380 ] 33 0.003% 100.018% ( 380, 580 ] 19 0.002% 100.019% ( 580, 870 ] 23 0.002% 100.022% ( 870, 1300 ] 12 0.001% 100.023% ( 1300, 1900 ] 7 0.001% 100.023% ( 1900, 2900 ] 6 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 76349 Average: 2.3935 StdDev: 24.57 Min: 0 Median: 1.4007 Max: 4305 Percentiles: P50: 1.40 P75: 1.80 P99: 6.35 P99.9: 101.59 P99.99: 615.29 ------------------------------------------------------ [ 0, 1 ] 19102 25.019% 25.019% ##### ( 1, 2 ] 47593 62.336% 87.355% ############ ( 2, 3 ] 5035 6.595% 93.950% # ( 3, 4 ] 2291 3.001% 96.951% # ( 4, 6 ] 1511 1.979% 98.930% ( 6, 10 ] 610 0.799% 99.729% ( 10, 15 ] 78 0.102% 99.831% ( 15, 22 ] 6 0.008% 99.839% ( 22, 34 ] 1 0.001% 99.840% ( 34, 51 ] 1 0.001% 99.842% ( 51, 76 ] 1 0.001% 99.843% ( 76, 110 ] 58 0.076% 99.919% ( 110, 170 ] 34 0.045% 99.963% ( 170, 250 ] 5 0.007% 99.970% ( 250, 380 ] 10 0.013% 99.983% ( 380, 580 ] 5 0.007% 99.990% ( 580, 870 ] 3 0.004% 99.993% ( 870, 1300 ] 2 0.003% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4863 StdDev: 8.09 Min: 0 Median: 1.5510 Max: 658 Percentiles: P50: 1.55 P75: 1.96 P99: 7.08 P99.9: 14.90 P99.99: 433.42 ------------------------------------------------------ [ 0, 1 ] 5198 16.250% 16.250% ### ( 1, 2 ] 19592 61.250% 77.500% ############ ( 2, 3 ] 3507 10.964% 88.464% ## ( 3, 4 ] 1863 5.824% 94.288% # ( 4, 6 ] 1419 4.436% 98.724% # ( 6, 10 ] 326 1.019% 99.744% ( 10, 15 ] 51 0.159% 99.903% ( 15, 22 ] 4 0.013% 99.916% ( 22, 34 ] 2 0.006% 99.922% ( 34, 51 ] 1 0.003% 99.925% ( 51, 76 ] 1 0.003% 99.928% ( 110, 170 ] 4 0.013% 99.941% ( 170, 250 ] 8 0.025% 99.966% ( 250, 380 ] 7 0.022% 99.987% ( 380, 580 ] 3 0.009% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 236521 Average: 3.3375 StdDev: 41.26 Min: 1 Median: 1.5336 Max: 5057 Percentiles: P50: 1.53 P75: 1.94 P99: 9.02 P99.9: 206.10 P99.99: 883.60 ------------------------------------------------------ [ 0, 1 ] 40747 17.228% 17.228% ### ( 1, 2 ] 145267 61.418% 78.646% ############ ( 2, 3 ] 27220 11.508% 90.154% ## ( 3, 4 ] 10390 4.393% 94.547% # ( 4, 6 ] 7494 3.168% 97.716% # ( 6, 10 ] 4029 1.703% 99.419% ( 10, 15 ] 523 0.221% 99.640% ( 15, 22 ] 86 0.036% 99.677% ( 22, 34 ] 26 0.011% 99.688% ( 34, 51 ] 2 0.001% 99.688% ( 51, 76 ] 6 0.003% 99.691% ( 76, 110 ] 179 0.076% 99.767% ( 110, 170 ] 269 0.114% 99.880% ( 170, 250 ] 103 0.044% 99.924% ( 250, 380 ] 67 0.028% 99.952% ( 380, 580 ] 64 0.027% 99.979% ( 580, 870 ] 25 0.011% 99.990% ( 870, 1300 ] 11 0.005% 99.995% ( 1300, 1900 ] 8 0.003% 99.998% ( 1900, 2900 ] 10 0.004% 100.002% ( 2900, 4400 ] 11 0.005% 100.007% ( 4400, 6600 ] 5 0.002% 100.009% ** Level 4 read latency histogram (micros): Count: 310 Average: 122.8806 StdDev: 562.36 Min: 1 Median: 1.6614 Max: 5212 Percentiles: P50: 1.66 P75: 3.44 P99: 3612.50 P99.9: 5212.00 P99.99: 5212.00 ------------------------------------------------------ [ 0, 1 ] 71 22.903% 22.903% ##### ( 1, 2 ] 127 40.968% 63.871% ######## ( 2, 3 ] 23 7.419% 71.290% # ( 3, 4 ] 26 8.387% 79.677% ## ( 4, 6 ] 23 7.419% 87.097% # ( 6, 10 ] 10 3.226% 90.323% # ( 10, 15 ] 1 0.323% 90.645% ( 51, 76 ] 1 0.323% 90.968% ( 76, 110 ] 1 0.323% 91.290% ( 110, 170 ] 2 0.645% 91.935% ( 170, 250 ] 2 0.645% 92.581% ( 250, 380 ] 5 1.613% 94.194% ( 380, 580 ] 3 0.968% 95.161% ( 580, 870 ] 3 0.968% 96.129% ( 870, 1300 ] 3 0.968% 97.097% ( 1300, 1900 ] 3 0.968% 98.065% ( 1900, 2900 ] 1 0.323% 98.387% ( 2900, 4400 ] 4 1.290% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 686.6500 StdDev: 844.27 Min: 77 Median: 293.3333 Max: 3599 Percentiles: P50: 293.33 P75: 870.00 P99: 3599.00 P99.9: 3599.00 P99.99: 3599.00 ------------------------------------------------------ ( 76, 110 ] 8 20.000% 20.000% #### ( 110, 170 ] 10 25.000% 45.000% ##### ( 170, 250 ] 1 2.500% 47.500% # ( 250, 380 ] 3 7.500% 55.000% ## ( 380, 580 ] 1 2.500% 57.500% # ( 580, 870 ] 7 17.500% 75.000% #### ( 870, 1300 ] 4 10.000% 85.000% ## ( 1300, 1900 ] 1 2.500% 87.500% # ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 317.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.588 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 277.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.846 H:M:S, 23.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/03-15:18:55 ... thread 0: (1000000,5000000) ops and (206357.2,292768.7) ops/second in (4.845966,17.078330) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.21 GB 94.4 3.4 0.0 3.4 8.1 4.7 0.0 1.7 132.5 312.2 26.62 24.90 83 0.321 3582K 3574 0.0 0.0 L1 4/0 392.59 MB 39.3 2.5 2.3 0.2 2.5 2.3 0.1 1.1 234.9 233.3 11.00 10.65 3 3.668 2624K 17K 0.0 0.0 L2 12/10 1.51 GB 2.6 0.1 0.1 0.1 0.1 0.1 2.1 2.0 231.0 230.9 0.55 0.53 1 0.546 127K 39 0.0 0.0 L3 16/3 864.05 MB 0.5 1.1 0.2 0.9 1.1 0.2 0.5 6.4 228.2 228.0 4.90 4.37 3 1.634 1136K 1314 0.0 0.0 L4 173/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 116.6 116.6 0.96 0.64 1 0.960 113K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/22 100.79 GB 0.0 7.3 2.7 4.6 11.9 7.3 3.9 2.6 169.6 277.9 44.03 41.08 91 0.484 7585K 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.3 2.7 4.6 11.9 7.3 3.9 2.6 169.6 277.9 44.03 41.08 91 0.484 7585K 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.3 2.7 4.6 7.3 2.7 0.0 0.0 244.2 243.5 30.59 29.10 21 1.457 7585K 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.1 13.44 11.99 70 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.3 total, 17.1 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.95 GB write, 708.72 MB/s write, 7.29 GB read, 432.72 MB/s read, 44.0 seconds Interval compaction: 11.95 GB write, 716.29 MB/s write, 7.29 GB read, 437.34 MB/s read, 44.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 12, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1629052 Average: 2.1302 StdDev: 8.53 Min: 1 Median: 1.4353 Max: 2889 Percentiles: P50: 1.44 P75: 1.82 P99: 5.68 P99.9: 9.99 P99.99: 23.95 ------------------------------------------------------ [ 0, 1 ] 359201 22.050% 22.050% #### ( 1, 2 ] 1045986 64.208% 86.258% ############# ( 2, 3 ] 122299 7.507% 93.765% ## ( 3, 4 ] 56604 3.475% 97.240% # ( 4, 6 ] 34192 2.099% 99.339% ( 6, 10 ] 9154 0.562% 99.901% ( 10, 15 ] 1299 0.080% 99.981% ( 15, 22 ] 152 0.009% 99.990% ( 22, 34 ] 19 0.001% 99.991% ( 34, 51 ] 11 0.001% 99.992% ( 51, 76 ] 12 0.001% 99.992% ( 76, 110 ] 108 0.007% 99.999% ( 110, 170 ] 164 0.010% 100.009% ( 170, 250 ] 74 0.005% 100.014% ( 250, 380 ] 53 0.003% 100.017% ( 380, 580 ] 49 0.003% 100.020% ( 580, 870 ] 36 0.002% 100.022% ( 870, 1300 ] 18 0.001% 100.023% ( 1300, 1900 ] 9 0.001% 100.024% ( 1900, 2900 ] 6 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 188457 Average: 3.3690 StdDev: 26.60 Min: 0 Median: 1.6212 Max: 4305 Percentiles: P50: 1.62 P75: 2.18 P99: 8.58 P99.9: 174.93 P99.99: 402.33 ------------------------------------------------------ [ 0, 1 ] 24734 13.124% 13.124% ### ( 1, 2 ] 111880 59.366% 72.491% ############ ( 2, 3 ] 26379 13.997% 86.488% ### ( 3, 4 ] 11228 5.958% 92.446% # ( 4, 6 ] 10710 5.683% 98.129% # ( 6, 10 ] 2545 1.350% 99.479% ( 10, 15 ] 461 0.245% 99.724% ( 15, 22 ] 51 0.027% 99.751% ( 22, 34 ] 4 0.002% 99.753% ( 34, 51 ] 1 0.001% 99.754% ( 51, 76 ] 2 0.001% 99.755% ( 76, 110 ] 118 0.063% 99.817% ( 110, 170 ] 150 0.080% 99.897% ( 170, 250 ] 90 0.048% 99.945% ( 250, 380 ] 76 0.040% 99.985% ( 380, 580 ] 82 0.044% 100.029% ( 580, 870 ] 40 0.021% 100.050% ( 870, 1300 ] 13 0.007% 100.057% ( 1300, 1900 ] 10 0.005% 100.062% ( 1900, 2900 ] 2 0.001% 100.063% ( 2900, 4400 ] 2 0.001% 100.064% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4863 StdDev: 8.09 Min: 0 Median: 1.5510 Max: 658 Percentiles: P50: 1.55 P75: 1.96 P99: 7.08 P99.9: 14.90 P99.99: 433.42 ------------------------------------------------------ [ 0, 1 ] 5198 16.250% 16.250% ### ( 1, 2 ] 19592 61.250% 77.500% ############ ( 2, 3 ] 3507 10.964% 88.464% ## ( 3, 4 ] 1863 5.824% 94.288% # ( 4, 6 ] 1419 4.436% 98.724% # ( 6, 10 ] 326 1.019% 99.744% ( 10, 15 ] 51 0.159% 99.903% ( 15, 22 ] 4 0.013% 99.916% ( 22, 34 ] 2 0.006% 99.922% ( 34, 51 ] 1 0.003% 99.925% ( 51, 76 ] 1 0.003% 99.928% ( 110, 170 ] 4 0.013% 99.941% ( 170, 250 ] 8 0.025% 99.966% ( 250, 380 ] 7 0.022% 99.987% ( 380, 580 ] 3 0.009% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 239795 Average: 3.8350 StdDev: 43.48 Min: 1 Median: 1.5383 Max: 5057 Percentiles: P50: 1.54 P75: 1.95 P99: 9.46 P99.9: 350.69 P99.99: 1054.92 ------------------------------------------------------ [ 0, 1 ] 40891 17.052% 17.052% ### ( 1, 2 ] 146781 61.211% 78.264% ############ ( 2, 3 ] 27876 11.625% 89.888% ## ( 3, 4 ] 10607 4.423% 94.312% # ( 4, 6 ] 7703 3.212% 97.524% # ( 6, 10 ] 4086 1.704% 99.228% ( 10, 15 ] 546 0.228% 99.456% ( 15, 22 ] 89 0.037% 99.493% ( 22, 34 ] 29 0.012% 99.505% ( 34, 51 ] 2 0.001% 99.506% ( 51, 76 ] 6 0.003% 99.508% ( 76, 110 ] 216 0.090% 99.598% ( 110, 170 ] 396 0.165% 99.764% ( 170, 250 ] 218 0.091% 99.854% ( 250, 380 ] 141 0.059% 99.913% ( 380, 580 ] 128 0.053% 99.967% ( 580, 870 ] 50 0.021% 99.987% ( 870, 1300 ] 14 0.006% 99.993% ( 1300, 1900 ] 10 0.004% 99.997% ( 1900, 2900 ] 11 0.005% 100.002% ( 2900, 4400 ] 11 0.005% 100.007% ( 4400, 6600 ] 5 0.002% 100.009% ** Level 4 read latency histogram (micros): Count: 310 Average: 122.8806 StdDev: 562.36 Min: 1 Median: 1.6614 Max: 5212 Percentiles: P50: 1.66 P75: 3.44 P99: 3612.50 P99.9: 5212.00 P99.99: 5212.00 ------------------------------------------------------ [ 0, 1 ] 71 22.903% 22.903% ##### ( 1, 2 ] 127 40.968% 63.871% ######## ( 2, 3 ] 23 7.419% 71.290% # ( 3, 4 ] 26 8.387% 79.677% ## ( 4, 6 ] 23 7.419% 87.097% # ( 6, 10 ] 10 3.226% 90.323% # ( 10, 15 ] 1 0.323% 90.645% ( 51, 76 ] 1 0.323% 90.968% ( 76, 110 ] 1 0.323% 91.290% ( 110, 170 ] 2 0.645% 91.935% ( 170, 250 ] 2 0.645% 92.581% ( 250, 380 ] 5 1.613% 94.194% ( 380, 580 ] 3 0.968% 95.161% ( 580, 870 ] 3 0.968% 96.129% ( 870, 1300 ] 3 0.968% 97.097% ( 1300, 1900 ] 3 0.968% 98.065% ( 1900, 2900 ] 1 0.323% 98.387% ( 2900, 4400 ] 4 1.290% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 686.6500 StdDev: 844.27 Min: 77 Median: 293.3333 Max: 3599 Percentiles: P50: 293.33 P75: 870.00 P99: 3599.00 P99.9: 3599.00 P99.99: 3599.00 ------------------------------------------------------ ( 76, 110 ] 8 20.000% 20.000% #### ( 110, 170 ] 10 25.000% 45.000% ##### ( 170, 250 ] 1 2.500% 47.500% # ( 250, 380 ] 3 7.500% 55.000% ## ( 380, 580 ] 1 2.500% 57.500% # ( 580, 870 ] 7 17.500% 75.000% #### ( 870, 1300 ] 4 10.000% 85.000% ## ( 1300, 1900 ] 1 2.500% 87.500% # ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 17.3 total, 4.8 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 285.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.656 H:M:S, 21.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 203.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.068 H:M:S, 42.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/03-15:18:59 ... thread 0: (1000000,6000000) ops and (246629.4,283916.2) ops/second in (4.054666,21.132996) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 3.13 GB 12.6 5.4 0.0 5.4 10.9 5.6 0.0 2.0 143.6 293.6 38.15 35.00 99 0.385 5564K 9142 0.0 0.0 L1 4/4 392.59 MB 0.0 2.5 2.3 0.2 2.5 2.3 0.1 1.1 234.9 233.3 11.00 10.65 3 3.668 2624K 17K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.1 2.0 231.0 230.9 0.55 0.53 1 0.546 127K 39 0.0 0.0 L3 27/7 1.43 GB 1.0 3.2 1.7 1.6 3.2 1.7 0.5 1.9 208.0 207.5 15.93 14.12 8 1.992 3366K 8296 0.0 0.0 L4 175/13 9.46 GB 1.0 0.6 0.6 0.0 0.6 0.6 0.9 1.0 112.6 112.5 5.85 3.21 8 0.731 665K 535 0.0 0.0 L5 1060/0 87.29 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1278/34 101.70 GB 0.0 11.9 4.7 7.2 17.4 10.3 5.3 3.1 170.2 249.8 71.49 63.50 119 0.601 12M 35K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.9 4.7 7.2 17.4 10.3 5.3 3.1 170.2 249.8 71.49 63.50 119 0.601 12M 35K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.9 4.7 7.2 11.8 4.7 0.0 0.0 223.2 222.5 54.50 48.99 37 1.473 12M 35K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 337.4 16.99 14.51 82 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.3 total, 21.1 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.44 GB write, 837.84 MB/s write, 11.88 GB read, 570.63 MB/s read, 71.5 seconds Interval compaction: 17.44 GB write, 845.07 MB/s write, 11.88 GB read, 575.56 MB/s read, 71.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 22, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2052288 Average: 2.3503 StdDev: 14.97 Min: 1 Median: 1.4901 Max: 5990 Percentiles: P50: 1.49 P75: 1.89 P99: 5.96 P99.9: 12.51 P99.99: 131.79 ------------------------------------------------------ [ 0, 1 ] 395025 19.248% 19.248% #### ( 1, 2 ] 1287746 62.747% 81.995% ############# ( 2, 3 ] 185512 9.039% 91.034% ## ( 3, 4 ] 94916 4.625% 95.659% # ( 4, 6 ] 70062 3.414% 99.073% # ( 6, 10 ] 15738 0.767% 99.840% ( 10, 15 ] 2471 0.120% 99.960% ( 15, 22 ] 296 0.014% 99.975% ( 22, 34 ] 29 0.001% 99.976% ( 34, 51 ] 15 0.001% 99.977% ( 51, 76 ] 17 0.001% 99.978% ( 76, 110 ] 143 0.007% 99.985% ( 110, 170 ] 316 0.015% 100.000% ( 170, 250 ] 179 0.009% 100.009% ( 250, 380 ] 129 0.006% 100.015% ( 380, 580 ] 129 0.006% 100.021% ( 580, 870 ] 82 0.004% 100.025% ( 870, 1300 ] 37 0.002% 100.027% ( 1300, 1900 ] 15 0.001% 100.028% ( 1900, 2900 ] 11 0.001% 100.028% ( 2900, 4400 ] 10 0.000% 100.029% ( 4400, 6600 ] 3 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 579309 Average: 4.0556 StdDev: 63.55 Min: 0 Median: 1.7544 Max: 12078 Percentiles: P50: 1.75 P75: 2.64 P99: 9.00 P99.9: 95.45 P99.99: 296.66 ------------------------------------------------------ [ 0, 1 ] 40361 6.967% 6.967% # ( 1, 2 ] 330469 57.045% 64.012% ########### ( 2, 3 ] 99690 17.208% 81.221% ### ( 3, 4 ] 46679 8.058% 89.279% ## ( 4, 6 ] 47845 8.259% 97.538% ## ( 6, 10 ] 11305 1.951% 99.489% ( 10, 15 ] 2033 0.351% 99.840% ( 15, 22 ] 231 0.040% 99.880% ( 22, 34 ] 19 0.003% 99.883% ( 34, 51 ] 2 0.000% 99.883% ( 51, 76 ] 3 0.001% 99.884% ( 76, 110 ] 162 0.028% 99.912% ( 110, 170 ] 239 0.041% 99.953% ( 170, 250 ] 156 0.027% 99.980% ( 250, 380 ] 159 0.027% 100.008% ( 380, 580 ] 178 0.031% 100.038% ( 580, 870 ] 110 0.019% 100.057% ( 870, 1300 ] 46 0.008% 100.065% ( 1300, 1900 ] 38 0.007% 100.072% ( 1900, 2900 ] 29 0.005% 100.077% ( 2900, 4400 ] 41 0.007% 100.084% ( 4400, 6600 ] 10 0.002% 100.086% ( 6600, 9900 ] 13 0.002% 100.088% ( 9900, 14000 ] 3 0.001% 100.088% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4863 StdDev: 8.09 Min: 0 Median: 1.5510 Max: 658 Percentiles: P50: 1.55 P75: 1.96 P99: 7.08 P99.9: 14.90 P99.99: 433.42 ------------------------------------------------------ [ 0, 1 ] 5198 16.250% 16.250% ### ( 1, 2 ] 19592 61.250% 77.500% ############ ( 2, 3 ] 3507 10.964% 88.464% ## ( 3, 4 ] 1863 5.824% 94.288% # ( 4, 6 ] 1419 4.436% 98.724% # ( 6, 10 ] 326 1.019% 99.744% ( 10, 15 ] 51 0.159% 99.903% ( 15, 22 ] 4 0.013% 99.916% ( 22, 34 ] 2 0.006% 99.922% ( 34, 51 ] 1 0.003% 99.925% ( 51, 76 ] 1 0.003% 99.928% ( 110, 170 ] 4 0.013% 99.941% ( 170, 250 ] 8 0.025% 99.966% ( 250, 380 ] 7 0.022% 99.987% ( 380, 580 ] 3 0.009% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 490149 Average: 3.8120 StdDev: 46.38 Min: 1 Median: 1.7095 Max: 7031 Percentiles: P50: 1.71 P75: 2.52 P99: 8.94 P99.9: 143.36 P99.99: 245.29 ------------------------------------------------------ [ 0, 1 ] 48290 9.852% 9.852% ## ( 1, 2 ] 277356 56.586% 66.438% ########### ( 2, 3 ] 81235 16.574% 83.012% ### ( 3, 4 ] 36614 7.470% 90.482% # ( 4, 6 ] 35492 7.241% 97.723% # ( 6, 10 ] 8530 1.740% 99.463% ( 10, 15 ] 1428 0.291% 99.754% ( 15, 22 ] 206 0.042% 99.796% ( 22, 34 ] 33 0.007% 99.803% ( 34, 51 ] 9 0.002% 99.805% ( 51, 76 ] 8 0.002% 99.807% ( 76, 110 ] 227 0.046% 99.853% ( 110, 170 ] 417 0.085% 99.938% ( 170, 250 ] 272 0.055% 99.993% ( 250, 380 ] 177 0.036% 100.030% ( 380, 580 ] 166 0.034% 100.063% ( 580, 870 ] 78 0.016% 100.079% ( 870, 1300 ] 26 0.005% 100.085% ( 1300, 1900 ] 19 0.004% 100.089% ( 1900, 2900 ] 17 0.003% 100.092% ( 2900, 4400 ] 38 0.008% 100.100% ( 4400, 6600 ] 7 0.001% 100.101% ( 6600, 9900 ] 1 0.000% 100.101% ** Level 4 read latency histogram (micros): Count: 10108 Average: 151.0588 StdDev: 511.63 Min: 0 Median: 2.0765 Max: 7680 Percentiles: P50: 2.08 P75: 3.94 P99: 2884.12 P99.9: 5347.65 P99.99: 6598.51 ------------------------------------------------------ [ 0, 1 ] 472 4.670% 4.670% # ( 1, 2 ] 4452 44.044% 48.714% ######### ( 2, 3 ] 1700 16.818% 65.532% ### ( 3, 4 ] 1014 10.032% 75.564% ## ( 4, 6 ] 708 7.004% 82.568% # ( 6, 10 ] 192 1.899% 84.468% ( 10, 15 ] 54 0.534% 85.002% ( 15, 22 ] 8 0.079% 85.081% ( 22, 34 ] 3 0.030% 85.111% ( 51, 76 ] 1 0.010% 85.121% ( 76, 110 ] 11 0.109% 85.230% ( 110, 170 ] 84 0.831% 86.061% ( 170, 250 ] 89 0.880% 86.941% ( 250, 380 ] 177 1.751% 88.692% ( 380, 580 ] 241 2.384% 91.076% ( 580, 870 ] 309 3.057% 94.133% # ( 870, 1300 ] 272 2.691% 96.824% # ( 1300, 1900 ] 153 1.514% 98.338% ( 1900, 2900 ] 68 0.673% 99.011% ( 2900, 4400 ] 83 0.821% 99.832% ( 4400, 6600 ] 16 0.158% 99.990% ( 6600, 9900 ] 2 0.020% 100.010% ** Level 5 read latency histogram (micros): Count: 100 Average: 886.9500 StdDev: 1045.65 Min: 77 Median: 446.6667 Max: 4363 Percentiles: P50: 446.67 P75: 1085.00 P99: 4212.50 P99.9: 4363.00 P99.99: 4363.00 ------------------------------------------------------ ( 76, 110 ] 11 11.000% 11.000% ## ( 110, 170 ] 19 19.000% 30.000% #### ( 170, 250 ] 7 7.000% 37.000% # ( 250, 380 ] 10 10.000% 47.000% ## ( 380, 580 ] 9 9.000% 56.000% ## ( 580, 870 ] 14 14.000% 70.000% ### ( 870, 1300 ] 10 10.000% 80.000% ## ( 1300, 1900 ] 2 2.000% 82.000% ( 1900, 2900 ] 10 10.000% 92.000% ## ( 2900, 4400 ] 8 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 21.3 total, 4.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 277.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.835 H:M:S, 22.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 242.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.178 H:M:S, 29.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/12/03-15:19:03 ... thread 0: (1000000,7000000) ops and (279209.6,283234.1) ops/second in (3.581539,24.714535) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 4.24 GB 100.7 6.2 0.0 6.2 12.9 6.7 0.0 1.9 141.8 294.7 44.86 41.15 117 0.383 6459K 10K 0.0 0.0 L1 4/4 392.59 MB 0.0 2.5 2.3 0.2 2.5 2.3 0.1 1.1 234.9 233.3 11.00 10.65 3 3.668 2624K 17K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.1 2.0 231.0 230.9 0.55 0.53 1 0.546 127K 39 0.0 0.0 L3 20/0 983.52 MB 1.0 3.2 1.7 1.6 3.2 1.7 0.5 1.9 208.0 207.5 15.93 14.12 8 1.992 3366K 8296 0.0 0.0 L4 178/0 9.62 GB 1.0 1.1 1.1 0.1 1.1 1.1 0.9 1.0 122.8 122.6 9.52 5.65 15 0.634 1168K 850 0.0 0.0 L5 1064/0 87.60 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/18 102.80 GB 0.0 13.2 5.2 8.1 19.9 11.8 5.6 3.0 165.6 249.0 81.86 72.09 144 0.568 13M 37K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.2 5.2 8.1 19.9 11.8 5.6 3.0 165.6 249.0 81.86 72.09 144 0.568 13M 37K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.2 5.2 8.1 13.2 5.1 0.0 0.0 220.5 219.9 61.48 54.69 47 1.308 13M 37K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 336.9 20.38 17.40 97 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.9 total, 24.7 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.91 GB write, 818.67 MB/s write, 13.24 GB read, 544.42 MB/s read, 81.9 seconds Interval compaction: 19.91 GB write, 824.71 MB/s write, 13.24 GB read, 548.44 MB/s read, 81.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 29, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2509300 Average: 2.3460 StdDev: 17.75 Min: 1 Median: 1.4950 Max: 14894 Percentiles: P50: 1.49 P75: 1.89 P99: 5.96 P99.9: 12.19 P99.99: 106.76 ------------------------------------------------------ [ 0, 1 ] 467918 18.647% 18.647% #### ( 1, 2 ] 1589379 63.340% 81.987% ############# ( 2, 3 ] 232253 9.256% 91.243% ## ( 3, 4 ] 113850 4.537% 95.780% # ( 4, 6 ] 82502 3.288% 99.068% # ( 6, 10 ] 19581 0.780% 99.848% ( 10, 15 ] 2993 0.119% 99.967% ( 15, 22 ] 350 0.014% 99.981% ( 22, 34 ] 36 0.001% 99.983% ( 34, 51 ] 16 0.001% 99.983% ( 51, 76 ] 23 0.001% 99.984% ( 76, 110 ] 167 0.007% 99.991% ( 110, 170 ] 345 0.014% 100.005% ( 170, 250 ] 199 0.008% 100.012% ( 250, 380 ] 145 0.006% 100.018% ( 380, 580 ] 136 0.005% 100.024% ( 580, 870 ] 91 0.004% 100.027% ( 870, 1300 ] 46 0.002% 100.029% ( 1300, 1900 ] 18 0.001% 100.030% ( 1900, 2900 ] 12 0.000% 100.030% ( 2900, 4400 ] 10 0.000% 100.031% ( 4400, 6600 ] 4 0.000% 100.031% ( 6600, 9900 ] 1 0.000% 100.031% ( 14000, 22000 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 579309 Average: 4.0556 StdDev: 63.55 Min: 0 Median: 1.7544 Max: 12078 Percentiles: P50: 1.75 P75: 2.64 P99: 9.00 P99.9: 95.45 P99.99: 296.66 ------------------------------------------------------ [ 0, 1 ] 40361 6.967% 6.967% # ( 1, 2 ] 330469 57.045% 64.012% ########### ( 2, 3 ] 99690 17.208% 81.221% ### ( 3, 4 ] 46679 8.058% 89.279% ## ( 4, 6 ] 47845 8.259% 97.538% ## ( 6, 10 ] 11305 1.951% 99.489% ( 10, 15 ] 2033 0.351% 99.840% ( 15, 22 ] 231 0.040% 99.880% ( 22, 34 ] 19 0.003% 99.883% ( 34, 51 ] 2 0.000% 99.883% ( 51, 76 ] 3 0.001% 99.884% ( 76, 110 ] 162 0.028% 99.912% ( 110, 170 ] 239 0.041% 99.953% ( 170, 250 ] 156 0.027% 99.980% ( 250, 380 ] 159 0.027% 100.008% ( 380, 580 ] 178 0.031% 100.038% ( 580, 870 ] 110 0.019% 100.057% ( 870, 1300 ] 46 0.008% 100.065% ( 1300, 1900 ] 38 0.007% 100.072% ( 1900, 2900 ] 29 0.005% 100.077% ( 2900, 4400 ] 41 0.007% 100.084% ( 4400, 6600 ] 10 0.002% 100.086% ( 6600, 9900 ] 13 0.002% 100.088% ( 9900, 14000 ] 3 0.001% 100.088% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4863 StdDev: 8.09 Min: 0 Median: 1.5510 Max: 658 Percentiles: P50: 1.55 P75: 1.96 P99: 7.08 P99.9: 14.90 P99.99: 433.42 ------------------------------------------------------ [ 0, 1 ] 5198 16.250% 16.250% ### ( 1, 2 ] 19592 61.250% 77.500% ############ ( 2, 3 ] 3507 10.964% 88.464% ## ( 3, 4 ] 1863 5.824% 94.288% # ( 4, 6 ] 1419 4.436% 98.724% # ( 6, 10 ] 326 1.019% 99.744% ( 10, 15 ] 51 0.159% 99.903% ( 15, 22 ] 4 0.013% 99.916% ( 22, 34 ] 2 0.006% 99.922% ( 34, 51 ] 1 0.003% 99.925% ( 51, 76 ] 1 0.003% 99.928% ( 110, 170 ] 4 0.013% 99.941% ( 170, 250 ] 8 0.025% 99.966% ( 250, 380 ] 7 0.022% 99.987% ( 380, 580 ] 3 0.009% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 560118 Average: 3.7198 StdDev: 44.14 Min: 1 Median: 1.7266 Max: 7031 Percentiles: P50: 1.73 P75: 2.57 P99: 8.86 P99.9: 107.74 P99.99: 190.88 ------------------------------------------------------ [ 0, 1 ] 50460 9.009% 9.009% ## ( 1, 2 ] 315991 56.415% 65.424% ########### ( 2, 3 ] 94889 16.941% 82.365% ### ( 3, 4 ] 43582 7.781% 90.146% ## ( 4, 6 ] 42468 7.582% 97.728% ## ( 6, 10 ] 9962 1.779% 99.506% ( 10, 15 ] 1696 0.303% 99.809% ( 15, 22 ] 242 0.043% 99.852% ( 22, 34 ] 37 0.007% 99.859% ( 34, 51 ] 10 0.002% 99.861% ( 51, 76 ] 9 0.002% 99.862% ( 76, 110 ] 227 0.041% 99.903% ( 110, 170 ] 418 0.075% 99.977% ( 170, 250 ] 272 0.049% 100.026% ( 250, 380 ] 180 0.032% 100.058% ( 380, 580 ] 169 0.030% 100.088% ( 580, 870 ] 78 0.014% 100.102% ( 870, 1300 ] 28 0.005% 100.107% ( 1300, 1900 ] 21 0.004% 100.111% ( 1900, 2900 ] 17 0.003% 100.114% ( 2900, 4400 ] 40 0.007% 100.121% ( 4400, 6600 ] 7 0.001% 100.122% ( 6600, 9900 ] 1 0.000% 100.122% ** Level 4 read latency histogram (micros): Count: 13930 Average: 130.3703 StdDev: 520.64 Min: 0 Median: 1.9645 Max: 21617 Percentiles: P50: 1.96 P75: 3.74 P99: 2661.73 P99.9: 5386.33 P99.99: 9467.70 ------------------------------------------------------ [ 0, 1 ] 746 5.355% 5.355% # ( 1, 2 ] 6448 46.289% 51.644% ######### ( 2, 3 ] 2254 16.181% 67.825% ### ( 3, 4 ] 1359 9.756% 77.581% ## ( 4, 6 ] 947 6.798% 84.379% # ( 6, 10 ] 277 1.989% 86.368% ( 10, 15 ] 77 0.553% 86.920% ( 15, 22 ] 10 0.072% 86.992% ( 22, 34 ] 7 0.050% 87.042% ( 34, 51 ] 1 0.007% 87.050% ( 51, 76 ] 1 0.007% 87.057% ( 76, 110 ] 17 0.122% 87.179% ( 110, 170 ] 118 0.847% 88.026% ( 170, 250 ] 122 0.876% 88.902% ( 250, 380 ] 212 1.522% 90.424% ( 380, 580 ] 306 2.197% 92.620% ( 580, 870 ] 357 2.563% 95.183% # ( 870, 1300 ] 302 2.168% 97.351% ( 1300, 1900 ] 168 1.206% 98.557% ( 1900, 2900 ] 81 0.581% 99.139% ( 2900, 4400 ] 98 0.704% 99.842% ( 4400, 6600 ] 18 0.129% 99.971% ( 6600, 9900 ] 3 0.022% 99.993% ( 9900, 14000 ] 1 0.007% 100.000% ( 14000, 22000 ] 1 0.007% 100.007% ** Level 5 read latency histogram (micros): Count: 120 Average: 887.8917 StdDev: 1063.50 Min: 77 Median: 422.8571 Max: 4363 Percentiles: P50: 422.86 P75: 1085.00 P99: 4220.00 P99.9: 4363.00 P99.99: 4363.00 ------------------------------------------------------ ( 76, 110 ] 14 11.667% 11.667% ## ( 110, 170 ] 23 19.167% 30.833% #### ( 170, 250 ] 8 6.667% 37.500% # ( 250, 380 ] 12 10.000% 47.500% ## ( 380, 580 ] 14 11.667% 59.167% ## ( 580, 870 ] 14 11.667% 70.833% ## ( 870, 1300 ] 10 8.333% 79.167% ## ( 1300, 1900 ] 3 2.500% 81.667% # ( 1900, 2900 ] 12 10.000% 91.667% ## ( 2900, 4400 ] 10 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 24.9 total, 3.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 276.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.756 H:M:S, 23.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.921 H:M:S, 25.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/12/03-15:19:10 ... thread 0: (1000000,8000000) ops and (141306.5,251640.8) ops/second in (7.076817,31.791352) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 5.16 GB 220.1 7.9 0.0 7.9 15.5 7.6 0.0 2.0 149.8 294.7 53.83 49.72 137 0.393 8186K 12K 0.0 0.0 L1 4/4 392.59 MB 0.0 2.5 2.3 0.2 2.5 2.3 0.1 1.1 234.9 233.3 11.00 10.65 3 3.668 2624K 17K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.1 2.0 231.0 230.9 0.55 0.53 1 0.546 127K 39 0.0 0.0 L3 20/0 983.52 MB 1.0 3.2 1.7 1.6 3.2 1.7 0.5 1.9 208.0 207.5 15.93 14.12 8 1.992 3366K 8296 0.0 0.0 L4 178/0 9.62 GB 1.0 1.1 1.1 0.1 1.1 1.1 0.9 1.0 122.8 122.6 9.52 5.65 15 0.634 1168K 850 0.0 0.0 L5 1064/0 87.60 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/14 103.73 GB 0.0 14.9 5.2 9.7 22.5 12.8 5.6 2.9 168.0 253.5 90.83 80.66 164 0.554 15M 39K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.9 5.2 9.7 22.5 12.8 5.6 2.9 168.0 253.5 90.83 80.66 164 0.554 15M 39K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.9 5.2 9.7 14.9 5.1 0.0 0.0 225.1 224.5 67.78 60.89 52 1.303 15M 39K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 338.9 23.05 19.77 112 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.0 total, 31.8 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.49 GB write, 720.14 MB/s write, 14.90 GB read, 477.11 MB/s read, 90.8 seconds Interval compaction: 22.49 GB write, 724.27 MB/s write, 14.90 GB read, 479.85 MB/s read, 90.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 29, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3318325 Average: 2.3083 StdDev: 16.24 Min: 1 Median: 1.4812 Max: 14894 Percentiles: P50: 1.48 P75: 1.87 P99: 5.96 P99.9: 12.34 P99.99: 122.64 ------------------------------------------------------ [ 0, 1 ] 636222 19.173% 19.173% #### ( 1, 2 ] 2125717 64.060% 83.233% ############# ( 2, 3 ] 291314 8.779% 92.012% ## ( 3, 4 ] 137635 4.148% 96.160% # ( 4, 6 ] 96375 2.904% 99.064% # ( 6, 10 ] 26074 0.786% 99.850% ( 10, 15 ] 3573 0.108% 99.957% ( 15, 22 ] 537 0.016% 99.974% ( 22, 34 ] 43 0.001% 99.975% ( 34, 51 ] 21 0.001% 99.975% ( 51, 76 ] 26 0.001% 99.976% ( 76, 110 ] 338 0.010% 99.986% ( 110, 170 ] 561 0.017% 100.003% ( 170, 250 ] 272 0.008% 100.012% ( 250, 380 ] 188 0.006% 100.017% ( 380, 580 ] 169 0.005% 100.022% ( 580, 870 ] 112 0.003% 100.026% ( 870, 1300 ] 50 0.002% 100.027% ( 1300, 1900 ] 21 0.001% 100.028% ( 1900, 2900 ] 14 0.000% 100.028% ( 2900, 4400 ] 13 0.000% 100.029% ( 4400, 6600 ] 4 0.000% 100.029% ( 6600, 9900 ] 1 0.000% 100.029% ( 14000, 22000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 585414 Average: 4.0476 StdDev: 63.23 Min: 0 Median: 1.7505 Max: 12078 Percentiles: P50: 1.75 P75: 2.63 P99: 9.01 P99.9: 103.64 P99.99: 297.50 ------------------------------------------------------ [ 0, 1 ] 41892 7.156% 7.156% # ( 1, 2 ] 334182 57.085% 64.241% ########### ( 2, 3 ] 100169 17.111% 81.351% ### ( 3, 4 ] 46821 7.998% 89.349% ## ( 4, 6 ] 47945 8.190% 97.539% ## ( 6, 10 ] 11381 1.944% 99.483% ( 10, 15 ] 2033 0.347% 99.831% ( 15, 22 ] 232 0.040% 99.870% ( 22, 34 ] 19 0.003% 99.874% ( 34, 51 ] 2 0.000% 99.874% ( 51, 76 ] 3 0.001% 99.874% ( 76, 110 ] 184 0.031% 99.906% ( 110, 170 ] 277 0.047% 99.953% ( 170, 250 ] 157 0.027% 99.980% ( 250, 380 ] 160 0.027% 100.007% ( 380, 580 ] 179 0.031% 100.038% ( 580, 870 ] 110 0.019% 100.057% ( 870, 1300 ] 46 0.008% 100.065% ( 1300, 1900 ] 38 0.006% 100.071% ( 1900, 2900 ] 29 0.005% 100.076% ( 2900, 4400 ] 41 0.007% 100.083% ( 4400, 6600 ] 10 0.002% 100.085% ( 6600, 9900 ] 13 0.002% 100.087% ( 9900, 14000 ] 3 0.001% 100.087% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4863 StdDev: 8.09 Min: 0 Median: 1.5510 Max: 658 Percentiles: P50: 1.55 P75: 1.96 P99: 7.08 P99.9: 14.90 P99.99: 433.42 ------------------------------------------------------ [ 0, 1 ] 5198 16.250% 16.250% ### ( 1, 2 ] 19592 61.250% 77.500% ############ ( 2, 3 ] 3507 10.964% 88.464% ## ( 3, 4 ] 1863 5.824% 94.288% # ( 4, 6 ] 1419 4.436% 98.724% # ( 6, 10 ] 326 1.019% 99.744% ( 10, 15 ] 51 0.159% 99.903% ( 15, 22 ] 4 0.013% 99.916% ( 22, 34 ] 2 0.006% 99.922% ( 34, 51 ] 1 0.003% 99.925% ( 51, 76 ] 1 0.003% 99.928% ( 110, 170 ] 4 0.013% 99.941% ( 170, 250 ] 8 0.025% 99.966% ( 250, 380 ] 7 0.022% 99.987% ( 380, 580 ] 3 0.009% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 560118 Average: 3.7198 StdDev: 44.14 Min: 1 Median: 1.7266 Max: 7031 Percentiles: P50: 1.73 P75: 2.57 P99: 8.86 P99.9: 107.74 P99.99: 190.88 ------------------------------------------------------ [ 0, 1 ] 50460 9.009% 9.009% ## ( 1, 2 ] 315991 56.415% 65.424% ########### ( 2, 3 ] 94889 16.941% 82.365% ### ( 3, 4 ] 43582 7.781% 90.146% ## ( 4, 6 ] 42468 7.582% 97.728% ## ( 6, 10 ] 9962 1.779% 99.506% ( 10, 15 ] 1696 0.303% 99.809% ( 15, 22 ] 242 0.043% 99.852% ( 22, 34 ] 37 0.007% 99.859% ( 34, 51 ] 10 0.002% 99.861% ( 51, 76 ] 9 0.002% 99.862% ( 76, 110 ] 227 0.041% 99.903% ( 110, 170 ] 418 0.075% 99.977% ( 170, 250 ] 272 0.049% 100.026% ( 250, 380 ] 180 0.032% 100.058% ( 380, 580 ] 169 0.030% 100.088% ( 580, 870 ] 78 0.014% 100.102% ( 870, 1300 ] 28 0.005% 100.107% ( 1300, 1900 ] 21 0.004% 100.111% ( 1900, 2900 ] 17 0.003% 100.114% ( 2900, 4400 ] 40 0.007% 100.121% ( 4400, 6600 ] 7 0.001% 100.122% ( 6600, 9900 ] 1 0.000% 100.122% ** Level 4 read latency histogram (micros): Count: 13930 Average: 130.3703 StdDev: 520.64 Min: 0 Median: 1.9645 Max: 21617 Percentiles: P50: 1.96 P75: 3.74 P99: 2661.73 P99.9: 5386.33 P99.99: 9467.70 ------------------------------------------------------ [ 0, 1 ] 746 5.355% 5.355% # ( 1, 2 ] 6448 46.289% 51.644% ######### ( 2, 3 ] 2254 16.181% 67.825% ### ( 3, 4 ] 1359 9.756% 77.581% ## ( 4, 6 ] 947 6.798% 84.379% # ( 6, 10 ] 277 1.989% 86.368% ( 10, 15 ] 77 0.553% 86.920% ( 15, 22 ] 10 0.072% 86.992% ( 22, 34 ] 7 0.050% 87.042% ( 34, 51 ] 1 0.007% 87.050% ( 51, 76 ] 1 0.007% 87.057% ( 76, 110 ] 17 0.122% 87.179% ( 110, 170 ] 118 0.847% 88.026% ( 170, 250 ] 122 0.876% 88.902% ( 250, 380 ] 212 1.522% 90.424% ( 380, 580 ] 306 2.197% 92.620% ( 580, 870 ] 357 2.563% 95.183% # ( 870, 1300 ] 302 2.168% 97.351% ( 1300, 1900 ] 168 1.206% 98.557% ( 1900, 2900 ] 81 0.581% 99.139% ( 2900, 4400 ] 98 0.704% 99.842% ( 4400, 6600 ] 18 0.129% 99.971% ( 6600, 9900 ] 3 0.022% 99.993% ( 9900, 14000 ] 1 0.007% 100.000% ( 14000, 22000 ] 1 0.007% 100.007% ** Level 5 read latency histogram (micros): Count: 120 Average: 887.8917 StdDev: 1063.50 Min: 77 Median: 422.8571 Max: 4363 Percentiles: P50: 422.86 P75: 1085.00 P99: 4220.00 P99.9: 4363.00 P99.99: 4363.00 ------------------------------------------------------ ( 76, 110 ] 14 11.667% 11.667% ## ( 110, 170 ] 23 19.167% 30.833% #### ( 170, 250 ] 8 6.667% 37.500% # ( 250, 380 ] 12 10.000% 47.500% ## ( 380, 580 ] 14 11.667% 59.167% ## ( 580, 870 ] 14 11.667% 70.833% ## ( 870, 1300 ] 10 8.333% 79.167% ## ( 1300, 1900 ] 3 2.500% 81.667% # ( 1900, 2900 ] 12 10.000% 91.667% ## ( 2900, 4400 ] 10 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 32.0 total, 7.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 246.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.136 H:M:S, 31.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 139.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.379 H:M:S, 61.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/03-15:19:17 ... thread 0: (1000000,9000000) ops and (142407.2,231878.3) ops/second in (7.022117,38.813469) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 3.07 GB 25.2 8.6 0.0 8.6 17.1 8.5 0.0 2.0 148.7 296.1 59.30 54.86 154 0.385 8953K 13K 0.0 0.0 L1 21/21 2.42 GB 0.0 5.9 5.3 0.6 5.8 5.3 0.1 1.1 230.8 228.1 26.25 25.25 4 6.562 6150K 70K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.0 2.0 231.0 230.9 0.55 0.53 1 0.546 127K 39 0.0 0.0 L3 16/0 979.46 MB 1.0 3.4 1.8 1.6 3.4 1.8 1.3 1.9 207.3 206.7 16.96 15.02 9 1.884 3570K 10K 0.0 0.0 L4 179/0 9.56 GB 1.0 2.1 2.0 0.1 2.1 2.0 0.9 1.0 124.3 124.1 17.33 10.56 28 0.619 2127K 1036 0.0 0.0 L5 1076/0 88.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/33 104.59 GB 0.0 20.2 9.2 11.0 28.6 17.7 8.3 3.3 171.7 243.6 120.38 106.22 196 0.614 20M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.2 9.2 11.0 28.6 17.7 8.3 3.3 171.7 243.6 120.38 106.22 196 0.614 20M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.2 9.2 11.0 20.1 9.1 0.0 0.0 218.4 217.4 94.63 84.04 70 1.352 20M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 340.1 25.75 22.18 126 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.0 total, 38.8 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.64 GB write, 752.10 MB/s write, 20.19 GB read, 530.06 MB/s read, 120.4 seconds Interval compaction: 28.64 GB write, 755.64 MB/s write, 20.19 GB read, 532.55 MB/s read, 120.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 36, total-stops: 31, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3801472 Average: 2.4063 StdDev: 20.10 Min: 1 Median: 1.4765 Max: 14894 Percentiles: P50: 1.48 P75: 1.87 P99: 5.99 P99.9: 13.34 P99.99: 180.89 ------------------------------------------------------ [ 0, 1 ] 741788 19.513% 19.513% #### ( 1, 2 ] 2432368 63.985% 83.498% ############# ( 2, 3 ] 327832 8.624% 92.122% ## ( 3, 4 ] 153285 4.032% 96.154% # ( 4, 6 ] 108533 2.855% 99.009% # ( 6, 10 ] 31110 0.818% 99.828% ( 10, 15 ] 4123 0.108% 99.936% ( 15, 22 ] 661 0.017% 99.953% ( 22, 34 ] 47 0.001% 99.955% ( 34, 51 ] 25 0.001% 99.955% ( 51, 76 ] 36 0.001% 99.956% ( 76, 110 ] 508 0.013% 99.970% ( 110, 170 ] 727 0.019% 99.989% ( 170, 250 ] 359 0.009% 99.998% ( 250, 380 ] 308 0.008% 100.006% ( 380, 580 ] 281 0.007% 100.014% ( 580, 870 ] 231 0.006% 100.020% ( 870, 1300 ] 130 0.003% 100.023% ( 1300, 1900 ] 59 0.002% 100.025% ( 1900, 2900 ] 29 0.001% 100.025% ( 2900, 4400 ] 31 0.001% 100.026% ( 4400, 6600 ] 6 0.000% 100.026% ( 6600, 9900 ] 1 0.000% 100.026% ( 14000, 22000 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 711850 Average: 3.8847 StdDev: 59.06 Min: 0 Median: 1.6946 Max: 12078 Percentiles: P50: 1.69 P75: 2.49 P99: 8.96 P99.9: 127.63 P99.99: 362.21 ------------------------------------------------------ [ 0, 1 ] 72603 10.199% 10.199% ## ( 1, 2 ] 407895 57.301% 67.500% ########### ( 2, 3 ] 109799 15.424% 82.924% ### ( 3, 4 ] 51704 7.263% 90.188% # ( 4, 6 ] 52827 7.421% 97.609% # ( 6, 10 ] 13398 1.882% 99.491% ( 10, 15 ] 2234 0.314% 99.805% ( 15, 22 ] 279 0.039% 99.844% ( 22, 34 ] 20 0.003% 99.847% ( 34, 51 ] 2 0.000% 99.847% ( 51, 76 ] 4 0.001% 99.848% ( 76, 110 ] 258 0.036% 99.884% ( 110, 170 ] 392 0.055% 99.939% ( 170, 250 ] 186 0.026% 99.965% ( 250, 380 ] 206 0.029% 99.994% ( 380, 580 ] 220 0.031% 100.025% ( 580, 870 ] 125 0.018% 100.042% ( 870, 1300 ] 64 0.009% 100.051% ( 1300, 1900 ] 42 0.006% 100.057% ( 1900, 2900 ] 32 0.004% 100.062% ( 2900, 4400 ] 45 0.006% 100.068% ( 4400, 6600 ] 11 0.002% 100.070% ( 6600, 9900 ] 13 0.002% 100.072% ( 9900, 14000 ] 3 0.000% 100.072% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4863 StdDev: 8.09 Min: 0 Median: 1.5510 Max: 658 Percentiles: P50: 1.55 P75: 1.96 P99: 7.08 P99.9: 14.90 P99.99: 433.42 ------------------------------------------------------ [ 0, 1 ] 5198 16.250% 16.250% ### ( 1, 2 ] 19592 61.250% 77.500% ############ ( 2, 3 ] 3507 10.964% 88.464% ## ( 3, 4 ] 1863 5.824% 94.288% # ( 4, 6 ] 1419 4.436% 98.724% # ( 6, 10 ] 326 1.019% 99.744% ( 10, 15 ] 51 0.159% 99.903% ( 15, 22 ] 4 0.013% 99.916% ( 22, 34 ] 2 0.006% 99.922% ( 34, 51 ] 1 0.003% 99.925% ( 51, 76 ] 1 0.003% 99.928% ( 110, 170 ] 4 0.013% 99.941% ( 170, 250 ] 8 0.025% 99.966% ( 250, 380 ] 7 0.022% 99.987% ( 380, 580 ] 3 0.009% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 815454 Average: 4.6985 StdDev: 59.56 Min: 1 Median: 1.8000 Max: 7031 Percentiles: P50: 1.80 P75: 2.78 P99: 9.43 P99.9: 111.68 P99.99: 219.87 ------------------------------------------------------ [ 0, 1 ] 58261 7.145% 7.145% # ( 1, 2 ] 436813 53.567% 60.711% ########### ( 2, 3 ] 148569 18.219% 78.931% #### ( 3, 4 ] 73620 9.028% 87.959% ## ( 4, 6 ] 73447 9.007% 96.966% ## ( 6, 10 ] 19328 2.370% 99.336% ( 10, 15 ] 3644 0.447% 99.783% ( 15, 22 ] 589 0.072% 99.855% ( 22, 34 ] 71 0.009% 99.864% ( 34, 51 ] 18 0.002% 99.866% ( 51, 76 ] 19 0.002% 99.868% ( 76, 110 ] 246 0.030% 99.898% ( 110, 170 ] 485 0.059% 99.958% ( 170, 250 ] 421 0.052% 100.009% ( 250, 380 ] 451 0.055% 100.065% ( 380, 580 ] 377 0.046% 100.111% ( 580, 870 ] 232 0.028% 100.139% ( 870, 1300 ] 125 0.015% 100.155% ( 1300, 1900 ] 81 0.010% 100.165% ( 1900, 2900 ] 81 0.010% 100.175% ( 2900, 4400 ] 105 0.013% 100.188% ( 4400, 6600 ] 18 0.002% 100.190% ( 6600, 9900 ] 1 0.000% 100.190% ** Level 4 read latency histogram (micros): Count: 25692 Average: 110.0319 StdDev: 439.38 Min: 0 Median: 1.9882 Max: 21617 Percentiles: P50: 1.99 P75: 3.77 P99: 1919.08 P99.9: 4428.23 P99.99: 6547.82 ------------------------------------------------------ [ 0, 1 ] 1331 5.181% 5.181% # ( 1, 2 ] 11652 45.353% 50.533% ######### ( 2, 3 ] 4280 16.659% 67.192% ### ( 3, 4 ] 2596 10.104% 77.296% ## ( 4, 6 ] 1811 7.049% 84.345% # ( 6, 10 ] 538 2.094% 86.439% ( 10, 15 ] 128 0.498% 86.938% ( 15, 22 ] 25 0.097% 87.035% ( 22, 34 ] 10 0.039% 87.074% ( 34, 51 ] 3 0.012% 87.085% ( 51, 76 ] 2 0.008% 87.093% ( 76, 110 ] 44 0.171% 87.265% ( 110, 170 ] 260 1.012% 88.277% ( 170, 250 ] 299 1.164% 89.440% ( 250, 380 ] 441 1.716% 91.157% ( 380, 580 ] 653 2.542% 93.698% # ( 580, 870 ] 629 2.448% 96.147% ( 870, 1300 ] 482 1.876% 98.023% ( 1300, 1900 ] 249 0.969% 98.992% ( 1900, 2900 ] 109 0.424% 99.416% ( 2900, 4400 ] 124 0.483% 99.899% ( 4400, 6600 ] 24 0.093% 99.992% ( 6600, 9900 ] 3 0.012% 100.004% ( 9900, 14000 ] 1 0.004% 100.008% ( 14000, 22000 ] 1 0.004% 100.012% ** Level 5 read latency histogram (micros): Count: 180 Average: 878.6167 StdDev: 1020.59 Min: 77 Median: 422.1053 Max: 4363 Percentiles: P50: 422.11 P75: 1128.00 P99: 4207.14 P99.9: 4363.00 P99.99: 4363.00 ------------------------------------------------------ ( 76, 110 ] 21 11.667% 11.667% ## ( 110, 170 ] 33 18.333% 30.000% #### ( 170, 250 ] 14 7.778% 37.778% ## ( 250, 380 ] 18 10.000% 47.778% ## ( 380, 580 ] 19 10.556% 58.333% ## ( 580, 870 ] 21 11.667% 70.000% ## ( 870, 1300 ] 15 8.333% 78.333% ## ( 1300, 1900 ] 6 3.333% 81.667% # ( 1900, 2900 ] 19 10.556% 92.222% ## ( 2900, 4400 ] 14 7.778% 100.000% ## ** DB Stats ** Uptime(secs): 39.0 total, 7.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 227.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.473 H:M:S, 37.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 140.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.338 H:M:S, 61.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.254 micros/op 159880 ops/sec 60.088 seconds 9606999 operations; 154.9 MB/s Microseconds per write: Count: 9606999 Average: 6.2544 StdDev: 287.31 Min: 1 Median: 1.7612 Max: 392014 Percentiles: P50: 1.76 P75: 2.78 P99: 8.37 P99.9: 1208.23 P99.99: 2757.31 ------------------------------------------------------ [ 0, 1 ] 1157207 12.045% 12.045% ## ( 1, 2 ] 4790387 49.864% 61.909% ########## ( 2, 3 ] 1607397 16.732% 78.640% ### ( 3, 4 ] 1364619 14.204% 92.845% ### ( 4, 6 ] 539314 5.614% 98.459% # ( 6, 10 ] 87756 0.913% 99.372% ( 10, 15 ] 19224 0.200% 99.572% ( 15, 22 ] 6639 0.069% 99.641% ( 22, 34 ] 1878 0.020% 99.661% ( 34, 51 ] 225 0.002% 99.663% ( 51, 76 ] 22 0.000% 99.663% ( 76, 110 ] 6476 0.067% 99.731% ( 110, 170 ] 2872 0.030% 99.761% ( 170, 250 ] 310 0.003% 99.764% ( 250, 380 ] 78 0.001% 99.765% ( 380, 580 ] 25 0.000% 99.765% ( 580, 870 ] 16 0.000% 99.765% ( 870, 1300 ] 16460 0.171% 99.937% ( 1300, 1900 ] 52 0.001% 99.937% ( 1900, 2900 ] 5927 0.062% 99.999% ( 2900, 4400 ] 66 0.001% 99.999% ( 4400, 6600 ] 21 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 11 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 210469 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9606999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9914422968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 517 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33737933 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29637609603 rocksdb.compact.write.bytes COUNT : 29418446296 rocksdb.flush.write.bytes COUNT : 9908670380 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 45 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 308 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9828660224 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3713024 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29728346649 rocksdb.non.last.level.read.count COUNT : 7182156 rocksdb.block.checksum.compute.count COUNT : 7181167 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.406137 P95 : 3.877945 P99 : 6.611778 P100 : 392005.000000 COUNT : 9606999 SUM : 55514999 rocksdb.compaction.times.micros P50 : 938928.571429 P95 : 4850000.000000 P99 : 22382102.000000 P100 : 22382102.000000 COUNT : 75 SUM : 121533814 rocksdb.compaction.times.cpu_micros P50 : 902500.000000 P95 : 3775000.000000 P99 : 19000000.000000 P100 : 20424312.000000 COUNT : 75 SUM : 107856979 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 713.465909 P95 : 1983.333333 P99 : 66250.000000 P100 : 383373.000000 COUNT : 135 SUM : 542566 rocksdb.compaction.outfile.sync.micros P50 : 985.101010 P95 : 46670.833333 P99 : 315780.000000 P100 : 422709.000000 COUNT : 347 SUM : 4674308 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 102.350000 P95 : 373.825000 P99 : 2510.000000 P100 : 3191.000000 COUNT : 239 SUM : 41758 rocksdb.table.open.io.micros P50 : 1210.090909 P95 : 5922.631579 P99 : 11644.777778 P100 : 11739.000000 COUNT : 517 SUM : 883056 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.573343 P95 : 7.679835 P99 : 11.355278 P100 : 21624.000000 COUNT : 7179889 SUM : 41037963 rocksdb.read.block.get.micros P50 : 378.859649 P95 : 2863.043478 P99 : 4532.000000 P100 : 5274.000000 COUNT : 1034 SUM : 737316 rocksdb.write.raw.block.micros P50 : 0.512900 P95 : 0.974511 P99 : 2.950396 P100 : 21282.000000 COUNT : 9528000 SUM : 18392707 rocksdb.numfiles.in.singlecompaction P50 : 3.176923 P95 : 7.500000 P99 : 14.687500 P100 : 29.000000 COUNT : 125 SUM : 487 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559336 P95 : 1180.294686 P99 : 2557.030907 P100 : 391795.000000 COUNT : 212872 SUM : 33751061 rocksdb.sst.read.micros P50 : 1.520987 P95 : 4.558791 P99 : 8.540715 P100 : 21617.000000 COUNT : 7182625 SUM : 26207755 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9606999 SUM : 9914422968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 208279.569892 P95 : 372500.000000 P99 : 556700.000000 P100 : 1046286.000000 COUNT : 135 SUM : 28699150 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 316 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0