[2024-11-18 05:54:41.132059] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-18 05:54:41.132315] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1981108 ] Set seed to 1731905681125343 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 05:54:41.250085] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 05:54:41.456334] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 05:54:41.456381] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1981108' to capture a snapshot of events at runtime. [2024-11-18 05:54:41.456392] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1981108 for offline analysis/debug. [2024-11-18 05:54:41.456417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 05:54:50 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-05:54:52 ... thread 0: (1000000,1000000) ops and (341283.6,341283.6) ops/second in (2.930114,2.930114) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 566.98 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 356.1 2.48 2.22 12 0.206 0 0 0.0 0.0 L1 1/0 2.10 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 253.0 252.7 1.00 0.96 1 0.996 255K 197 0.0 0.0 L2 3/2 298.48 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.2 1.8 233.6 233.5 0.48 0.45 1 0.476 113K 34 0.0 0.0 L3 17/10 818.40 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.2 201.2 0.31 0.26 1 0.310 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/18 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.4 1.5 99.9 306.9 4.26 3.89 15 0.284 432K 231 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.4 1.5 99.9 306.9 4.26 3.89 15 0.284 432K 231 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 238.8 238.6 1.78 1.67 3 0.594 432K 231 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 356.1 2.48 2.22 12 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 416.43 MB/s write, 0.42 GB read, 135.60 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 445.96 MB/s write, 0.42 GB read, 145.22 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 125868 Average: 1.8707 StdDev: 9.06 Min: 1 Median: 1.2662 Max: 1966 Percentiles: P50: 1.27 P75: 1.69 P99: 4.67 P99.9: 9.89 P99.99: 295.93 ------------------------------------------------------ [ 0, 1 ] 43050 34.202% 34.202% ####### ( 1, 2 ] 74710 59.356% 93.558% ############ ( 2, 3 ] 4595 3.651% 97.209% # ( 3, 4 ] 1893 1.504% 98.713% ( 4, 6 ] 1095 0.870% 99.583% ( 6, 10 ] 413 0.328% 99.911% ( 10, 15 ] 72 0.057% 99.968% ( 15, 22 ] 14 0.011% 99.979% ( 22, 34 ] 1 0.001% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 2 0.002% 99.983% ( 110, 170 ] 10 0.008% 99.991% ( 250, 380 ] 4 0.003% 99.994% ( 380, 580 ] 5 0.004% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ( 1300, 1900 ] 2 0.002% 100.002% ( 1900, 2900 ] 1 0.001% 100.002% ** Level 1 read latency histogram (micros): Count: 9249 Average: 2.8576 StdDev: 14.88 Min: 1 Median: 1.7244 Max: 959 Percentiles: P50: 1.72 P75: 2.46 P99: 8.05 P99.9: 14.49 P99.99: 959.00 ------------------------------------------------------ [ 0, 1 ] 688 7.439% 7.439% # ( 1, 2 ] 5435 58.763% 66.202% ############ ( 2, 3 ] 1757 18.997% 85.198% #### ( 3, 4 ] 614 6.639% 91.837% # ( 4, 6 ] 598 6.466% 98.303% # ( 6, 10 ] 130 1.406% 99.708% ( 10, 15 ] 22 0.238% 99.946% ( 15, 22 ] 2 0.022% 99.968% ( 22, 34 ] 1 0.011% 99.978% ( 250, 380 ] 1 0.011% 99.989% ( 380, 580 ] 1 0.011% 100.000% ( 870, 1300 ] 2 0.022% 100.022% ** Level 2 read latency histogram (micros): Count: 28150 Average: 2.6109 StdDev: 54.20 Min: 0 Median: 1.2162 Max: 8165 Percentiles: P50: 1.22 P75: 1.65 P99: 7.34 P99.9: 80.13 P99.99: 1737.00 ------------------------------------------------------ [ 0, 1 ] 10562 37.520% 37.520% ######## ( 1, 2 ] 16249 57.723% 95.243% ############ ( 2, 3 ] 678 2.409% 97.652% ( 3, 4 ] 218 0.774% 98.426% ( 4, 6 ] 91 0.323% 98.750% ( 6, 10 ] 210 0.746% 99.496% ( 10, 15 ] 61 0.217% 99.712% ( 15, 22 ] 3 0.011% 99.723% ( 34, 51 ] 3 0.011% 99.734% ( 51, 76 ] 46 0.163% 99.897% ( 76, 110 ] 7 0.025% 99.922% ( 110, 170 ] 1 0.004% 99.925% ( 170, 250 ] 8 0.028% 99.954% ( 250, 380 ] 1 0.004% 99.957% ( 380, 580 ] 5 0.018% 99.975% ( 580, 870 ] 1 0.004% 99.979% ( 870, 1300 ] 1 0.004% 99.982% ( 1300, 1900 ] 3 0.011% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 6600, 9900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 18806 Average: 13.3265 StdDev: 245.67 Min: 1 Median: 1.5604 Max: 9978 Percentiles: P50: 1.56 P75: 1.97 P99: 21.26 P99.9: 2497.00 P99.99: 8735.82 ------------------------------------------------------ [ 0, 1 ] 3044 16.186% 16.186% ### ( 1, 2 ] 11348 60.342% 76.529% ############ ( 2, 3 ] 2181 11.597% 88.126% ## ( 3, 4 ] 962 5.115% 93.242% # ( 4, 6 ] 646 3.435% 96.677% # ( 6, 10 ] 318 1.691% 98.368% ( 10, 15 ] 110 0.585% 98.952% ( 15, 22 ] 10 0.053% 99.006% ( 34, 51 ] 1 0.005% 99.011% ( 76, 110 ] 2 0.011% 99.022% ( 110, 170 ] 68 0.362% 99.383% ( 170, 250 ] 32 0.170% 99.553% ( 250, 380 ] 23 0.122% 99.676% ( 380, 580 ] 16 0.085% 99.761% ( 580, 870 ] 10 0.053% 99.814% ( 870, 1300 ] 8 0.043% 99.856% ( 1300, 1900 ] 7 0.037% 99.894% ( 1900, 2900 ] 2 0.011% 99.904% ( 2900, 4400 ] 5 0.027% 99.931% ( 4400, 6600 ] 4 0.021% 99.952% ( 6600, 9900 ] 11 0.058% 100.011% ( 9900, 14000 ] 1 0.005% 100.016% ** Level 4 read latency histogram (micros): Count: 30 Average: 3855.2000 StdDev: 3760.61 Min: 246 Median: 2900.0000 Max: 12495 Percentiles: P50: 2900.00 P75: 5814.29 P99: 12495.00 P99.9: 12495.00 P99.99: 12495.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 5 16.667% 20.000% ### ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 1 3.333% 40.000% # ( 1300, 1900 ] 2 6.667% 46.667% # ( 1900, 2900 ] 1 3.333% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 1 3.333% 86.667% # ( 9900, 14000 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 313.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.362 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.362 H:M:S, 12.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-05:54:56 ... thread 0: (1000000,2000000) ops and (328780.5,334915.4) ops/second in (3.041543,5.971657) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 1.54 GB 0.0 0.9 0.0 0.9 2.8 1.8 0.0 1.5 105.6 316.7 8.95 8.29 29 0.309 959K 1236 0.0 0.0 L1 1/1 2.10 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 253.0 252.7 1.00 0.96 1 0.996 255K 197 0.0 0.0 L2 1/1 120.92 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 233.6 233.5 0.48 0.45 1 0.476 113K 34 0.0 0.0 L3 78/33 995.41 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.0 4.4 212.4 212.3 4.95 4.24 3 1.651 1068K 590 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/46 97.98 GB 0.0 2.3 0.5 1.8 4.1 2.3 0.4 2.2 153.5 276.3 15.37 13.94 34 0.452 2397K 2057 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 0.5 1.8 4.1 2.3 0.4 2.2 153.5 276.3 15.37 13.94 34 0.452 2397K 2057 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 0.5 1.8 2.3 0.5 0.0 0.0 235.3 235.1 10.03 9.20 8 1.254 2397K 2057 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.7 5.34 4.74 26 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.15 GB write, 687.26 MB/s write, 2.31 GB read, 381.86 MB/s read, 15.4 seconds Interval compaction: 4.15 GB write, 711.19 MB/s write, 2.31 GB read, 395.16 MB/s read, 15.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 379094 Average: 2.1968 StdDev: 8.65 Min: 1 Median: 1.4864 Max: 2327 Percentiles: P50: 1.49 P75: 1.88 P99: 5.73 P99.9: 10.44 P99.99: 18.84 ------------------------------------------------------ [ 0, 1 ] 72415 19.102% 19.102% #### ( 1, 2 ] 240810 63.523% 82.625% ############# ( 2, 3 ] 38759 10.224% 92.849% ## ( 3, 4 ] 13550 3.574% 96.423% # ( 4, 6 ] 11301 2.981% 99.404% # ( 6, 10 ] 1849 0.488% 99.892% ( 10, 15 ] 354 0.093% 99.985% ( 15, 22 ] 33 0.009% 99.994% ( 22, 34 ] 10 0.003% 99.997% ( 34, 51 ] 3 0.001% 99.997% ( 51, 76 ] 3 0.001% 99.998% ( 110, 170 ] 12 0.003% 100.001% ( 170, 250 ] 9 0.002% 100.004% ( 250, 380 ] 8 0.002% 100.006% ( 380, 580 ] 14 0.004% 100.009% ( 580, 870 ] 6 0.002% 100.011% ( 870, 1300 ] 4 0.001% 100.012% ( 1300, 1900 ] 2 0.001% 100.013% ( 1900, 2900 ] 3 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 34814 Average: 2.6715 StdDev: 7.75 Min: 1 Median: 1.7479 Max: 959 Percentiles: P50: 1.75 P75: 2.50 P99: 7.71 P99.9: 14.07 P99.99: 317.42 ------------------------------------------------------ [ 0, 1 ] 2159 6.202% 6.202% # ( 1, 2 ] 20389 58.566% 64.767% ############ ( 2, 3 ] 7055 20.265% 85.032% #### ( 3, 4 ] 2387 6.856% 91.888% # ( 4, 6 ] 2301 6.609% 98.498% # ( 6, 10 ] 410 1.178% 99.675% ( 10, 15 ] 96 0.276% 99.951% ( 15, 22 ] 12 0.034% 99.986% ( 22, 34 ] 1 0.003% 99.989% ( 250, 380 ] 1 0.003% 99.991% ( 380, 580 ] 1 0.003% 99.994% ( 870, 1300 ] 2 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 40533 Average: 2.4175 StdDev: 45.17 Min: 0 Median: 1.2860 Max: 8165 Percentiles: P50: 1.29 P75: 1.70 P99: 5.81 P99.9: 69.73 P99.99: 1489.34 ------------------------------------------------------ [ 0, 1 ] 13319 32.860% 32.860% ####### ( 1, 2 ] 24293 59.934% 92.794% ############ ( 2, 3 ] 1673 4.128% 96.921% # ( 3, 4 ] 586 1.446% 98.367% ( 4, 6 ] 284 0.701% 99.067% ( 6, 10 ] 234 0.577% 99.645% ( 10, 15 ] 63 0.155% 99.800% ( 15, 22 ] 3 0.007% 99.808% ( 34, 51 ] 3 0.007% 99.815% ( 51, 76 ] 46 0.113% 99.928% ( 76, 110 ] 7 0.017% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 8 0.020% 99.968% ( 250, 380 ] 1 0.002% 99.970% ( 380, 580 ] 5 0.012% 99.983% ( 580, 870 ] 1 0.002% 99.985% ( 870, 1300 ] 1 0.002% 99.988% ( 1300, 1900 ] 3 0.007% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 207175 Average: 3.9405 StdDev: 76.03 Min: 1 Median: 1.5652 Max: 9978 Percentiles: P50: 1.57 P75: 1.97 P99: 9.20 P99.9: 230.21 P99.99: 761.53 ------------------------------------------------------ [ 0, 1 ] 30621 14.780% 14.780% ### ( 1, 2 ] 129101 62.315% 77.095% ############ ( 2, 3 ] 23807 11.491% 88.586% ## ( 3, 4 ] 10855 5.240% 93.826% # ( 4, 6 ] 7684 3.709% 97.535% # ( 6, 10 ] 3796 1.832% 99.367% ( 10, 15 ] 554 0.267% 99.635% ( 15, 22 ] 57 0.028% 99.662% ( 22, 34 ] 13 0.006% 99.668% ( 34, 51 ] 6 0.003% 99.671% ( 51, 76 ] 2 0.001% 99.672% ( 76, 110 ] 99 0.048% 99.720% ( 110, 170 ] 278 0.134% 99.854% ( 170, 250 ] 126 0.061% 99.915% ( 250, 380 ] 71 0.034% 99.949% ( 380, 580 ] 63 0.030% 99.980% ( 580, 870 ] 34 0.016% 99.996% ( 870, 1300 ] 13 0.006% 100.002% ( 1300, 1900 ] 8 0.004% 100.006% ( 1900, 2900 ] 5 0.002% 100.009% ( 2900, 4400 ] 5 0.002% 100.011% ( 4400, 6600 ] 4 0.002% 100.013% ( 6600, 9900 ] 11 0.005% 100.018% ( 9900, 14000 ] 1 0.000% 100.019% ** Level 4 read latency histogram (micros): Count: 30 Average: 3855.2000 StdDev: 3760.61 Min: 246 Median: 2900.0000 Max: 12495 Percentiles: P50: 2900.00 P75: 5814.29 P99: 12495.00 P99.9: 12495.00 P99.99: 12495.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 5 16.667% 20.000% ### ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 1 3.333% 40.000% # ( 1300, 1900 ] 2 6.667% 46.667% # ( 1900, 2900 ] 1 3.333% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 1 3.333% 86.667% # ( 9900, 14000 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.781 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.419 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-05:54:59 ... thread 0: (1000000,3000000) ops and (326232.2,331970.1) ops/second in (3.065301,9.036958) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.46 GB 94.4 1.8 0.0 1.8 4.6 2.8 0.0 1.6 121.6 310.2 15.02 14.01 45 0.334 1854K 2204 0.0 0.0 L1 1/1 2.10 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 253.0 252.7 1.00 0.96 1 0.996 255K 197 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 233.6 233.5 0.48 0.45 1 0.476 113K 34 0.0 0.0 L3 29/0 999.18 MB 1.0 1.2 0.4 0.9 1.2 0.4 0.0 3.5 213.5 213.4 5.94 5.16 4 1.484 1263K 590 0.0 0.0 L4 140/0 9.65 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1229/12 98.90 GB 0.0 3.4 0.6 2.8 6.1 3.4 0.5 2.2 154.2 280.4 22.43 20.58 51 0.440 3487K 3025 0.0 0.0 Int 0/0 0.00 KB 0.0 3.4 0.6 2.8 6.1 3.4 0.5 2.2 154.2 280.4 22.43 20.58 51 0.440 3487K 3025 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.4 0.6 2.8 3.4 0.6 0.0 0.0 240.4 240.1 14.39 13.43 12 1.199 3487K 3025 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.5 8.04 7.15 39 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.14 GB write, 680.22 MB/s write, 3.38 GB read, 373.99 MB/s read, 22.4 seconds Interval compaction: 6.14 GB write, 695.87 MB/s write, 3.38 GB read, 382.59 MB/s read, 22.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 800592 Average: 2.2813 StdDev: 9.96 Min: 1 Median: 1.5318 Max: 3770 Percentiles: P50: 1.53 P75: 1.91 P99: 5.79 P99.9: 10.45 P99.99: 14.71 ------------------------------------------------------ [ 0, 1 ] 121573 15.185% 15.185% ### ( 1, 2 ] 524152 65.471% 80.656% ############# ( 2, 3 ] 92457 11.549% 92.205% ## ( 3, 4 ] 31266 3.905% 96.110% # ( 4, 6 ] 25831 3.226% 99.336% # ( 6, 10 ] 4438 0.554% 99.891% ( 10, 15 ] 846 0.106% 99.996% ( 15, 22 ] 69 0.009% 100.005% ( 22, 34 ] 19 0.002% 100.007% ( 34, 51 ] 9 0.001% 100.008% ( 51, 76 ] 7 0.001% 100.009% ( 76, 110 ] 55 0.007% 100.016% ( 110, 170 ] 30 0.004% 100.020% ( 170, 250 ] 37 0.005% 100.025% ( 250, 380 ] 21 0.003% 100.027% ( 380, 580 ] 24 0.003% 100.030% ( 580, 870 ] 12 0.001% 100.032% ( 870, 1300 ] 10 0.001% 100.033% ( 1300, 1900 ] 3 0.000% 100.033% ( 1900, 2900 ] 3 0.000% 100.034% ( 2900, 4400 ] 3 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 63401 Average: 2.5600 StdDev: 5.79 Min: 1 Median: 1.7090 Max: 959 Percentiles: P50: 1.71 P75: 2.37 P99: 6.74 P99.9: 13.43 P99.99: 21.45 ------------------------------------------------------ [ 0, 1 ] 4044 6.378% 6.378% # ( 1, 2 ] 39010 61.529% 67.907% ############ ( 2, 3 ] 12023 18.963% 86.871% #### ( 3, 4 ] 3822 6.028% 92.899% # ( 4, 6 ] 3759 5.929% 98.828% # ( 6, 10 ] 589 0.929% 99.757% ( 10, 15 ] 132 0.208% 99.965% ( 15, 22 ] 17 0.027% 99.992% ( 22, 34 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.995% ( 380, 580 ] 1 0.002% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40533 Average: 2.4175 StdDev: 45.17 Min: 0 Median: 1.2860 Max: 8165 Percentiles: P50: 1.29 P75: 1.70 P99: 5.81 P99.9: 69.73 P99.99: 1489.34 ------------------------------------------------------ [ 0, 1 ] 13319 32.860% 32.860% ####### ( 1, 2 ] 24293 59.934% 92.794% ############ ( 2, 3 ] 1673 4.128% 96.921% # ( 3, 4 ] 586 1.446% 98.367% ( 4, 6 ] 284 0.701% 99.067% ( 6, 10 ] 234 0.577% 99.645% ( 10, 15 ] 63 0.155% 99.800% ( 15, 22 ] 3 0.007% 99.808% ( 34, 51 ] 3 0.007% 99.815% ( 51, 76 ] 46 0.113% 99.928% ( 76, 110 ] 7 0.017% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 8 0.020% 99.968% ( 250, 380 ] 1 0.002% 99.970% ( 380, 580 ] 5 0.012% 99.983% ( 580, 870 ] 1 0.002% 99.985% ( 870, 1300 ] 1 0.002% 99.988% ( 1300, 1900 ] 3 0.007% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 230753 Average: 3.8032 StdDev: 72.16 Min: 1 Median: 1.5761 Max: 9978 Percentiles: P50: 1.58 P75: 1.98 P99: 9.08 P99.9: 217.40 P99.99: 749.95 ------------------------------------------------------ [ 0, 1 ] 32514 14.090% 14.090% ### ( 1, 2 ] 143844 62.337% 76.427% ############ ( 2, 3 ] 27809 12.051% 88.479% ## ( 3, 4 ] 12203 5.288% 93.767% # ( 4, 6 ] 8982 3.892% 97.659% # ( 6, 10 ] 4015 1.740% 99.399% ( 10, 15 ] 618 0.268% 99.667% ( 15, 22 ] 64 0.028% 99.695% ( 22, 34 ] 13 0.006% 99.701% ( 34, 51 ] 6 0.003% 99.703% ( 51, 76 ] 2 0.001% 99.704% ( 76, 110 ] 99 0.043% 99.747% ( 110, 170 ] 278 0.120% 99.867% ( 170, 250 ] 127 0.055% 99.922% ( 250, 380 ] 72 0.031% 99.954% ( 380, 580 ] 64 0.028% 99.981% ( 580, 870 ] 34 0.015% 99.996% ( 870, 1300 ] 13 0.006% 100.002% ( 1300, 1900 ] 8 0.003% 100.005% ( 1900, 2900 ] 6 0.003% 100.008% ( 2900, 4400 ] 5 0.002% 100.010% ( 4400, 6600 ] 4 0.002% 100.012% ( 6600, 9900 ] 11 0.005% 100.016% ( 9900, 14000 ] 1 0.000% 100.017% ** Level 4 read latency histogram (micros): Count: 30 Average: 3855.2000 StdDev: 3760.61 Min: 246 Median: 2900.0000 Max: 12495 Percentiles: P50: 2900.00 P75: 5814.29 P99: 12495.00 P99.9: 12495.00 P99.99: 12495.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 5 16.667% 20.000% ### ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 1 3.333% 40.000% # ( 1300, 1900 ] 2 6.667% 46.667% # ( 1900, 2900 ] 1 3.333% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 1 3.333% 86.667% # ( 9900, 14000 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 319.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.208 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.428 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-05:55:02 ... thread 0: (1000000,4000000) ops and (334805.0,332674.3) ops/second in (2.986813,12.023771) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.21 GB 201.4 2.6 0.0 2.6 6.4 3.7 0.0 1.7 128.1 309.7 21.14 19.76 62 0.341 2750K 3284 0.0 0.0 L1 11/0 1.22 GB 125.4 1.5 1.4 0.1 1.5 1.4 0.1 1.0 230.8 229.8 6.55 6.30 2 3.277 1536K 6657 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 233.6 233.5 0.48 0.45 1 0.476 113K 34 0.0 0.0 L3 29/0 999.18 MB 1.0 1.2 0.4 0.9 1.2 0.4 0.0 3.5 213.5 213.4 5.94 5.16 4 1.484 1263K 590 0.0 0.0 L4 140/0 9.65 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1237/4 99.88 GB 0.0 5.5 1.8 3.6 9.2 5.6 0.5 2.5 164.2 276.5 34.11 31.67 69 0.494 5662K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.8 3.6 9.2 5.6 0.5 2.5 164.2 276.5 34.11 31.67 69 0.494 5662K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.8 3.6 5.5 1.8 0.0 0.0 240.5 240.0 23.29 22.05 16 1.456 5662K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 355.1 10.82 9.62 53 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.21 GB write, 771.03 MB/s write, 5.47 GB read, 457.82 MB/s read, 34.1 seconds Interval compaction: 9.21 GB write, 784.37 MB/s write, 5.47 GB read, 465.74 MB/s read, 34.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 16, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1135402 Average: 2.2853 StdDev: 10.78 Min: 1 Median: 1.5185 Max: 3770 Percentiles: P50: 1.52 P75: 1.90 P99: 5.80 P99.9: 10.86 P99.99: 17.34 ------------------------------------------------------ [ 0, 1 ] 180764 15.921% 15.921% ### ( 1, 2 ] 746254 65.726% 81.647% ############# ( 2, 3 ] 125686 11.070% 92.716% ## ( 3, 4 ] 41187 3.628% 96.344% # ( 4, 6 ] 33454 2.946% 99.290% # ( 6, 10 ] 6717 0.592% 99.882% ( 10, 15 ] 1190 0.105% 99.987% ( 15, 22 ] 109 0.010% 99.996% ( 22, 34 ] 23 0.002% 99.998% ( 34, 51 ] 12 0.001% 99.999% ( 51, 76 ] 8 0.001% 100.000% ( 76, 110 ] 78 0.007% 100.007% ( 110, 170 ] 101 0.009% 100.016% ( 170, 250 ] 68 0.006% 100.022% ( 250, 380 ] 41 0.004% 100.026% ( 380, 580 ] 51 0.004% 100.030% ( 580, 870 ] 25 0.002% 100.032% ( 870, 1300 ] 17 0.001% 100.034% ( 1300, 1900 ] 5 0.000% 100.034% ( 1900, 2900 ] 3 0.000% 100.034% ( 2900, 4400 ] 5 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 63987 Average: 2.9866 StdDev: 20.28 Min: 0 Median: 1.7079 Max: 2093 Percentiles: P50: 1.71 P75: 2.37 P99: 7.32 P99.9: 103.94 P99.99: 1179.71 ------------------------------------------------------ [ 0, 1 ] 4150 6.486% 6.486% # ( 1, 2 ] 39332 61.469% 67.954% ############ ( 2, 3 ] 12068 18.860% 86.815% #### ( 3, 4 ] 3834 5.992% 92.806% # ( 4, 6 ] 3765 5.884% 98.690% # ( 6, 10 ] 600 0.938% 99.628% ( 10, 15 ] 132 0.206% 99.834% ( 15, 22 ] 17 0.027% 99.861% ( 22, 34 ] 1 0.002% 99.862% ( 34, 51 ] 1 0.002% 99.864% ( 76, 110 ] 28 0.044% 99.908% ( 110, 170 ] 19 0.030% 99.937% ( 170, 250 ] 8 0.013% 99.950% ( 250, 380 ] 9 0.014% 99.964% ( 380, 580 ] 10 0.016% 99.980% ( 580, 870 ] 3 0.005% 99.984% ( 870, 1300 ] 5 0.008% 99.992% ( 1300, 1900 ] 4 0.006% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 40533 Average: 2.4175 StdDev: 45.17 Min: 0 Median: 1.2860 Max: 8165 Percentiles: P50: 1.29 P75: 1.70 P99: 5.81 P99.9: 69.73 P99.99: 1489.34 ------------------------------------------------------ [ 0, 1 ] 13319 32.860% 32.860% ####### ( 1, 2 ] 24293 59.934% 92.794% ############ ( 2, 3 ] 1673 4.128% 96.921% # ( 3, 4 ] 586 1.446% 98.367% ( 4, 6 ] 284 0.701% 99.067% ( 6, 10 ] 234 0.577% 99.645% ( 10, 15 ] 63 0.155% 99.800% ( 15, 22 ] 3 0.007% 99.808% ( 34, 51 ] 3 0.007% 99.815% ( 51, 76 ] 46 0.113% 99.928% ( 76, 110 ] 7 0.017% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 8 0.020% 99.968% ( 250, 380 ] 1 0.002% 99.970% ( 380, 580 ] 5 0.012% 99.983% ( 580, 870 ] 1 0.002% 99.985% ( 870, 1300 ] 1 0.002% 99.988% ( 1300, 1900 ] 3 0.007% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 230753 Average: 3.8032 StdDev: 72.16 Min: 1 Median: 1.5761 Max: 9978 Percentiles: P50: 1.58 P75: 1.98 P99: 9.08 P99.9: 217.40 P99.99: 749.95 ------------------------------------------------------ [ 0, 1 ] 32514 14.090% 14.090% ### ( 1, 2 ] 143844 62.337% 76.427% ############ ( 2, 3 ] 27809 12.051% 88.479% ## ( 3, 4 ] 12203 5.288% 93.767% # ( 4, 6 ] 8982 3.892% 97.659% # ( 6, 10 ] 4015 1.740% 99.399% ( 10, 15 ] 618 0.268% 99.667% ( 15, 22 ] 64 0.028% 99.695% ( 22, 34 ] 13 0.006% 99.701% ( 34, 51 ] 6 0.003% 99.703% ( 51, 76 ] 2 0.001% 99.704% ( 76, 110 ] 99 0.043% 99.747% ( 110, 170 ] 278 0.120% 99.867% ( 170, 250 ] 127 0.055% 99.922% ( 250, 380 ] 72 0.031% 99.954% ( 380, 580 ] 64 0.028% 99.981% ( 580, 870 ] 34 0.015% 99.996% ( 870, 1300 ] 13 0.006% 100.002% ( 1300, 1900 ] 8 0.003% 100.005% ( 1900, 2900 ] 6 0.003% 100.008% ( 2900, 4400 ] 5 0.002% 100.010% ( 4400, 6600 ] 4 0.002% 100.012% ( 6600, 9900 ] 11 0.005% 100.016% ( 9900, 14000 ] 1 0.000% 100.017% ** Level 4 read latency histogram (micros): Count: 30 Average: 3855.2000 StdDev: 3760.61 Min: 246 Median: 2900.0000 Max: 12495 Percentiles: P50: 2900.00 P75: 5814.29 P99: 12495.00 P99.9: 12495.00 P99.99: 12495.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 5 16.667% 20.000% ### ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 1 3.333% 40.000% # ( 1300, 1900 ] 2 6.667% 46.667% # ( 1900, 2900 ] 1 3.333% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 1 3.333% 86.667% # ( 9900, 14000 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.598 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.390 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/18-05:55:05 ... thread 0: (1000000,5000000) ops and (316725.4,329357.3) ops/second in (3.157309,15.181080) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.13 GB 62.9 3.4 0.0 3.4 8.1 4.7 0.0 1.7 131.3 309.4 26.86 25.14 79 0.340 3581K 4167 0.0 0.0 L1 11/11 1.22 GB 0.0 1.5 1.4 0.1 1.5 1.4 0.1 1.0 230.8 229.8 6.55 6.30 2 3.277 1536K 6657 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 233.6 233.5 0.48 0.45 1 0.476 113K 34 0.0 0.0 L3 29/0 999.18 MB 1.0 1.2 0.4 0.9 1.2 0.4 0.0 3.5 213.5 213.4 5.94 5.16 4 1.484 1263K 590 0.0 0.0 L4 140/0 9.65 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/26 100.80 GB 0.0 6.3 1.8 4.4 10.9 6.5 0.5 2.3 161.2 281.1 39.83 37.06 86 0.463 6494K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 1.8 4.4 10.9 6.5 0.5 2.3 161.2 281.1 39.83 37.06 86 0.463 6494K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 1.8 4.4 6.3 1.8 0.0 0.0 243.2 242.7 26.40 25.10 19 1.389 6494K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.4 13.43 11.96 67 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.2 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.93 GB write, 727.39 MB/s write, 6.27 GB read, 417.10 MB/s read, 39.8 seconds Interval compaction: 10.93 GB write, 737.36 MB/s write, 6.27 GB read, 422.82 MB/s read, 39.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 18, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1431042 Average: 2.2807 StdDev: 10.60 Min: 0 Median: 1.5156 Max: 3770 Percentiles: P50: 1.52 P75: 1.89 P99: 5.77 P99.9: 10.64 P99.99: 19.32 ------------------------------------------------------ [ 0, 1 ] 227266 15.881% 15.881% ### ( 1, 2 ] 946916 66.170% 82.051% ############# ( 2, 3 ] 155985 10.900% 92.951% ## ( 3, 4 ] 50791 3.549% 96.500% # ( 4, 6 ] 40529 2.832% 99.332% # ( 6, 10 ] 7947 0.555% 99.888% ( 10, 15 ] 1384 0.097% 99.984% ( 15, 22 ] 131 0.009% 99.994% ( 22, 34 ] 24 0.002% 99.995% ( 34, 51 ] 13 0.001% 99.996% ( 51, 76 ] 11 0.001% 99.997% ( 76, 110 ] 135 0.009% 100.006% ( 110, 170 ] 147 0.010% 100.017% ( 170, 250 ] 81 0.006% 100.022% ( 250, 380 ] 53 0.004% 100.026% ( 380, 580 ] 68 0.005% 100.031% ( 580, 870 ] 34 0.002% 100.033% ( 870, 1300 ] 23 0.002% 100.035% ( 1300, 1900 ] 6 0.000% 100.035% ( 1900, 2900 ] 4 0.000% 100.035% ( 2900, 4400 ] 5 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 122192 Average: 2.8206 StdDev: 16.71 Min: 0 Median: 1.6044 Max: 2093 Percentiles: P50: 1.60 P75: 1.99 P99: 8.03 P99.9: 150.93 P99.99: 799.29 ------------------------------------------------------ [ 0, 1 ] 13571 11.106% 11.106% ## ( 1, 2 ] 78626 64.346% 75.453% ############# ( 2, 3 ] 17577 14.385% 89.837% ### ( 3, 4 ] 5436 4.449% 94.286% # ( 4, 6 ] 4944 4.046% 98.332% # ( 6, 10 ] 1606 1.314% 99.646% ( 10, 15 ] 194 0.159% 99.805% ( 15, 22 ] 19 0.016% 99.821% ( 22, 34 ] 2 0.002% 99.822% ( 34, 51 ] 1 0.001% 99.823% ( 51, 76 ] 1 0.001% 99.824% ( 76, 110 ] 28 0.023% 99.847% ( 110, 170 ] 95 0.078% 99.925% ( 170, 250 ] 31 0.025% 99.950% ( 250, 380 ] 25 0.020% 99.971% ( 380, 580 ] 20 0.016% 99.987% ( 580, 870 ] 5 0.004% 99.991% ( 870, 1300 ] 6 0.005% 99.996% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 40533 Average: 2.4175 StdDev: 45.17 Min: 0 Median: 1.2860 Max: 8165 Percentiles: P50: 1.29 P75: 1.70 P99: 5.81 P99.9: 69.73 P99.99: 1489.34 ------------------------------------------------------ [ 0, 1 ] 13319 32.860% 32.860% ####### ( 1, 2 ] 24293 59.934% 92.794% ############ ( 2, 3 ] 1673 4.128% 96.921% # ( 3, 4 ] 586 1.446% 98.367% ( 4, 6 ] 284 0.701% 99.067% ( 6, 10 ] 234 0.577% 99.645% ( 10, 15 ] 63 0.155% 99.800% ( 15, 22 ] 3 0.007% 99.808% ( 34, 51 ] 3 0.007% 99.815% ( 51, 76 ] 46 0.113% 99.928% ( 76, 110 ] 7 0.017% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 8 0.020% 99.968% ( 250, 380 ] 1 0.002% 99.970% ( 380, 580 ] 5 0.012% 99.983% ( 580, 870 ] 1 0.002% 99.985% ( 870, 1300 ] 1 0.002% 99.988% ( 1300, 1900 ] 3 0.007% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 230753 Average: 3.8032 StdDev: 72.16 Min: 1 Median: 1.5761 Max: 9978 Percentiles: P50: 1.58 P75: 1.98 P99: 9.08 P99.9: 217.40 P99.99: 749.95 ------------------------------------------------------ [ 0, 1 ] 32514 14.090% 14.090% ### ( 1, 2 ] 143844 62.337% 76.427% ############ ( 2, 3 ] 27809 12.051% 88.479% ## ( 3, 4 ] 12203 5.288% 93.767% # ( 4, 6 ] 8982 3.892% 97.659% # ( 6, 10 ] 4015 1.740% 99.399% ( 10, 15 ] 618 0.268% 99.667% ( 15, 22 ] 64 0.028% 99.695% ( 22, 34 ] 13 0.006% 99.701% ( 34, 51 ] 6 0.003% 99.703% ( 51, 76 ] 2 0.001% 99.704% ( 76, 110 ] 99 0.043% 99.747% ( 110, 170 ] 278 0.120% 99.867% ( 170, 250 ] 127 0.055% 99.922% ( 250, 380 ] 72 0.031% 99.954% ( 380, 580 ] 64 0.028% 99.981% ( 580, 870 ] 34 0.015% 99.996% ( 870, 1300 ] 13 0.006% 100.002% ( 1300, 1900 ] 8 0.003% 100.005% ( 1900, 2900 ] 6 0.003% 100.008% ( 2900, 4400 ] 5 0.002% 100.010% ( 4400, 6600 ] 4 0.002% 100.012% ( 6600, 9900 ] 11 0.005% 100.016% ( 9900, 14000 ] 1 0.000% 100.017% ** Level 4 read latency histogram (micros): Count: 30 Average: 3855.2000 StdDev: 3760.61 Min: 246 Median: 2900.0000 Max: 12495 Percentiles: P50: 2900.00 P75: 5814.29 P99: 12495.00 P99.9: 12495.00 P99.99: 12495.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 5 16.667% 20.000% ### ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 1 3.333% 40.000% # ( 1300, 1900 ] 2 6.667% 46.667% # ( 1900, 2900 ] 1 3.333% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 1 3.333% 86.667% # ( 9900, 14000 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 15.4 total, 3.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 319.72 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.119 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 311.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.521 H:M:S, 16.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-05:55:14 ... thread 0: (1000000,6000000) ops and (103984.9,241956.3) ops/second in (9.616783,24.797863) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 4.11 GB 162.9 5.7 0.0 5.7 11.4 5.6 0.0 2.0 150.7 299.4 38.88 36.45 100 0.389 5947K 12K 0.0 0.0 L1 11/11 1.22 GB 0.0 1.5 1.4 0.1 1.5 1.4 0.1 1.0 230.8 229.8 6.55 6.30 2 3.277 1536K 6657 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 233.6 233.5 0.48 0.45 1 0.476 113K 34 0.0 0.0 L3 29/0 999.18 MB 1.0 1.2 0.4 0.9 1.2 0.4 0.0 3.5 213.5 213.4 5.94 5.16 4 1.484 1263K 590 0.0 0.0 L4 140/0 9.65 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/26 101.78 GB 0.0 8.5 1.8 6.7 14.2 7.5 0.5 2.5 168.8 280.2 51.84 48.36 107 0.485 8859K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.5 1.8 6.7 14.2 7.5 0.5 2.5 168.8 280.2 51.84 48.36 107 0.485 8859K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.5 1.8 6.7 8.5 1.8 0.0 0.0 246.8 246.3 35.44 33.77 24 1.477 8859K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 353.4 16.40 14.59 83 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.0 total, 24.8 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.18 GB write, 580.81 MB/s write, 8.54 GB read, 349.87 MB/s read, 51.8 seconds Interval compaction: 14.18 GB write, 585.68 MB/s write, 8.54 GB read, 352.80 MB/s read, 51.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 18, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2336003 Average: 2.5632 StdDev: 13.29 Min: 0 Median: 1.5062 Max: 4083 Percentiles: P50: 1.51 P75: 1.88 P99: 5.99 P99.9: 129.67 P99.99: 219.70 ------------------------------------------------------ [ 0, 1 ] 375884 16.091% 16.091% ### ( 1, 2 ] 1564834 66.988% 83.079% ############# ( 2, 3 ] 238227 10.198% 93.277% ## ( 3, 4 ] 75838 3.246% 96.523% # ( 4, 6 ] 58101 2.487% 99.010% ( 6, 10 ] 16261 0.696% 99.706% ( 10, 15 ] 2013 0.086% 99.793% ( 15, 22 ] 222 0.010% 99.802% ( 22, 34 ] 29 0.001% 99.803% ( 34, 51 ] 16 0.001% 99.804% ( 51, 76 ] 18 0.001% 99.805% ( 76, 110 ] 1368 0.059% 99.863% ( 110, 170 ] 2614 0.112% 99.975% ( 170, 250 ] 556 0.024% 99.999% ( 250, 380 ] 322 0.014% 100.013% ( 380, 580 ] 269 0.012% 100.024% ( 580, 870 ] 120 0.005% 100.029% ( 870, 1300 ] 39 0.002% 100.031% ( 1300, 1900 ] 10 0.000% 100.032% ( 1900, 2900 ] 6 0.000% 100.032% ( 2900, 4400 ] 7 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 305669 Average: 2.7944 StdDev: 14.90 Min: 0 Median: 1.5512 Max: 2928 Percentiles: P50: 1.55 P75: 1.93 P99: 8.46 P99.9: 160.17 P99.99: 556.58 ------------------------------------------------------ [ 0, 1 ] 40495 13.248% 13.248% ### ( 1, 2 ] 203799 66.673% 79.921% ############# ( 2, 3 ] 35520 11.620% 91.542% ## ( 3, 4 ] 10960 3.586% 95.127% # ( 4, 6 ] 8978 2.937% 98.064% # ( 6, 10 ] 4642 1.519% 99.583% ( 10, 15 ] 362 0.118% 99.701% ( 15, 22 ] 42 0.014% 99.715% ( 22, 34 ] 3 0.001% 99.716% ( 34, 51 ] 1 0.000% 99.716% ( 51, 76 ] 6 0.002% 99.718% ( 76, 110 ] 205 0.067% 99.785% ( 110, 170 ] 419 0.137% 99.922% ( 170, 250 ] 114 0.037% 99.960% ( 250, 380 ] 58 0.019% 99.979% ( 380, 580 ] 39 0.013% 99.991% ( 580, 870 ] 10 0.003% 99.995% ( 870, 1300 ] 10 0.003% 99.998% ( 1300, 1900 ] 4 0.001% 99.999% ( 1900, 2900 ] 1 0.000% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 40533 Average: 2.4175 StdDev: 45.17 Min: 0 Median: 1.2860 Max: 8165 Percentiles: P50: 1.29 P75: 1.70 P99: 5.81 P99.9: 69.73 P99.99: 1489.34 ------------------------------------------------------ [ 0, 1 ] 13319 32.860% 32.860% ####### ( 1, 2 ] 24293 59.934% 92.794% ############ ( 2, 3 ] 1673 4.128% 96.921% # ( 3, 4 ] 586 1.446% 98.367% ( 4, 6 ] 284 0.701% 99.067% ( 6, 10 ] 234 0.577% 99.645% ( 10, 15 ] 63 0.155% 99.800% ( 15, 22 ] 3 0.007% 99.808% ( 34, 51 ] 3 0.007% 99.815% ( 51, 76 ] 46 0.113% 99.928% ( 76, 110 ] 7 0.017% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 8 0.020% 99.968% ( 250, 380 ] 1 0.002% 99.970% ( 380, 580 ] 5 0.012% 99.983% ( 580, 870 ] 1 0.002% 99.985% ( 870, 1300 ] 1 0.002% 99.988% ( 1300, 1900 ] 3 0.007% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 230753 Average: 3.8032 StdDev: 72.16 Min: 1 Median: 1.5761 Max: 9978 Percentiles: P50: 1.58 P75: 1.98 P99: 9.08 P99.9: 217.40 P99.99: 749.95 ------------------------------------------------------ [ 0, 1 ] 32514 14.090% 14.090% ### ( 1, 2 ] 143844 62.337% 76.427% ############ ( 2, 3 ] 27809 12.051% 88.479% ## ( 3, 4 ] 12203 5.288% 93.767% # ( 4, 6 ] 8982 3.892% 97.659% # ( 6, 10 ] 4015 1.740% 99.399% ( 10, 15 ] 618 0.268% 99.667% ( 15, 22 ] 64 0.028% 99.695% ( 22, 34 ] 13 0.006% 99.701% ( 34, 51 ] 6 0.003% 99.703% ( 51, 76 ] 2 0.001% 99.704% ( 76, 110 ] 99 0.043% 99.747% ( 110, 170 ] 278 0.120% 99.867% ( 170, 250 ] 127 0.055% 99.922% ( 250, 380 ] 72 0.031% 99.954% ( 380, 580 ] 64 0.028% 99.981% ( 580, 870 ] 34 0.015% 99.996% ( 870, 1300 ] 13 0.006% 100.002% ( 1300, 1900 ] 8 0.003% 100.005% ( 1900, 2900 ] 6 0.003% 100.008% ( 2900, 4400 ] 5 0.002% 100.010% ( 4400, 6600 ] 4 0.002% 100.012% ( 6600, 9900 ] 11 0.005% 100.016% ( 9900, 14000 ] 1 0.000% 100.017% ** Level 4 read latency histogram (micros): Count: 30 Average: 3855.2000 StdDev: 3760.61 Min: 246 Median: 2900.0000 Max: 12495 Percentiles: P50: 2900.00 P75: 5814.29 P99: 12495.00 P99.9: 12495.00 P99.99: 12495.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 5 16.667% 20.000% ### ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 1 3.333% 40.000% # ( 1300, 1900 ] 2 6.667% 46.667% # ( 1900, 2900 ] 1 3.333% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 1 3.333% 86.667% # ( 9900, 14000 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 25.0 total, 9.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 236.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.792 H:M:S, 35.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 102.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.673 H:M:S, 69.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-05:55:20 ... thread 0: (1000000,7000000) ops and (187232.4,232258.6) ops/second in (5.340957,30.138820) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.82 GB 12.6 6.5 0.0 6.5 13.1 6.6 0.0 2.0 148.0 299.9 44.70 41.82 118 0.379 6715K 13K 0.0 0.0 L1 29/29 2.44 GB 0.0 5.0 3.7 1.3 4.9 3.6 0.1 1.3 221.7 219.0 22.98 21.70 3 7.660 5173K 61K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.2 1.8 233.6 233.5 0.48 0.45 1 0.476 113K 34 0.0 0.0 L3 14/0 997.05 MB 1.0 1.2 0.4 0.9 1.2 0.4 1.0 3.5 213.5 213.4 5.94 5.16 4 1.484 1263K 590 0.0 0.0 L4 174/0 9.67 GB 1.0 0.3 0.2 0.0 0.3 0.2 0.9 1.1 168.2 167.9 1.60 1.23 2 0.798 267K 444 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1285/40 102.71 GB 0.0 13.0 4.3 8.7 19.6 10.9 4.2 3.0 176.5 265.3 75.69 70.36 128 0.591 13M 75K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.0 4.3 8.7 19.6 10.9 4.2 3.0 176.5 265.3 75.69 70.36 128 0.591 13M 75K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.0 4.3 8.7 13.0 4.3 0.0 0.0 236.9 235.6 56.37 53.20 30 1.879 13M 75K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.2 19.32 17.16 98 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.3 total, 30.1 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.61 GB write, 661.77 MB/s write, 13.04 GB read, 440.09 MB/s read, 75.7 seconds Interval compaction: 19.61 GB write, 666.34 MB/s write, 13.04 GB read, 443.12 MB/s read, 75.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 19, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2766934 Average: 2.5643 StdDev: 13.90 Min: 0 Median: 1.5074 Max: 4083 Percentiles: P50: 1.51 P75: 1.88 P99: 6.17 P99.9: 127.69 P99.99: 231.43 ------------------------------------------------------ [ 0, 1 ] 443080 16.013% 16.013% ### ( 1, 2 ] 1853260 66.979% 82.992% ############# ( 2, 3 ] 284709 10.290% 93.282% ## ( 3, 4 ] 88870 3.212% 96.494% # ( 4, 6 ] 68480 2.475% 98.969% ( 6, 10 ] 20755 0.750% 99.719% ( 10, 15 ] 2391 0.086% 99.805% ( 15, 22 ] 285 0.010% 99.816% ( 22, 34 ] 35 0.001% 99.817% ( 34, 51 ] 17 0.001% 99.817% ( 51, 76 ] 26 0.001% 99.818% ( 76, 110 ] 1427 0.052% 99.870% ( 110, 170 ] 2829 0.102% 99.972% ( 170, 250 ] 645 0.023% 99.995% ( 250, 380 ] 409 0.015% 100.010% ( 380, 580 ] 345 0.012% 100.023% ( 580, 870 ] 156 0.006% 100.028% ( 870, 1300 ] 53 0.002% 100.030% ( 1300, 1900 ] 10 0.000% 100.031% ( 1900, 2900 ] 10 0.000% 100.031% ( 2900, 4400 ] 10 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 415304 Average: 2.9547 StdDev: 20.74 Min: 0 Median: 1.5454 Max: 3136 Percentiles: P50: 1.55 P75: 1.92 P99: 8.56 P99.9: 169.97 P99.99: 1015.22 ------------------------------------------------------ [ 0, 1 ] 57464 13.837% 13.837% ### ( 1, 2 ] 275368 66.305% 80.142% ############# ( 2, 3 ] 47837 11.519% 91.660% ## ( 3, 4 ] 14357 3.457% 95.117% # ( 4, 6 ] 12000 2.889% 98.007% # ( 6, 10 ] 6442 1.551% 99.558% ( 10, 15 ] 530 0.128% 99.686% ( 15, 22 ] 71 0.017% 99.703% ( 22, 34 ] 3 0.001% 99.703% ( 34, 51 ] 1 0.000% 99.704% ( 51, 76 ] 7 0.002% 99.705% ( 76, 110 ] 245 0.059% 99.764% ( 110, 170 ] 564 0.136% 99.900% ( 170, 250 ] 152 0.037% 99.937% ( 250, 380 ] 107 0.026% 99.962% ( 380, 580 ] 72 0.017% 99.980% ( 580, 870 ] 32 0.008% 99.987% ( 870, 1300 ] 31 0.007% 99.995% ( 1300, 1900 ] 11 0.003% 99.998% ( 1900, 2900 ] 8 0.002% 100.000% ( 2900, 4400 ] 2 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 40533 Average: 2.4175 StdDev: 45.17 Min: 0 Median: 1.2860 Max: 8165 Percentiles: P50: 1.29 P75: 1.70 P99: 5.81 P99.9: 69.73 P99.99: 1489.34 ------------------------------------------------------ [ 0, 1 ] 13319 32.860% 32.860% ####### ( 1, 2 ] 24293 59.934% 92.794% ############ ( 2, 3 ] 1673 4.128% 96.921% # ( 3, 4 ] 586 1.446% 98.367% ( 4, 6 ] 284 0.701% 99.067% ( 6, 10 ] 234 0.577% 99.645% ( 10, 15 ] 63 0.155% 99.800% ( 15, 22 ] 3 0.007% 99.808% ( 34, 51 ] 3 0.007% 99.815% ( 51, 76 ] 46 0.113% 99.928% ( 76, 110 ] 7 0.017% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 8 0.020% 99.968% ( 250, 380 ] 1 0.002% 99.970% ( 380, 580 ] 5 0.012% 99.983% ( 580, 870 ] 1 0.002% 99.985% ( 870, 1300 ] 1 0.002% 99.988% ( 1300, 1900 ] 3 0.007% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 266166 Average: 4.0628 StdDev: 68.92 Min: 1 Median: 1.6006 Max: 9978 Percentiles: P50: 1.60 P75: 2.02 P99: 9.37 P99.9: 317.79 P99.99: 847.06 ------------------------------------------------------ [ 0, 1 ] 34161 12.834% 12.834% ### ( 1, 2 ] 164695 61.877% 74.711% ############ ( 2, 3 ] 35809 13.454% 88.165% ### ( 3, 4 ] 14088 5.293% 93.458% # ( 4, 6 ] 10802 4.058% 97.516% # ( 6, 10 ] 4684 1.760% 99.276% ( 10, 15 ] 804 0.302% 99.578% ( 15, 22 ] 88 0.033% 99.611% ( 22, 34 ] 15 0.006% 99.617% ( 34, 51 ] 6 0.002% 99.619% ( 51, 76 ] 2 0.001% 99.620% ( 76, 110 ] 119 0.045% 99.664% ( 110, 170 ] 351 0.132% 99.796% ( 170, 250 ] 207 0.078% 99.874% ( 250, 380 ] 132 0.050% 99.924% ( 380, 580 ] 111 0.042% 99.965% ( 580, 870 ] 71 0.027% 99.992% ( 870, 1300 ] 24 0.009% 100.001% ( 1300, 1900 ] 8 0.003% 100.004% ( 1900, 2900 ] 8 0.003% 100.007% ( 2900, 4400 ] 5 0.002% 100.009% ( 4400, 6600 ] 4 0.002% 100.011% ( 6600, 9900 ] 11 0.004% 100.015% ( 9900, 14000 ] 1 0.000% 100.015% ** Level 4 read latency histogram (micros): Count: 175 Average: 675.4343 StdDev: 2126.20 Min: 0 Median: 1.7791 Max: 12495 Percentiles: P50: 1.78 P75: 15.25 P99: 12206.25 P99.9: 12495.00 P99.99: 12495.00 ------------------------------------------------------ [ 0, 1 ] 54 30.857% 30.857% ###### ( 1, 2 ] 43 24.571% 55.429% ##### ( 2, 3 ] 6 3.429% 58.857% # ( 3, 4 ] 9 5.143% 64.000% # ( 6, 10 ] 3 1.714% 65.714% ( 10, 15 ] 16 9.143% 74.857% ## ( 15, 22 ] 7 4.000% 78.857% # ( 34, 51 ] 1 0.571% 79.429% ( 170, 250 ] 4 2.286% 81.714% ( 250, 380 ] 1 0.571% 82.286% ( 380, 580 ] 6 3.429% 85.714% # ( 580, 870 ] 6 3.429% 89.143% # ( 870, 1300 ] 1 0.571% 89.714% ( 1300, 1900 ] 2 1.143% 90.857% ( 1900, 2900 ] 1 0.571% 91.429% ( 2900, 4400 ] 3 1.714% 93.143% ( 4400, 6600 ] 7 4.000% 97.143% # ( 6600, 9900 ] 1 0.571% 97.714% ( 9900, 14000 ] 4 2.286% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 1125.4833 StdDev: 1329.75 Min: 90 Median: 480.0000 Max: 4933 Percentiles: P50: 480.00 P75: 1700.00 P99: 4933.00 P99.9: 4933.00 P99.99: 4933.00 ------------------------------------------------------ ( 76, 110 ] 2 3.333% 3.333% # ( 110, 170 ] 5 8.333% 11.667% ## ( 170, 250 ] 13 21.667% 33.333% #### ( 250, 380 ] 6 10.000% 43.333% ## ( 380, 580 ] 8 13.333% 56.667% ### ( 580, 870 ] 6 10.000% 66.667% ## ( 870, 1300 ] 3 5.000% 71.667% # ( 1300, 1900 ] 3 5.000% 76.667% # ( 1900, 2900 ] 4 6.667% 83.333% # ( 2900, 4400 ] 8 13.333% 96.667% ### ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 30.3 total, 5.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 227.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.373 H:M:S, 37.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 184.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.581 H:M:S, 48.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-05:55:44 ... thread 0: (1000000,8000000) ops and (41890.0,148118.3) ops/second in (23.872061,54.010881) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 1.35 GB 18.9 7.2 0.0 7.2 14.8 7.6 0.0 1.9 142.8 293.9 51.61 47.38 135 0.382 7482K 13K 0.0 0.0 L1 9/9 1.08 GB 0.0 9.9 6.1 3.7 9.7 6.0 0.1 1.6 219.9 216.7 45.94 42.35 4 11.485 8637K 61K 0.0 0.0 L2 3/1 271.88 MB 1.8 0.1 0.1 0.0 0.1 0.1 5.0 1.8 233.6 233.5 0.48 0.45 1 0.476 113K 34 0.0 0.0 L3 42/9 3.80 GB 2.9 2.1 0.7 1.4 2.1 0.7 4.1 2.9 163.5 162.5 13.13 9.20 8 1.642 2156K 13K 0.0 0.0 L4 179/12 10.30 GB 1.0 0.9 0.9 0.1 0.9 0.9 0.9 1.1 118.6 118.3 8.09 4.49 7 1.156 839K 2072 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/39 103.59 GB 0.0 20.2 7.8 12.4 27.7 15.2 11.1 3.6 173.5 237.5 119.25 103.87 155 0.769 19M 90K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.2 7.8 12.4 27.7 15.2 11.1 3.6 173.5 237.5 119.25 103.87 155 0.769 19M 90K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.2 7.8 12.4 20.0 7.6 0.0 0.0 215.6 213.8 95.95 84.02 43 2.231 19M 90K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 335.3 23.30 19.85 112 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.2 total, 54.0 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.66 GB write, 522.42 MB/s write, 20.21 GB read, 381.62 MB/s read, 119.3 seconds Interval compaction: 27.66 GB write, 524.44 MB/s write, 20.21 GB read, 383.09 MB/s read, 119.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 22, pending-compaction-bytes-stops: 0, total-delays: 43, total-stops: 25, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3543916 Average: 2.9993 StdDev: 28.59 Min: 0 Median: 1.4943 Max: 12744 Percentiles: P50: 1.49 P75: 1.87 P99: 7.49 P99.9: 161.35 P99.99: 433.30 ------------------------------------------------------ [ 0, 1 ] 601859 16.983% 16.983% ### ( 1, 2 ] 2367263 66.798% 83.781% ############# ( 2, 3 ] 335731 9.473% 93.254% ## ( 3, 4 ] 108974 3.075% 96.329% # ( 4, 6 ] 83740 2.363% 98.692% ( 6, 10 ] 29203 0.824% 99.516% ( 10, 15 ] 3130 0.088% 99.605% ( 15, 22 ] 413 0.012% 99.616% ( 22, 34 ] 42 0.001% 99.617% ( 34, 51 ] 21 0.001% 99.618% ( 51, 76 ] 33 0.001% 99.619% ( 76, 110 ] 4559 0.129% 99.748% ( 110, 170 ] 6315 0.178% 99.926% ( 170, 250 ] 1186 0.033% 99.959% ( 250, 380 ] 865 0.024% 99.984% ( 380, 580 ] 854 0.024% 100.008% ( 580, 870 ] 365 0.010% 100.018% ( 870, 1300 ] 119 0.003% 100.021% ( 1300, 1900 ] 39 0.001% 100.022% ( 1900, 2900 ] 45 0.001% 100.024% ( 2900, 4400 ] 64 0.002% 100.026% ( 4400, 6600 ] 22 0.001% 100.026% ( 6600, 9900 ] 2 0.000% 100.026% ( 9900, 14000 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1531388 Average: 4.2160 StdDev: 63.59 Min: 0 Median: 1.5440 Max: 12759 Percentiles: P50: 1.54 P75: 1.98 P99: 9.39 P99.9: 151.97 P99.99: 283.36 ------------------------------------------------------ [ 0, 1 ] 288040 18.809% 18.809% #### ( 1, 2 ] 878112 57.341% 76.150% ########### ( 2, 3 ] 177085 11.564% 87.714% ## ( 3, 4 ] 73480 4.798% 92.512% # ( 4, 6 ] 75521 4.932% 97.443% # ( 6, 10 ] 28107 1.835% 99.279% ( 10, 15 ] 4186 0.273% 99.552% ( 15, 22 ] 551 0.036% 99.588% ( 22, 34 ] 32 0.002% 99.590% ( 34, 51 ] 25 0.002% 99.592% ( 51, 76 ] 20 0.001% 99.593% ( 76, 110 ] 2660 0.174% 99.767% ( 110, 170 ] 2913 0.190% 99.957% ( 170, 250 ] 401 0.026% 99.983% ( 250, 380 ] 397 0.026% 100.009% ( 380, 580 ] 418 0.027% 100.037% ( 580, 870 ] 352 0.023% 100.060% ( 870, 1300 ] 208 0.014% 100.073% ( 1300, 1900 ] 97 0.006% 100.079% ( 1900, 2900 ] 124 0.008% 100.088% ( 2900, 4400 ] 153 0.010% 100.098% ( 4400, 6600 ] 55 0.004% 100.101% ( 6600, 9900 ] 12 0.001% 100.102% ( 9900, 14000 ] 4 0.000% 100.102% ** Level 2 read latency histogram (micros): Count: 40533 Average: 2.4175 StdDev: 45.17 Min: 0 Median: 1.2860 Max: 8165 Percentiles: P50: 1.29 P75: 1.70 P99: 5.81 P99.9: 69.73 P99.99: 1489.34 ------------------------------------------------------ [ 0, 1 ] 13319 32.860% 32.860% ####### ( 1, 2 ] 24293 59.934% 92.794% ############ ( 2, 3 ] 1673 4.128% 96.921% # ( 3, 4 ] 586 1.446% 98.367% ( 4, 6 ] 284 0.701% 99.067% ( 6, 10 ] 234 0.577% 99.645% ( 10, 15 ] 63 0.155% 99.800% ( 15, 22 ] 3 0.007% 99.808% ( 34, 51 ] 3 0.007% 99.815% ( 51, 76 ] 46 0.113% 99.928% ( 76, 110 ] 7 0.017% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 8 0.020% 99.968% ( 250, 380 ] 1 0.002% 99.970% ( 380, 580 ] 5 0.012% 99.983% ( 580, 870 ] 1 0.002% 99.985% ( 870, 1300 ] 1 0.002% 99.988% ( 1300, 1900 ] 3 0.007% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 311673 Average: 5.6051 StdDev: 78.94 Min: 1 Median: 1.6533 Max: 9978 Percentiles: P50: 1.65 P75: 2.29 P99: 9.74 P99.9: 673.93 P99.99: 1261.27 ------------------------------------------------------ [ 0, 1 ] 34813 11.170% 11.170% ## ( 1, 2 ] 185258 59.440% 70.610% ############ ( 2, 3 ] 47530 15.250% 85.860% ### ( 3, 4 ] 19128 6.137% 91.997% # ( 4, 6 ] 16482 5.288% 97.285% # ( 6, 10 ] 5714 1.833% 99.118% ( 10, 15 ] 967 0.310% 99.429% ( 15, 22 ] 106 0.034% 99.463% ( 22, 34 ] 18 0.006% 99.468% ( 34, 51 ] 6 0.002% 99.470% ( 51, 76 ] 3 0.001% 99.471% ( 76, 110 ] 119 0.038% 99.509% ( 110, 170 ] 360 0.116% 99.625% ( 170, 250 ] 251 0.081% 99.705% ( 250, 380 ] 223 0.072% 99.777% ( 380, 580 ] 306 0.098% 99.875% ( 580, 870 ] 248 0.080% 99.955% ( 870, 1300 ] 124 0.040% 99.995% ( 1300, 1900 ] 50 0.016% 100.011% ( 1900, 2900 ] 25 0.008% 100.019% ( 2900, 4400 ] 21 0.007% 100.025% ( 4400, 6600 ] 6 0.002% 100.027% ( 6600, 9900 ] 11 0.004% 100.031% ( 9900, 14000 ] 1 0.000% 100.031% ** Level 4 read latency histogram (micros): Count: 9889 Average: 70.8500 StdDev: 427.85 Min: 0 Median: 1.9680 Max: 12495 Percentiles: P50: 1.97 P75: 3.35 P99: 1594.29 P99.9: 5084.42 P99.99: 10936.38 ------------------------------------------------------ [ 0, 1 ] 391 3.954% 3.954% # ( 1, 2 ] 4704 47.568% 51.522% ########## ( 2, 3 ] 1963 19.850% 71.372% #### ( 3, 4 ] 1013 10.244% 81.616% ## ( 4, 6 ] 830 8.393% 90.009% ## ( 6, 10 ] 245 2.478% 92.487% ( 10, 15 ] 79 0.799% 93.285% ( 15, 22 ] 18 0.182% 93.467% ( 22, 34 ] 3 0.030% 93.498% ( 34, 51 ] 6 0.061% 93.558% ( 51, 76 ] 1 0.010% 93.569% ( 110, 170 ] 15 0.152% 93.720% ( 170, 250 ] 44 0.445% 94.165% ( 250, 380 ] 94 0.951% 95.116% ( 380, 580 ] 125 1.264% 96.380% ( 580, 870 ] 139 1.406% 97.785% ( 870, 1300 ] 100 1.011% 98.797% ( 1300, 1900 ] 41 0.415% 99.211% ( 1900, 2900 ] 28 0.283% 99.494% ( 2900, 4400 ] 37 0.374% 99.869% ( 4400, 6600 ] 10 0.101% 99.970% ( 6600, 9900 ] 1 0.010% 99.980% ( 9900, 14000 ] 4 0.040% 100.020% ** Level 5 read latency histogram (micros): Count: 60 Average: 1125.4833 StdDev: 1329.75 Min: 90 Median: 480.0000 Max: 4933 Percentiles: P50: 480.00 P75: 1700.00 P99: 4933.00 P99.9: 4933.00 P99.99: 4933.00 ------------------------------------------------------ ( 76, 110 ] 2 3.333% 3.333% # ( 110, 170 ] 5 8.333% 11.667% ## ( 170, 250 ] 13 21.667% 33.333% #### ( 250, 380 ] 6 10.000% 43.333% ## ( 380, 580 ] 8 13.333% 56.667% ### ( 580, 870 ] 6 10.000% 66.667% ## ( 870, 1300 ] 3 5.000% 71.667% # ( 1300, 1900 ] 3 5.000% 76.667% # ( 1900, 2900 ] 4 6.667% 83.333% # ( 2900, 4400 ] 8 13.333% 96.667% ### ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 54.2 total, 23.9 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 145.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.205 H:M:S, 59.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 41.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:20.832 H:M:S, 87.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/18-05:55:49 ... thread 0: (1000000,9000000) ops and (190246.1,151854.6) ops/second in (5.256349,59.267230) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 2.27 GB 44.1 7.5 0.0 7.5 16.0 8.5 0.0 1.9 132.2 282.6 58.14 51.24 148 0.393 7802K 14K 0.0 0.0 L1 9/9 1.08 GB 0.0 9.9 6.1 3.7 9.7 6.0 0.1 1.6 219.9 216.7 45.94 42.35 4 11.485 8637K 61K 0.0 0.0 L2 1/0 90.43 MB 0.9 0.1 0.1 0.0 0.1 0.1 5.0 1.8 233.6 233.5 0.48 0.45 1 0.476 113K 34 0.0 0.0 L3 14/0 965.65 MB 1.0 2.5 0.9 1.6 2.5 0.9 4.1 2.8 158.2 156.9 16.35 11.25 10 1.635 2602K 20K 0.0 0.0 L4 164/0 9.68 GB 1.0 4.6 3.9 0.7 4.6 3.9 0.9 1.2 121.3 121.0 39.05 22.58 36 1.085 4408K 11K 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1307/25 104.50 GB 0.0 24.6 11.0 13.7 33.0 19.3 14.7 3.9 157.7 211.2 159.95 127.87 199 0.804 23M 107K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.6 11.0 13.7 33.0 19.3 14.7 3.9 157.7 211.2 159.95 127.87 199 0.804 23M 107K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.6 11.0 13.7 24.4 10.8 0.0 0.0 191.0 189.5 132.04 105.48 75 1.761 23M 107K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 313.8 27.91 22.39 124 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.5 total, 59.3 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.99 GB write, 568.02 MB/s write, 24.63 GB read, 424.06 MB/s read, 160.0 seconds Interval compaction: 32.99 GB write, 570.02 MB/s write, 24.63 GB read, 425.55 MB/s read, 160.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 28, pending-compaction-bytes-stops: 0, total-delays: 49, total-stops: 46, interval: 95 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3943894 Average: 3.2016 StdDev: 39.61 Min: 0 Median: 1.5203 Max: 18976 Percentiles: P50: 1.52 P75: 1.90 P99: 7.90 P99.9: 162.61 P99.99: 501.01 ------------------------------------------------------ [ 0, 1 ] 623425 15.807% 15.807% ### ( 1, 2 ] 2591612 65.712% 81.519% ############# ( 2, 3 ] 414622 10.513% 92.032% ## ( 3, 4 ] 138017 3.500% 95.532% # ( 4, 6 ] 118961 3.016% 98.548% # ( 6, 10 ] 37530 0.952% 99.500% ( 10, 15 ] 4922 0.125% 99.625% ( 15, 22 ] 555 0.014% 99.639% ( 22, 34 ] 57 0.001% 99.640% ( 34, 51 ] 27 0.001% 99.641% ( 51, 76 ] 34 0.001% 99.642% ( 76, 110 ] 4572 0.116% 99.758% ( 110, 170 ] 6407 0.162% 99.920% ( 170, 250 ] 1262 0.032% 99.952% ( 250, 380 ] 922 0.023% 99.975% ( 380, 580 ] 953 0.024% 100.000% ( 580, 870 ] 465 0.012% 100.011% ( 870, 1300 ] 219 0.006% 100.017% ( 1300, 1900 ] 107 0.003% 100.020% ( 1900, 2900 ] 103 0.003% 100.022% ( 2900, 4400 ] 113 0.003% 100.025% ( 4400, 6600 ] 35 0.001% 100.026% ( 6600, 9900 ] 13 0.000% 100.026% ( 9900, 14000 ] 2 0.000% 100.026% ( 14000, 22000 ] 2 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 2053204 Average: 5.9608 StdDev: 100.90 Min: 0 Median: 1.6496 Max: 24041 Percentiles: P50: 1.65 P75: 2.39 P99: 9.71 P99.9: 180.72 P99.99: 629.41 ------------------------------------------------------ [ 0, 1 ] 295552 14.395% 14.395% ### ( 1, 2 ] 1125383 54.811% 69.206% ########### ( 2, 3 ] 307819 14.992% 84.198% ### ( 3, 4 ] 125713 6.123% 90.321% # ( 4, 6 ] 138777 6.759% 97.080% # ( 6, 10 ] 42517 2.071% 99.150% ( 10, 15 ] 8522 0.415% 99.566% ( 15, 22 ] 1013 0.049% 99.615% ( 22, 34 ] 66 0.003% 99.618% ( 34, 51 ] 36 0.002% 99.620% ( 51, 76 ] 38 0.002% 99.622% ( 76, 110 ] 2669 0.130% 99.752% ( 110, 170 ] 2980 0.145% 99.897% ( 170, 250 ] 491 0.024% 99.921% ( 250, 380 ] 575 0.028% 99.949% ( 380, 580 ] 717 0.035% 99.984% ( 580, 870 ] 767 0.037% 100.021% ( 870, 1300 ] 519 0.025% 100.046% ( 1300, 1900 ] 345 0.017% 100.063% ( 1900, 2900 ] 421 0.021% 100.084% ( 2900, 4400 ] 496 0.024% 100.108% ( 4400, 6600 ] 168 0.008% 100.116% ( 6600, 9900 ] 47 0.002% 100.118% ( 9900, 14000 ] 9 0.000% 100.119% ( 14000, 22000 ] 3 0.000% 100.119% ( 22000, 33000 ] 1 0.000% 100.119% ** Level 2 read latency histogram (micros): Count: 40533 Average: 2.4175 StdDev: 45.17 Min: 0 Median: 1.2860 Max: 8165 Percentiles: P50: 1.29 P75: 1.70 P99: 5.81 P99.9: 69.73 P99.99: 1489.34 ------------------------------------------------------ [ 0, 1 ] 13319 32.860% 32.860% ####### ( 1, 2 ] 24293 59.934% 92.794% ############ ( 2, 3 ] 1673 4.128% 96.921% # ( 3, 4 ] 586 1.446% 98.367% ( 4, 6 ] 284 0.701% 99.067% ( 6, 10 ] 234 0.577% 99.645% ( 10, 15 ] 63 0.155% 99.800% ( 15, 22 ] 3 0.007% 99.808% ( 34, 51 ] 3 0.007% 99.815% ( 51, 76 ] 46 0.113% 99.928% ( 76, 110 ] 7 0.017% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 8 0.020% 99.968% ( 250, 380 ] 1 0.002% 99.970% ( 380, 580 ] 5 0.012% 99.983% ( 580, 870 ] 1 0.002% 99.985% ( 870, 1300 ] 1 0.002% 99.988% ( 1300, 1900 ] 3 0.007% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 592985 Average: 8.2438 StdDev: 120.14 Min: 1 Median: 1.8085 Max: 23498 Percentiles: P50: 1.81 P75: 2.74 P99: 9.84 P99.9: 991.33 P99.99: 2028.25 ------------------------------------------------------ [ 0, 1 ] 38985 6.574% 6.574% # ( 1, 2 ] 318507 53.712% 60.287% ########### ( 2, 3 ] 117616 19.835% 80.121% #### ( 3, 4 ] 49524 8.352% 88.473% ## ( 4, 6 ] 51249 8.643% 97.116% ## ( 6, 10 ] 11632 1.962% 99.077% ( 10, 15 ] 2273 0.383% 99.461% ( 15, 22 ] 260 0.044% 99.504% ( 22, 34 ] 27 0.005% 99.509% ( 34, 51 ] 8 0.001% 99.510% ( 51, 76 ] 7 0.001% 99.511% ( 76, 110 ] 124 0.021% 99.532% ( 110, 170 ] 372 0.063% 99.595% ( 170, 250 ] 282 0.048% 99.643% ( 250, 380 ] 340 0.057% 99.700% ( 380, 580 ] 505 0.085% 99.785% ( 580, 870 ] 569 0.096% 99.881% ( 870, 1300 ] 397 0.067% 99.948% ( 1300, 1900 ] 221 0.037% 99.985% ( 1900, 2900 ] 216 0.036% 100.022% ( 2900, 4400 ] 194 0.033% 100.054% ( 4400, 6600 ] 41 0.007% 100.061% ( 6600, 9900 ] 22 0.004% 100.065% ( 9900, 14000 ] 2 0.000% 100.065% ( 14000, 22000 ] 1 0.000% 100.066% ( 22000, 33000 ] 1 0.000% 100.066% ** Level 4 read latency histogram (micros): Count: 153390 Average: 17.8162 StdDev: 204.92 Min: 0 Median: 1.9860 Max: 21160 Percentiles: P50: 1.99 P75: 3.02 P99: 260.26 P99.9: 1995.17 P99.99: 3003.93 ------------------------------------------------------ [ 0, 1 ] 2684 1.750% 1.750% ( 1, 2 ] 75064 48.937% 50.686% ########## ( 2, 3 ] 37049 24.153% 74.840% ##### ( 3, 4 ] 15550 10.138% 84.978% ## ( 4, 6 ] 16579 10.808% 95.786% ## ( 6, 10 ] 3683 2.401% 98.187% ( 10, 15 ] 853 0.556% 98.743% ( 15, 22 ] 107 0.070% 98.813% ( 22, 34 ] 17 0.011% 98.824% ( 34, 51 ] 9 0.006% 98.830% ( 51, 76 ] 4 0.003% 98.832% ( 76, 110 ] 25 0.016% 98.849% ( 110, 170 ] 67 0.044% 98.892% ( 170, 250 ] 149 0.097% 98.990% ( 250, 380 ] 204 0.133% 99.122% ( 380, 580 ] 307 0.200% 99.323% ( 580, 870 ] 389 0.254% 99.576% ( 870, 1300 ] 307 0.200% 99.776% ( 1300, 1900 ] 176 0.115% 99.891% ( 1900, 2900 ] 143 0.093% 99.984% ( 2900, 4400 ] 125 0.081% 100.066% ( 4400, 6600 ] 45 0.029% 100.095% ( 6600, 9900 ] 6 0.004% 100.099% ( 9900, 14000 ] 5 0.003% 100.102% ( 14000, 22000 ] 2 0.001% 100.104% ** Level 5 read latency histogram (micros): Count: 280 Average: 1807.1071 StdDev: 1892.90 Min: 81 Median: 944.1379 Max: 9219 Percentiles: P50: 944.14 P75: 3009.76 P99: 8360.00 P99.9: 9219.00 P99.99: 9219.00 ------------------------------------------------------ ( 76, 110 ] 5 1.786% 1.786% ( 110, 170 ] 22 7.857% 9.643% ## ( 170, 250 ] 18 6.429% 16.071% # ( 250, 380 ] 18 6.429% 22.500% # ( 380, 580 ] 35 12.500% 35.000% ### ( 580, 870 ] 37 13.214% 48.214% ### ( 870, 1300 ] 29 10.357% 58.571% ## ( 1300, 1900 ] 19 6.786% 65.357% # ( 1900, 2900 ] 24 8.571% 73.929% ## ( 2900, 4400 ] 41 14.643% 88.571% ### ( 4400, 6600 ] 26 9.286% 97.857% ## ( 6600, 9900 ] 6 2.143% 100.000% ** DB Stats ** Uptime(secs): 59.5 total, 5.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 148.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:34.622 H:M:S, 58.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 187.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.417 H:M:S, 46.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.515 micros/op 153484 ops/sec 60.038 seconds 9214999 operations; 148.7 MB/s Microseconds per write: Count: 9214999 Average: 6.5153 StdDev: 439.26 Min: 0 Median: 1.7317 Max: 737407 Percentiles: P50: 1.73 P75: 2.74 P99: 9.13 P99.9: 1254.89 P99.99: 2793.83 ------------------------------------------------------ [ 0, 1 ] 1287034 13.967% 13.967% ### ( 1, 2 ] 4537880 49.244% 63.211% ########## ( 2, 3 ] 1470960 15.963% 79.174% ### ( 3, 4 ] 1258247 13.654% 92.828% ### ( 4, 6 ] 487446 5.290% 98.118% # ( 6, 10 ] 103764 1.126% 99.244% ( 10, 15 ] 30970 0.336% 99.580% ( 15, 22 ] 7258 0.079% 99.659% ( 22, 34 ] 1372 0.015% 99.674% ( 34, 51 ] 249 0.003% 99.676% ( 51, 76 ] 45 0.000% 99.677% ( 76, 110 ] 6541 0.071% 99.748% ( 110, 170 ] 2426 0.026% 99.774% ( 170, 250 ] 268 0.003% 99.777% ( 250, 380 ] 145 0.002% 99.779% ( 380, 580 ] 24 0.000% 99.779% ( 580, 870 ] 11 0.000% 99.779% ( 870, 1300 ] 12450 0.135% 99.914% ( 1300, 1900 ] 46 0.000% 99.915% ( 1900, 2900 ] 7766 0.084% 99.999% ( 2900, 4400 ] 54 0.001% 100.000% ( 4400, 6600 ] 14 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 203706 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9214999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9509878968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 549 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34819549 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28548942141 rocksdb.compact.write.bytes COUNT : 28341967609 rocksdb.flush.write.bytes COUNT : 9446115817 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 66 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 221 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9369961472 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3648512 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28644689779 rocksdb.non.last.level.read.count COUNT : 6918151 rocksdb.block.checksum.compute.count COUNT : 6917119 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.382082 P95 : 3.899752 P99 : 7.666341 P100 : 737404.000000 COUNT : 9214999 SUM : 55789392 rocksdb.compaction.times.micros P50 : 1185833.333333 P95 : 4520000.000000 P99 : 22960832.000000 P100 : 22960832.000000 COUNT : 76 SUM : 133549573 rocksdb.compaction.times.cpu_micros P50 : 918285.714286 P95 : 4520000.000000 P99 : 18960000.000000 P100 : 20657014.000000 COUNT : 76 SUM : 106947626 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 686.044776 P95 : 3875.000000 P99 : 100550.000000 P100 : 144830.000000 COUNT : 127 SUM : 407698 rocksdb.compaction.outfile.sync.micros P50 : 1031.948052 P95 : 143176.470588 P99 : 283280.000000 P100 : 304353.000000 COUNT : 372 SUM : 7373487 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.567568 P95 : 1750.000000 P99 : 4287.500000 P100 : 5278.000000 COUNT : 230 SUM : 86612 rocksdb.table.open.io.micros P50 : 1477.631579 P95 : 12685.588235 P99 : 20951.578947 P100 : 23444.000000 COUNT : 549 SUM : 1560738 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.617609 P95 : 7.925149 P99 : 12.598616 P100 : 24061.000000 COUNT : 6916303 SUM : 47042334 rocksdb.read.block.get.micros P50 : 497.293233 P95 : 4753.157895 P99 : 8803.666667 P100 : 12628.000000 COUNT : 1098 SUM : 1246215 rocksdb.write.raw.block.micros P50 : 0.514315 P95 : 0.977198 P99 : 2.949645 P100 : 35575.000000 COUNT : 9154265 SUM : 19660935 rocksdb.numfiles.in.singlecompaction P50 : 3.276316 P95 : 5.733333 P99 : 30.640000 P100 : 36.000000 COUNT : 128 SUM : 544 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566680 P95 : 1271.808119 P99 : 2685.050310 P100 : 737196.000000 COUNT : 173429 SUM : 34835627 rocksdb.sst.read.micros P50 : 1.586715 P95 : 4.813444 P99 : 9.217226 P100 : 24041.000000 COUNT : 6919507 SUM : 33521049 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9214999 SUM : 9509878968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212696.629213 P95 : 458375.000000 P99 : 984100.000000 P100 : 995400.000000 COUNT : 127 SUM : 28634378 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 341 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0