[2024-12-16 17:52:11.127200] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-16 17:52:11.127479] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid954238 ] Set seed to 1734367931120556 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-16 17:52:11.238608] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-16 17:52:11.278549] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-16 17:52:11.278595] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 954238' to capture a snapshot of events at runtime. [2024-12-16 17:52:11.278608] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid954238 for offline analysis/debug. [2024-12-16 17:52:11.278631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 16 17:52:15 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/16-17:52:18 ... thread 0: (1000000,1000000) ops and (358705.5,358705.5) ops/second in (2.787802,2.787802) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.02 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 354.5 2.31 2.10 12 0.193 0 0 0.0 0.0 L2 3/2 251.76 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 250.6 250.5 1.51 1.45 2 0.754 383K 207 0.0 0.0 L3 10/0 804.39 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 99.0 313.4 3.82 3.55 14 0.273 383K 207 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 99.0 313.4 3.82 3.55 14 0.273 383K 207 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 250.6 250.5 1.51 1.45 2 0.754 383K 207 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 354.5 2.31 2.10 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 395.48 MB/s write, 0.37 GB read, 124.90 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 428.90 MB/s write, 0.37 GB read, 135.45 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 101666 Average: 1.8667 StdDev: 20.42 Min: 0 Median: 1.1560 Max: 3256 Percentiles: P50: 1.16 P75: 1.63 P99: 3.80 P99.9: 9.39 P99.99: 311.39 ------------------------------------------------------ [ 0, 1 ] 42392 41.697% 41.697% ######## ( 1, 2 ] 54106 53.219% 94.917% ########### ( 2, 3 ] 3227 3.174% 98.091% # ( 3, 4 ] 1149 1.130% 99.221% ( 4, 6 ] 487 0.479% 99.700% ( 6, 10 ] 240 0.236% 99.936% ( 10, 15 ] 32 0.031% 99.968% ( 15, 22 ] 4 0.004% 99.971% ( 22, 34 ] 2 0.002% 99.973% ( 34, 51 ] 3 0.003% 99.976% ( 110, 170 ] 8 0.008% 99.984% ( 170, 250 ] 3 0.003% 99.987% ( 250, 380 ] 6 0.006% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 1 0.001% 99.995% ( 1900, 2900 ] 2 0.002% 99.997% ( 2900, 4400 ] 3 0.003% 100.000% ** Level 1 read latency histogram (micros): Count: 5 Average: 1138.6000 StdDev: 726.91 Min: 172 Median: 1400.0000 Max: 1772 Percentiles: P50: 1400.00 P75: 1650.00 P99: 1772.00 P99.9: 1772.00 P99.99: 1772.00 ------------------------------------------------------ ( 170, 250 ] 1 20.000% 20.000% #### ( 250, 380 ] 1 20.000% 40.000% #### ( 1300, 1900 ] 3 60.000% 100.000% ############ ** Level 2 read latency histogram (micros): Count: 50002 Average: 1.9204 StdDev: 15.16 Min: 0 Median: 1.1985 Max: 2084 Percentiles: P50: 1.20 P75: 1.66 P99: 4.93 P99.9: 9.79 P99.99: 579.98 ------------------------------------------------------ [ 0, 1 ] 19661 39.320% 39.320% ######## ( 1, 2 ] 26905 53.808% 93.128% ########### ( 2, 3 ] 1712 3.424% 96.552% # ( 3, 4 ] 1009 2.018% 98.570% ( 4, 6 ] 462 0.924% 99.494% ( 6, 10 ] 214 0.428% 99.922% ( 10, 15 ] 18 0.036% 99.958% ( 15, 22 ] 6 0.012% 99.970% ( 22, 34 ] 2 0.004% 99.974% ( 51, 76 ] 2 0.004% 99.978% ( 110, 170 ] 1 0.002% 99.980% ( 170, 250 ] 2 0.004% 99.984% ( 250, 380 ] 1 0.002% 99.986% ( 380, 580 ] 2 0.004% 99.990% ( 580, 870 ] 1 0.002% 99.992% ( 870, 1300 ] 1 0.002% 99.994% ( 1300, 1900 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 40 Average: 1614.1000 StdDev: 1194.17 Min: 203 Median: 1300.0000 Max: 4893 Percentiles: P50: 1300.00 P75: 2471.43 P99: 4893.00 P99.9: 4893.00 P99.99: 4893.00 ------------------------------------------------------ ( 170, 250 ] 3 7.500% 7.500% ## ( 250, 380 ] 1 2.500% 10.000% # ( 380, 580 ] 4 10.000% 20.000% ## ( 580, 870 ] 9 22.500% 42.500% ##### ( 870, 1300 ] 3 7.500% 50.000% ## ( 1300, 1900 ] 6 15.000% 65.000% ### ( 1900, 2900 ] 7 17.500% 82.500% #### ( 2900, 4400 ] 6 15.000% 97.500% ### ( 4400, 6600 ] 1 2.500% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1850.5333 StdDev: 1550.24 Min: 216 Median: 1300.0000 Max: 5933 Percentiles: P50: 1300.00 P75: 2733.33 P99: 5933.00 P99.9: 5933.00 P99.99: 5933.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 2 6.667% 10.000% # ( 380, 580 ] 3 10.000% 20.000% ## ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 5 16.667% 66.667% ### ( 1900, 2900 ] 3 10.000% 76.667% ## ( 2900, 4400 ] 5 16.667% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 325.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.211 H:M:S, 7.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 352.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.211 H:M:S, 7.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-17:52:21 ... thread 0: (1000000,2000000) ops and (323232.3,340046.3) ops/second in (3.093750,5.881552) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.17 GB 12.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.8 319.1 8.29 7.70 29 0.286 831K 853 0.0 0.0 L1 1/1 3.13 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 238.4 238.0 1.59 1.54 1 1.586 383K 599 0.0 0.0 L2 2/1 54.79 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.6 250.5 1.51 1.45 2 0.754 383K 207 0.0 0.0 L3 20/10 1.12 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 228.2 228.2 1.09 1.02 1 1.094 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 156.1 156.2 1.44 1.08 1 1.440 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/18 97.92 GB 0.0 2.0 1.0 1.0 3.8 2.8 1.1 2.1 147.3 278.4 13.92 12.79 34 0.409 2081K 1659 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 1.0 1.0 3.8 2.8 1.1 2.1 147.3 278.4 13.92 12.79 34 0.409 2081K 1659 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 1.0 1.0 2.0 1.0 0.0 0.0 234.7 234.5 8.73 8.14 8 1.092 2081K 1659 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.6 5.18 4.65 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.78 GB write, 633.16 MB/s write, 2.00 GB read, 334.90 MB/s read, 13.9 seconds Interval compaction: 3.78 GB write, 658.54 MB/s write, 2.00 GB read, 348.32 MB/s read, 13.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 386047 Average: 2.1602 StdDev: 14.71 Min: 0 Median: 1.4326 Max: 3256 Percentiles: P50: 1.43 P75: 1.84 P99: 5.60 P99.9: 9.69 P99.99: 15.09 ------------------------------------------------------ [ 0, 1 ] 90402 23.417% 23.417% ##### ( 1, 2 ] 237201 61.444% 84.861% ############ ( 2, 3 ] 31406 8.135% 92.996% ## ( 3, 4 ] 15571 4.033% 97.030% # ( 4, 6 ] 9518 2.466% 99.495% ( 6, 10 ] 1694 0.439% 99.934% ( 10, 15 ] 217 0.056% 99.990% ( 15, 22 ] 32 0.008% 99.998% ( 22, 34 ] 9 0.002% 100.001% ( 34, 51 ] 5 0.001% 100.002% ( 51, 76 ] 2 0.001% 100.003% ( 110, 170 ] 13 0.003% 100.006% ( 170, 250 ] 10 0.003% 100.009% ( 250, 380 ] 12 0.003% 100.012% ( 580, 870 ] 5 0.001% 100.013% ( 870, 1300 ] 3 0.001% 100.014% ( 1300, 1900 ] 5 0.001% 100.015% ( 1900, 2900 ] 7 0.002% 100.017% ( 2900, 4400 ] 3 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 31 Average: 315.9355 StdDev: 567.19 Min: 1 Median: 2.6250 Max: 1772 Percentiles: P50: 2.62 P75: 331.25 P99: 1772.00 P99.9: 1772.00 P99.99: 1772.00 ------------------------------------------------------ [ 0, 1 ] 7 22.581% 22.581% ##### ( 1, 2 ] 6 19.355% 41.935% #### ( 2, 3 ] 4 12.903% 54.839% ### ( 4, 6 ] 1 3.226% 58.065% # ( 34, 51 ] 1 3.226% 61.290% # ( 110, 170 ] 1 3.226% 64.516% # ( 170, 250 ] 2 6.452% 70.968% # ( 250, 380 ] 2 6.452% 77.419% # ( 380, 580 ] 2 6.452% 83.871% # ( 580, 870 ] 1 3.226% 87.097% # ( 1300, 1900 ] 4 12.903% 100.000% ### ** Level 2 read latency histogram (micros): Count: 95726 Average: 2.0123 StdDev: 10.98 Min: 0 Median: 1.3443 Max: 2084 Percentiles: P50: 1.34 P75: 1.77 P99: 5.45 P99.9: 9.66 P99.99: 187.10 ------------------------------------------------------ [ 0, 1 ] 28658 29.938% 29.938% ###### ( 1, 2 ] 55775 58.265% 88.203% ############ ( 2, 3 ] 5723 5.979% 94.181% # ( 3, 4 ] 3346 3.495% 97.677% # ( 4, 6 ] 1749 1.827% 99.504% ( 6, 10 ] 415 0.434% 99.937% ( 10, 15 ] 39 0.041% 99.978% ( 15, 22 ] 6 0.006% 99.984% ( 22, 34 ] 2 0.002% 99.986% ( 51, 76 ] 2 0.002% 99.989% ( 110, 170 ] 1 0.001% 99.990% ( 170, 250 ] 2 0.002% 99.992% ( 250, 380 ] 1 0.001% 99.993% ( 380, 580 ] 2 0.002% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 2 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 184937 Average: 3.2267 StdDev: 33.92 Min: 1 Median: 1.5742 Max: 4893 Percentiles: P50: 1.57 P75: 1.99 P99: 8.78 P99.9: 152.06 P99.99: 427.26 ------------------------------------------------------ [ 0, 1 ] 29161 15.768% 15.768% ### ( 1, 2 ] 110255 59.618% 75.386% ############ ( 2, 3 ] 24241 13.108% 88.493% ### ( 3, 4 ] 9920 5.364% 93.857% # ( 4, 6 ] 7532 4.073% 97.930% # ( 6, 10 ] 2848 1.540% 99.470% ( 10, 15 ] 460 0.249% 99.719% ( 15, 22 ] 94 0.051% 99.770% ( 22, 34 ] 34 0.018% 99.788% ( 34, 51 ] 7 0.004% 99.792% ( 76, 110 ] 90 0.049% 99.840% ( 110, 170 ] 157 0.085% 99.925% ( 170, 250 ] 61 0.033% 99.958% ( 250, 380 ] 50 0.027% 99.985% ( 380, 580 ] 36 0.019% 100.005% ( 580, 870 ] 24 0.013% 100.018% ( 870, 1300 ] 11 0.006% 100.024% ( 1300, 1900 ] 9 0.005% 100.029% ( 1900, 2900 ] 9 0.005% 100.034% ( 2900, 4400 ] 6 0.003% 100.037% ( 4400, 6600 ] 1 0.001% 100.037% ** Level 4 read latency histogram (micros): Count: 320 Average: 177.4625 StdDev: 717.56 Min: 0 Median: 2.0943 Max: 5933 Percentiles: P50: 2.09 P75: 5.57 P99: 4040.00 P99.9: 5933.00 P99.99: 5933.00 ------------------------------------------------------ [ 0, 1 ] 51 15.938% 15.938% ### ( 1, 2 ] 104 32.500% 48.438% ####### ( 2, 3 ] 53 16.562% 65.000% ### ( 3, 4 ] 21 6.562% 71.562% # ( 4, 6 ] 14 4.375% 75.938% # ( 6, 10 ] 3 0.938% 76.875% ( 10, 15 ] 26 8.125% 85.000% ## ( 15, 22 ] 17 5.312% 90.312% # ( 22, 34 ] 1 0.312% 90.625% ( 170, 250 ] 1 0.312% 90.938% ( 250, 380 ] 2 0.625% 91.562% ( 380, 580 ] 3 0.938% 92.500% ( 580, 870 ] 6 1.875% 94.375% ( 870, 1300 ] 3 0.938% 95.312% ( 1300, 1900 ] 5 1.562% 96.875% ( 1900, 2900 ] 3 0.938% 97.812% ( 2900, 4400 ] 5 1.562% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.617 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.406 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-17:52:24 ... thread 0: (1000000,3000000) ops and (324840.8,334822.1) ops/second in (3.078431,8.959983) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 2.15 GB 81.8 1.6 0.0 1.6 4.4 2.8 0.0 1.6 115.5 315.2 14.19 13.23 46 0.308 1663K 1730 0.0 0.0 L1 1/1 3.13 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 238.4 238.0 1.59 1.54 1 1.586 383K 599 0.0 0.0 L2 1/0 52.75 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.6 250.5 1.51 1.45 2 0.754 383K 207 0.0 0.0 L3 19/0 893.21 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 239.3 238.8 4.41 4.05 2 2.207 1072K 2075 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 156.1 156.2 1.44 1.08 1 1.440 228K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/11 98.90 GB 0.0 3.6 1.0 2.6 6.4 3.8 1.7 2.3 158.8 281.2 23.13 21.36 52 0.445 3731K 4611 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 1.0 2.6 6.4 3.8 1.7 2.3 158.8 281.2 23.13 21.36 52 0.445 3731K 4611 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 1.0 2.6 3.6 1.0 0.0 0.0 242.4 242.1 15.16 14.22 12 1.263 3731K 4611 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 355.5 7.97 7.14 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.35 GB write, 707.22 MB/s write, 3.59 GB read, 399.53 MB/s read, 23.1 seconds Interval compaction: 6.35 GB write, 725.83 MB/s write, 3.59 GB read, 410.04 MB/s read, 23.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 789818 Average: 2.1844 StdDev: 11.67 Min: 0 Median: 1.4700 Max: 3256 Percentiles: P50: 1.47 P75: 1.86 P99: 5.57 P99.9: 9.60 P99.99: 14.11 ------------------------------------------------------ [ 0, 1 ] 156480 19.812% 19.812% #### ( 1, 2 ] 507276 64.227% 84.039% ############# ( 2, 3 ] 69774 8.834% 92.873% ## ( 3, 4 ] 32989 4.177% 97.050% # ( 4, 6 ] 19648 2.488% 99.538% ( 6, 10 ] 3179 0.402% 99.940% ( 10, 15 ] 480 0.061% 100.001% ( 15, 22 ] 49 0.006% 100.007% ( 22, 34 ] 16 0.002% 100.009% ( 34, 51 ] 9 0.001% 100.010% ( 51, 76 ] 8 0.001% 100.011% ( 76, 110 ] 13 0.002% 100.013% ( 110, 170 ] 33 0.004% 100.017% ( 170, 250 ] 33 0.004% 100.021% ( 250, 380 ] 26 0.003% 100.025% ( 380, 580 ] 8 0.001% 100.026% ( 580, 870 ] 16 0.002% 100.028% ( 870, 1300 ] 5 0.001% 100.028% ( 1300, 1900 ] 8 0.001% 100.029% ( 1900, 2900 ] 8 0.001% 100.030% ( 2900, 4400 ] 3 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 12342 Average: 4.2846 StdDev: 38.67 Min: 1 Median: 1.5535 Max: 1772 Percentiles: P50: 1.55 P75: 1.97 P99: 9.37 P99.9: 505.73 P99.99: 1714.87 ------------------------------------------------------ [ 0, 1 ] 2057 16.667% 16.667% ### ( 1, 2 ] 7433 60.225% 76.892% ############ ( 2, 3 ] 1333 10.801% 87.692% ## ( 3, 4 ] 786 6.368% 94.061% # ( 4, 6 ] 414 3.354% 97.415% # ( 6, 10 ] 232 1.880% 99.295% ( 10, 15 ] 9 0.073% 99.368% ( 15, 22 ] 1 0.008% 99.376% ( 34, 51 ] 1 0.008% 99.384% ( 76, 110 ] 5 0.041% 99.425% ( 110, 170 ] 35 0.284% 99.708% ( 170, 250 ] 10 0.081% 99.789% ( 250, 380 ] 8 0.065% 99.854% ( 380, 580 ] 9 0.073% 99.927% ( 580, 870 ] 4 0.032% 99.959% ( 870, 1300 ] 1 0.008% 99.968% ( 1300, 1900 ] 4 0.032% 100.000% ** Level 2 read latency histogram (micros): Count: 111915 Average: 2.2014 StdDev: 12.63 Min: 0 Median: 1.3754 Max: 2084 Percentiles: P50: 1.38 P75: 1.80 P99: 5.77 P99.9: 13.29 P99.99: 531.30 ------------------------------------------------------ [ 0, 1 ] 31208 27.885% 27.885% ###### ( 1, 2 ] 65923 58.905% 86.790% ############ ( 2, 3 ] 7469 6.674% 93.464% # ( 3, 4 ] 4202 3.755% 97.218% # ( 4, 6 ] 2257 2.017% 99.235% ( 6, 10 ] 698 0.624% 99.859% ( 10, 15 ] 70 0.063% 99.921% ( 15, 22 ] 9 0.008% 99.929% ( 22, 34 ] 2 0.002% 99.931% ( 51, 76 ] 2 0.002% 99.933% ( 110, 170 ] 28 0.025% 99.958% ( 170, 250 ] 13 0.012% 99.970% ( 250, 380 ] 16 0.014% 99.984% ( 380, 580 ] 9 0.008% 99.992% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233064 Average: 3.1735 StdDev: 31.30 Min: 0 Median: 1.5547 Max: 4893 Percentiles: P50: 1.55 P75: 1.97 P99: 8.77 P99.9: 163.49 P99.99: 490.77 ------------------------------------------------------ [ 0, 1 ] 38446 16.496% 16.496% ### ( 1, 2 ] 140759 60.395% 76.891% ############ ( 2, 3 ] 28057 12.038% 88.929% ## ( 3, 4 ] 12290 5.273% 94.202% # ( 4, 6 ] 8666 3.718% 97.921% # ( 6, 10 ] 3636 1.560% 99.481% ( 10, 15 ] 517 0.222% 99.703% ( 15, 22 ] 96 0.041% 99.744% ( 22, 34 ] 35 0.015% 99.759% ( 34, 51 ] 7 0.003% 99.762% ( 51, 76 ] 1 0.000% 99.762% ( 76, 110 ] 115 0.049% 99.812% ( 110, 170 ] 231 0.099% 99.911% ( 170, 250 ] 93 0.040% 99.951% ( 250, 380 ] 64 0.027% 99.978% ( 380, 580 ] 50 0.021% 100.000% ( 580, 870 ] 30 0.013% 100.012% ( 870, 1300 ] 14 0.006% 100.018% ( 1300, 1900 ] 10 0.004% 100.023% ( 1900, 2900 ] 9 0.004% 100.027% ( 2900, 4400 ] 6 0.003% 100.029% ( 4400, 6600 ] 1 0.000% 100.030% ** Level 4 read latency histogram (micros): Count: 320 Average: 177.4625 StdDev: 717.56 Min: 0 Median: 2.0943 Max: 5933 Percentiles: P50: 2.09 P75: 5.57 P99: 4040.00 P99.9: 5933.00 P99.99: 5933.00 ------------------------------------------------------ [ 0, 1 ] 51 15.938% 15.938% ### ( 1, 2 ] 104 32.500% 48.438% ####### ( 2, 3 ] 53 16.562% 65.000% ### ( 3, 4 ] 21 6.562% 71.562% # ( 4, 6 ] 14 4.375% 75.938% # ( 6, 10 ] 3 0.938% 76.875% ( 10, 15 ] 26 8.125% 85.000% ## ( 15, 22 ] 17 5.312% 90.312% # ( 22, 34 ] 1 0.312% 90.625% ( 170, 250 ] 1 0.312% 90.938% ( 250, 380 ] 2 0.625% 91.562% ( 380, 580 ] 3 0.938% 92.500% ( 580, 870 ] 6 1.875% 94.375% ( 870, 1300 ] 3 0.938% 95.312% ( 1300, 1900 ] 5 1.562% 96.875% ( 1900, 2900 ] 3 0.938% 97.812% ( 2900, 4400 ] 5 1.562% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 870.6000 StdDev: 980.19 Min: 115 Median: 446.6667 Max: 2997 Percentiles: P50: 446.67 P75: 870.00 P99: 2997.00 P99.9: 2997.00 P99.99: 2997.00 ------------------------------------------------------ ( 110, 170 ] 5 25.000% 25.000% ##### ( 170, 250 ] 3 15.000% 40.000% ### ( 250, 380 ] 1 5.000% 45.000% # ( 380, 580 ] 3 15.000% 60.000% ### ( 580, 870 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 320.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.041 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.423 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-17:52:27 ... thread 0: (1000000,4000000) ops and (337458.8,335477.4) ops/second in (2.963325,11.923308) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.09 GB 188.8 2.5 0.0 2.5 6.2 3.7 0.0 1.7 124.3 313.7 20.27 18.95 63 0.322 2558K 2714 0.0 0.0 L1 9/0 1.04 GB 106.8 1.4 1.4 0.0 1.4 1.4 0.2 1.0 233.5 232.7 6.21 6.00 2 3.107 1473K 5269 0.0 0.0 L2 1/0 52.75 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.6 250.5 1.51 1.45 2 0.754 383K 207 0.0 0.0 L3 19/0 893.21 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 239.3 238.8 4.41 4.05 2 2.207 1072K 2075 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 156.1 156.2 1.44 1.08 1 1.440 228K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/4 99.88 GB 0.0 5.5 2.1 3.4 9.2 5.8 1.7 2.5 166.3 279.5 33.85 31.54 70 0.484 5717K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 2.1 3.4 9.2 5.8 1.7 2.5 166.3 279.5 33.85 31.54 70 0.484 5717K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 2.1 3.4 5.5 2.1 0.0 0.0 244.0 243.6 23.07 21.88 16 1.442 5717K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 356.5 10.78 9.66 54 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.24 GB write, 778.06 MB/s write, 5.50 GB read, 462.94 MB/s read, 33.9 seconds Interval compaction: 9.24 GB write, 793.44 MB/s write, 5.50 GB read, 472.10 MB/s read, 33.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1113348 Average: 2.1620 StdDev: 11.52 Min: 0 Median: 1.4475 Max: 3647 Percentiles: P50: 1.45 P75: 1.84 P99: 5.54 P99.9: 9.77 P99.99: 14.90 ------------------------------------------------------ [ 0, 1 ] 238083 21.384% 21.384% #### ( 1, 2 ] 712000 63.951% 85.336% ############# ( 2, 3 ] 90801 8.156% 93.491% ## ( 3, 4 ] 42221 3.792% 97.284% # ( 4, 6 ] 24749 2.223% 99.507% ( 6, 10 ] 4651 0.418% 99.924% ( 10, 15 ] 746 0.067% 99.991% ( 15, 22 ] 79 0.007% 99.998% ( 22, 34 ] 17 0.002% 100.000% ( 34, 51 ] 11 0.001% 100.001% ( 51, 76 ] 10 0.001% 100.002% ( 76, 110 ] 62 0.006% 100.007% ( 110, 170 ] 82 0.007% 100.015% ( 170, 250 ] 61 0.005% 100.020% ( 250, 380 ] 45 0.004% 100.024% ( 380, 580 ] 26 0.002% 100.027% ( 580, 870 ] 23 0.002% 100.029% ( 870, 1300 ] 6 0.001% 100.029% ( 1300, 1900 ] 13 0.001% 100.030% ( 1900, 2900 ] 8 0.001% 100.031% ( 2900, 4400 ] 4 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 13180 Average: 6.2752 StdDev: 53.32 Min: 1 Median: 1.5553 Max: 1833 Percentiles: P50: 1.56 P75: 1.97 P99: 126.30 P99.9: 806.78 P99.99: 1768.20 ------------------------------------------------------ [ 0, 1 ] 2194 16.646% 16.646% ### ( 1, 2 ] 7916 60.061% 76.707% ############ ( 2, 3 ] 1423 10.797% 87.504% ## ( 3, 4 ] 808 6.131% 93.634% # ( 4, 6 ] 428 3.247% 96.882% # ( 6, 10 ] 240 1.821% 98.703% ( 10, 15 ] 13 0.099% 98.801% ( 15, 22 ] 1 0.008% 98.809% ( 34, 51 ] 1 0.008% 98.816% ( 76, 110 ] 6 0.046% 98.862% ( 110, 170 ] 67 0.508% 99.370% ( 170, 250 ] 24 0.182% 99.552% ( 250, 380 ] 19 0.144% 99.697% ( 380, 580 ] 19 0.144% 99.841% ( 580, 870 ] 10 0.076% 99.917% ( 870, 1300 ] 5 0.038% 99.954% ( 1300, 1900 ] 6 0.046% 100.000% ** Level 2 read latency histogram (micros): Count: 111915 Average: 2.2014 StdDev: 12.63 Min: 0 Median: 1.3754 Max: 2084 Percentiles: P50: 1.38 P75: 1.80 P99: 5.77 P99.9: 13.29 P99.99: 531.30 ------------------------------------------------------ [ 0, 1 ] 31208 27.885% 27.885% ###### ( 1, 2 ] 65923 58.905% 86.790% ############ ( 2, 3 ] 7469 6.674% 93.464% # ( 3, 4 ] 4202 3.755% 97.218% # ( 4, 6 ] 2257 2.017% 99.235% ( 6, 10 ] 698 0.624% 99.859% ( 10, 15 ] 70 0.063% 99.921% ( 15, 22 ] 9 0.008% 99.929% ( 22, 34 ] 2 0.002% 99.931% ( 51, 76 ] 2 0.002% 99.933% ( 110, 170 ] 28 0.025% 99.958% ( 170, 250 ] 13 0.012% 99.970% ( 250, 380 ] 16 0.014% 99.984% ( 380, 580 ] 9 0.008% 99.992% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233064 Average: 3.1735 StdDev: 31.30 Min: 0 Median: 1.5547 Max: 4893 Percentiles: P50: 1.55 P75: 1.97 P99: 8.77 P99.9: 163.49 P99.99: 490.77 ------------------------------------------------------ [ 0, 1 ] 38446 16.496% 16.496% ### ( 1, 2 ] 140759 60.395% 76.891% ############ ( 2, 3 ] 28057 12.038% 88.929% ## ( 3, 4 ] 12290 5.273% 94.202% # ( 4, 6 ] 8666 3.718% 97.921% # ( 6, 10 ] 3636 1.560% 99.481% ( 10, 15 ] 517 0.222% 99.703% ( 15, 22 ] 96 0.041% 99.744% ( 22, 34 ] 35 0.015% 99.759% ( 34, 51 ] 7 0.003% 99.762% ( 51, 76 ] 1 0.000% 99.762% ( 76, 110 ] 115 0.049% 99.812% ( 110, 170 ] 231 0.099% 99.911% ( 170, 250 ] 93 0.040% 99.951% ( 250, 380 ] 64 0.027% 99.978% ( 380, 580 ] 50 0.021% 100.000% ( 580, 870 ] 30 0.013% 100.012% ( 870, 1300 ] 14 0.006% 100.018% ( 1300, 1900 ] 10 0.004% 100.023% ( 1900, 2900 ] 9 0.004% 100.027% ( 2900, 4400 ] 6 0.003% 100.029% ( 4400, 6600 ] 1 0.000% 100.030% ** Level 4 read latency histogram (micros): Count: 320 Average: 177.4625 StdDev: 717.56 Min: 0 Median: 2.0943 Max: 5933 Percentiles: P50: 2.09 P75: 5.57 P99: 4040.00 P99.9: 5933.00 P99.99: 5933.00 ------------------------------------------------------ [ 0, 1 ] 51 15.938% 15.938% ### ( 1, 2 ] 104 32.500% 48.438% ####### ( 2, 3 ] 53 16.562% 65.000% ### ( 3, 4 ] 21 6.562% 71.562% # ( 4, 6 ] 14 4.375% 75.938% # ( 6, 10 ] 3 0.938% 76.875% ( 10, 15 ] 26 8.125% 85.000% ## ( 15, 22 ] 17 5.312% 90.312% # ( 22, 34 ] 1 0.312% 90.625% ( 170, 250 ] 1 0.312% 90.938% ( 250, 380 ] 2 0.625% 91.562% ( 380, 580 ] 3 0.938% 92.500% ( 580, 870 ] 6 1.875% 94.375% ( 870, 1300 ] 3 0.938% 95.312% ( 1300, 1900 ] 5 1.562% 96.875% ( 1900, 2900 ] 3 0.938% 97.812% ( 2900, 4400 ] 5 1.562% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 870.6000 StdDev: 980.19 Min: 115 Median: 446.6667 Max: 2997 Percentiles: P50: 446.67 P75: 870.00 P99: 2997.00 P99.9: 2997.00 P99.99: 2997.00 ------------------------------------------------------ ( 110, 170 ] 5 25.000% 25.000% ##### ( 170, 250 ] 3 15.000% 40.000% ### ( 250, 380 ] 1 5.000% 45.000% # ( 380, 580 ] 3 15.000% 60.000% ### ( 580, 870 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.390 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.349 H:M:S, 11.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/16-17:52:30 ... thread 0: (1000000,5000000) ops and (366697.8,341288.8) ops/second in (2.727041,14.650349) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/8 3.01 GB 251.7 3.3 0.0 3.3 7.9 4.7 0.0 1.7 129.3 314.5 25.83 24.20 80 0.323 3390K 3571 0.0 0.0 L1 9/0 1.04 GB 106.8 1.4 1.4 0.0 1.4 1.4 0.2 1.0 233.5 232.7 6.21 6.00 2 3.107 1473K 5269 0.0 0.0 L2 1/0 52.75 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.6 250.5 1.51 1.45 2 0.754 383K 207 0.0 0.0 L3 19/0 893.21 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 239.3 238.8 4.41 4.05 2 2.207 1072K 2075 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 156.1 156.2 1.44 1.08 1 1.440 228K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/8 100.80 GB 0.0 6.3 2.1 4.2 11.0 6.7 1.7 2.3 163.7 284.9 39.40 36.79 87 0.453 6548K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 2.1 4.2 11.0 6.7 1.7 2.3 163.7 284.9 39.40 36.79 87 0.453 6548K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 2.1 4.2 6.3 2.1 0.0 0.0 247.2 246.7 26.09 24.85 19 1.373 6548K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 359.6 13.31 11.94 68 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.9 total, 14.7 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.96 GB write, 753.96 MB/s write, 6.30 GB read, 433.16 MB/s read, 39.4 seconds Interval compaction: 10.96 GB write, 766.09 MB/s write, 6.30 GB read, 440.13 MB/s read, 39.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 20, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1334227 Average: 2.1111 StdDev: 11.54 Min: 0 Median: 1.4167 Max: 3647 Percentiles: P50: 1.42 P75: 1.81 P99: 5.46 P99.9: 9.74 P99.99: 16.16 ------------------------------------------------------ [ 0, 1 ] 317144 23.770% 23.770% ##### ( 1, 2 ] 839830 62.945% 86.715% ############# ( 2, 3 ] 98803 7.405% 94.120% # ( 3, 4 ] 45900 3.440% 97.560% # ( 4, 6 ] 26270 1.969% 99.529% ( 6, 10 ] 5290 0.396% 99.926% ( 10, 15 ] 841 0.063% 99.989% ( 15, 22 ] 112 0.008% 99.997% ( 22, 34 ] 21 0.002% 99.999% ( 34, 51 ] 13 0.001% 100.000% ( 51, 76 ] 11 0.001% 100.001% ( 76, 110 ] 62 0.005% 100.005% ( 110, 170 ] 88 0.007% 100.012% ( 170, 250 ] 71 0.005% 100.017% ( 250, 380 ] 50 0.004% 100.021% ( 380, 580 ] 28 0.002% 100.023% ( 580, 870 ] 27 0.002% 100.025% ( 870, 1300 ] 7 0.001% 100.026% ( 1300, 1900 ] 17 0.001% 100.027% ( 1900, 2900 ] 10 0.001% 100.028% ( 2900, 4400 ] 4 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 13180 Average: 6.2752 StdDev: 53.32 Min: 1 Median: 1.5553 Max: 1833 Percentiles: P50: 1.56 P75: 1.97 P99: 126.30 P99.9: 806.78 P99.99: 1768.20 ------------------------------------------------------ [ 0, 1 ] 2194 16.646% 16.646% ### ( 1, 2 ] 7916 60.061% 76.707% ############ ( 2, 3 ] 1423 10.797% 87.504% ## ( 3, 4 ] 808 6.131% 93.634% # ( 4, 6 ] 428 3.247% 96.882% # ( 6, 10 ] 240 1.821% 98.703% ( 10, 15 ] 13 0.099% 98.801% ( 15, 22 ] 1 0.008% 98.809% ( 34, 51 ] 1 0.008% 98.816% ( 76, 110 ] 6 0.046% 98.862% ( 110, 170 ] 67 0.508% 99.370% ( 170, 250 ] 24 0.182% 99.552% ( 250, 380 ] 19 0.144% 99.697% ( 380, 580 ] 19 0.144% 99.841% ( 580, 870 ] 10 0.076% 99.917% ( 870, 1300 ] 5 0.038% 99.954% ( 1300, 1900 ] 6 0.046% 100.000% ** Level 2 read latency histogram (micros): Count: 111915 Average: 2.2014 StdDev: 12.63 Min: 0 Median: 1.3754 Max: 2084 Percentiles: P50: 1.38 P75: 1.80 P99: 5.77 P99.9: 13.29 P99.99: 531.30 ------------------------------------------------------ [ 0, 1 ] 31208 27.885% 27.885% ###### ( 1, 2 ] 65923 58.905% 86.790% ############ ( 2, 3 ] 7469 6.674% 93.464% # ( 3, 4 ] 4202 3.755% 97.218% # ( 4, 6 ] 2257 2.017% 99.235% ( 6, 10 ] 698 0.624% 99.859% ( 10, 15 ] 70 0.063% 99.921% ( 15, 22 ] 9 0.008% 99.929% ( 22, 34 ] 2 0.002% 99.931% ( 51, 76 ] 2 0.002% 99.933% ( 110, 170 ] 28 0.025% 99.958% ( 170, 250 ] 13 0.012% 99.970% ( 250, 380 ] 16 0.014% 99.984% ( 380, 580 ] 9 0.008% 99.992% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233064 Average: 3.1735 StdDev: 31.30 Min: 0 Median: 1.5547 Max: 4893 Percentiles: P50: 1.55 P75: 1.97 P99: 8.77 P99.9: 163.49 P99.99: 490.77 ------------------------------------------------------ [ 0, 1 ] 38446 16.496% 16.496% ### ( 1, 2 ] 140759 60.395% 76.891% ############ ( 2, 3 ] 28057 12.038% 88.929% ## ( 3, 4 ] 12290 5.273% 94.202% # ( 4, 6 ] 8666 3.718% 97.921% # ( 6, 10 ] 3636 1.560% 99.481% ( 10, 15 ] 517 0.222% 99.703% ( 15, 22 ] 96 0.041% 99.744% ( 22, 34 ] 35 0.015% 99.759% ( 34, 51 ] 7 0.003% 99.762% ( 51, 76 ] 1 0.000% 99.762% ( 76, 110 ] 115 0.049% 99.812% ( 110, 170 ] 231 0.099% 99.911% ( 170, 250 ] 93 0.040% 99.951% ( 250, 380 ] 64 0.027% 99.978% ( 380, 580 ] 50 0.021% 100.000% ( 580, 870 ] 30 0.013% 100.012% ( 870, 1300 ] 14 0.006% 100.018% ( 1300, 1900 ] 10 0.004% 100.023% ( 1900, 2900 ] 9 0.004% 100.027% ( 2900, 4400 ] 6 0.003% 100.029% ( 4400, 6600 ] 1 0.000% 100.030% ** Level 4 read latency histogram (micros): Count: 320 Average: 177.4625 StdDev: 717.56 Min: 0 Median: 2.0943 Max: 5933 Percentiles: P50: 2.09 P75: 5.57 P99: 4040.00 P99.9: 5933.00 P99.99: 5933.00 ------------------------------------------------------ [ 0, 1 ] 51 15.938% 15.938% ### ( 1, 2 ] 104 32.500% 48.438% ####### ( 2, 3 ] 53 16.562% 65.000% ### ( 3, 4 ] 21 6.562% 71.562% # ( 4, 6 ] 14 4.375% 75.938% # ( 6, 10 ] 3 0.938% 76.875% ( 10, 15 ] 26 8.125% 85.000% ## ( 15, 22 ] 17 5.312% 90.312% # ( 22, 34 ] 1 0.312% 90.625% ( 170, 250 ] 1 0.312% 90.938% ( 250, 380 ] 2 0.625% 91.562% ( 380, 580 ] 3 0.938% 92.500% ( 580, 870 ] 6 1.875% 94.375% ( 870, 1300 ] 3 0.938% 95.312% ( 1300, 1900 ] 5 1.562% 96.875% ( 1900, 2900 ] 3 0.938% 97.812% ( 2900, 4400 ] 5 1.562% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 870.6000 StdDev: 980.19 Min: 115 Median: 446.6667 Max: 2997 Percentiles: P50: 446.67 P75: 870.00 P99: 2997.00 P99.9: 2997.00 P99.99: 2997.00 ------------------------------------------------------ ( 110, 170 ] 5 25.000% 25.000% ##### ( 170, 250 ] 3 15.000% 40.000% ### ( 250, 380 ] 1 5.000% 45.000% # ( 380, 580 ] 3 15.000% 60.000% ### ( 580, 870 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 14.9 total, 2.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 330.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.560 H:M:S, 10.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 360.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.170 H:M:S, 6.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-17:52:33 ... thread 0: (1000000,6000000) ops and (296498.4,332907.0) ops/second in (3.372700,18.023049) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/4 4.06 GB 390.1 4.6 0.0 4.6 10.3 5.7 0.0 1.8 139.6 312.6 33.84 31.82 101 0.335 4797K 5077 0.0 0.0 L1 9/0 1.04 GB 106.8 1.4 1.4 0.0 1.4 1.4 0.2 1.0 233.5 232.7 6.21 6.00 2 3.107 1473K 5269 0.0 0.0 L2 1/0 52.75 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.6 250.5 1.51 1.45 2 0.754 383K 207 0.0 0.0 L3 19/0 893.21 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 239.3 238.8 4.41 4.05 2 2.207 1072K 2075 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 156.1 156.2 1.44 1.08 1 1.440 228K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/4 101.85 GB 0.0 7.7 2.1 5.6 13.4 7.8 1.7 2.3 165.2 288.5 47.42 44.41 108 0.439 7955K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.7 2.1 5.6 13.4 7.8 1.7 2.3 165.2 288.5 47.42 44.41 108 0.439 7955K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.7 2.1 5.6 7.6 2.1 0.0 0.0 251.2 250.8 31.19 29.86 24 1.300 7955K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 361.0 16.23 14.55 84 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.3 total, 18.0 interval Flush(GB): cumulative 5.722, interval 5.722 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.36 GB write, 749.16 MB/s write, 7.65 GB read, 429.05 MB/s read, 47.4 seconds Interval compaction: 13.36 GB write, 758.97 MB/s write, 7.65 GB read, 434.66 MB/s read, 47.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 21, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1640717 Average: 2.0665 StdDev: 10.97 Min: 0 Median: 1.3946 Max: 3647 Percentiles: P50: 1.39 P75: 1.79 P99: 5.36 P99.9: 9.70 P99.99: 15.82 ------------------------------------------------------ [ 0, 1 ] 415871 25.347% 25.347% ##### ( 1, 2 ] 1024969 62.471% 87.818% ############ ( 2, 3 ] 112028 6.828% 94.646% # ( 3, 4 ] 51914 3.164% 97.810% # ( 4, 6 ] 28788 1.755% 99.564% ( 6, 10 ] 5959 0.363% 99.928% ( 10, 15 ] 1007 0.061% 99.989% ( 15, 22 ] 145 0.009% 99.998% ( 22, 34 ] 24 0.001% 99.999% ( 34, 51 ] 13 0.001% 100.000% ( 51, 76 ] 15 0.001% 100.001% ( 76, 110 ] 62 0.004% 100.005% ( 110, 170 ] 94 0.006% 100.010% ( 170, 250 ] 81 0.005% 100.015% ( 250, 380 ] 59 0.004% 100.019% ( 380, 580 ] 34 0.002% 100.021% ( 580, 870 ] 33 0.002% 100.023% ( 870, 1300 ] 10 0.001% 100.024% ( 1300, 1900 ] 18 0.001% 100.025% ( 1900, 2900 ] 11 0.001% 100.025% ( 2900, 4400 ] 4 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 13180 Average: 6.2752 StdDev: 53.32 Min: 1 Median: 1.5553 Max: 1833 Percentiles: P50: 1.56 P75: 1.97 P99: 126.30 P99.9: 806.78 P99.99: 1768.20 ------------------------------------------------------ [ 0, 1 ] 2194 16.646% 16.646% ### ( 1, 2 ] 7916 60.061% 76.707% ############ ( 2, 3 ] 1423 10.797% 87.504% ## ( 3, 4 ] 808 6.131% 93.634% # ( 4, 6 ] 428 3.247% 96.882% # ( 6, 10 ] 240 1.821% 98.703% ( 10, 15 ] 13 0.099% 98.801% ( 15, 22 ] 1 0.008% 98.809% ( 34, 51 ] 1 0.008% 98.816% ( 76, 110 ] 6 0.046% 98.862% ( 110, 170 ] 67 0.508% 99.370% ( 170, 250 ] 24 0.182% 99.552% ( 250, 380 ] 19 0.144% 99.697% ( 380, 580 ] 19 0.144% 99.841% ( 580, 870 ] 10 0.076% 99.917% ( 870, 1300 ] 5 0.038% 99.954% ( 1300, 1900 ] 6 0.046% 100.000% ** Level 2 read latency histogram (micros): Count: 111915 Average: 2.2014 StdDev: 12.63 Min: 0 Median: 1.3754 Max: 2084 Percentiles: P50: 1.38 P75: 1.80 P99: 5.77 P99.9: 13.29 P99.99: 531.30 ------------------------------------------------------ [ 0, 1 ] 31208 27.885% 27.885% ###### ( 1, 2 ] 65923 58.905% 86.790% ############ ( 2, 3 ] 7469 6.674% 93.464% # ( 3, 4 ] 4202 3.755% 97.218% # ( 4, 6 ] 2257 2.017% 99.235% ( 6, 10 ] 698 0.624% 99.859% ( 10, 15 ] 70 0.063% 99.921% ( 15, 22 ] 9 0.008% 99.929% ( 22, 34 ] 2 0.002% 99.931% ( 51, 76 ] 2 0.002% 99.933% ( 110, 170 ] 28 0.025% 99.958% ( 170, 250 ] 13 0.012% 99.970% ( 250, 380 ] 16 0.014% 99.984% ( 380, 580 ] 9 0.008% 99.992% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 2 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233064 Average: 3.1735 StdDev: 31.30 Min: 0 Median: 1.5547 Max: 4893 Percentiles: P50: 1.55 P75: 1.97 P99: 8.77 P99.9: 163.49 P99.99: 490.77 ------------------------------------------------------ [ 0, 1 ] 38446 16.496% 16.496% ### ( 1, 2 ] 140759 60.395% 76.891% ############ ( 2, 3 ] 28057 12.038% 88.929% ## ( 3, 4 ] 12290 5.273% 94.202% # ( 4, 6 ] 8666 3.718% 97.921% # ( 6, 10 ] 3636 1.560% 99.481% ( 10, 15 ] 517 0.222% 99.703% ( 15, 22 ] 96 0.041% 99.744% ( 22, 34 ] 35 0.015% 99.759% ( 34, 51 ] 7 0.003% 99.762% ( 51, 76 ] 1 0.000% 99.762% ( 76, 110 ] 115 0.049% 99.812% ( 110, 170 ] 231 0.099% 99.911% ( 170, 250 ] 93 0.040% 99.951% ( 250, 380 ] 64 0.027% 99.978% ( 380, 580 ] 50 0.021% 100.000% ( 580, 870 ] 30 0.013% 100.012% ( 870, 1300 ] 14 0.006% 100.018% ( 1300, 1900 ] 10 0.004% 100.023% ( 1900, 2900 ] 9 0.004% 100.027% ( 2900, 4400 ] 6 0.003% 100.029% ( 4400, 6600 ] 1 0.000% 100.030% ** Level 4 read latency histogram (micros): Count: 320 Average: 177.4625 StdDev: 717.56 Min: 0 Median: 2.0943 Max: 5933 Percentiles: P50: 2.09 P75: 5.57 P99: 4040.00 P99.9: 5933.00 P99.99: 5933.00 ------------------------------------------------------ [ 0, 1 ] 51 15.938% 15.938% ### ( 1, 2 ] 104 32.500% 48.438% ####### ( 2, 3 ] 53 16.562% 65.000% ### ( 3, 4 ] 21 6.562% 71.562% # ( 4, 6 ] 14 4.375% 75.938% # ( 6, 10 ] 3 0.938% 76.875% ( 10, 15 ] 26 8.125% 85.000% ## ( 15, 22 ] 17 5.312% 90.312% # ( 22, 34 ] 1 0.312% 90.625% ( 170, 250 ] 1 0.312% 90.938% ( 250, 380 ] 2 0.625% 91.562% ( 380, 580 ] 3 0.938% 92.500% ( 580, 870 ] 6 1.875% 94.375% ( 870, 1300 ] 3 0.938% 95.312% ( 1300, 1900 ] 5 1.562% 96.875% ( 1900, 2900 ] 3 0.938% 97.812% ( 2900, 4400 ] 5 1.562% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 870.6000 StdDev: 980.19 Min: 115 Median: 446.6667 Max: 2997 Percentiles: P50: 446.67 P75: 870.00 P99: 2997.00 P99.9: 2997.00 P99.99: 2997.00 ------------------------------------------------------ ( 110, 170 ] 5 25.000% 25.000% ##### ( 170, 250 ] 3 15.000% 40.000% ### ( 250, 380 ] 1 5.000% 45.000% # ( 380, 580 ] 3 15.000% 60.000% ### ( 580, 870 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 18.3 total, 3.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 323.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.338 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 291.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.779 H:M:S, 23.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/16-17:53:05 ... thread 0: (1000000,7000000) ops and (31426.3,140439.5) ops/second in (31.820482,49.843531) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 2/2 754.72 MB 0.0 5.6 0.0 5.6 12.2 6.6 0.0 1.8 136.5 298.3 42.01 38.17 117 0.359 5820K 6535 0.0 0.0 L1 0/0 0.00 KB 0.0 6.7 5.7 1.0 6.6 5.5 0.2 1.2 212.0 207.6 32.36 28.58 3 10.787 6967K 142K 0.0 0.0 L2 30/27 3.66 GB 3.7 1.1 0.9 0.2 1.1 0.9 4.9 1.3 212.2 211.7 5.48 4.96 3 1.827 437K 207 0.0 0.0 L3 26/9 1.89 GB 1.0 3.0 1.6 1.4 2.9 1.5 0.6 1.9 192.1 189.8 15.83 12.91 10 1.583 3088K 38K 0.0 0.0 L4 171/6 9.50 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 156.1 156.2 1.44 1.08 1 1.440 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1285/44 102.60 GB 0.0 16.6 8.3 8.3 23.1 14.8 7.5 3.5 175.3 243.4 97.11 85.71 134 0.725 16M 187K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.6 8.3 8.3 23.1 14.8 7.5 3.5 175.3 243.4 97.11 85.71 134 0.725 16M 187K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.6 8.3 8.3 16.4 8.2 0.0 0.0 220.4 217.9 77.25 68.66 37 2.088 16M 187K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 342.5 19.87 17.05 97 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.1 total, 49.8 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.08 GB write, 471.98 MB/s write, 16.62 GB read, 339.91 MB/s read, 97.1 seconds Interval compaction: 23.08 GB write, 474.22 MB/s write, 16.62 GB read, 341.52 MB/s read, 97.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 25, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2999821 Average: 3.1221 StdDev: 21.80 Min: 0 Median: 1.3456 Max: 5809 Percentiles: P50: 1.35 P75: 1.77 P99: 9.22 P99.9: 169.46 P99.99: 524.72 ------------------------------------------------------ [ 0, 1 ] 887719 29.592% 29.592% ###### ( 1, 2 ] 1771269 59.046% 88.638% ############ ( 2, 3 ] 158452 5.282% 93.920% # ( 3, 4 ] 84852 2.829% 96.749% # ( 4, 6 ] 54506 1.817% 98.566% ( 6, 10 ] 16203 0.540% 99.106% ( 10, 15 ] 2666 0.089% 99.195% ( 15, 22 ] 770 0.026% 99.220% ( 22, 34 ] 39 0.001% 99.222% ( 34, 51 ] 15 0.001% 99.222% ( 51, 76 ] 602 0.020% 99.242% ( 76, 110 ] 11772 0.392% 99.635% ( 110, 170 ] 8029 0.268% 99.902% ( 170, 250 ] 1120 0.037% 99.940% ( 250, 380 ] 940 0.031% 99.971% ( 380, 580 ] 785 0.026% 99.997% ( 580, 870 ] 315 0.011% 100.008% ( 870, 1300 ] 85 0.003% 100.011% ( 1300, 1900 ] 49 0.002% 100.012% ( 1900, 2900 ] 31 0.001% 100.013% ( 2900, 4400 ] 25 0.001% 100.014% ( 4400, 6600 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 1146587 Average: 4.6081 StdDev: 55.34 Min: 0 Median: 1.6771 Max: 10321 Percentiles: P50: 1.68 P75: 2.51 P99: 9.27 P99.9: 151.25 P99.99: 294.19 ------------------------------------------------------ [ 0, 1 ] 149165 13.009% 13.009% ### ( 1, 2 ] 626370 54.629% 67.639% ########### ( 2, 3 ] 166518 14.523% 82.161% ### ( 3, 4 ] 94344 8.228% 90.390% ## ( 4, 6 ] 81605 7.117% 97.507% # ( 6, 10 ] 20966 1.829% 99.336% ( 10, 15 ] 3349 0.292% 99.628% ( 15, 22 ] 417 0.036% 99.664% ( 22, 34 ] 28 0.002% 99.666% ( 34, 51 ] 3 0.000% 99.667% ( 51, 76 ] 158 0.014% 99.680% ( 76, 110 ] 1539 0.134% 99.815% ( 110, 170 ] 1423 0.124% 99.939% ( 170, 250 ] 414 0.036% 99.975% ( 250, 380 ] 510 0.044% 100.019% ( 380, 580 ] 599 0.052% 100.072% ( 580, 870 ] 490 0.043% 100.114% ( 870, 1300 ] 274 0.024% 100.138% ( 1300, 1900 ] 149 0.013% 100.151% ( 1900, 2900 ] 98 0.009% 100.160% ( 2900, 4400 ] 78 0.007% 100.167% ( 4400, 6600 ] 15 0.001% 100.168% ( 6600, 9900 ] 4 0.000% 100.168% ( 9900, 14000 ] 1 0.000% 100.168% ** Level 2 read latency histogram (micros): Count: 253113 Average: 3.5098 StdDev: 51.45 Min: 0 Median: 1.6892 Max: 6115 Percentiles: P50: 1.69 P75: 2.59 P99: 7.39 P99.9: 11.78 P99.99: 14.29 ------------------------------------------------------ [ 0, 1 ] 34423 13.600% 13.600% ### ( 1, 2 ] 133678 52.814% 66.413% ########### ( 2, 3 ] 36675 14.490% 80.903% ### ( 3, 4 ] 23422 9.254% 90.157% ## ( 4, 6 ] 21257 8.398% 98.555% ## ( 6, 10 ] 3243 1.281% 99.836% ( 10, 15 ] 454 0.179% 100.015% ( 15, 22 ] 44 0.017% 100.033% ( 22, 34 ] 8 0.003% 100.036% ( 51, 76 ] 13 0.005% 100.041% ( 76, 110 ] 2 0.001% 100.042% ( 110, 170 ] 34 0.013% 100.055% ( 170, 250 ] 16 0.006% 100.062% ( 250, 380 ] 27 0.011% 100.072% ( 380, 580 ] 18 0.007% 100.079% ( 580, 870 ] 25 0.010% 100.089% ( 870, 1300 ] 11 0.004% 100.094% ( 1300, 1900 ] 17 0.007% 100.100% ( 1900, 2900 ] 13 0.005% 100.105% ( 2900, 4400 ] 26 0.010% 100.116% ( 4400, 6600 ] 7 0.003% 100.119% ** Level 3 read latency histogram (micros): Count: 385365 Average: 5.3681 StdDev: 57.11 Min: 0 Median: 1.6698 Max: 4893 Percentiles: P50: 1.67 P75: 2.41 P99: 9.75 P99.9: 756.97 P99.99: 1574.12 ------------------------------------------------------ [ 0, 1 ] 44195 11.468% 11.468% ## ( 1, 2 ] 221679 57.524% 68.993% ############ ( 2, 3 ] 56968 14.783% 83.776% ### ( 3, 4 ] 28806 7.475% 91.251% # ( 4, 6 ] 22681 5.886% 97.136% # ( 6, 10 ] 7655 1.986% 99.123% ( 10, 15 ] 1216 0.316% 99.438% ( 15, 22 ] 204 0.053% 99.491% ( 22, 34 ] 56 0.015% 99.506% ( 34, 51 ] 8 0.002% 99.508% ( 51, 76 ] 2 0.001% 99.508% ( 76, 110 ] 139 0.036% 99.544% ( 110, 170 ] 329 0.085% 99.630% ( 170, 250 ] 222 0.058% 99.687% ( 250, 380 ] 282 0.073% 99.760% ( 380, 580 ] 358 0.093% 99.853% ( 580, 870 ] 296 0.077% 99.930% ( 870, 1300 ] 194 0.050% 99.981% ( 1300, 1900 ] 82 0.021% 100.002% ( 1900, 2900 ] 37 0.010% 100.011% ( 2900, 4400 ] 26 0.007% 100.018% ( 4400, 6600 ] 3 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 571 Average: 539.0665 StdDev: 863.89 Min: 0 Median: 20.5588 Max: 5933 Percentiles: P50: 20.56 P75: 775.75 P99: 4107.11 P99.9: 5933.00 P99.99: 5933.00 ------------------------------------------------------ [ 0, 1 ] 51 8.932% 8.932% ## ( 1, 2 ] 104 18.214% 27.145% #### ( 2, 3 ] 53 9.282% 36.427% ## ( 3, 4 ] 21 3.678% 40.105% # ( 4, 6 ] 14 2.452% 42.557% ( 6, 10 ] 3 0.525% 43.082% ( 10, 15 ] 26 4.553% 47.636% # ( 15, 22 ] 17 2.977% 50.613% # ( 22, 34 ] 1 0.175% 50.788% ( 110, 170 ] 8 1.401% 52.189% ( 170, 250 ] 12 2.102% 54.291% ( 250, 380 ] 26 4.553% 58.844% # ( 380, 580 ] 46 8.056% 66.900% ## ( 580, 870 ] 70 12.259% 79.159% ## ( 870, 1300 ] 49 8.581% 87.741% ## ( 1300, 1900 ] 28 4.904% 92.644% # ( 1900, 2900 ] 22 3.853% 96.497% # ( 2900, 4400 ] 19 3.327% 99.825% # ( 4400, 6600 ] 2 0.350% 100.175% ** Level 5 read latency histogram (micros): Count: 60 Average: 968.2833 StdDev: 1010.15 Min: 115 Median: 513.3333 Max: 3579 Percentiles: P50: 513.33 P75: 1525.00 P99: 3579.00 P99.9: 3579.00 P99.99: 3579.00 ------------------------------------------------------ ( 110, 170 ] 11 18.333% 18.333% #### ( 170, 250 ] 7 11.667% 30.000% ## ( 250, 380 ] 8 13.333% 43.333% ### ( 380, 580 ] 6 10.000% 53.333% ## ( 580, 870 ] 8 13.333% 66.667% ### ( 870, 1300 ] 2 3.333% 70.000% # ( 1300, 1900 ] 8 13.333% 83.333% ### ( 1900, 2900 ] 4 6.667% 90.000% # ( 2900, 4400 ] 6 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 50.1 total, 31.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 137.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.661 H:M:S, 61.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 30.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:28.323 H:M:S, 89.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/16-17:53:09 ... thread 0: (1000000,8000000) ops and (265250.2,149216.0) ops/second in (3.770025,53.613556) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 1007.12 MB 75.5 6.2 0.0 6.2 13.8 7.6 0.0 1.8 132.6 295.1 48.00 43.20 132 0.364 6460K 7280 0.0 0.0 L1 11/1 616.85 MB 56.2 7.4 6.4 1.0 7.3 6.3 0.2 1.1 210.6 206.7 36.16 31.86 4 9.039 7734K 143K 0.0 0.0 L2 31/29 3.72 GB 2.5 1.1 0.9 0.2 1.1 0.9 5.0 1.3 212.2 211.7 5.48 4.96 3 1.827 437K 207 0.0 0.0 L3 19/14 1.25 GB 0.4 3.1 1.6 1.5 3.1 1.6 0.7 1.9 188.3 186.1 16.98 13.62 11 1.544 3248K 38K 0.0 0.0 L4 172/0 9.61 GB 1.0 0.9 0.9 0.0 0.9 0.9 0.8 1.0 132.1 131.9 7.29 4.51 9 0.810 945K 0 0.0 0.0 L5 1064/0 87.42 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/48 103.58 GB 0.0 18.9 9.8 9.1 26.3 17.2 8.3 3.4 169.5 236.3 113.91 98.14 159 0.716 18M 189K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.9 9.8 9.1 26.3 17.2 8.3 3.4 169.5 236.3 113.91 98.14 159 0.716 18M 189K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.9 9.8 9.1 18.7 9.6 0.0 0.0 213.3 211.1 90.51 78.47 49 1.847 18M 189K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 333.9 23.40 19.67 110 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.9 total, 53.6 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.29 GB write, 499.92 MB/s write, 18.85 GB read, 358.46 MB/s read, 113.9 seconds Interval compaction: 26.29 GB write, 502.12 MB/s write, 18.85 GB read, 360.03 MB/s read, 113.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 44, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3366254 Average: 3.1207 StdDev: 23.62 Min: 0 Median: 1.3857 Max: 6888 Percentiles: P50: 1.39 P75: 1.81 P99: 8.88 P99.9: 166.58 P99.99: 489.31 ------------------------------------------------------ [ 0, 1 ] 915337 27.192% 27.192% ##### ( 1, 2 ] 1990427 59.129% 86.320% ############ ( 2, 3 ] 214456 6.371% 92.691% # ( 3, 4 ] 115757 3.439% 96.130% # ( 4, 6 ] 81108 2.409% 98.539% ( 6, 10 ] 21561 0.641% 99.180% ( 10, 15 ] 3352 0.100% 99.279% ( 15, 22 ] 846 0.025% 99.305% ( 22, 34 ] 49 0.001% 99.306% ( 34, 51 ] 17 0.001% 99.307% ( 51, 76 ] 603 0.018% 99.324% ( 76, 110 ] 11785 0.350% 99.675% ( 110, 170 ] 8051 0.239% 99.914% ( 170, 250 ] 1149 0.034% 99.948% ( 250, 380 ] 971 0.029% 99.977% ( 380, 580 ] 824 0.024% 100.001% ( 580, 870 ] 340 0.010% 100.011% ( 870, 1300 ] 95 0.003% 100.014% ( 1300, 1900 ] 56 0.002% 100.016% ( 1900, 2900 ] 54 0.002% 100.017% ( 2900, 4400 ] 34 0.001% 100.018% ( 4400, 6600 ] 5 0.000% 100.019% ( 6600, 9900 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1518766 Average: 4.7965 StdDev: 62.44 Min: 0 Median: 1.7036 Max: 10321 Percentiles: P50: 1.70 P75: 2.55 P99: 9.28 P99.9: 165.25 P99.99: 377.52 ------------------------------------------------------ [ 0, 1 ] 163677 10.777% 10.777% ## ( 1, 2 ] 846651 55.746% 66.523% ########### ( 2, 3 ] 232140 15.285% 81.808% ### ( 3, 4 ] 127394 8.388% 90.196% ## ( 4, 6 ] 110098 7.249% 97.445% # ( 6, 10 ] 28803 1.896% 99.341% ( 10, 15 ] 4703 0.310% 99.651% ( 15, 22 ] 514 0.034% 99.685% ( 22, 34 ] 34 0.002% 99.687% ( 34, 51 ] 5 0.000% 99.687% ( 51, 76 ] 160 0.011% 99.698% ( 76, 110 ] 1619 0.107% 99.805% ( 110, 170 ] 1577 0.104% 99.908% ( 170, 250 ] 580 0.038% 99.947% ( 250, 380 ] 675 0.044% 99.991% ( 380, 580 ] 769 0.051% 100.042% ( 580, 870 ] 619 0.041% 100.082% ( 870, 1300 ] 352 0.023% 100.106% ( 1300, 1900 ] 191 0.013% 100.118% ( 1900, 2900 ] 161 0.011% 100.129% ( 2900, 4400 ] 158 0.010% 100.139% ( 4400, 6600 ] 33 0.002% 100.141% ( 6600, 9900 ] 8 0.001% 100.142% ( 9900, 14000 ] 1 0.000% 100.142% ** Level 2 read latency histogram (micros): Count: 253113 Average: 3.5098 StdDev: 51.45 Min: 0 Median: 1.6892 Max: 6115 Percentiles: P50: 1.69 P75: 2.59 P99: 7.39 P99.9: 11.78 P99.99: 14.29 ------------------------------------------------------ [ 0, 1 ] 34423 13.600% 13.600% ### ( 1, 2 ] 133678 52.814% 66.413% ########### ( 2, 3 ] 36675 14.490% 80.903% ### ( 3, 4 ] 23422 9.254% 90.157% ## ( 4, 6 ] 21257 8.398% 98.555% ## ( 6, 10 ] 3243 1.281% 99.836% ( 10, 15 ] 454 0.179% 100.015% ( 15, 22 ] 44 0.017% 100.033% ( 22, 34 ] 8 0.003% 100.036% ( 51, 76 ] 13 0.005% 100.041% ( 76, 110 ] 2 0.001% 100.042% ( 110, 170 ] 34 0.013% 100.055% ( 170, 250 ] 16 0.006% 100.062% ( 250, 380 ] 27 0.011% 100.072% ( 380, 580 ] 18 0.007% 100.079% ( 580, 870 ] 25 0.010% 100.089% ( 870, 1300 ] 11 0.004% 100.094% ( 1300, 1900 ] 17 0.007% 100.100% ( 1900, 2900 ] 13 0.005% 100.105% ( 2900, 4400 ] 26 0.010% 100.116% ( 4400, 6600 ] 7 0.003% 100.119% ** Level 3 read latency histogram (micros): Count: 600891 Average: 6.9667 StdDev: 97.23 Min: 0 Median: 1.7423 Max: 8942 Percentiles: P50: 1.74 P75: 2.64 P99: 9.71 P99.9: 697.19 P99.99: 1358.78 ------------------------------------------------------ [ 0, 1 ] 50708 8.439% 8.439% ## ( 1, 2 ] 336450 55.992% 64.431% ########### ( 2, 3 ] 99784 16.606% 81.037% ### ( 3, 4 ] 51835 8.626% 89.663% ## ( 4, 6 ] 44757 7.448% 97.111% # ( 6, 10 ] 12245 2.038% 99.149% ( 10, 15 ] 2338 0.389% 99.538% ( 15, 22 ] 337 0.056% 99.594% ( 22, 34 ] 70 0.012% 99.606% ( 34, 51 ] 12 0.002% 99.608% ( 51, 76 ] 5 0.001% 99.609% ( 76, 110 ] 145 0.024% 99.633% ( 110, 170 ] 349 0.058% 99.691% ( 170, 250 ] 256 0.043% 99.734% ( 250, 380 ] 354 0.059% 99.793% ( 380, 580 ] 478 0.080% 99.872% ( 580, 870 ] 416 0.069% 99.941% ( 870, 1300 ] 279 0.046% 99.988% ( 1300, 1900 ] 142 0.024% 100.011% ( 1900, 2900 ] 172 0.029% 100.040% ( 2900, 4400 ] 201 0.033% 100.074% ( 4400, 6600 ] 36 0.006% 100.080% ( 6600, 9900 ] 4 0.001% 100.080% ** Level 4 read latency histogram (micros): Count: 8450 Average: 84.6837 StdDev: 436.09 Min: 0 Median: 1.8983 Max: 7919 Percentiles: P50: 1.90 P75: 3.13 P99: 2577.08 P99.9: 4961.00 P99.99: 7111.50 ------------------------------------------------------ [ 0, 1 ] 425 5.030% 5.030% # ( 1, 2 ] 4230 50.059% 55.089% ########## ( 2, 3 ] 1572 18.604% 73.692% #### ( 3, 4 ] 861 10.189% 83.882% ## ( 4, 6 ] 543 6.426% 90.308% # ( 6, 10 ] 161 1.905% 92.213% ( 10, 15 ] 61 0.722% 92.935% ( 15, 22 ] 24 0.284% 93.219% ( 22, 34 ] 3 0.036% 93.254% ( 34, 51 ] 1 0.012% 93.266% ( 76, 110 ] 6 0.071% 93.337% ( 110, 170 ] 26 0.308% 93.645% ( 170, 250 ] 36 0.426% 94.071% ( 250, 380 ] 55 0.651% 94.722% ( 380, 580 ] 92 1.089% 95.811% ( 580, 870 ] 111 1.314% 97.124% ( 870, 1300 ] 75 0.888% 98.012% ( 1300, 1900 ] 51 0.604% 98.615% ( 1900, 2900 ] 48 0.568% 99.183% ( 2900, 4400 ] 58 0.686% 99.870% ( 4400, 6600 ] 10 0.118% 99.988% ( 6600, 9900 ] 1 0.012% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 1088.7000 StdDev: 1199.60 Min: 115 Median: 625.7895 Max: 6329 Percentiles: P50: 625.79 P75: 1433.33 P99: 5500.00 P99.9: 6329.00 P99.99: 6329.00 ------------------------------------------------------ ( 110, 170 ] 11 11.000% 11.000% ## ( 170, 250 ] 9 9.000% 20.000% ## ( 250, 380 ] 15 15.000% 35.000% ### ( 380, 580 ] 12 12.000% 47.000% ## ( 580, 870 ] 19 19.000% 66.000% #### ( 870, 1300 ] 7 7.000% 73.000% # ( 1300, 1900 ] 9 9.000% 82.000% ## ( 1900, 2900 ] 6 6.000% 88.000% # ( 2900, 4400 ] 10 10.000% 98.000% ## ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 53.9 total, 3.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 146.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.678 H:M:S, 58.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 261.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.017 H:M:S, 27.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.694 micros/op 149390 ops/sec 60.004 seconds 8963999 operations; 144.7 MB/s Microseconds per write: Count: 8963999 Average: 6.6937 StdDev: 563.59 Min: 0 Median: 1.7517 Max: 831914 Percentiles: P50: 1.75 P75: 2.77 P99: 8.98 P99.9: 1232.65 P99.99: 2781.54 ------------------------------------------------------ [ 0, 1 ] 1167218 13.021% 13.021% ### ( 1, 2 ] 4409967 49.196% 62.218% ########## ( 2, 3 ] 1497172 16.702% 78.920% ### ( 3, 4 ] 1234325 13.770% 92.689% ### ( 4, 6 ] 498313 5.559% 98.249% # ( 6, 10 ] 90351 1.008% 99.256% ( 10, 15 ] 28142 0.314% 99.570% ( 15, 22 ] 7441 0.083% 99.653% ( 22, 34 ] 1454 0.016% 99.670% ( 34, 51 ] 172 0.002% 99.672% ( 51, 76 ] 33 0.000% 99.672% ( 76, 110 ] 5823 0.065% 99.737% ( 110, 170 ] 2822 0.031% 99.768% ( 170, 250 ] 276 0.003% 99.771% ( 250, 380 ] 123 0.001% 99.773% ( 380, 580 ] 30 0.000% 99.773% ( 580, 870 ] 28 0.000% 99.773% ( 870, 1300 ] 13452 0.150% 99.924% ( 1300, 1900 ] 49 0.001% 99.924% ( 1900, 2900 ] 6706 0.075% 99.999% ( 2900, 4400 ] 56 0.001% 99.999% ( 4400, 6600 ] 11 0.000% 100.000% ( 6600, 9900 ] 8 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 75000, 110000 ] 4 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 9 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 380000, 570000 ] 3 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 230257 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8963999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9250846968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 582 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35211997 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31237462541 rocksdb.compact.write.bytes COUNT : 30999461449 rocksdb.flush.write.bytes COUNT : 9115925113 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 74 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 246 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9042506752 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3588096 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31336711750 rocksdb.non.last.level.read.count COUNT : 7569181 rocksdb.block.checksum.compute.count COUNT : 7568091 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.402197 P95 : 3.906925 P99 : 7.406626 P100 : 831912.000000 COUNT : 8963999 SUM : 55834217 rocksdb.compaction.times.micros P50 : 891875.000000 P95 : 4300000.000000 P99 : 9800000.000000 P100 : 26147957.000000 COUNT : 100 SUM : 154937791 rocksdb.compaction.times.cpu_micros P50 : 546666.666667 P95 : 3950000.000000 P99 : 9800000.000000 P100 : 22581444.000000 COUNT : 100 SUM : 120783840 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 734.206349 P95 : 13139.000000 P99 : 72375.000000 P100 : 95858.000000 COUNT : 121 SUM : 468416 rocksdb.compaction.outfile.sync.micros P50 : 1394.285714 P95 : 67720.588235 P99 : 146120.000000 P100 : 225887.000000 COUNT : 399 SUM : 5259943 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 172.666667 P95 : 2257.142857 P99 : 4078.571429 P100 : 4958.000000 COUNT : 250 SUM : 118211 rocksdb.table.open.io.micros P50 : 1594.230769 P95 : 8628.529412 P99 : 13694.363636 P100 : 24815.000000 COUNT : 582 SUM : 1438083 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.663040 P95 : 8.450666 P99 : 13.824266 P100 : 23138.000000 COUNT : 7566649 SUM : 59778825 rocksdb.read.block.get.micros P50 : 526.564885 P95 : 3765.217391 P99 : 5868.923077 P100 : 8793.000000 COUNT : 1164 SUM : 1131613 rocksdb.write.raw.block.micros P50 : 0.515455 P95 : 0.979365 P99 : 2.908851 P100 : 30805.000000 COUNT : 9718611 SUM : 21635513 rocksdb.numfiles.in.singlecompaction P50 : 1.969231 P95 : 8.600000 P99 : 18.640000 P100 : 27.000000 COUNT : 148 SUM : 510 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.574530 P95 : 1266.983342 P99 : 2676.849499 P100 : 831723.000000 COUNT : 156310 SUM : 35226199 rocksdb.sst.read.micros P50 : 1.601329 P95 : 5.108608 P99 : 9.786631 P100 : 23135.000000 COUNT : 7569748 SUM : 44338707 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8963999 SUM : 9250846968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 207538.461538 P95 : 541500.000000 P99 : 946126.000000 P100 : 946126.000000 COUNT : 121 SUM : 28709060 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 358 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0