[2024-12-06 00:00:38.338610] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-12-06 00:00:38.338898] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1631982 ] Set seed to 1733439638331818 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-06 00:00:38.450459] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-06 00:00:38.491790] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-06 00:00:38.491838] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1631982' to capture a snapshot of events at runtime. [2024-12-06 00:00:38.491848] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-06 00:00:38.491859] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-06 00:00:38.491867] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1631982 for offline analysis/debug. [2024-12-06 00:00:38.491956] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 6 00:00:42 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/06-00:00:45 ... thread 0: (1000000,1000000) ops and (339750.4,339750.4) ops/second in (2.943337,2.943337) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.99 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 353.5 2.49 2.26 12 0.208 0 0 0.0 0.0 L1 3/3 251.73 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 252.8 252.6 1.00 0.97 1 0.997 255K 212 0.0 0.0 L2 1/0 48.81 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 239.2 239.1 0.47 0.44 1 0.466 113K 30 0.0 0.0 L3 16/0 755.46 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 202.7 202.7 0.31 0.26 1 0.309 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 99.8 306.5 4.27 3.93 15 0.284 432K 242 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 99.8 306.5 4.27 3.93 15 0.284 432K 242 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 240.5 240.4 1.77 1.66 3 0.590 432K 242 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 353.5 2.49 2.26 12 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 419.22 MB/s write, 0.42 GB read, 136.53 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 444.05 MB/s write, 0.42 GB read, 144.62 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 104530 Average: 1.7895 StdDev: 17.77 Min: 1 Median: 1.1134 Max: 3046 Percentiles: P50: 1.11 P75: 1.59 P99: 3.34 P99.9: 8.86 P99.99: 334.44 ------------------------------------------------------ [ 0, 1 ] 46005 44.011% 44.011% ######### ( 1, 2 ] 55232 52.838% 96.850% ########### ( 2, 3 ] 1975 1.889% 98.739% ( 3, 4 ] 815 0.780% 99.519% ( 4, 6 ] 289 0.276% 99.795% ( 6, 10 ] 156 0.149% 99.945% ( 10, 15 ] 25 0.024% 99.968% ( 15, 22 ] 6 0.006% 99.974% ( 22, 34 ] 3 0.003% 99.977% ( 51, 76 ] 2 0.002% 99.979% ( 110, 170 ] 8 0.008% 99.987% ( 170, 250 ] 1 0.001% 99.988% ( 250, 380 ] 7 0.007% 99.994% ( 580, 870 ] 2 0.002% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ( 2900, 4400 ] 2 0.002% 100.002% ** Level 1 read latency histogram (micros): Count: 31776 Average: 2.3513 StdDev: 32.85 Min: 1 Median: 1.1559 Max: 4102 Percentiles: P50: 1.16 P75: 1.63 P99: 5.21 P99.9: 82.94 P99.99: 1793.44 ------------------------------------------------------ [ 0, 1 ] 13257 41.720% 41.720% ######## ( 1, 2 ] 16880 53.122% 94.842% ########### ( 2, 3 ] 906 2.851% 97.693% # ( 3, 4 ] 287 0.903% 98.596% ( 4, 6 ] 212 0.667% 99.264% ( 6, 10 ] 119 0.374% 99.638% ( 10, 15 ] 25 0.079% 99.717% ( 15, 22 ] 10 0.031% 99.748% ( 22, 34 ] 1 0.003% 99.751% ( 34, 51 ] 26 0.082% 99.833% ( 51, 76 ] 20 0.063% 99.896% ( 76, 110 ] 6 0.019% 99.915% ( 110, 170 ] 3 0.009% 99.924% ( 170, 250 ] 9 0.028% 99.953% ( 250, 380 ] 6 0.019% 99.972% ( 580, 870 ] 3 0.009% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 1 0.003% 99.991% ( 1900, 2900 ] 2 0.006% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 15882 Average: 1.7423 StdDev: 3.57 Min: 1 Median: 1.1909 Max: 289 Percentiles: P50: 1.19 P75: 1.64 P99: 3.62 P99.9: 10.88 P99.99: 226.47 ------------------------------------------------------ [ 0, 1 ] 6241 39.296% 39.296% ######## ( 1, 2 ] 8904 56.063% 95.360% ########### ( 2, 3 ] 501 3.155% 98.514% # ( 3, 4 ] 125 0.787% 99.301% ( 4, 6 ] 58 0.365% 99.666% ( 6, 10 ] 35 0.220% 99.887% ( 10, 15 ] 12 0.076% 99.962% ( 15, 22 ] 2 0.013% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 756.0750 StdDev: 1087.10 Min: 0 Median: 170.0000 Max: 4670 Percentiles: P50: 170.00 P75: 1252.22 P99: 4670.00 P99.9: 4670.00 P99.99: 4670.00 ------------------------------------------------------ [ 0, 1 ] 27 33.750% 33.750% ####### ( 1, 2 ] 8 10.000% 43.750% ## ( 2, 3 ] 1 1.250% 45.000% ( 6, 10 ] 1 1.250% 46.250% ( 51, 76 ] 2 2.500% 48.750% # ( 110, 170 ] 1 1.250% 50.000% ( 170, 250 ] 4 5.000% 55.000% # ( 250, 380 ] 2 2.500% 57.500% # ( 380, 580 ] 2 2.500% 60.000% # ( 580, 870 ] 4 5.000% 65.000% # ( 870, 1300 ] 9 11.250% 76.250% ## ( 1300, 1900 ] 8 10.000% 86.250% ## ( 1900, 2900 ] 7 8.750% 95.000% ## ( 2900, 4400 ] 3 3.750% 98.750% # ( 4400, 6600 ] 1 1.250% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1641.5429 StdDev: 1115.88 Min: 94 Median: 1480.0000 Max: 3984 Percentiles: P50: 1480.00 P75: 2650.00 P99: 3984.00 P99.9: 3984.00 P99.99: 3984.00 ------------------------------------------------------ ( 76, 110 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 380, 580 ] 2 5.714% 17.143% # ( 580, 870 ] 5 14.286% 31.429% ### ( 870, 1300 ] 5 14.286% 45.714% ### ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 7 20.000% 80.000% #### ( 2900, 4400 ] 7 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 315.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.397 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.397 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/06-00:00:48 ... thread 0: (1000000,2000000) ops and (331925.7,335792.5) ops/second in (3.012722,5.956059) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 1.17 GB 6.3 0.6 0.0 0.6 2.3 1.8 0.0 1.3 77.4 326.8 7.32 6.74 27 0.271 575K 659 0.0 0.0 L1 2/2 50.44 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.8 246.3 3.32 3.23 2 1.659 831K 1384 0.0 0.0 L2 5/4 563.88 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.6 1.8 239.2 239.1 0.47 0.44 1 0.466 113K 30 0.0 0.0 L3 16/9 755.46 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 202.7 202.7 0.31 0.26 1 0.309 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1193/24 97.92 GB 0.0 1.5 0.6 0.9 3.3 2.4 0.7 1.9 136.6 296.5 11.41 10.67 31 0.368 1583K 2073 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.3 2.4 0.6 1.9 136.6 296.5 11.41 10.67 31 0.368 1583K 2073 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 251.2 250.9 6.21 6.01 6 1.035 1583K 2073 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.9 5.21 4.66 25 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.30 GB write, 551.93 MB/s write, 1.52 GB read, 254.35 MB/s read, 11.4 seconds Interval compaction: 3.30 GB write, 568.09 MB/s write, 1.52 GB read, 261.79 MB/s read, 11.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 390700 Average: 2.1511 StdDev: 13.47 Min: 1 Median: 1.4422 Max: 3086 Percentiles: P50: 1.44 P75: 1.84 P99: 5.64 P99.9: 10.69 P99.99: 14.59 ------------------------------------------------------ [ 0, 1 ] 87120 22.298% 22.298% #### ( 1, 2 ] 244728 62.638% 84.937% ############# ( 2, 3 ] 34336 8.788% 93.725% ## ( 3, 4 ] 13671 3.499% 97.224% # ( 4, 6 ] 8447 2.162% 99.386% ( 6, 10 ] 1946 0.498% 99.884% ( 10, 15 ] 451 0.115% 100.000% ( 15, 22 ] 34 0.009% 100.008% ( 22, 34 ] 9 0.002% 100.011% ( 34, 51 ] 4 0.001% 100.012% ( 51, 76 ] 4 0.001% 100.013% ( 76, 110 ] 1 0.000% 100.013% ( 110, 170 ] 10 0.003% 100.016% ( 170, 250 ] 9 0.002% 100.018% ( 250, 380 ] 12 0.003% 100.021% ( 380, 580 ] 3 0.001% 100.022% ( 580, 870 ] 5 0.001% 100.023% ( 870, 1300 ] 5 0.001% 100.024% ( 1300, 1900 ] 2 0.001% 100.025% ( 1900, 2900 ] 4 0.001% 100.026% ( 2900, 4400 ] 4 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 131200 Average: 2.4040 StdDev: 18.19 Min: 1 Median: 1.5216 Max: 4102 Percentiles: P50: 1.52 P75: 1.92 P99: 5.94 P99.9: 14.91 P99.99: 572.00 ------------------------------------------------------ [ 0, 1 ] 22847 17.414% 17.414% ### ( 1, 2 ] 81959 62.469% 79.883% ############ ( 2, 3 ] 15687 11.957% 91.839% ## ( 3, 4 ] 5386 4.105% 95.944% # ( 4, 6 ] 4123 3.143% 99.087% # ( 6, 10 ] 887 0.676% 99.763% ( 10, 15 ] 183 0.139% 99.902% ( 15, 22 ] 32 0.024% 99.927% ( 22, 34 ] 7 0.005% 99.932% ( 34, 51 ] 26 0.020% 99.952% ( 51, 76 ] 21 0.016% 99.968% ( 76, 110 ] 6 0.005% 99.973% ( 110, 170 ] 4 0.003% 99.976% ( 170, 250 ] 9 0.007% 99.982% ( 250, 380 ] 7 0.005% 99.988% ( 380, 580 ] 3 0.002% 99.990% ( 580, 870 ] 4 0.003% 99.993% ( 870, 1300 ] 3 0.002% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15932 Average: 1.7450 StdDev: 3.56 Min: 1 Median: 1.1932 Max: 289 Percentiles: P50: 1.19 P75: 1.64 P99: 3.64 P99.9: 10.86 P99.99: 226.27 ------------------------------------------------------ [ 0, 1 ] 6241 39.173% 39.173% ######## ( 1, 2 ] 8929 56.044% 95.217% ########### ( 2, 3 ] 522 3.276% 98.494% # ( 3, 4 ] 127 0.797% 99.291% ( 4, 6 ] 60 0.377% 99.667% ( 6, 10 ] 35 0.220% 99.887% ( 10, 15 ] 12 0.075% 99.962% ( 15, 22 ] 2 0.013% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 83471 Average: 4.0351 StdDev: 44.67 Min: 0 Median: 1.6723 Max: 4670 Percentiles: P50: 1.67 P75: 2.30 P99: 9.62 P99.9: 327.74 P99.99: 1343.53 ------------------------------------------------------ [ 0, 1 ] 7607 9.113% 9.113% ## ( 1, 2 ] 50762 60.814% 69.927% ############ ( 2, 3 ] 13969 16.735% 86.662% ### ( 3, 4 ] 4966 5.949% 92.612% # ( 4, 6 ] 3780 4.529% 97.140% # ( 6, 10 ] 1717 2.057% 99.197% ( 10, 15 ] 276 0.331% 99.528% ( 15, 22 ] 67 0.080% 99.608% ( 22, 34 ] 14 0.017% 99.625% ( 34, 51 ] 2 0.002% 99.627% ( 51, 76 ] 5 0.006% 99.633% ( 76, 110 ] 38 0.046% 99.679% ( 110, 170 ] 110 0.132% 99.811% ( 170, 250 ] 53 0.063% 99.874% ( 250, 380 ] 36 0.043% 99.917% ( 380, 580 ] 30 0.036% 99.953% ( 580, 870 ] 17 0.020% 99.974% ( 870, 1300 ] 13 0.016% 99.989% ( 1300, 1900 ] 9 0.011% 100.000% ( 1900, 2900 ] 7 0.008% 100.008% ( 2900, 4400 ] 3 0.004% 100.012% ( 4400, 6600 ] 1 0.001% 100.013% ** Level 4 read latency histogram (micros): Count: 35 Average: 1641.5429 StdDev: 1115.88 Min: 94 Median: 1480.0000 Max: 3984 Percentiles: P50: 1480.00 P75: 2650.00 P99: 3984.00 P99.9: 3984.00 P99.99: 3984.00 ------------------------------------------------------ ( 76, 110 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 380, 580 ] 2 5.714% 17.143% # ( 580, 870 ] 5 14.286% 31.429% ### ( 870, 1300 ] 5 14.286% 45.714% ### ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 7 20.000% 80.000% #### ( 2900, 4400 ] 7 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.777 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.381 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/06-00:00:51 ... thread 0: (1000000,3000000) ops and (322973.7,331408.0) ops/second in (3.096227,9.052286) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 1.4 0.0 1.4 4.2 2.8 0.0 1.5 105.7 312.3 13.71 12.68 44 0.312 1471K 1599 0.0 0.0 L1 10/0 865.77 MB 86.6 1.6 1.3 0.4 1.6 1.3 0.1 1.3 232.7 232.0 7.25 7.00 3 2.418 1713K 4173 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 239.2 239.1 0.47 0.44 1 0.466 113K 30 0.0 0.0 L3 27/0 965.24 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 208.2 208.1 6.72 5.95 4 1.680 1399K 710 0.0 0.0 L4 148/0 9.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1243/4 98.90 GB 0.0 4.5 2.0 2.6 7.3 4.7 1.3 2.6 165.1 265.5 28.15 26.07 52 0.541 4696K 6512 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 2.0 2.6 7.3 4.7 1.3 2.6 165.1 265.5 28.15 26.07 52 0.541 4696K 6512 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 2.0 2.6 4.5 2.0 0.0 0.0 231.9 231.6 20.03 18.85 13 1.541 4696K 6512 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 349.3 8.11 7.21 39 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.30 GB write, 809.99 MB/s write, 4.54 GB read, 503.53 MB/s read, 28.1 seconds Interval compaction: 7.30 GB write, 825.59 MB/s write, 4.54 GB read, 513.23 MB/s read, 28.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 789305 Average: 2.3645 StdDev: 11.74 Min: 1 Median: 1.5486 Max: 3086 Percentiles: P50: 1.55 P75: 1.95 P99: 5.91 P99.9: 12.08 P99.99: 14.95 ------------------------------------------------------ [ 0, 1 ] 124031 15.714% 15.714% ### ( 1, 2 ] 493327 62.501% 78.215% ############# ( 2, 3 ] 96493 12.225% 90.440% ## ( 3, 4 ] 39346 4.985% 95.425% # ( 4, 6 ] 29529 3.741% 99.166% # ( 6, 10 ] 5273 0.668% 99.835% ( 10, 15 ] 1240 0.157% 99.992% ( 15, 22 ] 112 0.014% 100.006% ( 22, 34 ] 18 0.002% 100.008% ( 34, 51 ] 5 0.001% 100.009% ( 51, 76 ] 9 0.001% 100.010% ( 76, 110 ] 50 0.006% 100.016% ( 110, 170 ] 82 0.010% 100.027% ( 170, 250 ] 45 0.006% 100.032% ( 250, 380 ] 32 0.004% 100.036% ( 380, 580 ] 17 0.002% 100.039% ( 580, 870 ] 15 0.002% 100.040% ( 870, 1300 ] 11 0.001% 100.042% ( 1300, 1900 ] 6 0.001% 100.043% ( 1900, 2900 ] 4 0.001% 100.043% ( 2900, 4400 ] 5 0.001% 100.044% ** Level 1 read latency histogram (micros): Count: 219867 Average: 2.5981 StdDev: 15.89 Min: 0 Median: 1.6218 Max: 4102 Percentiles: P50: 1.62 P75: 2.11 P99: 6.54 P99.9: 18.52 P99.99: 580.39 ------------------------------------------------------ [ 0, 1 ] 25800 11.734% 11.734% ## ( 1, 2 ] 135301 61.538% 73.272% ############ ( 2, 3 ] 34052 15.488% 88.760% ### ( 3, 4 ] 12073 5.491% 94.251% # ( 4, 6 ] 10195 4.637% 98.888% # ( 6, 10 ] 1833 0.834% 99.721% ( 10, 15 ] 365 0.166% 99.887% ( 15, 22 ] 56 0.025% 99.913% ( 22, 34 ] 8 0.004% 99.916% ( 34, 51 ] 27 0.012% 99.929% ( 51, 76 ] 22 0.010% 99.939% ( 76, 110 ] 47 0.021% 99.960% ( 110, 170 ] 20 0.009% 99.969% ( 170, 250 ] 20 0.009% 99.978% ( 250, 380 ] 14 0.006% 99.985% ( 380, 580 ] 12 0.005% 99.990% ( 580, 870 ] 10 0.005% 99.995% ( 870, 1300 ] 4 0.002% 99.996% ( 1300, 1900 ] 4 0.002% 99.998% ( 1900, 2900 ] 3 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28278 Average: 2.0653 StdDev: 2.81 Min: 1 Median: 1.4195 Max: 289 Percentiles: P50: 1.42 P75: 1.84 P99: 5.67 P99.9: 11.95 P99.99: 176.89 ------------------------------------------------------ [ 0, 1 ] 7072 25.009% 25.009% ##### ( 1, 2 ] 16846 59.573% 84.582% ############ ( 2, 3 ] 2352 8.317% 92.899% ## ( 3, 4 ] 1118 3.954% 96.853% # ( 4, 6 ] 727 2.571% 99.424% # ( 6, 10 ] 123 0.435% 99.859% ( 10, 15 ] 30 0.106% 99.965% ( 15, 22 ] 6 0.021% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 196559 Average: 3.7101 StdDev: 33.04 Min: 0 Median: 1.7098 Max: 4670 Percentiles: P50: 1.71 P75: 2.46 P99: 9.46 P99.9: 241.26 P99.99: 778.24 ------------------------------------------------------ [ 0, 1 ] 14421 7.337% 7.337% # ( 1, 2 ] 118150 60.109% 67.446% ############ ( 2, 3 ] 32609 16.590% 84.036% ### ( 3, 4 ] 14466 7.360% 91.395% # ( 4, 6 ] 11248 5.722% 97.118% # ( 6, 10 ] 4274 2.174% 99.292% ( 10, 15 ] 589 0.300% 99.592% ( 15, 22 ] 126 0.064% 99.656% ( 22, 34 ] 31 0.016% 99.672% ( 34, 51 ] 5 0.003% 99.674% ( 51, 76 ] 37 0.019% 99.693% ( 76, 110 ] 86 0.044% 99.737% ( 110, 170 ] 218 0.111% 99.848% ( 170, 250 ] 115 0.059% 99.906% ( 250, 380 ] 78 0.040% 99.946% ( 380, 580 ] 59 0.030% 99.976% ( 580, 870 ] 40 0.020% 99.996% ( 870, 1300 ] 21 0.011% 100.007% ( 1300, 1900 ] 13 0.007% 100.014% ( 1900, 2900 ] 8 0.004% 100.018% ( 2900, 4400 ] 3 0.002% 100.019% ( 4400, 6600 ] 1 0.001% 100.020% ** Level 4 read latency histogram (micros): Count: 35 Average: 1641.5429 StdDev: 1115.88 Min: 94 Median: 1480.0000 Max: 3984 Percentiles: P50: 1480.00 P75: 2650.00 P99: 3984.00 P99.9: 3984.00 P99.99: 3984.00 ------------------------------------------------------ ( 76, 110 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 380, 580 ] 2 5.714% 17.143% # ( 580, 870 ] 5 14.286% 31.429% ### ( 870, 1300 ] 5 14.286% 45.714% ### ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 7 20.000% 80.000% #### ( 2900, 4400 ] 7 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 757.6000 StdDev: 961.83 Min: 102 Median: 223.3333 Max: 3358 Percentiles: P50: 223.33 P75: 1085.00 P99: 3358.00 P99.9: 3358.00 P99.99: 3358.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 7 35.000% 40.000% ####### ( 170, 250 ] 3 15.000% 55.000% ### ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 319.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.191 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.413 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/06-00:00:54 ... thread 0: (1000000,4000000) ops and (340824.0,333712.9) ops/second in (2.934066,11.986352) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 2.27 GB 88.1 2.2 0.0 2.2 5.9 3.7 0.0 1.6 116.5 310.6 19.47 18.09 60 0.324 2302K 2452 0.0 0.0 L1 10/10 865.77 MB 0.0 1.6 1.3 0.4 1.6 1.3 0.1 1.3 232.7 232.0 7.25 7.00 3 2.418 1713K 4173 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 239.2 239.1 0.47 0.44 1 0.466 113K 30 0.0 0.0 L3 27/0 965.24 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 208.2 208.1 6.72 5.95 4 1.680 1399K 710 0.0 0.0 L4 148/0 9.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/18 99.82 GB 0.0 5.3 2.0 3.4 9.0 5.6 1.3 2.4 161.2 272.5 33.90 31.48 68 0.499 5528K 7365 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 2.0 3.4 9.0 5.6 1.3 2.4 161.2 272.5 33.90 31.48 68 0.499 5528K 7365 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 2.0 3.4 5.3 2.0 0.0 0.0 235.9 235.6 23.17 21.93 16 1.448 5528K 7365 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 352.0 10.74 9.55 52 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.02 GB write, 759.55 MB/s write, 5.34 GB read, 449.40 MB/s read, 33.9 seconds Interval compaction: 9.02 GB write, 770.59 MB/s write, 5.34 GB read, 455.93 MB/s read, 33.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1045993 Average: 2.3223 StdDev: 11.85 Min: 1 Median: 1.5296 Max: 3135 Percentiles: P50: 1.53 P75: 1.92 P99: 5.85 P99.9: 11.72 P99.99: 14.89 ------------------------------------------------------ [ 0, 1 ] 171830 16.427% 16.427% ### ( 1, 2 ] 663077 63.392% 79.820% ############# ( 2, 3 ] 120745 11.544% 91.363% ## ( 3, 4 ] 47753 4.565% 95.928% # ( 4, 6 ] 34673 3.315% 99.243% # ( 6, 10 ] 6357 0.608% 99.851% ( 10, 15 ] 1487 0.142% 99.993% ( 15, 22 ] 136 0.013% 100.006% ( 22, 34 ] 21 0.002% 100.008% ( 34, 51 ] 7 0.001% 100.009% ( 51, 76 ] 10 0.001% 100.010% ( 76, 110 ] 58 0.006% 100.015% ( 110, 170 ] 97 0.009% 100.025% ( 170, 250 ] 55 0.005% 100.030% ( 250, 380 ] 39 0.004% 100.034% ( 380, 580 ] 23 0.002% 100.036% ( 580, 870 ] 23 0.002% 100.038% ( 870, 1300 ] 15 0.001% 100.039% ( 1300, 1900 ] 9 0.001% 100.040% ( 1900, 2900 ] 5 0.000% 100.041% ( 2900, 4400 ] 6 0.001% 100.041% ** Level 1 read latency histogram (micros): Count: 278197 Average: 2.6232 StdDev: 15.56 Min: 0 Median: 1.5841 Max: 4102 Percentiles: P50: 1.58 P75: 1.99 P99: 7.16 P99.9: 93.84 P99.99: 643.80 ------------------------------------------------------ [ 0, 1 ] 38267 13.755% 13.755% ### ( 1, 2 ] 172631 62.054% 75.809% ############ ( 2, 3 ] 38730 13.922% 89.731% ### ( 3, 4 ] 13704 4.926% 94.657% # ( 4, 6 ] 11317 4.068% 98.725% # ( 6, 10 ] 2638 0.948% 99.673% ( 10, 15 ] 460 0.165% 99.838% ( 15, 22 ] 62 0.022% 99.861% ( 22, 34 ] 10 0.004% 99.864% ( 34, 51 ] 28 0.010% 99.874% ( 51, 76 ] 23 0.008% 99.882% ( 76, 110 ] 93 0.033% 99.916% ( 110, 170 ] 111 0.040% 99.956% ( 170, 250 ] 37 0.013% 99.969% ( 250, 380 ] 31 0.011% 99.980% ( 380, 580 ] 23 0.008% 99.988% ( 580, 870 ] 19 0.007% 99.995% ( 870, 1300 ] 5 0.002% 99.997% ( 1300, 1900 ] 4 0.001% 99.999% ( 1900, 2900 ] 3 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28278 Average: 2.0653 StdDev: 2.81 Min: 1 Median: 1.4195 Max: 289 Percentiles: P50: 1.42 P75: 1.84 P99: 5.67 P99.9: 11.95 P99.99: 176.89 ------------------------------------------------------ [ 0, 1 ] 7072 25.009% 25.009% ##### ( 1, 2 ] 16846 59.573% 84.582% ############ ( 2, 3 ] 2352 8.317% 92.899% ## ( 3, 4 ] 1118 3.954% 96.853% # ( 4, 6 ] 727 2.571% 99.424% # ( 6, 10 ] 123 0.435% 99.859% ( 10, 15 ] 30 0.106% 99.965% ( 15, 22 ] 6 0.021% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 196559 Average: 3.7101 StdDev: 33.04 Min: 0 Median: 1.7098 Max: 4670 Percentiles: P50: 1.71 P75: 2.46 P99: 9.46 P99.9: 241.26 P99.99: 778.24 ------------------------------------------------------ [ 0, 1 ] 14421 7.337% 7.337% # ( 1, 2 ] 118150 60.109% 67.446% ############ ( 2, 3 ] 32609 16.590% 84.036% ### ( 3, 4 ] 14466 7.360% 91.395% # ( 4, 6 ] 11248 5.722% 97.118% # ( 6, 10 ] 4274 2.174% 99.292% ( 10, 15 ] 589 0.300% 99.592% ( 15, 22 ] 126 0.064% 99.656% ( 22, 34 ] 31 0.016% 99.672% ( 34, 51 ] 5 0.003% 99.674% ( 51, 76 ] 37 0.019% 99.693% ( 76, 110 ] 86 0.044% 99.737% ( 110, 170 ] 218 0.111% 99.848% ( 170, 250 ] 115 0.059% 99.906% ( 250, 380 ] 78 0.040% 99.946% ( 380, 580 ] 59 0.030% 99.976% ( 580, 870 ] 40 0.020% 99.996% ( 870, 1300 ] 21 0.011% 100.007% ( 1300, 1900 ] 13 0.007% 100.014% ( 1900, 2900 ] 8 0.004% 100.018% ( 2900, 4400 ] 3 0.002% 100.019% ( 4400, 6600 ] 1 0.001% 100.020% ** Level 4 read latency histogram (micros): Count: 35 Average: 1641.5429 StdDev: 1115.88 Min: 94 Median: 1480.0000 Max: 3984 Percentiles: P50: 1480.00 P75: 2650.00 P99: 3984.00 P99.9: 3984.00 P99.99: 3984.00 ------------------------------------------------------ ( 76, 110 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 380, 580 ] 2 5.714% 17.143% # ( 580, 870 ] 5 14.286% 31.429% ### ( 870, 1300 ] 5 14.286% 45.714% ### ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 7 20.000% 80.000% #### ( 2900, 4400 ] 7 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 757.6000 StdDev: 961.83 Min: 102 Median: 223.3333 Max: 3358 Percentiles: P50: 223.33 P75: 1085.00 P99: 3358.00 P99.9: 3358.00 P99.99: 3358.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 7 35.000% 40.000% ####### ( 170, 250 ] 3 15.000% 55.000% ### ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.548 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.357 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/06-00:00:58 ... thread 0: (1000000,5000000) ops and (277381.3,320687.6) ops/second in (3.605146,15.591498) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.26 GB 163.6 3.1 0.0 3.1 7.7 4.7 0.0 1.7 123.2 310.4 25.56 23.84 77 0.332 3198K 3438 0.0 0.0 L1 10/10 865.77 MB 0.0 1.6 1.3 0.4 1.6 1.3 0.1 1.3 232.7 232.0 7.25 7.00 3 2.418 1713K 4173 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 239.2 239.1 0.47 0.44 1 0.466 113K 30 0.0 0.0 L3 27/0 965.24 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 208.2 208.1 6.72 5.95 4 1.680 1399K 710 0.0 0.0 L4 148/0 9.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/22 100.80 GB 0.0 6.2 2.0 4.2 10.9 6.6 1.3 2.3 158.7 278.2 40.00 37.22 85 0.471 6423K 8351 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 2.0 4.2 10.9 6.6 1.3 2.3 158.7 278.2 40.00 37.22 85 0.471 6423K 8351 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 2.0 4.2 6.2 2.0 0.0 0.0 240.3 239.9 26.42 25.12 19 1.390 6423K 8351 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 352.5 13.58 12.11 66 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.6 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.87 GB write, 705.67 MB/s write, 6.20 GB read, 402.58 MB/s read, 40.0 seconds Interval compaction: 10.87 GB write, 713.57 MB/s write, 6.20 GB read, 407.08 MB/s read, 40.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 19, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1446674 Average: 2.3075 StdDev: 12.15 Min: 1 Median: 1.5182 Max: 3876 Percentiles: P50: 1.52 P75: 1.90 P99: 5.82 P99.9: 11.67 P99.99: 18.45 ------------------------------------------------------ [ 0, 1 ] 237864 16.442% 16.442% ### ( 1, 2 ] 936907 64.763% 81.205% ############# ( 2, 3 ] 158171 10.933% 92.138% ## ( 3, 4 ] 60934 4.212% 96.350% # ( 4, 6 ] 42157 2.914% 99.264% # ( 6, 10 ] 8583 0.593% 99.858% ( 10, 15 ] 1838 0.127% 99.985% ( 15, 22 ] 157 0.011% 99.996% ( 22, 34 ] 23 0.002% 99.997% ( 34, 51 ] 10 0.001% 99.998% ( 51, 76 ] 12 0.001% 99.999% ( 76, 110 ] 130 0.009% 100.008% ( 110, 170 ] 161 0.011% 100.019% ( 170, 250 ] 96 0.007% 100.026% ( 250, 380 ] 75 0.005% 100.031% ( 380, 580 ] 40 0.003% 100.033% ( 580, 870 ] 32 0.002% 100.036% ( 870, 1300 ] 20 0.001% 100.037% ( 1300, 1900 ] 11 0.001% 100.038% ( 1900, 2900 ] 6 0.000% 100.038% ( 2900, 4400 ] 9 0.001% 100.039% ** Level 1 read latency histogram (micros): Count: 352388 Average: 2.6332 StdDev: 15.33 Min: 0 Median: 1.5738 Max: 4102 Percentiles: P50: 1.57 P75: 1.97 P99: 7.48 P99.9: 107.30 P99.99: 603.21 ------------------------------------------------------ [ 0, 1 ] 47505 13.481% 13.481% ### ( 1, 2 ] 224272 63.643% 77.124% ############# ( 2, 3 ] 46611 13.227% 90.352% ### ( 3, 4 ] 16192 4.595% 94.946% # ( 4, 6 ] 12891 3.658% 98.605% # ( 6, 10 ] 3762 1.068% 99.672% ( 10, 15 ] 511 0.145% 99.817% ( 15, 22 ] 65 0.018% 99.836% ( 22, 34 ] 10 0.003% 99.839% ( 34, 51 ] 28 0.008% 99.846% ( 51, 76 ] 23 0.007% 99.853% ( 76, 110 ] 181 0.051% 99.904% ( 110, 170 ] 161 0.046% 99.950% ( 170, 250 ] 61 0.017% 99.967% ( 250, 380 ] 45 0.013% 99.980% ( 380, 580 ] 34 0.010% 99.990% ( 580, 870 ] 22 0.006% 99.996% ( 870, 1300 ] 6 0.002% 99.998% ( 1300, 1900 ] 4 0.001% 99.999% ( 1900, 2900 ] 4 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28278 Average: 2.0653 StdDev: 2.81 Min: 1 Median: 1.4195 Max: 289 Percentiles: P50: 1.42 P75: 1.84 P99: 5.67 P99.9: 11.95 P99.99: 176.89 ------------------------------------------------------ [ 0, 1 ] 7072 25.009% 25.009% ##### ( 1, 2 ] 16846 59.573% 84.582% ############ ( 2, 3 ] 2352 8.317% 92.899% ## ( 3, 4 ] 1118 3.954% 96.853% # ( 4, 6 ] 727 2.571% 99.424% # ( 6, 10 ] 123 0.435% 99.859% ( 10, 15 ] 30 0.106% 99.965% ( 15, 22 ] 6 0.021% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 196559 Average: 3.7101 StdDev: 33.04 Min: 0 Median: 1.7098 Max: 4670 Percentiles: P50: 1.71 P75: 2.46 P99: 9.46 P99.9: 241.26 P99.99: 778.24 ------------------------------------------------------ [ 0, 1 ] 14421 7.337% 7.337% # ( 1, 2 ] 118150 60.109% 67.446% ############ ( 2, 3 ] 32609 16.590% 84.036% ### ( 3, 4 ] 14466 7.360% 91.395% # ( 4, 6 ] 11248 5.722% 97.118% # ( 6, 10 ] 4274 2.174% 99.292% ( 10, 15 ] 589 0.300% 99.592% ( 15, 22 ] 126 0.064% 99.656% ( 22, 34 ] 31 0.016% 99.672% ( 34, 51 ] 5 0.003% 99.674% ( 51, 76 ] 37 0.019% 99.693% ( 76, 110 ] 86 0.044% 99.737% ( 110, 170 ] 218 0.111% 99.848% ( 170, 250 ] 115 0.059% 99.906% ( 250, 380 ] 78 0.040% 99.946% ( 380, 580 ] 59 0.030% 99.976% ( 580, 870 ] 40 0.020% 99.996% ( 870, 1300 ] 21 0.011% 100.007% ( 1300, 1900 ] 13 0.007% 100.014% ( 1900, 2900 ] 8 0.004% 100.018% ( 2900, 4400 ] 3 0.002% 100.019% ( 4400, 6600 ] 1 0.001% 100.020% ** Level 4 read latency histogram (micros): Count: 35 Average: 1641.5429 StdDev: 1115.88 Min: 94 Median: 1480.0000 Max: 3984 Percentiles: P50: 1480.00 P75: 2650.00 P99: 3984.00 P99.9: 3984.00 P99.99: 3984.00 ------------------------------------------------------ ( 76, 110 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 380, 580 ] 2 5.714% 17.143% # ( 580, 870 ] 5 14.286% 31.429% ### ( 870, 1300 ] 5 14.286% 45.714% ### ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 7 20.000% 80.000% #### ( 2900, 4400 ] 7 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 757.6000 StdDev: 961.83 Min: 102 Median: 223.3333 Max: 3358 Percentiles: P50: 223.33 P75: 1085.00 P99: 3358.00 P99.9: 3358.00 P99.99: 3358.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 7 35.000% 40.000% ####### ( 170, 250 ] 3 15.000% 55.000% ### ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.8 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 312.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.548 H:M:S, 16.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 273.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.000 H:M:S, 27.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-00:01:03 ... thread 0: (1000000,6000000) ops and (201338.1,291853.4) ops/second in (4.966770,20.558268) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/8 2.77 GB 176.2 3.8 0.0 3.8 9.4 5.6 0.0 1.7 125.3 309.2 31.16 29.03 95 0.328 3965K 4144 0.0 0.0 L1 16/0 1.23 GB 126.1 3.9 2.7 1.2 3.9 2.7 0.1 1.4 229.0 227.5 17.47 16.80 4 4.368 4062K 25K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.6 1.8 239.2 239.1 0.47 0.44 1 0.466 113K 30 0.0 0.0 L3 14/0 929.17 MB 0.9 1.4 0.6 0.8 1.4 0.6 1.0 2.2 208.2 208.1 6.72 5.95 4 1.680 1399K 710 0.0 0.0 L4 169/0 9.63 GB 1.0 0.3 0.3 0.0 0.3 0.3 1.1 1.1 180.6 180.1 1.80 1.51 2 0.900 300K 823 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1276/8 101.70 GB 0.0 9.5 3.7 5.9 15.1 9.2 5.1 2.7 169.1 268.0 57.62 53.73 106 0.544 9841K 31K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.5 3.7 5.9 15.1 9.2 5.0 2.7 169.1 268.0 57.62 53.73 106 0.544 9841K 31K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.5 3.7 5.9 9.5 3.6 0.0 0.0 236.0 235.2 41.28 39.20 25 1.651 9841K 31K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 350.9 16.34 14.52 81 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.7 total, 20.6 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.08 GB write, 744.81 MB/s write, 9.51 GB read, 469.87 MB/s read, 57.6 seconds Interval compaction: 15.08 GB write, 751.13 MB/s write, 9.51 GB read, 473.86 MB/s read, 57.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 19, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1912663 Average: 2.2889 StdDev: 11.72 Min: 1 Median: 1.5129 Max: 4170 Percentiles: P50: 1.51 P75: 1.90 P99: 5.83 P99.9: 11.70 P99.99: 20.16 ------------------------------------------------------ [ 0, 1 ] 317185 16.583% 16.583% ### ( 1, 2 ] 1246082 65.149% 81.732% ############# ( 2, 3 ] 203568 10.643% 92.376% ## ( 3, 4 ] 77861 4.071% 96.446% # ( 4, 6 ] 53523 2.798% 99.245% # ( 6, 10 ] 11721 0.613% 99.858% ( 10, 15 ] 2381 0.124% 99.982% ( 15, 22 ] 206 0.011% 99.993% ( 22, 34 ] 28 0.001% 99.994% ( 34, 51 ] 13 0.001% 99.995% ( 51, 76 ] 14 0.001% 99.996% ( 76, 110 ] 184 0.010% 100.005% ( 110, 170 ] 212 0.011% 100.016% ( 170, 250 ] 117 0.006% 100.023% ( 250, 380 ] 86 0.004% 100.027% ( 380, 580 ] 46 0.002% 100.029% ( 580, 870 ] 41 0.002% 100.032% ( 870, 1300 ] 28 0.001% 100.033% ( 1300, 1900 ] 13 0.001% 100.034% ( 1900, 2900 ] 7 0.000% 100.034% ( 2900, 4400 ] 10 0.001% 100.035% ** Level 1 read latency histogram (micros): Count: 472514 Average: 2.6716 StdDev: 15.49 Min: 0 Median: 1.5683 Max: 4102 Percentiles: P50: 1.57 P75: 1.96 P99: 7.74 P99.9: 119.92 P99.99: 652.49 ------------------------------------------------------ [ 0, 1 ] 64343 13.617% 13.617% ### ( 1, 2 ] 302491 64.017% 77.635% ############# ( 2, 3 ] 61162 12.944% 90.578% ### ( 3, 4 ] 20790 4.400% 94.978% # ( 4, 6 ] 16657 3.525% 98.504% # ( 6, 10 ] 5394 1.142% 99.645% ( 10, 15 ] 686 0.145% 99.790% ( 15, 22 ] 86 0.018% 99.808% ( 22, 34 ] 14 0.003% 99.811% ( 34, 51 ] 28 0.006% 99.817% ( 51, 76 ] 41 0.009% 99.826% ( 76, 110 ] 306 0.065% 99.891% ( 110, 170 ] 263 0.056% 99.946% ( 170, 250 ] 73 0.015% 99.962% ( 250, 380 ] 68 0.014% 99.976% ( 380, 580 ] 57 0.012% 99.988% ( 580, 870 ] 31 0.007% 99.995% ( 870, 1300 ] 10 0.002% 99.997% ( 1300, 1900 ] 9 0.002% 99.999% ( 1900, 2900 ] 4 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28278 Average: 2.0653 StdDev: 2.81 Min: 1 Median: 1.4195 Max: 289 Percentiles: P50: 1.42 P75: 1.84 P99: 5.67 P99.9: 11.95 P99.99: 176.89 ------------------------------------------------------ [ 0, 1 ] 7072 25.009% 25.009% ##### ( 1, 2 ] 16846 59.573% 84.582% ############ ( 2, 3 ] 2352 8.317% 92.899% ## ( 3, 4 ] 1118 3.954% 96.853% # ( 4, 6 ] 727 2.571% 99.424% # ( 6, 10 ] 123 0.435% 99.859% ( 10, 15 ] 30 0.106% 99.965% ( 15, 22 ] 6 0.021% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 246434 Average: 4.0178 StdDev: 33.93 Min: 0 Median: 1.7323 Max: 4670 Percentiles: P50: 1.73 P75: 2.51 P99: 9.72 P99.9: 327.79 P99.99: 810.86 ------------------------------------------------------ [ 0, 1 ] 15899 6.452% 6.452% # ( 1, 2 ] 146545 59.466% 65.918% ############ ( 2, 3 ] 43965 17.840% 83.758% #### ( 3, 4 ] 18225 7.395% 91.154% # ( 4, 6 ] 14369 5.831% 96.985% # ( 6, 10 ] 5342 2.168% 99.152% ( 10, 15 ] 749 0.304% 99.456% ( 15, 22 ] 150 0.061% 99.517% ( 22, 34 ] 31 0.013% 99.530% ( 34, 51 ] 5 0.002% 99.532% ( 51, 76 ] 42 0.017% 99.549% ( 76, 110 ] 202 0.082% 99.631% ( 110, 170 ] 389 0.158% 99.789% ( 170, 250 ] 189 0.077% 99.865% ( 250, 380 ] 143 0.058% 99.923% ( 380, 580 ] 115 0.047% 99.970% ( 580, 870 ] 62 0.025% 99.995% ( 870, 1300 ] 23 0.009% 100.004% ( 1300, 1900 ] 15 0.006% 100.011% ( 1900, 2900 ] 11 0.004% 100.015% ( 2900, 4400 ] 4 0.002% 100.017% ( 4400, 6600 ] 1 0.000% 100.017% ** Level 4 read latency histogram (micros): Count: 140 Average: 435.4571 StdDev: 895.84 Min: 1 Median: 6.4444 Max: 3984 Percentiles: P50: 6.44 P75: 315.00 P99: 3984.00 P99.9: 3984.00 P99.99: 3984.00 ------------------------------------------------------ [ 0, 1 ] 30 21.429% 21.429% #### ( 1, 2 ] 32 22.857% 44.286% ##### ( 2, 3 ] 2 1.429% 45.714% ( 3, 4 ] 1 0.714% 46.429% ( 4, 6 ] 4 2.857% 49.286% # ( 6, 10 ] 9 6.429% 55.714% # ( 15, 22 ] 2 1.429% 57.143% ( 22, 34 ] 10 7.143% 64.286% # ( 34, 51 ] 4 2.857% 67.143% # ( 76, 110 ] 2 1.429% 68.571% ( 110, 170 ] 4 2.857% 71.429% # ( 170, 250 ] 2 1.429% 72.857% ( 250, 380 ] 6 4.286% 77.143% # ( 380, 580 ] 2 1.429% 78.571% ( 580, 870 ] 6 4.286% 82.857% # ( 870, 1300 ] 5 3.571% 86.429% # ( 1300, 1900 ] 5 3.571% 90.000% # ( 1900, 2900 ] 7 5.000% 95.000% # ( 2900, 4400 ] 7 5.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 788.7250 StdDev: 994.46 Min: 79 Median: 305.7143 Max: 4290 Percentiles: P50: 305.71 P75: 1085.00 P99: 4100.00 P99.9: 4290.00 P99.99: 4290.00 ------------------------------------------------------ ( 76, 110 ] 10 12.500% 12.500% ### ( 110, 170 ] 19 23.750% 36.250% ##### ( 170, 250 ] 8 10.000% 46.250% ## ( 250, 380 ] 7 8.750% 55.000% ## ( 380, 580 ] 9 11.250% 66.250% ## ( 580, 870 ] 4 5.000% 71.250% # ( 870, 1300 ] 6 7.500% 78.750% ## ( 1300, 1900 ] 5 6.250% 85.000% # ( 1900, 2900 ] 8 10.000% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 20.7 total, 5.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 284.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.872 H:M:S, 23.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 198.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.324 H:M:S, 46.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-00:01:06 ... thread 0: (1000000,7000000) ops and (337843.4,297641.6) ops/second in (2.959951,23.518219) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 3.75 GB 6.3 5.7 0.0 5.7 12.2 6.6 0.0 1.9 141.0 304.7 41.11 38.55 114 0.361 5884K 7734 0.0 0.0 L1 16/16 1.23 GB 0.0 3.9 2.7 1.2 3.9 2.7 0.1 1.4 229.0 227.5 17.47 16.80 4 4.368 4062K 25K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.6 1.8 239.2 239.1 0.47 0.44 1 0.466 113K 30 0.0 0.0 L3 14/0 929.17 MB 0.9 1.4 0.6 0.8 1.4 0.6 1.0 2.2 208.2 208.1 6.72 5.95 4 1.680 1399K 710 0.0 0.0 L4 169/0 9.63 GB 1.0 0.3 0.3 0.0 0.3 0.3 1.1 1.1 180.6 180.1 1.80 1.51 2 0.900 300K 823 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/31 102.68 GB 0.0 11.4 3.7 7.7 17.9 10.2 5.1 2.7 172.1 271.4 67.57 63.24 125 0.541 11M 35K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.4 3.7 7.7 17.9 10.2 5.0 2.7 172.1 271.4 67.57 63.24 125 0.541 11M 35K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.4 3.7 7.7 11.3 3.6 0.0 0.0 240.1 239.4 48.44 46.24 30 1.615 11M 35K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.5 19.12 17.00 95 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.7 total, 23.5 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.91 GB write, 773.89 MB/s write, 11.36 GB read, 490.91 MB/s read, 67.6 seconds Interval compaction: 17.91 GB write, 779.62 MB/s write, 11.36 GB read, 494.55 MB/s read, 67.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 22, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2216818 Average: 2.2811 StdDev: 11.56 Min: 0 Median: 1.5001 Max: 4170 Percentiles: P50: 1.50 P75: 1.88 P99: 5.80 P99.9: 12.26 P99.99: 93.60 ------------------------------------------------------ [ 0, 1 ] 386429 17.432% 17.432% ### ( 1, 2 ] 1443595 65.120% 82.552% ############# ( 2, 3 ] 226603 10.222% 92.774% ## ( 3, 4 ] 85763 3.869% 96.643% # ( 4, 6 ] 58001 2.616% 99.259% # ( 6, 10 ] 12969 0.585% 99.844% ( 10, 15 ] 2745 0.124% 99.968% ( 15, 22 ] 220 0.010% 99.978% ( 22, 34 ] 28 0.001% 99.979% ( 34, 51 ] 17 0.001% 99.980% ( 51, 76 ] 26 0.001% 99.981% ( 76, 110 ] 389 0.018% 99.999% ( 110, 170 ] 311 0.014% 100.013% ( 170, 250 ] 166 0.007% 100.020% ( 250, 380 ] 111 0.005% 100.025% ( 380, 580 ] 62 0.003% 100.028% ( 580, 870 ] 50 0.002% 100.030% ( 870, 1300 ] 33 0.001% 100.032% ( 1300, 1900 ] 16 0.001% 100.032% ( 1900, 2900 ] 8 0.000% 100.033% ( 2900, 4400 ] 10 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 472515 Average: 2.6720 StdDev: 15.49 Min: 0 Median: 1.5683 Max: 4102 Percentiles: P50: 1.57 P75: 1.96 P99: 7.74 P99.9: 120.15 P99.99: 652.49 ------------------------------------------------------ [ 0, 1 ] 64343 13.617% 13.617% ### ( 1, 2 ] 302491 64.017% 77.634% ############# ( 2, 3 ] 61162 12.944% 90.578% ### ( 3, 4 ] 20790 4.400% 94.978% # ( 4, 6 ] 16657 3.525% 98.503% # ( 6, 10 ] 5394 1.142% 99.645% ( 10, 15 ] 686 0.145% 99.790% ( 15, 22 ] 86 0.018% 99.808% ( 22, 34 ] 14 0.003% 99.811% ( 34, 51 ] 28 0.006% 99.817% ( 51, 76 ] 41 0.009% 99.826% ( 76, 110 ] 306 0.065% 99.891% ( 110, 170 ] 263 0.056% 99.946% ( 170, 250 ] 74 0.016% 99.962% ( 250, 380 ] 68 0.014% 99.976% ( 380, 580 ] 57 0.012% 99.988% ( 580, 870 ] 31 0.007% 99.995% ( 870, 1300 ] 10 0.002% 99.997% ( 1300, 1900 ] 9 0.002% 99.999% ( 1900, 2900 ] 4 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28278 Average: 2.0653 StdDev: 2.81 Min: 1 Median: 1.4195 Max: 289 Percentiles: P50: 1.42 P75: 1.84 P99: 5.67 P99.9: 11.95 P99.99: 176.89 ------------------------------------------------------ [ 0, 1 ] 7072 25.009% 25.009% ##### ( 1, 2 ] 16846 59.573% 84.582% ############ ( 2, 3 ] 2352 8.317% 92.899% ## ( 3, 4 ] 1118 3.954% 96.853% # ( 4, 6 ] 727 2.571% 99.424% # ( 6, 10 ] 123 0.435% 99.859% ( 10, 15 ] 30 0.106% 99.965% ( 15, 22 ] 6 0.021% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 246434 Average: 4.0178 StdDev: 33.93 Min: 0 Median: 1.7323 Max: 4670 Percentiles: P50: 1.73 P75: 2.51 P99: 9.72 P99.9: 327.79 P99.99: 810.86 ------------------------------------------------------ [ 0, 1 ] 15899 6.452% 6.452% # ( 1, 2 ] 146545 59.466% 65.918% ############ ( 2, 3 ] 43965 17.840% 83.758% #### ( 3, 4 ] 18225 7.395% 91.154% # ( 4, 6 ] 14369 5.831% 96.985% # ( 6, 10 ] 5342 2.168% 99.152% ( 10, 15 ] 749 0.304% 99.456% ( 15, 22 ] 150 0.061% 99.517% ( 22, 34 ] 31 0.013% 99.530% ( 34, 51 ] 5 0.002% 99.532% ( 51, 76 ] 42 0.017% 99.549% ( 76, 110 ] 202 0.082% 99.631% ( 110, 170 ] 389 0.158% 99.789% ( 170, 250 ] 189 0.077% 99.865% ( 250, 380 ] 143 0.058% 99.923% ( 380, 580 ] 115 0.047% 99.970% ( 580, 870 ] 62 0.025% 99.995% ( 870, 1300 ] 23 0.009% 100.004% ( 1300, 1900 ] 15 0.006% 100.011% ( 1900, 2900 ] 11 0.004% 100.015% ( 2900, 4400 ] 4 0.002% 100.017% ( 4400, 6600 ] 1 0.000% 100.017% ** Level 4 read latency histogram (micros): Count: 140 Average: 435.4571 StdDev: 895.84 Min: 1 Median: 6.4444 Max: 3984 Percentiles: P50: 6.44 P75: 315.00 P99: 3984.00 P99.9: 3984.00 P99.99: 3984.00 ------------------------------------------------------ [ 0, 1 ] 30 21.429% 21.429% #### ( 1, 2 ] 32 22.857% 44.286% ##### ( 2, 3 ] 2 1.429% 45.714% ( 3, 4 ] 1 0.714% 46.429% ( 4, 6 ] 4 2.857% 49.286% # ( 6, 10 ] 9 6.429% 55.714% # ( 15, 22 ] 2 1.429% 57.143% ( 22, 34 ] 10 7.143% 64.286% # ( 34, 51 ] 4 2.857% 67.143% # ( 76, 110 ] 2 1.429% 68.571% ( 110, 170 ] 4 2.857% 71.429% # ( 170, 250 ] 2 1.429% 72.857% ( 250, 380 ] 6 4.286% 77.143% # ( 380, 580 ] 2 1.429% 78.571% ( 580, 870 ] 6 4.286% 82.857% # ( 870, 1300 ] 5 3.571% 86.429% # ( 1300, 1900 ] 5 3.571% 90.000% # ( 1900, 2900 ] 7 5.000% 95.000% # ( 2900, 4400 ] 7 5.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 788.7250 StdDev: 994.46 Min: 79 Median: 305.7143 Max: 4290 Percentiles: P50: 305.71 P75: 1085.00 P99: 4100.00 P99.9: 4290.00 P99.99: 4290.00 ------------------------------------------------------ ( 76, 110 ] 10 12.500% 12.500% ### ( 110, 170 ] 19 23.750% 36.250% ##### ( 170, 250 ] 8 10.000% 46.250% ## ( 250, 380 ] 7 8.750% 55.000% ## ( 380, 580 ] 9 11.250% 66.250% ## ( 580, 870 ] 4 5.000% 71.250% # ( 870, 1300 ] 6 7.500% 78.750% ## ( 1300, 1900 ] 5 6.250% 85.000% # ( 1900, 2900 ] 8 10.000% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 23.7 total, 3.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 290.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.267 H:M:S, 22.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.395 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/06-00:01:28 ... thread 0: (1000000,8000000) ops and (45174.0,175227.8) ops/second in (22.136644,45.654863) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 4.85 GB 119.3 7.5 0.0 7.5 15.2 7.7 0.0 2.0 149.0 301.4 51.59 48.32 136 0.379 7802K 11K 0.0 0.0 L1 16/16 1.23 GB 0.0 3.9 2.7 1.2 3.9 2.7 0.1 1.4 229.0 227.5 17.47 16.80 4 4.368 4062K 25K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.6 1.8 239.2 239.1 0.47 0.44 1 0.466 113K 30 0.0 0.0 L3 14/0 929.17 MB 0.9 1.4 0.6 0.8 1.4 0.6 1.0 2.2 208.2 208.1 6.72 5.95 4 1.680 1399K 710 0.0 0.0 L4 169/0 9.63 GB 1.0 0.3 0.3 0.0 0.3 0.3 1.1 1.1 180.6 180.1 1.80 1.51 2 0.900 300K 823 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/31 103.79 GB 0.0 13.2 3.7 9.5 20.9 11.3 5.1 2.7 173.2 273.6 78.04 73.01 147 0.531 13M 38K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.2 3.7 9.5 20.9 11.3 5.0 2.7 173.2 273.6 78.04 73.01 147 0.531 13M 38K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.2 3.7 9.5 13.2 3.6 0.0 0.0 242.7 242.0 55.71 53.14 35 1.592 13M 38K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.7 7.7 0.0 0.0 0.0 352.6 22.33 19.87 112 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.8 total, 45.7 interval Flush(GB): cumulative 7.690, interval 7.690 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.86 GB write, 465.97 MB/s write, 13.20 GB read, 295.01 MB/s read, 78.0 seconds Interval compaction: 20.86 GB write, 467.75 MB/s write, 13.20 GB read, 296.14 MB/s read, 78.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 24, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3620991 Average: 2.6548 StdDev: 15.58 Min: 0 Median: 1.4463 Max: 4170 Percentiles: P50: 1.45 P75: 1.83 P99: 6.44 P99.9: 146.52 P99.99: 303.05 ------------------------------------------------------ [ 0, 1 ] 769302 21.246% 21.246% #### ( 1, 2 ] 2333065 64.432% 85.677% ############# ( 2, 3 ] 291133 8.040% 93.717% ## ( 3, 4 ] 112863 3.117% 96.834% # ( 4, 6 ] 76145 2.103% 98.937% ( 6, 10 ] 20740 0.573% 99.510% ( 10, 15 ] 4065 0.112% 99.622% ( 15, 22 ] 668 0.018% 99.641% ( 22, 34 ] 35 0.001% 99.642% ( 34, 51 ] 23 0.001% 99.642% ( 51, 76 ] 551 0.015% 99.658% ( 76, 110 ] 5805 0.160% 99.818% ( 110, 170 ] 4889 0.135% 99.953% ( 170, 250 ] 1048 0.029% 99.982% ( 250, 380 ] 730 0.020% 100.002% ( 380, 580 ] 511 0.014% 100.016% ( 580, 870 ] 213 0.006% 100.022% ( 870, 1300 ] 53 0.001% 100.023% ( 1300, 1900 ] 19 0.001% 100.024% ( 1900, 2900 ] 20 0.001% 100.024% ( 2900, 4400 ] 18 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 777432 Average: 2.6921 StdDev: 15.35 Min: 0 Median: 1.4686 Max: 4102 Percentiles: P50: 1.47 P75: 1.87 P99: 7.97 P99.9: 150.82 P99.99: 572.51 ------------------------------------------------------ [ 0, 1 ] 160958 20.704% 20.704% #### ( 1, 2 ] 486039 62.519% 83.222% ############# ( 2, 3 ] 71762 9.231% 92.453% ## ( 3, 4 ] 25917 3.334% 95.787% # ( 4, 6 ] 21440 2.758% 98.544% # ( 6, 10 ] 7195 0.925% 99.470% ( 10, 15 ] 966 0.124% 99.594% ( 15, 22 ] 193 0.025% 99.619% ( 22, 34 ] 14 0.002% 99.621% ( 34, 51 ] 28 0.004% 99.624% ( 51, 76 ] 250 0.032% 99.657% ( 76, 110 ] 1251 0.161% 99.817% ( 110, 170 ] 943 0.121% 99.939% ( 170, 250 ] 160 0.021% 99.959% ( 250, 380 ] 142 0.018% 99.978% ( 380, 580 ] 100 0.013% 99.990% ( 580, 870 ] 43 0.006% 99.996% ( 870, 1300 ] 14 0.002% 99.998% ( 1300, 1900 ] 9 0.001% 99.999% ( 1900, 2900 ] 6 0.001% 100.000% ( 2900, 4400 ] 2 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28278 Average: 2.0653 StdDev: 2.81 Min: 1 Median: 1.4195 Max: 289 Percentiles: P50: 1.42 P75: 1.84 P99: 5.67 P99.9: 11.95 P99.99: 176.89 ------------------------------------------------------ [ 0, 1 ] 7072 25.009% 25.009% ##### ( 1, 2 ] 16846 59.573% 84.582% ############ ( 2, 3 ] 2352 8.317% 92.899% ## ( 3, 4 ] 1118 3.954% 96.853% # ( 4, 6 ] 727 2.571% 99.424% # ( 6, 10 ] 123 0.435% 99.859% ( 10, 15 ] 30 0.106% 99.965% ( 15, 22 ] 6 0.021% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 246434 Average: 4.0178 StdDev: 33.93 Min: 0 Median: 1.7323 Max: 4670 Percentiles: P50: 1.73 P75: 2.51 P99: 9.72 P99.9: 327.79 P99.99: 810.86 ------------------------------------------------------ [ 0, 1 ] 15899 6.452% 6.452% # ( 1, 2 ] 146545 59.466% 65.918% ############ ( 2, 3 ] 43965 17.840% 83.758% #### ( 3, 4 ] 18225 7.395% 91.154% # ( 4, 6 ] 14369 5.831% 96.985% # ( 6, 10 ] 5342 2.168% 99.152% ( 10, 15 ] 749 0.304% 99.456% ( 15, 22 ] 150 0.061% 99.517% ( 22, 34 ] 31 0.013% 99.530% ( 34, 51 ] 5 0.002% 99.532% ( 51, 76 ] 42 0.017% 99.549% ( 76, 110 ] 202 0.082% 99.631% ( 110, 170 ] 389 0.158% 99.789% ( 170, 250 ] 189 0.077% 99.865% ( 250, 380 ] 143 0.058% 99.923% ( 380, 580 ] 115 0.047% 99.970% ( 580, 870 ] 62 0.025% 99.995% ( 870, 1300 ] 23 0.009% 100.004% ( 1300, 1900 ] 15 0.006% 100.011% ( 1900, 2900 ] 11 0.004% 100.015% ( 2900, 4400 ] 4 0.002% 100.017% ( 4400, 6600 ] 1 0.000% 100.017% ** Level 4 read latency histogram (micros): Count: 140 Average: 435.4571 StdDev: 895.84 Min: 1 Median: 6.4444 Max: 3984 Percentiles: P50: 6.44 P75: 315.00 P99: 3984.00 P99.9: 3984.00 P99.99: 3984.00 ------------------------------------------------------ [ 0, 1 ] 30 21.429% 21.429% #### ( 1, 2 ] 32 22.857% 44.286% ##### ( 2, 3 ] 2 1.429% 45.714% ( 3, 4 ] 1 0.714% 46.429% ( 4, 6 ] 4 2.857% 49.286% # ( 6, 10 ] 9 6.429% 55.714% # ( 15, 22 ] 2 1.429% 57.143% ( 22, 34 ] 10 7.143% 64.286% # ( 34, 51 ] 4 2.857% 67.143% # ( 76, 110 ] 2 1.429% 68.571% ( 110, 170 ] 4 2.857% 71.429% # ( 170, 250 ] 2 1.429% 72.857% ( 250, 380 ] 6 4.286% 77.143% # ( 380, 580 ] 2 1.429% 78.571% ( 580, 870 ] 6 4.286% 82.857% # ( 870, 1300 ] 5 3.571% 86.429% # ( 1300, 1900 ] 5 3.571% 90.000% # ( 1900, 2900 ] 7 5.000% 95.000% # ( 2900, 4400 ] 7 5.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 788.7250 StdDev: 994.46 Min: 79 Median: 305.7143 Max: 4290 Percentiles: P50: 305.71 P75: 1085.00 P99: 4100.00 P99.9: 4290.00 P99.99: 4290.00 ------------------------------------------------------ ( 76, 110 ] 10 12.500% 12.500% ### ( 110, 170 ] 19 23.750% 36.250% ##### ( 170, 250 ] 8 10.000% 46.250% ## ( 250, 380 ] 7 8.750% 55.000% ## ( 380, 580 ] 9 11.250% 66.250% ## ( 580, 870 ] 4 5.000% 71.250% # ( 870, 1300 ] 6 7.500% 78.750% ## ( 1300, 1900 ] 5 6.250% 85.000% # ( 1900, 2900 ] 8 10.000% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 45.8 total, 22.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 171.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.372 H:M:S, 53.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 44.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:19.105 H:M:S, 86.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/06-00:01:36 ... thread 0: (1000000,9000000) ops and (119886.9,166678.8) ops/second in (8.341194,53.996057) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 2.03 GB 50.3 7.9 0.0 7.9 16.4 8.5 0.0 1.9 137.2 285.9 58.77 52.24 147 0.400 8186K 12K 0.0 0.0 L1 11/11 1.13 GB 0.0 8.8 6.4 2.4 8.7 6.3 0.1 1.4 221.9 218.4 40.73 37.68 5 8.145 9005K 25K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.2 1.8 239.2 239.1 0.47 0.44 1 0.466 113K 30 0.0 0.0 L3 14/1 1.01 GB 0.9 3.7 2.1 1.6 3.7 2.0 3.2 1.8 137.7 136.5 27.51 16.77 11 2.501 3826K 34K 0.0 0.0 L4 168/3 9.82 GB 1.0 4.4 3.8 0.6 4.4 3.8 1.1 1.2 123.6 123.0 36.62 21.17 38 0.964 4568K 24K 0.0 0.0 L5 1100/0 90.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1303/22 104.48 GB 0.0 24.9 12.3 12.6 33.3 20.7 14.3 3.9 155.5 207.6 164.10 128.29 202 0.812 25M 96K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.9 12.3 12.6 33.3 20.7 14.3 3.9 155.5 207.6 164.10 128.29 202 0.812 25M 96K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.9 12.3 12.6 24.7 12.1 0.0 0.0 186.8 185.3 136.61 106.00 80 1.708 25M 96K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 318.6 27.49 22.29 122 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.2 total, 54.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.27 GB write, 628.94 MB/s write, 24.93 GB read, 471.19 MB/s read, 164.1 seconds Interval compaction: 33.27 GB write, 630.97 MB/s write, 24.93 GB read, 472.71 MB/s read, 164.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 38, total-stops: 48, interval: 86 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4012505 Average: 3.0382 StdDev: 35.52 Min: 0 Median: 1.4787 Max: 9837 Percentiles: P50: 1.48 P75: 1.87 P99: 7.45 P99.9: 154.15 P99.99: 437.74 ------------------------------------------------------ [ 0, 1 ] 788320 19.647% 19.647% #### ( 1, 2 ] 2544322 63.410% 83.056% ############# ( 2, 3 ] 367601 9.161% 92.218% ## ( 3, 4 ] 149222 3.719% 95.937% # ( 4, 6 ] 112253 2.798% 98.734% # ( 6, 10 ] 29385 0.732% 99.467% ( 10, 15 ] 5530 0.138% 99.604% ( 15, 22 ] 855 0.021% 99.626% ( 22, 34 ] 48 0.001% 99.627% ( 34, 51 ] 28 0.001% 99.628% ( 51, 76 ] 656 0.016% 99.644% ( 76, 110 ] 6388 0.159% 99.803% ( 110, 170 ] 5280 0.132% 99.935% ( 170, 250 ] 1162 0.029% 99.964% ( 250, 380 ] 859 0.021% 99.985% ( 380, 580 ] 678 0.017% 100.002% ( 580, 870 ] 364 0.009% 100.011% ( 870, 1300 ] 160 0.004% 100.015% ( 1300, 1900 ] 90 0.002% 100.017% ( 1900, 2900 ] 112 0.003% 100.020% ( 2900, 4400 ] 129 0.003% 100.023% ( 4400, 6600 ] 29 0.001% 100.024% ( 6600, 9900 ] 15 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1754294 Average: 5.0552 StdDev: 79.17 Min: 0 Median: 1.7023 Max: 13287 Percentiles: P50: 1.70 P75: 2.51 P99: 9.14 P99.9: 115.19 P99.99: 260.48 ------------------------------------------------------ [ 0, 1 ] 186814 10.649% 10.649% ## ( 1, 2 ] 983025 56.035% 66.684% ########### ( 2, 3 ] 288139 16.425% 83.109% ### ( 3, 4 ] 126946 7.236% 90.345% # ( 4, 6 ] 124775 7.113% 97.458% # ( 6, 10 ] 34487 1.966% 99.424% ( 10, 15 ] 5540 0.316% 99.740% ( 15, 22 ] 777 0.044% 99.784% ( 22, 34 ] 47 0.003% 99.787% ( 34, 51 ] 44 0.003% 99.789% ( 51, 76 ] 331 0.019% 99.808% ( 76, 110 ] 1511 0.086% 99.894% ( 110, 170 ] 1200 0.068% 99.962% ( 170, 250 ] 430 0.025% 99.987% ( 250, 380 ] 652 0.037% 100.024% ( 380, 580 ] 663 0.038% 100.062% ( 580, 870 ] 641 0.037% 100.099% ( 870, 1300 ] 394 0.022% 100.121% ( 1300, 1900 ] 229 0.013% 100.134% ( 1900, 2900 ] 175 0.010% 100.144% ( 2900, 4400 ] 296 0.017% 100.161% ( 4400, 6600 ] 91 0.005% 100.166% ( 6600, 9900 ] 31 0.002% 100.168% ( 9900, 14000 ] 3 0.000% 100.168% ** Level 2 read latency histogram (micros): Count: 28278 Average: 2.0653 StdDev: 2.81 Min: 1 Median: 1.4195 Max: 289 Percentiles: P50: 1.42 P75: 1.84 P99: 5.67 P99.9: 11.95 P99.99: 176.89 ------------------------------------------------------ [ 0, 1 ] 7072 25.009% 25.009% ##### ( 1, 2 ] 16846 59.573% 84.582% ############ ( 2, 3 ] 2352 8.317% 92.899% ## ( 3, 4 ] 1118 3.954% 96.853% # ( 4, 6 ] 727 2.571% 99.424% # ( 6, 10 ] 123 0.435% 99.859% ( 10, 15 ] 30 0.106% 99.965% ( 15, 22 ] 6 0.021% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 919019 Average: 8.0235 StdDev: 112.40 Min: 0 Median: 1.9196 Max: 8746 Percentiles: P50: 1.92 P75: 2.92 P99: 9.52 P99.9: 531.01 P99.99: 848.08 ------------------------------------------------------ [ 0, 1 ] 23697 2.579% 2.579% # ( 1, 2 ] 473891 51.565% 54.143% ########## ( 2, 3 ] 208328 22.669% 76.812% ##### ( 3, 4 ] 97316 10.589% 87.401% ## ( 4, 6 ] 90010 9.794% 97.195% ## ( 6, 10 ] 18845 2.051% 99.246% ( 10, 15 ] 3435 0.374% 99.619% ( 15, 22 ] 433 0.047% 99.667% ( 22, 34 ] 47 0.005% 99.672% ( 34, 51 ] 13 0.001% 99.673% ( 51, 76 ] 50 0.005% 99.679% ( 76, 110 ] 222 0.024% 99.703% ( 110, 170 ] 465 0.051% 99.753% ( 170, 250 ] 344 0.037% 99.791% ( 250, 380 ] 486 0.053% 99.844% ( 380, 580 ] 686 0.075% 99.918% ( 580, 870 ] 713 0.078% 99.996% ( 870, 1300 ] 544 0.059% 100.055% ( 1300, 1900 ] 307 0.033% 100.088% ( 1900, 2900 ] 268 0.029% 100.118% ( 2900, 4400 ] 369 0.040% 100.158% ( 4400, 6600 ] 86 0.009% 100.167% ( 6600, 9900 ] 22 0.002% 100.170% ** Level 4 read latency histogram (micros): Count: 75444 Average: 18.2095 StdDev: 167.05 Min: 1 Median: 1.9025 Max: 6871 Percentiles: P50: 1.90 P75: 2.90 P99: 499.97 P99.9: 2863.52 P99.99: 4226.80 ------------------------------------------------------ [ 0, 1 ] 1798 2.383% 2.383% ( 1, 2 ] 39807 52.764% 55.147% ########### ( 2, 3 ] 16628 22.040% 77.187% #### ( 3, 4 ] 7534 9.986% 87.173% ## ( 4, 6 ] 6432 8.526% 95.699% ## ( 6, 10 ] 1574 2.086% 97.785% ( 10, 15 ] 320 0.424% 98.209% ( 15, 22 ] 58 0.077% 98.286% ( 22, 34 ] 15 0.020% 98.306% ( 34, 51 ] 9 0.012% 98.318% ( 51, 76 ] 1 0.001% 98.319% ( 76, 110 ] 25 0.033% 98.352% ( 110, 170 ] 99 0.131% 98.484% ( 170, 250 ] 108 0.143% 98.627% ( 250, 380 ] 134 0.178% 98.804% ( 380, 580 ] 246 0.326% 99.130% ( 580, 870 ] 251 0.333% 99.463% ( 870, 1300 ] 164 0.217% 99.681% ( 1300, 1900 ] 101 0.134% 99.814% ( 1900, 2900 ] 67 0.089% 99.903% ( 2900, 4400 ] 74 0.098% 100.001% ( 4400, 6600 ] 5 0.007% 100.008% ( 6600, 9900 ] 1 0.001% 100.009% ** Level 5 read latency histogram (micros): Count: 280 Average: 1655.4750 StdDev: 1704.89 Min: 79 Median: 907.3913 Max: 8398 Percentiles: P50: 907.39 P75: 2641.94 P99: 8052.00 P99.9: 8398.00 P99.99: 8398.00 ------------------------------------------------------ ( 76, 110 ] 11 3.929% 3.929% # ( 110, 170 ] 25 8.929% 12.857% ## ( 170, 250 ] 17 6.071% 18.929% # ( 250, 380 ] 23 8.214% 27.143% ## ( 380, 580 ] 33 11.786% 38.929% ## ( 580, 870 ] 29 10.357% 49.286% ## ( 870, 1300 ] 23 8.214% 57.500% ## ( 1300, 1900 ] 26 9.286% 66.786% ## ( 1900, 2900 ] 31 11.071% 77.857% ## ( 2900, 4400 ] 37 13.214% 91.071% ### ( 4400, 6600 ] 20 7.143% 98.214% # ( 6600, 9900 ] 5 1.786% 100.000% ** DB Stats ** Uptime(secs): 54.2 total, 8.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 163.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.635 H:M:S, 54.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 117.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.264 H:M:S, 63.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/06-00:01:39 ... thread 0: (1000000,10000000) ops and (327602.9,175289.3) ops/second in (3.052476,57.048533) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/7 2.95 GB 151.0 8.8 0.0 8.8 18.3 9.5 0.0 1.9 138.2 286.8 65.18 58.28 163 0.400 9145K 13K 0.0 0.0 L1 11/11 1.13 GB 0.0 8.8 6.4 2.4 8.7 6.3 0.1 1.4 221.9 218.4 40.73 37.68 5 8.145 9005K 25K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.2 1.8 239.2 239.1 0.47 0.44 1 0.466 113K 30 0.0 0.0 L3 13/0 906.02 MB 0.9 3.7 2.1 1.6 3.7 2.0 3.2 1.8 137.7 136.5 27.51 16.77 11 2.501 3826K 34K 0.0 0.0 L4 165/0 9.64 GB 1.0 4.6 3.9 0.7 4.6 3.9 1.1 1.2 125.6 125.0 37.83 22.14 39 0.970 4796K 25K 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1307/18 105.40 GB 0.0 26.1 12.5 13.6 35.3 21.7 14.6 3.7 155.5 210.7 171.71 135.31 219 0.784 26M 98K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.1 12.5 13.6 35.3 21.7 14.6 3.7 155.5 210.7 171.71 135.31 219 0.784 26M 98K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.1 12.5 13.6 25.9 12.2 0.0 0.0 188.7 187.2 141.50 110.58 84 1.684 26M 98K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 321.1 30.21 24.73 135 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.2 total, 57.0 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.33 GB write, 632.30 MB/s write, 26.07 GB read, 466.48 MB/s read, 171.7 seconds Interval compaction: 35.33 GB write, 634.23 MB/s write, 26.07 GB read, 467.91 MB/s read, 171.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 38, total-stops: 51, interval: 89 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4301325 Average: 2.9898 StdDev: 34.45 Min: 0 Median: 1.4828 Max: 9837 Percentiles: P50: 1.48 P75: 1.87 P99: 7.23 P99.9: 150.94 P99.99: 417.46 ------------------------------------------------------ [ 0, 1 ] 826415 19.213% 19.213% #### ( 1, 2 ] 2742771 63.766% 82.979% ############# ( 2, 3 ] 399410 9.286% 92.264% ## ( 3, 4 ] 161189 3.747% 96.012% # ( 4, 6 ] 119058 2.768% 98.780% # ( 6, 10 ] 30772 0.715% 99.495% ( 10, 15 ] 5761 0.134% 99.629% ( 15, 22 ] 870 0.020% 99.649% ( 22, 34 ] 52 0.001% 99.651% ( 34, 51 ] 30 0.001% 99.651% ( 51, 76 ] 657 0.015% 99.667% ( 76, 110 ] 6415 0.149% 99.816% ( 110, 170 ] 5311 0.123% 99.939% ( 170, 250 ] 1181 0.027% 99.967% ( 250, 380 ] 874 0.020% 99.987% ( 380, 580 ] 688 0.016% 100.003% ( 580, 870 ] 373 0.009% 100.012% ( 870, 1300 ] 166 0.004% 100.016% ( 1300, 1900 ] 92 0.002% 100.018% ( 1900, 2900 ] 113 0.003% 100.020% ( 2900, 4400 ] 130 0.003% 100.023% ( 4400, 6600 ] 29 0.001% 100.024% ( 6600, 9900 ] 15 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1900724 Average: 4.8717 StdDev: 76.12 Min: 0 Median: 1.6925 Max: 13287 Percentiles: P50: 1.69 P75: 2.46 P99: 9.08 P99.9: 116.73 P99.99: 267.27 ------------------------------------------------------ [ 0, 1 ] 198969 10.468% 10.468% ## ( 1, 2 ] 1085017 57.084% 67.552% ########### ( 2, 3 ] 307838 16.196% 83.748% ### ( 3, 4 ] 132545 6.973% 90.722% # ( 4, 6 ] 128802 6.776% 97.498% # ( 6, 10 ] 37022 1.948% 99.446% ( 10, 15 ] 5689 0.299% 99.745% ( 15, 22 ] 790 0.042% 99.787% ( 22, 34 ] 48 0.003% 99.789% ( 34, 51 ] 44 0.002% 99.792% ( 51, 76 ] 336 0.018% 99.809% ( 76, 110 ] 1579 0.083% 99.892% ( 110, 170 ] 1295 0.068% 99.961% ( 170, 250 ] 471 0.025% 99.985% ( 250, 380 ] 677 0.036% 100.021% ( 380, 580 ] 678 0.036% 100.057% ( 580, 870 ] 651 0.034% 100.091% ( 870, 1300 ] 396 0.021% 100.112% ( 1300, 1900 ] 229 0.012% 100.124% ( 1900, 2900 ] 175 0.009% 100.133% ( 2900, 4400 ] 296 0.016% 100.149% ( 4400, 6600 ] 91 0.005% 100.153% ( 6600, 9900 ] 31 0.002% 100.155% ( 9900, 14000 ] 3 0.000% 100.155% ** Level 2 read latency histogram (micros): Count: 28278 Average: 2.0653 StdDev: 2.81 Min: 1 Median: 1.4195 Max: 289 Percentiles: P50: 1.42 P75: 1.84 P99: 5.67 P99.9: 11.95 P99.99: 176.89 ------------------------------------------------------ [ 0, 1 ] 7072 25.009% 25.009% ##### ( 1, 2 ] 16846 59.573% 84.582% ############ ( 2, 3 ] 2352 8.317% 92.899% ## ( 3, 4 ] 1118 3.954% 96.853% # ( 4, 6 ] 727 2.571% 99.424% # ( 6, 10 ] 123 0.435% 99.859% ( 10, 15 ] 30 0.106% 99.965% ( 15, 22 ] 6 0.021% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 919019 Average: 8.0235 StdDev: 112.40 Min: 0 Median: 1.9196 Max: 8746 Percentiles: P50: 1.92 P75: 2.92 P99: 9.52 P99.9: 531.01 P99.99: 848.08 ------------------------------------------------------ [ 0, 1 ] 23697 2.579% 2.579% # ( 1, 2 ] 473891 51.565% 54.143% ########## ( 2, 3 ] 208328 22.669% 76.812% ##### ( 3, 4 ] 97316 10.589% 87.401% ## ( 4, 6 ] 90010 9.794% 97.195% ## ( 6, 10 ] 18845 2.051% 99.246% ( 10, 15 ] 3435 0.374% 99.619% ( 15, 22 ] 433 0.047% 99.667% ( 22, 34 ] 47 0.005% 99.672% ( 34, 51 ] 13 0.001% 99.673% ( 51, 76 ] 50 0.005% 99.679% ( 76, 110 ] 222 0.024% 99.703% ( 110, 170 ] 465 0.051% 99.753% ( 170, 250 ] 344 0.037% 99.791% ( 250, 380 ] 486 0.053% 99.844% ( 380, 580 ] 686 0.075% 99.918% ( 580, 870 ] 713 0.078% 99.996% ( 870, 1300 ] 544 0.059% 100.055% ( 1300, 1900 ] 307 0.033% 100.088% ( 1900, 2900 ] 268 0.029% 100.118% ( 2900, 4400 ] 369 0.040% 100.158% ( 4400, 6600 ] 86 0.009% 100.167% ( 6600, 9900 ] 22 0.002% 100.170% ** Level 4 read latency histogram (micros): Count: 87954 Average: 15.9995 StdDev: 154.84 Min: 1 Median: 1.8629 Max: 6871 Percentiles: P50: 1.86 P75: 2.82 P99: 399.81 P99.9: 2676.81 P99.99: 4201.44 ------------------------------------------------------ [ 0, 1 ] 2141 2.434% 2.434% ( 1, 2 ] 48485 55.125% 57.560% ########### ( 2, 3 ] 18752 21.320% 78.880% #### ( 3, 4 ] 8165 9.283% 88.163% ## ( 4, 6 ] 6900 7.845% 96.008% ## ( 6, 10 ] 1816 2.065% 98.073% ( 10, 15 ] 334 0.380% 98.453% ( 15, 22 ] 60 0.068% 98.521% ( 22, 34 ] 15 0.017% 98.538% ( 34, 51 ] 9 0.010% 98.548% ( 51, 76 ] 1 0.001% 98.549% ( 76, 110 ] 26 0.030% 98.579% ( 110, 170 ] 99 0.113% 98.691% ( 170, 250 ] 112 0.127% 98.819% ( 250, 380 ] 135 0.153% 98.972% ( 380, 580 ] 247 0.281% 99.253% ( 580, 870 ] 252 0.287% 99.540% ( 870, 1300 ] 164 0.186% 99.726% ( 1300, 1900 ] 101 0.115% 99.841% ( 1900, 2900 ] 67 0.076% 99.917% ( 2900, 4400 ] 74 0.084% 100.001% ( 4400, 6600 ] 5 0.006% 100.007% ( 6600, 9900 ] 1 0.001% 100.008% ** Level 5 read latency histogram (micros): Count: 300 Average: 1590.1767 StdDev: 1681.19 Min: 79 Median: 850.6667 Max: 8398 Percentiles: P50: 850.67 P75: 2525.00 P99: 7920.00 P99.9: 8398.00 P99.99: 8398.00 ------------------------------------------------------ ( 76, 110 ] 16 5.333% 5.333% # ( 110, 170 ] 32 10.667% 16.000% ## ( 170, 250 ] 17 5.667% 21.667% # ( 250, 380 ] 23 7.667% 29.333% ## ( 380, 580 ] 34 11.333% 40.667% ## ( 580, 870 ] 30 10.000% 50.667% ## ( 870, 1300 ] 25 8.333% 59.000% ## ( 1300, 1900 ] 28 9.333% 68.333% ## ( 1900, 2900 ] 32 10.667% 79.000% ## ( 2900, 4400 ] 38 12.667% 91.667% ### ( 4400, 6600 ] 20 6.667% 98.333% # ( 6600, 9900 ] 5 1.667% 100.000% ** DB Stats ** Uptime(secs): 57.2 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 171.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.047 H:M:S, 52.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.412 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.483 micros/op 182397 ops/sec 60.001 seconds 10943999 operations; 176.7 MB/s Microseconds per write: Count: 10943999 Average: 5.4825 StdDev: 394.42 Min: 0 Median: 1.7273 Max: 662817 Percentiles: P50: 1.73 P75: 2.71 P99: 7.67 P99.9: 1117.95 P99.99: 2739.69 ------------------------------------------------------ [ 0, 1 ] 1516916 13.861% 13.861% ### ( 1, 2 ] 5438331 49.692% 63.553% ########## ( 2, 3 ] 1755218 16.038% 79.591% ### ( 3, 4 ] 1519283 13.882% 93.474% ### ( 4, 6 ] 568474 5.194% 98.668% # ( 6, 10 ] 86911 0.794% 99.462% ( 10, 15 ] 21275 0.194% 99.657% ( 15, 22 ] 6917 0.063% 99.720% ( 22, 34 ] 1868 0.017% 99.737% ( 34, 51 ] 234 0.002% 99.739% ( 51, 76 ] 16 0.000% 99.739% ( 76, 110 ] 7321 0.067% 99.806% ( 110, 170 ] 3347 0.031% 99.837% ( 170, 250 ] 333 0.003% 99.840% ( 250, 380 ] 90 0.001% 99.840% ( 380, 580 ] 13 0.000% 99.841% ( 580, 870 ] 22 0.000% 99.841% ( 870, 1300 ] 11248 0.103% 99.944% ( 1300, 1900 ] 31 0.000% 99.944% ( 1900, 2900 ] 6022 0.055% 99.999% ( 2900, 4400 ] 83 0.001% 100.000% ( 4400, 6600 ] 11 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 18 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 231353 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10943999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11294206968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 567 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30486671 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31595943396 rocksdb.compact.write.bytes COUNT : 31365309644 rocksdb.flush.write.bytes COUNT : 11163609238 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 71 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 207 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11073682432 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4374528 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31703946197 rocksdb.non.last.level.read.count COUNT : 7657372 rocksdb.block.checksum.compute.count COUNT : 7656309 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.366625 P95 : 3.838741 P99 : 5.959400 P100 : 662814.000000 COUNT : 10943999 SUM : 55013889 rocksdb.compaction.times.micros P50 : 1073870.967742 P95 : 3971000.000000 P99 : 23254536.000000 P100 : 23254536.000000 COUNT : 87 SUM : 144840511 rocksdb.compaction.times.cpu_micros P50 : 891481.481481 P95 : 3203333.333333 P99 : 15040000.000000 P100 : 20875657.000000 COUNT : 87 SUM : 113857675 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 701.395349 P95 : 1289.882353 P99 : 141200.000000 P100 : 199249.000000 COUNT : 148 SUM : 494420 rocksdb.compaction.outfile.sync.micros P50 : 1109.187500 P95 : 254205.882353 P99 : 367076.470588 P100 : 391318.000000 COUNT : 369 SUM : 13350118 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 117.894737 P95 : 1860.000000 P99 : 4254.285714 P100 : 8554.000000 COUNT : 268 SUM : 109377 rocksdb.table.open.io.micros P50 : 1510.891089 P95 : 9397.500000 P99 : 16330.000000 P100 : 20577.000000 COUNT : 567 SUM : 1378736 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.643243 P95 : 7.792810 P99 : 11.697843 P100 : 13292.000000 COUNT : 7654839 SUM : 48272451 rocksdb.read.block.get.micros P50 : 453.684211 P95 : 3886.000000 P99 : 6202.166667 P100 : 8546.000000 COUNT : 1134 SUM : 1084536 rocksdb.write.raw.block.micros P50 : 0.513161 P95 : 0.975006 P99 : 2.983425 P100 : 15687.000000 COUNT : 10302367 SUM : 21162273 rocksdb.numfiles.in.singlecompaction P50 : 3.253012 P95 : 6.000000 P99 : 20.600000 P100 : 31.000000 COUNT : 140 SUM : 557 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559864 P95 : 1222.371631 P99 : 2642.707605 P100 : 662623.000000 COUNT : 162907 SUM : 30498484 rocksdb.sst.read.micros P50 : 1.584256 P95 : 4.645021 P99 : 8.750461 P100 : 13287.000000 COUNT : 7657807 SUM : 32553222 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10943999 SUM : 11294206968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214770.642202 P95 : 408500.000000 P99 : 752700.000000 P100 : 841491.000000 COUNT : 148 SUM : 32953577 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 359 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0