[2024-11-27 12:07:37.844833] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-11-27 12:07:37.844932] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1967851 ] Set seed to 1732705657842468 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-27 12:07:37.945914] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-27 12:07:37.987382] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-27 12:07:37.987430] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1967851' to capture a snapshot of events at runtime. [2024-11-27 12:07:37.987440] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-27 12:07:37.987466] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-27 12:07:37.987475] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1967851 for offline analysis/debug. [2024-11-27 12:07:37.987570] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 27 12:07:42 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/27-12:07:45 ... thread 0: (1000000,1000000) ops and (354382.2,354382.2) ops/second in (2.821812,2.821812) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.03 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 346.5 2.36 2.14 12 0.197 0 0 0.0 0.0 L2 3/2 251.75 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 239.5 239.4 1.58 1.52 2 0.789 383K 191 0.0 0.0 L3 9/0 741.38 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 95.9 303.6 3.94 3.66 14 0.282 383K 191 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 95.9 303.6 3.94 3.66 14 0.282 383K 191 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 239.5 239.4 1.58 1.52 2 0.789 383K 191 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 346.5 2.36 2.14 12 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 398.40 MB/s write, 0.37 GB read, 125.82 MB/s read, 3.9 seconds Interval compaction: 1.17 GB write, 423.90 MB/s write, 0.37 GB read, 133.87 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 97723 Average: 1.8703 StdDev: 15.46 Min: 0 Median: 1.2141 Max: 3051 Percentiles: P50: 1.21 P75: 1.66 P99: 3.86 P99.9: 9.81 P99.99: 259.87 ------------------------------------------------------ [ 0, 1 ] 37003 37.865% 37.865% ######## ( 1, 2 ] 55382 56.672% 94.538% ########### ( 2, 3 ] 3238 3.313% 97.851% # ( 3, 4 ] 1314 1.345% 99.196% ( 4, 6 ] 513 0.525% 99.721% ( 6, 10 ] 185 0.189% 99.910% ( 10, 15 ] 42 0.043% 99.953% ( 15, 22 ] 22 0.023% 99.975% ( 22, 34 ] 2 0.002% 99.977% ( 110, 170 ] 6 0.006% 99.984% ( 170, 250 ] 7 0.007% 99.991% ( 250, 380 ] 3 0.003% 99.994% ( 380, 580 ] 1 0.001% 99.995% ( 580, 870 ] 2 0.002% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 2 0.002% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ( 2900, 4400 ] 1 0.001% 100.002% ** Level 1 read latency histogram (micros): Count: 5 Average: 769.2000 StdDev: 1019.88 Min: 52 Median: 155.0000 Max: 2731 Percentiles: P50: 155.00 P75: 797.50 P99: 2731.00 P99.9: 2731.00 P99.99: 2731.00 ------------------------------------------------------ ( 51, 76 ] 1 20.000% 20.000% #### ( 110, 170 ] 2 40.000% 60.000% ######## ( 580, 870 ] 1 20.000% 80.000% #### ( 1900, 2900 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 47849 Average: 1.8694 StdDev: 7.64 Min: 1 Median: 1.2623 Max: 1040 Percentiles: P50: 1.26 P75: 1.70 P99: 5.05 P99.9: 9.78 P99.99: 394.33 ------------------------------------------------------ [ 0, 1 ] 16675 34.849% 34.849% ####### ( 1, 2 ] 27634 57.753% 92.602% ############ ( 2, 3 ] 1989 4.157% 96.759% # ( 3, 4 ] 782 1.634% 98.393% ( 4, 6 ] 555 1.160% 99.553% ( 6, 10 ] 177 0.370% 99.923% ( 10, 15 ] 24 0.050% 99.973% ( 15, 22 ] 7 0.015% 99.987% ( 51, 76 ] 1 0.002% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 3 0.006% 99.998% ( 870, 1300 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 40 Average: 1403.6750 StdDev: 1182.49 Min: 170 Median: 956.0000 Max: 4100 Percentiles: P50: 956.00 P75: 2328.57 P99: 4100.00 P99.9: 4100.00 P99.99: 4100.00 ------------------------------------------------------ ( 110, 170 ] 1 2.500% 2.500% # ( 170, 250 ] 5 12.500% 15.000% ### ( 250, 380 ] 3 7.500% 22.500% ## ( 380, 580 ] 4 10.000% 32.500% ## ( 580, 870 ] 6 15.000% 47.500% ### ( 870, 1300 ] 5 12.500% 60.000% ### ( 1300, 1900 ] 3 7.500% 67.500% ## ( 1900, 2900 ] 7 17.500% 85.000% #### ( 2900, 4400 ] 6 15.000% 100.000% ### ** Level 4 read latency histogram (micros): Count: 35 Average: 1560.5143 StdDev: 1169.23 Min: 258 Median: 1120.8333 Max: 4843 Percentiles: P50: 1120.83 P75: 2306.25 P99: 4843.00 P99.9: 4843.00 P99.99: 4843.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 3 8.571% 17.143% ## ( 580, 870 ] 8 22.857% 40.000% ##### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 3 8.571% 65.714% ## ( 1900, 2900 ] 8 22.857% 88.571% ##### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 327.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.218 H:M:S, 7.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.218 H:M:S, 7.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-12:07:48 ... thread 0: (1000000,2000000) ops and (320369.2,336518.4) ops/second in (3.121399,5.943211) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 1.17 GB 6.3 0.8 0.0 0.8 2.6 1.8 0.0 1.4 96.5 311.5 8.49 7.87 29 0.293 831K 897 0.0 0.0 L1 1/1 2.84 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 230.6 230.2 1.64 1.59 1 1.639 383K 630 0.0 0.0 L2 2/0 54.49 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 239.5 239.4 1.58 1.52 2 0.789 383K 191 0.0 0.0 L3 42/0 997.64 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 195.3 195.1 4.08 3.61 3 1.359 808K 826 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/8 97.92 GB 0.0 2.3 1.1 1.2 4.1 2.9 1.5 2.3 150.2 265.8 15.78 14.59 35 0.451 2407K 2544 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 1.1 1.2 4.1 2.9 1.4 2.3 150.2 265.8 15.78 14.59 35 0.451 2407K 2544 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 1.1 1.2 2.3 1.1 0.0 0.0 224.7 224.5 10.55 9.90 9 1.173 2407K 2544 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.3 5.23 4.69 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.10 GB write, 685.00 MB/s write, 2.32 GB read, 387.17 MB/s read, 15.8 seconds Interval compaction: 4.10 GB write, 705.82 MB/s write, 2.32 GB read, 398.94 MB/s read, 15.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 382851 Average: 2.1783 StdDev: 11.48 Min: 0 Median: 1.4682 Max: 3665 Percentiles: P50: 1.47 P75: 1.86 P99: 5.66 P99.9: 11.68 P99.99: 16.71 ------------------------------------------------------ [ 0, 1 ] 76814 20.064% 20.064% #### ( 1, 2 ] 244770 63.933% 83.997% ############# ( 2, 3 ] 35947 9.389% 93.386% ## ( 3, 4 ] 13926 3.637% 97.024% # ( 4, 6 ] 9108 2.379% 99.403% ( 6, 10 ] 1734 0.453% 99.856% ( 10, 15 ] 502 0.131% 99.987% ( 15, 22 ] 48 0.013% 99.999% ( 22, 34 ] 10 0.003% 100.002% ( 34, 51 ] 6 0.002% 100.004% ( 51, 76 ] 1 0.000% 100.004% ( 110, 170 ] 8 0.002% 100.006% ( 170, 250 ] 16 0.004% 100.010% ( 250, 380 ] 10 0.003% 100.013% ( 380, 580 ] 5 0.001% 100.014% ( 580, 870 ] 8 0.002% 100.016% ( 870, 1300 ] 5 0.001% 100.018% ( 1300, 1900 ] 4 0.001% 100.019% ( 1900, 2900 ] 1 0.000% 100.019% ( 2900, 4400 ] 2 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 81723 Average: 2.5184 StdDev: 11.66 Min: 1 Median: 1.6596 Max: 2731 Percentiles: P50: 1.66 P75: 2.16 P99: 5.99 P99.9: 12.38 P99.99: 16.41 ------------------------------------------------------ [ 0, 1 ] 5602 6.855% 6.855% # ( 1, 2 ] 53452 65.406% 72.261% ############# ( 2, 3 ] 13813 16.902% 89.163% ### ( 3, 4 ] 4424 5.413% 94.577% # ( 4, 6 ] 3632 4.444% 99.021% # ( 6, 10 ] 655 0.801% 99.823% ( 10, 15 ] 133 0.163% 99.985% ( 15, 22 ] 19 0.023% 100.009% ( 22, 34 ] 3 0.004% 100.012% ( 51, 76 ] 1 0.001% 100.013% ( 110, 170 ] 3 0.004% 100.017% ( 170, 250 ] 1 0.001% 100.018% ( 250, 380 ] 1 0.001% 100.020% ( 380, 580 ] 1 0.001% 100.021% ( 580, 870 ] 4 0.005% 100.026% ( 870, 1300 ] 1 0.001% 100.027% ( 1900, 2900 ] 1 0.001% 100.028% ** Level 2 read latency histogram (micros): Count: 95428 Average: 2.0382 StdDev: 5.46 Min: 1 Median: 1.4172 Max: 1040 Percentiles: P50: 1.42 P75: 1.81 P99: 5.57 P99.9: 9.99 P99.99: 20.52 ------------------------------------------------------ [ 0, 1 ] 22494 23.572% 23.572% ##### ( 1, 2 ] 60452 63.348% 86.920% ############# ( 2, 3 ] 7323 7.674% 94.594% ## ( 3, 4 ] 2717 2.847% 97.441% # ( 4, 6 ] 1894 1.985% 99.426% ( 6, 10 ] 454 0.476% 99.901% ( 10, 15 ] 75 0.079% 99.980% ( 15, 22 ] 12 0.013% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57414 Average: 3.5017 StdDev: 48.73 Min: 0 Median: 1.6643 Max: 4100 Percentiles: P50: 1.66 P75: 2.20 P99: 7.29 P99.9: 37.14 P99.99: 1351.72 ------------------------------------------------------ [ 0, 1 ] 4203 7.321% 7.321% # ( 1, 2 ] 36887 64.247% 71.568% ############# ( 2, 3 ] 10055 17.513% 89.081% #### ( 3, 4 ] 3141 5.471% 94.552% # ( 4, 6 ] 2397 4.175% 98.727% # ( 6, 10 ] 487 0.848% 99.575% ( 10, 15 ] 150 0.261% 99.836% ( 15, 22 ] 18 0.031% 99.868% ( 22, 34 ] 16 0.028% 99.895% ( 34, 51 ] 14 0.024% 99.920% ( 110, 170 ] 4 0.007% 99.927% ( 170, 250 ] 11 0.019% 99.946% ( 250, 380 ] 7 0.012% 99.958% ( 380, 580 ] 6 0.010% 99.969% ( 580, 870 ] 7 0.012% 99.981% ( 870, 1300 ] 5 0.009% 99.990% ( 1300, 1900 ] 3 0.005% 99.995% ( 1900, 2900 ] 7 0.012% 100.007% ( 2900, 4400 ] 6 0.010% 100.017% ** Level 4 read latency histogram (micros): Count: 35 Average: 1560.5143 StdDev: 1169.23 Min: 258 Median: 1120.8333 Max: 4843 Percentiles: P50: 1120.83 P75: 2306.25 P99: 4843.00 P99.9: 4843.00 P99.99: 4843.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 3 8.571% 17.143% ## ( 580, 870 ] 8 22.857% 40.000% ##### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 3 8.571% 65.714% ## ( 1900, 2900 ] 8 22.857% 88.571% ##### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 616.9000 StdDev: 684.60 Min: 100 Median: 223.3333 Max: 2401 Percentiles: P50: 223.33 P75: 870.00 P99: 2401.00 P99.9: 2401.00 P99.99: 2401.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 6 30.000% 60.000% ###### ( 580, 870 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.634 H:M:S, 10.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.416 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-12:07:51 ... thread 0: (1000000,3000000) ops and (326301.4,333042.4) ops/second in (3.064651,9.007862) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.15 GB 75.5 1.3 0.0 1.3 4.1 2.8 0.0 1.5 100.1 314.5 13.22 12.27 45 0.294 1343K 1387 0.0 0.0 L1 1/1 2.84 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 230.6 230.2 1.64 1.59 1 1.639 383K 630 0.0 0.0 L2 2/0 54.49 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 239.5 239.4 1.58 1.52 2 0.789 383K 191 0.0 0.0 L3 42/0 997.64 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 195.3 195.1 4.08 3.61 3 1.359 808K 826 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/12 98.90 GB 0.0 2.8 1.1 1.7 5.6 3.9 1.5 2.0 140.2 278.2 20.51 19.00 51 0.402 2919K 3034 0.0 0.0 Int 0/0 0.00 KB 0.0 2.8 1.1 1.7 5.6 3.9 1.4 2.0 140.2 278.2 20.51 19.00 51 0.402 2919K 3034 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.8 1.1 1.7 2.8 1.1 0.0 0.0 231.3 231.0 12.43 11.75 11 1.130 2919K 3034 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 350.9 8.08 7.24 40 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.57 GB write, 621.03 MB/s write, 2.81 GB read, 312.90 MB/s read, 20.5 seconds Interval compaction: 5.57 GB write, 633.49 MB/s write, 2.81 GB read, 319.18 MB/s read, 20.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 714823 Average: 2.1368 StdDev: 9.36 Min: 0 Median: 1.4673 Max: 3665 Percentiles: P50: 1.47 P75: 1.85 P99: 5.57 P99.9: 11.20 P99.99: 14.73 ------------------------------------------------------ [ 0, 1 ] 137777 19.274% 19.274% #### ( 1, 2 ] 469984 65.748% 85.023% ############# ( 2, 3 ] 66746 9.337% 94.360% ## ( 3, 4 ] 22311 3.121% 97.481% # ( 4, 6 ] 13846 1.937% 99.418% ( 6, 10 ] 3227 0.451% 99.870% ( 10, 15 ] 911 0.127% 99.997% ( 15, 22 ] 78 0.011% 100.008% ( 22, 34 ] 15 0.002% 100.010% ( 34, 51 ] 8 0.001% 100.011% ( 51, 76 ] 7 0.001% 100.012% ( 110, 170 ] 15 0.002% 100.014% ( 170, 250 ] 26 0.004% 100.018% ( 250, 380 ] 18 0.003% 100.020% ( 380, 580 ] 5 0.001% 100.021% ( 580, 870 ] 10 0.001% 100.023% ( 870, 1300 ] 8 0.001% 100.024% ( 1300, 1900 ] 7 0.001% 100.025% ( 1900, 2900 ] 1 0.000% 100.025% ( 2900, 4400 ] 2 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 81723 Average: 2.5184 StdDev: 11.66 Min: 1 Median: 1.6596 Max: 2731 Percentiles: P50: 1.66 P75: 2.16 P99: 5.99 P99.9: 12.38 P99.99: 16.41 ------------------------------------------------------ [ 0, 1 ] 5602 6.855% 6.855% # ( 1, 2 ] 53452 65.406% 72.261% ############# ( 2, 3 ] 13813 16.902% 89.163% ### ( 3, 4 ] 4424 5.413% 94.577% # ( 4, 6 ] 3632 4.444% 99.021% # ( 6, 10 ] 655 0.801% 99.823% ( 10, 15 ] 133 0.163% 99.985% ( 15, 22 ] 19 0.023% 100.009% ( 22, 34 ] 3 0.004% 100.012% ( 51, 76 ] 1 0.001% 100.013% ( 110, 170 ] 3 0.004% 100.017% ( 170, 250 ] 1 0.001% 100.018% ( 250, 380 ] 1 0.001% 100.020% ( 380, 580 ] 1 0.001% 100.021% ( 580, 870 ] 4 0.005% 100.026% ( 870, 1300 ] 1 0.001% 100.027% ( 1900, 2900 ] 1 0.001% 100.028% ** Level 2 read latency histogram (micros): Count: 95428 Average: 2.0382 StdDev: 5.46 Min: 1 Median: 1.4172 Max: 1040 Percentiles: P50: 1.42 P75: 1.81 P99: 5.57 P99.9: 9.99 P99.99: 20.52 ------------------------------------------------------ [ 0, 1 ] 22494 23.572% 23.572% ##### ( 1, 2 ] 60452 63.348% 86.920% ############# ( 2, 3 ] 7323 7.674% 94.594% ## ( 3, 4 ] 2717 2.847% 97.441% # ( 4, 6 ] 1894 1.985% 99.426% ( 6, 10 ] 454 0.476% 99.901% ( 10, 15 ] 75 0.079% 99.980% ( 15, 22 ] 12 0.013% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57414 Average: 3.5017 StdDev: 48.73 Min: 0 Median: 1.6643 Max: 4100 Percentiles: P50: 1.66 P75: 2.20 P99: 7.29 P99.9: 37.14 P99.99: 1351.72 ------------------------------------------------------ [ 0, 1 ] 4203 7.321% 7.321% # ( 1, 2 ] 36887 64.247% 71.568% ############# ( 2, 3 ] 10055 17.513% 89.081% #### ( 3, 4 ] 3141 5.471% 94.552% # ( 4, 6 ] 2397 4.175% 98.727% # ( 6, 10 ] 487 0.848% 99.575% ( 10, 15 ] 150 0.261% 99.836% ( 15, 22 ] 18 0.031% 99.868% ( 22, 34 ] 16 0.028% 99.895% ( 34, 51 ] 14 0.024% 99.920% ( 110, 170 ] 4 0.007% 99.927% ( 170, 250 ] 11 0.019% 99.946% ( 250, 380 ] 7 0.012% 99.958% ( 380, 580 ] 6 0.010% 99.969% ( 580, 870 ] 7 0.012% 99.981% ( 870, 1300 ] 5 0.009% 99.990% ( 1300, 1900 ] 3 0.005% 99.995% ( 1900, 2900 ] 7 0.012% 100.007% ( 2900, 4400 ] 6 0.010% 100.017% ** Level 4 read latency histogram (micros): Count: 35 Average: 1560.5143 StdDev: 1169.23 Min: 258 Median: 1120.8333 Max: 4843 Percentiles: P50: 1120.83 P75: 2306.25 P99: 4843.00 P99.9: 4843.00 P99.99: 4843.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 3 8.571% 17.143% ## ( 580, 870 ] 8 22.857% 40.000% ##### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 3 8.571% 65.714% ## ( 1900, 2900 ] 8 22.857% 88.571% ##### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 616.9000 StdDev: 684.60 Min: 100 Median: 223.3333 Max: 2401 Percentiles: P50: 223.33 P75: 870.00 P99: 2401.00 P99.9: 2401.00 P99.99: 2401.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 6 30.000% 60.000% ###### ( 580, 870 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 321.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.052 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.417 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-12:07:54 ... thread 0: (1000000,4000000) ops and (327065.0,331527.7) ops/second in (3.057496,12.065358) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 1.97 GB 176.2 2.2 0.0 2.2 5.8 3.7 0.0 1.6 114.0 309.2 19.35 18.07 61 0.317 2238K 2347 0.0 0.0 L1 10/0 1.10 GB 113.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 226.8 225.8 6.68 6.49 2 3.338 1537K 5919 0.0 0.0 L2 2/0 54.49 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 239.5 239.4 1.58 1.52 2 0.789 383K 191 0.0 0.0 L3 42/0 997.64 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 195.3 195.1 4.08 3.61 3 1.359 808K 826 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/4 99.82 GB 0.0 4.8 2.2 2.6 8.5 5.9 1.5 2.3 154.5 273.5 31.68 29.70 68 0.466 4968K 9283 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 2.2 2.6 8.5 5.9 1.4 2.3 154.5 273.5 31.68 29.70 68 0.466 4968K 9283 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 2.2 2.6 4.8 2.2 0.0 0.0 233.9 233.4 20.92 20.05 15 1.395 4968K 9283 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 351.2 10.76 9.65 53 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.1 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.46 GB write, 707.37 MB/s write, 4.78 GB read, 399.54 MB/s read, 31.7 seconds Interval compaction: 8.46 GB write, 717.96 MB/s write, 4.78 GB read, 405.52 MB/s read, 31.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1070758 Average: 2.1334 StdDev: 9.29 Min: 0 Median: 1.4684 Max: 3665 Percentiles: P50: 1.47 P75: 1.85 P99: 5.46 P99.9: 9.99 P99.99: 14.07 ------------------------------------------------------ [ 0, 1 ] 202892 18.948% 18.948% #### ( 1, 2 ] 709855 66.295% 85.243% ############# ( 2, 3 ] 99727 9.314% 94.557% ## ( 3, 4 ] 33532 3.132% 97.688% # ( 4, 6 ] 19219 1.795% 99.483% ( 6, 10 ] 4473 0.418% 99.901% ( 10, 15 ] 1170 0.109% 100.010% ( 15, 22 ] 90 0.008% 100.019% ( 22, 34 ] 19 0.002% 100.020% ( 34, 51 ] 9 0.001% 100.021% ( 51, 76 ] 9 0.001% 100.022% ( 76, 110 ] 16 0.001% 100.024% ( 110, 170 ] 40 0.004% 100.027% ( 170, 250 ] 37 0.003% 100.031% ( 250, 380 ] 25 0.002% 100.033% ( 380, 580 ] 8 0.001% 100.034% ( 580, 870 ] 15 0.001% 100.035% ( 870, 1300 ] 16 0.001% 100.037% ( 1300, 1900 ] 7 0.001% 100.037% ( 1900, 2900 ] 2 0.000% 100.038% ( 2900, 4400 ] 3 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 82493 Average: 2.7887 StdDev: 17.93 Min: 0 Median: 1.6587 Max: 2731 Percentiles: P50: 1.66 P75: 2.16 P99: 6.42 P99.9: 19.61 P99.99: 270.69 ------------------------------------------------------ [ 0, 1 ] 5732 6.948% 6.948% # ( 1, 2 ] 53915 65.357% 72.306% ############# ( 2, 3 ] 13865 16.807% 89.113% ### ( 3, 4 ] 4445 5.388% 94.501% # ( 4, 6 ] 3641 4.414% 98.915% # ( 6, 10 ] 667 0.809% 99.724% ( 10, 15 ] 133 0.161% 99.885% ( 15, 22 ] 19 0.023% 99.908% ( 22, 34 ] 3 0.004% 99.912% ( 51, 76 ] 4 0.005% 99.916% ( 76, 110 ] 34 0.041% 99.958% ( 110, 170 ] 18 0.022% 99.979% ( 170, 250 ] 7 0.008% 99.988% ( 250, 380 ] 11 0.013% 100.001% ( 380, 580 ] 5 0.006% 100.007% ( 580, 870 ] 8 0.010% 100.017% ( 870, 1300 ] 6 0.007% 100.024% ( 1300, 1900 ] 2 0.002% 100.027% ( 1900, 2900 ] 1 0.001% 100.028% ** Level 2 read latency histogram (micros): Count: 95428 Average: 2.0382 StdDev: 5.46 Min: 1 Median: 1.4172 Max: 1040 Percentiles: P50: 1.42 P75: 1.81 P99: 5.57 P99.9: 9.99 P99.99: 20.52 ------------------------------------------------------ [ 0, 1 ] 22494 23.572% 23.572% ##### ( 1, 2 ] 60452 63.348% 86.920% ############# ( 2, 3 ] 7323 7.674% 94.594% ## ( 3, 4 ] 2717 2.847% 97.441% # ( 4, 6 ] 1894 1.985% 99.426% ( 6, 10 ] 454 0.476% 99.901% ( 10, 15 ] 75 0.079% 99.980% ( 15, 22 ] 12 0.013% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57414 Average: 3.5017 StdDev: 48.73 Min: 0 Median: 1.6643 Max: 4100 Percentiles: P50: 1.66 P75: 2.20 P99: 7.29 P99.9: 37.14 P99.99: 1351.72 ------------------------------------------------------ [ 0, 1 ] 4203 7.321% 7.321% # ( 1, 2 ] 36887 64.247% 71.568% ############# ( 2, 3 ] 10055 17.513% 89.081% #### ( 3, 4 ] 3141 5.471% 94.552% # ( 4, 6 ] 2397 4.175% 98.727% # ( 6, 10 ] 487 0.848% 99.575% ( 10, 15 ] 150 0.261% 99.836% ( 15, 22 ] 18 0.031% 99.868% ( 22, 34 ] 16 0.028% 99.895% ( 34, 51 ] 14 0.024% 99.920% ( 110, 170 ] 4 0.007% 99.927% ( 170, 250 ] 11 0.019% 99.946% ( 250, 380 ] 7 0.012% 99.958% ( 380, 580 ] 6 0.010% 99.969% ( 580, 870 ] 7 0.012% 99.981% ( 870, 1300 ] 5 0.009% 99.990% ( 1300, 1900 ] 3 0.005% 99.995% ( 1900, 2900 ] 7 0.012% 100.007% ( 2900, 4400 ] 6 0.010% 100.017% ** Level 4 read latency histogram (micros): Count: 35 Average: 1560.5143 StdDev: 1169.23 Min: 258 Median: 1120.8333 Max: 4843 Percentiles: P50: 1120.83 P75: 2306.25 P99: 4843.00 P99.9: 4843.00 P99.99: 4843.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 3 8.571% 17.143% ## ( 580, 870 ] 8 22.857% 40.000% ##### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 3 8.571% 65.714% ## ( 1900, 2900 ] 8 22.857% 88.571% ##### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 616.9000 StdDev: 684.60 Min: 100 Median: 223.3333 Max: 2401 Percentiles: P50: 223.33 P75: 870.00 P99: 2401.00 P99.9: 2401.00 P99.99: 2401.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 6 30.000% 60.000% ###### ( 580, 870 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.472 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.421 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-12:07:57 ... thread 0: (1000000,5000000) ops and (328023.2,330820.8) ops/second in (3.048565,15.113923) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.95 GB 69.2 2.9 0.0 2.9 7.6 4.7 0.0 1.6 117.9 308.4 25.12 23.50 78 0.322 3006K 3068 0.0 0.0 L1 10/10 1.10 GB 0.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 226.8 225.8 6.68 6.49 2 3.338 1537K 5919 0.0 0.0 L2 2/0 54.49 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 239.5 239.4 1.58 1.52 2 0.789 383K 191 0.0 0.0 L3 42/0 997.64 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 195.3 195.1 4.08 3.61 3 1.359 808K 826 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1264/24 100.80 GB 0.0 5.5 2.2 3.3 10.2 6.9 1.5 2.2 150.9 278.4 37.45 35.13 85 0.441 5736K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 2.2 3.3 10.2 6.9 1.4 2.2 150.9 278.4 37.45 35.13 85 0.441 5736K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 2.2 3.3 5.5 2.2 0.0 0.0 237.0 236.6 23.84 22.92 18 1.324 5736K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 351.8 13.61 12.22 67 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.1 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.18 GB write, 681.66 MB/s write, 5.52 GB read, 369.33 MB/s read, 37.4 seconds Interval compaction: 10.18 GB write, 689.81 MB/s write, 5.52 GB read, 373.75 MB/s read, 37.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1325702 Average: 2.1436 StdDev: 10.40 Min: 0 Median: 1.4668 Max: 3665 Percentiles: P50: 1.47 P75: 1.84 P99: 5.43 P99.9: 9.98 P99.99: 14.28 ------------------------------------------------------ [ 0, 1 ] 250010 18.859% 18.859% #### ( 1, 2 ] 884466 66.717% 85.575% ############# ( 2, 3 ] 121612 9.173% 94.749% ## ( 3, 4 ] 40331 3.042% 97.791% # ( 4, 6 ] 22345 1.686% 99.477% ( 6, 10 ] 5637 0.425% 99.902% ( 10, 15 ] 1367 0.103% 100.005% ( 15, 22 ] 106 0.008% 100.013% ( 22, 34 ] 20 0.002% 100.014% ( 34, 51 ] 11 0.001% 100.015% ( 51, 76 ] 12 0.001% 100.016% ( 76, 110 ] 20 0.002% 100.018% ( 110, 170 ] 77 0.006% 100.024% ( 170, 250 ] 49 0.004% 100.027% ( 250, 380 ] 36 0.003% 100.030% ( 380, 580 ] 15 0.001% 100.031% ( 580, 870 ] 23 0.002% 100.033% ( 870, 1300 ] 19 0.001% 100.034% ( 1300, 1900 ] 12 0.001% 100.035% ( 1900, 2900 ] 3 0.000% 100.035% ( 2900, 4400 ] 5 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 143699 Average: 2.5706 StdDev: 14.25 Min: 0 Median: 1.5711 Max: 2731 Percentiles: P50: 1.57 P75: 1.95 P99: 7.23 P99.9: 84.63 P99.99: 279.49 ------------------------------------------------------ [ 0, 1 ] 17287 12.030% 12.030% ## ( 1, 2 ] 95535 66.483% 78.513% ############# ( 2, 3 ] 18693 13.008% 91.521% ### ( 3, 4 ] 5879 4.091% 95.612% # ( 4, 6 ] 4403 3.064% 98.676% # ( 6, 10 ] 1510 1.051% 99.727% ( 10, 15 ] 195 0.136% 99.863% ( 15, 22 ] 27 0.019% 99.882% ( 22, 34 ] 3 0.002% 99.884% ( 51, 76 ] 4 0.003% 99.887% ( 76, 110 ] 76 0.053% 99.939% ( 110, 170 ] 59 0.041% 99.981% ( 170, 250 ] 10 0.007% 99.987% ( 250, 380 ] 16 0.011% 99.999% ( 380, 580 ] 7 0.005% 100.003% ( 580, 870 ] 9 0.006% 100.010% ( 870, 1300 ] 6 0.004% 100.014% ( 1300, 1900 ] 2 0.001% 100.015% ( 1900, 2900 ] 1 0.001% 100.016% ** Level 2 read latency histogram (micros): Count: 95428 Average: 2.0382 StdDev: 5.46 Min: 1 Median: 1.4172 Max: 1040 Percentiles: P50: 1.42 P75: 1.81 P99: 5.57 P99.9: 9.99 P99.99: 20.52 ------------------------------------------------------ [ 0, 1 ] 22494 23.572% 23.572% ##### ( 1, 2 ] 60452 63.348% 86.920% ############# ( 2, 3 ] 7323 7.674% 94.594% ## ( 3, 4 ] 2717 2.847% 97.441% # ( 4, 6 ] 1894 1.985% 99.426% ( 6, 10 ] 454 0.476% 99.901% ( 10, 15 ] 75 0.079% 99.980% ( 15, 22 ] 12 0.013% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57414 Average: 3.5017 StdDev: 48.73 Min: 0 Median: 1.6643 Max: 4100 Percentiles: P50: 1.66 P75: 2.20 P99: 7.29 P99.9: 37.14 P99.99: 1351.72 ------------------------------------------------------ [ 0, 1 ] 4203 7.321% 7.321% # ( 1, 2 ] 36887 64.247% 71.568% ############# ( 2, 3 ] 10055 17.513% 89.081% #### ( 3, 4 ] 3141 5.471% 94.552% # ( 4, 6 ] 2397 4.175% 98.727% # ( 6, 10 ] 487 0.848% 99.575% ( 10, 15 ] 150 0.261% 99.836% ( 15, 22 ] 18 0.031% 99.868% ( 22, 34 ] 16 0.028% 99.895% ( 34, 51 ] 14 0.024% 99.920% ( 110, 170 ] 4 0.007% 99.927% ( 170, 250 ] 11 0.019% 99.946% ( 250, 380 ] 7 0.012% 99.958% ( 380, 580 ] 6 0.010% 99.969% ( 580, 870 ] 7 0.012% 99.981% ( 870, 1300 ] 5 0.009% 99.990% ( 1300, 1900 ] 3 0.005% 99.995% ( 1900, 2900 ] 7 0.012% 100.007% ( 2900, 4400 ] 6 0.010% 100.017% ** Level 4 read latency histogram (micros): Count: 35 Average: 1560.5143 StdDev: 1169.23 Min: 258 Median: 1120.8333 Max: 4843 Percentiles: P50: 1120.83 P75: 2306.25 P99: 4843.00 P99.9: 4843.00 P99.99: 4843.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 3 8.571% 17.143% ## ( 580, 870 ] 8 22.857% 40.000% ##### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 3 8.571% 65.714% ## ( 1900, 2900 ] 8 22.857% 88.571% ##### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 616.9000 StdDev: 684.60 Min: 100 Median: 223.3333 Max: 2401 Percentiles: P50: 223.33 P75: 870.00 P99: 2401.00 P99.9: 2401.00 P99.99: 2401.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 6 30.000% 60.000% ###### ( 580, 870 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.3 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 321.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.897 H:M:S, 12.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.425 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-12:08:05 ... thread 0: (1000000,6000000) ops and (129070.9,262448.8) ops/second in (7.747677,22.861600) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.93 GB 176.0 4.7 0.0 4.7 10.4 5.7 0.0 1.8 137.6 301.8 35.25 33.18 99 0.356 4924K 6574 0.0 0.0 L1 10/10 1.10 GB 0.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 226.8 225.8 6.68 6.49 2 3.338 1537K 5919 0.0 0.0 L2 2/0 54.49 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 239.5 239.4 1.58 1.52 2 0.789 383K 191 0.0 0.0 L3 42/0 997.64 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 195.3 195.1 4.08 3.61 3 1.359 808K 826 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/24 101.78 GB 0.0 7.4 2.2 5.1 13.0 7.9 1.5 2.3 158.4 280.0 47.58 44.81 106 0.449 7654K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.4 2.2 5.1 13.0 7.9 1.4 2.3 158.4 280.0 47.58 44.81 106 0.449 7654K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.4 2.2 5.1 7.3 2.2 0.0 0.0 242.4 241.9 31.11 30.05 23 1.352 7654K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 351.8 16.47 14.76 83 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.0 total, 22.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.01 GB write, 578.05 MB/s write, 7.36 GB read, 327.14 MB/s read, 47.6 seconds Interval compaction: 13.01 GB write, 582.61 MB/s write, 7.36 GB read, 329.73 MB/s read, 47.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 14, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2067278 Average: 2.1975 StdDev: 11.15 Min: 0 Median: 1.4709 Max: 3745 Percentiles: P50: 1.47 P75: 1.84 P99: 5.51 P99.9: 10.83 P99.99: 69.18 ------------------------------------------------------ [ 0, 1 ] 379128 18.339% 18.339% #### ( 1, 2 ] 1389889 67.233% 85.572% ############# ( 2, 3 ] 189486 9.166% 94.738% ## ( 3, 4 ] 61550 2.977% 97.716% # ( 4, 6 ] 35222 1.704% 99.419% ( 6, 10 ] 9615 0.465% 99.884% ( 10, 15 ] 1951 0.094% 99.979% ( 15, 22 ] 179 0.009% 99.988% ( 22, 34 ] 24 0.001% 99.989% ( 34, 51 ] 14 0.001% 99.989% ( 51, 76 ] 21 0.001% 99.990% ( 76, 110 ] 235 0.011% 100.002% ( 110, 170 ] 326 0.016% 100.018% ( 170, 250 ] 129 0.006% 100.024% ( 250, 380 ] 97 0.005% 100.028% ( 380, 580 ] 68 0.003% 100.032% ( 580, 870 ] 54 0.003% 100.034% ( 870, 1300 ] 27 0.001% 100.036% ( 1300, 1900 ] 16 0.001% 100.036% ( 1900, 2900 ] 6 0.000% 100.037% ( 2900, 4400 ] 8 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 297967 Average: 2.5463 StdDev: 12.33 Min: 0 Median: 1.5308 Max: 2731 Percentiles: P50: 1.53 P75: 1.90 P99: 7.54 P99.9: 111.30 P99.99: 373.51 ------------------------------------------------------ [ 0, 1 ] 41967 14.084% 14.084% ### ( 1, 2 ] 201632 67.669% 81.754% ############## ( 2, 3 ] 32529 10.917% 92.671% ## ( 3, 4 ] 9960 3.343% 96.013% # ( 4, 6 ] 7576 2.543% 98.556% # ( 6, 10 ] 3433 1.152% 99.708% ( 10, 15 ] 271 0.091% 99.799% ( 15, 22 ] 42 0.014% 99.813% ( 22, 34 ] 5 0.002% 99.815% ( 34, 51 ] 1 0.000% 99.815% ( 51, 76 ] 11 0.004% 99.819% ( 76, 110 ] 238 0.080% 99.899% ( 110, 170 ] 186 0.062% 99.961% ( 170, 250 ] 52 0.017% 99.979% ( 250, 380 ] 36 0.012% 99.991% ( 380, 580 ] 23 0.008% 99.998% ( 580, 870 ] 18 0.006% 100.004% ( 870, 1300 ] 7 0.002% 100.007% ( 1300, 1900 ] 2 0.001% 100.007% ( 1900, 2900 ] 1 0.000% 100.008% ** Level 2 read latency histogram (micros): Count: 95428 Average: 2.0382 StdDev: 5.46 Min: 1 Median: 1.4172 Max: 1040 Percentiles: P50: 1.42 P75: 1.81 P99: 5.57 P99.9: 9.99 P99.99: 20.52 ------------------------------------------------------ [ 0, 1 ] 22494 23.572% 23.572% ##### ( 1, 2 ] 60452 63.348% 86.920% ############# ( 2, 3 ] 7323 7.674% 94.594% ## ( 3, 4 ] 2717 2.847% 97.441% # ( 4, 6 ] 1894 1.985% 99.426% ( 6, 10 ] 454 0.476% 99.901% ( 10, 15 ] 75 0.079% 99.980% ( 15, 22 ] 12 0.013% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57414 Average: 3.5017 StdDev: 48.73 Min: 0 Median: 1.6643 Max: 4100 Percentiles: P50: 1.66 P75: 2.20 P99: 7.29 P99.9: 37.14 P99.99: 1351.72 ------------------------------------------------------ [ 0, 1 ] 4203 7.321% 7.321% # ( 1, 2 ] 36887 64.247% 71.568% ############# ( 2, 3 ] 10055 17.513% 89.081% #### ( 3, 4 ] 3141 5.471% 94.552% # ( 4, 6 ] 2397 4.175% 98.727% # ( 6, 10 ] 487 0.848% 99.575% ( 10, 15 ] 150 0.261% 99.836% ( 15, 22 ] 18 0.031% 99.868% ( 22, 34 ] 16 0.028% 99.895% ( 34, 51 ] 14 0.024% 99.920% ( 110, 170 ] 4 0.007% 99.927% ( 170, 250 ] 11 0.019% 99.946% ( 250, 380 ] 7 0.012% 99.958% ( 380, 580 ] 6 0.010% 99.969% ( 580, 870 ] 7 0.012% 99.981% ( 870, 1300 ] 5 0.009% 99.990% ( 1300, 1900 ] 3 0.005% 99.995% ( 1900, 2900 ] 7 0.012% 100.007% ( 2900, 4400 ] 6 0.010% 100.017% ** Level 4 read latency histogram (micros): Count: 35 Average: 1560.5143 StdDev: 1169.23 Min: 258 Median: 1120.8333 Max: 4843 Percentiles: P50: 1120.83 P75: 2306.25 P99: 4843.00 P99.9: 4843.00 P99.99: 4843.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 3 8.571% 17.143% ## ( 580, 870 ] 8 22.857% 40.000% ##### ( 870, 1300 ] 6 17.143% 57.143% ### ( 1300, 1900 ] 3 8.571% 65.714% ## ( 1900, 2900 ] 8 22.857% 88.571% ##### ( 2900, 4400 ] 3 8.571% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 616.9000 StdDev: 684.60 Min: 100 Median: 223.3333 Max: 2401 Percentiles: P50: 223.33 P75: 870.00 P99: 2401.00 P99.9: 2401.00 P99.99: 2401.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 6 30.000% 60.000% ###### ( 580, 870 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 23.0 total, 7.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 256.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.759 H:M:S, 29.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.861 H:M:S, 62.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-12:08:10 ... thread 0: (1000000,7000000) ops and (173164.6,244443.7) ops/second in (5.774852,28.636452) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.89 GB 31.5 5.5 0.0 5.5 12.1 6.6 0.0 1.8 137.2 301.9 40.87 38.48 116 0.352 5692K 7321 0.0 0.0 L1 18/18 2.02 GB 0.0 4.5 3.4 1.1 4.5 3.4 0.2 1.3 221.9 219.7 20.99 20.28 3 6.996 4730K 47K 0.0 0.0 L2 2/0 54.49 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.5 2.0 239.5 239.4 1.58 1.52 2 0.789 383K 191 0.0 0.0 L3 14/0 926.56 MB 0.9 0.8 0.6 0.2 0.8 0.6 1.1 1.4 195.3 195.1 4.08 3.61 3 1.359 808K 826 0.0 0.0 L4 167/0 9.63 GB 1.0 0.2 0.1 0.0 0.2 0.1 1.3 1.2 206.8 205.7 0.76 0.69 1 0.762 160K 865 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/30 102.66 GB 0.0 11.3 4.3 7.0 17.9 10.8 5.5 2.7 169.9 267.7 68.27 64.59 125 0.546 11M 56K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.3 4.3 7.0 17.9 10.8 5.3 2.7 169.9 267.7 68.27 64.59 125 0.546 11M 56K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.3 4.3 7.0 11.3 4.3 0.0 0.0 236.3 235.1 49.08 47.39 28 1.753 11M 56K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 351.2 19.19 17.20 97 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.8 total, 28.6 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.85 GB write, 634.31 MB/s write, 11.32 GB read, 402.40 MB/s read, 68.3 seconds Interval compaction: 17.85 GB write, 638.31 MB/s write, 11.32 GB read, 404.94 MB/s read, 68.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 15, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2520538 Average: 2.2306 StdDev: 11.93 Min: 0 Median: 1.4676 Max: 3745 Percentiles: P50: 1.47 P75: 1.84 P99: 5.56 P99.9: 11.88 P99.99: 118.00 ------------------------------------------------------ [ 0, 1 ] 465428 18.465% 18.465% #### ( 1, 2 ] 1699721 67.435% 85.900% ############# ( 2, 3 ] 224855 8.921% 94.821% ## ( 3, 4 ] 72963 2.895% 97.716% # ( 4, 6 ] 41522 1.647% 99.363% ( 6, 10 ] 12617 0.501% 99.864% ( 10, 15 ] 2425 0.096% 99.960% ( 15, 22 ] 235 0.009% 99.969% ( 22, 34 ] 26 0.001% 99.970% ( 34, 51 ] 17 0.001% 99.971% ( 51, 76 ] 38 0.002% 99.973% ( 76, 110 ] 370 0.015% 99.987% ( 110, 170 ] 517 0.021% 100.008% ( 170, 250 ] 218 0.009% 100.016% ( 250, 380 ] 186 0.007% 100.024% ( 380, 580 ] 117 0.005% 100.028% ( 580, 870 ] 88 0.003% 100.032% ( 870, 1300 ] 34 0.001% 100.033% ( 1300, 1900 ] 19 0.001% 100.034% ( 1900, 2900 ] 11 0.000% 100.034% ( 2900, 4400 ] 9 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 402348 Average: 2.5557 StdDev: 14.60 Min: 0 Median: 1.5057 Max: 3490 Percentiles: P50: 1.51 P75: 1.88 P99: 7.45 P99.9: 120.12 P99.99: 545.15 ------------------------------------------------------ [ 0, 1 ] 64435 16.015% 16.015% ### ( 1, 2 ] 270379 67.200% 83.215% ############# ( 2, 3 ] 40497 10.065% 93.280% ## ( 3, 4 ] 12195 3.031% 96.311% # ( 4, 6 ] 9216 2.291% 98.602% ( 6, 10 ] 4429 1.101% 99.702% ( 10, 15 ] 374 0.093% 99.795% ( 15, 22 ] 65 0.016% 99.812% ( 22, 34 ] 6 0.001% 99.813% ( 34, 51 ] 1 0.000% 99.813% ( 51, 76 ] 12 0.003% 99.816% ( 76, 110 ] 295 0.073% 99.890% ( 110, 170 ] 247 0.061% 99.951% ( 170, 250 ] 64 0.016% 99.967% ( 250, 380 ] 49 0.012% 99.979% ( 380, 580 ] 53 0.013% 99.992% ( 580, 870 ] 37 0.009% 100.001% ( 870, 1300 ] 12 0.003% 100.004% ( 1300, 1900 ] 3 0.001% 100.005% ( 1900, 2900 ] 1 0.000% 100.005% ( 2900, 4400 ] 1 0.000% 100.006% ** Level 2 read latency histogram (micros): Count: 95428 Average: 2.0382 StdDev: 5.46 Min: 1 Median: 1.4172 Max: 1040 Percentiles: P50: 1.42 P75: 1.81 P99: 5.57 P99.9: 9.99 P99.99: 20.52 ------------------------------------------------------ [ 0, 1 ] 22494 23.572% 23.572% ##### ( 1, 2 ] 60452 63.348% 86.920% ############# ( 2, 3 ] 7323 7.674% 94.594% ## ( 3, 4 ] 2717 2.847% 97.441% # ( 4, 6 ] 1894 1.985% 99.426% ( 6, 10 ] 454 0.476% 99.901% ( 10, 15 ] 75 0.079% 99.980% ( 15, 22 ] 12 0.013% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 64720 Average: 4.0297 StdDev: 49.88 Min: 0 Median: 1.6458 Max: 4100 Percentiles: P50: 1.65 P75: 2.14 P99: 8.67 P99.9: 302.32 P99.99: 1529.20 ------------------------------------------------------ [ 0, 1 ] 5690 8.792% 8.792% ## ( 1, 2 ] 41295 63.806% 72.597% ############# ( 2, 3 ] 10765 16.633% 89.231% ### ( 3, 4 ] 3444 5.321% 94.552% # ( 4, 6 ] 2495 3.855% 98.407% # ( 6, 10 ] 576 0.890% 99.297% ( 10, 15 ] 163 0.252% 99.549% ( 15, 22 ] 24 0.037% 99.586% ( 22, 34 ] 16 0.025% 99.611% ( 34, 51 ] 14 0.022% 99.632% ( 51, 76 ] 1 0.002% 99.634% ( 76, 110 ] 65 0.100% 99.734% ( 110, 170 ] 53 0.082% 99.816% ( 170, 250 ] 41 0.063% 99.879% ( 250, 380 ] 33 0.051% 99.930% ( 380, 580 ] 14 0.022% 99.952% ( 580, 870 ] 13 0.020% 99.972% ( 870, 1300 ] 10 0.015% 99.988% ( 1300, 1900 ] 4 0.006% 99.994% ( 1900, 2900 ] 8 0.012% 100.006% ( 2900, 4400 ] 6 0.009% 100.015% ** Level 4 read latency histogram (micros): Count: 50 Average: 1129.1000 StdDev: 1183.69 Min: 1 Median: 741.1111 Max: 4843 Percentiles: P50: 741.11 P75: 1800.00 P99: 4843.00 P99.9: 4843.00 P99.99: 4843.00 ------------------------------------------------------ [ 0, 1 ] 3 6.000% 6.000% # ( 1, 2 ] 4 8.000% 14.000% ## ( 2, 3 ] 1 2.000% 16.000% ( 3, 4 ] 1 2.000% 18.000% ( 110, 170 ] 1 2.000% 20.000% ( 170, 250 ] 2 4.000% 24.000% # ( 250, 380 ] 4 8.000% 32.000% ## ( 380, 580 ] 4 8.000% 40.000% ## ( 580, 870 ] 9 18.000% 58.000% #### ( 870, 1300 ] 6 12.000% 70.000% ## ( 1300, 1900 ] 3 6.000% 76.000% # ( 1900, 2900 ] 8 16.000% 92.000% ### ( 2900, 4400 ] 3 6.000% 98.000% # ( 4400, 6600 ] 1 2.000% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 816.7375 StdDev: 976.10 Min: 100 Median: 325.8333 Max: 3809 Percentiles: P50: 325.83 P75: 1128.00 P99: 3809.00 P99.9: 3809.00 P99.99: 3809.00 ------------------------------------------------------ ( 76, 110 ] 7 8.750% 8.750% ## ( 110, 170 ] 15 18.750% 27.500% #### ( 170, 250 ] 11 13.750% 41.250% ### ( 250, 380 ] 12 15.000% 56.250% ### ( 380, 580 ] 4 5.000% 61.250% # ( 580, 870 ] 8 10.000% 71.250% ## ( 870, 1300 ] 5 6.250% 77.500% # ( 1300, 1900 ] 6 7.500% 85.000% ## ( 1900, 2900 ] 7 8.750% 93.750% ## ( 2900, 4400 ] 5 6.250% 100.000% # ** DB Stats ** Uptime(secs): 28.8 total, 5.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 239.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.761 H:M:S, 33.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 170.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.002 H:M:S, 52.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-12:08:32 ... thread 0: (1000000,8000000) ops and (45713.9,158379.4) ops/second in (21.875179,50.511631) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/6 1.59 GB 6.3 7.4 0.0 7.4 15.0 7.6 0.0 2.0 140.8 283.7 54.12 48.87 133 0.407 7737K 13K 0.0 0.0 L1 10/10 985.60 MB 0.0 8.8 5.7 3.1 8.7 5.6 0.2 1.5 220.7 217.8 41.03 38.86 4 10.258 8662K 47K 0.0 0.0 L2 2/1 190.94 MB 1.0 0.4 0.2 0.2 0.4 0.2 4.8 2.0 239.5 239.4 1.58 1.52 2 0.789 383K 191 0.0 0.0 L3 25/8 2.16 GB 1.2 2.0 1.1 0.9 1.9 1.1 3.7 1.8 134.5 133.4 14.85 9.38 9 1.650 2029K 16K 0.0 0.0 L4 186/19 11.48 GB 1.1 2.3 2.0 0.3 2.3 2.0 1.3 1.1 125.3 124.6 18.59 10.89 20 0.929 2345K 12K 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/44 103.55 GB 0.0 20.9 9.0 11.9 28.3 16.4 11.3 3.7 164.3 222.5 130.17 109.53 168 0.775 21M 89K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.9 9.0 11.9 28.3 16.4 11.2 3.7 164.3 222.5 130.17 109.53 168 0.775 21M 89K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.9 9.0 11.9 20.7 8.8 0.0 0.0 202.0 200.5 105.83 89.61 58 1.825 21M 89K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 318.3 24.34 19.92 110 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.7 total, 50.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.29 GB write, 571.45 MB/s write, 20.88 GB read, 421.79 MB/s read, 130.2 seconds Interval compaction: 28.29 GB write, 573.49 MB/s write, 20.88 GB read, 423.30 MB/s read, 130.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 28, total-stops: 36, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3632552 Average: 2.7482 StdDev: 31.40 Min: 0 Median: 1.4736 Max: 9980 Percentiles: P50: 1.47 P75: 1.85 P99: 6.14 P99.9: 128.88 P99.99: 278.67 ------------------------------------------------------ [ 0, 1 ] 680004 18.720% 18.720% #### ( 1, 2 ] 2399105 66.045% 84.764% ############# ( 2, 3 ] 328466 9.042% 93.807% ## ( 3, 4 ] 112421 3.095% 96.901% # ( 4, 6 ] 75390 2.075% 98.977% ( 6, 10 ] 23501 0.647% 99.624% ( 10, 15 ] 4599 0.127% 99.750% ( 15, 22 ] 729 0.020% 99.770% ( 22, 34 ] 49 0.001% 99.772% ( 34, 51 ] 30 0.001% 99.773% ( 51, 76 ] 166 0.005% 99.777% ( 76, 110 ] 3400 0.094% 99.871% ( 110, 170 ] 3367 0.093% 99.964% ( 170, 250 ] 829 0.023% 99.986% ( 250, 380 ] 602 0.017% 100.003% ( 380, 580 ] 451 0.012% 100.015% ( 580, 870 ] 258 0.007% 100.022% ( 870, 1300 ] 102 0.003% 100.025% ( 1300, 1900 ] 69 0.002% 100.027% ( 1900, 2900 ] 67 0.002% 100.029% ( 2900, 4400 ] 90 0.002% 100.031% ( 4400, 6600 ] 19 0.001% 100.032% ( 6600, 9900 ] 13 0.000% 100.032% ( 9900, 14000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 1548256 Average: 4.8761 StdDev: 83.56 Min: 0 Median: 1.5929 Max: 12247 Percentiles: P50: 1.59 P75: 2.08 P99: 8.73 P99.9: 108.35 P99.99: 189.18 ------------------------------------------------------ [ 0, 1 ] 235821 15.231% 15.231% ### ( 1, 2 ] 907925 58.642% 73.873% ############ ( 2, 3 ] 205314 13.261% 87.134% ### ( 3, 4 ] 85503 5.523% 92.657% # ( 4, 6 ] 81453 5.261% 97.918% # ( 6, 10 ] 24574 1.587% 99.505% ( 10, 15 ] 3984 0.257% 99.762% ( 15, 22 ] 676 0.044% 99.806% ( 22, 34 ] 29 0.002% 99.808% ( 34, 51 ] 17 0.001% 99.809% ( 51, 76 ] 270 0.017% 99.826% ( 76, 110 ] 1201 0.078% 99.904% ( 110, 170 ] 1246 0.080% 99.984% ( 170, 250 ] 372 0.024% 100.008% ( 250, 380 ] 396 0.026% 100.034% ( 380, 580 ] 447 0.029% 100.063% ( 580, 870 ] 438 0.028% 100.091% ( 870, 1300 ] 294 0.019% 100.110% ( 1300, 1900 ] 168 0.011% 100.121% ( 1900, 2900 ] 214 0.014% 100.135% ( 2900, 4400 ] 282 0.018% 100.153% ( 4400, 6600 ] 100 0.006% 100.159% ( 6600, 9900 ] 32 0.002% 100.161% ( 9900, 14000 ] 3 0.000% 100.162% ** Level 2 read latency histogram (micros): Count: 95428 Average: 2.0382 StdDev: 5.46 Min: 1 Median: 1.4172 Max: 1040 Percentiles: P50: 1.42 P75: 1.81 P99: 5.57 P99.9: 9.99 P99.99: 20.52 ------------------------------------------------------ [ 0, 1 ] 22494 23.572% 23.572% ##### ( 1, 2 ] 60452 63.348% 86.920% ############# ( 2, 3 ] 7323 7.674% 94.594% ## ( 3, 4 ] 2717 2.847% 97.441% # ( 4, 6 ] 1894 1.985% 99.426% ( 6, 10 ] 454 0.476% 99.901% ( 10, 15 ] 75 0.079% 99.980% ( 15, 22 ] 12 0.013% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 406124 Average: 11.0999 StdDev: 138.88 Min: 0 Median: 1.8998 Max: 12231 Percentiles: P50: 1.90 P75: 2.88 P99: 9.78 P99.9: 762.29 P99.99: 987.29 ------------------------------------------------------ [ 0, 1 ] 10754 2.648% 2.648% # ( 1, 2 ] 213730 52.627% 55.275% ########### ( 2, 3 ] 90737 22.342% 77.617% #### ( 3, 4 ] 43022 10.593% 88.210% ## ( 4, 6 ] 37825 9.314% 97.524% ## ( 6, 10 ] 6340 1.561% 99.085% ( 10, 15 ] 1460 0.359% 99.445% ( 15, 22 ] 168 0.041% 99.486% ( 22, 34 ] 25 0.006% 99.492% ( 34, 51 ] 17 0.004% 99.496% ( 51, 76 ] 4 0.001% 99.497% ( 76, 110 ] 71 0.017% 99.515% ( 110, 170 ] 119 0.029% 99.544% ( 170, 250 ] 194 0.048% 99.592% ( 250, 380 ] 320 0.079% 99.671% ( 380, 580 ] 540 0.133% 99.804% ( 580, 870 ] 625 0.154% 99.957% ( 870, 1300 ] 489 0.120% 100.078% ( 1300, 1900 ] 245 0.060% 100.138% ( 1900, 2900 ] 155 0.038% 100.176% ( 2900, 4400 ] 232 0.057% 100.233% ( 4400, 6600 ] 70 0.017% 100.251% ( 6600, 9900 ] 7 0.002% 100.252% ( 9900, 14000 ] 1 0.000% 100.253% ** Level 4 read latency histogram (micros): Count: 20523 Average: 10.0893 StdDev: 138.43 Min: 1 Median: 2.0810 Max: 6572 Percentiles: P50: 2.08 P75: 3.05 P99: 10.51 P99.9: 1868.62 P99.99: 4015.19 ------------------------------------------------------ [ 0, 1 ] 183 0.892% 0.892% ( 1, 2 ] 9637 46.957% 47.849% ######### ( 2, 3 ] 5448 26.546% 74.395% ##### ( 3, 4 ] 2442 11.899% 86.293% ## ( 4, 6 ] 2294 11.178% 97.471% ## ( 6, 10 ] 305 1.486% 98.957% ( 10, 15 ] 86 0.419% 99.376% ( 15, 22 ] 4 0.019% 99.396% ( 22, 34 ] 2 0.010% 99.406% ( 34, 51 ] 1 0.005% 99.410% ( 76, 110 ] 10 0.049% 99.459% ( 110, 170 ] 9 0.044% 99.503% ( 170, 250 ] 23 0.112% 99.615% ( 250, 380 ] 9 0.044% 99.659% ( 380, 580 ] 5 0.024% 99.683% ( 580, 870 ] 17 0.083% 99.766% ( 870, 1300 ] 18 0.088% 99.854% ( 1300, 1900 ] 10 0.049% 99.903% ( 1900, 2900 ] 12 0.058% 99.961% ( 2900, 4400 ] 8 0.039% 100.000% ( 4400, 6600 ] 5 0.024% 100.024% ** Level 5 read latency histogram (micros): Count: 80 Average: 816.7375 StdDev: 976.10 Min: 100 Median: 325.8333 Max: 3809 Percentiles: P50: 325.83 P75: 1128.00 P99: 3809.00 P99.9: 3809.00 P99.99: 3809.00 ------------------------------------------------------ ( 76, 110 ] 7 8.750% 8.750% ## ( 110, 170 ] 15 18.750% 27.500% #### ( 170, 250 ] 11 13.750% 41.250% ### ( 250, 380 ] 12 15.000% 56.250% ### ( 380, 580 ] 4 5.000% 61.250% # ( 580, 870 ] 8 10.000% 71.250% ## ( 870, 1300 ] 5 6.250% 77.500% # ( 1300, 1900 ] 6 7.500% 85.000% ## ( 1900, 2900 ] 7 8.750% 93.750% ## ( 2900, 4400 ] 5 6.250% 100.000% # ** DB Stats ** Uptime(secs): 50.7 total, 21.9 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 155.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.274 H:M:S, 55.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 44.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:18.513 H:M:S, 84.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/27-12:08:36 ... thread 0: (1000000,9000000) ops and (235957.8,164384.5) ops/second in (4.238046,54.749677) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/6 2.51 GB 113.2 8.4 0.0 8.4 16.9 8.5 0.0 2.0 138.7 278.1 62.22 55.43 148 0.420 8761K 14K 0.0 0.0 L1 10/10 985.60 MB 0.0 8.8 5.7 3.1 8.7 5.6 0.2 1.5 220.7 217.8 41.03 38.86 4 10.258 8662K 47K 0.0 0.0 L2 1/0 95.44 MB 1.0 0.4 0.2 0.2 0.4 0.2 4.8 2.0 239.5 239.4 1.58 1.52 2 0.789 383K 191 0.0 0.0 L3 14/0 887.39 MB 0.9 2.2 1.2 1.0 2.2 1.2 3.7 1.8 134.9 133.7 16.47 10.44 10 1.647 2256K 19K 0.0 0.0 L4 158/0 9.59 GB 1.0 4.3 3.4 0.9 4.3 3.3 1.3 1.3 121.5 120.8 36.27 20.79 33 1.099 4376K 18K 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/16 104.46 GB 0.0 24.1 10.4 13.7 32.4 18.8 14.6 3.8 156.7 210.8 157.58 127.05 197 0.800 24M 99K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.1 10.4 13.7 32.4 18.8 14.5 3.8 156.7 210.8 157.58 127.05 197 0.800 24M 99K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.1 10.4 13.7 23.9 10.3 0.0 0.0 190.6 189.3 129.51 104.57 75 1.727 24M 99K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 309.8 28.07 22.48 122 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.9 total, 54.8 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.43 GB write, 604.56 MB/s write, 24.11 GB read, 449.48 MB/s read, 157.6 seconds Interval compaction: 32.43 GB write, 606.56 MB/s write, 24.11 GB read, 450.97 MB/s read, 157.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 28, total-stops: 56, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4005235 Average: 2.8734 StdDev: 36.19 Min: 0 Median: 1.4948 Max: 9980 Percentiles: P50: 1.49 P75: 1.88 P99: 6.56 P99.9: 125.41 P99.99: 289.22 ------------------------------------------------------ [ 0, 1 ] 705369 17.611% 17.611% #### ( 1, 2 ] 2621808 65.460% 83.071% ############# ( 2, 3 ] 399876 9.984% 93.055% ## ( 3, 4 ] 135920 3.394% 96.448% # ( 4, 6 ] 98112 2.450% 98.898% ( 6, 10 ] 29103 0.727% 99.624% ( 10, 15 ] 5627 0.140% 99.765% ( 15, 22 ] 842 0.021% 99.786% ( 22, 34 ] 58 0.001% 99.787% ( 34, 51 ] 34 0.001% 99.788% ( 51, 76 ] 169 0.004% 99.792% ( 76, 110 ] 3434 0.086% 99.878% ( 110, 170 ] 3421 0.085% 99.963% ( 170, 250 ] 873 0.022% 99.985% ( 250, 380 ] 628 0.016% 100.001% ( 380, 580 ] 487 0.012% 100.013% ( 580, 870 ] 310 0.008% 100.021% ( 870, 1300 ] 142 0.004% 100.024% ( 1300, 1900 ] 97 0.002% 100.027% ( 1900, 2900 ] 109 0.003% 100.030% ( 2900, 4400 ] 147 0.004% 100.033% ( 4400, 6600 ] 36 0.001% 100.034% ( 6600, 9900 ] 14 0.000% 100.034% ( 9900, 14000 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 1854100 Average: 5.5655 StdDev: 95.09 Min: 0 Median: 1.6380 Max: 12247 Percentiles: P50: 1.64 P75: 2.28 P99: 8.92 P99.9: 112.67 P99.99: 251.03 ------------------------------------------------------ [ 0, 1 ] 245474 13.240% 13.240% ### ( 1, 2 ] 1068263 57.616% 70.856% ############ ( 2, 3 ] 274769 14.820% 85.675% ### ( 3, 4 ] 114125 6.155% 91.831% # ( 4, 6 ] 109114 5.885% 97.716% # ( 6, 10 ] 32570 1.757% 99.472% ( 10, 15 ] 5432 0.293% 99.765% ( 15, 22 ] 840 0.045% 99.811% ( 22, 34 ] 50 0.003% 99.813% ( 34, 51 ] 20 0.001% 99.814% ( 51, 76 ] 273 0.015% 99.829% ( 76, 110 ] 1258 0.068% 99.897% ( 110, 170 ] 1322 0.071% 99.968% ( 170, 250 ] 402 0.022% 99.990% ( 250, 380 ] 455 0.025% 100.014% ( 380, 580 ] 538 0.029% 100.043% ( 580, 870 ] 565 0.030% 100.074% ( 870, 1300 ] 431 0.023% 100.097% ( 1300, 1900 ] 264 0.014% 100.111% ( 1900, 2900 ] 363 0.020% 100.131% ( 2900, 4400 ] 476 0.026% 100.157% ( 4400, 6600 ] 155 0.008% 100.165% ( 6600, 9900 ] 44 0.002% 100.167% ( 9900, 14000 ] 3 0.000% 100.168% ** Level 2 read latency histogram (micros): Count: 95428 Average: 2.0382 StdDev: 5.46 Min: 1 Median: 1.4172 Max: 1040 Percentiles: P50: 1.42 P75: 1.81 P99: 5.57 P99.9: 9.99 P99.99: 20.52 ------------------------------------------------------ [ 0, 1 ] 22494 23.572% 23.572% ##### ( 1, 2 ] 60452 63.348% 86.920% ############# ( 2, 3 ] 7323 7.674% 94.594% ## ( 3, 4 ] 2717 2.847% 97.441% # ( 4, 6 ] 1894 1.985% 99.426% ( 6, 10 ] 454 0.476% 99.901% ( 10, 15 ] 75 0.079% 99.980% ( 15, 22 ] 12 0.013% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 502861 Average: 12.3111 StdDev: 149.99 Min: 0 Median: 1.9027 Max: 12231 Percentiles: P50: 1.90 P75: 2.89 P99: 10.21 P99.9: 945.97 P99.99: 1239.50 ------------------------------------------------------ [ 0, 1 ] 12745 2.534% 2.534% # ( 1, 2 ] 264411 52.581% 55.116% ########### ( 2, 3 ] 112968 22.465% 77.581% #### ( 3, 4 ] 53038 10.547% 88.128% ## ( 4, 6 ] 46354 9.218% 97.346% ## ( 6, 10 ] 8237 1.638% 98.984% ( 10, 15 ] 1848 0.367% 99.352% ( 15, 22 ] 215 0.043% 99.394% ( 22, 34 ] 32 0.006% 99.401% ( 34, 51 ] 19 0.004% 99.405% ( 51, 76 ] 5 0.001% 99.406% ( 76, 110 ] 71 0.014% 99.420% ( 110, 170 ] 129 0.026% 99.445% ( 170, 250 ] 222 0.044% 99.490% ( 250, 380 ] 401 0.080% 99.569% ( 380, 580 ] 692 0.138% 99.707% ( 580, 870 ] 854 0.170% 99.877% ( 870, 1300 ] 663 0.132% 100.009% ( 1300, 1900 ] 338 0.067% 100.076% ( 1900, 2900 ] 257 0.051% 100.127% ( 2900, 4400 ] 351 0.070% 100.197% ( 4400, 6600 ] 93 0.018% 100.215% ( 6600, 9900 ] 10 0.002% 100.217% ( 9900, 14000 ] 1 0.000% 100.217% ** Level 4 read latency histogram (micros): Count: 121580 Average: 9.6009 StdDev: 137.21 Min: 1 Median: 1.8882 Max: 9284 Percentiles: P50: 1.89 P75: 2.83 P99: 9.84 P99.9: 1297.17 P99.99: 3040.59 ------------------------------------------------------ [ 0, 1 ] 2051 1.687% 1.687% ( 1, 2 ] 66131 54.393% 56.080% ########### ( 2, 3 ] 27642 22.736% 78.816% ##### ( 3, 4 ] 11692 9.617% 88.432% ## ( 4, 6 ] 10401 8.555% 96.987% ## ( 6, 10 ] 2549 2.097% 99.084% ( 10, 15 ] 474 0.390% 99.474% ( 15, 22 ] 43 0.035% 99.509% ( 22, 34 ] 7 0.006% 99.515% ( 34, 51 ] 3 0.002% 99.517% ( 76, 110 ] 27 0.022% 99.539% ( 110, 170 ] 39 0.032% 99.571% ( 170, 250 ] 86 0.071% 99.642% ( 250, 380 ] 66 0.054% 99.696% ( 380, 580 ] 72 0.059% 99.756% ( 580, 870 ] 88 0.072% 99.828% ( 870, 1300 ] 88 0.072% 99.900% ( 1300, 1900 ] 52 0.043% 99.943% ( 1900, 2900 ] 50 0.041% 99.984% ( 2900, 4400 ] 73 0.060% 100.044% ( 4400, 6600 ] 17 0.014% 100.058% ( 6600, 9900 ] 5 0.004% 100.063% ** Level 5 read latency histogram (micros): Count: 280 Average: 1405.8107 StdDev: 1587.09 Min: 76 Median: 720.6061 Max: 8667 Percentiles: P50: 720.61 P75: 2142.42 P99: 6820.00 P99.9: 8667.00 P99.99: 8667.00 ------------------------------------------------------ ( 51, 76 ] 1 0.357% 0.357% ( 76, 110 ] 12 4.286% 4.643% # ( 110, 170 ] 30 10.714% 15.357% ## ( 170, 250 ] 16 5.714% 21.071% # ( 250, 380 ] 29 10.357% 31.429% ## ( 380, 580 ] 36 12.857% 44.286% ### ( 580, 870 ] 33 11.786% 56.071% ## ( 870, 1300 ] 28 10.000% 66.071% ## ( 1300, 1900 ] 17 6.071% 72.143% # ( 1900, 2900 ] 33 11.786% 83.929% ## ( 2900, 4400 ] 27 9.643% 93.571% ## ( 4400, 6600 ] 15 5.357% 98.929% # ( 6600, 9900 ] 3 1.071% 100.000% ** DB Stats ** Uptime(secs): 54.9 total, 4.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 161.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.726 H:M:S, 54.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 232.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.451 H:M:S, 34.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-12:08:40 ... thread 0: (1000000,10000000) ops and (301679.8,172222.4) ops/second in (3.314773,58.064450) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/6 3.56 GB 220.2 9.3 0.0 9.3 18.8 9.5 0.0 2.0 138.4 280.2 68.73 61.55 165 0.417 9656K 15K 0.0 0.0 L1 10/10 985.60 MB 0.0 8.8 5.7 3.1 8.7 5.6 0.2 1.5 220.7 217.8 41.03 38.86 4 10.258 8662K 47K 0.0 0.0 L2 1/0 95.44 MB 1.0 0.4 0.2 0.2 0.4 0.2 4.8 2.0 239.5 239.4 1.58 1.52 2 0.789 383K 191 0.0 0.0 L3 14/0 887.39 MB 0.9 2.2 1.2 1.0 2.2 1.2 3.7 1.8 134.9 133.7 16.47 10.44 10 1.647 2256K 19K 0.0 0.0 L4 158/0 9.59 GB 1.0 4.3 3.4 0.9 4.3 3.3 1.3 1.3 121.5 120.8 36.27 20.79 33 1.099 4376K 18K 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/16 105.50 GB 0.0 25.0 10.4 14.5 34.3 19.8 14.6 3.6 155.9 214.3 164.08 133.17 214 0.767 25M 100K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.0 10.4 14.5 34.3 19.8 14.5 3.6 155.9 214.3 164.08 133.17 214 0.767 25M 100K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.0 10.4 14.5 24.8 10.3 0.0 0.0 192.4 191.1 132.90 107.90 78 1.704 25M 100K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 313.2 31.18 25.27 136 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.2 total, 58.1 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.34 GB write, 603.67 MB/s write, 24.97 GB read, 439.05 MB/s read, 164.1 seconds Interval compaction: 34.34 GB write, 605.55 MB/s write, 24.97 GB read, 440.41 MB/s read, 164.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 61, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 28, total-stops: 61, interval: 89 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4293570 Average: 2.8299 StdDev: 35.06 Min: 0 Median: 1.4972 Max: 9980 Percentiles: P50: 1.50 P75: 1.88 P99: 6.36 P99.9: 118.96 P99.99: 264.44 ------------------------------------------------------ [ 0, 1 ] 744916 17.350% 17.350% ### ( 1, 2 ] 2819708 65.673% 83.022% ############# ( 2, 3 ] 433035 10.086% 93.108% ## ( 3, 4 ] 146271 3.407% 96.515% # ( 4, 6 ] 103959 2.421% 98.936% ( 6, 10 ] 30479 0.710% 99.646% ( 10, 15 ] 5833 0.136% 99.782% ( 15, 22 ] 862 0.020% 99.802% ( 22, 34 ] 59 0.001% 99.803% ( 34, 51 ] 36 0.001% 99.804% ( 51, 76 ] 174 0.004% 99.808% ( 76, 110 ] 3434 0.080% 99.888% ( 110, 170 ] 3426 0.080% 99.968% ( 170, 250 ] 879 0.020% 99.988% ( 250, 380 ] 636 0.015% 100.003% ( 380, 580 ] 490 0.011% 100.015% ( 580, 870 ] 314 0.007% 100.022% ( 870, 1300 ] 146 0.003% 100.025% ( 1300, 1900 ] 99 0.002% 100.028% ( 1900, 2900 ] 109 0.003% 100.030% ( 2900, 4400 ] 149 0.003% 100.034% ( 4400, 6600 ] 36 0.001% 100.034% ( 6600, 9900 ] 14 0.000% 100.035% ( 9900, 14000 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 2006178 Average: 5.3410 StdDev: 91.45 Min: 0 Median: 1.6338 Max: 12247 Percentiles: P50: 1.63 P75: 2.24 P99: 8.88 P99.9: 112.89 P99.99: 258.86 ------------------------------------------------------ [ 0, 1 ] 259065 12.913% 12.913% ### ( 1, 2 ] 1173984 58.518% 71.432% ############ ( 2, 3 ] 295692 14.739% 86.171% ### ( 3, 4 ] 119256 5.944% 92.115% # ( 4, 6 ] 112860 5.626% 97.741% # ( 6, 10 ] 35135 1.751% 99.492% ( 10, 15 ] 5553 0.277% 99.769% ( 15, 22 ] 854 0.043% 99.812% ( 22, 34 ] 52 0.003% 99.814% ( 34, 51 ] 20 0.001% 99.815% ( 51, 76 ] 273 0.014% 99.829% ( 76, 110 ] 1360 0.068% 99.897% ( 110, 170 ] 1409 0.070% 99.967% ( 170, 250 ] 432 0.022% 99.988% ( 250, 380 ] 475 0.024% 100.012% ( 380, 580 ] 554 0.028% 100.040% ( 580, 870 ] 572 0.029% 100.068% ( 870, 1300 ] 432 0.022% 100.090% ( 1300, 1900 ] 264 0.013% 100.103% ( 1900, 2900 ] 363 0.018% 100.121% ( 2900, 4400 ] 476 0.024% 100.145% ( 4400, 6600 ] 155 0.008% 100.152% ( 6600, 9900 ] 44 0.002% 100.155% ( 9900, 14000 ] 3 0.000% 100.155% ** Level 2 read latency histogram (micros): Count: 95428 Average: 2.0382 StdDev: 5.46 Min: 1 Median: 1.4172 Max: 1040 Percentiles: P50: 1.42 P75: 1.81 P99: 5.57 P99.9: 9.99 P99.99: 20.52 ------------------------------------------------------ [ 0, 1 ] 22494 23.572% 23.572% ##### ( 1, 2 ] 60452 63.348% 86.920% ############# ( 2, 3 ] 7323 7.674% 94.594% ## ( 3, 4 ] 2717 2.847% 97.441% # ( 4, 6 ] 1894 1.985% 99.426% ( 6, 10 ] 454 0.476% 99.901% ( 10, 15 ] 75 0.079% 99.980% ( 15, 22 ] 12 0.013% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 3 0.003% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 502861 Average: 12.3111 StdDev: 149.99 Min: 0 Median: 1.9027 Max: 12231 Percentiles: P50: 1.90 P75: 2.89 P99: 10.21 P99.9: 945.97 P99.99: 1239.50 ------------------------------------------------------ [ 0, 1 ] 12745 2.534% 2.534% # ( 1, 2 ] 264411 52.581% 55.116% ########### ( 2, 3 ] 112968 22.465% 77.581% #### ( 3, 4 ] 53038 10.547% 88.128% ## ( 4, 6 ] 46354 9.218% 97.346% ## ( 6, 10 ] 8237 1.638% 98.984% ( 10, 15 ] 1848 0.367% 99.352% ( 15, 22 ] 215 0.043% 99.394% ( 22, 34 ] 32 0.006% 99.401% ( 34, 51 ] 19 0.004% 99.405% ( 51, 76 ] 5 0.001% 99.406% ( 76, 110 ] 71 0.014% 99.420% ( 110, 170 ] 129 0.026% 99.445% ( 170, 250 ] 222 0.044% 99.490% ( 250, 380 ] 401 0.080% 99.569% ( 380, 580 ] 692 0.138% 99.707% ( 580, 870 ] 854 0.170% 99.877% ( 870, 1300 ] 663 0.132% 100.009% ( 1300, 1900 ] 338 0.067% 100.076% ( 1900, 2900 ] 257 0.051% 100.127% ( 2900, 4400 ] 351 0.070% 100.197% ( 4400, 6600 ] 93 0.018% 100.215% ( 6600, 9900 ] 10 0.002% 100.217% ( 9900, 14000 ] 1 0.000% 100.217% ** Level 4 read latency histogram (micros): Count: 121580 Average: 9.6009 StdDev: 137.21 Min: 1 Median: 1.8882 Max: 9284 Percentiles: P50: 1.89 P75: 2.83 P99: 9.84 P99.9: 1297.17 P99.99: 3040.59 ------------------------------------------------------ [ 0, 1 ] 2051 1.687% 1.687% ( 1, 2 ] 66131 54.393% 56.080% ########### ( 2, 3 ] 27642 22.736% 78.816% ##### ( 3, 4 ] 11692 9.617% 88.432% ## ( 4, 6 ] 10401 8.555% 96.987% ## ( 6, 10 ] 2549 2.097% 99.084% ( 10, 15 ] 474 0.390% 99.474% ( 15, 22 ] 43 0.035% 99.509% ( 22, 34 ] 7 0.006% 99.515% ( 34, 51 ] 3 0.002% 99.517% ( 76, 110 ] 27 0.022% 99.539% ( 110, 170 ] 39 0.032% 99.571% ( 170, 250 ] 86 0.071% 99.642% ( 250, 380 ] 66 0.054% 99.696% ( 380, 580 ] 72 0.059% 99.756% ( 580, 870 ] 88 0.072% 99.828% ( 870, 1300 ] 88 0.072% 99.900% ( 1300, 1900 ] 52 0.043% 99.943% ( 1900, 2900 ] 50 0.041% 99.984% ( 2900, 4400 ] 73 0.060% 100.044% ( 4400, 6600 ] 17 0.014% 100.058% ( 6600, 9900 ] 5 0.004% 100.063% ** Level 5 read latency histogram (micros): Count: 280 Average: 1405.8107 StdDev: 1587.09 Min: 76 Median: 720.6061 Max: 8667 Percentiles: P50: 720.61 P75: 2142.42 P99: 6820.00 P99.9: 8667.00 P99.99: 8667.00 ------------------------------------------------------ ( 51, 76 ] 1 0.357% 0.357% ( 76, 110 ] 12 4.286% 4.643% # ( 110, 170 ] 30 10.714% 15.357% ## ( 170, 250 ] 16 5.714% 21.071% # ( 250, 380 ] 29 10.357% 31.429% ## ( 380, 580 ] 36 12.857% 44.286% ### ( 580, 870 ] 33 11.786% 56.071% ## ( 870, 1300 ] 28 10.000% 66.071% ## ( 1300, 1900 ] 17 6.071% 72.143% # ( 1900, 2900 ] 33 11.786% 83.929% ## ( 2900, 4400 ] 27 9.643% 93.571% ## ( 4400, 6600 ] 15 5.357% 98.929% # ( 6600, 9900 ] 3 1.071% 100.000% ** DB Stats ** Uptime(secs): 58.2 total, 3.3 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 168.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.356 H:M:S, 52.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 296.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.631 H:M:S, 19.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.635 micros/op 177447 ops/sec 60.001 seconds 10646999 operations; 171.9 MB/s Microseconds per write: Count: 10646999 Average: 5.6355 StdDev: 516.13 Min: 1 Median: 1.7491 Max: 830099 Percentiles: P50: 1.75 P75: 2.77 P99: 8.81 P99.9: 1105.75 P99.99: 2645.12 ------------------------------------------------------ [ 0, 1 ] 1313506 12.337% 12.337% ## ( 1, 2 ] 5352791 50.275% 62.612% ########## ( 2, 3 ] 1721116 16.165% 78.777% ### ( 3, 4 ] 1490829 14.002% 92.780% ### ( 4, 6 ] 582693 5.473% 98.252% # ( 6, 10 ] 113289 1.064% 99.316% ( 10, 15 ] 32591 0.306% 99.623% ( 15, 22 ] 8544 0.080% 99.703% ( 22, 34 ] 1778 0.017% 99.720% ( 34, 51 ] 238 0.002% 99.722% ( 51, 76 ] 43 0.000% 99.722% ( 76, 110 ] 7443 0.070% 99.792% ( 110, 170 ] 2885 0.027% 99.819% ( 170, 250 ] 330 0.003% 99.822% ( 250, 380 ] 138 0.001% 99.824% ( 380, 580 ] 32 0.000% 99.824% ( 580, 870 ] 16 0.000% 99.824% ( 870, 1300 ] 14756 0.139% 99.963% ( 1300, 1900 ] 23 0.000% 99.963% ( 1900, 2900 ] 3883 0.036% 99.999% ( 2900, 4400 ] 35 0.000% 100.000% ( 4400, 6600 ] 9 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 18 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 190349 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10646999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10987702968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 547 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30588073 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29705333620 rocksdb.compact.write.bytes COUNT : 29504819319 rocksdb.flush.write.bytes COUNT : 10833303445 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 67 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 327 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10746086400 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4294656 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29807877803 rocksdb.non.last.level.read.count COUNT : 7195282 rocksdb.block.checksum.compute.count COUNT : 7194255 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.371533 P95 : 3.882194 P99 : 7.068228 P100 : 830097.000000 COUNT : 10646999 SUM : 54737967 rocksdb.compaction.times.micros P50 : 1210937.500000 P95 : 5345000.000000 P99 : 18760000.000000 P100 : 20044289.000000 COUNT : 81 SUM : 147290560 rocksdb.compaction.times.cpu_micros P50 : 953947.368421 P95 : 5345000.000000 P99 : 15520000.000000 P100 : 18580394.000000 COUNT : 81 SUM : 119631824 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 702.444444 P95 : 2700.000000 P99 : 28160.000000 P100 : 430897.000000 COUNT : 144 SUM : 614040 rocksdb.compaction.outfile.sync.micros P50 : 1089.134615 P95 : 150636.363636 P99 : 247520.000000 P100 : 275294.000000 COUNT : 331 SUM : 7358295 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 99.400000 P95 : 1241.642857 P99 : 3957.500000 P100 : 5703.000000 COUNT : 259 SUM : 77589 rocksdb.table.open.io.micros P50 : 1525.000000 P95 : 8558.478261 P99 : 13851.769231 P100 : 18991.000000 COUNT : 547 SUM : 1256820 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.622649 P95 : 7.386525 P99 : 10.823912 P100 : 12301.000000 COUNT : 7192663 SUM : 46091547 rocksdb.read.block.get.micros P50 : 486.060606 P95 : 3811.904762 P99 : 6223.130435 P100 : 10103.000000 COUNT : 1094 SUM : 1034092 rocksdb.write.raw.block.micros P50 : 0.512439 P95 : 0.973635 P99 : 2.833917 P100 : 13483.000000 COUNT : 9782805 SUM : 20200895 rocksdb.numfiles.in.singlecompaction P50 : 3.288235 P95 : 5.366667 P99 : 29.320000 P100 : 42.000000 COUNT : 139 SUM : 568 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560557 P95 : 1160.698949 P99 : 2458.045560 P100 : 829905.000000 COUNT : 173627 SUM : 30603999 rocksdb.sst.read.micros P50 : 1.560557 P95 : 4.266119 P99 : 8.290487 P100 : 12247.000000 COUNT : 7195459 SUM : 31430353 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10646999 SUM : 10987702968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214190.476190 P95 : 418000.000000 P99 : 975928.000000 P100 : 975928.000000 COUNT : 144 SUM : 32827997 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 327 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0