[2024-12-07 14:24:17.010653] Starting SPDK v25.01-pre git sha1 a2f5e1c2d / DPDK 23.11.0 initialization... [2024-12-07 14:24:17.010863] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid187962 ] Set seed to 1733577857005351 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-07 14:24:17.136533] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-07 14:24:17.159869] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-07 14:24:17.159914] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 187962' to capture a snapshot of events at runtime. [2024-12-07 14:24:17.159925] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-07 14:24:17.159936] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-07 14:24:17.159944] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid187962 for offline analysis/debug. [2024-12-07 14:24:17.160511] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 7 14:24:21 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/07-14:24:24 ... thread 0: (1000000,1000000) ops and (354387.9,354387.9) ops/second in (2.821767,2.821767) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.01 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 350.4 2.34 2.11 12 0.195 0 0 0.0 0.0 L2 3/2 251.75 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 249.1 248.9 1.52 1.47 2 0.759 383K 198 0.0 0.0 L3 12/0 993.33 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1184/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 98.0 310.4 3.85 3.58 14 0.275 383K 198 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 98.0 310.4 3.85 3.58 14 0.275 383K 198 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 249.1 248.9 1.52 1.47 2 0.759 383K 198 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 350.4 2.34 2.11 12 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 392.65 MB/s write, 0.37 GB read, 124.00 MB/s read, 3.9 seconds Interval compaction: 1.17 GB write, 423.90 MB/s write, 0.37 GB read, 133.87 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 102607 Average: 1.8877 StdDev: 22.60 Min: 0 Median: 1.1851 Max: 3953 Percentiles: P50: 1.19 P75: 1.64 P99: 3.75 P99.9: 9.55 P99.99: 352.68 ------------------------------------------------------ [ 0, 1 ] 40795 39.758% 39.758% ######## ( 1, 2 ] 56787 55.344% 95.103% ########### ( 2, 3 ] 3182 3.101% 98.204% # ( 3, 4 ] 1097 1.069% 99.273% ( 4, 6 ] 497 0.484% 99.757% ( 6, 10 ] 166 0.162% 99.919% ( 10, 15 ] 54 0.053% 99.972% ( 15, 22 ] 5 0.005% 99.977% ( 22, 34 ] 1 0.001% 99.978% ( 110, 170 ] 6 0.006% 99.983% ( 170, 250 ] 3 0.003% 99.986% ( 250, 380 ] 6 0.006% 99.992% ( 380, 580 ] 1 0.001% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 2900, 4400 ] 3 0.003% 100.001% ** Level 1 read latency histogram (micros): Count: 5 Average: 1256.6000 StdDev: 1147.50 Min: 179 Median: 530.0000 Max: 2939 Percentiles: P50: 530.00 P75: 2650.00 P99: 2939.00 P99.9: 2939.00 P99.99: 2939.00 ------------------------------------------------------ ( 170, 250 ] 1 20.000% 20.000% #### ( 380, 580 ] 2 40.000% 60.000% ######## ( 1900, 2900 ] 1 20.000% 80.000% #### ( 2900, 4400 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 50517 Average: 1.8605 StdDev: 7.08 Min: 0 Median: 1.2543 Max: 1085 Percentiles: P50: 1.25 P75: 1.69 P99: 5.02 P99.9: 11.39 P99.99: 291.09 ------------------------------------------------------ [ 0, 1 ] 17853 35.341% 35.341% ####### ( 1, 2 ] 29125 57.654% 92.994% ############ ( 2, 3 ] 1904 3.769% 96.763% # ( 3, 4 ] 870 1.722% 98.486% ( 4, 6 ] 512 1.014% 99.499% ( 6, 10 ] 192 0.380% 99.879% ( 10, 15 ] 45 0.089% 99.968% ( 15, 22 ] 6 0.012% 99.980% ( 22, 34 ] 4 0.008% 99.988% ( 76, 110 ] 1 0.002% 99.990% ( 170, 250 ] 1 0.002% 99.992% ( 250, 380 ] 3 0.006% 99.998% ( 580, 870 ] 2 0.004% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 55 Average: 1555.4364 StdDev: 1239.17 Min: 81 Median: 1146.4286 Max: 5242 Percentiles: P50: 1146.43 P75: 2504.17 P99: 5242.00 P99.9: 5242.00 P99.99: 5242.00 ------------------------------------------------------ ( 76, 110 ] 2 3.636% 3.636% # ( 110, 170 ] 3 5.455% 9.091% # ( 170, 250 ] 1 1.818% 10.909% ( 250, 380 ] 2 3.636% 14.545% # ( 380, 580 ] 4 7.273% 21.818% # ( 580, 870 ] 11 20.000% 41.818% #### ( 870, 1300 ] 7 12.727% 54.545% ### ( 1300, 1900 ] 4 7.273% 61.818% # ( 1900, 2900 ] 12 21.818% 83.636% #### ( 2900, 4400 ] 8 14.545% 98.182% ### ( 4400, 6600 ] 1 1.818% 100.000% ** Level 4 read latency histogram (micros): Count: 20 Average: 1774.2000 StdDev: 1335.59 Min: 156 Median: 1300.0000 Max: 4480 Percentiles: P50: 1300.00 P75: 2700.00 P99: 4480.00 P99.9: 4480.00 P99.99: 4480.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 1 5.000% 10.000% # ( 250, 380 ] 2 10.000% 20.000% ## ( 580, 870 ] 4 20.000% 40.000% #### ( 870, 1300 ] 2 10.000% 50.000% ## ( 1300, 1900 ] 1 5.000% 55.000% # ( 1900, 2900 ] 5 25.000% 80.000% ##### ( 2900, 4400 ] 3 15.000% 95.000% ### ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 322.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.208 H:M:S, 6.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.208 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/07-14:24:27 ... thread 0: (1000000,2000000) ops and (322635.7,337767.2) ops/second in (3.099471,5.921238) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 1.17 GB 12.6 0.2 0.0 0.2 2.0 1.8 0.0 1.1 40.9 337.7 6.15 5.59 27 0.228 255K 239 0.0 0.0 L1 1/1 3.83 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 235.5 235.0 1.61 1.57 1 1.605 383K 629 0.0 0.0 L2 2/1 53.76 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 249.1 248.9 1.52 1.47 2 0.759 383K 198 0.0 0.0 L3 18/8 1.00 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 224.8 224.8 1.11 1.02 1 1.109 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 152.0 152.0 1.48 1.09 1 1.476 227K 0 0.0 0.0 L5 1048/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/22 97.92 GB 0.0 1.4 1.0 0.4 3.2 2.8 1.8 1.8 124.9 278.8 11.86 10.74 32 0.371 1504K 1066 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 1.0 0.4 3.2 2.8 1.7 1.8 124.9 278.8 11.86 10.74 32 0.371 1504K 1066 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 1.0 0.4 1.4 1.0 0.0 0.0 221.5 221.3 6.69 6.11 6 1.115 1504K 1066 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.1 5.17 4.62 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.23 GB write, 538.02 MB/s write, 1.45 GB read, 241.01 MB/s read, 11.9 seconds Interval compaction: 3.23 GB write, 558.43 MB/s write, 1.45 GB read, 250.15 MB/s read, 11.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 345774 Average: 2.1928 StdDev: 17.38 Min: 0 Median: 1.4636 Max: 5892 Percentiles: P50: 1.46 P75: 1.85 P99: 5.60 P99.9: 10.00 P99.99: 14.93 ------------------------------------------------------ [ 0, 1 ] 70158 20.290% 20.290% #### ( 1, 2 ] 221587 64.084% 84.374% ############# ( 2, 3 ] 32128 9.292% 93.666% ## ( 3, 4 ] 12592 3.642% 97.308% # ( 4, 6 ] 7337 2.122% 99.430% ( 6, 10 ] 1626 0.470% 99.900% ( 10, 15 ] 316 0.091% 99.991% ( 15, 22 ] 38 0.011% 100.002% ( 22, 34 ] 9 0.003% 100.005% ( 34, 51 ] 1 0.000% 100.005% ( 51, 76 ] 2 0.001% 100.006% ( 110, 170 ] 12 0.003% 100.009% ( 170, 250 ] 8 0.002% 100.012% ( 250, 380 ] 13 0.004% 100.015% ( 380, 580 ] 4 0.001% 100.016% ( 580, 870 ] 5 0.001% 100.018% ( 870, 1300 ] 3 0.001% 100.019% ( 1300, 1900 ] 4 0.001% 100.020% ( 1900, 2900 ] 1 0.000% 100.020% ( 2900, 4400 ] 3 0.001% 100.021% ( 4400, 6600 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 31 Average: 317.5484 StdDev: 663.48 Min: 1 Median: 2.5000 Max: 2939 Percentiles: P50: 2.50 P75: 323.12 P99: 2939.00 P99.9: 2939.00 P99.99: 2939.00 ------------------------------------------------------ [ 0, 1 ] 6 19.355% 19.355% #### ( 1, 2 ] 9 29.032% 48.387% ###### ( 2, 3 ] 1 3.226% 51.613% # ( 3, 4 ] 1 3.226% 54.839% # ( 4, 6 ] 1 3.226% 58.065% # ( 110, 170 ] 1 3.226% 61.290% # ( 170, 250 ] 2 6.452% 67.742% # ( 250, 380 ] 4 12.903% 80.645% ### ( 380, 580 ] 2 6.452% 87.097% # ( 580, 870 ] 1 3.226% 90.323% # ( 870, 1300 ] 1 3.226% 93.548% # ( 1900, 2900 ] 1 3.226% 96.774% # ( 2900, 4400 ] 1 3.226% 100.000% # ** Level 2 read latency histogram (micros): Count: 95770 Average: 2.0348 StdDev: 5.19 Min: 0 Median: 1.4106 Max: 1085 Percentiles: P50: 1.41 P75: 1.81 P99: 5.54 P99.9: 9.93 P99.99: 30.22 ------------------------------------------------------ [ 0, 1 ] 23537 24.577% 24.577% ##### ( 1, 2 ] 59295 61.914% 86.491% ############ ( 2, 3 ] 7429 7.757% 94.248% ## ( 3, 4 ] 3152 3.291% 97.539% # ( 4, 6 ] 1823 1.904% 99.442% ( 6, 10 ] 446 0.466% 99.908% ( 10, 15 ] 66 0.069% 99.977% ( 15, 22 ] 9 0.009% 99.986% ( 22, 34 ] 5 0.005% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 174034 Average: 3.3605 StdDev: 37.61 Min: 1 Median: 1.6241 Max: 5242 Percentiles: P50: 1.62 P75: 2.06 P99: 8.53 P99.9: 158.42 P99.99: 408.73 ------------------------------------------------------ [ 0, 1 ] 17953 10.316% 10.316% ## ( 1, 2 ] 110659 63.585% 73.901% ############# ( 2, 3 ] 29563 16.987% 90.887% ### ( 3, 4 ] 7105 4.083% 94.970% # ( 4, 6 ] 5511 3.167% 98.137% # ( 6, 10 ] 2375 1.365% 99.501% ( 10, 15 ] 366 0.210% 99.712% ( 15, 22 ] 61 0.035% 99.747% ( 22, 34 ] 22 0.013% 99.759% ( 51, 76 ] 8 0.005% 99.764% ( 76, 110 ] 79 0.045% 99.809% ( 110, 170 ] 197 0.113% 99.922% ( 170, 250 ] 70 0.040% 99.963% ( 250, 380 ] 44 0.025% 99.988% ( 380, 580 ] 32 0.018% 100.006% ( 580, 870 ] 30 0.017% 100.024% ( 870, 1300 ] 10 0.006% 100.029% ( 1300, 1900 ] 4 0.002% 100.032% ( 1900, 2900 ] 12 0.007% 100.038% ( 2900, 4400 ] 8 0.005% 100.043% ( 4400, 6600 ] 1 0.001% 100.044% ** Level 4 read latency histogram (micros): Count: 310 Average: 125.5839 StdDev: 552.85 Min: 1 Median: 2.7234 Max: 4480 Percentiles: P50: 2.72 P75: 9.60 P99: 3350.00 P99.9: 4480.00 P99.99: 4480.00 ------------------------------------------------------ [ 0, 1 ] 14 4.516% 4.516% # ( 1, 2 ] 73 23.548% 28.065% ##### ( 2, 3 ] 94 30.323% 58.387% ###### ( 3, 4 ] 32 10.323% 68.710% ## ( 4, 6 ] 15 4.839% 73.548% # ( 6, 10 ] 5 1.613% 75.161% ( 10, 15 ] 19 6.129% 81.290% # ( 15, 22 ] 24 7.742% 89.032% ## ( 22, 34 ] 8 2.581% 91.613% # ( 34, 51 ] 1 0.323% 91.935% ( 110, 170 ] 2 0.645% 92.581% ( 170, 250 ] 2 0.645% 93.226% ( 250, 380 ] 4 1.290% 94.516% ( 580, 870 ] 5 1.613% 96.129% ( 870, 1300 ] 2 0.645% 96.774% ( 1300, 1900 ] 1 0.323% 97.097% ( 1900, 2900 ] 5 1.613% 98.710% ( 2900, 4400 ] 3 0.968% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 635.1500 StdDev: 767.74 Min: 86 Median: 170.0000 Max: 3140 Percentiles: P50: 170.00 P75: 870.00 P99: 3140.00 P99.9: 3140.00 P99.99: 3140.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 4 20.000% 50.000% #### ( 380, 580 ] 3 15.000% 65.000% ### ( 580, 870 ] 2 10.000% 75.000% ## ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.622 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.413 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/07-14:24:30 ... thread 0: (1000000,3000000) ops and (315553.4,330023.1) ops/second in (3.169036,9.090274) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.41 GB 113.3 1.4 0.0 1.4 4.1 2.8 0.0 1.5 103.0 313.5 13.46 12.46 45 0.299 1407K 1504 0.0 0.0 L1 3/0 243.43 MB 24.3 1.1 1.1 0.0 1.1 1.1 0.2 1.0 232.2 231.5 4.90 4.79 2 2.449 1155K 3047 0.0 0.0 L2 3/3 384.79 MB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 249.1 248.9 1.52 1.47 2 0.759 383K 198 0.0 0.0 L3 14/3 690.65 MB 0.4 1.2 0.4 0.8 1.2 0.4 0.4 2.8 219.9 219.4 5.46 5.09 4 1.364 1218K 2303 0.0 0.0 L4 170/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 152.0 152.0 1.48 1.09 1 1.476 227K 0 0.0 0.0 L5 1056/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/10 98.90 GB 0.0 4.2 1.9 2.3 7.0 4.7 3.5 2.5 161.3 266.8 26.81 24.90 54 0.496 4392K 7052 0.0 0.0 Int 0/0 0.00 KB 0.0 4.2 1.9 2.3 7.0 4.7 3.4 2.5 161.3 266.8 26.81 24.90 54 0.496 4392K 7052 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.2 1.9 2.3 4.2 1.9 0.0 0.0 231.1 230.7 18.72 17.70 14 1.337 4392K 7052 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 350.4 8.09 7.20 40 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.99 GB write, 767.81 MB/s write, 4.22 GB read, 464.30 MB/s read, 26.8 seconds Interval compaction: 6.99 GB write, 786.79 MB/s write, 4.22 GB read, 475.78 MB/s read, 26.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 708428 Average: 2.2685 StdDev: 14.23 Min: 0 Median: 1.5228 Max: 5892 Percentiles: P50: 1.52 P75: 1.91 P99: 5.73 P99.9: 9.91 P99.99: 14.08 ------------------------------------------------------ [ 0, 1 ] 112962 15.945% 15.945% ### ( 1, 2 ] 461485 65.142% 81.088% ############# ( 2, 3 ] 76658 10.821% 91.908% ## ( 3, 4 ] 33231 4.691% 96.599% # ( 4, 6 ] 19644 2.773% 99.372% # ( 6, 10 ] 3827 0.540% 99.912% ( 10, 15 ] 675 0.095% 100.008% ( 15, 22 ] 87 0.012% 100.020% ( 22, 34 ] 16 0.002% 100.022% ( 34, 51 ] 4 0.001% 100.023% ( 51, 76 ] 4 0.001% 100.023% ( 110, 170 ] 15 0.002% 100.025% ( 170, 250 ] 19 0.003% 100.028% ( 250, 380 ] 20 0.003% 100.031% ( 380, 580 ] 5 0.001% 100.032% ( 580, 870 ] 10 0.001% 100.033% ( 870, 1300 ] 7 0.001% 100.034% ( 1300, 1900 ] 7 0.001% 100.035% ( 1900, 2900 ] 2 0.000% 100.035% ( 2900, 4400 ] 4 0.001% 100.036% ( 4400, 6600 ] 1 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 191490 Average: 2.8232 StdDev: 14.78 Min: 1 Median: 1.7129 Max: 2939 Percentiles: P50: 1.71 P75: 2.37 P99: 7.23 P99.9: 14.23 P99.99: 123.29 ------------------------------------------------------ [ 0, 1 ] 9460 4.940% 4.940% # ( 1, 2 ] 121033 63.206% 68.146% ############# ( 2, 3 ] 35460 18.518% 86.664% #### ( 3, 4 ] 12931 6.753% 93.417% # ( 4, 6 ] 10067 5.257% 98.674% # ( 6, 10 ] 2030 1.060% 99.734% ( 10, 15 ] 375 0.196% 99.930% ( 15, 22 ] 58 0.030% 99.960% ( 22, 34 ] 14 0.007% 99.968% ( 34, 51 ] 2 0.001% 99.969% ( 51, 76 ] 2 0.001% 99.970% ( 76, 110 ] 28 0.015% 99.984% ( 110, 170 ] 49 0.026% 100.010% ( 170, 250 ] 33 0.017% 100.027% ( 250, 380 ] 28 0.015% 100.042% ( 380, 580 ] 23 0.012% 100.054% ( 580, 870 ] 8 0.004% 100.058% ( 870, 1300 ] 5 0.003% 100.061% ( 1300, 1900 ] 4 0.002% 100.063% ( 1900, 2900 ] 1 0.001% 100.063% ( 2900, 4400 ] 1 0.001% 100.064% ** Level 2 read latency histogram (micros): Count: 95911 Average: 2.0359 StdDev: 5.18 Min: 0 Median: 1.4114 Max: 1085 Percentiles: P50: 1.41 P75: 1.82 P99: 5.54 P99.9: 9.93 P99.99: 30.18 ------------------------------------------------------ [ 0, 1 ] 23537 24.540% 24.540% ##### ( 1, 2 ] 59359 61.890% 86.430% ############ ( 2, 3 ] 7481 7.800% 94.230% ## ( 3, 4 ] 3165 3.300% 97.530% # ( 4, 6 ] 1834 1.912% 99.442% ( 6, 10 ] 447 0.466% 99.908% ( 10, 15 ] 66 0.069% 99.977% ( 15, 22 ] 9 0.009% 99.986% ( 22, 34 ] 5 0.005% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 210738 Average: 3.3479 StdDev: 35.23 Min: 1 Median: 1.6439 Max: 5242 Percentiles: P50: 1.64 P75: 2.14 P99: 8.61 P99.9: 163.29 P99.99: 475.12 ------------------------------------------------------ [ 0, 1 ] 19627 9.313% 9.313% ## ( 1, 2 ] 133157 63.186% 72.500% ############# ( 2, 3 ] 36653 17.393% 89.892% ### ( 3, 4 ] 9778 4.640% 94.532% # ( 4, 6 ] 7449 3.535% 98.067% # ( 6, 10 ] 3011 1.429% 99.496% ( 10, 15 ] 451 0.214% 99.710% ( 15, 22 ] 80 0.038% 99.748% ( 22, 34 ] 25 0.012% 99.759% ( 51, 76 ] 9 0.004% 99.764% ( 76, 110 ] 83 0.039% 99.803% ( 110, 170 ] 230 0.109% 99.912% ( 170, 250 ] 93 0.044% 99.956% ( 250, 380 ] 50 0.024% 99.980% ( 380, 580 ] 44 0.021% 100.001% ( 580, 870 ] 32 0.015% 100.016% ( 870, 1300 ] 14 0.007% 100.023% ( 1300, 1900 ] 6 0.003% 100.026% ( 1900, 2900 ] 12 0.006% 100.031% ( 2900, 4400 ] 8 0.004% 100.035% ( 4400, 6600 ] 1 0.000% 100.036% ** Level 4 read latency histogram (micros): Count: 310 Average: 125.5839 StdDev: 552.85 Min: 1 Median: 2.7234 Max: 4480 Percentiles: P50: 2.72 P75: 9.60 P99: 3350.00 P99.9: 4480.00 P99.99: 4480.00 ------------------------------------------------------ [ 0, 1 ] 14 4.516% 4.516% # ( 1, 2 ] 73 23.548% 28.065% ##### ( 2, 3 ] 94 30.323% 58.387% ###### ( 3, 4 ] 32 10.323% 68.710% ## ( 4, 6 ] 15 4.839% 73.548% # ( 6, 10 ] 5 1.613% 75.161% ( 10, 15 ] 19 6.129% 81.290% # ( 15, 22 ] 24 7.742% 89.032% ## ( 22, 34 ] 8 2.581% 91.613% # ( 34, 51 ] 1 0.323% 91.935% ( 110, 170 ] 2 0.645% 92.581% ( 170, 250 ] 2 0.645% 93.226% ( 250, 380 ] 4 1.290% 94.516% ( 580, 870 ] 5 1.613% 96.129% ( 870, 1300 ] 2 0.645% 96.774% ( 1300, 1900 ] 1 0.323% 97.097% ( 1900, 2900 ] 5 1.613% 98.710% ( 2900, 4400 ] 3 0.968% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 743.2667 StdDev: 997.61 Min: 86 Median: 250.0000 Max: 4223 Percentiles: P50: 250.00 P75: 797.50 P99: 4175.00 P99.9: 4223.00 P99.99: 4223.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 12 20.000% 40.000% #### ( 170, 250 ] 6 10.000% 50.000% ## ( 250, 380 ] 1 1.667% 51.667% ( 380, 580 ] 8 13.333% 65.000% ### ( 580, 870 ] 8 13.333% 78.333% ### ( 870, 1300 ] 3 5.000% 83.333% # ( 1300, 1900 ] 2 3.333% 86.667% # ( 1900, 2900 ] 4 6.667% 93.333% # ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 9.3 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 316.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.066 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 310.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.444 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/07-14:24:33 ... thread 0: (1000000,4000000) ops and (328445.6,329627.3) ops/second in (3.044644,12.134918) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.34 GB 207.7 2.2 0.0 2.2 5.9 3.7 0.0 1.6 116.2 309.7 19.52 18.15 61 0.320 2302K 2489 0.0 0.0 L1 3/0 243.43 MB 24.3 1.1 1.1 0.0 1.1 1.1 0.2 1.0 232.2 231.5 4.90 4.79 2 2.449 1155K 3047 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 249.1 248.9 1.52 1.47 2 0.759 383K 198 0.0 0.0 L3 22/0 984.53 MB 1.0 1.8 0.8 1.0 1.8 0.8 0.4 2.3 221.9 221.5 8.36 7.87 6 1.394 1884K 3791 0.0 0.0 L4 172/0 9.67 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.8 1.0 156.4 156.3 1.86 1.41 2 0.928 294K 150 0.0 0.0 L5 1056/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/4 99.82 GB 0.0 5.8 2.4 3.4 9.5 6.0 3.5 2.6 164.0 268.3 36.15 33.68 73 0.495 6021K 9675 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 2.4 3.4 9.5 6.0 3.4 2.6 164.0 268.3 36.15 33.68 73 0.495 6021K 9675 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 2.4 3.4 5.8 2.4 0.0 0.0 233.6 233.2 25.38 24.09 20 1.269 6021K 9675 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 350.8 10.78 9.60 53 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.1 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.47 GB write, 784.67 MB/s write, 5.79 GB read, 479.69 MB/s read, 36.2 seconds Interval compaction: 9.47 GB write, 799.20 MB/s write, 5.79 GB read, 488.58 MB/s read, 36.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 18, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 951925 Average: 2.1996 StdDev: 13.47 Min: 0 Median: 1.4853 Max: 5892 Percentiles: P50: 1.49 P75: 1.87 P99: 5.63 P99.9: 9.88 P99.99: 14.29 ------------------------------------------------------ [ 0, 1 ] 177679 18.665% 18.665% #### ( 1, 2 ] 614627 64.567% 83.232% ############# ( 2, 3 ] 91745 9.638% 92.870% ## ( 3, 4 ] 39775 4.178% 97.048% # ( 4, 6 ] 22730 2.388% 99.436% ( 6, 10 ] 4557 0.479% 99.915% ( 10, 15 ] 835 0.088% 100.002% ( 15, 22 ] 110 0.012% 100.014% ( 22, 34 ] 18 0.002% 100.016% ( 34, 51 ] 5 0.001% 100.016% ( 51, 76 ] 7 0.001% 100.017% ( 110, 170 ] 19 0.002% 100.019% ( 170, 250 ] 26 0.003% 100.022% ( 250, 380 ] 27 0.003% 100.025% ( 380, 580 ] 7 0.001% 100.025% ( 580, 870 ] 16 0.002% 100.027% ( 870, 1300 ] 10 0.001% 100.028% ( 1300, 1900 ] 8 0.001% 100.029% ( 1900, 2900 ] 2 0.000% 100.029% ( 2900, 4400 ] 6 0.001% 100.030% ( 4400, 6600 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 254208 Average: 2.6964 StdDev: 12.86 Min: 1 Median: 1.6822 Max: 2939 Percentiles: P50: 1.68 P75: 2.26 P99: 7.06 P99.9: 13.58 P99.99: 102.20 ------------------------------------------------------ [ 0, 1 ] 14819 5.829% 5.829% # ( 1, 2 ] 164599 64.750% 70.579% ############# ( 2, 3 ] 43960 17.293% 87.872% ### ( 3, 4 ] 15791 6.212% 94.084% # ( 4, 6 ] 11782 4.635% 98.719% # ( 6, 10 ] 2689 1.058% 99.777% ( 10, 15 ] 438 0.172% 99.949% ( 15, 22 ] 64 0.025% 99.974% ( 22, 34 ] 15 0.006% 99.980% ( 34, 51 ] 2 0.001% 99.981% ( 51, 76 ] 2 0.001% 99.982% ( 76, 110 ] 28 0.011% 99.993% ( 110, 170 ] 52 0.020% 100.013% ( 170, 250 ] 34 0.013% 100.026% ( 250, 380 ] 28 0.011% 100.037% ( 380, 580 ] 23 0.009% 100.046% ( 580, 870 ] 8 0.003% 100.050% ( 870, 1300 ] 5 0.002% 100.052% ( 1300, 1900 ] 4 0.002% 100.053% ( 1900, 2900 ] 1 0.000% 100.053% ( 2900, 4400 ] 1 0.000% 100.054% ** Level 2 read latency histogram (micros): Count: 95911 Average: 2.0359 StdDev: 5.18 Min: 0 Median: 1.4114 Max: 1085 Percentiles: P50: 1.41 P75: 1.82 P99: 5.54 P99.9: 9.93 P99.99: 30.18 ------------------------------------------------------ [ 0, 1 ] 23537 24.540% 24.540% ##### ( 1, 2 ] 59359 61.890% 86.430% ############ ( 2, 3 ] 7481 7.800% 94.230% ## ( 3, 4 ] 3165 3.300% 97.530% # ( 4, 6 ] 1834 1.912% 99.442% ( 6, 10 ] 447 0.466% 99.908% ( 10, 15 ] 66 0.069% 99.977% ( 15, 22 ] 9 0.009% 99.986% ( 22, 34 ] 5 0.005% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 224547 Average: 3.3329 StdDev: 34.41 Min: 1 Median: 1.6493 Max: 5242 Percentiles: P50: 1.65 P75: 2.16 P99: 8.56 P99.9: 163.84 P99.99: 482.48 ------------------------------------------------------ [ 0, 1 ] 20222 9.006% 9.006% ## ( 1, 2 ] 141772 63.137% 72.143% ############# ( 2, 3 ] 39298 17.501% 89.644% #### ( 3, 4 ] 10680 4.756% 94.400% # ( 4, 6 ] 8319 3.705% 98.105% # ( 6, 10 ] 3139 1.398% 99.503% ( 10, 15 ] 475 0.212% 99.714% ( 15, 22 ] 86 0.038% 99.752% ( 22, 34 ] 25 0.011% 99.764% ( 51, 76 ] 9 0.004% 99.768% ( 76, 110 ] 83 0.037% 99.804% ( 110, 170 ] 239 0.106% 99.911% ( 170, 250 ] 97 0.043% 99.954% ( 250, 380 ] 58 0.026% 99.980% ( 380, 580 ] 44 0.020% 100.000% ( 580, 870 ] 33 0.015% 100.014% ( 870, 1300 ] 15 0.007% 100.021% ( 1300, 1900 ] 7 0.003% 100.024% ( 1900, 2900 ] 12 0.005% 100.029% ( 2900, 4400 ] 8 0.004% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ** Level 4 read latency histogram (micros): Count: 3349 Average: 26.1824 StdDev: 182.86 Min: 0 Median: 1.7106 Max: 4480 Percentiles: P50: 1.71 P75: 2.57 P99: 499.14 P99.9: 3225.50 P99.99: 4480.00 ------------------------------------------------------ [ 0, 1 ] 303 9.047% 9.047% ## ( 1, 2 ] 1930 57.629% 66.677% ############ ( 2, 3 ] 487 14.542% 81.218% ### ( 3, 4 ] 198 5.912% 87.130% # ( 4, 6 ] 85 2.538% 89.669% # ( 6, 10 ] 59 1.762% 91.430% ( 10, 15 ] 30 0.896% 92.326% ( 15, 22 ] 26 0.776% 93.102% ( 22, 34 ] 8 0.239% 93.341% ( 34, 51 ] 1 0.030% 93.371% ( 51, 76 ] 3 0.090% 93.461% ( 76, 110 ] 49 1.463% 94.924% ( 110, 170 ] 73 2.180% 97.104% ( 170, 250 ] 28 0.836% 97.940% ( 250, 380 ] 23 0.687% 98.626% ( 380, 580 ] 21 0.627% 99.254% ( 580, 870 ] 11 0.328% 99.582% ( 870, 1300 ] 4 0.119% 99.701% ( 1300, 1900 ] 1 0.030% 99.731% ( 1900, 2900 ] 5 0.149% 99.881% ( 2900, 4400 ] 3 0.090% 99.970% ( 4400, 6600 ] 1 0.030% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 743.2667 StdDev: 997.61 Min: 86 Median: 250.0000 Max: 4223 Percentiles: P50: 250.00 P75: 797.50 P99: 4175.00 P99.9: 4223.00 P99.99: 4223.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 12 20.000% 40.000% #### ( 170, 250 ] 6 10.000% 50.000% ## ( 250, 380 ] 1 1.667% 51.667% ( 380, 580 ] 8 13.333% 65.000% ### ( 580, 870 ] 8 13.333% 78.333% ### ( 870, 1300 ] 3 5.000% 83.333% # ( 1300, 1900 ] 2 3.333% 86.667% # ( 1900, 2900 ] 4 6.667% 93.333% # ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 318.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.467 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.401 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/07-14:24:36 ... thread 0: (1000000,5000000) ops and (331734.3,330046.5) ops/second in (3.014461,15.149379) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 3.32 GB 25.2 3.0 0.0 3.0 7.7 4.7 0.0 1.6 121.5 309.9 25.40 23.68 78 0.326 3134K 3343 0.0 0.0 L1 3/3 243.43 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 232.2 231.5 4.90 4.79 2 2.449 1155K 3047 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 249.1 248.9 1.52 1.47 2 0.759 383K 198 0.0 0.0 L3 22/0 984.53 MB 1.0 1.8 0.8 1.0 1.8 0.8 0.4 2.3 221.9 221.5 8.36 7.87 6 1.394 1884K 3791 0.0 0.0 L4 172/0 9.67 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.8 1.0 156.4 156.3 1.86 1.41 2 0.928 294K 150 0.0 0.0 L5 1056/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/19 100.80 GB 0.0 6.6 2.4 4.2 11.3 7.0 3.5 2.4 160.6 274.2 42.03 39.22 90 0.467 6852K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.6 2.4 4.2 11.3 7.0 3.4 2.4 160.6 274.2 42.03 39.22 90 0.467 6852K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.6 2.4 4.2 6.6 2.4 0.0 0.0 237.1 236.7 28.46 27.12 23 1.238 6852K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 352.9 13.57 12.10 67 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.2 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.26 GB write, 749.59 MB/s write, 6.59 GB read, 438.91 MB/s read, 42.0 seconds Interval compaction: 11.26 GB write, 760.71 MB/s write, 6.59 GB read, 445.42 MB/s read, 42.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1240351 Average: 2.1787 StdDev: 13.15 Min: 0 Median: 1.4636 Max: 5892 Percentiles: P50: 1.46 P75: 1.85 P99: 5.57 P99.9: 10.00 P99.99: 18.18 ------------------------------------------------------ [ 0, 1 ] 248050 19.998% 19.998% #### ( 1, 2 ] 802629 64.710% 84.708% ############# ( 2, 3 ] 110779 8.931% 93.639% ## ( 3, 4 ] 46369 3.738% 97.378% # ( 4, 6 ] 25622 2.066% 99.444% ( 6, 10 ] 5662 0.456% 99.900% ( 10, 15 ] 1056 0.085% 99.985% ( 15, 22 ] 132 0.011% 99.996% ( 22, 34 ] 25 0.002% 99.998% ( 34, 51 ] 6 0.000% 99.998% ( 51, 76 ] 7 0.001% 99.999% ( 76, 110 ] 82 0.007% 100.005% ( 110, 170 ] 88 0.007% 100.013% ( 170, 250 ] 49 0.004% 100.017% ( 250, 380 ] 47 0.004% 100.020% ( 380, 580 ] 22 0.002% 100.022% ( 580, 870 ] 20 0.002% 100.024% ( 870, 1300 ] 15 0.001% 100.025% ( 1300, 1900 ] 10 0.001% 100.026% ( 1900, 2900 ] 2 0.000% 100.026% ( 2900, 4400 ] 8 0.001% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 254209 Average: 2.6969 StdDev: 12.86 Min: 1 Median: 1.6822 Max: 2939 Percentiles: P50: 1.68 P75: 2.26 P99: 7.06 P99.9: 13.59 P99.99: 103.42 ------------------------------------------------------ [ 0, 1 ] 14819 5.829% 5.829% # ( 1, 2 ] 164599 64.749% 70.579% ############# ( 2, 3 ] 43960 17.293% 87.872% ### ( 3, 4 ] 15791 6.212% 94.084% # ( 4, 6 ] 11782 4.635% 98.718% # ( 6, 10 ] 2689 1.058% 99.776% ( 10, 15 ] 438 0.172% 99.948% ( 15, 22 ] 64 0.025% 99.974% ( 22, 34 ] 15 0.006% 99.980% ( 34, 51 ] 2 0.001% 99.980% ( 51, 76 ] 2 0.001% 99.981% ( 76, 110 ] 28 0.011% 99.992% ( 110, 170 ] 53 0.021% 100.013% ( 170, 250 ] 34 0.013% 100.026% ( 250, 380 ] 28 0.011% 100.037% ( 380, 580 ] 23 0.009% 100.046% ( 580, 870 ] 8 0.003% 100.050% ( 870, 1300 ] 5 0.002% 100.052% ( 1300, 1900 ] 4 0.002% 100.053% ( 1900, 2900 ] 1 0.000% 100.053% ( 2900, 4400 ] 1 0.000% 100.054% ** Level 2 read latency histogram (micros): Count: 95911 Average: 2.0359 StdDev: 5.18 Min: 0 Median: 1.4114 Max: 1085 Percentiles: P50: 1.41 P75: 1.82 P99: 5.54 P99.9: 9.93 P99.99: 30.18 ------------------------------------------------------ [ 0, 1 ] 23537 24.540% 24.540% ##### ( 1, 2 ] 59359 61.890% 86.430% ############ ( 2, 3 ] 7481 7.800% 94.230% ## ( 3, 4 ] 3165 3.300% 97.530% # ( 4, 6 ] 1834 1.912% 99.442% ( 6, 10 ] 447 0.466% 99.908% ( 10, 15 ] 66 0.069% 99.977% ( 15, 22 ] 9 0.009% 99.986% ( 22, 34 ] 5 0.005% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 224547 Average: 3.3329 StdDev: 34.41 Min: 1 Median: 1.6493 Max: 5242 Percentiles: P50: 1.65 P75: 2.16 P99: 8.56 P99.9: 163.84 P99.99: 482.48 ------------------------------------------------------ [ 0, 1 ] 20222 9.006% 9.006% ## ( 1, 2 ] 141772 63.137% 72.143% ############# ( 2, 3 ] 39298 17.501% 89.644% #### ( 3, 4 ] 10680 4.756% 94.400% # ( 4, 6 ] 8319 3.705% 98.105% # ( 6, 10 ] 3139 1.398% 99.503% ( 10, 15 ] 475 0.212% 99.714% ( 15, 22 ] 86 0.038% 99.752% ( 22, 34 ] 25 0.011% 99.764% ( 51, 76 ] 9 0.004% 99.768% ( 76, 110 ] 83 0.037% 99.804% ( 110, 170 ] 239 0.106% 99.911% ( 170, 250 ] 97 0.043% 99.954% ( 250, 380 ] 58 0.026% 99.980% ( 380, 580 ] 44 0.020% 100.000% ( 580, 870 ] 33 0.015% 100.014% ( 870, 1300 ] 15 0.007% 100.021% ( 1300, 1900 ] 7 0.003% 100.024% ( 1900, 2900 ] 12 0.005% 100.029% ( 2900, 4400 ] 8 0.004% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ** Level 4 read latency histogram (micros): Count: 3349 Average: 26.1824 StdDev: 182.86 Min: 0 Median: 1.7106 Max: 4480 Percentiles: P50: 1.71 P75: 2.57 P99: 499.14 P99.9: 3225.50 P99.99: 4480.00 ------------------------------------------------------ [ 0, 1 ] 303 9.047% 9.047% ## ( 1, 2 ] 1930 57.629% 66.677% ############ ( 2, 3 ] 487 14.542% 81.218% ### ( 3, 4 ] 198 5.912% 87.130% # ( 4, 6 ] 85 2.538% 89.669% # ( 6, 10 ] 59 1.762% 91.430% ( 10, 15 ] 30 0.896% 92.326% ( 15, 22 ] 26 0.776% 93.102% ( 22, 34 ] 8 0.239% 93.341% ( 34, 51 ] 1 0.030% 93.371% ( 51, 76 ] 3 0.090% 93.461% ( 76, 110 ] 49 1.463% 94.924% ( 110, 170 ] 73 2.180% 97.104% ( 170, 250 ] 28 0.836% 97.940% ( 250, 380 ] 23 0.687% 98.626% ( 380, 580 ] 21 0.627% 99.254% ( 580, 870 ] 11 0.328% 99.582% ( 870, 1300 ] 4 0.119% 99.701% ( 1300, 1900 ] 1 0.030% 99.731% ( 1900, 2900 ] 5 0.149% 99.881% ( 2900, 4400 ] 3 0.090% 99.970% ( 4400, 6600 ] 1 0.030% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 743.2667 StdDev: 997.61 Min: 86 Median: 250.0000 Max: 4223 Percentiles: P50: 250.00 P75: 797.50 P99: 4175.00 P99.9: 4223.00 P99.99: 4223.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 12 20.000% 40.000% #### ( 170, 250 ] 6 10.000% 50.000% ## ( 250, 380 ] 1 1.667% 51.667% ( 380, 580 ] 8 13.333% 65.000% ### ( 580, 870 ] 8 13.333% 78.333% ### ( 870, 1300 ] 3 5.000% 83.333% # ( 1300, 1900 ] 2 3.333% 86.667% # ( 1900, 2900 ] 4 6.667% 93.333% # ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 15.4 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 320.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.875 H:M:S, 12.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.408 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/07-14:24:44 ... thread 0: (1000000,6000000) ops and (133247.6,264851.5) ops/second in (7.504827,22.654206) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 4.30 GB 157.1 4.9 0.0 4.9 10.5 5.7 0.0 1.9 141.0 304.9 35.30 33.18 99 0.357 5052K 6896 0.0 0.0 L1 3/3 243.43 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 232.2 231.5 4.90 4.79 2 2.449 1155K 3047 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 249.1 248.9 1.52 1.47 2 0.759 383K 198 0.0 0.0 L3 22/0 984.53 MB 1.0 1.8 0.8 1.0 1.8 0.8 0.4 2.3 221.9 221.5 8.36 7.87 6 1.394 1884K 3791 0.0 0.0 L4 172/0 9.67 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.8 1.0 156.4 156.3 1.86 1.41 2 0.928 294K 150 0.0 0.0 L5 1056/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/15 101.78 GB 0.0 8.4 2.4 6.1 14.1 8.0 3.5 2.5 166.3 277.6 51.94 48.71 111 0.468 8770K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.4 2.4 6.1 14.1 8.0 3.4 2.5 166.3 277.6 51.94 48.71 111 0.468 8770K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.4 2.4 6.1 8.4 2.3 0.0 0.0 243.5 243.1 35.47 34.03 28 1.267 8770K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 351.9 16.47 14.68 83 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.9 total, 22.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.08 GB write, 630.19 MB/s write, 8.44 GB read, 377.52 MB/s read, 51.9 seconds Interval compaction: 14.08 GB write, 636.44 MB/s write, 8.44 GB read, 381.26 MB/s read, 51.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 21, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2142408 Average: 2.1525 StdDev: 11.80 Min: 0 Median: 1.4570 Max: 5892 Percentiles: P50: 1.46 P75: 1.83 P99: 5.49 P99.9: 9.89 P99.99: 21.07 ------------------------------------------------------ [ 0, 1 ] 420048 19.606% 19.606% #### ( 1, 2 ] 1424811 66.505% 86.111% ############# ( 2, 3 ] 177000 8.262% 94.373% ## ( 3, 4 ] 71805 3.352% 97.725% # ( 4, 6 ] 36620 1.709% 99.434% ( 6, 10 ] 10255 0.479% 99.913% ( 10, 15 ] 1472 0.069% 99.981% ( 15, 22 ] 212 0.010% 99.991% ( 22, 34 ] 31 0.001% 99.993% ( 34, 51 ] 8 0.000% 99.993% ( 51, 76 ] 14 0.001% 99.994% ( 76, 110 ] 190 0.009% 100.003% ( 110, 170 ] 242 0.011% 100.014% ( 170, 250 ] 92 0.004% 100.018% ( 250, 380 ] 67 0.003% 100.021% ( 380, 580 ] 41 0.002% 100.023% ( 580, 870 ] 37 0.002% 100.025% ( 870, 1300 ] 24 0.001% 100.026% ( 1300, 1900 ] 14 0.001% 100.027% ( 1900, 2900 ] 5 0.000% 100.027% ( 2900, 4400 ] 8 0.000% 100.027% ( 4400, 6600 ] 2 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 264513 Average: 2.7047 StdDev: 12.94 Min: 1 Median: 1.6716 Max: 2939 Percentiles: P50: 1.67 P75: 2.22 P99: 7.11 P99.9: 14.22 P99.99: 130.19 ------------------------------------------------------ [ 0, 1 ] 17135 6.478% 6.478% # ( 1, 2 ] 171423 64.807% 71.285% ############# ( 2, 3 ] 44554 16.844% 88.129% ### ( 3, 4 ] 16030 6.060% 94.189% # ( 4, 6 ] 11952 4.518% 98.707% # ( 6, 10 ] 2781 1.051% 99.759% ( 10, 15 ] 443 0.167% 99.926% ( 15, 22 ] 65 0.025% 99.951% ( 22, 34 ] 15 0.006% 99.957% ( 34, 51 ] 2 0.001% 99.957% ( 51, 76 ] 2 0.001% 99.958% ( 76, 110 ] 62 0.023% 99.981% ( 110, 170 ] 67 0.025% 100.007% ( 170, 250 ] 44 0.017% 100.023% ( 250, 380 ] 29 0.011% 100.034% ( 380, 580 ] 26 0.010% 100.044% ( 580, 870 ] 9 0.003% 100.048% ( 870, 1300 ] 5 0.002% 100.050% ( 1300, 1900 ] 4 0.002% 100.051% ( 1900, 2900 ] 1 0.000% 100.051% ( 2900, 4400 ] 1 0.000% 100.052% ** Level 2 read latency histogram (micros): Count: 95911 Average: 2.0359 StdDev: 5.18 Min: 0 Median: 1.4114 Max: 1085 Percentiles: P50: 1.41 P75: 1.82 P99: 5.54 P99.9: 9.93 P99.99: 30.18 ------------------------------------------------------ [ 0, 1 ] 23537 24.540% 24.540% ##### ( 1, 2 ] 59359 61.890% 86.430% ############ ( 2, 3 ] 7481 7.800% 94.230% ## ( 3, 4 ] 3165 3.300% 97.530% # ( 4, 6 ] 1834 1.912% 99.442% ( 6, 10 ] 447 0.466% 99.908% ( 10, 15 ] 66 0.069% 99.977% ( 15, 22 ] 9 0.009% 99.986% ( 22, 34 ] 5 0.005% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 224547 Average: 3.3329 StdDev: 34.41 Min: 1 Median: 1.6493 Max: 5242 Percentiles: P50: 1.65 P75: 2.16 P99: 8.56 P99.9: 163.84 P99.99: 482.48 ------------------------------------------------------ [ 0, 1 ] 20222 9.006% 9.006% ## ( 1, 2 ] 141772 63.137% 72.143% ############# ( 2, 3 ] 39298 17.501% 89.644% #### ( 3, 4 ] 10680 4.756% 94.400% # ( 4, 6 ] 8319 3.705% 98.105% # ( 6, 10 ] 3139 1.398% 99.503% ( 10, 15 ] 475 0.212% 99.714% ( 15, 22 ] 86 0.038% 99.752% ( 22, 34 ] 25 0.011% 99.764% ( 51, 76 ] 9 0.004% 99.768% ( 76, 110 ] 83 0.037% 99.804% ( 110, 170 ] 239 0.106% 99.911% ( 170, 250 ] 97 0.043% 99.954% ( 250, 380 ] 58 0.026% 99.980% ( 380, 580 ] 44 0.020% 100.000% ( 580, 870 ] 33 0.015% 100.014% ( 870, 1300 ] 15 0.007% 100.021% ( 1300, 1900 ] 7 0.003% 100.024% ( 1900, 2900 ] 12 0.005% 100.029% ( 2900, 4400 ] 8 0.004% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ** Level 4 read latency histogram (micros): Count: 3349 Average: 26.1824 StdDev: 182.86 Min: 0 Median: 1.7106 Max: 4480 Percentiles: P50: 1.71 P75: 2.57 P99: 499.14 P99.9: 3225.50 P99.99: 4480.00 ------------------------------------------------------ [ 0, 1 ] 303 9.047% 9.047% ## ( 1, 2 ] 1930 57.629% 66.677% ############ ( 2, 3 ] 487 14.542% 81.218% ### ( 3, 4 ] 198 5.912% 87.130% # ( 4, 6 ] 85 2.538% 89.669% # ( 6, 10 ] 59 1.762% 91.430% ( 10, 15 ] 30 0.896% 92.326% ( 15, 22 ] 26 0.776% 93.102% ( 22, 34 ] 8 0.239% 93.341% ( 34, 51 ] 1 0.030% 93.371% ( 51, 76 ] 3 0.090% 93.461% ( 76, 110 ] 49 1.463% 94.924% ( 110, 170 ] 73 2.180% 97.104% ( 170, 250 ] 28 0.836% 97.940% ( 250, 380 ] 23 0.687% 98.626% ( 380, 580 ] 21 0.627% 99.254% ( 580, 870 ] 11 0.328% 99.582% ( 870, 1300 ] 4 0.119% 99.701% ( 1300, 1900 ] 1 0.030% 99.731% ( 1900, 2900 ] 5 0.149% 99.881% ( 2900, 4400 ] 3 0.090% 99.970% ( 4400, 6600 ] 1 0.030% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 743.2667 StdDev: 997.61 Min: 86 Median: 250.0000 Max: 4223 Percentiles: P50: 250.00 P75: 797.50 P99: 4175.00 P99.9: 4223.00 P99.99: 4223.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 12 20.000% 40.000% #### ( 170, 250 ] 6 10.000% 50.000% ## ( 250, 380 ] 1 1.667% 51.667% ( 380, 580 ] 8 13.333% 65.000% ### ( 580, 870 ] 8 13.333% 78.333% ### ( 870, 1300 ] 3 5.000% 83.333% # ( 1300, 1900 ] 2 3.333% 86.667% # ( 1900, 2900 ] 4 6.667% 93.333% # ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 22.9 total, 7.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 258.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.504 H:M:S, 28.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 131.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.629 H:M:S, 61.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/07-14:24:50 ... thread 0: (1000000,7000000) ops and (165776.2,244017.8) ops/second in (6.032229,28.686435) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 2.46 GB 6.3 5.6 0.0 5.6 12.2 6.6 0.0 1.8 139.0 302.4 41.23 38.48 116 0.355 5820K 7630 0.0 0.0 L1 21/21 2.03 GB 0.0 4.1 3.9 0.2 4.1 3.8 0.2 1.1 229.9 227.3 18.33 17.74 3 6.109 4277K 47K 0.0 0.0 L2 3/2 306.49 MB 0.5 0.4 0.2 0.2 0.4 0.2 2.0 2.0 249.1 248.9 1.52 1.47 2 0.759 383K 198 0.0 0.0 L3 31/9 1.47 GB 1.0 2.7 1.4 1.3 2.7 1.4 0.4 1.9 212.4 211.7 13.25 12.21 10 1.325 2859K 9754 0.0 0.0 L4 170/5 9.48 GB 1.0 0.4 0.4 0.0 0.4 0.4 0.8 1.0 162.5 162.3 2.57 1.96 4 0.642 423K 457 0.0 0.0 L5 1060/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/47 102.65 GB 0.0 13.2 5.9 7.4 19.8 12.4 4.8 3.0 176.3 263.1 76.89 71.86 135 0.570 13M 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.2 5.9 7.4 19.8 12.4 4.7 3.0 176.3 263.1 76.89 71.86 135 0.570 13M 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.2 5.9 7.4 13.2 5.8 0.0 0.0 236.4 235.3 57.34 54.67 38 1.509 13M 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 344.7 19.56 17.19 97 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.9 total, 28.7 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.76 GB write, 699.72 MB/s write, 13.24 GB read, 468.86 MB/s read, 76.9 seconds Interval compaction: 19.76 GB write, 705.20 MB/s write, 13.24 GB read, 472.53 MB/s read, 76.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 26, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2634996 Average: 2.2423 StdDev: 13.16 Min: 0 Median: 1.4647 Max: 5892 Percentiles: P50: 1.46 P75: 1.84 P99: 5.66 P99.9: 11.52 P99.99: 136.58 ------------------------------------------------------ [ 0, 1 ] 506851 19.235% 19.235% #### ( 1, 2 ] 1744628 66.210% 85.445% ############# ( 2, 3 ] 223900 8.497% 93.942% ## ( 3, 4 ] 91401 3.469% 97.411% # ( 4, 6 ] 50355 1.911% 99.322% ( 6, 10 ] 14588 0.554% 99.876% ( 10, 15 ] 2109 0.080% 99.956% ( 15, 22 ] 303 0.011% 99.967% ( 22, 34 ] 39 0.001% 99.969% ( 34, 51 ] 12 0.000% 99.969% ( 51, 76 ] 21 0.001% 99.970% ( 76, 110 ] 306 0.012% 99.982% ( 110, 170 ] 500 0.019% 100.001% ( 170, 250 ] 202 0.008% 100.008% ( 250, 380 ] 150 0.006% 100.014% ( 380, 580 ] 136 0.005% 100.019% ( 580, 870 ] 96 0.004% 100.023% ( 870, 1300 ] 47 0.002% 100.025% ( 1300, 1900 ] 26 0.001% 100.026% ( 1900, 2900 ] 8 0.000% 100.026% ( 2900, 4400 ] 10 0.000% 100.026% ( 4400, 6600 ] 2 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 494651 Average: 3.3667 StdDev: 33.26 Min: 1 Median: 1.6995 Max: 6422 Percentiles: P50: 1.70 P75: 2.37 P99: 8.19 P99.9: 77.53 P99.99: 317.26 ------------------------------------------------------ [ 0, 1 ] 33393 6.751% 6.751% # ( 1, 2 ] 305835 61.828% 68.579% ############ ( 2, 3 ] 86530 17.493% 86.072% ### ( 3, 4 ] 33270 6.726% 92.798% # ( 4, 6 ] 26793 5.417% 98.215% # ( 6, 10 ] 7089 1.433% 99.648% ( 10, 15 ] 1042 0.211% 99.859% ( 15, 22 ] 159 0.032% 99.891% ( 22, 34 ] 24 0.005% 99.896% ( 34, 51 ] 3 0.001% 99.896% ( 51, 76 ] 14 0.003% 99.899% ( 76, 110 ] 119 0.024% 99.923% ( 110, 170 ] 143 0.029% 99.952% ( 170, 250 ] 128 0.026% 99.978% ( 250, 380 ] 117 0.024% 100.002% ( 380, 580 ] 128 0.026% 100.027% ( 580, 870 ] 94 0.019% 100.046% ( 870, 1300 ] 50 0.010% 100.057% ( 1300, 1900 ] 23 0.005% 100.061% ( 1900, 2900 ] 21 0.004% 100.066% ( 2900, 4400 ] 14 0.003% 100.068% ( 4400, 6600 ] 2 0.000% 100.069% ** Level 2 read latency histogram (micros): Count: 95911 Average: 2.0359 StdDev: 5.18 Min: 0 Median: 1.4114 Max: 1085 Percentiles: P50: 1.41 P75: 1.82 P99: 5.54 P99.9: 9.93 P99.99: 30.18 ------------------------------------------------------ [ 0, 1 ] 23537 24.540% 24.540% ##### ( 1, 2 ] 59359 61.890% 86.430% ############ ( 2, 3 ] 7481 7.800% 94.230% ## ( 3, 4 ] 3165 3.300% 97.530% # ( 4, 6 ] 1834 1.912% 99.442% ( 6, 10 ] 447 0.466% 99.908% ( 10, 15 ] 66 0.069% 99.977% ( 15, 22 ] 9 0.009% 99.986% ( 22, 34 ] 5 0.005% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 365301 Average: 3.6421 StdDev: 33.55 Min: 1 Median: 1.7378 Max: 5242 Percentiles: P50: 1.74 P75: 2.48 P99: 8.86 P99.9: 158.43 P99.99: 318.18 ------------------------------------------------------ [ 0, 1 ] 22960 6.285% 6.285% # ( 1, 2 ] 216456 59.254% 65.539% ############ ( 2, 3 ] 71729 19.636% 85.175% #### ( 3, 4 ] 24929 6.824% 91.999% # ( 4, 6 ] 21331 5.839% 97.838% # ( 6, 10 ] 5941 1.626% 99.465% ( 10, 15 ] 1022 0.280% 99.745% ( 15, 22 ] 157 0.043% 99.788% ( 22, 34 ] 32 0.009% 99.796% ( 34, 51 ] 1 0.000% 99.797% ( 51, 76 ] 9 0.002% 99.799% ( 76, 110 ] 108 0.030% 99.829% ( 110, 170 ] 323 0.088% 99.917% ( 170, 250 ] 192 0.053% 99.970% ( 250, 380 ] 142 0.039% 100.008% ( 380, 580 ] 132 0.036% 100.045% ( 580, 870 ] 81 0.022% 100.067% ( 870, 1300 ] 28 0.008% 100.074% ( 1300, 1900 ] 15 0.004% 100.079% ( 1900, 2900 ] 16 0.004% 100.083% ( 2900, 4400 ] 10 0.003% 100.086% ( 4400, 6600 ] 1 0.000% 100.086% ** Level 4 read latency histogram (micros): Count: 5449 Average: 52.1997 StdDev: 243.53 Min: 0 Median: 1.8138 Max: 4480 Percentiles: P50: 1.81 P75: 2.91 P99: 1164.55 P99.9: 3287.75 P99.99: 4480.00 ------------------------------------------------------ [ 0, 1 ] 353 6.478% 6.478% # ( 1, 2 ] 2914 53.478% 59.956% ########### ( 2, 3 ] 899 16.498% 76.454% ### ( 3, 4 ] 414 7.598% 84.052% ## ( 4, 6 ] 196 3.597% 87.649% # ( 6, 10 ] 100 1.835% 89.484% ( 10, 15 ] 35 0.642% 90.127% ( 15, 22 ] 27 0.496% 90.622% ( 22, 34 ] 9 0.165% 90.787% ( 34, 51 ] 1 0.018% 90.806% ( 51, 76 ] 3 0.055% 90.861% ( 76, 110 ] 53 0.973% 91.833% ( 110, 170 ] 95 1.743% 93.577% ( 170, 250 ] 55 1.009% 94.586% ( 250, 380 ] 64 1.175% 95.761% ( 380, 580 ] 80 1.468% 97.229% ( 580, 870 ] 65 1.193% 98.422% ( 870, 1300 ] 46 0.844% 99.266% ( 1300, 1900 ] 19 0.349% 99.615% ( 1900, 2900 ] 14 0.257% 99.872% ( 2900, 4400 ] 6 0.110% 99.982% ( 4400, 6600 ] 1 0.018% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 839.1750 StdDev: 1032.73 Min: 86 Median: 430.0000 Max: 4223 Percentiles: P50: 430.00 P75: 977.50 P99: 4200.00 P99.9: 4223.00 P99.99: 4223.00 ------------------------------------------------------ ( 76, 110 ] 12 15.000% 15.000% ### ( 110, 170 ] 13 16.250% 31.250% ### ( 170, 250 ] 8 10.000% 41.250% ## ( 250, 380 ] 4 5.000% 46.250% # ( 380, 580 ] 12 15.000% 61.250% ### ( 580, 870 ] 10 12.500% 73.750% ### ( 870, 1300 ] 4 5.000% 78.750% # ( 1300, 1900 ] 5 6.250% 85.000% # ( 1900, 2900 ] 6 7.500% 92.500% ## ( 2900, 4400 ] 6 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 28.9 total, 6.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 238.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.716 H:M:S, 33.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 163.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.212 H:M:S, 53.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/12/07-14:25:08 ... thread 0: (1000000,8000000) ops and (53430.9,168768.5) ops/second in (18.715766,47.402201) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 2/1 1.35 GB 6.3 8.1 0.0 8.1 15.6 7.6 0.0 2.1 148.3 287.2 55.65 50.86 134 0.415 8377K 16K 0.0 0.0 L1 1/1 128.78 MB 0.0 8.2 6.0 2.3 8.1 5.9 0.2 1.4 222.1 219.2 37.96 35.63 4 9.489 7932K 47K 0.0 0.0 L2 31/16 3.69 GB 17.5 0.4 0.2 0.2 0.4 0.2 5.9 2.0 249.1 248.9 1.52 1.47 2 0.759 383K 198 0.0 0.0 L3 25/10 1.23 GB 0.8 3.2 1.7 1.5 3.2 1.7 0.7 1.9 204.5 203.8 16.14 14.46 12 1.345 3352K 12K 0.0 0.0 L4 175/0 9.57 GB 1.0 1.2 1.2 0.1 1.2 1.2 0.8 1.1 138.4 138.1 9.08 5.86 17 0.534 1277K 2523 0.0 0.0 L5 1068/0 87.60 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/28 103.56 GB 0.0 21.1 9.0 12.1 28.5 16.4 9.7 3.8 179.6 242.8 120.34 108.28 169 0.712 21M 79K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.1 9.0 12.1 28.5 16.4 9.6 3.8 179.6 242.8 120.34 108.28 169 0.712 21M 79K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.1 9.0 12.1 21.0 8.8 0.0 0.0 223.1 221.7 96.88 88.38 59 1.642 21M 79K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 330.2 23.47 19.90 110 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.6 total, 47.4 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.54 GB write, 613.56 MB/s write, 21.11 GB read, 453.87 MB/s read, 120.3 seconds Interval compaction: 28.54 GB write, 616.47 MB/s write, 21.11 GB read, 456.03 MB/s read, 120.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 40, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3720769 Average: 2.6032 StdDev: 19.53 Min: 0 Median: 1.4657 Max: 11114 Percentiles: P50: 1.47 P75: 1.85 P99: 6.09 P99.9: 137.47 P99.99: 284.72 ------------------------------------------------------ [ 0, 1 ] 728539 19.580% 19.580% #### ( 1, 2 ] 2430347 65.318% 84.899% ############# ( 2, 3 ] 313590 8.428% 93.327% ## ( 3, 4 ] 132737 3.567% 96.894% # ( 4, 6 ] 77793 2.091% 98.985% ( 6, 10 ] 23984 0.645% 99.630% ( 10, 15 ] 3478 0.093% 99.723% ( 15, 22 ] 518 0.014% 99.737% ( 22, 34 ] 53 0.001% 99.738% ( 34, 51 ] 28 0.001% 99.739% ( 51, 76 ] 84 0.002% 99.742% ( 76, 110 ] 3976 0.107% 99.848% ( 110, 170 ] 4198 0.113% 99.961% ( 170, 250 ] 910 0.024% 99.986% ( 250, 380 ] 610 0.016% 100.002% ( 380, 580 ] 467 0.013% 100.015% ( 580, 870 ] 215 0.006% 100.020% ( 870, 1300 ] 64 0.002% 100.022% ( 1300, 1900 ] 34 0.001% 100.023% ( 1900, 2900 ] 13 0.000% 100.023% ( 2900, 4400 ] 23 0.001% 100.024% ( 4400, 6600 ] 4 0.000% 100.024% ( 6600, 9900 ] 1 0.000% 100.024% ( 9900, 14000 ] 3 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1205104 Average: 3.9951 StdDev: 65.32 Min: 1 Median: 1.5857 Max: 11398 Percentiles: P50: 1.59 P75: 2.03 P99: 8.43 P99.9: 141.51 P99.99: 407.07 ------------------------------------------------------ [ 0, 1 ] 182327 15.130% 15.130% ### ( 1, 2 ] 717479 59.537% 74.666% ############ ( 2, 3 ] 160266 13.299% 87.965% ### ( 3, 4 ] 67880 5.633% 93.598% # ( 4, 6 ] 55809 4.631% 98.229% # ( 6, 10 ] 15285 1.268% 99.497% ( 10, 15 ] 2557 0.212% 99.709% ( 15, 22 ] 441 0.037% 99.746% ( 22, 34 ] 40 0.003% 99.749% ( 34, 51 ] 8 0.001% 99.750% ( 51, 76 ] 143 0.012% 99.762% ( 76, 110 ] 1143 0.095% 99.857% ( 110, 170 ] 992 0.082% 99.939% ( 170, 250 ] 290 0.024% 99.963% ( 250, 380 ] 286 0.024% 99.987% ( 380, 580 ] 277 0.023% 100.010% ( 580, 870 ] 187 0.016% 100.025% ( 870, 1300 ] 125 0.010% 100.036% ( 1300, 1900 ] 87 0.007% 100.043% ( 1900, 2900 ] 106 0.009% 100.052% ( 2900, 4400 ] 150 0.012% 100.064% ( 4400, 6600 ] 27 0.002% 100.066% ( 6600, 9900 ] 15 0.001% 100.068% ( 9900, 14000 ] 3 0.000% 100.068% ** Level 2 read latency histogram (micros): Count: 95911 Average: 2.0359 StdDev: 5.18 Min: 0 Median: 1.4114 Max: 1085 Percentiles: P50: 1.41 P75: 1.82 P99: 5.54 P99.9: 9.93 P99.99: 30.18 ------------------------------------------------------ [ 0, 1 ] 23537 24.540% 24.540% ##### ( 1, 2 ] 59359 61.890% 86.430% ############ ( 2, 3 ] 7481 7.800% 94.230% ## ( 3, 4 ] 3165 3.300% 97.530% # ( 4, 6 ] 1834 1.912% 99.442% ( 6, 10 ] 447 0.466% 99.908% ( 10, 15 ] 66 0.069% 99.977% ( 15, 22 ] 9 0.009% 99.986% ( 22, 34 ] 5 0.005% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 624394 Average: 4.4032 StdDev: 57.61 Min: 1 Median: 1.8348 Max: 6856 Percentiles: P50: 1.83 P75: 2.74 P99: 8.67 P99.9: 19.08 P99.99: 149.83 ------------------------------------------------------ [ 0, 1 ] 26044 4.171% 4.171% # ( 1, 2 ] 342789 54.899% 59.071% ########### ( 2, 3 ] 134949 21.613% 80.683% #### ( 3, 4 ] 56338 9.023% 89.706% ## ( 4, 6 ] 51135 8.190% 97.896% ## ( 6, 10 ] 10311 1.651% 99.547% ( 10, 15 ] 2037 0.326% 99.873% ( 15, 22 ] 286 0.046% 99.919% ( 22, 34 ] 48 0.008% 99.927% ( 34, 51 ] 5 0.001% 99.928% ( 51, 76 ] 12 0.002% 99.930% ( 76, 110 ] 124 0.020% 99.949% ( 110, 170 ] 382 0.061% 100.011% ( 170, 250 ] 310 0.050% 100.060% ( 250, 380 ] 267 0.043% 100.103% ( 380, 580 ] 240 0.038% 100.141% ( 580, 870 ] 150 0.024% 100.165% ( 870, 1300 ] 72 0.012% 100.177% ( 1300, 1900 ] 42 0.007% 100.184% ( 1900, 2900 ] 47 0.008% 100.191% ( 2900, 4400 ] 72 0.012% 100.203% ( 4400, 6600 ] 18 0.003% 100.206% ( 6600, 9900 ] 1 0.000% 100.206% ** Level 4 read latency histogram (micros): Count: 18444 Average: 57.7647 StdDev: 410.54 Min: 0 Median: 1.9157 Max: 18040 Percentiles: P50: 1.92 P75: 3.10 P99: 1249.14 P99.9: 5068.21 P99.99: 17081.60 ------------------------------------------------------ [ 0, 1 ] 681 3.692% 3.692% # ( 1, 2 ] 9327 50.569% 54.262% ########## ( 2, 3 ] 3619 19.622% 73.883% #### ( 3, 4 ] 1987 10.773% 84.656% ## ( 4, 6 ] 1097 5.948% 90.604% # ( 6, 10 ] 379 2.055% 92.659% ( 10, 15 ] 85 0.461% 93.120% ( 15, 22 ] 41 0.222% 93.342% ( 22, 34 ] 10 0.054% 93.396% ( 34, 51 ] 1 0.005% 93.402% ( 51, 76 ] 6 0.033% 93.434% ( 76, 110 ] 83 0.450% 93.884% ( 110, 170 ] 158 0.857% 94.741% ( 170, 250 ] 141 0.764% 95.505% ( 250, 380 ] 147 0.797% 96.302% ( 380, 580 ] 183 0.992% 97.295% ( 580, 870 ] 192 1.041% 98.336% ( 870, 1300 ] 139 0.754% 99.089% ( 1300, 1900 ] 51 0.277% 99.366% ( 1900, 2900 ] 41 0.222% 99.588% ( 2900, 4400 ] 53 0.287% 99.875% ( 4400, 6600 ] 15 0.081% 99.957% ( 6600, 9900 ] 3 0.016% 99.973% ( 9900, 14000 ] 2 0.011% 99.984% ( 14000, 22000 ] 3 0.016% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 867.0333 StdDev: 1069.11 Min: 81 Median: 422.1053 Max: 4514 Percentiles: P50: 422.11 P75: 1128.00 P99: 4366.67 P99.9: 4514.00 P99.99: 4514.00 ------------------------------------------------------ ( 76, 110 ] 18 15.000% 15.000% ### ( 110, 170 ] 19 15.833% 30.833% ### ( 170, 250 ] 9 7.500% 38.333% ## ( 250, 380 ] 10 8.333% 46.667% ## ( 380, 580 ] 19 15.833% 62.500% ### ( 580, 870 ] 12 10.000% 72.500% ## ( 870, 1300 ] 5 4.167% 76.667% # ( 1300, 1900 ] 10 8.333% 85.000% ## ( 1900, 2900 ] 8 6.667% 91.667% # ( 2900, 4400 ] 9 7.500% 99.167% ## ( 4400, 6600 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 47.6 total, 18.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 165.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.910 H:M:S, 52.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 52.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:15.194 H:M:S, 81.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/07-14:25:16 ... thread 0: (1000000,9000000) ops and (123548.6,162173.3) ops/second in (8.093979,55.496180) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 2.27 GB 62.9 8.5 0.0 8.5 17.0 8.5 0.0 2.0 131.8 263.4 65.93 55.39 145 0.455 8825K 16K 0.0 0.0 L1 1/1 128.78 MB 0.0 8.2 6.0 2.3 8.1 5.9 0.2 1.4 222.1 219.2 37.96 35.63 4 9.489 7932K 47K 0.0 0.0 L2 2/1 257.56 MB 1.3 0.4 0.2 0.2 0.4 0.2 5.9 2.0 249.1 248.9 1.52 1.47 2 0.759 383K 198 0.0 0.0 L3 33/10 2.26 GB 1.7 8.6 5.1 3.5 8.6 5.1 0.7 1.7 140.7 139.9 62.85 40.28 34 1.849 8198K 47K 0.0 0.0 L4 202/9 11.93 GB 1.2 3.7 3.5 0.2 3.7 3.5 0.8 1.0 127.1 126.8 29.78 17.76 43 0.692 3742K 2523 0.0 0.0 L5 1068/0 87.60 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1314/26 104.44 GB 0.0 29.4 14.8 14.6 37.7 23.1 9.7 4.4 152.1 195.1 198.03 150.52 228 0.869 29M 114K 0.0 0.0 Int 0/0 0.00 KB 0.0 29.4 14.8 14.6 37.7 23.1 9.6 4.4 152.1 195.1 198.03 150.52 228 0.869 29M 114K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 29.4 14.8 14.6 29.2 14.6 0.0 0.0 180.3 179.2 167.06 127.88 108 1.547 29M 114K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 280.7 30.97 22.64 120 0.258 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.7 total, 55.5 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.73 GB write, 693.28 MB/s write, 29.42 GB read, 540.66 MB/s read, 198.0 seconds Interval compaction: 37.73 GB write, 696.08 MB/s write, 29.42 GB read, 542.85 MB/s read, 198.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 79, interval: 102 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4144709 Average: 3.0988 StdDev: 41.21 Min: 0 Median: 1.5086 Max: 20665 Percentiles: P50: 1.51 P75: 1.90 P99: 7.38 P99.9: 144.57 P99.99: 494.72 ------------------------------------------------------ [ 0, 1 ] 738389 17.815% 17.815% #### ( 1, 2 ] 2622718 63.279% 81.094% ############# ( 2, 3 ] 420255 10.140% 91.233% ## ( 3, 4 ] 178483 4.306% 95.540% # ( 4, 6 ] 130796 3.156% 98.695% # ( 6, 10 ] 36459 0.880% 99.575% ( 10, 15 ] 6020 0.145% 99.720% ( 15, 22 ] 833 0.020% 99.740% ( 22, 34 ] 76 0.002% 99.742% ( 34, 51 ] 36 0.001% 99.743% ( 51, 76 ] 87 0.002% 99.745% ( 76, 110 ] 3981 0.096% 99.841% ( 110, 170 ] 4220 0.102% 99.943% ( 170, 250 ] 938 0.023% 99.966% ( 250, 380 ] 672 0.016% 99.982% ( 380, 580 ] 578 0.014% 99.996% ( 580, 870 ] 374 0.009% 100.005% ( 870, 1300 ] 199 0.005% 100.010% ( 1300, 1900 ] 165 0.004% 100.014% ( 1900, 2900 ] 167 0.004% 100.018% ( 2900, 4400 ] 213 0.005% 100.023% ( 4400, 6600 ] 41 0.001% 100.024% ( 6600, 9900 ] 7 0.000% 100.024% ( 9900, 14000 ] 3 0.000% 100.024% ( 14000, 22000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 2027826 Average: 6.4659 StdDev: 104.57 Min: 1 Median: 1.7392 Max: 11398 Percentiles: P50: 1.74 P75: 2.60 P99: 9.22 P99.9: 164.33 P99.99: 647.62 ------------------------------------------------------ [ 0, 1 ] 192387 9.487% 9.487% ## ( 1, 2 ] 1111304 54.803% 64.290% ########### ( 2, 3 ] 361236 17.814% 82.104% #### ( 3, 4 ] 163261 8.051% 90.155% ## ( 4, 6 ] 149012 7.348% 97.503% # ( 6, 10 ] 37707 1.859% 99.363% ( 10, 15 ] 7391 0.364% 99.727% ( 15, 22 ] 1159 0.057% 99.785% ( 22, 34 ] 85 0.004% 99.789% ( 34, 51 ] 37 0.002% 99.791% ( 51, 76 ] 153 0.008% 99.798% ( 76, 110 ] 1148 0.057% 99.855% ( 110, 170 ] 1014 0.050% 99.905% ( 170, 250 ] 365 0.018% 99.923% ( 250, 380 ] 511 0.025% 99.948% ( 380, 580 ] 683 0.034% 99.982% ( 580, 870 ] 730 0.036% 100.018% ( 870, 1300 ] 539 0.027% 100.044% ( 1300, 1900 ] 414 0.020% 100.065% ( 1900, 2900 ] 567 0.028% 100.093% ( 2900, 4400 ] 767 0.038% 100.130% ( 4400, 6600 ] 178 0.009% 100.139% ( 6600, 9900 ] 32 0.002% 100.141% ( 9900, 14000 ] 3 0.000% 100.141% ** Level 2 read latency histogram (micros): Count: 95911 Average: 2.0359 StdDev: 5.18 Min: 0 Median: 1.4114 Max: 1085 Percentiles: P50: 1.41 P75: 1.82 P99: 5.54 P99.9: 9.93 P99.99: 30.18 ------------------------------------------------------ [ 0, 1 ] 23537 24.540% 24.540% ##### ( 1, 2 ] 59359 61.890% 86.430% ############ ( 2, 3 ] 7481 7.800% 94.230% ## ( 3, 4 ] 3165 3.300% 97.530% # ( 4, 6 ] 1834 1.912% 99.442% ( 6, 10 ] 447 0.466% 99.908% ( 10, 15 ] 66 0.069% 99.977% ( 15, 22 ] 9 0.009% 99.986% ( 22, 34 ] 5 0.005% 99.992% ( 76, 110 ] 1 0.001% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1786169 Average: 7.9874 StdDev: 116.07 Min: 1 Median: 1.9597 Max: 21060 Percentiles: P50: 1.96 P75: 2.96 P99: 9.24 P99.9: 15.25 P99.99: 142.88 ------------------------------------------------------ [ 0, 1 ] 37541 2.102% 2.102% ( 1, 2 ] 891488 49.911% 52.012% ########## ( 2, 3 ] 427087 23.911% 75.923% ##### ( 3, 4 ] 195051 10.920% 86.843% ## ( 4, 6 ] 185870 10.406% 97.249% ## ( 6, 10 ] 38639 2.163% 99.413% ( 10, 15 ] 8666 0.485% 99.898% ( 15, 22 ] 1125 0.063% 99.961% ( 22, 34 ] 102 0.006% 99.966% ( 34, 51 ] 32 0.002% 99.968% ( 51, 76 ] 22 0.001% 99.969% ( 76, 110 ] 135 0.008% 99.977% ( 110, 170 ] 424 0.024% 100.001% ( 170, 250 ] 468 0.026% 100.027% ( 250, 380 ] 665 0.037% 100.064% ( 380, 580 ] 898 0.050% 100.114% ( 580, 870 ] 1055 0.059% 100.173% ( 870, 1300 ] 864 0.048% 100.222% ( 1300, 1900 ] 586 0.033% 100.255% ( 1900, 2900 ] 688 0.039% 100.293% ( 2900, 4400 ] 844 0.047% 100.340% ( 4400, 6600 ] 158 0.009% 100.349% ( 6600, 9900 ] 28 0.002% 100.351% ( 9900, 14000 ] 2 0.000% 100.351% ( 14000, 22000 ] 1 0.000% 100.351% ** Level 4 read latency histogram (micros): Count: 46867 Average: 91.1694 StdDev: 474.17 Min: 0 Median: 1.9916 Max: 18040 Percentiles: P50: 1.99 P75: 3.24 P99: 2607.88 P99.9: 5437.77 P99.99: 9013.39 ------------------------------------------------------ [ 0, 1 ] 1228 2.620% 2.620% # ( 1, 2 ] 22393 47.780% 50.400% ########## ( 2, 3 ] 10259 21.890% 72.290% #### ( 3, 4 ] 5324 11.360% 83.649% ## ( 4, 6 ] 3006 6.414% 90.063% # ( 6, 10 ] 1024 2.185% 92.248% ( 10, 15 ] 214 0.457% 92.705% ( 15, 22 ] 58 0.124% 92.829% ( 22, 34 ] 14 0.030% 92.859% ( 34, 51 ] 2 0.004% 92.863% ( 51, 76 ] 6 0.013% 92.876% ( 76, 110 ] 85 0.181% 93.057% ( 110, 170 ] 190 0.405% 93.462% ( 170, 250 ] 207 0.442% 93.904% ( 250, 380 ] 279 0.595% 94.499% ( 380, 580 ] 445 0.949% 95.449% ( 580, 870 ] 569 1.214% 96.663% ( 870, 1300 ] 550 1.174% 97.836% ( 1300, 1900 ] 345 0.736% 98.573% ( 1900, 2900 ] 283 0.604% 99.176% ( 2900, 4400 ] 308 0.657% 99.834% ( 4400, 6600 ] 66 0.141% 99.974% ( 6600, 9900 ] 10 0.021% 99.996% ( 9900, 14000 ] 2 0.004% 100.000% ( 14000, 22000 ] 3 0.006% 100.006% ** Level 5 read latency histogram (micros): Count: 120 Average: 867.0333 StdDev: 1069.11 Min: 81 Median: 422.1053 Max: 4514 Percentiles: P50: 422.11 P75: 1128.00 P99: 4366.67 P99.9: 4514.00 P99.99: 4514.00 ------------------------------------------------------ ( 76, 110 ] 18 15.000% 15.000% ### ( 110, 170 ] 19 15.833% 30.833% ### ( 170, 250 ] 9 7.500% 38.333% ## ( 250, 380 ] 10 8.333% 46.667% ## ( 380, 580 ] 19 15.833% 62.500% ### ( 580, 870 ] 12 10.000% 72.500% ## ( 870, 1300 ] 5 4.167% 76.667% # ( 1300, 1900 ] 10 8.333% 85.000% ## ( 1900, 2900 ] 8 6.667% 91.667% # ( 2900, 4400 ] 9 7.500% 99.167% ## ( 4400, 6600 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 55.7 total, 8.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 158.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.069 H:M:S, 54.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 121.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.159 H:M:S, 63.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.099 micros/op 163965 ops/sec 60.494 seconds 9918999 operations; 158.9 MB/s Microseconds per write: Count: 9918999 Average: 6.0988 StdDev: 783.62 Min: 0 Median: 1.7670 Max: 978309 Percentiles: P50: 1.77 P75: 2.82 P99: 9.69 P99.9: 1093.84 P99.99: 2575.32 ------------------------------------------------------ [ 0, 1 ] 1226948 12.370% 12.370% ## ( 1, 2 ] 4866507 49.062% 61.432% ########## ( 2, 3 ] 1642966 16.564% 77.996% ### ( 3, 4 ] 1384266 13.956% 91.952% ### ( 4, 6 ] 573788 5.785% 97.736% # ( 6, 10 ] 135683 1.368% 99.104% ( 10, 15 ] 47725 0.481% 99.585% ( 15, 22 ] 11035 0.111% 99.697% ( 22, 34 ] 2062 0.021% 99.718% ( 34, 51 ] 276 0.003% 99.720% ( 51, 76 ] 47 0.000% 99.721% ( 76, 110 ] 6675 0.067% 99.788% ( 110, 170 ] 2868 0.029% 99.817% ( 170, 250 ] 282 0.003% 99.820% ( 250, 380 ] 210 0.002% 99.822% ( 380, 580 ] 50 0.001% 99.822% ( 580, 870 ] 36 0.000% 99.823% ( 870, 1300 ] 14707 0.148% 99.971% ( 1300, 1900 ] 21 0.000% 99.971% ( 1900, 2900 ] 2747 0.028% 99.999% ( 2900, 4400 ] 50 0.001% 99.999% ( 4400, 6600 ] 11 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 5 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 5 0.000% 100.000% ( 860000, 1200000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 236360 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9918999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10236406968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 719 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32325590 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 39135890347 rocksdb.compact.write.bytes COUNT : 38888600041 rocksdb.flush.write.bytes COUNT : 10172629182 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 87 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 437 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10090884096 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4167680 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 39244634390 rocksdb.non.last.level.read.count COUNT : 9480115 rocksdb.block.checksum.compute.count COUNT : 9478764 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.424390 P95 : 3.965836 P99 : 8.304322 P100 : 978307.000000 COUNT : 9918999 SUM : 55716595 rocksdb.compaction.times.micros P50 : 1033207.547170 P95 : 3273333.333333 P99 : 13076000.000000 P100 : 19629206.000000 COUNT : 144 SUM : 214608800 rocksdb.compaction.times.cpu_micros P50 : 723529.411765 P95 : 2700000.000000 P99 : 12152000.000000 P100 : 17885161.000000 COUNT : 144 SUM : 159413123 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 733.529412 P95 : 26400.000000 P99 : 98800.000000 P100 : 400309.000000 COUNT : 132 SUM : 901395 rocksdb.compaction.outfile.sync.micros P50 : 2592.307692 P95 : 160086.956522 P99 : 277040.000000 P100 : 670113.000000 COUNT : 496 SUM : 14351051 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 150.000000 P95 : 2968.181818 P99 : 5793.333333 P100 : 7324.000000 COUNT : 310 SUM : 183464 rocksdb.table.open.io.micros P50 : 1685.714286 P95 : 8568.214286 P99 : 12748.294118 P100 : 16975.000000 COUNT : 719 SUM : 1760727 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.782018 P95 : 8.542679 P99 : 12.925055 P100 : 21068.000000 COUNT : 9476750 SUM : 75287511 rocksdb.read.block.get.micros P50 : 509.078014 P95 : 3818.333333 P99 : 5908.000000 P100 : 8364.000000 COUNT : 1438 SUM : 1429290 rocksdb.write.raw.block.micros P50 : 0.516268 P95 : 0.980910 P99 : 3.153014 P100 : 26802.000000 COUNT : 11882869 SUM : 28956591 rocksdb.numfiles.in.singlecompaction P50 : 2.578125 P95 : 5.012500 P99 : 15.070000 P100 : 27.000000 COUNT : 199 SUM : 662 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560417 P95 : 1142.681713 P99 : 2316.204487 P100 : 978098.000000 COUNT : 162734 SUM : 32344328 rocksdb.sst.read.micros P50 : 1.686190 P95 : 5.142107 P99 : 9.245455 P100 : 21060.000000 COUNT : 9480489 SUM : 55226864 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9918999 SUM : 10236406968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 218780.487805 P95 : 773000.000000 P99 : 1097879.000000 P100 : 1097879.000000 COUNT : 132 SUM : 35669189 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 472 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0