[2024-07-12 12:28:42.656828] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... [2024-07-12 12:28:42.656928] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2802021 ] Set seed to 1720780122654559 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-12 12:28:42.757818] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-12 12:28:42.976973] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-12 12:28:42.977023] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2802021' to capture a snapshot of events at runtime. [2024-07-12 12:28:42.977033] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2802021 for offline analysis/debug. [2024-07-12 12:28:42.977057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 12 12:28:52 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/12-12:28:55 ... thread 0: (1000000,1000000) ops and (343407.3,343407.3) ops/second in (2.911994,2.911994) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 630.01 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 360.7 2.44 2.20 12 0.204 0 0 0.0 0.0 L2 3/2 251.77 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 254.9 254.8 1.48 1.43 2 0.741 383K 192 0.0 0.0 L3 9/0 741.34 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 97.00 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.8 1.4 96.2 320.7 3.93 3.63 14 0.281 383K 192 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.7 1.4 96.2 320.7 3.93 3.63 14 0.281 383K 192 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 254.9 254.8 1.48 1.43 2 0.741 383K 192 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 360.7 2.44 2.20 12 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 407.10 MB/s write, 0.37 GB read, 122.14 MB/s read, 3.9 seconds Interval compaction: 1.23 GB write, 432.37 MB/s write, 0.37 GB read, 129.72 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 110956 Average: 2.0143 StdDev: 21.53 Min: 0 Median: 1.3027 Max: 4190 Percentiles: P50: 1.30 P75: 1.70 P99: 4.04 P99.9: 8.94 P99.99: 667.43 ------------------------------------------------------ [ 0, 1 ] 34500 31.093% 31.093% ###### ( 1, 2 ] 69306 62.463% 93.556% ############ ( 2, 3 ] 4540 4.092% 97.648% # ( 3, 4 ] 1484 1.337% 98.985% ( 4, 6 ] 856 0.771% 99.757% ( 6, 10 ] 218 0.196% 99.953% ( 10, 15 ] 23 0.021% 99.974% ( 15, 22 ] 4 0.004% 99.977% ( 22, 34 ] 1 0.001% 99.978% ( 34, 51 ] 1 0.001% 99.979% ( 110, 170 ] 7 0.006% 99.986% ( 250, 380 ] 3 0.003% 99.988% ( 380, 580 ] 2 0.002% 99.990% ( 580, 870 ] 3 0.003% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 5 0.005% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 1 read latency histogram (micros): Count: 5 Average: 1739.2000 StdDev: 1407.56 Min: 258 Median: 1085.0000 Max: 3923 Percentiles: P50: 1085.00 P75: 2650.00 P99: 3923.00 P99.9: 3923.00 P99.99: 3923.00 ------------------------------------------------------ ( 250, 380 ] 1 20.000% 20.000% #### ( 580, 870 ] 1 20.000% 40.000% #### ( 870, 1300 ] 1 20.000% 60.000% #### ( 1900, 2900 ] 1 20.000% 80.000% #### ( 2900, 4400 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 60798 Average: 2.1082 StdDev: 21.65 Min: 0 Median: 1.3382 Max: 3754 Percentiles: P50: 1.34 P75: 1.74 P99: 5.34 P99.9: 9.90 P99.99: 1001.90 ------------------------------------------------------ [ 0, 1 ] 17666 29.057% 29.057% ###### ( 1, 2 ] 37645 61.918% 90.975% ############ ( 2, 3 ] 2959 4.867% 95.842% # ( 3, 4 ] 1400 2.303% 98.145% ( 4, 6 ] 777 1.278% 99.423% ( 6, 10 ] 298 0.490% 99.913% ( 10, 15 ] 29 0.048% 99.961% ( 15, 22 ] 8 0.013% 99.974% ( 22, 34 ] 2 0.003% 99.977% ( 34, 51 ] 1 0.002% 99.979% ( 51, 76 ] 2 0.003% 99.982% ( 110, 170 ] 1 0.002% 99.984% ( 250, 380 ] 2 0.003% 99.987% ( 380, 580 ] 1 0.002% 99.988% ( 870, 1300 ] 3 0.005% 99.993% ( 1300, 1900 ] 1 0.002% 99.995% ( 1900, 2900 ] 2 0.003% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 3541.8909 StdDev: 2876.90 Min: 144 Median: 2750.0000 Max: 10797 Percentiles: P50: 2750.00 P75: 4491.67 P99: 10797.00 P99.9: 10797.00 P99.99: 10797.00 ------------------------------------------------------ ( 110, 170 ] 1 1.818% 1.818% ( 170, 250 ] 1 1.818% 3.636% ( 250, 380 ] 2 3.636% 7.273% # ( 380, 580 ] 1 1.818% 9.091% ( 870, 1300 ] 6 10.909% 20.000% ## ( 1300, 1900 ] 8 14.545% 34.545% ### ( 1900, 2900 ] 10 18.182% 52.727% #### ( 2900, 4400 ] 12 21.818% 74.545% #### ( 4400, 6600 ] 6 10.909% 85.455% ## ( 6600, 9900 ] 3 5.455% 90.909% # ( 9900, 14000 ] 5 9.091% 100.000% ## ** Level 4 read latency histogram (micros): Count: 15 Average: 4119.0667 StdDev: 2779.10 Min: 1340 Median: 3462.5000 Max: 10921 Percentiles: P50: 3462.50 P75: 5775.00 P99: 10921.00 P99.9: 10921.00 P99.99: 10921.00 ------------------------------------------------------ ( 1300, 1900 ] 2 13.333% 13.333% ### ( 1900, 2900 ] 4 26.667% 40.000% ##### ( 2900, 4400 ] 4 26.667% 66.667% ##### ( 4400, 6600 ] 2 13.333% 80.000% ### ( 6600, 9900 ] 2 13.333% 93.333% ### ( 9900, 14000 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 643.3500 StdDev: 924.38 Min: 77 Median: 130.0000 Max: 3633 Percentiles: P50: 130.00 P75: 773.33 P99: 3633.00 P99.9: 3633.00 P99.99: 3633.00 ------------------------------------------------------ ( 76, 110 ] 9 45.000% 45.000% ######### ( 110, 170 ] 3 15.000% 60.000% ### ( 380, 580 ] 1 5.000% 65.000% # ( 580, 870 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 318.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.398 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 337.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-12:28:57 ... thread 0: (1000000,2000000) ops and (359820.3,351422.3) ops/second in (2.779165,5.691159) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.17 GB 62.9 0.6 0.0 0.6 2.3 1.8 0.0 1.3 78.1 329.8 7.26 6.67 28 0.259 575K 579 0.0 0.0 L1 1/0 2.88 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 241.8 241.4 1.56 1.51 1 1.563 383K 610 0.0 0.0 L2 2/0 55.02 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.5 2.0 254.9 254.8 1.48 1.43 2 0.741 383K 192 0.0 0.0 L3 42/0 996.57 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 205.9 205.7 3.87 3.44 3 1.290 808K 802 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/8 97.92 GB 0.0 2.1 1.1 1.0 3.9 2.9 2.1 2.2 149.6 278.3 14.17 13.05 34 0.417 2152K 2183 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 1.1 1.0 3.9 2.9 2.0 2.2 149.6 278.3 14.17 13.05 34 0.417 2152K 2183 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 1.1 1.0 2.1 1.1 0.0 0.0 232.5 232.2 9.12 8.55 8 1.140 2152K 2183 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 361.5 5.05 4.51 26 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.7 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.85 GB write, 671.52 MB/s write, 2.07 GB read, 360.85 MB/s read, 14.2 seconds Interval compaction: 3.85 GB write, 692.86 MB/s write, 2.07 GB read, 372.32 MB/s read, 14.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 386495 Average: 2.2506 StdDev: 14.98 Min: 0 Median: 1.4973 Max: 4190 Percentiles: P50: 1.50 P75: 1.88 P99: 5.73 P99.9: 10.06 P99.99: 14.96 ------------------------------------------------------ [ 0, 1 ] 67807 17.544% 17.544% #### ( 1, 2 ] 252261 65.269% 82.813% ############# ( 2, 3 ] 38928 10.072% 92.885% ## ( 3, 4 ] 14306 3.701% 96.587% # ( 4, 6 ] 10814 2.798% 99.384% # ( 6, 10 ] 1989 0.515% 99.899% ( 10, 15 ] 355 0.092% 99.991% ( 15, 22 ] 42 0.011% 100.002% ( 22, 34 ] 8 0.002% 100.004% ( 34, 51 ] 1 0.000% 100.004% ( 51, 76 ] 3 0.001% 100.005% ( 110, 170 ] 13 0.003% 100.008% ( 170, 250 ] 6 0.002% 100.010% ( 250, 380 ] 6 0.002% 100.011% ( 380, 580 ] 7 0.002% 100.013% ( 580, 870 ] 6 0.002% 100.015% ( 870, 1300 ] 7 0.002% 100.017% ( 1300, 1900 ] 6 0.002% 100.018% ( 1900, 2900 ] 1 0.000% 100.018% ( 2900, 4400 ] 4 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 81564 Average: 2.6129 StdDev: 19.18 Min: 1 Median: 1.6758 Max: 3923 Percentiles: P50: 1.68 P75: 2.24 P99: 5.99 P99.9: 12.85 P99.99: 21.60 ------------------------------------------------------ [ 0, 1 ] 5310 6.510% 6.510% # ( 1, 2 ] 52488 64.352% 70.862% ############# ( 2, 3 ] 14309 17.543% 88.405% #### ( 3, 4 ] 4536 5.561% 93.967% # ( 4, 6 ] 4125 5.057% 99.024% # ( 6, 10 ] 642 0.787% 99.811% ( 10, 15 ] 127 0.156% 99.967% ( 15, 22 ] 20 0.025% 99.991% ( 51, 76 ] 1 0.001% 99.993% ( 110, 170 ] 1 0.001% 99.994% ( 170, 250 ] 1 0.001% 99.995% ( 250, 380 ] 5 0.006% 100.001% ( 580, 870 ] 1 0.001% 100.002% ( 870, 1300 ] 2 0.002% 100.005% ( 1300, 1900 ] 1 0.001% 100.006% ( 1900, 2900 ] 1 0.001% 100.007% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 95452 Average: 2.1780 StdDev: 17.30 Min: 0 Median: 1.4328 Max: 3754 Percentiles: P50: 1.43 P75: 1.82 P99: 5.69 P99.9: 10.97 P99.99: 279.56 ------------------------------------------------------ [ 0, 1 ] 21372 22.390% 22.390% #### ( 1, 2 ] 60896 63.798% 86.188% ############# ( 2, 3 ] 7300 7.648% 93.836% ## ( 3, 4 ] 3079 3.226% 97.061% # ( 4, 6 ] 2195 2.300% 99.361% ( 6, 10 ] 499 0.523% 99.884% ( 10, 15 ] 80 0.084% 99.968% ( 15, 22 ] 13 0.014% 99.981% ( 22, 34 ] 3 0.003% 99.984% ( 34, 51 ] 1 0.001% 99.985% ( 51, 76 ] 2 0.002% 99.987% ( 76, 110 ] 1 0.001% 99.988% ( 110, 170 ] 1 0.001% 99.990% ( 250, 380 ] 2 0.002% 99.992% ( 380, 580 ] 1 0.001% 99.993% ( 870, 1300 ] 3 0.003% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57553 Average: 5.9168 StdDev: 141.13 Min: 0 Median: 1.6711 Max: 10797 Percentiles: P50: 1.67 P75: 2.23 P99: 7.32 P99.9: 276.87 P99.99: 6869.17 ------------------------------------------------------ [ 0, 1 ] 4098 7.120% 7.120% # ( 1, 2 ] 36775 63.898% 71.018% ############# ( 2, 3 ] 9883 17.172% 88.190% ### ( 3, 4 ] 3221 5.597% 93.787% # ( 4, 6 ] 2823 4.905% 98.692% # ( 6, 10 ] 538 0.935% 99.626% ( 10, 15 ] 120 0.209% 99.835% ( 15, 22 ] 27 0.047% 99.882% ( 22, 34 ] 2 0.003% 99.885% ( 51, 76 ] 1 0.002% 99.887% ( 110, 170 ] 3 0.005% 99.892% ( 170, 250 ] 3 0.005% 99.897% ( 250, 380 ] 7 0.012% 99.910% ( 380, 580 ] 2 0.003% 99.913% ( 580, 870 ] 1 0.002% 99.915% ( 870, 1300 ] 7 0.012% 99.927% ( 1300, 1900 ] 8 0.014% 99.941% ( 1900, 2900 ] 10 0.017% 99.958% ( 2900, 4400 ] 12 0.021% 99.979% ( 4400, 6600 ] 6 0.010% 99.990% ( 6600, 9900 ] 3 0.005% 99.995% ( 9900, 14000 ] 5 0.009% 100.003% ** Level 4 read latency histogram (micros): Count: 15 Average: 4119.0667 StdDev: 2779.10 Min: 1340 Median: 3462.5000 Max: 10921 Percentiles: P50: 3462.50 P75: 5775.00 P99: 10921.00 P99.9: 10921.00 P99.99: 10921.00 ------------------------------------------------------ ( 1300, 1900 ] 2 13.333% 13.333% ### ( 1900, 2900 ] 4 26.667% 40.000% ##### ( 2900, 4400 ] 4 26.667% 66.667% ##### ( 4400, 6600 ] 2 13.333% 80.000% ### ( 6600, 9900 ] 2 13.333% 93.333% ### ( 9900, 14000 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 806.0250 StdDev: 1129.64 Min: 76 Median: 150.0000 Max: 3804 Percentiles: P50: 150.00 P75: 870.00 P99: 3804.00 P99.9: 3804.00 P99.99: 3804.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 13 32.500% 35.000% ####### ( 110, 170 ] 9 22.500% 57.500% ##### ( 380, 580 ] 4 10.000% 67.500% ## ( 580, 870 ] 3 7.500% 75.000% ## ( 1300, 1900 ] 4 10.000% 85.000% ## ( 1900, 2900 ] 2 5.000% 90.000% # ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 5.9 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 335.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.581 H:M:S, 9.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 354.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.184 H:M:S, 6.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-12:29:00 ... thread 0: (1000000,3000000) ops and (334299.1,345522.9) ops/second in (2.991333,8.682492) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.09 GB 44.1 1.4 0.0 1.4 4.1 2.7 0.0 1.5 107.0 320.9 12.95 12.00 44 0.294 1407K 1441 0.0 0.0 L1 1/1 2.88 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 241.8 241.4 1.56 1.51 1 1.563 383K 610 0.0 0.0 L2 2/0 55.02 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.5 2.0 254.9 254.8 1.48 1.43 2 0.741 383K 192 0.0 0.0 L3 42/0 996.57 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 205.9 205.7 3.87 3.44 3 1.290 808K 802 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/12 98.84 GB 0.0 2.9 1.1 1.8 5.6 3.8 2.1 2.1 147.9 287.3 19.87 18.39 50 0.397 2983K 3045 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 1.1 1.8 5.6 3.8 2.0 2.1 147.9 287.3 19.87 18.39 50 0.397 2983K 3045 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 1.1 1.8 2.9 1.1 0.0 0.0 241.4 241.1 12.17 11.54 11 1.107 2983K 3045 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 360.3 7.69 6.84 39 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.7 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.57 GB write, 643.80 MB/s write, 2.87 GB read, 331.48 MB/s read, 19.9 seconds Interval compaction: 5.57 GB write, 657.22 MB/s write, 2.87 GB read, 338.38 MB/s read, 19.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 702547 Average: 2.1775 StdDev: 12.39 Min: 0 Median: 1.4823 Max: 4190 Percentiles: P50: 1.48 P75: 1.85 P99: 5.54 P99.9: 9.78 P99.99: 14.75 ------------------------------------------------------ [ 0, 1 ] 123673 17.604% 17.604% #### ( 1, 2 ] 471927 67.174% 84.777% ############# ( 2, 3 ] 65555 9.331% 94.108% ## ( 3, 4 ] 22392 3.187% 97.296% # ( 4, 6 ] 15549 2.213% 99.509% ( 6, 10 ] 2912 0.414% 99.923% ( 10, 15 ] 496 0.071% 99.994% ( 15, 22 ] 67 0.010% 100.003% ( 22, 34 ] 10 0.001% 100.005% ( 34, 51 ] 5 0.001% 100.006% ( 51, 76 ] 5 0.001% 100.006% ( 110, 170 ] 21 0.003% 100.009% ( 170, 250 ] 9 0.001% 100.011% ( 250, 380 ] 8 0.001% 100.012% ( 380, 580 ] 14 0.002% 100.014% ( 580, 870 ] 13 0.002% 100.016% ( 870, 1300 ] 8 0.001% 100.017% ( 1300, 1900 ] 8 0.001% 100.018% ( 1900, 2900 ] 3 0.000% 100.018% ( 2900, 4400 ] 4 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 81565 Average: 2.6129 StdDev: 19.18 Min: 1 Median: 1.6758 Max: 3923 Percentiles: P50: 1.68 P75: 2.24 P99: 5.99 P99.9: 12.85 P99.99: 21.60 ------------------------------------------------------ [ 0, 1 ] 5310 6.510% 6.510% # ( 1, 2 ] 52488 64.351% 70.861% ############# ( 2, 3 ] 14309 17.543% 88.404% #### ( 3, 4 ] 4536 5.561% 93.966% # ( 4, 6 ] 4125 5.057% 99.023% # ( 6, 10 ] 643 0.788% 99.811% ( 10, 15 ] 127 0.156% 99.967% ( 15, 22 ] 20 0.025% 99.991% ( 51, 76 ] 1 0.001% 99.993% ( 110, 170 ] 1 0.001% 99.994% ( 170, 250 ] 1 0.001% 99.995% ( 250, 380 ] 5 0.006% 100.001% ( 580, 870 ] 1 0.001% 100.002% ( 870, 1300 ] 2 0.002% 100.005% ( 1300, 1900 ] 1 0.001% 100.006% ( 1900, 2900 ] 1 0.001% 100.007% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 95452 Average: 2.1780 StdDev: 17.30 Min: 0 Median: 1.4328 Max: 3754 Percentiles: P50: 1.43 P75: 1.82 P99: 5.69 P99.9: 10.97 P99.99: 279.56 ------------------------------------------------------ [ 0, 1 ] 21372 22.390% 22.390% #### ( 1, 2 ] 60896 63.798% 86.188% ############# ( 2, 3 ] 7300 7.648% 93.836% ## ( 3, 4 ] 3079 3.226% 97.061% # ( 4, 6 ] 2195 2.300% 99.361% ( 6, 10 ] 499 0.523% 99.884% ( 10, 15 ] 80 0.084% 99.968% ( 15, 22 ] 13 0.014% 99.981% ( 22, 34 ] 3 0.003% 99.984% ( 34, 51 ] 1 0.001% 99.985% ( 51, 76 ] 2 0.002% 99.987% ( 76, 110 ] 1 0.001% 99.988% ( 110, 170 ] 1 0.001% 99.990% ( 250, 380 ] 2 0.002% 99.992% ( 380, 580 ] 1 0.001% 99.993% ( 870, 1300 ] 3 0.003% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57553 Average: 5.9168 StdDev: 141.13 Min: 0 Median: 1.6711 Max: 10797 Percentiles: P50: 1.67 P75: 2.23 P99: 7.32 P99.9: 276.87 P99.99: 6869.17 ------------------------------------------------------ [ 0, 1 ] 4098 7.120% 7.120% # ( 1, 2 ] 36775 63.898% 71.018% ############# ( 2, 3 ] 9883 17.172% 88.190% ### ( 3, 4 ] 3221 5.597% 93.787% # ( 4, 6 ] 2823 4.905% 98.692% # ( 6, 10 ] 538 0.935% 99.626% ( 10, 15 ] 120 0.209% 99.835% ( 15, 22 ] 27 0.047% 99.882% ( 22, 34 ] 2 0.003% 99.885% ( 51, 76 ] 1 0.002% 99.887% ( 110, 170 ] 3 0.005% 99.892% ( 170, 250 ] 3 0.005% 99.897% ( 250, 380 ] 7 0.012% 99.910% ( 380, 580 ] 2 0.003% 99.913% ( 580, 870 ] 1 0.002% 99.915% ( 870, 1300 ] 7 0.012% 99.927% ( 1300, 1900 ] 8 0.014% 99.941% ( 1900, 2900 ] 10 0.017% 99.958% ( 2900, 4400 ] 12 0.021% 99.979% ( 4400, 6600 ] 6 0.010% 99.990% ( 6600, 9900 ] 3 0.005% 99.995% ( 9900, 14000 ] 5 0.009% 100.003% ** Level 4 read latency histogram (micros): Count: 15 Average: 4119.0667 StdDev: 2779.10 Min: 1340 Median: 3462.5000 Max: 10921 Percentiles: P50: 3462.50 P75: 5775.00 P99: 10921.00 P99.9: 10921.00 P99.99: 10921.00 ------------------------------------------------------ ( 1300, 1900 ] 2 13.333% 13.333% ### ( 1900, 2900 ] 4 26.667% 40.000% ##### ( 2900, 4400 ] 4 26.667% 66.667% ##### ( 4400, 6600 ] 2 13.333% 80.000% ### ( 6600, 9900 ] 2 13.333% 93.333% ### ( 9900, 14000 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 806.0250 StdDev: 1129.64 Min: 76 Median: 150.0000 Max: 3804 Percentiles: P50: 150.00 P75: 870.00 P99: 3804.00 P99.9: 3804.00 P99.99: 3804.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 13 32.500% 35.000% ####### ( 110, 170 ] 9 22.500% 57.500% ##### ( 380, 580 ] 4 10.000% 67.500% ## ( 580, 870 ] 3 7.500% 75.000% ## ( 1300, 1900 ] 4 10.000% 85.000% ## ( 1900, 2900 ] 2 5.000% 90.000% # ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 8.9 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 333.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.981 H:M:S, 11.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.400 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-12:29:04 ... thread 0: (1000000,4000000) ops and (295438.4,331474.5) ops/second in (3.384800,12.067292) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.20 GB 157.3 2.5 0.0 2.5 6.3 3.8 0.0 1.6 123.8 315.6 20.35 18.97 63 0.323 2558K 2663 0.0 0.0 L1 1/1 2.88 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 241.8 241.4 1.56 1.51 1 1.563 383K 610 0.0 0.0 L2 2/0 55.02 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.5 2.0 254.9 254.8 1.48 1.43 2 0.741 383K 192 0.0 0.0 L3 42/0 996.57 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 205.9 205.7 3.87 3.44 3 1.290 808K 802 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/12 99.95 GB 0.0 4.0 1.1 2.9 7.8 4.9 2.1 2.0 149.4 292.4 27.27 25.36 69 0.395 4135K 4267 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 1.1 2.9 7.8 4.9 2.0 2.0 149.4 292.4 27.27 25.36 69 0.395 4135K 4267 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 1.1 2.9 4.0 1.1 0.0 0.0 249.3 249.0 16.34 15.62 15 1.089 4135K 4267 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 357.4 10.93 9.74 54 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.1 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.79 GB write, 650.94 MB/s write, 3.98 GB read, 332.45 MB/s read, 27.3 seconds Interval compaction: 7.79 GB write, 660.70 MB/s write, 3.98 GB read, 337.44 MB/s read, 27.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 12, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1147859 Average: 2.2165 StdDev: 10.96 Min: 0 Median: 1.5058 Max: 4190 Percentiles: P50: 1.51 P75: 1.87 P99: 5.57 P99.9: 9.71 P99.99: 14.43 ------------------------------------------------------ [ 0, 1 ] 178999 15.594% 15.594% ### ( 1, 2 ] 780767 68.019% 83.614% ############## ( 2, 3 ] 117588 10.244% 93.858% ## ( 3, 4 ] 37929 3.304% 97.162% # ( 4, 6 ] 26831 2.337% 99.500% ( 6, 10 ] 4953 0.431% 99.931% ( 10, 15 ] 767 0.067% 99.998% ( 15, 22 ] 89 0.008% 100.006% ( 22, 34 ] 11 0.001% 100.007% ( 34, 51 ] 10 0.001% 100.007% ( 51, 76 ] 7 0.001% 100.008% ( 76, 110 ] 40 0.003% 100.011% ( 110, 170 ] 52 0.005% 100.016% ( 170, 250 ] 36 0.003% 100.019% ( 250, 380 ] 22 0.002% 100.021% ( 380, 580 ] 28 0.002% 100.024% ( 580, 870 ] 21 0.002% 100.025% ( 870, 1300 ] 17 0.001% 100.027% ( 1300, 1900 ] 11 0.001% 100.028% ( 1900, 2900 ] 4 0.000% 100.028% ( 2900, 4400 ] 4 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 81565 Average: 2.6129 StdDev: 19.18 Min: 1 Median: 1.6758 Max: 3923 Percentiles: P50: 1.68 P75: 2.24 P99: 5.99 P99.9: 12.85 P99.99: 21.60 ------------------------------------------------------ [ 0, 1 ] 5310 6.510% 6.510% # ( 1, 2 ] 52488 64.351% 70.861% ############# ( 2, 3 ] 14309 17.543% 88.404% #### ( 3, 4 ] 4536 5.561% 93.966% # ( 4, 6 ] 4125 5.057% 99.023% # ( 6, 10 ] 643 0.788% 99.811% ( 10, 15 ] 127 0.156% 99.967% ( 15, 22 ] 20 0.025% 99.991% ( 51, 76 ] 1 0.001% 99.993% ( 110, 170 ] 1 0.001% 99.994% ( 170, 250 ] 1 0.001% 99.995% ( 250, 380 ] 5 0.006% 100.001% ( 580, 870 ] 1 0.001% 100.002% ( 870, 1300 ] 2 0.002% 100.005% ( 1300, 1900 ] 1 0.001% 100.006% ( 1900, 2900 ] 1 0.001% 100.007% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 95452 Average: 2.1780 StdDev: 17.30 Min: 0 Median: 1.4328 Max: 3754 Percentiles: P50: 1.43 P75: 1.82 P99: 5.69 P99.9: 10.97 P99.99: 279.56 ------------------------------------------------------ [ 0, 1 ] 21372 22.390% 22.390% #### ( 1, 2 ] 60896 63.798% 86.188% ############# ( 2, 3 ] 7300 7.648% 93.836% ## ( 3, 4 ] 3079 3.226% 97.061% # ( 4, 6 ] 2195 2.300% 99.361% ( 6, 10 ] 499 0.523% 99.884% ( 10, 15 ] 80 0.084% 99.968% ( 15, 22 ] 13 0.014% 99.981% ( 22, 34 ] 3 0.003% 99.984% ( 34, 51 ] 1 0.001% 99.985% ( 51, 76 ] 2 0.002% 99.987% ( 76, 110 ] 1 0.001% 99.988% ( 110, 170 ] 1 0.001% 99.990% ( 250, 380 ] 2 0.002% 99.992% ( 380, 580 ] 1 0.001% 99.993% ( 870, 1300 ] 3 0.003% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57553 Average: 5.9168 StdDev: 141.13 Min: 0 Median: 1.6711 Max: 10797 Percentiles: P50: 1.67 P75: 2.23 P99: 7.32 P99.9: 276.87 P99.99: 6869.17 ------------------------------------------------------ [ 0, 1 ] 4098 7.120% 7.120% # ( 1, 2 ] 36775 63.898% 71.018% ############# ( 2, 3 ] 9883 17.172% 88.190% ### ( 3, 4 ] 3221 5.597% 93.787% # ( 4, 6 ] 2823 4.905% 98.692% # ( 6, 10 ] 538 0.935% 99.626% ( 10, 15 ] 120 0.209% 99.835% ( 15, 22 ] 27 0.047% 99.882% ( 22, 34 ] 2 0.003% 99.885% ( 51, 76 ] 1 0.002% 99.887% ( 110, 170 ] 3 0.005% 99.892% ( 170, 250 ] 3 0.005% 99.897% ( 250, 380 ] 7 0.012% 99.910% ( 380, 580 ] 2 0.003% 99.913% ( 580, 870 ] 1 0.002% 99.915% ( 870, 1300 ] 7 0.012% 99.927% ( 1300, 1900 ] 8 0.014% 99.941% ( 1900, 2900 ] 10 0.017% 99.958% ( 2900, 4400 ] 12 0.021% 99.979% ( 4400, 6600 ] 6 0.010% 99.990% ( 6600, 9900 ] 3 0.005% 99.995% ( 9900, 14000 ] 5 0.009% 100.003% ** Level 4 read latency histogram (micros): Count: 15 Average: 4119.0667 StdDev: 2779.10 Min: 1340 Median: 3462.5000 Max: 10921 Percentiles: P50: 3462.50 P75: 5775.00 P99: 10921.00 P99.9: 10921.00 P99.99: 10921.00 ------------------------------------------------------ ( 1300, 1900 ] 2 13.333% 13.333% ### ( 1900, 2900 ] 4 26.667% 40.000% ##### ( 2900, 4400 ] 4 26.667% 66.667% ##### ( 4400, 6600 ] 2 13.333% 80.000% ### ( 6600, 9900 ] 2 13.333% 93.333% ### ( 9900, 14000 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 806.0250 StdDev: 1129.64 Min: 76 Median: 150.0000 Max: 3804 Percentiles: P50: 150.00 P75: 870.00 P99: 3804.00 P99.9: 3804.00 P99.99: 3804.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 13 32.500% 35.000% ####### ( 110, 170 ] 9 22.500% 57.500% ##### ( 380, 580 ] 4 10.000% 67.500% ## ( 580, 870 ] 3 7.500% 75.000% ## ( 1300, 1900 ] 4 10.000% 85.000% ## ( 1900, 2900 ] 2 5.000% 90.000% # ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.3 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.743 H:M:S, 14.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 290.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.762 H:M:S, 22.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-12:29:07 ... thread 0: (1000000,5000000) ops and (366799.8,337984.6) ops/second in (2.726283,14.793575) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 2.70 GB 220.3 3.0 0.0 3.0 7.7 4.7 0.0 1.6 124.2 316.6 24.86 23.17 78 0.319 3134K 3312 0.0 0.0 L1 12/0 1.35 GB 137.9 1.7 1.7 0.0 1.7 1.7 0.2 1.0 233.0 231.8 7.58 7.30 2 3.788 1792K 8800 0.0 0.0 L2 2/0 55.02 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.5 2.0 254.9 254.8 1.48 1.43 2 0.741 383K 192 0.0 0.0 L3 42/0 996.57 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 205.9 205.7 3.87 3.44 3 1.290 808K 802 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/8 100.80 GB 0.0 5.9 2.5 3.4 10.5 7.1 2.1 2.3 159.5 285.8 37.79 35.35 85 0.445 6119K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 2.5 3.4 10.5 7.1 2.0 2.3 159.5 285.8 37.79 35.35 85 0.445 6119K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 2.5 3.4 5.9 2.5 0.0 0.0 246.3 245.8 24.47 23.48 18 1.359 6119K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 359.4 13.32 11.86 67 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.0 total, 14.8 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.55 GB write, 721.24 MB/s write, 5.89 GB read, 402.44 MB/s read, 37.8 seconds Interval compaction: 10.55 GB write, 730.06 MB/s write, 5.89 GB read, 407.37 MB/s read, 37.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 15, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1397813 Average: 2.2018 StdDev: 10.97 Min: 0 Median: 1.4889 Max: 4190 Percentiles: P50: 1.49 P75: 1.86 P99: 5.51 P99.9: 9.78 P99.99: 17.03 ------------------------------------------------------ [ 0, 1 ] 234264 16.759% 16.759% ### ( 1, 2 ] 950467 67.997% 84.756% ############## ( 2, 3 ] 133481 9.549% 94.305% ## ( 3, 4 ] 43125 3.085% 97.390% # ( 4, 6 ] 29770 2.130% 99.520% ( 6, 10 ] 5624 0.402% 99.923% ( 10, 15 ] 916 0.066% 99.988% ( 15, 22 ] 101 0.007% 99.995% ( 22, 34 ] 14 0.001% 99.996% ( 34, 51 ] 12 0.001% 99.997% ( 51, 76 ] 8 0.001% 99.998% ( 76, 110 ] 47 0.003% 100.001% ( 110, 170 ] 124 0.009% 100.010% ( 170, 250 ] 59 0.004% 100.014% ( 250, 380 ] 38 0.003% 100.017% ( 380, 580 ] 42 0.003% 100.020% ( 580, 870 ] 33 0.002% 100.022% ( 870, 1300 ] 24 0.002% 100.024% ( 1300, 1900 ] 11 0.001% 100.025% ( 1900, 2900 ] 6 0.000% 100.025% ( 2900, 4400 ] 4 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 82355 Average: 3.0575 StdDev: 32.18 Min: 1 Median: 1.6758 Max: 4192 Percentiles: P50: 1.68 P75: 2.24 P99: 6.45 P99.9: 86.25 P99.99: 935.75 ------------------------------------------------------ [ 0, 1 ] 5392 6.547% 6.547% # ( 1, 2 ] 52950 64.295% 70.842% ############# ( 2, 3 ] 14400 17.485% 88.327% ### ( 3, 4 ] 4575 5.555% 93.883% # ( 4, 6 ] 4141 5.028% 98.911% # ( 6, 10 ] 655 0.795% 99.706% ( 10, 15 ] 128 0.155% 99.862% ( 15, 22 ] 20 0.024% 99.886% ( 22, 34 ] 1 0.001% 99.887% ( 51, 76 ] 1 0.001% 99.888% ( 76, 110 ] 32 0.039% 99.927% ( 110, 170 ] 19 0.023% 99.950% ( 170, 250 ] 5 0.006% 99.956% ( 250, 380 ] 10 0.012% 99.968% ( 380, 580 ] 14 0.017% 99.985% ( 580, 870 ] 3 0.004% 99.989% ( 870, 1300 ] 5 0.006% 99.995% ( 1300, 1900 ] 3 0.004% 99.999% ( 1900, 2900 ] 6 0.007% 100.006% ( 2900, 4400 ] 2 0.002% 100.008% ** Level 2 read latency histogram (micros): Count: 95452 Average: 2.1780 StdDev: 17.30 Min: 0 Median: 1.4328 Max: 3754 Percentiles: P50: 1.43 P75: 1.82 P99: 5.69 P99.9: 10.97 P99.99: 279.56 ------------------------------------------------------ [ 0, 1 ] 21372 22.390% 22.390% #### ( 1, 2 ] 60896 63.798% 86.188% ############# ( 2, 3 ] 7300 7.648% 93.836% ## ( 3, 4 ] 3079 3.226% 97.061% # ( 4, 6 ] 2195 2.300% 99.361% ( 6, 10 ] 499 0.523% 99.884% ( 10, 15 ] 80 0.084% 99.968% ( 15, 22 ] 13 0.014% 99.981% ( 22, 34 ] 3 0.003% 99.984% ( 34, 51 ] 1 0.001% 99.985% ( 51, 76 ] 2 0.002% 99.987% ( 76, 110 ] 1 0.001% 99.988% ( 110, 170 ] 1 0.001% 99.990% ( 250, 380 ] 2 0.002% 99.992% ( 380, 580 ] 1 0.001% 99.993% ( 870, 1300 ] 3 0.003% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57553 Average: 5.9168 StdDev: 141.13 Min: 0 Median: 1.6711 Max: 10797 Percentiles: P50: 1.67 P75: 2.23 P99: 7.32 P99.9: 276.87 P99.99: 6869.17 ------------------------------------------------------ [ 0, 1 ] 4098 7.120% 7.120% # ( 1, 2 ] 36775 63.898% 71.018% ############# ( 2, 3 ] 9883 17.172% 88.190% ### ( 3, 4 ] 3221 5.597% 93.787% # ( 4, 6 ] 2823 4.905% 98.692% # ( 6, 10 ] 538 0.935% 99.626% ( 10, 15 ] 120 0.209% 99.835% ( 15, 22 ] 27 0.047% 99.882% ( 22, 34 ] 2 0.003% 99.885% ( 51, 76 ] 1 0.002% 99.887% ( 110, 170 ] 3 0.005% 99.892% ( 170, 250 ] 3 0.005% 99.897% ( 250, 380 ] 7 0.012% 99.910% ( 380, 580 ] 2 0.003% 99.913% ( 580, 870 ] 1 0.002% 99.915% ( 870, 1300 ] 7 0.012% 99.927% ( 1300, 1900 ] 8 0.014% 99.941% ( 1900, 2900 ] 10 0.017% 99.958% ( 2900, 4400 ] 12 0.021% 99.979% ( 4400, 6600 ] 6 0.010% 99.990% ( 6600, 9900 ] 3 0.005% 99.995% ( 9900, 14000 ] 5 0.009% 100.003% ** Level 4 read latency histogram (micros): Count: 15 Average: 4119.0667 StdDev: 2779.10 Min: 1340 Median: 3462.5000 Max: 10921 Percentiles: P50: 3462.50 P75: 5775.00 P99: 10921.00 P99.9: 10921.00 P99.99: 10921.00 ------------------------------------------------------ ( 1300, 1900 ] 2 13.333% 13.333% ### ( 1900, 2900 ] 4 26.667% 40.000% ##### ( 2900, 4400 ] 4 26.667% 66.667% ##### ( 4400, 6600 ] 2 13.333% 80.000% ### ( 6600, 9900 ] 2 13.333% 93.333% ### ( 9900, 14000 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 806.0250 StdDev: 1129.64 Min: 76 Median: 150.0000 Max: 3804 Percentiles: P50: 150.00 P75: 870.00 P99: 3804.00 P99.9: 3804.00 P99.99: 3804.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 13 32.500% 35.000% ####### ( 110, 170 ] 9 22.500% 57.500% ##### ( 380, 580 ] 4 10.000% 67.500% ## ( 580, 870 ] 3 7.500% 75.000% ## ( 1300, 1900 ] 4 10.000% 85.000% ## ( 1900, 2900 ] 2 5.000% 90.000% # ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 15.0 total, 2.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 328.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.937 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 361.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.194 H:M:S, 7.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-12:29:10 ... thread 0: (1000000,6000000) ops and (319754.8,334803.3) ops/second in (3.127396,17.920971) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/19 3.69 GB 0.0 4.1 0.0 4.1 9.8 5.7 0.0 1.7 132.6 314.6 31.83 29.77 95 0.335 4285K 4480 0.0 0.0 L1 12/12 1.35 GB 0.0 1.7 1.7 0.0 1.7 1.7 0.2 1.0 233.0 231.8 7.58 7.30 2 3.788 1792K 8800 0.0 0.0 L2 2/0 55.02 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.5 2.0 254.9 254.8 1.48 1.43 2 0.741 383K 192 0.0 0.0 L3 42/0 996.57 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 205.9 205.7 3.87 3.44 3 1.290 808K 802 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/31 101.78 GB 0.0 7.0 2.5 4.5 12.6 8.1 2.1 2.2 160.0 289.2 44.75 41.94 102 0.439 7271K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.0 2.5 4.5 12.6 8.1 2.0 2.2 160.0 289.2 44.75 41.94 102 0.439 7271K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.0 2.5 4.5 7.0 2.4 0.0 0.0 249.6 249.1 28.69 27.63 22 1.304 7271K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 360.9 16.06 14.32 80 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.1 total, 17.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.64 GB write, 714.89 MB/s write, 6.99 GB read, 395.56 MB/s read, 44.8 seconds Interval compaction: 12.64 GB write, 722.10 MB/s write, 6.99 GB read, 399.55 MB/s read, 44.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 18, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1625978 Average: 2.2096 StdDev: 12.02 Min: 0 Median: 1.4745 Max: 4190 Percentiles: P50: 1.47 P75: 1.84 P99: 5.47 P99.9: 9.93 P99.99: 119.60 ------------------------------------------------------ [ 0, 1 ] 289414 17.799% 17.799% #### ( 1, 2 ] 1103519 67.868% 85.667% ############## ( 2, 3 ] 145926 8.975% 94.642% ## ( 3, 4 ] 47300 2.909% 97.551% # ( 4, 6 ] 32045 1.971% 99.522% ( 6, 10 ] 6250 0.384% 99.906% ( 10, 15 ] 1028 0.063% 99.969% ( 15, 22 ] 129 0.008% 99.977% ( 22, 34 ] 17 0.001% 99.978% ( 34, 51 ] 13 0.001% 99.979% ( 51, 76 ] 9 0.001% 99.980% ( 76, 110 ] 123 0.008% 99.987% ( 110, 170 ] 265 0.016% 100.004% ( 170, 250 ] 98 0.006% 100.010% ( 250, 380 ] 56 0.003% 100.013% ( 380, 580 ] 61 0.004% 100.017% ( 580, 870 ] 48 0.003% 100.020% ( 870, 1300 ] 30 0.002% 100.022% ( 1300, 1900 ] 13 0.001% 100.023% ( 1900, 2900 ] 6 0.000% 100.023% ( 2900, 4400 ] 8 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 95979 Average: 3.0083 StdDev: 30.18 Min: 1 Median: 1.6350 Max: 4192 Percentiles: P50: 1.64 P75: 2.09 P99: 7.12 P99.9: 110.03 P99.99: 826.65 ------------------------------------------------------ [ 0, 1 ] 8510 8.867% 8.867% ## ( 1, 2 ] 62170 64.775% 73.641% ############# ( 2, 3 ] 15068 15.699% 89.340% ### ( 3, 4 ] 4770 4.970% 94.310% # ( 4, 6 ] 4259 4.437% 98.748% # ( 6, 10 ] 866 0.902% 99.650% ( 10, 15 ] 157 0.164% 99.814% ( 15, 22 ] 21 0.022% 99.835% ( 22, 34 ] 1 0.001% 99.836% ( 51, 76 ] 1 0.001% 99.837% ( 76, 110 ] 60 0.063% 99.900% ( 110, 170 ] 40 0.042% 99.942% ( 170, 250 ] 13 0.014% 99.955% ( 250, 380 ] 14 0.015% 99.970% ( 380, 580 ] 16 0.017% 99.986% ( 580, 870 ] 4 0.004% 99.991% ( 870, 1300 ] 5 0.005% 99.996% ( 1300, 1900 ] 3 0.003% 99.999% ( 1900, 2900 ] 6 0.006% 100.005% ( 2900, 4400 ] 2 0.002% 100.007% ** Level 2 read latency histogram (micros): Count: 95452 Average: 2.1780 StdDev: 17.30 Min: 0 Median: 1.4328 Max: 3754 Percentiles: P50: 1.43 P75: 1.82 P99: 5.69 P99.9: 10.97 P99.99: 279.56 ------------------------------------------------------ [ 0, 1 ] 21372 22.390% 22.390% #### ( 1, 2 ] 60896 63.798% 86.188% ############# ( 2, 3 ] 7300 7.648% 93.836% ## ( 3, 4 ] 3079 3.226% 97.061% # ( 4, 6 ] 2195 2.300% 99.361% ( 6, 10 ] 499 0.523% 99.884% ( 10, 15 ] 80 0.084% 99.968% ( 15, 22 ] 13 0.014% 99.981% ( 22, 34 ] 3 0.003% 99.984% ( 34, 51 ] 1 0.001% 99.985% ( 51, 76 ] 2 0.002% 99.987% ( 76, 110 ] 1 0.001% 99.988% ( 110, 170 ] 1 0.001% 99.990% ( 250, 380 ] 2 0.002% 99.992% ( 380, 580 ] 1 0.001% 99.993% ( 870, 1300 ] 3 0.003% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57553 Average: 5.9168 StdDev: 141.13 Min: 0 Median: 1.6711 Max: 10797 Percentiles: P50: 1.67 P75: 2.23 P99: 7.32 P99.9: 276.87 P99.99: 6869.17 ------------------------------------------------------ [ 0, 1 ] 4098 7.120% 7.120% # ( 1, 2 ] 36775 63.898% 71.018% ############# ( 2, 3 ] 9883 17.172% 88.190% ### ( 3, 4 ] 3221 5.597% 93.787% # ( 4, 6 ] 2823 4.905% 98.692% # ( 6, 10 ] 538 0.935% 99.626% ( 10, 15 ] 120 0.209% 99.835% ( 15, 22 ] 27 0.047% 99.882% ( 22, 34 ] 2 0.003% 99.885% ( 51, 76 ] 1 0.002% 99.887% ( 110, 170 ] 3 0.005% 99.892% ( 170, 250 ] 3 0.005% 99.897% ( 250, 380 ] 7 0.012% 99.910% ( 380, 580 ] 2 0.003% 99.913% ( 580, 870 ] 1 0.002% 99.915% ( 870, 1300 ] 7 0.012% 99.927% ( 1300, 1900 ] 8 0.014% 99.941% ( 1900, 2900 ] 10 0.017% 99.958% ( 2900, 4400 ] 12 0.021% 99.979% ( 4400, 6600 ] 6 0.010% 99.990% ( 6600, 9900 ] 3 0.005% 99.995% ( 9900, 14000 ] 5 0.009% 100.003% ** Level 4 read latency histogram (micros): Count: 15 Average: 4119.0667 StdDev: 2779.10 Min: 1340 Median: 3462.5000 Max: 10921 Percentiles: P50: 3462.50 P75: 5775.00 P99: 10921.00 P99.9: 10921.00 P99.99: 10921.00 ------------------------------------------------------ ( 1300, 1900 ] 2 13.333% 13.333% ### ( 1900, 2900 ] 4 26.667% 40.000% ##### ( 2900, 4400 ] 4 26.667% 66.667% ##### ( 4400, 6600 ] 2 13.333% 80.000% ### ( 6600, 9900 ] 2 13.333% 93.333% ### ( 9900, 14000 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 806.0250 StdDev: 1129.64 Min: 76 Median: 150.0000 Max: 3804 Percentiles: P50: 150.00 P75: 870.00 P99: 3804.00 P99.9: 3804.00 P99.99: 3804.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 13 32.500% 35.000% ####### ( 110, 170 ] 9 22.500% 57.500% ##### ( 380, 580 ] 4 10.000% 67.500% ## ( 580, 870 ] 3 7.500% 75.000% ## ( 1300, 1900 ] 4 10.000% 85.000% ## ( 1900, 2900 ] 2 5.000% 90.000% # ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 18.1 total, 3.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 326.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.510 H:M:S, 13.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.573 H:M:S, 18.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-12:29:36 ... thread 0: (1000000,7000000) ops and (38339.1,159076.5) ops/second in (26.083023,44.003994) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.29 GB 94.4 4.9 0.0 4.9 11.6 6.6 0.0 1.7 124.2 291.8 40.57 35.61 111 0.366 5117K 5302 0.0 0.0 L1 6/6 705.04 MB 0.0 6.5 5.1 1.3 6.3 5.0 0.2 1.2 220.4 216.6 29.98 27.24 3 9.992 6708K 113K 0.0 0.0 L2 1/1 53.16 MB 0.0 0.4 0.2 0.2 0.4 0.2 4.4 1.8 233.6 233.4 1.79 1.63 3 0.597 385K 192 0.0 0.0 L3 19/5 1.36 GB 1.0 2.7 2.1 0.5 2.6 2.1 2.5 1.3 150.9 150.5 18.02 12.65 16 1.126 1952K 3264 0.0 0.0 L4 181/23 11.40 GB 1.0 2.1 1.8 0.3 2.1 1.8 2.4 1.2 117.2 116.6 18.28 9.99 17 1.075 2135K 8390 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/39 102.65 GB 0.0 16.5 9.2 7.3 23.0 15.7 11.8 3.5 155.8 217.2 108.64 87.13 150 0.724 16M 130K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.5 9.2 7.3 23.0 15.7 11.7 3.5 155.8 217.2 108.64 87.13 150 0.724 16M 130K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.5 9.2 7.3 16.4 9.1 0.0 0.0 193.5 192.0 87.46 70.06 57 1.534 16M 130K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 321.2 21.18 17.07 93 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.2 total, 44.0 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.04 GB write, 533.93 MB/s write, 16.53 GB read, 383.06 MB/s read, 108.6 seconds Interval compaction: 23.04 GB write, 536.12 MB/s write, 16.53 GB read, 384.63 MB/s read, 108.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 52, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 52, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2710351 Average: 2.9441 StdDev: 25.69 Min: 0 Median: 1.4501 Max: 11362 Percentiles: P50: 1.45 P75: 1.82 P99: 7.55 P99.9: 158.01 P99.99: 444.73 ------------------------------------------------------ [ 0, 1 ] 541118 19.965% 19.965% #### ( 1, 2 ] 1808709 66.733% 86.698% ############# ( 2, 3 ] 200646 7.403% 94.101% # ( 3, 4 ] 72745 2.684% 96.785% # ( 4, 6 ] 53445 1.972% 98.757% ( 6, 10 ] 17027 0.628% 99.385% ( 10, 15 ] 2191 0.081% 99.466% ( 15, 22 ] 501 0.018% 99.485% ( 22, 34 ] 33 0.001% 99.486% ( 34, 51 ] 16 0.001% 99.486% ( 51, 76 ] 18 0.001% 99.487% ( 76, 110 ] 7132 0.263% 99.750% ( 110, 170 ] 5074 0.187% 99.937% ( 170, 250 ] 716 0.026% 99.964% ( 250, 380 ] 563 0.021% 99.985% ( 380, 580 ] 451 0.017% 100.001% ( 580, 870 ] 195 0.007% 100.008% ( 870, 1300 ] 63 0.002% 100.011% ( 1300, 1900 ] 39 0.001% 100.012% ( 1900, 2900 ] 29 0.001% 100.013% ( 2900, 4400 ] 51 0.002% 100.015% ( 4400, 6600 ] 6 0.000% 100.015% ( 6600, 9900 ] 3 0.000% 100.015% ( 9900, 14000 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 1322546 Average: 7.5889 StdDev: 127.73 Min: 1 Median: 1.8153 Max: 15972 Percentiles: P50: 1.82 P75: 2.79 P99: 9.39 P99.9: 103.80 P99.99: 194.25 ------------------------------------------------------ [ 0, 1 ] 117980 8.921% 8.921% ## ( 1, 2 ] 666333 50.383% 59.303% ########## ( 2, 3 ] 263195 19.901% 79.204% #### ( 3, 4 ] 110950 8.389% 87.593% ## ( 4, 6 ] 128779 9.737% 97.330% ## ( 6, 10 ] 26034 1.968% 99.299% ( 10, 15 ] 6022 0.455% 99.754% ( 15, 22 ] 694 0.052% 99.807% ( 22, 34 ] 50 0.004% 99.810% ( 34, 51 ] 44 0.003% 99.814% ( 51, 76 ] 23 0.002% 99.815% ( 76, 110 ] 1369 0.104% 99.919% ( 110, 170 ] 888 0.067% 99.986% ( 170, 250 ] 174 0.013% 99.999% ( 250, 380 ] 202 0.015% 100.014% ( 380, 580 ] 319 0.024% 100.039% ( 580, 870 ] 408 0.031% 100.069% ( 870, 1300 ] 362 0.027% 100.097% ( 1300, 1900 ] 316 0.024% 100.121% ( 1900, 2900 ] 471 0.036% 100.156% ( 2900, 4400 ] 593 0.045% 100.201% ( 4400, 6600 ] 176 0.013% 100.214% ( 6600, 9900 ] 65 0.005% 100.219% ( 9900, 14000 ] 7 0.001% 100.220% ( 14000, 22000 ] 2 0.000% 100.220% ** Level 2 read latency histogram (micros): Count: 106192 Average: 2.7209 StdDev: 37.68 Min: 0 Median: 1.4819 Max: 4922 Percentiles: P50: 1.48 P75: 1.89 P99: 5.93 P99.9: 16.94 P99.99: 2026.93 ------------------------------------------------------ [ 0, 1 ] 21483 20.230% 20.230% #### ( 1, 2 ] 65600 61.775% 82.005% ############ ( 2, 3 ] 10112 9.522% 91.528% ## ( 3, 4 ] 4435 4.176% 95.704% # ( 4, 6 ] 3627 3.416% 99.120% # ( 6, 10 ] 701 0.660% 99.780% ( 10, 15 ] 122 0.115% 99.895% ( 15, 22 ] 21 0.020% 99.914% ( 22, 34 ] 3 0.003% 99.917% ( 34, 51 ] 1 0.001% 99.918% ( 51, 76 ] 2 0.002% 99.920% ( 76, 110 ] 15 0.014% 99.934% ( 110, 170 ] 15 0.014% 99.948% ( 170, 250 ] 13 0.012% 99.960% ( 250, 380 ] 9 0.008% 99.969% ( 380, 580 ] 13 0.012% 99.981% ( 580, 870 ] 3 0.003% 99.984% ( 870, 1300 ] 5 0.005% 99.989% ( 1300, 1900 ] 1 0.001% 99.990% ( 1900, 2900 ] 3 0.003% 99.992% ( 2900, 4400 ] 7 0.007% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 422770 Average: 14.8543 StdDev: 193.84 Min: 0 Median: 1.9828 Max: 17814 Percentiles: P50: 1.98 P75: 2.99 P99: 12.50 P99.9: 1691.73 P99.99: 2792.77 ------------------------------------------------------ [ 0, 1 ] 9181 2.172% 2.172% ( 1, 2 ] 205741 48.665% 50.837% ########## ( 2, 3 ] 103032 24.371% 75.207% ##### ( 3, 4 ] 45551 10.774% 85.982% ## ( 4, 6 ] 46566 11.014% 96.996% ## ( 6, 10 ] 7545 1.785% 98.781% ( 10, 15 ] 1852 0.438% 99.219% ( 15, 22 ] 183 0.043% 99.262% ( 22, 34 ] 14 0.003% 99.266% ( 34, 51 ] 5 0.001% 99.267% ( 51, 76 ] 1 0.000% 99.267% ( 76, 110 ] 30 0.007% 99.274% ( 110, 170 ] 164 0.039% 99.313% ( 170, 250 ] 226 0.053% 99.366% ( 250, 380 ] 338 0.080% 99.446% ( 380, 580 ] 531 0.126% 99.572% ( 580, 870 ] 663 0.157% 99.729% ( 870, 1300 ] 515 0.122% 99.851% ( 1300, 1900 ] 322 0.076% 99.927% ( 1900, 2900 ] 301 0.071% 99.998% ( 2900, 4400 ] 393 0.093% 100.091% ( 4400, 6600 ] 110 0.026% 100.117% ( 6600, 9900 ] 22 0.005% 100.122% ( 9900, 14000 ] 14 0.003% 100.125% ( 14000, 22000 ] 5 0.001% 100.127% ** Level 4 read latency histogram (micros): Count: 10574 Average: 17.3276 StdDev: 240.06 Min: 1 Median: 2.1338 Max: 10921 Percentiles: P50: 2.13 P75: 3.09 P99: 14.59 P99.9: 3912.64 P99.99: 9805.29 ------------------------------------------------------ [ 0, 1 ] 113 1.069% 1.069% ( 1, 2 ] 4782 45.224% 46.293% ######### ( 2, 3 ] 2930 27.709% 74.002% ###### ( 3, 4 ] 1136 10.743% 84.746% ## ( 4, 6 ] 1251 11.831% 96.577% ## ( 6, 10 ] 215 2.033% 98.610% ( 10, 15 ] 46 0.435% 99.045% ( 15, 22 ] 7 0.066% 99.111% ( 34, 51 ] 4 0.038% 99.149% ( 51, 76 ] 3 0.028% 99.177% ( 76, 110 ] 3 0.028% 99.206% ( 110, 170 ] 4 0.038% 99.243% ( 170, 250 ] 28 0.265% 99.508% ( 580, 870 ] 3 0.028% 99.537% ( 870, 1300 ] 8 0.076% 99.612% ( 1300, 1900 ] 12 0.113% 99.726% ( 1900, 2900 ] 12 0.113% 99.839% ( 2900, 4400 ] 11 0.104% 99.943% ( 4400, 6600 ] 4 0.038% 99.981% ( 6600, 9900 ] 2 0.019% 100.000% ( 9900, 14000 ] 1 0.009% 100.009% ** Level 5 read latency histogram (micros): Count: 155 Average: 1880.4323 StdDev: 1884.61 Min: 76 Median: 1131.0714 Max: 8066 Percentiles: P50: 1131.07 P75: 2860.53 P99: 8066.00 P99.9: 8066.00 P99.99: 8066.00 ------------------------------------------------------ ( 51, 76 ] 1 0.645% 0.645% ( 76, 110 ] 13 8.387% 9.032% ## ( 110, 170 ] 9 5.806% 14.839% # ( 170, 250 ] 1 0.645% 15.484% ( 250, 380 ] 8 5.161% 20.645% # ( 380, 580 ] 16 10.323% 30.968% ## ( 580, 870 ] 21 13.548% 44.516% ### ( 870, 1300 ] 14 9.032% 53.548% ## ( 1300, 1900 ] 15 9.677% 63.226% ## ( 1900, 2900 ] 19 12.258% 75.484% ## ( 2900, 4400 ] 19 12.258% 87.742% ## ( 4400, 6600 ] 14 9.032% 96.774% ## ( 6600, 9900 ] 5 3.226% 100.000% # ** DB Stats ** Uptime(secs): 44.2 total, 26.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 155.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.043 H:M:S, 56.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 37.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:22.533 H:M:S, 86.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/12-12:29:39 ... thread 0: (1000000,8000000) ops and (268510.1,167615.6) ops/second in (3.724254,47.728248) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.21 GB 44.1 5.6 0.0 5.6 13.2 7.6 0.0 1.7 122.5 287.9 46.81 40.78 125 0.374 5820K 6226 0.0 0.0 L1 0/0 0.00 KB 0.0 6.5 5.1 1.3 6.3 5.0 0.2 1.2 220.4 216.6 29.98 27.24 3 9.992 6708K 113K 0.0 0.0 L2 1/0 29.57 MB 0.3 1.1 0.9 0.2 1.1 0.9 4.4 1.3 170.8 170.4 6.89 5.13 4 1.722 439K 192 0.0 0.0 L3 14/0 919.15 MB 0.9 3.1 2.5 0.6 3.1 2.5 2.8 1.2 148.3 147.9 21.14 14.66 21 1.007 2375K 4290 0.0 0.0 L4 158/0 9.62 GB 1.0 3.7 2.8 0.9 3.7 2.8 2.5 1.3 127.6 127.1 29.72 17.61 28 1.061 3781K 12K 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/11 103.56 GB 0.0 20.0 11.3 8.6 27.4 18.7 15.2 3.6 152.0 208.5 134.53 105.41 181 0.743 19M 137K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.0 11.3 8.6 27.4 18.7 15.1 3.6 152.0 208.5 134.53 105.41 181 0.743 19M 137K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.0 11.3 8.6 19.8 11.2 0.0 0.0 185.8 184.5 110.01 85.87 76 1.447 19M 137K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 316.0 24.52 19.54 105 0.234 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.9 total, 47.7 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.39 GB write, 585.34 MB/s write, 19.96 GB read, 426.70 MB/s read, 134.5 seconds Interval compaction: 27.39 GB write, 587.56 MB/s write, 19.96 GB read, 428.32 MB/s read, 134.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 66, interval: 77 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3021490 Average: 2.9926 StdDev: 27.83 Min: 0 Median: 1.4708 Max: 11362 Percentiles: P50: 1.47 P75: 1.85 P99: 7.62 P99.9: 157.40 P99.99: 481.30 ------------------------------------------------------ [ 0, 1 ] 566036 18.734% 18.734% #### ( 1, 2 ] 2006554 66.409% 85.143% ############# ( 2, 3 ] 250830 8.302% 93.445% ## ( 3, 4 ] 89179 2.951% 96.396% # ( 4, 6 ] 70206 2.324% 98.720% ( 6, 10 ] 20872 0.691% 99.410% ( 10, 15 ] 2969 0.098% 99.509% ( 15, 22 ] 567 0.019% 99.527% ( 22, 34 ] 36 0.001% 99.529% ( 34, 51 ] 16 0.001% 99.529% ( 51, 76 ] 18 0.001% 99.530% ( 76, 110 ] 7137 0.236% 99.766% ( 110, 170 ] 5125 0.170% 99.936% ( 170, 250 ] 764 0.025% 99.961% ( 250, 380 ] 617 0.020% 99.981% ( 380, 580 ] 517 0.017% 99.998% ( 580, 870 ] 253 0.008% 100.007% ( 870, 1300 ] 105 0.003% 100.010% ( 1300, 1900 ] 65 0.002% 100.012% ( 1900, 2900 ] 41 0.001% 100.014% ( 2900, 4400 ] 67 0.002% 100.016% ( 4400, 6600 ] 8 0.000% 100.016% ( 6600, 9900 ] 4 0.000% 100.016% ( 9900, 14000 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 1510243 Average: 7.3142 StdDev: 122.21 Min: 1 Median: 1.8291 Max: 15972 Percentiles: P50: 1.83 P75: 2.79 P99: 9.45 P99.9: 104.43 P99.99: 256.00 ------------------------------------------------------ [ 0, 1 ] 120602 7.986% 7.986% ## ( 1, 2 ] 765272 50.672% 58.658% ########## ( 2, 3 ] 310489 20.559% 79.217% #### ( 3, 4 ] 126181 8.355% 87.572% ## ( 4, 6 ] 146131 9.676% 97.248% ## ( 6, 10 ] 30705 2.033% 99.281% ( 10, 15 ] 7270 0.481% 99.762% ( 15, 22 ] 805 0.053% 99.815% ( 22, 34 ] 59 0.004% 99.819% ( 34, 51 ] 48 0.003% 99.822% ( 51, 76 ] 25 0.002% 99.824% ( 76, 110 ] 1370 0.091% 99.915% ( 110, 170 ] 906 0.060% 99.975% ( 170, 250 ] 216 0.014% 99.989% ( 250, 380 ] 281 0.019% 100.008% ( 380, 580 ] 417 0.028% 100.035% ( 580, 870 ] 481 0.032% 100.067% ( 870, 1300 ] 422 0.028% 100.095% ( 1300, 1900 ] 348 0.023% 100.118% ( 1900, 2900 ] 504 0.033% 100.152% ( 2900, 4400 ] 618 0.041% 100.192% ( 4400, 6600 ] 183 0.012% 100.205% ( 6600, 9900 ] 67 0.004% 100.209% ( 9900, 14000 ] 7 0.000% 100.210% ( 14000, 22000 ] 2 0.000% 100.210% ** Level 2 read latency histogram (micros): Count: 275262 Average: 6.1593 StdDev: 95.91 Min: 0 Median: 1.8200 Max: 7422 Percentiles: P50: 1.82 P75: 2.76 P99: 9.24 P99.9: 20.53 P99.99: 413.28 ------------------------------------------------------ [ 0, 1 ] 22504 8.175% 8.175% ## ( 1, 2 ] 140403 51.007% 59.183% ########## ( 2, 3 ] 57129 20.754% 79.937% #### ( 3, 4 ] 23090 8.388% 88.325% ## ( 4, 6 ] 25400 9.228% 97.553% ## ( 6, 10 ] 4924 1.789% 99.342% ( 10, 15 ] 1412 0.513% 99.855% ( 15, 22 ] 158 0.057% 99.912% ( 22, 34 ] 16 0.006% 99.918% ( 34, 51 ] 8 0.003% 99.921% ( 51, 76 ] 4 0.001% 99.922% ( 76, 110 ] 20 0.007% 99.930% ( 110, 170 ] 35 0.013% 99.942% ( 170, 250 ] 45 0.016% 99.959% ( 250, 380 ] 71 0.026% 99.984% ( 380, 580 ] 93 0.034% 100.018% ( 580, 870 ] 112 0.041% 100.059% ( 870, 1300 ] 72 0.026% 100.085% ( 1300, 1900 ] 49 0.018% 100.103% ( 1900, 2900 ] 74 0.027% 100.130% ( 2900, 4400 ] 93 0.034% 100.163% ( 4400, 6600 ] 23 0.008% 100.172% ( 6600, 9900 ] 1 0.000% 100.172% ** Level 3 read latency histogram (micros): Count: 466608 Average: 15.6029 StdDev: 193.98 Min: 0 Median: 1.9822 Max: 17814 Percentiles: P50: 1.98 P75: 2.99 P99: 14.00 P99.9: 1816.84 P99.99: 2951.71 ------------------------------------------------------ [ 0, 1 ] 10020 2.147% 2.147% ( 1, 2 ] 227321 48.718% 50.865% ########## ( 2, 3 ] 114276 24.491% 75.356% ##### ( 3, 4 ] 49607 10.631% 85.987% ## ( 4, 6 ] 50497 10.822% 96.810% ## ( 6, 10 ] 8506 1.823% 98.632% ( 10, 15 ] 2145 0.460% 99.092% ( 15, 22 ] 213 0.046% 99.138% ( 22, 34 ] 16 0.003% 99.141% ( 34, 51 ] 7 0.002% 99.143% ( 51, 76 ] 1 0.000% 99.143% ( 76, 110 ] 41 0.009% 99.152% ( 110, 170 ] 224 0.048% 99.200% ( 170, 250 ] 301 0.065% 99.264% ( 250, 380 ] 437 0.094% 99.358% ( 380, 580 ] 680 0.146% 99.504% ( 580, 870 ] 845 0.181% 99.685% ( 870, 1300 ] 665 0.143% 99.827% ( 1300, 1900 ] 394 0.084% 99.912% ( 1900, 2900 ] 350 0.075% 99.987% ( 2900, 4400 ] 445 0.095% 100.082% ( 4400, 6600 ] 118 0.025% 100.107% ( 6600, 9900 ] 23 0.005% 100.112% ( 9900, 14000 ] 14 0.003% 100.115% ( 14000, 22000 ] 5 0.001% 100.116% ** Level 4 read latency histogram (micros): Count: 83852 Average: 8.3065 StdDev: 126.09 Min: 1 Median: 1.9562 Max: 10921 Percentiles: P50: 1.96 P75: 2.90 P99: 9.96 P99.9: 1150.11 P99.99: 3412.42 ------------------------------------------------------ [ 0, 1 ] 986 1.176% 1.176% ( 1, 2 ] 42814 51.059% 52.235% ########## ( 2, 3 ] 21301 25.403% 77.638% ##### ( 3, 4 ] 7683 9.163% 86.801% ## ( 4, 6 ] 8756 10.442% 97.243% ## ( 6, 10 ] 1489 1.776% 99.019% ( 10, 15 ] 351 0.419% 99.437% ( 15, 22 ] 42 0.050% 99.487% ( 22, 34 ] 8 0.010% 99.497% ( 34, 51 ] 9 0.011% 99.507% ( 51, 76 ] 4 0.005% 99.512% ( 76, 110 ] 17 0.020% 99.533% ( 110, 170 ] 48 0.057% 99.590% ( 170, 250 ] 80 0.095% 99.685% ( 250, 380 ] 44 0.052% 99.738% ( 380, 580 ] 59 0.070% 99.808% ( 580, 870 ] 55 0.066% 99.874% ( 870, 1300 ] 34 0.041% 99.914% ( 1300, 1900 ] 27 0.032% 99.946% ( 1900, 2900 ] 25 0.030% 99.976% ( 2900, 4400 ] 34 0.041% 100.017% ( 4400, 6600 ] 9 0.011% 100.027% ( 6600, 9900 ] 4 0.005% 100.032% ( 9900, 14000 ] 1 0.001% 100.033% ** Level 5 read latency histogram (micros): Count: 320 Average: 1772.4688 StdDev: 1782.59 Min: 76 Median: 1069.6429 Max: 8066 Percentiles: P50: 1069.64 P75: 2761.11 P99: 8066.00 P99.9: 8066.00 P99.99: 8066.00 ------------------------------------------------------ ( 51, 76 ] 1 0.312% 0.312% ( 76, 110 ] 16 5.000% 5.312% # ( 110, 170 ] 17 5.312% 10.625% # ( 170, 250 ] 10 3.125% 13.750% # ( 250, 380 ] 32 10.000% 23.750% ## ( 380, 580 ] 36 11.250% 35.000% ## ( 580, 870 ] 35 10.938% 45.938% ## ( 870, 1300 ] 28 8.750% 54.688% ## ( 1300, 1900 ] 34 10.625% 65.312% ## ( 1900, 2900 ] 36 11.250% 76.562% ## ( 2900, 4400 ] 42 13.125% 89.688% ### ( 4400, 6600 ] 26 8.125% 97.812% ## ( 6600, 9900 ] 7 2.188% 100.000% ** DB Stats ** Uptime(secs): 47.9 total, 3.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 164.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.944 H:M:S, 54.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 264.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.901 H:M:S, 24.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-12:29:42 ... thread 0: (1000000,9000000) ops and (330629.1,177330.2) ops/second in (3.024537,50.752785) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/7 3.13 GB 169.9 6.7 0.0 6.7 15.2 8.5 0.0 1.8 127.6 289.0 53.82 47.39 142 0.379 6972K 7393 0.0 0.0 L1 0/0 0.00 KB 0.0 6.5 5.1 1.3 6.3 5.0 0.2 1.2 220.4 216.6 29.98 27.24 3 9.992 6708K 113K 0.0 0.0 L2 1/0 29.57 MB 0.3 1.1 0.9 0.2 1.1 0.9 4.4 1.3 170.8 170.4 6.89 5.13 4 1.722 439K 192 0.0 0.0 L3 14/0 919.15 MB 0.9 3.1 2.5 0.6 3.1 2.5 2.8 1.2 148.3 147.9 21.14 14.66 21 1.007 2375K 4290 0.0 0.0 L4 158/0 9.62 GB 1.0 3.7 2.8 0.9 3.7 2.8 2.5 1.3 127.6 127.1 29.72 17.61 28 1.061 3781K 12K 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/7 104.48 GB 0.0 21.1 11.3 9.7 29.4 19.7 15.2 3.5 152.4 212.8 141.55 112.03 198 0.715 20M 138K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.1 11.3 9.7 29.4 19.7 15.1 3.5 152.4 212.8 141.55 112.03 198 0.715 20M 138K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.1 11.3 9.7 20.9 11.2 0.0 0.0 188.7 187.4 114.33 90.11 80 1.429 20M 138K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 319.5 27.21 21.91 118 0.231 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.9 total, 50.8 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.42 GB write, 591.38 MB/s write, 21.07 GB read, 423.62 MB/s read, 141.5 seconds Interval compaction: 29.42 GB write, 593.48 MB/s write, 21.07 GB read, 425.13 MB/s read, 141.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 68, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3446878 Average: 2.9189 StdDev: 26.46 Min: 0 Median: 1.4836 Max: 11362 Percentiles: P50: 1.48 P75: 1.86 P99: 7.37 P99.9: 151.28 P99.99: 407.15 ------------------------------------------------------ [ 0, 1 ] 611113 17.729% 17.729% #### ( 1, 2 ] 2300125 66.731% 84.460% ############# ( 2, 3 ] 305941 8.876% 93.336% ## ( 3, 4 ] 104173 3.022% 96.358% # ( 4, 6 ] 82650 2.398% 98.756% ( 6, 10 ] 24611 0.714% 99.470% ( 10, 15 ] 3420 0.099% 99.569% ( 15, 22 ] 603 0.017% 99.587% ( 22, 34 ] 40 0.001% 99.588% ( 34, 51 ] 18 0.001% 99.588% ( 51, 76 ] 20 0.001% 99.589% ( 76, 110 ] 7163 0.208% 99.797% ( 110, 170 ] 5169 0.150% 99.947% ( 170, 250 ] 788 0.023% 99.970% ( 250, 380 ] 628 0.018% 99.988% ( 380, 580 ] 540 0.016% 100.004% ( 580, 870 ] 264 0.008% 100.011% ( 870, 1300 ] 113 0.003% 100.015% ( 1300, 1900 ] 70 0.002% 100.017% ( 1900, 2900 ] 42 0.001% 100.018% ( 2900, 4400 ] 68 0.002% 100.020% ( 4400, 6600 ] 9 0.000% 100.020% ( 6600, 9900 ] 4 0.000% 100.020% ( 9900, 14000 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1510243 Average: 7.3142 StdDev: 122.21 Min: 1 Median: 1.8291 Max: 15972 Percentiles: P50: 1.83 P75: 2.79 P99: 9.45 P99.9: 104.43 P99.99: 256.00 ------------------------------------------------------ [ 0, 1 ] 120602 7.986% 7.986% ## ( 1, 2 ] 765272 50.672% 58.658% ########## ( 2, 3 ] 310489 20.559% 79.217% #### ( 3, 4 ] 126181 8.355% 87.572% ## ( 4, 6 ] 146131 9.676% 97.248% ## ( 6, 10 ] 30705 2.033% 99.281% ( 10, 15 ] 7270 0.481% 99.762% ( 15, 22 ] 805 0.053% 99.815% ( 22, 34 ] 59 0.004% 99.819% ( 34, 51 ] 48 0.003% 99.822% ( 51, 76 ] 25 0.002% 99.824% ( 76, 110 ] 1370 0.091% 99.915% ( 110, 170 ] 906 0.060% 99.975% ( 170, 250 ] 216 0.014% 99.989% ( 250, 380 ] 281 0.019% 100.008% ( 380, 580 ] 417 0.028% 100.035% ( 580, 870 ] 481 0.032% 100.067% ( 870, 1300 ] 422 0.028% 100.095% ( 1300, 1900 ] 348 0.023% 100.118% ( 1900, 2900 ] 504 0.033% 100.152% ( 2900, 4400 ] 618 0.041% 100.192% ( 4400, 6600 ] 183 0.012% 100.205% ( 6600, 9900 ] 67 0.004% 100.209% ( 9900, 14000 ] 7 0.000% 100.210% ( 14000, 22000 ] 2 0.000% 100.210% ** Level 2 read latency histogram (micros): Count: 275262 Average: 6.1593 StdDev: 95.91 Min: 0 Median: 1.8200 Max: 7422 Percentiles: P50: 1.82 P75: 2.76 P99: 9.24 P99.9: 20.53 P99.99: 413.28 ------------------------------------------------------ [ 0, 1 ] 22504 8.175% 8.175% ## ( 1, 2 ] 140403 51.007% 59.183% ########## ( 2, 3 ] 57129 20.754% 79.937% #### ( 3, 4 ] 23090 8.388% 88.325% ## ( 4, 6 ] 25400 9.228% 97.553% ## ( 6, 10 ] 4924 1.789% 99.342% ( 10, 15 ] 1412 0.513% 99.855% ( 15, 22 ] 158 0.057% 99.912% ( 22, 34 ] 16 0.006% 99.918% ( 34, 51 ] 8 0.003% 99.921% ( 51, 76 ] 4 0.001% 99.922% ( 76, 110 ] 20 0.007% 99.930% ( 110, 170 ] 35 0.013% 99.942% ( 170, 250 ] 45 0.016% 99.959% ( 250, 380 ] 71 0.026% 99.984% ( 380, 580 ] 93 0.034% 100.018% ( 580, 870 ] 112 0.041% 100.059% ( 870, 1300 ] 72 0.026% 100.085% ( 1300, 1900 ] 49 0.018% 100.103% ( 1900, 2900 ] 74 0.027% 100.130% ( 2900, 4400 ] 93 0.034% 100.163% ( 4400, 6600 ] 23 0.008% 100.172% ( 6600, 9900 ] 1 0.000% 100.172% ** Level 3 read latency histogram (micros): Count: 466608 Average: 15.6029 StdDev: 193.98 Min: 0 Median: 1.9822 Max: 17814 Percentiles: P50: 1.98 P75: 2.99 P99: 14.00 P99.9: 1816.84 P99.99: 2951.71 ------------------------------------------------------ [ 0, 1 ] 10020 2.147% 2.147% ( 1, 2 ] 227321 48.718% 50.865% ########## ( 2, 3 ] 114276 24.491% 75.356% ##### ( 3, 4 ] 49607 10.631% 85.987% ## ( 4, 6 ] 50497 10.822% 96.810% ## ( 6, 10 ] 8506 1.823% 98.632% ( 10, 15 ] 2145 0.460% 99.092% ( 15, 22 ] 213 0.046% 99.138% ( 22, 34 ] 16 0.003% 99.141% ( 34, 51 ] 7 0.002% 99.143% ( 51, 76 ] 1 0.000% 99.143% ( 76, 110 ] 41 0.009% 99.152% ( 110, 170 ] 224 0.048% 99.200% ( 170, 250 ] 301 0.065% 99.264% ( 250, 380 ] 437 0.094% 99.358% ( 380, 580 ] 680 0.146% 99.504% ( 580, 870 ] 845 0.181% 99.685% ( 870, 1300 ] 665 0.143% 99.827% ( 1300, 1900 ] 394 0.084% 99.912% ( 1900, 2900 ] 350 0.075% 99.987% ( 2900, 4400 ] 445 0.095% 100.082% ( 4400, 6600 ] 118 0.025% 100.107% ( 6600, 9900 ] 23 0.005% 100.112% ( 9900, 14000 ] 14 0.003% 100.115% ( 14000, 22000 ] 5 0.001% 100.116% ** Level 4 read latency histogram (micros): Count: 83852 Average: 8.3065 StdDev: 126.09 Min: 1 Median: 1.9562 Max: 10921 Percentiles: P50: 1.96 P75: 2.90 P99: 9.96 P99.9: 1150.11 P99.99: 3412.42 ------------------------------------------------------ [ 0, 1 ] 986 1.176% 1.176% ( 1, 2 ] 42814 51.059% 52.235% ########## ( 2, 3 ] 21301 25.403% 77.638% ##### ( 3, 4 ] 7683 9.163% 86.801% ## ( 4, 6 ] 8756 10.442% 97.243% ## ( 6, 10 ] 1489 1.776% 99.019% ( 10, 15 ] 351 0.419% 99.437% ( 15, 22 ] 42 0.050% 99.487% ( 22, 34 ] 8 0.010% 99.497% ( 34, 51 ] 9 0.011% 99.507% ( 51, 76 ] 4 0.005% 99.512% ( 76, 110 ] 17 0.020% 99.533% ( 110, 170 ] 48 0.057% 99.590% ( 170, 250 ] 80 0.095% 99.685% ( 250, 380 ] 44 0.052% 99.738% ( 380, 580 ] 59 0.070% 99.808% ( 580, 870 ] 55 0.066% 99.874% ( 870, 1300 ] 34 0.041% 99.914% ( 1300, 1900 ] 27 0.032% 99.946% ( 1900, 2900 ] 25 0.030% 99.976% ( 2900, 4400 ] 34 0.041% 100.017% ( 4400, 6600 ] 9 0.011% 100.027% ( 6600, 9900 ] 4 0.005% 100.032% ( 9900, 14000 ] 1 0.001% 100.033% ** Level 5 read latency histogram (micros): Count: 320 Average: 1772.4688 StdDev: 1782.59 Min: 76 Median: 1069.6429 Max: 8066 Percentiles: P50: 1069.64 P75: 2761.11 P99: 8066.00 P99.9: 8066.00 P99.99: 8066.00 ------------------------------------------------------ ( 51, 76 ] 1 0.312% 0.312% ( 76, 110 ] 16 5.000% 5.312% # ( 110, 170 ] 17 5.312% 10.625% # ( 170, 250 ] 10 3.125% 13.750% # ( 250, 380 ] 32 10.000% 23.750% ## ( 380, 580 ] 36 11.250% 35.000% ## ( 580, 870 ] 35 10.938% 45.938% ## ( 870, 1300 ] 28 8.750% 54.688% ## ( 1300, 1900 ] 34 10.625% 65.312% ## ( 1900, 2900 ] 36 11.250% 76.562% ## ( 2900, 4400 ] 42 13.125% 89.688% ### ( 4400, 6600 ] 26 8.125% 97.812% ## ( 6600, 9900 ] 7 2.188% 100.000% ** DB Stats ** Uptime(secs): 50.9 total, 3.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 173.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.346 H:M:S, 51.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.402 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/12-12:29:46 ... thread 0: (1000000,10000000) ops and (318118.6,185541.6) ops/second in (3.143482,53.896267) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 2.64 GB 6.3 7.5 0.0 7.5 17.0 9.5 0.0 1.8 128.8 291.3 59.66 52.87 159 0.375 7803K 8274 0.0 0.0 L1 14/14 1.47 GB 0.0 7.9 6.6 1.3 7.8 6.5 0.2 1.2 219.6 216.3 36.96 33.73 4 9.240 8241K 123K 0.0 0.0 L2 1/0 29.57 MB 0.3 1.1 0.9 0.2 1.1 0.9 4.4 1.3 170.8 170.4 6.89 5.13 4 1.722 439K 192 0.0 0.0 L3 14/0 919.15 MB 0.9 3.1 2.5 0.6 3.1 2.5 2.8 1.2 148.3 147.9 21.14 14.66 21 1.007 2375K 4290 0.0 0.0 L4 158/0 9.62 GB 1.0 3.7 2.8 0.9 3.7 2.8 2.5 1.3 127.6 127.1 29.72 17.61 28 1.061 3781K 12K 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/26 105.45 GB 0.0 23.3 12.8 10.5 32.7 22.1 15.2 3.4 154.9 216.7 154.36 123.99 216 0.715 22M 148K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.3 12.8 10.5 32.7 22.1 15.1 3.4 154.9 216.7 154.36 123.99 216 0.715 22M 148K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.3 12.8 10.5 23.2 12.6 0.0 0.0 192.3 191.0 124.33 99.57 84 1.480 22M 148K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 323.1 30.03 24.42 132 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.1 total, 53.9 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.66 GB write, 618.51 MB/s write, 23.35 GB read, 442.07 MB/s read, 154.4 seconds Interval compaction: 32.66 GB write, 620.59 MB/s write, 23.35 GB read, 443.56 MB/s read, 154.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 71, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 71, interval: 83 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3728398 Average: 2.8660 StdDev: 25.75 Min: 0 Median: 1.4802 Max: 11362 Percentiles: P50: 1.48 P75: 1.85 P99: 7.14 P99.9: 148.77 P99.99: 392.98 ------------------------------------------------------ [ 0, 1 ] 667423 17.901% 17.901% #### ( 1, 2 ] 2492168 66.843% 84.744% ############# ( 2, 3 ] 326863 8.767% 93.511% ## ( 3, 4 ] 110585 2.966% 96.477% # ( 4, 6 ] 86614 2.323% 98.800% ( 6, 10 ] 26132 0.701% 99.501% ( 10, 15 ] 3556 0.095% 99.596% ( 15, 22 ] 632 0.017% 99.613% ( 22, 34 ] 42 0.001% 99.614% ( 34, 51 ] 20 0.001% 99.615% ( 51, 76 ] 22 0.001% 99.615% ( 76, 110 ] 7205 0.193% 99.809% ( 110, 170 ] 5273 0.141% 99.950% ( 170, 250 ] 810 0.022% 99.972% ( 250, 380 ] 644 0.017% 99.989% ( 380, 580 ] 557 0.015% 100.004% ( 580, 870 ] 274 0.007% 100.011% ( 870, 1300 ] 116 0.003% 100.014% ( 1300, 1900 ] 72 0.002% 100.016% ( 1900, 2900 ] 45 0.001% 100.018% ( 2900, 4400 ] 69 0.002% 100.019% ( 4400, 6600 ] 9 0.000% 100.020% ( 6600, 9900 ] 4 0.000% 100.020% ( 9900, 14000 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1513290 Average: 7.3237 StdDev: 122.16 Min: 1 Median: 1.8284 Max: 15972 Percentiles: P50: 1.83 P75: 2.79 P99: 9.46 P99.9: 105.80 P99.99: 269.18 ------------------------------------------------------ [ 0, 1 ] 121262 8.013% 8.013% ## ( 1, 2 ] 767021 50.686% 58.699% ########## ( 2, 3 ] 310770 20.536% 79.235% #### ( 3, 4 ] 126324 8.348% 87.582% ## ( 4, 6 ] 146179 9.660% 97.242% ## ( 6, 10 ] 30762 2.033% 99.275% ( 10, 15 ] 7280 0.481% 99.756% ( 15, 22 ] 808 0.053% 99.809% ( 22, 34 ] 60 0.004% 99.813% ( 34, 51 ] 48 0.003% 99.817% ( 51, 76 ] 25 0.002% 99.818% ( 76, 110 ] 1412 0.093% 99.912% ( 110, 170 ] 922 0.061% 99.972% ( 170, 250 ] 222 0.015% 99.987% ( 250, 380 ] 296 0.020% 100.007% ( 380, 580 ] 422 0.028% 100.035% ( 580, 870 ] 481 0.032% 100.066% ( 870, 1300 ] 429 0.028% 100.095% ( 1300, 1900 ] 351 0.023% 100.118% ( 1900, 2900 ] 505 0.033% 100.151% ( 2900, 4400 ] 618 0.041% 100.192% ( 4400, 6600 ] 183 0.012% 100.204% ( 6600, 9900 ] 67 0.004% 100.209% ( 9900, 14000 ] 7 0.000% 100.209% ( 14000, 22000 ] 2 0.000% 100.209% ** Level 2 read latency histogram (micros): Count: 275262 Average: 6.1593 StdDev: 95.91 Min: 0 Median: 1.8200 Max: 7422 Percentiles: P50: 1.82 P75: 2.76 P99: 9.24 P99.9: 20.53 P99.99: 413.28 ------------------------------------------------------ [ 0, 1 ] 22504 8.175% 8.175% ## ( 1, 2 ] 140403 51.007% 59.183% ########## ( 2, 3 ] 57129 20.754% 79.937% #### ( 3, 4 ] 23090 8.388% 88.325% ## ( 4, 6 ] 25400 9.228% 97.553% ## ( 6, 10 ] 4924 1.789% 99.342% ( 10, 15 ] 1412 0.513% 99.855% ( 15, 22 ] 158 0.057% 99.912% ( 22, 34 ] 16 0.006% 99.918% ( 34, 51 ] 8 0.003% 99.921% ( 51, 76 ] 4 0.001% 99.922% ( 76, 110 ] 20 0.007% 99.930% ( 110, 170 ] 35 0.013% 99.942% ( 170, 250 ] 45 0.016% 99.959% ( 250, 380 ] 71 0.026% 99.984% ( 380, 580 ] 93 0.034% 100.018% ( 580, 870 ] 112 0.041% 100.059% ( 870, 1300 ] 72 0.026% 100.085% ( 1300, 1900 ] 49 0.018% 100.103% ( 1900, 2900 ] 74 0.027% 100.130% ( 2900, 4400 ] 93 0.034% 100.163% ( 4400, 6600 ] 23 0.008% 100.172% ( 6600, 9900 ] 1 0.000% 100.172% ** Level 3 read latency histogram (micros): Count: 466608 Average: 15.6029 StdDev: 193.98 Min: 0 Median: 1.9822 Max: 17814 Percentiles: P50: 1.98 P75: 2.99 P99: 14.00 P99.9: 1816.84 P99.99: 2951.71 ------------------------------------------------------ [ 0, 1 ] 10020 2.147% 2.147% ( 1, 2 ] 227321 48.718% 50.865% ########## ( 2, 3 ] 114276 24.491% 75.356% ##### ( 3, 4 ] 49607 10.631% 85.987% ## ( 4, 6 ] 50497 10.822% 96.810% ## ( 6, 10 ] 8506 1.823% 98.632% ( 10, 15 ] 2145 0.460% 99.092% ( 15, 22 ] 213 0.046% 99.138% ( 22, 34 ] 16 0.003% 99.141% ( 34, 51 ] 7 0.002% 99.143% ( 51, 76 ] 1 0.000% 99.143% ( 76, 110 ] 41 0.009% 99.152% ( 110, 170 ] 224 0.048% 99.200% ( 170, 250 ] 301 0.065% 99.264% ( 250, 380 ] 437 0.094% 99.358% ( 380, 580 ] 680 0.146% 99.504% ( 580, 870 ] 845 0.181% 99.685% ( 870, 1300 ] 665 0.143% 99.827% ( 1300, 1900 ] 394 0.084% 99.912% ( 1900, 2900 ] 350 0.075% 99.987% ( 2900, 4400 ] 445 0.095% 100.082% ( 4400, 6600 ] 118 0.025% 100.107% ( 6600, 9900 ] 23 0.005% 100.112% ( 9900, 14000 ] 14 0.003% 100.115% ( 14000, 22000 ] 5 0.001% 100.116% ** Level 4 read latency histogram (micros): Count: 83852 Average: 8.3065 StdDev: 126.09 Min: 1 Median: 1.9562 Max: 10921 Percentiles: P50: 1.96 P75: 2.90 P99: 9.96 P99.9: 1150.11 P99.99: 3412.42 ------------------------------------------------------ [ 0, 1 ] 986 1.176% 1.176% ( 1, 2 ] 42814 51.059% 52.235% ########## ( 2, 3 ] 21301 25.403% 77.638% ##### ( 3, 4 ] 7683 9.163% 86.801% ## ( 4, 6 ] 8756 10.442% 97.243% ## ( 6, 10 ] 1489 1.776% 99.019% ( 10, 15 ] 351 0.419% 99.437% ( 15, 22 ] 42 0.050% 99.487% ( 22, 34 ] 8 0.010% 99.497% ( 34, 51 ] 9 0.011% 99.507% ( 51, 76 ] 4 0.005% 99.512% ( 76, 110 ] 17 0.020% 99.533% ( 110, 170 ] 48 0.057% 99.590% ( 170, 250 ] 80 0.095% 99.685% ( 250, 380 ] 44 0.052% 99.738% ( 380, 580 ] 59 0.070% 99.808% ( 580, 870 ] 55 0.066% 99.874% ( 870, 1300 ] 34 0.041% 99.914% ( 1300, 1900 ] 27 0.032% 99.946% ( 1900, 2900 ] 25 0.030% 99.976% ( 2900, 4400 ] 34 0.041% 100.017% ( 4400, 6600 ] 9 0.011% 100.027% ( 6600, 9900 ] 4 0.005% 100.032% ( 9900, 14000 ] 1 0.001% 100.033% ** Level 5 read latency histogram (micros): Count: 320 Average: 1772.4688 StdDev: 1782.59 Min: 76 Median: 1069.6429 Max: 8066 Percentiles: P50: 1069.64 P75: 2761.11 P99: 8066.00 P99.9: 8066.00 P99.99: 8066.00 ------------------------------------------------------ ( 51, 76 ] 1 0.312% 0.312% ( 76, 110 ] 16 5.000% 5.312% # ( 110, 170 ] 17 5.312% 10.625% # ( 170, 250 ] 10 3.125% 13.750% # ( 250, 380 ] 32 10.000% 23.750% ## ( 380, 580 ] 36 11.250% 35.000% ## ( 580, 870 ] 35 10.938% 45.938% ## ( 870, 1300 ] 28 8.750% 54.688% ## ( 1300, 1900 ] 34 10.625% 65.312% ## ( 1900, 2900 ] 36 11.250% 76.562% ## ( 2900, 4400 ] 42 13.125% 89.688% ### ( 4400, 6600 ] 26 8.125% 97.812% ## ( 6600, 9900 ] 7 2.188% 100.000% ** DB Stats ** Uptime(secs): 54.1 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 181.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.907 H:M:S, 49.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.561 H:M:S, 17.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/12-12:29:49 ... thread 0: (1000000,11000000) ops and (282339.6,191510.5) ops/second in (3.541834,57.438101) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 3.63 GB 81.8 8.3 0.0 8.3 18.8 10.4 0.0 1.8 129.7 292.9 65.57 58.42 177 0.370 8635K 9137 0.0 0.0 L1 14/14 1.47 GB 0.0 7.9 6.6 1.3 7.8 6.5 0.2 1.2 219.6 216.3 36.96 33.73 4 9.240 8241K 123K 0.0 0.0 L2 1/0 29.57 MB 0.3 1.1 0.9 0.2 1.1 0.9 4.4 1.3 170.8 170.4 6.89 5.13 4 1.722 439K 192 0.0 0.0 L3 14/0 919.15 MB 0.9 3.1 2.5 0.6 3.1 2.5 2.8 1.2 148.3 147.9 21.14 14.66 21 1.007 2375K 4290 0.0 0.0 L4 158/0 9.62 GB 1.0 3.7 2.8 0.9 3.7 2.8 2.5 1.3 127.6 127.1 29.72 17.61 28 1.061 3781K 12K 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1310/30 106.44 GB 0.0 24.1 12.8 11.3 34.4 23.1 15.2 3.3 154.3 220.1 160.27 129.54 234 0.685 23M 149K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.1 12.8 11.3 34.4 23.1 15.1 3.3 154.3 220.1 160.27 129.54 234 0.685 23M 149K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.1 12.8 11.3 24.0 12.6 0.0 0.0 194.0 192.8 127.42 102.60 87 1.465 23M 149K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 326.0 32.85 26.93 147 0.223 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.6 total, 57.4 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.45 GB write, 612.18 MB/s write, 24.15 GB read, 429.11 MB/s read, 160.3 seconds Interval compaction: 34.45 GB write, 614.11 MB/s write, 24.15 GB read, 430.46 MB/s read, 160.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 73, interval: 88 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4071612 Average: 2.8210 StdDev: 24.87 Min: 0 Median: 1.4853 Max: 11362 Percentiles: P50: 1.49 P75: 1.86 P99: 6.88 P99.9: 144.86 P99.99: 365.85 ------------------------------------------------------ [ 0, 1 ] 711167 17.466% 17.466% ### ( 1, 2 ] 2729762 67.044% 84.510% ############# ( 2, 3 ] 366859 9.010% 93.520% ## ( 3, 4 ] 121453 2.983% 96.503% # ( 4, 6 ] 95532 2.346% 98.850% ( 6, 10 ] 27823 0.683% 99.533% ( 10, 15 ] 3831 0.094% 99.627% ( 15, 22 ] 658 0.016% 99.643% ( 22, 34 ] 45 0.001% 99.644% ( 34, 51 ] 21 0.001% 99.645% ( 51, 76 ] 23 0.001% 99.645% ( 76, 110 ] 7265 0.178% 99.824% ( 110, 170 ] 5340 0.131% 99.955% ( 170, 250 ] 836 0.021% 99.976% ( 250, 380 ] 663 0.016% 99.992% ( 380, 580 ] 578 0.014% 100.006% ( 580, 870 ] 282 0.007% 100.013% ( 870, 1300 ] 121 0.003% 100.016% ( 1300, 1900 ] 72 0.002% 100.018% ( 1900, 2900 ] 46 0.001% 100.019% ( 2900, 4400 ] 71 0.002% 100.021% ( 4400, 6600 ] 9 0.000% 100.021% ( 6600, 9900 ] 4 0.000% 100.021% ( 9900, 14000 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1586454 Average: 7.1061 StdDev: 119.33 Min: 1 Median: 1.8109 Max: 15972 Percentiles: P50: 1.81 P75: 2.76 P99: 9.42 P99.9: 106.22 P99.99: 277.23 ------------------------------------------------------ [ 0, 1 ] 130517 8.227% 8.227% ## ( 1, 2 ] 817210 51.512% 59.739% ########## ( 2, 3 ] 319200 20.120% 79.859% #### ( 3, 4 ] 128281 8.086% 87.945% ## ( 4, 6 ] 148053 9.332% 97.277% ## ( 6, 10 ] 31959 2.014% 99.292% ( 10, 15 ] 7407 0.467% 99.759% ( 15, 22 ] 813 0.051% 99.810% ( 22, 34 ] 61 0.004% 99.814% ( 34, 51 ] 48 0.003% 99.817% ( 51, 76 ] 26 0.002% 99.819% ( 76, 110 ] 1454 0.092% 99.910% ( 110, 170 ] 953 0.060% 99.970% ( 170, 250 ] 248 0.016% 99.986% ( 250, 380 ] 312 0.020% 100.006% ( 380, 580 ] 430 0.027% 100.033% ( 580, 870 ] 485 0.031% 100.063% ( 870, 1300 ] 430 0.027% 100.090% ( 1300, 1900 ] 351 0.022% 100.112% ( 1900, 2900 ] 505 0.032% 100.144% ( 2900, 4400 ] 618 0.039% 100.183% ( 4400, 6600 ] 183 0.012% 100.195% ( 6600, 9900 ] 67 0.004% 100.199% ( 9900, 14000 ] 7 0.000% 100.199% ( 14000, 22000 ] 2 0.000% 100.200% ** Level 2 read latency histogram (micros): Count: 275262 Average: 6.1593 StdDev: 95.91 Min: 0 Median: 1.8200 Max: 7422 Percentiles: P50: 1.82 P75: 2.76 P99: 9.24 P99.9: 20.53 P99.99: 413.28 ------------------------------------------------------ [ 0, 1 ] 22504 8.175% 8.175% ## ( 1, 2 ] 140403 51.007% 59.183% ########## ( 2, 3 ] 57129 20.754% 79.937% #### ( 3, 4 ] 23090 8.388% 88.325% ## ( 4, 6 ] 25400 9.228% 97.553% ## ( 6, 10 ] 4924 1.789% 99.342% ( 10, 15 ] 1412 0.513% 99.855% ( 15, 22 ] 158 0.057% 99.912% ( 22, 34 ] 16 0.006% 99.918% ( 34, 51 ] 8 0.003% 99.921% ( 51, 76 ] 4 0.001% 99.922% ( 76, 110 ] 20 0.007% 99.930% ( 110, 170 ] 35 0.013% 99.942% ( 170, 250 ] 45 0.016% 99.959% ( 250, 380 ] 71 0.026% 99.984% ( 380, 580 ] 93 0.034% 100.018% ( 580, 870 ] 112 0.041% 100.059% ( 870, 1300 ] 72 0.026% 100.085% ( 1300, 1900 ] 49 0.018% 100.103% ( 1900, 2900 ] 74 0.027% 100.130% ( 2900, 4400 ] 93 0.034% 100.163% ( 4400, 6600 ] 23 0.008% 100.172% ( 6600, 9900 ] 1 0.000% 100.172% ** Level 3 read latency histogram (micros): Count: 466608 Average: 15.6029 StdDev: 193.98 Min: 0 Median: 1.9822 Max: 17814 Percentiles: P50: 1.98 P75: 2.99 P99: 14.00 P99.9: 1816.84 P99.99: 2951.71 ------------------------------------------------------ [ 0, 1 ] 10020 2.147% 2.147% ( 1, 2 ] 227321 48.718% 50.865% ########## ( 2, 3 ] 114276 24.491% 75.356% ##### ( 3, 4 ] 49607 10.631% 85.987% ## ( 4, 6 ] 50497 10.822% 96.810% ## ( 6, 10 ] 8506 1.823% 98.632% ( 10, 15 ] 2145 0.460% 99.092% ( 15, 22 ] 213 0.046% 99.138% ( 22, 34 ] 16 0.003% 99.141% ( 34, 51 ] 7 0.002% 99.143% ( 51, 76 ] 1 0.000% 99.143% ( 76, 110 ] 41 0.009% 99.152% ( 110, 170 ] 224 0.048% 99.200% ( 170, 250 ] 301 0.065% 99.264% ( 250, 380 ] 437 0.094% 99.358% ( 380, 580 ] 680 0.146% 99.504% ( 580, 870 ] 845 0.181% 99.685% ( 870, 1300 ] 665 0.143% 99.827% ( 1300, 1900 ] 394 0.084% 99.912% ( 1900, 2900 ] 350 0.075% 99.987% ( 2900, 4400 ] 445 0.095% 100.082% ( 4400, 6600 ] 118 0.025% 100.107% ( 6600, 9900 ] 23 0.005% 100.112% ( 9900, 14000 ] 14 0.003% 100.115% ( 14000, 22000 ] 5 0.001% 100.116% ** Level 4 read latency histogram (micros): Count: 83852 Average: 8.3065 StdDev: 126.09 Min: 1 Median: 1.9562 Max: 10921 Percentiles: P50: 1.96 P75: 2.90 P99: 9.96 P99.9: 1150.11 P99.99: 3412.42 ------------------------------------------------------ [ 0, 1 ] 986 1.176% 1.176% ( 1, 2 ] 42814 51.059% 52.235% ########## ( 2, 3 ] 21301 25.403% 77.638% ##### ( 3, 4 ] 7683 9.163% 86.801% ## ( 4, 6 ] 8756 10.442% 97.243% ## ( 6, 10 ] 1489 1.776% 99.019% ( 10, 15 ] 351 0.419% 99.437% ( 15, 22 ] 42 0.050% 99.487% ( 22, 34 ] 8 0.010% 99.497% ( 34, 51 ] 9 0.011% 99.507% ( 51, 76 ] 4 0.005% 99.512% ( 76, 110 ] 17 0.020% 99.533% ( 110, 170 ] 48 0.057% 99.590% ( 170, 250 ] 80 0.095% 99.685% ( 250, 380 ] 44 0.052% 99.738% ( 380, 580 ] 59 0.070% 99.808% ( 580, 870 ] 55 0.066% 99.874% ( 870, 1300 ] 34 0.041% 99.914% ( 1300, 1900 ] 27 0.032% 99.946% ( 1900, 2900 ] 25 0.030% 99.976% ( 2900, 4400 ] 34 0.041% 100.017% ( 4400, 6600 ] 9 0.011% 100.027% ( 6600, 9900 ] 4 0.005% 100.032% ( 9900, 14000 ] 1 0.001% 100.033% ** Level 5 read latency histogram (micros): Count: 320 Average: 1772.4688 StdDev: 1782.59 Min: 76 Median: 1069.6429 Max: 8066 Percentiles: P50: 1069.64 P75: 2761.11 P99: 8066.00 P99.9: 8066.00 P99.99: 8066.00 ------------------------------------------------------ ( 51, 76 ] 1 0.312% 0.312% ( 76, 110 ] 16 5.000% 5.312% # ( 110, 170 ] 17 5.312% 10.625% # ( 170, 250 ] 10 3.125% 13.750% # ( 250, 380 ] 32 10.000% 23.750% ## ( 380, 580 ] 36 11.250% 35.000% ## ( 580, 870 ] 35 10.938% 45.938% ## ( 870, 1300 ] 28 8.750% 54.688% ## ( 1300, 1900 ] 34 10.625% 65.312% ## ( 1900, 2900 ] 36 11.250% 76.562% ## ( 2900, 4400 ] 42 13.125% 89.688% ### ( 4400, 6600 ] 26 8.125% 97.812% ## ( 6600, 9900 ] 7 2.188% 100.000% ** DB Stats ** Uptime(secs): 57.6 total, 3.5 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 187.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.816 H:M:S, 48.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 277.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.908 H:M:S, 25.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.440 micros/op 183828 ops/sec 60.110 seconds 11049999 operations; 178.1 MB/s Microseconds per write: Count: 11049999 Average: 5.4398 StdDev: 455.96 Min: 0 Median: 1.7217 Max: 744721 Percentiles: P50: 1.72 P75: 2.65 P99: 8.89 P99.9: 1090.21 P99.99: 2691.99 ------------------------------------------------------ [ 0, 1 ] 1568433 14.194% 14.194% ### ( 1, 2 ] 5481982 49.611% 63.805% ########## ( 2, 3 ] 1902129 17.214% 81.019% ### ( 3, 4 ] 1419729 12.848% 93.867% ### ( 4, 6 ] 481117 4.354% 98.221% # ( 6, 10 ] 119329 1.080% 99.301% ( 10, 15 ] 37297 0.338% 99.638% ( 15, 22 ] 9437 0.085% 99.724% ( 22, 34 ] 1622 0.015% 99.738% ( 34, 51 ] 218 0.002% 99.740% ( 51, 76 ] 24 0.000% 99.740% ( 76, 110 ] 8362 0.076% 99.816% ( 110, 170 ] 2389 0.022% 99.838% ( 170, 250 ] 307 0.003% 99.841% ( 250, 380 ] 156 0.001% 99.842% ( 380, 580 ] 29 0.000% 99.842% ( 580, 870 ] 29 0.000% 99.842% ( 870, 1300 ] 12419 0.112% 99.955% ( 1300, 1900 ] 29 0.000% 99.955% ( 1900, 2900 ] 4870 0.044% 99.999% ( 2900, 4400 ] 52 0.000% 100.000% ( 4400, 6600 ] 3 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 19 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 186092 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11049999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11403598968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 541 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30224536 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27710841600 rocksdb.compact.write.bytes COUNT : 27523127448 rocksdb.flush.write.bytes COUNT : 11361783577 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 71 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 306 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11270282240 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4465664 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27821020678 rocksdb.non.last.level.read.count COUNT : 6714452 rocksdb.block.checksum.compute.count COUNT : 6713441 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.356037 P95 : 3.799745 P99 : 7.239226 P100 : 744718.000000 COUNT : 11049999 SUM : 54946098 rocksdb.compaction.times.micros P50 : 1050731.707317 P95 : 1887272.727273 P99 : 22400209.000000 P100 : 22400209.000000 COUNT : 88 SUM : 128358801 rocksdb.compaction.times.cpu_micros P50 : 885500.000000 P95 : 1806666.666667 P99 : 14960000.000000 P100 : 19940482.000000 COUNT : 88 SUM : 103525715 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 705.449438 P95 : 2675.000000 P99 : 10945.500000 P100 : 13246.000000 COUNT : 149 SUM : 151318 rocksdb.compaction.outfile.sync.micros P50 : 1085.000000 P95 : 23038.888889 P99 : 64750.000000 P100 : 111335.000000 COUNT : 323 SUM : 1595606 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 111.578947 P95 : 2033.333333 P99 : 4220.000000 P100 : 9267.000000 COUNT : 284 SUM : 119582 rocksdb.table.open.io.micros P50 : 1706.097561 P95 : 12686.136364 P99 : 20484.444444 P100 : 23914.000000 COUNT : 541 SUM : 1662328 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.641891 P95 : 7.922423 P99 : 12.172895 P100 : 15976.000000 COUNT : 6711845 SUM : 46910934 rocksdb.read.block.get.micros P50 : 564.615385 P95 : 4945.000000 P99 : 9184.153846 P100 : 17828.000000 COUNT : 1082 SUM : 1319692 rocksdb.write.raw.block.micros P50 : 0.512859 P95 : 0.974433 P99 : 2.690006 P100 : 24893.000000 COUNT : 9417722 SUM : 20599329 rocksdb.numfiles.in.singlecompaction P50 : 3.152941 P95 : 3.978824 P99 : 24.640000 P100 : 27.000000 COUNT : 156 SUM : 554 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.568757 P95 : 1220.604202 P99 : 2610.706320 P100 : 744539.000000 COUNT : 143576 SUM : 30239885 rocksdb.sst.read.micros P50 : 1.592991 P95 : 4.728791 P99 : 8.858931 P100 : 17814.000000 COUNT : 6714609 SUM : 33624466 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11049999 SUM : 11403598968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 207108.433735 P95 : 377456.521739 P99 : 788950.000000 P100 : 910221.000000 COUNT : 149 SUM : 33201192 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 325 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0