[2024-11-20 17:38:24.319904] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 22.11.4 initialization... [2024-11-20 17:38:24.320203] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3161411 ] Set seed to 1732120704313032 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 17:38:24.448543] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 17:38:24.480159] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 17:38:24.480206] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3161411' to capture a snapshot of events at runtime. [2024-11-20 17:38:24.480218] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 17:38:24.480229] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 17:38:24.480237] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3161411 for offline analysis/debug. [2024-11-20 17:38:24.480332] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 17:38:25 2024 CPU: 144 * Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz CPUCache: 55296 KB 2024/11/20-17:38:28 ... thread 0: (1000000,1000000) ops and (352056.5,352056.5) ops/second in (2.840453,2.840453) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 630.02 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 394.1 2.24 2.07 14 0.160 0 0 0.0 0.0 L1 2/2 125.95 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.1 1.0 270.3 270.2 0.47 0.46 1 0.466 127K 45 0.0 0.0 L2 2/1 125.96 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 268.2 268.2 0.47 0.46 1 0.470 127K 36 0.0 0.0 L3 13/0 993.18 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 124/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1132/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/11 97.00 GB 0.0 0.2 0.2 0.1 1.1 1.0 0.3 1.3 79.4 357.2 3.17 2.99 16 0.198 255K 81 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.2 0.1 1.1 1.0 0.2 1.3 79.4 357.2 3.17 2.99 16 0.198 255K 81 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.2 0.1 0.2 0.2 0.0 0.0 269.3 269.2 0.94 0.92 2 0.468 255K 81 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 394.1 2.24 2.07 14 0.160 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.8 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 368.93 MB/s write, 0.25 GB read, 81.99 MB/s read, 3.2 seconds Interval compaction: 1.11 GB write, 398.89 MB/s write, 0.25 GB read, 88.65 MB/s read, 3.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 138702 Average: 1.8898 StdDev: 4.73 Min: 0 Median: 1.3185 Max: 1263 Percentiles: P50: 1.32 P75: 1.73 P99: 4.49 P99.9: 8.98 P99.99: 21.24 ------------------------------------------------------ [ 0, 1 ] 42587 30.704% 30.704% ###### ( 1, 2 ] 84047 60.595% 91.299% ############ ( 2, 3 ] 7674 5.533% 96.832% # ( 3, 4 ] 2691 1.940% 98.772% ( 4, 6 ] 1294 0.933% 99.705% ( 6, 10 ] 366 0.264% 99.969% ( 10, 15 ] 24 0.017% 99.986% ( 15, 22 ] 8 0.006% 99.992% ( 22, 34 ] 5 0.004% 99.996% ( 34, 51 ] 2 0.001% 99.997% ( 76, 110 ] 1 0.001% 99.998% ( 110, 170 ] 11 0.008% 100.006% ( 170, 250 ] 7 0.005% 100.011% ( 250, 380 ] 9 0.006% 100.017% ( 870, 1300 ] 1 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 32002 Average: 2.1202 StdDev: 21.36 Min: 0 Median: 1.3194 Max: 2126 Percentiles: P50: 1.32 P75: 1.72 P99: 3.89 P99.9: 8.46 P99.99: 840.97 ------------------------------------------------------ [ 0, 1 ] 9618 30.054% 30.054% ###### ( 1, 2 ] 19986 62.452% 92.507% ############ ( 2, 3 ] 1598 4.993% 97.500% # ( 3, 4 ] 542 1.694% 99.194% ( 4, 6 ] 202 0.631% 99.825% ( 6, 10 ] 39 0.122% 99.947% ( 10, 15 ] 3 0.009% 99.956% ( 15, 22 ] 1 0.003% 99.959% ( 110, 170 ] 2 0.006% 99.966% ( 250, 380 ] 4 0.012% 99.978% ( 380, 580 ] 2 0.006% 99.984% ( 580, 870 ] 2 0.006% 99.991% ( 1900, 2900 ] 3 0.009% 100.000% ** Level 2 read latency histogram (micros): Count: 24388 Average: 2.5350 StdDev: 27.17 Min: 1 Median: 1.5310 Max: 3412 Percentiles: P50: 1.53 P75: 1.93 P99: 5.95 P99.9: 12.83 P99.99: 1111.32 ------------------------------------------------------ [ 0, 1 ] 4154 17.033% 17.033% ### ( 1, 2 ] 15142 62.088% 79.121% ############ ( 2, 3 ] 2669 10.944% 90.065% ## ( 3, 4 ] 1449 5.941% 96.006% # ( 4, 6 ] 750 3.075% 99.082% # ( 6, 10 ] 190 0.779% 99.861% ( 10, 15 ] 17 0.070% 99.930% ( 15, 22 ] 5 0.021% 99.951% ( 22, 34 ] 3 0.012% 99.963% ( 51, 76 ] 1 0.004% 99.967% ( 76, 110 ] 3 0.012% 99.979% ( 250, 380 ] 2 0.008% 99.988% ( 870, 1300 ] 1 0.004% 99.992% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1358.7273 StdDev: 837.00 Min: 178 Median: 1138.7500 Max: 2843 Percentiles: P50: 1138.75 P75: 2212.50 P99: 2843.00 P99.9: 2843.00 P99.99: 2843.00 ------------------------------------------------------ ( 170, 250 ] 2 3.636% 3.636% # ( 250, 380 ] 5 9.091% 12.727% ## ( 380, 580 ] 4 7.273% 20.000% # ( 580, 870 ] 14 25.455% 45.455% ##### ( 870, 1300 ] 4 7.273% 52.727% # ( 1300, 1900 ] 6 10.909% 63.636% ## ( 1900, 2900 ] 20 36.364% 100.000% ####### ** Level 4 read latency histogram (micros): Count: 15 Average: 1291.1333 StdDev: 781.39 Min: 342 Median: 833.7500 Max: 2614 Percentiles: P50: 833.75 P75: 1962.50 P99: 2614.00 P99.9: 2614.00 P99.99: 2614.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 3 20.000% 26.667% #### ( 580, 870 ] 4 26.667% 53.333% ##### ( 1300, 1900 ] 3 20.000% 73.333% #### ( 1900, 2900 ] 4 26.667% 100.000% ##### ** DB Stats ** Uptime(secs): 3.1 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 320.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 346.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-17:38:31 ... thread 0: (1000000,2000000) ops and (332802.3,342158.7) ops/second in (3.004787,5.845240) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 1.41 GB 18.9 0.6 0.0 0.6 2.4 1.8 0.0 1.3 87.1 377.2 6.51 6.06 31 0.210 575K 637 0.0 0.0 L1 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.1 1.4 263.9 263.7 1.67 1.64 2 0.835 447K 418 0.0 0.0 L2 1/0 53.85 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.4 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 15/0 949.49 MB 0.9 0.8 0.1 0.7 0.8 0.1 0.4 6.2 305.1 303.9 2.65 2.51 2 1.323 820K 3130 0.0 0.0 L4 181/0 9.71 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 160.3 160.3 0.70 0.58 1 0.701 114K 0 0.0 0.0 L5 1136/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1348/12 97.98 GB 0.0 2.0 0.6 1.4 3.9 2.4 1.5 2.1 170.9 327.6 12.04 11.28 38 0.317 2089K 4225 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.6 1.4 3.9 2.4 1.4 2.1 170.9 327.6 12.04 11.28 38 0.317 2089K 4225 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.6 1.4 2.0 0.6 0.0 0.0 277.4 276.8 7.42 7.05 9 0.824 2089K 4225 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 409.0 4.62 4.23 29 0.159 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.85 GB write, 648.85 MB/s write, 2.01 GB read, 338.59 MB/s read, 12.0 seconds Interval compaction: 3.85 GB write, 674.46 MB/s write, 2.01 GB read, 351.96 MB/s read, 12.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 398528 Average: 1.8945 StdDev: 4.89 Min: 0 Median: 1.3078 Max: 1457 Percentiles: P50: 1.31 P75: 1.75 P99: 4.51 P99.9: 8.37 P99.99: 9.81 ------------------------------------------------------ [ 0, 1 ] 129931 32.603% 32.603% ####### ( 1, 2 ] 225282 56.529% 89.131% ########### ( 2, 3 ] 27480 6.895% 96.027% # ( 3, 4 ] 10836 2.719% 98.746% # ( 4, 6 ] 4013 1.007% 99.753% ( 6, 10 ] 993 0.249% 100.002% ( 10, 15 ] 93 0.023% 100.025% ( 15, 22 ] 17 0.004% 100.029% ( 22, 34 ] 10 0.003% 100.032% ( 34, 51 ] 7 0.002% 100.034% ( 51, 76 ] 1 0.000% 100.034% ( 76, 110 ] 2 0.001% 100.034% ( 110, 170 ] 25 0.006% 100.041% ( 170, 250 ] 13 0.003% 100.044% ( 250, 380 ] 16 0.004% 100.048% ( 380, 580 ] 3 0.001% 100.049% ( 580, 870 ] 1 0.000% 100.049% ( 870, 1300 ] 3 0.001% 100.050% ( 1300, 1900 ] 1 0.000% 100.050% ** Level 1 read latency histogram (micros): Count: 45078 Average: 2.1466 StdDev: 18.98 Min: 0 Median: 1.2186 Max: 2126 Percentiles: P50: 1.22 P75: 1.68 P99: 4.44 P99.9: 105.93 P99.99: 724.25 ------------------------------------------------------ [ 0, 1 ] 17252 38.271% 38.271% ######## ( 1, 2 ] 24187 53.656% 91.927% ########### ( 2, 3 ] 2302 5.107% 97.034% # ( 3, 4 ] 808 1.792% 98.826% ( 4, 6 ] 353 0.783% 99.610% ( 6, 10 ] 80 0.177% 99.787% ( 10, 15 ] 15 0.033% 99.820% ( 15, 22 ] 3 0.007% 99.827% ( 22, 34 ] 4 0.009% 99.836% ( 34, 51 ] 13 0.029% 99.865% ( 51, 76 ] 8 0.018% 99.882% ( 76, 110 ] 9 0.020% 99.902% ( 110, 170 ] 11 0.024% 99.927% ( 170, 250 ] 18 0.040% 99.967% ( 250, 380 ] 7 0.016% 99.982% ( 380, 580 ] 2 0.004% 99.987% ( 580, 870 ] 3 0.007% 99.993% ( 1900, 2900 ] 3 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 172604 Average: 2.4937 StdDev: 29.56 Min: 0 Median: 1.0459 Max: 2843 Percentiles: P50: 1.05 P75: 1.68 P99: 5.67 P99.9: 166.33 P99.99: 1986.98 ------------------------------------------------------ [ 0, 1 ] 83200 48.203% 48.203% ########## ( 1, 2 ] 67647 39.192% 87.395% ######## ( 2, 3 ] 11422 6.617% 94.012% # ( 3, 4 ] 6152 3.564% 97.577% # ( 4, 6 ] 2950 1.709% 99.286% ( 6, 10 ] 524 0.304% 99.589% ( 10, 15 ] 72 0.042% 99.631% ( 15, 22 ] 74 0.043% 99.674% ( 22, 34 ] 38 0.022% 99.696% ( 34, 51 ] 170 0.098% 99.794% ( 51, 76 ] 37 0.021% 99.816% ( 76, 110 ] 90 0.052% 99.868% ( 110, 170 ] 59 0.034% 99.902% ( 170, 250 ] 77 0.045% 99.947% ( 250, 380 ] 35 0.020% 99.967% ( 380, 580 ] 10 0.006% 99.973% ( 580, 870 ] 18 0.010% 99.983% ( 870, 1300 ] 4 0.002% 99.986% ( 1300, 1900 ] 6 0.003% 99.989% ( 1900, 2900 ] 20 0.012% 100.001% ** Level 4 read latency histogram (micros): Count: 300 Average: 66.5300 StdDev: 330.85 Min: 0 Median: 1.1481 Max: 2614 Percentiles: P50: 1.15 P75: 2.26 P99: 2150.00 P99.9: 2614.00 P99.99: 2614.00 ------------------------------------------------------ [ 0, 1 ] 138 46.000% 46.000% ######### ( 1, 2 ] 81 27.000% 73.000% ##### ( 2, 3 ] 23 7.667% 80.667% ## ( 3, 4 ] 16 5.333% 86.000% # ( 4, 6 ] 21 7.000% 93.000% # ( 6, 10 ] 6 2.000% 95.000% ( 250, 380 ] 1 0.333% 95.333% ( 380, 580 ] 3 1.000% 96.333% ( 580, 870 ] 4 1.333% 97.667% ( 1300, 1900 ] 3 1.000% 98.667% ( 1900, 2900 ] 4 1.333% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 269.3500 StdDev: 202.52 Min: 102 Median: 186.0000 Max: 798 Percentiles: P50: 186.00 P75: 315.00 P99: 798.00 P99.9: 798.00 P99.99: 798.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 6 30.000% 45.000% ###### ( 170, 250 ] 5 25.000% 70.000% ##### ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 1 5.000% 85.000% # ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.248 H:M:S, 4.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.248 H:M:S, 8.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-17:38:34 ... thread 0: (1000000,3000000) ops and (419221.8,364492.9) ops/second in (2.385372,8.230612) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 1.5 0.0 1.5 4.3 2.8 0.0 1.6 135.0 377.8 11.67 10.96 50 0.233 1599K 1653 0.0 0.0 L1 10/0 1002.97 MB 100.3 1.4 1.3 0.1 1.4 1.3 0.1 1.1 270.1 269.2 5.36 5.26 3 1.787 1470K 4600 0.0 0.0 L2 1/0 53.85 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.4 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 15/0 949.49 MB 0.9 0.8 0.1 0.7 0.8 0.1 0.4 6.2 305.1 303.9 2.65 2.51 2 1.323 820K 3130 0.0 0.0 L4 181/0 9.71 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 160.3 160.3 0.70 0.58 1 0.701 114K 0 0.0 0.0 L5 1136/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1353/4 98.90 GB 0.0 4.0 1.6 2.4 6.7 4.4 1.5 2.4 195.0 330.3 20.89 19.80 58 0.360 4136K 9423 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 1.6 2.4 6.7 4.4 1.4 2.4 195.0 330.3 20.89 19.80 58 0.360 4136K 9423 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 1.6 2.4 4.0 1.6 0.0 0.0 284.5 283.8 14.32 13.82 14 1.023 4136K 9423 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 431.7 6.57 5.98 44 0.149 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.5 total, 8.2 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.74 GB write, 815.11 MB/s write, 3.98 GB read, 481.29 MB/s read, 20.9 seconds Interval compaction: 6.74 GB write, 837.96 MB/s write, 3.98 GB read, 494.78 MB/s read, 20.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 4, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 814126 Average: 1.8764 StdDev: 4.29 Min: 0 Median: 1.2845 Max: 1457 Percentiles: P50: 1.28 P75: 1.74 P99: 4.36 P99.9: 7.32 P99.99: 8.93 ------------------------------------------------------ [ 0, 1 ] 280528 34.458% 34.458% ####### ( 1, 2 ] 444709 54.624% 89.082% ########### ( 2, 3 ] 56200 6.903% 95.985% # ( 3, 4 ] 23076 2.834% 98.819% # ( 4, 6 ] 8200 1.007% 99.826% ( 6, 10 ] 1815 0.223% 100.049% ( 10, 15 ] 168 0.021% 100.070% ( 15, 22 ] 27 0.003% 100.073% ( 22, 34 ] 16 0.002% 100.075% ( 34, 51 ] 11 0.001% 100.077% ( 51, 76 ] 5 0.001% 100.077% ( 76, 110 ] 23 0.003% 100.080% ( 110, 170 ] 67 0.008% 100.088% ( 170, 250 ] 25 0.003% 100.091% ( 250, 380 ] 36 0.004% 100.096% ( 380, 580 ] 7 0.001% 100.097% ( 580, 870 ] 3 0.000% 100.097% ( 870, 1300 ] 3 0.000% 100.097% ( 1300, 1900 ] 1 0.000% 100.098% ** Level 1 read latency histogram (micros): Count: 45128 Average: 2.2769 StdDev: 20.28 Min: 0 Median: 1.2186 Max: 2126 Percentiles: P50: 1.22 P75: 1.68 P99: 4.55 P99.9: 178.32 P99.99: 760.32 ------------------------------------------------------ [ 0, 1 ] 17274 38.278% 38.278% ######## ( 1, 2 ] 24194 53.612% 91.890% ########### ( 2, 3 ] 2302 5.101% 96.991% # ( 3, 4 ] 810 1.795% 98.786% ( 4, 6 ] 353 0.782% 99.568% ( 6, 10 ] 80 0.177% 99.745% ( 10, 15 ] 16 0.035% 99.781% ( 15, 22 ] 3 0.007% 99.787% ( 22, 34 ] 5 0.011% 99.798% ( 34, 51 ] 13 0.029% 99.827% ( 51, 76 ] 8 0.018% 99.845% ( 76, 110 ] 9 0.020% 99.865% ( 110, 170 ] 14 0.031% 99.896% ( 170, 250 ] 18 0.040% 99.936% ( 250, 380 ] 18 0.040% 99.976% ( 380, 580 ] 4 0.009% 99.984% ( 580, 870 ] 4 0.009% 99.993% ( 1900, 2900 ] 3 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 172604 Average: 2.4937 StdDev: 29.56 Min: 0 Median: 1.0459 Max: 2843 Percentiles: P50: 1.05 P75: 1.68 P99: 5.67 P99.9: 166.33 P99.99: 1986.98 ------------------------------------------------------ [ 0, 1 ] 83200 48.203% 48.203% ########## ( 1, 2 ] 67647 39.192% 87.395% ######## ( 2, 3 ] 11422 6.617% 94.012% # ( 3, 4 ] 6152 3.564% 97.577% # ( 4, 6 ] 2950 1.709% 99.286% ( 6, 10 ] 524 0.304% 99.589% ( 10, 15 ] 72 0.042% 99.631% ( 15, 22 ] 74 0.043% 99.674% ( 22, 34 ] 38 0.022% 99.696% ( 34, 51 ] 170 0.098% 99.794% ( 51, 76 ] 37 0.021% 99.816% ( 76, 110 ] 90 0.052% 99.868% ( 110, 170 ] 59 0.034% 99.902% ( 170, 250 ] 77 0.045% 99.947% ( 250, 380 ] 35 0.020% 99.967% ( 380, 580 ] 10 0.006% 99.973% ( 580, 870 ] 18 0.010% 99.983% ( 870, 1300 ] 4 0.002% 99.986% ( 1300, 1900 ] 6 0.003% 99.989% ( 1900, 2900 ] 20 0.012% 100.001% ** Level 4 read latency histogram (micros): Count: 300 Average: 66.5300 StdDev: 330.85 Min: 0 Median: 1.1481 Max: 2614 Percentiles: P50: 1.15 P75: 2.26 P99: 2150.00 P99.9: 2614.00 P99.99: 2614.00 ------------------------------------------------------ [ 0, 1 ] 138 46.000% 46.000% ######### ( 1, 2 ] 81 27.000% 73.000% ##### ( 2, 3 ] 23 7.667% 80.667% ## ( 3, 4 ] 16 5.333% 86.000% # ( 4, 6 ] 21 7.000% 93.000% # ( 6, 10 ] 6 2.000% 95.000% ( 250, 380 ] 1 0.333% 95.333% ( 380, 580 ] 3 1.000% 96.333% ( 580, 870 ] 4 1.333% 97.667% ( 1300, 1900 ] 3 1.000% 98.667% ( 1900, 2900 ] 4 1.333% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 269.3500 StdDev: 202.52 Min: 102 Median: 186.0000 Max: 798 Percentiles: P50: 186.00 P75: 315.00 P99: 798.00 P99.9: 798.00 P99.99: 798.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 6 30.000% 45.000% ###### ( 170, 250 ] 5 25.000% 70.000% ##### ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 1 5.000% 85.000% # ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 8.5 total, 2.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 348.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.392 H:M:S, 4.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 412.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.143 H:M:S, 6.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-17:38:36 ... thread 0: (1000000,4000000) ops and (386722.4,369807.2) ops/second in (2.585834,10.816446) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 2.27 GB 88.1 2.3 0.0 2.3 6.0 3.7 0.0 1.6 146.6 378.0 16.33 15.36 66 0.247 2430K 2538 0.0 0.0 L1 10/10 1002.97 MB 0.0 1.4 1.3 0.1 1.4 1.3 0.1 1.1 270.1 269.2 5.36 5.26 3 1.787 1470K 4600 0.0 0.0 L2 1/0 53.85 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.4 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 15/0 949.49 MB 0.9 0.8 0.1 0.7 0.8 0.1 0.4 6.2 305.1 303.9 2.65 2.51 2 1.323 820K 3130 0.0 0.0 L4 181/0 9.71 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 160.3 160.3 0.70 0.58 1 0.701 114K 0 0.0 0.0 L5 1136/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1357/18 99.82 GB 0.0 4.8 1.6 3.2 8.5 5.3 1.5 2.3 191.5 339.1 25.54 24.20 74 0.345 4967K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 1.6 3.2 8.5 5.3 1.4 2.3 191.5 339.1 25.54 24.20 74 0.345 4967K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 1.6 3.2 4.8 1.6 0.0 0.0 294.2 293.6 16.63 16.06 17 0.978 4967K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 423.9 8.92 8.14 57 0.156 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.0 total, 10.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.46 GB write, 783.91 MB/s write, 4.78 GB read, 442.77 MB/s read, 25.5 seconds Interval compaction: 8.46 GB write, 800.63 MB/s write, 4.78 GB read, 452.22 MB/s read, 25.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 7, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1060144 Average: 1.8485 StdDev: 4.77 Min: 0 Median: 1.2549 Max: 1587 Percentiles: P50: 1.25 P75: 1.72 P99: 4.14 P99.9: 7.16 P99.99: 8.92 ------------------------------------------------------ [ 0, 1 ] 385929 36.403% 36.403% ####### ( 1, 2 ] 565418 53.334% 89.738% ########### ( 2, 3 ] 69848 6.589% 96.326% # ( 3, 4 ] 27688 2.612% 98.938% # ( 4, 6 ] 9574 0.903% 99.841% ( 6, 10 ] 2168 0.205% 100.045% ( 10, 15 ] 210 0.020% 100.065% ( 15, 22 ] 31 0.003% 100.068% ( 22, 34 ] 22 0.002% 100.070% ( 34, 51 ] 15 0.001% 100.072% ( 51, 76 ] 5 0.000% 100.072% ( 76, 110 ] 23 0.002% 100.074% ( 110, 170 ] 81 0.008% 100.082% ( 170, 250 ] 40 0.004% 100.086% ( 250, 380 ] 47 0.004% 100.090% ( 380, 580 ] 9 0.001% 100.091% ( 580, 870 ] 5 0.000% 100.091% ( 870, 1300 ] 4 0.000% 100.092% ( 1300, 1900 ] 3 0.000% 100.092% ** Level 1 read latency histogram (micros): Count: 104489 Average: 2.1856 StdDev: 14.07 Min: 0 Median: 1.3493 Max: 2126 Percentiles: P50: 1.35 P75: 1.75 P99: 4.40 P99.9: 111.18 P99.99: 482.04 ------------------------------------------------------ [ 0, 1 ] 29535 28.266% 28.266% ###### ( 1, 2 ] 65019 62.226% 90.492% ############ ( 2, 3 ] 6278 6.008% 96.500% # ( 3, 4 ] 2445 2.340% 98.840% ( 4, 6 ] 845 0.809% 99.649% ( 6, 10 ] 194 0.186% 99.834% ( 10, 15 ] 21 0.020% 99.855% ( 15, 22 ] 3 0.003% 99.857% ( 22, 34 ] 5 0.005% 99.862% ( 34, 51 ] 13 0.012% 99.875% ( 51, 76 ] 8 0.008% 99.882% ( 76, 110 ] 18 0.017% 99.900% ( 110, 170 ] 26 0.025% 99.924% ( 170, 250 ] 45 0.043% 99.967% ( 250, 380 ] 21 0.020% 99.988% ( 380, 580 ] 5 0.005% 99.992% ( 580, 870 ] 5 0.005% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 172604 Average: 2.4937 StdDev: 29.56 Min: 0 Median: 1.0459 Max: 2843 Percentiles: P50: 1.05 P75: 1.68 P99: 5.67 P99.9: 166.33 P99.99: 1986.98 ------------------------------------------------------ [ 0, 1 ] 83200 48.203% 48.203% ########## ( 1, 2 ] 67647 39.192% 87.395% ######## ( 2, 3 ] 11422 6.617% 94.012% # ( 3, 4 ] 6152 3.564% 97.577% # ( 4, 6 ] 2950 1.709% 99.286% ( 6, 10 ] 524 0.304% 99.589% ( 10, 15 ] 72 0.042% 99.631% ( 15, 22 ] 74 0.043% 99.674% ( 22, 34 ] 38 0.022% 99.696% ( 34, 51 ] 170 0.098% 99.794% ( 51, 76 ] 37 0.021% 99.816% ( 76, 110 ] 90 0.052% 99.868% ( 110, 170 ] 59 0.034% 99.902% ( 170, 250 ] 77 0.045% 99.947% ( 250, 380 ] 35 0.020% 99.967% ( 380, 580 ] 10 0.006% 99.973% ( 580, 870 ] 18 0.010% 99.983% ( 870, 1300 ] 4 0.002% 99.986% ( 1300, 1900 ] 6 0.003% 99.989% ( 1900, 2900 ] 20 0.012% 100.001% ** Level 4 read latency histogram (micros): Count: 300 Average: 66.5300 StdDev: 330.85 Min: 0 Median: 1.1481 Max: 2614 Percentiles: P50: 1.15 P75: 2.26 P99: 2150.00 P99.9: 2614.00 P99.99: 2614.00 ------------------------------------------------------ [ 0, 1 ] 138 46.000% 46.000% ######### ( 1, 2 ] 81 27.000% 73.000% ##### ( 2, 3 ] 23 7.667% 80.667% ## ( 3, 4 ] 16 5.333% 86.000% # ( 4, 6 ] 21 7.000% 93.000% # ( 6, 10 ] 6 2.000% 95.000% ( 250, 380 ] 1 0.333% 95.333% ( 380, 580 ] 3 1.000% 96.333% ( 580, 870 ] 4 1.333% 97.667% ( 1300, 1900 ] 3 1.000% 98.667% ( 1900, 2900 ] 4 1.333% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 269.3500 StdDev: 202.52 Min: 102 Median: 186.0000 Max: 798 Percentiles: P50: 186.00 P75: 315.00 P99: 798.00 P99.9: 798.00 P99.99: 798.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 6 30.000% 45.000% ###### ( 170, 250 ] 5 25.000% 70.000% ##### ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 1 5.000% 85.000% # ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 11.0 total, 2.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 356.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.764 H:M:S, 6.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 380.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.372 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-17:38:39 ... thread 0: (1000000,5000000) ops and (352567.2,366225.6) ops/second in (2.836339,13.652785) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.26 GB 188.8 3.3 0.0 3.3 8.0 4.7 0.0 1.7 160.4 385.9 21.21 19.98 86 0.247 3454K 3476 0.0 0.0 L1 10/10 1002.97 MB 0.0 1.4 1.3 0.1 1.4 1.3 0.1 1.1 270.1 269.2 5.36 5.26 3 1.787 1470K 4600 0.0 0.0 L2 1/0 53.85 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.4 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 15/0 949.49 MB 0.9 0.8 0.1 0.7 0.8 0.1 0.4 6.2 305.1 303.9 2.65 2.51 2 1.323 820K 3130 0.0 0.0 L4 181/0 9.71 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 160.3 160.3 0.70 0.58 1 0.701 114K 0 0.0 0.0 L5 1136/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1361/18 100.80 GB 0.0 5.8 1.6 4.2 10.4 6.3 1.5 2.2 193.9 350.9 30.43 28.82 94 0.324 5991K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 1.6 4.2 10.4 6.3 1.4 2.2 193.9 350.9 30.43 28.82 94 0.324 5991K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 1.6 4.2 5.8 1.6 0.0 0.0 304.1 303.5 19.40 18.79 21 0.924 5991K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 434.1 11.03 10.04 73 0.151 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.9 total, 13.7 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.43 GB write, 768.90 MB/s write, 5.76 GB read, 424.93 MB/s read, 30.4 seconds Interval compaction: 10.43 GB write, 781.90 MB/s write, 5.76 GB read, 432.11 MB/s read, 30.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 7, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1434545 Average: 1.8317 StdDev: 5.53 Min: 0 Median: 1.2018 Max: 1590 Percentiles: P50: 1.20 P75: 1.69 P99: 3.99 P99.9: 7.23 P99.99: 9.27 ------------------------------------------------------ [ 0, 1 ] 570469 39.767% 39.767% ######## ( 1, 2 ] 727589 50.719% 90.486% ########## ( 2, 3 ] 88496 6.169% 96.655% # ( 3, 4 ] 33996 2.370% 99.024% ( 4, 6 ] 11782 0.821% 99.846% ( 6, 10 ] 2530 0.176% 100.022% ( 10, 15 ] 262 0.018% 100.040% ( 15, 22 ] 37 0.003% 100.043% ( 22, 34 ] 24 0.002% 100.045% ( 34, 51 ] 22 0.002% 100.046% ( 51, 76 ] 6 0.000% 100.047% ( 76, 110 ] 109 0.008% 100.054% ( 110, 170 ] 176 0.012% 100.066% ( 170, 250 ] 113 0.008% 100.074% ( 250, 380 ] 87 0.006% 100.080% ( 380, 580 ] 24 0.002% 100.082% ( 580, 870 ] 12 0.001% 100.083% ( 870, 1300 ] 5 0.000% 100.083% ( 1300, 1900 ] 4 0.000% 100.084% ** Level 1 read latency histogram (micros): Count: 186734 Average: 2.1534 StdDev: 12.04 Min: 0 Median: 1.2701 Max: 2126 Percentiles: P50: 1.27 P75: 1.72 P99: 4.90 P99.9: 152.14 P99.99: 377.57 ------------------------------------------------------ [ 0, 1 ] 65343 34.993% 34.993% ####### ( 1, 2 ] 103742 55.556% 90.549% ########### ( 2, 3 ] 10535 5.642% 96.190% # ( 3, 4 ] 4318 2.312% 98.503% ( 4, 6 ] 2053 1.099% 99.602% ( 6, 10 ] 366 0.196% 99.798% ( 10, 15 ] 30 0.016% 99.814% ( 15, 22 ] 4 0.002% 99.816% ( 22, 34 ] 5 0.003% 99.819% ( 34, 51 ] 14 0.007% 99.826% ( 51, 76 ] 9 0.005% 99.831% ( 76, 110 ] 77 0.041% 99.873% ( 110, 170 ] 73 0.039% 99.912% ( 170, 250 ] 111 0.059% 99.971% ( 250, 380 ] 36 0.019% 99.990% ( 380, 580 ] 10 0.005% 99.996% ( 580, 870 ] 5 0.003% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 172604 Average: 2.4937 StdDev: 29.56 Min: 0 Median: 1.0459 Max: 2843 Percentiles: P50: 1.05 P75: 1.68 P99: 5.67 P99.9: 166.33 P99.99: 1986.98 ------------------------------------------------------ [ 0, 1 ] 83200 48.203% 48.203% ########## ( 1, 2 ] 67647 39.192% 87.395% ######## ( 2, 3 ] 11422 6.617% 94.012% # ( 3, 4 ] 6152 3.564% 97.577% # ( 4, 6 ] 2950 1.709% 99.286% ( 6, 10 ] 524 0.304% 99.589% ( 10, 15 ] 72 0.042% 99.631% ( 15, 22 ] 74 0.043% 99.674% ( 22, 34 ] 38 0.022% 99.696% ( 34, 51 ] 170 0.098% 99.794% ( 51, 76 ] 37 0.021% 99.816% ( 76, 110 ] 90 0.052% 99.868% ( 110, 170 ] 59 0.034% 99.902% ( 170, 250 ] 77 0.045% 99.947% ( 250, 380 ] 35 0.020% 99.967% ( 380, 580 ] 10 0.006% 99.973% ( 580, 870 ] 18 0.010% 99.983% ( 870, 1300 ] 4 0.002% 99.986% ( 1300, 1900 ] 6 0.003% 99.989% ( 1900, 2900 ] 20 0.012% 100.001% ** Level 4 read latency histogram (micros): Count: 300 Average: 66.5300 StdDev: 330.85 Min: 0 Median: 1.1481 Max: 2614 Percentiles: P50: 1.15 P75: 2.26 P99: 2150.00 P99.9: 2614.00 P99.99: 2614.00 ------------------------------------------------------ [ 0, 1 ] 138 46.000% 46.000% ######### ( 1, 2 ] 81 27.000% 73.000% ##### ( 2, 3 ] 23 7.667% 80.667% ## ( 3, 4 ] 16 5.333% 86.000% # ( 4, 6 ] 21 7.000% 93.000% # ( 6, 10 ] 6 2.000% 95.000% ( 250, 380 ] 1 0.333% 95.333% ( 380, 580 ] 3 1.000% 96.333% ( 580, 870 ] 4 1.333% 97.667% ( 1300, 1900 ] 3 1.000% 98.667% ( 1900, 2900 ] 4 1.333% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 269.3500 StdDev: 202.52 Min: 102 Median: 186.0000 Max: 798 Percentiles: P50: 186.00 P75: 315.00 P99: 798.00 P99.9: 798.00 P99.99: 798.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 6 30.000% 45.000% ###### ( 170, 250 ] 5 25.000% 70.000% ##### ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 1 5.000% 85.000% # ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 13.9 total, 2.8 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 354.38 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.289 H:M:S, 9.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 346.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.525 H:M:S, 18.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-17:38:44 ... thread 0: (1000000,6000000) ops and (205848.0,324136.2) ops/second in (4.857953,18.510738) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 2.83 GB 107.0 4.1 0.0 4.1 9.7 5.7 0.0 1.7 161.7 387.0 25.71 24.20 105 0.245 4221K 4181 0.0 0.0 L1 4/0 439.26 MB 43.9 3.8 2.7 1.1 3.8 2.7 0.1 1.4 277.9 275.8 14.03 13.63 4 3.508 3959K 28K 0.0 0.0 L2 16/11 1.94 GB 5.7 0.1 0.1 0.1 0.1 0.1 2.4 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 15/2 1003.28 MB 0.7 0.9 0.2 0.7 0.9 0.2 0.4 4.8 285.0 284.0 3.07 2.79 3 1.022 887K 3181 0.0 0.0 L4 181/0 9.71 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 160.3 160.3 0.70 0.58 1 0.701 114K 0 0.0 0.0 L5 1136/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1369/24 101.76 GB 0.0 9.0 3.1 5.9 14.6 8.7 3.5 2.6 208.4 339.3 44.01 41.69 115 0.383 9314K 35K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.0 3.1 5.9 14.6 8.7 3.3 2.6 208.4 339.3 44.01 41.69 115 0.383 9314K 35K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.0 3.1 5.9 8.9 3.0 0.0 0.0 297.8 296.6 30.81 29.72 26 1.185 9314K 35K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 438.9 13.21 11.97 89 0.148 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.7 total, 18.5 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.58 GB write, 796.69 MB/s write, 8.96 GB read, 489.40 MB/s read, 44.0 seconds Interval compaction: 14.58 GB write, 806.62 MB/s write, 8.96 GB read, 495.51 MB/s read, 44.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 7, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2095832 Average: 1.8417 StdDev: 5.86 Min: 0 Median: 1.1668 Max: 1658 Percentiles: P50: 1.17 P75: 1.69 P99: 4.36 P99.9: 7.61 P99.99: 9.70 ------------------------------------------------------ [ 0, 1 ] 880186 41.997% 41.997% ######## ( 1, 2 ] 1005706 47.986% 89.983% ########## ( 2, 3 ] 129675 6.187% 96.170% # ( 3, 4 ] 55548 2.650% 98.821% # ( 4, 6 ] 21166 1.010% 99.831% ( 6, 10 ] 3610 0.172% 100.003% ( 10, 15 ] 361 0.017% 100.020% ( 15, 22 ] 55 0.003% 100.023% ( 22, 34 ] 31 0.001% 100.024% ( 34, 51 ] 28 0.001% 100.025% ( 51, 76 ] 8 0.000% 100.026% ( 76, 110 ] 281 0.013% 100.039% ( 110, 170 ] 324 0.015% 100.055% ( 170, 250 ] 269 0.013% 100.068% ( 250, 380 ] 130 0.006% 100.074% ( 380, 580 ] 38 0.002% 100.076% ( 580, 870 ] 19 0.001% 100.076% ( 870, 1300 ] 9 0.000% 100.077% ( 1300, 1900 ] 5 0.000% 100.077% ** Level 1 read latency histogram (micros): Count: 489814 Average: 2.3709 StdDev: 12.88 Min: 0 Median: 1.2501 Max: 2126 Percentiles: P50: 1.25 P75: 1.77 P99: 5.52 P99.9: 194.35 P99.99: 354.12 ------------------------------------------------------ [ 0, 1 ] 185781 37.929% 37.929% ######## ( 1, 2 ] 236451 48.274% 86.203% ########## ( 2, 3 ] 36738 7.500% 93.703% ## ( 3, 4 ] 18722 3.822% 97.525% # ( 4, 6 ] 9480 1.935% 99.461% ( 6, 10 ] 1415 0.289% 99.749% ( 10, 15 ] 109 0.022% 99.772% ( 15, 22 ] 17 0.003% 99.775% ( 22, 34 ] 10 0.002% 99.777% ( 34, 51 ] 15 0.003% 99.780% ( 51, 76 ] 9 0.002% 99.782% ( 76, 110 ] 218 0.045% 99.827% ( 110, 170 ] 250 0.051% 99.878% ( 170, 250 ] 362 0.074% 99.952% ( 250, 380 ] 236 0.048% 100.000% ( 380, 580 ] 71 0.014% 100.014% ( 580, 870 ] 16 0.003% 100.018% ( 870, 1300 ] 1 0.000% 100.018% ( 1900, 2900 ] 3 0.001% 100.018% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 175791 Average: 3.1264 StdDev: 32.63 Min: 0 Median: 1.0572 Max: 2843 Percentiles: P50: 1.06 P75: 1.69 P99: 5.97 P99.9: 332.57 P99.99: 1971.04 ------------------------------------------------------ [ 0, 1 ] 83946 47.753% 47.753% ########## ( 1, 2 ] 69065 39.288% 87.041% ######## ( 2, 3 ] 11733 6.674% 93.716% # ( 3, 4 ] 6320 3.595% 97.311% # ( 4, 6 ] 3019 1.717% 99.028% ( 6, 10 ] 546 0.311% 99.339% ( 10, 15 ] 74 0.042% 99.381% ( 15, 22 ] 74 0.042% 99.423% ( 22, 34 ] 38 0.022% 99.445% ( 34, 51 ] 170 0.097% 99.542% ( 51, 76 ] 37 0.021% 99.563% ( 76, 110 ] 129 0.073% 99.636% ( 110, 170 ] 162 0.092% 99.728% ( 170, 250 ] 219 0.125% 99.853% ( 250, 380 ] 131 0.075% 99.927% ( 380, 580 ] 64 0.036% 99.964% ( 580, 870 ] 35 0.020% 99.984% ( 870, 1300 ] 4 0.002% 99.986% ( 1300, 1900 ] 6 0.003% 99.989% ( 1900, 2900 ] 20 0.011% 100.001% ** Level 4 read latency histogram (micros): Count: 300 Average: 66.5300 StdDev: 330.85 Min: 0 Median: 1.1481 Max: 2614 Percentiles: P50: 1.15 P75: 2.26 P99: 2150.00 P99.9: 2614.00 P99.99: 2614.00 ------------------------------------------------------ [ 0, 1 ] 138 46.000% 46.000% ######### ( 1, 2 ] 81 27.000% 73.000% ##### ( 2, 3 ] 23 7.667% 80.667% ## ( 3, 4 ] 16 5.333% 86.000% # ( 4, 6 ] 21 7.000% 93.000% # ( 6, 10 ] 6 2.000% 95.000% ( 250, 380 ] 1 0.333% 95.333% ( 380, 580 ] 3 1.000% 96.333% ( 580, 870 ] 4 1.333% 97.667% ( 1300, 1900 ] 3 1.000% 98.667% ( 1900, 2900 ] 4 1.333% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 269.3500 StdDev: 202.52 Min: 102 Median: 186.0000 Max: 798 Percentiles: P50: 186.00 P75: 315.00 P99: 798.00 P99.9: 798.00 P99.99: 798.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 6 30.000% 45.000% ###### ( 170, 250 ] 5 25.000% 70.000% ##### ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 1 5.000% 85.000% # ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 18.7 total, 4.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 315.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.613 H:M:S, 19.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 202.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.324 H:M:S, 47.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-17:38:47 ... thread 0: (1000000,7000000) ops and (292787.1,319252.9) ops/second in (3.415451,21.926189) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 3.74 GB 37.8 6.6 0.0 6.6 13.1 6.6 0.0 2.0 189.0 377.6 35.65 33.49 125 0.285 6843K 15K 0.0 0.0 L1 4/4 439.26 MB 0.0 3.8 2.7 1.1 3.8 2.7 0.1 1.4 277.9 275.8 14.03 13.63 4 3.508 3959K 28K 0.0 0.0 L2 1/0 128.78 MB 1.3 0.1 0.1 0.1 0.1 0.1 2.4 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 44/9 1.70 GB 1.4 3.1 2.0 1.1 3.1 2.0 0.4 1.5 269.7 268.9 11.63 10.72 8 1.454 3173K 9147 0.0 0.0 L4 187/9 9.88 GB 1.0 0.7 0.7 0.0 0.7 0.7 0.8 1.0 170.0 169.9 4.15 2.75 14 0.297 707K 480 0.0 0.0 L5 1148/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1398/33 102.67 GB 0.0 14.3 5.4 8.8 20.8 12.0 4.9 3.2 221.5 322.8 65.99 61.09 153 0.431 14M 53K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.3 5.4 8.8 20.8 12.0 4.8 3.2 221.5 322.8 65.99 61.09 153 0.431 14M 53K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.3 5.4 8.8 14.2 5.4 0.0 0.0 289.7 288.6 50.44 47.20 49 1.029 14M 53K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 433.6 15.55 13.88 104 0.150 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.2 total, 21.9 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.80 GB write, 961.17 MB/s write, 14.27 GB read, 659.44 MB/s read, 66.0 seconds Interval compaction: 20.80 GB write, 971.28 MB/s write, 14.27 GB read, 666.38 MB/s read, 66.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 7, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2523280 Average: 1.9292 StdDev: 11.53 Min: 0 Median: 1.1835 Max: 7371 Percentiles: P50: 1.18 P75: 1.71 P99: 4.74 P99.9: 8.39 P99.99: 12.37 ------------------------------------------------------ [ 0, 1 ] 1042521 41.316% 41.316% ######## ( 1, 2 ] 1193837 47.313% 88.629% ######### ( 2, 3 ] 171548 6.799% 95.428% # ( 3, 4 ] 78421 3.108% 98.536% # ( 4, 6 ] 31470 1.247% 99.783% ( 6, 10 ] 4948 0.196% 99.979% ( 10, 15 ] 596 0.024% 100.002% ( 15, 22 ] 109 0.004% 100.007% ( 22, 34 ] 52 0.002% 100.009% ( 34, 51 ] 32 0.001% 100.010% ( 51, 76 ] 10 0.000% 100.010% ( 76, 110 ] 285 0.011% 100.022% ( 110, 170 ] 479 0.019% 100.041% ( 170, 250 ] 408 0.016% 100.057% ( 250, 380 ] 259 0.010% 100.067% ( 380, 580 ] 93 0.004% 100.071% ( 580, 870 ] 36 0.001% 100.072% ( 870, 1300 ] 13 0.001% 100.073% ( 1300, 1900 ] 11 0.000% 100.073% ( 1900, 2900 ] 2 0.000% 100.073% ( 2900, 4400 ] 5 0.000% 100.074% ( 4400, 6600 ] 2 0.000% 100.074% ( 6600, 9900 ] 1 0.000% 100.074% ** Level 1 read latency histogram (micros): Count: 850705 Average: 2.4510 StdDev: 19.85 Min: 0 Median: 1.2819 Max: 6506 Percentiles: P50: 1.28 P75: 1.80 P99: 5.58 P99.9: 182.27 P99.99: 354.76 ------------------------------------------------------ [ 0, 1 ] 310232 36.468% 36.468% ####### ( 1, 2 ] 408352 48.002% 84.469% ########## ( 2, 3 ] 71181 8.367% 92.837% ## ( 3, 4 ] 37251 4.379% 97.215% # ( 4, 6 ] 19263 2.264% 99.480% ( 6, 10 ] 2641 0.310% 99.790% ( 10, 15 ] 153 0.018% 99.808% ( 15, 22 ] 20 0.002% 99.811% ( 22, 34 ] 13 0.002% 99.812% ( 34, 51 ] 20 0.002% 99.814% ( 51, 76 ] 11 0.001% 99.816% ( 76, 110 ] 266 0.031% 99.847% ( 110, 170 ] 366 0.043% 99.890% ( 170, 250 ] 556 0.065% 99.955% ( 250, 380 ] 366 0.043% 99.998% ( 380, 580 ] 134 0.016% 100.014% ( 580, 870 ] 50 0.006% 100.020% ( 870, 1300 ] 6 0.001% 100.021% ( 1300, 1900 ] 7 0.001% 100.022% ( 1900, 2900 ] 8 0.001% 100.022% ( 2900, 4400 ] 7 0.001% 100.023% ( 4400, 6600 ] 2 0.000% 100.024% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 390190 Average: 4.0151 StdDev: 62.04 Min: 0 Median: 1.2766 Max: 10331 Percentiles: P50: 1.28 P75: 1.88 P99: 5.99 P99.9: 395.16 P99.99: 1766.35 ------------------------------------------------------ [ 0, 1 ] 150452 38.559% 38.559% ######## ( 1, 2 ] 161420 41.370% 79.928% ######## ( 2, 3 ] 38304 9.817% 89.745% ## ( 3, 4 ] 23700 6.074% 95.819% # ( 4, 6 ] 12469 3.196% 99.015% # ( 6, 10 ] 1864 0.478% 99.492% ( 10, 15 ] 195 0.050% 99.542% ( 15, 22 ] 115 0.029% 99.572% ( 22, 34 ] 48 0.012% 99.584% ( 34, 51 ] 174 0.045% 99.629% ( 51, 76 ] 45 0.012% 99.640% ( 76, 110 ] 169 0.043% 99.683% ( 110, 170 ] 269 0.069% 99.752% ( 170, 250 ] 313 0.080% 99.833% ( 250, 380 ] 251 0.064% 99.897% ( 380, 580 ] 169 0.043% 99.940% ( 580, 870 ] 106 0.027% 99.967% ( 870, 1300 ] 61 0.016% 99.983% ( 1300, 1900 ] 36 0.009% 99.992% ( 1900, 2900 ] 50 0.013% 100.005% ( 2900, 4400 ] 37 0.009% 100.015% ( 4400, 6600 ] 10 0.003% 100.017% ( 6600, 9900 ] 1 0.000% 100.017% ( 9900, 14000 ] 1 0.000% 100.018% ** Level 4 read latency histogram (micros): Count: 8395 Average: 114.9906 StdDev: 422.13 Min: 0 Median: 1.5882 Max: 5471 Percentiles: P50: 1.59 P75: 2.84 P99: 2416.94 P99.9: 4355.48 P99.99: 5471.00 ------------------------------------------------------ [ 0, 1 ] 2413 28.743% 28.743% ###### ( 1, 2 ] 3034 36.141% 64.884% ####### ( 2, 3 ] 1008 12.007% 76.891% ## ( 3, 4 ] 430 5.122% 82.013% # ( 4, 6 ] 177 2.108% 84.122% ( 6, 10 ] 38 0.453% 84.574% ( 10, 15 ] 5 0.060% 84.634% ( 76, 110 ] 29 0.345% 84.979% ( 110, 170 ] 112 1.334% 86.313% ( 170, 250 ] 148 1.763% 88.076% ( 250, 380 ] 235 2.799% 90.876% # ( 380, 580 ] 274 3.264% 94.139% # ( 580, 870 ] 230 2.740% 96.879% # ( 870, 1300 ] 91 1.084% 97.963% ( 1300, 1900 ] 55 0.655% 98.618% ( 1900, 2900 ] 62 0.739% 99.357% ( 2900, 4400 ] 47 0.560% 99.917% ( 4400, 6600 ] 9 0.107% 100.024% ** Level 5 read latency histogram (micros): Count: 80 Average: 383.6000 StdDev: 258.30 Min: 102 Median: 305.7143 Max: 1133 Percentiles: P50: 305.71 P75: 580.00 P99: 1133.00 P99.9: 1133.00 P99.99: 1133.00 ------------------------------------------------------ ( 76, 110 ] 4 5.000% 5.000% # ( 110, 170 ] 15 18.750% 23.750% #### ( 170, 250 ] 15 18.750% 42.500% #### ( 250, 380 ] 14 17.500% 60.000% #### ( 380, 580 ] 12 15.000% 75.000% ### ( 580, 870 ] 17 21.250% 96.250% #### ( 870, 1300 ] 3 3.750% 100.000% # ** DB Stats ** Uptime(secs): 22.2 total, 3.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 310.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.197 H:M:S, 18.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.584 H:M:S, 17.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/20-17:38:51 ... thread 0: (1000000,8000000) ops and (260947.9,310578.6) ops/second in (3.832182,25.758371) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 4.78 GB 144.8 7.6 0.0 7.6 15.2 7.6 0.0 2.0 189.2 378.0 41.28 38.52 145 0.285 7930K 16K 0.0 0.0 L1 4/4 439.26 MB 0.0 3.8 2.7 1.1 3.8 2.7 0.1 1.4 277.9 275.8 14.03 13.63 4 3.508 3959K 28K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.4 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 26/0 958.21 MB 1.0 3.3 2.1 1.2 3.3 2.1 0.4 1.5 269.3 268.5 12.45 11.42 9 1.383 3392K 9569 0.0 0.0 L4 192/0 9.53 GB 1.0 1.6 1.6 0.1 1.6 1.5 0.8 1.0 169.7 169.5 9.75 6.12 35 0.279 1598K 899 0.0 0.0 L5 1164/0 88.03 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1404/15 103.71 GB 0.0 16.5 6.4 10.0 24.0 14.0 6.1 3.1 215.9 315.3 78.03 70.18 195 0.400 17M 55K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.5 6.4 10.0 24.0 14.0 6.0 3.1 215.9 315.3 78.03 70.18 195 0.400 17M 55K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.5 6.4 10.0 16.4 6.4 0.0 0.0 281.4 280.5 59.86 54.23 75 0.798 17M 55K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 430.0 18.17 15.96 120 0.151 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.0 total, 25.8 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.03 GB write, 946.55 MB/s write, 16.45 GB read, 648.21 MB/s read, 78.0 seconds Interval compaction: 24.03 GB write, 955.03 MB/s write, 16.45 GB read, 654.02 MB/s read, 78.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 15, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3080326 Average: 1.9323 StdDev: 12.49 Min: 0 Median: 1.1635 Max: 7371 Percentiles: P50: 1.16 P75: 1.70 P99: 4.75 P99.9: 8.38 P99.99: 13.34 ------------------------------------------------------ [ 0, 1 ] 1306077 42.401% 42.401% ######## ( 1, 2 ] 1432101 46.492% 88.892% ######### ( 2, 3 ] 203661 6.612% 95.504% # ( 3, 4 ] 93218 3.026% 98.530% # ( 4, 6 ] 38765 1.258% 99.789% ( 6, 10 ] 5749 0.187% 99.975% ( 10, 15 ] 671 0.022% 99.997% ( 15, 22 ] 124 0.004% 100.001% ( 22, 34 ] 60 0.002% 100.003% ( 34, 51 ] 38 0.001% 100.004% ( 51, 76 ] 12 0.000% 100.005% ( 76, 110 ] 321 0.010% 100.015% ( 110, 170 ] 594 0.019% 100.035% ( 170, 250 ] 507 0.016% 100.051% ( 250, 380 ] 332 0.011% 100.062% ( 380, 580 ] 132 0.004% 100.066% ( 580, 870 ] 57 0.002% 100.068% ( 870, 1300 ] 23 0.001% 100.069% ( 1300, 1900 ] 18 0.001% 100.069% ( 1900, 2900 ] 7 0.000% 100.070% ( 2900, 4400 ] 9 0.000% 100.070% ( 4400, 6600 ] 2 0.000% 100.070% ( 6600, 9900 ] 1 0.000% 100.070% ** Level 1 read latency histogram (micros): Count: 883407 Average: 2.5195 StdDev: 23.70 Min: 0 Median: 1.2782 Max: 6506 Percentiles: P50: 1.28 P75: 1.80 P99: 5.58 P99.9: 187.72 P99.99: 374.04 ------------------------------------------------------ [ 0, 1 ] 324453 36.727% 36.727% ####### ( 1, 2 ] 421479 47.711% 84.438% ########## ( 2, 3 ] 74025 8.379% 92.818% ## ( 3, 4 ] 38799 4.392% 97.210% # ( 4, 6 ] 20072 2.272% 99.482% ( 6, 10 ] 2716 0.307% 99.789% ( 10, 15 ] 159 0.018% 99.807% ( 15, 22 ] 20 0.002% 99.809% ( 22, 34 ] 13 0.001% 99.811% ( 34, 51 ] 20 0.002% 99.813% ( 51, 76 ] 11 0.001% 99.814% ( 76, 110 ] 266 0.030% 99.844% ( 110, 170 ] 367 0.042% 99.886% ( 170, 250 ] 558 0.063% 99.949% ( 250, 380 ] 378 0.043% 99.992% ( 380, 580 ] 146 0.017% 100.008% ( 580, 870 ] 67 0.008% 100.016% ( 870, 1300 ] 15 0.002% 100.018% ( 1300, 1900 ] 14 0.002% 100.019% ( 1900, 2900 ] 14 0.002% 100.021% ( 2900, 4400 ] 12 0.001% 100.022% ( 4400, 6600 ] 3 0.000% 100.023% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 610089 Average: 3.7406 StdDev: 58.53 Min: 0 Median: 1.3297 Max: 10331 Percentiles: P50: 1.33 P75: 1.92 P99: 5.89 P99.9: 317.01 P99.99: 1249.37 ------------------------------------------------------ [ 0, 1 ] 219968 36.055% 36.055% ####### ( 1, 2 ] 258040 42.295% 78.351% ######## ( 2, 3 ] 65169 10.682% 89.032% ## ( 3, 4 ] 40923 6.708% 95.740% # ( 4, 6 ] 21009 3.444% 99.184% # ( 6, 10 ] 2725 0.447% 99.630% ( 10, 15 ] 258 0.042% 99.673% ( 15, 22 ] 126 0.021% 99.693% ( 22, 34 ] 56 0.009% 99.703% ( 34, 51 ] 177 0.029% 99.732% ( 51, 76 ] 50 0.008% 99.740% ( 76, 110 ] 182 0.030% 99.770% ( 110, 170 ] 297 0.049% 99.818% ( 170, 250 ] 352 0.058% 99.876% ( 250, 380 ] 285 0.047% 99.923% ( 380, 580 ] 198 0.032% 99.955% ( 580, 870 ] 138 0.023% 99.978% ( 870, 1300 ] 85 0.014% 99.992% ( 1300, 1900 ] 56 0.009% 100.001% ( 1900, 2900 ] 71 0.012% 100.012% ( 2900, 4400 ] 56 0.009% 100.022% ( 4400, 6600 ] 14 0.002% 100.024% ( 6600, 9900 ] 2 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.024% ** Level 4 read latency histogram (micros): Count: 17751 Average: 103.8931 StdDev: 420.23 Min: 0 Median: 1.5515 Max: 6475 Percentiles: P50: 1.55 P75: 2.67 P99: 2452.56 P99.9: 4624.90 P99.99: 6222.49 ------------------------------------------------------ [ 0, 1 ] 5227 29.446% 29.446% ###### ( 1, 2 ] 6615 37.266% 66.712% ####### ( 2, 3 ] 2212 12.461% 79.173% ## ( 3, 4 ] 939 5.290% 84.463% # ( 4, 6 ] 408 2.298% 86.761% ( 6, 10 ] 77 0.434% 87.195% ( 10, 15 ] 12 0.068% 87.263% ( 15, 22 ] 1 0.006% 87.268% ( 22, 34 ] 2 0.011% 87.280% ( 51, 76 ] 1 0.006% 87.285% ( 76, 110 ] 55 0.310% 87.595% ( 110, 170 ] 190 1.070% 88.665% ( 170, 250 ] 253 1.425% 90.091% ( 250, 380 ] 401 2.259% 92.350% ( 380, 580 ] 435 2.451% 94.800% ( 580, 870 ] 372 2.096% 96.896% ( 870, 1300 ] 184 1.037% 97.933% ( 1300, 1900 ] 116 0.653% 98.586% ( 1900, 2900 ] 133 0.749% 99.335% ( 2900, 4400 ] 98 0.552% 99.887% ( 4400, 6600 ] 22 0.124% 100.011% ** Level 5 read latency histogram (micros): Count: 160 Average: 643.7812 StdDev: 906.09 Min: 100 Median: 380.0000 Max: 8481 Percentiles: P50: 380.00 P75: 760.00 P99: 4175.00 P99.9: 8481.00 P99.99: 8481.00 ------------------------------------------------------ ( 76, 110 ] 6 3.750% 3.750% # ( 110, 170 ] 19 11.875% 15.625% ## ( 170, 250 ] 29 18.125% 33.750% #### ( 250, 380 ] 26 16.250% 50.000% ### ( 380, 580 ] 22 13.750% 63.750% ### ( 580, 870 ] 29 18.125% 81.875% #### ( 870, 1300 ] 14 8.750% 90.625% ## ( 1300, 1900 ] 6 3.750% 94.375% # ( 1900, 2900 ] 4 2.500% 96.875% # ( 2900, 4400 ] 4 2.500% 99.375% # ( 6600, 9900 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 26.0 total, 3.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 302.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.432 H:M:S, 20.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 256.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.235 H:M:S, 32.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-17:39:02 ... thread 0: (1000000,9000000) ops and (96545.4,249195.7) ops/second in (10.357816,36.116187) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 2.27 GB 12.6 9.4 0.0 9.4 17.9 8.5 0.0 2.1 195.7 371.8 49.24 45.78 163 0.302 9784K 22K 0.0 0.0 L1 21/21 2.03 GB 0.0 7.6 6.1 1.5 7.5 6.0 0.1 1.2 287.6 284.2 27.09 26.04 5 5.417 7909K 90K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 4.1 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 23/3 1.18 GB 0.9 4.5 3.0 1.5 4.5 3.0 1.2 1.5 237.5 236.5 19.37 16.30 16 1.211 4659K 18K 0.0 0.0 L4 193/10 9.75 GB 1.0 3.5 3.0 0.5 3.5 3.0 0.8 1.2 165.1 164.4 21.76 13.59 60 0.363 3451K 13K 0.0 0.0 L5 1180/0 89.26 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1425/40 104.48 GB 0.0 25.1 12.2 13.0 33.5 20.5 9.9 3.9 218.3 290.7 117.97 102.21 246 0.480 25M 144K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.1 12.2 13.0 33.5 20.5 9.8 3.9 218.3 290.7 117.97 102.21 246 0.480 25M 144K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.1 12.2 13.0 25.0 12.0 0.0 0.0 264.3 262.8 97.42 84.46 112 0.870 25M 144K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 423.1 20.55 17.75 134 0.153 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.3 total, 36.1 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.49 GB write, 943.51 MB/s write, 25.15 GB read, 708.38 MB/s read, 118.0 seconds Interval compaction: 33.49 GB write, 949.54 MB/s write, 25.15 GB read, 712.91 MB/s read, 118.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 28, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 28, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 64, total-stops: 15, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4187177 Average: 2.0014 StdDev: 19.26 Min: 0 Median: 1.1553 Max: 10215 Percentiles: P50: 1.16 P75: 1.69 P99: 4.84 P99.9: 8.84 P99.99: 95.51 ------------------------------------------------------ [ 0, 1 ] 1791871 42.794% 42.794% ######### ( 1, 2 ] 1943361 46.412% 89.206% ######### ( 2, 3 ] 262309 6.265% 95.471% # ( 3, 4 ] 124647 2.977% 98.448% # ( 4, 6 ] 55259 1.320% 99.768% ( 6, 10 ] 7804 0.186% 99.954% ( 10, 15 ] 833 0.020% 99.974% ( 15, 22 ] 149 0.004% 99.977% ( 22, 34 ] 66 0.002% 99.979% ( 34, 51 ] 49 0.001% 99.980% ( 51, 76 ] 17 0.000% 99.981% ( 76, 110 ] 687 0.016% 99.997% ( 110, 170 ] 995 0.024% 100.021% ( 170, 250 ] 800 0.019% 100.040% ( 250, 380 ] 467 0.011% 100.051% ( 380, 580 ] 218 0.005% 100.056% ( 580, 870 ] 97 0.002% 100.059% ( 870, 1300 ] 47 0.001% 100.060% ( 1300, 1900 ] 31 0.001% 100.060% ( 1900, 2900 ] 28 0.001% 100.061% ( 2900, 4400 ] 33 0.001% 100.062% ( 4400, 6600 ] 6 0.000% 100.062% ( 6600, 9900 ] 7 0.000% 100.062% ( 9900, 14000 ] 1 0.000% 100.062% ** Level 1 read latency histogram (micros): Count: 1244106 Average: 3.1842 StdDev: 52.48 Min: 0 Median: 1.3173 Max: 18594 Percentiles: P50: 1.32 P75: 1.86 P99: 5.86 P99.9: 205.82 P99.99: 511.11 ------------------------------------------------------ [ 0, 1 ] 440604 35.415% 35.415% ####### ( 1, 2 ] 571844 45.964% 81.380% ######### ( 2, 3 ] 113409 9.116% 90.495% ## ( 3, 4 ] 67635 5.436% 95.932% # ( 4, 6 ] 41105 3.304% 99.236% # ( 6, 10 ] 6365 0.512% 99.747% ( 10, 15 ] 446 0.036% 99.783% ( 15, 22 ] 58 0.005% 99.788% ( 22, 34 ] 41 0.003% 99.791% ( 34, 51 ] 53 0.004% 99.795% ( 51, 76 ] 46 0.004% 99.799% ( 76, 110 ] 378 0.030% 99.829% ( 110, 170 ] 556 0.045% 99.874% ( 170, 250 ] 719 0.058% 99.932% ( 250, 380 ] 541 0.043% 99.975% ( 380, 580 ] 277 0.022% 99.998% ( 580, 870 ] 131 0.011% 100.008% ( 870, 1300 ] 41 0.003% 100.011% ( 1300, 1900 ] 47 0.004% 100.015% ( 1900, 2900 ] 70 0.006% 100.021% ( 2900, 4400 ] 107 0.009% 100.029% ( 4400, 6600 ] 24 0.002% 100.031% ( 6600, 9900 ] 3 0.000% 100.032% ( 9900, 14000 ] 1 0.000% 100.032% ( 14000, 22000 ] 1 0.000% 100.032% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1088398 Average: 4.3204 StdDev: 67.09 Min: 0 Median: 1.4922 Max: 10331 Percentiles: P50: 1.49 P75: 2.21 P99: 6.66 P99.9: 367.32 P99.99: 1085.41 ------------------------------------------------------ [ 0, 1 ] 307241 28.229% 28.229% ###### ( 1, 2 ] 481409 44.231% 72.460% ######### ( 2, 3 ] 134095 12.320% 84.780% ## ( 3, 4 ] 93407 8.582% 93.362% ## ( 4, 6 ] 59960 5.509% 98.871% # ( 6, 10 ] 8529 0.784% 99.655% ( 10, 15 ] 473 0.043% 99.698% ( 15, 22 ] 170 0.016% 99.714% ( 22, 34 ] 90 0.008% 99.722% ( 34, 51 ] 211 0.019% 99.742% ( 51, 76 ] 70 0.006% 99.748% ( 76, 110 ] 202 0.019% 99.767% ( 110, 170 ] 393 0.036% 99.803% ( 170, 250 ] 501 0.046% 99.849% ( 250, 380 ] 619 0.057% 99.906% ( 380, 580 ] 508 0.047% 99.952% ( 580, 870 ] 326 0.030% 99.982% ( 870, 1300 ] 170 0.016% 99.998% ( 1300, 1900 ] 102 0.009% 100.007% ( 1900, 2900 ] 120 0.011% 100.018% ( 2900, 4400 ] 162 0.015% 100.033% ( 4400, 6600 ] 34 0.003% 100.036% ( 6600, 9900 ] 6 0.001% 100.037% ( 9900, 14000 ] 1 0.000% 100.037% ** Level 4 read latency histogram (micros): Count: 161723 Average: 30.0804 StdDev: 253.59 Min: 0 Median: 1.6135 Max: 12569 Percentiles: P50: 1.61 P75: 2.58 P99: 737.23 P99.9: 3822.51 P99.99: 5327.31 ------------------------------------------------------ [ 0, 1 ] 36577 22.617% 22.617% ##### ( 1, 2 ] 72182 44.633% 67.250% ######### ( 2, 3 ] 21747 13.447% 80.697% ### ( 3, 4 ] 14775 9.136% 89.833% ## ( 4, 6 ] 9764 6.037% 95.871% # ( 6, 10 ] 1686 1.043% 96.913% ( 10, 15 ] 78 0.048% 96.961% ( 15, 22 ] 4 0.002% 96.964% ( 22, 34 ] 11 0.007% 96.971% ( 34, 51 ] 14 0.009% 96.979% ( 51, 76 ] 10 0.006% 96.986% ( 76, 110 ] 74 0.046% 97.031% ( 110, 170 ] 282 0.174% 97.206% ( 170, 250 ] 540 0.334% 97.540% ( 250, 380 ] 889 0.550% 98.089% ( 380, 580 ] 1045 0.646% 98.735% ( 580, 870 ] 789 0.488% 99.223% ( 870, 1300 ] 417 0.258% 99.481% ( 1300, 1900 ] 250 0.155% 99.636% ( 1900, 2900 ] 252 0.156% 99.792% ( 2900, 4400 ] 285 0.176% 99.968% ( 4400, 6600 ] 85 0.053% 100.020% ( 6600, 9900 ] 14 0.009% 100.029% ( 9900, 14000 ] 4 0.002% 100.032% ** Level 5 read latency histogram (micros): Count: 240 Average: 618.9792 StdDev: 786.41 Min: 95 Median: 396.2162 Max: 8481 Percentiles: P50: 396.22 P75: 763.90 P99: 3875.00 P99.9: 8481.00 P99.99: 8481.00 ------------------------------------------------------ ( 76, 110 ] 8 3.333% 3.333% # ( 110, 170 ] 20 8.333% 11.667% ## ( 170, 250 ] 47 19.583% 31.250% #### ( 250, 380 ] 42 17.500% 48.750% #### ( 380, 580 ] 37 15.417% 64.167% ### ( 580, 870 ] 41 17.083% 81.250% ### ( 870, 1300 ] 24 10.000% 91.250% ## ( 1300, 1900 ] 10 4.167% 95.417% # ( 1900, 2900 ] 6 2.500% 97.917% # ( 2900, 4400 ] 4 1.667% 99.583% ( 6600, 9900 ] 1 0.417% 100.000% ** DB Stats ** Uptime(secs): 36.3 total, 10.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 243.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.285 H:M:S, 33.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 95.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.853 H:M:S, 66.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-17:39:04 ... thread 0: (1000000,10000000) ops and (382794.9,258207.4) ops/second in (2.612365,38.728552) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 3.31 GB 94.4 10.1 0.0 10.1 19.7 9.5 0.0 2.1 193.2 374.3 53.80 50.00 183 0.294 10M 22K 0.0 0.0 L1 21/21 2.03 GB 0.0 7.6 6.1 1.5 7.5 6.0 0.1 1.2 287.6 284.2 27.09 26.04 5 5.417 7909K 90K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 4.1 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 20/0 904.58 MB 0.9 4.5 3.0 1.5 4.5 3.0 1.2 1.5 237.5 236.5 19.37 16.30 16 1.211 4659K 18K 0.0 0.0 L4 190/0 9.73 GB 1.0 4.1 3.3 0.8 4.1 3.3 0.8 1.2 169.8 168.8 24.62 15.69 63 0.391 4047K 22K 0.0 0.0 L5 1184/0 89.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1431/31 105.52 GB 0.0 26.5 12.4 14.0 35.8 21.8 10.2 3.8 216.1 292.7 125.38 108.53 269 0.466 27M 154K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.5 12.4 14.0 35.8 21.8 10.1 3.8 216.1 292.7 125.38 108.53 269 0.466 27M 154K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.5 12.4 14.0 26.3 12.3 0.0 0.0 264.4 262.9 102.46 88.70 118 0.868 27M 154K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 426.1 22.92 19.82 151 0.152 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.0 total, 38.7 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.84 GB write, 941.96 MB/s write, 26.46 GB read, 695.36 MB/s read, 125.4 seconds Interval compaction: 35.84 GB write, 947.57 MB/s write, 26.46 GB read, 699.50 MB/s read, 125.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 28, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 28, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 64, total-stops: 15, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4581085 Average: 1.9913 StdDev: 18.58 Min: 0 Median: 1.1511 Max: 10215 Percentiles: P50: 1.15 P75: 1.69 P99: 4.81 P99.9: 8.79 P99.99: 92.48 ------------------------------------------------------ [ 0, 1 ] 1970345 43.010% 43.010% ######### ( 1, 2 ] 2118885 46.253% 89.263% ######### ( 2, 3 ] 286629 6.257% 95.520% # ( 3, 4 ] 135272 2.953% 98.473% # ( 4, 6 ] 59539 1.300% 99.773% ( 6, 10 ] 8370 0.183% 99.955% ( 10, 15 ] 947 0.021% 99.976% ( 15, 22 ] 165 0.004% 99.980% ( 22, 34 ] 70 0.002% 99.981% ( 34, 51 ] 52 0.001% 99.982% ( 51, 76 ] 19 0.000% 99.983% ( 76, 110 ] 691 0.015% 99.998% ( 110, 170 ] 1028 0.022% 100.020% ( 170, 250 ] 863 0.019% 100.039% ( 250, 380 ] 544 0.012% 100.051% ( 380, 580 ] 248 0.005% 100.056% ( 580, 870 ] 108 0.002% 100.059% ( 870, 1300 ] 50 0.001% 100.060% ( 1300, 1900 ] 33 0.001% 100.061% ( 1900, 2900 ] 28 0.001% 100.061% ( 2900, 4400 ] 33 0.001% 100.062% ( 4400, 6600 ] 6 0.000% 100.062% ( 6600, 9900 ] 7 0.000% 100.062% ( 9900, 14000 ] 1 0.000% 100.062% ** Level 1 read latency histogram (micros): Count: 1316169 Average: 3.1285 StdDev: 51.06 Min: 0 Median: 1.3124 Max: 18594 Percentiles: P50: 1.31 P75: 1.86 P99: 5.85 P99.9: 200.65 P99.99: 499.13 ------------------------------------------------------ [ 0, 1 ] 469029 35.636% 35.636% ####### ( 1, 2 ] 605087 45.973% 81.609% ######### ( 2, 3 ] 118991 9.041% 90.650% ## ( 3, 4 ] 70508 5.357% 96.007% # ( 4, 6 ] 42698 3.244% 99.251% # ( 6, 10 ] 6572 0.499% 99.750% ( 10, 15 ] 455 0.035% 99.785% ( 15, 22 ] 59 0.004% 99.790% ( 22, 34 ] 41 0.003% 99.793% ( 34, 51 ] 54 0.004% 99.797% ( 51, 76 ] 46 0.003% 99.800% ( 76, 110 ] 417 0.032% 99.832% ( 110, 170 ] 607 0.046% 99.878% ( 170, 250 ] 754 0.057% 99.935% ( 250, 380 ] 552 0.042% 99.977% ( 380, 580 ] 281 0.021% 99.999% ( 580, 870 ] 131 0.010% 100.009% ( 870, 1300 ] 41 0.003% 100.012% ( 1300, 1900 ] 47 0.004% 100.015% ( 1900, 2900 ] 70 0.005% 100.021% ( 2900, 4400 ] 107 0.008% 100.029% ( 4400, 6600 ] 24 0.002% 100.031% ( 6600, 9900 ] 3 0.000% 100.031% ( 9900, 14000 ] 1 0.000% 100.031% ( 14000, 22000 ] 1 0.000% 100.031% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1088688 Average: 4.3197 StdDev: 67.08 Min: 0 Median: 1.4921 Max: 10331 Percentiles: P50: 1.49 P75: 2.21 P99: 6.66 P99.9: 367.25 P99.99: 1085.33 ------------------------------------------------------ [ 0, 1 ] 307373 28.233% 28.233% ###### ( 1, 2 ] 481535 44.231% 72.464% ######### ( 2, 3 ] 134114 12.319% 84.783% ## ( 3, 4 ] 93419 8.581% 93.364% ## ( 4, 6 ] 59961 5.508% 98.871% # ( 6, 10 ] 8529 0.783% 99.655% ( 10, 15 ] 473 0.043% 99.698% ( 15, 22 ] 170 0.016% 99.714% ( 22, 34 ] 90 0.008% 99.722% ( 34, 51 ] 211 0.019% 99.742% ( 51, 76 ] 70 0.006% 99.748% ( 76, 110 ] 202 0.019% 99.767% ( 110, 170 ] 393 0.036% 99.803% ( 170, 250 ] 501 0.046% 99.849% ( 250, 380 ] 619 0.057% 99.906% ( 380, 580 ] 508 0.047% 99.952% ( 580, 870 ] 326 0.030% 99.982% ( 870, 1300 ] 170 0.016% 99.998% ( 1300, 1900 ] 102 0.009% 100.007% ( 1900, 2900 ] 120 0.011% 100.018% ( 2900, 4400 ] 162 0.015% 100.033% ( 4400, 6600 ] 34 0.003% 100.036% ( 6600, 9900 ] 6 0.001% 100.037% ( 9900, 14000 ] 1 0.000% 100.037% ** Level 4 read latency histogram (micros): Count: 202807 Average: 24.8599 StdDev: 227.05 Min: 0 Median: 1.5580 Max: 12569 Percentiles: P50: 1.56 P75: 2.37 P99: 591.52 P99.9: 3601.02 P99.99: 5195.09 ------------------------------------------------------ [ 0, 1 ] 49494 24.404% 24.404% ##### ( 1, 2 ] 93032 45.872% 70.277% ######### ( 2, 3 ] 25587 12.616% 82.893% ### ( 3, 4 ] 16823 8.295% 91.188% ## ( 4, 6 ] 10754 5.303% 96.491% # ( 6, 10 ] 1779 0.877% 97.368% ( 10, 15 ] 84 0.041% 97.409% ( 15, 22 ] 5 0.002% 97.412% ( 22, 34 ] 11 0.005% 97.417% ( 34, 51 ] 15 0.007% 97.425% ( 51, 76 ] 10 0.005% 97.430% ( 76, 110 ] 81 0.040% 97.470% ( 110, 170 ] 336 0.166% 97.635% ( 170, 250 ] 638 0.315% 97.950% ( 250, 380 ] 1005 0.496% 98.445% ( 380, 580 ] 1093 0.539% 98.984% ( 580, 870 ] 804 0.396% 99.381% ( 870, 1300 ] 418 0.206% 99.587% ( 1300, 1900 ] 250 0.123% 99.710% ( 1900, 2900 ] 252 0.124% 99.834% ( 2900, 4400 ] 285 0.141% 99.975% ( 4400, 6600 ] 85 0.042% 100.017% ( 6600, 9900 ] 14 0.007% 100.024% ( 9900, 14000 ] 4 0.002% 100.026% ** Level 5 read latency histogram (micros): Count: 260 Average: 605.9385 StdDev: 760.14 Min: 95 Median: 389.5238 Max: 8481 Percentiles: P50: 389.52 P75: 744.77 P99: 3800.00 P99.9: 8481.00 P99.99: 8481.00 ------------------------------------------------------ ( 76, 110 ] 8 3.077% 3.077% # ( 110, 170 ] 20 7.692% 10.769% ## ( 170, 250 ] 50 19.231% 30.000% #### ( 250, 380 ] 50 19.231% 49.231% #### ( 380, 580 ] 42 16.154% 65.385% ### ( 580, 870 ] 44 16.923% 82.308% ### ( 870, 1300 ] 25 9.615% 91.923% ## ( 1300, 1900 ] 10 3.846% 95.769% # ( 1900, 2900 ] 6 2.308% 98.077% ( 2900, 4400 ] 4 1.538% 99.615% ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 39.0 total, 2.6 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 252.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.285 H:M:S, 31.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 376.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-17:39:18 ... thread 0: (1000000,11000000) ops and (70090.4,207563.5) ops/second in (14.267288,52.995840) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 2.08 GB 18.9 12.6 0.0 12.6 23.0 10.4 0.0 2.2 192.7 352.0 67.01 60.76 202 0.332 13M 33K 0.0 0.0 L1 0/0 0.00 KB 0.0 11.8 8.2 3.6 11.6 8.1 0.1 1.4 285.7 282.0 42.23 39.61 6 7.038 10M 90K 0.0 0.0 L2 1/0 128.78 MB 1.3 0.1 0.1 0.1 0.1 0.1 8.2 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 46/8 3.45 GB 2.7 7.7 5.2 2.5 7.6 5.1 3.0 1.5 196.9 195.7 40.03 29.00 32 1.251 7601K 47K 0.0 0.0 L4 206/25 11.08 GB 1.1 6.2 4.7 1.5 6.1 4.6 0.9 1.3 170.6 169.0 37.11 23.61 77 0.482 6232K 59K 0.0 0.0 L5 1184/0 89.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1444/38 106.30 GB 0.0 38.4 18.1 20.3 48.6 28.3 16.2 4.6 210.4 266.1 186.88 153.47 319 0.586 37M 231K 0.0 0.0 Int 0/0 0.00 KB 0.0 38.4 18.1 20.3 48.6 28.3 16.1 4.6 210.4 266.1 186.88 153.47 319 0.586 37M 231K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 38.4 18.1 20.3 38.1 17.8 0.0 0.0 244.7 242.9 160.66 131.72 154 1.043 37M 231K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 408.4 26.23 21.75 165 0.159 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.2 total, 53.0 interval Flush(GB): cumulative 10.459, interval 10.459 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 48.56 GB write, 934.26 MB/s write, 38.40 GB read, 738.67 MB/s read, 186.9 seconds Interval compaction: 48.56 GB write, 938.33 MB/s write, 38.40 GB read, 741.88 MB/s read, 186.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 28, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 28, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 66, pending-compaction-bytes-stops: 0, total-delays: 94, total-stops: 19, interval: 113 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5515188 Average: 2.3368 StdDev: 26.20 Min: 0 Median: 1.1892 Max: 10215 Percentiles: P50: 1.19 P75: 1.72 P99: 5.24 P99.9: 116.45 P99.99: 211.57 ------------------------------------------------------ [ 0, 1 ] 2264559 41.060% 41.060% ######## ( 1, 2 ] 2605371 47.240% 88.300% ######### ( 2, 3 ] 358663 6.503% 94.804% # ( 3, 4 ] 178149 3.230% 98.034% # ( 4, 6 ] 85766 1.555% 99.589% ( 6, 10 ] 12385 0.225% 99.813% ( 10, 15 ] 1368 0.025% 99.838% ( 15, 22 ] 234 0.004% 99.842% ( 22, 34 ] 92 0.002% 99.844% ( 34, 51 ] 65 0.001% 99.845% ( 51, 76 ] 24 0.000% 99.846% ( 76, 110 ] 2588 0.047% 99.893% ( 110, 170 ] 3822 0.069% 99.962% ( 170, 250 ] 2988 0.054% 100.016% ( 250, 380 ] 1197 0.022% 100.038% ( 380, 580 ] 472 0.009% 100.046% ( 580, 870 ] 204 0.004% 100.050% ( 870, 1300 ] 84 0.002% 100.052% ( 1300, 1900 ] 67 0.001% 100.053% ( 1900, 2900 ] 85 0.002% 100.054% ( 2900, 4400 ] 103 0.002% 100.056% ( 4400, 6600 ] 24 0.000% 100.057% ( 6600, 9900 ] 8 0.000% 100.057% ( 9900, 14000 ] 1 0.000% 100.057% ** Level 1 read latency histogram (micros): Count: 2733226 Average: 4.4712 StdDev: 83.09 Min: 0 Median: 1.3477 Max: 18594 Percentiles: P50: 1.35 P75: 1.93 P99: 6.26 P99.9: 306.43 P99.99: 1872.23 ------------------------------------------------------ [ 0, 1 ] 955384 34.954% 34.954% ####### ( 1, 2 ] 1182880 43.278% 78.232% ######### ( 2, 3 ] 270506 9.897% 88.129% ## ( 3, 4 ] 176552 6.459% 94.589% # ( 4, 6 ] 119316 4.365% 98.954% # ( 6, 10 ] 19514 0.714% 99.668% ( 10, 15 ] 1267 0.046% 99.714% ( 15, 22 ] 232 0.008% 99.723% ( 22, 34 ] 118 0.004% 99.727% ( 34, 51 ] 116 0.004% 99.731% ( 51, 76 ] 116 0.004% 99.736% ( 76, 110 ] 1241 0.045% 99.781% ( 110, 170 ] 1136 0.042% 99.823% ( 170, 250 ] 1613 0.059% 99.882% ( 250, 380 ] 1156 0.042% 99.924% ( 380, 580 ] 833 0.030% 99.954% ( 580, 870 ] 496 0.018% 99.973% ( 870, 1300 ] 264 0.010% 99.982% ( 1300, 1900 ] 223 0.008% 99.990% ( 1900, 2900 ] 388 0.014% 100.005% ( 2900, 4400 ] 586 0.021% 100.026% ( 4400, 6600 ] 173 0.006% 100.032% ( 6600, 9900 ] 39 0.001% 100.034% ( 9900, 14000 ] 3 0.000% 100.034% ( 14000, 22000 ] 1 0.000% 100.034% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1402551 Average: 5.1633 StdDev: 82.54 Min: 0 Median: 1.5299 Max: 10331 Percentiles: P50: 1.53 P75: 2.31 P99: 7.09 P99.9: 531.74 P99.99: 2107.76 ------------------------------------------------------ [ 0, 1 ] 368340 26.262% 26.262% ##### ( 1, 2 ] 628272 44.795% 71.057% ######### ( 2, 3 ] 179649 12.809% 83.866% ### ( 3, 4 ] 126295 9.005% 92.870% ## ( 4, 6 ] 82766 5.901% 98.772% # ( 6, 10 ] 11738 0.837% 99.608% ( 10, 15 ] 628 0.045% 99.653% ( 15, 22 ] 192 0.014% 99.667% ( 22, 34 ] 109 0.008% 99.675% ( 34, 51 ] 229 0.016% 99.691% ( 51, 76 ] 87 0.006% 99.697% ( 76, 110 ] 207 0.015% 99.712% ( 110, 170 ] 464 0.033% 99.745% ( 170, 250 ] 658 0.047% 99.792% ( 250, 380 ] 909 0.065% 99.857% ( 380, 580 ] 798 0.057% 99.914% ( 580, 870 ] 534 0.038% 99.952% ( 870, 1300 ] 303 0.022% 99.973% ( 1300, 1900 ] 186 0.013% 99.987% ( 1900, 2900 ] 225 0.016% 100.003% ( 2900, 4400 ] 326 0.023% 100.026% ( 4400, 6600 ] 70 0.005% 100.031% ( 6600, 9900 ] 13 0.001% 100.032% ( 9900, 14000 ] 1 0.000% 100.032% ** Level 4 read latency histogram (micros): Count: 459619 Average: 17.9955 StdDev: 190.10 Min: 0 Median: 1.5736 Max: 12569 Percentiles: P50: 1.57 P75: 2.43 P99: 438.25 P99.9: 3454.17 P99.99: 6197.77 ------------------------------------------------------ [ 0, 1 ] 110617 24.067% 24.067% ##### ( 1, 2 ] 207816 45.215% 69.282% ######### ( 2, 3 ] 60652 13.196% 82.478% ### ( 3, 4 ] 41527 9.035% 91.513% ## ( 4, 6 ] 26748 5.820% 97.333% # ( 6, 10 ] 4109 0.894% 98.227% ( 10, 15 ] 199 0.043% 98.270% ( 15, 22 ] 30 0.007% 98.277% ( 22, 34 ] 35 0.008% 98.284% ( 34, 51 ] 37 0.008% 98.292% ( 51, 76 ] 24 0.005% 98.298% ( 76, 110 ] 85 0.018% 98.316% ( 110, 170 ] 365 0.079% 98.395% ( 170, 250 ] 793 0.173% 98.568% ( 250, 380 ] 1470 0.320% 98.888% ( 380, 580 ] 1778 0.387% 99.275% ( 580, 870 ] 1315 0.286% 99.561% ( 870, 1300 ] 610 0.133% 99.693% ( 1300, 1900 ] 375 0.082% 99.775% ( 1900, 2900 ] 402 0.087% 99.862% ( 2900, 4400 ] 472 0.103% 99.965% ( 4400, 6600 ] 142 0.031% 99.996% ( 6600, 9900 ] 22 0.005% 100.001% ( 9900, 14000 ] 4 0.001% 100.002% ** Level 5 read latency histogram (micros): Count: 260 Average: 605.9385 StdDev: 760.14 Min: 95 Median: 389.5238 Max: 8481 Percentiles: P50: 389.52 P75: 744.77 P99: 3800.00 P99.9: 8481.00 P99.99: 8481.00 ------------------------------------------------------ ( 76, 110 ] 8 3.077% 3.077% # ( 110, 170 ] 20 7.692% 10.769% ## ( 170, 250 ] 50 19.231% 30.000% #### ( 250, 380 ] 50 19.231% 49.231% #### ( 380, 580 ] 42 16.154% 65.385% ### ( 580, 870 ] 44 16.923% 82.308% ### ( 870, 1300 ] 25 9.615% 91.923% ## ( 1300, 1900 ] 10 3.846% 95.769% # ( 1900, 2900 ] 6 2.308% 98.077% ( 2900, 4400 ] 4 1.538% 99.615% ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 53.2 total, 14.3 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 203.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.422 H:M:S, 44.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 68.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.137 H:M:S, 78.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/20-17:39:23 ... thread 0: (1000000,12000000) ops and (228620.2,209168.9) ops/second in (4.374067,57.369907) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 3.06 GB 88.1 13.3 0.0 13.3 24.7 11.4 0.0 2.2 184.7 343.4 73.64 64.81 217 0.339 13M 34K 0.0 0.0 L1 0/0 0.00 KB 0.0 11.8 8.2 3.6 11.6 8.1 0.1 1.4 285.7 282.0 42.23 39.61 6 7.038 10M 90K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 8.2 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 18/0 979.93 MB 1.0 7.7 5.2 2.5 7.6 5.1 3.1 1.5 196.9 195.7 40.03 29.00 32 1.251 7601K 47K 0.0 0.0 L4 167/0 9.58 GB 1.0 11.0 7.2 3.8 10.9 7.0 1.0 1.5 167.2 165.4 67.33 40.63 104 0.647 11M 120K 0.0 0.0 L5 1236/0 93.63 GB 1.0 0.0 0.0 0.0 0.0 0.0 8.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1435/9 107.23 GB 0.0 43.9 20.6 23.3 55.0 31.7 20.5 4.8 200.9 251.6 223.73 174.54 361 0.620 43M 293K 0.0 0.0 Int 0/0 0.00 KB 0.0 43.9 20.6 23.3 55.0 31.7 20.4 4.8 200.9 251.6 223.73 174.54 361 0.620 43M 293K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 43.9 20.6 23.3 43.5 20.3 0.0 0.0 232.5 230.6 193.33 150.75 183 1.056 43M 293K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 11.4 11.4 0.0 0.0 0.0 385.4 30.41 23.79 178 0.171 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.6 total, 57.4 interval Flush(GB): cumulative 11.443, interval 11.443 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 54.98 GB write, 977.34 MB/s write, 43.89 GB read, 780.17 MB/s read, 223.7 seconds Interval compaction: 54.98 GB write, 981.27 MB/s write, 43.89 GB read, 783.31 MB/s read, 223.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 28, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 28, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 69, pending-compaction-bytes-stops: 0, total-delays: 97, total-stops: 38, interval: 135 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5979569 Average: 2.5046 StdDev: 34.76 Min: 0 Median: 1.2003 Max: 15699 Percentiles: P50: 1.20 P75: 1.73 P99: 5.33 P99.9: 118.55 P99.99: 224.60 ------------------------------------------------------ [ 0, 1 ] 2427221 40.592% 40.592% ######## ( 1, 2 ] 2808110 46.962% 87.554% ######### ( 2, 3 ] 407300 6.812% 94.365% # ( 3, 4 ] 209088 3.497% 97.862% # ( 4, 6 ] 102533 1.715% 99.577% ( 6, 10 ] 14186 0.237% 99.814% ( 10, 15 ] 1542 0.026% 99.840% ( 15, 22 ] 246 0.004% 99.844% ( 22, 34 ] 112 0.002% 99.846% ( 34, 51 ] 79 0.001% 99.847% ( 51, 76 ] 32 0.001% 99.847% ( 76, 110 ] 2593 0.043% 99.891% ( 110, 170 ] 3849 0.064% 99.955% ( 170, 250 ] 3049 0.051% 100.006% ( 250, 380 ] 1316 0.022% 100.028% ( 380, 580 ] 618 0.010% 100.039% ( 580, 870 ] 323 0.005% 100.044% ( 870, 1300 ] 142 0.002% 100.046% ( 1300, 1900 ] 134 0.002% 100.049% ( 1900, 2900 ] 188 0.003% 100.052% ( 2900, 4400 ] 206 0.003% 100.055% ( 4400, 6600 ] 47 0.001% 100.056% ( 6600, 9900 ] 9 0.000% 100.056% ( 9900, 14000 ] 1 0.000% 100.056% ( 14000, 22000 ] 2 0.000% 100.056% ** Level 1 read latency histogram (micros): Count: 2993294 Average: 4.8192 StdDev: 90.67 Min: 0 Median: 1.3565 Max: 18594 Percentiles: P50: 1.36 P75: 1.94 P99: 6.20 P99.9: 360.84 P99.99: 2482.74 ------------------------------------------------------ [ 0, 1 ] 1035942 34.609% 34.609% ####### ( 1, 2 ] 1292448 43.178% 77.787% ######### ( 2, 3 ] 303616 10.143% 87.930% ## ( 3, 4 ] 199038 6.649% 94.580% # ( 4, 6 ] 131289 4.386% 98.966% # ( 6, 10 ] 20868 0.697% 99.663% ( 10, 15 ] 1438 0.048% 99.711% ( 15, 22 ] 240 0.008% 99.719% ( 22, 34 ] 128 0.004% 99.723% ( 34, 51 ] 136 0.005% 99.728% ( 51, 76 ] 124 0.004% 99.732% ( 76, 110 ] 1243 0.042% 99.773% ( 110, 170 ] 1138 0.038% 99.811% ( 170, 250 ] 1621 0.054% 99.866% ( 250, 380 ] 1210 0.040% 99.906% ( 380, 580 ] 949 0.032% 99.938% ( 580, 870 ] 611 0.020% 99.958% ( 870, 1300 ] 318 0.011% 99.969% ( 1300, 1900 ] 316 0.011% 99.979% ( 1900, 2900 ] 552 0.018% 99.998% ( 2900, 4400 ] 742 0.025% 100.022% ( 4400, 6600 ] 210 0.007% 100.029% ( 6600, 9900 ] 51 0.002% 100.031% ( 9900, 14000 ] 4 0.000% 100.031% ( 14000, 22000 ] 3 0.000% 100.031% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1744312 Average: 5.7277 StdDev: 97.49 Min: 0 Median: 1.5116 Max: 20330 Percentiles: P50: 1.51 P75: 2.27 P99: 6.87 P99.9: 673.64 P99.99: 2873.52 ------------------------------------------------------ [ 0, 1 ] 477426 27.370% 27.370% ##### ( 1, 2 ] 771520 44.231% 71.601% ######### ( 2, 3 ] 221971 12.725% 84.326% ### ( 3, 4 ] 155022 8.887% 93.214% ## ( 4, 6 ] 98014 5.619% 98.833% # ( 6, 10 ] 13379 0.767% 99.600% ( 10, 15 ] 847 0.049% 99.648% ( 15, 22 ] 209 0.012% 99.660% ( 22, 34 ] 132 0.008% 99.668% ( 34, 51 ] 244 0.014% 99.682% ( 51, 76 ] 99 0.006% 99.688% ( 76, 110 ] 211 0.012% 99.700% ( 110, 170 ] 466 0.027% 99.726% ( 170, 250 ] 681 0.039% 99.765% ( 250, 380 ] 1055 0.060% 99.826% ( 380, 580 ] 1045 0.060% 99.886% ( 580, 870 ] 764 0.044% 99.930% ( 870, 1300 ] 403 0.023% 99.953% ( 1300, 1900 ] 266 0.015% 99.968% ( 1900, 2900 ] 394 0.023% 99.991% ( 2900, 4400 ] 511 0.029% 100.020% ( 4400, 6600 ] 123 0.007% 100.027% ( 6600, 9900 ] 17 0.001% 100.028% ( 9900, 14000 ] 5 0.000% 100.028% ( 14000, 22000 ] 3 0.000% 100.028% ** Level 4 read latency histogram (micros): Count: 1001186 Average: 14.6361 StdDev: 180.25 Min: 0 Median: 1.4907 Max: 26980 Percentiles: P50: 1.49 P75: 2.23 P99: 275.03 P99.9: 2908.04 P99.99: 4476.38 ------------------------------------------------------ [ 0, 1 ] 287344 28.700% 28.700% ###### ( 1, 2 ] 434590 43.408% 72.108% ######### ( 2, 3 ] 127032 12.688% 84.796% ### ( 3, 4 ] 84830 8.473% 93.269% ## ( 4, 6 ] 48529 4.847% 98.116% # ( 6, 10 ] 6313 0.631% 98.747% ( 10, 15 ] 459 0.046% 98.793% ( 15, 22 ] 53 0.005% 98.798% ( 22, 34 ] 60 0.006% 98.804% ( 34, 51 ] 56 0.006% 98.809% ( 51, 76 ] 37 0.004% 98.813% ( 76, 110 ] 97 0.010% 98.823% ( 110, 170 ] 433 0.043% 98.866% ( 170, 250 ] 948 0.095% 98.961% ( 250, 380 ] 2042 0.204% 99.165% ( 380, 580 ] 2744 0.274% 99.439% ( 580, 870 ] 2160 0.216% 99.655% ( 870, 1300 ] 966 0.096% 99.751% ( 1300, 1900 ] 681 0.068% 99.819% ( 1900, 2900 ] 806 0.081% 99.900% ( 2900, 4400 ] 898 0.090% 99.989% ( 4400, 6600 ] 227 0.023% 100.012% ( 6600, 9900 ] 37 0.004% 100.016% ( 9900, 14000 ] 4 0.000% 100.016% ( 14000, 22000 ] 4 0.000% 100.016% ( 22000, 33000 ] 4 0.000% 100.017% ** Level 5 read latency histogram (micros): Count: 520 Average: 803.9404 StdDev: 936.09 Min: 95 Median: 501.3483 Max: 8481 Percentiles: P50: 501.35 P75: 953.43 P99: 5060.00 P99.9: 8184.00 P99.99: 8481.00 ------------------------------------------------------ ( 76, 110 ] 10 1.923% 1.923% ( 110, 170 ] 31 5.962% 7.885% # ( 170, 250 ] 76 14.615% 22.500% ### ( 250, 380 ] 89 17.115% 39.615% ### ( 380, 580 ] 89 17.115% 56.731% ### ( 580, 870 ] 82 15.769% 72.500% ### ( 870, 1300 ] 67 12.885% 85.385% ### ( 1300, 1900 ] 28 5.385% 90.769% # ( 1900, 2900 ] 20 3.846% 94.615% # ( 2900, 4400 ] 21 4.038% 98.654% # ( 4400, 6600 ] 6 1.154% 99.808% ( 6600, 9900 ] 1 0.192% 100.000% ** DB Stats ** Uptime(secs): 57.6 total, 4.4 interval Cumulative writes: 0 writes, 12M keys, 0 commit groups, 0.0 writes per commit group, ingest: 11.53 GB, 205.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.212 H:M:S, 43.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 225.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.791 H:M:S, 40.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-17:39:25 ... thread 0: (1000000,13000000) ops and (445133.3,218060.7) ops/second in (2.246518,59.616425) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 3.99 GB 188.8 14.3 0.0 14.3 26.7 12.3 0.0 2.2 186.5 347.0 78.68 69.55 236 0.333 14M 35K 0.0 0.0 L1 0/0 0.00 KB 0.0 11.8 8.2 3.6 11.6 8.1 0.1 1.4 285.7 282.0 42.23 39.61 6 7.038 10M 90K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 8.2 2.0 255.9 255.9 0.51 0.49 2 0.255 132K 40 0.0 0.0 L3 18/0 979.93 MB 1.0 7.7 5.2 2.5 7.6 5.1 3.1 1.5 196.9 195.7 40.03 29.00 32 1.251 7601K 47K 0.0 0.0 L4 167/0 9.58 GB 1.0 11.0 7.2 3.8 10.9 7.0 1.0 1.5 167.2 165.4 67.33 40.63 104 0.647 11M 120K 0.0 0.0 L5 1236/0 93.63 GB 1.0 0.0 0.0 0.0 0.0 0.0 8.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1438/9 108.15 GB 0.0 44.9 20.6 24.3 56.9 32.6 20.5 4.6 201.1 254.9 228.77 179.28 380 0.602 44M 294K 0.0 0.0 Int 0/0 0.00 KB 0.0 44.9 20.6 24.3 56.9 32.6 20.4 4.6 201.1 254.9 228.77 179.28 380 0.602 44M 294K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 44.9 20.6 24.3 44.6 20.3 0.0 0.0 234.3 232.4 196.38 153.75 187 1.050 44M 294K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 12.4 12.4 0.0 0.0 0.0 391.0 32.39 25.53 193 0.168 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.8 total, 59.6 interval Flush(GB): cumulative 12.366, interval 12.366 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 56.95 GB write, 974.32 MB/s write, 44.93 GB read, 768.78 MB/s read, 228.8 seconds Interval compaction: 56.95 GB write, 978.09 MB/s write, 44.93 GB read, 771.76 MB/s read, 228.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 28, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 28, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 69, pending-compaction-bytes-stops: 0, total-delays: 97, total-stops: 38, interval: 135 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 6413102 Average: 2.4514 StdDev: 33.59 Min: 0 Median: 1.1907 Max: 15699 Percentiles: P50: 1.19 P75: 1.73 P99: 5.28 P99.9: 107.64 P99.99: 214.56 ------------------------------------------------------ [ 0, 1 ] 2635444 41.095% 41.095% ######## ( 1, 2 ] 2994119 46.688% 87.782% ######### ( 2, 3 ] 432454 6.743% 94.526% # ( 3, 4 ] 218755 3.411% 97.937% # ( 4, 6 ] 106748 1.665% 99.601% ( 6, 10 ] 14638 0.228% 99.829% ( 10, 15 ] 1621 0.025% 99.855% ( 15, 22 ] 257 0.004% 99.859% ( 22, 34 ] 115 0.002% 99.860% ( 34, 51 ] 87 0.001% 99.862% ( 51, 76 ] 33 0.001% 99.862% ( 76, 110 ] 2600 0.041% 99.903% ( 110, 170 ] 3881 0.061% 99.963% ( 170, 250 ] 3071 0.048% 100.011% ( 250, 380 ] 1338 0.021% 100.032% ( 380, 580 ] 624 0.010% 100.042% ( 580, 870 ] 327 0.005% 100.047% ( 870, 1300 ] 142 0.002% 100.049% ( 1300, 1900 ] 136 0.002% 100.051% ( 1900, 2900 ] 188 0.003% 100.054% ( 2900, 4400 ] 206 0.003% 100.057% ( 4400, 6600 ] 47 0.001% 100.058% ( 6600, 9900 ] 9 0.000% 100.058% ( 9900, 14000 ] 1 0.000% 100.058% ( 14000, 22000 ] 2 0.000% 100.058% ** Level 1 read latency histogram (micros): Count: 2993294 Average: 4.8192 StdDev: 90.67 Min: 0 Median: 1.3565 Max: 18594 Percentiles: P50: 1.36 P75: 1.94 P99: 6.20 P99.9: 360.84 P99.99: 2482.74 ------------------------------------------------------ [ 0, 1 ] 1035942 34.609% 34.609% ####### ( 1, 2 ] 1292448 43.178% 77.787% ######### ( 2, 3 ] 303616 10.143% 87.930% ## ( 3, 4 ] 199038 6.649% 94.580% # ( 4, 6 ] 131289 4.386% 98.966% # ( 6, 10 ] 20868 0.697% 99.663% ( 10, 15 ] 1438 0.048% 99.711% ( 15, 22 ] 240 0.008% 99.719% ( 22, 34 ] 128 0.004% 99.723% ( 34, 51 ] 136 0.005% 99.728% ( 51, 76 ] 124 0.004% 99.732% ( 76, 110 ] 1243 0.042% 99.773% ( 110, 170 ] 1138 0.038% 99.811% ( 170, 250 ] 1621 0.054% 99.866% ( 250, 380 ] 1210 0.040% 99.906% ( 380, 580 ] 949 0.032% 99.938% ( 580, 870 ] 611 0.020% 99.958% ( 870, 1300 ] 318 0.011% 99.969% ( 1300, 1900 ] 316 0.011% 99.979% ( 1900, 2900 ] 552 0.018% 99.998% ( 2900, 4400 ] 742 0.025% 100.022% ( 4400, 6600 ] 210 0.007% 100.029% ( 6600, 9900 ] 51 0.002% 100.031% ( 9900, 14000 ] 4 0.000% 100.031% ( 14000, 22000 ] 3 0.000% 100.031% ** Level 2 read latency histogram (micros): Count: 49116 Average: 2.2672 StdDev: 20.02 Min: 0 Median: 1.3235 Max: 3412 Percentiles: P50: 1.32 P75: 1.80 P99: 5.71 P99.9: 75.71 P99.99: 388.84 ------------------------------------------------------ [ 0, 1 ] 16275 33.136% 33.136% ####### ( 1, 2 ] 25604 52.130% 85.265% ########## ( 2, 3 ] 3915 7.971% 93.236% ## ( 3, 4 ] 1981 4.033% 97.270% # ( 4, 6 ] 992 2.020% 99.289% ( 6, 10 ] 246 0.501% 99.790% ( 10, 15 ] 19 0.039% 99.829% ( 15, 22 ] 7 0.014% 99.843% ( 22, 34 ] 5 0.010% 99.853% ( 34, 51 ] 13 0.026% 99.880% ( 51, 76 ] 10 0.020% 99.900% ( 76, 110 ] 5 0.010% 99.910% ( 110, 170 ] 17 0.035% 99.945% ( 170, 250 ] 18 0.037% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1744312 Average: 5.7277 StdDev: 97.49 Min: 0 Median: 1.5116 Max: 20330 Percentiles: P50: 1.51 P75: 2.27 P99: 6.87 P99.9: 673.64 P99.99: 2873.52 ------------------------------------------------------ [ 0, 1 ] 477426 27.370% 27.370% ##### ( 1, 2 ] 771520 44.231% 71.601% ######### ( 2, 3 ] 221971 12.725% 84.326% ### ( 3, 4 ] 155022 8.887% 93.214% ## ( 4, 6 ] 98014 5.619% 98.833% # ( 6, 10 ] 13379 0.767% 99.600% ( 10, 15 ] 847 0.049% 99.648% ( 15, 22 ] 209 0.012% 99.660% ( 22, 34 ] 132 0.008% 99.668% ( 34, 51 ] 244 0.014% 99.682% ( 51, 76 ] 99 0.006% 99.688% ( 76, 110 ] 211 0.012% 99.700% ( 110, 170 ] 466 0.027% 99.726% ( 170, 250 ] 681 0.039% 99.765% ( 250, 380 ] 1055 0.060% 99.826% ( 380, 580 ] 1045 0.060% 99.886% ( 580, 870 ] 764 0.044% 99.930% ( 870, 1300 ] 403 0.023% 99.953% ( 1300, 1900 ] 266 0.015% 99.968% ( 1900, 2900 ] 394 0.023% 99.991% ( 2900, 4400 ] 511 0.029% 100.020% ( 4400, 6600 ] 123 0.007% 100.027% ( 6600, 9900 ] 17 0.001% 100.028% ( 9900, 14000 ] 5 0.000% 100.028% ( 14000, 22000 ] 3 0.000% 100.028% ** Level 4 read latency histogram (micros): Count: 1001186 Average: 14.6361 StdDev: 180.25 Min: 0 Median: 1.4907 Max: 26980 Percentiles: P50: 1.49 P75: 2.23 P99: 275.03 P99.9: 2908.04 P99.99: 4476.38 ------------------------------------------------------ [ 0, 1 ] 287344 28.700% 28.700% ###### ( 1, 2 ] 434590 43.408% 72.108% ######### ( 2, 3 ] 127032 12.688% 84.796% ### ( 3, 4 ] 84830 8.473% 93.269% ## ( 4, 6 ] 48529 4.847% 98.116% # ( 6, 10 ] 6313 0.631% 98.747% ( 10, 15 ] 459 0.046% 98.793% ( 15, 22 ] 53 0.005% 98.798% ( 22, 34 ] 60 0.006% 98.804% ( 34, 51 ] 56 0.006% 98.809% ( 51, 76 ] 37 0.004% 98.813% ( 76, 110 ] 97 0.010% 98.823% ( 110, 170 ] 433 0.043% 98.866% ( 170, 250 ] 948 0.095% 98.961% ( 250, 380 ] 2042 0.204% 99.165% ( 380, 580 ] 2744 0.274% 99.439% ( 580, 870 ] 2160 0.216% 99.655% ( 870, 1300 ] 966 0.096% 99.751% ( 1300, 1900 ] 681 0.068% 99.819% ( 1900, 2900 ] 806 0.081% 99.900% ( 2900, 4400 ] 898 0.090% 99.989% ( 4400, 6600 ] 227 0.023% 100.012% ( 6600, 9900 ] 37 0.004% 100.016% ( 9900, 14000 ] 4 0.000% 100.016% ( 14000, 22000 ] 4 0.000% 100.016% ( 22000, 33000 ] 4 0.000% 100.017% ** Level 5 read latency histogram (micros): Count: 520 Average: 803.9404 StdDev: 936.09 Min: 95 Median: 501.3483 Max: 8481 Percentiles: P50: 501.35 P75: 953.43 P99: 5060.00 P99.9: 8184.00 P99.99: 8481.00 ------------------------------------------------------ ( 76, 110 ] 10 1.923% 1.923% ( 110, 170 ] 31 5.962% 7.885% # ( 170, 250 ] 76 14.615% 22.500% ### ( 250, 380 ] 89 17.115% 39.615% ### ( 380, 580 ] 89 17.115% 56.731% ### ( 580, 870 ] 82 15.769% 72.500% ### ( 870, 1300 ] 67 12.885% 85.385% ### ( 1300, 1900 ] 28 5.385% 90.769% # ( 1900, 2900 ] 20 3.846% 94.615% # ( 2900, 4400 ] 21 4.038% 98.654% # ( 4400, 6600 ] 6 1.154% 99.808% ( 6600, 9900 ] 1 0.192% 100.000% ** DB Stats ** Uptime(secs): 59.8 total, 2.2 interval Cumulative writes: 0 writes, 13M keys, 0 commit groups, 0.0 writes per commit group, ingest: 12.49 GB, 213.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.212 H:M:S, 42.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 438.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.557 micros/op 219457 ops/sec 60.002 seconds 13167999 operations; 212.6 MB/s Microseconds per write: Count: 13167999 Average: 4.5567 StdDev: 283.17 Min: 0 Median: 1.6758 Max: 628483 Percentiles: P50: 1.68 P75: 2.51 P99: 8.99 P99.9: 1010.94 P99.99: 2384.84 ------------------------------------------------------ [ 0, 1 ] 2632009 19.988% 19.988% #### ( 1, 2 ] 5848118 44.412% 64.400% ######### ( 2, 3 ] 2727693 20.715% 85.114% #### ( 3, 4 ] 1233032 9.364% 94.478% ## ( 4, 6 ] 500842 3.803% 98.281% # ( 6, 10 ] 126430 0.960% 99.242% ( 10, 15 ] 38190 0.290% 99.532% ( 15, 22 ] 18330 0.139% 99.671% ( 22, 34 ] 9101 0.069% 99.740% ( 34, 51 ] 1980 0.015% 99.755% ( 51, 76 ] 1292 0.010% 99.765% ( 76, 110 ] 10214 0.078% 99.842% ( 110, 170 ] 1680 0.013% 99.855% ( 170, 250 ] 348 0.003% 99.858% ( 250, 380 ] 181 0.001% 99.859% ( 380, 580 ] 79 0.001% 99.860% ( 580, 870 ] 34 0.000% 99.860% ( 870, 1300 ] 16103 0.122% 99.982% ( 1300, 1900 ] 169 0.001% 99.983% ( 1900, 2900 ] 1768 0.013% 99.997% ( 2900, 4400 ] 277 0.002% 99.999% ( 4400, 6600 ] 85 0.001% 100.000% ( 6600, 9900 ] 30 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 170000, 250000 ] 5 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 371371 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 13167999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 13589374968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 962 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 25212185 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 50770171988 rocksdb.compact.write.bytes COUNT : 50378316536 rocksdb.flush.write.bytes COUNT : 13476381099 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 111 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 559 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 13367035904 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4597760 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 50910537588 rocksdb.non.last.level.read.count COUNT : 12298604 rocksdb.block.checksum.compute.count COUNT : 12296791 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.291410 P95 : 3.724368 P99 : 7.636780 P100 : 628482.000000 COUNT : 13167999 SUM : 54302180 rocksdb.compaction.times.micros P50 : 735300.000000 P95 : 3092500.000000 P99 : 10262000.000000 P100 : 15140076.000000 COUNT : 189 SUM : 205620665 rocksdb.compaction.times.cpu_micros P50 : 591750.000000 P95 : 2537500.000000 P99 : 10031000.000000 P100 : 13566090.000000 COUNT : 189 SUM : 160913747 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 552.727273 P95 : 1340.000000 P99 : 5896.000000 P100 : 7641.000000 COUNT : 196 SUM : 144914 rocksdb.compaction.outfile.sync.micros P50 : 992.210526 P95 : 8803.235294 P99 : 16902.857143 P100 : 29639.000000 COUNT : 646 SUM : 1537374 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 143.870968 P95 : 1600.000000 P99 : 4205.000000 P100 : 7737.000000 COUNT : 430 SUM : 159064 rocksdb.table.open.io.micros P50 : 872.945205 P95 : 5726.666667 P99 : 10159.666667 P100 : 18244.000000 COUNT : 962 SUM : 1524438 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 2.614719 P95 : 5.643435 P99 : 9.225053 P100 : 26982.000000 COUNT : 12295985 SUM : 73247766 rocksdb.read.block.get.micros P50 : 288.500000 P95 : 2416.000000 P99 : 4393.207547 P100 : 12473.000000 COUNT : 1924 SUM : 1124541 rocksdb.write.raw.block.micros P50 : 0.510618 P95 : 0.970175 P99 : 2.429592 P100 : 35119.000000 COUNT : 15472568 SUM : 25087150 rocksdb.numfiles.in.singlecompaction P50 : 3.000000 P95 : 5.362500 P99 : 11.900000 P100 : 27.000000 COUNT : 262 SUM : 895 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.578110 P95 : 1116.509197 P99 : 2025.436047 P100 : 628302.000000 COUNT : 179725 SUM : 25243386 rocksdb.sst.read.micros P50 : 1.298565 P95 : 3.812892 P99 : 5.895922 P100 : 26980.000000 COUNT : 12301867 SUM : 55820593 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 13167999 SUM : 13589374968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 144588.235294 P95 : 345333.333333 P99 : 670533.333333 P100 : 769218.000000 COUNT : 196 SUM : 32812681 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 659 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0