[2024-11-21 01:00:57.761251] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 22.11.4 initialization... [2024-11-21 01:00:57.761530] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1138415 ] Set seed to 1732147257755426 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-21 01:00:57.858698] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-21 01:00:57.900478] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-21 01:00:57.900533] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1138415' to capture a snapshot of events at runtime. [2024-11-21 01:00:57.900544] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-21 01:00:57.900554] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-21 01:00:57.900562] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1138415 for offline analysis/debug. [2024-11-21 01:00:57.900651] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Nov 21 01:01:02 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/21-01:01:04 ... thread 0: (1000000,1000000) ops and (355148.4,355148.4) ops/second in (2.815724,2.815724) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 630.02 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 348.5 2.35 2.11 12 0.196 0 0 0.0 0.0 L2 3/2 237.25 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 248.3 248.1 1.41 1.35 2 0.703 354K 192 0.0 0.0 L3 11/0 944.88 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/11 96.94 GB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 92.9 310.9 3.76 3.45 14 0.268 354K 192 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 92.9 310.9 3.76 3.45 14 0.268 354K 192 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 248.3 248.1 1.41 1.35 2 0.703 354K 192 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 348.5 2.35 2.11 12 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.14 GB write, 386.16 MB/s write, 0.34 GB read, 115.39 MB/s read, 3.8 seconds Interval compaction: 1.14 GB write, 414.49 MB/s write, 0.34 GB read, 123.85 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 120739 Average: 1.9763 StdDev: 9.38 Min: 0 Median: 1.3304 Max: 1829 Percentiles: P50: 1.33 P75: 1.75 P99: 5.39 P99.9: 11.09 P99.99: 131.94 ------------------------------------------------------ [ 0, 1 ] 36791 30.472% 30.472% ###### ( 1, 2 ] 71355 59.099% 89.570% ############ ( 2, 3 ] 7068 5.854% 95.424% # ( 3, 4 ] 2900 2.402% 97.826% ( 4, 6 ] 2049 1.697% 99.523% ( 6, 10 ] 435 0.360% 99.883% ( 10, 15 ] 107 0.089% 99.972% ( 15, 22 ] 16 0.013% 99.985% ( 22, 34 ] 3 0.002% 99.988% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 2 0.002% 99.990% ( 110, 170 ] 8 0.007% 99.997% ( 170, 250 ] 3 0.002% 99.999% ( 250, 380 ] 9 0.007% 100.007% ( 580, 870 ] 1 0.001% 100.007% ( 1300, 1900 ] 3 0.002% 100.010% ** Level 2 read latency histogram (micros): Count: 70123 Average: 2.2249 StdDev: 24.49 Min: 0 Median: 1.3411 Max: 4362 Percentiles: P50: 1.34 P75: 1.76 P99: 5.63 P99.9: 39.38 P99.99: 651.61 ------------------------------------------------------ [ 0, 1 ] 20672 29.480% 29.480% ###### ( 1, 2 ] 42183 60.156% 89.635% ############ ( 2, 3 ] 3991 5.691% 95.327% # ( 3, 4 ] 1682 2.399% 97.725% ( 4, 6 ] 1099 1.567% 99.293% ( 6, 10 ] 345 0.492% 99.785% ( 10, 15 ] 53 0.076% 99.860% ( 15, 22 ] 10 0.014% 99.875% ( 22, 34 ] 3 0.004% 99.879% ( 34, 51 ] 47 0.067% 99.946% ( 51, 76 ] 6 0.009% 99.954% ( 76, 110 ] 4 0.006% 99.960% ( 110, 170 ] 3 0.004% 99.964% ( 170, 250 ] 8 0.011% 99.976% ( 250, 380 ] 7 0.010% 99.986% ( 380, 580 ] 2 0.003% 99.989% ( 580, 870 ] 4 0.006% 99.994% ( 1300, 1900 ] 1 0.001% 99.996% ( 1900, 2900 ] 2 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1635.2909 StdDev: 1434.23 Min: 199 Median: 913.0000 Max: 4902 Percentiles: P50: 913.00 P75: 2775.00 P99: 4902.00 P99.9: 4902.00 P99.99: 4902.00 ------------------------------------------------------ ( 170, 250 ] 4 7.273% 7.273% # ( 250, 380 ] 7 12.727% 20.000% ### ( 380, 580 ] 8 14.545% 34.545% ### ( 580, 870 ] 8 14.545% 49.091% ### ( 870, 1300 ] 5 9.091% 58.182% ## ( 1300, 1900 ] 4 7.273% 65.455% # ( 1900, 2900 ] 6 10.909% 76.364% ## ( 2900, 4400 ] 8 14.545% 90.909% ### ( 4400, 6600 ] 5 9.091% 100.000% ## ** Level 4 read latency histogram (micros): Count: 20 Average: 1512.9500 StdDev: 1242.31 Min: 231 Median: 977.5000 Max: 5003 Percentiles: P50: 977.50 P75: 2400.00 P99: 5003.00 P99.9: 5003.00 P99.99: 5003.00 ------------------------------------------------------ ( 170, 250 ] 1 5.000% 5.000% # ( 250, 380 ] 2 10.000% 15.000% ## ( 380, 580 ] 2 10.000% 25.000% ## ( 580, 870 ] 4 20.000% 45.000% #### ( 870, 1300 ] 4 20.000% 65.000% #### ( 1900, 2900 ] 4 20.000% 85.000% #### ( 2900, 4400 ] 2 10.000% 95.000% ## ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 325.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.224 H:M:S, 7.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 349.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.224 H:M:S, 7.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/21-01:01:08 ... thread 0: (1000000,2000000) ops and (326318.9,340123.8) ops/second in (3.064487,5.880211) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.29 GB 100.7 0.8 0.0 0.8 2.6 1.8 0.0 1.4 97.6 315.4 8.39 7.75 29 0.289 831K 817 0.0 0.0 L1 1/0 3.10 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 236.1 235.8 1.33 1.30 1 1.334 319K 440 0.0 0.0 L2 2/1 147.62 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 248.3 248.1 1.41 1.35 2 0.703 354K 192 0.0 0.0 L3 20/11 1.15 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 225.6 225.6 0.83 0.76 1 0.829 189K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 130.4 130.4 1.29 0.89 1 1.291 170K 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/16 97.92 GB 0.0 1.8 0.8 1.0 3.6 2.6 0.7 2.0 138.8 276.6 13.25 12.05 34 0.390 1866K 1449 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.8 1.0 3.6 2.6 0.7 2.0 138.8 276.6 13.25 12.05 34 0.390 1866K 1449 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.8 1.0 1.8 0.8 0.0 0.0 228.3 228.1 8.05 7.43 8 1.007 1866K 1449 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.7 5.19 4.62 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.58 GB write, 601.74 MB/s write, 1.80 GB read, 301.92 MB/s read, 13.2 seconds Interval compaction: 3.58 GB write, 622.88 MB/s write, 1.80 GB read, 312.53 MB/s read, 13.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 380053 Average: 2.1976 StdDev: 8.69 Min: 0 Median: 1.4934 Max: 1829 Percentiles: P50: 1.49 P75: 1.88 P99: 5.66 P99.9: 11.23 P99.99: 18.42 ------------------------------------------------------ [ 0, 1 ] 68961 18.145% 18.145% #### ( 1, 2 ] 245355 64.558% 82.703% ############# ( 2, 3 ] 39843 10.484% 93.187% ## ( 3, 4 ] 14327 3.770% 96.956% # ( 4, 6 ] 9363 2.464% 99.420% ( 6, 10 ] 1720 0.453% 99.873% ( 10, 15 ] 424 0.112% 99.984% ( 15, 22 ] 45 0.012% 99.996% ( 22, 34 ] 5 0.001% 99.997% ( 34, 51 ] 1 0.000% 99.998% ( 51, 76 ] 4 0.001% 99.999% ( 110, 170 ] 12 0.003% 100.002% ( 170, 250 ] 10 0.003% 100.004% ( 250, 380 ] 15 0.004% 100.008% ( 380, 580 ] 4 0.001% 100.009% ( 580, 870 ] 7 0.002% 100.011% ( 870, 1300 ] 5 0.001% 100.013% ( 1300, 1900 ] 6 0.002% 100.014% ** Level 1 read latency histogram (micros): Count: 20 Average: 163.6500 StdDev: 315.57 Min: 0 Median: 1.6250 Max: 1308 Percentiles: P50: 1.62 P75: 315.00 P99: 1308.00 P99.9: 1308.00 P99.99: 1308.00 ------------------------------------------------------ [ 0, 1 ] 5 25.000% 25.000% ##### ( 1, 2 ] 8 40.000% 65.000% ######## ( 4, 6 ] 1 5.000% 70.000% # ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 88380 Average: 2.2486 StdDev: 21.82 Min: 0 Median: 1.4039 Max: 4362 Percentiles: P50: 1.40 P75: 1.81 P99: 5.72 P99.9: 32.86 P99.99: 496.20 ------------------------------------------------------ [ 0, 1 ] 22086 24.990% 24.990% ##### ( 1, 2 ] 54720 61.914% 86.904% ############ ( 2, 3 ] 6597 7.464% 94.369% # ( 3, 4 ] 2590 2.931% 97.299% # ( 4, 6 ] 1752 1.982% 99.282% ( 6, 10 ] 458 0.518% 99.800% ( 10, 15 ] 72 0.081% 99.881% ( 15, 22 ] 13 0.015% 99.896% ( 22, 34 ] 4 0.005% 99.900% ( 34, 51 ] 47 0.053% 99.954% ( 51, 76 ] 9 0.010% 99.964% ( 76, 110 ] 4 0.005% 99.968% ( 110, 170 ] 3 0.003% 99.972% ( 170, 250 ] 8 0.009% 99.981% ( 250, 380 ] 7 0.008% 99.989% ( 380, 580 ] 2 0.002% 99.991% ( 580, 870 ] 4 0.005% 99.995% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 186777 Average: 3.6210 StdDev: 40.48 Min: 1 Median: 1.6563 Max: 4902 Percentiles: P50: 1.66 P75: 2.21 P99: 9.18 P99.9: 228.88 P99.99: 653.14 ------------------------------------------------------ [ 0, 1 ] 17405 9.319% 9.319% ## ( 1, 2 ] 115777 61.987% 71.305% ############ ( 2, 3 ] 32626 17.468% 88.773% ### ( 3, 4 ] 8904 4.767% 93.540% # ( 4, 6 ] 7615 4.077% 97.617% # ( 6, 10 ] 3249 1.740% 99.357% ( 10, 15 ] 482 0.258% 99.615% ( 15, 22 ] 92 0.049% 99.664% ( 22, 34 ] 23 0.012% 99.677% ( 34, 51 ] 4 0.002% 99.679% ( 51, 76 ] 7 0.004% 99.683% ( 76, 110 ] 100 0.054% 99.736% ( 110, 170 ] 226 0.121% 99.857% ( 170, 250 ] 109 0.058% 99.915% ( 250, 380 ] 75 0.040% 99.956% ( 380, 580 ] 56 0.030% 99.986% ( 580, 870 ] 33 0.018% 100.003% ( 870, 1300 ] 13 0.007% 100.010% ( 1300, 1900 ] 4 0.002% 100.012% ( 1900, 2900 ] 6 0.003% 100.016% ( 2900, 4400 ] 8 0.004% 100.020% ( 4400, 6600 ] 5 0.003% 100.022% ** Level 4 read latency histogram (micros): Count: 310 Average: 106.9968 StdDev: 488.39 Min: 1 Median: 2.6622 Max: 5003 Percentiles: P50: 2.66 P75: 5.86 P99: 2875.00 P99.9: 5003.00 P99.99: 5003.00 ------------------------------------------------------ [ 0, 1 ] 15 4.839% 4.839% # ( 1, 2 ] 91 29.355% 34.194% ###### ( 2, 3 ] 74 23.871% 58.065% ##### ( 3, 4 ] 33 10.645% 68.710% ## ( 4, 6 ] 21 6.774% 75.484% # ( 6, 10 ] 23 7.419% 82.903% # ( 10, 15 ] 26 8.387% 91.290% ## ( 15, 22 ] 3 0.968% 92.258% ( 110, 170 ] 1 0.323% 92.581% ( 170, 250 ] 1 0.323% 92.903% ( 250, 380 ] 3 0.968% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 5 1.613% 96.452% ( 870, 1300 ] 4 1.290% 97.742% ( 1900, 2900 ] 4 1.290% 99.032% ( 2900, 4400 ] 2 0.645% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.631 H:M:S, 10.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.407 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/21-01:01:11 ... thread 0: (1000000,3000000) ops and (328639.7,336207.6) ops/second in (3.042846,8.923057) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.27 GB 201.4 1.9 0.0 1.9 4.7 2.8 0.0 1.7 126.0 308.7 15.50 14.47 47 0.330 1982K 2066 0.0 0.0 L1 1/0 3.10 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 236.1 235.8 1.33 1.30 1 1.334 319K 440 0.0 0.0 L2 1/0 97.34 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 248.3 248.1 1.41 1.35 2 0.703 354K 192 0.0 0.0 L3 21/0 968.58 MB 1.0 1.2 0.2 0.9 1.2 0.2 0.2 5.0 236.8 236.4 4.99 4.60 2 2.496 1200K 1813 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 130.4 130.4 1.29 0.89 1 1.291 170K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/4 98.90 GB 0.0 3.9 0.9 3.0 6.6 3.7 1.3 2.4 161.8 277.2 24.53 22.61 53 0.463 4028K 4511 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 0.9 3.0 6.6 3.7 1.3 2.4 161.8 277.2 24.53 22.61 53 0.463 4028K 4511 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 0.9 3.0 3.9 0.9 0.0 0.0 239.8 239.6 16.54 15.52 13 1.272 4028K 4511 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 355.0 7.98 7.10 40 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.64 GB write, 744.42 MB/s write, 3.87 GB read, 434.47 MB/s read, 24.5 seconds Interval compaction: 6.64 GB write, 761.66 MB/s write, 3.87 GB read, 444.54 MB/s read, 24.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 641132 Average: 2.1785 StdDev: 9.86 Min: 0 Median: 1.4839 Max: 3544 Percentiles: P50: 1.48 P75: 1.87 P99: 5.58 P99.9: 10.32 P99.99: 16.54 ------------------------------------------------------ [ 0, 1 ] 118456 18.476% 18.476% #### ( 1, 2 ] 417671 65.146% 83.622% ############# ( 2, 3 ] 65093 10.153% 93.775% ## ( 3, 4 ] 22197 3.462% 97.237% # ( 4, 6 ] 14295 2.230% 99.467% ( 6, 10 ] 2740 0.427% 99.894% ( 10, 15 ] 602 0.094% 99.988% ( 15, 22 ] 63 0.010% 99.998% ( 22, 34 ] 7 0.001% 99.999% ( 34, 51 ] 3 0.000% 99.999% ( 51, 76 ] 7 0.001% 100.000% ( 110, 170 ] 17 0.003% 100.003% ( 170, 250 ] 16 0.002% 100.005% ( 250, 380 ] 20 0.003% 100.009% ( 380, 580 ] 7 0.001% 100.010% ( 580, 870 ] 16 0.002% 100.012% ( 870, 1300 ] 10 0.002% 100.014% ( 1300, 1900 ] 7 0.001% 100.015% ( 1900, 2900 ] 1 0.000% 100.015% ( 2900, 4400 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 20 Average: 163.6500 StdDev: 315.57 Min: 0 Median: 1.6250 Max: 1308 Percentiles: P50: 1.62 P75: 315.00 P99: 1308.00 P99.9: 1308.00 P99.99: 1308.00 ------------------------------------------------------ [ 0, 1 ] 5 25.000% 25.000% ##### ( 1, 2 ] 8 40.000% 65.000% ######## ( 4, 6 ] 1 5.000% 70.000% # ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 100878 Average: 2.2860 StdDev: 20.86 Min: 0 Median: 1.4223 Max: 4362 Percentiles: P50: 1.42 P75: 1.82 P99: 5.86 P99.9: 34.41 P99.99: 576.49 ------------------------------------------------------ [ 0, 1 ] 23651 23.445% 23.445% ##### ( 1, 2 ] 63433 62.881% 86.326% ############# ( 2, 3 ] 7996 7.926% 94.252% ## ( 3, 4 ] 2953 2.927% 97.180% # ( 4, 6 ] 1979 1.962% 99.142% ( 6, 10 ] 660 0.654% 99.796% ( 10, 15 ] 86 0.085% 99.881% ( 15, 22 ] 14 0.014% 99.895% ( 22, 34 ] 4 0.004% 99.899% ( 34, 51 ] 47 0.047% 99.945% ( 51, 76 ] 9 0.009% 99.954% ( 76, 110 ] 4 0.004% 99.958% ( 110, 170 ] 8 0.008% 99.966% ( 170, 250 ] 11 0.011% 99.977% ( 250, 380 ] 8 0.008% 99.985% ( 380, 580 ] 5 0.005% 99.990% ( 580, 870 ] 6 0.006% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 282785 Average: 3.3824 StdDev: 34.35 Min: 1 Median: 1.6226 Max: 4902 Percentiles: P50: 1.62 P75: 2.06 P99: 8.99 P99.9: 221.43 P99.99: 689.35 ------------------------------------------------------ [ 0, 1 ] 28877 10.212% 10.212% ## ( 1, 2 ] 180725 63.909% 74.121% ############# ( 2, 3 ] 44231 15.641% 89.762% ### ( 3, 4 ] 12505 4.422% 94.184% # ( 4, 6 ] 10001 3.537% 97.721% # ( 6, 10 ] 4838 1.711% 99.431% ( 10, 15 ] 583 0.206% 99.638% ( 15, 22 ] 100 0.035% 99.673% ( 22, 34 ] 25 0.009% 99.682% ( 34, 51 ] 5 0.002% 99.684% ( 51, 76 ] 12 0.004% 99.688% ( 76, 110 ] 214 0.076% 99.763% ( 110, 170 ] 284 0.100% 99.864% ( 170, 250 ] 159 0.056% 99.920% ( 250, 380 ] 101 0.036% 99.956% ( 380, 580 ] 79 0.028% 99.984% ( 580, 870 ] 47 0.017% 100.000% ( 870, 1300 ] 17 0.006% 100.006% ( 1300, 1900 ] 4 0.001% 100.008% ( 1900, 2900 ] 7 0.002% 100.010% ( 2900, 4400 ] 8 0.003% 100.013% ( 4400, 6600 ] 5 0.002% 100.015% ** Level 4 read latency histogram (micros): Count: 310 Average: 106.9968 StdDev: 488.39 Min: 1 Median: 2.6622 Max: 5003 Percentiles: P50: 2.66 P75: 5.86 P99: 2875.00 P99.9: 5003.00 P99.99: 5003.00 ------------------------------------------------------ [ 0, 1 ] 15 4.839% 4.839% # ( 1, 2 ] 91 29.355% 34.194% ###### ( 2, 3 ] 74 23.871% 58.065% ##### ( 3, 4 ] 33 10.645% 68.710% ## ( 4, 6 ] 21 6.774% 75.484% # ( 6, 10 ] 23 7.419% 82.903% # ( 10, 15 ] 26 8.387% 91.290% ## ( 15, 22 ] 3 0.968% 92.258% ( 110, 170 ] 1 0.323% 92.581% ( 170, 250 ] 1 0.323% 92.903% ( 250, 380 ] 3 0.968% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 5 1.613% 96.452% ( 870, 1300 ] 4 1.290% 97.742% ( 1900, 2900 ] 4 1.290% 99.032% ( 2900, 4400 ] 2 0.645% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 936.8000 StdDev: 1142.25 Min: 126 Median: 580.0000 Max: 4657 Percentiles: P50: 580.00 P75: 1156.67 P99: 4657.00 P99.9: 4657.00 P99.99: 4657.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 5 25.000% 40.000% ##### ( 250, 380 ] 1 5.000% 45.000% # ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 3 15.000% 65.000% ### ( 870, 1300 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.047 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.416 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/21-01:01:14 ... thread 0: (1000000,4000000) ops and (333934.3,335636.4) ops/second in (2.994601,11.917658) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/4 3.26 GB 308.4 2.8 0.0 2.8 6.5 3.7 0.0 1.7 131.2 308.9 21.61 20.22 64 0.338 2878K 3023 0.0 0.0 L1 1/0 3.10 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 236.1 235.8 1.33 1.30 1 1.334 319K 440 0.0 0.0 L2 1/0 97.34 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 248.3 248.1 1.41 1.35 2 0.703 354K 192 0.0 0.0 L3 21/0 968.58 MB 1.0 1.2 0.2 0.9 1.2 0.2 0.2 5.0 236.8 236.4 4.99 4.60 2 2.496 1200K 1813 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 130.4 130.4 1.29 0.89 1 1.291 170K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/4 99.88 GB 0.0 4.7 0.9 3.8 8.5 4.6 1.3 2.3 158.3 283.6 30.63 28.36 70 0.438 4924K 5468 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 0.9 3.8 8.5 4.6 1.3 2.3 158.3 283.6 30.63 28.36 70 0.438 4924K 5468 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 0.9 3.8 4.7 0.9 0.0 0.0 244.2 244.0 19.85 18.76 16 1.241 4924K 5468 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 356.6 10.78 9.60 54 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.48 GB write, 716.35 MB/s write, 4.74 GB read, 399.91 MB/s read, 30.6 seconds Interval compaction: 8.48 GB write, 728.77 MB/s write, 4.74 GB read, 406.84 MB/s read, 30.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 899068 Average: 2.1145 StdDev: 10.67 Min: 0 Median: 1.4432 Max: 3544 Percentiles: P50: 1.44 P75: 1.83 P99: 5.46 P99.9: 10.41 P99.99: 17.84 ------------------------------------------------------ [ 0, 1 ] 192255 21.384% 21.384% #### ( 1, 2 ] 580476 64.564% 85.948% ############# ( 2, 3 ] 78254 8.704% 94.652% ## ( 3, 4 ] 26972 3.000% 97.652% # ( 4, 6 ] 16631 1.850% 99.502% ( 6, 10 ] 3513 0.391% 99.892% ( 10, 15 ] 842 0.094% 99.986% ( 15, 22 ] 89 0.010% 99.996% ( 22, 34 ] 10 0.001% 99.997% ( 34, 51 ] 4 0.000% 99.998% ( 51, 76 ] 10 0.001% 99.999% ( 110, 170 ] 19 0.002% 100.001% ( 170, 250 ] 27 0.003% 100.004% ( 250, 380 ] 26 0.003% 100.007% ( 380, 580 ] 9 0.001% 100.008% ( 580, 870 ] 20 0.002% 100.010% ( 870, 1300 ] 14 0.002% 100.011% ( 1300, 1900 ] 8 0.001% 100.012% ( 1900, 2900 ] 3 0.000% 100.013% ( 2900, 4400 ] 3 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 20 Average: 163.6500 StdDev: 315.57 Min: 0 Median: 1.6250 Max: 1308 Percentiles: P50: 1.62 P75: 315.00 P99: 1308.00 P99.9: 1308.00 P99.99: 1308.00 ------------------------------------------------------ [ 0, 1 ] 5 25.000% 25.000% ##### ( 1, 2 ] 8 40.000% 65.000% ######## ( 4, 6 ] 1 5.000% 70.000% # ( 250, 380 ] 2 10.000% 80.000% ## ( 380, 580 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 100878 Average: 2.2860 StdDev: 20.86 Min: 0 Median: 1.4223 Max: 4362 Percentiles: P50: 1.42 P75: 1.82 P99: 5.86 P99.9: 34.41 P99.99: 576.49 ------------------------------------------------------ [ 0, 1 ] 23651 23.445% 23.445% ##### ( 1, 2 ] 63433 62.881% 86.326% ############# ( 2, 3 ] 7996 7.926% 94.252% ## ( 3, 4 ] 2953 2.927% 97.180% # ( 4, 6 ] 1979 1.962% 99.142% ( 6, 10 ] 660 0.654% 99.796% ( 10, 15 ] 86 0.085% 99.881% ( 15, 22 ] 14 0.014% 99.895% ( 22, 34 ] 4 0.004% 99.899% ( 34, 51 ] 47 0.047% 99.945% ( 51, 76 ] 9 0.009% 99.954% ( 76, 110 ] 4 0.004% 99.958% ( 110, 170 ] 8 0.008% 99.966% ( 170, 250 ] 11 0.011% 99.977% ( 250, 380 ] 8 0.008% 99.985% ( 380, 580 ] 5 0.005% 99.990% ( 580, 870 ] 6 0.006% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 282785 Average: 3.3824 StdDev: 34.35 Min: 1 Median: 1.6226 Max: 4902 Percentiles: P50: 1.62 P75: 2.06 P99: 8.99 P99.9: 221.43 P99.99: 689.35 ------------------------------------------------------ [ 0, 1 ] 28877 10.212% 10.212% ## ( 1, 2 ] 180725 63.909% 74.121% ############# ( 2, 3 ] 44231 15.641% 89.762% ### ( 3, 4 ] 12505 4.422% 94.184% # ( 4, 6 ] 10001 3.537% 97.721% # ( 6, 10 ] 4838 1.711% 99.431% ( 10, 15 ] 583 0.206% 99.638% ( 15, 22 ] 100 0.035% 99.673% ( 22, 34 ] 25 0.009% 99.682% ( 34, 51 ] 5 0.002% 99.684% ( 51, 76 ] 12 0.004% 99.688% ( 76, 110 ] 214 0.076% 99.763% ( 110, 170 ] 284 0.100% 99.864% ( 170, 250 ] 159 0.056% 99.920% ( 250, 380 ] 101 0.036% 99.956% ( 380, 580 ] 79 0.028% 99.984% ( 580, 870 ] 47 0.017% 100.000% ( 870, 1300 ] 17 0.006% 100.006% ( 1300, 1900 ] 4 0.001% 100.008% ( 1900, 2900 ] 7 0.002% 100.010% ( 2900, 4400 ] 8 0.003% 100.013% ( 4400, 6600 ] 5 0.002% 100.015% ** Level 4 read latency histogram (micros): Count: 310 Average: 106.9968 StdDev: 488.39 Min: 1 Median: 2.6622 Max: 5003 Percentiles: P50: 2.66 P75: 5.86 P99: 2875.00 P99.9: 5003.00 P99.99: 5003.00 ------------------------------------------------------ [ 0, 1 ] 15 4.839% 4.839% # ( 1, 2 ] 91 29.355% 34.194% ###### ( 2, 3 ] 74 23.871% 58.065% ##### ( 3, 4 ] 33 10.645% 68.710% ## ( 4, 6 ] 21 6.774% 75.484% # ( 6, 10 ] 23 7.419% 82.903% # ( 10, 15 ] 26 8.387% 91.290% ## ( 15, 22 ] 3 0.968% 92.258% ( 110, 170 ] 1 0.323% 92.581% ( 170, 250 ] 1 0.323% 92.903% ( 250, 380 ] 3 0.968% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 5 1.613% 96.452% ( 870, 1300 ] 4 1.290% 97.742% ( 1900, 2900 ] 4 1.290% 99.032% ( 2900, 4400 ] 2 0.645% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 936.8000 StdDev: 1142.25 Min: 126 Median: 580.0000 Max: 4657 Percentiles: P50: 580.00 P75: 1156.67 P99: 4657.00 P99.9: 4657.00 P99.99: 4657.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 5 25.000% 40.000% ##### ( 250, 380 ] 1 5.000% 45.000% # ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 3 15.000% 65.000% ### ( 870, 1300 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.444 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.396 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/21-01:01:19 ... thread 0: (1000000,5000000) ops and (189084.3,290591.2) ops/second in (5.288647,17.206305) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 4.18 GB 94.4 3.8 0.0 3.8 8.5 4.7 0.0 1.8 138.2 307.3 28.27 26.53 82 0.345 3965K 4112 0.0 0.0 L1 1/1 3.10 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 236.1 235.8 1.33 1.30 1 1.334 319K 440 0.0 0.0 L2 1/0 97.34 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 248.3 248.1 1.41 1.35 2 0.703 354K 192 0.0 0.0 L3 21/0 968.58 MB 1.0 1.2 0.2 0.9 1.2 0.2 0.2 5.0 236.8 236.4 4.99 4.60 2 2.496 1200K 1813 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 130.4 130.4 1.29 0.89 1 1.291 170K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/15 100.81 GB 0.0 5.8 0.9 4.9 10.5 5.6 1.3 2.2 158.7 286.9 37.29 34.67 88 0.424 6011K 6557 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 0.9 4.9 10.5 5.6 1.3 2.2 158.7 286.9 37.29 34.67 88 0.424 6011K 6557 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 0.9 4.9 5.8 0.9 0.0 0.0 247.7 247.5 23.90 22.73 20 1.195 6011K 6557 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.3 13.40 11.94 68 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.4 total, 17.2 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.45 GB write, 614.50 MB/s write, 5.78 GB read, 339.96 MB/s read, 37.3 seconds Interval compaction: 10.45 GB write, 621.88 MB/s write, 5.78 GB read, 344.04 MB/s read, 37.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 16, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1418293 Average: 2.1266 StdDev: 10.73 Min: 0 Median: 1.4402 Max: 3544 Percentiles: P50: 1.44 P75: 1.82 P99: 5.47 P99.9: 11.92 P99.99: 101.27 ------------------------------------------------------ [ 0, 1 ] 300128 21.161% 21.161% #### ( 1, 2 ] 929219 65.517% 86.678% ############# ( 2, 3 ] 118589 8.361% 95.039% ## ( 3, 4 ] 39462 2.782% 97.822% # ( 4, 6 ] 22765 1.605% 99.427% ( 6, 10 ] 6143 0.433% 99.860% ( 10, 15 ] 1480 0.104% 99.964% ( 15, 22 ] 235 0.017% 99.981% ( 22, 34 ] 18 0.001% 99.982% ( 34, 51 ] 6 0.000% 99.983% ( 51, 76 ] 17 0.001% 99.984% ( 76, 110 ] 120 0.008% 99.992% ( 110, 170 ] 132 0.009% 100.001% ( 170, 250 ] 47 0.003% 100.005% ( 250, 380 ] 52 0.004% 100.008% ( 380, 580 ] 25 0.002% 100.010% ( 580, 870 ] 31 0.002% 100.012% ( 870, 1300 ] 22 0.002% 100.014% ( 1300, 1900 ] 9 0.001% 100.015% ( 1900, 2900 ] 6 0.000% 100.015% ( 2900, 4400 ] 4 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 21 Average: 162.6190 StdDev: 308.00 Min: 0 Median: 1.6875 Max: 1308 Percentiles: P50: 1.69 P75: 298.75 P99: 1308.00 P99.9: 1308.00 P99.99: 1308.00 ------------------------------------------------------ [ 0, 1 ] 5 23.810% 23.810% ##### ( 1, 2 ] 8 38.095% 61.905% ######## ( 4, 6 ] 1 4.762% 66.667% # ( 110, 170 ] 1 4.762% 71.429% # ( 250, 380 ] 2 9.524% 80.952% ## ( 380, 580 ] 3 14.286% 95.238% ### ( 1300, 1900 ] 1 4.762% 100.000% # ** Level 2 read latency histogram (micros): Count: 100878 Average: 2.2860 StdDev: 20.86 Min: 0 Median: 1.4223 Max: 4362 Percentiles: P50: 1.42 P75: 1.82 P99: 5.86 P99.9: 34.41 P99.99: 576.49 ------------------------------------------------------ [ 0, 1 ] 23651 23.445% 23.445% ##### ( 1, 2 ] 63433 62.881% 86.326% ############# ( 2, 3 ] 7996 7.926% 94.252% ## ( 3, 4 ] 2953 2.927% 97.180% # ( 4, 6 ] 1979 1.962% 99.142% ( 6, 10 ] 660 0.654% 99.796% ( 10, 15 ] 86 0.085% 99.881% ( 15, 22 ] 14 0.014% 99.895% ( 22, 34 ] 4 0.004% 99.899% ( 34, 51 ] 47 0.047% 99.945% ( 51, 76 ] 9 0.009% 99.954% ( 76, 110 ] 4 0.004% 99.958% ( 110, 170 ] 8 0.008% 99.966% ( 170, 250 ] 11 0.011% 99.977% ( 250, 380 ] 8 0.008% 99.985% ( 380, 580 ] 5 0.005% 99.990% ( 580, 870 ] 6 0.006% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 282785 Average: 3.3824 StdDev: 34.35 Min: 1 Median: 1.6226 Max: 4902 Percentiles: P50: 1.62 P75: 2.06 P99: 8.99 P99.9: 221.43 P99.99: 689.35 ------------------------------------------------------ [ 0, 1 ] 28877 10.212% 10.212% ## ( 1, 2 ] 180725 63.909% 74.121% ############# ( 2, 3 ] 44231 15.641% 89.762% ### ( 3, 4 ] 12505 4.422% 94.184% # ( 4, 6 ] 10001 3.537% 97.721% # ( 6, 10 ] 4838 1.711% 99.431% ( 10, 15 ] 583 0.206% 99.638% ( 15, 22 ] 100 0.035% 99.673% ( 22, 34 ] 25 0.009% 99.682% ( 34, 51 ] 5 0.002% 99.684% ( 51, 76 ] 12 0.004% 99.688% ( 76, 110 ] 214 0.076% 99.763% ( 110, 170 ] 284 0.100% 99.864% ( 170, 250 ] 159 0.056% 99.920% ( 250, 380 ] 101 0.036% 99.956% ( 380, 580 ] 79 0.028% 99.984% ( 580, 870 ] 47 0.017% 100.000% ( 870, 1300 ] 17 0.006% 100.006% ( 1300, 1900 ] 4 0.001% 100.008% ( 1900, 2900 ] 7 0.002% 100.010% ( 2900, 4400 ] 8 0.003% 100.013% ( 4400, 6600 ] 5 0.002% 100.015% ** Level 4 read latency histogram (micros): Count: 310 Average: 106.9968 StdDev: 488.39 Min: 1 Median: 2.6622 Max: 5003 Percentiles: P50: 2.66 P75: 5.86 P99: 2875.00 P99.9: 5003.00 P99.99: 5003.00 ------------------------------------------------------ [ 0, 1 ] 15 4.839% 4.839% # ( 1, 2 ] 91 29.355% 34.194% ###### ( 2, 3 ] 74 23.871% 58.065% ##### ( 3, 4 ] 33 10.645% 68.710% ## ( 4, 6 ] 21 6.774% 75.484% # ( 6, 10 ] 23 7.419% 82.903% # ( 10, 15 ] 26 8.387% 91.290% ## ( 15, 22 ] 3 0.968% 92.258% ( 110, 170 ] 1 0.323% 92.581% ( 170, 250 ] 1 0.323% 92.903% ( 250, 380 ] 3 0.968% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 5 1.613% 96.452% ( 870, 1300 ] 4 1.290% 97.742% ( 1900, 2900 ] 4 1.290% 99.032% ( 2900, 4400 ] 2 0.645% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 936.8000 StdDev: 1142.25 Min: 126 Median: 580.0000 Max: 4657 Percentiles: P50: 580.00 P75: 1156.67 P99: 4657.00 P99.9: 4657.00 P99.99: 4657.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 5 25.000% 40.000% ##### ( 250, 380 ] 1 5.000% 45.000% # ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 3 15.000% 65.000% ### ( 870, 1300 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 17.4 total, 5.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 282.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.110 H:M:S, 23.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 186.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.666 H:M:S, 50.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/21-01:01:29 ... thread 0: (1000000,6000000) ops and (99178.4,219867.7) ops/second in (10.082839,27.289144) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 1.90 GB 112.8 5.8 0.0 5.8 11.5 5.7 0.0 2.0 153.3 301.4 39.04 36.76 103 0.379 6075K 9491 0.0 0.0 L1 9/0 1.03 GB 105.0 3.6 3.6 0.0 3.5 3.5 0.2 1.0 223.2 219.9 16.37 15.59 2 8.186 3709K 52K 0.0 0.0 L2 19/11 2.28 GB 9.5 0.3 0.2 0.2 0.3 0.2 2.5 1.8 248.3 248.1 1.41 1.35 2 0.703 354K 192 0.0 0.0 L3 21/9 968.58 MB 0.7 1.2 0.2 0.9 1.2 0.2 0.2 5.0 236.8 236.4 4.99 4.60 2 2.496 1200K 1813 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 130.4 130.4 1.29 0.89 1 1.291 170K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/24 101.73 GB 0.0 11.1 4.1 6.9 16.7 9.7 3.4 2.9 179.6 270.5 63.10 59.20 110 0.574 11M 63K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.1 4.1 6.9 16.7 9.7 3.4 2.9 179.6 270.5 63.10 59.20 110 0.574 11M 63K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.1 4.1 6.9 11.0 4.1 0.0 0.0 242.3 240.9 46.79 44.68 26 1.799 11M 63K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 355.2 16.32 14.52 84 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.5 total, 27.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.67 GB write, 620.71 MB/s write, 11.07 GB read, 412.27 MB/s read, 63.1 seconds Interval compaction: 16.67 GB write, 625.41 MB/s write, 11.07 GB read, 415.40 MB/s read, 63.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 16, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2506553 Average: 2.3342 StdDev: 12.64 Min: 0 Median: 1.4510 Max: 3883 Percentiles: P50: 1.45 P75: 1.83 P99: 5.81 P99.9: 97.25 P99.99: 224.99 ------------------------------------------------------ [ 0, 1 ] 502352 20.042% 20.042% #### ( 1, 2 ] 1665081 66.429% 86.471% ############# ( 2, 3 ] 207602 8.282% 94.753% ## ( 3, 4 ] 70271 2.803% 97.557% # ( 4, 6 ] 39988 1.595% 99.152% ( 6, 10 ] 14578 0.582% 99.733% ( 10, 15 ] 2546 0.102% 99.835% ( 15, 22 ] 536 0.021% 99.856% ( 22, 34 ] 34 0.001% 99.858% ( 34, 51 ] 44 0.002% 99.860% ( 51, 76 ] 107 0.004% 99.864% ( 76, 110 ] 1452 0.058% 99.922% ( 110, 170 ] 1435 0.057% 99.979% ( 170, 250 ] 402 0.016% 99.995% ( 250, 380 ] 235 0.009% 100.004% ( 380, 580 ] 170 0.007% 100.011% ( 580, 870 ] 94 0.004% 100.015% ( 870, 1300 ] 34 0.001% 100.016% ( 1300, 1900 ] 15 0.001% 100.017% ( 1900, 2900 ] 11 0.000% 100.017% ( 2900, 4400 ] 8 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 2193 Average: 66.3611 StdDev: 208.77 Min: 0 Median: 3.3792 Max: 2198 Percentiles: P50: 3.38 P75: 6.10 P99: 1143.34 P99.9: 1740.35 P99.99: 1839.03 ------------------------------------------------------ [ 0, 1 ] 232 10.579% 10.579% ## ( 1, 2 ] 566 25.809% 36.389% ##### ( 2, 3 ] 221 10.078% 46.466% ## ( 3, 4 ] 207 9.439% 55.905% ## ( 4, 6 ] 415 18.924% 74.829% #### ( 6, 10 ] 188 8.573% 83.402% ## ( 10, 15 ] 29 1.322% 84.724% ( 15, 22 ] 14 0.638% 85.363% ( 22, 34 ] 2 0.091% 85.454% ( 34, 51 ] 1 0.046% 85.499% ( 76, 110 ] 21 0.958% 86.457% ( 110, 170 ] 59 2.690% 89.147% # ( 170, 250 ] 57 2.599% 91.746% # ( 250, 380 ] 55 2.508% 94.254% # ( 380, 580 ] 64 2.918% 97.173% # ( 580, 870 ] 22 1.003% 98.176% ( 870, 1300 ] 30 1.368% 99.544% ( 1300, 1900 ] 12 0.547% 100.091% ( 1900, 2900 ] 2 0.091% 100.182% ** Level 2 read latency histogram (micros): Count: 100878 Average: 2.2860 StdDev: 20.86 Min: 0 Median: 1.4223 Max: 4362 Percentiles: P50: 1.42 P75: 1.82 P99: 5.86 P99.9: 34.41 P99.99: 576.49 ------------------------------------------------------ [ 0, 1 ] 23651 23.445% 23.445% ##### ( 1, 2 ] 63433 62.881% 86.326% ############# ( 2, 3 ] 7996 7.926% 94.252% ## ( 3, 4 ] 2953 2.927% 97.180% # ( 4, 6 ] 1979 1.962% 99.142% ( 6, 10 ] 660 0.654% 99.796% ( 10, 15 ] 86 0.085% 99.881% ( 15, 22 ] 14 0.014% 99.895% ( 22, 34 ] 4 0.004% 99.899% ( 34, 51 ] 47 0.047% 99.945% ( 51, 76 ] 9 0.009% 99.954% ( 76, 110 ] 4 0.004% 99.958% ( 110, 170 ] 8 0.008% 99.966% ( 170, 250 ] 11 0.011% 99.977% ( 250, 380 ] 8 0.008% 99.985% ( 380, 580 ] 5 0.005% 99.990% ( 580, 870 ] 6 0.006% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 282786 Average: 3.3847 StdDev: 34.37 Min: 1 Median: 1.6226 Max: 4902 Percentiles: P50: 1.62 P75: 2.06 P99: 8.99 P99.9: 221.93 P99.99: 693.11 ------------------------------------------------------ [ 0, 1 ] 28877 10.212% 10.212% ## ( 1, 2 ] 180725 63.909% 74.120% ############# ( 2, 3 ] 44231 15.641% 89.762% ### ( 3, 4 ] 12505 4.422% 94.184% # ( 4, 6 ] 10001 3.537% 97.720% # ( 6, 10 ] 4838 1.711% 99.431% ( 10, 15 ] 583 0.206% 99.637% ( 15, 22 ] 100 0.035% 99.673% ( 22, 34 ] 25 0.009% 99.681% ( 34, 51 ] 5 0.002% 99.683% ( 51, 76 ] 12 0.004% 99.687% ( 76, 110 ] 214 0.076% 99.763% ( 110, 170 ] 284 0.100% 99.864% ( 170, 250 ] 159 0.056% 99.920% ( 250, 380 ] 101 0.036% 99.955% ( 380, 580 ] 79 0.028% 99.983% ( 580, 870 ] 48 0.017% 100.000% ( 870, 1300 ] 17 0.006% 100.006% ( 1300, 1900 ] 4 0.001% 100.008% ( 1900, 2900 ] 7 0.002% 100.010% ( 2900, 4400 ] 8 0.003% 100.013% ( 4400, 6600 ] 5 0.002% 100.015% ** Level 4 read latency histogram (micros): Count: 310 Average: 106.9968 StdDev: 488.39 Min: 1 Median: 2.6622 Max: 5003 Percentiles: P50: 2.66 P75: 5.86 P99: 2875.00 P99.9: 5003.00 P99.99: 5003.00 ------------------------------------------------------ [ 0, 1 ] 15 4.839% 4.839% # ( 1, 2 ] 91 29.355% 34.194% ###### ( 2, 3 ] 74 23.871% 58.065% ##### ( 3, 4 ] 33 10.645% 68.710% ## ( 4, 6 ] 21 6.774% 75.484% # ( 6, 10 ] 23 7.419% 82.903% # ( 10, 15 ] 26 8.387% 91.290% ## ( 15, 22 ] 3 0.968% 92.258% ( 110, 170 ] 1 0.323% 92.581% ( 170, 250 ] 1 0.323% 92.903% ( 250, 380 ] 3 0.968% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 5 1.613% 96.452% ( 870, 1300 ] 4 1.290% 97.742% ( 1900, 2900 ] 4 1.290% 99.032% ( 2900, 4400 ] 2 0.645% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 936.8000 StdDev: 1142.25 Min: 126 Median: 580.0000 Max: 4657 Percentiles: P50: 580.00 P75: 1156.67 P99: 4657.00 P99.9: 4657.00 P99.99: 4657.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 5 25.000% 40.000% ##### ( 250, 380 ] 1 5.000% 45.000% # ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 3 15.000% 65.000% ### ( 870, 1300 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 27.5 total, 10.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 214.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.384 H:M:S, 41.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 97.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.274 H:M:S, 72.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/21-01:01:35 ... thread 0: (1000000,7000000) ops and (176095.0,212327.8) ops/second in (5.678754,32.967898) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/6 2.88 GB 56.7 7.2 0.0 7.2 13.8 6.6 0.0 2.1 152.4 292.9 48.34 44.80 119 0.406 7482K 12K 0.0 0.0 L1 9/9 1.03 GB 0.0 3.6 3.6 0.0 3.5 3.5 0.2 1.0 223.2 219.9 16.37 15.59 2 8.186 3709K 52K 0.0 0.0 L2 5/5 643.90 MB 0.0 0.3 0.2 0.2 0.3 0.2 2.5 1.8 248.3 248.1 1.41 1.35 2 0.703 354K 192 0.0 0.0 L3 27/3 1.16 GB 1.0 3.1 1.9 1.2 3.1 1.9 0.2 1.7 208.4 207.9 15.32 13.64 7 2.189 3242K 7061 0.0 0.0 L4 182/0 9.72 GB 1.0 0.9 0.9 0.0 0.9 0.9 1.0 1.0 117.2 117.1 7.95 4.59 14 0.568 926K 658 0.0 0.0 L5 1060/0 87.29 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/23 102.71 GB 0.0 15.1 6.5 8.6 21.7 13.1 5.5 3.3 173.4 248.6 89.39 79.96 144 0.621 15M 72K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.1 6.5 8.6 21.7 13.1 5.5 3.3 173.4 248.6 89.39 79.96 144 0.621 15M 72K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.1 6.5 8.6 15.1 6.4 0.0 0.0 223.3 222.2 69.40 62.79 47 1.477 15M 72K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 340.3 19.99 17.17 97 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.2 total, 33.0 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.70 GB write, 669.92 MB/s write, 15.13 GB read, 467.08 MB/s read, 89.4 seconds Interval compaction: 21.70 GB write, 674.12 MB/s write, 15.13 GB read, 470.01 MB/s read, 89.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 29, interval: 50 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2962492 Average: 2.4377 StdDev: 19.11 Min: 0 Median: 1.4946 Max: 19269 Percentiles: P50: 1.49 P75: 1.88 P99: 6.08 P99.9: 88.59 P99.99: 222.80 ------------------------------------------------------ [ 0, 1 ] 523754 17.680% 17.680% #### ( 1, 2 ] 1935887 65.347% 83.026% ############# ( 2, 3 ] 295424 9.972% 92.998% ## ( 3, 4 ] 105378 3.557% 96.555% # ( 4, 6 ] 71997 2.430% 98.986% ( 6, 10 ] 22036 0.744% 99.729% ( 10, 15 ] 3653 0.123% 99.853% ( 15, 22 ] 665 0.022% 99.875% ( 22, 34 ] 37 0.001% 99.876% ( 34, 51 ] 46 0.002% 99.878% ( 51, 76 ] 110 0.004% 99.882% ( 76, 110 ] 1465 0.049% 99.931% ( 110, 170 ] 1456 0.049% 99.980% ( 170, 250 ] 436 0.015% 99.995% ( 250, 380 ] 272 0.009% 100.004% ( 380, 580 ] 202 0.007% 100.011% ( 580, 870 ] 121 0.004% 100.015% ( 870, 1300 ] 50 0.002% 100.017% ( 1300, 1900 ] 17 0.001% 100.017% ( 1900, 2900 ] 18 0.001% 100.018% ( 2900, 4400 ] 17 0.001% 100.019% ( 4400, 6600 ] 2 0.000% 100.019% ( 6600, 9900 ] 1 0.000% 100.019% ( 14000, 22000 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 610161 Average: 4.4145 StdDev: 69.70 Min: 0 Median: 1.8229 Max: 18754 Percentiles: P50: 1.82 P75: 2.65 P99: 9.00 P99.9: 169.15 P99.99: 425.73 ------------------------------------------------------ [ 0, 1 ] 12310 2.018% 2.018% ( 1, 2 ] 355774 58.308% 60.326% ############ ( 2, 3 ] 138270 22.661% 82.987% ##### ( 3, 4 ] 46380 7.601% 90.588% ## ( 4, 6 ] 41890 6.865% 97.454% # ( 6, 10 ] 12583 2.062% 99.516% ( 10, 15 ] 1675 0.275% 99.790% ( 15, 22 ] 233 0.038% 99.829% ( 22, 34 ] 13 0.002% 99.831% ( 34, 51 ] 3 0.000% 99.831% ( 51, 76 ] 4 0.001% 99.832% ( 76, 110 ] 127 0.021% 99.853% ( 110, 170 ] 295 0.048% 99.901% ( 170, 250 ] 244 0.040% 99.941% ( 250, 380 ] 250 0.041% 99.982% ( 380, 580 ] 223 0.037% 100.019% ( 580, 870 ] 146 0.024% 100.042% ( 870, 1300 ] 97 0.016% 100.058% ( 1300, 1900 ] 39 0.006% 100.065% ( 1900, 2900 ] 45 0.007% 100.072% ( 2900, 4400 ] 43 0.007% 100.079% ( 4400, 6600 ] 14 0.002% 100.081% ( 6600, 9900 ] 14 0.002% 100.084% ( 14000, 22000 ] 2 0.000% 100.084% ** Level 2 read latency histogram (micros): Count: 100878 Average: 2.2860 StdDev: 20.86 Min: 0 Median: 1.4223 Max: 4362 Percentiles: P50: 1.42 P75: 1.82 P99: 5.86 P99.9: 34.41 P99.99: 576.49 ------------------------------------------------------ [ 0, 1 ] 23651 23.445% 23.445% ##### ( 1, 2 ] 63433 62.881% 86.326% ############# ( 2, 3 ] 7996 7.926% 94.252% ## ( 3, 4 ] 2953 2.927% 97.180% # ( 4, 6 ] 1979 1.962% 99.142% ( 6, 10 ] 660 0.654% 99.796% ( 10, 15 ] 86 0.085% 99.881% ( 15, 22 ] 14 0.014% 99.895% ( 22, 34 ] 4 0.004% 99.899% ( 34, 51 ] 47 0.047% 99.945% ( 51, 76 ] 9 0.009% 99.954% ( 76, 110 ] 4 0.004% 99.958% ( 110, 170 ] 8 0.008% 99.966% ( 170, 250 ] 11 0.011% 99.977% ( 250, 380 ] 8 0.008% 99.985% ( 380, 580 ] 5 0.005% 99.990% ( 580, 870 ] 6 0.006% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 508639 Average: 3.7230 StdDev: 37.00 Min: 0 Median: 1.7852 Max: 7014 Percentiles: P50: 1.79 P75: 2.64 P99: 8.98 P99.9: 147.06 P99.99: 263.14 ------------------------------------------------------ [ 0, 1 ] 31058 6.106% 6.106% # ( 1, 2 ] 284345 55.903% 62.009% ########### ( 2, 3 ] 103790 20.405% 82.415% #### ( 3, 4 ] 40043 7.873% 90.287% ## ( 4, 6 ] 37592 7.391% 97.678% # ( 6, 10 ] 9032 1.776% 99.454% ( 10, 15 ] 1484 0.292% 99.745% ( 15, 22 ] 183 0.036% 99.781% ( 22, 34 ] 33 0.006% 99.788% ( 34, 51 ] 13 0.003% 99.790% ( 51, 76 ] 18 0.004% 99.794% ( 76, 110 ] 297 0.058% 99.852% ( 110, 170 ] 394 0.077% 99.930% ( 170, 250 ] 285 0.056% 99.986% ( 250, 380 ] 219 0.043% 100.029% ( 380, 580 ] 161 0.032% 100.061% ( 580, 870 ] 97 0.019% 100.080% ( 870, 1300 ] 37 0.007% 100.087% ( 1300, 1900 ] 5 0.001% 100.088% ( 1900, 2900 ] 14 0.003% 100.091% ( 2900, 4400 ] 19 0.004% 100.094% ( 4400, 6600 ] 6 0.001% 100.096% ( 6600, 9900 ] 1 0.000% 100.096% ** Level 4 read latency histogram (micros): Count: 10005 Average: 129.6536 StdDev: 711.99 Min: 1 Median: 2.1462 Max: 20743 Percentiles: P50: 2.15 P75: 3.50 P99: 3286.29 P99.9: 6599.48 P99.99: 19332.67 ------------------------------------------------------ [ 0, 1 ] 162 1.619% 1.619% ( 1, 2 ] 4513 45.107% 46.727% ######### ( 2, 3 ] 2240 22.389% 69.115% #### ( 3, 4 ] 1186 11.854% 80.970% ## ( 4, 6 ] 685 6.847% 87.816% # ( 6, 10 ] 250 2.499% 90.315% ( 10, 15 ] 74 0.740% 91.054% ( 15, 22 ] 12 0.120% 91.174% ( 76, 110 ] 8 0.080% 91.254% ( 110, 170 ] 37 0.370% 91.624% ( 170, 250 ] 54 0.540% 92.164% ( 250, 380 ] 79 0.790% 92.954% ( 380, 580 ] 142 1.419% 94.373% ( 580, 870 ] 156 1.559% 95.932% ( 870, 1300 ] 130 1.299% 97.231% ( 1300, 1900 ] 67 0.670% 97.901% ( 1900, 2900 ] 86 0.860% 98.761% ( 2900, 4400 ] 93 0.930% 99.690% ( 4400, 6600 ] 21 0.210% 99.900% ( 6600, 9900 ] 4 0.040% 99.940% ( 9900, 14000 ] 1 0.010% 99.950% ( 14000, 22000 ] 6 0.060% 100.010% ** Level 5 read latency histogram (micros): Count: 100 Average: 1038.5600 StdDev: 1277.14 Min: 77 Median: 540.0000 Max: 6622 Percentiles: P50: 540.00 P75: 1300.00 P99: 6600.00 P99.9: 6622.00 P99.99: 6622.00 ------------------------------------------------------ ( 76, 110 ] 7 7.000% 7.000% # ( 110, 170 ] 15 15.000% 22.000% ### ( 170, 250 ] 13 13.000% 35.000% ### ( 250, 380 ] 11 11.000% 46.000% ## ( 380, 580 ] 5 5.000% 51.000% # ( 580, 870 ] 11 11.000% 62.000% ## ( 870, 1300 ] 13 13.000% 75.000% ### ( 1300, 1900 ] 9 9.000% 84.000% ## ( 1900, 2900 ] 7 7.000% 91.000% # ( 2900, 4400 ] 5 5.000% 96.000% # ( 4400, 6600 ] 3 3.000% 99.000% # ( 6600, 9900 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 33.2 total, 5.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 207.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.172 H:M:S, 42.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 173.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.788 H:M:S, 49.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/21-01:01:38 ... thread 0: (1000000,8000000) ops and (278984.0,218864.3) ops/second in (3.584435,36.552333) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 3.80 GB 119.5 8.1 0.0 8.1 15.7 7.6 0.0 2.1 149.7 289.0 55.53 50.99 135 0.411 8441K 13K 0.0 0.0 L1 9/9 1.03 GB 0.0 3.6 3.6 0.0 3.5 3.5 0.2 1.0 223.2 219.9 16.37 15.59 2 8.186 3709K 52K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.5 1.8 248.3 248.1 1.41 1.35 2 0.703 354K 192 0.0 0.0 L3 24/0 999.25 MB 1.0 3.9 2.5 1.4 3.9 2.5 0.2 1.6 199.6 199.2 20.20 17.46 9 2.244 4094K 9093 0.0 0.0 L4 184/0 9.54 GB 1.0 1.8 1.7 0.1 1.8 1.7 1.0 1.0 125.4 125.2 14.43 8.75 29 0.498 1799K 1632 0.0 0.0 L5 1072/0 88.28 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1303/19 103.63 GB 0.0 17.7 7.9 9.8 25.2 15.4 6.5 3.3 168.2 239.3 107.94 94.13 177 0.610 18M 77K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.7 7.9 9.8 25.2 15.4 6.5 3.3 168.2 239.3 107.94 94.13 177 0.610 18M 77K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.7 7.9 9.8 17.7 7.9 0.0 0.0 214.2 213.3 84.76 74.54 67 1.265 18M 77K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 334.4 23.17 19.60 110 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.8 total, 36.6 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.22 GB write, 702.57 MB/s write, 17.73 GB read, 493.93 MB/s read, 107.9 seconds Interval compaction: 25.22 GB write, 706.54 MB/s write, 17.73 GB read, 496.72 MB/s read, 107.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 45, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3398375 Average: 2.4971 StdDev: 19.64 Min: 0 Median: 1.5197 Max: 19269 Percentiles: P50: 1.52 P75: 1.91 P99: 6.45 P99.9: 79.93 P99.99: 213.30 ------------------------------------------------------ [ 0, 1 ] 555524 16.347% 16.347% ### ( 1, 2 ] 2200518 64.752% 81.099% ############# ( 2, 3 ] 376582 11.081% 92.180% ## ( 3, 4 ] 132165 3.889% 96.069% # ( 4, 6 ] 96466 2.839% 98.908% # ( 6, 10 ] 27928 0.822% 99.730% ( 10, 15 ] 4640 0.137% 99.866% ( 15, 22 ] 779 0.023% 99.889% ( 22, 34 ] 41 0.001% 99.890% ( 34, 51 ] 50 0.001% 99.892% ( 51, 76 ] 113 0.003% 99.895% ( 76, 110 ] 1484 0.044% 99.939% ( 110, 170 ] 1488 0.044% 99.982% ( 170, 250 ] 477 0.014% 99.996% ( 250, 380 ] 321 0.009% 100.006% ( 380, 580 ] 257 0.008% 100.013% ( 580, 870 ] 165 0.005% 100.018% ( 870, 1300 ] 71 0.002% 100.020% ( 1300, 1900 ] 26 0.001% 100.021% ( 1900, 2900 ] 22 0.001% 100.022% ( 2900, 4400 ] 26 0.001% 100.023% ( 4400, 6600 ] 2 0.000% 100.023% ( 6600, 9900 ] 1 0.000% 100.023% ( 14000, 22000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 646643 Average: 4.3485 StdDev: 68.33 Min: 0 Median: 1.8216 Max: 18754 Percentiles: P50: 1.82 P75: 2.65 P99: 8.99 P99.9: 163.16 P99.99: 427.41 ------------------------------------------------------ [ 0, 1 ] 13182 2.039% 2.039% ( 1, 2 ] 377491 58.377% 60.416% ############ ( 2, 3 ] 146189 22.607% 83.023% ##### ( 3, 4 ] 49150 7.601% 90.624% ## ( 4, 6 ] 44145 6.827% 97.451% # ( 6, 10 ] 13388 2.070% 99.521% ( 10, 15 ] 1796 0.278% 99.799% ( 15, 22 ] 246 0.038% 99.837% ( 22, 34 ] 14 0.002% 99.839% ( 34, 51 ] 3 0.000% 99.839% ( 51, 76 ] 4 0.001% 99.840% ( 76, 110 ] 127 0.020% 99.860% ( 110, 170 ] 295 0.046% 99.905% ( 170, 250 ] 245 0.038% 99.943% ( 250, 380 ] 250 0.039% 99.982% ( 380, 580 ] 225 0.035% 100.017% ( 580, 870 ] 148 0.023% 100.039% ( 870, 1300 ] 98 0.015% 100.055% ( 1300, 1900 ] 39 0.006% 100.061% ( 1900, 2900 ] 47 0.007% 100.068% ( 2900, 4400 ] 46 0.007% 100.075% ( 4400, 6600 ] 14 0.002% 100.077% ( 6600, 9900 ] 14 0.002% 100.079% ( 14000, 22000 ] 2 0.000% 100.080% ** Level 2 read latency histogram (micros): Count: 100878 Average: 2.2860 StdDev: 20.86 Min: 0 Median: 1.4223 Max: 4362 Percentiles: P50: 1.42 P75: 1.82 P99: 5.86 P99.9: 34.41 P99.99: 576.49 ------------------------------------------------------ [ 0, 1 ] 23651 23.445% 23.445% ##### ( 1, 2 ] 63433 62.881% 86.326% ############# ( 2, 3 ] 7996 7.926% 94.252% ## ( 3, 4 ] 2953 2.927% 97.180% # ( 4, 6 ] 1979 1.962% 99.142% ( 6, 10 ] 660 0.654% 99.796% ( 10, 15 ] 86 0.085% 99.881% ( 15, 22 ] 14 0.014% 99.895% ( 22, 34 ] 4 0.004% 99.899% ( 34, 51 ] 47 0.047% 99.945% ( 51, 76 ] 9 0.009% 99.954% ( 76, 110 ] 4 0.004% 99.958% ( 110, 170 ] 8 0.008% 99.966% ( 170, 250 ] 11 0.011% 99.977% ( 250, 380 ] 8 0.008% 99.985% ( 380, 580 ] 5 0.005% 99.990% ( 580, 870 ] 6 0.006% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 753261 Average: 4.2991 StdDev: 55.69 Min: 0 Median: 1.8605 Max: 7928 Percentiles: P50: 1.86 P75: 2.79 P99: 8.95 P99.9: 101.30 P99.99: 215.35 ------------------------------------------------------ [ 0, 1 ] 32658 4.336% 4.336% # ( 1, 2 ] 399724 53.066% 57.401% ########### ( 2, 3 ] 168092 22.315% 79.717% #### ( 3, 4 ] 68207 9.055% 88.771% ## ( 4, 6 ] 66703 8.855% 97.627% ## ( 6, 10 ] 14049 1.865% 99.492% ( 10, 15 ] 2489 0.330% 99.822% ( 15, 22 ] 283 0.038% 99.860% ( 22, 34 ] 36 0.005% 99.865% ( 34, 51 ] 14 0.002% 99.866% ( 51, 76 ] 25 0.003% 99.870% ( 76, 110 ] 306 0.041% 99.910% ( 110, 170 ] 416 0.055% 99.966% ( 170, 250 ] 324 0.043% 100.009% ( 250, 380 ] 270 0.036% 100.044% ( 380, 580 ] 260 0.035% 100.079% ( 580, 870 ] 194 0.026% 100.105% ( 870, 1300 ] 96 0.013% 100.117% ( 1300, 1900 ] 31 0.004% 100.122% ( 1900, 2900 ] 58 0.008% 100.129% ( 2900, 4400 ] 63 0.008% 100.138% ( 4400, 6600 ] 11 0.001% 100.139% ( 6600, 9900 ] 10 0.001% 100.140% ** Level 4 read latency histogram (micros): Count: 21262 Average: 96.3026 StdDev: 540.34 Min: 0 Median: 2.1287 Max: 20743 Percentiles: P50: 2.13 P75: 3.45 P99: 2462.54 P99.9: 5600.87 P99.99: 16498.40 ------------------------------------------------------ [ 0, 1 ] 374 1.759% 1.759% ( 1, 2 ] 9638 45.330% 47.089% ######### ( 2, 3 ] 4809 22.618% 69.707% ##### ( 3, 4 ] 2481 11.669% 81.375% ## ( 4, 6 ] 1462 6.876% 88.251% # ( 6, 10 ] 495 2.328% 90.579% ( 10, 15 ] 117 0.550% 91.130% ( 15, 22 ] 14 0.066% 91.196% ( 76, 110 ] 24 0.113% 91.308% ( 110, 170 ] 120 0.564% 91.873% ( 170, 250 ] 170 0.800% 92.672% ( 250, 380 ] 222 1.044% 93.716% ( 380, 580 ] 348 1.637% 95.353% ( 580, 870 ] 384 1.806% 97.159% ( 870, 1300 ] 223 1.049% 98.208% ( 1300, 1900 ] 102 0.480% 98.688% ( 1900, 2900 ] 118 0.555% 99.243% ( 2900, 4400 ] 125 0.588% 99.831% ( 4400, 6600 ] 27 0.127% 99.958% ( 6600, 9900 ] 4 0.019% 99.976% ( 9900, 14000 ] 1 0.005% 99.981% ( 14000, 22000 ] 6 0.028% 100.009% ** Level 5 read latency histogram (micros): Count: 160 Average: 1032.3125 StdDev: 1206.90 Min: 77 Median: 496.6667 Max: 6622 Percentiles: P50: 496.67 P75: 1441.18 P99: 6160.00 P99.9: 6622.00 P99.99: 6622.00 ------------------------------------------------------ ( 76, 110 ] 11 6.875% 6.875% # ( 110, 170 ] 23 14.375% 21.250% ### ( 170, 250 ] 24 15.000% 36.250% ### ( 250, 380 ] 15 9.375% 45.625% ## ( 380, 580 ] 12 7.500% 53.125% ## ( 580, 870 ] 14 8.750% 61.875% ## ( 870, 1300 ] 17 10.625% 72.500% ## ( 1300, 1900 ] 17 10.625% 83.125% ## ( 1900, 2900 ] 12 7.500% 90.625% ## ( 2900, 4400 ] 11 6.875% 97.500% # ( 4400, 6600 ] 3 1.875% 99.375% ( 6600, 9900 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 36.8 total, 3.6 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 214.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.942 H:M:S, 40.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.770 H:M:S, 21.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/21-01:01:41 ... thread 0: (1000000,9000000) ops and (311558.5,226346.7) ops/second in (3.209670,39.762003) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/10 4.79 GB 220.2 8.9 0.0 8.9 17.5 8.5 0.0 2.0 148.5 290.6 61.51 56.60 152 0.405 9273K 14K 0.0 0.0 L1 9/9 1.03 GB 0.0 3.6 3.6 0.0 3.5 3.5 0.2 1.0 223.2 219.9 16.37 15.59 2 8.186 3709K 52K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.5 1.8 248.3 248.1 1.41 1.35 2 0.703 354K 192 0.0 0.0 L3 24/0 999.25 MB 1.0 3.9 2.5 1.4 3.9 2.5 0.2 1.6 199.6 199.2 20.20 17.46 9 2.244 4094K 9093 0.0 0.0 L4 184/0 9.54 GB 1.0 1.8 1.7 0.1 1.8 1.7 1.0 1.0 125.4 125.2 14.43 8.75 29 0.498 1799K 1632 0.0 0.0 L5 1072/0 88.28 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1308/19 104.61 GB 0.0 18.5 7.9 10.6 27.0 16.4 6.5 3.2 166.6 242.8 113.91 99.74 194 0.587 19M 77K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.5 7.9 10.6 27.0 16.4 6.5 3.2 166.6 242.8 113.91 99.74 194 0.587 19M 77K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.5 7.9 10.6 18.5 7.9 0.0 0.0 215.9 215.0 87.90 77.62 70 1.256 19M 77K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 336.7 26.01 22.12 124 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.0 total, 39.8 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.00 GB write, 691.83 MB/s write, 18.53 GB read, 474.75 MB/s read, 113.9 seconds Interval compaction: 27.00 GB write, 695.43 MB/s write, 18.53 GB read, 477.22 MB/s read, 113.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 49, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3762793 Average: 2.4784 StdDev: 18.96 Min: 0 Median: 1.5225 Max: 19269 Percentiles: P50: 1.52 P75: 1.91 P99: 6.35 P99.9: 30.48 P99.99: 198.77 ------------------------------------------------------ [ 0, 1 ] 602724 16.018% 16.018% ### ( 1, 2 ] 2447127 65.035% 81.053% ############# ( 2, 3 ] 423337 11.251% 92.303% ## ( 3, 4 ] 144646 3.844% 96.148% # ( 4, 6 ] 104637 2.781% 98.928% # ( 6, 10 ] 30753 0.817% 99.746% ( 10, 15 ] 4954 0.132% 99.877% ( 15, 22 ] 819 0.022% 99.899% ( 22, 34 ] 47 0.001% 99.900% ( 34, 51 ] 52 0.001% 99.902% ( 51, 76 ] 120 0.003% 99.905% ( 76, 110 ] 1494 0.040% 99.945% ( 110, 170 ] 1528 0.041% 99.985% ( 170, 250 ] 497 0.013% 99.998% ( 250, 380 ] 330 0.009% 100.007% ( 380, 580 ] 274 0.007% 100.015% ( 580, 870 ] 174 0.005% 100.019% ( 870, 1300 ] 75 0.002% 100.021% ( 1300, 1900 ] 27 0.001% 100.022% ( 1900, 2900 ] 22 0.001% 100.022% ( 2900, 4400 ] 28 0.001% 100.023% ( 4400, 6600 ] 2 0.000% 100.023% ( 6600, 9900 ] 1 0.000% 100.023% ( 14000, 22000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 690470 Average: 4.2416 StdDev: 66.18 Min: 0 Median: 1.8022 Max: 18754 Percentiles: P50: 1.80 P75: 2.61 P99: 8.96 P99.9: 160.23 P99.99: 429.31 ------------------------------------------------------ [ 0, 1 ] 18051 2.614% 2.614% # ( 1, 2 ] 407842 59.067% 61.682% ############ ( 2, 3 ] 151789 21.983% 83.665% #### ( 3, 4 ] 50428 7.303% 90.968% # ( 4, 6 ] 45036 6.523% 97.491% # ( 6, 10 ] 14068 2.037% 99.528% ( 10, 15 ] 1823 0.264% 99.792% ( 15, 22 ] 249 0.036% 99.829% ( 22, 34 ] 15 0.002% 99.831% ( 34, 51 ] 3 0.000% 99.831% ( 51, 76 ] 14 0.002% 99.833% ( 76, 110 ] 197 0.029% 99.862% ( 110, 170 ] 316 0.046% 99.907% ( 170, 250 ] 253 0.037% 99.944% ( 250, 380 ] 260 0.038% 99.982% ( 380, 580 ] 231 0.033% 100.015% ( 580, 870 ] 150 0.022% 100.037% ( 870, 1300 ] 98 0.014% 100.051% ( 1300, 1900 ] 39 0.006% 100.057% ( 1900, 2900 ] 47 0.007% 100.064% ( 2900, 4400 ] 46 0.007% 100.070% ( 4400, 6600 ] 14 0.002% 100.072% ( 6600, 9900 ] 14 0.002% 100.074% ( 14000, 22000 ] 2 0.000% 100.075% ** Level 2 read latency histogram (micros): Count: 100878 Average: 2.2860 StdDev: 20.86 Min: 0 Median: 1.4223 Max: 4362 Percentiles: P50: 1.42 P75: 1.82 P99: 5.86 P99.9: 34.41 P99.99: 576.49 ------------------------------------------------------ [ 0, 1 ] 23651 23.445% 23.445% ##### ( 1, 2 ] 63433 62.881% 86.326% ############# ( 2, 3 ] 7996 7.926% 94.252% ## ( 3, 4 ] 2953 2.927% 97.180% # ( 4, 6 ] 1979 1.962% 99.142% ( 6, 10 ] 660 0.654% 99.796% ( 10, 15 ] 86 0.085% 99.881% ( 15, 22 ] 14 0.014% 99.895% ( 22, 34 ] 4 0.004% 99.899% ( 34, 51 ] 47 0.047% 99.945% ( 51, 76 ] 9 0.009% 99.954% ( 76, 110 ] 4 0.004% 99.958% ( 110, 170 ] 8 0.008% 99.966% ( 170, 250 ] 11 0.011% 99.977% ( 250, 380 ] 8 0.008% 99.985% ( 380, 580 ] 5 0.005% 99.990% ( 580, 870 ] 6 0.006% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 753261 Average: 4.2991 StdDev: 55.69 Min: 0 Median: 1.8605 Max: 7928 Percentiles: P50: 1.86 P75: 2.79 P99: 8.95 P99.9: 101.30 P99.99: 215.35 ------------------------------------------------------ [ 0, 1 ] 32658 4.336% 4.336% # ( 1, 2 ] 399724 53.066% 57.401% ########### ( 2, 3 ] 168092 22.315% 79.717% #### ( 3, 4 ] 68207 9.055% 88.771% ## ( 4, 6 ] 66703 8.855% 97.627% ## ( 6, 10 ] 14049 1.865% 99.492% ( 10, 15 ] 2489 0.330% 99.822% ( 15, 22 ] 283 0.038% 99.860% ( 22, 34 ] 36 0.005% 99.865% ( 34, 51 ] 14 0.002% 99.866% ( 51, 76 ] 25 0.003% 99.870% ( 76, 110 ] 306 0.041% 99.910% ( 110, 170 ] 416 0.055% 99.966% ( 170, 250 ] 324 0.043% 100.009% ( 250, 380 ] 270 0.036% 100.044% ( 380, 580 ] 260 0.035% 100.079% ( 580, 870 ] 194 0.026% 100.105% ( 870, 1300 ] 96 0.013% 100.117% ( 1300, 1900 ] 31 0.004% 100.122% ( 1900, 2900 ] 58 0.008% 100.129% ( 2900, 4400 ] 63 0.008% 100.138% ( 4400, 6600 ] 11 0.001% 100.139% ( 6600, 9900 ] 10 0.001% 100.140% ** Level 4 read latency histogram (micros): Count: 21262 Average: 96.3026 StdDev: 540.34 Min: 0 Median: 2.1287 Max: 20743 Percentiles: P50: 2.13 P75: 3.45 P99: 2462.54 P99.9: 5600.87 P99.99: 16498.40 ------------------------------------------------------ [ 0, 1 ] 374 1.759% 1.759% ( 1, 2 ] 9638 45.330% 47.089% ######### ( 2, 3 ] 4809 22.618% 69.707% ##### ( 3, 4 ] 2481 11.669% 81.375% ## ( 4, 6 ] 1462 6.876% 88.251% # ( 6, 10 ] 495 2.328% 90.579% ( 10, 15 ] 117 0.550% 91.130% ( 15, 22 ] 14 0.066% 91.196% ( 76, 110 ] 24 0.113% 91.308% ( 110, 170 ] 120 0.564% 91.873% ( 170, 250 ] 170 0.800% 92.672% ( 250, 380 ] 222 1.044% 93.716% ( 380, 580 ] 348 1.637% 95.353% ( 580, 870 ] 384 1.806% 97.159% ( 870, 1300 ] 223 1.049% 98.208% ( 1300, 1900 ] 102 0.480% 98.688% ( 1900, 2900 ] 118 0.555% 99.243% ( 2900, 4400 ] 125 0.588% 99.831% ( 4400, 6600 ] 27 0.127% 99.958% ( 6600, 9900 ] 4 0.019% 99.976% ( 9900, 14000 ] 1 0.005% 99.981% ( 14000, 22000 ] 6 0.028% 100.009% ** Level 5 read latency histogram (micros): Count: 160 Average: 1032.3125 StdDev: 1206.90 Min: 77 Median: 496.6667 Max: 6622 Percentiles: P50: 496.67 P75: 1441.18 P99: 6160.00 P99.9: 6622.00 P99.99: 6622.00 ------------------------------------------------------ ( 76, 110 ] 11 6.875% 6.875% # ( 110, 170 ] 23 14.375% 21.250% ### ( 170, 250 ] 24 15.000% 36.250% ### ( 250, 380 ] 15 9.375% 45.625% ## ( 380, 580 ] 12 7.500% 53.125% ## ( 580, 870 ] 14 8.750% 61.875% ## ( 870, 1300 ] 17 10.625% 72.500% ## ( 1300, 1900 ] 17 10.625% 83.125% ## ( 1900, 2900 ] 12 7.500% 90.625% ## ( 2900, 4400 ] 11 6.875% 97.500% # ( 4400, 6600 ] 3 1.875% 99.375% ( 6600, 9900 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 40.0 total, 3.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 221.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.516 H:M:S, 38.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 306.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.574 H:M:S, 17.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.287 micros/op 159048 ops/sec 60.164 seconds 9568999 operations; 154.1 MB/s Microseconds per write: Count: 9568999 Average: 6.2874 StdDev: 350.05 Min: 0 Median: 1.7415 Max: 623577 Percentiles: P50: 1.74 P75: 2.77 P99: 8.90 P99.9: 1195.76 P99.99: 2732.59 ------------------------------------------------------ [ 0, 1 ] 1279693 13.373% 13.373% ### ( 1, 2 ] 4726573 49.395% 62.768% ########## ( 2, 3 ] 1520642 15.891% 78.659% ### ( 3, 4 ] 1337744 13.980% 92.639% ### ( 4, 6 ] 534784 5.589% 98.228% # ( 6, 10 ] 102040 1.066% 99.294% ( 10, 15 ] 25653 0.268% 99.562% ( 15, 22 ] 7226 0.076% 99.638% ( 22, 34 ] 1474 0.015% 99.653% ( 34, 51 ] 183 0.002% 99.655% ( 51, 76 ] 38 0.000% 99.656% ( 76, 110 ] 6438 0.067% 99.723% ( 110, 170 ] 2838 0.030% 99.753% ( 170, 250 ] 330 0.003% 99.756% ( 250, 380 ] 106 0.001% 99.757% ( 380, 580 ] 29 0.000% 99.757% ( 580, 870 ] 32 0.000% 99.758% ( 870, 1300 ] 17961 0.188% 99.946% ( 1300, 1900 ] 66 0.001% 99.946% ( 1900, 2900 ] 5035 0.053% 99.999% ( 2900, 4400 ] 73 0.001% 100.000% ( 4400, 6600 ] 13 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 194365 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9568999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9875206968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 542 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33867560 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30465840105 rocksdb.compact.write.bytes COUNT : 30279898703 rocksdb.flush.write.bytes COUNT : 9842578809 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 52 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 268 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9763183616 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3767296 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30556125293 rocksdb.non.last.level.read.count COUNT : 7384016 rocksdb.block.checksum.compute.count COUNT : 7382984 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.384192 P95 : 3.906166 P99 : 7.465863 P100 : 623575.000000 COUNT : 9568999 SUM : 55676222 rocksdb.compaction.times.micros P50 : 866071.428571 P95 : 3635000.000000 P99 : 15846253.000000 P100 : 15846253.000000 COUNT : 97 SUM : 123312363 rocksdb.compaction.times.cpu_micros P50 : 787500.000000 P95 : 3302500.000000 P99 : 14775232.000000 P100 : 14775232.000000 COUNT : 97 SUM : 108022966 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 716.470588 P95 : 1360.000000 P99 : 8778.000000 P100 : 145456.000000 COUNT : 134 SUM : 248294 rocksdb.compaction.outfile.sync.micros P50 : 984.218750 P95 : 34983.333333 P99 : 175400.000000 P100 : 213611.000000 COUNT : 373 SUM : 2886494 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 100.555556 P95 : 1195.571429 P99 : 2630.000000 P100 : 3212.000000 COUNT : 254 SUM : 62871 rocksdb.table.open.io.micros P50 : 1144.065934 P95 : 6513.571429 P99 : 11411.142857 P100 : 14647.000000 COUNT : 542 SUM : 1005872 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.629009 P95 : 7.485159 P99 : 9.981032 P100 : 20747.000000 COUNT : 7381592 SUM : 40639338 rocksdb.read.block.get.micros P50 : 363.507463 P95 : 3102.325581 P99 : 5247.000000 P100 : 6688.000000 COUNT : 1084 SUM : 819783 rocksdb.write.raw.block.micros P50 : 0.512683 P95 : 0.974099 P99 : 2.949855 P100 : 28489.000000 COUNT : 9717777 SUM : 18507136 rocksdb.numfiles.in.singlecompaction P50 : 3.000000 P95 : 5.800000 P99 : 14.533333 P100 : 29.000000 COUNT : 128 SUM : 457 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560015 P95 : 1164.190549 P99 : 2485.179211 P100 : 623385.000000 COUNT : 216523 SUM : 33884660 rocksdb.sst.read.micros P50 : 1.581983 P95 : 4.441376 P99 : 7.941541 P100 : 20743.000000 COUNT : 7384320 SUM : 25476762 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9568999 SUM : 9875206968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 209587.628866 P95 : 347933.333333 P99 : 665700.000000 P100 : 801942.000000 COUNT : 134 SUM : 27793235 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 335 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0