[2024-11-28 06:01:48.721299] Starting SPDK v25.01-pre git sha1 35cd3e84d / DPDK 22.11.4 initialization... [2024-11-28 06:01:48.721402] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3553176 ] Set seed to 1732770108718976 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-28 06:01:48.811962] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-28 06:01:48.834486] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-28 06:01:48.834532] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3553176' to capture a snapshot of events at runtime. [2024-11-28 06:01:48.834542] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-28 06:01:48.834553] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-28 06:01:48.834561] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3553176 for offline analysis/debug. [2024-11-28 06:01:48.835107] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Nov 28 06:01:53 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/28-06:01:56 ... thread 0: (1000000,1000000) ops and (336957.5,336957.5) ops/second in (2.967733,2.967733) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.96 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 351.0 2.51 2.27 12 0.209 0 0 0.0 0.0 L1 3/3 251.72 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 259.0 258.8 0.97 0.95 1 0.973 255K 215 0.0 0.0 L2 1/0 48.91 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 221.0 221.0 0.50 0.48 1 0.504 113K 26 0.0 0.0 L3 16/0 755.45 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 217.8 217.9 0.29 0.24 1 0.287 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 99.6 305.8 4.28 3.94 15 0.285 432K 241 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 99.6 305.8 4.28 3.94 15 0.285 432K 241 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 241.5 241.3 1.76 1.67 3 0.588 432K 241 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 351.0 2.51 2.27 12 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 408.63 MB/s write, 0.42 GB read, 133.10 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 440.40 MB/s write, 0.42 GB read, 143.45 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 105643 Average: 1.7596 StdDev: 13.85 Min: 0 Median: 1.1414 Max: 2984 Percentiles: P50: 1.14 P75: 1.60 P99: 3.48 P99.9: 9.06 P99.99: 287.33 ------------------------------------------------------ [ 0, 1 ] 44725 42.336% 42.336% ######## ( 1, 2 ] 57240 54.182% 96.518% ########### ( 2, 3 ] 2217 2.099% 98.617% ( 3, 4 ] 848 0.803% 99.420% ( 4, 6 ] 340 0.322% 99.742% ( 6, 10 ] 219 0.207% 99.949% ( 10, 15 ] 24 0.023% 99.972% ( 15, 22 ] 4 0.004% 99.975% ( 22, 34 ] 1 0.001% 99.976% ( 110, 170 ] 5 0.005% 99.981% ( 170, 250 ] 8 0.008% 99.989% ( 250, 380 ] 5 0.005% 99.993% ( 380, 580 ] 3 0.003% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 1 read latency histogram (micros): Count: 32837 Average: 2.2959 StdDev: 20.58 Min: 0 Median: 1.1746 Max: 1796 Percentiles: P50: 1.17 P75: 1.64 P99: 5.26 P99.9: 184.88 P99.99: 1178.01 ------------------------------------------------------ [ 0, 1 ] 13333 40.604% 40.604% ######## ( 1, 2 ] 17674 53.823% 94.427% ########### ( 2, 3 ] 1102 3.356% 97.783% # ( 3, 4 ] 284 0.865% 98.648% ( 4, 6 ] 183 0.557% 99.205% ( 6, 10 ] 144 0.439% 99.644% ( 10, 15 ] 22 0.067% 99.711% ( 15, 22 ] 9 0.027% 99.738% ( 34, 51 ] 30 0.091% 99.829% ( 51, 76 ] 7 0.021% 99.851% ( 76, 110 ] 8 0.024% 99.875% ( 110, 170 ] 5 0.015% 99.890% ( 170, 250 ] 17 0.052% 99.942% ( 250, 380 ] 8 0.024% 99.967% ( 380, 580 ] 3 0.009% 99.976% ( 580, 870 ] 4 0.012% 99.988% ( 870, 1300 ] 1 0.003% 99.991% ( 1300, 1900 ] 3 0.009% 100.000% ** Level 2 read latency histogram (micros): Count: 15880 Average: 1.7641 StdDev: 3.94 Min: 0 Median: 1.1666 Max: 327 Percentiles: P50: 1.17 P75: 1.64 P99: 4.83 P99.9: 9.44 P99.99: 276.78 ------------------------------------------------------ [ 0, 1 ] 6547 41.228% 41.228% ######## ( 1, 2 ] 8359 52.639% 93.866% ########### ( 2, 3 ] 541 3.407% 97.273% # ( 3, 4 ] 207 1.304% 98.577% ( 4, 6 ] 162 1.020% 99.597% ( 6, 10 ] 56 0.353% 99.950% ( 10, 15 ] 3 0.019% 99.969% ( 15, 22 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 679.2750 StdDev: 975.20 Min: 1 Median: 51.0000 Max: 4695 Percentiles: P50: 51.00 P75: 1246.25 P99: 4695.00 P99.9: 4695.00 P99.99: 4695.00 ------------------------------------------------------ [ 0, 1 ] 20 25.000% 25.000% ##### ( 1, 2 ] 15 18.750% 43.750% #### ( 2, 3 ] 2 2.500% 46.250% # ( 3, 4 ] 1 1.250% 47.500% ( 34, 51 ] 2 2.500% 50.000% # ( 51, 76 ] 2 2.500% 52.500% # ( 170, 250 ] 2 2.500% 55.000% # ( 250, 380 ] 4 5.000% 60.000% # ( 380, 580 ] 3 3.750% 63.750% # ( 580, 870 ] 2 2.500% 66.250% # ( 870, 1300 ] 8 10.000% 76.250% ## ( 1300, 1900 ] 9 11.250% 87.500% ## ( 1900, 2900 ] 8 10.000% 97.500% ## ( 2900, 4400 ] 1 1.250% 98.750% ( 4400, 6600 ] 1 1.250% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1649.3714 StdDev: 1234.99 Min: 121 Median: 1202.2727 Max: 4556 Percentiles: P50: 1202.27 P75: 1962.50 P99: 4556.00 P99.9: 4556.00 P99.99: 4556.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 1 2.857% 8.571% # ( 580, 870 ] 6 17.143% 25.714% ### ( 870, 1300 ] 11 31.429% 57.143% ###### ( 1300, 1900 ] 6 17.143% 74.286% ### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 2 5.714% 91.429% # ( 4400, 6600 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 307.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.363 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.363 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-06:01:58 ... thread 0: (1000000,2000000) ops and (348501.8,342632.4) ops/second in (2.869426,5.837159) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.17 GB 62.9 0.6 0.0 0.6 2.3 1.8 0.0 1.3 77.0 324.9 7.37 6.78 28 0.263 575K 588 0.0 0.0 L1 2/0 50.34 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.9 246.5 3.32 3.23 2 1.658 831K 1473 0.0 0.0 L2 5/4 563.97 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.6 1.8 221.0 221.0 0.50 0.48 1 0.504 113K 26 0.0 0.0 L3 16/9 755.45 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 217.8 217.9 0.29 0.24 1 0.287 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1194/21 97.92 GB 0.0 1.5 0.6 0.9 3.3 2.4 0.7 1.9 135.9 295.0 11.47 10.73 32 0.359 1583K 2087 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.3 2.4 0.6 1.9 135.9 295.0 11.47 10.73 32 0.359 1583K 2087 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 248.2 247.8 6.28 6.08 6 1.047 1583K 2087 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.1 5.19 4.65 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.30 GB write, 557.60 MB/s write, 1.52 GB read, 256.96 MB/s read, 11.5 seconds Interval compaction: 3.30 GB write, 579.64 MB/s write, 1.52 GB read, 267.12 MB/s read, 11.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 390640 Average: 2.1431 StdDev: 9.17 Min: 0 Median: 1.4645 Max: 2984 Percentiles: P50: 1.46 P75: 1.86 P99: 5.62 P99.9: 9.84 P99.99: 14.54 ------------------------------------------------------ [ 0, 1 ] 81038 20.745% 20.745% #### ( 1, 2 ] 246049 62.986% 83.731% ############# ( 2, 3 ] 38303 9.805% 93.536% ## ( 3, 4 ] 14027 3.591% 97.127% # ( 4, 6 ] 9036 2.313% 99.440% ( 6, 10 ] 1872 0.479% 99.919% ( 10, 15 ] 306 0.078% 99.998% ( 15, 22 ] 31 0.008% 100.006% ( 22, 34 ] 4 0.001% 100.007% ( 34, 51 ] 2 0.001% 100.007% ( 51, 76 ] 3 0.001% 100.008% ( 110, 170 ] 8 0.002% 100.010% ( 170, 250 ] 18 0.005% 100.015% ( 250, 380 ] 12 0.003% 100.018% ( 380, 580 ] 7 0.002% 100.019% ( 580, 870 ] 6 0.002% 100.021% ( 870, 1300 ] 3 0.001% 100.022% ( 1900, 2900 ] 1 0.000% 100.022% ( 2900, 4400 ] 2 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 128416 Average: 2.4126 StdDev: 12.97 Min: 0 Median: 1.5410 Max: 1812 Percentiles: P50: 1.54 P75: 1.95 P99: 5.90 P99.9: 14.41 P99.99: 537.91 ------------------------------------------------------ [ 0, 1 ] 21574 16.800% 16.800% ### ( 1, 2 ] 78813 61.373% 78.173% ############ ( 2, 3 ] 17427 13.571% 91.744% ### ( 3, 4 ] 5197 4.047% 95.791% # ( 4, 6 ] 4350 3.387% 99.178% # ( 6, 10 ] 850 0.662% 99.840% ( 10, 15 ] 88 0.069% 99.909% ( 15, 22 ] 18 0.014% 99.923% ( 22, 34 ] 1 0.001% 99.924% ( 34, 51 ] 31 0.024% 99.948% ( 51, 76 ] 9 0.007% 99.955% ( 76, 110 ] 8 0.006% 99.961% ( 110, 170 ] 6 0.005% 99.966% ( 170, 250 ] 18 0.014% 99.980% ( 250, 380 ] 11 0.009% 99.988% ( 380, 580 ] 4 0.003% 99.991% ( 580, 870 ] 5 0.004% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 5 0.004% 100.001% ** Level 2 read latency histogram (micros): Count: 15931 Average: 1.7674 StdDev: 3.93 Min: 0 Median: 1.1693 Max: 327 Percentiles: P50: 1.17 P75: 1.64 P99: 4.84 P99.9: 9.43 P99.99: 276.45 ------------------------------------------------------ [ 0, 1 ] 6547 41.096% 41.096% ######## ( 1, 2 ] 8381 52.608% 93.704% ########### ( 2, 3 ] 563 3.534% 97.238% # ( 3, 4 ] 211 1.324% 98.563% ( 4, 6 ] 165 1.036% 99.598% ( 6, 10 ] 56 0.352% 99.950% ( 10, 15 ] 3 0.019% 99.969% ( 15, 22 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 79055 Average: 4.0062 StdDev: 41.67 Min: 1 Median: 1.7027 Max: 4695 Percentiles: P50: 1.70 P75: 2.36 P99: 9.27 P99.9: 326.66 P99.99: 1725.67 ------------------------------------------------------ [ 0, 1 ] 5415 6.850% 6.850% # ( 1, 2 ] 48547 61.409% 68.259% ############ ( 2, 3 ] 14605 18.474% 86.733% #### ( 3, 4 ] 4608 5.829% 92.562% # ( 4, 6 ] 3914 4.951% 97.513% # ( 6, 10 ] 1436 1.816% 99.330% ( 10, 15 ] 166 0.210% 99.540% ( 15, 22 ] 34 0.043% 99.583% ( 22, 34 ] 17 0.022% 99.604% ( 34, 51 ] 5 0.006% 99.610% ( 51, 76 ] 4 0.005% 99.615% ( 76, 110 ] 27 0.034% 99.650% ( 110, 170 ] 122 0.154% 99.804% ( 170, 250 ] 50 0.063% 99.867% ( 250, 380 ] 44 0.056% 99.923% ( 380, 580 ] 21 0.027% 99.949% ( 580, 870 ] 13 0.016% 99.966% ( 870, 1300 ] 12 0.015% 99.981% ( 1300, 1900 ] 10 0.013% 99.994% ( 1900, 2900 ] 8 0.010% 100.004% ( 2900, 4400 ] 1 0.001% 100.005% ( 4400, 6600 ] 1 0.001% 100.006% ** Level 4 read latency histogram (micros): Count: 35 Average: 1649.3714 StdDev: 1234.99 Min: 121 Median: 1202.2727 Max: 4556 Percentiles: P50: 1202.27 P75: 1962.50 P99: 4556.00 P99.9: 4556.00 P99.99: 4556.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 1 2.857% 8.571% # ( 580, 870 ] 6 17.143% 25.714% ### ( 870, 1300 ] 11 31.429% 57.143% ###### ( 1300, 1900 ] 6 17.143% 74.286% ### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 2 5.714% 91.429% # ( 4400, 6600 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 6.1 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.575 H:M:S, 9.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 342.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.212 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/28-06:02:02 ... thread 0: (1000000,3000000) ops and (325679.8,336788.8) ops/second in (3.070501,8.907660) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 2.09 GB 18.9 1.7 0.0 1.7 4.4 2.7 0.0 1.6 117.4 308.5 14.49 13.46 45 0.322 1727K 1819 0.0 0.0 L1 2/2 50.34 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.9 246.5 3.32 3.23 2 1.658 831K 1473 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 221.0 221.0 0.50 0.48 1 0.504 113K 26 0.0 0.0 L3 27/0 966.65 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 216.2 216.1 6.47 5.73 4 1.617 1399K 700 0.0 0.0 L4 148/0 9.63 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1237/11 98.84 GB 0.0 3.9 1.2 2.8 6.6 3.9 1.3 2.5 162.6 274.3 24.78 22.90 52 0.477 4070K 4018 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.2 2.8 6.6 3.9 1.3 2.5 162.6 274.3 24.78 22.90 52 0.477 4070K 4018 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.2 2.8 3.9 1.2 0.0 0.0 238.9 238.6 16.87 15.89 13 1.298 4070K 4018 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 350.5 7.91 7.01 39 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.64 GB write, 743.72 MB/s write, 3.94 GB read, 440.92 MB/s read, 24.8 seconds Interval compaction: 6.64 GB write, 762.99 MB/s write, 3.94 GB read, 452.35 MB/s read, 24.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 628769 Average: 2.2329 StdDev: 13.74 Min: 0 Median: 1.4844 Max: 4475 Percentiles: P50: 1.48 P75: 1.88 P99: 5.66 P99.9: 9.89 P99.99: 20.00 ------------------------------------------------------ [ 0, 1 ] 122890 19.545% 19.545% #### ( 1, 2 ] 395357 62.878% 82.422% ############# ( 2, 3 ] 65911 10.483% 92.905% ## ( 3, 4 ] 24782 3.941% 96.846% # ( 4, 6 ] 16295 2.592% 99.438% # ( 6, 10 ] 2986 0.475% 99.913% ( 10, 15 ] 448 0.071% 99.984% ( 15, 22 ] 52 0.008% 99.992% ( 22, 34 ] 8 0.001% 99.994% ( 34, 51 ] 3 0.000% 99.994% ( 51, 76 ] 5 0.001% 99.995% ( 76, 110 ] 7 0.001% 99.996% ( 110, 170 ] 30 0.005% 100.001% ( 170, 250 ] 40 0.006% 100.007% ( 250, 380 ] 21 0.003% 100.010% ( 380, 580 ] 23 0.004% 100.014% ( 580, 870 ] 15 0.002% 100.017% ( 870, 1300 ] 9 0.001% 100.018% ( 1300, 1900 ] 1 0.000% 100.018% ( 1900, 2900 ] 3 0.000% 100.019% ( 2900, 4400 ] 5 0.001% 100.019% ( 4400, 6600 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 207032 Average: 2.4608 StdDev: 10.24 Min: 0 Median: 1.6195 Max: 1812 Percentiles: P50: 1.62 P75: 2.09 P99: 5.91 P99.9: 12.91 P99.99: 324.42 ------------------------------------------------------ [ 0, 1 ] 24499 11.833% 11.833% ## ( 1, 2 ] 127556 61.612% 73.445% ############ ( 2, 3 ] 34291 16.563% 90.008% ### ( 3, 4 ] 10234 4.943% 94.952% # ( 4, 6 ] 8754 4.228% 99.180% # ( 6, 10 ] 1384 0.668% 99.848% ( 10, 15 ] 184 0.089% 99.937% ( 15, 22 ] 28 0.014% 99.951% ( 22, 34 ] 2 0.001% 99.952% ( 34, 51 ] 32 0.015% 99.967% ( 51, 76 ] 9 0.004% 99.972% ( 76, 110 ] 8 0.004% 99.975% ( 110, 170 ] 6 0.003% 99.978% ( 170, 250 ] 18 0.009% 99.987% ( 250, 380 ] 11 0.005% 99.992% ( 380, 580 ] 4 0.002% 99.994% ( 580, 870 ] 5 0.002% 99.997% ( 870, 1300 ] 2 0.001% 99.998% ( 1300, 1900 ] 5 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 28300 Average: 2.0876 StdDev: 3.05 Min: 0 Median: 1.4314 Max: 327 Percentiles: P50: 1.43 P75: 1.87 P99: 5.63 P99.9: 9.42 P99.99: 183.60 ------------------------------------------------------ [ 0, 1 ] 7122 25.166% 25.166% ##### ( 1, 2 ] 16291 57.565% 82.731% ############ ( 2, 3 ] 2629 9.290% 92.021% ## ( 3, 4 ] 1278 4.516% 96.537% # ( 4, 6 ] 856 3.025% 99.562% # ( 6, 10 ] 112 0.396% 99.958% ( 10, 15 ] 7 0.025% 99.982% ( 15, 22 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 196565 Average: 3.5339 StdDev: 30.22 Min: 1 Median: 1.6733 Max: 4695 Percentiles: P50: 1.67 P75: 2.26 P99: 8.99 P99.9: 250.65 P99.99: 902.09 ------------------------------------------------------ [ 0, 1 ] 14573 7.414% 7.414% # ( 1, 2 ] 124319 63.246% 70.660% ############# ( 2, 3 ] 32912 16.744% 87.403% ### ( 3, 4 ] 11568 5.885% 93.288% # ( 4, 6 ] 8650 4.401% 97.689% # ( 6, 10 ] 3453 1.757% 99.445% ( 10, 15 ] 329 0.167% 99.613% ( 15, 22 ] 58 0.030% 99.642% ( 22, 34 ] 23 0.012% 99.654% ( 34, 51 ] 11 0.006% 99.660% ( 51, 76 ] 36 0.018% 99.678% ( 76, 110 ] 98 0.050% 99.728% ( 110, 170 ] 220 0.112% 99.840% ( 170, 250 ] 118 0.060% 99.900% ( 250, 380 ] 87 0.044% 99.944% ( 380, 580 ] 54 0.027% 99.972% ( 580, 870 ] 35 0.018% 99.989% ( 870, 1300 ] 18 0.009% 99.998% ( 1300, 1900 ] 13 0.007% 100.005% ( 1900, 2900 ] 8 0.004% 100.009% ( 2900, 4400 ] 1 0.001% 100.010% ( 4400, 6600 ] 1 0.001% 100.010% ** Level 4 read latency histogram (micros): Count: 35 Average: 1649.3714 StdDev: 1234.99 Min: 121 Median: 1202.2727 Max: 4556 Percentiles: P50: 1202.27 P75: 1962.50 P99: 4556.00 P99.9: 4556.00 P99.99: 4556.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 1 2.857% 8.571% # ( 580, 870 ] 6 17.143% 25.714% ### ( 870, 1300 ] 11 31.429% 57.143% ###### ( 1300, 1900 ] 6 17.143% 74.286% ### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 2 5.714% 91.429% # ( 4400, 6600 ] 3 8.571% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 718.6000 StdDev: 773.50 Min: 117 Median: 347.5000 Max: 3114 Percentiles: P50: 347.50 P75: 870.00 P99: 3114.00 P99.9: 3114.00 P99.99: 3114.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 3 15.000% 35.000% ### ( 250, 380 ] 4 20.000% 55.000% #### ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.978 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.403 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-06:02:05 ... thread 0: (1000000,4000000) ops and (283572.7,321696.2) ops/second in (3.526433,12.434093) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.13 GB 100.7 2.5 0.0 2.5 6.2 3.7 0.0 1.7 121.7 307.1 20.71 19.24 63 0.329 2558K 2647 0.0 0.0 L1 2/2 50.34 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.9 246.5 3.32 3.23 2 1.658 831K 1473 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 221.0 221.0 0.50 0.48 1 0.504 113K 26 0.0 0.0 L3 27/0 966.65 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 216.2 216.1 6.47 5.73 4 1.617 1399K 700 0.0 0.0 L4 148/0 9.63 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1243/15 99.88 GB 0.0 4.7 1.2 3.6 8.5 4.9 1.3 2.3 156.4 280.2 31.00 28.68 70 0.443 4902K 4846 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 1.2 3.6 8.5 4.9 1.3 2.3 156.4 280.2 31.00 28.68 70 0.443 4902K 4846 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 1.2 3.6 4.7 1.2 0.0 0.0 242.8 242.5 19.97 18.91 16 1.248 4902K 4846 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 348.6 11.02 9.77 54 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.7 total, 12.4 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.48 GB write, 685.80 MB/s write, 4.74 GB read, 382.82 MB/s read, 31.0 seconds Interval compaction: 8.48 GB write, 698.53 MB/s write, 4.74 GB read, 389.93 MB/s read, 31.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 20, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1075617 Average: 2.2424 StdDev: 12.04 Min: 0 Median: 1.5026 Max: 4475 Percentiles: P50: 1.50 P75: 1.89 P99: 5.65 P99.9: 9.97 P99.99: 82.86 ------------------------------------------------------ [ 0, 1 ] 187480 17.430% 17.430% ### ( 1, 2 ] 697096 64.809% 82.239% ############# ( 2, 3 ] 120060 11.162% 93.401% ## ( 3, 4 ] 39716 3.692% 97.093% # ( 4, 6 ] 24801 2.306% 99.399% ( 6, 10 ] 5428 0.505% 99.904% ( 10, 15 ] 820 0.076% 99.980% ( 15, 22 ] 84 0.008% 99.988% ( 22, 34 ] 10 0.001% 99.989% ( 34, 51 ] 6 0.001% 99.989% ( 51, 76 ] 7 0.001% 99.990% ( 76, 110 ] 22 0.002% 99.992% ( 110, 170 ] 130 0.012% 100.004% ( 170, 250 ] 65 0.006% 100.010% ( 250, 380 ] 36 0.003% 100.013% ( 380, 580 ] 32 0.003% 100.016% ( 580, 870 ] 23 0.002% 100.019% ( 870, 1300 ] 12 0.001% 100.020% ( 1300, 1900 ] 6 0.001% 100.020% ( 1900, 2900 ] 5 0.000% 100.021% ( 2900, 4400 ] 5 0.000% 100.021% ( 4400, 6600 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 207032 Average: 2.4608 StdDev: 10.24 Min: 0 Median: 1.6195 Max: 1812 Percentiles: P50: 1.62 P75: 2.09 P99: 5.91 P99.9: 12.91 P99.99: 324.42 ------------------------------------------------------ [ 0, 1 ] 24499 11.833% 11.833% ## ( 1, 2 ] 127556 61.612% 73.445% ############ ( 2, 3 ] 34291 16.563% 90.008% ### ( 3, 4 ] 10234 4.943% 94.952% # ( 4, 6 ] 8754 4.228% 99.180% # ( 6, 10 ] 1384 0.668% 99.848% ( 10, 15 ] 184 0.089% 99.937% ( 15, 22 ] 28 0.014% 99.951% ( 22, 34 ] 2 0.001% 99.952% ( 34, 51 ] 32 0.015% 99.967% ( 51, 76 ] 9 0.004% 99.972% ( 76, 110 ] 8 0.004% 99.975% ( 110, 170 ] 6 0.003% 99.978% ( 170, 250 ] 18 0.009% 99.987% ( 250, 380 ] 11 0.005% 99.992% ( 380, 580 ] 4 0.002% 99.994% ( 580, 870 ] 5 0.002% 99.997% ( 870, 1300 ] 2 0.001% 99.998% ( 1300, 1900 ] 5 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 28300 Average: 2.0876 StdDev: 3.05 Min: 0 Median: 1.4314 Max: 327 Percentiles: P50: 1.43 P75: 1.87 P99: 5.63 P99.9: 9.42 P99.99: 183.60 ------------------------------------------------------ [ 0, 1 ] 7122 25.166% 25.166% ##### ( 1, 2 ] 16291 57.565% 82.731% ############ ( 2, 3 ] 2629 9.290% 92.021% ## ( 3, 4 ] 1278 4.516% 96.537% # ( 4, 6 ] 856 3.025% 99.562% # ( 6, 10 ] 112 0.396% 99.958% ( 10, 15 ] 7 0.025% 99.982% ( 15, 22 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 196565 Average: 3.5339 StdDev: 30.22 Min: 1 Median: 1.6733 Max: 4695 Percentiles: P50: 1.67 P75: 2.26 P99: 8.99 P99.9: 250.65 P99.99: 902.09 ------------------------------------------------------ [ 0, 1 ] 14573 7.414% 7.414% # ( 1, 2 ] 124319 63.246% 70.660% ############# ( 2, 3 ] 32912 16.744% 87.403% ### ( 3, 4 ] 11568 5.885% 93.288% # ( 4, 6 ] 8650 4.401% 97.689% # ( 6, 10 ] 3453 1.757% 99.445% ( 10, 15 ] 329 0.167% 99.613% ( 15, 22 ] 58 0.030% 99.642% ( 22, 34 ] 23 0.012% 99.654% ( 34, 51 ] 11 0.006% 99.660% ( 51, 76 ] 36 0.018% 99.678% ( 76, 110 ] 98 0.050% 99.728% ( 110, 170 ] 220 0.112% 99.840% ( 170, 250 ] 118 0.060% 99.900% ( 250, 380 ] 87 0.044% 99.944% ( 380, 580 ] 54 0.027% 99.972% ( 580, 870 ] 35 0.018% 99.989% ( 870, 1300 ] 18 0.009% 99.998% ( 1300, 1900 ] 13 0.007% 100.005% ( 1900, 2900 ] 8 0.004% 100.009% ( 2900, 4400 ] 1 0.001% 100.010% ( 4400, 6600 ] 1 0.001% 100.010% ** Level 4 read latency histogram (micros): Count: 35 Average: 1649.3714 StdDev: 1234.99 Min: 121 Median: 1202.2727 Max: 4556 Percentiles: P50: 1202.27 P75: 1962.50 P99: 4556.00 P99.9: 4556.00 P99.99: 4556.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 1 2.857% 8.571% # ( 580, 870 ] 6 17.143% 25.714% ### ( 870, 1300 ] 11 31.429% 57.143% ###### ( 1300, 1900 ] 6 17.143% 74.286% ### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 2 5.714% 91.429% # ( 4400, 6600 ] 3 8.571% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 718.6000 StdDev: 773.50 Min: 117 Median: 347.5000 Max: 3114 Percentiles: P50: 347.50 P75: 870.00 P99: 3114.00 P99.9: 3114.00 P99.99: 3114.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 3 15.000% 35.000% ### ( 250, 380 ] 4 20.000% 55.000% #### ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 3 15.000% 75.000% ### ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.7 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 310.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.816 H:M:S, 14.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 279.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.838 H:M:S, 23.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-06:02:10 ... thread 0: (1000000,5000000) ops and (202494.5,287811.2) ops/second in (4.938405,17.372498) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/5 2.15 GB 113.3 3.4 0.0 3.4 8.1 4.7 0.0 1.7 129.5 305.2 27.23 25.41 82 0.332 3582K 3658 0.0 0.0 L1 14/0 953.02 MB 95.3 2.8 2.4 0.4 2.7 2.4 0.1 1.1 235.4 233.8 11.98 11.56 3 3.993 2863K 19K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.6 1.8 221.0 221.0 0.50 0.48 1 0.504 113K 26 0.0 0.0 L3 19/5 1.19 GB 0.9 1.4 0.6 0.8 1.4 0.6 1.0 2.2 216.2 216.1 6.47 5.73 4 1.617 1399K 700 0.0 0.0 L4 156/5 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/15 100.79 GB 0.0 7.7 3.1 4.6 12.3 7.7 4.8 2.6 170.1 273.3 46.19 43.17 90 0.513 7957K 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.7 3.1 4.6 12.3 7.7 4.7 2.6 170.1 273.3 46.19 43.17 90 0.513 7957K 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.7 3.1 4.6 7.7 3.0 0.0 0.0 242.5 241.8 32.40 30.94 21 1.543 7957K 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 347.3 13.79 12.23 69 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.6 total, 17.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.33 GB write, 716.95 MB/s write, 7.67 GB read, 446.37 MB/s read, 46.2 seconds Interval compaction: 12.33 GB write, 726.48 MB/s write, 7.67 GB read, 452.30 MB/s read, 46.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 20, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1602954 Average: 2.2384 StdDev: 11.74 Min: 0 Median: 1.4935 Max: 4475 Percentiles: P50: 1.49 P75: 1.87 P99: 5.67 P99.9: 10.67 P99.99: 135.75 ------------------------------------------------------ [ 0, 1 ] 282976 17.653% 17.653% #### ( 1, 2 ] 1050695 65.547% 83.201% ############# ( 2, 3 ] 170993 10.667% 93.868% ## ( 3, 4 ] 54605 3.407% 97.275% # ( 4, 6 ] 33136 2.067% 99.342% ( 6, 10 ] 8787 0.548% 99.890% ( 10, 15 ] 1193 0.074% 99.965% ( 15, 22 ] 127 0.008% 99.972% ( 22, 34 ] 16 0.001% 99.973% ( 34, 51 ] 8 0.000% 99.974% ( 51, 76 ] 17 0.001% 99.975% ( 76, 110 ] 145 0.009% 99.984% ( 110, 170 ] 223 0.014% 99.998% ( 170, 250 ] 115 0.007% 100.005% ( 250, 380 ] 67 0.004% 100.009% ( 380, 580 ] 52 0.003% 100.013% ( 580, 870 ] 43 0.003% 100.015% ( 870, 1300 ] 15 0.001% 100.016% ( 1300, 1900 ] 9 0.001% 100.017% ( 1900, 2900 ] 8 0.000% 100.017% ( 2900, 4400 ] 6 0.000% 100.018% ( 4400, 6600 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 230282 Average: 2.6254 StdDev: 14.29 Min: 0 Median: 1.6195 Max: 1812 Percentiles: P50: 1.62 P75: 2.09 P99: 5.96 P99.9: 72.44 P99.99: 724.32 ------------------------------------------------------ [ 0, 1 ] 26703 11.596% 11.596% ## ( 1, 2 ] 142752 61.990% 73.586% ############ ( 2, 3 ] 38169 16.575% 90.161% ### ( 3, 4 ] 11161 4.847% 95.007% # ( 4, 6 ] 9390 4.078% 99.085% # ( 6, 10 ] 1594 0.692% 99.777% ( 10, 15 ] 206 0.089% 99.867% ( 15, 22 ] 34 0.015% 99.881% ( 22, 34 ] 3 0.001% 99.883% ( 34, 51 ] 32 0.014% 99.897% ( 51, 76 ] 9 0.004% 99.901% ( 76, 110 ] 76 0.033% 99.934% ( 110, 170 ] 56 0.024% 99.958% ( 170, 250 ] 31 0.013% 99.971% ( 250, 380 ] 26 0.011% 99.983% ( 380, 580 ] 11 0.005% 99.987% ( 580, 870 ] 12 0.005% 99.993% ( 870, 1300 ] 8 0.003% 99.996% ( 1300, 1900 ] 9 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 28300 Average: 2.0876 StdDev: 3.05 Min: 0 Median: 1.4314 Max: 327 Percentiles: P50: 1.43 P75: 1.87 P99: 5.63 P99.9: 9.42 P99.99: 183.60 ------------------------------------------------------ [ 0, 1 ] 7122 25.166% 25.166% ##### ( 1, 2 ] 16291 57.565% 82.731% ############ ( 2, 3 ] 2629 9.290% 92.021% ## ( 3, 4 ] 1278 4.516% 96.537% # ( 4, 6 ] 856 3.025% 99.562% # ( 6, 10 ] 112 0.396% 99.958% ( 10, 15 ] 7 0.025% 99.982% ( 15, 22 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 215713 Average: 3.8848 StdDev: 31.32 Min: 1 Median: 1.6788 Max: 4695 Percentiles: P50: 1.68 P75: 2.28 P99: 9.40 P99.9: 327.70 P99.99: 849.29 ------------------------------------------------------ [ 0, 1 ] 15703 7.280% 7.280% # ( 1, 2 ] 135763 62.937% 70.216% ############# ( 2, 3 ] 36788 17.054% 87.271% ### ( 3, 4 ] 12618 5.849% 93.120% # ( 4, 6 ] 9452 4.382% 97.502% # ( 6, 10 ] 3802 1.763% 99.264% ( 10, 15 ] 383 0.178% 99.442% ( 15, 22 ] 66 0.031% 99.472% ( 22, 34 ] 24 0.011% 99.484% ( 34, 51 ] 11 0.005% 99.489% ( 51, 76 ] 42 0.019% 99.508% ( 76, 110 ] 175 0.081% 99.589% ( 110, 170 ] 390 0.181% 99.770% ( 170, 250 ] 199 0.092% 99.862% ( 250, 380 ] 136 0.063% 99.925% ( 380, 580 ] 93 0.043% 99.968% ( 580, 870 ] 50 0.023% 99.992% ( 870, 1300 ] 21 0.010% 100.001% ( 1300, 1900 ] 14 0.006% 100.008% ( 1900, 2900 ] 8 0.004% 100.012% ( 2900, 4400 ] 1 0.000% 100.012% ( 4400, 6600 ] 1 0.000% 100.013% ** Level 4 read latency histogram (micros): Count: 35 Average: 1649.3714 StdDev: 1234.99 Min: 121 Median: 1202.2727 Max: 4556 Percentiles: P50: 1202.27 P75: 1962.50 P99: 4556.00 P99.9: 4556.00 P99.99: 4556.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 1 2.857% 5.714% # ( 380, 580 ] 1 2.857% 8.571% # ( 580, 870 ] 6 17.143% 25.714% ### ( 870, 1300 ] 11 31.429% 57.143% ###### ( 1300, 1900 ] 6 17.143% 74.286% ### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 2 5.714% 91.429% # ( 4400, 6600 ] 3 8.571% 100.000% ## ** Level 5 read latency histogram (micros): Count: 60 Average: 719.4000 StdDev: 832.91 Min: 75 Median: 305.7143 Max: 3266 Percentiles: P50: 305.71 P75: 1013.33 P99: 3266.00 P99.9: 3266.00 P99.99: 3266.00 ------------------------------------------------------ ( 51, 76 ] 1 1.667% 1.667% ( 76, 110 ] 5 8.333% 10.000% ## ( 110, 170 ] 13 21.667% 31.667% #### ( 170, 250 ] 8 13.333% 45.000% ### ( 250, 380 ] 7 11.667% 56.667% ## ( 380, 580 ] 4 6.667% 63.333% # ( 580, 870 ] 6 10.000% 73.333% ## ( 870, 1300 ] 3 5.000% 78.333% # ( 1300, 1900 ] 5 8.333% 86.667% ## ( 1900, 2900 ] 6 10.000% 96.667% ## ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 17.6 total, 4.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 279.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.997 H:M:S, 22.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 199.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.181 H:M:S, 44.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/28-06:02:13 ... thread 0: (1000000,6000000) ops and (312794.2,291694.2) ops/second in (3.196990,20.569488) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 3.13 GB 188.8 4.2 0.0 4.2 9.9 5.7 0.0 1.7 130.4 304.1 33.34 31.05 99 0.337 4413K 4520 0.0 0.0 L1 10/0 719.05 MB 71.9 2.8 2.4 0.4 2.7 2.4 0.1 1.1 235.4 233.8 11.98 11.56 3 3.993 2863K 19K 0.0 0.0 L2 1/0 59.40 MB 0.6 0.1 0.1 0.0 0.1 0.1 1.8 1.8 221.0 221.0 0.50 0.48 1 0.504 113K 26 0.0 0.0 L3 15/0 981.03 MB 1.0 1.4 0.6 0.8 1.4 0.6 1.2 2.2 216.2 216.1 6.47 5.73 4 1.617 1399K 700 0.0 0.0 L4 171/0 9.75 GB 1.0 0.5 0.4 0.1 0.5 0.4 1.1 1.2 175.2 174.6 2.84 2.23 4 0.709 475K 1651 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1274/9 101.77 GB 0.0 9.0 3.5 5.5 14.6 9.1 5.5 2.6 166.4 271.0 55.13 51.05 111 0.497 9264K 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.0 3.5 5.5 14.6 9.1 5.5 2.6 166.4 271.0 55.13 51.05 111 0.497 9264K 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.0 3.5 5.5 8.9 3.4 0.0 0.0 239.0 238.3 38.39 36.27 28 1.371 9264K 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 346.2 16.74 14.77 83 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.8 total, 20.6 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.59 GB write, 718.36 MB/s write, 8.96 GB read, 441.03 MB/s read, 55.1 seconds Interval compaction: 14.59 GB write, 726.42 MB/s write, 8.96 GB read, 445.98 MB/s read, 55.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 28, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2030439 Average: 2.2498 StdDev: 11.38 Min: 0 Median: 1.5059 Max: 4475 Percentiles: P50: 1.51 P75: 1.89 P99: 5.67 P99.9: 9.97 P99.99: 102.96 ------------------------------------------------------ [ 0, 1 ] 339602 16.726% 16.726% ### ( 1, 2 ] 1335595 65.779% 82.504% ############# ( 2, 3 ] 223757 11.020% 93.524% ## ( 3, 4 ] 73495 3.620% 97.144% # ( 4, 6 ] 45165 2.224% 99.368% ( 6, 10 ] 10865 0.535% 99.903% ( 10, 15 ] 1414 0.070% 99.973% ( 15, 22 ] 154 0.008% 99.981% ( 22, 34 ] 20 0.001% 99.982% ( 34, 51 ] 10 0.000% 99.982% ( 51, 76 ] 21 0.001% 99.983% ( 76, 110 ] 174 0.009% 99.992% ( 110, 170 ] 259 0.013% 100.005% ( 170, 250 ] 130 0.006% 100.011% ( 250, 380 ] 76 0.004% 100.015% ( 380, 580 ] 57 0.003% 100.017% ( 580, 870 ] 51 0.003% 100.020% ( 870, 1300 ] 21 0.001% 100.021% ( 1300, 1900 ] 12 0.001% 100.022% ( 1900, 2900 ] 9 0.000% 100.022% ( 2900, 4400 ] 7 0.000% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 283663 Average: 2.7366 StdDev: 14.66 Min: 0 Median: 1.6723 Max: 2482 Percentiles: P50: 1.67 P75: 2.29 P99: 6.33 P99.9: 31.35 P99.99: 341.12 ------------------------------------------------------ [ 0, 1 ] 27555 9.714% 9.714% ## ( 1, 2 ] 169989 59.926% 69.640% ############ ( 2, 3 ] 51842 18.276% 87.916% #### ( 3, 4 ] 16482 5.810% 93.727% # ( 4, 6 ] 14764 5.205% 98.931% # ( 6, 10 ] 2346 0.827% 99.759% ( 10, 15 ] 355 0.125% 99.884% ( 15, 22 ] 44 0.016% 99.899% ( 22, 34 ] 3 0.001% 99.900% ( 34, 51 ] 32 0.011% 99.912% ( 51, 76 ] 10 0.004% 99.915% ( 76, 110 ] 83 0.029% 99.944% ( 110, 170 ] 67 0.024% 99.968% ( 170, 250 ] 36 0.013% 99.981% ( 250, 380 ] 38 0.013% 99.994% ( 380, 580 ] 19 0.007% 100.001% ( 580, 870 ] 16 0.006% 100.006% ( 870, 1300 ] 10 0.004% 100.010% ( 1300, 1900 ] 9 0.003% 100.013% ( 1900, 2900 ] 1 0.000% 100.013% ** Level 2 read latency histogram (micros): Count: 28300 Average: 2.0876 StdDev: 3.05 Min: 0 Median: 1.4314 Max: 327 Percentiles: P50: 1.43 P75: 1.87 P99: 5.63 P99.9: 9.42 P99.99: 183.60 ------------------------------------------------------ [ 0, 1 ] 7122 25.166% 25.166% ##### ( 1, 2 ] 16291 57.565% 82.731% ############ ( 2, 3 ] 2629 9.290% 92.021% ## ( 3, 4 ] 1278 4.516% 96.537% # ( 4, 6 ] 856 3.025% 99.562% # ( 6, 10 ] 112 0.396% 99.958% ( 10, 15 ] 7 0.025% 99.982% ( 15, 22 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 258868 Average: 4.5322 StdDev: 44.83 Min: 1 Median: 1.7081 Max: 4695 Percentiles: P50: 1.71 P75: 2.39 P99: 9.62 P99.9: 431.62 P99.99: 1117.11 ------------------------------------------------------ [ 0, 1 ] 16811 6.494% 6.494% # ( 1, 2 ] 159057 61.443% 67.937% ############ ( 2, 3 ] 46629 18.013% 85.950% #### ( 3, 4 ] 16650 6.432% 92.382% # ( 4, 6 ] 12761 4.930% 97.311% # ( 6, 10 ] 4826 1.864% 99.176% ( 10, 15 ] 525 0.203% 99.378% ( 15, 22 ] 82 0.032% 99.410% ( 22, 34 ] 26 0.010% 99.420% ( 34, 51 ] 11 0.004% 99.424% ( 51, 76 ] 42 0.016% 99.441% ( 76, 110 ] 190 0.073% 99.514% ( 110, 170 ] 477 0.184% 99.698% ( 170, 250 ] 272 0.105% 99.803% ( 250, 380 ] 206 0.080% 99.883% ( 380, 580 ] 171 0.066% 99.949% ( 580, 870 ] 86 0.033% 99.982% ( 870, 1300 ] 35 0.014% 99.996% ( 1300, 1900 ] 15 0.006% 100.002% ( 1900, 2900 ] 32 0.012% 100.014% ( 2900, 4400 ] 9 0.003% 100.017% ( 4400, 6600 ] 1 0.000% 100.018% ** Level 4 read latency histogram (micros): Count: 175 Average: 377.9029 StdDev: 856.29 Min: 1 Median: 3.8750 Max: 4556 Percentiles: P50: 3.88 P75: 220.00 P99: 4556.00 P99.9: 4556.00 P99.99: 4556.00 ------------------------------------------------------ [ 0, 1 ] 42 24.000% 24.000% ##### ( 1, 2 ] 33 18.857% 42.857% #### ( 2, 3 ] 9 5.143% 48.000% # ( 3, 4 ] 4 2.286% 50.286% ( 4, 6 ] 6 3.429% 53.714% # ( 6, 10 ] 8 4.571% 58.286% # ( 10, 15 ] 1 0.571% 58.857% ( 15, 22 ] 1 0.571% 59.429% ( 22, 34 ] 15 8.571% 68.000% ## ( 34, 51 ] 1 0.571% 68.571% ( 51, 76 ] 1 0.571% 69.143% ( 110, 170 ] 9 5.143% 74.286% # ( 170, 250 ] 2 1.143% 75.429% ( 250, 380 ] 1 0.571% 76.000% ( 380, 580 ] 3 1.714% 77.714% ( 580, 870 ] 11 6.286% 84.000% # ( 870, 1300 ] 13 7.429% 91.429% # ( 1300, 1900 ] 6 3.429% 94.857% # ( 1900, 2900 ] 4 2.286% 97.143% ( 2900, 4400 ] 2 1.143% 98.286% ( 4400, 6600 ] 3 1.714% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 758.3625 StdDev: 948.43 Min: 75 Median: 268.5714 Max: 4353 Percentiles: P50: 268.57 P75: 1085.00 P99: 4100.00 P99.9: 4353.00 P99.99: 4353.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 13 16.250% 17.500% ### ( 110, 170 ] 17 21.250% 38.750% #### ( 170, 250 ] 8 10.000% 48.750% ## ( 250, 380 ] 7 8.750% 57.500% ## ( 380, 580 ] 5 6.250% 63.750% # ( 580, 870 ] 7 8.750% 72.500% ## ( 870, 1300 ] 4 5.000% 77.500% # ( 1300, 1900 ] 6 7.500% 85.000% ## ( 1900, 2900 ] 8 10.000% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 20.8 total, 3.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 283.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.510 H:M:S, 21.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 307.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.513 H:M:S, 16.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-06:02:17 ... thread 0: (1000000,7000000) ops and (254963.2,285812.0) ops/second in (3.922134,24.491622) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 4.11 GB 75.5 6.1 0.0 6.1 12.7 6.6 0.0 1.9 143.8 300.4 43.37 40.61 117 0.371 6331K 9980 0.0 0.0 L1 10/10 719.05 MB 0.0 2.8 2.4 0.4 2.7 2.4 0.1 1.1 235.4 233.8 11.98 11.56 3 3.993 2863K 19K 0.0 0.0 L2 1/0 59.40 MB 0.6 0.1 0.1 0.0 0.1 0.1 1.8 1.8 221.0 221.0 0.50 0.48 1 0.504 113K 26 0.0 0.0 L3 15/0 981.03 MB 1.0 1.4 0.6 0.8 1.4 0.6 1.2 2.2 216.2 216.1 6.47 5.73 4 1.617 1399K 700 0.0 0.0 L4 171/0 9.75 GB 1.0 0.5 0.4 0.1 0.5 0.4 1.1 1.2 175.2 174.6 2.84 2.23 4 0.709 475K 1651 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/23 102.75 GB 0.0 10.8 3.5 7.3 17.4 10.1 5.5 2.6 169.8 273.7 65.16 60.61 129 0.505 11M 31K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.8 3.5 7.3 17.4 10.1 5.5 2.6 169.8 273.7 65.16 60.61 129 0.505 11M 31K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.8 3.5 7.3 10.8 3.4 0.0 0.0 242.8 242.1 45.56 43.28 32 1.424 11M 31K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 347.0 19.60 17.33 97 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.7 total, 24.5 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.42 GB write, 721.35 MB/s write, 10.80 GB read, 447.47 MB/s read, 65.2 seconds Interval compaction: 17.42 GB write, 728.15 MB/s write, 10.80 GB read, 451.68 MB/s read, 65.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 32, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2403447 Average: 2.2500 StdDev: 12.06 Min: 0 Median: 1.4981 Max: 4709 Percentiles: P50: 1.50 P75: 1.88 P99: 5.66 P99.9: 10.65 P99.99: 124.76 ------------------------------------------------------ [ 0, 1 ] 413650 17.211% 17.211% ### ( 1, 2 ] 1582002 65.822% 83.033% ############# ( 2, 3 ] 258694 10.763% 93.796% ## ( 3, 4 ] 83484 3.474% 97.270% # ( 4, 6 ] 49985 2.080% 99.350% ( 6, 10 ] 12999 0.541% 99.890% ( 10, 15 ] 1771 0.074% 99.964% ( 15, 22 ] 194 0.008% 99.972% ( 22, 34 ] 22 0.001% 99.973% ( 34, 51 ] 11 0.000% 99.974% ( 51, 76 ] 25 0.001% 99.975% ( 76, 110 ] 271 0.011% 99.986% ( 110, 170 ] 401 0.017% 100.003% ( 170, 250 ] 167 0.007% 100.010% ( 250, 380 ] 94 0.004% 100.013% ( 380, 580 ] 76 0.003% 100.017% ( 580, 870 ] 61 0.003% 100.019% ( 870, 1300 ] 24 0.001% 100.020% ( 1300, 1900 ] 14 0.001% 100.021% ( 1900, 2900 ] 9 0.000% 100.021% ( 2900, 4400 ] 11 0.000% 100.022% ( 4400, 6600 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 283664 Average: 2.7369 StdDev: 14.66 Min: 0 Median: 1.6723 Max: 2482 Percentiles: P50: 1.67 P75: 2.29 P99: 6.33 P99.9: 34.18 P99.99: 341.11 ------------------------------------------------------ [ 0, 1 ] 27555 9.714% 9.714% ## ( 1, 2 ] 169989 59.926% 69.640% ############ ( 2, 3 ] 51842 18.276% 87.916% #### ( 3, 4 ] 16482 5.810% 93.726% # ( 4, 6 ] 14764 5.205% 98.931% # ( 6, 10 ] 2346 0.827% 99.758% ( 10, 15 ] 355 0.125% 99.883% ( 15, 22 ] 44 0.016% 99.899% ( 22, 34 ] 3 0.001% 99.900% ( 34, 51 ] 32 0.011% 99.911% ( 51, 76 ] 10 0.004% 99.915% ( 76, 110 ] 84 0.030% 99.944% ( 110, 170 ] 67 0.024% 99.968% ( 170, 250 ] 36 0.013% 99.981% ( 250, 380 ] 38 0.013% 99.994% ( 380, 580 ] 19 0.007% 100.001% ( 580, 870 ] 16 0.006% 100.006% ( 870, 1300 ] 10 0.004% 100.010% ( 1300, 1900 ] 9 0.003% 100.013% ( 1900, 2900 ] 1 0.000% 100.013% ** Level 2 read latency histogram (micros): Count: 28300 Average: 2.0876 StdDev: 3.05 Min: 0 Median: 1.4314 Max: 327 Percentiles: P50: 1.43 P75: 1.87 P99: 5.63 P99.9: 9.42 P99.99: 183.60 ------------------------------------------------------ [ 0, 1 ] 7122 25.166% 25.166% ##### ( 1, 2 ] 16291 57.565% 82.731% ############ ( 2, 3 ] 2629 9.290% 92.021% ## ( 3, 4 ] 1278 4.516% 96.537% # ( 4, 6 ] 856 3.025% 99.562% # ( 6, 10 ] 112 0.396% 99.958% ( 10, 15 ] 7 0.025% 99.982% ( 15, 22 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 258868 Average: 4.5322 StdDev: 44.83 Min: 1 Median: 1.7081 Max: 4695 Percentiles: P50: 1.71 P75: 2.39 P99: 9.62 P99.9: 431.62 P99.99: 1117.11 ------------------------------------------------------ [ 0, 1 ] 16811 6.494% 6.494% # ( 1, 2 ] 159057 61.443% 67.937% ############ ( 2, 3 ] 46629 18.013% 85.950% #### ( 3, 4 ] 16650 6.432% 92.382% # ( 4, 6 ] 12761 4.930% 97.311% # ( 6, 10 ] 4826 1.864% 99.176% ( 10, 15 ] 525 0.203% 99.378% ( 15, 22 ] 82 0.032% 99.410% ( 22, 34 ] 26 0.010% 99.420% ( 34, 51 ] 11 0.004% 99.424% ( 51, 76 ] 42 0.016% 99.441% ( 76, 110 ] 190 0.073% 99.514% ( 110, 170 ] 477 0.184% 99.698% ( 170, 250 ] 272 0.105% 99.803% ( 250, 380 ] 206 0.080% 99.883% ( 380, 580 ] 171 0.066% 99.949% ( 580, 870 ] 86 0.033% 99.982% ( 870, 1300 ] 35 0.014% 99.996% ( 1300, 1900 ] 15 0.006% 100.002% ( 1900, 2900 ] 32 0.012% 100.014% ( 2900, 4400 ] 9 0.003% 100.017% ( 4400, 6600 ] 1 0.000% 100.018% ** Level 4 read latency histogram (micros): Count: 175 Average: 377.9029 StdDev: 856.29 Min: 1 Median: 3.8750 Max: 4556 Percentiles: P50: 3.88 P75: 220.00 P99: 4556.00 P99.9: 4556.00 P99.99: 4556.00 ------------------------------------------------------ [ 0, 1 ] 42 24.000% 24.000% ##### ( 1, 2 ] 33 18.857% 42.857% #### ( 2, 3 ] 9 5.143% 48.000% # ( 3, 4 ] 4 2.286% 50.286% ( 4, 6 ] 6 3.429% 53.714% # ( 6, 10 ] 8 4.571% 58.286% # ( 10, 15 ] 1 0.571% 58.857% ( 15, 22 ] 1 0.571% 59.429% ( 22, 34 ] 15 8.571% 68.000% ## ( 34, 51 ] 1 0.571% 68.571% ( 51, 76 ] 1 0.571% 69.143% ( 110, 170 ] 9 5.143% 74.286% # ( 170, 250 ] 2 1.143% 75.429% ( 250, 380 ] 1 0.571% 76.000% ( 380, 580 ] 3 1.714% 77.714% ( 580, 870 ] 11 6.286% 84.000% # ( 870, 1300 ] 13 7.429% 91.429% # ( 1300, 1900 ] 6 3.429% 94.857% # ( 1900, 2900 ] 4 2.286% 97.143% ( 2900, 4400 ] 2 1.143% 98.286% ( 4400, 6600 ] 3 1.714% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 758.3625 StdDev: 948.43 Min: 75 Median: 268.5714 Max: 4353 Percentiles: P50: 268.57 P75: 1085.00 P99: 4100.00 P99.9: 4353.00 P99.99: 4353.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 13 16.250% 17.500% ### ( 110, 170 ] 17 21.250% 38.750% #### ( 170, 250 ] 8 10.000% 48.750% ## ( 250, 380 ] 7 8.750% 57.500% ## ( 380, 580 ] 5 6.250% 63.750% # ( 580, 870 ] 7 8.750% 72.500% ## ( 870, 1300 ] 4 5.000% 77.500% # ( 1300, 1900 ] 6 7.500% 85.000% ## ( 1900, 2900 ] 8 10.000% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 24.7 total, 3.9 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 278.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.716 H:M:S, 23.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 250.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.207 H:M:S, 30.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-06:02:38 ... thread 0: (1000000,8000000) ops and (47349.5,175395.7) ops/second in (21.119525,45.611147) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.72 GB 18.9 6.6 0.0 6.6 14.2 7.6 0.0 1.9 132.0 284.9 51.04 45.15 132 0.387 6843K 10K 0.0 0.0 L1 8/8 944.56 MB 0.0 6.8 5.8 1.1 6.7 5.7 0.1 1.2 225.5 222.4 31.02 29.11 4 7.756 7031K 24K 0.0 0.0 L2 3/2 386.34 MB 1.3 0.1 0.1 0.0 0.1 0.1 4.9 1.8 221.0 221.0 0.50 0.48 1 0.504 113K 26 0.0 0.0 L3 36/11 2.37 GB 1.5 3.9 2.0 1.9 3.8 2.0 2.6 1.9 141.4 140.4 28.01 17.57 14 2.001 4000K 26K 0.0 0.0 L4 185/6 11.07 GB 1.1 2.1 1.8 0.3 2.1 1.8 1.1 1.2 124.3 123.6 17.47 10.02 19 0.919 2175K 11K 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/37 103.62 GB 0.0 19.5 9.6 9.9 27.0 17.1 10.0 3.5 156.0 215.9 128.05 102.32 170 0.753 20M 72K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.5 9.6 9.9 27.0 17.1 10.0 3.5 156.0 215.9 128.05 102.32 170 0.753 20M 72K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.5 9.6 9.9 19.4 9.5 0.0 0.0 194.7 193.3 102.61 82.26 60 1.710 20M 72K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 307.0 25.44 20.06 110 0.231 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.8 total, 45.6 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.00 GB write, 603.01 MB/s write, 19.51 GB read, 435.79 MB/s read, 128.1 seconds Interval compaction: 27.00 GB write, 606.06 MB/s write, 19.51 GB read, 437.99 MB/s read, 128.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 57, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 57, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3465253 Average: 2.7441 StdDev: 30.41 Min: 0 Median: 1.4881 Max: 19752 Percentiles: P50: 1.49 P75: 1.88 P99: 5.99 P99.9: 124.97 P99.99: 427.98 ------------------------------------------------------ [ 0, 1 ] 647904 18.697% 18.697% #### ( 1, 2 ] 2222254 64.130% 82.827% ############# ( 2, 3 ] 350191 10.106% 92.933% ## ( 3, 4 ] 122916 3.547% 96.480% # ( 4, 6 ] 87593 2.528% 99.007% # ( 6, 10 ] 22035 0.636% 99.643% ( 10, 15 ] 3532 0.102% 99.745% ( 15, 22 ] 557 0.016% 99.761% ( 22, 34 ] 31 0.001% 99.762% ( 34, 51 ] 14 0.000% 99.763% ( 51, 76 ] 96 0.003% 99.765% ( 76, 110 ] 3991 0.115% 99.881% ( 110, 170 ] 2708 0.078% 99.959% ( 170, 250 ] 566 0.016% 99.975% ( 250, 380 ] 413 0.012% 99.987% ( 380, 580 ] 448 0.013% 100.000% ( 580, 870 ] 264 0.008% 100.008% ( 870, 1300 ] 138 0.004% 100.011% ( 1300, 1900 ] 59 0.002% 100.013% ( 1900, 2900 ] 53 0.002% 100.015% ( 2900, 4400 ] 70 0.002% 100.017% ( 4400, 6600 ] 27 0.001% 100.018% ( 6600, 9900 ] 4 0.000% 100.018% ( 14000, 22000 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 1306571 Average: 6.1773 StdDev: 106.96 Min: 0 Median: 1.8085 Max: 18604 Percentiles: P50: 1.81 P75: 2.75 P99: 9.10 P99.9: 97.94 P99.99: 166.97 ------------------------------------------------------ [ 0, 1 ] 106770 8.172% 8.172% ## ( 1, 2 ] 675921 51.732% 59.904% ########## ( 2, 3 ] 263007 20.130% 80.034% #### ( 3, 4 ] 114728 8.781% 88.815% ## ( 4, 6 ] 113055 8.653% 97.467% ## ( 6, 10 ] 25822 1.976% 99.444% ( 10, 15 ] 4543 0.348% 99.791% ( 15, 22 ] 648 0.050% 99.841% ( 22, 34 ] 56 0.004% 99.845% ( 34, 51 ] 55 0.004% 99.850% ( 51, 76 ] 80 0.006% 99.856% ( 76, 110 ] 898 0.069% 99.924% ( 110, 170 ] 903 0.069% 99.993% ( 170, 250 ] 227 0.017% 100.011% ( 250, 380 ] 335 0.026% 100.037% ( 380, 580 ] 418 0.032% 100.068% ( 580, 870 ] 420 0.032% 100.101% ( 870, 1300 ] 317 0.024% 100.125% ( 1300, 1900 ] 194 0.015% 100.140% ( 1900, 2900 ] 237 0.018% 100.158% ( 2900, 4400 ] 384 0.029% 100.187% ( 4400, 6600 ] 108 0.008% 100.196% ( 6600, 9900 ] 57 0.004% 100.200% ( 9900, 14000 ] 3 0.000% 100.200% ( 14000, 22000 ] 2 0.000% 100.200% ** Level 2 read latency histogram (micros): Count: 28300 Average: 2.0876 StdDev: 3.05 Min: 0 Median: 1.4314 Max: 327 Percentiles: P50: 1.43 P75: 1.87 P99: 5.63 P99.9: 9.42 P99.99: 183.60 ------------------------------------------------------ [ 0, 1 ] 7122 25.166% 25.166% ##### ( 1, 2 ] 16291 57.565% 82.731% ############ ( 2, 3 ] 2629 9.290% 92.021% ## ( 3, 4 ] 1278 4.516% 96.537% # ( 4, 6 ] 856 3.025% 99.562% # ( 6, 10 ] 112 0.396% 99.958% ( 10, 15 ] 7 0.025% 99.982% ( 15, 22 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 622441 Average: 7.4691 StdDev: 107.00 Min: 1 Median: 1.8894 Max: 7821 Percentiles: P50: 1.89 P75: 2.84 P99: 9.48 P99.9: 566.99 P99.99: 1083.95 ------------------------------------------------------ [ 0, 1 ] 20391 3.276% 3.276% # ( 1, 2 ] 327000 52.535% 55.811% ########### ( 2, 3 ] 141747 22.773% 78.584% ##### ( 3, 4 ] 59882 9.621% 88.204% ## ( 4, 6 ] 56535 9.083% 97.287% ## ( 6, 10 ] 12244 1.967% 99.254% ( 10, 15 ] 2028 0.326% 99.580% ( 15, 22 ] 252 0.040% 99.621% ( 22, 34 ] 45 0.007% 99.628% ( 34, 51 ] 17 0.003% 99.630% ( 51, 76 ] 46 0.007% 99.638% ( 76, 110 ] 193 0.031% 99.669% ( 110, 170 ] 493 0.079% 99.748% ( 170, 250 ] 319 0.051% 99.799% ( 250, 380 ] 305 0.049% 99.848% ( 380, 580 ] 345 0.055% 99.904% ( 580, 870 ] 386 0.062% 99.966% ( 870, 1300 ] 305 0.049% 100.015% ( 1300, 1900 ] 185 0.030% 100.045% ( 1900, 2900 ] 185 0.030% 100.074% ( 2900, 4400 ] 207 0.033% 100.107% ( 4400, 6600 ] 72 0.012% 100.119% ( 6600, 9900 ] 10 0.002% 100.121% ** Level 4 read latency histogram (micros): Count: 36569 Average: 29.1369 StdDev: 260.28 Min: 1 Median: 1.9060 Max: 17062 Percentiles: P50: 1.91 P75: 2.90 P99: 815.33 P99.9: 4107.07 P99.99: 6539.78 ------------------------------------------------------ [ 0, 1 ] 1059 2.896% 2.896% # ( 1, 2 ] 19012 51.989% 54.885% ########## ( 2, 3 ] 8180 22.369% 77.254% #### ( 3, 4 ] 3911 10.695% 87.949% ## ( 4, 6 ] 2579 7.052% 95.001% # ( 6, 10 ] 754 2.062% 97.063% ( 10, 15 ] 131 0.358% 97.421% ( 15, 22 ] 13 0.036% 97.457% ( 22, 34 ] 18 0.049% 97.506% ( 34, 51 ] 2 0.005% 97.512% ( 51, 76 ] 2 0.005% 97.517% ( 76, 110 ] 15 0.041% 97.558% ( 110, 170 ] 52 0.142% 97.700% ( 170, 250 ] 74 0.202% 97.903% ( 250, 380 ] 96 0.263% 98.165% ( 380, 580 ] 156 0.427% 98.592% ( 580, 870 ] 184 0.503% 99.095% ( 870, 1300 ] 138 0.377% 99.472% ( 1300, 1900 ] 71 0.194% 99.666% ( 1900, 2900 ] 46 0.126% 99.792% ( 2900, 4400 ] 49 0.134% 99.926% ( 4400, 6600 ] 24 0.066% 99.992% ( 6600, 9900 ] 5 0.014% 100.005% ( 14000, 22000 ] 1 0.003% 100.008% ** Level 5 read latency histogram (micros): Count: 80 Average: 758.3625 StdDev: 948.43 Min: 75 Median: 268.5714 Max: 4353 Percentiles: P50: 268.57 P75: 1085.00 P99: 4100.00 P99.9: 4353.00 P99.99: 4353.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 13 16.250% 17.500% ### ( 110, 170 ] 17 21.250% 38.750% #### ( 170, 250 ] 8 10.000% 48.750% ## ( 250, 380 ] 7 8.750% 57.500% ## ( 380, 580 ] 5 6.250% 63.750% # ( 580, 870 ] 7 8.750% 72.500% ## ( 870, 1300 ] 4 5.000% 77.500% # ( 1300, 1900 ] 6 7.500% 85.000% ## ( 1900, 2900 ] 8 10.000% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 45.8 total, 21.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 171.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.670 H:M:S, 51.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 46.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:17.954 H:M:S, 85.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/28-06:02:42 ... thread 0: (1000000,9000000) ops and (240900.8,180860.0) ops/second in (4.151087,49.762234) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.64 GB 125.8 7.6 0.0 7.6 16.2 8.5 0.0 1.9 130.8 277.2 59.72 51.84 147 0.406 7930K 11K 0.0 0.0 L1 8/8 944.56 MB 0.0 6.8 5.8 1.1 6.7 5.7 0.1 1.2 225.5 222.4 31.02 29.11 4 7.756 7031K 24K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.9 1.8 221.0 221.0 0.50 0.48 1 0.504 113K 26 0.0 0.0 L3 16/0 967.76 MB 1.0 4.8 2.4 2.4 4.8 2.3 2.6 2.0 140.8 139.9 34.79 21.88 17 2.047 4955K 34K 0.0 0.0 L4 171/0 9.59 GB 1.0 4.0 3.5 0.5 4.0 3.5 1.1 1.1 129.5 128.8 31.86 19.30 41 0.777 4159K 22K 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1310/18 104.53 GB 0.0 23.4 11.7 11.7 31.8 20.1 13.3 3.7 151.6 206.0 157.90 122.60 210 0.752 24M 92K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.4 11.7 11.7 31.8 20.1 13.2 3.7 151.6 206.0 157.90 122.60 210 0.752 24M 92K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.4 11.7 11.7 23.2 11.6 0.0 0.0 186.0 184.7 128.73 100.09 88 1.463 24M 92K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 300.1 29.18 22.51 122 0.239 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.0 total, 49.8 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.77 GB write, 650.74 MB/s write, 23.38 GB read, 478.91 MB/s read, 157.9 seconds Interval compaction: 31.77 GB write, 653.76 MB/s write, 23.38 GB read, 481.13 MB/s read, 157.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 77, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 77, interval: 98 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3827933 Average: 2.8414 StdDev: 34.16 Min: 0 Median: 1.5102 Max: 19752 Percentiles: P50: 1.51 P75: 1.90 P99: 6.35 P99.9: 122.33 P99.99: 448.14 ------------------------------------------------------ [ 0, 1 ] 670121 17.506% 17.506% #### ( 1, 2 ] 2437754 63.683% 81.189% ############# ( 2, 3 ] 418354 10.929% 92.118% ## ( 3, 4 ] 149466 3.905% 96.023% # ( 4, 6 ] 111541 2.914% 98.937% # ( 6, 10 ] 27255 0.712% 99.649% ( 10, 15 ] 4268 0.111% 99.760% ( 15, 22 ] 632 0.017% 99.777% ( 22, 34 ] 36 0.001% 99.778% ( 34, 51 ] 19 0.000% 99.778% ( 51, 76 ] 98 0.003% 99.781% ( 76, 110 ] 3998 0.104% 99.885% ( 110, 170 ] 2740 0.072% 99.957% ( 170, 250 ] 612 0.016% 99.973% ( 250, 380 ] 477 0.012% 99.985% ( 380, 580 ] 526 0.014% 99.999% ( 580, 870 ] 330 0.009% 100.008% ( 870, 1300 ] 178 0.005% 100.012% ( 1300, 1900 ] 80 0.002% 100.014% ( 1900, 2900 ] 76 0.002% 100.016% ( 2900, 4400 ] 100 0.003% 100.019% ( 4400, 6600 ] 34 0.001% 100.020% ( 6600, 9900 ] 7 0.000% 100.020% ( 14000, 22000 ] 2 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1413657 Average: 6.0682 StdDev: 104.40 Min: 0 Median: 1.8029 Max: 18604 Percentiles: P50: 1.80 P75: 2.73 P99: 9.10 P99.9: 103.60 P99.99: 211.33 ------------------------------------------------------ [ 0, 1 ] 111896 7.915% 7.915% ## ( 1, 2 ] 740997 52.417% 60.332% ########## ( 2, 3 ] 284254 20.108% 80.440% #### ( 3, 4 ] 121799 8.616% 89.056% ## ( 4, 6 ] 118914 8.412% 97.468% ## ( 6, 10 ] 27987 1.980% 99.448% ( 10, 15 ] 4759 0.337% 99.784% ( 15, 22 ] 682 0.048% 99.832% ( 22, 34 ] 61 0.004% 99.837% ( 34, 51 ] 56 0.004% 99.841% ( 51, 76 ] 81 0.006% 99.846% ( 76, 110 ] 933 0.066% 99.912% ( 110, 170 ] 968 0.068% 99.981% ( 170, 250 ] 249 0.018% 99.999% ( 250, 380 ] 356 0.025% 100.024% ( 380, 580 ] 466 0.033% 100.057% ( 580, 870 ] 451 0.032% 100.089% ( 870, 1300 ] 341 0.024% 100.113% ( 1300, 1900 ] 209 0.015% 100.127% ( 1900, 2900 ] 261 0.018% 100.146% ( 2900, 4400 ] 396 0.028% 100.174% ( 4400, 6600 ] 108 0.008% 100.182% ( 6600, 9900 ] 58 0.004% 100.186% ( 9900, 14000 ] 3 0.000% 100.186% ( 14000, 22000 ] 2 0.000% 100.186% ** Level 2 read latency histogram (micros): Count: 28300 Average: 2.0876 StdDev: 3.05 Min: 0 Median: 1.4314 Max: 327 Percentiles: P50: 1.43 P75: 1.87 P99: 5.63 P99.9: 9.42 P99.99: 183.60 ------------------------------------------------------ [ 0, 1 ] 7122 25.166% 25.166% ##### ( 1, 2 ] 16291 57.565% 82.731% ############ ( 2, 3 ] 2629 9.290% 92.021% ## ( 3, 4 ] 1278 4.516% 96.537% # ( 4, 6 ] 856 3.025% 99.562% # ( 6, 10 ] 112 0.396% 99.958% ( 10, 15 ] 7 0.025% 99.982% ( 15, 22 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 1150106 Average: 8.3353 StdDev: 125.40 Min: 1 Median: 1.9337 Max: 16063 Percentiles: P50: 1.93 P75: 2.90 P99: 9.33 P99.9: 486.57 P99.99: 856.26 ------------------------------------------------------ [ 0, 1 ] 26568 2.310% 2.310% ( 1, 2 ] 587408 51.074% 53.384% ########## ( 2, 3 ] 274845 23.897% 77.282% ##### ( 3, 4 ] 119505 10.391% 87.672% ## ( 4, 6 ] 111368 9.683% 97.356% ## ( 6, 10 ] 22739 1.977% 99.333% ( 10, 15 ] 3789 0.329% 99.662% ( 15, 22 ] 472 0.041% 99.703% ( 22, 34 ] 72 0.006% 99.710% ( 34, 51 ] 26 0.002% 99.712% ( 51, 76 ] 53 0.005% 99.716% ( 76, 110 ] 249 0.022% 99.738% ( 110, 170 ] 585 0.051% 99.789% ( 170, 250 ] 417 0.036% 99.825% ( 250, 380 ] 505 0.044% 99.869% ( 380, 580 ] 666 0.058% 99.927% ( 580, 870 ] 760 0.066% 99.993% ( 870, 1300 ] 634 0.055% 100.048% ( 1300, 1900 ] 378 0.033% 100.081% ( 1900, 2900 ] 419 0.036% 100.118% ( 2900, 4400 ] 496 0.043% 100.161% ( 4400, 6600 ] 138 0.012% 100.173% ( 6600, 9900 ] 36 0.003% 100.176% ( 9900, 14000 ] 7 0.001% 100.176% ( 14000, 22000 ] 2 0.000% 100.177% ** Level 4 read latency histogram (micros): Count: 36794 Average: 30.4548 StdDev: 264.39 Min: 1 Median: 1.9069 Max: 17062 Percentiles: P50: 1.91 P75: 2.90 P99: 848.83 P99.9: 4127.94 P99.99: 6537.72 ------------------------------------------------------ [ 0, 1 ] 1092 2.968% 2.968% # ( 1, 2 ] 19082 51.862% 54.830% ########## ( 2, 3 ] 8208 22.308% 77.138% #### ( 3, 4 ] 3913 10.635% 87.772% ## ( 4, 6 ] 2582 7.017% 94.790% # ( 6, 10 ] 757 2.057% 96.847% ( 10, 15 ] 134 0.364% 97.212% ( 15, 22 ] 13 0.035% 97.247% ( 22, 34 ] 23 0.063% 97.309% ( 34, 51 ] 2 0.005% 97.315% ( 51, 76 ] 2 0.005% 97.320% ( 76, 110 ] 31 0.084% 97.404% ( 110, 170 ] 57 0.155% 97.559% ( 170, 250 ] 95 0.258% 97.818% ( 250, 380 ] 98 0.266% 98.084% ( 380, 580 ] 160 0.435% 98.519% ( 580, 870 ] 191 0.519% 99.038% ( 870, 1300 ] 149 0.405% 99.443% ( 1300, 1900 ] 77 0.209% 99.652% ( 1900, 2900 ] 47 0.128% 99.780% ( 2900, 4400 ] 54 0.147% 99.927% ( 4400, 6600 ] 24 0.065% 99.992% ( 6600, 9900 ] 5 0.014% 100.005% ( 14000, 22000 ] 1 0.003% 100.008% ** Level 5 read latency histogram (micros): Count: 280 Average: 1283.9107 StdDev: 1279.83 Min: 75 Median: 754.0000 Max: 5525 Percentiles: P50: 754.00 P75: 2084.21 P99: 5525.00 P99.9: 5525.00 P99.99: 5525.00 ------------------------------------------------------ ( 51, 76 ] 1 0.357% 0.357% ( 76, 110 ] 14 5.000% 5.357% # ( 110, 170 ] 22 7.857% 13.214% ## ( 170, 250 ] 24 8.571% 21.786% ## ( 250, 380 ] 35 12.500% 34.286% ### ( 380, 580 ] 26 9.286% 43.571% ## ( 580, 870 ] 30 10.714% 54.286% ## ( 870, 1300 ] 29 10.357% 64.643% ## ( 1300, 1900 ] 22 7.857% 72.500% ## ( 1900, 2900 ] 38 13.571% 86.071% ### ( 2900, 4400 ] 31 11.071% 97.143% ## ( 4400, 6600 ] 8 2.857% 100.000% # ** DB Stats ** Uptime(secs): 50.0 total, 4.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 177.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.902 H:M:S, 49.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 237.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.232 H:M:S, 29.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-06:02:46 ... thread 0: (1000000,10000000) ops and (293576.7,188081.3) ops/second in (3.406265,53.168499) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.63 GB 226.5 8.7 0.0 8.7 18.2 9.5 0.0 1.9 133.2 279.4 66.68 58.35 166 0.402 9018K 12K 0.0 0.0 L1 8/8 944.56 MB 0.0 6.8 5.8 1.1 6.7 5.7 0.1 1.2 225.5 222.4 31.02 29.11 4 7.756 7031K 24K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.9 1.8 221.0 221.0 0.50 0.48 1 0.504 113K 26 0.0 0.0 L3 16/0 967.76 MB 1.0 4.8 2.4 2.4 4.8 2.3 2.6 2.0 140.8 139.9 34.79 21.88 17 2.047 4955K 34K 0.0 0.0 L4 171/0 9.59 GB 1.0 4.0 3.5 0.5 4.0 3.5 1.1 1.1 129.5 128.8 31.86 19.30 41 0.777 4159K 22K 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1313/18 105.51 GB 0.0 24.4 11.7 12.7 33.8 21.1 13.3 3.5 151.7 209.9 164.87 129.12 229 0.720 25M 94K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.4 11.7 12.7 33.8 21.1 13.2 3.5 151.7 209.9 164.87 129.12 229 0.720 25M 94K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.4 11.7 12.7 24.3 11.6 0.0 0.0 188.3 187.1 132.82 104.09 92 1.444 25M 94K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 304.7 32.05 25.03 137 0.234 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.4 total, 53.2 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.80 GB write, 648.15 MB/s write, 24.43 GB read, 468.42 MB/s read, 164.9 seconds Interval compaction: 33.80 GB write, 650.96 MB/s write, 24.43 GB read, 470.45 MB/s read, 164.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 78, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 78, interval: 102 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4092885 Average: 2.8131 StdDev: 33.22 Min: 0 Median: 1.5113 Max: 19752 Percentiles: P50: 1.51 P75: 1.90 P99: 6.19 P99.9: 120.10 P99.99: 436.32 ------------------------------------------------------ [ 0, 1 ] 707071 17.276% 17.276% ### ( 1, 2 ] 2619476 64.001% 81.276% ############# ( 2, 3 ] 449122 10.973% 92.250% ## ( 3, 4 ] 158810 3.880% 96.130% # ( 4, 6 ] 116146 2.838% 98.967% # ( 6, 10 ] 28361 0.693% 99.660% ( 10, 15 ] 4485 0.110% 99.770% ( 15, 22 ] 648 0.016% 99.786% ( 22, 34 ] 41 0.001% 99.787% ( 34, 51 ] 20 0.000% 99.787% ( 51, 76 ] 101 0.002% 99.790% ( 76, 110 ] 4037 0.099% 99.888% ( 110, 170 ] 2823 0.069% 99.957% ( 170, 250 ] 669 0.016% 99.974% ( 250, 380 ] 511 0.012% 99.986% ( 380, 580 ] 553 0.014% 100.000% ( 580, 870 ] 346 0.008% 100.008% ( 870, 1300 ] 179 0.004% 100.013% ( 1300, 1900 ] 82 0.002% 100.015% ( 1900, 2900 ] 76 0.002% 100.016% ( 2900, 4400 ] 102 0.002% 100.019% ( 4400, 6600 ] 34 0.001% 100.020% ( 6600, 9900 ] 7 0.000% 100.020% ( 14000, 22000 ] 2 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1572686 Average: 5.7210 StdDev: 99.06 Min: 0 Median: 1.7713 Max: 18604 Percentiles: P50: 1.77 P75: 2.65 P99: 9.02 P99.9: 107.31 P99.99: 229.03 ------------------------------------------------------ [ 0, 1 ] 130512 8.299% 8.299% ## ( 1, 2 ] 850244 54.063% 62.362% ########### ( 2, 3 ] 304269 19.347% 81.709% #### ( 3, 4 ] 127055 8.079% 89.788% ## ( 4, 6 ] 121842 7.747% 97.535% ## ( 6, 10 ] 30507 1.940% 99.475% ( 10, 15 ] 4861 0.309% 99.784% ( 15, 22 ] 689 0.044% 99.828% ( 22, 34 ] 63 0.004% 99.832% ( 34, 51 ] 56 0.004% 99.835% ( 51, 76 ] 88 0.006% 99.841% ( 76, 110 ] 1007 0.064% 99.905% ( 110, 170 ] 1121 0.071% 99.976% ( 170, 250 ] 291 0.019% 99.995% ( 250, 380 ] 391 0.025% 100.020% ( 380, 580 ] 478 0.030% 100.050% ( 580, 870 ] 459 0.029% 100.079% ( 870, 1300 ] 345 0.022% 100.101% ( 1300, 1900 ] 209 0.013% 100.115% ( 1900, 2900 ] 262 0.017% 100.131% ( 2900, 4400 ] 396 0.025% 100.156% ( 4400, 6600 ] 108 0.007% 100.163% ( 6600, 9900 ] 58 0.004% 100.167% ( 9900, 14000 ] 3 0.000% 100.167% ( 14000, 22000 ] 2 0.000% 100.167% ** Level 2 read latency histogram (micros): Count: 28300 Average: 2.0876 StdDev: 3.05 Min: 0 Median: 1.4314 Max: 327 Percentiles: P50: 1.43 P75: 1.87 P99: 5.63 P99.9: 9.42 P99.99: 183.60 ------------------------------------------------------ [ 0, 1 ] 7122 25.166% 25.166% ##### ( 1, 2 ] 16291 57.565% 82.731% ############ ( 2, 3 ] 2629 9.290% 92.021% ## ( 3, 4 ] 1278 4.516% 96.537% # ( 4, 6 ] 856 3.025% 99.562% # ( 6, 10 ] 112 0.396% 99.958% ( 10, 15 ] 7 0.025% 99.982% ( 15, 22 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 1150106 Average: 8.3353 StdDev: 125.40 Min: 1 Median: 1.9337 Max: 16063 Percentiles: P50: 1.93 P75: 2.90 P99: 9.33 P99.9: 486.57 P99.99: 856.26 ------------------------------------------------------ [ 0, 1 ] 26568 2.310% 2.310% ( 1, 2 ] 587408 51.074% 53.384% ########## ( 2, 3 ] 274845 23.897% 77.282% ##### ( 3, 4 ] 119505 10.391% 87.672% ## ( 4, 6 ] 111368 9.683% 97.356% ## ( 6, 10 ] 22739 1.977% 99.333% ( 10, 15 ] 3789 0.329% 99.662% ( 15, 22 ] 472 0.041% 99.703% ( 22, 34 ] 72 0.006% 99.710% ( 34, 51 ] 26 0.002% 99.712% ( 51, 76 ] 53 0.005% 99.716% ( 76, 110 ] 249 0.022% 99.738% ( 110, 170 ] 585 0.051% 99.789% ( 170, 250 ] 417 0.036% 99.825% ( 250, 380 ] 505 0.044% 99.869% ( 380, 580 ] 666 0.058% 99.927% ( 580, 870 ] 760 0.066% 99.993% ( 870, 1300 ] 634 0.055% 100.048% ( 1300, 1900 ] 378 0.033% 100.081% ( 1900, 2900 ] 419 0.036% 100.118% ( 2900, 4400 ] 496 0.043% 100.161% ( 4400, 6600 ] 138 0.012% 100.173% ( 6600, 9900 ] 36 0.003% 100.176% ( 9900, 14000 ] 7 0.001% 100.176% ( 14000, 22000 ] 2 0.000% 100.177% ** Level 4 read latency histogram (micros): Count: 36794 Average: 30.4548 StdDev: 264.39 Min: 1 Median: 1.9069 Max: 17062 Percentiles: P50: 1.91 P75: 2.90 P99: 848.83 P99.9: 4127.94 P99.99: 6537.72 ------------------------------------------------------ [ 0, 1 ] 1092 2.968% 2.968% # ( 1, 2 ] 19082 51.862% 54.830% ########## ( 2, 3 ] 8208 22.308% 77.138% #### ( 3, 4 ] 3913 10.635% 87.772% ## ( 4, 6 ] 2582 7.017% 94.790% # ( 6, 10 ] 757 2.057% 96.847% ( 10, 15 ] 134 0.364% 97.212% ( 15, 22 ] 13 0.035% 97.247% ( 22, 34 ] 23 0.063% 97.309% ( 34, 51 ] 2 0.005% 97.315% ( 51, 76 ] 2 0.005% 97.320% ( 76, 110 ] 31 0.084% 97.404% ( 110, 170 ] 57 0.155% 97.559% ( 170, 250 ] 95 0.258% 97.818% ( 250, 380 ] 98 0.266% 98.084% ( 380, 580 ] 160 0.435% 98.519% ( 580, 870 ] 191 0.519% 99.038% ( 870, 1300 ] 149 0.405% 99.443% ( 1300, 1900 ] 77 0.209% 99.652% ( 1900, 2900 ] 47 0.128% 99.780% ( 2900, 4400 ] 54 0.147% 99.927% ( 4400, 6600 ] 24 0.065% 99.992% ( 6600, 9900 ] 5 0.014% 100.005% ( 14000, 22000 ] 1 0.003% 100.008% ** Level 5 read latency histogram (micros): Count: 280 Average: 1283.9107 StdDev: 1279.83 Min: 75 Median: 754.0000 Max: 5525 Percentiles: P50: 754.00 P75: 2084.21 P99: 5525.00 P99.9: 5525.00 P99.99: 5525.00 ------------------------------------------------------ ( 51, 76 ] 1 0.357% 0.357% ( 76, 110 ] 14 5.000% 5.357% # ( 110, 170 ] 22 7.857% 13.214% ## ( 170, 250 ] 24 8.571% 21.786% ## ( 250, 380 ] 35 12.500% 34.286% ### ( 380, 580 ] 26 9.286% 43.571% ## ( 580, 870 ] 30 10.714% 54.286% ## ( 870, 1300 ] 29 10.357% 64.643% ## ( 1300, 1900 ] 22 7.857% 72.500% ## ( 1900, 2900 ] 38 13.571% 86.071% ### ( 2900, 4400 ] 31 11.071% 97.143% ## ( 4400, 6600 ] 8 2.857% 100.000% # ** DB Stats ** Uptime(secs): 53.4 total, 3.4 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 184.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.624 H:M:S, 48.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.722 H:M:S, 21.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-06:02:49 ... thread 0: (1000000,11000000) ops and (357103.1,196538.0) ops/second in (2.800312,55.968811) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 3.32 GB 283.2 9.2 0.0 9.2 19.5 10.4 0.0 1.9 132.2 282.0 70.99 62.37 181 0.392 9529K 13K 0.0 0.0 L1 30/0 2.07 GB 212.3 8.9 6.9 2.0 8.8 6.8 0.1 1.3 209.5 206.9 43.61 38.62 5 8.722 8352K 24K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.9 1.8 221.0 221.0 0.50 0.48 1 0.504 113K 26 0.0 0.0 L3 16/0 967.76 MB 1.0 4.8 2.4 2.4 4.8 2.3 2.6 2.0 140.8 139.9 34.79 21.88 17 2.047 4955K 34K 0.0 0.0 L4 171/0 9.59 GB 1.0 4.0 3.5 0.5 4.0 3.5 1.1 1.1 129.5 128.8 31.86 19.30 41 0.777 4159K 22K 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1336/8 106.35 GB 0.0 27.0 12.9 14.1 37.2 23.1 13.3 3.6 152.2 209.7 181.76 142.65 245 0.742 27M 94K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.0 12.9 14.1 37.2 23.1 13.2 3.6 152.2 209.7 181.76 142.65 245 0.742 27M 94K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.0 12.9 14.1 26.8 12.7 0.0 0.0 187.8 186.6 147.27 115.44 95 1.550 27M 94K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.4 10.4 0.0 0.0 0.0 308.7 34.49 27.22 150 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.2 total, 56.0 interval Flush(GB): cumulative 10.397, interval 10.397 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.23 GB write, 678.28 MB/s write, 27.01 GB read, 492.13 MB/s read, 181.8 seconds Interval compaction: 37.23 GB write, 681.08 MB/s write, 27.01 GB read, 494.16 MB/s read, 181.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 79, interval: 103 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4317981 Average: 2.7652 StdDev: 32.42 Min: 0 Median: 1.5012 Max: 19752 Percentiles: P50: 1.50 P75: 1.89 P99: 5.99 P99.9: 115.60 P99.99: 426.92 ------------------------------------------------------ [ 0, 1 ] 775986 17.971% 17.971% #### ( 1, 2 ] 2759528 63.908% 81.879% ############# ( 2, 3 ] 459441 10.640% 92.519% ## ( 3, 4 ] 162515 3.764% 96.283% # ( 4, 6 ] 117685 2.725% 99.008% # ( 6, 10 ] 28735 0.665% 99.674% ( 10, 15 ] 4642 0.108% 99.781% ( 15, 22 ] 667 0.015% 99.797% ( 22, 34 ] 44 0.001% 99.798% ( 34, 51 ] 21 0.000% 99.798% ( 51, 76 ] 101 0.002% 99.800% ( 76, 110 ] 4038 0.094% 99.894% ( 110, 170 ] 2831 0.066% 99.960% ( 170, 250 ] 674 0.016% 99.975% ( 250, 380 ] 515 0.012% 99.987% ( 380, 580 ] 555 0.013% 100.000% ( 580, 870 ] 351 0.008% 100.008% ( 870, 1300 ] 181 0.004% 100.012% ( 1300, 1900 ] 85 0.002% 100.014% ( 1900, 2900 ] 77 0.002% 100.016% ( 2900, 4400 ] 102 0.002% 100.018% ( 4400, 6600 ] 34 0.001% 100.019% ( 6600, 9900 ] 7 0.000% 100.019% ( 14000, 22000 ] 2 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1579254 Average: 5.7334 StdDev: 98.96 Min: 0 Median: 1.7704 Max: 18604 Percentiles: P50: 1.77 P75: 2.65 P99: 9.03 P99.9: 109.49 P99.99: 244.60 ------------------------------------------------------ [ 0, 1 ] 131088 8.301% 8.301% ## ( 1, 2 ] 854853 54.130% 62.431% ########### ( 2, 3 ] 305122 19.321% 81.751% #### ( 3, 4 ] 127279 8.059% 89.811% ## ( 4, 6 ] 121935 7.721% 97.532% ## ( 6, 10 ] 30616 1.939% 99.471% ( 10, 15 ] 4870 0.308% 99.779% ( 15, 22 ] 690 0.044% 99.823% ( 22, 34 ] 63 0.004% 99.827% ( 34, 51 ] 56 0.004% 99.830% ( 51, 76 ] 94 0.006% 99.836% ( 76, 110 ] 1024 0.065% 99.901% ( 110, 170 ] 1131 0.072% 99.973% ( 170, 250 ] 295 0.019% 99.991% ( 250, 380 ] 409 0.026% 100.017% ( 380, 580 ] 486 0.031% 100.048% ( 580, 870 ] 471 0.030% 100.078% ( 870, 1300 ] 362 0.023% 100.101% ( 1300, 1900 ] 210 0.013% 100.114% ( 1900, 2900 ] 263 0.017% 100.131% ( 2900, 4400 ] 396 0.025% 100.156% ( 4400, 6600 ] 108 0.007% 100.163% ( 6600, 9900 ] 58 0.004% 100.166% ( 9900, 14000 ] 3 0.000% 100.166% ( 14000, 22000 ] 2 0.000% 100.167% ** Level 2 read latency histogram (micros): Count: 28300 Average: 2.0876 StdDev: 3.05 Min: 0 Median: 1.4314 Max: 327 Percentiles: P50: 1.43 P75: 1.87 P99: 5.63 P99.9: 9.42 P99.99: 183.60 ------------------------------------------------------ [ 0, 1 ] 7122 25.166% 25.166% ##### ( 1, 2 ] 16291 57.565% 82.731% ############ ( 2, 3 ] 2629 9.290% 92.021% ## ( 3, 4 ] 1278 4.516% 96.537% # ( 4, 6 ] 856 3.025% 99.562% # ( 6, 10 ] 112 0.396% 99.958% ( 10, 15 ] 7 0.025% 99.982% ( 15, 22 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 1150106 Average: 8.3353 StdDev: 125.40 Min: 1 Median: 1.9337 Max: 16063 Percentiles: P50: 1.93 P75: 2.90 P99: 9.33 P99.9: 486.57 P99.99: 856.26 ------------------------------------------------------ [ 0, 1 ] 26568 2.310% 2.310% ( 1, 2 ] 587408 51.074% 53.384% ########## ( 2, 3 ] 274845 23.897% 77.282% ##### ( 3, 4 ] 119505 10.391% 87.672% ## ( 4, 6 ] 111368 9.683% 97.356% ## ( 6, 10 ] 22739 1.977% 99.333% ( 10, 15 ] 3789 0.329% 99.662% ( 15, 22 ] 472 0.041% 99.703% ( 22, 34 ] 72 0.006% 99.710% ( 34, 51 ] 26 0.002% 99.712% ( 51, 76 ] 53 0.005% 99.716% ( 76, 110 ] 249 0.022% 99.738% ( 110, 170 ] 585 0.051% 99.789% ( 170, 250 ] 417 0.036% 99.825% ( 250, 380 ] 505 0.044% 99.869% ( 380, 580 ] 666 0.058% 99.927% ( 580, 870 ] 760 0.066% 99.993% ( 870, 1300 ] 634 0.055% 100.048% ( 1300, 1900 ] 378 0.033% 100.081% ( 1900, 2900 ] 419 0.036% 100.118% ( 2900, 4400 ] 496 0.043% 100.161% ( 4400, 6600 ] 138 0.012% 100.173% ( 6600, 9900 ] 36 0.003% 100.176% ( 9900, 14000 ] 7 0.001% 100.176% ( 14000, 22000 ] 2 0.000% 100.177% ** Level 4 read latency histogram (micros): Count: 36794 Average: 30.4548 StdDev: 264.39 Min: 1 Median: 1.9069 Max: 17062 Percentiles: P50: 1.91 P75: 2.90 P99: 848.83 P99.9: 4127.94 P99.99: 6537.72 ------------------------------------------------------ [ 0, 1 ] 1092 2.968% 2.968% # ( 1, 2 ] 19082 51.862% 54.830% ########## ( 2, 3 ] 8208 22.308% 77.138% #### ( 3, 4 ] 3913 10.635% 87.772% ## ( 4, 6 ] 2582 7.017% 94.790% # ( 6, 10 ] 757 2.057% 96.847% ( 10, 15 ] 134 0.364% 97.212% ( 15, 22 ] 13 0.035% 97.247% ( 22, 34 ] 23 0.063% 97.309% ( 34, 51 ] 2 0.005% 97.315% ( 51, 76 ] 2 0.005% 97.320% ( 76, 110 ] 31 0.084% 97.404% ( 110, 170 ] 57 0.155% 97.559% ( 170, 250 ] 95 0.258% 97.818% ( 250, 380 ] 98 0.266% 98.084% ( 380, 580 ] 160 0.435% 98.519% ( 580, 870 ] 191 0.519% 99.038% ( 870, 1300 ] 149 0.405% 99.443% ( 1300, 1900 ] 77 0.209% 99.652% ( 1900, 2900 ] 47 0.128% 99.780% ( 2900, 4400 ] 54 0.147% 99.927% ( 4400, 6600 ] 24 0.065% 99.992% ( 6600, 9900 ] 5 0.014% 100.005% ( 14000, 22000 ] 1 0.003% 100.008% ** Level 5 read latency histogram (micros): Count: 280 Average: 1283.9107 StdDev: 1279.83 Min: 75 Median: 754.0000 Max: 5525 Percentiles: P50: 754.00 P75: 2084.21 P99: 5525.00 P99.9: 5525.00 P99.99: 5525.00 ------------------------------------------------------ ( 51, 76 ] 1 0.357% 0.357% ( 76, 110 ] 14 5.000% 5.357% # ( 110, 170 ] 22 7.857% 13.214% ## ( 170, 250 ] 24 8.571% 21.786% ## ( 250, 380 ] 35 12.500% 34.286% ### ( 380, 580 ] 26 9.286% 43.571% ## ( 580, 870 ] 30 10.714% 54.286% ## ( 870, 1300 ] 29 10.357% 64.643% ## ( 1300, 1900 ] 22 7.857% 72.500% ## ( 1900, 2900 ] 38 13.571% 86.071% ### ( 2900, 4400 ] 31 11.071% 97.143% ## ( 4400, 6600 ] 8 2.857% 100.000% # ** DB Stats ** Uptime(secs): 56.2 total, 2.8 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 192.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.813 H:M:S, 45.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.189 H:M:S, 6.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.274 micros/op 189626 ops/sec 60.039 seconds 11384999 operations; 183.7 MB/s Microseconds per write: Count: 11384999 Average: 5.2735 StdDev: 545.44 Min: 0 Median: 1.7497 Max: 956003 Percentiles: P50: 1.75 P75: 2.75 P99: 8.48 P99.9: 1043.91 P99.99: 2658.77 ------------------------------------------------------ [ 0, 1 ] 1426052 12.526% 12.526% ### ( 1, 2 ] 5690630 49.984% 62.509% ########## ( 2, 3 ] 1889775 16.599% 79.108% ### ( 3, 4 ] 1581888 13.894% 93.003% ### ( 4, 6 ] 613439 5.388% 98.391% # ( 6, 10 ] 111893 0.983% 99.374% ( 10, 15 ] 32371 0.284% 99.658% ( 15, 22 ] 9159 0.080% 99.738% ( 22, 34 ] 1876 0.016% 99.755% ( 34, 51 ] 194 0.002% 99.757% ( 51, 76 ] 31 0.000% 99.757% ( 76, 110 ] 7990 0.070% 99.827% ( 110, 170 ] 3106 0.027% 99.854% ( 170, 250 ] 327 0.003% 99.857% ( 250, 380 ] 133 0.001% 99.858% ( 380, 580 ] 32 0.000% 99.859% ( 580, 870 ] 26 0.000% 99.859% ( 870, 1300 ] 11601 0.102% 99.961% ( 1300, 1900 ] 27 0.000% 99.961% ( 1900, 2900 ] 4363 0.038% 99.999% ( 2900, 4400 ] 46 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 4 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 195732 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11384999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11749318968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 601 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 28698627 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30628829426 rocksdb.compact.write.bytes COUNT : 30425005218 rocksdb.flush.write.bytes COUNT : 11692256477 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 67 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 367 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11598003200 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4525056 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30736282720 rocksdb.non.last.level.read.count COUNT : 7419520 rocksdb.block.checksum.compute.count COUNT : 7418385 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.389055 P95 : 3.875384 P99 : 6.661612 P100 : 956001.000000 COUNT : 11384999 SUM : 54621944 rocksdb.compaction.times.micros P50 : 1025277.777778 P95 : 3390000.000000 P99 : 14080000.000000 P100 : 19045059.000000 COUNT : 99 SUM : 151502056 rocksdb.compaction.times.cpu_micros P50 : 906750.000000 P95 : 2583333.333333 P99 : 14080000.000000 P100 : 17550963.000000 COUNT : 99 SUM : 119584495 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 710.500000 P95 : 6765.000000 P99 : 204400.000000 P100 : 423623.000000 COUNT : 157 SUM : 834981 rocksdb.compaction.outfile.sync.micros P50 : 1141.437500 P95 : 179090.909091 P99 : 325833.333333 P100 : 337719.000000 COUNT : 375 SUM : 10644039 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 104.590909 P95 : 2422.222222 P99 : 5236.000000 P100 : 7672.000000 COUNT : 286 SUM : 126898 rocksdb.table.open.io.micros P50 : 1451.851852 P95 : 7504.655172 P99 : 11432.375000 P100 : 16341.000000 COUNT : 601 SUM : 1322925 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.649234 P95 : 7.733445 P99 : 10.722078 P100 : 19759.000000 COUNT : 7416750 SUM : 47953838 rocksdb.read.block.get.micros P50 : 442.385321 P95 : 3595.070423 P99 : 5398.000000 P100 : 5711.000000 COUNT : 1202 SUM : 1073071 rocksdb.write.raw.block.micros P50 : 0.513546 P95 : 0.975738 P99 : 2.929763 P100 : 32347.000000 COUNT : 10200481 SUM : 22202029 rocksdb.numfiles.in.singlecompaction P50 : 3.185185 P95 : 5.500000 P99 : 28.000000 P100 : 44.000000 COUNT : 150 SUM : 587 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559887 P95 : 1184.122919 P99 : 2561.299122 P100 : 955809.000000 COUNT : 149922 SUM : 28710774 rocksdb.sst.read.micros P50 : 1.604166 P95 : 4.618407 P99 : 8.271439 P100 : 19752.000000 COUNT : 7419888 SUM : 32892622 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11384999 SUM : 11749318968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212201.834862 P95 : 482125.000000 P99 : 1022066.666667 P100 : 1096377.000000 COUNT : 157 SUM : 35875119 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 369 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0