[2024-12-05 12:52:56.208526] Starting SPDK v25.01-pre git sha1 8d3947977 / DPDK 22.11.4 initialization... [2024-12-05 12:52:56.208644] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid38230 ] Set seed to 1733399576205973 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-05 12:52:56.324950] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-05 12:52:56.349909] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-05 12:52:56.349970] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 38230' to capture a snapshot of events at runtime. [2024-12-05 12:52:56.349983] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-05 12:52:56.349996] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-05 12:52:56.350006] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid38230 for offline analysis/debug. [2024-12-05 12:52:56.350558] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Dec 5 12:52:58 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/05-12:53:01 ... thread 0: (1000000,1000000) ops and (338735.7,338735.7) ops/second in (2.952154,2.952154) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 567.01 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 355.3 2.48 2.33 13 0.191 0 0 0.0 0.0 L1 3/3 188.89 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 257.1 257.0 0.73 0.72 1 0.735 191K 56 0.0 0.0 L2 2/1 125.97 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 235.7 235.6 0.53 0.52 1 0.535 127K 40 0.0 0.0 L3 11/0 930.25 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1197/12 97.00 GB 0.0 0.3 0.2 0.1 1.2 1.1 0.3 1.4 83.9 319.0 3.75 3.57 15 0.250 319K 96 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.2 1.1 0.2 1.4 83.9 319.0 3.75 3.57 15 0.250 319K 96 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 248.1 248.0 1.27 1.24 2 0.635 319K 96 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 355.3 2.48 2.33 13 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 380.05 MB/s write, 0.31 GB read, 100.02 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 405.25 MB/s write, 0.31 GB read, 106.65 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 132485 Average: 1.8749 StdDev: 5.13 Min: 1 Median: 1.2726 Max: 1428 Percentiles: P50: 1.27 P75: 1.71 P99: 5.32 P99.9: 11.82 P99.99: 209.10 ------------------------------------------------------ [ 0, 1 ] 45634 34.445% 34.445% ####### ( 1, 2 ] 75589 57.055% 91.499% ########### ( 2, 3 ] 6450 4.868% 96.368% # ( 3, 4 ] 2540 1.917% 98.285% ( 4, 6 ] 1439 1.086% 99.371% ( 6, 10 ] 655 0.494% 99.866% ( 10, 15 ] 128 0.097% 99.962% ( 15, 22 ] 19 0.014% 99.977% ( 22, 34 ] 7 0.005% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 170, 250 ] 22 0.017% 99.999% ( 250, 380 ] 2 0.002% 100.001% ( 380, 580 ] 1 0.001% 100.002% ( 1300, 1900 ] 1 0.001% 100.002% ** Level 1 read latency histogram (micros): Count: 25936 Average: 1.8720 StdDev: 4.83 Min: 0 Median: 1.2922 Max: 431 Percentiles: P50: 1.29 P75: 1.72 P99: 4.37 P99.9: 9.16 P99.99: 407.09 ------------------------------------------------------ [ 0, 1 ] 8534 32.904% 32.904% ####### ( 1, 2 ] 15173 58.502% 91.406% ############ ( 2, 3 ] 1349 5.201% 96.607% # ( 3, 4 ] 581 2.240% 98.847% ( 4, 6 ] 217 0.837% 99.684% ( 6, 10 ] 72 0.278% 99.961% ( 10, 15 ] 4 0.015% 99.977% ( 15, 22 ] 2 0.008% 99.985% ( 34, 51 ] 1 0.004% 99.988% ( 170, 250 ] 1 0.004% 99.992% ( 380, 580 ] 3 0.012% 100.004% ** Level 2 read latency histogram (micros): Count: 16522 Average: 2.8618 StdDev: 21.10 Min: 1 Median: 1.6362 Max: 1655 Percentiles: P50: 1.64 P75: 2.07 P99: 9.24 P99.9: 21.01 P99.99: 1404.34 ------------------------------------------------------ [ 0, 1 ] 1304 7.893% 7.893% ## ( 1, 2 ] 10936 66.191% 74.083% ############# ( 2, 3 ] 2193 13.273% 87.356% ### ( 3, 4 ] 941 5.695% 93.052% # ( 4, 6 ] 783 4.739% 97.791% # ( 6, 10 ] 247 1.495% 99.286% ( 10, 15 ] 80 0.484% 99.770% ( 15, 22 ] 25 0.151% 99.921% ( 22, 34 ] 5 0.030% 99.952% ( 51, 76 ] 1 0.006% 99.958% ( 250, 380 ] 2 0.012% 99.970% ( 380, 580 ] 1 0.006% 99.976% ( 580, 870 ] 1 0.006% 99.982% ( 870, 1300 ] 1 0.006% 99.988% ( 1300, 1900 ] 2 0.012% 100.000% ** Level 3 read latency histogram (micros): Count: 50 Average: 1188.9200 StdDev: 738.04 Min: 139 Median: 1085.0000 Max: 2665 Percentiles: P50: 1085.00 P75: 1738.46 P99: 2665.00 P99.9: 2665.00 P99.99: 2665.00 ------------------------------------------------------ ( 110, 170 ] 1 2.000% 2.000% ( 170, 250 ] 1 2.000% 4.000% ( 250, 380 ] 7 14.000% 18.000% ### ( 380, 580 ] 6 12.000% 30.000% ## ( 580, 870 ] 7 14.000% 44.000% ### ( 870, 1300 ] 6 12.000% 56.000% ## ( 1300, 1900 ] 13 26.000% 82.000% ##### ( 1900, 2900 ] 9 18.000% 100.000% #### ** Level 4 read latency histogram (micros): Count: 25 Average: 1234.8800 StdDev: 655.89 Min: 296 Median: 1138.7500 Max: 2677 Percentiles: P50: 1138.75 P75: 1775.00 P99: 2677.00 P99.9: 2677.00 P99.99: 2677.00 ------------------------------------------------------ ( 250, 380 ] 1 4.000% 4.000% # ( 380, 580 ] 3 12.000% 16.000% ## ( 580, 870 ] 6 24.000% 40.000% ##### ( 870, 1300 ] 4 16.000% 56.000% ### ( 1300, 1900 ] 6 24.000% 80.000% ##### ( 1900, 2900 ] 5 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 312.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.155 H:M:S, 4.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.155 H:M:S, 5.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/05-12:53:04 ... thread 0: (1000000,2000000) ops and (342009.4,340364.7) ops/second in (2.923896,5.876050) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.23 GB 75.5 0.7 0.0 0.7 2.5 1.8 0.0 1.4 92.7 316.5 8.16 7.73 31 0.263 767K 713 0.0 0.0 L1 1/0 4.27 MB 0.4 0.6 0.4 0.2 0.6 0.4 0.1 1.4 240.4 240.1 2.62 2.55 2 1.310 639K 816 0.0 0.0 L2 2/1 50.69 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 235.7 235.6 0.53 0.52 1 0.535 127K 40 0.0 0.0 L3 21/11 1.30 GB 0.4 0.1 0.1 0.0 0.1 0.1 0.5 1.0 211.7 211.7 0.59 0.55 1 0.589 126K 0 0.0 0.0 L4 174/0 9.64 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 150.5 150.5 0.75 0.63 1 0.747 114K 0 0.0 0.0 L5 1056/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/20 97.92 GB 0.0 1.7 0.7 1.0 3.5 2.5 1.1 2.0 138.3 282.6 12.65 11.99 36 0.351 1775K 1569 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.7 1.0 3.5 2.5 1.0 2.0 138.3 282.6 12.65 11.99 36 0.351 1775K 1569 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.7 1.0 1.7 0.7 0.0 0.0 231.4 231.2 7.56 7.26 8 0.945 1775K 1569 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 358.9 5.09 4.73 28 0.182 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.49 GB write, 588.58 MB/s write, 1.71 GB read, 288.01 MB/s read, 12.6 seconds Interval compaction: 3.49 GB write, 608.19 MB/s write, 1.71 GB read, 297.60 MB/s read, 12.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 401868 Average: 2.2038 StdDev: 4.70 Min: 1 Median: 1.5043 Max: 1428 Percentiles: P50: 1.50 P75: 1.90 P99: 5.94 P99.9: 13.00 P99.99: 17.85 ------------------------------------------------------ [ 0, 1 ] 72566 18.057% 18.057% #### ( 1, 2 ] 254562 63.345% 81.402% ############# ( 2, 3 ] 44837 11.157% 92.559% ## ( 3, 4 ] 16657 4.145% 96.704% # ( 4, 6 ] 9519 2.369% 99.073% ( 6, 10 ] 2834 0.705% 99.778% ( 10, 15 ] 821 0.204% 99.982% ( 15, 22 ] 83 0.021% 100.003% ( 22, 34 ] 18 0.004% 100.007% ( 34, 51 ] 3 0.001% 100.008% ( 51, 76 ] 4 0.001% 100.009% ( 76, 110 ] 2 0.000% 100.009% ( 170, 250 ] 44 0.011% 100.020% ( 250, 380 ] 10 0.002% 100.023% ( 380, 580 ] 3 0.001% 100.024% ( 580, 870 ] 1 0.000% 100.024% ( 870, 1300 ] 3 0.001% 100.025% ( 1300, 1900 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 47992 Average: 2.1750 StdDev: 7.06 Min: 0 Median: 1.4619 Max: 618 Percentiles: P50: 1.46 P75: 1.86 P99: 5.57 P99.9: 9.88 P99.99: 485.02 ------------------------------------------------------ [ 0, 1 ] 10196 21.245% 21.245% #### ( 1, 2 ] 29878 62.256% 83.501% ############ ( 2, 3 ] 4688 9.768% 93.270% ## ( 3, 4 ] 2003 4.174% 97.443% # ( 4, 6 ] 954 1.988% 99.431% ( 6, 10 ] 232 0.483% 99.915% ( 10, 15 ] 25 0.052% 99.967% ( 15, 22 ] 2 0.004% 99.971% ( 34, 51 ] 1 0.002% 99.973% ( 110, 170 ] 1 0.002% 99.975% ( 170, 250 ] 2 0.004% 99.979% ( 250, 380 ] 1 0.002% 99.981% ( 380, 580 ] 8 0.017% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31856 Average: 2.6378 StdDev: 15.22 Min: 1 Median: 1.6387 Max: 1655 Percentiles: P50: 1.64 P75: 2.06 P99: 8.21 P99.9: 17.29 P99.99: 816.18 ------------------------------------------------------ [ 0, 1 ] 2335 7.330% 7.330% # ( 1, 2 ] 21281 66.804% 74.134% ############# ( 2, 3 ] 4553 14.292% 88.426% ### ( 3, 4 ] 1778 5.581% 94.007% # ( 4, 6 ] 1387 4.354% 98.361% # ( 6, 10 ] 369 1.158% 99.520% ( 10, 15 ] 112 0.352% 99.871% ( 15, 22 ] 28 0.088% 99.959% ( 22, 34 ] 5 0.016% 99.975% ( 51, 76 ] 1 0.003% 99.978% ( 250, 380 ] 2 0.006% 99.984% ( 380, 580 ] 1 0.003% 99.987% ( 580, 870 ] 1 0.003% 99.991% ( 870, 1300 ] 1 0.003% 99.994% ( 1300, 1900 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 157101 Average: 3.0733 StdDev: 25.77 Min: 0 Median: 1.6273 Max: 2665 Percentiles: P50: 1.63 P75: 2.10 P99: 9.35 P99.9: 136.43 P99.99: 1405.69 ------------------------------------------------------ [ 0, 1 ] 16425 10.455% 10.455% ## ( 1, 2 ] 99037 63.040% 73.495% ############# ( 2, 3 ] 23402 14.896% 88.392% ### ( 3, 4 ] 8982 5.717% 94.109% # ( 4, 6 ] 5200 3.310% 97.419% # ( 6, 10 ] 2966 1.888% 99.307% ( 10, 15 ] 470 0.299% 99.606% ( 15, 22 ] 66 0.042% 99.648% ( 22, 34 ] 49 0.031% 99.679% ( 34, 51 ] 189 0.120% 99.799% ( 51, 76 ] 40 0.025% 99.825% ( 76, 110 ] 69 0.044% 99.869% ( 110, 170 ] 111 0.071% 99.940% ( 170, 250 ] 33 0.021% 99.961% ( 250, 380 ] 19 0.012% 99.973% ( 380, 580 ] 12 0.008% 99.980% ( 580, 870 ] 7 0.004% 99.985% ( 870, 1300 ] 6 0.004% 99.989% ( 1300, 1900 ] 13 0.008% 99.997% ( 1900, 2900 ] 9 0.006% 100.003% ** Level 4 read latency histogram (micros): Count: 315 Average: 101.2254 StdDev: 380.96 Min: 0 Median: 1.2742 Max: 2677 Percentiles: P50: 1.27 P75: 2.45 P99: 2270.00 P99.9: 2677.00 P99.99: 2677.00 ------------------------------------------------------ [ 0, 1 ] 132 41.905% 41.905% ######## ( 1, 2 ] 93 29.524% 71.429% ###### ( 2, 3 ] 25 7.937% 79.365% ## ( 3, 4 ] 11 3.492% 82.857% # ( 4, 6 ] 22 6.984% 89.841% # ( 6, 10 ] 3 0.952% 90.794% ( 10, 15 ] 1 0.317% 91.111% ( 110, 170 ] 2 0.635% 91.746% ( 170, 250 ] 1 0.317% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 6 1.905% 95.238% ( 870, 1300 ] 4 1.270% 96.508% ( 1300, 1900 ] 6 1.905% 98.413% ( 1900, 2900 ] 5 1.587% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.155 H:M:S, 2.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 336.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/05-12:53:06 ... thread 0: (1000000,3000000) ops and (350141.3,343562.3) ops/second in (2.855990,8.732040) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 2.21 GB 176.2 1.7 0.0 1.7 4.5 2.8 0.0 1.6 119.3 311.0 14.78 14.08 51 0.290 1791K 1662 0.0 0.0 L1 1/0 4.27 MB 0.4 0.6 0.4 0.2 0.6 0.4 0.1 1.4 240.4 240.1 2.62 2.55 2 1.310 639K 816 0.0 0.0 L2 1/0 49.52 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 235.7 235.6 0.53 0.52 1 0.535 127K 40 0.0 0.0 L3 17/0 813.82 MB 0.8 1.0 0.1 0.9 1.0 0.1 0.5 8.4 250.0 249.8 4.22 4.06 2 2.112 1072K 1184 0.0 0.0 L4 174/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 150.5 150.5 0.75 0.63 1 0.747 114K 0 0.0 0.0 L5 1064/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/8 98.90 GB 0.0 3.6 0.7 2.9 6.4 3.5 2.3 2.3 161.0 284.6 22.91 21.84 57 0.402 3745K 3702 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 0.7 2.9 6.4 3.5 2.2 2.3 161.0 284.6 22.91 21.84 57 0.402 3745K 3702 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 0.7 2.9 3.6 0.7 0.0 0.0 243.9 243.7 15.12 14.62 13 1.163 3745K 3702 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 364.0 7.79 7.22 44 0.177 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.7 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.37 GB write, 730.18 MB/s write, 3.60 GB read, 413.10 MB/s read, 22.9 seconds Interval compaction: 6.37 GB write, 746.55 MB/s write, 3.60 GB read, 422.36 MB/s read, 22.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 643978 Average: 2.1840 StdDev: 4.84 Min: 0 Median: 1.4954 Max: 1428 Percentiles: P50: 1.50 P75: 1.89 P99: 5.88 P99.9: 12.82 P99.99: 18.13 ------------------------------------------------------ [ 0, 1 ] 118356 18.379% 18.379% #### ( 1, 2 ] 411060 63.831% 82.210% ############# ( 2, 3 ] 69720 10.826% 93.037% ## ( 3, 4 ] 25341 3.935% 96.972% # ( 4, 6 ] 13915 2.161% 99.133% ( 6, 10 ] 4263 0.662% 99.795% ( 10, 15 ] 1207 0.187% 99.982% ( 15, 22 ] 120 0.019% 100.001% ( 22, 34 ] 23 0.004% 100.004% ( 34, 51 ] 4 0.001% 100.005% ( 51, 76 ] 8 0.001% 100.006% ( 76, 110 ] 2 0.000% 100.006% ( 170, 250 ] 71 0.011% 100.017% ( 250, 380 ] 15 0.002% 100.020% ( 380, 580 ] 5 0.001% 100.020% ( 580, 870 ] 5 0.001% 100.021% ( 870, 1300 ] 5 0.001% 100.022% ( 1300, 1900 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 47992 Average: 2.1750 StdDev: 7.06 Min: 0 Median: 1.4619 Max: 618 Percentiles: P50: 1.46 P75: 1.86 P99: 5.57 P99.9: 9.88 P99.99: 485.02 ------------------------------------------------------ [ 0, 1 ] 10196 21.245% 21.245% #### ( 1, 2 ] 29878 62.256% 83.501% ############ ( 2, 3 ] 4688 9.768% 93.270% ## ( 3, 4 ] 2003 4.174% 97.443% # ( 4, 6 ] 954 1.988% 99.431% ( 6, 10 ] 232 0.483% 99.915% ( 10, 15 ] 25 0.052% 99.967% ( 15, 22 ] 2 0.004% 99.971% ( 34, 51 ] 1 0.002% 99.973% ( 110, 170 ] 1 0.002% 99.975% ( 170, 250 ] 2 0.004% 99.979% ( 250, 380 ] 1 0.002% 99.981% ( 380, 580 ] 8 0.017% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 60272 Average: 2.5989 StdDev: 11.68 Min: 1 Median: 1.6148 Max: 1655 Percentiles: P50: 1.61 P75: 1.99 P99: 8.53 P99.9: 46.65 P99.99: 346.62 ------------------------------------------------------ [ 0, 1 ] 5306 8.803% 8.803% ## ( 1, 2 ] 40386 67.006% 75.810% ############# ( 2, 3 ] 8068 13.386% 89.196% ### ( 3, 4 ] 3166 5.253% 94.449% # ( 4, 6 ] 2174 3.607% 98.055% # ( 6, 10 ] 900 1.493% 99.549% ( 10, 15 ] 142 0.236% 99.784% ( 15, 22 ] 28 0.046% 99.831% ( 22, 34 ] 6 0.010% 99.841% ( 34, 51 ] 48 0.080% 99.920% ( 51, 76 ] 14 0.023% 99.944% ( 76, 110 ] 9 0.015% 99.959% ( 110, 170 ] 13 0.022% 99.980% ( 170, 250 ] 3 0.005% 99.985% ( 250, 380 ] 4 0.007% 99.992% ( 380, 580 ] 1 0.002% 99.993% ( 580, 870 ] 1 0.002% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 236641 Average: 2.8801 StdDev: 21.36 Min: 0 Median: 1.5987 Max: 2665 Percentiles: P50: 1.60 P75: 1.99 P99: 9.11 P99.9: 127.85 P99.99: 894.07 ------------------------------------------------------ [ 0, 1 ] 26751 11.304% 11.304% ## ( 1, 2 ] 152944 64.631% 75.936% ############# ( 2, 3 ] 32195 13.605% 89.541% ### ( 3, 4 ] 12280 5.189% 94.730% # ( 4, 6 ] 6697 2.830% 97.560% # ( 6, 10 ] 4379 1.850% 99.410% ( 10, 15 ] 550 0.232% 99.643% ( 15, 22 ] 69 0.029% 99.672% ( 22, 34 ] 50 0.021% 99.693% ( 34, 51 ] 314 0.133% 99.826% ( 51, 76 ] 56 0.024% 99.850% ( 76, 110 ] 78 0.033% 99.883% ( 110, 170 ] 139 0.059% 99.941% ( 170, 250 ] 70 0.030% 99.971% ( 250, 380 ] 24 0.010% 99.981% ( 380, 580 ] 14 0.006% 99.987% ( 580, 870 ] 7 0.003% 99.990% ( 870, 1300 ] 6 0.003% 99.992% ( 1300, 1900 ] 13 0.005% 99.998% ( 1900, 2900 ] 9 0.004% 100.002% ** Level 4 read latency histogram (micros): Count: 315 Average: 101.2254 StdDev: 380.96 Min: 0 Median: 1.2742 Max: 2677 Percentiles: P50: 1.27 P75: 2.45 P99: 2270.00 P99.9: 2677.00 P99.99: 2677.00 ------------------------------------------------------ [ 0, 1 ] 132 41.905% 41.905% ######## ( 1, 2 ] 93 29.524% 71.429% ###### ( 2, 3 ] 25 7.937% 79.365% ## ( 3, 4 ] 11 3.492% 82.857% # ( 4, 6 ] 22 6.984% 89.841% # ( 6, 10 ] 3 0.952% 90.794% ( 10, 15 ] 1 0.317% 91.111% ( 110, 170 ] 2 0.635% 91.746% ( 170, 250 ] 1 0.317% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 6 1.905% 95.238% ( 870, 1300 ] 4 1.270% 96.508% ( 1300, 1900 ] 6 1.905% 98.413% ( 1900, 2900 ] 5 1.587% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 329.5000 StdDev: 279.53 Min: 110 Median: 210.0000 Max: 1207 Percentiles: P50: 210.00 P75: 446.67 P99: 1207.00 P99.9: 1207.00 P99.99: 1207.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 13 32.500% 35.000% ####### ( 170, 250 ] 12 30.000% 65.000% ###### ( 250, 380 ] 3 7.500% 72.500% ## ( 380, 580 ] 3 7.500% 80.000% ## ( 580, 870 ] 5 12.500% 92.500% ### ( 870, 1300 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 8.9 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 330.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.155 H:M:S, 1.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 344.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/05-12:53:09 ... thread 0: (1000000,4000000) ops and (354214.8,346164.9) ops/second in (2.823146,11.555186) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/4 3.13 GB 295.8 2.7 0.0 2.7 6.4 3.7 0.0 1.7 131.2 309.9 21.13 20.17 70 0.302 2814K 2677 0.0 0.0 L1 1/0 4.27 MB 0.4 0.6 0.4 0.2 0.6 0.4 0.1 1.4 240.4 240.1 2.62 2.55 2 1.310 639K 816 0.0 0.0 L2 1/0 49.52 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 235.7 235.6 0.53 0.52 1 0.535 127K 40 0.0 0.0 L3 17/0 813.82 MB 0.8 1.0 0.1 0.9 1.0 0.1 0.5 8.4 250.0 249.8 4.22 4.06 2 2.112 1072K 1184 0.0 0.0 L4 174/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 150.5 150.5 0.75 0.63 1 0.747 114K 0 0.0 0.0 L5 1064/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/4 99.82 GB 0.0 4.6 0.7 3.9 8.3 4.4 2.3 2.2 160.5 289.6 29.26 27.93 76 0.385 4769K 4717 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 0.7 3.9 8.3 4.4 2.2 2.2 160.5 289.6 29.26 27.93 76 0.385 4769K 4717 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 0.7 3.9 4.6 0.7 0.0 0.0 246.8 246.6 19.03 18.45 17 1.119 4769K 4717 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 369.6 10.23 9.49 59 0.173 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.8 total, 11.6 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.27 GB write, 720.86 MB/s write, 4.59 GB read, 399.64 MB/s read, 29.3 seconds Interval compaction: 8.27 GB write, 733.07 MB/s write, 4.59 GB read, 406.41 MB/s read, 29.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 894235 Average: 2.1245 StdDev: 5.23 Min: 0 Median: 1.4625 Max: 1428 Percentiles: P50: 1.46 P75: 1.86 P99: 5.74 P99.9: 12.48 P99.99: 18.09 ------------------------------------------------------ [ 0, 1 ] 183746 20.548% 20.548% #### ( 1, 2 ] 569399 63.674% 84.222% ############# ( 2, 3 ] 87509 9.786% 94.008% ## ( 3, 4 ] 30923 3.458% 97.466% # ( 4, 6 ] 15792 1.766% 99.232% ( 6, 10 ] 5241 0.586% 99.818% ( 10, 15 ] 1477 0.165% 99.983% ( 15, 22 ] 135 0.015% 99.999% ( 22, 34 ] 29 0.003% 100.002% ( 34, 51 ] 5 0.001% 100.002% ( 51, 76 ] 12 0.001% 100.004% ( 76, 110 ] 2 0.000% 100.004% ( 110, 170 ] 1 0.000% 100.004% ( 170, 250 ] 93 0.010% 100.014% ( 250, 380 ] 22 0.002% 100.017% ( 380, 580 ] 7 0.001% 100.018% ( 580, 870 ] 5 0.001% 100.018% ( 870, 1300 ] 10 0.001% 100.019% ( 1300, 1900 ] 2 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 47992 Average: 2.1750 StdDev: 7.06 Min: 0 Median: 1.4619 Max: 618 Percentiles: P50: 1.46 P75: 1.86 P99: 5.57 P99.9: 9.88 P99.99: 485.02 ------------------------------------------------------ [ 0, 1 ] 10196 21.245% 21.245% #### ( 1, 2 ] 29878 62.256% 83.501% ############ ( 2, 3 ] 4688 9.768% 93.270% ## ( 3, 4 ] 2003 4.174% 97.443% # ( 4, 6 ] 954 1.988% 99.431% ( 6, 10 ] 232 0.483% 99.915% ( 10, 15 ] 25 0.052% 99.967% ( 15, 22 ] 2 0.004% 99.971% ( 34, 51 ] 1 0.002% 99.973% ( 110, 170 ] 1 0.002% 99.975% ( 170, 250 ] 2 0.004% 99.979% ( 250, 380 ] 1 0.002% 99.981% ( 380, 580 ] 8 0.017% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 60272 Average: 2.5989 StdDev: 11.68 Min: 1 Median: 1.6148 Max: 1655 Percentiles: P50: 1.61 P75: 1.99 P99: 8.53 P99.9: 46.65 P99.99: 346.62 ------------------------------------------------------ [ 0, 1 ] 5306 8.803% 8.803% ## ( 1, 2 ] 40386 67.006% 75.810% ############# ( 2, 3 ] 8068 13.386% 89.196% ### ( 3, 4 ] 3166 5.253% 94.449% # ( 4, 6 ] 2174 3.607% 98.055% # ( 6, 10 ] 900 1.493% 99.549% ( 10, 15 ] 142 0.236% 99.784% ( 15, 22 ] 28 0.046% 99.831% ( 22, 34 ] 6 0.010% 99.841% ( 34, 51 ] 48 0.080% 99.920% ( 51, 76 ] 14 0.023% 99.944% ( 76, 110 ] 9 0.015% 99.959% ( 110, 170 ] 13 0.022% 99.980% ( 170, 250 ] 3 0.005% 99.985% ( 250, 380 ] 4 0.007% 99.992% ( 380, 580 ] 1 0.002% 99.993% ( 580, 870 ] 1 0.002% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 236641 Average: 2.8801 StdDev: 21.36 Min: 0 Median: 1.5987 Max: 2665 Percentiles: P50: 1.60 P75: 1.99 P99: 9.11 P99.9: 127.85 P99.99: 894.07 ------------------------------------------------------ [ 0, 1 ] 26751 11.304% 11.304% ## ( 1, 2 ] 152944 64.631% 75.936% ############# ( 2, 3 ] 32195 13.605% 89.541% ### ( 3, 4 ] 12280 5.189% 94.730% # ( 4, 6 ] 6697 2.830% 97.560% # ( 6, 10 ] 4379 1.850% 99.410% ( 10, 15 ] 550 0.232% 99.643% ( 15, 22 ] 69 0.029% 99.672% ( 22, 34 ] 50 0.021% 99.693% ( 34, 51 ] 314 0.133% 99.826% ( 51, 76 ] 56 0.024% 99.850% ( 76, 110 ] 78 0.033% 99.883% ( 110, 170 ] 139 0.059% 99.941% ( 170, 250 ] 70 0.030% 99.971% ( 250, 380 ] 24 0.010% 99.981% ( 380, 580 ] 14 0.006% 99.987% ( 580, 870 ] 7 0.003% 99.990% ( 870, 1300 ] 6 0.003% 99.992% ( 1300, 1900 ] 13 0.005% 99.998% ( 1900, 2900 ] 9 0.004% 100.002% ** Level 4 read latency histogram (micros): Count: 315 Average: 101.2254 StdDev: 380.96 Min: 0 Median: 1.2742 Max: 2677 Percentiles: P50: 1.27 P75: 2.45 P99: 2270.00 P99.9: 2677.00 P99.99: 2677.00 ------------------------------------------------------ [ 0, 1 ] 132 41.905% 41.905% ######## ( 1, 2 ] 93 29.524% 71.429% ###### ( 2, 3 ] 25 7.937% 79.365% ## ( 3, 4 ] 11 3.492% 82.857% # ( 4, 6 ] 22 6.984% 89.841% # ( 6, 10 ] 3 0.952% 90.794% ( 10, 15 ] 1 0.317% 91.111% ( 110, 170 ] 2 0.635% 91.746% ( 170, 250 ] 1 0.317% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 6 1.905% 95.238% ( 870, 1300 ] 4 1.270% 96.508% ( 1300, 1900 ] 6 1.905% 98.413% ( 1900, 2900 ] 5 1.587% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 329.5000 StdDev: 279.53 Min: 110 Median: 210.0000 Max: 1207 Percentiles: P50: 210.00 P75: 446.67 P99: 1207.00 P99.9: 1207.00 P99.99: 1207.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 13 32.500% 35.000% ####### ( 170, 250 ] 12 30.000% 65.000% ###### ( 250, 380 ] 3 7.500% 72.500% ## ( 380, 580 ] 3 7.500% 80.000% ## ( 580, 870 ] 5 12.500% 92.500% ### ( 870, 1300 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 11.8 total, 2.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 334.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.155 H:M:S, 1.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/05-12:53:14 ... thread 0: (1000000,5000000) ops and (194611.8,299515.6) ops/second in (5.138435,16.693621) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 21/17 4.24 GB 44.1 3.9 0.0 3.9 8.7 4.8 0.0 1.8 139.0 308.3 29.00 27.74 93 0.312 4093K 3951 0.0 0.0 L1 1/1 4.27 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 240.4 240.1 2.62 2.55 2 1.310 639K 816 0.0 0.0 L2 1/0 49.52 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 235.7 235.6 0.53 0.52 1 0.535 127K 40 0.0 0.0 L3 17/0 813.82 MB 0.8 1.0 0.1 0.9 1.0 0.1 0.5 8.4 250.0 249.8 4.22 4.06 2 2.112 1072K 1184 0.0 0.0 L4 174/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 150.5 150.5 0.75 0.63 1 0.747 114K 0 0.0 0.0 L5 1064/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1278/18 100.93 GB 0.0 5.8 0.7 5.1 10.6 5.5 2.3 2.2 160.4 292.6 37.13 35.50 99 0.375 6048K 5991 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 0.7 5.1 10.6 5.5 2.2 2.2 160.4 292.6 37.13 35.50 99 0.375 6048K 5991 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 0.7 5.1 5.8 0.7 0.0 0.0 250.3 250.1 23.80 23.14 22 1.082 6048K 5991 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.8 4.8 0.0 0.0 0.0 368.5 13.33 12.36 77 0.173 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.9 total, 16.7 interval Flush(GB): cumulative 4.799, interval 4.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.61 GB write, 643.20 MB/s write, 5.82 GB read, 352.65 MB/s read, 37.1 seconds Interval compaction: 10.61 GB write, 650.75 MB/s write, 5.82 GB read, 356.78 MB/s read, 37.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 1, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1316095 Average: 2.0907 StdDev: 5.89 Min: 0 Median: 1.4259 Max: 1428 Percentiles: P50: 1.43 P75: 1.82 P99: 5.58 P99.9: 12.99 P99.99: 101.85 ------------------------------------------------------ [ 0, 1 ] 301879 22.937% 22.937% ##### ( 1, 2 ] 836369 63.549% 86.487% ############# ( 2, 3 ] 111162 8.446% 94.933% ## ( 3, 4 ] 38848 2.952% 97.885% # ( 4, 6 ] 18626 1.415% 99.300% ( 6, 10 ] 6810 0.517% 99.818% ( 10, 15 ] 1817 0.138% 99.956% ( 15, 22 ] 184 0.014% 99.970% ( 22, 34 ] 34 0.003% 99.972% ( 34, 51 ] 7 0.001% 99.973% ( 51, 76 ] 15 0.001% 99.974% ( 76, 110 ] 282 0.021% 99.995% ( 110, 170 ] 75 0.006% 100.001% ( 170, 250 ] 142 0.011% 100.012% ( 250, 380 ] 31 0.002% 100.014% ( 380, 580 ] 9 0.001% 100.015% ( 580, 870 ] 12 0.001% 100.016% ( 870, 1300 ] 12 0.001% 100.017% ( 1300, 1900 ] 6 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 47993 Average: 2.1774 StdDev: 7.08 Min: 0 Median: 1.4619 Max: 618 Percentiles: P50: 1.46 P75: 1.86 P99: 5.57 P99.9: 9.90 P99.99: 485.02 ------------------------------------------------------ [ 0, 1 ] 10196 21.245% 21.245% #### ( 1, 2 ] 29878 62.255% 83.500% ############ ( 2, 3 ] 4688 9.768% 93.268% ## ( 3, 4 ] 2003 4.174% 97.441% # ( 4, 6 ] 954 1.988% 99.429% ( 6, 10 ] 232 0.483% 99.912% ( 10, 15 ] 25 0.052% 99.965% ( 15, 22 ] 2 0.004% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 110, 170 ] 2 0.004% 99.975% ( 170, 250 ] 2 0.004% 99.979% ( 250, 380 ] 1 0.002% 99.981% ( 380, 580 ] 8 0.017% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 60272 Average: 2.5989 StdDev: 11.68 Min: 1 Median: 1.6148 Max: 1655 Percentiles: P50: 1.61 P75: 1.99 P99: 8.53 P99.9: 46.65 P99.99: 346.62 ------------------------------------------------------ [ 0, 1 ] 5306 8.803% 8.803% ## ( 1, 2 ] 40386 67.006% 75.810% ############# ( 2, 3 ] 8068 13.386% 89.196% ### ( 3, 4 ] 3166 5.253% 94.449% # ( 4, 6 ] 2174 3.607% 98.055% # ( 6, 10 ] 900 1.493% 99.549% ( 10, 15 ] 142 0.236% 99.784% ( 15, 22 ] 28 0.046% 99.831% ( 22, 34 ] 6 0.010% 99.841% ( 34, 51 ] 48 0.080% 99.920% ( 51, 76 ] 14 0.023% 99.944% ( 76, 110 ] 9 0.015% 99.959% ( 110, 170 ] 13 0.022% 99.980% ( 170, 250 ] 3 0.005% 99.985% ( 250, 380 ] 4 0.007% 99.992% ( 380, 580 ] 1 0.002% 99.993% ( 580, 870 ] 1 0.002% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 236641 Average: 2.8801 StdDev: 21.36 Min: 0 Median: 1.5987 Max: 2665 Percentiles: P50: 1.60 P75: 1.99 P99: 9.11 P99.9: 127.85 P99.99: 894.07 ------------------------------------------------------ [ 0, 1 ] 26751 11.304% 11.304% ## ( 1, 2 ] 152944 64.631% 75.936% ############# ( 2, 3 ] 32195 13.605% 89.541% ### ( 3, 4 ] 12280 5.189% 94.730% # ( 4, 6 ] 6697 2.830% 97.560% # ( 6, 10 ] 4379 1.850% 99.410% ( 10, 15 ] 550 0.232% 99.643% ( 15, 22 ] 69 0.029% 99.672% ( 22, 34 ] 50 0.021% 99.693% ( 34, 51 ] 314 0.133% 99.826% ( 51, 76 ] 56 0.024% 99.850% ( 76, 110 ] 78 0.033% 99.883% ( 110, 170 ] 139 0.059% 99.941% ( 170, 250 ] 70 0.030% 99.971% ( 250, 380 ] 24 0.010% 99.981% ( 380, 580 ] 14 0.006% 99.987% ( 580, 870 ] 7 0.003% 99.990% ( 870, 1300 ] 6 0.003% 99.992% ( 1300, 1900 ] 13 0.005% 99.998% ( 1900, 2900 ] 9 0.004% 100.002% ** Level 4 read latency histogram (micros): Count: 315 Average: 101.2254 StdDev: 380.96 Min: 0 Median: 1.2742 Max: 2677 Percentiles: P50: 1.27 P75: 2.45 P99: 2270.00 P99.9: 2677.00 P99.99: 2677.00 ------------------------------------------------------ [ 0, 1 ] 132 41.905% 41.905% ######## ( 1, 2 ] 93 29.524% 71.429% ###### ( 2, 3 ] 25 7.937% 79.365% ## ( 3, 4 ] 11 3.492% 82.857% # ( 4, 6 ] 22 6.984% 89.841% # ( 6, 10 ] 3 0.952% 90.794% ( 10, 15 ] 1 0.317% 91.111% ( 110, 170 ] 2 0.635% 91.746% ( 170, 250 ] 1 0.317% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 6 1.905% 95.238% ( 870, 1300 ] 4 1.270% 96.508% ( 1300, 1900 ] 6 1.905% 98.413% ( 1900, 2900 ] 5 1.587% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 329.5000 StdDev: 279.53 Min: 110 Median: 210.0000 Max: 1207 Percentiles: P50: 210.00 P75: 446.67 P99: 1207.00 P99.9: 1207.00 P99.99: 1207.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 13 32.500% 35.000% ####### ( 170, 250 ] 12 30.000% 65.000% ###### ( 250, 380 ] 3 7.500% 72.500% ## ( 380, 580 ] 3 7.500% 80.000% ## ( 580, 870 ] 5 12.500% 92.500% ### ( 870, 1300 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 16.9 total, 5.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 291.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.458 H:M:S, 14.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 191.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.303 H:M:S, 44.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/05-12:53:31 ... thread 0: (1000000,6000000) ops and (58805.9,178048.4) ops/second in (17.005088,33.698709) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.29 GB 44.1 4.4 0.0 4.4 10.1 5.7 0.0 1.8 135.2 307.9 33.54 31.94 109 0.308 4605K 4406 0.0 0.0 L1 5/5 485.18 MB 0.0 4.4 4.2 0.2 4.4 4.2 0.1 1.0 231.2 227.4 19.62 18.44 3 6.541 4606K 73K 0.0 0.0 L2 26/20 3.27 GB 7.7 0.1 0.1 0.1 0.1 0.1 3.8 2.0 235.7 235.6 0.53 0.52 1 0.535 127K 40 0.0 0.0 L3 16/3 863.28 MB 0.5 1.1 0.2 0.9 1.1 0.2 0.5 6.4 241.4 241.2 4.63 4.36 3 1.544 1135K 1244 0.0 0.0 L4 174/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 150.5 150.5 0.75 0.63 1 0.747 114K 0 0.0 0.0 L5 1064/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/36 101.72 GB 0.0 10.2 4.6 5.6 15.8 10.2 5.5 2.8 176.5 273.3 59.08 55.89 117 0.505 10M 79K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 4.6 5.6 15.8 10.2 5.4 2.8 176.5 273.3 59.08 55.89 117 0.505 10M 79K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 4.6 5.6 10.1 4.5 0.0 0.0 241.7 239.9 43.15 41.24 26 1.659 10M 79K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 363.9 15.93 14.65 91 0.175 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.9 total, 33.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.77 GB write, 476.32 MB/s write, 10.18 GB read, 307.68 MB/s read, 59.1 seconds Interval compaction: 15.77 GB write, 479.09 MB/s write, 10.18 GB read, 309.47 MB/s read, 59.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 1, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2458065 Average: 2.4570 StdDev: 9.23 Min: 0 Median: 1.3996 Max: 1928 Percentiles: P50: 1.40 P75: 1.81 P99: 6.07 P99.9: 148.76 P99.99: 216.71 ------------------------------------------------------ [ 0, 1 ] 627619 25.533% 25.533% ##### ( 1, 2 ] 1504969 61.226% 86.759% ############ ( 2, 3 ] 180864 7.358% 94.117% # ( 3, 4 ] 71114 2.893% 97.010% # ( 4, 6 ] 48692 1.981% 98.991% ( 6, 10 ] 13336 0.543% 99.533% ( 10, 15 ] 2792 0.114% 99.647% ( 15, 22 ] 499 0.020% 99.667% ( 22, 34 ] 53 0.002% 99.669% ( 34, 51 ] 10 0.000% 99.670% ( 51, 76 ] 17 0.001% 99.670% ( 76, 110 ] 2186 0.089% 99.759% ( 110, 170 ] 5351 0.218% 99.977% ( 170, 250 ] 545 0.022% 99.999% ( 250, 380 ] 263 0.011% 100.010% ( 380, 580 ] 52 0.002% 100.012% ( 580, 870 ] 23 0.001% 100.013% ( 870, 1300 ] 14 0.001% 100.014% ( 1300, 1900 ] 6 0.000% 100.014% ( 1900, 2900 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 444804 Average: 3.3393 StdDev: 20.08 Min: 0 Median: 1.8665 Max: 4534 Percentiles: P50: 1.87 P75: 2.77 P99: 8.89 P99.9: 21.96 P99.99: 152.05 ------------------------------------------------------ [ 0, 1 ] 15668 3.522% 3.522% # ( 1, 2 ] 238595 53.640% 57.163% ########### ( 2, 3 ] 103097 23.178% 80.341% ##### ( 3, 4 ] 40564 9.120% 89.461% ## ( 4, 6 ] 35920 8.075% 97.536% ## ( 6, 10 ] 9016 2.027% 99.563% ( 10, 15 ] 1342 0.302% 99.865% ( 15, 22 ] 159 0.036% 99.900% ( 22, 34 ] 15 0.003% 99.904% ( 34, 51 ] 4 0.001% 99.905% ( 51, 76 ] 3 0.001% 99.905% ( 76, 110 ] 86 0.019% 99.925% ( 110, 170 ] 416 0.094% 100.018% ( 170, 250 ] 229 0.051% 100.070% ( 250, 380 ] 105 0.024% 100.093% ( 380, 580 ] 89 0.020% 100.113% ( 580, 870 ] 16 0.004% 100.117% ( 870, 1300 ] 7 0.002% 100.118% ( 1300, 1900 ] 7 0.002% 100.120% ( 1900, 2900 ] 7 0.002% 100.122% ( 2900, 4400 ] 3 0.001% 100.122% ( 4400, 6600 ] 1 0.000% 100.123% ** Level 2 read latency histogram (micros): Count: 60272 Average: 2.5989 StdDev: 11.68 Min: 1 Median: 1.6148 Max: 1655 Percentiles: P50: 1.61 P75: 1.99 P99: 8.53 P99.9: 46.65 P99.99: 346.62 ------------------------------------------------------ [ 0, 1 ] 5306 8.803% 8.803% ## ( 1, 2 ] 40386 67.006% 75.810% ############# ( 2, 3 ] 8068 13.386% 89.196% ### ( 3, 4 ] 3166 5.253% 94.449% # ( 4, 6 ] 2174 3.607% 98.055% # ( 6, 10 ] 900 1.493% 99.549% ( 10, 15 ] 142 0.236% 99.784% ( 15, 22 ] 28 0.046% 99.831% ( 22, 34 ] 6 0.010% 99.841% ( 34, 51 ] 48 0.080% 99.920% ( 51, 76 ] 14 0.023% 99.944% ( 76, 110 ] 9 0.015% 99.959% ( 110, 170 ] 13 0.022% 99.980% ( 170, 250 ] 3 0.005% 99.985% ( 250, 380 ] 4 0.007% 99.992% ( 380, 580 ] 1 0.002% 99.993% ( 580, 870 ] 1 0.002% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 239825 Average: 3.2161 StdDev: 23.08 Min: 0 Median: 1.6015 Max: 2665 Percentiles: P50: 1.60 P75: 1.99 P99: 9.51 P99.9: 197.14 P99.99: 871.25 ------------------------------------------------------ [ 0, 1 ] 26890 11.212% 11.212% ## ( 1, 2 ] 154641 64.481% 75.693% ############# ( 2, 3 ] 32647 13.613% 89.306% ### ( 3, 4 ] 12526 5.223% 94.529% # ( 4, 6 ] 6828 2.847% 97.376% # ( 6, 10 ] 4435 1.849% 99.225% ( 10, 15 ] 560 0.234% 99.459% ( 15, 22 ] 70 0.029% 99.488% ( 22, 34 ] 54 0.023% 99.510% ( 34, 51 ] 314 0.131% 99.641% ( 51, 76 ] 56 0.023% 99.665% ( 76, 110 ] 144 0.060% 99.725% ( 110, 170 ] 372 0.155% 99.880% ( 170, 250 ] 142 0.059% 99.939% ( 250, 380 ] 73 0.030% 99.970% ( 380, 580 ] 35 0.015% 99.984% ( 580, 870 ] 14 0.006% 99.990% ( 870, 1300 ] 6 0.003% 99.992% ( 1300, 1900 ] 13 0.005% 99.998% ( 1900, 2900 ] 9 0.004% 100.002% ** Level 4 read latency histogram (micros): Count: 315 Average: 101.2254 StdDev: 380.96 Min: 0 Median: 1.2742 Max: 2677 Percentiles: P50: 1.27 P75: 2.45 P99: 2270.00 P99.9: 2677.00 P99.99: 2677.00 ------------------------------------------------------ [ 0, 1 ] 132 41.905% 41.905% ######## ( 1, 2 ] 93 29.524% 71.429% ###### ( 2, 3 ] 25 7.937% 79.365% ## ( 3, 4 ] 11 3.492% 82.857% # ( 4, 6 ] 22 6.984% 89.841% # ( 6, 10 ] 3 0.952% 90.794% ( 10, 15 ] 1 0.317% 91.111% ( 110, 170 ] 2 0.635% 91.746% ( 170, 250 ] 1 0.317% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 6 1.905% 95.238% ( 870, 1300 ] 4 1.270% 96.508% ( 1300, 1900 ] 6 1.905% 98.413% ( 1900, 2900 ] 5 1.587% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 329.5000 StdDev: 279.53 Min: 110 Median: 210.0000 Max: 1207 Percentiles: P50: 210.00 P75: 446.67 P99: 1207.00 P99.9: 1207.00 P99.99: 1207.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 13 32.500% 35.000% ####### ( 170, 250 ] 12 30.000% 65.000% ###### ( 250, 380 ] 3 7.500% 72.500% ## ( 380, 580 ] 3 7.500% 80.000% ## ( 580, 870 ] 5 12.500% 92.500% ### ( 870, 1300 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 33.9 total, 17.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 174.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.119 H:M:S, 47.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 57.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.661 H:M:S, 80.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/05-12:53:35 ... thread 0: (1000000,7000000) ops and (286526.8,188228.8) ops/second in (3.490075,37.188784) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 1.66 GB 113.3 5.2 0.0 5.2 11.8 6.6 0.0 1.8 133.1 304.2 39.75 37.65 127 0.313 5373K 5147 0.0 0.0 L1 13/0 1.02 GB 104.7 5.5 4.9 0.7 5.4 4.8 0.1 1.1 224.3 221.2 25.19 23.54 4 6.299 5245K 73K 0.0 0.0 L2 7/5 836.05 MB 2.6 0.1 0.1 0.1 0.1 0.1 3.8 2.0 235.7 235.6 0.53 0.52 1 0.535 127K 40 0.0 0.0 L3 52/13 2.94 GB 2.1 4.0 2.7 1.3 4.0 2.7 0.5 1.5 212.8 212.2 19.17 17.99 6 3.195 3882K 8130 0.0 0.0 L4 181/5 9.88 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.9 1.0 150.5 150.5 0.75 0.63 1 0.747 114K 0 0.0 0.0 L5 1064/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1331/31 102.69 GB 0.0 14.9 7.7 7.2 21.5 14.3 6.0 3.2 178.7 257.2 85.40 80.34 139 0.614 14M 86K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.9 7.7 7.2 21.5 14.3 5.9 3.2 178.7 257.2 85.40 80.34 139 0.614 14M 86K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.9 7.7 7.2 14.8 7.6 0.0 0.0 229.8 228.4 66.40 63.02 33 2.012 14M 86K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 358.2 19.00 17.33 106 0.179 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.4 total, 37.2 interval Flush(GB): cumulative 6.645, interval 6.645 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.45 GB write, 587.63 MB/s write, 14.90 GB read, 408.22 MB/s read, 85.4 seconds Interval compaction: 21.45 GB write, 590.72 MB/s write, 14.90 GB read, 410.37 MB/s read, 85.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 2, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2741120 Average: 2.6500 StdDev: 13.46 Min: 0 Median: 1.4440 Max: 4020 Percentiles: P50: 1.44 P75: 1.86 P99: 7.01 P99.9: 156.31 P99.99: 300.36 ------------------------------------------------------ [ 0, 1 ] 635093 23.169% 23.169% ##### ( 1, 2 ] 1656591 60.435% 83.604% ############ ( 2, 3 ] 244441 8.918% 92.521% ## ( 3, 4 ] 98721 3.601% 96.123% # ( 4, 6 ] 74201 2.707% 98.830% # ( 6, 10 ] 18392 0.671% 99.501% ( 10, 15 ] 3614 0.132% 99.633% ( 15, 22 ] 575 0.021% 99.654% ( 22, 34 ] 60 0.002% 99.656% ( 34, 51 ] 13 0.000% 99.656% ( 51, 76 ] 18 0.001% 99.657% ( 76, 110 ] 2233 0.081% 99.739% ( 110, 170 ] 5738 0.209% 99.948% ( 170, 250 ] 939 0.034% 99.982% ( 250, 380 ] 565 0.021% 100.003% ( 380, 580 ] 228 0.008% 100.011% ( 580, 870 ] 77 0.003% 100.014% ( 870, 1300 ] 28 0.001% 100.015% ( 1300, 1900 ] 16 0.001% 100.015% ( 1900, 2900 ] 12 0.000% 100.016% ( 2900, 4400 ] 6 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 1062933 Average: 3.6917 StdDev: 29.07 Min: 0 Median: 1.9188 Max: 4995 Percentiles: P50: 1.92 P75: 2.85 P99: 9.08 P99.9: 94.72 P99.99: 163.92 ------------------------------------------------------ [ 0, 1 ] 21256 2.000% 2.000% ( 1, 2 ] 555326 52.245% 54.244% ########## ( 2, 3 ] 260321 24.491% 78.735% ##### ( 3, 4 ] 103076 9.697% 88.433% ## ( 4, 6 ] 92961 8.746% 97.178% ## ( 6, 10 ] 25146 2.366% 99.544% ( 10, 15 ] 3304 0.311% 99.855% ( 15, 22 ] 333 0.031% 99.886% ( 22, 34 ] 25 0.002% 99.889% ( 34, 51 ] 7 0.001% 99.889% ( 51, 76 ] 12 0.001% 99.890% ( 76, 110 ] 189 0.018% 99.908% ( 110, 170 ] 970 0.091% 99.999% ( 170, 250 ] 751 0.071% 100.070% ( 250, 380 ] 429 0.040% 100.110% ( 380, 580 ] 243 0.023% 100.133% ( 580, 870 ] 77 0.007% 100.140% ( 870, 1300 ] 29 0.003% 100.143% ( 1300, 1900 ] 19 0.002% 100.145% ( 1900, 2900 ] 52 0.005% 100.150% ( 2900, 4400 ] 20 0.002% 100.152% ( 4400, 6600 ] 3 0.000% 100.152% ** Level 2 read latency histogram (micros): Count: 60272 Average: 2.5989 StdDev: 11.68 Min: 1 Median: 1.6148 Max: 1655 Percentiles: P50: 1.61 P75: 1.99 P99: 8.53 P99.9: 46.65 P99.99: 346.62 ------------------------------------------------------ [ 0, 1 ] 5306 8.803% 8.803% ## ( 1, 2 ] 40386 67.006% 75.810% ############# ( 2, 3 ] 8068 13.386% 89.196% ### ( 3, 4 ] 3166 5.253% 94.449% # ( 4, 6 ] 2174 3.607% 98.055% # ( 6, 10 ] 900 1.493% 99.549% ( 10, 15 ] 142 0.236% 99.784% ( 15, 22 ] 28 0.046% 99.831% ( 22, 34 ] 6 0.010% 99.841% ( 34, 51 ] 48 0.080% 99.920% ( 51, 76 ] 14 0.023% 99.944% ( 76, 110 ] 9 0.015% 99.959% ( 110, 170 ] 13 0.022% 99.980% ( 170, 250 ] 3 0.005% 99.985% ( 250, 380 ] 4 0.007% 99.992% ( 380, 580 ] 1 0.002% 99.993% ( 580, 870 ] 1 0.002% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 289060 Average: 4.1273 StdDev: 42.00 Min: 0 Median: 1.6625 Max: 4725 Percentiles: P50: 1.66 P75: 2.27 P99: 9.72 P99.9: 329.96 P99.99: 938.96 ------------------------------------------------------ [ 0, 1 ] 27280 9.437% 9.437% ## ( 1, 2 ] 176992 61.230% 70.668% ############ ( 2, 3 ] 46084 15.943% 86.610% ### ( 3, 4 ] 18183 6.290% 92.901% # ( 4, 6 ] 12462 4.311% 97.212% # ( 6, 10 ] 5569 1.927% 99.139% ( 10, 15 ] 720 0.249% 99.388% ( 15, 22 ] 84 0.029% 99.417% ( 22, 34 ] 59 0.020% 99.437% ( 34, 51 ] 316 0.109% 99.546% ( 51, 76 ] 56 0.019% 99.566% ( 76, 110 ] 157 0.054% 99.620% ( 110, 170 ] 467 0.162% 99.782% ( 170, 250 ] 234 0.081% 99.863% ( 250, 380 ] 182 0.063% 99.926% ( 380, 580 ] 123 0.043% 99.968% ( 580, 870 ] 61 0.021% 99.989% ( 870, 1300 ] 38 0.013% 100.002% ( 1300, 1900 ] 25 0.009% 100.011% ( 1900, 2900 ] 18 0.006% 100.017% ( 2900, 4400 ] 17 0.006% 100.023% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 4 read latency histogram (micros): Count: 991 Average: 548.2432 StdDev: 1081.06 Min: 0 Median: 2.8780 Max: 7759 Percentiles: P50: 2.88 P75: 688.75 P99: 4859.80 P99.9: 7759.00 P99.99: 7759.00 ------------------------------------------------------ [ 0, 1 ] 134 13.522% 13.522% ### ( 1, 2 ] 250 25.227% 38.749% ##### ( 2, 3 ] 127 12.815% 51.564% ### ( 3, 4 ] 57 5.752% 57.316% # ( 4, 6 ] 54 5.449% 62.765% # ( 6, 10 ] 12 1.211% 63.976% ( 10, 15 ] 7 0.706% 64.682% ( 15, 22 ] 2 0.202% 64.884% ( 76, 110 ] 1 0.101% 64.985% ( 110, 170 ] 7 0.706% 65.691% ( 170, 250 ] 14 1.413% 67.104% ( 250, 380 ] 26 2.624% 69.728% # ( 380, 580 ] 29 2.926% 72.654% # ( 580, 870 ] 62 6.256% 78.910% # ( 870, 1300 ] 62 6.256% 85.166% # ( 1300, 1900 ] 46 4.642% 89.808% # ( 1900, 2900 ] 42 4.238% 94.046% # ( 2900, 4400 ] 47 4.743% 98.789% # ( 4400, 6600 ] 10 1.009% 99.798% ( 6600, 9900 ] 2 0.202% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 329.5000 StdDev: 279.53 Min: 110 Median: 210.0000 Max: 1207 Percentiles: P50: 210.00 P75: 446.67 P99: 1207.00 P99.9: 1207.00 P99.99: 1207.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 13 32.500% 35.000% ####### ( 170, 250 ] 12 30.000% 65.000% ###### ( 250, 380 ] 3 7.500% 72.500% ## ( 380, 580 ] 3 7.500% 80.000% ## ( 580, 870 ] 5 12.500% 92.500% ### ( 870, 1300 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 37.4 total, 3.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 184.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.435 H:M:S, 44.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 282.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.317 H:M:S, 9.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/05-12:53:40 ... thread 0: (1000000,8000000) ops and (210211.8,190721.9) ops/second in (4.757107,41.945891) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.58 GB 56.6 6.1 0.0 6.1 13.7 7.6 0.0 1.8 128.6 288.1 48.51 44.19 142 0.342 6332K 6285 0.0 0.0 L1 13/13 1.02 GB 0.0 5.5 4.9 0.7 5.4 4.8 0.1 1.1 224.3 221.2 25.19 23.54 4 6.299 5245K 73K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.8 2.0 235.7 235.6 0.53 0.52 1 0.535 127K 40 0.0 0.0 L3 25/4 1.24 GB 1.0 5.6 3.5 2.1 5.6 3.5 0.5 1.6 197.9 197.3 29.10 25.79 10 2.910 5589K 14K 0.0 0.0 L4 183/4 9.43 GB 1.0 2.7 2.6 0.1 2.7 2.6 0.9 1.0 126.2 126.0 21.85 13.39 39 0.560 2755K 1431 0.0 0.0 L5 1100/0 89.32 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1338/35 103.60 GB 0.0 20.1 11.0 9.0 27.5 18.5 9.0 3.6 164.0 225.0 125.20 107.44 196 0.639 20M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.1 11.0 9.0 27.5 18.5 8.9 3.6 164.0 225.0 125.20 107.44 196 0.639 20M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.1 11.0 9.0 19.9 10.9 0.0 0.0 201.4 200.4 101.93 87.54 78 1.307 20M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 333.1 23.27 19.90 118 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.1 total, 41.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.51 GB write, 668.51 MB/s write, 20.05 GB read, 487.19 MB/s read, 125.2 seconds Interval compaction: 27.51 GB write, 671.63 MB/s write, 20.05 GB read, 489.46 MB/s read, 125.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 18, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3065109 Average: 2.8244 StdDev: 23.03 Min: 0 Median: 1.4824 Max: 9300 Percentiles: P50: 1.48 P75: 1.90 P99: 7.45 P99.9: 156.87 P99.99: 338.47 ------------------------------------------------------ [ 0, 1 ] 646431 21.090% 21.090% #### ( 1, 2 ] 1836857 59.928% 81.018% ############ ( 2, 3 ] 315050 10.279% 91.297% ## ( 3, 4 ] 127162 4.149% 95.445% # ( 4, 6 ] 100198 3.269% 98.714% # ( 6, 10 ] 24206 0.790% 99.504% ( 10, 15 ] 4548 0.148% 99.652% ( 15, 22 ] 659 0.022% 99.674% ( 22, 34 ] 77 0.003% 99.676% ( 34, 51 ] 18 0.001% 99.677% ( 51, 76 ] 24 0.001% 99.678% ( 76, 110 ] 2253 0.074% 99.751% ( 110, 170 ] 5839 0.190% 99.942% ( 170, 250 ] 1032 0.034% 99.975% ( 250, 380 ] 659 0.022% 99.997% ( 380, 580 ] 304 0.010% 100.007% ( 580, 870 ] 134 0.004% 100.011% ( 870, 1300 ] 72 0.002% 100.014% ( 1300, 1900 ] 43 0.001% 100.015% ( 1900, 2900 ] 52 0.002% 100.017% ( 2900, 4400 ] 43 0.001% 100.018% ( 4400, 6600 ] 7 0.000% 100.018% ( 6600, 9900 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 1176907 Average: 3.9392 StdDev: 40.99 Min: 0 Median: 1.9204 Max: 8019 Percentiles: P50: 1.92 P75: 2.85 P99: 9.16 P99.9: 124.81 P99.99: 192.95 ------------------------------------------------------ [ 0, 1 ] 23432 1.991% 1.991% ( 1, 2 ] 613895 52.162% 54.153% ########## ( 2, 3 ] 287947 24.466% 78.619% ##### ( 3, 4 ] 114109 9.696% 88.315% ## ( 4, 6 ] 103597 8.802% 97.117% ## ( 6, 10 ] 28036 2.382% 99.499% ( 10, 15 ] 3785 0.322% 99.821% ( 15, 22 ] 385 0.033% 99.854% ( 22, 34 ] 31 0.003% 99.856% ( 34, 51 ] 9 0.001% 99.857% ( 51, 76 ] 15 0.001% 99.858% ( 76, 110 ] 223 0.019% 99.877% ( 110, 170 ] 1078 0.092% 99.969% ( 170, 250 ] 862 0.073% 100.042% ( 250, 380 ] 515 0.044% 100.086% ( 380, 580 ] 286 0.024% 100.110% ( 580, 870 ] 102 0.009% 100.119% ( 870, 1300 ] 45 0.004% 100.123% ( 1300, 1900 ] 36 0.003% 100.126% ( 1900, 2900 ] 67 0.006% 100.132% ( 2900, 4400 ] 52 0.004% 100.136% ( 4400, 6600 ] 14 0.001% 100.137% ( 6600, 9900 ] 3 0.000% 100.137% ** Level 2 read latency histogram (micros): Count: 60272 Average: 2.5989 StdDev: 11.68 Min: 1 Median: 1.6148 Max: 1655 Percentiles: P50: 1.61 P75: 1.99 P99: 8.53 P99.9: 46.65 P99.99: 346.62 ------------------------------------------------------ [ 0, 1 ] 5306 8.803% 8.803% ## ( 1, 2 ] 40386 67.006% 75.810% ############# ( 2, 3 ] 8068 13.386% 89.196% ### ( 3, 4 ] 3166 5.253% 94.449% # ( 4, 6 ] 2174 3.607% 98.055% # ( 6, 10 ] 900 1.493% 99.549% ( 10, 15 ] 142 0.236% 99.784% ( 15, 22 ] 28 0.046% 99.831% ( 22, 34 ] 6 0.010% 99.841% ( 34, 51 ] 48 0.080% 99.920% ( 51, 76 ] 14 0.023% 99.944% ( 76, 110 ] 9 0.015% 99.959% ( 110, 170 ] 13 0.022% 99.980% ( 170, 250 ] 3 0.005% 99.985% ( 250, 380 ] 4 0.007% 99.992% ( 380, 580 ] 1 0.002% 99.993% ( 580, 870 ] 1 0.002% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1109708 Average: 5.4096 StdDev: 81.01 Min: 0 Median: 1.9359 Max: 10387 Percentiles: P50: 1.94 P75: 2.90 P99: 9.11 P99.9: 77.22 P99.99: 183.80 ------------------------------------------------------ [ 0, 1 ] 33670 3.034% 3.034% # ( 1, 2 ] 556897 50.184% 53.218% ########## ( 2, 3 ] 268295 24.177% 77.395% ##### ( 3, 4 ] 114859 10.350% 87.746% ## ( 4, 6 ] 107116 9.653% 97.398% ## ( 6, 10 ] 22873 2.061% 99.459% ( 10, 15 ] 3934 0.355% 99.814% ( 15, 22 ] 426 0.038% 99.852% ( 22, 34 ] 120 0.011% 99.863% ( 34, 51 ] 335 0.030% 99.893% ( 51, 76 ] 68 0.006% 99.900% ( 76, 110 ] 204 0.018% 99.918% ( 110, 170 ] 702 0.063% 99.981% ( 170, 250 ] 580 0.052% 100.033% ( 250, 380 ] 518 0.047% 100.080% ( 380, 580 ] 378 0.034% 100.114% ( 580, 870 ] 269 0.024% 100.138% ( 870, 1300 ] 200 0.018% 100.156% ( 1300, 1900 ] 164 0.015% 100.171% ( 1900, 2900 ] 157 0.014% 100.185% ( 2900, 4400 ] 220 0.020% 100.205% ( 4400, 6600 ] 42 0.004% 100.209% ( 6600, 9900 ] 24 0.002% 100.211% ( 9900, 14000 ] 2 0.000% 100.211% ** Level 4 read latency histogram (micros): Count: 19832 Average: 196.5498 StdDev: 768.57 Min: 0 Median: 2.4052 Max: 24484 Percentiles: P50: 2.41 P75: 3.90 P99: 3873.11 P99.9: 6570.48 P99.99: 19733.49 ------------------------------------------------------ [ 0, 1 ] 370 1.866% 1.866% ( 1, 2 ] 7504 37.838% 39.704% ######## ( 2, 3 ] 5039 25.408% 65.112% ##### ( 3, 4 ] 2175 10.967% 76.079% ## ( 4, 6 ] 1439 7.256% 83.335% # ( 6, 10 ] 430 2.168% 85.503% ( 10, 15 ] 78 0.393% 85.897% ( 15, 22 ] 24 0.121% 86.018% ( 22, 34 ] 11 0.055% 86.073% ( 34, 51 ] 4 0.020% 86.093% ( 51, 76 ] 2 0.010% 86.103% ( 76, 110 ] 19 0.096% 86.199% ( 110, 170 ] 176 0.887% 87.087% ( 170, 250 ] 256 1.291% 88.377% ( 250, 380 ] 279 1.407% 89.784% ( 380, 580 ] 328 1.654% 91.438% ( 580, 870 ] 383 1.931% 93.369% ( 870, 1300 ] 331 1.669% 95.038% ( 1300, 1900 ] 236 1.190% 96.228% ( 1900, 2900 ] 333 1.679% 97.907% ( 2900, 4400 ] 334 1.684% 99.592% ( 4400, 6600 ] 62 0.313% 99.904% ( 6600, 9900 ] 11 0.055% 99.960% ( 9900, 14000 ] 1 0.005% 99.965% ( 14000, 22000 ] 7 0.035% 100.000% ( 22000, 33000 ] 1 0.005% 100.005% ** Level 5 read latency histogram (micros): Count: 220 Average: 741.1409 StdDev: 886.42 Min: 95 Median: 389.0909 Max: 4153 Percentiles: P50: 389.09 P75: 861.71 P99: 4153.00 P99.9: 4153.00 P99.99: 4153.00 ------------------------------------------------------ ( 76, 110 ] 4 1.818% 1.818% ( 110, 170 ] 34 15.455% 17.273% ### ( 170, 250 ] 42 19.091% 36.364% #### ( 250, 380 ] 29 13.182% 49.545% ### ( 380, 580 ] 22 10.000% 59.545% ## ( 580, 870 ] 35 15.909% 75.455% ### ( 870, 1300 ] 23 10.455% 85.909% ## ( 1300, 1900 ] 12 5.455% 91.364% # ( 1900, 2900 ] 3 1.364% 92.727% ( 2900, 4400 ] 16 7.273% 100.000% # ** DB Stats ** Uptime(secs): 42.1 total, 4.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 186.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.688 H:M:S, 42.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 206.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.253 H:M:S, 26.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/05-12:53:45 ... thread 0: (1000000,9000000) ops and (189511.6,190586.7) ops/second in (5.276722,47.222613) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 3.56 GB 62.9 7.3 0.0 7.3 15.9 8.5 0.0 1.9 133.1 288.5 56.31 51.59 163 0.345 7612K 7492 0.0 0.0 L1 13/13 1.02 GB 0.0 5.5 4.9 0.7 5.4 4.8 0.1 1.1 224.3 221.2 25.19 23.54 4 6.299 5245K 73K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.8 2.0 235.7 235.6 0.53 0.52 1 0.535 127K 40 0.0 0.0 L3 21/0 994.51 MB 1.0 5.6 3.5 2.1 5.6 3.5 0.5 1.6 197.9 197.3 29.10 25.79 10 2.910 5589K 14K 0.0 0.0 L4 187/0 9.70 GB 1.0 3.0 2.9 0.1 3.0 2.9 0.9 1.0 130.0 129.8 23.40 14.72 43 0.544 3044K 1811 0.0 0.0 L5 1100/0 89.32 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1339/29 104.58 GB 0.0 21.6 11.3 10.2 30.0 19.8 9.0 3.5 164.1 228.3 134.55 116.16 221 0.609 21M 97K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.6 11.3 10.2 30.0 19.8 8.9 3.5 164.1 228.3 134.55 116.16 221 0.609 21M 97K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.6 11.3 10.2 21.5 11.2 0.0 0.0 203.6 202.6 108.43 93.69 87 1.246 21M 97K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 335.3 26.12 22.48 134 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.4 total, 47.2 interval Flush(GB): cumulative 8.552, interval 8.552 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.00 GB write, 647.92 MB/s write, 21.56 GB read, 465.55 MB/s read, 134.5 seconds Interval compaction: 30.00 GB write, 650.60 MB/s write, 21.56 GB read, 467.48 MB/s read, 134.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 18, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3571463 Average: 2.7425 StdDev: 21.56 Min: 0 Median: 1.4881 Max: 9300 Percentiles: P50: 1.49 P75: 1.90 P99: 7.21 P99.9: 151.23 P99.99: 307.60 ------------------------------------------------------ [ 0, 1 ] 723655 20.262% 20.262% #### ( 1, 2 ] 2175849 60.923% 81.185% ############ ( 2, 3 ] 372254 10.423% 91.608% ## ( 3, 4 ] 145471 4.073% 95.681% # ( 4, 6 ] 109911 3.077% 98.759% # ( 6, 10 ] 28464 0.797% 99.556% ( 10, 15 ] 5070 0.142% 99.698% ( 15, 22 ] 762 0.021% 99.719% ( 22, 34 ] 83 0.002% 99.722% ( 34, 51 ] 18 0.001% 99.722% ( 51, 76 ] 28 0.001% 99.723% ( 76, 110 ] 2282 0.064% 99.787% ( 110, 170 ] 5889 0.165% 99.952% ( 170, 250 ] 1071 0.030% 99.982% ( 250, 380 ] 679 0.019% 100.001% ( 380, 580 ] 311 0.009% 100.009% ( 580, 870 ] 140 0.004% 100.013% ( 870, 1300 ] 76 0.002% 100.015% ( 1300, 1900 ] 45 0.001% 100.017% ( 1900, 2900 ] 55 0.002% 100.018% ( 2900, 4400 ] 43 0.001% 100.019% ( 4400, 6600 ] 7 0.000% 100.020% ( 6600, 9900 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1252173 Average: 3.8642 StdDev: 39.88 Min: 0 Median: 1.8920 Max: 8019 Percentiles: P50: 1.89 P75: 2.81 P99: 9.14 P99.9: 126.34 P99.99: 193.93 ------------------------------------------------------ [ 0, 1 ] 34337 2.742% 2.742% # ( 1, 2 ] 663419 52.981% 55.724% ########### ( 2, 3 ] 297164 23.732% 79.455% ##### ( 3, 4 ] 116581 9.310% 88.766% ## ( 4, 6 ] 105313 8.410% 97.176% ## ( 6, 10 ] 29079 2.322% 99.498% ( 10, 15 ] 3903 0.312% 99.810% ( 15, 22 ] 398 0.032% 99.842% ( 22, 34 ] 31 0.002% 99.844% ( 34, 51 ] 9 0.001% 99.845% ( 51, 76 ] 15 0.001% 99.846% ( 76, 110 ] 348 0.028% 99.874% ( 110, 170 ] 1189 0.095% 99.969% ( 170, 250 ] 875 0.070% 100.039% ( 250, 380 ] 520 0.042% 100.081% ( 380, 580 ] 288 0.023% 100.104% ( 580, 870 ] 102 0.008% 100.112% ( 870, 1300 ] 45 0.004% 100.115% ( 1300, 1900 ] 37 0.003% 100.118% ( 1900, 2900 ] 68 0.005% 100.124% ( 2900, 4400 ] 52 0.004% 100.128% ( 4400, 6600 ] 14 0.001% 100.129% ( 6600, 9900 ] 3 0.000% 100.129% ** Level 2 read latency histogram (micros): Count: 60272 Average: 2.5989 StdDev: 11.68 Min: 1 Median: 1.6148 Max: 1655 Percentiles: P50: 1.61 P75: 1.99 P99: 8.53 P99.9: 46.65 P99.99: 346.62 ------------------------------------------------------ [ 0, 1 ] 5306 8.803% 8.803% ## ( 1, 2 ] 40386 67.006% 75.810% ############# ( 2, 3 ] 8068 13.386% 89.196% ### ( 3, 4 ] 3166 5.253% 94.449% # ( 4, 6 ] 2174 3.607% 98.055% # ( 6, 10 ] 900 1.493% 99.549% ( 10, 15 ] 142 0.236% 99.784% ( 15, 22 ] 28 0.046% 99.831% ( 22, 34 ] 6 0.010% 99.841% ( 34, 51 ] 48 0.080% 99.920% ( 51, 76 ] 14 0.023% 99.944% ( 76, 110 ] 9 0.015% 99.959% ( 110, 170 ] 13 0.022% 99.980% ( 170, 250 ] 3 0.005% 99.985% ( 250, 380 ] 4 0.007% 99.992% ( 380, 580 ] 1 0.002% 99.993% ( 580, 870 ] 1 0.002% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1171695 Average: 5.2791 StdDev: 78.98 Min: 0 Median: 1.9344 Max: 10387 Percentiles: P50: 1.93 P75: 2.90 P99: 9.04 P99.9: 46.87 P99.99: 169.90 ------------------------------------------------------ [ 0, 1 ] 34376 2.934% 2.934% # ( 1, 2 ] 590197 50.371% 53.305% ########## ( 2, 3 ] 283438 24.190% 77.496% ##### ( 3, 4 ] 121392 10.360% 87.856% ## ( 4, 6 ] 112473 9.599% 97.455% ## ( 6, 10 ] 23799 2.031% 99.486% ( 10, 15 ] 4036 0.344% 99.831% ( 15, 22 ] 437 0.037% 99.868% ( 22, 34 ] 121 0.010% 99.878% ( 34, 51 ] 336 0.029% 99.907% ( 51, 76 ] 68 0.006% 99.913% ( 76, 110 ] 204 0.017% 99.930% ( 110, 170 ] 702 0.060% 99.990% ( 170, 250 ] 580 0.050% 100.040% ( 250, 380 ] 518 0.044% 100.084% ( 380, 580 ] 378 0.032% 100.116% ( 580, 870 ] 269 0.023% 100.139% ( 870, 1300 ] 200 0.017% 100.156% ( 1300, 1900 ] 164 0.014% 100.170% ( 1900, 2900 ] 157 0.013% 100.183% ( 2900, 4400 ] 222 0.019% 100.202% ( 4400, 6600 ] 42 0.004% 100.206% ( 6600, 9900 ] 24 0.002% 100.208% ( 9900, 14000 ] 2 0.000% 100.208% ** Level 4 read latency histogram (micros): Count: 21604 Average: 182.0032 StdDev: 739.38 Min: 0 Median: 2.3655 Max: 24484 Percentiles: P50: 2.37 P75: 3.81 P99: 3795.34 P99.9: 6507.60 P99.99: 19530.97 ------------------------------------------------------ [ 0, 1 ] 430 1.990% 1.990% ( 1, 2 ] 8362 38.706% 40.696% ######## ( 2, 3 ] 5499 25.454% 66.150% ##### ( 3, 4 ] 2362 10.933% 77.083% ## ( 4, 6 ] 1541 7.133% 84.216% # ( 6, 10 ] 467 2.162% 86.378% ( 10, 15 ] 83 0.384% 86.762% ( 15, 22 ] 27 0.125% 86.887% ( 22, 34 ] 12 0.056% 86.942% ( 34, 51 ] 4 0.019% 86.961% ( 51, 76 ] 2 0.009% 86.970% ( 76, 110 ] 20 0.093% 87.063% ( 110, 170 ] 196 0.907% 87.970% ( 170, 250 ] 269 1.245% 89.215% ( 250, 380 ] 287 1.328% 90.543% ( 380, 580 ] 334 1.546% 92.089% ( 580, 870 ] 386 1.787% 93.876% ( 870, 1300 ] 334 1.546% 95.422% ( 1300, 1900 ] 237 1.097% 96.519% ( 1900, 2900 ] 336 1.555% 98.074% ( 2900, 4400 ] 335 1.551% 99.625% ( 4400, 6600 ] 62 0.287% 99.912% ( 6600, 9900 ] 11 0.051% 99.963% ( 9900, 14000 ] 1 0.005% 99.968% ( 14000, 22000 ] 7 0.032% 100.000% ( 22000, 33000 ] 1 0.005% 100.005% ** Level 5 read latency histogram (micros): Count: 220 Average: 741.1409 StdDev: 886.42 Min: 95 Median: 389.0909 Max: 4153 Percentiles: P50: 389.09 P75: 861.71 P99: 4153.00 P99.9: 4153.00 P99.99: 4153.00 ------------------------------------------------------ ( 76, 110 ] 4 1.818% 1.818% ( 110, 170 ] 34 15.455% 17.273% ### ( 170, 250 ] 42 19.091% 36.364% #### ( 250, 380 ] 29 13.182% 49.545% ### ( 380, 580 ] 22 10.000% 59.545% ## ( 580, 870 ] 35 15.909% 75.455% ### ( 870, 1300 ] 23 10.455% 85.909% ## ( 1300, 1900 ] 12 5.455% 91.364% # ( 1900, 2900 ] 3 1.364% 92.727% ( 2900, 4400 ] 16 7.273% 100.000% # ** DB Stats ** Uptime(secs): 47.4 total, 5.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 186.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.100 H:M:S, 42.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 186.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.412 H:M:S, 45.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/05-12:53:53 ... thread 0: (1000000,10000000) ops and (121741.4,180385.8) ops/second in (8.214133,55.436746) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.76 GB 37.8 8.7 0.0 8.7 18.3 9.5 0.0 1.9 135.3 282.8 66.10 59.98 179 0.369 9082K 13K 0.0 0.0 L1 12/12 1.40 GB 0.0 8.3 6.6 1.7 8.2 6.5 0.1 1.2 218.7 215.8 38.98 36.22 5 7.796 8162K 107K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 5.2 2.0 235.7 235.6 0.53 0.52 1 0.535 127K 40 0.0 0.0 L3 17/2 1.13 GB 0.9 6.4 4.0 2.4 6.4 3.9 1.4 1.6 192.5 191.7 34.06 29.67 14 2.433 6398K 22K 0.0 0.0 L4 193/14 10.29 GB 1.0 4.6 4.1 0.5 4.6 4.1 0.9 1.1 130.9 130.5 36.12 22.93 59 0.612 4730K 11K 0.0 0.0 L5 1108/0 89.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1344/38 105.51 GB 0.0 28.2 14.8 13.4 37.6 24.1 11.9 3.9 164.3 218.9 175.80 149.32 258 0.681 28M 155K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.2 14.8 13.4 37.6 24.1 11.8 3.9 164.3 218.9 175.80 149.32 258 0.681 28M 155K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.2 14.8 13.4 28.0 14.6 0.0 0.0 198.2 197.0 145.74 124.10 110 1.325 28M 155K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 324.9 30.06 25.22 148 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.6 total, 55.4 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.57 GB write, 691.58 MB/s write, 28.20 GB read, 519.09 MB/s read, 175.8 seconds Interval compaction: 37.57 GB write, 694.02 MB/s write, 28.20 GB read, 520.93 MB/s read, 175.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 26, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 26, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 36, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4192344 Average: 2.8025 StdDev: 23.52 Min: 0 Median: 1.5106 Max: 10838 Percentiles: P50: 1.51 P75: 1.92 P99: 7.53 P99.9: 151.28 P99.99: 317.70 ------------------------------------------------------ [ 0, 1 ] 789291 18.827% 18.827% #### ( 1, 2 ] 2559272 61.046% 79.873% ############ ( 2, 3 ] 469558 11.200% 91.074% ## ( 3, 4 ] 179477 4.281% 95.355% # ( 4, 6 ] 138657 3.307% 98.662% # ( 6, 10 ] 36945 0.881% 99.543% ( 10, 15 ] 6267 0.149% 99.693% ( 15, 22 ] 914 0.022% 99.715% ( 22, 34 ] 101 0.002% 99.717% ( 34, 51 ] 23 0.001% 99.718% ( 51, 76 ] 32 0.001% 99.718% ( 76, 110 ] 3006 0.072% 99.790% ( 110, 170 ] 6702 0.160% 99.950% ( 170, 250 ] 1261 0.030% 99.980% ( 250, 380 ] 808 0.019% 99.999% ( 380, 580 ] 388 0.009% 100.009% ( 580, 870 ] 178 0.004% 100.013% ( 870, 1300 ] 91 0.002% 100.015% ( 1300, 1900 ] 50 0.001% 100.016% ( 1900, 2900 ] 66 0.002% 100.018% ( 2900, 4400 ] 56 0.001% 100.019% ( 4400, 6600 ] 10 0.000% 100.019% ( 6600, 9900 ] 3 0.000% 100.019% ( 9900, 14000 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1605785 Average: 3.8053 StdDev: 40.14 Min: 0 Median: 1.8628 Max: 8720 Percentiles: P50: 1.86 P75: 2.77 P99: 9.13 P99.9: 128.31 P99.99: 208.48 ------------------------------------------------------ [ 0, 1 ] 57097 3.556% 3.556% # ( 1, 2 ] 864431 53.832% 57.388% ########### ( 2, 3 ] 367900 22.911% 80.299% ##### ( 3, 4 ] 142966 8.903% 89.202% ## ( 4, 6 ] 129107 8.040% 97.242% ## ( 6, 10 ] 36075 2.247% 99.489% ( 10, 15 ] 4881 0.304% 99.793% ( 15, 22 ] 525 0.033% 99.825% ( 22, 34 ] 40 0.002% 99.828% ( 34, 51 ] 13 0.001% 99.829% ( 51, 76 ] 21 0.001% 99.830% ( 76, 110 ] 701 0.044% 99.874% ( 110, 170 ] 1387 0.086% 99.960% ( 170, 250 ] 1001 0.062% 100.022% ( 250, 380 ] 581 0.036% 100.059% ( 380, 580 ] 352 0.022% 100.081% ( 580, 870 ] 140 0.009% 100.089% ( 870, 1300 ] 73 0.005% 100.094% ( 1300, 1900 ] 52 0.003% 100.097% ( 1900, 2900 ] 84 0.005% 100.102% ( 2900, 4400 ] 66 0.004% 100.106% ( 4400, 6600 ] 16 0.001% 100.107% ( 6600, 9900 ] 6 0.000% 100.108% ** Level 2 read latency histogram (micros): Count: 60272 Average: 2.5989 StdDev: 11.68 Min: 1 Median: 1.6148 Max: 1655 Percentiles: P50: 1.61 P75: 1.99 P99: 8.53 P99.9: 46.65 P99.99: 346.62 ------------------------------------------------------ [ 0, 1 ] 5306 8.803% 8.803% ## ( 1, 2 ] 40386 67.006% 75.810% ############# ( 2, 3 ] 8068 13.386% 89.196% ### ( 3, 4 ] 3166 5.253% 94.449% # ( 4, 6 ] 2174 3.607% 98.055% # ( 6, 10 ] 900 1.493% 99.549% ( 10, 15 ] 142 0.236% 99.784% ( 15, 22 ] 28 0.046% 99.831% ( 22, 34 ] 6 0.010% 99.841% ( 34, 51 ] 48 0.080% 99.920% ( 51, 76 ] 14 0.023% 99.944% ( 76, 110 ] 9 0.015% 99.959% ( 110, 170 ] 13 0.022% 99.980% ( 170, 250 ] 3 0.005% 99.985% ( 250, 380 ] 4 0.007% 99.992% ( 380, 580 ] 1 0.002% 99.993% ( 580, 870 ] 1 0.002% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1533371 Average: 5.9152 StdDev: 92.12 Min: 0 Median: 1.9753 Max: 13664 Percentiles: P50: 1.98 P75: 2.94 P99: 9.28 P99.9: 110.68 P99.99: 221.78 ------------------------------------------------------ [ 0, 1 ] 36402 2.374% 2.374% ( 1, 2 ] 748813 48.834% 51.208% ########## ( 2, 3 ] 387071 25.243% 76.452% ##### ( 3, 4 ] 162580 10.603% 87.054% ## ( 4, 6 ] 155966 10.171% 97.226% ## ( 6, 10 ] 33151 2.162% 99.388% ( 10, 15 ] 6316 0.412% 99.800% ( 15, 22 ] 736 0.048% 99.848% ( 22, 34 ] 147 0.010% 99.857% ( 34, 51 ] 355 0.023% 99.880% ( 51, 76 ] 79 0.005% 99.886% ( 76, 110 ] 212 0.014% 99.899% ( 110, 170 ] 844 0.055% 99.954% ( 170, 250 ] 843 0.055% 100.009% ( 250, 380 ] 762 0.050% 100.059% ( 380, 580 ] 574 0.037% 100.097% ( 580, 870 ] 376 0.025% 100.121% ( 870, 1300 ] 270 0.018% 100.139% ( 1300, 1900 ] 238 0.016% 100.154% ( 1900, 2900 ] 269 0.018% 100.172% ( 2900, 4400 ] 385 0.025% 100.197% ( 4400, 6600 ] 94 0.006% 100.203% ( 6600, 9900 ] 34 0.002% 100.205% ( 9900, 14000 ] 5 0.000% 100.205% ** Level 4 read latency histogram (micros): Count: 215587 Average: 29.5950 StdDev: 283.52 Min: 0 Median: 2.0370 Max: 24484 Percentiles: P50: 2.04 P75: 3.08 P99: 632.62 P99.9: 3553.10 P99.99: 4188.56 ------------------------------------------------------ [ 0, 1 ] 3110 1.443% 1.443% ( 1, 2 ] 102684 47.630% 49.073% ########## ( 2, 3 ] 54082 25.086% 74.158% ##### ( 3, 4 ] 22670 10.515% 84.674% ## ( 4, 6 ] 20683 9.594% 94.268% ## ( 6, 10 ] 5900 2.737% 97.004% # ( 10, 15 ] 1084 0.503% 97.507% ( 15, 22 ] 153 0.071% 97.578% ( 22, 34 ] 21 0.010% 97.588% ( 34, 51 ] 9 0.004% 97.592% ( 51, 76 ] 6 0.003% 97.595% ( 76, 110 ] 126 0.058% 97.653% ( 110, 170 ] 677 0.314% 97.967% ( 170, 250 ] 796 0.369% 98.337% ( 250, 380 ] 668 0.310% 98.646% ( 380, 580 ] 651 0.302% 98.948% ( 580, 870 ] 618 0.287% 99.235% ( 870, 1300 ] 445 0.206% 99.442% ( 1300, 1900 ] 323 0.150% 99.591% ( 1900, 2900 ] 467 0.217% 99.808% ( 2900, 4400 ] 458 0.212% 100.020% ( 4400, 6600 ] 88 0.041% 100.061% ( 6600, 9900 ] 20 0.009% 100.071% ( 9900, 14000 ] 1 0.000% 100.071% ( 14000, 22000 ] 10 0.005% 100.076% ( 22000, 33000 ] 1 0.000% 100.076% ** Level 5 read latency histogram (micros): Count: 260 Average: 740.7846 StdDev: 868.23 Min: 93 Median: 396.6667 Max: 4154 Percentiles: P50: 396.67 P75: 899.66 P99: 4154.00 P99.9: 4154.00 P99.99: 4154.00 ------------------------------------------------------ ( 76, 110 ] 6 2.308% 2.308% ( 110, 170 ] 38 14.615% 16.923% ### ( 170, 250 ] 51 19.615% 36.538% #### ( 250, 380 ] 33 12.692% 49.231% ### ( 380, 580 ] 24 9.231% 58.462% ## ( 580, 870 ] 41 15.769% 74.231% ### ( 870, 1300 ] 29 11.154% 85.385% ## ( 1300, 1900 ] 17 6.538% 91.923% # ( 1900, 2900 ] 4 1.538% 93.462% ( 2900, 4400 ] 17 6.538% 100.000% # ** DB Stats ** Uptime(secs): 55.6 total, 8.2 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 176.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.053 H:M:S, 45.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 119.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.953 H:M:S, 60.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/05-12:53:56 ... thread 0: (1000000,11000000) ops and (341359.8,188465.2) ops/second in (2.929460,58.366206) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 3.68 GB 132.2 9.8 0.0 9.8 20.2 10.4 0.0 1.9 137.0 283.4 73.09 66.64 198 0.369 10M 14K 0.0 0.0 L1 12/12 1.40 GB 0.0 8.3 6.6 1.7 8.2 6.5 0.1 1.2 218.7 215.8 38.98 36.22 5 7.796 8162K 107K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 5.2 2.0 235.7 235.6 0.53 0.52 1 0.535 127K 40 0.0 0.0 L3 15/0 896.26 MB 0.9 6.4 4.0 2.4 6.4 3.9 1.4 1.6 192.5 191.7 34.06 29.67 14 2.433 6398K 22K 0.0 0.0 L4 181/0 9.48 GB 1.0 5.4 4.3 1.0 5.4 4.3 0.9 1.2 137.8 137.2 40.06 26.50 61 0.657 5535K 22K 0.0 0.0 L5 1120/0 90.98 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1345/22 106.42 GB 0.0 30.0 15.0 15.0 40.3 25.3 12.9 3.9 164.6 221.0 186.72 159.55 279 0.669 30M 168K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.0 15.0 15.0 40.3 25.3 12.8 3.9 164.6 221.0 186.72 159.55 279 0.669 30M 168K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.0 15.0 15.0 29.8 14.8 0.0 0.0 199.6 198.4 154.02 131.91 116 1.328 30M 168K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 327.5 32.70 27.64 163 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.6 total, 58.4 interval Flush(GB): cumulative 10.459, interval 10.459 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.30 GB write, 704.72 MB/s write, 30.02 GB read, 524.95 MB/s read, 186.7 seconds Interval compaction: 40.30 GB write, 707.09 MB/s write, 30.02 GB read, 526.71 MB/s read, 186.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 26, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 26, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 36, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4595134 Average: 2.7759 StdDev: 22.54 Min: 0 Median: 1.5235 Max: 10838 Percentiles: P50: 1.52 P75: 1.93 P99: 7.50 P99.9: 146.57 P99.99: 278.95 ------------------------------------------------------ [ 0, 1 ] 821712 17.882% 17.882% #### ( 1, 2 ] 2819449 61.357% 79.239% ############ ( 2, 3 ] 538034 11.709% 90.948% ## ( 3, 4 ] 201823 4.392% 95.340% # ( 4, 6 ] 152646 3.322% 98.662% # ( 6, 10 ] 41474 0.903% 99.565% ( 10, 15 ] 7064 0.154% 99.719% ( 15, 22 ] 979 0.021% 99.740% ( 22, 34 ] 108 0.002% 99.742% ( 34, 51 ] 24 0.001% 99.743% ( 51, 76 ] 41 0.001% 99.744% ( 76, 110 ] 3038 0.066% 99.810% ( 110, 170 ] 6805 0.148% 99.958% ( 170, 250 ] 1295 0.028% 99.986% ( 250, 380 ] 824 0.018% 100.004% ( 380, 580 ] 394 0.009% 100.013% ( 580, 870 ] 181 0.004% 100.016% ( 870, 1300 ] 95 0.002% 100.019% ( 1300, 1900 ] 51 0.001% 100.020% ( 1900, 2900 ] 66 0.001% 100.021% ( 2900, 4400 ] 56 0.001% 100.022% ( 4400, 6600 ] 10 0.000% 100.023% ( 6600, 9900 ] 3 0.000% 100.023% ( 9900, 14000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1628202 Average: 3.7897 StdDev: 39.87 Min: 0 Median: 1.8613 Max: 8720 Percentiles: P50: 1.86 P75: 2.77 P99: 9.12 P99.9: 127.25 P99.99: 208.14 ------------------------------------------------------ [ 0, 1 ] 57830 3.552% 3.552% # ( 1, 2 ] 878027 53.926% 57.478% ########### ( 2, 3 ] 372251 22.863% 80.341% ##### ( 3, 4 ] 144827 8.895% 89.236% ## ( 4, 6 ] 130451 8.012% 97.248% ## ( 6, 10 ] 36553 2.245% 99.493% ( 10, 15 ] 4929 0.303% 99.795% ( 15, 22 ] 532 0.033% 99.828% ( 22, 34 ] 40 0.002% 99.830% ( 34, 51 ] 13 0.001% 99.831% ( 51, 76 ] 21 0.001% 99.832% ( 76, 110 ] 701 0.043% 99.876% ( 110, 170 ] 1387 0.085% 99.961% ( 170, 250 ] 1001 0.061% 100.022% ( 250, 380 ] 581 0.036% 100.058% ( 380, 580 ] 352 0.022% 100.079% ( 580, 870 ] 140 0.009% 100.088% ( 870, 1300 ] 73 0.004% 100.093% ( 1300, 1900 ] 52 0.003% 100.096% ( 1900, 2900 ] 84 0.005% 100.101% ( 2900, 4400 ] 66 0.004% 100.105% ( 4400, 6600 ] 16 0.001% 100.106% ( 6600, 9900 ] 6 0.000% 100.106% ** Level 2 read latency histogram (micros): Count: 60272 Average: 2.5989 StdDev: 11.68 Min: 1 Median: 1.6148 Max: 1655 Percentiles: P50: 1.61 P75: 1.99 P99: 8.53 P99.9: 46.65 P99.99: 346.62 ------------------------------------------------------ [ 0, 1 ] 5306 8.803% 8.803% ## ( 1, 2 ] 40386 67.006% 75.810% ############# ( 2, 3 ] 8068 13.386% 89.196% ### ( 3, 4 ] 3166 5.253% 94.449% # ( 4, 6 ] 2174 3.607% 98.055% # ( 6, 10 ] 900 1.493% 99.549% ( 10, 15 ] 142 0.236% 99.784% ( 15, 22 ] 28 0.046% 99.831% ( 22, 34 ] 6 0.010% 99.841% ( 34, 51 ] 48 0.080% 99.920% ( 51, 76 ] 14 0.023% 99.944% ( 76, 110 ] 9 0.015% 99.959% ( 110, 170 ] 13 0.022% 99.980% ( 170, 250 ] 3 0.005% 99.985% ( 250, 380 ] 4 0.007% 99.992% ( 380, 580 ] 1 0.002% 99.993% ( 580, 870 ] 1 0.002% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1533371 Average: 5.9152 StdDev: 92.12 Min: 0 Median: 1.9753 Max: 13664 Percentiles: P50: 1.98 P75: 2.94 P99: 9.28 P99.9: 110.68 P99.99: 221.78 ------------------------------------------------------ [ 0, 1 ] 36402 2.374% 2.374% ( 1, 2 ] 748813 48.834% 51.208% ########## ( 2, 3 ] 387071 25.243% 76.452% ##### ( 3, 4 ] 162580 10.603% 87.054% ## ( 4, 6 ] 155966 10.171% 97.226% ## ( 6, 10 ] 33151 2.162% 99.388% ( 10, 15 ] 6316 0.412% 99.800% ( 15, 22 ] 736 0.048% 99.848% ( 22, 34 ] 147 0.010% 99.857% ( 34, 51 ] 355 0.023% 99.880% ( 51, 76 ] 79 0.005% 99.886% ( 76, 110 ] 212 0.014% 99.899% ( 110, 170 ] 844 0.055% 99.954% ( 170, 250 ] 843 0.055% 100.009% ( 250, 380 ] 762 0.050% 100.059% ( 380, 580 ] 574 0.037% 100.097% ( 580, 870 ] 376 0.025% 100.121% ( 870, 1300 ] 270 0.018% 100.139% ( 1300, 1900 ] 238 0.016% 100.154% ( 1900, 2900 ] 269 0.018% 100.172% ( 2900, 4400 ] 385 0.025% 100.197% ( 4400, 6600 ] 94 0.006% 100.203% ( 6600, 9900 ] 34 0.002% 100.205% ( 9900, 14000 ] 5 0.000% 100.205% ** Level 4 read latency histogram (micros): Count: 272986 Average: 24.1040 StdDev: 252.25 Min: 0 Median: 1.9586 Max: 24484 Percentiles: P50: 1.96 P75: 2.95 P99: 436.66 P99.9: 3329.09 P99.99: 4133.74 ------------------------------------------------------ [ 0, 1 ] 4558 1.670% 1.670% ( 1, 2 ] 137639 50.420% 52.089% ########## ( 2, 3 ] 65648 24.048% 76.138% ##### ( 3, 4 ] 27240 9.979% 86.116% ## ( 4, 6 ] 23867 8.743% 94.859% ## ( 6, 10 ] 7178 2.629% 97.489% # ( 10, 15 ] 1197 0.438% 97.927% ( 15, 22 ] 165 0.060% 97.987% ( 22, 34 ] 21 0.008% 97.995% ( 34, 51 ] 10 0.004% 97.999% ( 51, 76 ] 6 0.002% 98.001% ( 76, 110 ] 194 0.071% 98.072% ( 110, 170 ] 792 0.290% 98.362% ( 170, 250 ] 867 0.318% 98.680% ( 250, 380 ] 688 0.252% 98.932% ( 380, 580 ] 657 0.241% 99.172% ( 580, 870 ] 620 0.227% 99.400% ( 870, 1300 ] 445 0.163% 99.563% ( 1300, 1900 ] 323 0.118% 99.681% ( 1900, 2900 ] 467 0.171% 99.852% ( 2900, 4400 ] 458 0.168% 100.020% ( 4400, 6600 ] 88 0.032% 100.052% ( 6600, 9900 ] 20 0.007% 100.059% ( 9900, 14000 ] 1 0.000% 100.060% ( 14000, 22000 ] 10 0.004% 100.063% ( 22000, 33000 ] 1 0.000% 100.064% ** Level 5 read latency histogram (micros): Count: 320 Average: 663.7625 StdDev: 807.97 Min: 93 Median: 345.7895 Max: 4154 Percentiles: P50: 345.79 P75: 819.57 P99: 4117.65 P99.9: 4154.00 P99.99: 4154.00 ------------------------------------------------------ ( 76, 110 ] 16 5.000% 5.000% # ( 110, 170 ] 53 16.562% 21.562% ### ( 170, 250 ] 63 19.688% 41.250% #### ( 250, 380 ] 38 11.875% 53.125% ## ( 380, 580 ] 32 10.000% 63.125% ## ( 580, 870 ] 46 14.375% 77.500% ### ( 870, 1300 ] 34 10.625% 88.125% ## ( 1300, 1900 ] 17 5.312% 93.438% # ( 1900, 2900 ] 4 1.250% 94.688% ( 2900, 4400 ] 17 5.312% 100.000% # ** DB Stats ** Uptime(secs): 58.6 total, 2.9 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 184.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.053 H:M:S, 42.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.236 micros/op 190996 ops/sec 60.001 seconds 11459999 operations; 185.1 MB/s Microseconds per write: Count: 11459999 Average: 5.2357 StdDev: 284.66 Min: 1 Median: 1.8311 Max: 603453 Percentiles: P50: 1.83 P75: 3.13 P99: 8.89 P99.9: 1064.66 P99.99: 2722.14 ------------------------------------------------------ [ 0, 1 ] 1251248 10.918% 10.918% ## ( 1, 2 ] 5389114 47.025% 57.944% ######### ( 2, 3 ] 1756097 15.324% 73.268% ### ( 3, 4 ] 1547736 13.506% 86.773% ### ( 4, 6 ] 1282614 11.192% 97.965% ## ( 6, 10 ] 164140 1.432% 99.397% ( 10, 15 ] 28728 0.251% 99.648% ( 15, 22 ] 8994 0.078% 99.727% ( 22, 34 ] 2925 0.026% 99.752% ( 34, 51 ] 508 0.004% 99.757% ( 51, 76 ] 105 0.001% 99.758% ( 76, 110 ] 22 0.000% 99.758% ( 110, 170 ] 10447 0.091% 99.849% ( 170, 250 ] 966 0.008% 99.857% ( 250, 380 ] 190 0.002% 99.859% ( 380, 580 ] 50 0.000% 99.859% ( 580, 870 ] 71 0.001% 99.860% ( 870, 1300 ] 10126 0.088% 99.948% ( 1300, 1900 ] 48 0.000% 99.949% ( 1900, 2900 ] 5746 0.050% 99.999% ( 2900, 4400 ] 98 0.001% 100.000% ( 4400, 6600 ] 11 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 6 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 193486 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11459999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11826718968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 674 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 25325131 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 34397273874 rocksdb.compact.write.bytes COUNT : 34200765098 rocksdb.flush.write.bytes COUNT : 11758870864 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 73 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 353 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11663449088 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3996672 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 34510514655 rocksdb.non.last.level.read.count COUNT : 8334407 rocksdb.block.checksum.compute.count COUNT : 8333132 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.471935 P95 : 4.909807 P99 : 7.573849 P100 : 603452.000000 COUNT : 11459999 SUM : 54353671 rocksdb.compaction.times.micros P50 : 841290.322581 P95 : 4355000.000000 P99 : 13244000.000000 P100 : 17001485.000000 COUNT : 118 SUM : 156046152 rocksdb.compaction.times.cpu_micros P50 : 642500.000000 P95 : 4355000.000000 P99 : 13244000.000000 P100 : 15884839.000000 COUNT : 118 SUM : 133879937 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 572.134831 P95 : 1517.500000 P99 : 4719.000000 P100 : 5548.000000 COUNT : 171 SUM : 133291 rocksdb.compaction.outfile.sync.micros P50 : 859.642857 P95 : 5830.000000 P99 : 8877.000000 P100 : 9456.000000 COUNT : 434 SUM : 697789 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 104.142857 P95 : 1495.000000 P99 : 4037.000000 P100 : 5130.000000 COUNT : 321 SUM : 94039 rocksdb.table.open.io.micros P50 : 849.285714 P95 : 5374.285714 P99 : 9250.421053 P100 : 12904.000000 COUNT : 674 SUM : 992008 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.766712 P95 : 8.307502 P99 : 12.534147 P100 : 24489.000000 COUNT : 8331601 SUM : 53652753 rocksdb.read.block.get.micros P50 : 331.995413 P95 : 1860.000000 P99 : 3989.677419 P100 : 8927.000000 COUNT : 1348 SUM : 740589 rocksdb.write.raw.block.micros P50 : 0.517781 P95 : 0.983784 P99 : 3.266621 P100 : 28545.000000 COUNT : 11132330 SUM : 24734865 rocksdb.numfiles.in.singlecompaction P50 : 3.065217 P95 : 8.155556 P99 : 19.795000 P100 : 23.000000 COUNT : 163 SUM : 590 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562759 P95 : 1240.287717 P99 : 2651.971559 P100 : 603249.000000 COUNT : 142477 SUM : 25334983 rocksdb.sst.read.micros P50 : 1.673546 P95 : 4.979057 P99 : 8.963962 P100 : 24484.000000 COUNT : 8335310 SUM : 35624760 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11459999 SUM : 11826718968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 189545.454545 P95 : 373500.000000 P99 : 612050.000000 P100 : 794009.000000 COUNT : 171 SUM : 34088646 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 430 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0