[2024-11-28 19:52:11.802477] Starting SPDK v25.01-pre git sha1 35cd3e84d / DPDK 24.11.0-rc4 initialization... [2024-11-28 19:52:11.802628] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3770317 ] Set seed to 1732819931798855 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-28 19:52:11.970354] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.11.0-rc4 is used. There is no support for it in SPDK. Enabled only for validation. [2024-11-28 19:52:12.028843] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-28 19:52:12.051435] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-28 19:52:12.051471] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3770317' to capture a snapshot of events at runtime. [2024-11-28 19:52:12.051483] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-28 19:52:12.051491] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-28 19:52:12.051500] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3770317 for offline analysis/debug. [2024-11-28 19:52:12.052041] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Nov 28 19:52:16 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/28-19:52:19 ... thread 0: (1000000,1000000) ops and (357596.4,357596.4) ops/second in (2.796449,2.796449) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.02 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 351.0 2.33 2.09 12 0.194 0 0 0.0 0.0 L2 3/2 251.77 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 249.1 249.0 1.52 1.47 2 0.758 383K 201 0.0 0.0 L3 9/0 741.21 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.8 1.5 98.2 310.8 3.85 3.56 14 0.275 383K 201 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.8 1.5 98.2 310.8 3.85 3.56 14 0.275 383K 201 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 249.1 249.0 1.52 1.47 2 0.758 383K 201 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 351.0 2.33 2.09 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 404.20 MB/s write, 0.37 GB read, 127.65 MB/s read, 3.9 seconds Interval compaction: 1.17 GB write, 427.68 MB/s write, 0.37 GB read, 135.07 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 101371 Average: 1.8229 StdDev: 15.80 Min: 1 Median: 1.1776 Max: 2847 Percentiles: P50: 1.18 P75: 1.64 P99: 3.76 P99.9: 9.19 P99.99: 272.44 ------------------------------------------------------ [ 0, 1 ] 40863 40.310% 40.310% ######## ( 1, 2 ] 55315 54.567% 94.877% ########### ( 2, 3 ] 3321 3.276% 98.153% # ( 3, 4 ] 1125 1.110% 99.263% ( 4, 6 ] 503 0.496% 99.759% ( 6, 10 ] 179 0.177% 99.936% ( 10, 15 ] 29 0.029% 99.964% ( 15, 22 ] 7 0.007% 99.971% ( 22, 34 ] 2 0.002% 99.973% ( 34, 51 ] 1 0.001% 99.974% ( 51, 76 ] 2 0.002% 99.976% ( 110, 170 ] 6 0.006% 99.982% ( 170, 250 ] 7 0.007% 99.989% ( 250, 380 ] 5 0.005% 99.994% ( 380, 580 ] 2 0.002% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 50297 Average: 2.0139 StdDev: 19.00 Min: 0 Median: 1.2394 Max: 2618 Percentiles: P50: 1.24 P75: 1.67 P99: 4.50 P99.9: 9.76 P99.99: 868.28 ------------------------------------------------------ [ 0, 1 ] 18236 36.257% 36.257% ####### ( 1, 2 ] 28871 57.401% 93.658% ########### ( 2, 3 ] 1897 3.772% 97.429% # ( 3, 4 ] 682 1.356% 98.785% ( 4, 6 ] 430 0.855% 99.640% ( 6, 10 ] 139 0.276% 99.916% ( 10, 15 ] 19 0.038% 99.954% ( 15, 22 ] 5 0.010% 99.964% ( 22, 34 ] 1 0.002% 99.966% ( 51, 76 ] 3 0.006% 99.972% ( 250, 380 ] 4 0.008% 99.980% ( 580, 870 ] 5 0.010% 99.990% ( 870, 1300 ] 3 0.006% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1613.9273 StdDev: 1064.01 Min: 296 Median: 1273.1250 Max: 4403 Percentiles: P50: 1273.12 P75: 2377.27 P99: 4403.00 P99.9: 4403.00 P99.99: 4403.00 ------------------------------------------------------ ( 250, 380 ] 2 3.636% 3.636% # ( 380, 580 ] 5 9.091% 12.727% ## ( 580, 870 ] 13 23.636% 36.364% ##### ( 870, 1300 ] 8 14.545% 50.909% ### ( 1300, 1900 ] 8 14.545% 65.455% ### ( 1900, 2900 ] 11 20.000% 85.455% #### ( 2900, 4400 ] 7 12.727% 98.182% ### ( 4400, 6600 ] 1 1.818% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1701.8000 StdDev: 908.31 Min: 726 Median: 1400.0000 Max: 3896 Percentiles: P50: 1400.00 P75: 2316.67 P99: 3896.00 P99.9: 3896.00 P99.99: 3896.00 ------------------------------------------------------ ( 580, 870 ] 2 13.333% 13.333% ### ( 870, 1300 ] 5 33.333% 46.667% ####### ( 1300, 1900 ] 3 20.000% 66.667% #### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 2900, 4400 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 596.8000 StdDev: 782.63 Min: 90 Median: 150.0000 Max: 2847 Percentiles: P50: 150.00 P75: 870.00 P99: 2800.00 P99.9: 2847.00 P99.99: 2847.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 6 30.000% 60.000% ###### ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 1 5.000% 70.000% # ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 332.38 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.209 H:M:S, 7.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.209 H:M:S, 7.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-19:52:22 ... thread 0: (1000000,2000000) ops and (321387.8,338526.6) ops/second in (3.111506,5.907955) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.17 GB 88.1 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.1 316.9 8.35 7.73 29 0.288 831K 874 0.0 0.0 L1 1/0 2.86 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.5 240.0 1.57 1.52 1 1.572 383K 627 0.0 0.0 L2 2/0 54.75 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.1 249.0 1.52 1.47 2 0.758 383K 201 0.0 0.0 L3 42/0 998.37 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.7 201.5 3.95 3.47 3 1.316 808K 832 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/4 97.92 GB 0.0 2.3 1.1 1.2 4.1 2.9 2.1 2.3 154.2 272.8 15.38 14.19 35 0.439 2407K 2534 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 1.1 1.2 4.1 2.9 2.1 2.3 154.2 272.8 15.38 14.19 35 0.439 2407K 2534 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 1.1 1.2 2.3 1.1 0.0 0.0 232.1 231.9 10.22 9.58 9 1.135 2407K 2534 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.6 5.17 4.61 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.10 GB write, 690.93 MB/s write, 2.32 GB read, 390.50 MB/s read, 15.4 seconds Interval compaction: 4.10 GB write, 709.94 MB/s write, 2.32 GB read, 401.24 MB/s read, 15.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 390085 Average: 2.1252 StdDev: 13.11 Min: 1 Median: 1.4374 Max: 4444 Percentiles: P50: 1.44 P75: 1.84 P99: 5.52 P99.9: 9.68 P99.99: 14.33 ------------------------------------------------------ [ 0, 1 ] 88819 22.769% 22.769% ##### ( 1, 2 ] 242879 62.263% 85.032% ############ ( 2, 3 ] 34596 8.869% 93.901% ## ( 3, 4 ] 13803 3.538% 97.440% # ( 4, 6 ] 7999 2.051% 99.490% ( 6, 10 ] 1736 0.445% 99.935% ( 10, 15 ] 247 0.063% 99.998% ( 15, 22 ] 28 0.007% 100.006% ( 22, 34 ] 7 0.002% 100.007% ( 34, 51 ] 6 0.002% 100.009% ( 51, 76 ] 3 0.001% 100.010% ( 110, 170 ] 12 0.003% 100.013% ( 170, 250 ] 14 0.004% 100.016% ( 250, 380 ] 14 0.004% 100.020% ( 380, 580 ] 3 0.001% 100.021% ( 580, 870 ] 4 0.001% 100.022% ( 870, 1300 ] 4 0.001% 100.023% ( 1300, 1900 ] 2 0.001% 100.023% ( 1900, 2900 ] 3 0.001% 100.024% ( 2900, 4400 ] 1 0.000% 100.024% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 81648 Average: 2.4367 StdDev: 4.80 Min: 1 Median: 1.6537 Max: 853 Percentiles: P50: 1.65 P75: 2.15 P99: 5.91 P99.9: 10.58 P99.99: 14.66 ------------------------------------------------------ [ 0, 1 ] 6217 7.614% 7.614% ## ( 1, 2 ] 52943 64.843% 72.457% ############# ( 2, 3 ] 13677 16.751% 89.209% ### ( 3, 4 ] 4751 5.819% 95.027% # ( 4, 6 ] 3396 4.159% 99.187% # ( 6, 10 ] 572 0.701% 99.887% ( 10, 15 ] 90 0.110% 99.998% ( 15, 22 ] 11 0.013% 100.011% ( 22, 34 ] 2 0.002% 100.013% ( 34, 51 ] 1 0.001% 100.015% ( 110, 170 ] 1 0.001% 100.016% ( 170, 250 ] 1 0.001% 100.017% ( 250, 380 ] 1 0.001% 100.018% ( 380, 580 ] 3 0.004% 100.022% ( 580, 870 ] 2 0.002% 100.024% ** Level 2 read latency histogram (micros): Count: 95448 Average: 2.0946 StdDev: 13.81 Min: 0 Median: 1.3965 Max: 2618 Percentiles: P50: 1.40 P75: 1.80 P99: 5.30 P99.9: 9.94 P99.99: 606.40 ------------------------------------------------------ [ 0, 1 ] 24025 25.171% 25.171% ##### ( 1, 2 ] 59765 62.615% 87.786% ############# ( 2, 3 ] 7164 7.506% 95.292% ## ( 3, 4 ] 2586 2.709% 98.001% # ( 4, 6 ] 1465 1.535% 99.536% ( 6, 10 ] 353 0.370% 99.906% ( 10, 15 ] 61 0.064% 99.970% ( 15, 22 ] 9 0.009% 99.979% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 3 0.003% 99.985% ( 250, 380 ] 4 0.004% 99.990% ( 580, 870 ] 5 0.005% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57428 Average: 4.0766 StdDev: 60.50 Min: 0 Median: 1.6484 Max: 4403 Percentiles: P50: 1.65 P75: 2.14 P99: 6.25 P99.9: 211.15 P99.99: 2014.29 ------------------------------------------------------ [ 0, 1 ] 4637 8.074% 8.074% ## ( 1, 2 ] 37132 64.658% 72.733% ############# ( 2, 3 ] 9440 16.438% 89.171% ### ( 3, 4 ] 3301 5.748% 94.919% # ( 4, 6 ] 2318 4.036% 98.955% # ( 6, 10 ] 412 0.717% 99.673% ( 10, 15 ] 79 0.138% 99.810% ( 15, 22 ] 8 0.014% 99.824% ( 22, 34 ] 37 0.064% 99.889% ( 51, 76 ] 2 0.003% 99.892% ( 76, 110 ] 1 0.002% 99.894% ( 110, 170 ] 1 0.002% 99.896% ( 170, 250 ] 5 0.009% 99.904% ( 250, 380 ] 7 0.012% 99.916% ( 380, 580 ] 10 0.017% 99.934% ( 580, 870 ] 14 0.024% 99.958% ( 870, 1300 ] 8 0.014% 99.972% ( 1300, 1900 ] 9 0.016% 99.988% ( 1900, 2900 ] 11 0.019% 100.007% ( 2900, 4400 ] 7 0.012% 100.019% ( 4400, 6600 ] 1 0.002% 100.021% ** Level 4 read latency histogram (micros): Count: 15 Average: 1701.8000 StdDev: 908.31 Min: 726 Median: 1400.0000 Max: 3896 Percentiles: P50: 1400.00 P75: 2316.67 P99: 3896.00 P99.9: 3896.00 P99.99: 3896.00 ------------------------------------------------------ ( 580, 870 ] 2 13.333% 13.333% ### ( 870, 1300 ] 5 33.333% 46.667% ####### ( 1300, 1900 ] 3 20.000% 66.667% #### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 2900, 4400 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 560.4750 StdDev: 708.65 Min: 86 Median: 153.6364 Max: 2847 Percentiles: P50: 153.64 P75: 725.00 P99: 2766.67 P99.9: 2847.00 P99.99: 2847.00 ------------------------------------------------------ ( 76, 110 ] 12 30.000% 30.000% ###### ( 110, 170 ] 11 27.500% 57.500% ###### ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 4 10.000% 72.500% ## ( 580, 870 ] 2 5.000% 77.500% # ( 870, 1300 ] 2 5.000% 82.500% # ( 1300, 1900 ] 4 10.000% 92.500% ## ( 1900, 2900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.617 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.408 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-19:52:24 ... thread 0: (1000000,3000000) ops and (357990.3,344775.0) ops/second in (2.793372,8.701327) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.09 GB 188.8 1.7 0.0 1.7 4.4 2.7 0.0 1.6 119.9 315.2 14.18 13.23 46 0.308 1727K 1839 0.0 0.0 L1 1/0 2.86 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.5 240.0 1.57 1.52 1 1.572 383K 627 0.0 0.0 L2 2/0 54.75 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.1 249.0 1.52 1.47 2 0.758 383K 201 0.0 0.0 L3 42/0 998.37 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.7 201.5 3.95 3.47 3 1.316 808K 832 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/4 98.84 GB 0.0 3.2 1.1 2.1 5.9 3.8 2.1 2.2 153.3 283.8 21.22 19.69 52 0.408 3303K 3499 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.1 2.1 5.9 3.8 2.1 2.2 153.3 283.8 21.22 19.69 52 0.408 3303K 3499 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.1 2.1 3.2 1.1 0.0 0.0 241.0 240.8 13.50 12.80 12 1.125 3303K 3499 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 359.0 7.72 6.89 40 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.7 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.88 GB write, 679.18 MB/s write, 3.18 GB read, 366.93 MB/s read, 21.2 seconds Interval compaction: 5.88 GB write, 691.87 MB/s write, 3.18 GB read, 373.79 MB/s read, 21.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 641251 Average: 2.0446 StdDev: 13.28 Min: 1 Median: 1.3893 Max: 4444 Percentiles: P50: 1.39 P75: 1.79 P99: 5.27 P99.9: 9.62 P99.99: 14.62 ------------------------------------------------------ [ 0, 1 ] 165793 25.855% 25.855% ##### ( 1, 2 ] 397691 62.018% 87.873% ############ ( 2, 3 ] 47213 7.363% 95.235% # ( 3, 4 ] 17931 2.796% 98.032% # ( 4, 6 ] 9805 1.529% 99.561% ( 6, 10 ] 2408 0.376% 99.936% ( 10, 15 ] 374 0.058% 99.994% ( 15, 22 ] 46 0.007% 100.002% ( 22, 34 ] 8 0.001% 100.003% ( 34, 51 ] 7 0.001% 100.004% ( 51, 76 ] 6 0.001% 100.005% ( 76, 110 ] 1 0.000% 100.005% ( 110, 170 ] 16 0.002% 100.007% ( 170, 250 ] 25 0.004% 100.011% ( 250, 380 ] 20 0.003% 100.015% ( 380, 580 ] 6 0.001% 100.015% ( 580, 870 ] 6 0.001% 100.016% ( 870, 1300 ] 6 0.001% 100.017% ( 1300, 1900 ] 4 0.001% 100.018% ( 1900, 2900 ] 5 0.001% 100.019% ( 2900, 4400 ] 3 0.000% 100.019% ( 4400, 6600 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 81648 Average: 2.4367 StdDev: 4.80 Min: 1 Median: 1.6537 Max: 853 Percentiles: P50: 1.65 P75: 2.15 P99: 5.91 P99.9: 10.58 P99.99: 14.66 ------------------------------------------------------ [ 0, 1 ] 6217 7.614% 7.614% ## ( 1, 2 ] 52943 64.843% 72.457% ############# ( 2, 3 ] 13677 16.751% 89.209% ### ( 3, 4 ] 4751 5.819% 95.027% # ( 4, 6 ] 3396 4.159% 99.187% # ( 6, 10 ] 572 0.701% 99.887% ( 10, 15 ] 90 0.110% 99.998% ( 15, 22 ] 11 0.013% 100.011% ( 22, 34 ] 2 0.002% 100.013% ( 34, 51 ] 1 0.001% 100.015% ( 110, 170 ] 1 0.001% 100.016% ( 170, 250 ] 1 0.001% 100.017% ( 250, 380 ] 1 0.001% 100.018% ( 380, 580 ] 3 0.004% 100.022% ( 580, 870 ] 2 0.002% 100.024% ** Level 2 read latency histogram (micros): Count: 95448 Average: 2.0946 StdDev: 13.81 Min: 0 Median: 1.3965 Max: 2618 Percentiles: P50: 1.40 P75: 1.80 P99: 5.30 P99.9: 9.94 P99.99: 606.40 ------------------------------------------------------ [ 0, 1 ] 24025 25.171% 25.171% ##### ( 1, 2 ] 59765 62.615% 87.786% ############# ( 2, 3 ] 7164 7.506% 95.292% ## ( 3, 4 ] 2586 2.709% 98.001% # ( 4, 6 ] 1465 1.535% 99.536% ( 6, 10 ] 353 0.370% 99.906% ( 10, 15 ] 61 0.064% 99.970% ( 15, 22 ] 9 0.009% 99.979% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 3 0.003% 99.985% ( 250, 380 ] 4 0.004% 99.990% ( 580, 870 ] 5 0.005% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57428 Average: 4.0766 StdDev: 60.50 Min: 0 Median: 1.6484 Max: 4403 Percentiles: P50: 1.65 P75: 2.14 P99: 6.25 P99.9: 211.15 P99.99: 2014.29 ------------------------------------------------------ [ 0, 1 ] 4637 8.074% 8.074% ## ( 1, 2 ] 37132 64.658% 72.733% ############# ( 2, 3 ] 9440 16.438% 89.171% ### ( 3, 4 ] 3301 5.748% 94.919% # ( 4, 6 ] 2318 4.036% 98.955% # ( 6, 10 ] 412 0.717% 99.673% ( 10, 15 ] 79 0.138% 99.810% ( 15, 22 ] 8 0.014% 99.824% ( 22, 34 ] 37 0.064% 99.889% ( 51, 76 ] 2 0.003% 99.892% ( 76, 110 ] 1 0.002% 99.894% ( 110, 170 ] 1 0.002% 99.896% ( 170, 250 ] 5 0.009% 99.904% ( 250, 380 ] 7 0.012% 99.916% ( 380, 580 ] 10 0.017% 99.934% ( 580, 870 ] 14 0.024% 99.958% ( 870, 1300 ] 8 0.014% 99.972% ( 1300, 1900 ] 9 0.016% 99.988% ( 1900, 2900 ] 11 0.019% 100.007% ( 2900, 4400 ] 7 0.012% 100.019% ( 4400, 6600 ] 1 0.002% 100.021% ** Level 4 read latency histogram (micros): Count: 15 Average: 1701.8000 StdDev: 908.31 Min: 726 Median: 1400.0000 Max: 3896 Percentiles: P50: 1400.00 P75: 2316.67 P99: 3896.00 P99.9: 3896.00 P99.99: 3896.00 ------------------------------------------------------ ( 580, 870 ] 2 13.333% 13.333% ### ( 870, 1300 ] 5 33.333% 46.667% ####### ( 1300, 1900 ] 3 20.000% 66.667% #### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 2900, 4400 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 560.4750 StdDev: 708.65 Min: 86 Median: 153.6364 Max: 2847 Percentiles: P50: 153.64 P75: 725.00 P99: 2766.67 P99.9: 2847.00 P99.99: 2847.00 ------------------------------------------------------ ( 76, 110 ] 12 30.000% 30.000% ###### ( 110, 170 ] 11 27.500% 57.500% ###### ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 4 10.000% 72.500% ## ( 580, 870 ] 2 5.000% 77.500% # ( 870, 1300 ] 2 5.000% 82.500% # ( 1300, 1900 ] 4 10.000% 92.500% ## ( 1900, 2900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 8.9 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 333.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.801 H:M:S, 9.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 352.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.184 H:M:S, 6.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-19:52:27 ... thread 0: (1000000,4000000) ops and (329676.9,340872.3) ops/second in (3.033273,11.734600) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 3.07 GB 31.5 2.4 0.0 2.4 6.1 3.7 0.0 1.6 124.6 316.2 19.71 18.41 63 0.313 2494K 2538 0.0 0.0 L1 1/1 2.86 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.5 240.0 1.57 1.52 1 1.572 383K 627 0.0 0.0 L2 2/0 54.75 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.1 249.0 1.52 1.47 2 0.758 383K 201 0.0 0.0 L3 42/0 998.37 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.7 201.5 3.95 3.47 3 1.316 808K 832 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/17 99.82 GB 0.0 3.9 1.1 2.8 7.6 4.8 2.1 2.1 149.9 291.0 26.75 24.87 69 0.388 4070K 4198 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.1 2.8 7.6 4.8 2.1 2.1 149.9 291.0 26.75 24.87 69 0.388 4070K 4198 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.1 2.8 3.9 1.1 0.0 0.0 246.4 246.1 16.27 15.52 15 1.085 4070K 4198 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 360.8 10.48 9.35 54 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.9 total, 11.7 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.60 GB write, 654.22 MB/s write, 3.92 GB read, 336.93 MB/s read, 26.7 seconds Interval compaction: 7.60 GB write, 663.29 MB/s write, 3.92 GB read, 341.60 MB/s read, 26.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 926471 Average: 2.0456 StdDev: 13.34 Min: 1 Median: 1.3878 Max: 4444 Percentiles: P50: 1.39 P75: 1.79 P99: 5.13 P99.9: 9.62 P99.99: 14.89 ------------------------------------------------------ [ 0, 1 ] 237204 25.603% 25.603% ##### ( 1, 2 ] 582879 62.914% 88.517% ############# ( 2, 3 ] 66030 7.127% 95.644% # ( 3, 4 ] 24099 2.601% 98.245% # ( 4, 6 ] 12361 1.334% 99.579% ( 6, 10 ] 3286 0.355% 99.934% ( 10, 15 ] 535 0.058% 99.992% ( 15, 22 ] 60 0.006% 99.998% ( 22, 34 ] 9 0.001% 99.999% ( 34, 51 ] 9 0.001% 100.000% ( 51, 76 ] 9 0.001% 100.001% ( 76, 110 ] 1 0.000% 100.001% ( 110, 170 ] 66 0.007% 100.008% ( 170, 250 ] 36 0.004% 100.012% ( 250, 380 ] 31 0.003% 100.016% ( 380, 580 ] 12 0.001% 100.017% ( 580, 870 ] 14 0.002% 100.018% ( 870, 1300 ] 9 0.001% 100.019% ( 1300, 1900 ] 7 0.001% 100.020% ( 1900, 2900 ] 6 0.001% 100.021% ( 2900, 4400 ] 5 0.001% 100.021% ( 4400, 6600 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 81649 Average: 2.4368 StdDev: 4.80 Min: 1 Median: 1.6537 Max: 853 Percentiles: P50: 1.65 P75: 2.15 P99: 5.91 P99.9: 10.58 P99.99: 14.66 ------------------------------------------------------ [ 0, 1 ] 6217 7.614% 7.614% ## ( 1, 2 ] 52943 64.842% 72.456% ############# ( 2, 3 ] 13677 16.751% 89.207% ### ( 3, 4 ] 4751 5.819% 95.026% # ( 4, 6 ] 3397 4.160% 99.187% # ( 6, 10 ] 572 0.701% 99.887% ( 10, 15 ] 90 0.110% 99.998% ( 15, 22 ] 11 0.013% 100.011% ( 22, 34 ] 2 0.002% 100.013% ( 34, 51 ] 1 0.001% 100.015% ( 110, 170 ] 1 0.001% 100.016% ( 170, 250 ] 1 0.001% 100.017% ( 250, 380 ] 1 0.001% 100.018% ( 380, 580 ] 3 0.004% 100.022% ( 580, 870 ] 2 0.002% 100.024% ** Level 2 read latency histogram (micros): Count: 95448 Average: 2.0946 StdDev: 13.81 Min: 0 Median: 1.3965 Max: 2618 Percentiles: P50: 1.40 P75: 1.80 P99: 5.30 P99.9: 9.94 P99.99: 606.40 ------------------------------------------------------ [ 0, 1 ] 24025 25.171% 25.171% ##### ( 1, 2 ] 59765 62.615% 87.786% ############# ( 2, 3 ] 7164 7.506% 95.292% ## ( 3, 4 ] 2586 2.709% 98.001% # ( 4, 6 ] 1465 1.535% 99.536% ( 6, 10 ] 353 0.370% 99.906% ( 10, 15 ] 61 0.064% 99.970% ( 15, 22 ] 9 0.009% 99.979% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 3 0.003% 99.985% ( 250, 380 ] 4 0.004% 99.990% ( 580, 870 ] 5 0.005% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57428 Average: 4.0766 StdDev: 60.50 Min: 0 Median: 1.6484 Max: 4403 Percentiles: P50: 1.65 P75: 2.14 P99: 6.25 P99.9: 211.15 P99.99: 2014.29 ------------------------------------------------------ [ 0, 1 ] 4637 8.074% 8.074% ## ( 1, 2 ] 37132 64.658% 72.733% ############# ( 2, 3 ] 9440 16.438% 89.171% ### ( 3, 4 ] 3301 5.748% 94.919% # ( 4, 6 ] 2318 4.036% 98.955% # ( 6, 10 ] 412 0.717% 99.673% ( 10, 15 ] 79 0.138% 99.810% ( 15, 22 ] 8 0.014% 99.824% ( 22, 34 ] 37 0.064% 99.889% ( 51, 76 ] 2 0.003% 99.892% ( 76, 110 ] 1 0.002% 99.894% ( 110, 170 ] 1 0.002% 99.896% ( 170, 250 ] 5 0.009% 99.904% ( 250, 380 ] 7 0.012% 99.916% ( 380, 580 ] 10 0.017% 99.934% ( 580, 870 ] 14 0.024% 99.958% ( 870, 1300 ] 8 0.014% 99.972% ( 1300, 1900 ] 9 0.016% 99.988% ( 1900, 2900 ] 11 0.019% 100.007% ( 2900, 4400 ] 7 0.012% 100.019% ( 4400, 6600 ] 1 0.002% 100.021% ** Level 4 read latency histogram (micros): Count: 15 Average: 1701.8000 StdDev: 908.31 Min: 726 Median: 1400.0000 Max: 3896 Percentiles: P50: 1400.00 P75: 2316.67 P99: 3896.00 P99.9: 3896.00 P99.99: 3896.00 ------------------------------------------------------ ( 580, 870 ] 2 13.333% 13.333% ### ( 870, 1300 ] 5 33.333% 46.667% ####### ( 1300, 1900 ] 3 20.000% 66.667% #### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 2900, 4400 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 560.4750 StdDev: 708.65 Min: 86 Median: 153.6364 Max: 2847 Percentiles: P50: 153.64 P75: 725.00 P99: 2766.67 P99.9: 2847.00 P99.99: 2847.00 ------------------------------------------------------ ( 76, 110 ] 12 30.000% 30.000% ###### ( 110, 170 ] 11 27.500% 57.500% ###### ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 4 10.000% 72.500% ## ( 580, 870 ] 2 5.000% 77.500% # ( 870, 1300 ] 2 5.000% 82.500% # ( 1300, 1900 ] 4 10.000% 92.500% ## ( 1900, 2900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 11.9 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 330.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.196 H:M:S, 10.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.395 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-19:52:35 ... thread 0: (1000000,5000000) ops and (134884.2,261118.9) ops/second in (7.413767,19.148367) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 4.05 GB 138.2 4.2 0.0 4.2 8.9 4.7 0.0 1.9 147.4 309.6 29.48 27.78 84 0.351 4412K 6034 0.0 0.0 L1 1/1 2.86 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.5 240.0 1.57 1.52 1 1.572 383K 627 0.0 0.0 L2 2/0 54.75 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.1 249.0 1.52 1.47 2 0.758 383K 201 0.0 0.0 L3 42/0 998.37 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.7 201.5 3.95 3.47 3 1.316 808K 832 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/17 100.80 GB 0.0 5.8 1.1 4.6 10.4 5.8 2.1 2.2 161.5 292.4 36.52 34.24 90 0.406 5989K 7694 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 1.1 4.6 10.4 5.8 2.1 2.2 161.5 292.4 36.52 34.24 90 0.406 5989K 7694 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 1.1 4.6 5.8 1.1 0.0 0.0 253.4 253.0 23.28 22.43 20 1.164 5989K 7694 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 361.8 13.23 11.81 70 0.189 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.3 total, 19.2 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.43 GB write, 552.91 MB/s write, 5.76 GB read, 305.41 MB/s read, 36.5 seconds Interval compaction: 10.43 GB write, 557.61 MB/s write, 5.76 GB read, 308.01 MB/s read, 36.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 10, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1822593 Average: 2.0993 StdDev: 11.69 Min: 1 Median: 1.4227 Max: 4444 Percentiles: P50: 1.42 P75: 1.80 P99: 5.25 P99.9: 9.66 P99.99: 17.23 ------------------------------------------------------ [ 0, 1 ] 406023 22.277% 22.277% #### ( 1, 2 ] 1195381 65.587% 87.864% ############# ( 2, 3 ] 136959 7.515% 95.379% ## ( 3, 4 ] 50604 2.776% 98.155% # ( 4, 6 ] 24652 1.353% 99.508% ( 6, 10 ] 7815 0.429% 99.936% ( 10, 15 ] 943 0.052% 99.988% ( 15, 22 ] 109 0.006% 99.994% ( 22, 34 ] 15 0.001% 99.995% ( 34, 51 ] 11 0.001% 99.996% ( 51, 76 ] 19 0.001% 99.997% ( 76, 110 ] 163 0.009% 100.006% ( 110, 170 ] 218 0.012% 100.018% ( 170, 250 ] 94 0.005% 100.023% ( 250, 380 ] 65 0.004% 100.026% ( 380, 580 ] 47 0.003% 100.029% ( 580, 870 ] 28 0.002% 100.030% ( 870, 1300 ] 26 0.001% 100.032% ( 1300, 1900 ] 9 0.000% 100.032% ( 1900, 2900 ] 9 0.000% 100.033% ( 2900, 4400 ] 6 0.000% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 81649 Average: 2.4368 StdDev: 4.80 Min: 1 Median: 1.6537 Max: 853 Percentiles: P50: 1.65 P75: 2.15 P99: 5.91 P99.9: 10.58 P99.99: 14.66 ------------------------------------------------------ [ 0, 1 ] 6217 7.614% 7.614% ## ( 1, 2 ] 52943 64.842% 72.456% ############# ( 2, 3 ] 13677 16.751% 89.207% ### ( 3, 4 ] 4751 5.819% 95.026% # ( 4, 6 ] 3397 4.160% 99.187% # ( 6, 10 ] 572 0.701% 99.887% ( 10, 15 ] 90 0.110% 99.998% ( 15, 22 ] 11 0.013% 100.011% ( 22, 34 ] 2 0.002% 100.013% ( 34, 51 ] 1 0.001% 100.015% ( 110, 170 ] 1 0.001% 100.016% ( 170, 250 ] 1 0.001% 100.017% ( 250, 380 ] 1 0.001% 100.018% ( 380, 580 ] 3 0.004% 100.022% ( 580, 870 ] 2 0.002% 100.024% ** Level 2 read latency histogram (micros): Count: 95448 Average: 2.0946 StdDev: 13.81 Min: 0 Median: 1.3965 Max: 2618 Percentiles: P50: 1.40 P75: 1.80 P99: 5.30 P99.9: 9.94 P99.99: 606.40 ------------------------------------------------------ [ 0, 1 ] 24025 25.171% 25.171% ##### ( 1, 2 ] 59765 62.615% 87.786% ############# ( 2, 3 ] 7164 7.506% 95.292% ## ( 3, 4 ] 2586 2.709% 98.001% # ( 4, 6 ] 1465 1.535% 99.536% ( 6, 10 ] 353 0.370% 99.906% ( 10, 15 ] 61 0.064% 99.970% ( 15, 22 ] 9 0.009% 99.979% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 3 0.003% 99.985% ( 250, 380 ] 4 0.004% 99.990% ( 580, 870 ] 5 0.005% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57428 Average: 4.0766 StdDev: 60.50 Min: 0 Median: 1.6484 Max: 4403 Percentiles: P50: 1.65 P75: 2.14 P99: 6.25 P99.9: 211.15 P99.99: 2014.29 ------------------------------------------------------ [ 0, 1 ] 4637 8.074% 8.074% ## ( 1, 2 ] 37132 64.658% 72.733% ############# ( 2, 3 ] 9440 16.438% 89.171% ### ( 3, 4 ] 3301 5.748% 94.919% # ( 4, 6 ] 2318 4.036% 98.955% # ( 6, 10 ] 412 0.717% 99.673% ( 10, 15 ] 79 0.138% 99.810% ( 15, 22 ] 8 0.014% 99.824% ( 22, 34 ] 37 0.064% 99.889% ( 51, 76 ] 2 0.003% 99.892% ( 76, 110 ] 1 0.002% 99.894% ( 110, 170 ] 1 0.002% 99.896% ( 170, 250 ] 5 0.009% 99.904% ( 250, 380 ] 7 0.012% 99.916% ( 380, 580 ] 10 0.017% 99.934% ( 580, 870 ] 14 0.024% 99.958% ( 870, 1300 ] 8 0.014% 99.972% ( 1300, 1900 ] 9 0.016% 99.988% ( 1900, 2900 ] 11 0.019% 100.007% ( 2900, 4400 ] 7 0.012% 100.019% ( 4400, 6600 ] 1 0.002% 100.021% ** Level 4 read latency histogram (micros): Count: 15 Average: 1701.8000 StdDev: 908.31 Min: 726 Median: 1400.0000 Max: 3896 Percentiles: P50: 1400.00 P75: 2316.67 P99: 3896.00 P99.9: 3896.00 P99.99: 3896.00 ------------------------------------------------------ ( 580, 870 ] 2 13.333% 13.333% ### ( 870, 1300 ] 5 33.333% 46.667% ####### ( 1300, 1900 ] 3 20.000% 66.667% #### ( 1900, 2900 ] 3 20.000% 86.667% #### ( 2900, 4400 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 560.4750 StdDev: 708.65 Min: 86 Median: 153.6364 Max: 2847 Percentiles: P50: 153.64 P75: 725.00 P99: 2766.67 P99.9: 2847.00 P99.99: 2847.00 ------------------------------------------------------ ( 76, 110 ] 12 30.000% 30.000% ###### ( 110, 170 ] 11 27.500% 57.500% ###### ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 4 10.000% 72.500% ## ( 580, 870 ] 2 5.000% 77.500% # ( 870, 1300 ] 2 5.000% 82.500% # ( 1300, 1900 ] 4 10.000% 92.500% ## ( 1900, 2900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 19.3 total, 7.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 254.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.891 H:M:S, 30.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 132.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.696 H:M:S, 63.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-19:52:39 ... thread 0: (1000000,6000000) ops and (256256.4,260295.7) ops/second in (3.902342,23.050709) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 2.58 GB 25.2 5.0 0.0 5.0 10.6 5.7 0.0 1.9 145.4 310.4 35.09 33.03 102 0.344 5180K 6723 0.0 0.0 L1 13/13 1.43 GB 0.0 2.8 2.8 0.0 2.8 2.8 0.2 1.0 229.3 226.9 12.64 12.23 2 6.320 2943K 30K 0.0 0.0 L2 2/0 54.75 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.4 2.0 249.1 249.0 1.52 1.47 2 0.758 383K 201 0.0 0.0 L3 14/0 926.59 MB 0.9 0.8 0.6 0.2 0.8 0.6 1.1 1.4 201.7 201.5 3.95 3.47 3 1.316 808K 832 0.0 0.0 L4 167/0 9.62 GB 1.0 0.2 0.1 0.0 0.2 0.1 1.6 1.3 215.7 214.6 0.78 0.70 1 0.777 170K 852 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/25 101.76 GB 0.0 9.1 3.7 5.4 14.7 9.3 6.0 2.6 173.1 279.8 53.97 50.90 110 0.491 9485K 38K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.1 3.7 5.4 14.7 9.3 6.0 2.6 173.1 279.8 53.97 50.90 110 0.491 9485K 38K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.1 3.7 5.4 9.1 3.7 0.0 0.0 246.4 245.4 37.92 36.57 25 1.517 9485K 38K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 361.0 16.05 14.33 85 0.189 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.2 total, 23.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.74 GB write, 650.39 MB/s write, 9.12 GB read, 402.42 MB/s read, 54.0 seconds Interval compaction: 14.74 GB write, 654.97 MB/s write, 9.12 GB read, 405.26 MB/s read, 54.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 12, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2190160 Average: 2.1320 StdDev: 12.23 Min: 1 Median: 1.4249 Max: 4444 Percentiles: P50: 1.42 P75: 1.81 P99: 5.32 P99.9: 9.79 P99.99: 86.21 ------------------------------------------------------ [ 0, 1 ] 483804 22.090% 22.090% #### ( 1, 2 ] 1438550 65.682% 87.772% ############# ( 2, 3 ] 165566 7.560% 95.332% ## ( 3, 4 ] 60566 2.765% 98.097% # ( 4, 6 ] 29937 1.367% 99.464% ( 6, 10 ] 10088 0.461% 99.925% ( 10, 15 ] 1178 0.054% 99.978% ( 15, 22 ] 132 0.006% 99.985% ( 22, 34 ] 19 0.001% 99.985% ( 34, 51 ] 12 0.001% 99.986% ( 51, 76 ] 27 0.001% 99.987% ( 76, 110 ] 213 0.010% 99.997% ( 110, 170 ] 348 0.016% 100.013% ( 170, 250 ] 157 0.007% 100.020% ( 250, 380 ] 93 0.004% 100.024% ( 380, 580 ] 95 0.004% 100.029% ( 580, 870 ] 52 0.002% 100.031% ( 870, 1300 ] 32 0.001% 100.032% ( 1300, 1900 ] 12 0.001% 100.033% ( 1900, 2900 ] 10 0.000% 100.033% ( 2900, 4400 ] 8 0.000% 100.034% ( 4400, 6600 ] 1 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 115183 Average: 2.7091 StdDev: 17.58 Min: 1 Median: 1.6114 Max: 1714 Percentiles: P50: 1.61 P75: 1.99 P99: 5.86 P99.9: 14.79 P99.99: 536.02 ------------------------------------------------------ [ 0, 1 ] 10962 9.517% 9.517% ## ( 1, 2 ] 76270 66.216% 75.733% ############# ( 2, 3 ] 17457 15.156% 90.889% ### ( 3, 4 ] 5710 4.957% 95.847% # ( 4, 6 ] 3905 3.390% 99.237% # ( 6, 10 ] 668 0.580% 99.817% ( 10, 15 ] 100 0.087% 99.904% ( 15, 22 ] 12 0.010% 99.914% ( 22, 34 ] 2 0.002% 99.916% ( 34, 51 ] 1 0.001% 99.917% ( 76, 110 ] 36 0.031% 99.948% ( 110, 170 ] 17 0.015% 99.963% ( 170, 250 ] 8 0.007% 99.970% ( 250, 380 ] 11 0.010% 99.979% ( 380, 580 ] 16 0.014% 99.993% ( 580, 870 ] 12 0.010% 100.003% ( 870, 1300 ] 12 0.010% 100.014% ( 1300, 1900 ] 4 0.003% 100.017% ** Level 2 read latency histogram (micros): Count: 95448 Average: 2.0946 StdDev: 13.81 Min: 0 Median: 1.3965 Max: 2618 Percentiles: P50: 1.40 P75: 1.80 P99: 5.30 P99.9: 9.94 P99.99: 606.40 ------------------------------------------------------ [ 0, 1 ] 24025 25.171% 25.171% ##### ( 1, 2 ] 59765 62.615% 87.786% ############# ( 2, 3 ] 7164 7.506% 95.292% ## ( 3, 4 ] 2586 2.709% 98.001% # ( 4, 6 ] 1465 1.535% 99.536% ( 6, 10 ] 353 0.370% 99.906% ( 10, 15 ] 61 0.064% 99.970% ( 15, 22 ] 9 0.009% 99.979% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 3 0.003% 99.985% ( 250, 380 ] 4 0.004% 99.990% ( 580, 870 ] 5 0.005% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 67259 Average: 4.5494 StdDev: 59.02 Min: 0 Median: 1.6189 Max: 4403 Percentiles: P50: 1.62 P75: 2.02 P99: 8.44 P99.9: 481.55 P99.99: 2006.17 ------------------------------------------------------ [ 0, 1 ] 6679 9.930% 9.930% ## ( 1, 2 ] 43548 64.747% 74.677% ############# ( 2, 3 ] 10077 14.982% 89.659% ### ( 3, 4 ] 3538 5.260% 94.920% # ( 4, 6 ] 2412 3.586% 98.506% # ( 6, 10 ] 546 0.812% 99.318% ( 10, 15 ] 90 0.134% 99.451% ( 15, 22 ] 8 0.012% 99.463% ( 22, 34 ] 37 0.055% 99.518% ( 51, 76 ] 17 0.025% 99.544% ( 76, 110 ] 98 0.146% 99.689% ( 110, 170 ] 67 0.100% 99.789% ( 170, 250 ] 32 0.048% 99.836% ( 250, 380 ] 27 0.040% 99.877% ( 380, 580 ] 31 0.046% 99.923% ( 580, 870 ] 24 0.036% 99.958% ( 870, 1300 ] 11 0.016% 99.975% ( 1300, 1900 ] 9 0.013% 99.988% ( 1900, 2900 ] 12 0.018% 100.006% ( 2900, 4400 ] 7 0.010% 100.016% ( 4400, 6600 ] 1 0.001% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 788.9143 StdDev: 1001.12 Min: 1 Median: 210.0000 Max: 3896 Percentiles: P50: 210.00 P75: 1235.50 P99: 3896.00 P99.9: 3896.00 P99.99: 3896.00 ------------------------------------------------------ [ 0, 1 ] 7 20.000% 20.000% #### ( 1, 2 ] 5 14.286% 34.286% ### ( 15, 22 ] 1 2.857% 37.143% # ( 76, 110 ] 1 2.857% 40.000% # ( 110, 170 ] 3 8.571% 48.571% ## ( 170, 250 ] 1 2.857% 51.429% # ( 380, 580 ] 1 2.857% 54.286% # ( 580, 870 ] 3 8.571% 62.857% ## ( 870, 1300 ] 5 14.286% 77.143% ### ( 1300, 1900 ] 3 8.571% 85.714% ## ( 1900, 2900 ] 3 8.571% 94.286% ## ( 2900, 4400 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 100 Average: 617.7300 StdDev: 776.84 Min: 83 Median: 170.0000 Max: 2867 Percentiles: P50: 170.00 P75: 870.00 P99: 2788.89 P99.9: 2867.00 P99.99: 2867.00 ------------------------------------------------------ ( 76, 110 ] 26 26.000% 26.000% ##### ( 110, 170 ] 24 24.000% 50.000% ##### ( 170, 250 ] 5 5.000% 55.000% # ( 250, 380 ] 7 7.000% 62.000% # ( 380, 580 ] 7 7.000% 69.000% # ( 580, 870 ] 6 6.000% 75.000% # ( 870, 1300 ] 6 6.000% 81.000% # ( 1300, 1900 ] 10 10.000% 91.000% ## ( 1900, 2900 ] 9 9.000% 100.000% ## ** DB Stats ** Uptime(secs): 23.2 total, 3.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 254.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.119 H:M:S, 30.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 252.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.228 H:M:S, 31.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-19:52:42 ... thread 0: (1000000,7000000) ops and (329726.8,268368.7) ops/second in (3.032814,26.083523) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 3.50 GB 119.6 5.8 0.0 5.8 12.4 6.6 0.0 1.9 145.4 308.9 41.17 38.74 118 0.349 6076K 7681 0.0 0.0 L1 13/13 1.43 GB 0.0 2.8 2.8 0.0 2.8 2.8 0.2 1.0 229.3 226.9 12.64 12.23 2 6.320 2943K 30K 0.0 0.0 L2 2/0 54.75 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.4 2.0 249.1 249.0 1.52 1.47 2 0.758 383K 201 0.0 0.0 L3 14/0 926.59 MB 0.9 0.8 0.6 0.2 0.8 0.6 1.1 1.4 201.7 201.5 3.95 3.47 3 1.316 808K 832 0.0 0.0 L4 167/0 9.62 GB 1.0 0.2 0.1 0.0 0.2 0.1 1.6 1.3 215.7 214.6 0.78 0.70 1 0.777 170K 852 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/25 102.68 GB 0.0 10.0 3.7 6.3 16.5 10.2 6.0 2.5 170.3 281.9 60.05 56.61 126 0.477 10M 39K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.0 3.7 6.3 16.5 10.2 6.0 2.5 170.3 281.9 60.05 56.61 126 0.477 10M 39K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.0 3.7 6.3 9.9 3.7 0.0 0.0 247.6 246.6 41.30 39.86 28 1.475 10M 39K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 359.5 18.75 16.75 98 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.2 total, 26.1 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.53 GB write, 644.80 MB/s write, 9.98 GB read, 389.52 MB/s read, 60.0 seconds Interval compaction: 16.53 GB write, 648.82 MB/s write, 9.98 GB read, 391.95 MB/s read, 60.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 15, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2576475 Average: 2.1422 StdDev: 12.01 Min: 0 Median: 1.4395 Max: 4444 Percentiles: P50: 1.44 P75: 1.82 P99: 5.37 P99.9: 9.69 P99.99: 14.93 ------------------------------------------------------ [ 0, 1 ] 539383 20.935% 20.935% #### ( 1, 2 ] 1704002 66.137% 87.072% ############# ( 2, 3 ] 206989 8.034% 95.106% ## ( 3, 4 ] 74788 2.903% 98.008% # ( 4, 6 ] 37213 1.444% 99.453% ( 6, 10 ] 12506 0.485% 99.938% ( 10, 15 ] 1356 0.053% 99.991% ( 15, 22 ] 146 0.006% 99.996% ( 22, 34 ] 25 0.001% 99.997% ( 34, 51 ] 13 0.001% 99.998% ( 51, 76 ] 29 0.001% 99.999% ( 76, 110 ] 213 0.008% 100.007% ( 110, 170 ] 354 0.014% 100.021% ( 170, 250 ] 165 0.006% 100.027% ( 250, 380 ] 101 0.004% 100.031% ( 380, 580 ] 97 0.004% 100.035% ( 580, 870 ] 57 0.002% 100.037% ( 870, 1300 ] 35 0.001% 100.039% ( 1300, 1900 ] 12 0.000% 100.039% ( 1900, 2900 ] 12 0.000% 100.040% ( 2900, 4400 ] 10 0.000% 100.040% ( 4400, 6600 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 142628 Average: 2.7143 StdDev: 16.92 Min: 1 Median: 1.6040 Max: 1714 Percentiles: P50: 1.60 P75: 1.98 P99: 5.98 P99.9: 82.90 P99.99: 558.45 ------------------------------------------------------ [ 0, 1 ] 14036 9.841% 9.841% ## ( 1, 2 ] 94838 66.493% 76.334% ############# ( 2, 3 ] 21210 14.871% 91.205% ### ( 3, 4 ] 6665 4.673% 95.878% # ( 4, 6 ] 4499 3.154% 99.032% # ( 6, 10 ] 1073 0.752% 99.785% ( 10, 15 ] 128 0.090% 99.874% ( 15, 22 ] 17 0.012% 99.886% ( 22, 34 ] 2 0.001% 99.888% ( 34, 51 ] 1 0.001% 99.889% ( 51, 76 ] 4 0.003% 99.891% ( 76, 110 ] 61 0.043% 99.934% ( 110, 170 ] 26 0.018% 99.952% ( 170, 250 ] 17 0.012% 99.964% ( 250, 380 ] 18 0.013% 99.977% ( 380, 580 ] 21 0.015% 99.992% ( 580, 870 ] 15 0.011% 100.002% ( 870, 1300 ] 13 0.009% 100.011% ( 1300, 1900 ] 4 0.003% 100.014% ** Level 2 read latency histogram (micros): Count: 95448 Average: 2.0946 StdDev: 13.81 Min: 0 Median: 1.3965 Max: 2618 Percentiles: P50: 1.40 P75: 1.80 P99: 5.30 P99.9: 9.94 P99.99: 606.40 ------------------------------------------------------ [ 0, 1 ] 24025 25.171% 25.171% ##### ( 1, 2 ] 59765 62.615% 87.786% ############# ( 2, 3 ] 7164 7.506% 95.292% ## ( 3, 4 ] 2586 2.709% 98.001% # ( 4, 6 ] 1465 1.535% 99.536% ( 6, 10 ] 353 0.370% 99.906% ( 10, 15 ] 61 0.064% 99.970% ( 15, 22 ] 9 0.009% 99.979% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 3 0.003% 99.985% ( 250, 380 ] 4 0.004% 99.990% ( 580, 870 ] 5 0.005% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 67259 Average: 4.5494 StdDev: 59.02 Min: 0 Median: 1.6189 Max: 4403 Percentiles: P50: 1.62 P75: 2.02 P99: 8.44 P99.9: 481.55 P99.99: 2006.17 ------------------------------------------------------ [ 0, 1 ] 6679 9.930% 9.930% ## ( 1, 2 ] 43548 64.747% 74.677% ############# ( 2, 3 ] 10077 14.982% 89.659% ### ( 3, 4 ] 3538 5.260% 94.920% # ( 4, 6 ] 2412 3.586% 98.506% # ( 6, 10 ] 546 0.812% 99.318% ( 10, 15 ] 90 0.134% 99.451% ( 15, 22 ] 8 0.012% 99.463% ( 22, 34 ] 37 0.055% 99.518% ( 51, 76 ] 17 0.025% 99.544% ( 76, 110 ] 98 0.146% 99.689% ( 110, 170 ] 67 0.100% 99.789% ( 170, 250 ] 32 0.048% 99.836% ( 250, 380 ] 27 0.040% 99.877% ( 380, 580 ] 31 0.046% 99.923% ( 580, 870 ] 24 0.036% 99.958% ( 870, 1300 ] 11 0.016% 99.975% ( 1300, 1900 ] 9 0.013% 99.988% ( 1900, 2900 ] 12 0.018% 100.006% ( 2900, 4400 ] 7 0.010% 100.016% ( 4400, 6600 ] 1 0.001% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 788.9143 StdDev: 1001.12 Min: 1 Median: 210.0000 Max: 3896 Percentiles: P50: 210.00 P75: 1235.50 P99: 3896.00 P99.9: 3896.00 P99.99: 3896.00 ------------------------------------------------------ [ 0, 1 ] 7 20.000% 20.000% #### ( 1, 2 ] 5 14.286% 34.286% ### ( 15, 22 ] 1 2.857% 37.143% # ( 76, 110 ] 1 2.857% 40.000% # ( 110, 170 ] 3 8.571% 48.571% ## ( 170, 250 ] 1 2.857% 51.429% # ( 380, 580 ] 1 2.857% 54.286% # ( 580, 870 ] 3 8.571% 62.857% ## ( 870, 1300 ] 5 14.286% 77.143% ### ( 1300, 1900 ] 3 8.571% 85.714% ## ( 1900, 2900 ] 3 8.571% 94.286% ## ( 2900, 4400 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 100 Average: 617.7300 StdDev: 776.84 Min: 83 Median: 170.0000 Max: 2867 Percentiles: P50: 170.00 P75: 870.00 P99: 2788.89 P99.9: 2867.00 P99.99: 2867.00 ------------------------------------------------------ ( 76, 110 ] 26 26.000% 26.000% ##### ( 110, 170 ] 24 24.000% 50.000% ##### ( 170, 250 ] 5 5.000% 55.000% # ( 250, 380 ] 7 7.000% 62.000% # ( 380, 580 ] 7 7.000% 69.000% # ( 580, 870 ] 6 6.000% 75.000% # ( 870, 1300 ] 6 6.000% 81.000% # ( 1300, 1900 ] 10 10.000% 91.000% ## ( 1900, 2900 ] 9 9.000% 100.000% ## ** DB Stats ** Uptime(secs): 26.2 total, 3.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 262.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.499 H:M:S, 28.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.380 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-19:52:57 ... thread 0: (1000000,8000000) ops and (64911.5,192821.7) ops/second in (15.405588,41.489111) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 2.51 GB 31.5 8.3 0.0 8.3 15.9 7.6 0.0 2.1 151.9 291.1 55.98 51.20 135 0.415 8632K 19K 0.0 0.0 L1 12/12 1.39 GB 0.0 6.3 4.9 1.4 6.2 4.8 0.2 1.3 223.8 221.1 28.75 27.25 3 9.583 6511K 55K 0.0 0.0 L2 2/2 257.55 MB 0.0 0.4 0.2 0.2 0.4 0.2 3.4 2.0 249.1 249.0 1.52 1.47 2 0.758 383K 201 0.0 0.0 L3 30/13 1.64 GB 1.0 2.5 1.2 1.2 2.4 1.2 2.2 2.0 162.5 161.6 15.52 11.50 9 1.724 2560K 13K 0.0 0.0 L4 167/5 9.70 GB 1.0 1.4 1.2 0.2 1.4 1.2 1.6 1.2 137.4 136.7 10.52 6.54 13 0.809 1418K 5468 0.0 0.0 L5 1072/0 88.15 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/39 103.65 GB 0.0 18.8 7.5 11.4 26.3 15.0 10.1 3.5 171.7 240.2 112.29 97.97 162 0.693 19M 94K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.8 7.5 11.4 26.3 15.0 10.1 3.5 171.7 240.2 112.29 97.97 162 0.693 19M 94K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.8 7.5 11.4 18.7 7.4 0.0 0.0 216.8 215.4 88.95 78.32 51 1.744 19M 94K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 334.8 23.33 19.64 111 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.7 total, 41.5 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.34 GB write, 647.50 MB/s write, 18.83 GB read, 462.84 MB/s read, 112.3 seconds Interval compaction: 26.34 GB write, 650.04 MB/s write, 18.83 GB read, 464.65 MB/s read, 112.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 32, interval: 53 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3649168 Average: 2.6000 StdDev: 24.77 Min: 0 Median: 1.4668 Max: 9029 Percentiles: P50: 1.47 P75: 1.85 P99: 5.92 P99.9: 115.67 P99.99: 216.44 ------------------------------------------------------ [ 0, 1 ] 716012 19.621% 19.621% #### ( 1, 2 ] 2374745 65.076% 84.698% ############# ( 2, 3 ] 325727 8.926% 93.624% ## ( 3, 4 ] 123691 3.390% 97.013% # ( 4, 6 ] 75473 2.068% 99.081% ( 6, 10 ] 23653 0.648% 99.730% ( 10, 15 ] 2827 0.077% 99.807% ( 15, 22 ] 379 0.010% 99.817% ( 22, 34 ] 33 0.001% 99.818% ( 34, 51 ] 20 0.001% 99.819% ( 51, 76 ] 44 0.001% 99.820% ( 76, 110 ] 2617 0.072% 99.892% ( 110, 170 ] 3149 0.086% 99.978% ( 170, 250 ] 746 0.020% 99.999% ( 250, 380 ] 546 0.015% 100.014% ( 380, 580 ] 415 0.011% 100.025% ( 580, 870 ] 216 0.006% 100.031% ( 870, 1300 ] 83 0.002% 100.033% ( 1300, 1900 ] 48 0.001% 100.034% ( 1900, 2900 ] 42 0.001% 100.036% ( 2900, 4400 ] 59 0.002% 100.037% ( 4400, 6600 ] 13 0.000% 100.038% ( 6600, 9900 ] 6 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 1047638 Average: 4.4271 StdDev: 64.63 Min: 1 Median: 1.7016 Max: 11208 Percentiles: P50: 1.70 P75: 2.45 P99: 8.71 P99.9: 88.26 P99.99: 141.97 ------------------------------------------------------ [ 0, 1 ] 97246 9.282% 9.282% ## ( 1, 2 ] 607997 58.035% 67.317% ############ ( 2, 3 ] 178034 16.994% 84.311% ### ( 3, 4 ] 75026 7.161% 91.473% # ( 4, 6 ] 66161 6.315% 97.788% # ( 6, 10 ] 18745 1.789% 99.577% ( 10, 15 ] 2617 0.250% 99.827% ( 15, 22 ] 398 0.038% 99.865% ( 22, 34 ] 30 0.003% 99.868% ( 34, 51 ] 7 0.001% 99.869% ( 51, 76 ] 33 0.003% 99.872% ( 76, 110 ] 822 0.078% 99.950% ( 110, 170 ] 783 0.075% 100.025% ( 170, 250 ] 282 0.027% 100.052% ( 250, 380 ] 287 0.027% 100.079% ( 380, 580 ] 369 0.035% 100.114% ( 580, 870 ] 302 0.029% 100.143% ( 870, 1300 ] 182 0.017% 100.161% ( 1300, 1900 ] 99 0.009% 100.170% ( 1900, 2900 ] 96 0.009% 100.179% ( 2900, 4400 ] 122 0.012% 100.191% ( 4400, 6600 ] 34 0.003% 100.194% ( 6600, 9900 ] 7 0.001% 100.195% ( 9900, 14000 ] 2 0.000% 100.195% ** Level 2 read latency histogram (micros): Count: 95448 Average: 2.0946 StdDev: 13.81 Min: 0 Median: 1.3965 Max: 2618 Percentiles: P50: 1.40 P75: 1.80 P99: 5.30 P99.9: 9.94 P99.99: 606.40 ------------------------------------------------------ [ 0, 1 ] 24025 25.171% 25.171% ##### ( 1, 2 ] 59765 62.615% 87.786% ############# ( 2, 3 ] 7164 7.506% 95.292% ## ( 3, 4 ] 2586 2.709% 98.001% # ( 4, 6 ] 1465 1.535% 99.536% ( 6, 10 ] 353 0.370% 99.906% ( 10, 15 ] 61 0.064% 99.970% ( 15, 22 ] 9 0.009% 99.979% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 3 0.003% 99.985% ( 250, 380 ] 4 0.004% 99.990% ( 580, 870 ] 5 0.005% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 347544 Average: 8.1111 StdDev: 96.34 Min: 0 Median: 1.8688 Max: 7907 Percentiles: P50: 1.87 P75: 2.81 P99: 9.37 P99.9: 486.49 P99.99: 638.55 ------------------------------------------------------ [ 0, 1 ] 11775 3.388% 3.388% # ( 1, 2 ] 186471 53.654% 57.042% ########### ( 2, 3 ] 77165 22.203% 79.245% #### ( 3, 4 ] 34691 9.982% 89.227% ## ( 4, 6 ] 29502 8.489% 97.715% ## ( 6, 10 ] 5299 1.525% 99.240% ( 10, 15 ] 868 0.250% 99.490% ( 15, 22 ] 88 0.025% 99.515% ( 22, 34 ] 43 0.012% 99.528% ( 34, 51 ] 6 0.002% 99.529% ( 51, 76 ] 21 0.006% 99.535% ( 76, 110 ] 149 0.043% 99.578% ( 110, 170 ] 216 0.062% 99.640% ( 170, 250 ] 247 0.071% 99.711% ( 250, 380 ] 402 0.116% 99.827% ( 380, 580 ] 476 0.137% 99.964% ( 580, 870 ] 447 0.129% 100.093% ( 870, 1300 ] 274 0.079% 100.171% ( 1300, 1900 ] 97 0.028% 100.199% ( 1900, 2900 ] 93 0.027% 100.226% ( 2900, 4400 ] 96 0.028% 100.254% ( 4400, 6600 ] 14 0.004% 100.258% ( 6600, 9900 ] 3 0.001% 100.259% ** Level 4 read latency histogram (micros): Count: 190 Average: 311.7263 StdDev: 662.34 Min: 1 Median: 2.8571 Max: 3896 Percentiles: P50: 2.86 P75: 207.50 P99: 3450.00 P99.9: 3896.00 P99.99: 3896.00 ------------------------------------------------------ [ 0, 1 ] 21 11.053% 11.053% ## ( 1, 2 ] 56 29.474% 40.526% ###### ( 2, 3 ] 21 11.053% 51.579% ## ( 3, 4 ] 7 3.684% 55.263% # ( 4, 6 ] 3 1.579% 56.842% ( 6, 10 ] 3 1.579% 58.421% ( 10, 15 ] 4 2.105% 60.526% ( 15, 22 ] 3 1.579% 62.105% ( 22, 34 ] 2 1.053% 63.158% ( 34, 51 ] 2 1.053% 64.211% ( 51, 76 ] 4 2.105% 66.316% ( 76, 110 ] 5 2.632% 68.947% # ( 110, 170 ] 4 2.105% 71.053% ( 170, 250 ] 16 8.421% 79.474% ## ( 250, 380 ] 1 0.526% 80.000% ( 380, 580 ] 2 1.053% 81.053% ( 580, 870 ] 9 4.737% 85.789% # ( 870, 1300 ] 10 5.263% 91.053% # ( 1300, 1900 ] 9 4.737% 95.789% # ( 1900, 2900 ] 5 2.632% 98.421% # ( 2900, 4400 ] 3 1.579% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 831.2750 StdDev: 940.81 Min: 82 Median: 402.2222 Max: 3679 Percentiles: P50: 402.22 P75: 1257.00 P99: 3679.00 P99.9: 3679.00 P99.99: 3679.00 ------------------------------------------------------ ( 76, 110 ] 29 18.125% 18.125% #### ( 110, 170 ] 25 15.625% 33.750% ### ( 170, 250 ] 9 5.625% 39.375% # ( 250, 380 ] 15 9.375% 48.750% ## ( 380, 580 ] 18 11.250% 60.000% ## ( 580, 870 ] 15 9.375% 69.375% ## ( 870, 1300 ] 10 6.250% 75.625% # ( 1300, 1900 ] 13 8.125% 83.750% ## ( 1900, 2900 ] 22 13.750% 97.500% ### ( 2900, 4400 ] 4 2.500% 100.000% # ** DB Stats ** Uptime(secs): 41.7 total, 15.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 189.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.795 H:M:S, 47.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 63.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.296 H:M:S, 79.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/11/28-19:53:01 ... thread 0: (1000000,9000000) ops and (276689.0,199542.0) ops/second in (3.614166,45.103277) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 3.37 GB 100.7 9.0 0.0 9.0 17.4 8.5 0.0 2.1 148.6 288.8 61.87 56.12 149 0.415 9336K 20K 0.0 0.0 L1 12/12 1.39 GB 0.0 6.3 4.9 1.4 6.2 4.8 0.2 1.3 223.8 221.1 28.75 27.25 3 9.583 6511K 55K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.4 2.0 249.1 249.0 1.52 1.47 2 0.758 383K 201 0.0 0.0 L3 18/0 946.15 MB 0.9 3.1 1.5 1.6 3.0 1.5 2.2 2.0 163.6 162.6 19.17 14.32 11 1.742 3184K 19K 0.0 0.0 L4 169/0 9.61 GB 1.0 2.5 2.2 0.4 2.5 2.1 1.6 1.2 147.9 147.1 17.36 11.73 27 0.643 2557K 11K 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/23 104.50 GB 0.0 21.2 8.7 12.5 29.6 17.0 11.2 3.5 168.7 235.3 128.66 110.89 192 0.670 21M 107K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.2 8.7 12.5 29.6 17.0 11.2 3.5 168.7 235.3 128.66 110.89 192 0.670 21M 107K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.2 8.7 12.5 21.1 8.6 0.0 0.0 212.4 211.1 102.22 88.98 69 1.481 21M 107K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 328.8 26.44 21.91 123 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.3 total, 45.1 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.56 GB write, 668.71 MB/s write, 21.20 GB read, 479.59 MB/s read, 128.7 seconds Interval compaction: 29.56 GB write, 671.12 MB/s write, 21.20 GB read, 481.32 MB/s read, 128.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 43, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4053603 Average: 2.6432 StdDev: 27.99 Min: 0 Median: 1.4861 Max: 11227 Percentiles: P50: 1.49 P75: 1.87 P99: 5.97 P99.9: 107.77 P99.99: 200.13 ------------------------------------------------------ [ 0, 1 ] 751393 18.536% 18.536% #### ( 1, 2 ] 2623821 64.728% 83.265% ############# ( 2, 3 ] 393371 9.704% 92.969% ## ( 3, 4 ] 149051 3.677% 96.646% # ( 4, 6 ] 96793 2.388% 99.034% ( 6, 10 ] 28648 0.707% 99.740% ( 10, 15 ] 3423 0.084% 99.825% ( 15, 22 ] 447 0.011% 99.836% ( 22, 34 ] 43 0.001% 99.837% ( 34, 51 ] 21 0.001% 99.837% ( 51, 76 ] 53 0.001% 99.839% ( 76, 110 ] 2661 0.066% 99.904% ( 110, 170 ] 3184 0.079% 99.983% ( 170, 250 ] 769 0.019% 100.002% ( 250, 380 ] 562 0.014% 100.016% ( 380, 580 ] 431 0.011% 100.026% ( 580, 870 ] 232 0.006% 100.032% ( 870, 1300 ] 91 0.002% 100.034% ( 1300, 1900 ] 52 0.001% 100.036% ( 1900, 2900 ] 49 0.001% 100.037% ( 2900, 4400 ] 79 0.002% 100.039% ( 4400, 6600 ] 23 0.001% 100.039% ( 6600, 9900 ] 10 0.000% 100.040% ( 9900, 14000 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 1098192 Average: 4.4026 StdDev: 64.38 Min: 1 Median: 1.7059 Max: 11208 Percentiles: P50: 1.71 P75: 2.46 P99: 8.72 P99.9: 88.78 P99.99: 144.42 ------------------------------------------------------ [ 0, 1 ] 99216 9.034% 9.034% ## ( 1, 2 ] 637271 58.029% 67.064% ############ ( 2, 3 ] 188246 17.141% 84.205% ### ( 3, 4 ] 79122 7.205% 91.410% # ( 4, 6 ] 69837 6.359% 97.769% # ( 6, 10 ] 19851 1.808% 99.577% ( 10, 15 ] 2743 0.250% 99.826% ( 15, 22 ] 411 0.037% 99.864% ( 22, 34 ] 35 0.003% 99.867% ( 34, 51 ] 8 0.001% 99.868% ( 51, 76 ] 34 0.003% 99.871% ( 76, 110 ] 851 0.077% 99.948% ( 110, 170 ] 797 0.073% 100.021% ( 170, 250 ] 292 0.027% 100.048% ( 250, 380 ] 292 0.027% 100.074% ( 380, 580 ] 374 0.034% 100.108% ( 580, 870 ] 303 0.028% 100.136% ( 870, 1300 ] 184 0.017% 100.153% ( 1300, 1900 ] 100 0.009% 100.162% ( 1900, 2900 ] 100 0.009% 100.171% ( 2900, 4400 ] 128 0.012% 100.182% ( 4400, 6600 ] 37 0.003% 100.186% ( 6600, 9900 ] 7 0.001% 100.186% ( 9900, 14000 ] 2 0.000% 100.187% ** Level 2 read latency histogram (micros): Count: 95448 Average: 2.0946 StdDev: 13.81 Min: 0 Median: 1.3965 Max: 2618 Percentiles: P50: 1.40 P75: 1.80 P99: 5.30 P99.9: 9.94 P99.99: 606.40 ------------------------------------------------------ [ 0, 1 ] 24025 25.171% 25.171% ##### ( 1, 2 ] 59765 62.615% 87.786% ############# ( 2, 3 ] 7164 7.506% 95.292% ## ( 3, 4 ] 2586 2.709% 98.001% # ( 4, 6 ] 1465 1.535% 99.536% ( 6, 10 ] 353 0.370% 99.906% ( 10, 15 ] 61 0.064% 99.970% ( 15, 22 ] 9 0.009% 99.979% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 3 0.003% 99.985% ( 250, 380 ] 4 0.004% 99.990% ( 580, 870 ] 5 0.005% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 664116 Average: 6.2459 StdDev: 78.49 Min: 0 Median: 1.9148 Max: 11337 Percentiles: P50: 1.91 P75: 2.89 P99: 8.53 P99.9: 78.37 P99.99: 185.04 ------------------------------------------------------ [ 0, 1 ] 16404 2.470% 2.470% ( 1, 2 ] 345063 51.958% 54.428% ########## ( 2, 3 ] 152849 23.015% 77.444% ##### ( 3, 4 ] 72283 10.884% 88.328% ## ( 4, 6 ] 63948 9.629% 97.957% ## ( 6, 10 ] 10941 1.647% 99.604% ( 10, 15 ] 1678 0.253% 99.857% ( 15, 22 ] 188 0.028% 99.885% ( 22, 34 ] 53 0.008% 99.893% ( 34, 51 ] 6 0.001% 99.894% ( 51, 76 ] 26 0.004% 99.898% ( 76, 110 ] 185 0.028% 99.926% ( 110, 170 ] 353 0.053% 99.979% ( 170, 250 ] 386 0.058% 100.037% ( 250, 380 ] 527 0.079% 100.117% ( 380, 580 ] 602 0.091% 100.207% ( 580, 870 ] 518 0.078% 100.285% ( 870, 1300 ] 309 0.047% 100.332% ( 1300, 1900 ] 106 0.016% 100.348% ( 1900, 2900 ] 106 0.016% 100.364% ( 2900, 4400 ] 115 0.017% 100.381% ( 4400, 6600 ] 18 0.003% 100.384% ( 6600, 9900 ] 7 0.001% 100.385% ( 9900, 14000 ] 1 0.000% 100.385% ** Level 4 read latency histogram (micros): Count: 330 Average: 255.0667 StdDev: 576.10 Min: 0 Median: 2.5714 Max: 3896 Percentiles: P50: 2.57 P75: 182.00 P99: 2850.00 P99.9: 3896.00 P99.99: 3896.00 ------------------------------------------------------ [ 0, 1 ] 45 13.636% 13.636% ### ( 1, 2 ] 100 30.303% 43.939% ###### ( 2, 3 ] 35 10.606% 54.545% ## ( 3, 4 ] 9 2.727% 57.273% # ( 4, 6 ] 4 1.212% 58.485% ( 6, 10 ] 5 1.515% 60.000% ( 10, 15 ] 8 2.424% 62.424% ( 15, 22 ] 5 1.515% 63.939% ( 22, 34 ] 3 0.909% 64.848% ( 34, 51 ] 3 0.909% 65.758% ( 51, 76 ] 16 4.848% 70.606% # ( 76, 110 ] 5 1.515% 72.121% ( 110, 170 ] 5 1.515% 73.636% ( 170, 250 ] 30 9.091% 82.727% ## ( 250, 380 ] 1 0.303% 83.030% ( 380, 580 ] 3 0.909% 83.939% ( 580, 870 ] 12 3.636% 87.576% # ( 870, 1300 ] 19 5.758% 93.333% # ( 1300, 1900 ] 13 3.939% 97.273% # ( 1900, 2900 ] 6 1.818% 99.091% ( 2900, 4400 ] 3 0.909% 100.000% ** Level 5 read latency histogram (micros): Count: 220 Average: 915.0000 StdDev: 1048.48 Min: 82 Median: 435.1724 Max: 4962 Percentiles: P50: 435.17 P75: 1370.59 P99: 4220.00 P99.9: 4962.00 P99.99: 4962.00 ------------------------------------------------------ ( 76, 110 ] 30 13.636% 13.636% ### ( 110, 170 ] 33 15.000% 28.636% ### ( 170, 250 ] 16 7.273% 35.909% # ( 250, 380 ] 23 10.455% 46.364% ## ( 380, 580 ] 29 13.182% 59.545% ### ( 580, 870 ] 18 8.182% 67.727% ## ( 870, 1300 ] 14 6.364% 74.091% # ( 1300, 1900 ] 17 7.727% 81.818% ## ( 1900, 2900 ] 29 13.182% 95.000% ### ( 2900, 4400 ] 10 4.545% 99.545% # ( 4400, 6600 ] 1 0.455% 100.000% ** DB Stats ** Uptime(secs): 45.3 total, 3.6 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 195.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.424 H:M:S, 45.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 272.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.629 H:M:S, 17.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/28-19:53:04 ... thread 0: (1000000,10000000) ops and (307688.1,206811.0) ops/second in (3.250044,48.353321) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/7 4.41 GB 232.8 10.1 0.0 10.1 19.6 9.5 0.0 2.1 149.2 289.8 69.25 63.10 167 0.415 10M 21K 0.0 0.0 L1 12/12 1.39 GB 0.0 6.3 4.9 1.4 6.2 4.8 0.2 1.3 223.8 221.1 28.75 27.25 3 9.583 6511K 55K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.4 2.0 249.1 249.0 1.52 1.47 2 0.758 383K 201 0.0 0.0 L3 18/0 946.15 MB 0.9 3.1 1.5 1.6 3.0 1.5 2.2 2.0 163.6 162.6 19.17 14.32 11 1.742 3184K 19K 0.0 0.0 L4 169/0 9.61 GB 1.0 2.5 2.2 0.4 2.5 2.1 1.6 1.2 147.9 147.1 17.36 11.73 27 0.643 2557K 11K 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/19 105.54 GB 0.0 22.3 8.7 13.6 31.7 18.1 11.2 3.3 167.9 238.7 136.04 117.87 210 0.648 23M 108K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.3 8.7 13.6 31.7 18.1 11.2 3.3 167.9 238.7 136.04 117.87 210 0.648 23M 108K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.3 8.7 13.6 22.2 8.6 0.0 0.0 214.4 213.1 106.56 93.22 73 1.460 23M 108K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 331.2 29.48 24.65 137 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.5 total, 48.4 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.71 GB write, 669.33 MB/s write, 22.31 GB read, 470.83 MB/s read, 136.0 seconds Interval compaction: 31.71 GB write, 671.59 MB/s write, 22.31 GB read, 472.42 MB/s read, 136.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 47, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 47, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4344478 Average: 2.6180 StdDev: 27.25 Min: 0 Median: 1.4880 Max: 11227 Percentiles: P50: 1.49 P75: 1.87 P99: 5.95 P99.9: 103.67 P99.99: 192.27 ------------------------------------------------------ [ 0, 1 ] 795048 18.300% 18.300% #### ( 1, 2 ] 2822271 64.962% 83.262% ############# ( 2, 3 ] 424409 9.769% 93.031% ## ( 3, 4 ] 159577 3.673% 96.704% # ( 4, 6 ] 102257 2.354% 99.058% ( 6, 10 ] 30207 0.695% 99.754% ( 10, 15 ] 3619 0.083% 99.837% ( 15, 22 ] 454 0.010% 99.847% ( 22, 34 ] 43 0.001% 99.848% ( 34, 51 ] 24 0.001% 99.849% ( 51, 76 ] 54 0.001% 99.850% ( 76, 110 ] 2668 0.061% 99.911% ( 110, 170 ] 3197 0.074% 99.985% ( 170, 250 ] 778 0.018% 100.003% ( 250, 380 ] 573 0.013% 100.016% ( 380, 580 ] 450 0.010% 100.026% ( 580, 870 ] 238 0.005% 100.032% ( 870, 1300 ] 98 0.002% 100.034% ( 1300, 1900 ] 55 0.001% 100.035% ( 1900, 2900 ] 50 0.001% 100.037% ( 2900, 4400 ] 81 0.002% 100.039% ( 4400, 6600 ] 23 0.001% 100.039% ( 6600, 9900 ] 10 0.000% 100.039% ( 9900, 14000 ] 1 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 1227283 Average: 4.2125 StdDev: 60.98 Min: 1 Median: 1.6896 Max: 11208 Percentiles: P50: 1.69 P75: 2.40 P99: 8.67 P99.9: 91.60 P99.99: 150.95 ------------------------------------------------------ [ 0, 1 ] 113283 9.230% 9.230% ## ( 1, 2 ] 725557 59.119% 68.349% ############ ( 2, 3 ] 205396 16.736% 85.085% ### ( 3, 4 ] 83480 6.802% 91.887% # ( 4, 6 ] 72774 5.930% 97.817% # ( 6, 10 ] 21734 1.771% 99.588% ( 10, 15 ] 2885 0.235% 99.823% ( 15, 22 ] 418 0.034% 99.857% ( 22, 34 ] 37 0.003% 99.860% ( 34, 51 ] 8 0.001% 99.861% ( 51, 76 ] 57 0.005% 99.865% ( 76, 110 ] 930 0.076% 99.941% ( 110, 170 ] 881 0.072% 100.013% ( 170, 250 ] 325 0.026% 100.039% ( 250, 380 ] 309 0.025% 100.064% ( 380, 580 ] 392 0.032% 100.096% ( 580, 870 ] 307 0.025% 100.121% ( 870, 1300 ] 185 0.015% 100.136% ( 1300, 1900 ] 100 0.008% 100.145% ( 1900, 2900 ] 100 0.008% 100.153% ( 2900, 4400 ] 128 0.010% 100.163% ( 4400, 6600 ] 37 0.003% 100.166% ( 6600, 9900 ] 7 0.001% 100.167% ( 9900, 14000 ] 2 0.000% 100.167% ** Level 2 read latency histogram (micros): Count: 95448 Average: 2.0946 StdDev: 13.81 Min: 0 Median: 1.3965 Max: 2618 Percentiles: P50: 1.40 P75: 1.80 P99: 5.30 P99.9: 9.94 P99.99: 606.40 ------------------------------------------------------ [ 0, 1 ] 24025 25.171% 25.171% ##### ( 1, 2 ] 59765 62.615% 87.786% ############# ( 2, 3 ] 7164 7.506% 95.292% ## ( 3, 4 ] 2586 2.709% 98.001% # ( 4, 6 ] 1465 1.535% 99.536% ( 6, 10 ] 353 0.370% 99.906% ( 10, 15 ] 61 0.064% 99.970% ( 15, 22 ] 9 0.009% 99.979% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 3 0.003% 99.985% ( 250, 380 ] 4 0.004% 99.990% ( 580, 870 ] 5 0.005% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 664116 Average: 6.2459 StdDev: 78.49 Min: 0 Median: 1.9148 Max: 11337 Percentiles: P50: 1.91 P75: 2.89 P99: 8.53 P99.9: 78.37 P99.99: 185.04 ------------------------------------------------------ [ 0, 1 ] 16404 2.470% 2.470% ( 1, 2 ] 345063 51.958% 54.428% ########## ( 2, 3 ] 152849 23.015% 77.444% ##### ( 3, 4 ] 72283 10.884% 88.328% ## ( 4, 6 ] 63948 9.629% 97.957% ## ( 6, 10 ] 10941 1.647% 99.604% ( 10, 15 ] 1678 0.253% 99.857% ( 15, 22 ] 188 0.028% 99.885% ( 22, 34 ] 53 0.008% 99.893% ( 34, 51 ] 6 0.001% 99.894% ( 51, 76 ] 26 0.004% 99.898% ( 76, 110 ] 185 0.028% 99.926% ( 110, 170 ] 353 0.053% 99.979% ( 170, 250 ] 386 0.058% 100.037% ( 250, 380 ] 527 0.079% 100.117% ( 380, 580 ] 602 0.091% 100.207% ( 580, 870 ] 518 0.078% 100.285% ( 870, 1300 ] 309 0.047% 100.332% ( 1300, 1900 ] 106 0.016% 100.348% ( 1900, 2900 ] 106 0.016% 100.364% ( 2900, 4400 ] 115 0.017% 100.381% ( 4400, 6600 ] 18 0.003% 100.384% ( 6600, 9900 ] 7 0.001% 100.385% ( 9900, 14000 ] 1 0.000% 100.385% ** Level 4 read latency histogram (micros): Count: 330 Average: 255.0667 StdDev: 576.10 Min: 0 Median: 2.5714 Max: 3896 Percentiles: P50: 2.57 P75: 182.00 P99: 2850.00 P99.9: 3896.00 P99.99: 3896.00 ------------------------------------------------------ [ 0, 1 ] 45 13.636% 13.636% ### ( 1, 2 ] 100 30.303% 43.939% ###### ( 2, 3 ] 35 10.606% 54.545% ## ( 3, 4 ] 9 2.727% 57.273% # ( 4, 6 ] 4 1.212% 58.485% ( 6, 10 ] 5 1.515% 60.000% ( 10, 15 ] 8 2.424% 62.424% ( 15, 22 ] 5 1.515% 63.939% ( 22, 34 ] 3 0.909% 64.848% ( 34, 51 ] 3 0.909% 65.758% ( 51, 76 ] 16 4.848% 70.606% # ( 76, 110 ] 5 1.515% 72.121% ( 110, 170 ] 5 1.515% 73.636% ( 170, 250 ] 30 9.091% 82.727% ## ( 250, 380 ] 1 0.303% 83.030% ( 380, 580 ] 3 0.909% 83.939% ( 580, 870 ] 12 3.636% 87.576% # ( 870, 1300 ] 19 5.758% 93.333% # ( 1300, 1900 ] 13 3.939% 97.273% # ( 1900, 2900 ] 6 1.818% 99.091% ( 2900, 4400 ] 3 0.909% 100.000% ** Level 5 read latency histogram (micros): Count: 220 Average: 915.0000 StdDev: 1048.48 Min: 82 Median: 435.1724 Max: 4962 Percentiles: P50: 435.17 P75: 1370.59 P99: 4220.00 P99.9: 4962.00 P99.99: 4962.00 ------------------------------------------------------ ( 76, 110 ] 30 13.636% 13.636% ### ( 110, 170 ] 33 15.000% 28.636% ### ( 170, 250 ] 16 7.273% 35.909% # ( 250, 380 ] 23 10.455% 46.364% ## ( 380, 580 ] 29 13.182% 59.545% ### ( 580, 870 ] 18 8.182% 67.727% ## ( 870, 1300 ] 14 6.364% 74.091% # ( 1300, 1900 ] 17 7.727% 81.818% ## ( 1900, 2900 ] 29 13.182% 95.000% ### ( 2900, 4400 ] 10 4.545% 99.545% # ( 4400, 6600 ] 1 0.455% 100.000% ** DB Stats ** Uptime(secs): 48.5 total, 3.2 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 202.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.022 H:M:S, 43.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.598 H:M:S, 18.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.914 micros/op 169083 ops/sec 60.071 seconds 10156999 operations; 163.8 MB/s Microseconds per write: Count: 10156999 Average: 5.9142 StdDev: 368.60 Min: 1 Median: 1.7546 Max: 706181 Percentiles: P50: 1.75 P75: 2.77 P99: 8.71 P99.9: 1153.66 P99.99: 2686.38 ------------------------------------------------------ [ 0, 1 ] 1238141 12.190% 12.190% ## ( 1, 2 ] 5089222 50.106% 62.296% ########## ( 2, 3 ] 1670207 16.444% 78.739% ### ( 3, 4 ] 1428787 14.067% 92.807% ### ( 4, 6 ] 563638 5.549% 98.356% # ( 6, 10 ] 96581 0.951% 99.307% ( 10, 15 ] 29056 0.286% 99.593% ( 15, 22 ] 7491 0.074% 99.666% ( 22, 34 ] 1784 0.018% 99.684% ( 34, 51 ] 188 0.002% 99.686% ( 51, 76 ] 30 0.000% 99.686% ( 76, 110 ] 6862 0.068% 99.754% ( 110, 170 ] 3047 0.030% 99.784% ( 170, 250 ] 275 0.003% 99.786% ( 250, 380 ] 121 0.001% 99.788% ( 380, 580 ] 22 0.000% 99.788% ( 580, 870 ] 16 0.000% 99.788% ( 870, 1300 ] 17242 0.170% 99.958% ( 1300, 1900 ] 46 0.000% 99.958% ( 1900, 2900 ] 4104 0.040% 99.999% ( 2900, 4400 ] 88 0.001% 99.999% ( 4400, 6600 ] 13 0.000% 100.000% ( 6600, 9900 ] 10 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 201610 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10156999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10482022968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 546 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31847856 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31172032516 rocksdb.compact.write.bytes COUNT : 30968088279 rocksdb.flush.write.bytes COUNT : 10437034783 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 59 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 289 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10352977920 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4116480 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31270141725 rocksdb.non.last.level.read.count COUNT : 7552350 rocksdb.block.checksum.compute.count COUNT : 7551317 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.401183 P95 : 3.891828 P99 : 6.906321 P100 : 706179.000000 COUNT : 10156999 SUM : 55240952 rocksdb.compaction.times.micros P50 : 993939.393939 P95 : 4020000.000000 P99 : 16109933.000000 P100 : 16109933.000000 COUNT : 88 SUM : 134031769 rocksdb.compaction.times.cpu_micros P50 : 910000.000000 P95 : 3740000.000000 P99 : 15024305.000000 P100 : 15024305.000000 COUNT : 88 SUM : 116917631 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 671.578947 P95 : 1900.000000 P99 : 11130.000000 P100 : 12573.000000 COUNT : 140 SUM : 127907 rocksdb.compaction.outfile.sync.micros P50 : 1068.712121 P95 : 76531.250000 P99 : 153133.333333 P100 : 205143.000000 COUNT : 353 SUM : 3788265 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 100.620690 P95 : 908.222222 P99 : 2080.000000 P100 : 3444.000000 COUNT : 264 SUM : 53939 rocksdb.table.open.io.micros P50 : 1313.953488 P95 : 6504.666667 P99 : 9547.043478 P100 : 10182.000000 COUNT : 546 SUM : 1033035 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.617668 P95 : 7.374529 P99 : 9.946982 P100 : 13350.000000 COUNT : 7549698 SUM : 41488896 rocksdb.read.block.get.micros P50 : 415.714286 P95 : 2998.076923 P99 : 4258.076923 P100 : 6261.000000 COUNT : 1092 SUM : 847078 rocksdb.write.raw.block.micros P50 : 0.512474 P95 : 0.973701 P99 : 2.819265 P100 : 21117.000000 COUNT : 10027922 SUM : 19818367 rocksdb.numfiles.in.singlecompaction P50 : 3.225000 P95 : 5.120000 P99 : 18.920000 P100 : 38.000000 COUNT : 144 SUM : 550 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.556508 P95 : 1140.377843 P99 : 2396.563112 P100 : 705973.000000 COUNT : 211305 SUM : 31862206 rocksdb.sst.read.micros P50 : 1.560002 P95 : 4.287283 P99 : 7.787448 P100 : 11337.000000 COUNT : 7552477 SUM : 25894725 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10156999 SUM : 10482022968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 206705.882353 P95 : 380000.000000 P99 : 557333.333333 P100 : 857628.000000 COUNT : 140 SUM : 30074366 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 327 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0