[2024-07-25 13:41:47.128171] Starting SPDK v24.09-pre git sha1 704257090 / DPDK 24.07.0-rc3 initialization... [2024-07-25 13:41:47.128339] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid298036 ] Set seed to 1721907707124659 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-25 13:41:47.212124] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc3 is used. There is no support for it in SPDK. Enabled only for validation. [2024-07-25 13:41:47.271103] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-25 13:41:47.318914] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-25 13:41:47.318963] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 298036' to capture a snapshot of events at runtime. [2024-07-25 13:41:47.318983] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-25 13:41:47.318995] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-25 13:41:47.319007] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid298036 for offline analysis/debug. [2024-07-25 13:41:47.319105] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Jul 25 13:41:51 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/25-13:41:54 ... thread 0: (1000000,1000000) ops and (332694.1,332694.1) ops/second in (3.005764,3.005764) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 377.99 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 329.3 2.49 2.24 12 0.207 0 0 0.0 0.0 L1 4/0 251.74 MB 25.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 242.1 241.8 1.04 1.00 1 1.041 255K 262 0.0 0.0 L2 3/2 188.88 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 241.2 241.1 0.78 0.75 1 0.783 191K 85 0.0 0.0 L3 10/0 867.20 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1183/6 96.94 GB 0.0 0.4 0.4 0.1 1.2 1.2 0.5 1.5 102.3 292.2 4.31 3.99 14 0.308 447K 347 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.2 1.2 0.4 1.5 102.3 292.2 4.31 3.99 14 0.308 447K 347 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 241.7 241.5 1.82 1.75 2 0.912 447K 347 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 329.3 2.49 2.24 12 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 393.94 MB/s write, 0.43 GB read, 137.92 MB/s read, 4.3 seconds Interval compaction: 1.23 GB write, 418.91 MB/s write, 0.43 GB read, 146.66 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 146364 Average: 1.9765 StdDev: 10.07 Min: 0 Median: 1.3374 Max: 2975 Percentiles: P50: 1.34 P75: 1.75 P99: 5.40 P99.9: 12.29 P99.99: 23.09 ------------------------------------------------------ [ 0, 1 ] 43462 29.694% 29.694% ###### ( 1, 2 ] 88083 60.181% 89.875% ############ ( 2, 3 ] 8654 5.913% 95.788% # ( 3, 4 ] 3475 2.374% 98.162% ( 4, 6 ] 1748 1.194% 99.356% ( 6, 10 ] 697 0.476% 99.833% ( 10, 15 ] 218 0.149% 99.982% ( 15, 22 ] 13 0.009% 99.990% ( 22, 34 ] 4 0.003% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 76, 110 ] 2 0.001% 99.995% ( 170, 250 ] 14 0.010% 100.005% ( 250, 380 ] 3 0.002% 100.007% ( 380, 580 ] 2 0.001% 100.008% ( 870, 1300 ] 4 0.003% 100.011% ( 2900, 4400 ] 1 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 25 Average: 437.5200 StdDev: 847.69 Min: 1 Median: 2.5000 Max: 3069 Percentiles: P50: 2.50 P75: 455.00 P99: 3069.00 P99.9: 3069.00 P99.99: 3069.00 ------------------------------------------------------ [ 0, 1 ] 4 16.000% 16.000% ### ( 1, 2 ] 8 32.000% 48.000% ###### ( 2, 3 ] 1 4.000% 52.000% # ( 3, 4 ] 1 4.000% 56.000% # ( 15, 22 ] 1 4.000% 60.000% # ( 110, 170 ] 1 4.000% 64.000% # ( 170, 250 ] 1 4.000% 68.000% # ( 250, 380 ] 1 4.000% 72.000% # ( 380, 580 ] 2 8.000% 80.000% ## ( 580, 870 ] 1 4.000% 84.000% # ( 870, 1300 ] 1 4.000% 88.000% # ( 1300, 1900 ] 1 4.000% 92.000% # ( 2900, 4400 ] 2 8.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 33495 Average: 2.2731 StdDev: 5.16 Min: 1 Median: 1.5442 Max: 664 Percentiles: P50: 1.54 P75: 1.91 P99: 6.09 P99.9: 10.11 P99.99: 222.04 ------------------------------------------------------ [ 0, 1 ] 4260 12.718% 12.718% ### ( 1, 2 ] 22948 68.512% 81.230% ############## ( 2, 3 ] 3489 10.416% 91.647% ## ( 3, 4 ] 1556 4.645% 96.292% # ( 4, 6 ] 901 2.690% 98.982% # ( 6, 10 ] 308 0.920% 99.901% ( 10, 15 ] 24 0.072% 99.973% ( 15, 22 ] 4 0.012% 99.985% ( 22, 34 ] 1 0.003% 99.988% ( 51, 76 ] 1 0.003% 99.991% ( 170, 250 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 380, 580 ] 1 0.003% 100.000% ( 580, 870 ] 1 0.003% 100.003% ** Level 3 read latency histogram (micros): Count: 44 Average: 1624.6136 StdDev: 1272.53 Min: 124 Median: 870.0000 Max: 4596 Percentiles: P50: 870.00 P75: 2600.00 P99: 4317.50 P99.9: 4391.75 P99.99: 4399.17 ------------------------------------------------------ ( 110, 170 ] 1 2.273% 2.273% ( 170, 250 ] 3 6.818% 9.091% # ( 250, 380 ] 2 4.545% 13.636% # ( 380, 580 ] 10 22.727% 36.364% ##### ( 580, 870 ] 6 13.636% 50.000% ### ( 870, 1300 ] 2 4.545% 54.545% # ( 1300, 1900 ] 2 4.545% 59.091% # ( 1900, 2900 ] 10 22.727% 81.818% ##### ( 2900, 4400 ] 8 18.182% 100.000% #### ( 4400, 6600 ] 1 2.273% 102.273% ** Level 4 read latency histogram (micros): Count: 30 Average: 1891.0000 StdDev: 918.33 Min: 534 Median: 1750.0000 Max: 4134 Percentiles: P50: 1750.00 P75: 2511.11 P99: 4134.00 P99.9: 4134.00 P99.99: 4134.00 ------------------------------------------------------ ( 380, 580 ] 3 10.000% 10.000% ## ( 580, 870 ] 1 3.333% 13.333% # ( 870, 1300 ] 5 16.667% 30.000% ### ( 1300, 1900 ] 8 26.667% 56.667% ##### ( 1900, 2900 ] 9 30.000% 86.667% ###### ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 307.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.212 H:M:S, 6.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.212 H:M:S, 7.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/25-13:41:58 ... thread 0: (1000000,2000000) ops and (291193.0,310563.2) ops/second in (3.434149,6.439913) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/6 944.39 MB 6.3 0.7 0.0 0.7 2.5 1.8 0.0 1.4 86.5 295.5 8.74 8.05 29 0.301 767K 744 0.0 0.0 L1 2/2 138.85 MB 0.0 0.7 0.7 0.0 0.7 0.7 0.2 1.0 229.3 229.0 3.02 2.91 2 1.510 703K 900 0.0 0.0 L2 3/3 228.23 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 238.7 238.6 0.81 0.77 2 0.404 195K 88 0.0 0.0 L3 20/11 1.18 GB 0.2 0.4 0.3 0.1 0.4 0.3 0.3 1.2 206.3 206.1 1.96 1.79 3 0.652 409K 265 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 122.9 122.9 1.37 0.95 1 1.370 170K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/22 97.92 GB 0.0 2.2 1.3 0.9 3.9 3.1 1.2 2.2 139.3 254.1 15.90 14.48 37 0.430 2247K 1997 0.0 0.0 Int 0/0 0.00 KB 0.0 2.2 1.3 0.9 3.9 3.1 1.1 2.2 139.3 254.1 15.90 14.48 37 0.430 2247K 1997 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.2 1.3 0.9 2.2 1.3 0.0 0.0 215.7 215.5 10.26 9.46 11 0.933 2247K 1997 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 324.4 5.63 5.02 26 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.6 total, 6.4 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.94 GB write, 608.99 MB/s write, 2.16 GB read, 333.82 MB/s read, 15.9 seconds Interval compaction: 3.94 GB write, 627.01 MB/s write, 2.16 GB read, 343.70 MB/s read, 15.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 424392 Average: 2.3234 StdDev: 13.07 Min: 0 Median: 1.5441 Max: 5506 Percentiles: P50: 1.54 P75: 1.94 P99: 6.08 P99.9: 12.81 P99.99: 14.88 ------------------------------------------------------ [ 0, 1 ] 66907 15.765% 15.765% ### ( 1, 2 ] 267028 62.920% 78.686% ############# ( 2, 3 ] 52614 12.398% 91.083% ## ( 3, 4 ] 20413 4.810% 95.893% # ( 4, 6 ] 13122 3.092% 98.985% # ( 6, 10 ] 3369 0.794% 99.779% ( 10, 15 ] 919 0.217% 99.995% ( 15, 22 ] 63 0.015% 100.010% ( 22, 34 ] 15 0.004% 100.014% ( 34, 51 ] 3 0.001% 100.014% ( 51, 76 ] 1 0.000% 100.015% ( 76, 110 ] 2 0.000% 100.015% ( 110, 170 ] 1 0.000% 100.015% ( 170, 250 ] 26 0.006% 100.021% ( 250, 380 ] 8 0.002% 100.023% ( 380, 580 ] 7 0.002% 100.025% ( 580, 870 ] 6 0.001% 100.026% ( 870, 1300 ] 6 0.001% 100.028% ( 1300, 1900 ] 1 0.000% 100.028% ( 1900, 2900 ] 1 0.000% 100.028% ( 2900, 4400 ] 2 0.000% 100.029% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 103368 Average: 2.8971 StdDev: 15.92 Min: 1 Median: 1.8434 Max: 3069 Percentiles: P50: 1.84 P75: 2.71 P99: 8.11 P99.9: 13.29 P99.99: 14.46 ------------------------------------------------------ [ 0, 1 ] 3398 3.287% 3.287% # ( 1, 2 ] 57250 55.385% 58.672% ########### ( 2, 3 ] 23625 22.855% 81.527% ##### ( 3, 4 ] 9656 9.341% 90.869% ## ( 4, 6 ] 7657 7.408% 98.276% # ( 6, 10 ] 1418 1.372% 99.648% ( 10, 15 ] 398 0.385% 100.033% ( 15, 22 ] 45 0.044% 100.076% ( 22, 34 ] 3 0.003% 100.079% ( 110, 170 ] 1 0.001% 100.080% ( 170, 250 ] 1 0.001% 100.081% ( 250, 380 ] 5 0.005% 100.086% ( 380, 580 ] 4 0.004% 100.090% ( 580, 870 ] 1 0.001% 100.091% ( 870, 1300 ] 3 0.003% 100.094% ( 1300, 1900 ] 1 0.001% 100.095% ( 2900, 4400 ] 2 0.002% 100.097% ** Level 2 read latency histogram (micros): Count: 48730 Average: 2.2281 StdDev: 4.31 Min: 1 Median: 1.5359 Max: 664 Percentiles: P50: 1.54 P75: 1.90 P99: 5.91 P99.9: 10.04 P99.99: 54.17 ------------------------------------------------------ [ 0, 1 ] 6451 13.238% 13.238% ### ( 1, 2 ] 33425 68.592% 81.830% ############## ( 2, 3 ] 5170 10.609% 92.440% ## ( 3, 4 ] 2121 4.353% 96.793% # ( 4, 6 ] 1129 2.317% 99.109% ( 6, 10 ] 385 0.790% 99.899% ( 10, 15 ] 38 0.078% 99.977% ( 15, 22 ] 5 0.010% 99.988% ( 22, 34 ] 1 0.002% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 215566 Average: 3.5942 StdDev: 32.73 Min: 0 Median: 1.8014 Max: 4596 Percentiles: P50: 1.80 P75: 2.63 P99: 9.84 P99.9: 159.28 P99.99: 456.39 ------------------------------------------------------ [ 0, 1 ] 10022 4.649% 4.649% # ( 1, 2 ] 121986 56.589% 61.238% ########### ( 2, 3 ] 47195 21.894% 83.131% #### ( 3, 4 ] 17232 7.994% 91.125% ## ( 4, 6 ] 12363 5.735% 96.860% # ( 6, 10 ] 4802 2.228% 99.088% ( 10, 15 ] 1204 0.559% 99.647% ( 15, 22 ] 151 0.070% 99.717% ( 22, 34 ] 85 0.039% 99.756% ( 34, 51 ] 10 0.005% 99.761% ( 51, 76 ] 11 0.005% 99.766% ( 76, 110 ] 103 0.048% 99.814% ( 110, 170 ] 227 0.105% 99.919% ( 170, 250 ] 78 0.036% 99.955% ( 250, 380 ] 51 0.024% 99.979% ( 380, 580 ] 64 0.030% 100.008% ( 580, 870 ] 22 0.010% 100.019% ( 870, 1300 ] 6 0.003% 100.021% ( 1300, 1900 ] 3 0.001% 100.023% ( 1900, 2900 ] 11 0.005% 100.028% ( 2900, 4400 ] 8 0.004% 100.032% ( 4400, 6600 ] 1 0.000% 100.032% ** Level 4 read latency histogram (micros): Count: 320 Average: 180.3156 StdDev: 617.91 Min: 0 Median: 1.6972 Max: 4134 Percentiles: P50: 1.70 P75: 5.75 P99: 3200.00 P99.9: 4134.00 P99.99: 4134.00 ------------------------------------------------------ [ 0, 1 ] 61 19.062% 19.062% #### ( 1, 2 ] 142 44.375% 63.438% ######### ( 2, 3 ] 27 8.438% 71.875% ## ( 3, 4 ] 3 0.938% 72.812% ( 4, 6 ] 8 2.500% 75.312% # ( 6, 10 ] 40 12.500% 87.812% ### ( 10, 15 ] 8 2.500% 90.312% # ( 34, 51 ] 1 0.312% 90.625% ( 380, 580 ] 3 0.938% 91.562% ( 580, 870 ] 1 0.312% 91.875% ( 870, 1300 ] 5 1.562% 93.438% ( 1300, 1900 ] 8 2.500% 95.938% # ( 1900, 2900 ] 9 2.812% 98.750% # ( 2900, 4400 ] 4 1.250% 100.000% ** DB Stats ** Uptime(secs): 6.6 total, 3.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 296.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.649 H:M:S, 9.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.437 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/25-13:42:01 ... thread 0: (1000000,3000000) ops and (301544.1,307497.5) ops/second in (3.316265,9.756178) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 1.91 GB 75.5 1.3 0.0 1.3 4.1 2.8 0.0 1.5 94.0 295.3 14.08 13.02 45 0.313 1343K 1375 0.0 0.0 L1 2/2 138.85 MB 0.0 0.7 0.7 0.0 0.7 0.7 0.2 1.0 229.3 229.0 3.02 2.91 2 1.510 703K 900 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 238.7 238.6 0.81 0.77 2 0.404 195K 88 0.0 0.0 L3 18/0 920.71 MB 0.9 1.6 0.6 1.0 1.6 0.6 0.3 2.9 212.2 211.5 7.67 7.20 5 1.534 1653K 4932 0.0 0.0 L4 170/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 122.9 122.9 1.37 0.95 1 1.370 170K 0 0.0 0.0 L5 1052/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/12 98.90 GB 0.0 3.9 1.5 2.4 6.7 4.3 2.3 2.4 148.6 253.5 26.95 24.85 55 0.490 4066K 7295 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.5 2.4 6.7 4.3 2.2 2.4 148.6 253.5 26.95 24.85 55 0.490 4066K 7295 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.5 2.4 3.9 1.5 0.0 0.0 220.0 219.6 18.20 17.05 15 1.214 4066K 7295 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 324.2 8.74 7.81 40 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.9 total, 9.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.67 GB write, 686.82 MB/s write, 3.91 GB read, 402.59 MB/s read, 26.9 seconds Interval compaction: 6.67 GB write, 700.24 MB/s write, 3.91 GB read, 410.45 MB/s read, 26.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 787580 Average: 2.3111 StdDev: 10.72 Min: 0 Median: 1.5519 Max: 5506 Percentiles: P50: 1.55 P75: 1.93 P99: 5.91 P99.9: 12.32 P99.99: 14.80 ------------------------------------------------------ [ 0, 1 ] 109389 13.889% 13.889% ### ( 1, 2 ] 515282 65.426% 79.315% ############# ( 2, 3 ] 99632 12.650% 91.966% ### ( 3, 4 ] 35691 4.532% 96.497% # ( 4, 6 ] 20593 2.615% 99.112% # ( 6, 10 ] 5546 0.704% 99.816% ( 10, 15 ] 1425 0.181% 99.997% ( 15, 22 ] 91 0.012% 100.009% ( 22, 34 ] 27 0.003% 100.012% ( 34, 51 ] 7 0.001% 100.013% ( 51, 76 ] 1 0.000% 100.013% ( 76, 110 ] 37 0.005% 100.018% ( 110, 170 ] 20 0.003% 100.020% ( 170, 250 ] 47 0.006% 100.026% ( 250, 380 ] 14 0.002% 100.028% ( 380, 580 ] 21 0.003% 100.031% ( 580, 870 ] 12 0.002% 100.032% ( 870, 1300 ] 10 0.001% 100.034% ( 1300, 1900 ] 4 0.001% 100.034% ( 1900, 2900 ] 1 0.000% 100.034% ( 2900, 4400 ] 2 0.000% 100.035% ( 4400, 6600 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 183960 Average: 2.7641 StdDev: 13.52 Min: 1 Median: 1.7435 Max: 3069 Percentiles: P50: 1.74 P75: 2.48 P99: 7.98 P99.9: 13.85 P99.99: 17.48 ------------------------------------------------------ [ 0, 1 ] 9202 5.002% 5.002% # ( 1, 2 ] 111331 60.519% 65.521% ############ ( 2, 3 ] 36674 19.936% 85.457% #### ( 3, 4 ] 13709 7.452% 92.909% # ( 4, 6 ] 10055 5.466% 98.375% # ( 6, 10 ] 2325 1.264% 99.639% ( 10, 15 ] 624 0.339% 99.978% ( 15, 22 ] 61 0.033% 100.011% ( 22, 34 ] 4 0.002% 100.014% ( 51, 76 ] 4 0.002% 100.016% ( 76, 110 ] 2 0.001% 100.017% ( 110, 170 ] 18 0.010% 100.027% ( 170, 250 ] 15 0.008% 100.035% ( 250, 380 ] 22 0.012% 100.047% ( 380, 580 ] 11 0.006% 100.053% ( 580, 870 ] 3 0.002% 100.054% ( 870, 1300 ] 3 0.002% 100.056% ( 1300, 1900 ] 2 0.001% 100.057% ( 2900, 4400 ] 2 0.001% 100.058% ** Level 2 read latency histogram (micros): Count: 48981 Average: 2.2314 StdDev: 4.30 Min: 1 Median: 1.5377 Max: 664 Percentiles: P50: 1.54 P75: 1.90 P99: 5.91 P99.9: 10.37 P99.99: 53.55 ------------------------------------------------------ [ 0, 1 ] 6454 13.177% 13.177% ### ( 1, 2 ] 33541 68.478% 81.654% ############## ( 2, 3 ] 5262 10.743% 92.397% ## ( 3, 4 ] 2142 4.373% 96.770% # ( 4, 6 ] 1142 2.332% 99.102% ( 6, 10 ] 388 0.792% 99.894% ( 10, 15 ] 41 0.084% 99.978% ( 15, 22 ] 5 0.010% 99.988% ( 22, 34 ] 1 0.002% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 239540 Average: 3.6049 StdDev: 32.04 Min: 0 Median: 1.7910 Max: 4596 Percentiles: P50: 1.79 P75: 2.60 P99: 9.82 P99.9: 165.10 P99.99: 503.81 ------------------------------------------------------ [ 0, 1 ] 10994 4.590% 4.590% # ( 1, 2 ] 137525 57.412% 62.002% ########### ( 2, 3 ] 51705 21.585% 83.587% #### ( 3, 4 ] 18514 7.729% 91.316% ## ( 4, 6 ] 13336 5.567% 96.883% # ( 6, 10 ] 5310 2.217% 99.100% ( 10, 15 ] 1296 0.541% 99.641% ( 15, 22 ] 157 0.066% 99.707% ( 22, 34 ] 85 0.035% 99.742% ( 34, 51 ] 10 0.004% 99.746% ( 51, 76 ] 11 0.005% 99.751% ( 76, 110 ] 104 0.043% 99.794% ( 110, 170 ] 276 0.115% 99.909% ( 170, 250 ] 88 0.037% 99.946% ( 250, 380 ] 58 0.024% 99.970% ( 380, 580 ] 76 0.032% 100.002% ( 580, 870 ] 31 0.013% 100.015% ( 870, 1300 ] 8 0.003% 100.018% ( 1300, 1900 ] 5 0.002% 100.020% ( 1900, 2900 ] 11 0.005% 100.025% ( 2900, 4400 ] 8 0.003% 100.028% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 4 read latency histogram (micros): Count: 320 Average: 180.3156 StdDev: 617.91 Min: 0 Median: 1.6972 Max: 4134 Percentiles: P50: 1.70 P75: 5.75 P99: 3200.00 P99.9: 4134.00 P99.99: 4134.00 ------------------------------------------------------ [ 0, 1 ] 61 19.062% 19.062% #### ( 1, 2 ] 142 44.375% 63.438% ######### ( 2, 3 ] 27 8.438% 71.875% ## ( 3, 4 ] 3 0.938% 72.812% ( 4, 6 ] 8 2.500% 75.312% # ( 6, 10 ] 40 12.500% 87.812% ### ( 10, 15 ] 8 2.500% 90.312% # ( 34, 51 ] 1 0.312% 90.625% ( 380, 580 ] 3 0.938% 91.562% ( 580, 870 ] 1 0.312% 91.875% ( 870, 1300 ] 5 1.562% 93.438% ( 1300, 1900 ] 8 2.500% 95.938% # ( 1900, 2900 ] 9 2.812% 98.750% # ( 2900, 4400 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 1063.1250 StdDev: 1259.05 Min: 106 Median: 347.5000 Max: 4510 Percentiles: P50: 347.50 P75: 1600.00 P99: 4510.00 P99.9: 4510.00 P99.99: 4510.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 9 22.500% 25.000% ##### ( 170, 250 ] 7 17.500% 42.500% #### ( 250, 380 ] 4 10.000% 52.500% ## ( 380, 580 ] 1 2.500% 55.000% # ( 580, 870 ] 4 10.000% 65.000% ## ( 870, 1300 ] 3 7.500% 72.500% ## ( 1300, 1900 ] 2 5.000% 77.500% # ( 1900, 2900 ] 2 5.000% 82.500% # ( 2900, 4400 ] 6 15.000% 97.500% ### ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 9.9 total, 3.3 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 296.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.076 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 296.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.427 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/25-13:42:04 ... thread 0: (1000000,4000000) ops and (304312.8,306695.1) ops/second in (3.286093,13.042271) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 1.97 GB 31.5 2.1 0.0 2.1 5.8 3.7 0.0 1.6 106.4 293.9 20.14 18.71 61 0.330 2174K 2234 0.0 0.0 L1 10/10 1015.73 MB 0.0 1.7 1.5 0.1 1.7 1.5 0.2 1.1 226.0 225.3 7.58 7.28 3 2.527 1739K 5275 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 238.7 238.6 0.81 0.77 2 0.404 195K 88 0.0 0.0 L3 18/0 920.71 MB 0.9 1.6 0.6 1.0 1.6 0.6 0.3 2.9 212.2 211.5 7.67 7.20 5 1.534 1653K 4932 0.0 0.0 L4 170/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 122.9 122.9 1.37 0.95 1 1.370 170K 0 0.0 0.0 L5 1052/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/21 99.82 GB 0.0 5.7 2.4 3.3 9.4 6.1 2.3 2.5 155.6 255.8 37.57 34.91 72 0.522 5934K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 2.4 3.3 9.4 6.1 2.2 2.5 155.6 255.8 37.57 34.91 72 0.522 5934K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 2.4 3.3 5.7 2.4 0.0 0.0 224.8 224.4 25.99 24.57 19 1.368 5934K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 326.5 11.58 10.34 53 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.2 total, 13.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.39 GB write, 726.25 MB/s write, 5.71 GB read, 441.60 MB/s read, 37.6 seconds Interval compaction: 9.39 GB write, 736.86 MB/s write, 5.71 GB read, 448.05 MB/s read, 37.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1088144 Average: 2.3042 StdDev: 10.70 Min: 0 Median: 1.5435 Max: 5506 Percentiles: P50: 1.54 P75: 1.92 P99: 5.87 P99.9: 12.38 P99.99: 15.00 ------------------------------------------------------ [ 0, 1 ] 154342 14.184% 14.184% ### ( 1, 2 ] 717019 65.894% 80.078% ############# ( 2, 3 ] 134987 12.405% 92.483% ## ( 3, 4 ] 47033 4.322% 96.805% # ( 4, 6 ] 25541 2.347% 99.153% ( 6, 10 ] 7242 0.666% 99.818% ( 10, 15 ] 1873 0.172% 99.990% ( 15, 22 ] 118 0.011% 100.001% ( 22, 34 ] 38 0.003% 100.005% ( 34, 51 ] 9 0.001% 100.005% ( 51, 76 ] 5 0.000% 100.006% ( 76, 110 ] 71 0.007% 100.012% ( 110, 170 ] 61 0.006% 100.018% ( 170, 250 ] 69 0.006% 100.024% ( 250, 380 ] 35 0.003% 100.027% ( 380, 580 ] 35 0.003% 100.031% ( 580, 870 ] 14 0.001% 100.032% ( 870, 1300 ] 13 0.001% 100.033% ( 1300, 1900 ] 8 0.001% 100.034% ( 1900, 2900 ] 2 0.000% 100.034% ( 2900, 4400 ] 3 0.000% 100.034% ( 4400, 6600 ] 1 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 249309 Average: 2.7284 StdDev: 14.04 Min: 0 Median: 1.6778 Max: 3069 Percentiles: P50: 1.68 P75: 2.28 P99: 7.67 P99.9: 14.46 P99.99: 154.41 ------------------------------------------------------ [ 0, 1 ] 19355 7.763% 7.763% ## ( 1, 2 ] 155353 62.313% 70.077% ############ ( 2, 3 ] 44147 17.708% 87.785% #### ( 3, 4 ] 15793 6.335% 94.119% # ( 4, 6 ] 11009 4.416% 98.535% # ( 6, 10 ] 2776 1.113% 99.649% ( 10, 15 ] 703 0.282% 99.931% ( 15, 22 ] 66 0.026% 99.957% ( 22, 34 ] 4 0.002% 99.959% ( 34, 51 ] 1 0.000% 99.959% ( 51, 76 ] 5 0.002% 99.961% ( 76, 110 ] 22 0.009% 99.970% ( 110, 170 ] 69 0.028% 99.998% ( 170, 250 ] 31 0.012% 100.010% ( 250, 380 ] 35 0.014% 100.024% ( 380, 580 ] 29 0.012% 100.036% ( 580, 870 ] 6 0.002% 100.038% ( 870, 1300 ] 8 0.003% 100.041% ( 1300, 1900 ] 3 0.001% 100.043% ( 2900, 4400 ] 2 0.001% 100.043% ** Level 2 read latency histogram (micros): Count: 48981 Average: 2.2314 StdDev: 4.30 Min: 1 Median: 1.5377 Max: 664 Percentiles: P50: 1.54 P75: 1.90 P99: 5.91 P99.9: 10.37 P99.99: 53.55 ------------------------------------------------------ [ 0, 1 ] 6454 13.177% 13.177% ### ( 1, 2 ] 33541 68.478% 81.654% ############## ( 2, 3 ] 5262 10.743% 92.397% ## ( 3, 4 ] 2142 4.373% 96.770% # ( 4, 6 ] 1142 2.332% 99.102% ( 6, 10 ] 388 0.792% 99.894% ( 10, 15 ] 41 0.084% 99.978% ( 15, 22 ] 5 0.010% 99.988% ( 22, 34 ] 1 0.002% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 239540 Average: 3.6049 StdDev: 32.04 Min: 0 Median: 1.7910 Max: 4596 Percentiles: P50: 1.79 P75: 2.60 P99: 9.82 P99.9: 165.10 P99.99: 503.81 ------------------------------------------------------ [ 0, 1 ] 10994 4.590% 4.590% # ( 1, 2 ] 137525 57.412% 62.002% ########### ( 2, 3 ] 51705 21.585% 83.587% #### ( 3, 4 ] 18514 7.729% 91.316% ## ( 4, 6 ] 13336 5.567% 96.883% # ( 6, 10 ] 5310 2.217% 99.100% ( 10, 15 ] 1296 0.541% 99.641% ( 15, 22 ] 157 0.066% 99.707% ( 22, 34 ] 85 0.035% 99.742% ( 34, 51 ] 10 0.004% 99.746% ( 51, 76 ] 11 0.005% 99.751% ( 76, 110 ] 104 0.043% 99.794% ( 110, 170 ] 276 0.115% 99.909% ( 170, 250 ] 88 0.037% 99.946% ( 250, 380 ] 58 0.024% 99.970% ( 380, 580 ] 76 0.032% 100.002% ( 580, 870 ] 31 0.013% 100.015% ( 870, 1300 ] 8 0.003% 100.018% ( 1300, 1900 ] 5 0.002% 100.020% ( 1900, 2900 ] 11 0.005% 100.025% ( 2900, 4400 ] 8 0.003% 100.028% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 4 read latency histogram (micros): Count: 320 Average: 180.3156 StdDev: 617.91 Min: 0 Median: 1.6972 Max: 4134 Percentiles: P50: 1.70 P75: 5.75 P99: 3200.00 P99.9: 4134.00 P99.99: 4134.00 ------------------------------------------------------ [ 0, 1 ] 61 19.062% 19.062% #### ( 1, 2 ] 142 44.375% 63.438% ######### ( 2, 3 ] 27 8.438% 71.875% ## ( 3, 4 ] 3 0.938% 72.812% ( 4, 6 ] 8 2.500% 75.312% # ( 6, 10 ] 40 12.500% 87.812% ### ( 10, 15 ] 8 2.500% 90.312% # ( 34, 51 ] 1 0.312% 90.625% ( 380, 580 ] 3 0.938% 91.562% ( 580, 870 ] 1 0.312% 91.875% ( 870, 1300 ] 5 1.562% 93.438% ( 1300, 1900 ] 8 2.500% 95.938% # ( 1900, 2900 ] 9 2.812% 98.750% # ( 2900, 4400 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 1063.1250 StdDev: 1259.05 Min: 106 Median: 347.5000 Max: 4510 Percentiles: P50: 347.50 P75: 1600.00 P99: 4510.00 P99.9: 4510.00 P99.99: 4510.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 9 22.500% 25.000% ##### ( 170, 250 ] 7 17.500% 42.500% #### ( 250, 380 ] 4 10.000% 52.500% ## ( 380, 580 ] 1 2.500% 55.000% # ( 580, 870 ] 4 10.000% 65.000% ## ( 870, 1300 ] 3 7.500% 72.500% ## ( 1300, 1900 ] 2 5.000% 77.500% # ( 1900, 2900 ] 2 5.000% 82.500% # ( 2900, 4400 ] 6 15.000% 97.500% ### ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 13.2 total, 3.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 297.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.523 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.446 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/25-13:42:08 ... thread 0: (1000000,5000000) ops and (299948.4,305321.5) ops/second in (3.333907,16.376178) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 2.95 GB 138.5 3.0 0.0 3.0 7.6 4.7 0.0 1.6 113.1 292.1 26.73 24.86 78 0.343 3070K 3192 0.0 0.0 L1 10/10 1015.73 MB 0.0 1.7 1.5 0.1 1.7 1.5 0.2 1.1 226.0 225.3 7.58 7.28 3 2.527 1739K 5275 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 238.7 238.6 0.81 0.77 2 0.404 195K 88 0.0 0.0 L3 18/0 920.71 MB 0.9 1.6 0.6 1.0 1.6 0.6 0.3 2.9 212.2 211.5 7.67 7.20 5 1.534 1653K 4932 0.0 0.0 L4 170/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 122.9 122.9 1.37 0.95 1 1.370 170K 0 0.0 0.0 L5 1052/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/21 100.80 GB 0.0 6.6 2.4 4.2 11.2 7.0 2.3 2.4 152.3 260.4 44.16 41.06 89 0.496 6829K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.6 2.4 4.2 11.2 7.0 2.2 2.4 152.3 260.4 44.16 41.06 89 0.496 6829K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.6 2.4 4.2 6.6 2.4 0.0 0.0 227.7 227.3 29.54 28.02 22 1.343 6829K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 327.4 14.62 13.04 67 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.6 total, 16.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.23 GB write, 694.11 MB/s write, 6.57 GB read, 405.97 MB/s read, 44.2 seconds Interval compaction: 11.23 GB write, 702.19 MB/s write, 6.57 GB read, 410.70 MB/s read, 44.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1460374 Average: 2.3123 StdDev: 10.29 Min: 0 Median: 1.5498 Max: 5506 Percentiles: P50: 1.55 P75: 1.93 P99: 5.89 P99.9: 12.52 P99.99: 14.98 ------------------------------------------------------ [ 0, 1 ] 199261 13.645% 13.645% ### ( 1, 2 ] 965648 66.123% 79.768% ############# ( 2, 3 ] 186709 12.785% 92.553% ### ( 3, 4 ] 62923 4.309% 96.862% # ( 4, 6 ] 33025 2.261% 99.123% ( 6, 10 ] 10004 0.685% 99.808% ( 10, 15 ] 2667 0.183% 99.991% ( 15, 22 ] 166 0.011% 100.002% ( 22, 34 ] 49 0.003% 100.005% ( 34, 51 ] 13 0.001% 100.006% ( 51, 76 ] 11 0.001% 100.007% ( 76, 110 ] 120 0.008% 100.015% ( 110, 170 ] 80 0.005% 100.021% ( 170, 250 ] 87 0.006% 100.027% ( 250, 380 ] 47 0.003% 100.030% ( 380, 580 ] 45 0.003% 100.033% ( 580, 870 ] 22 0.002% 100.034% ( 870, 1300 ] 20 0.001% 100.036% ( 1300, 1900 ] 10 0.001% 100.036% ( 1900, 2900 ] 2 0.000% 100.037% ( 2900, 4400 ] 4 0.000% 100.037% ( 4400, 6600 ] 1 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 319702 Average: 2.7529 StdDev: 13.44 Min: 0 Median: 1.6630 Max: 3069 Percentiles: P50: 1.66 P75: 2.21 P99: 8.04 P99.9: 76.07 P99.99: 208.38 ------------------------------------------------------ [ 0, 1 ] 25781 8.064% 8.064% ## ( 1, 2 ] 202210 63.250% 71.314% ############# ( 2, 3 ] 55026 17.212% 88.525% ### ( 3, 4 ] 18812 5.884% 94.409% # ( 4, 6 ] 12677 3.965% 98.375% # ( 6, 10 ] 3923 1.227% 99.602% ( 10, 15 ] 860 0.269% 99.871% ( 15, 22 ] 82 0.026% 99.896% ( 22, 34 ] 4 0.001% 99.898% ( 34, 51 ] 1 0.000% 99.898% ( 51, 76 ] 6 0.002% 99.900% ( 76, 110 ] 139 0.043% 99.943% ( 110, 170 ] 126 0.039% 99.983% ( 170, 250 ] 48 0.015% 99.998% ( 250, 380 ] 52 0.016% 100.014% ( 380, 580 ] 39 0.012% 100.026% ( 580, 870 ] 10 0.003% 100.029% ( 870, 1300 ] 8 0.003% 100.032% ( 1300, 1900 ] 3 0.001% 100.033% ( 2900, 4400 ] 2 0.001% 100.033% ** Level 2 read latency histogram (micros): Count: 48981 Average: 2.2314 StdDev: 4.30 Min: 1 Median: 1.5377 Max: 664 Percentiles: P50: 1.54 P75: 1.90 P99: 5.91 P99.9: 10.37 P99.99: 53.55 ------------------------------------------------------ [ 0, 1 ] 6454 13.177% 13.177% ### ( 1, 2 ] 33541 68.478% 81.654% ############## ( 2, 3 ] 5262 10.743% 92.397% ## ( 3, 4 ] 2142 4.373% 96.770% # ( 4, 6 ] 1142 2.332% 99.102% ( 6, 10 ] 388 0.792% 99.894% ( 10, 15 ] 41 0.084% 99.978% ( 15, 22 ] 5 0.010% 99.988% ( 22, 34 ] 1 0.002% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 239540 Average: 3.6049 StdDev: 32.04 Min: 0 Median: 1.7910 Max: 4596 Percentiles: P50: 1.79 P75: 2.60 P99: 9.82 P99.9: 165.10 P99.99: 503.81 ------------------------------------------------------ [ 0, 1 ] 10994 4.590% 4.590% # ( 1, 2 ] 137525 57.412% 62.002% ########### ( 2, 3 ] 51705 21.585% 83.587% #### ( 3, 4 ] 18514 7.729% 91.316% ## ( 4, 6 ] 13336 5.567% 96.883% # ( 6, 10 ] 5310 2.217% 99.100% ( 10, 15 ] 1296 0.541% 99.641% ( 15, 22 ] 157 0.066% 99.707% ( 22, 34 ] 85 0.035% 99.742% ( 34, 51 ] 10 0.004% 99.746% ( 51, 76 ] 11 0.005% 99.751% ( 76, 110 ] 104 0.043% 99.794% ( 110, 170 ] 276 0.115% 99.909% ( 170, 250 ] 88 0.037% 99.946% ( 250, 380 ] 58 0.024% 99.970% ( 380, 580 ] 76 0.032% 100.002% ( 580, 870 ] 31 0.013% 100.015% ( 870, 1300 ] 8 0.003% 100.018% ( 1300, 1900 ] 5 0.002% 100.020% ( 1900, 2900 ] 11 0.005% 100.025% ( 2900, 4400 ] 8 0.003% 100.028% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 4 read latency histogram (micros): Count: 320 Average: 180.3156 StdDev: 617.91 Min: 0 Median: 1.6972 Max: 4134 Percentiles: P50: 1.70 P75: 5.75 P99: 3200.00 P99.9: 4134.00 P99.99: 4134.00 ------------------------------------------------------ [ 0, 1 ] 61 19.062% 19.062% #### ( 1, 2 ] 142 44.375% 63.438% ######### ( 2, 3 ] 27 8.438% 71.875% ## ( 3, 4 ] 3 0.938% 72.812% ( 4, 6 ] 8 2.500% 75.312% # ( 6, 10 ] 40 12.500% 87.812% ### ( 10, 15 ] 8 2.500% 90.312% # ( 34, 51 ] 1 0.312% 90.625% ( 380, 580 ] 3 0.938% 91.562% ( 580, 870 ] 1 0.312% 91.875% ( 870, 1300 ] 5 1.562% 93.438% ( 1300, 1900 ] 8 2.500% 95.938% # ( 1900, 2900 ] 9 2.812% 98.750% # ( 2900, 4400 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 1063.1250 StdDev: 1259.05 Min: 106 Median: 347.5000 Max: 4510 Percentiles: P50: 347.50 P75: 1600.00 P99: 4510.00 P99.9: 4510.00 P99.99: 4510.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 9 22.500% 25.000% ##### ( 170, 250 ] 7 17.500% 42.500% #### ( 250, 380 ] 4 10.000% 52.500% ## ( 380, 580 ] 1 2.500% 55.000% # ( 580, 870 ] 4 10.000% 65.000% ## ( 870, 1300 ] 3 7.500% 72.500% ## ( 1300, 1900 ] 2 5.000% 77.500% # ( 1900, 2900 ] 2 5.000% 82.500% # ( 2900, 4400 ] 6 15.000% 97.500% ### ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 16.6 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 297.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.952 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 295.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.429 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/25-13:42:12 ... thread 0: (1000000,6000000) ops and (213815.7,284993.6) ops/second in (4.676926,21.053104) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/7 3.93 GB 264.3 4.2 0.0 4.2 9.9 5.7 0.0 1.7 123.9 288.9 35.09 32.80 99 0.354 4413K 4552 0.0 0.0 L1 10/10 1015.73 MB 0.0 1.7 1.5 0.1 1.7 1.5 0.2 1.1 226.0 225.3 7.58 7.28 3 2.527 1739K 5275 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 238.7 238.6 0.81 0.77 2 0.404 195K 88 0.0 0.0 L3 18/0 920.71 MB 0.9 1.6 0.6 1.0 1.6 0.6 0.3 2.9 212.2 211.5 7.67 7.20 5 1.534 1653K 4932 0.0 0.0 L4 170/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 122.9 122.9 1.37 0.95 1 1.370 170K 0 0.0 0.0 L5 1052/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/17 101.78 GB 0.0 7.9 2.4 5.5 13.5 8.0 2.3 2.4 153.2 263.3 52.52 49.00 110 0.477 8173K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.9 2.4 5.5 13.5 8.0 2.2 2.4 153.2 263.3 52.52 49.00 110 0.477 8173K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.9 2.4 5.5 7.8 2.4 0.0 0.0 231.2 230.7 34.82 33.19 27 1.290 8173K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 327.3 17.71 15.80 83 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.2 total, 21.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.51 GB write, 650.96 MB/s write, 7.86 GB read, 378.87 MB/s read, 52.5 seconds Interval compaction: 13.51 GB write, 656.86 MB/s write, 7.86 GB read, 382.30 MB/s read, 52.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 21, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1875221 Average: 2.3160 StdDev: 10.94 Min: 0 Median: 1.5430 Max: 5506 Percentiles: P50: 1.54 P75: 1.92 P99: 5.93 P99.9: 12.77 P99.99: 19.36 ------------------------------------------------------ [ 0, 1 ] 261101 13.924% 13.924% ### ( 1, 2 ] 1245955 66.443% 80.367% ############# ( 2, 3 ] 233371 12.445% 92.812% ## ( 3, 4 ] 77232 4.119% 96.930% # ( 4, 6 ] 40290 2.149% 99.079% ( 6, 10 ] 13502 0.720% 99.799% ( 10, 15 ] 3418 0.182% 99.981% ( 15, 22 ] 264 0.014% 99.995% ( 22, 34 ] 59 0.003% 99.998% ( 34, 51 ] 17 0.001% 99.999% ( 51, 76 ] 15 0.001% 100.000% ( 76, 110 ] 200 0.011% 100.011% ( 110, 170 ] 130 0.007% 100.018% ( 170, 250 ] 129 0.007% 100.025% ( 250, 380 ] 71 0.004% 100.028% ( 380, 580 ] 61 0.003% 100.032% ( 580, 870 ] 32 0.002% 100.033% ( 870, 1300 ] 30 0.002% 100.035% ( 1300, 1900 ] 11 0.001% 100.036% ( 1900, 2900 ] 2 0.000% 100.036% ( 2900, 4400 ] 8 0.000% 100.036% ( 4400, 6600 ] 1 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 436873 Average: 2.6672 StdDev: 12.20 Min: 0 Median: 1.6236 Max: 3069 Percentiles: P50: 1.62 P75: 2.05 P99: 8.14 P99.9: 86.67 P99.99: 223.30 ------------------------------------------------------ [ 0, 1 ] 43266 9.904% 9.904% ## ( 1, 2 ] 280915 64.301% 74.205% ############# ( 2, 3 ] 68002 15.566% 89.770% ### ( 3, 4 ] 22485 5.147% 94.917% # ( 4, 6 ] 14800 3.388% 98.305% # ( 6, 10 ] 5684 1.301% 99.606% ( 10, 15 ] 1079 0.247% 99.853% ( 15, 22 ] 119 0.027% 99.880% ( 22, 34 ] 4 0.001% 99.881% ( 34, 51 ] 1 0.000% 99.881% ( 51, 76 ] 9 0.002% 99.883% ( 76, 110 ] 233 0.053% 99.937% ( 110, 170 ] 196 0.045% 99.982% ( 170, 250 ] 56 0.013% 99.995% ( 250, 380 ] 56 0.013% 100.007% ( 380, 580 ] 50 0.011% 100.019% ( 580, 870 ] 12 0.003% 100.022% ( 870, 1300 ] 9 0.002% 100.024% ( 1300, 1900 ] 3 0.001% 100.024% ( 2900, 4400 ] 2 0.000% 100.025% ** Level 2 read latency histogram (micros): Count: 48981 Average: 2.2314 StdDev: 4.30 Min: 1 Median: 1.5377 Max: 664 Percentiles: P50: 1.54 P75: 1.90 P99: 5.91 P99.9: 10.37 P99.99: 53.55 ------------------------------------------------------ [ 0, 1 ] 6454 13.177% 13.177% ### ( 1, 2 ] 33541 68.478% 81.654% ############## ( 2, 3 ] 5262 10.743% 92.397% ## ( 3, 4 ] 2142 4.373% 96.770% # ( 4, 6 ] 1142 2.332% 99.102% ( 6, 10 ] 388 0.792% 99.894% ( 10, 15 ] 41 0.084% 99.978% ( 15, 22 ] 5 0.010% 99.988% ( 22, 34 ] 1 0.002% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 239540 Average: 3.6049 StdDev: 32.04 Min: 0 Median: 1.7910 Max: 4596 Percentiles: P50: 1.79 P75: 2.60 P99: 9.82 P99.9: 165.10 P99.99: 503.81 ------------------------------------------------------ [ 0, 1 ] 10994 4.590% 4.590% # ( 1, 2 ] 137525 57.412% 62.002% ########### ( 2, 3 ] 51705 21.585% 83.587% #### ( 3, 4 ] 18514 7.729% 91.316% ## ( 4, 6 ] 13336 5.567% 96.883% # ( 6, 10 ] 5310 2.217% 99.100% ( 10, 15 ] 1296 0.541% 99.641% ( 15, 22 ] 157 0.066% 99.707% ( 22, 34 ] 85 0.035% 99.742% ( 34, 51 ] 10 0.004% 99.746% ( 51, 76 ] 11 0.005% 99.751% ( 76, 110 ] 104 0.043% 99.794% ( 110, 170 ] 276 0.115% 99.909% ( 170, 250 ] 88 0.037% 99.946% ( 250, 380 ] 58 0.024% 99.970% ( 380, 580 ] 76 0.032% 100.002% ( 580, 870 ] 31 0.013% 100.015% ( 870, 1300 ] 8 0.003% 100.018% ( 1300, 1900 ] 5 0.002% 100.020% ( 1900, 2900 ] 11 0.005% 100.025% ( 2900, 4400 ] 8 0.003% 100.028% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 4 read latency histogram (micros): Count: 320 Average: 180.3156 StdDev: 617.91 Min: 0 Median: 1.6972 Max: 4134 Percentiles: P50: 1.70 P75: 5.75 P99: 3200.00 P99.9: 4134.00 P99.99: 4134.00 ------------------------------------------------------ [ 0, 1 ] 61 19.062% 19.062% #### ( 1, 2 ] 142 44.375% 63.438% ######### ( 2, 3 ] 27 8.438% 71.875% ## ( 3, 4 ] 3 0.938% 72.812% ( 4, 6 ] 8 2.500% 75.312% # ( 6, 10 ] 40 12.500% 87.812% ### ( 10, 15 ] 8 2.500% 90.312% # ( 34, 51 ] 1 0.312% 90.625% ( 380, 580 ] 3 0.938% 91.562% ( 580, 870 ] 1 0.312% 91.875% ( 870, 1300 ] 5 1.562% 93.438% ( 1300, 1900 ] 8 2.500% 95.938% # ( 1900, 2900 ] 9 2.812% 98.750% # ( 2900, 4400 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 1063.1250 StdDev: 1259.05 Min: 106 Median: 347.5000 Max: 4510 Percentiles: P50: 347.50 P75: 1600.00 P99: 4510.00 P99.9: 4510.00 P99.99: 4510.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 9 22.500% 25.000% ##### ( 170, 250 ] 7 17.500% 42.500% #### ( 250, 380 ] 4 10.000% 52.500% ## ( 380, 580 ] 1 2.500% 55.000% # ( 580, 870 ] 4 10.000% 65.000% ## ( 870, 1300 ] 3 7.500% 72.500% ## ( 1300, 1900 ] 2 5.000% 77.500% # ( 1900, 2900 ] 2 5.000% 82.500% # ( 2900, 4400 ] 6 15.000% 97.500% ### ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 21.2 total, 4.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 277.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.757 H:M:S, 17.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 210.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.805 H:M:S, 38.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/25-13:42:17 ... thread 0: (1000000,7000000) ops and (232575.1,276103.7) ops/second in (4.299686,25.352790) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.56 GB 62.9 5.0 0.0 5.0 11.7 6.6 0.0 1.8 125.1 289.6 41.31 38.62 117 0.353 5245K 5418 0.0 0.0 L1 26/26 2.32 GB 0.0 4.0 2.9 1.1 4.0 2.9 0.2 1.4 220.6 219.1 18.65 17.89 4 4.661 4176K 27K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 238.7 238.6 0.81 0.77 2 0.404 195K 88 0.0 0.0 L3 18/0 920.71 MB 0.9 1.6 0.6 1.0 1.6 0.6 0.3 2.9 212.2 211.5 7.67 7.20 5 1.534 1653K 4932 0.0 0.0 L4 170/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 122.9 122.9 1.37 0.95 1 1.370 170K 0 0.0 0.0 L5 1052/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/41 102.74 GB 0.0 11.0 3.7 7.3 17.6 10.3 2.3 2.7 161.4 258.4 69.80 65.43 129 0.541 11M 38K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.0 3.7 7.3 17.6 10.3 2.2 2.7 161.4 258.4 69.80 65.43 129 0.541 11M 38K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.0 3.7 7.3 11.0 3.7 0.0 0.0 229.7 228.9 49.06 46.92 31 1.582 11M 38K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 328.0 20.74 18.52 98 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.5 total, 25.4 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.61 GB write, 705.96 MB/s write, 11.00 GB read, 441.13 MB/s read, 69.8 seconds Interval compaction: 17.61 GB write, 711.27 MB/s write, 11.00 GB read, 444.44 MB/s read, 69.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 22, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2236860 Average: 2.3489 StdDev: 11.51 Min: 0 Median: 1.5395 Max: 5506 Percentiles: P50: 1.54 P75: 1.91 P99: 5.95 P99.9: 13.36 P99.99: 94.58 ------------------------------------------------------ [ 0, 1 ] 314560 14.063% 14.063% ### ( 1, 2 ] 1490120 66.617% 80.679% ############# ( 2, 3 ] 274336 12.264% 92.944% ## ( 3, 4 ] 90226 4.034% 96.977% # ( 4, 6 ] 46355 2.072% 99.049% ( 6, 10 ] 16185 0.724% 99.773% ( 10, 15 ] 4224 0.189% 99.962% ( 15, 22 ] 341 0.015% 99.977% ( 22, 34 ] 66 0.003% 99.980% ( 34, 51 ] 20 0.001% 99.981% ( 51, 76 ] 23 0.001% 99.982% ( 76, 110 ] 330 0.015% 99.997% ( 110, 170 ] 313 0.014% 100.011% ( 170, 250 ] 195 0.009% 100.019% ( 250, 380 ] 107 0.005% 100.024% ( 380, 580 ] 91 0.004% 100.028% ( 580, 870 ] 70 0.003% 100.031% ( 870, 1300 ] 46 0.002% 100.033% ( 1300, 1900 ] 15 0.001% 100.034% ( 1900, 2900 ] 4 0.000% 100.034% ( 2900, 4400 ] 8 0.000% 100.035% ( 4400, 6600 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 539412 Average: 2.7139 StdDev: 13.28 Min: 0 Median: 1.6059 Max: 3069 Percentiles: P50: 1.61 P75: 1.99 P99: 8.32 P99.9: 103.54 P99.99: 324.38 ------------------------------------------------------ [ 0, 1 ] 58001 10.753% 10.753% ## ( 1, 2 ] 349383 64.771% 75.524% ############# ( 2, 3 ] 79408 14.721% 90.245% ### ( 3, 4 ] 26260 4.868% 95.113% # ( 4, 6 ] 16710 3.098% 98.211% # ( 6, 10 ] 7349 1.362% 99.573% ( 10, 15 ] 1264 0.234% 99.808% ( 15, 22 ] 150 0.028% 99.836% ( 22, 34 ] 6 0.001% 99.837% ( 34, 51 ] 2 0.000% 99.837% ( 51, 76 ] 18 0.003% 99.840% ( 76, 110 ] 397 0.074% 99.914% ( 110, 170 ] 270 0.050% 99.964% ( 170, 250 ] 92 0.017% 99.981% ( 250, 380 ] 84 0.016% 99.997% ( 380, 580 ] 79 0.015% 100.011% ( 580, 870 ] 25 0.005% 100.016% ( 870, 1300 ] 15 0.003% 100.019% ( 1300, 1900 ] 3 0.001% 100.019% ( 1900, 2900 ] 1 0.000% 100.019% ( 2900, 4400 ] 2 0.000% 100.020% ** Level 2 read latency histogram (micros): Count: 48981 Average: 2.2314 StdDev: 4.30 Min: 1 Median: 1.5377 Max: 664 Percentiles: P50: 1.54 P75: 1.90 P99: 5.91 P99.9: 10.37 P99.99: 53.55 ------------------------------------------------------ [ 0, 1 ] 6454 13.177% 13.177% ### ( 1, 2 ] 33541 68.478% 81.654% ############## ( 2, 3 ] 5262 10.743% 92.397% ## ( 3, 4 ] 2142 4.373% 96.770% # ( 4, 6 ] 1142 2.332% 99.102% ( 6, 10 ] 388 0.792% 99.894% ( 10, 15 ] 41 0.084% 99.978% ( 15, 22 ] 5 0.010% 99.988% ( 22, 34 ] 1 0.002% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 239540 Average: 3.6049 StdDev: 32.04 Min: 0 Median: 1.7910 Max: 4596 Percentiles: P50: 1.79 P75: 2.60 P99: 9.82 P99.9: 165.10 P99.99: 503.81 ------------------------------------------------------ [ 0, 1 ] 10994 4.590% 4.590% # ( 1, 2 ] 137525 57.412% 62.002% ########### ( 2, 3 ] 51705 21.585% 83.587% #### ( 3, 4 ] 18514 7.729% 91.316% ## ( 4, 6 ] 13336 5.567% 96.883% # ( 6, 10 ] 5310 2.217% 99.100% ( 10, 15 ] 1296 0.541% 99.641% ( 15, 22 ] 157 0.066% 99.707% ( 22, 34 ] 85 0.035% 99.742% ( 34, 51 ] 10 0.004% 99.746% ( 51, 76 ] 11 0.005% 99.751% ( 76, 110 ] 104 0.043% 99.794% ( 110, 170 ] 276 0.115% 99.909% ( 170, 250 ] 88 0.037% 99.946% ( 250, 380 ] 58 0.024% 99.970% ( 380, 580 ] 76 0.032% 100.002% ( 580, 870 ] 31 0.013% 100.015% ( 870, 1300 ] 8 0.003% 100.018% ( 1300, 1900 ] 5 0.002% 100.020% ( 1900, 2900 ] 11 0.005% 100.025% ( 2900, 4400 ] 8 0.003% 100.028% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 4 read latency histogram (micros): Count: 320 Average: 180.3156 StdDev: 617.91 Min: 0 Median: 1.6972 Max: 4134 Percentiles: P50: 1.70 P75: 5.75 P99: 3200.00 P99.9: 4134.00 P99.99: 4134.00 ------------------------------------------------------ [ 0, 1 ] 61 19.062% 19.062% #### ( 1, 2 ] 142 44.375% 63.438% ######### ( 2, 3 ] 27 8.438% 71.875% ## ( 3, 4 ] 3 0.938% 72.812% ( 4, 6 ] 8 2.500% 75.312% # ( 6, 10 ] 40 12.500% 87.812% ### ( 10, 15 ] 8 2.500% 90.312% # ( 34, 51 ] 1 0.312% 90.625% ( 380, 580 ] 3 0.938% 91.562% ( 580, 870 ] 1 0.312% 91.875% ( 870, 1300 ] 5 1.562% 93.438% ( 1300, 1900 ] 8 2.500% 95.938% # ( 1900, 2900 ] 9 2.812% 98.750% # ( 2900, 4400 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 1063.1250 StdDev: 1259.05 Min: 106 Median: 347.5000 Max: 4510 Percentiles: P50: 347.50 P75: 1600.00 P99: 4510.00 P99.9: 4510.00 P99.99: 4510.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 9 22.500% 25.000% ##### ( 170, 250 ] 7 17.500% 42.500% #### ( 250, 380 ] 4 10.000% 52.500% ## ( 380, 580 ] 1 2.500% 55.000% # ( 580, 870 ] 4 10.000% 65.000% ## ( 870, 1300 ] 3 7.500% 72.500% ## ( 1300, 1900 ] 2 5.000% 77.500% # ( 1900, 2900 ] 2 5.000% 82.500% # ( 2900, 4400 ] 6 15.000% 97.500% ### ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 25.5 total, 4.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 269.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.217 H:M:S, 20.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 228.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.460 H:M:S, 34.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/25-13:42:46 ... thread 0: (1000000,8000000) ops and (33398.9,144681.4) ops/second in (29.941136,55.293926) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/3 1.78 GB 63.0 6.9 0.0 6.9 14.4 7.6 0.0 1.9 130.1 272.9 54.21 48.71 133 0.408 7162K 10K 0.0 0.0 L1 9/9 777.43 MB 0.0 9.0 5.6 3.4 8.9 5.5 0.2 1.6 215.2 212.2 43.03 40.01 5 8.607 9149K 27K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.9 1.5 238.7 238.6 0.81 0.77 2 0.404 195K 88 0.0 0.0 L3 19/3 1.09 GB 0.9 6.3 4.7 1.6 6.2 4.7 0.3 1.3 153.8 153.1 41.78 31.25 14 2.984 5002K 22K 0.0 0.0 L4 173/6 9.84 GB 1.0 4.0 3.9 0.1 4.0 3.9 0.7 1.0 113.8 113.6 36.12 20.73 45 0.803 4093K 2832 0.0 0.0 L5 1096/0 90.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/21 103.53 GB 0.0 26.4 14.3 12.1 33.8 21.7 10.3 4.5 153.7 196.7 175.95 141.48 199 0.884 25M 64K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.4 14.3 12.1 33.8 21.7 10.2 4.5 153.7 196.7 175.95 141.48 199 0.884 25M 64K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.4 14.3 12.1 26.2 14.2 0.0 0.0 180.4 179.2 149.90 120.04 89 1.684 25M 64K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 297.4 26.06 21.43 110 0.237 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.5 total, 55.3 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.80 GB write, 623.80 MB/s write, 26.41 GB read, 487.39 MB/s read, 176.0 seconds Interval compaction: 33.80 GB write, 625.95 MB/s write, 26.41 GB read, 489.07 MB/s read, 176.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 58, interval: 85 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3554287 Average: 3.2515 StdDev: 41.46 Min: 0 Median: 1.5491 Max: 9566 Percentiles: P50: 1.55 P75: 1.94 P99: 8.29 P99.9: 145.32 P99.99: 485.32 ------------------------------------------------------ [ 0, 1 ] 540643 15.211% 15.211% ### ( 1, 2 ] 2251827 63.355% 78.566% ############# ( 2, 3 ] 448235 12.611% 91.177% ### ( 3, 4 ] 149853 4.216% 95.393% # ( 4, 6 ] 109523 3.081% 98.475% # ( 6, 10 ] 32629 0.918% 99.393% ( 10, 15 ] 8105 0.228% 99.621% ( 15, 22 ] 976 0.027% 99.648% ( 22, 34 ] 104 0.003% 99.651% ( 34, 51 ] 31 0.001% 99.652% ( 51, 76 ] 836 0.024% 99.676% ( 76, 110 ] 5669 0.159% 99.835% ( 110, 170 ] 3910 0.110% 99.945% ( 170, 250 ] 729 0.021% 99.966% ( 250, 380 ] 573 0.016% 99.982% ( 380, 580 ] 548 0.015% 99.997% ( 580, 870 ] 312 0.009% 100.006% ( 870, 1300 ] 197 0.006% 100.012% ( 1300, 1900 ] 121 0.003% 100.015% ( 1900, 2900 ] 130 0.004% 100.019% ( 2900, 4400 ] 199 0.006% 100.024% ( 4400, 6600 ] 50 0.001% 100.026% ( 6600, 9900 ] 7 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 2160908 Average: 5.4526 StdDev: 84.56 Min: 0 Median: 1.7989 Max: 9431 Percentiles: P50: 1.80 P75: 2.72 P99: 9.37 P99.9: 90.50 P99.99: 130.79 ------------------------------------------------------ [ 0, 1 ] 223987 10.365% 10.365% ## ( 1, 2 ] 1072041 49.611% 59.976% ########## ( 2, 3 ] 453069 20.967% 80.943% #### ( 3, 4 ] 176604 8.173% 89.115% ## ( 4, 6 ] 177003 8.191% 97.307% ## ( 6, 10 ] 43463 2.011% 99.318% ( 10, 15 ] 9727 0.450% 99.768% ( 15, 22 ] 1206 0.056% 99.824% ( 22, 34 ] 95 0.004% 99.828% ( 34, 51 ] 39 0.002% 99.830% ( 51, 76 ] 452 0.021% 99.851% ( 76, 110 ] 2488 0.115% 99.966% ( 110, 170 ] 1495 0.069% 100.035% ( 170, 250 ] 494 0.023% 100.058% ( 250, 380 ] 592 0.027% 100.085% ( 380, 580 ] 707 0.033% 100.118% ( 580, 870 ] 567 0.026% 100.144% ( 870, 1300 ] 378 0.017% 100.162% ( 1300, 1900 ] 257 0.012% 100.174% ( 1900, 2900 ] 403 0.019% 100.192% ( 2900, 4400 ] 554 0.026% 100.218% ( 4400, 6600 ] 114 0.005% 100.223% ( 6600, 9900 ] 28 0.001% 100.225% ** Level 2 read latency histogram (micros): Count: 48981 Average: 2.2314 StdDev: 4.30 Min: 1 Median: 1.5377 Max: 664 Percentiles: P50: 1.54 P75: 1.90 P99: 5.91 P99.9: 10.37 P99.99: 53.55 ------------------------------------------------------ [ 0, 1 ] 6454 13.177% 13.177% ### ( 1, 2 ] 33541 68.478% 81.654% ############## ( 2, 3 ] 5262 10.743% 92.397% ## ( 3, 4 ] 2142 4.373% 96.770% # ( 4, 6 ] 1142 2.332% 99.102% ( 6, 10 ] 388 0.792% 99.894% ( 10, 15 ] 41 0.084% 99.978% ( 15, 22 ] 5 0.010% 99.988% ( 22, 34 ] 1 0.002% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1358628 Average: 8.6282 StdDev: 123.03 Min: 0 Median: 2.2297 Max: 10059 Percentiles: P50: 2.23 P75: 3.09 P99: 9.88 P99.9: 150.26 P99.99: 406.00 ------------------------------------------------------ [ 0, 1 ] 16145 1.188% 1.188% ( 1, 2 ] 565918 41.654% 42.842% ######## ( 2, 3 ] 423301 31.157% 73.998% ###### ( 3, 4 ] 153866 11.325% 85.324% ## ( 4, 6 ] 150941 11.110% 96.433% ## ( 6, 10 ] 35954 2.646% 99.080% # ( 10, 15 ] 9382 0.691% 99.770% ( 15, 22 ] 1024 0.075% 99.846% ( 22, 34 ] 170 0.013% 99.858% ( 34, 51 ] 65 0.005% 99.863% ( 51, 76 ] 38 0.003% 99.866% ( 76, 110 ] 148 0.011% 99.877% ( 110, 170 ] 473 0.035% 99.911% ( 170, 250 ] 391 0.029% 99.940% ( 250, 380 ] 572 0.042% 99.982% ( 380, 580 ] 801 0.059% 100.041% ( 580, 870 ] 868 0.064% 100.105% ( 870, 1300 ] 617 0.045% 100.151% ( 1300, 1900 ] 417 0.031% 100.181% ( 1900, 2900 ] 611 0.045% 100.226% ( 2900, 4400 ] 642 0.047% 100.274% ( 4400, 6600 ] 167 0.012% 100.286% ( 6600, 9900 ] 37 0.003% 100.289% ( 9900, 14000 ] 1 0.000% 100.289% ** Level 4 read latency histogram (micros): Count: 34347 Average: 140.1343 StdDev: 585.17 Min: 0 Median: 2.4609 Max: 8041 Percentiles: P50: 2.46 P75: 3.62 P99: 3556.78 P99.9: 5834.80 P99.99: 6566.06 ------------------------------------------------------ [ 0, 1 ] 341 0.993% 0.993% ( 1, 2 ] 11673 33.986% 34.978% ####### ( 2, 3 ] 11195 32.594% 67.572% ####### ( 3, 4 ] 4142 12.059% 79.631% ## ( 4, 6 ] 2789 8.120% 87.751% ## ( 6, 10 ] 815 2.373% 90.124% ( 10, 15 ] 216 0.629% 90.753% ( 15, 22 ] 34 0.099% 90.852% ( 22, 34 ] 6 0.017% 90.870% ( 34, 51 ] 3 0.009% 90.878% ( 76, 110 ] 9 0.026% 90.905% ( 110, 170 ] 119 0.346% 91.251% ( 170, 250 ] 135 0.393% 91.644% ( 250, 380 ] 210 0.611% 92.256% ( 380, 580 ] 366 1.066% 93.321% ( 580, 870 ] 539 1.569% 94.890% ( 870, 1300 ] 513 1.494% 96.384% ( 1300, 1900 ] 358 1.042% 97.426% ( 1900, 2900 ] 347 1.010% 98.437% ( 2900, 4400 ] 442 1.287% 99.723% ( 4400, 6600 ] 93 0.271% 99.994% ( 6600, 9900 ] 9 0.026% 100.020% ** Level 5 read latency histogram (micros): Count: 276 Average: 1617.5906 StdDev: 1559.78 Min: 106 Median: 903.0769 Max: 6923 Percentiles: P50: 903.08 P75: 2718.18 P99: 6501.65 P99.9: 6923.00 P99.99: 6923.00 ------------------------------------------------------ ( 76, 110 ] 1 0.362% 0.362% ( 110, 170 ] 20 7.246% 7.609% # ( 170, 250 ] 18 6.522% 14.130% # ( 250, 380 ] 27 9.783% 23.913% ## ( 380, 580 ] 41 14.855% 38.768% ### ( 580, 870 ] 29 10.507% 49.275% ## ( 870, 1300 ] 26 9.420% 58.696% ## ( 1300, 1900 ] 18 6.522% 65.217% # ( 1900, 2900 ] 33 11.957% 77.174% ## ( 2900, 4400 ] 44 15.942% 93.116% ### ( 4400, 6600 ] 17 6.159% 99.275% # ( 6600, 9900 ] 2 0.725% 100.000% ** DB Stats ** Uptime(secs): 55.5 total, 29.9 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 141.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.131 H:M:S, 56.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 32.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:25.913 H:M:S, 86.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/25-13:42:50 ... thread 0: (1000000,9000000) ops and (297324.1,153433.7) ops/second in (3.363333,58.657259) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/7 2.76 GB 132.1 7.8 0.0 7.8 16.3 8.5 0.0 1.9 130.3 273.8 60.91 54.95 150 0.406 8058K 11K 0.0 0.0 L1 9/9 777.43 MB 0.0 9.0 5.6 3.4 8.9 5.5 0.2 1.6 215.2 212.2 43.03 40.01 5 8.607 9149K 27K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.9 1.5 238.7 238.6 0.81 0.77 2 0.404 195K 88 0.0 0.0 L3 16/0 944.58 MB 0.9 6.3 4.7 1.6 6.2 4.7 0.3 1.3 153.8 153.1 41.78 31.25 14 2.984 5002K 22K 0.0 0.0 L4 171/0 9.70 GB 1.0 4.2 4.1 0.1 4.2 4.1 0.7 1.0 114.9 114.7 37.34 21.59 47 0.795 4271K 2832 0.0 0.0 L5 1100/0 90.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1308/16 104.51 GB 0.0 27.4 14.5 12.9 35.8 22.9 10.6 4.2 152.8 199.5 183.88 148.57 218 0.843 26M 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.4 14.5 12.9 35.8 22.9 10.5 4.2 152.8 199.5 183.88 148.57 218 0.843 26M 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.4 14.5 12.9 27.3 14.3 0.0 0.0 181.7 180.5 154.67 124.35 94 1.645 26M 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 299.7 29.21 24.23 124 0.236 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.8 total, 58.7 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.82 GB write, 623.31 MB/s write, 27.45 GB read, 477.59 MB/s read, 183.9 seconds Interval compaction: 35.82 GB write, 625.34 MB/s write, 27.45 GB read, 479.14 MB/s read, 183.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 62, interval: 89 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3814377 Average: 3.1939 StdDev: 40.13 Min: 0 Median: 1.5511 Max: 9566 Percentiles: P50: 1.55 P75: 1.94 P99: 8.15 P99.9: 141.34 P99.99: 454.58 ------------------------------------------------------ [ 0, 1 ] 569286 14.925% 14.925% ### ( 1, 2 ] 2427535 63.642% 78.566% ############# ( 2, 3 ] 484084 12.691% 91.257% ### ( 3, 4 ] 161048 4.222% 95.480% # ( 4, 6 ] 115617 3.031% 98.511% # ( 6, 10 ] 34772 0.912% 99.422% ( 10, 15 ] 8501 0.223% 99.645% ( 15, 22 ] 1002 0.026% 99.671% ( 22, 34 ] 107 0.003% 99.674% ( 34, 51 ] 32 0.001% 99.675% ( 51, 76 ] 839 0.022% 99.697% ( 76, 110 ] 5683 0.149% 99.846% ( 110, 170 ] 3939 0.103% 99.949% ( 170, 250 ] 755 0.020% 99.969% ( 250, 380 ] 587 0.015% 99.985% ( 380, 580 ] 562 0.015% 99.999% ( 580, 870 ] 317 0.008% 100.008% ( 870, 1300 ] 201 0.005% 100.013% ( 1300, 1900 ] 125 0.003% 100.016% ( 1900, 2900 ] 132 0.003% 100.020% ( 2900, 4400 ] 199 0.005% 100.025% ( 4400, 6600 ] 50 0.001% 100.026% ( 6600, 9900 ] 7 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 2312054 Average: 5.2768 StdDev: 81.82 Min: 0 Median: 1.7806 Max: 9431 Percentiles: P50: 1.78 P75: 2.68 P99: 9.34 P99.9: 92.99 P99.99: 137.83 ------------------------------------------------------ [ 0, 1 ] 239841 10.374% 10.374% ## ( 1, 2 ] 1173666 50.763% 61.136% ########## ( 2, 3 ] 474139 20.507% 81.644% #### ( 3, 4 ] 182585 7.897% 89.541% ## ( 4, 6 ] 180222 7.795% 97.336% ## ( 6, 10 ] 46108 1.994% 99.330% ( 10, 15 ] 10067 0.435% 99.765% ( 15, 22 ] 1228 0.053% 99.818% ( 22, 34 ] 95 0.004% 99.823% ( 34, 51 ] 40 0.002% 99.824% ( 51, 76 ] 452 0.020% 99.844% ( 76, 110 ] 2600 0.112% 99.956% ( 110, 170 ] 1681 0.073% 100.029% ( 170, 250 ] 526 0.023% 100.052% ( 250, 380 ] 622 0.027% 100.079% ( 380, 580 ] 726 0.031% 100.110% ( 580, 870 ] 575 0.025% 100.135% ( 870, 1300 ] 379 0.016% 100.151% ( 1300, 1900 ] 257 0.011% 100.162% ( 1900, 2900 ] 404 0.017% 100.180% ( 2900, 4400 ] 554 0.024% 100.204% ( 4400, 6600 ] 114 0.005% 100.209% ( 6600, 9900 ] 28 0.001% 100.210% ** Level 2 read latency histogram (micros): Count: 48981 Average: 2.2314 StdDev: 4.30 Min: 1 Median: 1.5377 Max: 664 Percentiles: P50: 1.54 P75: 1.90 P99: 5.91 P99.9: 10.37 P99.99: 53.55 ------------------------------------------------------ [ 0, 1 ] 6454 13.177% 13.177% ### ( 1, 2 ] 33541 68.478% 81.654% ############## ( 2, 3 ] 5262 10.743% 92.397% ## ( 3, 4 ] 2142 4.373% 96.770% # ( 4, 6 ] 1142 2.332% 99.102% ( 6, 10 ] 388 0.792% 99.894% ( 10, 15 ] 41 0.084% 99.978% ( 15, 22 ] 5 0.010% 99.988% ( 22, 34 ] 1 0.002% 99.990% ( 51, 76 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 1 0.002% 99.996% ( 380, 580 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1378592 Average: 8.5397 StdDev: 122.14 Min: 0 Median: 2.2183 Max: 10059 Percentiles: P50: 2.22 P75: 3.07 P99: 9.86 P99.9: 147.09 P99.99: 404.25 ------------------------------------------------------ [ 0, 1 ] 16783 1.217% 1.217% ( 1, 2 ] 579268 42.019% 43.236% ######## ( 2, 3 ] 427180 30.987% 74.223% ###### ( 3, 4 ] 154851 11.233% 85.455% ## ( 4, 6 ] 151582 10.995% 96.451% ## ( 6, 10 ] 36371 2.638% 99.089% # ( 10, 15 ] 9437 0.685% 99.774% ( 15, 22 ] 1028 0.075% 99.848% ( 22, 34 ] 170 0.012% 99.861% ( 34, 51 ] 65 0.005% 99.865% ( 51, 76 ] 38 0.003% 99.868% ( 76, 110 ] 148 0.011% 99.879% ( 110, 170 ] 473 0.034% 99.913% ( 170, 250 ] 391 0.028% 99.941% ( 250, 380 ] 572 0.041% 99.983% ( 380, 580 ] 801 0.058% 100.041% ( 580, 870 ] 868 0.063% 100.104% ( 870, 1300 ] 617 0.045% 100.149% ( 1300, 1900 ] 417 0.030% 100.179% ( 1900, 2900 ] 611 0.044% 100.223% ( 2900, 4400 ] 642 0.047% 100.270% ( 4400, 6600 ] 167 0.012% 100.282% ( 6600, 9900 ] 37 0.003% 100.285% ( 9900, 14000 ] 1 0.000% 100.285% ** Level 4 read latency histogram (micros): Count: 35045 Average: 137.4365 StdDev: 579.63 Min: 0 Median: 2.4418 Max: 8041 Percentiles: P50: 2.44 P75: 3.59 P99: 3533.09 P99.9: 5818.29 P99.99: 6564.41 ------------------------------------------------------ [ 0, 1 ] 398 1.136% 1.136% ( 1, 2 ] 12121 34.587% 35.723% ####### ( 2, 3 ] 11324 32.313% 68.035% ###### ( 3, 4 ] 4170 11.899% 79.934% ## ( 4, 6 ] 2802 7.995% 87.930% ## ( 6, 10 ] 829 2.366% 90.295% ( 10, 15 ] 218 0.622% 90.917% ( 15, 22 ] 34 0.097% 91.014% ( 22, 34 ] 6 0.017% 91.032% ( 34, 51 ] 3 0.009% 91.040% ( 76, 110 ] 9 0.026% 91.066% ( 110, 170 ] 121 0.345% 91.411% ( 170, 250 ] 137 0.391% 91.802% ( 250, 380 ] 213 0.608% 92.410% ( 380, 580 ] 366 1.044% 93.454% ( 580, 870 ] 539 1.538% 94.992% ( 870, 1300 ] 513 1.464% 96.456% ( 1300, 1900 ] 358 1.022% 97.478% ( 1900, 2900 ] 347 0.990% 98.468% ( 2900, 4400 ] 442 1.261% 99.729% ( 4400, 6600 ] 93 0.265% 99.994% ( 6600, 9900 ] 9 0.026% 100.020% ** Level 5 read latency histogram (micros): Count: 280 Average: 1605.1071 StdDev: 1554.48 Min: 106 Median: 886.5385 Max: 6923 Percentiles: P50: 886.54 P75: 2694.12 P99: 6496.47 P99.9: 6923.00 P99.99: 6923.00 ------------------------------------------------------ ( 76, 110 ] 1 0.357% 0.357% ( 110, 170 ] 21 7.500% 7.857% ## ( 170, 250 ] 18 6.429% 14.286% # ( 250, 380 ] 28 10.000% 24.286% ## ( 380, 580 ] 42 15.000% 39.286% ### ( 580, 870 ] 29 10.357% 49.643% ## ( 870, 1300 ] 26 9.286% 58.929% ## ( 1300, 1900 ] 18 6.429% 65.357% # ( 1900, 2900 ] 34 12.143% 77.500% ## ( 2900, 4400 ] 44 15.714% 93.214% ### ( 4400, 6600 ] 17 6.071% 99.286% # ( 6600, 9900 ] 2 0.714% 100.000% ** DB Stats ** Uptime(secs): 58.8 total, 3.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 150.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.571 H:M:S, 53.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 292.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.440 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.446 micros/op 155127 ops/sec 60.228 seconds 9342999 operations; 150.3 MB/s Microseconds per write: Count: 9342999 Average: 6.4463 StdDev: 476.20 Min: 0 Median: 1.8308 Max: 712737 Percentiles: P50: 1.83 P75: 3.14 P99: 9.42 P99.9: 1205.27 P99.99: 2801.16 ------------------------------------------------------ [ 0, 1 ] 1090581 11.673% 11.673% ## ( 1, 2 ] 4310300 46.134% 57.807% ######### ( 2, 3 ] 1426085 15.264% 73.070% ### ( 3, 4 ] 1289132 13.798% 86.868% ### ( 4, 6 ] 1008751 10.797% 97.665% ## ( 6, 10 ] 145851 1.561% 99.226% ( 10, 15 ] 32441 0.347% 99.573% ( 15, 22 ] 9446 0.101% 99.674% ( 22, 34 ] 2495 0.027% 99.701% ( 34, 51 ] 409 0.004% 99.706% ( 51, 76 ] 53 0.001% 99.706% ( 76, 110 ] 9 0.000% 99.706% ( 110, 170 ] 8597 0.092% 99.798% ( 170, 250 ] 665 0.007% 99.805% ( 250, 380 ] 175 0.002% 99.807% ( 380, 580 ] 37 0.000% 99.808% ( 580, 870 ] 39 0.000% 99.808% ( 870, 1300 ] 11017 0.118% 99.926% ( 1300, 1900 ] 71 0.001% 99.927% ( 1900, 2900 ] 6559 0.070% 99.997% ( 2900, 4400 ] 174 0.002% 99.999% ( 4400, 6600 ] 59 0.001% 99.999% ( 6600, 9900 ] 30 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 197465 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9342999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9641974968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 590 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32083932 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32757756478 rocksdb.compact.write.bytes COUNT : 32549858238 rocksdb.flush.write.bytes COUNT : 9578287223 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 66 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 340 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9501081600 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3716096 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32854849489 rocksdb.non.last.level.read.count COUNT : 7936136 rocksdb.block.checksum.compute.count COUNT : 7935022 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.488372 P95 : 4.964661 P99 : 8.489903 P100 : 712735.000000 COUNT : 9342999 SUM : 55773812 rocksdb.compaction.times.micros P50 : 973333.333333 P95 : 4520000.000000 P99 : 22220000.000000 P100 : 24389050.000000 COUNT : 98 SUM : 170426591 rocksdb.compaction.times.cpu_micros P50 : 570000.000000 P95 : 4410000.000000 P99 : 22123495.000000 P100 : 22123495.000000 COUNT : 98 SUM : 136622715 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 725.000000 P95 : 3175.000000 P99 : 11355.500000 P100 : 12185.000000 COUNT : 129 SUM : 127449 rocksdb.compaction.outfile.sync.micros P50 : 1198.823529 P95 : 9836.129032 P99 : 13334.888889 P100 : 15071.000000 COUNT : 392 SUM : 1022842 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 152.750000 P95 : 2605.555556 P99 : 4300.625000 P100 : 7634.000000 COUNT : 253 SUM : 119900 rocksdb.table.open.io.micros P50 : 1638.297872 P95 : 9596.052632 P99 : 13483.043478 P100 : 19305.000000 COUNT : 590 SUM : 1532313 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.881177 P95 : 8.710657 P99 : 13.646436 P100 : 10064.000000 COUNT : 7933543 SUM : 61191871 rocksdb.read.block.get.micros P50 : 514.285714 P95 : 4029.213483 P99 : 6080.000000 P100 : 7144.000000 COUNT : 1180 SUM : 1207236 rocksdb.write.raw.block.micros P50 : 0.532996 P95 : 1.287282 P99 : 3.646523 P100 : 13417.000000 COUNT : 10205092 SUM : 23766960 rocksdb.numfiles.in.singlecompaction P50 : 2.833333 P95 : 5.933333 P99 : 18.920000 P100 : 37.000000 COUNT : 144 SUM : 505 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564125 P95 : 1258.210388 P99 : 2694.642421 P100 : 712517.000000 COUNT : 158086 SUM : 32098029 rocksdb.sst.read.micros P50 : 1.712341 P95 : 5.166884 P99 : 9.612221 P100 : 10059.000000 COUNT : 7936720 SUM : 43628891 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9342999 SUM : 9641974968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 218380.952381 P95 : 518277.777778 P99 : 831966.666667 P100 : 862460.000000 COUNT : 129 SUM : 30694434 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 368 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0