[2024-07-12 23:35:38.007826] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 22.11.4 initialization... [2024-07-12 23:35:38.008094] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2850843 ] Set seed to 1720820138001399 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-12 23:35:38.103068] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-12 23:35:38.140796] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-12 23:35:38.140842] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2850843' to capture a snapshot of events at runtime. [2024-07-12 23:35:38.140852] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-12 23:35:38.140865] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-12 23:35:38.140873] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2850843 for offline analysis/debug. [2024-07-12 23:35:38.140999] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 12 23:35:42 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/12-23:35:45 ... thread 0: (1000000,1000000) ops and (360317.1,360317.1) ops/second in (2.775333,2.775333) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.04 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 352.4 2.32 2.10 12 0.194 0 0 0.0 0.0 L2 3/2 251.75 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 L3 12/0 993.35 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 99.4 314.9 3.80 3.53 14 0.271 383K 196 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 99.4 314.9 3.80 3.53 14 0.271 383K 196 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 352.4 2.32 2.10 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 403.91 MB/s write, 0.37 GB read, 127.55 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 430.98 MB/s write, 0.37 GB read, 136.10 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 103028 Average: 1.8590 StdDev: 17.13 Min: 0 Median: 1.2068 Max: 3930 Percentiles: P50: 1.21 P75: 1.65 P99: 3.72 P99.9: 8.65 P99.99: 346.13 ------------------------------------------------------ [ 0, 1 ] 39385 38.227% 38.227% ######## ( 1, 2 ] 58665 56.941% 95.168% ########### ( 2, 3 ] 3191 3.097% 98.266% # ( 3, 4 ] 1047 1.016% 99.282% ( 4, 6 ] 530 0.514% 99.796% ( 6, 10 ] 163 0.158% 99.954% ( 10, 15 ] 13 0.013% 99.967% ( 15, 22 ] 8 0.008% 99.975% ( 22, 34 ] 3 0.003% 99.978% ( 110, 170 ] 9 0.009% 99.986% ( 170, 250 ] 1 0.001% 99.987% ( 250, 380 ] 5 0.005% 99.992% ( 580, 870 ] 3 0.003% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 48844 Average: 2.0114 StdDev: 21.14 Min: 1 Median: 1.2695 Max: 3313 Percentiles: P50: 1.27 P75: 1.70 P99: 4.94 P99.9: 9.84 P99.99: 596.76 ------------------------------------------------------ [ 0, 1 ] 16690 34.170% 34.170% ####### ( 1, 2 ] 28690 58.738% 92.908% ############ ( 2, 3 ] 1991 4.076% 96.984% # ( 3, 4 ] 741 1.517% 98.501% ( 4, 6 ] 516 1.056% 99.558% ( 6, 10 ] 174 0.356% 99.914% ( 10, 15 ] 21 0.043% 99.957% ( 15, 22 ] 8 0.016% 99.973% ( 34, 51 ] 1 0.002% 99.975% ( 51, 76 ] 2 0.004% 99.980% ( 170, 250 ] 1 0.002% 99.982% ( 250, 380 ] 4 0.008% 99.990% ( 580, 870 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1517.5455 StdDev: 1130.27 Min: 59 Median: 1415.3846 Max: 4543 Percentiles: P50: 1415.38 P75: 2261.11 P99: 4543.00 P99.9: 4543.00 P99.99: 4543.00 ------------------------------------------------------ ( 51, 76 ] 1 1.818% 1.818% ( 110, 170 ] 1 1.818% 3.636% ( 170, 250 ] 4 7.273% 10.909% # ( 250, 380 ] 2 3.636% 14.545% # ( 380, 580 ] 9 16.364% 30.909% ### ( 580, 870 ] 4 7.273% 38.182% # ( 870, 1300 ] 4 7.273% 45.455% # ( 1300, 1900 ] 13 23.636% 69.091% ##### ( 1900, 2900 ] 9 16.364% 85.455% ### ( 2900, 4400 ] 6 10.909% 96.364% ## ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 1540.1500 StdDev: 1662.35 Min: 163 Median: 870.0000 Max: 6132 Percentiles: P50: 870.00 P75: 1700.00 P99: 6132.00 P99.9: 6132.00 P99.99: 6132.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 250, 380 ] 2 10.000% 15.000% ## ( 380, 580 ] 4 20.000% 35.000% #### ( 580, 870 ] 3 15.000% 50.000% ### ( 870, 1300 ] 3 15.000% 65.000% ### ( 1300, 1900 ] 3 15.000% 80.000% ### ( 2900, 4400 ] 2 10.000% 90.000% ## ( 4400, 6600 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 332.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.230 H:M:S, 7.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 354.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.230 H:M:S, 8.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-23:35:48 ... thread 0: (1000000,2000000) ops and (326864.6,342776.6) ops/second in (3.059371,5.834704) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.17 GB 62.9 0.6 0.0 0.6 2.3 1.8 0.0 1.3 76.8 324.4 7.38 6.77 28 0.264 575K 621 0.0 0.0 L1 1/0 3.78 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.8 237.4 1.59 1.54 1 1.590 383K 600 0.0 0.0 L2 2/1 53.50 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 L3 18/8 1.00 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 234.2 234.2 1.06 1.00 1 1.064 253K 0 0.0 0.0 L4 173/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 150.6 150.6 1.49 1.11 1 1.486 227K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/17 97.92 GB 0.0 1.8 1.0 0.7 3.5 2.8 1.8 2.0 138.2 278.7 12.99 11.85 33 0.394 1823K 1417 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 1.0 0.7 3.5 2.8 1.7 2.0 138.2 278.7 12.99 11.85 33 0.394 1823K 1417 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 1.0 0.7 1.8 1.0 0.0 0.0 230.4 230.2 7.80 7.22 7 1.114 1823K 1417 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.4 5.20 4.63 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.54 GB write, 601.34 MB/s write, 1.75 GB read, 298.21 MB/s read, 13.0 seconds Interval compaction: 3.54 GB write, 620.52 MB/s write, 1.75 GB read, 307.72 MB/s read, 13.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389819 Average: 2.2032 StdDev: 10.91 Min: 0 Median: 1.4960 Max: 3930 Percentiles: P50: 1.50 P75: 1.88 P99: 5.65 P99.9: 9.91 P99.99: 14.67 ------------------------------------------------------ [ 0, 1 ] 70283 18.030% 18.030% #### ( 1, 2 ] 251242 64.451% 82.481% ############# ( 2, 3 ] 41670 10.690% 93.170% ## ( 3, 4 ] 14456 3.708% 96.879% # ( 4, 6 ] 10048 2.578% 99.456% # ( 6, 10 ] 1773 0.455% 99.911% ( 10, 15 ] 331 0.085% 99.996% ( 15, 22 ] 27 0.007% 100.003% ( 22, 34 ] 7 0.002% 100.005% ( 34, 51 ] 1 0.000% 100.005% ( 51, 76 ] 1 0.000% 100.005% ( 110, 170 ] 15 0.004% 100.009% ( 170, 250 ] 8 0.002% 100.011% ( 250, 380 ] 13 0.003% 100.014% ( 380, 580 ] 1 0.000% 100.015% ( 580, 870 ] 7 0.002% 100.016% ( 870, 1300 ] 6 0.002% 100.018% ( 1300, 1900 ] 3 0.001% 100.019% ( 1900, 2900 ] 2 0.001% 100.019% ( 2900, 4400 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 25 Average: 174.6400 StdDev: 331.37 Min: 1 Median: 1.7500 Max: 1377 Percentiles: P50: 1.75 P75: 230.00 P99: 1377.00 P99.9: 1377.00 P99.99: 1377.00 ------------------------------------------------------ [ 0, 1 ] 8 32.000% 32.000% ###### ( 1, 2 ] 6 24.000% 56.000% ##### ( 2, 3 ] 2 8.000% 64.000% ## ( 4, 6 ] 1 4.000% 68.000% # ( 110, 170 ] 1 4.000% 72.000% # ( 170, 250 ] 1 4.000% 76.000% # ( 250, 380 ] 2 8.000% 84.000% ## ( 380, 580 ] 1 4.000% 88.000% # ( 580, 870 ] 2 8.000% 96.000% ## ( 1300, 1900 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 95756 Average: 2.1157 StdDev: 15.11 Min: 1 Median: 1.4201 Max: 3313 Percentiles: P50: 1.42 P75: 1.81 P99: 5.56 P99.9: 9.91 P99.99: 203.95 ------------------------------------------------------ [ 0, 1 ] 22388 23.380% 23.380% ##### ( 1, 2 ] 60677 63.366% 86.747% ############# ( 2, 3 ] 7425 7.754% 94.501% ## ( 3, 4 ] 2739 2.860% 97.361% # ( 4, 6 ] 2018 2.107% 99.468% ( 6, 10 ] 423 0.442% 99.910% ( 10, 15 ] 56 0.058% 99.969% ( 15, 22 ] 14 0.015% 99.983% ( 22, 34 ] 3 0.003% 99.986% ( 34, 51 ] 1 0.001% 99.987% ( 51, 76 ] 2 0.002% 99.990% ( 170, 250 ] 1 0.001% 99.991% ( 250, 380 ] 4 0.004% 99.995% ( 580, 870 ] 2 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 168201 Average: 3.5840 StdDev: 37.91 Min: 1 Median: 1.7378 Max: 4543 Percentiles: P50: 1.74 P75: 2.42 P99: 8.88 P99.9: 161.40 P99.99: 523.05 ------------------------------------------------------ [ 0, 1 ] 8777 5.218% 5.218% # ( 1, 2 ] 102095 60.698% 65.916% ############ ( 2, 3 ] 36080 21.451% 87.367% #### ( 3, 4 ] 9379 5.576% 92.943% # ( 4, 6 ] 8169 4.857% 97.800% # ( 6, 10 ] 2804 1.667% 99.467% ( 10, 15 ] 429 0.255% 99.722% ( 15, 22 ] 90 0.054% 99.775% ( 22, 34 ] 20 0.012% 99.787% ( 34, 51 ] 1 0.001% 99.788% ( 51, 76 ] 2 0.001% 99.789% ( 76, 110 ] 73 0.043% 99.832% ( 110, 170 ] 134 0.080% 99.912% ( 170, 250 ] 65 0.039% 99.951% ( 250, 380 ] 40 0.024% 99.974% ( 380, 580 ] 38 0.023% 99.997% ( 580, 870 ] 24 0.014% 100.011% ( 870, 1300 ] 11 0.007% 100.018% ( 1300, 1900 ] 14 0.008% 100.026% ( 1900, 2900 ] 9 0.005% 100.032% ( 2900, 4400 ] 7 0.004% 100.036% ( 4400, 6600 ] 2 0.001% 100.037% ** Level 4 read latency histogram (micros): Count: 305 Average: 107.1803 StdDev: 570.84 Min: 0 Median: 1.9087 Max: 6132 Percentiles: P50: 1.91 P75: 6.21 P99: 3612.50 P99.9: 6132.00 P99.99: 6132.00 ------------------------------------------------------ [ 0, 1 ] 58 19.016% 19.016% #### ( 1, 2 ] 104 34.098% 53.115% ####### ( 2, 3 ] 46 15.082% 68.197% ### ( 3, 4 ] 12 3.934% 72.131% # ( 4, 6 ] 8 2.623% 74.754% # ( 6, 10 ] 14 4.590% 79.344% # ( 10, 15 ] 26 8.525% 87.869% ## ( 15, 22 ] 14 4.590% 92.459% # ( 110, 170 ] 2 0.656% 93.115% ( 170, 250 ] 1 0.328% 93.443% ( 250, 380 ] 3 0.984% 94.426% ( 380, 580 ] 4 1.311% 95.738% ( 580, 870 ] 3 0.984% 96.721% ( 870, 1300 ] 3 0.984% 97.705% ( 1300, 1900 ] 3 0.984% 98.689% ( 2900, 4400 ] 2 0.656% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 999.8500 StdDev: 1323.61 Min: 80 Median: 250.0000 Max: 4867 Percentiles: P50: 250.00 P75: 1600.00 P99: 4867.00 P99.9: 4867.00 P99.99: 4867.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 4 20.000% 45.000% #### ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 1 5.000% 55.000% # ( 580, 870 ] 2 10.000% 65.000% ## ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 326.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.643 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.413 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/12-23:35:51 ... thread 0: (1000000,3000000) ops and (328542.0,337896.6) ops/second in (3.043751,8.878455) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 2.15 GB 25.2 1.4 0.0 1.4 4.1 2.8 0.0 1.5 104.0 316.5 13.33 12.35 45 0.296 1407K 1518 0.0 0.0 L1 1/1 3.78 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.8 237.4 1.59 1.54 1 1.590 383K 600 0.0 0.0 L2 1/0 50.95 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 L3 12/0 512.18 MB 0.5 0.9 0.2 0.7 0.9 0.2 0.4 3.7 226.9 226.5 4.10 3.83 2 2.049 944K 1780 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 150.6 150.6 1.49 1.11 1 1.486 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/16 98.90 GB 0.0 3.2 1.0 2.2 6.0 3.8 2.9 2.2 149.9 278.7 21.98 20.26 51 0.431 3346K 4094 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.0 2.2 6.0 3.8 2.8 2.2 149.9 278.7 21.98 20.26 51 0.431 3346K 4094 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.0 2.2 3.2 1.0 0.0 0.0 236.1 235.8 13.96 13.11 11 1.269 3346K 4094 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 353.5 8.02 7.15 40 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.98 GB write, 675.77 MB/s write, 3.22 GB read, 363.54 MB/s read, 22.0 seconds Interval compaction: 5.98 GB write, 689.94 MB/s write, 3.22 GB read, 371.15 MB/s read, 22.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 706857 Average: 2.1761 StdDev: 10.54 Min: 0 Median: 1.4955 Max: 3930 Percentiles: P50: 1.50 P75: 1.87 P99: 5.49 P99.9: 9.68 P99.99: 14.46 ------------------------------------------------------ [ 0, 1 ] 119837 16.953% 16.953% ### ( 1, 2 ] 471427 66.693% 83.647% ############# ( 2, 3 ] 74044 10.475% 94.122% ## ( 3, 4 ] 23409 3.312% 97.434% # ( 4, 6 ] 14847 2.100% 99.534% ( 6, 10 ] 2810 0.398% 99.932% ( 10, 15 ] 463 0.066% 99.997% ( 15, 22 ] 41 0.006% 100.003% ( 22, 34 ] 12 0.002% 100.005% ( 34, 51 ] 2 0.000% 100.005% ( 51, 76 ] 7 0.001% 100.006% ( 110, 170 ] 24 0.003% 100.009% ( 170, 250 ] 11 0.002% 100.011% ( 250, 380 ] 19 0.003% 100.014% ( 380, 580 ] 4 0.001% 100.014% ( 580, 870 ] 11 0.002% 100.016% ( 870, 1300 ] 10 0.001% 100.017% ( 1300, 1900 ] 6 0.001% 100.018% ( 1900, 2900 ] 3 0.000% 100.018% ( 2900, 4400 ] 2 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 26 Average: 168.0000 StdDev: 326.63 Min: 1 Median: 1.7143 Max: 1377 Percentiles: P50: 1.71 P75: 210.00 P99: 1377.00 P99.9: 1377.00 P99.99: 1377.00 ------------------------------------------------------ [ 0, 1 ] 8 30.769% 30.769% ###### ( 1, 2 ] 7 26.923% 57.692% ##### ( 2, 3 ] 2 7.692% 65.385% ## ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 2 7.692% 84.615% ## ( 380, 580 ] 1 3.846% 88.462% # ( 580, 870 ] 2 7.692% 96.154% ## ( 1300, 1900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 124216 Average: 2.2013 StdDev: 13.87 Min: 1 Median: 1.4475 Max: 3313 Percentiles: P50: 1.45 P75: 1.83 P99: 5.82 P99.9: 12.78 P99.99: 262.53 ------------------------------------------------------ [ 0, 1 ] 26135 21.040% 21.040% #### ( 1, 2 ] 80381 64.711% 85.751% ############# ( 2, 3 ] 10701 8.615% 94.365% ## ( 3, 4 ] 3566 2.871% 97.236% # ( 4, 6 ] 2408 1.939% 99.175% ( 6, 10 ] 863 0.695% 99.870% ( 10, 15 ] 68 0.055% 99.924% ( 15, 22 ] 14 0.011% 99.936% ( 22, 34 ] 3 0.002% 99.938% ( 34, 51 ] 1 0.001% 99.939% ( 51, 76 ] 3 0.002% 99.941% ( 76, 110 ] 26 0.021% 99.962% ( 110, 170 ] 31 0.025% 99.987% ( 170, 250 ] 3 0.002% 99.990% ( 250, 380 ] 6 0.005% 99.994% ( 580, 870 ] 4 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 200773 Average: 3.5763 StdDev: 36.05 Min: 1 Median: 1.7120 Max: 4543 Percentiles: P50: 1.71 P75: 2.35 P99: 8.88 P99.9: 189.73 P99.99: 579.72 ------------------------------------------------------ [ 0, 1 ] 11825 5.890% 5.890% # ( 1, 2 ] 124391 61.956% 67.846% ############ ( 2, 3 ] 40697 20.270% 88.116% #### ( 3, 4 ] 10591 5.275% 93.391% # ( 4, 6 ] 8846 4.406% 97.797% # ( 6, 10 ] 3349 1.668% 99.465% ( 10, 15 ] 459 0.229% 99.694% ( 15, 22 ] 93 0.046% 99.740% ( 22, 34 ] 20 0.010% 99.750% ( 34, 51 ] 1 0.000% 99.750% ( 51, 76 ] 2 0.001% 99.751% ( 76, 110 ] 73 0.036% 99.788% ( 110, 170 ] 205 0.102% 99.890% ( 170, 250 ] 82 0.041% 99.931% ( 250, 380 ] 64 0.032% 99.963% ( 380, 580 ] 55 0.027% 99.990% ( 580, 870 ] 32 0.016% 100.006% ( 870, 1300 ] 16 0.008% 100.014% ( 1300, 1900 ] 15 0.007% 100.021% ( 1900, 2900 ] 9 0.004% 100.026% ( 2900, 4400 ] 7 0.003% 100.029% ( 4400, 6600 ] 2 0.001% 100.030% ** Level 4 read latency histogram (micros): Count: 305 Average: 107.1803 StdDev: 570.84 Min: 0 Median: 1.9087 Max: 6132 Percentiles: P50: 1.91 P75: 6.21 P99: 3612.50 P99.9: 6132.00 P99.99: 6132.00 ------------------------------------------------------ [ 0, 1 ] 58 19.016% 19.016% #### ( 1, 2 ] 104 34.098% 53.115% ####### ( 2, 3 ] 46 15.082% 68.197% ### ( 3, 4 ] 12 3.934% 72.131% # ( 4, 6 ] 8 2.623% 74.754% # ( 6, 10 ] 14 4.590% 79.344% # ( 10, 15 ] 26 8.525% 87.869% ## ( 15, 22 ] 14 4.590% 92.459% # ( 110, 170 ] 2 0.656% 93.115% ( 170, 250 ] 1 0.328% 93.443% ( 250, 380 ] 3 0.984% 94.426% ( 380, 580 ] 4 1.311% 95.738% ( 580, 870 ] 3 0.984% 96.721% ( 870, 1300 ] 3 0.984% 97.705% ( 1300, 1900 ] 3 0.984% 98.689% ( 2900, 4400 ] 2 0.656% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 885.2000 StdDev: 1140.30 Min: 80 Median: 218.0000 Max: 4867 Percentiles: P50: 218.00 P75: 1300.00 P99: 4867.00 P99.9: 4867.00 P99.99: 4867.00 ------------------------------------------------------ ( 76, 110 ] 13 21.667% 21.667% #### ( 110, 170 ] 14 23.333% 45.000% ##### ( 170, 250 ] 5 8.333% 53.333% ## ( 250, 380 ] 3 5.000% 58.333% # ( 380, 580 ] 1 1.667% 60.000% ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 4 6.667% 75.000% # ( 1300, 1900 ] 2 3.333% 78.333% # ( 1900, 2900 ] 8 13.333% 91.667% ### ( 2900, 4400 ] 4 6.667% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 325.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.045 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.402 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/12-23:35:54 ... thread 0: (1000000,4000000) ops and (327747.2,335300.8) ops/second in (3.051132,11.929587) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 3.07 GB 144.7 2.5 0.0 2.5 6.1 3.7 0.0 1.7 124.0 309.9 20.32 18.94 62 0.328 2558K 2755 0.0 0.0 L1 1/1 3.78 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.8 237.4 1.59 1.54 1 1.590 383K 600 0.0 0.0 L2 1/0 50.95 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 L3 12/0 512.18 MB 0.5 0.9 0.2 0.7 0.9 0.2 0.4 3.7 226.9 226.5 4.10 3.83 2 2.049 944K 1780 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 150.6 150.6 1.49 1.11 1 1.486 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/12 99.82 GB 0.0 4.3 1.0 3.3 8.0 4.7 2.9 2.2 152.9 283.2 28.97 26.84 68 0.426 4498K 5331 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.0 3.3 8.0 4.7 2.8 2.2 152.9 283.2 28.97 26.84 68 0.426 4498K 5331 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.0 3.3 4.3 1.0 0.0 0.0 241.9 241.6 18.31 17.36 15 1.221 4498K 5331 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 354.6 10.66 9.48 53 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.01 GB write, 677.07 MB/s write, 4.33 GB read, 365.58 MB/s read, 29.0 seconds Interval compaction: 8.01 GB write, 687.63 MB/s write, 4.33 GB read, 371.28 MB/s read, 29.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1140614 Average: 2.2224 StdDev: 9.79 Min: 0 Median: 1.5196 Max: 3930 Percentiles: P50: 1.52 P75: 1.89 P99: 5.57 P99.9: 9.73 P99.99: 14.06 ------------------------------------------------------ [ 0, 1 ] 171140 15.004% 15.004% ### ( 1, 2 ] 768165 67.347% 82.351% ############# ( 2, 3 ] 130773 11.465% 93.816% ## ( 3, 4 ] 39734 3.484% 97.300% # ( 4, 6 ] 24766 2.171% 99.471% ( 6, 10 ] 5247 0.460% 99.931% ( 10, 15 ] 834 0.073% 100.004% ( 15, 22 ] 54 0.005% 100.009% ( 22, 34 ] 18 0.002% 100.010% ( 34, 51 ] 5 0.000% 100.011% ( 51, 76 ] 11 0.001% 100.012% ( 76, 110 ] 32 0.003% 100.014% ( 110, 170 ] 55 0.005% 100.019% ( 170, 250 ] 32 0.003% 100.022% ( 250, 380 ] 30 0.003% 100.025% ( 380, 580 ] 16 0.001% 100.026% ( 580, 870 ] 20 0.002% 100.028% ( 870, 1300 ] 18 0.002% 100.029% ( 1300, 1900 ] 9 0.001% 100.030% ( 1900, 2900 ] 4 0.000% 100.031% ( 2900, 4400 ] 2 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 26 Average: 168.0000 StdDev: 326.63 Min: 1 Median: 1.7143 Max: 1377 Percentiles: P50: 1.71 P75: 210.00 P99: 1377.00 P99.9: 1377.00 P99.99: 1377.00 ------------------------------------------------------ [ 0, 1 ] 8 30.769% 30.769% ###### ( 1, 2 ] 7 26.923% 57.692% ##### ( 2, 3 ] 2 7.692% 65.385% ## ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 2 7.692% 84.615% ## ( 380, 580 ] 1 3.846% 88.462% # ( 580, 870 ] 2 7.692% 96.154% ## ( 1300, 1900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 124216 Average: 2.2013 StdDev: 13.87 Min: 1 Median: 1.4475 Max: 3313 Percentiles: P50: 1.45 P75: 1.83 P99: 5.82 P99.9: 12.78 P99.99: 262.53 ------------------------------------------------------ [ 0, 1 ] 26135 21.040% 21.040% #### ( 1, 2 ] 80381 64.711% 85.751% ############# ( 2, 3 ] 10701 8.615% 94.365% ## ( 3, 4 ] 3566 2.871% 97.236% # ( 4, 6 ] 2408 1.939% 99.175% ( 6, 10 ] 863 0.695% 99.870% ( 10, 15 ] 68 0.055% 99.924% ( 15, 22 ] 14 0.011% 99.936% ( 22, 34 ] 3 0.002% 99.938% ( 34, 51 ] 1 0.001% 99.939% ( 51, 76 ] 3 0.002% 99.941% ( 76, 110 ] 26 0.021% 99.962% ( 110, 170 ] 31 0.025% 99.987% ( 170, 250 ] 3 0.002% 99.990% ( 250, 380 ] 6 0.005% 99.994% ( 580, 870 ] 4 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 200773 Average: 3.5763 StdDev: 36.05 Min: 1 Median: 1.7120 Max: 4543 Percentiles: P50: 1.71 P75: 2.35 P99: 8.88 P99.9: 189.73 P99.99: 579.72 ------------------------------------------------------ [ 0, 1 ] 11825 5.890% 5.890% # ( 1, 2 ] 124391 61.956% 67.846% ############ ( 2, 3 ] 40697 20.270% 88.116% #### ( 3, 4 ] 10591 5.275% 93.391% # ( 4, 6 ] 8846 4.406% 97.797% # ( 6, 10 ] 3349 1.668% 99.465% ( 10, 15 ] 459 0.229% 99.694% ( 15, 22 ] 93 0.046% 99.740% ( 22, 34 ] 20 0.010% 99.750% ( 34, 51 ] 1 0.000% 99.750% ( 51, 76 ] 2 0.001% 99.751% ( 76, 110 ] 73 0.036% 99.788% ( 110, 170 ] 205 0.102% 99.890% ( 170, 250 ] 82 0.041% 99.931% ( 250, 380 ] 64 0.032% 99.963% ( 380, 580 ] 55 0.027% 99.990% ( 580, 870 ] 32 0.016% 100.006% ( 870, 1300 ] 16 0.008% 100.014% ( 1300, 1900 ] 15 0.007% 100.021% ( 1900, 2900 ] 9 0.004% 100.026% ( 2900, 4400 ] 7 0.003% 100.029% ( 4400, 6600 ] 2 0.001% 100.030% ** Level 4 read latency histogram (micros): Count: 305 Average: 107.1803 StdDev: 570.84 Min: 0 Median: 1.9087 Max: 6132 Percentiles: P50: 1.91 P75: 6.21 P99: 3612.50 P99.9: 6132.00 P99.99: 6132.00 ------------------------------------------------------ [ 0, 1 ] 58 19.016% 19.016% #### ( 1, 2 ] 104 34.098% 53.115% ####### ( 2, 3 ] 46 15.082% 68.197% ### ( 3, 4 ] 12 3.934% 72.131% # ( 4, 6 ] 8 2.623% 74.754% # ( 6, 10 ] 14 4.590% 79.344% # ( 10, 15 ] 26 8.525% 87.869% ## ( 15, 22 ] 14 4.590% 92.459% # ( 110, 170 ] 2 0.656% 93.115% ( 170, 250 ] 1 0.328% 93.443% ( 250, 380 ] 3 0.984% 94.426% ( 380, 580 ] 4 1.311% 95.738% ( 580, 870 ] 3 0.984% 96.721% ( 870, 1300 ] 3 0.984% 97.705% ( 1300, 1900 ] 3 0.984% 98.689% ( 2900, 4400 ] 2 0.656% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 885.2000 StdDev: 1140.30 Min: 80 Median: 218.0000 Max: 4867 Percentiles: P50: 218.00 P75: 1300.00 P99: 4867.00 P99.9: 4867.00 P99.99: 4867.00 ------------------------------------------------------ ( 76, 110 ] 13 21.667% 21.667% #### ( 110, 170 ] 14 23.333% 45.000% ##### ( 170, 250 ] 5 8.333% 53.333% ## ( 250, 380 ] 3 5.000% 58.333% # ( 380, 580 ] 1 1.667% 60.000% ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 4 6.667% 75.000% # ( 1300, 1900 ] 2 3.333% 78.333% # ( 1900, 2900 ] 8 13.333% 91.667% ### ( 2900, 4400 ] 4 6.667% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 12.1 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.437 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.392 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-23:35:57 ... thread 0: (1000000,5000000) ops and (328832.0,333986.7) ops/second in (3.041067,14.970654) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 2.70 GB 12.6 3.3 0.0 3.3 7.9 4.7 0.0 1.7 127.8 310.8 26.13 24.41 80 0.327 3390K 3545 0.0 0.0 L1 12/12 1.35 GB 0.0 1.7 1.7 0.0 1.7 1.7 0.2 1.0 232.7 231.5 7.59 7.34 2 3.795 1793K 8794 0.0 0.0 L2 1/0 50.95 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 L3 12/0 512.18 MB 0.5 0.9 0.2 0.7 0.9 0.2 0.4 3.7 226.9 226.5 4.10 3.83 2 2.049 944K 1780 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 150.6 150.6 1.49 1.11 1 1.486 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/27 100.80 GB 0.0 6.5 2.4 4.1 11.1 7.0 2.9 2.4 162.7 279.8 40.78 38.11 87 0.469 6739K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 2.4 4.1 11.1 7.0 2.8 2.4 162.7 279.8 40.78 38.11 87 0.469 6739K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 2.4 4.1 6.5 2.4 0.0 0.0 242.7 242.1 27.35 26.15 19 1.440 6739K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.4 13.43 11.96 68 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.0 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.14 GB write, 752.75 MB/s write, 6.48 GB read, 437.86 MB/s read, 40.8 seconds Interval compaction: 11.14 GB write, 762.11 MB/s write, 6.48 GB read, 443.30 MB/s read, 40.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 16, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1395085 Average: 2.2225 StdDev: 11.02 Min: 0 Median: 1.5002 Max: 3930 Percentiles: P50: 1.50 P75: 1.87 P99: 5.54 P99.9: 9.90 P99.99: 18.12 ------------------------------------------------------ [ 0, 1 ] 231363 16.584% 16.584% ### ( 1, 2 ] 931939 66.802% 83.386% ############# ( 2, 3 ] 150236 10.769% 94.155% ## ( 3, 4 ] 46006 3.298% 97.452% # ( 4, 6 ] 27989 2.006% 99.459% ( 6, 10 ] 6310 0.452% 99.911% ( 10, 15 ] 1071 0.077% 99.988% ( 15, 22 ] 73 0.005% 99.993% ( 22, 34 ] 19 0.001% 99.994% ( 34, 51 ] 9 0.001% 99.995% ( 51, 76 ] 12 0.001% 99.996% ( 76, 110 ] 107 0.008% 100.004% ( 110, 170 ] 146 0.010% 100.014% ( 170, 250 ] 69 0.005% 100.019% ( 250, 380 ] 51 0.004% 100.023% ( 380, 580 ] 29 0.002% 100.025% ( 580, 870 ] 26 0.002% 100.027% ( 870, 1300 ] 24 0.002% 100.028% ( 1300, 1900 ] 11 0.001% 100.029% ( 1900, 2900 ] 7 0.001% 100.030% ( 2900, 4400 ] 4 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 19306 Average: 4.2511 StdDev: 41.23 Min: 0 Median: 1.3161 Max: 2086 Percentiles: P50: 1.32 P75: 1.73 P99: 9.75 P99.9: 634.58 P99.99: 1788.33 ------------------------------------------------------ [ 0, 1 ] 5929 30.711% 30.711% ###### ( 1, 2 ] 11780 61.017% 91.728% ############ ( 2, 3 ] 746 3.864% 95.592% # ( 3, 4 ] 252 1.305% 96.897% ( 4, 6 ] 225 1.165% 98.063% ( 6, 10 ] 193 1.000% 99.062% ( 10, 15 ] 21 0.109% 99.171% ( 15, 22 ] 1 0.005% 99.176% ( 22, 34 ] 1 0.005% 99.182% ( 34, 51 ] 1 0.005% 99.187% ( 51, 76 ] 11 0.057% 99.244% ( 76, 110 ] 50 0.259% 99.503% ( 110, 170 ] 31 0.161% 99.663% ( 170, 250 ] 12 0.062% 99.725% ( 250, 380 ] 18 0.093% 99.819% ( 380, 580 ] 14 0.073% 99.891% ( 580, 870 ] 9 0.047% 99.938% ( 870, 1300 ] 6 0.031% 99.969% ( 1300, 1900 ] 5 0.026% 99.995% ( 1900, 2900 ] 1 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 124216 Average: 2.2013 StdDev: 13.87 Min: 1 Median: 1.4475 Max: 3313 Percentiles: P50: 1.45 P75: 1.83 P99: 5.82 P99.9: 12.78 P99.99: 262.53 ------------------------------------------------------ [ 0, 1 ] 26135 21.040% 21.040% #### ( 1, 2 ] 80381 64.711% 85.751% ############# ( 2, 3 ] 10701 8.615% 94.365% ## ( 3, 4 ] 3566 2.871% 97.236% # ( 4, 6 ] 2408 1.939% 99.175% ( 6, 10 ] 863 0.695% 99.870% ( 10, 15 ] 68 0.055% 99.924% ( 15, 22 ] 14 0.011% 99.936% ( 22, 34 ] 3 0.002% 99.938% ( 34, 51 ] 1 0.001% 99.939% ( 51, 76 ] 3 0.002% 99.941% ( 76, 110 ] 26 0.021% 99.962% ( 110, 170 ] 31 0.025% 99.987% ( 170, 250 ] 3 0.002% 99.990% ( 250, 380 ] 6 0.005% 99.994% ( 580, 870 ] 4 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 200773 Average: 3.5763 StdDev: 36.05 Min: 1 Median: 1.7120 Max: 4543 Percentiles: P50: 1.71 P75: 2.35 P99: 8.88 P99.9: 189.73 P99.99: 579.72 ------------------------------------------------------ [ 0, 1 ] 11825 5.890% 5.890% # ( 1, 2 ] 124391 61.956% 67.846% ############ ( 2, 3 ] 40697 20.270% 88.116% #### ( 3, 4 ] 10591 5.275% 93.391% # ( 4, 6 ] 8846 4.406% 97.797% # ( 6, 10 ] 3349 1.668% 99.465% ( 10, 15 ] 459 0.229% 99.694% ( 15, 22 ] 93 0.046% 99.740% ( 22, 34 ] 20 0.010% 99.750% ( 34, 51 ] 1 0.000% 99.750% ( 51, 76 ] 2 0.001% 99.751% ( 76, 110 ] 73 0.036% 99.788% ( 110, 170 ] 205 0.102% 99.890% ( 170, 250 ] 82 0.041% 99.931% ( 250, 380 ] 64 0.032% 99.963% ( 380, 580 ] 55 0.027% 99.990% ( 580, 870 ] 32 0.016% 100.006% ( 870, 1300 ] 16 0.008% 100.014% ( 1300, 1900 ] 15 0.007% 100.021% ( 1900, 2900 ] 9 0.004% 100.026% ( 2900, 4400 ] 7 0.003% 100.029% ( 4400, 6600 ] 2 0.001% 100.030% ** Level 4 read latency histogram (micros): Count: 305 Average: 107.1803 StdDev: 570.84 Min: 0 Median: 1.9087 Max: 6132 Percentiles: P50: 1.91 P75: 6.21 P99: 3612.50 P99.9: 6132.00 P99.99: 6132.00 ------------------------------------------------------ [ 0, 1 ] 58 19.016% 19.016% #### ( 1, 2 ] 104 34.098% 53.115% ####### ( 2, 3 ] 46 15.082% 68.197% ### ( 3, 4 ] 12 3.934% 72.131% # ( 4, 6 ] 8 2.623% 74.754% # ( 6, 10 ] 14 4.590% 79.344% # ( 10, 15 ] 26 8.525% 87.869% ## ( 15, 22 ] 14 4.590% 92.459% # ( 110, 170 ] 2 0.656% 93.115% ( 170, 250 ] 1 0.328% 93.443% ( 250, 380 ] 3 0.984% 94.426% ( 380, 580 ] 4 1.311% 95.738% ( 580, 870 ] 3 0.984% 96.721% ( 870, 1300 ] 3 0.984% 97.705% ( 1300, 1900 ] 3 0.984% 98.689% ( 2900, 4400 ] 2 0.656% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 885.2000 StdDev: 1140.30 Min: 80 Median: 218.0000 Max: 4867 Percentiles: P50: 218.00 P75: 1300.00 P99: 4867.00 P99.9: 4867.00 P99.99: 4867.00 ------------------------------------------------------ ( 76, 110 ] 13 21.667% 21.667% #### ( 110, 170 ] 14 23.333% 45.000% ##### ( 170, 250 ] 5 8.333% 53.333% ## ( 250, 380 ] 3 5.000% 58.333% # ( 380, 580 ] 1 1.667% 60.000% ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 4 6.667% 75.000% # ( 1300, 1900 ] 2 3.333% 78.333% # ( 1900, 2900 ] 8 13.333% 91.667% ### ( 2900, 4400 ] 4 6.667% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 15.2 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 324.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.864 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.427 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-23:36:01 ... thread 0: (1000000,6000000) ops and (234698.5,311989.1) ops/second in (4.260785,19.231439) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 3.69 GB 138.5 4.3 0.0 4.3 10.0 5.7 0.0 1.8 134.0 310.0 32.91 30.84 99 0.332 4477K 4640 0.0 0.0 L1 12/12 1.35 GB 0.0 1.7 1.7 0.0 1.7 1.7 0.2 1.0 232.7 231.5 7.59 7.34 2 3.795 1793K 8794 0.0 0.0 L2 1/0 50.95 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 L3 12/0 512.18 MB 0.5 0.9 0.2 0.7 0.9 0.2 0.4 3.7 226.9 226.5 4.10 3.83 2 2.049 944K 1780 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 150.6 150.6 1.49 1.11 1 1.486 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/23 101.78 GB 0.0 7.5 2.4 5.2 13.2 8.0 2.9 2.3 162.1 283.6 47.56 44.54 106 0.449 7826K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.5 2.4 5.2 13.2 8.0 2.8 2.3 162.1 283.6 47.56 44.54 106 0.449 7826K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.5 2.4 5.2 7.5 2.4 0.0 0.0 246.0 245.5 31.33 30.07 23 1.362 7826K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 357.1 16.23 14.47 83 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.4 total, 19.2 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.17 GB write, 694.58 MB/s write, 7.53 GB read, 396.94 MB/s read, 47.6 seconds Interval compaction: 13.17 GB write, 701.31 MB/s write, 7.53 GB read, 400.78 MB/s read, 47.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 19, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1819123 Average: 2.2158 StdDev: 10.63 Min: 0 Median: 1.5006 Max: 3930 Percentiles: P50: 1.50 P75: 1.87 P99: 5.52 P99.9: 9.91 P99.99: 18.16 ------------------------------------------------------ [ 0, 1 ] 296892 16.321% 16.321% ### ( 1, 2 ] 1223841 67.276% 83.597% ############# ( 2, 3 ] 194628 10.699% 94.296% ## ( 3, 4 ] 59007 3.244% 97.540% # ( 4, 6 ] 34960 1.922% 99.462% ( 6, 10 ] 8161 0.449% 99.910% ( 10, 15 ] 1408 0.077% 99.988% ( 15, 22 ] 102 0.006% 99.993% ( 22, 34 ] 23 0.001% 99.994% ( 34, 51 ] 11 0.001% 99.995% ( 51, 76 ] 18 0.001% 99.996% ( 76, 110 ] 154 0.008% 100.005% ( 110, 170 ] 186 0.010% 100.015% ( 170, 250 ] 86 0.005% 100.019% ( 250, 380 ] 62 0.003% 100.023% ( 380, 580 ] 35 0.002% 100.025% ( 580, 870 ] 33 0.002% 100.027% ( 870, 1300 ] 32 0.002% 100.028% ( 1300, 1900 ] 13 0.001% 100.029% ( 1900, 2900 ] 8 0.000% 100.030% ( 2900, 4400 ] 5 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 110002 Average: 2.8409 StdDev: 19.75 Min: 0 Median: 1.4835 Max: 2086 Percentiles: P50: 1.48 P75: 1.86 P99: 8.26 P99.9: 179.14 P99.99: 992.84 ------------------------------------------------------ [ 0, 1 ] 19636 17.851% 17.851% #### ( 1, 2 ] 73141 66.491% 84.341% ############# ( 2, 3 ] 10536 9.578% 93.919% ## ( 3, 4 ] 2710 2.464% 96.383% ( 4, 6 ] 2054 1.867% 98.250% ( 6, 10 ] 1465 1.332% 99.582% ( 10, 15 ] 97 0.088% 99.670% ( 15, 22 ] 9 0.008% 99.678% ( 22, 34 ] 2 0.002% 99.680% ( 34, 51 ] 2 0.002% 99.682% ( 51, 76 ] 11 0.010% 99.692% ( 76, 110 ] 125 0.114% 99.805% ( 110, 170 ] 101 0.092% 99.897% ( 170, 250 ] 35 0.032% 99.929% ( 250, 380 ] 26 0.024% 99.953% ( 380, 580 ] 23 0.021% 99.974% ( 580, 870 ] 17 0.015% 99.989% ( 870, 1300 ] 7 0.006% 99.995% ( 1300, 1900 ] 5 0.005% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 124216 Average: 2.2013 StdDev: 13.87 Min: 1 Median: 1.4475 Max: 3313 Percentiles: P50: 1.45 P75: 1.83 P99: 5.82 P99.9: 12.78 P99.99: 262.53 ------------------------------------------------------ [ 0, 1 ] 26135 21.040% 21.040% #### ( 1, 2 ] 80381 64.711% 85.751% ############# ( 2, 3 ] 10701 8.615% 94.365% ## ( 3, 4 ] 3566 2.871% 97.236% # ( 4, 6 ] 2408 1.939% 99.175% ( 6, 10 ] 863 0.695% 99.870% ( 10, 15 ] 68 0.055% 99.924% ( 15, 22 ] 14 0.011% 99.936% ( 22, 34 ] 3 0.002% 99.938% ( 34, 51 ] 1 0.001% 99.939% ( 51, 76 ] 3 0.002% 99.941% ( 76, 110 ] 26 0.021% 99.962% ( 110, 170 ] 31 0.025% 99.987% ( 170, 250 ] 3 0.002% 99.990% ( 250, 380 ] 6 0.005% 99.994% ( 580, 870 ] 4 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 200773 Average: 3.5763 StdDev: 36.05 Min: 1 Median: 1.7120 Max: 4543 Percentiles: P50: 1.71 P75: 2.35 P99: 8.88 P99.9: 189.73 P99.99: 579.72 ------------------------------------------------------ [ 0, 1 ] 11825 5.890% 5.890% # ( 1, 2 ] 124391 61.956% 67.846% ############ ( 2, 3 ] 40697 20.270% 88.116% #### ( 3, 4 ] 10591 5.275% 93.391% # ( 4, 6 ] 8846 4.406% 97.797% # ( 6, 10 ] 3349 1.668% 99.465% ( 10, 15 ] 459 0.229% 99.694% ( 15, 22 ] 93 0.046% 99.740% ( 22, 34 ] 20 0.010% 99.750% ( 34, 51 ] 1 0.000% 99.750% ( 51, 76 ] 2 0.001% 99.751% ( 76, 110 ] 73 0.036% 99.788% ( 110, 170 ] 205 0.102% 99.890% ( 170, 250 ] 82 0.041% 99.931% ( 250, 380 ] 64 0.032% 99.963% ( 380, 580 ] 55 0.027% 99.990% ( 580, 870 ] 32 0.016% 100.006% ( 870, 1300 ] 16 0.008% 100.014% ( 1300, 1900 ] 15 0.007% 100.021% ( 1900, 2900 ] 9 0.004% 100.026% ( 2900, 4400 ] 7 0.003% 100.029% ( 4400, 6600 ] 2 0.001% 100.030% ** Level 4 read latency histogram (micros): Count: 305 Average: 107.1803 StdDev: 570.84 Min: 0 Median: 1.9087 Max: 6132 Percentiles: P50: 1.91 P75: 6.21 P99: 3612.50 P99.9: 6132.00 P99.99: 6132.00 ------------------------------------------------------ [ 0, 1 ] 58 19.016% 19.016% #### ( 1, 2 ] 104 34.098% 53.115% ####### ( 2, 3 ] 46 15.082% 68.197% ### ( 3, 4 ] 12 3.934% 72.131% # ( 4, 6 ] 8 2.623% 74.754% # ( 6, 10 ] 14 4.590% 79.344% # ( 10, 15 ] 26 8.525% 87.869% ## ( 15, 22 ] 14 4.590% 92.459% # ( 110, 170 ] 2 0.656% 93.115% ( 170, 250 ] 1 0.328% 93.443% ( 250, 380 ] 3 0.984% 94.426% ( 380, 580 ] 4 1.311% 95.738% ( 580, 870 ] 3 0.984% 96.721% ( 870, 1300 ] 3 0.984% 97.705% ( 1300, 1900 ] 3 0.984% 98.689% ( 2900, 4400 ] 2 0.656% 99.344% ( 4400, 6600 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 885.2000 StdDev: 1140.30 Min: 80 Median: 218.0000 Max: 4867 Percentiles: P50: 218.00 P75: 1300.00 P99: 4867.00 P99.9: 4867.00 P99.99: 4867.00 ------------------------------------------------------ ( 76, 110 ] 13 21.667% 21.667% #### ( 110, 170 ] 14 23.333% 45.000% ##### ( 170, 250 ] 5 8.333% 53.333% ## ( 250, 380 ] 3 5.000% 58.333% # ( 380, 580 ] 1 1.667% 60.000% ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 4 6.667% 75.000% # ( 1300, 1900 ] 2 3.333% 78.333% # ( 1900, 2900 ] 8 13.333% 91.667% ### ( 2900, 4400 ] 4 6.667% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 19.4 total, 4.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 304.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.460 H:M:S, 17.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 230.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.595 H:M:S, 37.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/12-23:36:16 ... thread 0: (1000000,7000000) ops and (67447.4,205532.9) ops/second in (14.826372,34.057811) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 2.27 GB 31.5 6.1 0.0 6.1 12.7 6.6 0.0 1.9 147.4 306.6 42.30 39.79 119 0.355 6331K 8142 0.0 0.0 L1 14/14 1.61 GB 0.0 5.4 4.1 1.4 5.3 4.0 0.2 1.3 228.7 225.8 24.22 23.05 3 8.073 5623K 68K 0.0 0.0 L2 7/6 901.46 MB 1.3 0.4 0.2 0.2 0.4 0.2 2.4 2.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 L3 33/11 1.64 GB 1.1 2.4 1.4 1.0 2.4 1.4 0.4 1.7 216.8 216.3 11.48 10.56 6 1.913 2527K 6362 0.0 0.0 L4 170/6 9.68 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 150.6 150.6 1.49 1.11 1 1.486 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/43 102.64 GB 0.0 14.5 5.9 8.6 21.0 12.4 4.9 3.2 183.6 265.8 80.96 75.93 131 0.618 15M 83K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.5 5.9 8.6 21.0 12.4 4.8 3.2 183.6 265.8 80.96 75.93 131 0.618 15M 83K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.5 5.9 8.6 14.4 5.8 0.0 0.0 239.6 238.2 62.05 59.11 33 1.880 15M 83K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 356.5 18.91 16.82 98 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.2 total, 34.1 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.02 GB write, 628.44 MB/s write, 14.52 GB read, 434.04 MB/s read, 81.0 seconds Interval compaction: 21.02 GB write, 631.88 MB/s write, 14.52 GB read, 436.42 MB/s read, 81.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 19, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2871510 Average: 2.3996 StdDev: 12.88 Min: 0 Median: 1.4976 Max: 4013 Percentiles: P50: 1.50 P75: 1.87 P99: 5.76 P99.9: 85.05 P99.99: 182.95 ------------------------------------------------------ [ 0, 1 ] 482257 16.795% 16.795% ### ( 1, 2 ] 1916271 66.734% 83.528% ############# ( 2, 3 ] 295236 10.282% 93.810% ## ( 3, 4 ] 95776 3.335% 97.145% # ( 4, 6 ] 60480 2.106% 99.252% ( 6, 10 ] 15570 0.542% 99.794% ( 10, 15 ] 2153 0.075% 99.869% ( 15, 22 ] 271 0.009% 99.878% ( 22, 34 ] 31 0.001% 99.879% ( 34, 51 ] 12 0.000% 99.880% ( 51, 76 ] 123 0.004% 99.884% ( 76, 110 ] 1726 0.060% 99.944% ( 110, 170 ] 1262 0.044% 99.988% ( 170, 250 ] 345 0.012% 100.000% ( 250, 380 ] 269 0.009% 100.009% ( 380, 580 ] 216 0.008% 100.017% ( 580, 870 ] 132 0.005% 100.022% ( 870, 1300 ] 66 0.002% 100.024% ( 1300, 1900 ] 24 0.001% 100.025% ( 1900, 2900 ] 12 0.000% 100.025% ( 2900, 4400 ] 8 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 773913 Average: 3.2127 StdDev: 32.81 Min: 0 Median: 1.6145 Max: 8307 Percentiles: P50: 1.61 P75: 2.06 P99: 8.28 P99.9: 143.04 P99.99: 307.61 ------------------------------------------------------ [ 0, 1 ] 90132 11.646% 11.646% ## ( 1, 2 ] 483039 62.415% 74.061% ############ ( 2, 3 ] 115274 14.895% 88.956% ### ( 3, 4 ] 39300 5.078% 94.034% # ( 4, 6 ] 32241 4.166% 98.200% # ( 6, 10 ] 10855 1.403% 99.603% ( 10, 15 ] 1016 0.131% 99.734% ( 15, 22 ] 138 0.018% 99.752% ( 22, 34 ] 12 0.002% 99.754% ( 34, 51 ] 8 0.001% 99.755% ( 51, 76 ] 40 0.005% 99.760% ( 76, 110 ] 649 0.084% 99.844% ( 110, 170 ] 792 0.102% 99.946% ( 170, 250 ] 244 0.032% 99.978% ( 250, 380 ] 218 0.028% 100.006% ( 380, 580 ] 162 0.021% 100.027% ( 580, 870 ] 115 0.015% 100.042% ( 870, 1300 ] 43 0.006% 100.047% ( 1300, 1900 ] 26 0.003% 100.051% ( 1900, 2900 ] 12 0.002% 100.052% ( 2900, 4400 ] 16 0.002% 100.054% ( 4400, 6600 ] 3 0.000% 100.055% ( 6600, 9900 ] 4 0.001% 100.055% ** Level 2 read latency histogram (micros): Count: 124216 Average: 2.2013 StdDev: 13.87 Min: 1 Median: 1.4475 Max: 3313 Percentiles: P50: 1.45 P75: 1.83 P99: 5.82 P99.9: 12.78 P99.99: 262.53 ------------------------------------------------------ [ 0, 1 ] 26135 21.040% 21.040% #### ( 1, 2 ] 80381 64.711% 85.751% ############# ( 2, 3 ] 10701 8.615% 94.365% ## ( 3, 4 ] 3566 2.871% 97.236% # ( 4, 6 ] 2408 1.939% 99.175% ( 6, 10 ] 863 0.695% 99.870% ( 10, 15 ] 68 0.055% 99.924% ( 15, 22 ] 14 0.011% 99.936% ( 22, 34 ] 3 0.002% 99.938% ( 34, 51 ] 1 0.001% 99.939% ( 51, 76 ] 3 0.002% 99.941% ( 76, 110 ] 26 0.021% 99.962% ( 110, 170 ] 31 0.025% 99.987% ( 170, 250 ] 3 0.002% 99.990% ( 250, 380 ] 6 0.005% 99.994% ( 580, 870 ] 4 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 257952 Average: 4.3429 StdDev: 47.24 Min: 1 Median: 1.7643 Max: 5705 Percentiles: P50: 1.76 P75: 2.51 P99: 9.17 P99.9: 304.27 P99.99: 574.62 ------------------------------------------------------ [ 0, 1 ] 12574 4.875% 4.875% # ( 1, 2 ] 152292 59.039% 63.913% ############ ( 2, 3 ] 55886 21.665% 85.579% #### ( 3, 4 ] 16642 6.452% 92.030% # ( 4, 6 ] 14627 5.670% 97.701% # ( 6, 10 ] 4237 1.643% 99.343% ( 10, 15 ] 634 0.246% 99.589% ( 15, 22 ] 115 0.045% 99.634% ( 22, 34 ] 25 0.010% 99.643% ( 34, 51 ] 2 0.001% 99.644% ( 51, 76 ] 3 0.001% 99.645% ( 76, 110 ] 111 0.043% 99.688% ( 110, 170 ] 281 0.109% 99.797% ( 170, 250 ] 199 0.077% 99.874% ( 250, 380 ] 163 0.063% 99.938% ( 380, 580 ] 141 0.055% 99.992% ( 580, 870 ] 101 0.039% 100.031% ( 870, 1300 ] 35 0.014% 100.045% ( 1300, 1900 ] 18 0.007% 100.052% ( 1900, 2900 ] 12 0.005% 100.057% ( 2900, 4400 ] 18 0.007% 100.064% ( 4400, 6600 ] 3 0.001% 100.065% ** Level 4 read latency histogram (micros): Count: 2877 Average: 105.4668 StdDev: 405.83 Min: 0 Median: 2.1404 Max: 6814 Percentiles: P50: 2.14 P75: 3.80 P99: 1645.13 P99.9: 5956.87 P99.99: 6814.00 ------------------------------------------------------ [ 0, 1 ] 95 3.302% 3.302% # ( 1, 2 ] 1259 43.761% 47.063% ######### ( 2, 3 ] 602 20.925% 67.987% #### ( 3, 4 ] 252 8.759% 76.747% ## ( 4, 6 ] 156 5.422% 82.169% # ( 6, 10 ] 64 2.225% 84.393% ( 10, 15 ] 28 0.973% 85.367% ( 15, 22 ] 14 0.487% 85.853% ( 76, 110 ] 8 0.278% 86.131% ( 110, 170 ] 22 0.765% 86.896% ( 170, 250 ] 42 1.460% 88.356% ( 250, 380 ] 59 2.051% 90.407% ( 380, 580 ] 100 3.476% 93.883% # ( 580, 870 ] 94 3.267% 97.150% # ( 870, 1300 ] 40 1.390% 98.540% ( 1300, 1900 ] 23 0.799% 99.340% ( 1900, 2900 ] 4 0.139% 99.479% ( 2900, 4400 ] 10 0.348% 99.826% ( 4400, 6600 ] 3 0.104% 99.930% ( 6600, 9900 ] 2 0.070% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 885.2000 StdDev: 1140.30 Min: 80 Median: 218.0000 Max: 4867 Percentiles: P50: 218.00 P75: 1300.00 P99: 4867.00 P99.9: 4867.00 P99.99: 4867.00 ------------------------------------------------------ ( 76, 110 ] 13 21.667% 21.667% #### ( 110, 170 ] 14 23.333% 45.000% ##### ( 170, 250 ] 5 8.333% 53.333% ## ( 250, 380 ] 3 5.000% 58.333% # ( 380, 580 ] 1 1.667% 60.000% ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 4 6.667% 75.000% # ( 1300, 1900 ] 2 3.333% 78.333% # ( 1900, 2900 ] 8 13.333% 91.667% ### ( 2900, 4400 ] 4 6.667% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 34.2 total, 14.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 201.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.043 H:M:S, 43.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 66.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.583 H:M:S, 78.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/12-23:36:20 ... thread 0: (1000000,8000000) ops and (249347.4,210148.7) ops/second in (4.010469,38.068280) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 3.26 GB 107.0 6.7 0.0 6.7 14.3 7.6 0.0 1.9 141.0 300.0 48.69 44.85 134 0.363 6971K 8901 0.0 0.0 L1 14/14 1.61 GB 0.0 5.4 4.1 1.4 5.3 4.0 0.2 1.3 228.7 225.8 24.22 23.05 3 8.073 5623K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.4 2.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 L3 23/3 1.16 GB 1.0 3.6 2.3 1.3 3.5 2.3 0.4 1.5 201.5 201.0 18.08 15.66 10 1.808 3700K 9959 0.0 0.0 L4 176/3 9.68 GB 1.0 1.7 1.6 0.1 1.7 1.6 0.8 1.1 141.0 140.7 12.10 7.88 23 0.526 1697K 2069 0.0 0.0 L5 1068/0 87.91 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/30 103.61 GB 0.0 17.7 8.1 9.6 25.2 15.6 6.3 3.3 173.4 246.6 104.57 92.87 172 0.608 18M 89K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.7 8.1 9.6 25.2 15.6 6.2 3.3 173.4 246.6 104.57 92.87 172 0.608 18M 89K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.7 8.1 9.6 17.6 8.0 0.0 0.0 221.4 220.2 81.91 73.50 61 1.343 18M 89K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 342.0 22.66 19.37 111 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.3 total, 38.1 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.18 GB write, 674.12 MB/s write, 17.71 GB read, 473.96 MB/s read, 104.6 seconds Interval compaction: 25.18 GB write, 677.41 MB/s write, 17.71 GB read, 476.27 MB/s read, 104.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 33, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3218259 Average: 2.4772 StdDev: 15.40 Min: 0 Median: 1.5222 Max: 4473 Percentiles: P50: 1.52 P75: 1.90 P99: 5.87 P99.9: 83.56 P99.99: 201.77 ------------------------------------------------------ [ 0, 1 ] 498892 15.502% 15.502% ### ( 1, 2 ] 2125957 66.059% 81.561% ############# ( 2, 3 ] 361379 11.229% 92.790% ## ( 3, 4 ] 121435 3.773% 96.563% # ( 4, 6 ] 83714 2.601% 99.165% # ( 6, 10 ] 20046 0.623% 99.788% ( 10, 15 ] 2719 0.084% 99.872% ( 15, 22 ] 322 0.010% 99.882% ( 22, 34 ] 43 0.001% 99.883% ( 34, 51 ] 17 0.001% 99.884% ( 51, 76 ] 124 0.004% 99.888% ( 76, 110 ] 1771 0.055% 99.943% ( 110, 170 ] 1352 0.042% 99.985% ( 170, 250 ] 421 0.013% 99.998% ( 250, 380 ] 328 0.010% 100.008% ( 380, 580 ] 270 0.008% 100.016% ( 580, 870 ] 155 0.005% 100.021% ( 870, 1300 ] 78 0.002% 100.024% ( 1300, 1900 ] 33 0.001% 100.025% ( 1900, 2900 ] 19 0.001% 100.025% ( 2900, 4400 ] 19 0.001% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1022661 Average: 3.9492 StdDev: 64.62 Min: 0 Median: 1.6696 Max: 11423 Percentiles: P50: 1.67 P75: 2.29 P99: 8.57 P99.9: 158.85 P99.99: 504.17 ------------------------------------------------------ [ 0, 1 ] 94819 9.272% 9.272% ## ( 1, 2 ] 622058 60.827% 70.099% ############ ( 2, 3 ] 172888 16.906% 87.005% ### ( 3, 4 ] 60139 5.881% 92.886% # ( 4, 6 ] 51877 5.073% 97.958% # ( 6, 10 ] 16572 1.620% 99.579% ( 10, 15 ] 1603 0.157% 99.735% ( 15, 22 ] 216 0.021% 99.757% ( 22, 34 ] 21 0.002% 99.759% ( 34, 51 ] 11 0.001% 99.760% ( 51, 76 ] 42 0.004% 99.764% ( 76, 110 ] 681 0.067% 99.830% ( 110, 170 ] 875 0.086% 99.916% ( 170, 250 ] 315 0.031% 99.947% ( 250, 380 ] 290 0.028% 99.975% ( 380, 580 ] 246 0.024% 99.999% ( 580, 870 ] 171 0.017% 100.016% ( 870, 1300 ] 76 0.007% 100.023% ( 1300, 1900 ] 51 0.005% 100.028% ( 1900, 2900 ] 64 0.006% 100.035% ( 2900, 4400 ] 75 0.007% 100.042% ( 4400, 6600 ] 27 0.003% 100.045% ( 6600, 9900 ] 24 0.002% 100.047% ( 9900, 14000 ] 2 0.000% 100.047% ** Level 2 read latency histogram (micros): Count: 124216 Average: 2.2013 StdDev: 13.87 Min: 1 Median: 1.4475 Max: 3313 Percentiles: P50: 1.45 P75: 1.83 P99: 5.82 P99.9: 12.78 P99.99: 262.53 ------------------------------------------------------ [ 0, 1 ] 26135 21.040% 21.040% #### ( 1, 2 ] 80381 64.711% 85.751% ############# ( 2, 3 ] 10701 8.615% 94.365% ## ( 3, 4 ] 3566 2.871% 97.236% # ( 4, 6 ] 2408 1.939% 99.175% ( 6, 10 ] 863 0.695% 99.870% ( 10, 15 ] 68 0.055% 99.924% ( 15, 22 ] 14 0.011% 99.936% ( 22, 34 ] 3 0.002% 99.938% ( 34, 51 ] 1 0.001% 99.939% ( 51, 76 ] 3 0.002% 99.941% ( 76, 110 ] 26 0.021% 99.962% ( 110, 170 ] 31 0.025% 99.987% ( 170, 250 ] 3 0.002% 99.990% ( 250, 380 ] 6 0.005% 99.994% ( 580, 870 ] 4 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 625912 Average: 4.8339 StdDev: 74.47 Min: 1 Median: 1.8858 Max: 10632 Percentiles: P50: 1.89 P75: 2.79 P99: 8.55 P99.9: 119.25 P99.99: 272.59 ------------------------------------------------------ [ 0, 1 ] 16262 2.598% 2.598% # ( 1, 2 ] 334962 53.516% 56.114% ########### ( 2, 3 ] 148707 23.758% 79.872% ##### ( 3, 4 ] 58361 9.324% 89.197% ## ( 4, 6 ] 54923 8.775% 97.971% ## ( 6, 10 ] 10118 1.617% 99.588% ( 10, 15 ] 1504 0.240% 99.828% ( 15, 22 ] 206 0.033% 99.861% ( 22, 34 ] 44 0.007% 99.868% ( 34, 51 ] 10 0.002% 99.870% ( 51, 76 ] 9 0.001% 99.871% ( 76, 110 ] 131 0.021% 99.892% ( 110, 170 ] 325 0.052% 99.944% ( 170, 250 ] 250 0.040% 99.984% ( 250, 380 ] 221 0.035% 100.019% ( 380, 580 ] 229 0.037% 100.056% ( 580, 870 ] 182 0.029% 100.085% ( 870, 1300 ] 89 0.014% 100.099% ( 1300, 1900 ] 55 0.009% 100.108% ( 1900, 2900 ] 67 0.011% 100.119% ( 2900, 4400 ] 72 0.012% 100.130% ( 4400, 6600 ] 30 0.005% 100.135% ( 6600, 9900 ] 12 0.002% 100.137% ( 9900, 14000 ] 1 0.000% 100.137% ** Level 4 read latency histogram (micros): Count: 22294 Average: 50.7314 StdDev: 278.49 Min: 0 Median: 2.0288 Max: 7116 Percentiles: P50: 2.03 P75: 3.22 P99: 1110.85 P99.9: 3888.69 P99.99: 5889.53 ------------------------------------------------------ [ 0, 1 ] 476 2.135% 2.135% ( 1, 2 ] 10522 47.197% 49.332% ######### ( 2, 3 ] 5172 23.199% 72.531% ##### ( 3, 4 ] 2532 11.357% 83.888% ## ( 4, 6 ] 1463 6.562% 90.450% # ( 6, 10 ] 461 2.068% 92.518% ( 10, 15 ] 91 0.408% 92.926% ( 15, 22 ] 31 0.139% 93.065% ( 22, 34 ] 5 0.022% 93.088% ( 34, 51 ] 2 0.009% 93.097% ( 76, 110 ] 63 0.283% 93.379% ( 110, 170 ] 152 0.682% 94.061% ( 170, 250 ] 183 0.821% 94.882% ( 250, 380 ] 219 0.982% 95.864% ( 380, 580 ] 330 1.480% 97.345% ( 580, 870 ] 280 1.256% 98.601% ( 870, 1300 ] 159 0.713% 99.314% ( 1300, 1900 ] 64 0.287% 99.601% ( 1900, 2900 ] 41 0.184% 99.785% ( 2900, 4400 ] 39 0.175% 99.960% ( 4400, 6600 ] 10 0.045% 100.004% ( 6600, 9900 ] 4 0.018% 100.022% ** Level 5 read latency histogram (micros): Count: 140 Average: 992.7857 StdDev: 1120.66 Min: 80 Median: 460.0000 Max: 4867 Percentiles: P50: 460.00 P75: 1633.33 P99: 4867.00 P99.9: 4867.00 P99.99: 4867.00 ------------------------------------------------------ ( 76, 110 ] 16 11.429% 11.429% ## ( 110, 170 ] 21 15.000% 26.429% ### ( 170, 250 ] 18 12.857% 39.286% ### ( 250, 380 ] 11 7.857% 47.143% ## ( 380, 580 ] 10 7.143% 54.286% # ( 580, 870 ] 14 10.000% 64.286% ## ( 870, 1300 ] 10 7.143% 71.429% # ( 1300, 1900 ] 9 6.429% 77.857% # ( 1900, 2900 ] 21 15.000% 92.857% ### ( 2900, 4400 ] 7 5.000% 97.857% # ( 4400, 6600 ] 3 2.143% 100.000% ** DB Stats ** Uptime(secs): 38.3 total, 4.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 205.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.119 H:M:S, 42.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 245.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.077 H:M:S, 26.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/07/12-23:36:25 ... thread 0: (1000000,9000000) ops and (195836.1,208455.9) ops/second in (5.106311,43.174591) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/6 4.30 GB 239.2 7.8 0.0 7.8 16.4 8.6 0.0 1.9 142.1 299.9 55.85 51.57 153 0.365 8058K 9941 0.0 0.0 L1 14/14 1.61 GB 0.0 5.4 4.1 1.4 5.3 4.0 0.2 1.3 228.7 225.8 24.22 23.05 3 8.073 5623K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.4 2.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 L3 20/0 987.43 MB 1.0 3.6 2.3 1.3 3.5 2.3 0.4 1.5 201.5 201.0 18.08 15.66 10 1.808 3700K 9959 0.0 0.0 L4 175/0 9.57 GB 1.0 1.9 1.8 0.1 1.9 1.8 0.8 1.1 145.1 144.8 13.19 8.86 26 0.507 1903K 2378 0.0 0.0 L5 1072/0 88.22 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/20 104.66 GB 0.0 19.0 8.3 10.6 27.5 16.8 6.6 3.2 172.1 249.4 112.81 100.56 194 0.582 19M 90K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.0 8.3 10.6 27.5 16.8 6.5 3.2 172.1 249.4 112.81 100.56 194 0.582 19M 90K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.0 8.3 10.6 18.9 8.2 0.0 0.0 222.8 221.7 87.12 78.48 68 1.281 19M 90K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 343.3 25.69 22.08 126 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.4 total, 43.2 interval Flush(GB): cumulative 8.613, interval 8.613 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.48 GB write, 648.88 MB/s write, 18.96 GB read, 447.63 MB/s read, 112.8 seconds Interval compaction: 27.48 GB write, 651.67 MB/s write, 18.96 GB read, 449.56 MB/s read, 112.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 32, total-stops: 37, interval: 69 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3550136 Average: 2.4556 StdDev: 15.03 Min: 0 Median: 1.5204 Max: 4473 Percentiles: P50: 1.52 P75: 1.90 P99: 5.86 P99.9: 79.63 P99.99: 194.78 ------------------------------------------------------ [ 0, 1 ] 552648 15.567% 15.567% ### ( 1, 2 ] 2348893 66.163% 81.730% ############# ( 2, 3 ] 397033 11.184% 92.914% ## ( 3, 4 ] 131803 3.713% 96.627% # ( 4, 6 ] 90585 2.552% 99.178% # ( 6, 10 ] 21828 0.615% 99.793% ( 10, 15 ] 3068 0.086% 99.879% ( 15, 22 ] 343 0.010% 99.889% ( 22, 34 ] 45 0.001% 99.890% ( 34, 51 ] 18 0.001% 99.891% ( 51, 76 ] 125 0.004% 99.894% ( 76, 110 ] 1846 0.052% 99.946% ( 110, 170 ] 1410 0.040% 99.986% ( 170, 250 ] 439 0.012% 99.999% ( 250, 380 ] 332 0.009% 100.008% ( 380, 580 ] 278 0.008% 100.016% ( 580, 870 ] 165 0.005% 100.020% ( 870, 1300 ] 81 0.002% 100.023% ( 1300, 1900 ] 35 0.001% 100.024% ( 1900, 2900 ] 20 0.001% 100.024% ( 2900, 4400 ] 20 0.001% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1216991 Average: 3.7040 StdDev: 59.37 Min: 0 Median: 1.6353 Max: 11423 Percentiles: P50: 1.64 P75: 2.16 P99: 8.44 P99.9: 153.69 P99.99: 505.04 ------------------------------------------------------ [ 0, 1 ] 133387 10.960% 10.960% ## ( 1, 2 ] 747894 61.454% 72.415% ############ ( 2, 3 ] 190938 15.689% 88.104% ### ( 3, 4 ] 65084 5.348% 93.452% # ( 4, 6 ] 56024 4.603% 98.056% # ( 6, 10 ] 18853 1.549% 99.605% ( 10, 15 ] 1696 0.139% 99.744% ( 15, 22 ] 232 0.019% 99.763% ( 22, 34 ] 21 0.002% 99.765% ( 34, 51 ] 11 0.001% 99.766% ( 51, 76 ] 81 0.007% 99.772% ( 76, 110 ] 846 0.070% 99.842% ( 110, 170 ] 971 0.080% 99.922% ( 170, 250 ] 353 0.029% 99.951% ( 250, 380 ] 307 0.025% 99.976% ( 380, 580 ] 274 0.023% 99.998% ( 580, 870 ] 178 0.015% 100.013% ( 870, 1300 ] 78 0.006% 100.019% ( 1300, 1900 ] 52 0.004% 100.024% ( 1900, 2900 ] 64 0.005% 100.029% ( 2900, 4400 ] 75 0.006% 100.035% ( 4400, 6600 ] 27 0.002% 100.037% ( 6600, 9900 ] 24 0.002% 100.039% ( 9900, 14000 ] 2 0.000% 100.040% ** Level 2 read latency histogram (micros): Count: 124216 Average: 2.2013 StdDev: 13.87 Min: 1 Median: 1.4475 Max: 3313 Percentiles: P50: 1.45 P75: 1.83 P99: 5.82 P99.9: 12.78 P99.99: 262.53 ------------------------------------------------------ [ 0, 1 ] 26135 21.040% 21.040% #### ( 1, 2 ] 80381 64.711% 85.751% ############# ( 2, 3 ] 10701 8.615% 94.365% ## ( 3, 4 ] 3566 2.871% 97.236% # ( 4, 6 ] 2408 1.939% 99.175% ( 6, 10 ] 863 0.695% 99.870% ( 10, 15 ] 68 0.055% 99.924% ( 15, 22 ] 14 0.011% 99.936% ( 22, 34 ] 3 0.002% 99.938% ( 34, 51 ] 1 0.001% 99.939% ( 51, 76 ] 3 0.002% 99.941% ( 76, 110 ] 26 0.021% 99.962% ( 110, 170 ] 31 0.025% 99.987% ( 170, 250 ] 3 0.002% 99.990% ( 250, 380 ] 6 0.005% 99.994% ( 580, 870 ] 4 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 674411 Average: 4.6962 StdDev: 71.75 Min: 1 Median: 1.8922 Max: 10632 Percentiles: P50: 1.89 P75: 2.81 P99: 8.49 P99.9: 95.36 P99.99: 242.18 ------------------------------------------------------ [ 0, 1 ] 16794 2.490% 2.490% ( 1, 2 ] 359110 53.248% 55.738% ########### ( 2, 3 ] 161208 23.904% 79.642% ##### ( 3, 4 ] 63986 9.488% 89.129% ## ( 4, 6 ] 59780 8.864% 97.993% ## ( 6, 10 ] 10906 1.617% 99.610% ( 10, 15 ] 1587 0.235% 99.846% ( 15, 22 ] 228 0.034% 99.880% ( 22, 34 ] 44 0.007% 99.886% ( 34, 51 ] 10 0.001% 99.888% ( 51, 76 ] 9 0.001% 99.889% ( 76, 110 ] 131 0.019% 99.908% ( 110, 170 ] 325 0.048% 99.957% ( 170, 250 ] 250 0.037% 99.994% ( 250, 380 ] 221 0.033% 100.026% ( 380, 580 ] 229 0.034% 100.060% ( 580, 870 ] 182 0.027% 100.087% ( 870, 1300 ] 89 0.013% 100.101% ( 1300, 1900 ] 55 0.008% 100.109% ( 1900, 2900 ] 67 0.010% 100.119% ( 2900, 4400 ] 72 0.011% 100.129% ( 4400, 6600 ] 30 0.004% 100.134% ( 6600, 9900 ] 12 0.002% 100.136% ( 9900, 14000 ] 1 0.000% 100.136% ** Level 4 read latency histogram (micros): Count: 25280 Average: 46.8293 StdDev: 263.41 Min: 0 Median: 1.9965 Max: 7116 Percentiles: P50: 2.00 P75: 3.17 P99: 1036.12 P99.9: 3773.85 P99.99: 5823.84 ------------------------------------------------------ [ 0, 1 ] 575 2.275% 2.275% ( 1, 2 ] 12107 47.892% 50.166% ########## ( 2, 3 ] 5801 22.947% 73.113% ##### ( 3, 4 ] 2841 11.238% 84.351% ## ( 4, 6 ] 1624 6.424% 90.775% # ( 6, 10 ] 517 2.045% 92.820% ( 10, 15 ] 102 0.403% 93.224% ( 15, 22 ] 32 0.127% 93.350% ( 22, 34 ] 6 0.024% 93.374% ( 34, 51 ] 2 0.008% 93.382% ( 76, 110 ] 72 0.285% 93.667% ( 110, 170 ] 183 0.724% 94.391% ( 170, 250 ] 215 0.850% 95.241% ( 250, 380 ] 236 0.934% 96.175% ( 380, 580 ] 354 1.400% 97.575% ( 580, 870 ] 298 1.179% 98.754% ( 870, 1300 ] 161 0.637% 99.391% ( 1300, 1900 ] 65 0.257% 99.648% ( 1900, 2900 ] 41 0.162% 99.810% ( 2900, 4400 ] 39 0.154% 99.964% ( 4400, 6600 ] 10 0.040% 100.004% ( 6600, 9900 ] 4 0.016% 100.020% ** Level 5 read latency histogram (micros): Count: 160 Average: 950.8687 StdDev: 1101.98 Min: 77 Median: 416.3636 Max: 4867 Percentiles: P50: 416.36 P75: 1540.00 P99: 4867.00 P99.9: 4867.00 P99.99: 4867.00 ------------------------------------------------------ ( 76, 110 ] 25 15.625% 15.625% ### ( 110, 170 ] 24 15.000% 30.625% ### ( 170, 250 ] 18 11.250% 41.875% ## ( 250, 380 ] 11 6.875% 48.750% # ( 380, 580 ] 11 6.875% 55.625% # ( 580, 870 ] 16 10.000% 65.625% ## ( 870, 1300 ] 11 6.875% 72.500% # ( 1300, 1900 ] 10 6.250% 78.750% # ( 1900, 2900 ] 23 14.375% 93.125% ### ( 2900, 4400 ] 8 5.000% 98.125% # ( 4400, 6600 ] 3 1.875% 100.000% ** DB Stats ** Uptime(secs): 43.4 total, 5.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 204.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.549 H:M:S, 42.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 192.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.430 H:M:S, 47.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/07/12-23:36:38 ... thread 0: (1000000,10000000) ops and (78769.9,178987.6) ops/second in (12.695197,55.869788) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 3.19 GB 294.7 9.9 0.0 9.9 19.4 9.5 0.0 2.0 144.8 282.9 70.05 62.78 167 0.419 10M 21K 0.0 0.0 L1 4/0 445.38 MB 44.5 9.0 6.0 3.0 8.9 5.9 0.2 1.5 225.3 222.4 40.84 38.42 4 10.210 8189K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 5.5 2.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 L3 19/0 932.49 MB 0.9 7.6 5.1 2.5 7.6 5.0 0.8 1.5 163.1 162.5 47.74 34.64 28 1.705 6861K 23K 0.0 0.0 L4 170/0 9.73 GB 1.0 5.7 4.9 0.8 5.7 4.9 0.9 1.2 134.6 134.2 43.36 26.86 60 0.723 5780K 10K 0.0 0.0 L5 1108/0 91.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1312/4 105.43 GB 0.0 32.6 16.1 16.4 41.9 25.4 13.0 4.4 163.9 210.6 203.47 164.13 261 0.780 31M 123K 0.0 0.0 Int 0/0 0.00 KB 0.0 32.6 16.1 16.4 41.9 25.4 12.9 4.4 163.9 210.6 203.47 164.13 261 0.780 31M 123K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 32.6 16.1 16.4 32.4 16.0 0.0 0.0 192.2 191.1 173.47 139.73 124 1.399 31M 123K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 323.4 30.00 24.40 137 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.1 total, 55.9 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 41.85 GB write, 764.48 MB/s write, 32.56 GB read, 594.79 MB/s read, 203.5 seconds Interval compaction: 41.85 GB write, 767.03 MB/s write, 32.56 GB read, 596.77 MB/s read, 203.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 43, pending-compaction-bytes-stops: 0, total-delays: 61, total-stops: 62, interval: 123 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4232701 Average: 2.6371 StdDev: 21.90 Min: 0 Median: 1.5452 Max: 7060 Percentiles: P50: 1.55 P75: 1.93 P99: 6.24 P99.9: 88.33 P99.99: 285.48 ------------------------------------------------------ [ 0, 1 ] 624811 14.762% 14.762% ### ( 1, 2 ] 2735580 64.630% 79.391% ############# ( 2, 3 ] 504204 11.912% 91.303% ## ( 3, 4 ] 182427 4.310% 95.613% # ( 4, 6 ] 141342 3.339% 98.953% # ( 6, 10 ] 33877 0.800% 99.753% ( 10, 15 ] 4638 0.110% 99.862% ( 15, 22 ] 512 0.012% 99.875% ( 22, 34 ] 59 0.001% 99.876% ( 34, 51 ] 47 0.001% 99.877% ( 51, 76 ] 188 0.004% 99.881% ( 76, 110 ] 2165 0.051% 99.933% ( 110, 170 ] 1771 0.042% 99.974% ( 170, 250 ] 546 0.013% 99.987% ( 250, 380 ] 413 0.010% 99.997% ( 380, 580 ] 389 0.009% 100.006% ( 580, 870 ] 276 0.007% 100.013% ( 870, 1300 ] 169 0.004% 100.017% ( 1300, 1900 ] 81 0.002% 100.019% ( 1900, 2900 ] 61 0.001% 100.020% ( 2900, 4400 ] 53 0.001% 100.021% ( 4400, 6600 ] 10 0.000% 100.022% ( 6600, 9900 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 2102058 Average: 5.5517 StdDev: 90.99 Min: 0 Median: 1.7381 Max: 11423 Percentiles: P50: 1.74 P75: 2.58 P99: 8.81 P99.9: 238.24 P99.99: 841.38 ------------------------------------------------------ [ 0, 1 ] 192857 9.175% 9.175% ## ( 1, 2 ] 1162653 55.310% 64.485% ########### ( 2, 3 ] 382513 18.197% 82.682% #### ( 3, 4 ] 160331 7.627% 90.309% ## ( 4, 6 ] 156401 7.440% 97.750% # ( 6, 10 ] 37350 1.777% 99.527% ( 10, 15 ] 4447 0.212% 99.738% ( 15, 22 ] 541 0.026% 99.764% ( 22, 34 ] 43 0.002% 99.766% ( 34, 51 ] 32 0.002% 99.767% ( 51, 76 ] 160 0.008% 99.775% ( 76, 110 ] 972 0.046% 99.821% ( 110, 170 ] 1261 0.060% 99.881% ( 170, 250 ] 463 0.022% 99.903% ( 250, 380 ] 544 0.026% 99.929% ( 380, 580 ] 657 0.031% 99.960% ( 580, 870 ] 691 0.033% 99.993% ( 870, 1300 ] 537 0.026% 100.019% ( 1300, 1900 ] 343 0.016% 100.035% ( 1900, 2900 ] 397 0.019% 100.054% ( 2900, 4400 ] 473 0.023% 100.076% ( 4400, 6600 ] 139 0.007% 100.083% ( 6600, 9900 ] 47 0.002% 100.085% ( 9900, 14000 ] 3 0.000% 100.085% ** Level 2 read latency histogram (micros): Count: 124216 Average: 2.2013 StdDev: 13.87 Min: 1 Median: 1.4475 Max: 3313 Percentiles: P50: 1.45 P75: 1.83 P99: 5.82 P99.9: 12.78 P99.99: 262.53 ------------------------------------------------------ [ 0, 1 ] 26135 21.040% 21.040% #### ( 1, 2 ] 80381 64.711% 85.751% ############# ( 2, 3 ] 10701 8.615% 94.365% ## ( 3, 4 ] 3566 2.871% 97.236% # ( 4, 6 ] 2408 1.939% 99.175% ( 6, 10 ] 863 0.695% 99.870% ( 10, 15 ] 68 0.055% 99.924% ( 15, 22 ] 14 0.011% 99.936% ( 22, 34 ] 3 0.002% 99.938% ( 34, 51 ] 1 0.001% 99.939% ( 51, 76 ] 3 0.002% 99.941% ( 76, 110 ] 26 0.021% 99.962% ( 110, 170 ] 31 0.025% 99.987% ( 170, 250 ] 3 0.002% 99.990% ( 250, 380 ] 6 0.005% 99.994% ( 580, 870 ] 4 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1810167 Average: 6.1024 StdDev: 92.07 Min: 1 Median: 1.9966 Max: 15297 Percentiles: P50: 2.00 P75: 2.99 P99: 8.80 P99.9: 21.93 P99.99: 390.57 ------------------------------------------------------ [ 0, 1 ] 24361 1.346% 1.346% ( 1, 2 ] 883698 48.819% 50.164% ########## ( 2, 3 ] 453912 25.076% 75.240% ##### ( 3, 4 ] 204070 11.274% 86.514% ## ( 4, 6 ] 201871 11.152% 97.666% ## ( 6, 10 ] 34496 1.906% 99.571% ( 10, 15 ] 5324 0.294% 99.865% ( 15, 22 ] 631 0.035% 99.900% ( 22, 34 ] 78 0.004% 99.905% ( 34, 51 ] 31 0.002% 99.906% ( 51, 76 ] 66 0.004% 99.910% ( 76, 110 ] 155 0.009% 99.919% ( 110, 170 ] 363 0.020% 99.939% ( 170, 250 ] 385 0.021% 99.960% ( 250, 380 ] 507 0.028% 99.988% ( 380, 580 ] 719 0.040% 100.028% ( 580, 870 ] 793 0.044% 100.071% ( 870, 1300 ] 591 0.033% 100.104% ( 1300, 1900 ] 377 0.021% 100.125% ( 1900, 2900 ] 359 0.020% 100.145% ( 2900, 4400 ] 419 0.023% 100.168% ( 4400, 6600 ] 127 0.007% 100.175% ( 6600, 9900 ] 33 0.002% 100.177% ( 9900, 14000 ] 1 0.000% 100.177% ( 14000, 22000 ] 1 0.000% 100.177% ** Level 4 read latency histogram (micros): Count: 216061 Average: 33.1359 StdDev: 278.51 Min: 0 Median: 2.0490 Max: 23313 Percentiles: P50: 2.05 P75: 3.12 P99: 916.65 P99.9: 3810.31 P99.99: 4473.20 ------------------------------------------------------ [ 0, 1 ] 2951 1.366% 1.366% ( 1, 2 ] 102450 47.417% 48.783% ######### ( 2, 3 ] 53683 24.846% 73.629% ##### ( 3, 4 ] 24693 11.429% 85.058% ## ( 4, 6 ] 20903 9.675% 94.733% ## ( 6, 10 ] 5170 2.393% 97.125% ( 10, 15 ] 834 0.386% 97.511% ( 15, 22 ] 108 0.050% 97.561% ( 22, 34 ] 18 0.008% 97.570% ( 34, 51 ] 4 0.002% 97.572% ( 51, 76 ] 4 0.002% 97.573% ( 76, 110 ] 82 0.038% 97.611% ( 110, 170 ] 226 0.105% 97.716% ( 170, 250 ] 320 0.148% 97.864% ( 250, 380 ] 467 0.216% 98.080% ( 380, 580 ] 856 0.396% 98.476% ( 580, 870 ] 1037 0.480% 98.956% ( 870, 1300 ] 870 0.403% 99.359% ( 1300, 1900 ] 469 0.217% 99.576% ( 1900, 2900 ] 405 0.187% 99.763% ( 2900, 4400 ] 486 0.225% 99.988% ( 4400, 6600 ] 102 0.047% 100.036% ( 6600, 9900 ] 28 0.013% 100.049% ( 14000, 22000 ] 2 0.001% 100.050% ( 22000, 33000 ] 1 0.000% 100.050% ** Level 5 read latency histogram (micros): Count: 340 Average: 1632.4118 StdDev: 1794.33 Min: 77 Median: 935.1515 Max: 10770 Percentiles: P50: 935.15 P75: 2541.03 P99: 9570.00 P99.9: 10770.00 P99.99: 10770.00 ------------------------------------------------------ ( 76, 110 ] 26 7.647% 7.647% ## ( 110, 170 ] 29 8.529% 16.176% ## ( 170, 250 ] 24 7.059% 23.235% # ( 250, 380 ] 19 5.588% 28.824% # ( 380, 580 ] 28 8.235% 37.059% ## ( 580, 870 ] 39 11.471% 48.529% ## ( 870, 1300 ] 33 9.706% 58.235% ## ( 1300, 1900 ] 32 9.412% 67.647% ## ( 1900, 2900 ] 39 11.471% 79.118% ## ( 2900, 4400 ] 45 13.235% 92.353% ### ( 4400, 6600 ] 19 5.588% 97.941% # ( 6600, 9900 ] 4 1.176% 99.118% ( 9900, 14000 ] 3 0.882% 100.000% ** DB Stats ** Uptime(secs): 56.1 total, 12.7 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 175.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.251 H:M:S, 50.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 77.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.702 H:M:S, 76.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/12-23:36:41 ... thread 0: (1000000,11000000) ops and (337352.3,186966.6) ops/second in (2.964260,58.834048) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 4.11 GB 389.1 10.8 0.0 10.8 21.1 10.4 0.0 2.0 145.0 284.9 75.99 68.37 183 0.415 11M 22K 0.0 0.0 L1 4/0 445.38 MB 44.5 9.0 6.0 3.0 8.9 5.9 0.2 1.5 225.3 222.4 40.84 38.42 4 10.210 8189K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 5.5 2.0 256.0 255.9 1.48 1.43 2 0.738 383K 196 0.0 0.0 L3 19/0 932.49 MB 0.9 7.6 5.1 2.5 7.6 5.0 0.8 1.5 163.1 162.5 47.74 34.64 28 1.705 6861K 23K 0.0 0.0 L4 170/0 9.73 GB 1.0 5.7 4.9 0.8 5.7 4.9 0.9 1.2 134.6 134.2 43.36 26.86 60 0.723 5780K 10K 0.0 0.0 L5 1108/0 91.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1316/4 106.35 GB 0.0 33.4 16.1 17.3 43.6 26.4 13.0 4.2 163.4 213.4 209.41 169.72 277 0.756 32M 124K 0.0 0.0 Int 0/0 0.00 KB 0.0 33.4 16.1 17.3 43.6 26.4 12.9 4.2 163.4 213.4 209.41 169.72 277 0.756 32M 124K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 33.4 16.1 17.3 33.2 16.0 0.0 0.0 193.6 192.5 176.80 143.00 127 1.392 32M 124K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.4 10.4 0.0 0.0 0.0 326.5 32.61 26.72 150 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.0 total, 58.8 interval Flush(GB): cumulative 10.397, interval 10.397 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 43.63 GB write, 757.02 MB/s write, 33.42 GB read, 579.86 MB/s read, 209.4 seconds Interval compaction: 43.63 GB write, 759.42 MB/s write, 33.42 GB read, 581.69 MB/s read, 209.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 43, pending-compaction-bytes-stops: 0, total-delays: 61, total-stops: 66, interval: 127 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4477203 Average: 2.5981 StdDev: 21.47 Min: 0 Median: 1.5337 Max: 7060 Percentiles: P50: 1.53 P75: 1.92 P99: 6.03 P99.9: 84.65 P99.99: 276.46 ------------------------------------------------------ [ 0, 1 ] 696255 15.551% 15.551% ### ( 1, 2 ] 2889980 64.549% 80.100% ############# ( 2, 3 ] 516299 11.532% 91.632% ## ( 3, 4 ] 186587 4.167% 95.799% # ( 4, 6 ] 143046 3.195% 98.994% # ( 6, 10 ] 34307 0.766% 99.760% ( 10, 15 ] 4842 0.108% 99.869% ( 15, 22 ] 553 0.012% 99.881% ( 22, 34 ] 63 0.001% 99.882% ( 34, 51 ] 52 0.001% 99.883% ( 51, 76 ] 192 0.004% 99.888% ( 76, 110 ] 2165 0.048% 99.936% ( 110, 170 ] 1777 0.040% 99.976% ( 170, 250 ] 553 0.012% 99.988% ( 250, 380 ] 419 0.009% 99.997% ( 380, 580 ] 392 0.009% 100.006% ( 580, 870 ] 279 0.006% 100.012% ( 870, 1300 ] 173 0.004% 100.016% ( 1300, 1900 ] 82 0.002% 100.018% ( 1900, 2900 ] 63 0.001% 100.020% ( 2900, 4400 ] 54 0.001% 100.021% ( 4400, 6600 ] 10 0.000% 100.021% ( 6600, 9900 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 2102058 Average: 5.5517 StdDev: 90.99 Min: 0 Median: 1.7381 Max: 11423 Percentiles: P50: 1.74 P75: 2.58 P99: 8.81 P99.9: 238.24 P99.99: 841.38 ------------------------------------------------------ [ 0, 1 ] 192857 9.175% 9.175% ## ( 1, 2 ] 1162653 55.310% 64.485% ########### ( 2, 3 ] 382513 18.197% 82.682% #### ( 3, 4 ] 160331 7.627% 90.309% ## ( 4, 6 ] 156401 7.440% 97.750% # ( 6, 10 ] 37350 1.777% 99.527% ( 10, 15 ] 4447 0.212% 99.738% ( 15, 22 ] 541 0.026% 99.764% ( 22, 34 ] 43 0.002% 99.766% ( 34, 51 ] 32 0.002% 99.767% ( 51, 76 ] 160 0.008% 99.775% ( 76, 110 ] 972 0.046% 99.821% ( 110, 170 ] 1261 0.060% 99.881% ( 170, 250 ] 463 0.022% 99.903% ( 250, 380 ] 544 0.026% 99.929% ( 380, 580 ] 657 0.031% 99.960% ( 580, 870 ] 691 0.033% 99.993% ( 870, 1300 ] 537 0.026% 100.019% ( 1300, 1900 ] 343 0.016% 100.035% ( 1900, 2900 ] 397 0.019% 100.054% ( 2900, 4400 ] 473 0.023% 100.076% ( 4400, 6600 ] 139 0.007% 100.083% ( 6600, 9900 ] 47 0.002% 100.085% ( 9900, 14000 ] 3 0.000% 100.085% ** Level 2 read latency histogram (micros): Count: 124216 Average: 2.2013 StdDev: 13.87 Min: 1 Median: 1.4475 Max: 3313 Percentiles: P50: 1.45 P75: 1.83 P99: 5.82 P99.9: 12.78 P99.99: 262.53 ------------------------------------------------------ [ 0, 1 ] 26135 21.040% 21.040% #### ( 1, 2 ] 80381 64.711% 85.751% ############# ( 2, 3 ] 10701 8.615% 94.365% ## ( 3, 4 ] 3566 2.871% 97.236% # ( 4, 6 ] 2408 1.939% 99.175% ( 6, 10 ] 863 0.695% 99.870% ( 10, 15 ] 68 0.055% 99.924% ( 15, 22 ] 14 0.011% 99.936% ( 22, 34 ] 3 0.002% 99.938% ( 34, 51 ] 1 0.001% 99.939% ( 51, 76 ] 3 0.002% 99.941% ( 76, 110 ] 26 0.021% 99.962% ( 110, 170 ] 31 0.025% 99.987% ( 170, 250 ] 3 0.002% 99.990% ( 250, 380 ] 6 0.005% 99.994% ( 580, 870 ] 4 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1810167 Average: 6.1024 StdDev: 92.07 Min: 1 Median: 1.9966 Max: 15297 Percentiles: P50: 2.00 P75: 2.99 P99: 8.80 P99.9: 21.93 P99.99: 390.57 ------------------------------------------------------ [ 0, 1 ] 24361 1.346% 1.346% ( 1, 2 ] 883698 48.819% 50.164% ########## ( 2, 3 ] 453912 25.076% 75.240% ##### ( 3, 4 ] 204070 11.274% 86.514% ## ( 4, 6 ] 201871 11.152% 97.666% ## ( 6, 10 ] 34496 1.906% 99.571% ( 10, 15 ] 5324 0.294% 99.865% ( 15, 22 ] 631 0.035% 99.900% ( 22, 34 ] 78 0.004% 99.905% ( 34, 51 ] 31 0.002% 99.906% ( 51, 76 ] 66 0.004% 99.910% ( 76, 110 ] 155 0.009% 99.919% ( 110, 170 ] 363 0.020% 99.939% ( 170, 250 ] 385 0.021% 99.960% ( 250, 380 ] 507 0.028% 99.988% ( 380, 580 ] 719 0.040% 100.028% ( 580, 870 ] 793 0.044% 100.071% ( 870, 1300 ] 591 0.033% 100.104% ( 1300, 1900 ] 377 0.021% 100.125% ( 1900, 2900 ] 359 0.020% 100.145% ( 2900, 4400 ] 419 0.023% 100.168% ( 4400, 6600 ] 127 0.007% 100.175% ( 6600, 9900 ] 33 0.002% 100.177% ( 9900, 14000 ] 1 0.000% 100.177% ( 14000, 22000 ] 1 0.000% 100.177% ** Level 4 read latency histogram (micros): Count: 216061 Average: 33.1359 StdDev: 278.51 Min: 0 Median: 2.0490 Max: 23313 Percentiles: P50: 2.05 P75: 3.12 P99: 916.65 P99.9: 3810.31 P99.99: 4473.20 ------------------------------------------------------ [ 0, 1 ] 2951 1.366% 1.366% ( 1, 2 ] 102450 47.417% 48.783% ######### ( 2, 3 ] 53683 24.846% 73.629% ##### ( 3, 4 ] 24693 11.429% 85.058% ## ( 4, 6 ] 20903 9.675% 94.733% ## ( 6, 10 ] 5170 2.393% 97.125% ( 10, 15 ] 834 0.386% 97.511% ( 15, 22 ] 108 0.050% 97.561% ( 22, 34 ] 18 0.008% 97.570% ( 34, 51 ] 4 0.002% 97.572% ( 51, 76 ] 4 0.002% 97.573% ( 76, 110 ] 82 0.038% 97.611% ( 110, 170 ] 226 0.105% 97.716% ( 170, 250 ] 320 0.148% 97.864% ( 250, 380 ] 467 0.216% 98.080% ( 380, 580 ] 856 0.396% 98.476% ( 580, 870 ] 1037 0.480% 98.956% ( 870, 1300 ] 870 0.403% 99.359% ( 1300, 1900 ] 469 0.217% 99.576% ( 1900, 2900 ] 405 0.187% 99.763% ( 2900, 4400 ] 486 0.225% 99.988% ( 4400, 6600 ] 102 0.047% 100.036% ( 6600, 9900 ] 28 0.013% 100.049% ( 14000, 22000 ] 2 0.001% 100.050% ( 22000, 33000 ] 1 0.000% 100.050% ** Level 5 read latency histogram (micros): Count: 340 Average: 1632.4118 StdDev: 1794.33 Min: 77 Median: 935.1515 Max: 10770 Percentiles: P50: 935.15 P75: 2541.03 P99: 9570.00 P99.9: 10770.00 P99.99: 10770.00 ------------------------------------------------------ ( 76, 110 ] 26 7.647% 7.647% ## ( 110, 170 ] 29 8.529% 16.176% ## ( 170, 250 ] 24 7.059% 23.235% # ( 250, 380 ] 19 5.588% 28.824% # ( 380, 580 ] 28 8.235% 37.059% ## ( 580, 870 ] 39 11.471% 48.529% ## ( 870, 1300 ] 33 9.706% 58.235% ## ( 1300, 1900 ] 32 9.412% 67.647% ## ( 1900, 2900 ] 39 11.471% 79.118% ## ( 2900, 4400 ] 45 13.235% 92.353% ### ( 4400, 6600 ] 19 5.588% 97.941% # ( 6600, 9900 ] 4 1.176% 99.118% ( 9900, 14000 ] 3 0.882% 100.000% ** DB Stats ** Uptime(secs): 59.0 total, 3.0 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 183.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.635 H:M:S, 48.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.384 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.270 micros/op 189758 ops/sec 60.003 seconds 11385999 operations; 183.9 MB/s Microseconds per write: Count: 11385999 Average: 5.2699 StdDev: 411.82 Min: 1 Median: 1.7527 Max: 730501 Percentiles: P50: 1.75 P75: 2.71 P99: 8.57 P99.9: 1068.44 P99.99: 2547.23 ------------------------------------------------------ [ 0, 1 ] 1393620 12.240% 12.240% ## ( 1, 2 ] 5711841 50.165% 62.405% ########## ( 2, 3 ] 2006323 17.621% 80.026% #### ( 3, 4 ] 1539983 13.525% 93.551% ### ( 4, 6 ] 546950 4.804% 98.355% # ( 6, 10 ] 114344 1.004% 99.359% ( 10, 15 ] 31972 0.281% 99.640% ( 15, 22 ] 8227 0.072% 99.712% ( 22, 34 ] 1957 0.017% 99.730% ( 34, 51 ] 282 0.002% 99.732% ( 51, 76 ] 61 0.001% 99.733% ( 76, 110 ] 8253 0.072% 99.805% ( 110, 170 ] 2872 0.025% 99.830% ( 170, 250 ] 306 0.003% 99.833% ( 250, 380 ] 136 0.001% 99.834% ( 380, 580 ] 34 0.000% 99.835% ( 580, 870 ] 29 0.000% 99.835% ( 870, 1300 ] 16085 0.141% 99.976% ( 1300, 1900 ] 89 0.001% 99.977% ( 1900, 2900 ] 2312 0.020% 99.997% ( 2900, 4400 ] 225 0.002% 99.999% ( 4400, 6600 ] 54 0.000% 100.000% ( 6600, 9900 ] 15 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 191378 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11385999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11750350968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 672 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 28806997 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 36522124816 rocksdb.compact.write.bytes COUNT : 36319749770 rocksdb.flush.write.bytes COUNT : 11626160293 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 76 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 440 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11532411904 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4469760 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 36635133581 rocksdb.non.last.level.read.count COUNT : 8846325 rocksdb.block.checksum.compute.count COUNT : 8845057 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.390742 P95 : 3.818998 P99 : 6.848265 P100 : 730498.000000 COUNT : 11385999 SUM : 54548149 rocksdb.compaction.times.micros P50 : 972045.454545 P95 : 3894000.000000 P99 : 16629606.000000 P100 : 16629606.000000 COUNT : 129 SUM : 178927525 rocksdb.compaction.times.cpu_micros P50 : 804230.769231 P95 : 2810000.000000 P99 : 15705997.000000 P100 : 15705997.000000 COUNT : 129 SUM : 145084697 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 692.375000 P95 : 1284.363636 P99 : 15760.000000 P100 : 16587.000000 COUNT : 156 SUM : 166803 rocksdb.compaction.outfile.sync.micros P50 : 1179.600000 P95 : 72777.777778 P99 : 154533.333333 P100 : 233687.000000 COUNT : 432 SUM : 5657771 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 105.600000 P95 : 2477.777778 P99 : 5209.600000 P100 : 5545.000000 COUNT : 316 SUM : 130736 rocksdb.table.open.io.micros P50 : 1438.842975 P95 : 8910.000000 P99 : 17804.444444 P100 : 29780.000000 COUNT : 672 SUM : 1602861 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.739174 P95 : 8.099690 P99 : 10.570946 P100 : 23318.000000 COUNT : 8843052 SUM : 60751933 rocksdb.read.block.get.micros P50 : 447.039106 P95 : 3910.294118 P99 : 6383.771429 P100 : 10826.000000 COUNT : 1344 SUM : 1276664 rocksdb.write.raw.block.micros P50 : 0.512660 P95 : 0.974055 P99 : 2.740267 P100 : 30686.000000 COUNT : 11612802 SUM : 23730716 rocksdb.numfiles.in.singlecompaction P50 : 3.013889 P95 : 5.600000 P99 : 19.480000 P100 : 23.000000 COUNT : 172 SUM : 601 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.556734 P95 : 1123.705884 P99 : 2212.913559 P100 : 730329.000000 COUNT : 184387 SUM : 28822214 rocksdb.sst.read.micros P50 : 1.666325 P95 : 4.913905 P99 : 8.338164 P100 : 23313.000000 COUNT : 8846463 SUM : 42744824 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11385999 SUM : 11750350968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210388.349515 P95 : 386333.333333 P99 : 697600.000000 P100 : 915331.000000 COUNT : 156 SUM : 33813500 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 440 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0