[2024-07-13 04:05:54.653216] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 23.11.0 initialization... [2024-07-13 04:05:54.653466] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4164843 ] Set seed to 1720836354646793 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-13 04:05:54.761030] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-13 04:05:54.802694] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-13 04:05:54.802746] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 4164843' to capture a snapshot of events at runtime. [2024-07-13 04:05:54.802756] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-13 04:05:54.802766] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-13 04:05:54.802773] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid4164843 for offline analysis/debug. [2024-07-13 04:05:54.802860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Jul 13 04:05:59 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/13-04:06:02 ... thread 0: (1000000,1000000) ops and (337234.5,337234.5) ops/second in (2.965296,2.965296) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.99 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 351.5 2.51 2.27 12 0.209 0 0 0.0 0.0 L1 3/0 249.32 MB 24.9 0.2 0.2 0.0 0.2 0.2 0.2 1.0 249.7 249.4 1.01 0.97 1 1.009 255K 242 0.0 0.0 L2 3/2 191.30 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 241.9 241.8 0.80 0.75 2 0.399 196K 70 0.0 0.0 L3 11/0 930.30 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1179/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.5 1.5 103.1 307.4 4.32 4.00 15 0.288 452K 312 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 103.1 307.4 4.32 4.00 15 0.288 452K 312 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 246.2 246.1 1.81 1.72 3 0.603 452K 312 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 351.5 2.51 2.27 12 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.30 GB write, 425.40 MB/s write, 0.43 GB read, 142.74 MB/s read, 4.3 seconds Interval compaction: 1.30 GB write, 447.28 MB/s write, 0.43 GB read, 150.08 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 156372 Average: 1.9723 StdDev: 14.22 Min: 1 Median: 1.3098 Max: 3869 Percentiles: P50: 1.31 P75: 1.74 P99: 5.32 P99.9: 9.70 P99.99: 20.65 ------------------------------------------------------ [ 0, 1 ] 49956 31.947% 31.947% ###### ( 1, 2 ] 91121 58.272% 90.219% ############ ( 2, 3 ] 8623 5.514% 95.733% # ( 3, 4 ] 3467 2.217% 97.950% ( 4, 6 ] 2494 1.595% 99.545% ( 6, 10 ] 600 0.384% 99.929% ( 10, 15 ] 77 0.049% 99.978% ( 15, 22 ] 24 0.015% 99.994% ( 22, 34 ] 4 0.003% 99.996% ( 34, 51 ] 4 0.003% 99.999% ( 51, 76 ] 3 0.002% 100.001% ( 110, 170 ] 7 0.004% 100.005% ( 170, 250 ] 2 0.001% 100.006% ( 250, 380 ] 6 0.004% 100.010% ( 380, 580 ] 1 0.001% 100.011% ( 580, 870 ] 2 0.001% 100.012% ( 870, 1300 ] 3 0.002% 100.014% ( 1300, 1900 ] 1 0.001% 100.015% ( 1900, 2900 ] 1 0.001% 100.015% ( 2900, 4400 ] 1 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 639 Average: 17.7183 StdDev: 160.53 Min: 1 Median: 2.5477 Max: 2735 Percentiles: P50: 2.55 P75: 3.58 P99: 319.77 P99.9: 2580.50 P99.99: 2735.00 ------------------------------------------------------ [ 0, 1 ] 13 2.034% 2.034% ( 1, 2 ] 186 29.108% 31.142% ###### ( 2, 3 ] 220 34.429% 65.571% ####### ( 3, 4 ] 103 16.119% 81.690% ### ( 4, 6 ] 87 13.615% 95.305% ### ( 6, 10 ] 13 2.034% 97.340% ( 10, 15 ] 3 0.469% 97.809% ( 15, 22 ] 2 0.313% 98.122% ( 22, 34 ] 1 0.156% 98.279% ( 110, 170 ] 1 0.156% 98.435% ( 170, 250 ] 2 0.313% 98.748% ( 250, 380 ] 3 0.469% 99.218% ( 380, 580 ] 1 0.156% 99.374% ( 580, 870 ] 1 0.156% 99.531% ( 1300, 1900 ] 1 0.156% 99.687% ( 1900, 2900 ] 2 0.313% 100.000% ** Level 2 read latency histogram (micros): Count: 42667 Average: 2.2469 StdDev: 6.05 Min: 1 Median: 1.5358 Max: 1154 Percentiles: P50: 1.54 P75: 1.90 P99: 5.85 P99.9: 9.95 P99.99: 21.07 ------------------------------------------------------ [ 0, 1 ] 5623 13.179% 13.179% ### ( 1, 2 ] 29322 68.723% 81.902% ############## ( 2, 3 ] 4271 10.010% 91.912% ## ( 3, 4 ] 1692 3.966% 95.877% # ( 4, 6 ] 1444 3.384% 99.262% # ( 6, 10 ] 278 0.652% 99.913% ( 10, 15 ] 33 0.077% 99.991% ( 15, 22 ] 2 0.005% 99.995% ( 22, 34 ] 2 0.005% 100.000% ( 110, 170 ] 1 0.002% 100.002% ( 170, 250 ] 1 0.002% 100.005% ( 250, 380 ] 1 0.002% 100.007% ( 870, 1300 ] 1 0.002% 100.009% ** Level 3 read latency histogram (micros): Count: 50 Average: 1411.0000 StdDev: 1260.52 Min: 148 Median: 956.0000 Max: 6381 Percentiles: P50: 956.00 P75: 2218.18 P99: 6050.00 P99.9: 6381.00 P99.99: 6381.00 ------------------------------------------------------ ( 110, 170 ] 1 2.000% 2.000% ( 170, 250 ] 1 2.000% 4.000% ( 250, 380 ] 2 4.000% 8.000% # ( 380, 580 ] 12 24.000% 32.000% ##### ( 580, 870 ] 7 14.000% 46.000% ### ( 870, 1300 ] 10 20.000% 66.000% #### ( 1300, 1900 ] 1 2.000% 68.000% ( 1900, 2900 ] 11 22.000% 90.000% #### ( 2900, 4400 ] 3 6.000% 96.000% # ( 4400, 6600 ] 2 4.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 25 Average: 1454.1200 StdDev: 1423.83 Min: 154 Median: 1063.5000 Max: 6281 Percentiles: P50: 1063.50 P75: 1750.00 P99: 6281.00 P99.9: 6281.00 P99.99: 6281.00 ------------------------------------------------------ ( 110, 170 ] 1 4.000% 4.000% # ( 170, 250 ] 1 4.000% 8.000% # ( 250, 380 ] 1 4.000% 12.000% # ( 380, 580 ] 2 8.000% 20.000% ## ( 580, 870 ] 3 12.000% 32.000% ## ( 870, 1300 ] 10 40.000% 72.000% ######## ( 1300, 1900 ] 1 4.000% 76.000% # ( 1900, 2900 ] 3 12.000% 88.000% ## ( 2900, 4400 ] 1 4.000% 92.000% # ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 315.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.437 H:M:S, 14.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.437 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-04:06:05 ... thread 0: (1000000,2000000) ops and (326708.4,331888.0) ops/second in (3.060833,6.026129) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.41 GB 12.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 96.5 319.0 8.49 7.86 29 0.293 831K 863 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 249.7 249.4 1.01 0.97 1 1.009 255K 242 0.0 0.0 L2 2/1 81.61 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.4 1.5 241.9 241.8 0.80 0.75 2 0.399 196K 70 0.0 0.0 L3 20/11 1.09 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.3 1.0 231.5 231.5 0.81 0.74 1 0.808 189K 0 0.0 0.0 L4 174/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 128.7 128.7 1.31 0.90 1 1.307 170K 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/22 97.98 GB 0.0 1.6 0.7 0.9 3.4 2.6 0.9 1.9 130.5 282.6 12.41 11.23 34 0.365 1644K 1175 0.0 0.0 Int 0/0 0.00 KB 0.0 1.6 0.7 0.9 3.4 2.6 0.8 1.9 130.5 282.6 12.41 11.23 34 0.365 1644K 1175 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.6 0.7 0.9 1.6 0.7 0.0 0.0 231.0 230.8 7.01 6.40 8 0.876 1644K 1175 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.9 5.40 4.83 26 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.43 GB write, 567.68 MB/s write, 1.58 GB read, 262.06 MB/s read, 12.4 seconds Interval compaction: 3.43 GB write, 582.05 MB/s write, 1.58 GB read, 268.70 MB/s read, 12.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 412139 Average: 2.1899 StdDev: 12.61 Min: 1 Median: 1.4725 Max: 3869 Percentiles: P50: 1.47 P75: 1.87 P99: 5.70 P99.9: 9.74 P99.99: 15.34 ------------------------------------------------------ [ 0, 1 ] 83982 20.377% 20.377% #### ( 1, 2 ] 258377 62.692% 83.069% ############# ( 2, 3 ] 40853 9.912% 92.981% ## ( 3, 4 ] 14835 3.600% 96.581% # ( 4, 6 ] 11752 2.851% 99.432% # ( 6, 10 ] 2063 0.501% 99.933% ( 10, 15 ] 235 0.057% 99.990% ( 15, 22 ] 37 0.009% 99.999% ( 22, 34 ] 10 0.002% 100.001% ( 34, 51 ] 7 0.002% 100.003% ( 51, 76 ] 3 0.001% 100.004% ( 110, 170 ] 13 0.003% 100.007% ( 170, 250 ] 8 0.002% 100.009% ( 250, 380 ] 15 0.004% 100.012% ( 380, 580 ] 3 0.001% 100.013% ( 580, 870 ] 6 0.001% 100.015% ( 870, 1300 ] 6 0.001% 100.016% ( 1300, 1900 ] 3 0.001% 100.017% ( 1900, 2900 ] 2 0.000% 100.017% ( 2900, 4400 ] 2 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 639 Average: 17.7183 StdDev: 160.53 Min: 1 Median: 2.5477 Max: 2735 Percentiles: P50: 2.55 P75: 3.58 P99: 319.77 P99.9: 2580.50 P99.99: 2735.00 ------------------------------------------------------ [ 0, 1 ] 13 2.034% 2.034% ( 1, 2 ] 186 29.108% 31.142% ###### ( 2, 3 ] 220 34.429% 65.571% ####### ( 3, 4 ] 103 16.119% 81.690% ### ( 4, 6 ] 87 13.615% 95.305% ### ( 6, 10 ] 13 2.034% 97.340% ( 10, 15 ] 3 0.469% 97.809% ( 15, 22 ] 2 0.313% 98.122% ( 22, 34 ] 1 0.156% 98.279% ( 110, 170 ] 1 0.156% 98.435% ( 170, 250 ] 2 0.313% 98.748% ( 250, 380 ] 3 0.469% 99.218% ( 380, 580 ] 1 0.156% 99.374% ( 580, 870 ] 1 0.156% 99.531% ( 1300, 1900 ] 1 0.156% 99.687% ( 1900, 2900 ] 2 0.313% 100.000% ** Level 2 read latency histogram (micros): Count: 48715 Average: 2.2364 StdDev: 5.67 Min: 1 Median: 1.5366 Max: 1154 Percentiles: P50: 1.54 P75: 1.90 P99: 5.83 P99.9: 9.89 P99.99: 22.51 ------------------------------------------------------ [ 0, 1 ] 6387 13.111% 13.111% ### ( 1, 2 ] 33487 68.741% 81.852% ############## ( 2, 3 ] 5056 10.379% 92.230% ## ( 3, 4 ] 1862 3.822% 96.053% # ( 4, 6 ] 1569 3.221% 99.273% # ( 6, 10 ] 314 0.645% 99.918% ( 10, 15 ] 33 0.068% 99.986% ( 15, 22 ] 2 0.004% 99.990% ( 22, 34 ] 3 0.006% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 205244 Average: 3.5168 StdDev: 34.18 Min: 1 Median: 1.7057 Max: 6381 Percentiles: P50: 1.71 P75: 2.37 P99: 9.25 P99.9: 180.81 P99.99: 548.25 ------------------------------------------------------ [ 0, 1 ] 15533 7.568% 7.568% ## ( 1, 2 ] 123406 60.126% 67.695% ############ ( 2, 3 ] 41033 19.992% 87.687% #### ( 3, 4 ] 10401 5.068% 92.754% # ( 4, 6 ] 9803 4.776% 97.531% # ( 6, 10 ] 3709 1.807% 99.338% ( 10, 15 ] 652 0.318% 99.656% ( 15, 22 ] 123 0.060% 99.715% ( 22, 34 ] 32 0.016% 99.731% ( 34, 51 ] 1 0.000% 99.732% ( 51, 76 ] 7 0.003% 99.735% ( 76, 110 ] 98 0.048% 99.783% ( 110, 170 ] 229 0.112% 99.894% ( 170, 250 ] 87 0.042% 99.937% ( 250, 380 ] 59 0.029% 99.965% ( 380, 580 ] 60 0.029% 99.995% ( 580, 870 ] 31 0.015% 100.010% ( 870, 1300 ] 17 0.008% 100.018% ( 1300, 1900 ] 5 0.002% 100.020% ( 1900, 2900 ] 12 0.006% 100.026% ( 2900, 4400 ] 3 0.001% 100.028% ( 4400, 6600 ] 2 0.001% 100.029% ** Level 4 read latency histogram (micros): Count: 315 Average: 125.0190 StdDev: 561.66 Min: 1 Median: 2.3929 Max: 6281 Percentiles: P50: 2.39 P75: 6.20 P99: 2850.00 P99.9: 6253.50 P99.99: 6281.00 ------------------------------------------------------ [ 0, 1 ] 35 11.111% 11.111% ## ( 1, 2 ] 95 30.159% 41.270% ###### ( 2, 3 ] 70 22.222% 63.492% #### ( 3, 4 ] 22 6.984% 70.476% # ( 4, 6 ] 13 4.127% 74.603% # ( 6, 10 ] 25 7.937% 82.540% ## ( 10, 15 ] 19 6.032% 88.571% # ( 15, 22 ] 3 0.952% 89.524% ( 22, 34 ] 1 0.317% 89.841% ( 34, 51 ] 1 0.317% 90.159% ( 110, 170 ] 4 1.270% 91.429% ( 170, 250 ] 1 0.317% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 4 1.270% 94.603% ( 870, 1300 ] 10 3.175% 97.778% # ( 1300, 1900 ] 1 0.317% 98.095% ( 1900, 2900 ] 3 0.952% 99.048% ( 2900, 4400 ] 1 0.317% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.878 H:M:S, 14.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.440 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/13-04:06:07 ... thread 0: (1000000,3000000) ops and (355629.7,339441.7) ops/second in (2.811914,8.838043) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.27 GB 69.2 1.3 0.0 1.3 4.0 2.7 0.0 1.5 102.3 316.6 12.93 11.97 44 0.294 1343K 1376 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 249.7 249.4 1.01 0.97 1 1.009 255K 242 0.0 0.0 L2 1/0 77.38 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.4 1.5 241.9 241.8 0.80 0.75 2 0.399 196K 70 0.0 0.0 L3 13/0 606.00 MB 0.6 1.1 0.2 0.9 1.1 0.2 0.3 5.8 228.2 227.4 4.91 4.56 2 2.457 1139K 4292 0.0 0.0 L4 170/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 128.7 128.7 1.31 0.90 1 1.307 170K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/14 98.84 GB 0.0 3.0 0.7 2.3 5.7 3.4 2.1 2.1 145.9 277.9 20.96 19.16 50 0.419 3105K 5980 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 0.7 2.3 5.7 3.4 1.9 2.1 145.9 277.9 20.96 19.16 50 0.419 3105K 5980 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 0.7 2.3 3.0 0.7 0.0 0.0 233.9 233.5 13.07 12.13 11 1.188 3105K 5980 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 351.4 7.89 7.03 39 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.69 GB write, 647.70 MB/s write, 2.99 GB read, 340.09 MB/s read, 21.0 seconds Interval compaction: 5.69 GB write, 658.88 MB/s write, 2.99 GB read, 345.96 MB/s read, 21.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 782367 Average: 2.2257 StdDev: 10.89 Min: 1 Median: 1.5125 Max: 3869 Percentiles: P50: 1.51 P75: 1.89 P99: 5.67 P99.9: 9.71 P99.99: 14.36 ------------------------------------------------------ [ 0, 1 ] 128864 16.471% 16.471% ### ( 1, 2 ] 511843 65.422% 81.893% ############# ( 2, 3 ] 84878 10.849% 92.742% ## ( 3, 4 ] 30326 3.876% 96.618% # ( 4, 6 ] 22256 2.845% 99.463% # ( 6, 10 ] 3690 0.472% 99.935% ( 10, 15 ] 497 0.064% 99.998% ( 15, 22 ] 55 0.007% 100.005% ( 22, 34 ] 12 0.002% 100.007% ( 34, 51 ] 8 0.001% 100.008% ( 51, 76 ] 4 0.001% 100.008% ( 76, 110 ] 15 0.002% 100.010% ( 110, 170 ] 22 0.003% 100.013% ( 170, 250 ] 18 0.002% 100.015% ( 250, 380 ] 22 0.003% 100.018% ( 380, 580 ] 5 0.001% 100.019% ( 580, 870 ] 13 0.002% 100.021% ( 870, 1300 ] 9 0.001% 100.022% ( 1300, 1900 ] 4 0.001% 100.022% ( 1900, 2900 ] 3 0.000% 100.023% ( 2900, 4400 ] 3 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 28928 Average: 3.4060 StdDev: 27.85 Min: 1 Median: 1.6963 Max: 2735 Percentiles: P50: 1.70 P75: 2.29 P99: 9.07 P99.9: 233.27 P99.99: 1364.32 ------------------------------------------------------ [ 0, 1 ] 1244 4.300% 4.300% # ( 1, 2 ] 18987 65.635% 69.936% ############# ( 2, 3 ] 5125 17.716% 87.652% #### ( 3, 4 ] 1470 5.082% 92.734% # ( 4, 6 ] 1400 4.840% 97.573% # ( 6, 10 ] 537 1.856% 99.430% ( 10, 15 ] 75 0.259% 99.689% ( 15, 22 ] 12 0.041% 99.730% ( 22, 34 ] 2 0.007% 99.737% ( 110, 170 ] 36 0.124% 99.862% ( 170, 250 ] 14 0.048% 99.910% ( 250, 380 ] 10 0.035% 99.945% ( 380, 580 ] 7 0.024% 99.969% ( 580, 870 ] 5 0.017% 99.986% ( 870, 1300 ] 1 0.003% 99.990% ( 1300, 1900 ] 1 0.003% 99.993% ( 1900, 2900 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 49043 Average: 2.2390 StdDev: 5.66 Min: 1 Median: 1.5384 Max: 1154 Percentiles: P50: 1.54 P75: 1.90 P99: 5.83 P99.9: 9.90 P99.99: 22.38 ------------------------------------------------------ [ 0, 1 ] 6394 13.038% 13.038% ### ( 1, 2 ] 33671 68.656% 81.694% ############## ( 2, 3 ] 5155 10.511% 92.205% ## ( 3, 4 ] 1883 3.839% 96.044% # ( 4, 6 ] 1582 3.226% 99.270% # ( 6, 10 ] 317 0.646% 99.916% ( 10, 15 ] 34 0.069% 99.986% ( 15, 22 ] 2 0.004% 99.990% ( 22, 34 ] 3 0.006% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 250654 Average: 3.4775 StdDev: 32.35 Min: 1 Median: 1.6927 Max: 6381 Percentiles: P50: 1.69 P75: 2.32 P99: 9.20 P99.9: 191.80 P99.99: 594.76 ------------------------------------------------------ [ 0, 1 ] 19006 7.583% 7.583% ## ( 1, 2 ] 153492 61.237% 68.819% ############ ( 2, 3 ] 48077 19.181% 88.000% #### ( 3, 4 ] 12442 4.964% 92.964% # ( 4, 6 ] 11519 4.596% 97.559% # ( 6, 10 ] 4521 1.804% 99.363% ( 10, 15 ] 740 0.295% 99.658% ( 15, 22 ] 124 0.049% 99.708% ( 22, 34 ] 32 0.013% 99.720% ( 34, 51 ] 3 0.001% 99.722% ( 51, 76 ] 8 0.003% 99.725% ( 76, 110 ] 135 0.054% 99.779% ( 110, 170 ] 276 0.110% 99.889% ( 170, 250 ] 104 0.041% 99.930% ( 250, 380 ] 74 0.030% 99.960% ( 380, 580 ] 74 0.030% 99.989% ( 580, 870 ] 38 0.015% 100.004% ( 870, 1300 ] 23 0.009% 100.014% ( 1300, 1900 ] 8 0.003% 100.017% ( 1900, 2900 ] 12 0.005% 100.022% ( 2900, 4400 ] 3 0.001% 100.023% ( 4400, 6600 ] 2 0.001% 100.024% ** Level 4 read latency histogram (micros): Count: 315 Average: 125.0190 StdDev: 561.66 Min: 1 Median: 2.3929 Max: 6281 Percentiles: P50: 2.39 P75: 6.20 P99: 2850.00 P99.9: 6253.50 P99.99: 6281.00 ------------------------------------------------------ [ 0, 1 ] 35 11.111% 11.111% ## ( 1, 2 ] 95 30.159% 41.270% ###### ( 2, 3 ] 70 22.222% 63.492% #### ( 3, 4 ] 22 6.984% 70.476% # ( 4, 6 ] 13 4.127% 74.603% # ( 6, 10 ] 25 7.937% 82.540% ## ( 10, 15 ] 19 6.032% 88.571% # ( 15, 22 ] 3 0.952% 89.524% ( 22, 34 ] 1 0.317% 89.841% ( 34, 51 ] 1 0.317% 90.159% ( 110, 170 ] 4 1.270% 91.429% ( 170, 250 ] 1 0.317% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 4 1.270% 94.603% ( 870, 1300 ] 10 3.175% 97.778% # ( 1300, 1900 ] 1 0.317% 98.095% ( 1900, 2900 ] 3 0.952% 99.048% ( 2900, 4400 ] 1 0.317% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 941.4000 StdDev: 1083.44 Min: 98 Median: 465.7143 Max: 4282 Percentiles: P50: 465.71 P75: 1300.00 P99: 4200.00 P99.9: 4282.00 P99.99: 4282.00 ------------------------------------------------------ ( 76, 110 ] 3 7.500% 7.500% ## ( 110, 170 ] 7 17.500% 25.000% #### ( 170, 250 ] 4 10.000% 35.000% ## ( 250, 380 ] 3 7.500% 42.500% ## ( 380, 580 ] 7 17.500% 60.000% #### ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 6 15.000% 92.500% ### ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 9.0 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 328.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.082 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 350.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.204 H:M:S, 7.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/13-04:06:11 ... thread 0: (1000000,4000000) ops and (315370.5,333085.8) ops/second in (3.170874,12.008917) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.27 GB 25.2 2.4 0.0 2.4 6.1 3.8 0.0 1.6 121.7 311.8 20.19 18.85 62 0.326 2494K 2619 0.0 0.0 L1 10/10 1.04 GB 0.0 1.3 1.3 0.0 1.3 1.3 0.2 1.0 237.9 237.0 5.56 5.38 2 2.779 1342K 4845 0.0 0.0 L2 1/0 77.38 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.4 1.5 241.9 241.8 0.80 0.75 2 0.399 196K 70 0.0 0.0 L3 13/0 606.00 MB 0.6 1.1 0.2 0.9 1.1 0.2 0.3 5.8 228.2 227.4 4.91 4.56 2 2.457 1139K 4292 0.0 0.0 L4 170/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 128.7 128.7 1.31 0.90 1 1.307 170K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/21 99.88 GB 0.0 5.1 1.8 3.4 8.9 5.5 2.1 2.4 160.6 277.4 32.77 30.45 69 0.475 5343K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 1.8 3.4 8.9 5.5 1.9 2.4 160.6 277.4 32.77 30.45 69 0.475 5343K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 1.8 3.4 5.1 1.8 0.0 0.0 240.7 240.2 21.86 20.72 16 1.366 5343K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 352.1 10.91 9.73 53 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.88 GB write, 747.60 MB/s write, 5.14 GB read, 432.64 MB/s read, 32.8 seconds Interval compaction: 8.88 GB write, 757.10 MB/s write, 5.14 GB read, 438.14 MB/s read, 32.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 18, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1037327 Average: 2.2010 StdDev: 12.47 Min: 0 Median: 1.4763 Max: 3869 Percentiles: P50: 1.48 P75: 1.86 P99: 5.59 P99.9: 9.79 P99.99: 49.75 ------------------------------------------------------ [ 0, 1 ] 197466 19.036% 19.036% #### ( 1, 2 ] 674331 65.007% 84.043% ############# ( 2, 3 ] 100069 9.647% 93.689% ## ( 3, 4 ] 35426 3.415% 97.105% # ( 4, 6 ] 24704 2.382% 99.486% ( 6, 10 ] 4528 0.437% 99.923% ( 10, 15 ] 605 0.058% 99.981% ( 15, 22 ] 71 0.007% 99.988% ( 22, 34 ] 14 0.001% 99.989% ( 34, 51 ] 10 0.001% 99.990% ( 51, 76 ] 6 0.001% 99.991% ( 76, 110 ] 63 0.006% 99.997% ( 110, 170 ] 93 0.009% 100.006% ( 170, 250 ] 36 0.003% 100.009% ( 250, 380 ] 39 0.004% 100.013% ( 380, 580 ] 27 0.003% 100.016% ( 580, 870 ] 18 0.002% 100.017% ( 870, 1300 ] 16 0.002% 100.019% ( 1300, 1900 ] 5 0.000% 100.019% ( 1900, 2900 ] 5 0.000% 100.020% ( 2900, 4400 ] 7 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 44421 Average: 3.3404 StdDev: 28.58 Min: 0 Median: 1.5435 Max: 2735 Percentiles: P50: 1.54 P75: 1.94 P99: 9.11 P99.9: 287.20 P99.99: 1411.58 ------------------------------------------------------ [ 0, 1 ] 7048 15.866% 15.866% ### ( 1, 2 ] 27898 62.804% 78.670% ############# ( 2, 3 ] 5399 12.154% 90.824% ## ( 3, 4 ] 1586 3.570% 94.395% # ( 4, 6 ] 1456 3.278% 97.672% # ( 6, 10 ] 758 1.706% 99.379% ( 10, 15 ] 99 0.223% 99.602% ( 15, 22 ] 15 0.034% 99.635% ( 22, 34 ] 2 0.005% 99.640% ( 34, 51 ] 2 0.005% 99.644% ( 76, 110 ] 30 0.068% 99.712% ( 110, 170 ] 53 0.119% 99.831% ( 170, 250 ] 26 0.059% 99.890% ( 250, 380 ] 16 0.036% 99.926% ( 380, 580 ] 15 0.034% 99.959% ( 580, 870 ] 6 0.014% 99.973% ( 870, 1300 ] 7 0.016% 99.989% ( 1300, 1900 ] 3 0.007% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 49043 Average: 2.2390 StdDev: 5.66 Min: 1 Median: 1.5384 Max: 1154 Percentiles: P50: 1.54 P75: 1.90 P99: 5.83 P99.9: 9.90 P99.99: 22.38 ------------------------------------------------------ [ 0, 1 ] 6394 13.038% 13.038% ### ( 1, 2 ] 33671 68.656% 81.694% ############## ( 2, 3 ] 5155 10.511% 92.205% ## ( 3, 4 ] 1883 3.839% 96.044% # ( 4, 6 ] 1582 3.226% 99.270% # ( 6, 10 ] 317 0.646% 99.916% ( 10, 15 ] 34 0.069% 99.986% ( 15, 22 ] 2 0.004% 99.990% ( 22, 34 ] 3 0.006% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 250654 Average: 3.4775 StdDev: 32.35 Min: 1 Median: 1.6927 Max: 6381 Percentiles: P50: 1.69 P75: 2.32 P99: 9.20 P99.9: 191.80 P99.99: 594.76 ------------------------------------------------------ [ 0, 1 ] 19006 7.583% 7.583% ## ( 1, 2 ] 153492 61.237% 68.819% ############ ( 2, 3 ] 48077 19.181% 88.000% #### ( 3, 4 ] 12442 4.964% 92.964% # ( 4, 6 ] 11519 4.596% 97.559% # ( 6, 10 ] 4521 1.804% 99.363% ( 10, 15 ] 740 0.295% 99.658% ( 15, 22 ] 124 0.049% 99.708% ( 22, 34 ] 32 0.013% 99.720% ( 34, 51 ] 3 0.001% 99.722% ( 51, 76 ] 8 0.003% 99.725% ( 76, 110 ] 135 0.054% 99.779% ( 110, 170 ] 276 0.110% 99.889% ( 170, 250 ] 104 0.041% 99.930% ( 250, 380 ] 74 0.030% 99.960% ( 380, 580 ] 74 0.030% 99.989% ( 580, 870 ] 38 0.015% 100.004% ( 870, 1300 ] 23 0.009% 100.014% ( 1300, 1900 ] 8 0.003% 100.017% ( 1900, 2900 ] 12 0.005% 100.022% ( 2900, 4400 ] 3 0.001% 100.023% ( 4400, 6600 ] 2 0.001% 100.024% ** Level 4 read latency histogram (micros): Count: 315 Average: 125.0190 StdDev: 561.66 Min: 1 Median: 2.3929 Max: 6281 Percentiles: P50: 2.39 P75: 6.20 P99: 2850.00 P99.9: 6253.50 P99.99: 6281.00 ------------------------------------------------------ [ 0, 1 ] 35 11.111% 11.111% ## ( 1, 2 ] 95 30.159% 41.270% ###### ( 2, 3 ] 70 22.222% 63.492% #### ( 3, 4 ] 22 6.984% 70.476% # ( 4, 6 ] 13 4.127% 74.603% # ( 6, 10 ] 25 7.937% 82.540% ## ( 10, 15 ] 19 6.032% 88.571% # ( 15, 22 ] 3 0.952% 89.524% ( 22, 34 ] 1 0.317% 89.841% ( 34, 51 ] 1 0.317% 90.159% ( 110, 170 ] 4 1.270% 91.429% ( 170, 250 ] 1 0.317% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 4 1.270% 94.603% ( 870, 1300 ] 10 3.175% 97.778% # ( 1300, 1900 ] 1 0.317% 98.095% ( 1900, 2900 ] 3 0.952% 99.048% ( 2900, 4400 ] 1 0.317% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 941.4000 StdDev: 1083.44 Min: 98 Median: 465.7143 Max: 4282 Percentiles: P50: 465.71 P75: 1300.00 P99: 4200.00 P99.9: 4282.00 P99.99: 4282.00 ------------------------------------------------------ ( 76, 110 ] 3 7.500% 7.500% ## ( 110, 170 ] 7 17.500% 25.000% #### ( 170, 250 ] 4 10.000% 35.000% ## ( 250, 380 ] 3 7.500% 42.500% ## ( 380, 580 ] 7 17.500% 60.000% #### ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 6 15.000% 92.500% ### ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 12.2 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.660 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 310.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.578 H:M:S, 18.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/13-04:06:14 ... thread 0: (1000000,5000000) ops and (296051.1,324955.7) ops/second in (3.377795,15.386712) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.20 GB 94.4 3.2 0.0 3.2 7.9 4.7 0.0 1.7 126.7 311.7 25.86 24.16 79 0.327 3326K 3431 0.0 0.0 L1 10/10 1.04 GB 0.0 1.3 1.3 0.0 1.3 1.3 0.2 1.0 237.9 237.0 5.56 5.38 2 2.779 1342K 4845 0.0 0.0 L2 1/0 77.38 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.4 1.5 241.9 241.8 0.80 0.75 2 0.399 196K 70 0.0 0.0 L3 13/0 606.00 MB 0.6 1.1 0.2 0.9 1.1 0.2 0.3 5.8 228.2 227.4 4.91 4.56 2 2.457 1139K 4292 0.0 0.0 L4 170/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 128.7 128.7 1.31 0.90 1 1.307 170K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/25 100.80 GB 0.0 5.9 1.8 4.2 10.6 6.4 2.1 2.3 158.2 282.4 38.44 35.76 86 0.447 6174K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 1.8 4.2 10.6 6.4 1.9 2.3 158.2 282.4 38.44 35.76 86 0.447 6174K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 1.8 4.2 5.9 1.8 0.0 0.0 244.5 243.9 24.88 23.68 19 1.309 6174K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.1 13.56 12.08 67 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.60 GB write, 698.56 MB/s write, 5.94 GB read, 391.30 MB/s read, 38.4 seconds Interval compaction: 10.60 GB write, 705.48 MB/s write, 5.94 GB read, 395.18 MB/s read, 38.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 20, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1385682 Average: 2.2026 StdDev: 11.89 Min: 0 Median: 1.4805 Max: 3869 Percentiles: P50: 1.48 P75: 1.86 P99: 5.57 P99.9: 9.81 P99.99: 58.60 ------------------------------------------------------ [ 0, 1 ] 255897 18.467% 18.467% #### ( 1, 2 ] 909394 65.628% 84.095% ############# ( 2, 3 ] 135101 9.750% 93.845% ## ( 3, 4 ] 46864 3.382% 97.227% # ( 4, 6 ] 31288 2.258% 99.485% ( 6, 10 ] 6041 0.436% 99.921% ( 10, 15 ] 831 0.060% 99.981% ( 15, 22 ] 90 0.006% 99.987% ( 22, 34 ] 21 0.002% 99.989% ( 34, 51 ] 14 0.001% 99.990% ( 51, 76 ] 8 0.001% 99.990% ( 76, 110 ] 98 0.007% 99.997% ( 110, 170 ] 127 0.009% 100.007% ( 170, 250 ] 62 0.004% 100.011% ( 250, 380 ] 51 0.004% 100.015% ( 380, 580 ] 40 0.003% 100.018% ( 580, 870 ] 29 0.002% 100.020% ( 870, 1300 ] 19 0.001% 100.021% ( 1300, 1900 ] 5 0.000% 100.022% ( 1900, 2900 ] 5 0.000% 100.022% ( 2900, 4400 ] 9 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 111023 Average: 2.8382 StdDev: 19.74 Min: 0 Median: 1.5187 Max: 2735 Percentiles: P50: 1.52 P75: 1.90 P99: 8.60 P99.9: 168.59 P99.99: 1008.45 ------------------------------------------------------ [ 0, 1 ] 17898 16.121% 16.121% ### ( 1, 2 ] 72514 65.314% 81.435% ############# ( 2, 3 ] 12012 10.819% 92.255% ## ( 3, 4 ] 3567 3.213% 95.468% # ( 4, 6 ] 2742 2.470% 97.937% ( 6, 10 ] 1813 1.633% 99.570% ( 10, 15 ] 164 0.148% 99.718% ( 15, 22 ] 23 0.021% 99.739% ( 22, 34 ] 2 0.002% 99.741% ( 34, 51 ] 2 0.002% 99.742% ( 51, 76 ] 1 0.001% 99.743% ( 76, 110 ] 90 0.081% 99.824% ( 110, 170 ] 86 0.077% 99.902% ( 170, 250 ] 39 0.035% 99.937% ( 250, 380 ] 23 0.021% 99.958% ( 380, 580 ] 25 0.023% 99.980% ( 580, 870 ] 8 0.007% 99.987% ( 870, 1300 ] 9 0.008% 99.995% ( 1300, 1900 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 49043 Average: 2.2390 StdDev: 5.66 Min: 1 Median: 1.5384 Max: 1154 Percentiles: P50: 1.54 P75: 1.90 P99: 5.83 P99.9: 9.90 P99.99: 22.38 ------------------------------------------------------ [ 0, 1 ] 6394 13.038% 13.038% ### ( 1, 2 ] 33671 68.656% 81.694% ############## ( 2, 3 ] 5155 10.511% 92.205% ## ( 3, 4 ] 1883 3.839% 96.044% # ( 4, 6 ] 1582 3.226% 99.270% # ( 6, 10 ] 317 0.646% 99.916% ( 10, 15 ] 34 0.069% 99.986% ( 15, 22 ] 2 0.004% 99.990% ( 22, 34 ] 3 0.006% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 250654 Average: 3.4775 StdDev: 32.35 Min: 1 Median: 1.6927 Max: 6381 Percentiles: P50: 1.69 P75: 2.32 P99: 9.20 P99.9: 191.80 P99.99: 594.76 ------------------------------------------------------ [ 0, 1 ] 19006 7.583% 7.583% ## ( 1, 2 ] 153492 61.237% 68.819% ############ ( 2, 3 ] 48077 19.181% 88.000% #### ( 3, 4 ] 12442 4.964% 92.964% # ( 4, 6 ] 11519 4.596% 97.559% # ( 6, 10 ] 4521 1.804% 99.363% ( 10, 15 ] 740 0.295% 99.658% ( 15, 22 ] 124 0.049% 99.708% ( 22, 34 ] 32 0.013% 99.720% ( 34, 51 ] 3 0.001% 99.722% ( 51, 76 ] 8 0.003% 99.725% ( 76, 110 ] 135 0.054% 99.779% ( 110, 170 ] 276 0.110% 99.889% ( 170, 250 ] 104 0.041% 99.930% ( 250, 380 ] 74 0.030% 99.960% ( 380, 580 ] 74 0.030% 99.989% ( 580, 870 ] 38 0.015% 100.004% ( 870, 1300 ] 23 0.009% 100.014% ( 1300, 1900 ] 8 0.003% 100.017% ( 1900, 2900 ] 12 0.005% 100.022% ( 2900, 4400 ] 3 0.001% 100.023% ( 4400, 6600 ] 2 0.001% 100.024% ** Level 4 read latency histogram (micros): Count: 315 Average: 125.0190 StdDev: 561.66 Min: 1 Median: 2.3929 Max: 6281 Percentiles: P50: 2.39 P75: 6.20 P99: 2850.00 P99.9: 6253.50 P99.99: 6281.00 ------------------------------------------------------ [ 0, 1 ] 35 11.111% 11.111% ## ( 1, 2 ] 95 30.159% 41.270% ###### ( 2, 3 ] 70 22.222% 63.492% #### ( 3, 4 ] 22 6.984% 70.476% # ( 4, 6 ] 13 4.127% 74.603% # ( 6, 10 ] 25 7.937% 82.540% ## ( 10, 15 ] 19 6.032% 88.571% # ( 15, 22 ] 3 0.952% 89.524% ( 22, 34 ] 1 0.317% 89.841% ( 34, 51 ] 1 0.317% 90.159% ( 110, 170 ] 4 1.270% 91.429% ( 170, 250 ] 1 0.317% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 4 1.270% 94.603% ( 870, 1300 ] 10 3.175% 97.778% # ( 1300, 1900 ] 1 0.317% 98.095% ( 1900, 2900 ] 3 0.952% 99.048% ( 2900, 4400 ] 1 0.317% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 941.4000 StdDev: 1083.44 Min: 98 Median: 465.7143 Max: 4282 Percentiles: P50: 465.71 P75: 1300.00 P99: 4200.00 P99.9: 4282.00 P99.99: 4282.00 ------------------------------------------------------ ( 76, 110 ] 3 7.500% 7.500% ## ( 110, 170 ] 7 17.500% 25.000% #### ( 170, 250 ] 4 10.000% 35.000% ## ( 250, 380 ] 3 7.500% 42.500% ## ( 380, 580 ] 7 17.500% 60.000% #### ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 6 15.000% 92.500% ### ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 15.5 total, 3.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 316.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.411 H:M:S, 15.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 291.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.751 H:M:S, 22.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-04:06:22 ... thread 0: (1000000,6000000) ops and (119839.5,252831.6) ops/second in (8.344495,23.731207) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 4.18 GB 219.9 5.1 0.0 5.1 10.8 5.7 0.0 1.9 145.8 307.2 35.85 33.75 100 0.359 5308K 8057 0.0 0.0 L1 10/10 1.04 GB 0.0 1.3 1.3 0.0 1.3 1.3 0.2 1.0 237.9 237.0 5.56 5.38 2 2.779 1342K 4845 0.0 0.0 L2 1/0 77.38 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.4 1.5 241.9 241.8 0.80 0.75 2 0.399 196K 70 0.0 0.0 L3 13/0 606.00 MB 0.6 1.1 0.2 0.9 1.1 0.2 0.3 5.8 228.2 227.4 4.91 4.56 2 2.457 1139K 4292 0.0 0.0 L4 170/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 128.7 128.7 1.31 0.90 1 1.307 170K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/21 101.78 GB 0.0 7.8 1.8 6.1 13.5 7.4 2.1 2.4 165.9 285.2 48.43 45.35 107 0.453 8157K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.8 1.8 6.1 13.5 7.4 1.9 2.4 165.9 285.2 48.43 45.35 107 0.453 8157K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.8 1.8 6.1 7.8 1.8 0.0 0.0 251.2 250.7 31.98 30.68 24 1.332 8157K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 352.3 16.45 14.67 83 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.9 total, 23.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.49 GB write, 578.25 MB/s write, 7.84 GB read, 336.33 MB/s read, 48.4 seconds Interval compaction: 13.49 GB write, 581.96 MB/s write, 7.84 GB read, 338.49 MB/s read, 48.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 20, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2190578 Average: 2.2254 StdDev: 11.50 Min: 0 Median: 1.4707 Max: 3869 Percentiles: P50: 1.47 P75: 1.85 P99: 5.60 P99.9: 10.87 P99.99: 145.67 ------------------------------------------------------ [ 0, 1 ] 409777 18.706% 18.706% #### ( 1, 2 ] 1456237 66.477% 85.184% ############# ( 2, 3 ] 200202 9.139% 94.323% ## ( 3, 4 ] 69194 3.159% 97.482% # ( 4, 6 ] 41507 1.895% 99.376% ( 6, 10 ] 11254 0.514% 99.890% ( 10, 15 ] 1246 0.057% 99.947% ( 15, 22 ] 141 0.006% 99.953% ( 22, 34 ] 27 0.001% 99.955% ( 34, 51 ] 22 0.001% 99.956% ( 51, 76 ] 11 0.001% 99.956% ( 76, 110 ] 434 0.020% 99.976% ( 110, 170 ] 518 0.024% 100.000% ( 170, 250 ] 153 0.007% 100.007% ( 250, 380 ] 115 0.005% 100.012% ( 380, 580 ] 91 0.004% 100.016% ( 580, 870 ] 59 0.003% 100.019% ( 870, 1300 ] 26 0.001% 100.020% ( 1300, 1900 ] 8 0.000% 100.020% ( 1900, 2900 ] 8 0.000% 100.021% ( 2900, 4400 ] 10 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 275432 Average: 2.5711 StdDev: 14.01 Min: 0 Median: 1.4921 Max: 2735 Percentiles: P50: 1.49 P75: 1.87 P99: 8.25 P99.9: 140.57 P99.99: 576.71 ------------------------------------------------------ [ 0, 1 ] 47019 17.071% 17.071% ### ( 1, 2 ] 184322 66.921% 83.992% ############# ( 2, 3 ] 25632 9.306% 93.298% ## ( 3, 4 ] 8028 2.915% 96.213% # ( 4, 6 ] 5290 1.921% 98.133% ( 6, 10 ] 4250 1.543% 99.677% ( 10, 15 ] 246 0.089% 99.766% ( 15, 22 ] 32 0.012% 99.777% ( 22, 34 ] 4 0.001% 99.779% ( 34, 51 ] 3 0.001% 99.780% ( 51, 76 ] 13 0.005% 99.785% ( 76, 110 ] 206 0.075% 99.859% ( 110, 170 ] 219 0.080% 99.939% ( 170, 250 ] 65 0.024% 99.963% ( 250, 380 ] 43 0.016% 99.978% ( 380, 580 ] 33 0.012% 99.990% ( 580, 870 ] 13 0.005% 99.995% ( 870, 1300 ] 9 0.003% 99.998% ( 1300, 1900 ] 3 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 49043 Average: 2.2390 StdDev: 5.66 Min: 1 Median: 1.5384 Max: 1154 Percentiles: P50: 1.54 P75: 1.90 P99: 5.83 P99.9: 9.90 P99.99: 22.38 ------------------------------------------------------ [ 0, 1 ] 6394 13.038% 13.038% ### ( 1, 2 ] 33671 68.656% 81.694% ############## ( 2, 3 ] 5155 10.511% 92.205% ## ( 3, 4 ] 1883 3.839% 96.044% # ( 4, 6 ] 1582 3.226% 99.270% # ( 6, 10 ] 317 0.646% 99.916% ( 10, 15 ] 34 0.069% 99.986% ( 15, 22 ] 2 0.004% 99.990% ( 22, 34 ] 3 0.006% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 250654 Average: 3.4775 StdDev: 32.35 Min: 1 Median: 1.6927 Max: 6381 Percentiles: P50: 1.69 P75: 2.32 P99: 9.20 P99.9: 191.80 P99.99: 594.76 ------------------------------------------------------ [ 0, 1 ] 19006 7.583% 7.583% ## ( 1, 2 ] 153492 61.237% 68.819% ############ ( 2, 3 ] 48077 19.181% 88.000% #### ( 3, 4 ] 12442 4.964% 92.964% # ( 4, 6 ] 11519 4.596% 97.559% # ( 6, 10 ] 4521 1.804% 99.363% ( 10, 15 ] 740 0.295% 99.658% ( 15, 22 ] 124 0.049% 99.708% ( 22, 34 ] 32 0.013% 99.720% ( 34, 51 ] 3 0.001% 99.722% ( 51, 76 ] 8 0.003% 99.725% ( 76, 110 ] 135 0.054% 99.779% ( 110, 170 ] 276 0.110% 99.889% ( 170, 250 ] 104 0.041% 99.930% ( 250, 380 ] 74 0.030% 99.960% ( 380, 580 ] 74 0.030% 99.989% ( 580, 870 ] 38 0.015% 100.004% ( 870, 1300 ] 23 0.009% 100.014% ( 1300, 1900 ] 8 0.003% 100.017% ( 1900, 2900 ] 12 0.005% 100.022% ( 2900, 4400 ] 3 0.001% 100.023% ( 4400, 6600 ] 2 0.001% 100.024% ** Level 4 read latency histogram (micros): Count: 315 Average: 125.0190 StdDev: 561.66 Min: 1 Median: 2.3929 Max: 6281 Percentiles: P50: 2.39 P75: 6.20 P99: 2850.00 P99.9: 6253.50 P99.99: 6281.00 ------------------------------------------------------ [ 0, 1 ] 35 11.111% 11.111% ## ( 1, 2 ] 95 30.159% 41.270% ###### ( 2, 3 ] 70 22.222% 63.492% #### ( 3, 4 ] 22 6.984% 70.476% # ( 4, 6 ] 13 4.127% 74.603% # ( 6, 10 ] 25 7.937% 82.540% ## ( 10, 15 ] 19 6.032% 88.571% # ( 15, 22 ] 3 0.952% 89.524% ( 22, 34 ] 1 0.317% 89.841% ( 34, 51 ] 1 0.317% 90.159% ( 110, 170 ] 4 1.270% 91.429% ( 170, 250 ] 1 0.317% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 4 1.270% 94.603% ( 870, 1300 ] 10 3.175% 97.778% # ( 1300, 1900 ] 1 0.317% 98.095% ( 1900, 2900 ] 3 0.952% 99.048% ( 2900, 4400 ] 1 0.317% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 941.4000 StdDev: 1083.44 Min: 98 Median: 465.7143 Max: 4282 Percentiles: P50: 465.71 P75: 1300.00 P99: 4200.00 P99.9: 4282.00 P99.99: 4282.00 ------------------------------------------------------ ( 76, 110 ] 3 7.500% 7.500% ## ( 110, 170 ] 7 17.500% 25.000% #### ( 170, 250 ] 4 10.000% 35.000% ## ( 250, 380 ] 3 7.500% 42.500% ## ( 380, 580 ] 7 17.500% 60.000% #### ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 6 15.000% 92.500% ### ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 23.9 total, 8.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 247.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.894 H:M:S, 33.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 117.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.482 H:M:S, 65.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/13-04:06:28 ... thread 0: (1000000,7000000) ops and (176710.0,238174.7) ops/second in (5.658990,29.390197) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 3.13 GB 0.0 6.7 0.0 6.7 13.3 6.6 0.0 2.0 152.2 302.7 45.11 42.45 118 0.382 6970K 11K 0.0 0.0 L1 10/10 1.02 GB 0.0 4.4 3.3 1.0 4.3 3.3 0.2 1.3 230.6 228.2 19.36 18.56 3 6.453 4533K 46K 0.0 0.0 L2 9/6 1.13 GB 3.9 0.2 0.1 0.1 0.2 0.1 2.4 1.5 241.9 241.8 0.80 0.75 2 0.399 196K 70 0.0 0.0 L3 24/2 1.02 GB 1.0 2.2 1.1 1.1 2.2 1.1 0.3 2.0 218.9 218.3 10.47 9.60 5 2.093 2327K 6730 0.0 0.0 L4 169/0 9.44 GB 1.0 0.4 0.4 0.0 0.4 0.4 0.8 1.0 140.1 139.9 3.13 2.15 6 0.522 445K 497 0.0 0.0 L5 1056/0 86.98 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1278/28 102.72 GB 0.0 13.9 5.0 8.9 20.5 11.6 5.0 3.1 180.7 266.2 78.87 73.51 134 0.589 14M 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 5.0 8.9 20.5 11.6 4.9 3.1 180.7 266.2 78.87 73.51 134 0.589 14M 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 5.0 8.9 13.9 4.9 0.0 0.0 239.9 238.8 59.41 56.29 37 1.606 14M 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 349.8 19.45 17.22 97 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.5 total, 29.4 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.50 GB write, 710.48 MB/s write, 13.92 GB read, 482.42 MB/s read, 78.9 seconds Interval compaction: 20.50 GB write, 714.17 MB/s write, 13.92 GB read, 484.93 MB/s read, 78.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 24, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2733379 Average: 2.3193 StdDev: 11.92 Min: 0 Median: 1.4976 Max: 3869 Percentiles: P50: 1.50 P75: 1.88 P99: 5.80 P99.9: 12.84 P99.99: 161.33 ------------------------------------------------------ [ 0, 1 ] 466831 17.079% 17.079% ### ( 1, 2 ] 1808236 66.154% 83.233% ############# ( 2, 3 ] 271413 9.930% 93.162% ## ( 3, 4 ] 101844 3.726% 96.888% # ( 4, 6 ] 64130 2.346% 99.234% ( 6, 10 ] 17195 0.629% 99.864% ( 10, 15 ] 1754 0.064% 99.928% ( 15, 22 ] 180 0.007% 99.934% ( 22, 34 ] 29 0.001% 99.935% ( 34, 51 ] 57 0.002% 99.937% ( 51, 76 ] 39 0.001% 99.939% ( 76, 110 ] 710 0.026% 99.965% ( 110, 170 ] 805 0.029% 99.994% ( 170, 250 ] 254 0.009% 100.004% ( 250, 380 ] 185 0.007% 100.010% ( 380, 580 ] 145 0.005% 100.016% ( 580, 870 ] 95 0.003% 100.019% ( 870, 1300 ] 38 0.001% 100.021% ( 1300, 1900 ] 11 0.000% 100.021% ( 1900, 2900 ] 9 0.000% 100.021% ( 2900, 4400 ] 12 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 704779 Average: 3.2159 StdDev: 34.99 Min: 0 Median: 1.6329 Max: 9286 Percentiles: P50: 1.63 P75: 2.09 P99: 8.45 P99.9: 147.73 P99.99: 499.69 ------------------------------------------------------ [ 0, 1 ] 65099 9.237% 9.237% ## ( 1, 2 ] 453921 64.406% 73.643% ############# ( 2, 3 ] 105425 14.959% 88.602% ### ( 3, 4 ] 37130 5.268% 93.870% # ( 4, 6 ] 29207 4.144% 98.014% # ( 6, 10 ] 11370 1.613% 99.627% ( 10, 15 ] 1147 0.163% 99.790% ( 15, 22 ] 121 0.017% 99.807% ( 22, 34 ] 8 0.001% 99.808% ( 34, 51 ] 3 0.000% 99.809% ( 51, 76 ] 25 0.004% 99.812% ( 76, 110 ] 358 0.051% 99.863% ( 110, 170 ] 417 0.059% 99.922% ( 170, 250 ] 207 0.029% 99.952% ( 250, 380 ] 166 0.024% 99.975% ( 380, 580 ] 178 0.025% 100.000% ( 580, 870 ] 102 0.014% 100.015% ( 870, 1300 ] 49 0.007% 100.022% ( 1300, 1900 ] 22 0.003% 100.025% ( 1900, 2900 ] 11 0.002% 100.027% ( 2900, 4400 ] 18 0.003% 100.029% ( 4400, 6600 ] 5 0.001% 100.030% ( 6600, 9900 ] 3 0.000% 100.030% ** Level 2 read latency histogram (micros): Count: 49043 Average: 2.2390 StdDev: 5.66 Min: 1 Median: 1.5384 Max: 1154 Percentiles: P50: 1.54 P75: 1.90 P99: 5.83 P99.9: 9.90 P99.99: 22.38 ------------------------------------------------------ [ 0, 1 ] 6394 13.038% 13.038% ### ( 1, 2 ] 33671 68.656% 81.694% ############## ( 2, 3 ] 5155 10.511% 92.205% ## ( 3, 4 ] 1883 3.839% 96.044% # ( 4, 6 ] 1582 3.226% 99.270% # ( 6, 10 ] 317 0.646% 99.916% ( 10, 15 ] 34 0.069% 99.986% ( 15, 22 ] 2 0.004% 99.990% ( 22, 34 ] 3 0.006% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 332555 Average: 3.8382 StdDev: 37.66 Min: 1 Median: 1.7478 Max: 6381 Percentiles: P50: 1.75 P75: 2.50 P99: 9.24 P99.9: 180.23 P99.99: 364.31 ------------------------------------------------------ [ 0, 1 ] 20613 6.198% 6.198% # ( 1, 2 ] 194785 58.572% 64.771% ############ ( 2, 3 ] 67548 20.312% 85.082% #### ( 3, 4 ] 21456 6.452% 91.534% # ( 4, 6 ] 20117 6.049% 97.584% # ( 6, 10 ] 5811 1.747% 99.331% ( 10, 15 ] 1008 0.303% 99.634% ( 15, 22 ] 161 0.048% 99.682% ( 22, 34 ] 34 0.010% 99.693% ( 34, 51 ] 4 0.001% 99.694% ( 51, 76 ] 8 0.002% 99.696% ( 76, 110 ] 223 0.067% 99.763% ( 110, 170 ] 429 0.129% 99.892% ( 170, 250 ] 199 0.060% 99.952% ( 250, 380 ] 143 0.043% 99.995% ( 380, 580 ] 126 0.038% 100.033% ( 580, 870 ] 63 0.019% 100.052% ( 870, 1300 ] 32 0.010% 100.062% ( 1300, 1900 ] 9 0.003% 100.064% ( 1900, 2900 ] 16 0.005% 100.069% ( 2900, 4400 ] 12 0.004% 100.073% ( 4400, 6600 ] 2 0.001% 100.073% ** Level 4 read latency histogram (micros): Count: 3954 Average: 57.5713 StdDev: 259.68 Min: 1 Median: 2.0500 Max: 6596 Percentiles: P50: 2.05 P75: 3.44 P99: 1148.68 P99.9: 2969.00 P99.99: 6310.04 ------------------------------------------------------ [ 0, 1 ] 128 3.237% 3.237% # ( 1, 2 ] 1807 45.701% 48.938% ######### ( 2, 3 ] 840 21.244% 70.182% #### ( 3, 4 ] 436 11.027% 81.209% ## ( 4, 6 ] 241 6.095% 87.304% # ( 6, 10 ] 87 2.200% 89.504% ( 10, 15 ] 49 1.239% 90.744% ( 15, 22 ] 3 0.076% 90.819% ( 22, 34 ] 1 0.025% 90.845% ( 34, 51 ] 1 0.025% 90.870% ( 76, 110 ] 12 0.303% 91.173% ( 110, 170 ] 36 0.910% 92.084% ( 170, 250 ] 42 1.062% 93.146% ( 250, 380 ] 57 1.442% 94.588% ( 380, 580 ] 84 2.124% 96.712% ( 580, 870 ] 60 1.517% 98.230% ( 870, 1300 ] 47 1.189% 99.418% ( 1300, 1900 ] 15 0.379% 99.798% ( 1900, 2900 ] 4 0.101% 99.899% ( 2900, 4400 ] 1 0.025% 99.924% ( 4400, 6600 ] 3 0.076% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 1053.3375 StdDev: 1154.63 Min: 96 Median: 505.0000 Max: 4510 Percentiles: P50: 505.00 P75: 1976.92 P99: 4510.00 P99.9: 4510.00 P99.99: 4510.00 ------------------------------------------------------ ( 76, 110 ] 7 8.750% 8.750% ## ( 110, 170 ] 11 13.750% 22.500% ### ( 170, 250 ] 7 8.750% 31.250% ## ( 250, 380 ] 10 12.500% 43.750% ### ( 380, 580 ] 8 10.000% 53.750% ## ( 580, 870 ] 7 8.750% 62.500% ## ( 870, 1300 ] 7 8.750% 71.250% ## ( 1300, 1900 ] 2 2.500% 73.750% # ( 1900, 2900 ] 13 16.250% 90.000% ### ( 2900, 4400 ] 7 8.750% 98.750% ## ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 29.5 total, 5.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 233.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.755 H:M:S, 36.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 173.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.861 H:M:S, 50.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/13-04:06:32 ... thread 0: (1000000,8000000) ops and (227372.0,236768.5) ops/second in (4.398078,33.788275) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 4.05 GB 94.4 7.6 0.0 7.6 15.2 7.6 0.0 2.0 149.6 297.8 52.20 48.53 133 0.393 7930K 12K 0.0 0.0 L1 10/10 1.02 GB 0.0 4.4 3.3 1.0 4.3 3.3 0.2 1.3 230.6 228.2 19.36 18.56 3 6.453 4533K 46K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 2.4 1.5 241.9 241.8 0.80 0.75 2 0.399 196K 70 0.0 0.0 L3 23/0 997.35 MB 1.0 3.8 2.3 1.5 3.8 2.3 0.3 1.7 207.2 206.7 18.79 16.59 10 1.879 3953K 9796 0.0 0.0 L4 177/0 9.62 GB 1.0 1.7 1.6 0.1 1.7 1.6 0.8 1.0 146.2 145.9 11.66 7.90 29 0.402 1689K 1437 0.0 0.0 L5 1068/0 87.97 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/20 103.63 GB 0.0 17.6 7.3 10.3 25.1 14.8 6.0 3.3 175.7 250.4 102.80 92.34 177 0.581 18M 70K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.6 7.3 10.3 25.1 14.8 5.9 3.3 175.7 250.4 102.80 92.34 177 0.581 18M 70K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.6 7.3 10.3 17.6 7.2 0.0 0.0 225.7 224.8 80.02 72.63 68 1.177 18M 70K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 340.2 22.78 19.71 109 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.9 total, 33.8 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.14 GB write, 758.36 MB/s write, 17.64 GB read, 532.20 MB/s read, 102.8 seconds Interval compaction: 25.14 GB write, 761.78 MB/s write, 17.64 GB read, 534.60 MB/s read, 102.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 30, total-stops: 40, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3209793 Average: 2.4160 StdDev: 16.38 Min: 0 Median: 1.5291 Max: 7590 Percentiles: P50: 1.53 P75: 1.91 P99: 5.92 P99.9: 12.74 P99.99: 155.09 ------------------------------------------------------ [ 0, 1 ] 496488 15.468% 15.468% ### ( 1, 2 ] 2094769 65.262% 80.730% ############# ( 2, 3 ] 353410 11.010% 91.740% ## ( 3, 4 ] 137976 4.299% 96.039% # ( 4, 6 ] 98812 3.078% 99.117% # ( 6, 10 ] 23702 0.738% 99.856% ( 10, 15 ] 2603 0.081% 99.937% ( 15, 22 ] 241 0.008% 99.944% ( 22, 34 ] 34 0.001% 99.945% ( 34, 51 ] 65 0.002% 99.947% ( 51, 76 ] 41 0.001% 99.949% ( 76, 110 ] 715 0.022% 99.971% ( 110, 170 ] 821 0.026% 99.996% ( 170, 250 ] 285 0.009% 100.005% ( 250, 380 ] 210 0.007% 100.012% ( 380, 580 ] 176 0.005% 100.017% ( 580, 870 ] 113 0.004% 100.021% ( 870, 1300 ] 59 0.002% 100.023% ( 1300, 1900 ] 18 0.001% 100.023% ( 1900, 2900 ] 18 0.001% 100.024% ( 2900, 4400 ] 25 0.001% 100.025% ( 4400, 6600 ] 4 0.000% 100.025% ( 6600, 9900 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 885497 Average: 3.6689 StdDev: 52.15 Min: 0 Median: 1.6651 Max: 9286 Percentiles: P50: 1.67 P75: 2.23 P99: 8.61 P99.9: 164.75 P99.99: 645.81 ------------------------------------------------------ [ 0, 1 ] 69064 7.799% 7.799% ## ( 1, 2 ] 561888 63.455% 71.254% ############# ( 2, 3 ] 142141 16.052% 87.306% ### ( 3, 4 ] 51455 5.811% 93.117% # ( 4, 6 ] 42321 4.779% 97.896% # ( 6, 10 ] 14989 1.693% 99.589% ( 10, 15 ] 1731 0.195% 99.785% ( 15, 22 ] 166 0.019% 99.803% ( 22, 34 ] 11 0.001% 99.805% ( 34, 51 ] 8 0.001% 99.805% ( 51, 76 ] 28 0.003% 99.809% ( 76, 110 ] 387 0.044% 99.852% ( 110, 170 ] 463 0.052% 99.905% ( 170, 250 ] 255 0.029% 99.933% ( 250, 380 ] 233 0.026% 99.960% ( 380, 580 ] 236 0.027% 99.986% ( 580, 870 ] 143 0.016% 100.002% ( 870, 1300 ] 91 0.010% 100.013% ( 1300, 1900 ] 44 0.005% 100.018% ( 1900, 2900 ] 31 0.004% 100.021% ( 2900, 4400 ] 47 0.005% 100.027% ( 4400, 6600 ] 27 0.003% 100.030% ( 6600, 9900 ] 11 0.001% 100.031% ** Level 2 read latency histogram (micros): Count: 49043 Average: 2.2390 StdDev: 5.66 Min: 1 Median: 1.5384 Max: 1154 Percentiles: P50: 1.54 P75: 1.90 P99: 5.83 P99.9: 9.90 P99.99: 22.38 ------------------------------------------------------ [ 0, 1 ] 6394 13.038% 13.038% ### ( 1, 2 ] 33671 68.656% 81.694% ############## ( 2, 3 ] 5155 10.511% 92.205% ## ( 3, 4 ] 1883 3.839% 96.044% # ( 4, 6 ] 1582 3.226% 99.270% # ( 6, 10 ] 317 0.646% 99.916% ( 10, 15 ] 34 0.069% 99.986% ( 15, 22 ] 2 0.004% 99.990% ( 22, 34 ] 3 0.006% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 735161 Average: 4.0601 StdDev: 50.46 Min: 1 Median: 1.8580 Max: 8019 Percentiles: P50: 1.86 P75: 2.79 P99: 8.68 P99.9: 89.20 P99.99: 171.29 ------------------------------------------------------ [ 0, 1 ] 25399 3.455% 3.455% # ( 1, 2 ] 398797 54.246% 57.701% ########### ( 2, 3 ] 160746 21.865% 79.567% #### ( 3, 4 ] 66750 9.080% 88.646% ## ( 4, 6 ] 67465 9.177% 97.823% ## ( 6, 10 ] 12906 1.756% 99.579% ( 10, 15 ] 1929 0.262% 99.841% ( 15, 22 ] 260 0.035% 99.876% ( 22, 34 ] 43 0.006% 99.882% ( 34, 51 ] 21 0.003% 99.885% ( 51, 76 ] 19 0.003% 99.888% ( 76, 110 ] 234 0.032% 99.919% ( 110, 170 ] 514 0.070% 99.989% ( 170, 250 ] 279 0.038% 100.027% ( 250, 380 ] 208 0.028% 100.056% ( 380, 580 ] 212 0.029% 100.084% ( 580, 870 ] 148 0.020% 100.105% ( 870, 1300 ] 85 0.012% 100.116% ( 1300, 1900 ] 24 0.003% 100.119% ( 1900, 2900 ] 39 0.005% 100.125% ( 2900, 4400 ] 49 0.007% 100.131% ( 4400, 6600 ] 14 0.002% 100.133% ( 6600, 9900 ] 4 0.001% 100.134% ** Level 4 read latency histogram (micros): Count: 21166 Average: 70.0206 StdDev: 352.66 Min: 1 Median: 2.0837 Max: 10071 Percentiles: P50: 2.08 P75: 3.47 P99: 1402.62 P99.9: 5119.81 P99.99: 7571.74 ------------------------------------------------------ [ 0, 1 ] 513 2.424% 2.424% ( 1, 2 ] 9696 45.809% 48.233% ######### ( 2, 3 ] 4471 21.123% 69.357% #### ( 3, 4 ] 2552 12.057% 81.414% ## ( 4, 6 ] 1500 7.087% 88.500% # ( 6, 10 ] 393 1.857% 90.357% ( 10, 15 ] 142 0.671% 91.028% ( 15, 22 ] 13 0.061% 91.089% ( 22, 34 ] 2 0.009% 91.099% ( 34, 51 ] 1 0.005% 91.104% ( 76, 110 ] 64 0.302% 91.406% ( 110, 170 ] 180 0.850% 92.256% ( 170, 250 ] 202 0.954% 93.211% ( 250, 380 ] 271 1.280% 94.491% ( 380, 580 ] 394 1.861% 96.353% ( 580, 870 ] 359 1.696% 98.049% ( 870, 1300 ] 188 0.888% 98.937% ( 1300, 1900 ] 78 0.369% 99.305% ( 1900, 2900 ] 66 0.312% 99.617% ( 2900, 4400 ] 51 0.241% 99.858% ( 4400, 6600 ] 27 0.128% 99.986% ( 6600, 9900 ] 3 0.014% 100.000% ( 9900, 14000 ] 1 0.005% 100.005% ** Level 5 read latency histogram (micros): Count: 140 Average: 1149.5714 StdDev: 1231.85 Min: 90 Median: 555.0000 Max: 4510 Percentiles: P50: 555.00 P75: 2100.00 P99: 4366.67 P99.9: 4510.00 P99.99: 4510.00 ------------------------------------------------------ ( 76, 110 ] 10 7.143% 7.143% # ( 110, 170 ] 18 12.857% 20.000% ### ( 170, 250 ] 12 8.571% 28.571% ## ( 250, 380 ] 16 11.429% 40.000% ## ( 380, 580 ] 16 11.429% 51.429% ## ( 580, 870 ] 14 10.000% 61.429% ## ( 870, 1300 ] 10 7.143% 68.571% # ( 1300, 1900 ] 5 3.571% 72.143% # ( 1900, 2900 ] 20 14.286% 86.429% ### ( 2900, 4400 ] 18 12.857% 99.286% ### ( 4400, 6600 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 33.9 total, 4.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 231.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.326 H:M:S, 36.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 223.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.571 H:M:S, 35.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-04:06:48 ... thread 0: (1000000,9000000) ops and (63785.0,181943.3) ops/second in (15.677677,49.465952) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 2.15 GB 62.9 8.7 0.0 8.7 17.2 8.5 0.0 2.0 151.4 298.3 59.08 55.02 150 0.394 9081K 13K 0.0 0.0 L1 4/0 390.41 MB 39.0 8.2 6.1 2.1 8.1 6.0 0.2 1.3 230.4 227.3 36.43 34.73 4 9.109 7915K 46K 0.0 0.0 L2 11/9 1.38 GB 2.6 0.2 0.1 0.1 0.2 0.1 5.8 1.5 241.9 241.8 0.80 0.75 2 0.399 196K 70 0.0 0.0 L3 34/9 1.80 GB 1.3 6.3 3.8 2.5 6.3 3.8 0.7 1.6 177.2 176.4 36.54 28.48 23 1.589 6446K 29K 0.0 0.0 L4 187/14 10.78 GB 1.1 3.1 2.7 0.3 3.1 2.7 0.8 1.1 139.6 139.2 22.67 14.62 43 0.527 3088K 5345 0.0 0.0 L5 1068/0 87.97 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1312/38 104.47 GB 0.0 26.5 12.8 13.7 34.9 21.2 9.9 4.1 174.7 229.6 155.53 133.60 222 0.701 26M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.5 12.8 13.7 34.9 21.2 9.8 4.1 174.7 229.6 155.53 133.60 222 0.701 26M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.5 12.8 13.7 26.4 12.7 0.0 0.0 208.9 207.7 130.06 111.51 100 1.301 26M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 341.4 25.46 22.10 122 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.6 total, 49.5 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.87 GB write, 719.51 MB/s write, 26.53 GB read, 547.59 MB/s read, 155.5 seconds Interval compaction: 34.87 GB write, 721.73 MB/s write, 26.53 GB read, 549.28 MB/s read, 155.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 48, pending-compaction-bytes-stops: 0, total-delays: 63, total-stops: 44, interval: 107 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4250201 Average: 2.4781 StdDev: 19.03 Min: 0 Median: 1.5292 Max: 7912 Percentiles: P50: 1.53 P75: 1.92 P99: 6.25 P99.9: 13.63 P99.99: 173.86 ------------------------------------------------------ [ 0, 1 ] 680137 16.002% 16.002% ### ( 1, 2 ] 2730649 64.248% 80.250% ############# ( 2, 3 ] 465127 10.944% 91.194% ## ( 3, 4 ] 186069 4.378% 95.572% # ( 4, 6 ] 143385 3.374% 98.945% # ( 6, 10 ] 37521 0.883% 99.828% ( 10, 15 ] 4216 0.099% 99.927% ( 15, 22 ] 441 0.010% 99.938% ( 22, 34 ] 53 0.001% 99.939% ( 34, 51 ] 69 0.002% 99.940% ( 51, 76 ] 75 0.002% 99.942% ( 76, 110 ] 995 0.023% 99.966% ( 110, 170 ] 1022 0.024% 99.990% ( 170, 250 ] 373 0.009% 99.998% ( 250, 380 ] 283 0.007% 100.005% ( 380, 580 ] 261 0.006% 100.011% ( 580, 870 ] 235 0.006% 100.017% ( 870, 1300 ] 120 0.003% 100.020% ( 1300, 1900 ] 41 0.001% 100.020% ( 1900, 2900 ] 30 0.001% 100.021% ( 2900, 4400 ] 37 0.001% 100.022% ( 4400, 6600 ] 5 0.000% 100.022% ( 6600, 9900 ] 5 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1694507 Average: 4.9200 StdDev: 77.13 Min: 0 Median: 1.7131 Max: 11216 Percentiles: P50: 1.71 P75: 2.53 P99: 9.12 P99.9: 192.87 P99.99: 659.09 ------------------------------------------------------ [ 0, 1 ] 166673 9.836% 9.836% ## ( 1, 2 ] 954445 56.326% 66.162% ########### ( 2, 3 ] 281855 16.633% 82.795% ### ( 3, 4 ] 124506 7.348% 90.143% # ( 4, 6 ] 123451 7.285% 97.428% # ( 6, 10 ] 34155 2.016% 99.444% ( 10, 15 ] 5308 0.313% 99.757% ( 15, 22 ] 611 0.036% 99.793% ( 22, 34 ] 40 0.002% 99.796% ( 34, 51 ] 29 0.002% 99.797% ( 51, 76 ] 147 0.009% 99.806% ( 76, 110 ] 685 0.040% 99.846% ( 110, 170 ] 806 0.048% 99.894% ( 170, 250 ] 355 0.021% 99.915% ( 250, 380 ] 481 0.028% 99.943% ( 380, 580 ] 628 0.037% 99.980% ( 580, 870 ] 596 0.035% 100.016% ( 870, 1300 ] 463 0.027% 100.043% ( 1300, 1900 ] 225 0.013% 100.056% ( 1900, 2900 ] 174 0.010% 100.066% ( 2900, 4400 ] 247 0.015% 100.081% ( 4400, 6600 ] 77 0.005% 100.086% ( 6600, 9900 ] 30 0.002% 100.087% ( 9900, 14000 ] 5 0.000% 100.088% ** Level 2 read latency histogram (micros): Count: 49043 Average: 2.2390 StdDev: 5.66 Min: 1 Median: 1.5384 Max: 1154 Percentiles: P50: 1.54 P75: 1.90 P99: 5.83 P99.9: 9.90 P99.99: 22.38 ------------------------------------------------------ [ 0, 1 ] 6394 13.038% 13.038% ### ( 1, 2 ] 33671 68.656% 81.694% ############## ( 2, 3 ] 5155 10.511% 92.205% ## ( 3, 4 ] 1883 3.839% 96.044% # ( 4, 6 ] 1582 3.226% 99.270% # ( 6, 10 ] 317 0.646% 99.916% ( 10, 15 ] 34 0.069% 99.986% ( 15, 22 ] 2 0.004% 99.990% ( 22, 34 ] 3 0.006% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 1326541 Average: 5.4668 StdDev: 76.45 Min: 1 Median: 1.9441 Max: 15345 Percentiles: P50: 1.94 P75: 2.98 P99: 9.10 P99.9: 141.16 P99.99: 399.72 ------------------------------------------------------ [ 0, 1 ] 31712 2.391% 2.391% ( 1, 2 ] 668946 50.428% 52.818% ########## ( 2, 3 ] 300052 22.619% 75.438% ##### ( 3, 4 ] 140343 10.580% 86.017% ## ( 4, 6 ] 151144 11.394% 97.411% ## ( 6, 10 ] 27228 2.053% 99.464% ( 10, 15 ] 4615 0.348% 99.811% ( 15, 22 ] 477 0.036% 99.847% ( 22, 34 ] 67 0.005% 99.852% ( 34, 51 ] 38 0.003% 99.855% ( 51, 76 ] 55 0.004% 99.859% ( 76, 110 ] 244 0.018% 99.878% ( 110, 170 ] 569 0.043% 99.921% ( 170, 250 ] 401 0.030% 99.951% ( 250, 380 ] 459 0.035% 99.986% ( 380, 580 ] 612 0.046% 100.032% ( 580, 870 ] 577 0.043% 100.075% ( 870, 1300 ] 422 0.032% 100.107% ( 1300, 1900 ] 212 0.016% 100.123% ( 1900, 2900 ] 168 0.013% 100.136% ( 2900, 4400 ] 207 0.016% 100.151% ( 4400, 6600 ] 55 0.004% 100.155% ( 6600, 9900 ] 12 0.001% 100.156% ( 9900, 14000 ] 2 0.000% 100.156% ( 14000, 22000 ] 1 0.000% 100.157% ** Level 4 read latency histogram (micros): Count: 123392 Average: 37.8646 StdDev: 281.03 Min: 1 Median: 2.0695 Max: 22720 Percentiles: P50: 2.07 P75: 3.41 P99: 1063.36 P99.9: 3948.15 P99.99: 5830.39 ------------------------------------------------------ [ 0, 1 ] 2042 1.655% 1.655% ( 1, 2 ] 57792 46.836% 48.491% ######### ( 2, 3 ] 26775 21.699% 70.190% #### ( 3, 4 ] 14638 11.863% 82.053% ## ( 4, 6 ] 14099 11.426% 93.479% ## ( 6, 10 ] 3126 2.533% 96.013% # ( 10, 15 ] 727 0.589% 96.602% ( 15, 22 ] 68 0.055% 96.657% ( 22, 34 ] 3 0.002% 96.659% ( 34, 51 ] 3 0.002% 96.662% ( 51, 76 ] 8 0.006% 96.668% ( 76, 110 ] 69 0.056% 96.724% ( 110, 170 ] 199 0.161% 96.886% ( 170, 250 ] 261 0.212% 97.097% ( 250, 380 ] 445 0.361% 97.458% ( 380, 580 ] 733 0.594% 98.052% ( 580, 870 ] 876 0.710% 98.762% ( 870, 1300 ] 654 0.530% 99.292% ( 1300, 1900 ] 330 0.267% 99.559% ( 1900, 2900 ] 255 0.207% 99.766% ( 2900, 4400 ] 237 0.192% 99.958% ( 4400, 6600 ] 61 0.049% 100.007% ( 6600, 9900 ] 10 0.008% 100.015% ( 9900, 14000 ] 4 0.003% 100.019% ( 22000, 33000 ] 1 0.001% 100.019% ** Level 5 read latency histogram (micros): Count: 140 Average: 1149.5714 StdDev: 1231.85 Min: 90 Median: 555.0000 Max: 4510 Percentiles: P50: 555.00 P75: 2100.00 P99: 4366.67 P99.9: 4510.00 P99.99: 4510.00 ------------------------------------------------------ ( 76, 110 ] 10 7.143% 7.143% # ( 110, 170 ] 18 12.857% 20.000% ### ( 170, 250 ] 12 8.571% 28.571% ## ( 250, 380 ] 16 11.429% 40.000% ## ( 380, 580 ] 16 11.429% 51.429% ## ( 580, 870 ] 14 10.000% 61.429% ## ( 870, 1300 ] 10 7.143% 68.571% # ( 1300, 1900 ] 5 3.571% 72.143% # ( 1900, 2900 ] 20 14.286% 86.429% ### ( 2900, 4400 ] 18 12.857% 99.286% ### ( 4400, 6600 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 49.6 total, 15.7 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 178.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.914 H:M:S, 50.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 62.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.588 H:M:S, 80.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/13-04:06:52 ... thread 0: (1000000,10000000) ops and (223839.4,185413.7) ops/second in (4.467488,53.933440) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/5 3.12 GB 81.8 10.8 0.0 10.8 20.3 9.4 0.0 2.1 152.2 285.0 72.85 66.20 166 0.439 11M 24K 0.0 0.0 L1 4/4 390.41 MB 0.0 8.2 6.1 2.1 8.1 6.0 0.2 1.3 230.4 227.3 36.43 34.73 4 9.109 7915K 46K 0.0 0.0 L2 2/2 257.56 MB 0.0 0.2 0.1 0.1 0.2 0.1 5.8 1.5 241.9 241.8 0.80 0.75 2 0.399 196K 70 0.0 0.0 L3 26/6 1.50 GB 1.0 7.5 5.0 2.6 7.5 4.9 0.7 1.5 174.1 173.4 44.18 34.00 24 1.841 7421K 29K 0.0 0.0 L4 169/4 9.56 GB 1.0 5.0 4.1 0.9 5.0 4.1 0.9 1.2 129.2 128.6 39.53 23.55 62 0.638 5032K 16K 0.0 0.0 L5 1100/0 90.61 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1311/21 105.42 GB 0.0 31.7 15.3 16.4 41.0 24.6 12.6 4.3 167.5 216.6 193.80 159.24 258 0.751 31M 118K 0.0 0.0 Int 0/0 0.00 KB 0.0 31.7 15.3 16.4 41.0 24.6 12.5 4.3 167.5 216.6 193.80 159.24 258 0.751 31M 118K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 31.7 15.3 16.4 31.5 15.1 0.0 0.0 197.8 196.6 164.15 134.51 123 1.335 31M 118K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 327.2 29.65 24.73 135 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.1 total, 53.9 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 41.00 GB write, 776.16 MB/s write, 31.71 GB read, 600.33 MB/s read, 193.8 seconds Interval compaction: 41.00 GB write, 778.35 MB/s write, 31.71 GB read, 602.03 MB/s read, 193.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 48, pending-compaction-bytes-stops: 0, total-delays: 63, total-stops: 63, interval: 126 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4620574 Average: 2.5713 StdDev: 21.58 Min: 0 Median: 1.5469 Max: 7912 Percentiles: P50: 1.55 P75: 1.94 P99: 6.57 P99.9: 13.92 P99.99: 208.81 ------------------------------------------------------ [ 0, 1 ] 698218 15.111% 15.111% ### ( 1, 2 ] 2947422 63.789% 78.900% ############# ( 2, 3 ] 537851 11.640% 90.541% ## ( 3, 4 ] 212802 4.606% 95.146% # ( 4, 6 ] 171806 3.718% 98.864% # ( 6, 10 ] 43788 0.948% 99.812% ( 10, 15 ] 5184 0.112% 99.924% ( 15, 22 ] 528 0.011% 99.936% ( 22, 34 ] 56 0.001% 99.937% ( 34, 51 ] 70 0.002% 99.938% ( 51, 76 ] 77 0.002% 99.940% ( 76, 110 ] 1044 0.023% 99.963% ( 110, 170 ] 1068 0.023% 99.986% ( 170, 250 ] 408 0.009% 99.995% ( 250, 380 ] 335 0.007% 100.002% ( 380, 580 ] 339 0.007% 100.009% ( 580, 870 ] 299 0.006% 100.016% ( 870, 1300 ] 185 0.004% 100.020% ( 1300, 1900 ] 68 0.001% 100.021% ( 1900, 2900 ] 59 0.001% 100.022% ( 2900, 4400 ] 52 0.001% 100.023% ( 4400, 6600 ] 7 0.000% 100.024% ( 6600, 9900 ] 5 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1875915 Average: 4.9550 StdDev: 77.10 Min: 0 Median: 1.7196 Max: 11216 Percentiles: P50: 1.72 P75: 2.54 P99: 9.15 P99.9: 234.66 P99.99: 739.08 ------------------------------------------------------ [ 0, 1 ] 173026 9.224% 9.224% ## ( 1, 2 ] 1063010 56.666% 65.890% ########### ( 2, 3 ] 317328 16.916% 82.806% ### ( 3, 4 ] 138089 7.361% 90.167% # ( 4, 6 ] 135756 7.237% 97.404% # ( 6, 10 ] 38002 2.026% 99.429% ( 10, 15 ] 6004 0.320% 99.749% ( 15, 22 ] 664 0.035% 99.785% ( 22, 34 ] 44 0.002% 99.787% ( 34, 51 ] 32 0.002% 99.789% ( 51, 76 ] 148 0.008% 99.797% ( 76, 110 ] 726 0.039% 99.835% ( 110, 170 ] 886 0.047% 99.883% ( 170, 250 ] 401 0.021% 99.904% ( 250, 380 ] 544 0.029% 99.933% ( 380, 580 ] 707 0.038% 99.971% ( 580, 870 ] 657 0.035% 100.006% ( 870, 1300 ] 513 0.027% 100.033% ( 1300, 1900 ] 258 0.014% 100.047% ( 1900, 2900 ] 207 0.011% 100.058% ( 2900, 4400 ] 276 0.015% 100.073% ( 4400, 6600 ] 86 0.005% 100.077% ( 6600, 9900 ] 31 0.002% 100.079% ( 9900, 14000 ] 5 0.000% 100.079% ** Level 2 read latency histogram (micros): Count: 49043 Average: 2.2390 StdDev: 5.66 Min: 1 Median: 1.5384 Max: 1154 Percentiles: P50: 1.54 P75: 1.90 P99: 5.83 P99.9: 9.90 P99.99: 22.38 ------------------------------------------------------ [ 0, 1 ] 6394 13.038% 13.038% ### ( 1, 2 ] 33671 68.656% 81.694% ############## ( 2, 3 ] 5155 10.511% 92.205% ## ( 3, 4 ] 1883 3.839% 96.044% # ( 4, 6 ] 1582 3.226% 99.270% # ( 6, 10 ] 317 0.646% 99.916% ( 10, 15 ] 34 0.069% 99.986% ( 15, 22 ] 2 0.004% 99.990% ( 22, 34 ] 3 0.006% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 1701974 Average: 5.8719 StdDev: 83.27 Min: 1 Median: 1.9513 Max: 15345 Percentiles: P50: 1.95 P75: 2.99 P99: 9.17 P99.9: 156.28 P99.99: 479.83 ------------------------------------------------------ [ 0, 1 ] 36374 2.137% 2.137% ( 1, 2 ] 856301 50.312% 52.449% ########## ( 2, 3 ] 389459 22.883% 75.332% ##### ( 3, 4 ] 181560 10.668% 86.000% ## ( 4, 6 ] 193132 11.348% 97.347% ## ( 6, 10 ] 35505 2.086% 99.433% ( 10, 15 ] 6373 0.374% 99.808% ( 15, 22 ] 686 0.040% 99.848% ( 22, 34 ] 89 0.005% 99.853% ( 34, 51 ] 39 0.002% 99.856% ( 51, 76 ] 55 0.003% 99.859% ( 76, 110 ] 250 0.015% 99.874% ( 110, 170 ] 586 0.034% 99.908% ( 170, 250 ] 430 0.025% 99.933% ( 250, 380 ] 564 0.033% 99.966% ( 380, 580 ] 809 0.048% 100.014% ( 580, 870 ] 822 0.048% 100.062% ( 870, 1300 ] 619 0.036% 100.099% ( 1300, 1900 ] 339 0.020% 100.119% ( 1900, 2900 ] 289 0.017% 100.136% ( 2900, 4400 ] 325 0.019% 100.155% ( 4400, 6600 ] 81 0.005% 100.159% ( 6600, 9900 ] 20 0.001% 100.161% ( 9900, 14000 ] 2 0.000% 100.161% ( 14000, 22000 ] 1 0.000% 100.161% ** Level 4 read latency histogram (micros): Count: 231485 Average: 28.8331 StdDev: 239.49 Min: 1 Median: 1.9778 Max: 22720 Percentiles: P50: 1.98 P75: 3.20 P99: 824.17 P99.9: 3313.33 P99.99: 4224.42 ------------------------------------------------------ [ 0, 1 ] 4408 1.904% 1.904% ( 1, 2 ] 113860 49.187% 51.091% ########## ( 2, 3 ] 50281 21.721% 72.812% #### ( 3, 4 ] 25515 11.022% 83.834% ## ( 4, 6 ] 24943 10.775% 94.610% ## ( 6, 10 ] 5700 2.462% 97.072% ( 10, 15 ] 1202 0.519% 97.591% ( 15, 22 ] 112 0.048% 97.640% ( 22, 34 ] 10 0.004% 97.644% ( 34, 51 ] 5 0.002% 97.646% ( 51, 76 ] 9 0.004% 97.650% ( 76, 110 ] 72 0.031% 97.681% ( 110, 170 ] 220 0.095% 97.776% ( 170, 250 ] 321 0.139% 97.915% ( 250, 380 ] 566 0.245% 98.159% ( 380, 580 ] 940 0.406% 98.565% ( 580, 870 ] 1195 0.516% 99.082% ( 870, 1300 ] 931 0.402% 99.484% ( 1300, 1900 ] 482 0.208% 99.692% ( 1900, 2900 ] 387 0.167% 99.859% ( 2900, 4400 ] 343 0.148% 100.007% ( 4400, 6600 ] 73 0.032% 100.039% ( 6600, 9900 ] 13 0.006% 100.044% ( 9900, 14000 ] 4 0.002% 100.046% ( 22000, 33000 ] 1 0.000% 100.047% ** Level 5 read latency histogram (micros): Count: 300 Average: 1270.6467 StdDev: 1259.90 Min: 84 Median: 750.5882 Max: 6667 Percentiles: P50: 750.59 P75: 2143.90 P99: 5500.00 P99.9: 6667.00 P99.99: 6667.00 ------------------------------------------------------ ( 76, 110 ] 13 4.333% 4.333% # ( 110, 170 ] 31 10.333% 14.667% ## ( 170, 250 ] 24 8.000% 22.667% ## ( 250, 380 ] 29 9.667% 32.333% ## ( 380, 580 ] 33 11.000% 43.333% ## ( 580, 870 ] 34 11.333% 54.667% ## ( 870, 1300 ] 27 9.000% 63.667% ## ( 1300, 1900 ] 24 8.000% 71.667% ## ( 1900, 2900 ] 41 13.667% 85.333% ### ( 2900, 4400 ] 39 13.000% 98.333% ### ( 4400, 6600 ] 4 1.333% 99.667% ( 6600, 9900 ] 1 0.333% 100.000% ** DB Stats ** Uptime(secs): 54.1 total, 4.5 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 181.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.669 H:M:S, 49.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 220.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.755 H:M:S, 39.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/13-04:06:56 ... thread 0: (1000000,11000000) ops and (300020.6,192084.2) ops/second in (3.333105,57.266545) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/13 4.05 GB 119.6 11.4 0.0 11.4 21.8 10.4 0.0 2.1 149.5 285.1 78.33 71.00 181 0.433 11M 25K 0.0 0.0 L1 4/4 390.41 MB 0.0 8.2 6.1 2.1 8.1 6.0 0.2 1.3 230.4 227.3 36.43 34.73 4 9.109 7915K 46K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 5.8 1.5 241.9 241.8 0.80 0.75 2 0.399 196K 70 0.0 0.0 L3 20/0 937.50 MB 0.9 7.9 5.2 2.7 7.9 5.2 0.7 1.5 173.8 173.1 46.62 35.84 26 1.793 7708K 29K 0.0 0.0 L4 169/0 9.71 GB 1.0 5.9 4.9 0.9 5.8 4.9 0.9 1.2 133.9 133.3 44.79 27.56 71 0.631 5915K 17K 0.0 0.0 L5 1108/0 91.29 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1318/17 106.34 GB 0.0 33.6 16.4 17.2 43.8 26.6 13.3 4.2 166.2 216.7 206.98 169.88 284 0.729 33M 119K 0.0 0.0 Int 0/0 0.00 KB 0.0 33.6 16.4 17.2 43.8 26.6 13.2 4.2 166.2 216.7 206.98 169.88 284 0.729 33M 119K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 33.6 16.4 17.2 33.4 16.2 0.0 0.0 197.3 196.2 174.32 142.71 136 1.282 33M 119K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.4 10.4 0.0 0.0 0.0 326.0 32.66 27.17 148 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.4 total, 57.3 interval Flush(GB): cumulative 10.397, interval 10.397 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 43.80 GB write, 781.13 MB/s write, 33.59 GB read, 599.11 MB/s read, 207.0 seconds Interval compaction: 43.80 GB write, 783.21 MB/s write, 33.59 GB read, 600.70 MB/s read, 207.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 48, pending-compaction-bytes-stops: 0, total-delays: 63, total-stops: 73, interval: 136 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5036622 Average: 2.5876 StdDev: 21.74 Min: 0 Median: 1.5568 Max: 7912 Percentiles: P50: 1.56 P75: 1.95 P99: 6.67 P99.9: 13.80 P99.99: 189.16 ------------------------------------------------------ [ 0, 1 ] 733654 14.566% 14.566% ### ( 1, 2 ] 3205252 63.639% 78.205% ############# ( 2, 3 ] 608512 12.082% 90.287% ## ( 3, 4 ] 236334 4.692% 94.979% # ( 4, 6 ] 194336 3.858% 98.838% # ( 6, 10 ] 48933 0.972% 99.809% ( 10, 15 ] 6014 0.119% 99.929% ( 15, 22 ] 593 0.012% 99.941% ( 22, 34 ] 64 0.001% 99.942% ( 34, 51 ] 71 0.001% 99.943% ( 51, 76 ] 78 0.002% 99.945% ( 76, 110 ] 1066 0.021% 99.966% ( 110, 170 ] 1108 0.022% 99.988% ( 170, 250 ] 444 0.009% 99.997% ( 250, 380 ] 368 0.007% 100.004% ( 380, 580 ] 366 0.007% 100.011% ( 580, 870 ] 324 0.006% 100.018% ( 870, 1300 ] 194 0.004% 100.022% ( 1300, 1900 ] 75 0.001% 100.023% ( 1900, 2900 ] 65 0.001% 100.024% ( 2900, 4400 ] 59 0.001% 100.026% ( 4400, 6600 ] 8 0.000% 100.026% ( 6600, 9900 ] 5 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1908618 Average: 4.9590 StdDev: 76.95 Min: 0 Median: 1.7229 Max: 11216 Percentiles: P50: 1.72 P75: 2.55 P99: 9.16 P99.9: 243.00 P99.99: 749.84 ------------------------------------------------------ [ 0, 1 ] 173304 9.080% 9.080% ## ( 1, 2 ] 1080439 56.608% 65.689% ########### ( 2, 3 ] 324639 17.009% 82.698% ### ( 3, 4 ] 141519 7.415% 90.112% # ( 4, 6 ] 139029 7.284% 97.397% # ( 6, 10 ] 38751 2.030% 99.427% ( 10, 15 ] 6141 0.322% 99.749% ( 15, 22 ] 669 0.035% 99.784% ( 22, 34 ] 44 0.002% 99.786% ( 34, 51 ] 32 0.002% 99.788% ( 51, 76 ] 148 0.008% 99.796% ( 76, 110 ] 726 0.038% 99.834% ( 110, 170 ] 897 0.047% 99.881% ( 170, 250 ] 407 0.021% 99.902% ( 250, 380 ] 562 0.029% 99.931% ( 380, 580 ] 726 0.038% 99.969% ( 580, 870 ] 673 0.035% 100.005% ( 870, 1300 ] 522 0.027% 100.032% ( 1300, 1900 ] 262 0.014% 100.046% ( 1900, 2900 ] 210 0.011% 100.057% ( 2900, 4400 ] 279 0.015% 100.071% ( 4400, 6600 ] 88 0.005% 100.076% ( 6600, 9900 ] 31 0.002% 100.078% ( 9900, 14000 ] 5 0.000% 100.078% ** Level 2 read latency histogram (micros): Count: 49043 Average: 2.2390 StdDev: 5.66 Min: 1 Median: 1.5384 Max: 1154 Percentiles: P50: 1.54 P75: 1.90 P99: 5.83 P99.9: 9.90 P99.99: 22.38 ------------------------------------------------------ [ 0, 1 ] 6394 13.038% 13.038% ### ( 1, 2 ] 33671 68.656% 81.694% ############## ( 2, 3 ] 5155 10.511% 92.205% ## ( 3, 4 ] 1883 3.839% 96.044% # ( 4, 6 ] 1582 3.226% 99.270% # ( 6, 10 ] 317 0.646% 99.916% ( 10, 15 ] 34 0.069% 99.986% ( 15, 22 ] 2 0.004% 99.990% ( 22, 34 ] 3 0.006% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 1909929 Average: 5.6730 StdDev: 80.77 Min: 1 Median: 1.9513 Max: 15345 Percentiles: P50: 1.95 P75: 2.98 P99: 9.08 P99.9: 118.88 P99.99: 428.42 ------------------------------------------------------ [ 0, 1 ] 38083 1.994% 1.994% ( 1, 2 ] 963851 50.465% 52.459% ########## ( 2, 3 ] 438321 22.950% 75.409% ##### ( 3, 4 ] 204035 10.683% 86.092% ## ( 4, 6 ] 216612 11.341% 97.433% ## ( 6, 10 ] 38833 2.033% 99.466% ( 10, 15 ] 7008 0.367% 99.833% ( 15, 22 ] 746 0.039% 99.872% ( 22, 34 ] 96 0.005% 99.877% ( 34, 51 ] 40 0.002% 99.879% ( 51, 76 ] 56 0.003% 99.882% ( 76, 110 ] 250 0.013% 99.895% ( 110, 170 ] 595 0.031% 99.927% ( 170, 250 ] 435 0.023% 99.949% ( 250, 380 ] 578 0.030% 99.980% ( 380, 580 ] 822 0.043% 100.023% ( 580, 870 ] 853 0.045% 100.067% ( 870, 1300 ] 639 0.033% 100.101% ( 1300, 1900 ] 352 0.018% 100.119% ( 1900, 2900 ] 309 0.016% 100.135% ( 2900, 4400 ] 349 0.018% 100.154% ( 4400, 6600 ] 83 0.004% 100.158% ( 6600, 9900 ] 21 0.001% 100.159% ( 9900, 14000 ] 2 0.000% 100.159% ( 14000, 22000 ] 1 0.000% 100.159% ** Level 4 read latency histogram (micros): Count: 240314 Average: 28.9342 StdDev: 238.88 Min: 1 Median: 1.9764 Max: 22720 Percentiles: P50: 1.98 P75: 3.19 P99: 826.54 P99.9: 3321.21 P99.99: 4235.08 ------------------------------------------------------ [ 0, 1 ] 4640 1.931% 1.931% ( 1, 2 ] 118307 49.230% 51.161% ########## ( 2, 3 ] 52362 21.789% 72.950% #### ( 3, 4 ] 26407 10.989% 83.939% ## ( 4, 6 ] 25568 10.639% 94.578% ## ( 6, 10 ] 5851 2.435% 97.013% ( 10, 15 ] 1244 0.518% 97.530% ( 15, 22 ] 116 0.048% 97.579% ( 22, 34 ] 10 0.004% 97.583% ( 34, 51 ] 6 0.002% 97.585% ( 51, 76 ] 9 0.004% 97.589% ( 76, 110 ] 107 0.045% 97.634% ( 110, 170 ] 268 0.112% 97.745% ( 170, 250 ] 367 0.153% 97.898% ( 250, 380 ] 598 0.249% 98.147% ( 380, 580 ] 995 0.414% 98.561% ( 580, 870 ] 1242 0.517% 99.077% ( 870, 1300 ] 969 0.403% 99.481% ( 1300, 1900 ] 507 0.211% 99.692% ( 1900, 2900 ] 401 0.167% 99.859% ( 2900, 4400 ] 355 0.148% 100.006% ( 4400, 6600 ] 74 0.031% 100.037% ( 6600, 9900 ] 14 0.006% 100.043% ( 9900, 14000 ] 4 0.002% 100.045% ( 22000, 33000 ] 1 0.000% 100.045% ** Level 5 read latency histogram (micros): Count: 340 Average: 1262.2353 StdDev: 1292.20 Min: 84 Median: 725.0000 Max: 7868 Percentiles: P50: 725.00 P75: 2091.49 P99: 5984.00 P99.9: 7868.00 P99.99: 7868.00 ------------------------------------------------------ ( 76, 110 ] 16 4.706% 4.706% # ( 110, 170 ] 34 10.000% 14.706% ## ( 170, 250 ] 26 7.647% 22.353% ## ( 250, 380 ] 33 9.706% 32.059% ## ( 380, 580 ] 42 12.353% 44.412% ## ( 580, 870 ] 38 11.176% 55.588% ## ( 870, 1300 ] 31 9.118% 64.706% ## ( 1300, 1900 ] 26 7.647% 72.353% ## ( 1900, 2900 ] 47 13.824% 86.176% ### ( 2900, 4400 ] 40 11.765% 97.941% ## ( 4400, 6600 ] 5 1.471% 99.412% ( 6600, 9900 ] 2 0.588% 100.000% ** DB Stats ** Uptime(secs): 57.4 total, 3.3 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 188.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.276 H:M:S, 47.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 295.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.608 H:M:S, 18.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.086 micros/op 196615 ops/sec 60.066 seconds 11809999 operations; 190.5 MB/s Microseconds per write: Count: 11809999 Average: 5.0860 StdDev: 416.05 Min: 0 Median: 1.7375 Max: 792304 Percentiles: P50: 1.74 P75: 2.70 P99: 8.68 P99.9: 1024.93 P99.99: 2647.78 ------------------------------------------------------ [ 0, 1 ] 1600629 13.553% 13.553% ### ( 1, 2 ] 5836135 49.417% 62.970% ########## ( 2, 3 ] 2032585 17.211% 80.181% ### ( 3, 4 ] 1569085 13.286% 93.467% ### ( 4, 6 ] 572897 4.851% 98.318% # ( 6, 10 ] 120115 1.017% 99.335% ( 10, 15 ] 38260 0.324% 99.659% ( 15, 22 ] 9336 0.079% 99.738% ( 22, 34 ] 2403 0.020% 99.758% ( 34, 51 ] 261 0.002% 99.760% ( 51, 76 ] 42 0.000% 99.761% ( 76, 110 ] 8392 0.071% 99.832% ( 110, 170 ] 3130 0.027% 99.858% ( 170, 250 ] 301 0.003% 99.861% ( 250, 380 ] 141 0.001% 99.862% ( 380, 580 ] 29 0.000% 99.862% ( 580, 870 ] 22 0.000% 99.863% ( 870, 1300 ] 12284 0.104% 99.967% ( 1300, 1900 ] 159 0.001% 99.968% ( 1900, 2900 ] 3493 0.030% 99.997% ( 2900, 4400 ] 217 0.002% 99.999% ( 4400, 6600 ] 36 0.000% 100.000% ( 6600, 9900 ] 13 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 3 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 20 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 209021 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11809999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 12187918968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 692 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 27963763 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 39430213035 rocksdb.compact.write.bytes COUNT : 39219678445 rocksdb.flush.write.bytes COUNT : 12154434275 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 77 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 380 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 12056561664 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4798464 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 39548104689 rocksdb.non.last.level.read.count COUNT : 9554334 rocksdb.block.checksum.compute.count COUNT : 9553027 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.389644 P95 : 3.841177 P99 : 6.956705 P100 : 792301.000000 COUNT : 11809999 SUM : 54681644 rocksdb.compaction.times.micros P50 : 932250.000000 P95 : 3754000.000000 P99 : 12362000.000000 P100 : 17075643.000000 COUNT : 139 SUM : 177627482 rocksdb.compaction.times.cpu_micros P50 : 637666.666667 P95 : 3390000.000000 P99 : 12362000.000000 P100 : 16172663.000000 COUNT : 139 SUM : 145962183 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 707.424242 P95 : 1274.916667 P99 : 39630.000000 P100 : 84672.000000 COUNT : 161 SUM : 258222 rocksdb.compaction.outfile.sync.micros P50 : 1135.921053 P95 : 91625.000000 P99 : 175280.000000 P100 : 200088.000000 COUNT : 467 SUM : 6836701 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 117.826087 P95 : 1923.076923 P99 : 3230.000000 P100 : 5469.000000 COUNT : 334 SUM : 120605 rocksdb.table.open.io.micros P50 : 1414.893617 P95 : 7839.512195 P99 : 11118.285714 P100 : 16223.000000 COUNT : 692 SUM : 1439199 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.722781 P95 : 8.192190 P99 : 11.537343 P100 : 22724.000000 COUNT : 9551241 SUM : 61408261 rocksdb.read.block.get.micros P50 : 450.238095 P95 : 3270.312500 P99 : 5326.588235 P100 : 8034.000000 COUNT : 1384 SUM : 1170802 rocksdb.write.raw.block.micros P50 : 0.512522 P95 : 0.973792 P99 : 2.774048 P100 : 13465.000000 COUNT : 12443943 SUM : 24782508 rocksdb.numfiles.in.singlecompaction P50 : 2.588235 P95 : 4.933333 P99 : 15.560000 P100 : 21.000000 COUNT : 184 SUM : 605 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558048 P95 : 1161.511105 P99 : 2524.006346 P100 : 792109.000000 COUNT : 156557 SUM : 27979698 rocksdb.sst.read.micros P50 : 1.665741 P95 : 4.997219 P99 : 8.513700 P100 : 22720.000000 COUNT : 9554879 SUM : 41868931 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11809999 SUM : 12187918968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212330.097087 P95 : 379729.166667 P99 : 683100.000000 P100 : 937724.000000 COUNT : 161 SUM : 35288137 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 453 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0