[2024-11-18 11:40:12.430755] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 24.03.0 initialization... [2024-11-18 11:40:12.431030] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1690787 ] Set seed to 1731926412424065 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 11:40:12.556125] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 11:40:12.664183] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 11:40:12.664231] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1690787' to capture a snapshot of events at runtime. [2024-11-18 11:40:12.664241] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-18 11:40:12.664267] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-18 11:40:12.664276] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1690787 for offline analysis/debug. [2024-11-18 11:40:12.665665] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 11:40:21 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-11:40:24 ... thread 0: (1000000,1000000) ops and (339732.8,339732.8) ops/second in (2.943490,2.943490) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 629.96 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 355.9 2.48 2.22 12 0.207 0 0 0.0 0.0 L2 3/2 251.74 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 L3 12/0 993.32 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/8 97.00 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.4 95.4 318.0 3.96 3.65 14 0.283 383K 205 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.4 95.4 318.0 3.96 3.65 14 0.283 383K 205 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 355.9 2.48 2.22 12 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 393.93 MB/s write, 0.37 GB read, 118.19 MB/s read, 4.0 seconds Interval compaction: 1.23 GB write, 427.67 MB/s write, 0.37 GB read, 128.31 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 113058 Average: 1.9801 StdDev: 18.60 Min: 1 Median: 1.3061 Max: 3290 Percentiles: P50: 1.31 P75: 1.71 P99: 4.01 P99.9: 9.10 P99.99: 366.75 ------------------------------------------------------ [ 0, 1 ] 35157 31.096% 31.096% ###### ( 1, 2 ] 69831 61.766% 92.862% ############ ( 2, 3 ] 5377 4.756% 97.618% # ( 3, 4 ] 1559 1.379% 98.997% ( 4, 6 ] 849 0.751% 99.748% ( 6, 10 ] 222 0.196% 99.944% ( 10, 15 ] 26 0.023% 99.967% ( 15, 22 ] 12 0.011% 99.978% ( 51, 76 ] 2 0.002% 99.980% ( 110, 170 ] 5 0.004% 99.984% ( 170, 250 ] 4 0.004% 99.988% ( 250, 380 ] 3 0.003% 99.990% ( 380, 580 ] 1 0.001% 99.991% ( 580, 870 ] 4 0.004% 99.995% ( 1300, 1900 ] 3 0.003% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 61663 Average: 2.2135 StdDev: 37.21 Min: 1 Median: 1.3527 Max: 6807 Percentiles: P50: 1.35 P75: 1.75 P99: 5.24 P99.9: 9.93 P99.99: 660.59 ------------------------------------------------------ [ 0, 1 ] 17130 27.780% 27.780% ###### ( 1, 2 ] 38846 62.997% 90.777% ############# ( 2, 3 ] 3428 5.559% 96.337% # ( 3, 4 ] 1173 1.902% 98.239% ( 4, 6 ] 759 1.231% 99.470% ( 6, 10 ] 270 0.438% 99.908% ( 10, 15 ] 39 0.063% 99.971% ( 15, 22 ] 4 0.006% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 34, 51 ] 1 0.002% 99.981% ( 51, 76 ] 1 0.002% 99.982% ( 250, 380 ] 2 0.003% 99.985% ( 380, 580 ] 2 0.003% 99.989% ( 580, 870 ] 3 0.005% 99.994% ( 870, 1300 ] 1 0.002% 99.995% ( 2900, 4400 ] 1 0.002% 99.997% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 3203.4000 StdDev: 2498.81 Min: 168 Median: 2962.5000 Max: 8758 Percentiles: P50: 2962.50 P75: 5018.75 P99: 8758.00 P99.9: 8758.00 P99.99: 8758.00 ------------------------------------------------------ ( 110, 170 ] 1 1.818% 1.818% ( 170, 250 ] 1 1.818% 3.636% ( 250, 380 ] 2 3.636% 7.273% # ( 380, 580 ] 3 5.455% 12.727% # ( 580, 870 ] 7 12.727% 25.455% ### ( 870, 1300 ] 7 12.727% 38.182% ### ( 1900, 2900 ] 6 10.909% 49.091% ## ( 2900, 4400 ] 12 21.818% 70.909% #### ( 4400, 6600 ] 8 14.545% 85.455% ### ( 6600, 9900 ] 8 14.545% 100.000% ### ** Level 4 read latency histogram (micros): Count: 20 Average: 4138.9500 StdDev: 1830.25 Min: 1607 Median: 3900.0000 Max: 7906 Percentiles: P50: 3900.00 P75: 5500.00 P99: 7906.00 P99.9: 7906.00 P99.99: 7906.00 ------------------------------------------------------ ( 1300, 1900 ] 3 15.000% 15.000% ### ( 1900, 2900 ] 3 15.000% 30.000% ### ( 2900, 4400 ] 6 30.000% 60.000% ###### ( 4400, 6600 ] 6 30.000% 90.000% ###### ( 6600, 9900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.2 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 307.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.393 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.393 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-11:40:27 ... thread 0: (1000000,2000000) ops and (322469.7,330876.2) ops/second in (3.101067,6.044557) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.23 GB 69.2 0.6 0.0 0.6 2.4 1.8 0.0 1.3 74.6 323.0 7.60 6.96 28 0.272 575K 617 0.0 0.0 L1 1/0 3.76 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 236.9 236.5 1.60 1.54 1 1.595 383K 628 0.0 0.0 L2 2/1 54.53 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 L3 18/8 1.00 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 228.5 228.5 1.09 1.02 1 1.090 253K 0 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 146.6 146.6 1.53 1.13 1 1.528 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/17 97.98 GB 0.0 1.8 1.0 0.7 3.6 2.9 2.1 1.9 135.0 277.0 13.30 12.09 33 0.403 1823K 1450 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 1.0 0.7 3.6 2.9 2.0 1.9 135.0 277.0 13.30 12.09 33 0.403 1823K 1450 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 1.0 0.7 1.8 1.0 0.0 0.0 226.7 226.6 7.92 7.31 7 1.132 1823K 1450 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.3 5.38 4.78 26 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.60 GB write, 584.95 MB/s write, 1.75 GB read, 285.15 MB/s read, 13.3 seconds Interval compaction: 3.60 GB write, 609.35 MB/s write, 1.75 GB read, 297.05 MB/s read, 13.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 409831 Average: 2.3278 StdDev: 11.69 Min: 1 Median: 1.5622 Max: 3290 Percentiles: P50: 1.56 P75: 1.95 P99: 5.85 P99.9: 11.40 P99.99: 17.34 ------------------------------------------------------ [ 0, 1 ] 58130 14.184% 14.184% ### ( 1, 2 ] 261071 63.702% 77.886% ############# ( 2, 3 ] 57285 13.978% 91.864% ### ( 3, 4 ] 16321 3.982% 95.846% # ( 4, 6 ] 13988 3.413% 99.259% # ( 6, 10 ] 2490 0.608% 99.867% ( 10, 15 ] 486 0.119% 99.985% ( 15, 22 ] 57 0.014% 99.999% ( 22, 34 ] 3 0.001% 100.000% ( 34, 51 ] 1 0.000% 100.000% ( 51, 76 ] 8 0.002% 100.002% ( 110, 170 ] 10 0.002% 100.005% ( 170, 250 ] 11 0.003% 100.007% ( 250, 380 ] 7 0.002% 100.009% ( 380, 580 ] 6 0.001% 100.010% ( 580, 870 ] 10 0.002% 100.013% ( 870, 1300 ] 4 0.001% 100.014% ( 1300, 1900 ] 3 0.001% 100.015% ( 1900, 2900 ] 3 0.001% 100.015% ( 2900, 4400 ] 2 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 25 Average: 176.2400 StdDev: 307.55 Min: 1 Median: 2.1667 Max: 1086 Percentiles: P50: 2.17 P75: 240.00 P99: 1086.00 P99.9: 1086.00 P99.99: 1086.00 ------------------------------------------------------ [ 0, 1 ] 6 24.000% 24.000% ##### ( 1, 2 ] 6 24.000% 48.000% ##### ( 2, 3 ] 3 12.000% 60.000% ## ( 6, 10 ] 1 4.000% 64.000% # ( 110, 170 ] 1 4.000% 68.000% # ( 170, 250 ] 2 8.000% 76.000% ## ( 250, 380 ] 3 12.000% 88.000% ## ( 580, 870 ] 1 4.000% 92.000% # ( 870, 1300 ] 2 8.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 95796 Average: 2.2730 StdDev: 29.86 Min: 1 Median: 1.4618 Max: 6807 Percentiles: P50: 1.46 P75: 1.85 P99: 5.66 P99.9: 10.68 P99.99: 342.33 ------------------------------------------------------ [ 0, 1 ] 19631 20.493% 20.493% #### ( 1, 2 ] 61216 63.902% 84.395% ############# ( 2, 3 ] 9469 9.885% 94.280% ## ( 3, 4 ] 2743 2.863% 97.143% # ( 4, 6 ] 2140 2.234% 99.377% ( 6, 10 ] 490 0.512% 99.888% ( 10, 15 ] 82 0.086% 99.974% ( 15, 22 ] 10 0.010% 99.984% ( 22, 34 ] 1 0.001% 99.985% ( 34, 51 ] 1 0.001% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 76, 110 ] 1 0.001% 99.989% ( 250, 380 ] 2 0.002% 99.991% ( 380, 580 ] 2 0.002% 99.993% ( 580, 870 ] 3 0.003% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 2900, 4400 ] 1 0.001% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 181371 Average: 4.1757 StdDev: 72.49 Min: 0 Median: 1.7654 Max: 8758 Percentiles: P50: 1.77 P75: 2.47 P99: 8.86 P99.9: 187.28 P99.99: 560.76 ------------------------------------------------------ [ 0, 1 ] 7861 4.334% 4.334% # ( 1, 2 ] 108211 59.663% 63.997% ############ ( 2, 3 ] 42231 23.284% 87.281% ##### ( 3, 4 ] 9540 5.260% 92.541% # ( 4, 6 ] 9464 5.218% 97.759% # ( 6, 10 ] 3151 1.737% 99.497% ( 10, 15 ] 424 0.234% 99.730% ( 15, 22 ] 57 0.031% 99.762% ( 22, 34 ] 4 0.002% 99.764% ( 34, 51 ] 1 0.001% 99.765% ( 76, 110 ] 54 0.030% 99.794% ( 110, 170 ] 175 0.096% 99.891% ( 170, 250 ] 77 0.042% 99.933% ( 250, 380 ] 64 0.035% 99.969% ( 380, 580 ] 43 0.024% 99.992% ( 580, 870 ] 32 0.018% 100.010% ( 870, 1300 ] 14 0.008% 100.018% ( 1300, 1900 ] 2 0.001% 100.019% ( 1900, 2900 ] 6 0.003% 100.022% ( 2900, 4400 ] 12 0.007% 100.029% ( 4400, 6600 ] 8 0.004% 100.033% ( 6600, 9900 ] 8 0.004% 100.037% ** Level 4 read latency histogram (micros): Count: 305 Average: 279.9410 StdDev: 1125.31 Min: 0 Median: 2.1810 Max: 7906 Percentiles: P50: 2.18 P75: 5.65 P99: 6215.00 P99.9: 7906.00 P99.99: 7906.00 ------------------------------------------------------ [ 0, 1 ] 43 14.098% 14.098% ### ( 1, 2 ] 99 32.459% 46.557% ###### ( 2, 3 ] 58 19.016% 65.574% #### ( 3, 4 ] 18 5.902% 71.475% # ( 4, 6 ] 13 4.262% 75.738% # ( 6, 10 ] 8 2.623% 78.361% # ( 10, 15 ] 19 6.230% 84.590% # ( 15, 22 ] 19 6.230% 90.820% # ( 22, 34 ] 3 0.984% 91.803% ( 110, 170 ] 2 0.656% 92.459% ( 170, 250 ] 1 0.328% 92.787% ( 250, 380 ] 1 0.328% 93.115% ( 580, 870 ] 1 0.328% 93.443% ( 1300, 1900 ] 3 0.984% 94.426% ( 1900, 2900 ] 3 0.984% 95.410% ( 2900, 4400 ] 6 1.967% 97.377% ( 4400, 6600 ] 6 1.967% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 900.2000 StdDev: 1119.67 Min: 81 Median: 460.0000 Max: 5332 Percentiles: P50: 460.00 P75: 1128.00 P99: 5332.00 P99.9: 5332.00 P99.99: 5332.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 3 7.500% 20.000% ## ( 170, 250 ] 5 12.500% 32.500% ### ( 250, 380 ] 5 12.500% 45.000% ### ( 380, 580 ] 5 12.500% 57.500% ### ( 580, 870 ] 4 10.000% 67.500% ## ( 870, 1300 ] 5 12.500% 80.000% ### ( 1300, 1900 ] 2 5.000% 85.000% # ( 1900, 2900 ] 3 7.500% 92.500% ## ( 2900, 4400 ] 2 5.000% 97.500% # ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 6.3 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 312.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.827 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.434 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-11:40:30 ... thread 0: (1000000,3000000) ops and (354081.3,338265.7) ops/second in (2.824210,8.868767) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.09 GB 44.1 1.4 0.0 1.4 4.1 2.7 0.0 1.5 104.5 313.5 13.26 12.26 44 0.301 1407K 1464 0.0 0.0 L1 1/1 3.76 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 236.9 236.5 1.60 1.54 1 1.595 383K 628 0.0 0.0 L2 1/0 51.98 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 L3 12/0 510.87 MB 0.5 0.9 0.2 0.7 0.9 0.2 0.4 3.7 223.4 223.0 4.16 3.86 2 2.082 944K 1734 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 146.6 146.6 1.53 1.13 1 1.528 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/13 98.84 GB 0.0 3.2 1.0 2.2 5.9 3.7 2.9 2.2 149.6 275.3 22.03 20.23 50 0.441 3346K 4031 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.0 2.2 5.9 3.7 2.8 2.2 149.6 275.3 22.03 20.23 50 0.441 3346K 4031 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.0 2.2 3.2 1.0 0.0 0.0 232.4 232.1 14.18 13.26 11 1.289 3346K 4031 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 353.3 7.85 6.97 39 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.92 GB write, 664.67 MB/s write, 3.22 GB read, 361.28 MB/s read, 22.0 seconds Interval compaction: 5.92 GB write, 683.56 MB/s write, 3.22 GB read, 371.55 MB/s read, 22.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 669286 Average: 2.2759 StdDev: 11.33 Min: 1 Median: 1.5446 Max: 3987 Percentiles: P50: 1.54 P75: 1.93 P99: 5.72 P99.9: 10.91 P99.99: 15.71 ------------------------------------------------------ [ 0, 1 ] 95674 14.295% 14.295% ### ( 1, 2 ] 438770 65.558% 79.853% ############# ( 2, 3 ] 89009 13.299% 93.152% ### ( 3, 4 ] 23258 3.475% 96.627% # ( 4, 6 ] 18442 2.755% 99.382% # ( 6, 10 ] 3333 0.498% 99.880% ( 10, 15 ] 726 0.108% 99.989% ( 15, 22 ] 80 0.012% 100.001% ( 22, 34 ] 6 0.001% 100.002% ( 34, 51 ] 1 0.000% 100.002% ( 51, 76 ] 9 0.001% 100.003% ( 110, 170 ] 15 0.002% 100.006% ( 170, 250 ] 17 0.003% 100.008% ( 250, 380 ] 10 0.001% 100.010% ( 380, 580 ] 12 0.002% 100.011% ( 580, 870 ] 13 0.002% 100.013% ( 870, 1300 ] 11 0.002% 100.015% ( 1300, 1900 ] 4 0.001% 100.016% ( 1900, 2900 ] 3 0.000% 100.016% ( 2900, 4400 ] 3 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 26 Average: 169.6154 StdDev: 303.39 Min: 1 Median: 2.3333 Max: 1086 Percentiles: P50: 2.33 P75: 230.00 P99: 1086.00 P99.9: 1086.00 P99.99: 1086.00 ------------------------------------------------------ [ 0, 1 ] 6 23.077% 23.077% ##### ( 1, 2 ] 6 23.077% 46.154% ##### ( 2, 3 ] 3 11.538% 57.692% ## ( 3, 4 ] 1 3.846% 61.538% # ( 6, 10 ] 1 3.846% 65.385% # ( 110, 170 ] 1 3.846% 69.231% # ( 170, 250 ] 2 7.692% 76.923% ## ( 250, 380 ] 3 11.538% 88.462% ## ( 580, 870 ] 1 3.846% 92.308% # ( 870, 1300 ] 2 7.692% 100.000% ## ** Level 2 read latency histogram (micros): Count: 124205 Average: 2.3959 StdDev: 27.54 Min: 1 Median: 1.4882 Max: 6807 Percentiles: P50: 1.49 P75: 1.87 P99: 5.94 P99.9: 13.38 P99.99: 656.34 ------------------------------------------------------ [ 0, 1 ] 22741 18.309% 18.309% #### ( 1, 2 ] 80634 64.920% 83.229% ############# ( 2, 3 ] 13490 10.861% 94.090% ## ( 3, 4 ] 3459 2.785% 96.875% # ( 4, 6 ] 2727 2.196% 99.071% ( 6, 10 ] 967 0.779% 99.849% ( 10, 15 ] 93 0.075% 99.924% ( 15, 22 ] 10 0.008% 99.932% ( 22, 34 ] 1 0.001% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 11 0.009% 99.944% ( 110, 170 ] 42 0.034% 99.977% ( 170, 250 ] 6 0.005% 99.982% ( 250, 380 ] 6 0.005% 99.987% ( 380, 580 ] 2 0.002% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 200802 Average: 4.0952 StdDev: 69.31 Min: 0 Median: 1.7470 Max: 8758 Percentiles: P50: 1.75 P75: 2.43 P99: 8.84 P99.9: 199.02 P99.99: 587.62 ------------------------------------------------------ [ 0, 1 ] 9600 4.781% 4.781% # ( 1, 2 ] 121559 60.537% 65.318% ############ ( 2, 3 ] 45197 22.508% 87.826% ##### ( 3, 4 ] 10100 5.030% 92.856% # ( 4, 6 ] 9876 4.918% 97.774% # ( 6, 10 ] 3472 1.729% 99.503% ( 10, 15 ] 433 0.216% 99.719% ( 15, 22 ] 57 0.028% 99.747% ( 22, 34 ] 4 0.002% 99.749% ( 34, 51 ] 1 0.000% 99.750% ( 76, 110 ] 77 0.038% 99.788% ( 110, 170 ] 194 0.097% 99.884% ( 170, 250 ] 86 0.043% 99.927% ( 250, 380 ] 74 0.037% 99.964% ( 380, 580 ] 51 0.025% 99.990% ( 580, 870 ] 35 0.017% 100.007% ( 870, 1300 ] 17 0.008% 100.015% ( 1300, 1900 ] 3 0.001% 100.017% ( 1900, 2900 ] 6 0.003% 100.020% ( 2900, 4400 ] 12 0.006% 100.026% ( 4400, 6600 ] 8 0.004% 100.030% ( 6600, 9900 ] 8 0.004% 100.034% ** Level 4 read latency histogram (micros): Count: 305 Average: 279.9410 StdDev: 1125.31 Min: 0 Median: 2.1810 Max: 7906 Percentiles: P50: 2.18 P75: 5.65 P99: 6215.00 P99.9: 7906.00 P99.99: 7906.00 ------------------------------------------------------ [ 0, 1 ] 43 14.098% 14.098% ### ( 1, 2 ] 99 32.459% 46.557% ###### ( 2, 3 ] 58 19.016% 65.574% #### ( 3, 4 ] 18 5.902% 71.475% # ( 4, 6 ] 13 4.262% 75.738% # ( 6, 10 ] 8 2.623% 78.361% # ( 10, 15 ] 19 6.230% 84.590% # ( 15, 22 ] 19 6.230% 90.820% # ( 22, 34 ] 3 0.984% 91.803% ( 110, 170 ] 2 0.656% 92.459% ( 170, 250 ] 1 0.328% 92.787% ( 250, 380 ] 1 0.328% 93.115% ( 580, 870 ] 1 0.328% 93.443% ( 1300, 1900 ] 3 0.984% 94.426% ( 1900, 2900 ] 3 0.984% 95.410% ( 2900, 4400 ] 6 1.967% 97.377% ( 4400, 6600 ] 6 1.967% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 974.8500 StdDev: 1200.73 Min: 81 Median: 505.0000 Max: 5332 Percentiles: P50: 505.00 P75: 1177.14 P99: 5332.00 P99.9: 5332.00 P99.99: 5332.00 ------------------------------------------------------ ( 76, 110 ] 7 11.667% 11.667% ## ( 110, 170 ] 4 6.667% 18.333% # ( 170, 250 ] 6 10.000% 28.333% ## ( 250, 380 ] 8 13.333% 41.667% ### ( 380, 580 ] 8 13.333% 55.000% ### ( 580, 870 ] 7 11.667% 66.667% ## ( 870, 1300 ] 7 11.667% 78.333% ## ( 1300, 1900 ] 4 6.667% 85.000% # ( 1900, 2900 ] 3 5.000% 90.000% # ( 2900, 4400 ] 4 6.667% 96.667% # ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.045 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.217 H:M:S, 7.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-11:40:33 ... thread 0: (1000000,4000000) ops and (274909.3,319838.0) ops/second in (3.637563,12.506330) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.20 GB 182.5 2.4 0.0 2.4 6.2 3.8 0.0 1.6 119.4 309.0 20.58 19.15 63 0.327 2494K 2561 0.0 0.0 L1 1/1 3.76 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 236.9 236.5 1.60 1.54 1 1.595 383K 628 0.0 0.0 L2 1/0 51.98 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 L3 12/0 510.87 MB 0.5 0.9 0.2 0.7 0.9 0.2 0.4 3.7 223.4 223.0 4.16 3.86 2 2.082 944K 1734 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 146.6 146.6 1.53 1.13 1 1.528 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/9 99.95 GB 0.0 4.3 1.0 3.2 8.1 4.8 2.9 2.1 148.8 281.7 29.35 27.12 69 0.425 4434K 5128 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.0 3.2 8.1 4.8 2.8 2.1 148.8 281.7 29.35 27.12 69 0.425 4434K 5128 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.0 3.2 4.3 1.0 0.0 0.0 239.3 239.0 18.25 17.26 15 1.217 4434K 5128 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 351.9 11.10 9.86 54 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.8 total, 12.5 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.07 GB write, 647.89 MB/s write, 4.26 GB read, 342.22 MB/s read, 29.4 seconds Interval compaction: 8.07 GB write, 660.95 MB/s write, 4.26 GB read, 349.12 MB/s read, 29.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 13, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1127586 Average: 2.3011 StdDev: 10.64 Min: 1 Median: 1.5521 Max: 3987 Percentiles: P50: 1.55 P75: 1.93 P99: 5.73 P99.9: 10.85 P99.99: 18.68 ------------------------------------------------------ [ 0, 1 ] 149588 13.266% 13.266% ### ( 1, 2 ] 750170 66.529% 79.795% ############# ( 2, 3 ] 154096 13.666% 93.461% ### ( 3, 4 ] 37082 3.289% 96.750% # ( 4, 6 ] 29273 2.596% 99.346% # ( 6, 10 ] 6054 0.537% 99.883% ( 10, 15 ] 1155 0.102% 99.985% ( 15, 22 ] 109 0.010% 99.995% ( 22, 34 ] 9 0.001% 99.996% ( 34, 51 ] 3 0.000% 99.996% ( 51, 76 ] 15 0.001% 99.997% ( 76, 110 ] 52 0.005% 100.002% ( 110, 170 ] 82 0.007% 100.009% ( 170, 250 ] 45 0.004% 100.013% ( 250, 380 ] 33 0.003% 100.016% ( 380, 580 ] 34 0.003% 100.019% ( 580, 870 ] 26 0.002% 100.021% ( 870, 1300 ] 15 0.001% 100.023% ( 1300, 1900 ] 6 0.001% 100.023% ( 1900, 2900 ] 6 0.001% 100.024% ( 2900, 4400 ] 3 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 26 Average: 169.6154 StdDev: 303.39 Min: 1 Median: 2.3333 Max: 1086 Percentiles: P50: 2.33 P75: 230.00 P99: 1086.00 P99.9: 1086.00 P99.99: 1086.00 ------------------------------------------------------ [ 0, 1 ] 6 23.077% 23.077% ##### ( 1, 2 ] 6 23.077% 46.154% ##### ( 2, 3 ] 3 11.538% 57.692% ## ( 3, 4 ] 1 3.846% 61.538% # ( 6, 10 ] 1 3.846% 65.385% # ( 110, 170 ] 1 3.846% 69.231% # ( 170, 250 ] 2 7.692% 76.923% ## ( 250, 380 ] 3 11.538% 88.462% ## ( 580, 870 ] 1 3.846% 92.308% # ( 870, 1300 ] 2 7.692% 100.000% ## ** Level 2 read latency histogram (micros): Count: 124205 Average: 2.3959 StdDev: 27.54 Min: 1 Median: 1.4882 Max: 6807 Percentiles: P50: 1.49 P75: 1.87 P99: 5.94 P99.9: 13.38 P99.99: 656.34 ------------------------------------------------------ [ 0, 1 ] 22741 18.309% 18.309% #### ( 1, 2 ] 80634 64.920% 83.229% ############# ( 2, 3 ] 13490 10.861% 94.090% ## ( 3, 4 ] 3459 2.785% 96.875% # ( 4, 6 ] 2727 2.196% 99.071% ( 6, 10 ] 967 0.779% 99.849% ( 10, 15 ] 93 0.075% 99.924% ( 15, 22 ] 10 0.008% 99.932% ( 22, 34 ] 1 0.001% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 11 0.009% 99.944% ( 110, 170 ] 42 0.034% 99.977% ( 170, 250 ] 6 0.005% 99.982% ( 250, 380 ] 6 0.005% 99.987% ( 380, 580 ] 2 0.002% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 200802 Average: 4.0952 StdDev: 69.31 Min: 0 Median: 1.7470 Max: 8758 Percentiles: P50: 1.75 P75: 2.43 P99: 8.84 P99.9: 199.02 P99.99: 587.62 ------------------------------------------------------ [ 0, 1 ] 9600 4.781% 4.781% # ( 1, 2 ] 121559 60.537% 65.318% ############ ( 2, 3 ] 45197 22.508% 87.826% ##### ( 3, 4 ] 10100 5.030% 92.856% # ( 4, 6 ] 9876 4.918% 97.774% # ( 6, 10 ] 3472 1.729% 99.503% ( 10, 15 ] 433 0.216% 99.719% ( 15, 22 ] 57 0.028% 99.747% ( 22, 34 ] 4 0.002% 99.749% ( 34, 51 ] 1 0.000% 99.750% ( 76, 110 ] 77 0.038% 99.788% ( 110, 170 ] 194 0.097% 99.884% ( 170, 250 ] 86 0.043% 99.927% ( 250, 380 ] 74 0.037% 99.964% ( 380, 580 ] 51 0.025% 99.990% ( 580, 870 ] 35 0.017% 100.007% ( 870, 1300 ] 17 0.008% 100.015% ( 1300, 1900 ] 3 0.001% 100.017% ( 1900, 2900 ] 6 0.003% 100.020% ( 2900, 4400 ] 12 0.006% 100.026% ( 4400, 6600 ] 8 0.004% 100.030% ( 6600, 9900 ] 8 0.004% 100.034% ** Level 4 read latency histogram (micros): Count: 305 Average: 279.9410 StdDev: 1125.31 Min: 0 Median: 2.1810 Max: 7906 Percentiles: P50: 2.18 P75: 5.65 P99: 6215.00 P99.9: 7906.00 P99.99: 7906.00 ------------------------------------------------------ [ 0, 1 ] 43 14.098% 14.098% ### ( 1, 2 ] 99 32.459% 46.557% ###### ( 2, 3 ] 58 19.016% 65.574% #### ( 3, 4 ] 18 5.902% 71.475% # ( 4, 6 ] 13 4.262% 75.738% # ( 6, 10 ] 8 2.623% 78.361% # ( 10, 15 ] 19 6.230% 84.590% # ( 15, 22 ] 19 6.230% 90.820% # ( 22, 34 ] 3 0.984% 91.803% ( 110, 170 ] 2 0.656% 92.459% ( 170, 250 ] 1 0.328% 92.787% ( 250, 380 ] 1 0.328% 93.115% ( 580, 870 ] 1 0.328% 93.443% ( 1300, 1900 ] 3 0.984% 94.426% ( 1900, 2900 ] 3 0.984% 95.410% ( 2900, 4400 ] 6 1.967% 97.377% ( 4400, 6600 ] 6 1.967% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 974.8500 StdDev: 1200.73 Min: 81 Median: 505.0000 Max: 5332 Percentiles: P50: 505.00 P75: 1177.14 P99: 5332.00 P99.9: 5332.00 P99.99: 5332.00 ------------------------------------------------------ ( 76, 110 ] 7 11.667% 11.667% ## ( 110, 170 ] 4 6.667% 18.333% # ( 170, 250 ] 6 10.000% 28.333% ## ( 250, 380 ] 8 13.333% 41.667% ### ( 380, 580 ] 8 13.333% 55.000% ### ( 580, 870 ] 7 11.667% 66.667% ## ( 870, 1300 ] 7 11.667% 78.333% ## ( 1300, 1900 ] 4 6.667% 85.000% # ( 1900, 2900 ] 3 5.000% 90.000% # ( 2900, 4400 ] 4 6.667% 96.667% # ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 12.8 total, 3.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 308.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.050 H:M:S, 16.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 270.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.005 H:M:S, 27.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/18-11:40:36 ... thread 0: (1000000,5000000) ops and (354276.8,326179.5) ops/second in (2.822652,15.328982) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 2.64 GB 0.0 3.2 0.0 3.2 7.9 4.7 0.0 1.7 125.3 308.4 26.14 24.38 79 0.331 3326K 3401 0.0 0.0 L1 13/13 1.41 GB 0.0 1.8 1.8 0.0 1.8 1.8 0.2 1.0 230.7 229.5 7.93 7.67 2 3.964 1857K 9655 0.0 0.0 L2 1/0 51.98 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 L3 12/0 510.87 MB 0.5 0.9 0.2 0.7 0.9 0.2 0.4 3.7 223.4 223.0 4.16 3.86 2 2.082 944K 1734 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 146.6 146.6 1.53 1.13 1 1.528 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/27 100.80 GB 0.0 6.5 2.4 4.0 11.1 7.1 2.9 2.4 160.9 276.7 41.24 38.48 86 0.480 6739K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 2.4 4.0 11.1 7.1 2.8 2.4 160.9 276.7 41.24 38.48 86 0.480 6739K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 2.4 4.0 6.5 2.4 0.0 0.0 239.4 238.8 27.73 26.48 19 1.459 6739K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.4 13.51 12.00 67 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.14 GB write, 732.17 MB/s write, 6.48 GB read, 425.93 MB/s read, 41.2 seconds Interval compaction: 11.14 GB write, 744.22 MB/s write, 6.48 GB read, 432.93 MB/s read, 41.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 15, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1359614 Average: 2.2823 StdDev: 11.03 Min: 0 Median: 1.5269 Max: 3987 Percentiles: P50: 1.53 P75: 1.90 P99: 5.68 P99.9: 11.19 P99.99: 100.99 ------------------------------------------------------ [ 0, 1 ] 204401 15.034% 15.034% ### ( 1, 2 ] 902238 66.360% 81.394% ############# ( 2, 3 ] 170689 12.554% 93.948% ### ( 3, 4 ] 41878 3.080% 97.028% # ( 4, 6 ] 31934 2.349% 99.377% ( 6, 10 ] 6808 0.501% 99.877% ( 10, 15 ] 1286 0.095% 99.972% ( 15, 22 ] 128 0.009% 99.981% ( 22, 34 ] 11 0.001% 99.982% ( 34, 51 ] 4 0.000% 99.983% ( 51, 76 ] 18 0.001% 99.984% ( 76, 110 ] 113 0.008% 99.992% ( 110, 170 ] 172 0.013% 100.005% ( 170, 250 ] 73 0.005% 100.010% ( 250, 380 ] 54 0.004% 100.014% ( 380, 580 ] 50 0.004% 100.018% ( 580, 870 ] 37 0.003% 100.021% ( 870, 1300 ] 20 0.001% 100.022% ( 1300, 1900 ] 8 0.001% 100.023% ( 1900, 2900 ] 8 0.001% 100.023% ( 2900, 4400 ] 3 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1649 Average: 31.9297 StdDev: 156.34 Min: 0 Median: 1.7004 Max: 3178 Percentiles: P50: 1.70 P75: 2.41 P99: 574.24 P99.9: 2251.00 P99.99: 3178.00 ------------------------------------------------------ [ 0, 1 ] 122 7.398% 7.398% # ( 1, 2 ] 1003 60.825% 68.223% ############ ( 2, 3 ] 272 16.495% 84.718% ### ( 3, 4 ] 25 1.516% 86.234% ( 4, 6 ] 30 1.819% 88.053% ( 6, 10 ] 34 2.062% 90.115% ( 10, 15 ] 2 0.121% 90.237% ( 51, 76 ] 1 0.061% 90.297% ( 76, 110 ] 47 2.850% 93.147% # ( 110, 170 ] 46 2.790% 95.937% # ( 170, 250 ] 21 1.273% 97.210% ( 250, 380 ] 13 0.788% 97.999% ( 380, 580 ] 17 1.031% 99.030% ( 580, 870 ] 2 0.121% 99.151% ( 870, 1300 ] 9 0.546% 99.697% ( 1300, 1900 ] 3 0.182% 99.879% ( 1900, 2900 ] 1 0.061% 99.939% ( 2900, 4400 ] 1 0.061% 100.000% ** Level 2 read latency histogram (micros): Count: 124205 Average: 2.3959 StdDev: 27.54 Min: 1 Median: 1.4882 Max: 6807 Percentiles: P50: 1.49 P75: 1.87 P99: 5.94 P99.9: 13.38 P99.99: 656.34 ------------------------------------------------------ [ 0, 1 ] 22741 18.309% 18.309% #### ( 1, 2 ] 80634 64.920% 83.229% ############# ( 2, 3 ] 13490 10.861% 94.090% ## ( 3, 4 ] 3459 2.785% 96.875% # ( 4, 6 ] 2727 2.196% 99.071% ( 6, 10 ] 967 0.779% 99.849% ( 10, 15 ] 93 0.075% 99.924% ( 15, 22 ] 10 0.008% 99.932% ( 22, 34 ] 1 0.001% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 11 0.009% 99.944% ( 110, 170 ] 42 0.034% 99.977% ( 170, 250 ] 6 0.005% 99.982% ( 250, 380 ] 6 0.005% 99.987% ( 380, 580 ] 2 0.002% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 200802 Average: 4.0952 StdDev: 69.31 Min: 0 Median: 1.7470 Max: 8758 Percentiles: P50: 1.75 P75: 2.43 P99: 8.84 P99.9: 199.02 P99.99: 587.62 ------------------------------------------------------ [ 0, 1 ] 9600 4.781% 4.781% # ( 1, 2 ] 121559 60.537% 65.318% ############ ( 2, 3 ] 45197 22.508% 87.826% ##### ( 3, 4 ] 10100 5.030% 92.856% # ( 4, 6 ] 9876 4.918% 97.774% # ( 6, 10 ] 3472 1.729% 99.503% ( 10, 15 ] 433 0.216% 99.719% ( 15, 22 ] 57 0.028% 99.747% ( 22, 34 ] 4 0.002% 99.749% ( 34, 51 ] 1 0.000% 99.750% ( 76, 110 ] 77 0.038% 99.788% ( 110, 170 ] 194 0.097% 99.884% ( 170, 250 ] 86 0.043% 99.927% ( 250, 380 ] 74 0.037% 99.964% ( 380, 580 ] 51 0.025% 99.990% ( 580, 870 ] 35 0.017% 100.007% ( 870, 1300 ] 17 0.008% 100.015% ( 1300, 1900 ] 3 0.001% 100.017% ( 1900, 2900 ] 6 0.003% 100.020% ( 2900, 4400 ] 12 0.006% 100.026% ( 4400, 6600 ] 8 0.004% 100.030% ( 6600, 9900 ] 8 0.004% 100.034% ** Level 4 read latency histogram (micros): Count: 305 Average: 279.9410 StdDev: 1125.31 Min: 0 Median: 2.1810 Max: 7906 Percentiles: P50: 2.18 P75: 5.65 P99: 6215.00 P99.9: 7906.00 P99.99: 7906.00 ------------------------------------------------------ [ 0, 1 ] 43 14.098% 14.098% ### ( 1, 2 ] 99 32.459% 46.557% ###### ( 2, 3 ] 58 19.016% 65.574% #### ( 3, 4 ] 18 5.902% 71.475% # ( 4, 6 ] 13 4.262% 75.738% # ( 6, 10 ] 8 2.623% 78.361% # ( 10, 15 ] 19 6.230% 84.590% # ( 15, 22 ] 19 6.230% 90.820% # ( 22, 34 ] 3 0.984% 91.803% ( 110, 170 ] 2 0.656% 92.459% ( 170, 250 ] 1 0.328% 92.787% ( 250, 380 ] 1 0.328% 93.115% ( 580, 870 ] 1 0.328% 93.443% ( 1300, 1900 ] 3 0.984% 94.426% ( 1900, 2900 ] 3 0.984% 95.410% ( 2900, 4400 ] 6 1.967% 97.377% ( 4400, 6600 ] 6 1.967% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 974.8500 StdDev: 1200.73 Min: 81 Median: 505.0000 Max: 5332 Percentiles: P50: 505.00 P75: 1177.14 P99: 5332.00 P99.9: 5332.00 P99.99: 5332.00 ------------------------------------------------------ ( 76, 110 ] 7 11.667% 11.667% ## ( 110, 170 ] 4 6.667% 18.333% # ( 170, 250 ] 6 10.000% 28.333% ## ( 250, 380 ] 8 13.333% 41.667% ### ( 380, 580 ] 8 13.333% 55.000% ### ( 580, 870 ] 7 11.667% 66.667% ## ( 870, 1300 ] 7 11.667% 78.333% ## ( 1300, 1900 ] 4 6.667% 85.000% # ( 1900, 2900 ] 3 5.000% 90.000% # ( 2900, 4400 ] 4 6.667% 96.667% # ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 15.6 total, 2.8 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 315.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.286 H:M:S, 14.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.237 H:M:S, 8.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/18-11:40:42 ... thread 0: (1000000,6000000) ops and (156245.0,276126.3) ops/second in (6.400204,21.729186) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/18 3.69 GB 0.0 4.2 0.0 4.2 10.0 5.7 0.0 1.7 130.9 307.2 33.21 31.05 99 0.335 4413K 4514 0.0 0.0 L1 13/13 1.41 GB 0.0 1.8 1.8 0.0 1.8 1.8 0.2 1.0 230.7 229.5 7.93 7.67 2 3.964 1857K 9655 0.0 0.0 L2 1/0 51.98 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 L3 12/0 510.87 MB 0.5 0.9 0.2 0.7 0.9 0.2 0.4 3.7 223.4 223.0 4.16 3.86 2 2.082 944K 1734 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 146.6 146.6 1.53 1.13 1 1.528 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/31 101.84 GB 0.0 7.5 2.4 5.1 13.2 8.1 2.9 2.3 159.6 280.5 48.31 45.14 106 0.456 7827K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.5 2.4 5.1 13.2 8.1 2.8 2.3 159.6 280.5 48.31 45.14 106 0.456 7827K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.5 2.4 5.1 7.5 2.4 0.0 0.0 242.8 242.2 31.75 30.44 23 1.381 7827K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 353.9 16.55 14.70 83 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.0 total, 21.7 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.23 GB write, 616.39 MB/s write, 7.53 GB read, 350.64 MB/s read, 48.3 seconds Interval compaction: 13.23 GB write, 623.55 MB/s write, 7.53 GB read, 354.71 MB/s read, 48.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 16, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1875453 Average: 2.2612 StdDev: 10.83 Min: 0 Median: 1.5186 Max: 3987 Percentiles: P50: 1.52 P75: 1.89 P99: 5.63 P99.9: 10.54 P99.99: 111.59 ------------------------------------------------------ [ 0, 1 ] 284017 15.144% 15.144% ### ( 1, 2 ] 1260465 67.209% 82.352% ############# ( 2, 3 ] 224691 11.981% 94.333% ## ( 3, 4 ] 54807 2.922% 97.255% # ( 4, 6 ] 40078 2.137% 99.392% ( 6, 10 ] 9358 0.499% 99.891% ( 10, 15 ] 1506 0.080% 99.972% ( 15, 22 ] 160 0.009% 99.980% ( 22, 34 ] 12 0.001% 99.981% ( 34, 51 ] 4 0.000% 99.981% ( 51, 76 ] 19 0.001% 99.982% ( 76, 110 ] 144 0.008% 99.990% ( 110, 170 ] 244 0.013% 100.003% ( 170, 250 ] 101 0.005% 100.008% ( 250, 380 ] 70 0.004% 100.012% ( 380, 580 ] 76 0.004% 100.016% ( 580, 870 ] 51 0.003% 100.019% ( 870, 1300 ] 27 0.001% 100.020% ( 1300, 1900 ] 9 0.000% 100.021% ( 1900, 2900 ] 10 0.001% 100.021% ( 2900, 4400 ] 4 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 129392 Average: 2.7039 StdDev: 19.21 Min: 0 Median: 1.4877 Max: 3178 Percentiles: P50: 1.49 P75: 1.85 P99: 8.09 P99.9: 155.34 P99.99: 958.61 ------------------------------------------------------ [ 0, 1 ] 21584 16.681% 16.681% ### ( 1, 2 ] 88392 68.313% 84.994% ############## ( 2, 3 ] 12138 9.381% 94.375% ## ( 3, 4 ] 2788 2.155% 96.530% ( 4, 6 ] 2254 1.742% 98.272% ( 6, 10 ] 1807 1.397% 99.668% ( 10, 15 ] 64 0.049% 99.718% ( 15, 22 ] 9 0.007% 99.725% ( 34, 51 ] 3 0.002% 99.727% ( 51, 76 ] 2 0.002% 99.729% ( 76, 110 ] 107 0.083% 99.811% ( 110, 170 ] 153 0.118% 99.930% ( 170, 250 ] 34 0.026% 99.956% ( 250, 380 ] 16 0.012% 99.968% ( 380, 580 ] 25 0.019% 99.988% ( 580, 870 ] 2 0.002% 99.989% ( 870, 1300 ] 10 0.008% 99.997% ( 1300, 1900 ] 3 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 124205 Average: 2.3959 StdDev: 27.54 Min: 1 Median: 1.4882 Max: 6807 Percentiles: P50: 1.49 P75: 1.87 P99: 5.94 P99.9: 13.38 P99.99: 656.34 ------------------------------------------------------ [ 0, 1 ] 22741 18.309% 18.309% #### ( 1, 2 ] 80634 64.920% 83.229% ############# ( 2, 3 ] 13490 10.861% 94.090% ## ( 3, 4 ] 3459 2.785% 96.875% # ( 4, 6 ] 2727 2.196% 99.071% ( 6, 10 ] 967 0.779% 99.849% ( 10, 15 ] 93 0.075% 99.924% ( 15, 22 ] 10 0.008% 99.932% ( 22, 34 ] 1 0.001% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 11 0.009% 99.944% ( 110, 170 ] 42 0.034% 99.977% ( 170, 250 ] 6 0.005% 99.982% ( 250, 380 ] 6 0.005% 99.987% ( 380, 580 ] 2 0.002% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 200802 Average: 4.0952 StdDev: 69.31 Min: 0 Median: 1.7470 Max: 8758 Percentiles: P50: 1.75 P75: 2.43 P99: 8.84 P99.9: 199.02 P99.99: 587.62 ------------------------------------------------------ [ 0, 1 ] 9600 4.781% 4.781% # ( 1, 2 ] 121559 60.537% 65.318% ############ ( 2, 3 ] 45197 22.508% 87.826% ##### ( 3, 4 ] 10100 5.030% 92.856% # ( 4, 6 ] 9876 4.918% 97.774% # ( 6, 10 ] 3472 1.729% 99.503% ( 10, 15 ] 433 0.216% 99.719% ( 15, 22 ] 57 0.028% 99.747% ( 22, 34 ] 4 0.002% 99.749% ( 34, 51 ] 1 0.000% 99.750% ( 76, 110 ] 77 0.038% 99.788% ( 110, 170 ] 194 0.097% 99.884% ( 170, 250 ] 86 0.043% 99.927% ( 250, 380 ] 74 0.037% 99.964% ( 380, 580 ] 51 0.025% 99.990% ( 580, 870 ] 35 0.017% 100.007% ( 870, 1300 ] 17 0.008% 100.015% ( 1300, 1900 ] 3 0.001% 100.017% ( 1900, 2900 ] 6 0.003% 100.020% ( 2900, 4400 ] 12 0.006% 100.026% ( 4400, 6600 ] 8 0.004% 100.030% ( 6600, 9900 ] 8 0.004% 100.034% ** Level 4 read latency histogram (micros): Count: 305 Average: 279.9410 StdDev: 1125.31 Min: 0 Median: 2.1810 Max: 7906 Percentiles: P50: 2.18 P75: 5.65 P99: 6215.00 P99.9: 7906.00 P99.99: 7906.00 ------------------------------------------------------ [ 0, 1 ] 43 14.098% 14.098% ### ( 1, 2 ] 99 32.459% 46.557% ###### ( 2, 3 ] 58 19.016% 65.574% #### ( 3, 4 ] 18 5.902% 71.475% # ( 4, 6 ] 13 4.262% 75.738% # ( 6, 10 ] 8 2.623% 78.361% # ( 10, 15 ] 19 6.230% 84.590% # ( 15, 22 ] 19 6.230% 90.820% # ( 22, 34 ] 3 0.984% 91.803% ( 110, 170 ] 2 0.656% 92.459% ( 170, 250 ] 1 0.328% 92.787% ( 250, 380 ] 1 0.328% 93.115% ( 580, 870 ] 1 0.328% 93.443% ( 1300, 1900 ] 3 0.984% 94.426% ( 1900, 2900 ] 3 0.984% 95.410% ( 2900, 4400 ] 6 1.967% 97.377% ( 4400, 6600 ] 6 1.967% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 974.8500 StdDev: 1200.73 Min: 81 Median: 505.0000 Max: 5332 Percentiles: P50: 505.00 P75: 1177.14 P99: 5332.00 P99.9: 5332.00 P99.99: 5332.00 ------------------------------------------------------ ( 76, 110 ] 7 11.667% 11.667% ## ( 110, 170 ] 4 6.667% 18.333% # ( 170, 250 ] 6 10.000% 28.333% ## ( 250, 380 ] 8 13.333% 41.667% ### ( 380, 580 ] 8 13.333% 55.000% ### ( 580, 870 ] 7 11.667% 66.667% ## ( 870, 1300 ] 7 11.667% 78.333% ## ( 1300, 1900 ] 4 6.667% 85.000% # ( 1900, 2900 ] 3 5.000% 90.000% # ( 2900, 4400 ] 4 6.667% 96.667% # ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 22.0 total, 6.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 268.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.888 H:M:S, 26.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 153.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.602 H:M:S, 56.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/18-11:40:59 ... thread 0: (1000000,7000000) ops and (60362.3,182787.5) ops/second in (16.566641,38.295827) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 2.02 GB 37.8 6.0 0.0 6.0 12.7 6.7 0.0 1.9 143.2 302.3 43.10 40.39 119 0.362 6267K 9544 0.0 0.0 L1 13/13 1.46 GB 0.0 5.8 4.4 1.4 5.8 4.3 0.2 1.3 218.0 215.0 27.42 25.47 3 9.140 6070K 83K 0.0 0.0 L2 8/6 1.01 GB 2.6 0.4 0.2 0.2 0.4 0.2 2.9 2.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 L3 36/10 2.02 GB 1.5 2.8 1.8 1.0 2.8 1.8 0.4 1.6 210.6 210.0 13.65 12.56 6 2.275 2919K 7824 0.0 0.0 L4 170/6 9.68 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 146.6 146.6 1.53 1.13 1 1.528 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1287/40 102.74 GB 0.0 15.3 6.6 8.6 21.9 13.2 5.4 3.3 179.3 256.9 87.17 80.98 131 0.665 15M 101K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.3 6.6 8.6 21.9 13.2 5.3 3.3 179.3 256.9 87.17 80.98 131 0.665 15M 101K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.3 6.6 8.6 15.2 6.5 0.0 0.0 231.1 229.6 67.62 63.69 32 2.113 15M 101K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 351.2 19.55 17.29 99 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.5 total, 38.3 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.87 GB write, 580.86 MB/s write, 15.26 GB read, 405.37 MB/s read, 87.2 seconds Interval compaction: 21.87 GB write, 584.68 MB/s write, 15.26 GB read, 408.04 MB/s read, 87.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 32, total-stops: 16, interval: 48 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2957034 Average: 2.7107 StdDev: 16.21 Min: 0 Median: 1.5338 Max: 6626 Percentiles: P50: 1.53 P75: 1.91 P99: 6.46 P99.9: 137.33 P99.99: 331.15 ------------------------------------------------------ [ 0, 1 ] 436137 14.749% 14.749% ### ( 1, 2 ] 1952692 66.035% 80.785% ############# ( 2, 3 ] 365410 12.357% 93.142% ## ( 3, 4 ] 93697 3.169% 96.311% # ( 4, 6 ] 77120 2.608% 98.919% # ( 6, 10 ] 20926 0.708% 99.626% ( 10, 15 ] 2375 0.080% 99.707% ( 15, 22 ] 310 0.010% 99.717% ( 22, 34 ] 16 0.001% 99.718% ( 34, 51 ] 7 0.000% 99.718% ( 51, 76 ] 23 0.001% 99.719% ( 76, 110 ] 3899 0.132% 99.850% ( 110, 170 ] 3216 0.109% 99.959% ( 170, 250 ] 630 0.021% 99.981% ( 250, 380 ] 449 0.015% 99.996% ( 380, 580 ] 435 0.015% 100.010% ( 580, 870 ] 190 0.006% 100.017% ( 870, 1300 ] 49 0.002% 100.018% ( 1300, 1900 ] 16 0.001% 100.019% ( 1900, 2900 ] 26 0.001% 100.020% ( 2900, 4400 ] 9 0.000% 100.020% ( 4400, 6600 ] 1 0.000% 100.020% ( 6600, 9900 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 874533 Average: 3.4121 StdDev: 29.56 Min: 0 Median: 1.7136 Max: 7491 Percentiles: P50: 1.71 P75: 2.43 P99: 8.83 P99.9: 142.42 P99.99: 250.28 ------------------------------------------------------ [ 0, 1 ] 77376 8.848% 8.848% ## ( 1, 2 ] 504329 57.668% 66.516% ############ ( 2, 3 ] 172112 19.680% 86.197% #### ( 3, 4 ] 51509 5.890% 92.086% # ( 4, 6 ] 49704 5.683% 97.770% # ( 6, 10 ] 15188 1.737% 99.507% ( 10, 15 ] 1576 0.180% 99.687% ( 15, 22 ] 224 0.026% 99.712% ( 22, 34 ] 19 0.002% 99.715% ( 34, 51 ] 7 0.001% 99.715% ( 51, 76 ] 21 0.002% 99.718% ( 76, 110 ] 1038 0.119% 99.836% ( 110, 170 ] 1028 0.118% 99.954% ( 170, 250 ] 314 0.036% 99.990% ( 250, 380 ] 257 0.029% 100.019% ( 380, 580 ] 229 0.026% 100.046% ( 580, 870 ] 98 0.011% 100.057% ( 870, 1300 ] 55 0.006% 100.063% ( 1300, 1900 ] 11 0.001% 100.064% ( 1900, 2900 ] 24 0.003% 100.067% ( 2900, 4400 ] 13 0.001% 100.068% ( 4400, 6600 ] 4 0.000% 100.069% ( 6600, 9900 ] 2 0.000% 100.069% ** Level 2 read latency histogram (micros): Count: 124205 Average: 2.3959 StdDev: 27.54 Min: 1 Median: 1.4882 Max: 6807 Percentiles: P50: 1.49 P75: 1.87 P99: 5.94 P99.9: 13.38 P99.99: 656.34 ------------------------------------------------------ [ 0, 1 ] 22741 18.309% 18.309% #### ( 1, 2 ] 80634 64.920% 83.229% ############# ( 2, 3 ] 13490 10.861% 94.090% ## ( 3, 4 ] 3459 2.785% 96.875% # ( 4, 6 ] 2727 2.196% 99.071% ( 6, 10 ] 967 0.779% 99.849% ( 10, 15 ] 93 0.075% 99.924% ( 15, 22 ] 10 0.008% 99.932% ( 22, 34 ] 1 0.001% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 11 0.009% 99.944% ( 110, 170 ] 42 0.034% 99.977% ( 170, 250 ] 6 0.005% 99.982% ( 250, 380 ] 6 0.005% 99.987% ( 380, 580 ] 2 0.002% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 275456 Average: 4.5520 StdDev: 64.25 Min: 0 Median: 1.8481 Max: 8758 Percentiles: P50: 1.85 P75: 2.68 P99: 9.11 P99.9: 242.50 P99.99: 465.35 ------------------------------------------------------ [ 0, 1 ] 9946 3.611% 3.611% # ( 1, 2 ] 150663 54.696% 58.307% ########### ( 2, 3 ] 67266 24.420% 82.726% ##### ( 3, 4 ] 19709 7.155% 89.882% # ( 4, 6 ] 21116 7.666% 97.547% ## ( 6, 10 ] 5148 1.869% 99.416% ( 10, 15 ] 642 0.233% 99.649% ( 15, 22 ] 92 0.033% 99.683% ( 22, 34 ] 7 0.003% 99.685% ( 34, 51 ] 1 0.000% 99.686% ( 51, 76 ] 4 0.001% 99.687% ( 76, 110 ] 108 0.039% 99.726% ( 110, 170 ] 303 0.110% 99.836% ( 170, 250 ] 197 0.072% 99.908% ( 250, 380 ] 168 0.061% 99.969% ( 380, 580 ] 144 0.052% 100.021% ( 580, 870 ] 84 0.030% 100.052% ( 870, 1300 ] 37 0.013% 100.065% ( 1300, 1900 ] 9 0.003% 100.068% ( 1900, 2900 ] 7 0.003% 100.071% ( 2900, 4400 ] 14 0.005% 100.076% ( 4400, 6600 ] 8 0.003% 100.079% ( 6600, 9900 ] 9 0.003% 100.082% ** Level 4 read latency histogram (micros): Count: 3631 Average: 68.2101 StdDev: 404.97 Min: 0 Median: 2.3234 Max: 7906 Percentiles: P50: 2.32 P75: 3.68 P99: 1392.18 P99.9: 6087.40 P99.99: 7906.00 ------------------------------------------------------ [ 0, 1 ] 74 2.038% 2.038% ( 1, 2 ] 1453 40.017% 42.055% ######## ( 2, 3 ] 892 24.566% 66.621% ##### ( 3, 4 ] 448 12.338% 78.959% ## ( 4, 6 ] 309 8.510% 87.469% ## ( 6, 10 ] 81 2.231% 89.700% ( 10, 15 ] 28 0.771% 90.471% ( 15, 22 ] 20 0.551% 91.022% ( 22, 34 ] 3 0.083% 91.104% ( 51, 76 ] 1 0.028% 91.132% ( 76, 110 ] 6 0.165% 91.297% ( 110, 170 ] 53 1.460% 92.757% ( 170, 250 ] 54 1.487% 94.244% ( 250, 380 ] 61 1.680% 95.924% ( 380, 580 ] 50 1.377% 97.301% ( 580, 870 ] 45 1.239% 98.540% ( 870, 1300 ] 15 0.413% 98.953% ( 1300, 1900 ] 11 0.303% 99.256% ( 1900, 2900 ] 6 0.165% 99.422% ( 2900, 4400 ] 12 0.330% 99.752% ( 4400, 6600 ] 7 0.193% 99.945% ( 6600, 9900 ] 2 0.055% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 974.8500 StdDev: 1200.73 Min: 81 Median: 505.0000 Max: 5332 Percentiles: P50: 505.00 P75: 1177.14 P99: 5332.00 P99.9: 5332.00 P99.99: 5332.00 ------------------------------------------------------ ( 76, 110 ] 7 11.667% 11.667% ## ( 110, 170 ] 4 6.667% 18.333% # ( 170, 250 ] 6 10.000% 28.333% ## ( 250, 380 ] 8 13.333% 41.667% ### ( 380, 580 ] 8 13.333% 55.000% ### ( 580, 870 ] 7 11.667% 66.667% ## ( 870, 1300 ] 7 11.667% 78.333% ## ( 1300, 1900 ] 4 6.667% 85.000% # ( 1900, 2900 ] 3 5.000% 90.000% # ( 2900, 4400 ] 4 6.667% 96.667% # ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 38.6 total, 16.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 178.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.434 H:M:S, 50.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 59.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.546 H:M:S, 81.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 0 2024/11/18-11:41:03 ... thread 0: (1000000,8000000) ops and (222130.1,186926.0) ops/second in (4.501867,42.797694) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.88 GB 100.7 6.6 0.0 6.6 14.2 7.6 0.0 1.9 136.5 291.7 49.85 45.29 132 0.378 6907K 10K 0.0 0.0 L1 13/13 1.46 GB 0.0 5.8 4.4 1.4 5.8 4.3 0.2 1.3 218.0 215.0 27.42 25.47 3 9.140 6070K 83K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.9 2.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 L3 18/0 933.59 MB 0.9 4.1 2.8 1.3 4.1 2.8 0.4 1.5 188.7 188.2 22.50 18.84 11 2.045 4311K 11K 0.0 0.0 L4 173/0 9.44 GB 1.0 2.4 2.3 0.1 2.4 2.3 0.8 1.0 140.8 140.5 17.80 11.74 32 0.556 2472K 2221 0.0 0.0 L5 1080/0 88.89 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/22 103.59 GB 0.0 19.4 9.7 9.7 26.9 17.2 7.8 3.6 167.2 231.4 119.04 102.77 180 0.661 20M 108K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.4 9.7 9.7 26.9 17.2 7.7 3.6 167.2 231.4 119.04 102.77 180 0.661 20M 108K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.4 9.7 9.7 19.3 9.6 0.0 0.0 208.7 207.5 95.41 83.11 70 1.363 20M 108K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 327.8 23.64 19.66 110 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.1 total, 42.8 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.90 GB write, 639.82 MB/s write, 19.44 GB read, 462.43 MB/s read, 119.0 seconds Interval compaction: 26.90 GB write, 643.59 MB/s write, 19.44 GB read, 465.16 MB/s read, 119.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 32, total-stops: 40, interval: 72 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3241584 Average: 2.8593 StdDev: 23.49 Min: 0 Median: 1.5622 Max: 10043 Percentiles: P50: 1.56 P75: 1.95 P99: 7.05 P99.9: 138.43 P99.99: 377.91 ------------------------------------------------------ [ 0, 1 ] 443661 13.687% 13.687% ### ( 1, 2 ] 2093673 64.588% 78.275% ############# ( 2, 3 ] 441643 13.624% 91.899% ### ( 3, 4 ] 116970 3.608% 95.507% # ( 4, 6 ] 106092 3.273% 98.780% # ( 6, 10 ] 27065 0.835% 99.615% ( 10, 15 ] 3313 0.102% 99.717% ( 15, 22 ] 408 0.013% 99.730% ( 22, 34 ] 24 0.001% 99.731% ( 34, 51 ] 10 0.000% 99.731% ( 51, 76 ] 23 0.001% 99.732% ( 76, 110 ] 3908 0.121% 99.852% ( 110, 170 ] 3276 0.101% 99.953% ( 170, 250 ] 694 0.021% 99.975% ( 250, 380 ] 508 0.016% 99.990% ( 380, 580 ] 503 0.016% 100.006% ( 580, 870 ] 258 0.008% 100.014% ( 870, 1300 ] 100 0.003% 100.017% ( 1300, 1900 ] 47 0.001% 100.018% ( 1900, 2900 ] 58 0.002% 100.020% ( 2900, 4400 ] 27 0.001% 100.021% ( 4400, 6600 ] 8 0.000% 100.021% ( 6600, 9900 ] 4 0.000% 100.021% ( 9900, 14000 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1185203 Average: 4.5236 StdDev: 69.34 Min: 0 Median: 1.7871 Max: 12313 Percentiles: P50: 1.79 P75: 2.61 P99: 9.10 P99.9: 164.76 P99.99: 512.50 ------------------------------------------------------ [ 0, 1 ] 80731 6.812% 6.812% # ( 1, 2 ] 650335 54.871% 61.683% ########### ( 2, 3 ] 260231 21.957% 83.639% #### ( 3, 4 ] 81314 6.861% 90.500% # ( 4, 6 ] 82453 6.957% 97.457% # ( 6, 10 ] 23631 1.994% 99.451% ( 10, 15 ] 2823 0.238% 99.689% ( 15, 22 ] 340 0.029% 99.718% ( 22, 34 ] 32 0.003% 99.720% ( 34, 51 ] 14 0.001% 99.722% ( 51, 76 ] 24 0.002% 99.724% ( 76, 110 ] 1075 0.091% 99.814% ( 110, 170 ] 1113 0.094% 99.908% ( 170, 250 ] 372 0.031% 99.940% ( 250, 380 ] 355 0.030% 99.970% ( 380, 580 ] 366 0.031% 100.001% ( 580, 870 ] 240 0.020% 100.021% ( 870, 1300 ] 168 0.014% 100.035% ( 1300, 1900 ] 79 0.007% 100.042% ( 1900, 2900 ] 126 0.011% 100.052% ( 2900, 4400 ] 123 0.010% 100.063% ( 4400, 6600 ] 32 0.003% 100.065% ( 6600, 9900 ] 26 0.002% 100.067% ( 9900, 14000 ] 1 0.000% 100.068% ** Level 2 read latency histogram (micros): Count: 124205 Average: 2.3959 StdDev: 27.54 Min: 1 Median: 1.4882 Max: 6807 Percentiles: P50: 1.49 P75: 1.87 P99: 5.94 P99.9: 13.38 P99.99: 656.34 ------------------------------------------------------ [ 0, 1 ] 22741 18.309% 18.309% #### ( 1, 2 ] 80634 64.920% 83.229% ############# ( 2, 3 ] 13490 10.861% 94.090% ## ( 3, 4 ] 3459 2.785% 96.875% # ( 4, 6 ] 2727 2.196% 99.071% ( 6, 10 ] 967 0.779% 99.849% ( 10, 15 ] 93 0.075% 99.924% ( 15, 22 ] 10 0.008% 99.932% ( 22, 34 ] 1 0.001% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 11 0.009% 99.944% ( 110, 170 ] 42 0.034% 99.977% ( 170, 250 ] 6 0.005% 99.982% ( 250, 380 ] 6 0.005% 99.987% ( 380, 580 ] 2 0.002% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 839104 Average: 4.8341 StdDev: 69.04 Min: 0 Median: 2.0468 Max: 8758 Percentiles: P50: 2.05 P75: 2.93 P99: 8.81 P99.9: 18.27 P99.99: 183.27 ------------------------------------------------------ [ 0, 1 ] 12206 1.455% 1.455% ( 1, 2 ] 396187 47.215% 48.670% ######### ( 2, 3 ] 238484 28.421% 77.091% ###### ( 3, 4 ] 81797 9.748% 86.840% ## ( 4, 6 ] 90520 10.788% 97.627% ## ( 6, 10 ] 16411 1.956% 99.583% ( 10, 15 ] 2524 0.301% 99.884% ( 15, 22 ] 291 0.035% 99.918% ( 22, 34 ] 30 0.004% 99.922% ( 34, 51 ] 10 0.001% 99.923% ( 51, 76 ] 8 0.001% 99.924% ( 76, 110 ] 121 0.014% 99.939% ( 110, 170 ] 381 0.045% 99.984% ( 170, 250 ] 302 0.036% 100.020% ( 250, 380 ] 259 0.031% 100.051% ( 380, 580 ] 260 0.031% 100.082% ( 580, 870 ] 216 0.026% 100.108% ( 870, 1300 ] 131 0.016% 100.123% ( 1300, 1900 ] 75 0.009% 100.132% ( 1900, 2900 ] 72 0.009% 100.141% ( 2900, 4400 ] 118 0.014% 100.155% ( 4400, 6600 ] 27 0.003% 100.158% ( 6600, 9900 ] 14 0.002% 100.160% ** Level 4 read latency histogram (micros): Count: 31558 Average: 72.0462 StdDev: 411.53 Min: 0 Median: 2.1542 Max: 13537 Percentiles: P50: 2.15 P75: 3.29 P99: 1880.65 P99.9: 5443.23 P99.99: 8653.26 ------------------------------------------------------ [ 0, 1 ] 431 1.366% 1.366% ( 1, 2 ] 14100 44.680% 46.045% ######### ( 2, 3 ] 8093 25.645% 71.690% ##### ( 3, 4 ] 3541 11.221% 82.911% ## ( 4, 6 ] 2402 7.611% 90.522% ## ( 6, 10 ] 696 2.205% 92.728% ( 10, 15 ] 151 0.478% 93.206% ( 15, 22 ] 49 0.155% 93.361% ( 22, 34 ] 11 0.035% 93.396% ( 34, 51 ] 5 0.016% 93.412% ( 51, 76 ] 2 0.006% 93.418% ( 76, 110 ] 20 0.063% 93.482% ( 110, 170 ] 164 0.520% 94.002% ( 170, 250 ] 210 0.665% 94.667% ( 250, 380 ] 261 0.827% 95.494% ( 380, 580 ] 303 0.960% 96.454% ( 580, 870 ] 379 1.201% 97.655% ( 870, 1300 ] 287 0.909% 98.565% ( 1300, 1900 ] 142 0.450% 99.015% ( 1900, 2900 ] 136 0.431% 99.445% ( 2900, 4400 ] 124 0.393% 99.838% ( 4400, 6600 ] 41 0.130% 99.968% ( 6600, 9900 ] 11 0.035% 100.003% ( 9900, 14000 ] 3 0.010% 100.013% ** Level 5 read latency histogram (micros): Count: 200 Average: 1469.6400 StdDev: 1476.87 Min: 81 Median: 832.1739 Max: 6061 Percentiles: P50: 832.17 P75: 2366.67 P99: 6061.00 P99.9: 6061.00 P99.99: 6061.00 ------------------------------------------------------ ( 76, 110 ] 12 6.000% 6.000% # ( 110, 170 ] 13 6.500% 12.500% # ( 170, 250 ] 15 7.500% 20.000% ## ( 250, 380 ] 18 9.000% 29.000% ## ( 380, 580 ] 22 11.000% 40.000% ## ( 580, 870 ] 23 11.500% 51.500% ## ( 870, 1300 ] 18 9.000% 60.500% ## ( 1300, 1900 ] 15 7.500% 68.000% ## ( 1900, 2900 ] 30 15.000% 83.000% ### ( 2900, 4400 ] 24 12.000% 95.000% ## ( 4400, 6600 ] 10 5.000% 100.000% # ** DB Stats ** Uptime(secs): 43.1 total, 4.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 182.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.113 H:M:S, 49.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 218.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.679 H:M:S, 37.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-11:41:07 ... thread 0: (1000000,9000000) ops and (290638.8,194643.5) ops/second in (3.440697,46.238391) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 3.93 GB 201.4 7.4 0.0 7.4 16.0 8.6 0.0 1.9 136.1 293.4 55.99 51.04 149 0.376 7738K 11K 0.0 0.0 L1 13/13 1.46 GB 0.0 5.8 4.4 1.4 5.8 4.3 0.2 1.3 218.0 215.0 27.42 25.47 3 9.140 6070K 83K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.9 2.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 L3 18/0 933.59 MB 0.9 4.1 2.8 1.3 4.1 2.8 0.4 1.5 188.7 188.2 22.50 18.84 11 2.045 4311K 11K 0.0 0.0 L4 173/0 9.44 GB 1.0 2.4 2.3 0.1 2.4 2.3 0.8 1.0 140.8 140.5 17.80 11.74 32 0.556 2472K 2221 0.0 0.0 L5 1080/0 88.89 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/22 104.64 GB 0.0 20.2 9.7 10.5 28.7 18.3 7.8 3.3 165.6 235.1 125.19 108.52 197 0.635 20M 109K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.2 9.7 10.5 28.7 18.3 7.7 3.3 165.6 235.1 125.19 108.52 197 0.635 20M 109K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.2 9.7 10.5 20.1 9.6 0.0 0.0 210.5 209.3 98.48 86.12 73 1.349 20M 109K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 330.2 26.71 22.39 124 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.5 total, 46.2 interval Flush(GB): cumulative 8.613, interval 8.613 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.74 GB write, 633.10 MB/s write, 20.24 GB read, 445.82 MB/s read, 125.2 seconds Interval compaction: 28.74 GB write, 636.55 MB/s write, 20.24 GB read, 448.26 MB/s read, 125.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 34, total-stops: 44, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3524467 Average: 2.8151 StdDev: 22.84 Min: 0 Median: 1.5630 Max: 10043 Percentiles: P50: 1.56 P75: 1.95 P99: 6.87 P99.9: 132.83 P99.99: 361.61 ------------------------------------------------------ [ 0, 1 ] 475601 13.494% 13.494% ### ( 1, 2 ] 2285475 64.846% 78.340% ############# ( 2, 3 ] 483575 13.721% 92.061% ### ( 3, 4 ] 125717 3.567% 95.628% # ( 4, 6 ] 112600 3.195% 98.823% # ( 6, 10 ] 28707 0.815% 99.637% ( 10, 15 ] 3624 0.103% 99.740% ( 15, 22 ] 423 0.012% 99.752% ( 22, 34 ] 28 0.001% 99.753% ( 34, 51 ] 11 0.000% 99.753% ( 51, 76 ] 26 0.001% 99.754% ( 76, 110 ] 3908 0.111% 99.865% ( 110, 170 ] 3281 0.093% 99.958% ( 170, 250 ] 700 0.020% 99.978% ( 250, 380 ] 512 0.015% 99.992% ( 380, 580 ] 508 0.014% 100.006% ( 580, 870 ] 265 0.008% 100.014% ( 870, 1300 ] 102 0.003% 100.017% ( 1300, 1900 ] 48 0.001% 100.018% ( 1900, 2900 ] 60 0.002% 100.020% ( 2900, 4400 ] 29 0.001% 100.021% ( 4400, 6600 ] 8 0.000% 100.021% ( 6600, 9900 ] 4 0.000% 100.021% ( 9900, 14000 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1323860 Average: 4.3282 StdDev: 65.70 Min: 0 Median: 1.7631 Max: 12313 Percentiles: P50: 1.76 P75: 2.55 P99: 9.02 P99.9: 162.52 P99.99: 512.25 ------------------------------------------------------ [ 0, 1 ] 93771 7.083% 7.083% # ( 1, 2 ] 744569 56.242% 63.325% ########### ( 2, 3 ] 281459 21.260% 84.586% #### ( 3, 4 ] 85267 6.441% 91.027% # ( 4, 6 ] 85880 6.487% 97.514% # ( 6, 10 ] 26069 1.969% 99.483% ( 10, 15 ] 2891 0.218% 99.701% ( 15, 22 ] 345 0.026% 99.727% ( 22, 34 ] 34 0.003% 99.730% ( 34, 51 ] 14 0.001% 99.731% ( 51, 76 ] 26 0.002% 99.733% ( 76, 110 ] 1123 0.085% 99.818% ( 110, 170 ] 1243 0.094% 99.912% ( 170, 250 ] 407 0.031% 99.942% ( 250, 380 ] 379 0.029% 99.971% ( 380, 580 ] 379 0.029% 100.000% ( 580, 870 ] 247 0.019% 100.018% ( 870, 1300 ] 170 0.013% 100.031% ( 1300, 1900 ] 79 0.006% 100.037% ( 1900, 2900 ] 126 0.010% 100.047% ( 2900, 4400 ] 123 0.009% 100.056% ( 4400, 6600 ] 32 0.002% 100.058% ( 6600, 9900 ] 26 0.002% 100.060% ( 9900, 14000 ] 1 0.000% 100.060% ** Level 2 read latency histogram (micros): Count: 124205 Average: 2.3959 StdDev: 27.54 Min: 1 Median: 1.4882 Max: 6807 Percentiles: P50: 1.49 P75: 1.87 P99: 5.94 P99.9: 13.38 P99.99: 656.34 ------------------------------------------------------ [ 0, 1 ] 22741 18.309% 18.309% #### ( 1, 2 ] 80634 64.920% 83.229% ############# ( 2, 3 ] 13490 10.861% 94.090% ## ( 3, 4 ] 3459 2.785% 96.875% # ( 4, 6 ] 2727 2.196% 99.071% ( 6, 10 ] 967 0.779% 99.849% ( 10, 15 ] 93 0.075% 99.924% ( 15, 22 ] 10 0.008% 99.932% ( 22, 34 ] 1 0.001% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 11 0.009% 99.944% ( 110, 170 ] 42 0.034% 99.977% ( 170, 250 ] 6 0.005% 99.982% ( 250, 380 ] 6 0.005% 99.987% ( 380, 580 ] 2 0.002% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 839104 Average: 4.8341 StdDev: 69.04 Min: 0 Median: 2.0468 Max: 8758 Percentiles: P50: 2.05 P75: 2.93 P99: 8.81 P99.9: 18.27 P99.99: 183.27 ------------------------------------------------------ [ 0, 1 ] 12206 1.455% 1.455% ( 1, 2 ] 396187 47.215% 48.670% ######### ( 2, 3 ] 238484 28.421% 77.091% ###### ( 3, 4 ] 81797 9.748% 86.840% ## ( 4, 6 ] 90520 10.788% 97.627% ## ( 6, 10 ] 16411 1.956% 99.583% ( 10, 15 ] 2524 0.301% 99.884% ( 15, 22 ] 291 0.035% 99.918% ( 22, 34 ] 30 0.004% 99.922% ( 34, 51 ] 10 0.001% 99.923% ( 51, 76 ] 8 0.001% 99.924% ( 76, 110 ] 121 0.014% 99.939% ( 110, 170 ] 381 0.045% 99.984% ( 170, 250 ] 302 0.036% 100.020% ( 250, 380 ] 259 0.031% 100.051% ( 380, 580 ] 260 0.031% 100.082% ( 580, 870 ] 216 0.026% 100.108% ( 870, 1300 ] 131 0.016% 100.123% ( 1300, 1900 ] 75 0.009% 100.132% ( 1900, 2900 ] 72 0.009% 100.141% ( 2900, 4400 ] 118 0.014% 100.155% ( 4400, 6600 ] 27 0.003% 100.158% ( 6600, 9900 ] 14 0.002% 100.160% ** Level 4 read latency histogram (micros): Count: 31558 Average: 72.0462 StdDev: 411.53 Min: 0 Median: 2.1542 Max: 13537 Percentiles: P50: 2.15 P75: 3.29 P99: 1880.65 P99.9: 5443.23 P99.99: 8653.26 ------------------------------------------------------ [ 0, 1 ] 431 1.366% 1.366% ( 1, 2 ] 14100 44.680% 46.045% ######### ( 2, 3 ] 8093 25.645% 71.690% ##### ( 3, 4 ] 3541 11.221% 82.911% ## ( 4, 6 ] 2402 7.611% 90.522% ## ( 6, 10 ] 696 2.205% 92.728% ( 10, 15 ] 151 0.478% 93.206% ( 15, 22 ] 49 0.155% 93.361% ( 22, 34 ] 11 0.035% 93.396% ( 34, 51 ] 5 0.016% 93.412% ( 51, 76 ] 2 0.006% 93.418% ( 76, 110 ] 20 0.063% 93.482% ( 110, 170 ] 164 0.520% 94.002% ( 170, 250 ] 210 0.665% 94.667% ( 250, 380 ] 261 0.827% 95.494% ( 380, 580 ] 303 0.960% 96.454% ( 580, 870 ] 379 1.201% 97.655% ( 870, 1300 ] 287 0.909% 98.565% ( 1300, 1900 ] 142 0.450% 99.015% ( 1900, 2900 ] 136 0.431% 99.445% ( 2900, 4400 ] 124 0.393% 99.838% ( 4400, 6600 ] 41 0.130% 99.968% ( 6600, 9900 ] 11 0.035% 100.003% ( 9900, 14000 ] 3 0.010% 100.013% ** Level 5 read latency histogram (micros): Count: 200 Average: 1469.6400 StdDev: 1476.87 Min: 81 Median: 832.1739 Max: 6061 Percentiles: P50: 832.17 P75: 2366.67 P99: 6061.00 P99.9: 6061.00 P99.99: 6061.00 ------------------------------------------------------ ( 76, 110 ] 12 6.000% 6.000% # ( 110, 170 ] 13 6.500% 12.500% # ( 170, 250 ] 15 7.500% 20.000% ## ( 250, 380 ] 18 9.000% 29.000% ## ( 380, 580 ] 22 11.000% 40.000% ## ( 580, 870 ] 23 11.500% 51.500% ## ( 870, 1300 ] 18 9.000% 60.500% ## ( 1300, 1900 ] 15 7.500% 68.000% ## ( 1900, 2900 ] 30 15.000% 83.000% ### ( 2900, 4400 ] 24 12.000% 95.000% ## ( 4400, 6600 ] 10 5.000% 100.000% # ** DB Stats ** Uptime(secs): 46.5 total, 3.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 190.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.952 H:M:S, 47.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.839 H:M:S, 24.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/18-11:41:15 ... thread 0: (1000000,10000000) ops and (118846.3,182973.8) ops/second in (8.414229,54.652620) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/5 3.13 GB 182.5 8.5 0.0 8.5 18.0 9.5 0.0 1.9 138.7 293.2 62.69 57.36 167 0.375 8826K 12K 0.0 0.0 L1 13/0 1.54 GB 158.0 9.0 6.1 2.9 8.8 6.0 0.2 1.5 213.0 210.2 43.07 39.57 4 10.767 7791K 83K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.5 2.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 L3 25/2 1.19 GB 1.0 6.1 3.8 2.2 6.0 3.8 0.9 1.6 178.8 178.1 34.66 27.93 22 1.576 6295K 23K 0.0 0.0 L4 174/7 9.70 GB 1.0 4.1 3.6 0.6 4.1 3.6 0.9 1.2 142.7 142.3 29.75 20.09 47 0.633 4168K 8008 0.0 0.0 L5 1092/0 89.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1319/14 105.45 GB 0.0 28.0 13.7 14.3 37.3 23.0 10.8 3.9 167.1 222.7 171.65 146.38 242 0.709 27M 127K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.0 13.7 14.3 37.3 23.0 10.7 3.9 167.1 222.7 171.65 146.38 242 0.709 27M 127K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.0 13.7 14.3 27.9 13.5 0.0 0.0 201.5 200.3 142.36 121.72 104 1.369 27M 127K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 331.2 29.29 24.67 138 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.9 total, 54.7 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.32 GB write, 696.10 MB/s write, 28.01 GB read, 522.46 MB/s read, 171.6 seconds Interval compaction: 37.32 GB write, 699.31 MB/s write, 28.01 GB read, 524.87 MB/s read, 171.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 27, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 27, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 41, pending-compaction-bytes-stops: 0, total-delays: 68, total-stops: 44, interval: 112 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4093361 Average: 2.8159 StdDev: 22.96 Min: 0 Median: 1.5801 Max: 12441 Percentiles: P50: 1.58 P75: 1.97 P99: 7.08 P99.9: 127.91 P99.99: 357.13 ------------------------------------------------------ [ 0, 1 ] 522558 12.766% 12.766% ### ( 1, 2 ] 2627570 64.191% 76.957% ############# ( 2, 3 ] 586491 14.328% 91.285% ### ( 3, 4 ] 159888 3.906% 95.191% # ( 4, 6 ] 146159 3.571% 98.762% # ( 6, 10 ] 36251 0.886% 99.647% ( 10, 15 ] 4711 0.115% 99.762% ( 15, 22 ] 538 0.013% 99.775% ( 22, 34 ] 34 0.001% 99.776% ( 34, 51 ] 16 0.000% 99.777% ( 51, 76 ] 30 0.001% 99.777% ( 76, 110 ] 3979 0.097% 99.875% ( 110, 170 ] 3496 0.085% 99.960% ( 170, 250 ] 771 0.019% 99.979% ( 250, 380 ] 559 0.014% 99.992% ( 380, 580 ] 557 0.014% 100.006% ( 580, 870 ] 301 0.007% 100.013% ( 870, 1300 ] 110 0.003% 100.016% ( 1300, 1900 ] 54 0.001% 100.017% ( 1900, 2900 ] 65 0.002% 100.019% ( 2900, 4400 ] 35 0.001% 100.020% ( 4400, 6600 ] 8 0.000% 100.020% ( 6600, 9900 ] 4 0.000% 100.020% ( 9900, 14000 ] 2 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1760960 Average: 4.5778 StdDev: 66.83 Min: 0 Median: 1.7878 Max: 16549 Percentiles: P50: 1.79 P75: 2.61 P99: 9.20 P99.9: 220.42 P99.99: 667.65 ------------------------------------------------------ [ 0, 1 ] 116239 6.601% 6.601% # ( 1, 2 ] 970080 55.088% 61.689% ########### ( 2, 3 ] 381877 21.686% 83.375% #### ( 3, 4 ] 119782 6.802% 90.177% # ( 4, 6 ] 125114 7.105% 97.282% # ( 6, 10 ] 37829 2.148% 99.430% ( 10, 15 ] 4441 0.252% 99.682% ( 15, 22 ] 541 0.031% 99.713% ( 22, 34 ] 56 0.003% 99.716% ( 34, 51 ] 19 0.001% 99.717% ( 51, 76 ] 51 0.003% 99.720% ( 76, 110 ] 1355 0.077% 99.797% ( 110, 170 ] 1447 0.082% 99.879% ( 170, 250 ] 584 0.033% 99.912% ( 250, 380 ] 574 0.033% 99.945% ( 380, 580 ] 645 0.037% 99.981% ( 580, 870 ] 496 0.028% 100.010% ( 870, 1300 ] 369 0.021% 100.031% ( 1300, 1900 ] 151 0.009% 100.039% ( 1900, 2900 ] 164 0.009% 100.048% ( 2900, 4400 ] 153 0.009% 100.057% ( 4400, 6600 ] 48 0.003% 100.060% ( 6600, 9900 ] 30 0.002% 100.062% ( 9900, 14000 ] 1 0.000% 100.062% ( 14000, 22000 ] 1 0.000% 100.062% ** Level 2 read latency histogram (micros): Count: 124205 Average: 2.3959 StdDev: 27.54 Min: 1 Median: 1.4882 Max: 6807 Percentiles: P50: 1.49 P75: 1.87 P99: 5.94 P99.9: 13.38 P99.99: 656.34 ------------------------------------------------------ [ 0, 1 ] 22741 18.309% 18.309% #### ( 1, 2 ] 80634 64.920% 83.229% ############# ( 2, 3 ] 13490 10.861% 94.090% ## ( 3, 4 ] 3459 2.785% 96.875% # ( 4, 6 ] 2727 2.196% 99.071% ( 6, 10 ] 967 0.779% 99.849% ( 10, 15 ] 93 0.075% 99.924% ( 15, 22 ] 10 0.008% 99.932% ( 22, 34 ] 1 0.001% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 11 0.009% 99.944% ( 110, 170 ] 42 0.034% 99.977% ( 170, 250 ] 6 0.005% 99.982% ( 250, 380 ] 6 0.005% 99.987% ( 380, 580 ] 2 0.002% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1398174 Average: 4.8998 StdDev: 64.98 Min: 0 Median: 2.1703 Max: 8758 Percentiles: P50: 2.17 P75: 3.10 P99: 8.99 P99.9: 14.61 P99.99: 122.57 ------------------------------------------------------ [ 0, 1 ] 14673 1.049% 1.049% ( 1, 2 ] 615875 44.049% 45.098% ######### ( 2, 3 ] 402430 28.783% 73.881% ###### ( 3, 4 ] 150725 10.780% 84.661% ## ( 4, 6 ] 176492 12.623% 97.284% ### ( 6, 10 ] 32136 2.298% 99.582% ( 10, 15 ] 4816 0.344% 99.927% ( 15, 22 ] 555 0.040% 99.966% ( 22, 34 ] 50 0.004% 99.970% ( 34, 51 ] 15 0.001% 99.971% ( 51, 76 ] 38 0.003% 99.974% ( 76, 110 ] 142 0.010% 99.984% ( 110, 170 ] 416 0.030% 100.014% ( 170, 250 ] 380 0.027% 100.041% ( 250, 380 ] 418 0.030% 100.071% ( 380, 580 ] 474 0.034% 100.104% ( 580, 870 ] 441 0.032% 100.136% ( 870, 1300 ] 301 0.022% 100.158% ( 1300, 1900 ] 150 0.011% 100.168% ( 1900, 2900 ] 110 0.008% 100.176% ( 2900, 4400 ] 168 0.012% 100.188% ( 4400, 6600 ] 37 0.003% 100.191% ( 6600, 9900 ] 18 0.001% 100.192% ** Level 4 read latency histogram (micros): Count: 175206 Average: 26.5557 StdDev: 230.65 Min: 0 Median: 2.1977 Max: 18526 Percentiles: P50: 2.20 P75: 3.32 P99: 734.79 P99.9: 2997.74 P99.99: 4304.53 ------------------------------------------------------ [ 0, 1 ] 2148 1.226% 1.226% ( 1, 2 ] 76219 43.503% 44.728% ######### ( 2, 3 ] 46719 26.665% 71.394% ##### ( 3, 4 ] 19924 11.372% 82.765% ## ( 4, 6 ] 19283 11.006% 93.771% ## ( 6, 10 ] 5265 3.005% 96.776% # ( 10, 15 ] 845 0.482% 97.259% ( 15, 22 ] 140 0.080% 97.339% ( 22, 34 ] 26 0.015% 97.353% ( 34, 51 ] 6 0.003% 97.357% ( 51, 76 ] 24 0.014% 97.371% ( 76, 110 ] 71 0.041% 97.411% ( 110, 170 ] 344 0.196% 97.607% ( 170, 250 ] 510 0.291% 97.898% ( 250, 380 ] 625 0.357% 98.255% ( 380, 580 ] 809 0.462% 98.717% ( 580, 870 ] 931 0.531% 99.248% ( 870, 1300 ] 650 0.371% 99.619% ( 1300, 1900 ] 290 0.166% 99.785% ( 1900, 2900 ] 191 0.109% 99.894% ( 2900, 4400 ] 181 0.103% 99.997% ( 4400, 6600 ] 49 0.028% 100.025% ( 6600, 9900 ] 15 0.009% 100.034% ( 9900, 14000 ] 5 0.003% 100.037% ( 14000, 22000 ] 3 0.002% 100.038% ** Level 5 read latency histogram (micros): Count: 260 Average: 1385.9269 StdDev: 1442.60 Min: 80 Median: 760.0000 Max: 6169 Percentiles: P50: 760.00 P75: 2233.33 P99: 6080.00 P99.9: 6169.00 P99.99: 6169.00 ------------------------------------------------------ ( 76, 110 ] 15 5.769% 5.769% # ( 110, 170 ] 22 8.462% 14.231% ## ( 170, 250 ] 22 8.462% 22.692% ## ( 250, 380 ] 25 9.615% 32.308% ## ( 380, 580 ] 28 10.769% 43.077% ## ( 580, 870 ] 29 11.154% 54.231% ## ( 870, 1300 ] 23 8.846% 63.077% ## ( 1300, 1900 ] 19 7.308% 70.385% # ( 1900, 2900 ] 36 13.846% 84.231% ### ( 2900, 4400 ] 30 11.538% 95.769% ## ( 4400, 6600 ] 11 4.231% 100.000% # ** DB Stats ** Uptime(secs): 54.9 total, 8.4 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 179.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.650 H:M:S, 50.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 116.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.698 H:M:S, 67.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-11:41:18 ... thread 0: (1000000,11000000) ops and (322031.0,190450.1) ops/second in (3.105291,57.757911) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 4.05 GB 357.9 10.4 0.0 10.4 20.8 10.4 0.0 2.0 145.1 289.9 73.38 67.48 183 0.401 10M 20K 0.0 0.0 L1 13/0 1.54 GB 158.0 9.0 6.1 2.9 8.8 6.0 0.2 1.5 213.0 210.2 43.07 39.57 4 10.767 7791K 83K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.5 2.0 255.0 254.8 1.48 1.43 2 0.741 383K 205 0.0 0.0 L3 23/0 969.26 MB 1.0 6.1 3.8 2.2 6.0 3.8 0.9 1.6 178.8 178.1 34.66 27.93 22 1.576 6295K 23K 0.0 0.0 L4 171/0 9.64 GB 1.0 4.6 3.8 0.7 4.5 3.8 0.9 1.2 146.9 146.4 31.79 21.97 49 0.649 4596K 10K 0.0 0.0 L5 1096/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1321/8 106.36 GB 0.0 30.3 13.9 16.4 40.6 24.1 11.1 3.9 168.5 225.2 184.38 158.38 260 0.709 29M 138K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.3 13.9 16.4 40.6 24.1 11.0 3.9 168.5 225.2 184.38 158.38 260 0.709 29M 138K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.3 13.9 16.4 30.2 13.7 0.0 0.0 203.9 202.7 152.34 131.28 109 1.398 29M 138K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.4 10.4 0.0 0.0 0.0 332.3 32.04 27.10 151 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.0 total, 57.8 interval Flush(GB): cumulative 10.397, interval 10.397 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.56 GB write, 715.91 MB/s write, 30.34 GB read, 535.47 MB/s read, 184.4 seconds Interval compaction: 40.56 GB write, 719.03 MB/s write, 30.34 GB read, 537.81 MB/s read, 184.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 27, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 27, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 41, pending-compaction-bytes-stops: 0, total-delays: 68, total-stops: 49, interval: 117 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4421349 Average: 2.7765 StdDev: 22.32 Min: 0 Median: 1.5777 Max: 12441 Percentiles: P50: 1.58 P75: 1.97 P99: 6.97 P99.9: 121.35 P99.99: 334.32 ------------------------------------------------------ [ 0, 1 ] 570249 12.898% 12.898% ### ( 1, 2 ] 2839428 64.221% 77.118% ############# ( 2, 3 ] 630747 14.266% 91.384% ### ( 3, 4 ] 171738 3.884% 95.269% # ( 4, 6 ] 155527 3.518% 98.786% # ( 6, 10 ] 38916 0.880% 99.667% ( 10, 15 ] 5035 0.114% 99.780% ( 15, 22 ] 563 0.013% 99.793% ( 22, 34 ] 35 0.001% 99.794% ( 34, 51 ] 17 0.000% 99.794% ( 51, 76 ] 33 0.001% 99.795% ( 76, 110 ] 3979 0.090% 99.885% ( 110, 170 ] 3499 0.079% 99.964% ( 170, 250 ] 778 0.018% 99.982% ( 250, 380 ] 561 0.013% 99.994% ( 380, 580 ] 563 0.013% 100.007% ( 580, 870 ] 307 0.007% 100.014% ( 870, 1300 ] 114 0.003% 100.017% ( 1300, 1900 ] 56 0.001% 100.018% ( 1900, 2900 ] 65 0.001% 100.019% ( 2900, 4400 ] 36 0.001% 100.020% ( 4400, 6600 ] 9 0.000% 100.020% ( 6600, 9900 ] 4 0.000% 100.021% ( 9900, 14000 ] 2 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1760960 Average: 4.5778 StdDev: 66.83 Min: 0 Median: 1.7878 Max: 16549 Percentiles: P50: 1.79 P75: 2.61 P99: 9.20 P99.9: 220.42 P99.99: 667.65 ------------------------------------------------------ [ 0, 1 ] 116239 6.601% 6.601% # ( 1, 2 ] 970080 55.088% 61.689% ########### ( 2, 3 ] 381877 21.686% 83.375% #### ( 3, 4 ] 119782 6.802% 90.177% # ( 4, 6 ] 125114 7.105% 97.282% # ( 6, 10 ] 37829 2.148% 99.430% ( 10, 15 ] 4441 0.252% 99.682% ( 15, 22 ] 541 0.031% 99.713% ( 22, 34 ] 56 0.003% 99.716% ( 34, 51 ] 19 0.001% 99.717% ( 51, 76 ] 51 0.003% 99.720% ( 76, 110 ] 1355 0.077% 99.797% ( 110, 170 ] 1447 0.082% 99.879% ( 170, 250 ] 584 0.033% 99.912% ( 250, 380 ] 574 0.033% 99.945% ( 380, 580 ] 645 0.037% 99.981% ( 580, 870 ] 496 0.028% 100.010% ( 870, 1300 ] 369 0.021% 100.031% ( 1300, 1900 ] 151 0.009% 100.039% ( 1900, 2900 ] 164 0.009% 100.048% ( 2900, 4400 ] 153 0.009% 100.057% ( 4400, 6600 ] 48 0.003% 100.060% ( 6600, 9900 ] 30 0.002% 100.062% ( 9900, 14000 ] 1 0.000% 100.062% ( 14000, 22000 ] 1 0.000% 100.062% ** Level 2 read latency histogram (micros): Count: 124205 Average: 2.3959 StdDev: 27.54 Min: 1 Median: 1.4882 Max: 6807 Percentiles: P50: 1.49 P75: 1.87 P99: 5.94 P99.9: 13.38 P99.99: 656.34 ------------------------------------------------------ [ 0, 1 ] 22741 18.309% 18.309% #### ( 1, 2 ] 80634 64.920% 83.229% ############# ( 2, 3 ] 13490 10.861% 94.090% ## ( 3, 4 ] 3459 2.785% 96.875% # ( 4, 6 ] 2727 2.196% 99.071% ( 6, 10 ] 967 0.779% 99.849% ( 10, 15 ] 93 0.075% 99.924% ( 15, 22 ] 10 0.008% 99.932% ( 22, 34 ] 1 0.001% 99.933% ( 34, 51 ] 1 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 11 0.009% 99.944% ( 110, 170 ] 42 0.034% 99.977% ( 170, 250 ] 6 0.005% 99.982% ( 250, 380 ] 6 0.005% 99.987% ( 380, 580 ] 2 0.002% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1452867 Average: 4.8184 StdDev: 63.75 Min: 0 Median: 2.1579 Max: 8758 Percentiles: P50: 2.16 P75: 3.07 P99: 8.95 P99.9: 14.56 P99.99: 119.33 ------------------------------------------------------ [ 0, 1 ] 15215 1.047% 1.047% ( 1, 2 ] 645071 44.400% 45.447% ######### ( 2, 3 ] 418941 28.835% 74.283% ###### ( 3, 4 ] 154681 10.647% 84.929% ## ( 4, 6 ] 180431 12.419% 97.348% ## ( 6, 10 ] 32595 2.243% 99.592% ( 10, 15 ] 4917 0.338% 99.930% ( 15, 22 ] 561 0.039% 99.969% ( 22, 34 ] 50 0.003% 99.972% ( 34, 51 ] 15 0.001% 99.973% ( 51, 76 ] 38 0.003% 99.976% ( 76, 110 ] 142 0.010% 99.986% ( 110, 170 ] 416 0.029% 100.014% ( 170, 250 ] 380 0.026% 100.040% ( 250, 380 ] 418 0.029% 100.069% ( 380, 580 ] 474 0.033% 100.102% ( 580, 870 ] 441 0.030% 100.132% ( 870, 1300 ] 301 0.021% 100.153% ( 1300, 1900 ] 150 0.010% 100.163% ( 1900, 2900 ] 110 0.008% 100.171% ( 2900, 4400 ] 168 0.012% 100.182% ( 4400, 6600 ] 37 0.003% 100.185% ( 6600, 9900 ] 18 0.001% 100.186% ** Level 4 read latency histogram (micros): Count: 194838 Average: 24.3731 StdDev: 219.04 Min: 0 Median: 2.1469 Max: 18526 Percentiles: P50: 2.15 P75: 3.21 P99: 675.83 P99.9: 2853.73 P99.99: 4279.97 ------------------------------------------------------ [ 0, 1 ] 2517 1.292% 1.292% ( 1, 2 ] 87281 44.797% 46.089% ######### ( 2, 3 ] 51870 26.622% 72.711% ##### ( 3, 4 ] 21231 10.897% 83.607% ## ( 4, 6 ] 20471 10.507% 94.114% ## ( 6, 10 ] 5610 2.879% 96.993% # ( 10, 15 ] 900 0.462% 97.455% ( 15, 22 ] 148 0.076% 97.531% ( 22, 34 ] 28 0.014% 97.546% ( 34, 51 ] 6 0.003% 97.549% ( 51, 76 ] 26 0.013% 97.562% ( 76, 110 ] 83 0.043% 97.605% ( 110, 170 ] 377 0.193% 97.798% ( 170, 250 ] 540 0.277% 98.075% ( 250, 380 ] 657 0.337% 98.413% ( 380, 580 ] 835 0.429% 98.841% ( 580, 870 ] 937 0.481% 99.322% ( 870, 1300 ] 653 0.335% 99.657% ( 1300, 1900 ] 291 0.149% 99.807% ( 1900, 2900 ] 191 0.098% 99.905% ( 2900, 4400 ] 181 0.093% 99.997% ( 4400, 6600 ] 49 0.025% 100.023% ( 6600, 9900 ] 15 0.008% 100.030% ( 9900, 14000 ] 5 0.003% 100.033% ( 14000, 22000 ] 3 0.002% 100.034% ** Level 5 read latency histogram (micros): Count: 280 Average: 1346.0393 StdDev: 1426.10 Min: 78 Median: 730.0000 Max: 6169 Percentiles: P50: 730.00 P75: 2150.00 P99: 6040.00 P99.9: 6169.00 P99.99: 6169.00 ------------------------------------------------------ ( 76, 110 ] 19 6.786% 6.786% # ( 110, 170 ] 26 9.286% 16.071% ## ( 170, 250 ] 24 8.571% 24.643% ## ( 250, 380 ] 25 8.929% 33.571% ## ( 380, 580 ] 31 11.071% 44.643% ## ( 580, 870 ] 29 10.357% 55.000% ## ( 870, 1300 ] 25 8.929% 63.929% ## ( 1300, 1900 ] 22 7.857% 71.786% ## ( 1900, 2900 ] 36 12.857% 84.643% ### ( 2900, 4400 ] 32 11.429% 96.071% ## ( 4400, 6600 ] 11 3.929% 100.000% # ** DB Stats ** Uptime(secs): 58.0 total, 3.1 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 186.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.152 H:M:S, 48.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.502 H:M:S, 16.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.413 micros/op 184730 ops/sec 60.006 seconds 11084999 operations; 179.0 MB/s Microseconds per write: Count: 11084999 Average: 5.4133 StdDev: 343.71 Min: 0 Median: 1.7241 Max: 503458 Percentiles: P50: 1.72 P75: 2.70 P99: 8.48 P99.9: 1105.30 P99.99: 2672.54 ------------------------------------------------------ [ 0, 1 ] 1560621 14.079% 14.079% ### ( 1, 2 ] 5499096 49.608% 63.687% ########## ( 2, 3 ] 1778848 16.047% 79.734% ### ( 3, 4 ] 1504632 13.574% 93.308% ### ( 4, 6 ] 566491 5.110% 98.418% # ( 6, 10 ] 103913 0.937% 99.356% ( 10, 15 ] 30883 0.279% 99.635% ( 15, 22 ] 8201 0.074% 99.708% ( 22, 34 ] 1555 0.014% 99.723% ( 34, 51 ] 206 0.002% 99.724% ( 51, 76 ] 28 0.000% 99.725% ( 76, 110 ] 7741 0.070% 99.794% ( 110, 170 ] 3012 0.027% 99.822% ( 170, 250 ] 363 0.003% 99.825% ( 250, 380 ] 141 0.001% 99.826% ( 380, 580 ] 34 0.000% 99.826% ( 580, 870 ] 34 0.000% 99.827% ( 870, 1300 ] 14830 0.134% 99.961% ( 1300, 1900 ] 91 0.001% 99.961% ( 1900, 2900 ] 4104 0.037% 99.998% ( 2900, 4400 ] 111 0.001% 99.999% ( 4400, 6600 ] 29 0.000% 100.000% ( 6600, 9900 ] 7 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 170000, 250000 ] 18 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 185503 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11084999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11439718968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 625 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30133799 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 33506808744 rocksdb.compact.write.bytes COUNT : 33311801505 rocksdb.flush.write.bytes COUNT : 11427815009 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 64 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 403 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11335723008 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4455424 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33612988363 rocksdb.non.last.level.read.count COUNT : 8116490 rocksdb.block.checksum.compute.count COUNT : 8115304 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.362375 P95 : 3.857088 P99 : 6.717951 P100 : 503452.000000 COUNT : 11084999 SUM : 54928080 rocksdb.compaction.times.micros P50 : 945000.000000 P95 : 3866000.000000 P99 : 17560000.000000 P100 : 19491352.000000 COUNT : 111 SUM : 154485437 rocksdb.compaction.times.cpu_micros P50 : 881794.871795 P95 : 3215000.000000 P99 : 17560000.000000 P100 : 17800674.000000 COUNT : 111 SUM : 133389482 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 706.086957 P95 : 1430.000000 P99 : 15840.000000 P100 : 21547.000000 COUNT : 154 SUM : 151649 rocksdb.compaction.outfile.sync.micros P50 : 1124.814815 P95 : 64375.000000 P99 : 109936.363636 P100 : 129573.000000 COUNT : 402 SUM : 3678652 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 102.946809 P95 : 1063.500000 P99 : 2415.000000 P100 : 5326.000000 COUNT : 297 SUM : 72287 rocksdb.table.open.io.micros P50 : 1462.931034 P95 : 8492.647059 P99 : 20000.000000 P100 : 22988.000000 COUNT : 625 SUM : 1487468 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.790436 P95 : 8.215512 P99 : 11.435047 P100 : 18529.000000 COUNT : 8113463 SUM : 49723401 rocksdb.read.block.get.micros P50 : 516.054422 P95 : 3791.509434 P99 : 6422.580645 P100 : 8836.000000 COUNT : 1250 SUM : 1176808 rocksdb.write.raw.block.micros P50 : 0.512839 P95 : 0.974394 P99 : 2.900288 P100 : 14845.000000 COUNT : 10835802 SUM : 21543134 rocksdb.numfiles.in.singlecompaction P50 : 3.079710 P95 : 5.783333 P99 : 24.820000 P100 : 28.000000 COUNT : 153 SUM : 563 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.556348 P95 : 1150.385746 P99 : 2475.876037 P100 : 503083.000000 COUNT : 189906 SUM : 30148053 rocksdb.sst.read.micros P50 : 1.697194 P95 : 4.993945 P99 : 8.676635 P100 : 18526.000000 COUNT : 8116650 SUM : 33196858 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11084999 SUM : 11439718968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212434.782609 P95 : 367000.000000 P99 : 636700.000000 P100 : 688670.000000 COUNT : 154 SUM : 32729290 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 403 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0