[2024-12-16 00:34:13.267630] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-16 00:34:13.267896] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1981462 ] Set seed to 1734305653260944 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-16 00:34:13.384712] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-16 00:34:13.595390] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-16 00:34:13.595444] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1981462' to capture a snapshot of events at runtime. [2024-12-16 00:34:13.595454] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1981462 for offline analysis/debug. [2024-12-16 00:34:13.595485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 16 00:34:22 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/16-00:34:24 ... thread 0: (1000000,1000000) ops and (357288.2,357288.2) ops/second in (2.798861,2.798861) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.04 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 355.3 2.31 2.05 12 0.192 0 0 0.0 0.0 L2 3/2 251.76 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 254.6 254.5 1.48 1.43 2 0.742 383K 206 0.0 0.0 L3 11/0 930.60 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1179/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 99.7 315.8 3.79 3.48 14 0.271 383K 206 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 99.7 315.8 3.79 3.48 14 0.271 383K 206 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 254.6 254.5 1.48 1.43 2 0.742 383K 206 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 355.3 2.31 2.05 12 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 395.62 MB/s write, 0.37 GB read, 124.94 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 427.35 MB/s write, 0.37 GB read, 134.97 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 102268 Average: 1.9870 StdDev: 21.68 Min: 1 Median: 1.2705 Max: 3223 Percentiles: P50: 1.27 P75: 1.68 P99: 3.93 P99.9: 9.27 P99.99: 557.32 ------------------------------------------------------ [ 0, 1 ] 34313 33.552% 33.552% ####### ( 1, 2 ] 62197 60.818% 94.370% ############ ( 2, 3 ] 3510 3.432% 97.802% # ( 3, 4 ] 1321 1.292% 99.094% ( 4, 6 ] 654 0.639% 99.733% ( 6, 10 ] 210 0.205% 99.938% ( 10, 15 ] 34 0.033% 99.972% ( 15, 22 ] 4 0.004% 99.976% ( 22, 34 ] 1 0.001% 99.977% ( 51, 76 ] 1 0.001% 99.978% ( 110, 170 ] 7 0.007% 99.984% ( 170, 250 ] 4 0.004% 99.988% ( 250, 380 ] 1 0.001% 99.989% ( 380, 580 ] 2 0.002% 99.991% ( 580, 870 ] 1 0.001% 99.992% ( 870, 1300 ] 2 0.002% 99.994% ( 1300, 1900 ] 3 0.003% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 51871 Average: 2.3064 StdDev: 45.27 Min: 0 Median: 1.3014 Max: 7916 Percentiles: P50: 1.30 P75: 1.71 P99: 4.87 P99.9: 9.79 P99.99: 1462.58 ------------------------------------------------------ [ 0, 1 ] 16265 31.357% 31.357% ###### ( 1, 2 ] 32088 61.861% 93.218% ############ ( 2, 3 ] 1890 3.644% 96.861% # ( 3, 4 ] 890 1.716% 98.577% ( 4, 6 ] 505 0.974% 99.551% ( 6, 10 ] 191 0.368% 99.919% ( 10, 15 ] 24 0.046% 99.965% ( 15, 22 ] 1 0.002% 99.967% ( 22, 34 ] 1 0.002% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 250, 380 ] 3 0.006% 99.977% ( 380, 580 ] 3 0.006% 99.983% ( 580, 870 ] 2 0.004% 99.987% ( 870, 1300 ] 1 0.002% 99.988% ( 1300, 1900 ] 3 0.006% 99.994% ( 2900, 4400 ] 1 0.002% 99.996% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 45 Average: 3394.3556 StdDev: 2644.26 Min: 290 Median: 2462.5000 Max: 9439 Percentiles: P50: 2462.50 P75: 6416.67 P99: 9439.00 P99.9: 9439.00 P99.99: 9439.00 ------------------------------------------------------ ( 250, 380 ] 3 6.667% 6.667% # ( 380, 580 ] 1 2.222% 8.889% ( 580, 870 ] 3 6.667% 15.556% # ( 870, 1300 ] 7 15.556% 31.111% ### ( 1300, 1900 ] 4 8.889% 40.000% ## ( 1900, 2900 ] 8 17.778% 57.778% #### ( 2900, 4400 ] 5 11.111% 68.889% ## ( 4400, 6600 ] 3 6.667% 75.556% # ( 6600, 9900 ] 11 24.444% 100.000% ##### ** Level 4 read latency histogram (micros): Count: 25 Average: 3136.8800 StdDev: 2536.74 Min: 96 Median: 2650.0000 Max: 7317 Percentiles: P50: 2650.00 P75: 5408.33 P99: 7317.00 P99.9: 7317.00 P99.99: 7317.00 ------------------------------------------------------ ( 76, 110 ] 2 8.000% 8.000% ## ( 250, 380 ] 1 4.000% 12.000% # ( 380, 580 ] 1 4.000% 16.000% # ( 580, 870 ] 4 16.000% 32.000% ### ( 870, 1300 ] 1 4.000% 36.000% # ( 1300, 1900 ] 2 8.000% 44.000% ## ( 1900, 2900 ] 2 8.000% 52.000% ## ( 2900, 4400 ] 3 12.000% 64.000% ## ( 4400, 6600 ] 6 24.000% 88.000% ##### ( 6600, 9900 ] 3 12.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 325.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.204 H:M:S, 6.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.204 H:M:S, 7.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-00:34:28 ... thread 0: (1000000,2000000) ops and (325205.8,340492.9) ops/second in (3.074976,5.873837) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.17 GB 88.1 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.5 318.2 8.31 7.66 29 0.287 831K 908 0.0 0.0 L1 1/0 3.57 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.2 236.7 1.59 1.54 1 1.594 383K 645 0.0 0.0 L2 2/1 54.53 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 254.6 254.5 1.48 1.43 2 0.742 383K 206 0.0 0.0 L3 21/11 1.25 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.5 1.0 239.3 239.3 1.04 0.98 1 1.042 253K 0 0.0 0.0 L4 170/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 149.3 149.3 1.50 1.13 1 1.503 227K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1246/16 97.92 GB 0.0 2.0 1.0 1.0 3.8 2.8 1.5 2.1 147.0 278.0 13.94 12.75 34 0.410 2080K 1759 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 1.0 1.0 3.8 2.8 1.3 2.1 147.0 278.0 13.94 12.75 34 0.410 2080K 1759 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 1.0 1.0 2.0 1.0 0.0 0.0 233.1 232.8 8.79 8.19 8 1.099 2080K 1759 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 355.1 5.15 4.55 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.78 GB write, 635.08 MB/s write, 2.00 GB read, 335.88 MB/s read, 13.9 seconds Interval compaction: 3.78 GB write, 659.36 MB/s write, 2.00 GB read, 348.72 MB/s read, 13.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389145 Average: 2.3075 StdDev: 16.80 Min: 0 Median: 1.5213 Max: 6189 Percentiles: P50: 1.52 P75: 1.91 P99: 5.79 P99.9: 10.41 P99.99: 15.67 ------------------------------------------------------ [ 0, 1 ] 65320 16.786% 16.786% ### ( 1, 2 ] 247944 63.715% 80.501% ############# ( 2, 3 ] 44199 11.358% 91.859% ## ( 3, 4 ] 15881 4.081% 95.940% # ( 4, 6 ] 13345 3.429% 99.369% # ( 6, 10 ] 2037 0.523% 99.892% ( 10, 15 ] 378 0.097% 99.989% ( 15, 22 ] 32 0.008% 99.998% ( 22, 34 ] 5 0.001% 99.999% ( 51, 76 ] 3 0.001% 100.000% ( 76, 110 ] 1 0.000% 100.000% ( 110, 170 ] 8 0.002% 100.002% ( 170, 250 ] 13 0.003% 100.005% ( 250, 380 ] 4 0.001% 100.006% ( 380, 580 ] 9 0.002% 100.009% ( 580, 870 ] 8 0.002% 100.011% ( 870, 1300 ] 7 0.002% 100.013% ( 1300, 1900 ] 4 0.001% 100.014% ( 1900, 2900 ] 2 0.001% 100.014% ( 2900, 4400 ] 3 0.001% 100.015% ( 4400, 6600 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 25 Average: 189.2000 StdDev: 331.48 Min: 1 Median: 1.7222 Max: 1120 Percentiles: P50: 1.72 P75: 230.00 P99: 1120.00 P99.9: 1120.00 P99.99: 1120.00 ------------------------------------------------------ [ 0, 1 ] 6 24.000% 24.000% ##### ( 1, 2 ] 9 36.000% 60.000% ####### ( 2, 3 ] 1 4.000% 64.000% # ( 4, 6 ] 1 4.000% 68.000% # ( 110, 170 ] 1 4.000% 72.000% # ( 170, 250 ] 1 4.000% 76.000% # ( 250, 380 ] 1 4.000% 80.000% # ( 380, 580 ] 1 4.000% 84.000% # ( 580, 870 ] 2 8.000% 92.000% ## ( 870, 1300 ] 2 8.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 95655 Average: 2.3104 StdDev: 33.34 Min: 0 Median: 1.4399 Max: 7916 Percentiles: P50: 1.44 P75: 1.83 P99: 5.68 P99.9: 10.84 P99.99: 542.30 ------------------------------------------------------ [ 0, 1 ] 20990 21.943% 21.943% #### ( 1, 2 ] 61014 63.785% 85.729% ############# ( 2, 3 ] 7463 7.802% 93.531% ## ( 3, 4 ] 3221 3.367% 96.898% # ( 4, 6 ] 2396 2.505% 99.403% # ( 6, 10 ] 461 0.482% 99.885% ( 10, 15 ] 85 0.089% 99.974% ( 15, 22 ] 8 0.008% 99.982% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 1 0.001% 99.984% ( 250, 380 ] 3 0.003% 99.987% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 2 0.002% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 3 0.003% 99.997% ( 2900, 4400 ] 1 0.001% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 185555 Average: 3.9352 StdDev: 69.51 Min: 0 Median: 1.6444 Max: 9439 Percentiles: P50: 1.64 P75: 2.18 P99: 8.90 P99.9: 188.27 P99.99: 649.97 ------------------------------------------------------ [ 0, 1 ] 18366 9.898% 9.898% ## ( 1, 2 ] 115480 62.235% 72.133% ############ ( 2, 3 ] 29394 15.841% 87.974% ### ( 3, 4 ] 9119 4.914% 92.888% # ( 4, 6 ] 9141 4.926% 97.815% # ( 6, 10 ] 3036 1.636% 99.451% ( 10, 15 ] 511 0.275% 99.726% ( 15, 22 ] 37 0.020% 99.746% ( 22, 34 ] 3 0.002% 99.748% ( 51, 76 ] 5 0.003% 99.750% ( 76, 110 ] 75 0.040% 99.791% ( 110, 170 ] 186 0.100% 99.891% ( 170, 250 ] 72 0.039% 99.930% ( 250, 380 ] 60 0.032% 99.962% ( 380, 580 ] 43 0.023% 99.985% ( 580, 870 ] 35 0.019% 100.004% ( 870, 1300 ] 14 0.008% 100.012% ( 1300, 1900 ] 8 0.004% 100.016% ( 1900, 2900 ] 8 0.004% 100.020% ( 2900, 4400 ] 6 0.003% 100.024% ( 4400, 6600 ] 3 0.002% 100.025% ( 6600, 9900 ] 11 0.006% 100.031% ** Level 4 read latency histogram (micros): Count: 315 Average: 260.4921 StdDev: 1107.28 Min: 1 Median: 2.8125 Max: 7317 Percentiles: P50: 2.81 P75: 8.33 P99: 6545.00 P99.9: 7317.00 P99.99: 7317.00 ------------------------------------------------------ [ 0, 1 ] 18 5.714% 5.714% # ( 1, 2 ] 81 25.714% 31.429% ##### ( 2, 3 ] 72 22.857% 54.286% ##### ( 3, 4 ] 36 11.429% 65.714% ## ( 4, 6 ] 24 7.619% 73.333% ## ( 6, 10 ] 9 2.857% 76.190% # ( 10, 15 ] 7 2.222% 78.413% ( 15, 22 ] 26 8.254% 86.667% ## ( 22, 34 ] 10 3.175% 89.841% # ( 76, 110 ] 2 0.635% 90.476% ( 110, 170 ] 1 0.317% 90.794% ( 170, 250 ] 1 0.317% 91.111% ( 250, 380 ] 5 1.587% 92.698% ( 380, 580 ] 2 0.635% 93.333% ( 580, 870 ] 4 1.270% 94.603% ( 870, 1300 ] 1 0.317% 94.921% ( 1300, 1900 ] 2 0.635% 95.556% ( 1900, 2900 ] 2 0.635% 96.190% ( 2900, 4400 ] 3 0.952% 97.143% ( 4400, 6600 ] 6 1.905% 99.048% ( 6600, 9900 ] 3 0.952% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 824.6500 StdDev: 1083.46 Min: 94 Median: 170.0000 Max: 3761 Percentiles: P50: 170.00 P75: 1085.00 P99: 3761.00 P99.9: 3761.00 P99.99: 3761.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 4 20.000% 50.000% #### ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 322.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.595 H:M:S, 9.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.391 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-00:34:31 ... thread 0: (1000000,3000000) ops and (327029.8,335883.7) ops/second in (3.057825,8.931662) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/16 2.15 GB 0.0 1.4 0.0 1.4 4.1 2.8 0.0 1.5 104.3 317.5 13.29 12.27 45 0.295 1407K 1551 0.0 0.0 L1 1/1 3.57 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.2 236.7 1.59 1.54 1 1.594 383K 645 0.0 0.0 L2 1/0 52.20 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 254.6 254.5 1.48 1.43 2 0.742 383K 206 0.0 0.0 L3 17/0 762.01 MB 0.8 1.2 0.2 0.9 1.2 0.2 0.5 4.7 244.7 244.2 4.83 4.47 2 2.416 1200K 2369 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 149.3 149.3 1.50 1.13 1 1.503 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/17 98.90 GB 0.0 3.5 1.0 2.4 6.2 3.8 2.3 2.3 156.3 281.0 22.70 20.85 51 0.445 3603K 4771 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 1.0 2.4 6.2 3.8 2.1 2.3 156.3 281.0 22.70 20.85 51 0.445 3603K 4771 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 1.0 2.4 3.5 1.0 0.0 0.0 241.5 241.2 14.69 13.76 11 1.336 3603K 4771 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 354.0 8.01 7.09 40 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.23 GB write, 696.53 MB/s write, 3.47 GB read, 387.51 MB/s read, 22.7 seconds Interval compaction: 6.23 GB write, 714.04 MB/s write, 3.47 GB read, 397.25 MB/s read, 22.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 672371 Average: 2.2775 StdDev: 13.73 Min: 0 Median: 1.5241 Max: 6189 Percentiles: P50: 1.52 P75: 1.91 P99: 5.78 P99.9: 10.70 P99.99: 16.16 ------------------------------------------------------ [ 0, 1 ] 106299 15.810% 15.810% ### ( 1, 2 ] 438597 65.231% 81.041% ############# ( 2, 3 ] 77032 11.457% 92.498% ## ( 3, 4 ] 25251 3.756% 96.253% # ( 4, 6 ] 20702 3.079% 99.332% # ( 6, 10 ] 3723 0.554% 99.886% ( 10, 15 ] 692 0.103% 99.989% ( 15, 22 ] 59 0.009% 99.998% ( 22, 34 ] 11 0.002% 99.999% ( 34, 51 ] 1 0.000% 99.999% ( 51, 76 ] 6 0.001% 100.000% ( 76, 110 ] 16 0.002% 100.003% ( 110, 170 ] 11 0.002% 100.004% ( 170, 250 ] 23 0.003% 100.008% ( 250, 380 ] 8 0.001% 100.009% ( 380, 580 ] 16 0.002% 100.011% ( 580, 870 ] 12 0.002% 100.013% ( 870, 1300 ] 11 0.002% 100.015% ( 1300, 1900 ] 5 0.001% 100.015% ( 1900, 2900 ] 3 0.000% 100.016% ( 2900, 4400 ] 3 0.000% 100.016% ( 4400, 6600 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 26 Average: 182.0000 StdDev: 327.03 Min: 1 Median: 1.7000 Max: 1120 Percentiles: P50: 1.70 P75: 210.00 P99: 1120.00 P99.9: 1120.00 P99.99: 1120.00 ------------------------------------------------------ [ 0, 1 ] 6 23.077% 23.077% ##### ( 1, 2 ] 10 38.462% 61.538% ######## ( 2, 3 ] 1 3.846% 65.385% # ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 1 3.846% 80.769% # ( 380, 580 ] 1 3.846% 84.615% # ( 580, 870 ] 2 7.692% 92.308% ## ( 870, 1300 ] 2 7.692% 100.000% ## ** Level 2 read latency histogram (micros): Count: 140289 Average: 2.4983 StdDev: 28.73 Min: 0 Median: 1.4611 Max: 7916 Percentiles: P50: 1.46 P75: 1.85 P99: 6.60 P99.9: 102.96 P99.99: 651.45 ------------------------------------------------------ [ 0, 1 ] 28078 20.014% 20.014% #### ( 1, 2 ] 91238 65.036% 85.050% ############# ( 2, 3 ] 11639 8.296% 93.347% ## ( 3, 4 ] 4536 3.233% 96.580% # ( 4, 6 ] 3208 2.287% 98.867% ( 6, 10 ] 1242 0.885% 99.752% ( 10, 15 ] 131 0.093% 99.845% ( 15, 22 ] 20 0.014% 99.860% ( 22, 34 ] 1 0.001% 99.860% ( 34, 51 ] 1 0.001% 99.861% ( 76, 110 ] 69 0.049% 99.910% ( 110, 170 ] 55 0.039% 99.949% ( 170, 250 ] 22 0.016% 99.965% ( 250, 380 ] 23 0.016% 99.981% ( 380, 580 ] 10 0.007% 99.989% ( 580, 870 ] 8 0.006% 99.994% ( 870, 1300 ] 2 0.001% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 248979 Average: 3.6926 StdDev: 60.79 Min: 0 Median: 1.6241 Max: 9439 Percentiles: P50: 1.62 P75: 2.08 P99: 8.86 P99.9: 191.15 P99.99: 692.30 ------------------------------------------------------ [ 0, 1 ] 26147 10.502% 10.502% ## ( 1, 2 ] 157563 63.284% 73.785% ############# ( 2, 3 ] 37230 14.953% 88.738% ### ( 3, 4 ] 11459 4.602% 93.341% # ( 4, 6 ] 11105 4.460% 97.801% # ( 6, 10 ] 4170 1.675% 99.476% ( 10, 15 ] 627 0.252% 99.728% ( 15, 22 ] 42 0.017% 99.745% ( 22, 34 ] 4 0.002% 99.746% ( 34, 51 ] 1 0.000% 99.747% ( 51, 76 ] 6 0.002% 99.749% ( 76, 110 ] 84 0.034% 99.783% ( 110, 170 ] 264 0.106% 99.889% ( 170, 250 ] 106 0.043% 99.931% ( 250, 380 ] 76 0.031% 99.962% ( 380, 580 ] 55 0.022% 99.984% ( 580, 870 ] 39 0.016% 100.000% ( 870, 1300 ] 22 0.009% 100.008% ( 1300, 1900 ] 8 0.003% 100.012% ( 1900, 2900 ] 9 0.004% 100.015% ( 2900, 4400 ] 6 0.002% 100.018% ( 4400, 6600 ] 3 0.001% 100.019% ( 6600, 9900 ] 11 0.004% 100.023% ** Level 4 read latency histogram (micros): Count: 315 Average: 260.4921 StdDev: 1107.28 Min: 1 Median: 2.8125 Max: 7317 Percentiles: P50: 2.81 P75: 8.33 P99: 6545.00 P99.9: 7317.00 P99.99: 7317.00 ------------------------------------------------------ [ 0, 1 ] 18 5.714% 5.714% # ( 1, 2 ] 81 25.714% 31.429% ##### ( 2, 3 ] 72 22.857% 54.286% ##### ( 3, 4 ] 36 11.429% 65.714% ## ( 4, 6 ] 24 7.619% 73.333% ## ( 6, 10 ] 9 2.857% 76.190% # ( 10, 15 ] 7 2.222% 78.413% ( 15, 22 ] 26 8.254% 86.667% ## ( 22, 34 ] 10 3.175% 89.841% # ( 76, 110 ] 2 0.635% 90.476% ( 110, 170 ] 1 0.317% 90.794% ( 170, 250 ] 1 0.317% 91.111% ( 250, 380 ] 5 1.587% 92.698% ( 380, 580 ] 2 0.635% 93.333% ( 580, 870 ] 4 1.270% 94.603% ( 870, 1300 ] 1 0.317% 94.921% ( 1300, 1900 ] 2 0.635% 95.556% ( 1900, 2900 ] 2 0.635% 96.190% ( 2900, 4400 ] 3 0.952% 97.143% ( 4400, 6600 ] 6 1.905% 99.048% ( 6600, 9900 ] 3 0.952% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 893.0750 StdDev: 1118.21 Min: 94 Median: 293.3333 Max: 3923 Percentiles: P50: 293.33 P75: 1300.00 P99: 3923.00 P99.9: 3923.00 P99.99: 3923.00 ------------------------------------------------------ ( 76, 110 ] 7 17.500% 17.500% #### ( 110, 170 ] 8 20.000% 37.500% #### ( 170, 250 ] 4 10.000% 47.500% ## ( 250, 380 ] 3 7.500% 55.000% ## ( 380, 580 ] 3 7.500% 62.500% ## ( 580, 870 ] 3 7.500% 70.000% ## ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 5 12.500% 90.000% ### ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.000 H:M:S, 10.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/16-00:34:34 ... thread 0: (1000000,4000000) ops and (328455.5,333995.4) ops/second in (3.044552,11.976214) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 3.07 GB 119.6 2.5 0.0 2.5 6.1 3.7 0.0 1.7 123.7 309.1 20.37 18.93 62 0.329 2558K 2782 0.0 0.0 L1 1/1 3.57 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.2 236.7 1.59 1.54 1 1.594 383K 645 0.0 0.0 L2 1/0 52.20 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 254.6 254.5 1.48 1.43 2 0.742 383K 206 0.0 0.0 L3 17/0 762.01 MB 0.8 1.2 0.2 0.9 1.2 0.2 0.5 4.7 244.7 244.2 4.83 4.47 2 2.416 1200K 2369 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 149.3 149.3 1.50 1.13 1 1.503 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/13 99.82 GB 0.0 4.6 1.0 3.6 8.3 4.7 2.3 2.2 157.2 283.9 29.78 27.51 68 0.438 4755K 6002 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 1.0 3.6 8.3 4.7 2.1 2.2 157.2 283.9 29.78 27.51 68 0.438 4755K 6002 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 1.0 3.6 4.6 1.0 0.0 0.0 245.7 245.4 19.06 18.02 15 1.271 4755K 6002 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 352.4 10.73 9.49 53 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.26 GB write, 693.00 MB/s write, 4.57 GB read, 383.75 MB/s read, 29.8 seconds Interval compaction: 8.26 GB write, 706.00 MB/s write, 4.57 GB read, 390.95 MB/s read, 29.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1097843 Average: 2.2791 StdDev: 11.88 Min: 0 Median: 1.5384 Max: 6189 Percentiles: P50: 1.54 P75: 1.92 P99: 5.78 P99.9: 9.98 P99.99: 14.43 ------------------------------------------------------ [ 0, 1 ] 157789 14.373% 14.373% ### ( 1, 2 ] 726476 66.173% 80.546% ############# ( 2, 3 ] 132439 12.064% 92.609% ## ( 3, 4 ] 41001 3.735% 96.344% # ( 4, 6 ] 32755 2.984% 99.327% # ( 6, 10 ] 6320 0.576% 99.903% ( 10, 15 ] 1075 0.098% 100.001% ( 15, 22 ] 86 0.008% 100.009% ( 22, 34 ] 11 0.001% 100.010% ( 34, 51 ] 5 0.000% 100.010% ( 51, 76 ] 8 0.001% 100.011% ( 76, 110 ] 26 0.002% 100.013% ( 110, 170 ] 22 0.002% 100.015% ( 170, 250 ] 33 0.003% 100.018% ( 250, 380 ] 12 0.001% 100.020% ( 380, 580 ] 25 0.002% 100.022% ( 580, 870 ] 19 0.002% 100.024% ( 870, 1300 ] 15 0.001% 100.025% ( 1300, 1900 ] 8 0.001% 100.026% ( 1900, 2900 ] 3 0.000% 100.026% ( 2900, 4400 ] 4 0.000% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 26 Average: 182.0000 StdDev: 327.03 Min: 1 Median: 1.7000 Max: 1120 Percentiles: P50: 1.70 P75: 210.00 P99: 1120.00 P99.9: 1120.00 P99.99: 1120.00 ------------------------------------------------------ [ 0, 1 ] 6 23.077% 23.077% ##### ( 1, 2 ] 10 38.462% 61.538% ######## ( 2, 3 ] 1 3.846% 65.385% # ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 1 3.846% 80.769% # ( 380, 580 ] 1 3.846% 84.615% # ( 580, 870 ] 2 7.692% 92.308% ## ( 870, 1300 ] 2 7.692% 100.000% ## ** Level 2 read latency histogram (micros): Count: 140289 Average: 2.4983 StdDev: 28.73 Min: 0 Median: 1.4611 Max: 7916 Percentiles: P50: 1.46 P75: 1.85 P99: 6.60 P99.9: 102.96 P99.99: 651.45 ------------------------------------------------------ [ 0, 1 ] 28078 20.014% 20.014% #### ( 1, 2 ] 91238 65.036% 85.050% ############# ( 2, 3 ] 11639 8.296% 93.347% ## ( 3, 4 ] 4536 3.233% 96.580% # ( 4, 6 ] 3208 2.287% 98.867% ( 6, 10 ] 1242 0.885% 99.752% ( 10, 15 ] 131 0.093% 99.845% ( 15, 22 ] 20 0.014% 99.860% ( 22, 34 ] 1 0.001% 99.860% ( 34, 51 ] 1 0.001% 99.861% ( 76, 110 ] 69 0.049% 99.910% ( 110, 170 ] 55 0.039% 99.949% ( 170, 250 ] 22 0.016% 99.965% ( 250, 380 ] 23 0.016% 99.981% ( 380, 580 ] 10 0.007% 99.989% ( 580, 870 ] 8 0.006% 99.994% ( 870, 1300 ] 2 0.001% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 248979 Average: 3.6926 StdDev: 60.79 Min: 0 Median: 1.6241 Max: 9439 Percentiles: P50: 1.62 P75: 2.08 P99: 8.86 P99.9: 191.15 P99.99: 692.30 ------------------------------------------------------ [ 0, 1 ] 26147 10.502% 10.502% ## ( 1, 2 ] 157563 63.284% 73.785% ############# ( 2, 3 ] 37230 14.953% 88.738% ### ( 3, 4 ] 11459 4.602% 93.341% # ( 4, 6 ] 11105 4.460% 97.801% # ( 6, 10 ] 4170 1.675% 99.476% ( 10, 15 ] 627 0.252% 99.728% ( 15, 22 ] 42 0.017% 99.745% ( 22, 34 ] 4 0.002% 99.746% ( 34, 51 ] 1 0.000% 99.747% ( 51, 76 ] 6 0.002% 99.749% ( 76, 110 ] 84 0.034% 99.783% ( 110, 170 ] 264 0.106% 99.889% ( 170, 250 ] 106 0.043% 99.931% ( 250, 380 ] 76 0.031% 99.962% ( 380, 580 ] 55 0.022% 99.984% ( 580, 870 ] 39 0.016% 100.000% ( 870, 1300 ] 22 0.009% 100.008% ( 1300, 1900 ] 8 0.003% 100.012% ( 1900, 2900 ] 9 0.004% 100.015% ( 2900, 4400 ] 6 0.002% 100.018% ( 4400, 6600 ] 3 0.001% 100.019% ( 6600, 9900 ] 11 0.004% 100.023% ** Level 4 read latency histogram (micros): Count: 315 Average: 260.4921 StdDev: 1107.28 Min: 1 Median: 2.8125 Max: 7317 Percentiles: P50: 2.81 P75: 8.33 P99: 6545.00 P99.9: 7317.00 P99.99: 7317.00 ------------------------------------------------------ [ 0, 1 ] 18 5.714% 5.714% # ( 1, 2 ] 81 25.714% 31.429% ##### ( 2, 3 ] 72 22.857% 54.286% ##### ( 3, 4 ] 36 11.429% 65.714% ## ( 4, 6 ] 24 7.619% 73.333% ## ( 6, 10 ] 9 2.857% 76.190% # ( 10, 15 ] 7 2.222% 78.413% ( 15, 22 ] 26 8.254% 86.667% ## ( 22, 34 ] 10 3.175% 89.841% # ( 76, 110 ] 2 0.635% 90.476% ( 110, 170 ] 1 0.317% 90.794% ( 170, 250 ] 1 0.317% 91.111% ( 250, 380 ] 5 1.587% 92.698% ( 380, 580 ] 2 0.635% 93.333% ( 580, 870 ] 4 1.270% 94.603% ( 870, 1300 ] 1 0.317% 94.921% ( 1300, 1900 ] 2 0.635% 95.556% ( 1900, 2900 ] 2 0.635% 96.190% ( 2900, 4400 ] 3 0.952% 97.143% ( 4400, 6600 ] 6 1.905% 99.048% ( 6600, 9900 ] 3 0.952% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 893.0750 StdDev: 1118.21 Min: 94 Median: 293.3333 Max: 3923 Percentiles: P50: 293.33 P75: 1300.00 P99: 3923.00 P99.9: 3923.00 P99.99: 3923.00 ------------------------------------------------------ ( 76, 110 ] 7 17.500% 17.500% #### ( 110, 170 ] 8 20.000% 37.500% #### ( 170, 250 ] 4 10.000% 47.500% ## ( 250, 380 ] 3 7.500% 55.000% ## ( 380, 580 ] 3 7.500% 62.500% ## ( 580, 870 ] 3 7.500% 70.000% ## ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 5 12.500% 90.000% ### ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 322.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.384 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.384 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-00:34:37 ... thread 0: (1000000,5000000) ops and (278939.7,321311.6) ops/second in (3.585004,15.561218) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.46 GB 6.3 3.3 0.0 3.3 7.9 4.7 0.0 1.7 127.2 309.4 26.25 24.46 80 0.328 3390K 3613 0.0 0.0 L1 14/14 1.59 GB 0.0 2.0 2.0 0.0 2.0 2.0 0.2 1.0 231.1 229.7 8.73 8.48 2 4.366 2048K 12K 0.0 0.0 L2 1/0 52.20 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 254.6 254.5 1.48 1.43 2 0.742 383K 206 0.0 0.0 L3 17/0 762.01 MB 0.8 1.2 0.2 0.9 1.2 0.2 0.5 4.7 244.7 244.2 4.83 4.47 2 2.416 1200K 2369 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 149.3 149.3 1.50 1.13 1 1.503 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/28 100.79 GB 0.0 7.0 2.6 4.4 11.6 7.3 2.3 2.5 166.8 278.3 42.80 39.97 87 0.492 7251K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.0 2.6 4.4 11.6 7.3 2.1 2.5 166.8 278.3 42.80 39.97 87 0.492 7251K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.0 2.6 4.4 7.0 2.6 0.0 0.0 243.7 243.1 29.30 28.00 19 1.542 7251K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.6 13.50 11.97 68 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.6 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.63 GB write, 754.42 MB/s write, 6.97 GB read, 452.35 MB/s read, 42.8 seconds Interval compaction: 11.63 GB write, 765.31 MB/s write, 6.97 GB read, 458.88 MB/s read, 42.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 16, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1466730 Average: 2.2951 StdDev: 11.78 Min: 0 Median: 1.5304 Max: 6189 Percentiles: P50: 1.53 P75: 1.91 P99: 5.81 P99.9: 10.48 P99.99: 20.14 ------------------------------------------------------ [ 0, 1 ] 215059 14.662% 14.662% ### ( 1, 2 ] 977248 66.628% 81.290% ############# ( 2, 3 ] 170377 11.616% 92.906% ## ( 3, 4 ] 52366 3.570% 96.477% # ( 4, 6 ] 40966 2.793% 99.270% # ( 6, 10 ] 9115 0.621% 99.891% ( 10, 15 ] 1373 0.094% 99.985% ( 15, 22 ] 108 0.007% 99.992% ( 22, 34 ] 16 0.001% 99.993% ( 34, 51 ] 8 0.001% 99.994% ( 51, 76 ] 11 0.001% 99.994% ( 76, 110 ] 113 0.008% 100.002% ( 110, 170 ] 137 0.009% 100.011% ( 170, 250 ] 66 0.004% 100.016% ( 250, 380 ] 40 0.003% 100.019% ( 380, 580 ] 49 0.003% 100.022% ( 580, 870 ] 35 0.002% 100.024% ( 870, 1300 ] 19 0.001% 100.026% ( 1300, 1900 ] 10 0.001% 100.026% ( 1900, 2900 ] 5 0.000% 100.027% ( 2900, 4400 ] 5 0.000% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 21657 Average: 4.4483 StdDev: 44.77 Min: 0 Median: 1.4084 Max: 2437 Percentiles: P50: 1.41 P75: 1.79 P99: 9.75 P99.9: 628.68 P99.99: 1880.12 ------------------------------------------------------ [ 0, 1 ] 4989 23.036% 23.036% ##### ( 1, 2 ] 14299 66.025% 89.061% ############# ( 2, 3 ] 1231 5.684% 94.745% # ( 3, 4 ] 384 1.773% 96.518% ( 4, 6 ] 215 0.993% 97.511% ( 6, 10 ] 344 1.588% 99.100% ( 10, 15 ] 24 0.111% 99.210% ( 15, 22 ] 1 0.005% 99.215% ( 22, 34 ] 2 0.009% 99.224% ( 51, 76 ] 1 0.005% 99.229% ( 76, 110 ] 45 0.208% 99.437% ( 110, 170 ] 60 0.277% 99.714% ( 170, 250 ] 7 0.032% 99.746% ( 250, 380 ] 12 0.055% 99.801% ( 380, 580 ] 20 0.092% 99.894% ( 580, 870 ] 8 0.037% 99.931% ( 870, 1300 ] 8 0.037% 99.968% ( 1300, 1900 ] 5 0.023% 99.991% ( 1900, 2900 ] 2 0.009% 100.000% ** Level 2 read latency histogram (micros): Count: 140289 Average: 2.4983 StdDev: 28.73 Min: 0 Median: 1.4611 Max: 7916 Percentiles: P50: 1.46 P75: 1.85 P99: 6.60 P99.9: 102.96 P99.99: 651.45 ------------------------------------------------------ [ 0, 1 ] 28078 20.014% 20.014% #### ( 1, 2 ] 91238 65.036% 85.050% ############# ( 2, 3 ] 11639 8.296% 93.347% ## ( 3, 4 ] 4536 3.233% 96.580% # ( 4, 6 ] 3208 2.287% 98.867% ( 6, 10 ] 1242 0.885% 99.752% ( 10, 15 ] 131 0.093% 99.845% ( 15, 22 ] 20 0.014% 99.860% ( 22, 34 ] 1 0.001% 99.860% ( 34, 51 ] 1 0.001% 99.861% ( 76, 110 ] 69 0.049% 99.910% ( 110, 170 ] 55 0.039% 99.949% ( 170, 250 ] 22 0.016% 99.965% ( 250, 380 ] 23 0.016% 99.981% ( 380, 580 ] 10 0.007% 99.989% ( 580, 870 ] 8 0.006% 99.994% ( 870, 1300 ] 2 0.001% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 248979 Average: 3.6926 StdDev: 60.79 Min: 0 Median: 1.6241 Max: 9439 Percentiles: P50: 1.62 P75: 2.08 P99: 8.86 P99.9: 191.15 P99.99: 692.30 ------------------------------------------------------ [ 0, 1 ] 26147 10.502% 10.502% ## ( 1, 2 ] 157563 63.284% 73.785% ############# ( 2, 3 ] 37230 14.953% 88.738% ### ( 3, 4 ] 11459 4.602% 93.341% # ( 4, 6 ] 11105 4.460% 97.801% # ( 6, 10 ] 4170 1.675% 99.476% ( 10, 15 ] 627 0.252% 99.728% ( 15, 22 ] 42 0.017% 99.745% ( 22, 34 ] 4 0.002% 99.746% ( 34, 51 ] 1 0.000% 99.747% ( 51, 76 ] 6 0.002% 99.749% ( 76, 110 ] 84 0.034% 99.783% ( 110, 170 ] 264 0.106% 99.889% ( 170, 250 ] 106 0.043% 99.931% ( 250, 380 ] 76 0.031% 99.962% ( 380, 580 ] 55 0.022% 99.984% ( 580, 870 ] 39 0.016% 100.000% ( 870, 1300 ] 22 0.009% 100.008% ( 1300, 1900 ] 8 0.003% 100.012% ( 1900, 2900 ] 9 0.004% 100.015% ( 2900, 4400 ] 6 0.002% 100.018% ( 4400, 6600 ] 3 0.001% 100.019% ( 6600, 9900 ] 11 0.004% 100.023% ** Level 4 read latency histogram (micros): Count: 315 Average: 260.4921 StdDev: 1107.28 Min: 1 Median: 2.8125 Max: 7317 Percentiles: P50: 2.81 P75: 8.33 P99: 6545.00 P99.9: 7317.00 P99.99: 7317.00 ------------------------------------------------------ [ 0, 1 ] 18 5.714% 5.714% # ( 1, 2 ] 81 25.714% 31.429% ##### ( 2, 3 ] 72 22.857% 54.286% ##### ( 3, 4 ] 36 11.429% 65.714% ## ( 4, 6 ] 24 7.619% 73.333% ## ( 6, 10 ] 9 2.857% 76.190% # ( 10, 15 ] 7 2.222% 78.413% ( 15, 22 ] 26 8.254% 86.667% ## ( 22, 34 ] 10 3.175% 89.841% # ( 76, 110 ] 2 0.635% 90.476% ( 110, 170 ] 1 0.317% 90.794% ( 170, 250 ] 1 0.317% 91.111% ( 250, 380 ] 5 1.587% 92.698% ( 380, 580 ] 2 0.635% 93.333% ( 580, 870 ] 4 1.270% 94.603% ( 870, 1300 ] 1 0.317% 94.921% ( 1300, 1900 ] 2 0.635% 95.556% ( 1900, 2900 ] 2 0.635% 96.190% ( 2900, 4400 ] 3 0.952% 97.143% ( 4400, 6600 ] 6 1.905% 99.048% ( 6600, 9900 ] 3 0.952% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 893.0750 StdDev: 1118.21 Min: 94 Median: 293.3333 Max: 3923 Percentiles: P50: 293.33 P75: 1300.00 P99: 3923.00 P99.9: 3923.00 P99.99: 3923.00 ------------------------------------------------------ ( 76, 110 ] 7 17.500% 17.500% #### ( 110, 170 ] 8 20.000% 37.500% #### ( 170, 250 ] 4 10.000% 47.500% ## ( 250, 380 ] 3 7.500% 55.000% ## ( 380, 580 ] 3 7.500% 62.500% ## ( 580, 870 ] 3 7.500% 70.000% ## ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 5 12.500% 90.000% ### ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 15.8 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 311.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.307 H:M:S, 14.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.924 H:M:S, 25.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-00:34:41 ... thread 0: (1000000,6000000) ops and (279429.9,313480.7) ops/second in (3.578715,19.139933) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.44 GB 107.0 4.3 0.0 4.3 10.0 5.7 0.0 1.8 133.0 307.7 33.15 30.95 99 0.335 4477K 4681 0.0 0.0 L1 14/14 1.59 GB 0.0 2.0 2.0 0.0 2.0 2.0 0.2 1.0 231.1 229.7 8.73 8.48 2 4.366 2048K 12K 0.0 0.0 L2 1/0 52.20 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 254.6 254.5 1.48 1.43 2 0.742 383K 206 0.0 0.0 L3 17/0 762.01 MB 0.8 1.2 0.2 0.9 1.2 0.2 0.5 4.7 244.7 244.2 4.83 4.47 2 2.416 1200K 2369 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 149.3 149.3 1.50 1.13 1 1.503 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/28 101.78 GB 0.0 8.0 2.6 5.4 13.7 8.3 2.3 2.4 165.2 281.4 49.71 46.46 106 0.469 8339K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.0 2.6 5.4 13.7 8.3 2.1 2.4 165.2 281.4 49.71 46.46 106 0.469 8339K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.0 2.6 5.4 8.0 2.6 0.0 0.0 245.9 245.3 33.40 32.03 23 1.452 8339K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 355.4 16.31 14.43 83 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.4 total, 19.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.66 GB write, 722.29 MB/s write, 8.02 GB read, 424.06 MB/s read, 49.7 seconds Interval compaction: 13.66 GB write, 730.77 MB/s write, 8.02 GB read, 429.04 MB/s read, 49.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 18, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1864380 Average: 2.3053 StdDev: 11.63 Min: 0 Median: 1.5338 Max: 6189 Percentiles: P50: 1.53 P75: 1.91 P99: 5.80 P99.9: 10.58 P99.99: 29.28 ------------------------------------------------------ [ 0, 1 ] 265991 14.267% 14.267% ### ( 1, 2 ] 1248021 66.940% 81.207% ############# ( 2, 3 ] 219193 11.757% 92.964% ## ( 3, 4 ] 66221 3.552% 96.516% # ( 4, 6 ] 51371 2.755% 99.271% # ( 6, 10 ] 11519 0.618% 99.889% ( 10, 15 ] 1726 0.093% 99.982% ( 15, 22 ] 137 0.007% 99.989% ( 22, 34 ] 24 0.001% 99.991% ( 34, 51 ] 10 0.001% 99.991% ( 51, 76 ] 17 0.001% 99.992% ( 76, 110 ] 141 0.008% 100.000% ( 110, 170 ] 191 0.010% 100.010% ( 170, 250 ] 102 0.005% 100.015% ( 250, 380 ] 59 0.003% 100.018% ( 380, 580 ] 69 0.004% 100.022% ( 580, 870 ] 52 0.003% 100.025% ( 870, 1300 ] 26 0.001% 100.026% ( 1300, 1900 ] 11 0.001% 100.027% ( 1900, 2900 ] 5 0.000% 100.027% ( 2900, 4400 ] 7 0.000% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 106814 Average: 3.0447 StdDev: 21.98 Min: 0 Median: 1.5564 Max: 2437 Percentiles: P50: 1.56 P75: 1.92 P99: 8.80 P99.9: 167.47 P99.99: 1124.11 ------------------------------------------------------ [ 0, 1 ] 12888 12.066% 12.066% ## ( 1, 2 ] 72819 68.174% 80.239% ############## ( 2, 3 ] 13049 12.217% 92.456% ## ( 3, 4 ] 3134 2.934% 95.390% # ( 4, 6 ] 2568 2.404% 97.794% ( 6, 10 ] 1839 1.722% 99.516% ( 10, 15 ] 147 0.138% 99.654% ( 15, 22 ] 8 0.007% 99.661% ( 22, 34 ] 3 0.003% 99.664% ( 51, 76 ] 1 0.001% 99.665% ( 76, 110 ] 143 0.134% 99.799% ( 110, 170 ] 114 0.107% 99.905% ( 170, 250 ] 20 0.019% 99.924% ( 250, 380 ] 25 0.023% 99.948% ( 380, 580 ] 31 0.029% 99.977% ( 580, 870 ] 10 0.009% 99.986% ( 870, 1300 ] 9 0.008% 99.994% ( 1300, 1900 ] 5 0.005% 99.999% ( 1900, 2900 ] 2 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 140289 Average: 2.4983 StdDev: 28.73 Min: 0 Median: 1.4611 Max: 7916 Percentiles: P50: 1.46 P75: 1.85 P99: 6.60 P99.9: 102.96 P99.99: 651.45 ------------------------------------------------------ [ 0, 1 ] 28078 20.014% 20.014% #### ( 1, 2 ] 91238 65.036% 85.050% ############# ( 2, 3 ] 11639 8.296% 93.347% ## ( 3, 4 ] 4536 3.233% 96.580% # ( 4, 6 ] 3208 2.287% 98.867% ( 6, 10 ] 1242 0.885% 99.752% ( 10, 15 ] 131 0.093% 99.845% ( 15, 22 ] 20 0.014% 99.860% ( 22, 34 ] 1 0.001% 99.860% ( 34, 51 ] 1 0.001% 99.861% ( 76, 110 ] 69 0.049% 99.910% ( 110, 170 ] 55 0.039% 99.949% ( 170, 250 ] 22 0.016% 99.965% ( 250, 380 ] 23 0.016% 99.981% ( 380, 580 ] 10 0.007% 99.989% ( 580, 870 ] 8 0.006% 99.994% ( 870, 1300 ] 2 0.001% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 248979 Average: 3.6926 StdDev: 60.79 Min: 0 Median: 1.6241 Max: 9439 Percentiles: P50: 1.62 P75: 2.08 P99: 8.86 P99.9: 191.15 P99.99: 692.30 ------------------------------------------------------ [ 0, 1 ] 26147 10.502% 10.502% ## ( 1, 2 ] 157563 63.284% 73.785% ############# ( 2, 3 ] 37230 14.953% 88.738% ### ( 3, 4 ] 11459 4.602% 93.341% # ( 4, 6 ] 11105 4.460% 97.801% # ( 6, 10 ] 4170 1.675% 99.476% ( 10, 15 ] 627 0.252% 99.728% ( 15, 22 ] 42 0.017% 99.745% ( 22, 34 ] 4 0.002% 99.746% ( 34, 51 ] 1 0.000% 99.747% ( 51, 76 ] 6 0.002% 99.749% ( 76, 110 ] 84 0.034% 99.783% ( 110, 170 ] 264 0.106% 99.889% ( 170, 250 ] 106 0.043% 99.931% ( 250, 380 ] 76 0.031% 99.962% ( 380, 580 ] 55 0.022% 99.984% ( 580, 870 ] 39 0.016% 100.000% ( 870, 1300 ] 22 0.009% 100.008% ( 1300, 1900 ] 8 0.003% 100.012% ( 1900, 2900 ] 9 0.004% 100.015% ( 2900, 4400 ] 6 0.002% 100.018% ( 4400, 6600 ] 3 0.001% 100.019% ( 6600, 9900 ] 11 0.004% 100.023% ** Level 4 read latency histogram (micros): Count: 315 Average: 260.4921 StdDev: 1107.28 Min: 1 Median: 2.8125 Max: 7317 Percentiles: P50: 2.81 P75: 8.33 P99: 6545.00 P99.9: 7317.00 P99.99: 7317.00 ------------------------------------------------------ [ 0, 1 ] 18 5.714% 5.714% # ( 1, 2 ] 81 25.714% 31.429% ##### ( 2, 3 ] 72 22.857% 54.286% ##### ( 3, 4 ] 36 11.429% 65.714% ## ( 4, 6 ] 24 7.619% 73.333% ## ( 6, 10 ] 9 2.857% 76.190% # ( 10, 15 ] 7 2.222% 78.413% ( 15, 22 ] 26 8.254% 86.667% ## ( 22, 34 ] 10 3.175% 89.841% # ( 76, 110 ] 2 0.635% 90.476% ( 110, 170 ] 1 0.317% 90.794% ( 170, 250 ] 1 0.317% 91.111% ( 250, 380 ] 5 1.587% 92.698% ( 380, 580 ] 2 0.635% 93.333% ( 580, 870 ] 4 1.270% 94.603% ( 870, 1300 ] 1 0.317% 94.921% ( 1300, 1900 ] 2 0.635% 95.556% ( 1900, 2900 ] 2 0.635% 96.190% ( 2900, 4400 ] 3 0.952% 97.143% ( 4400, 6600 ] 6 1.905% 99.048% ( 6600, 9900 ] 3 0.952% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 893.0750 StdDev: 1118.21 Min: 94 Median: 293.3333 Max: 3923 Percentiles: P50: 293.33 P75: 1300.00 P99: 3923.00 P99.9: 3923.00 P99.99: 3923.00 ------------------------------------------------------ ( 76, 110 ] 7 17.500% 17.500% #### ( 110, 170 ] 8 20.000% 37.500% #### ( 170, 250 ] 4 10.000% 47.500% ## ( 250, 380 ] 3 7.500% 55.000% ## ( 380, 580 ] 3 7.500% 62.500% ## ( 580, 870 ] 3 7.500% 70.000% ## ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 1 2.500% 77.500% # ( 1900, 2900 ] 5 12.500% 90.000% ### ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 19.4 total, 3.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 304.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.177 H:M:S, 16.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 275.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.869 H:M:S, 24.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-00:34:57 ... thread 0: (1000000,7000000) ops and (63210.1,200227.7) ops/second in (15.820257,34.960190) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.21 GB 25.2 5.0 0.0 5.0 11.6 6.6 0.0 1.8 132.9 306.2 38.87 36.24 117 0.332 5245K 5416 0.0 0.0 L1 14/14 1.67 GB 0.0 5.7 4.1 1.6 5.6 4.0 0.2 1.4 226.5 223.8 25.82 24.46 3 8.607 5939K 70K 0.0 0.0 L2 8/6 1.01 GB 2.6 0.4 0.2 0.2 0.4 0.2 2.4 2.0 254.6 254.5 1.48 1.43 2 0.742 383K 206 0.0 0.0 L3 30/9 1.39 GB 1.0 2.6 1.3 1.2 2.5 1.3 0.5 2.0 221.9 221.4 11.77 10.82 6 1.961 2652K 6484 0.0 0.0 L4 177/4 9.74 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.9 1.0 149.3 149.3 1.50 1.13 1 1.503 227K 0 0.0 0.0 L5 1052/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/46 102.64 GB 0.0 13.9 5.8 8.1 20.4 12.3 5.1 3.1 179.1 262.9 79.44 74.09 129 0.616 14M 82K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 5.8 8.1 20.4 12.3 4.9 3.1 179.1 262.9 79.44 74.09 129 0.616 14M 82K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 5.8 8.1 13.8 5.7 0.0 0.0 235.7 234.3 60.37 57.26 31 1.947 14M 82K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 353.4 19.07 16.83 98 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.2 total, 35.0 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.40 GB write, 593.57 MB/s write, 13.89 GB read, 404.36 MB/s read, 79.4 seconds Interval compaction: 20.40 GB write, 597.38 MB/s write, 13.89 GB read, 406.96 MB/s read, 79.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 18, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2610318 Average: 2.5514 StdDev: 14.55 Min: 0 Median: 1.5186 Max: 6189 Percentiles: P50: 1.52 P75: 1.90 P99: 6.34 P99.9: 105.79 P99.99: 262.78 ------------------------------------------------------ [ 0, 1 ] 411439 15.762% 15.762% ### ( 1, 2 ] 1723303 66.019% 81.781% ############# ( 2, 3 ] 283775 10.871% 92.652% ## ( 3, 4 ] 90764 3.477% 96.129% # ( 4, 6 ] 73208 2.805% 98.934% # ( 6, 10 ] 20552 0.787% 99.721% ( 10, 15 ] 2666 0.102% 99.823% ( 15, 22 ] 356 0.014% 99.837% ( 22, 34 ] 35 0.001% 99.838% ( 34, 51 ] 11 0.000% 99.839% ( 51, 76 ] 20 0.001% 99.840% ( 76, 110 ] 1805 0.069% 99.909% ( 110, 170 ] 1676 0.064% 99.973% ( 170, 250 ] 419 0.016% 99.989% ( 250, 380 ] 315 0.012% 100.001% ( 380, 580 ] 320 0.012% 100.013% ( 580, 870 ] 168 0.006% 100.020% ( 870, 1300 ] 58 0.002% 100.022% ( 1300, 1900 ] 20 0.001% 100.023% ( 1900, 2900 ] 7 0.000% 100.023% ( 2900, 4400 ] 10 0.000% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 806058 Average: 3.1237 StdDev: 25.95 Min: 0 Median: 1.5802 Max: 6465 Percentiles: P50: 1.58 P75: 1.99 P99: 8.87 P99.9: 142.39 P99.99: 317.32 ------------------------------------------------------ [ 0, 1 ] 119661 14.845% 14.845% ### ( 1, 2 ] 488434 60.595% 75.441% ############ ( 2, 3 ] 110637 13.726% 89.166% ### ( 3, 4 ] 34872 4.326% 93.493% # ( 4, 6 ] 35000 4.342% 97.835% # ( 6, 10 ] 13100 1.625% 99.460% ( 10, 15 ] 1756 0.218% 99.678% ( 15, 22 ] 312 0.039% 99.716% ( 22, 34 ] 19 0.002% 99.719% ( 34, 51 ] 5 0.001% 99.719% ( 51, 76 ] 10 0.001% 99.721% ( 76, 110 ] 1013 0.126% 99.846% ( 110, 170 ] 802 0.099% 99.946% ( 170, 250 ] 258 0.032% 99.978% ( 250, 380 ] 190 0.024% 100.001% ( 380, 580 ] 176 0.022% 100.023% ( 580, 870 ] 88 0.011% 100.034% ( 870, 1300 ] 58 0.007% 100.041% ( 1300, 1900 ] 20 0.002% 100.044% ( 1900, 2900 ] 11 0.001% 100.045% ( 2900, 4400 ] 9 0.001% 100.046% ( 4400, 6600 ] 4 0.000% 100.047% ** Level 2 read latency histogram (micros): Count: 140289 Average: 2.4983 StdDev: 28.73 Min: 0 Median: 1.4611 Max: 7916 Percentiles: P50: 1.46 P75: 1.85 P99: 6.60 P99.9: 102.96 P99.99: 651.45 ------------------------------------------------------ [ 0, 1 ] 28078 20.014% 20.014% #### ( 1, 2 ] 91238 65.036% 85.050% ############# ( 2, 3 ] 11639 8.296% 93.347% ## ( 3, 4 ] 4536 3.233% 96.580% # ( 4, 6 ] 3208 2.287% 98.867% ( 6, 10 ] 1242 0.885% 99.752% ( 10, 15 ] 131 0.093% 99.845% ( 15, 22 ] 20 0.014% 99.860% ( 22, 34 ] 1 0.001% 99.860% ( 34, 51 ] 1 0.001% 99.861% ( 76, 110 ] 69 0.049% 99.910% ( 110, 170 ] 55 0.039% 99.949% ( 170, 250 ] 22 0.016% 99.965% ( 250, 380 ] 23 0.016% 99.981% ( 380, 580 ] 10 0.007% 99.989% ( 580, 870 ] 8 0.006% 99.994% ( 870, 1300 ] 2 0.001% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 291478 Average: 4.2118 StdDev: 59.97 Min: 0 Median: 1.6573 Max: 9439 Percentiles: P50: 1.66 P75: 2.24 P99: 9.22 P99.9: 341.76 P99.99: 785.85 ------------------------------------------------------ [ 0, 1 ] 27413 9.405% 9.405% ## ( 1, 2 ] 180017 61.760% 71.165% ############ ( 2, 3 ] 47156 16.178% 87.343% ### ( 3, 4 ] 15003 5.147% 92.490% # ( 4, 6 ] 14951 5.129% 97.620% # ( 6, 10 ] 4994 1.713% 99.333% ( 10, 15 ] 766 0.263% 99.596% ( 15, 22 ] 65 0.022% 99.618% ( 22, 34 ] 8 0.003% 99.621% ( 34, 51 ] 6 0.002% 99.623% ( 51, 76 ] 6 0.002% 99.625% ( 76, 110 ] 118 0.040% 99.665% ( 110, 170 ] 343 0.118% 99.783% ( 170, 250 ] 218 0.075% 99.858% ( 250, 380 ] 175 0.060% 99.918% ( 380, 580 ] 142 0.049% 99.967% ( 580, 870 ] 97 0.033% 100.000% ( 870, 1300 ] 46 0.016% 100.016% ( 1300, 1900 ] 11 0.004% 100.020% ( 1900, 2900 ] 10 0.003% 100.023% ( 2900, 4400 ] 8 0.003% 100.026% ( 4400, 6600 ] 3 0.001% 100.027% ( 6600, 9900 ] 11 0.004% 100.031% ** Level 4 read latency histogram (micros): Count: 913 Average: 348.4502 StdDev: 900.46 Min: 1 Median: 3.4244 Max: 7317 Percentiles: P50: 3.42 P75: 287.92 P99: 5101.56 P99.9: 7317.00 P99.99: 7317.00 ------------------------------------------------------ [ 0, 1 ] 27 2.957% 2.957% # ( 1, 2 ] 238 26.068% 29.025% ##### ( 2, 3 ] 155 16.977% 46.002% ### ( 3, 4 ] 86 9.419% 55.422% ## ( 4, 6 ] 56 6.134% 61.555% # ( 6, 10 ] 16 1.752% 63.308% ( 10, 15 ] 11 1.205% 64.513% ( 15, 22 ] 26 2.848% 67.360% # ( 22, 34 ] 10 1.095% 68.456% ( 76, 110 ] 2 0.219% 68.675% ( 110, 170 ] 25 2.738% 71.413% # ( 170, 250 ] 24 2.629% 74.042% # ( 250, 380 ] 30 3.286% 77.327% # ( 380, 580 ] 62 6.791% 84.118% # ( 580, 870 ] 48 5.257% 89.376% # ( 870, 1300 ] 32 3.505% 92.881% # ( 1300, 1900 ] 19 2.081% 94.962% ( 1900, 2900 ] 16 1.752% 96.714% ( 2900, 4400 ] 18 1.972% 98.686% ( 4400, 6600 ] 9 0.986% 99.671% ( 6600, 9900 ] 3 0.329% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 918.1333 StdDev: 1083.35 Min: 94 Median: 347.5000 Max: 3923 Percentiles: P50: 347.50 P75: 1540.00 P99: 3923.00 P99.9: 3923.00 P99.99: 3923.00 ------------------------------------------------------ ( 76, 110 ] 7 11.667% 11.667% ## ( 110, 170 ] 14 23.333% 35.000% ##### ( 170, 250 ] 6 10.000% 45.000% ## ( 250, 380 ] 4 6.667% 51.667% # ( 380, 580 ] 5 8.333% 60.000% ## ( 580, 870 ] 4 6.667% 66.667% # ( 870, 1300 ] 3 5.000% 71.667% # ( 1300, 1900 ] 5 8.333% 80.000% ## ( 1900, 2900 ] 6 10.000% 90.000% ## ( 2900, 4400 ] 6 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 35.2 total, 15.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 195.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.782 H:M:S, 44.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 62.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.606 H:M:S, 79.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/12/16-00:35:01 ... thread 0: (1000000,8000000) ops and (217282.7,202211.7) ops/second in (4.602300,39.562490) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.20 GB 119.6 5.9 0.0 5.9 13.5 7.6 0.0 1.8 129.0 294.2 46.86 42.48 133 0.352 6140K 6390 0.0 0.0 L1 14/14 1.67 GB 0.0 5.7 4.1 1.6 5.6 4.0 0.2 1.4 226.5 223.8 25.82 24.46 3 8.607 5939K 70K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.4 2.0 254.6 254.5 1.48 1.43 2 0.742 383K 206 0.0 0.0 L3 21/0 974.45 MB 1.0 4.0 2.3 1.6 3.9 2.3 0.5 1.7 206.3 205.8 19.63 17.25 11 1.784 4112K 10K 0.0 0.0 L4 180/0 9.58 GB 1.0 1.7 1.7 0.1 1.7 1.7 0.9 1.1 138.0 137.7 12.98 8.49 24 0.541 1774K 1948 0.0 0.0 L5 1072/0 88.21 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/27 103.61 GB 0.0 17.7 8.3 9.4 25.2 15.8 6.7 3.3 169.6 241.4 106.77 94.11 173 0.617 18M 89K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.7 8.3 9.4 25.2 15.8 6.5 3.3 169.6 241.4 106.77 94.11 173 0.617 18M 89K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.7 8.3 9.4 17.6 8.2 0.0 0.0 216.9 215.8 83.53 74.61 62 1.347 18M 89K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 333.3 23.25 19.50 111 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.8 total, 39.6 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.17 GB write, 647.68 MB/s write, 17.69 GB read, 455.25 MB/s read, 106.8 seconds Interval compaction: 25.17 GB write, 651.36 MB/s write, 17.69 GB read, 457.83 MB/s read, 106.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 48, interval: 73 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2975350 Average: 2.6638 StdDev: 16.68 Min: 0 Median: 1.5503 Max: 7486 Percentiles: P50: 1.55 P75: 1.94 P99: 6.96 P99.9: 108.71 P99.99: 306.04 ------------------------------------------------------ [ 0, 1 ] 430344 14.464% 14.464% ### ( 1, 2 ] 1921540 64.582% 79.046% ############# ( 2, 3 ] 359383 12.079% 91.124% ## ( 3, 4 ] 119941 4.031% 95.155% # ( 4, 6 ] 107881 3.626% 98.781% # ( 6, 10 ] 27021 0.908% 99.689% ( 10, 15 ] 3909 0.131% 99.821% ( 15, 22 ] 489 0.016% 99.837% ( 22, 34 ] 47 0.002% 99.839% ( 34, 51 ] 14 0.000% 99.839% ( 51, 76 ] 20 0.001% 99.840% ( 76, 110 ] 1858 0.062% 99.902% ( 110, 170 ] 1876 0.063% 99.965% ( 170, 250 ] 553 0.019% 99.984% ( 250, 380 ] 414 0.014% 99.998% ( 380, 580 ] 427 0.014% 100.012% ( 580, 870 ] 225 0.008% 100.020% ( 870, 1300 ] 86 0.003% 100.023% ( 1300, 1900 ] 24 0.001% 100.024% ( 1900, 2900 ] 12 0.000% 100.024% ( 2900, 4400 ] 15 0.001% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ( 6600, 9900 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1114431 Average: 3.7834 StdDev: 53.25 Min: 0 Median: 1.6593 Max: 11616 Percentiles: P50: 1.66 P75: 2.31 P99: 9.18 P99.9: 155.51 P99.99: 450.65 ------------------------------------------------------ [ 0, 1 ] 127055 11.401% 11.401% ## ( 1, 2 ] 652425 58.543% 69.944% ############ ( 2, 3 ] 183624 16.477% 86.421% ### ( 3, 4 ] 60312 5.412% 91.833% # ( 4, 6 ] 63074 5.660% 97.493% # ( 6, 10 ] 21142 1.897% 99.390% ( 10, 15 ] 3355 0.301% 99.691% ( 15, 22 ] 496 0.045% 99.735% ( 22, 34 ] 39 0.003% 99.739% ( 34, 51 ] 8 0.001% 99.740% ( 51, 76 ] 14 0.001% 99.741% ( 76, 110 ] 1052 0.094% 99.835% ( 110, 170 ] 950 0.085% 99.921% ( 170, 250 ] 368 0.033% 99.954% ( 250, 380 ] 307 0.028% 99.981% ( 380, 580 ] 279 0.025% 100.006% ( 580, 870 ] 178 0.016% 100.022% ( 870, 1300 ] 103 0.009% 100.031% ( 1300, 1900 ] 45 0.004% 100.035% ( 1900, 2900 ] 52 0.005% 100.040% ( 2900, 4400 ] 64 0.006% 100.046% ( 4400, 6600 ] 30 0.003% 100.049% ( 6600, 9900 ] 10 0.001% 100.049% ( 9900, 14000 ] 2 0.000% 100.050% ** Level 2 read latency histogram (micros): Count: 140289 Average: 2.4983 StdDev: 28.73 Min: 0 Median: 1.4611 Max: 7916 Percentiles: P50: 1.46 P75: 1.85 P99: 6.60 P99.9: 102.96 P99.99: 651.45 ------------------------------------------------------ [ 0, 1 ] 28078 20.014% 20.014% #### ( 1, 2 ] 91238 65.036% 85.050% ############# ( 2, 3 ] 11639 8.296% 93.347% ## ( 3, 4 ] 4536 3.233% 96.580% # ( 4, 6 ] 3208 2.287% 98.867% ( 6, 10 ] 1242 0.885% 99.752% ( 10, 15 ] 131 0.093% 99.845% ( 15, 22 ] 20 0.014% 99.860% ( 22, 34 ] 1 0.001% 99.860% ( 34, 51 ] 1 0.001% 99.861% ( 76, 110 ] 69 0.049% 99.910% ( 110, 170 ] 55 0.039% 99.949% ( 170, 250 ] 22 0.016% 99.965% ( 250, 380 ] 23 0.016% 99.981% ( 380, 580 ] 10 0.007% 99.989% ( 580, 870 ] 8 0.006% 99.994% ( 870, 1300 ] 2 0.001% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 731592 Average: 4.3525 StdDev: 69.45 Min: 0 Median: 1.8802 Max: 13959 Percentiles: P50: 1.88 P75: 2.82 P99: 9.01 P99.9: 125.28 P99.99: 293.24 ------------------------------------------------------ [ 0, 1 ] 32697 4.469% 4.469% # ( 1, 2 ] 378423 51.726% 56.195% ########## ( 2, 3 ] 166909 22.814% 79.010% ##### ( 3, 4 ] 63407 8.667% 87.677% ## ( 4, 6 ] 72141 9.861% 97.538% ## ( 6, 10 ] 14241 1.947% 99.484% ( 10, 15 ] 2520 0.344% 99.829% ( 15, 22 ] 252 0.034% 99.863% ( 22, 34 ] 17 0.002% 99.865% ( 34, 51 ] 11 0.002% 99.867% ( 51, 76 ] 10 0.001% 99.868% ( 76, 110 ] 130 0.018% 99.886% ( 110, 170 ] 402 0.055% 99.941% ( 170, 250 ] 282 0.039% 99.979% ( 250, 380 ] 231 0.032% 100.011% ( 380, 580 ] 220 0.030% 100.041% ( 580, 870 ] 159 0.022% 100.063% ( 870, 1300 ] 84 0.011% 100.074% ( 1300, 1900 ] 32 0.004% 100.079% ( 1900, 2900 ] 27 0.004% 100.082% ( 2900, 4400 ] 52 0.007% 100.090% ( 4400, 6600 ] 19 0.003% 100.092% ( 6600, 9900 ] 21 0.003% 100.095% ( 9900, 14000 ] 4 0.001% 100.096% ** Level 4 read latency histogram (micros): Count: 23164 Average: 64.3238 StdDev: 349.90 Min: 1 Median: 2.1396 Max: 7657 Percentiles: P50: 2.14 P75: 3.44 P99: 1610.24 P99.9: 4934.97 P99.99: 7657.00 ------------------------------------------------------ [ 0, 1 ] 627 2.707% 2.707% # ( 1, 2 ] 10210 44.077% 46.784% ######### ( 2, 3 ] 5336 23.036% 69.820% ##### ( 3, 4 ] 2727 11.773% 81.592% ## ( 4, 6 ] 1991 8.595% 90.187% ## ( 6, 10 ] 461 1.990% 92.178% ( 10, 15 ] 196 0.846% 93.024% ( 15, 22 ] 48 0.207% 93.231% ( 22, 34 ] 13 0.056% 93.287% ( 76, 110 ] 7 0.030% 93.317% ( 110, 170 ] 113 0.488% 93.805% ( 170, 250 ] 143 0.617% 94.422% ( 250, 380 ] 215 0.928% 95.351% ( 380, 580 ] 299 1.291% 96.641% ( 580, 870 ] 311 1.343% 97.984% ( 870, 1300 ] 179 0.773% 98.757% ( 1300, 1900 ] 109 0.471% 99.227% ( 1900, 2900 ] 90 0.389% 99.616% ( 2900, 4400 ] 60 0.259% 99.875% ( 4400, 6600 ] 24 0.104% 99.978% ( 6600, 9900 ] 5 0.022% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1228.2625 StdDev: 1422.44 Min: 88 Median: 568.2353 Max: 7748 Percentiles: P50: 568.24 P75: 1900.00 P99: 7260.00 P99.9: 7748.00 P99.99: 7748.00 ------------------------------------------------------ ( 76, 110 ] 13 8.125% 8.125% ## ( 110, 170 ] 21 13.125% 21.250% ### ( 170, 250 ] 13 8.125% 29.375% ## ( 250, 380 ] 17 10.625% 40.000% ## ( 380, 580 ] 17 10.625% 50.625% ## ( 580, 870 ] 10 6.250% 56.875% # ( 870, 1300 ] 14 8.750% 65.625% ## ( 1300, 1900 ] 15 9.375% 75.000% ## ( 1900, 2900 ] 20 12.500% 87.500% ### ( 2900, 4400 ] 14 8.750% 96.250% ## ( 4400, 6600 ] 4 2.500% 98.750% # ( 6600, 9900 ] 2 1.250% 100.000% ** DB Stats ** Uptime(secs): 39.8 total, 4.6 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 197.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.556 H:M:S, 44.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 213.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.774 H:M:S, 38.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-00:35:09 ... thread 0: (1000000,9000000) ops and (131308.1,190766.2) ops/second in (7.615675,47.178165) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 4.18 GB 226.3 7.8 0.0 7.8 16.3 8.5 0.0 1.9 139.2 292.6 57.01 52.08 154 0.370 8058K 9874 0.0 0.0 L1 14/14 1.67 GB 0.0 5.7 4.1 1.6 5.6 4.0 0.2 1.4 226.5 223.8 25.82 24.46 3 8.607 5939K 70K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.4 2.0 254.6 254.5 1.48 1.43 2 0.742 383K 206 0.0 0.0 L3 21/0 974.45 MB 1.0 4.0 2.3 1.6 3.9 2.3 0.5 1.7 206.3 205.8 19.63 17.25 11 1.784 4112K 10K 0.0 0.0 L4 180/0 9.58 GB 1.0 1.7 1.7 0.1 1.7 1.7 0.9 1.1 138.0 137.7 12.98 8.49 24 0.541 1774K 1948 0.0 0.0 L5 1072/0 88.21 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/27 104.59 GB 0.0 19.5 8.3 11.3 28.0 16.7 6.7 3.3 171.1 245.2 116.92 103.71 194 0.603 20M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.5 8.3 11.3 28.0 16.7 6.5 3.3 171.1 245.2 116.92 103.71 194 0.603 20M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.5 8.3 11.3 19.4 8.2 0.0 0.0 220.3 219.3 90.78 81.65 67 1.355 20M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 335.0 26.14 22.06 127 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.4 total, 47.2 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.99 GB write, 604.67 MB/s write, 19.53 GB read, 421.96 MB/s read, 116.9 seconds Interval compaction: 27.99 GB write, 607.55 MB/s write, 19.53 GB read, 423.97 MB/s read, 116.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 34, total-stops: 48, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3564066 Average: 2.7045 StdDev: 16.92 Min: 0 Median: 1.5439 Max: 7486 Percentiles: P50: 1.54 P75: 1.93 P99: 7.00 P99.9: 130.23 P99.99: 339.88 ------------------------------------------------------ [ 0, 1 ] 518374 14.544% 14.544% ### ( 1, 2 ] 2323283 65.186% 79.731% ############# ( 2, 3 ] 420994 11.812% 91.543% ## ( 3, 4 ] 137392 3.855% 95.398% # ( 4, 6 ] 120498 3.381% 98.779% # ( 6, 10 ] 31634 0.888% 99.666% ( 10, 15 ] 4263 0.120% 99.786% ( 15, 22 ] 549 0.015% 99.801% ( 22, 34 ] 52 0.001% 99.803% ( 34, 51 ] 16 0.000% 99.803% ( 51, 76 ] 22 0.001% 99.804% ( 76, 110 ] 2412 0.068% 99.872% ( 110, 170 ] 3004 0.084% 99.956% ( 170, 250 ] 808 0.023% 99.979% ( 250, 380 ] 591 0.017% 99.995% ( 380, 580 ] 554 0.016% 100.011% ( 580, 870 ] 287 0.008% 100.019% ( 870, 1300 ] 106 0.003% 100.022% ( 1300, 1900 ] 27 0.001% 100.022% ( 1900, 2900 ] 16 0.000% 100.023% ( 2900, 4400 ] 18 0.001% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ( 6600, 9900 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1397414 Average: 3.5681 StdDev: 47.80 Min: 0 Median: 1.6357 Max: 11616 Percentiles: P50: 1.64 P75: 2.19 P99: 9.08 P99.9: 154.62 P99.99: 453.13 ------------------------------------------------------ [ 0, 1 ] 161821 11.580% 11.580% ## ( 1, 2 ] 844533 60.435% 72.015% ############ ( 2, 3 ] 218241 15.617% 87.633% ### ( 3, 4 ] 68772 4.921% 92.554% # ( 4, 6 ] 70159 5.021% 97.575% # ( 6, 10 ] 25866 1.851% 99.426% ( 10, 15 ] 3727 0.267% 99.693% ( 15, 22 ] 554 0.040% 99.732% ( 22, 34 ] 42 0.003% 99.735% ( 34, 51 ] 8 0.001% 99.736% ( 51, 76 ] 16 0.001% 99.737% ( 76, 110 ] 1218 0.087% 99.824% ( 110, 170 ] 1426 0.102% 99.926% ( 170, 250 ] 432 0.031% 99.957% ( 250, 380 ] 348 0.025% 99.982% ( 380, 580 ] 307 0.022% 100.004% ( 580, 870 ] 187 0.013% 100.017% ( 870, 1300 ] 107 0.008% 100.025% ( 1300, 1900 ] 46 0.003% 100.028% ( 1900, 2900 ] 52 0.004% 100.032% ( 2900, 4400 ] 64 0.005% 100.037% ( 4400, 6600 ] 30 0.002% 100.039% ( 6600, 9900 ] 10 0.001% 100.040% ( 9900, 14000 ] 2 0.000% 100.040% ** Level 2 read latency histogram (micros): Count: 140289 Average: 2.4983 StdDev: 28.73 Min: 0 Median: 1.4611 Max: 7916 Percentiles: P50: 1.46 P75: 1.85 P99: 6.60 P99.9: 102.96 P99.99: 651.45 ------------------------------------------------------ [ 0, 1 ] 28078 20.014% 20.014% #### ( 1, 2 ] 91238 65.036% 85.050% ############# ( 2, 3 ] 11639 8.296% 93.347% ## ( 3, 4 ] 4536 3.233% 96.580% # ( 4, 6 ] 3208 2.287% 98.867% ( 6, 10 ] 1242 0.885% 99.752% ( 10, 15 ] 131 0.093% 99.845% ( 15, 22 ] 20 0.014% 99.860% ( 22, 34 ] 1 0.001% 99.860% ( 34, 51 ] 1 0.001% 99.861% ( 76, 110 ] 69 0.049% 99.910% ( 110, 170 ] 55 0.039% 99.949% ( 170, 250 ] 22 0.016% 99.965% ( 250, 380 ] 23 0.016% 99.981% ( 380, 580 ] 10 0.007% 99.989% ( 580, 870 ] 8 0.006% 99.994% ( 870, 1300 ] 2 0.001% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 731592 Average: 4.3525 StdDev: 69.45 Min: 0 Median: 1.8802 Max: 13959 Percentiles: P50: 1.88 P75: 2.82 P99: 9.01 P99.9: 125.28 P99.99: 293.24 ------------------------------------------------------ [ 0, 1 ] 32697 4.469% 4.469% # ( 1, 2 ] 378423 51.726% 56.195% ########## ( 2, 3 ] 166909 22.814% 79.010% ##### ( 3, 4 ] 63407 8.667% 87.677% ## ( 4, 6 ] 72141 9.861% 97.538% ## ( 6, 10 ] 14241 1.947% 99.484% ( 10, 15 ] 2520 0.344% 99.829% ( 15, 22 ] 252 0.034% 99.863% ( 22, 34 ] 17 0.002% 99.865% ( 34, 51 ] 11 0.002% 99.867% ( 51, 76 ] 10 0.001% 99.868% ( 76, 110 ] 130 0.018% 99.886% ( 110, 170 ] 402 0.055% 99.941% ( 170, 250 ] 282 0.039% 99.979% ( 250, 380 ] 231 0.032% 100.011% ( 380, 580 ] 220 0.030% 100.041% ( 580, 870 ] 159 0.022% 100.063% ( 870, 1300 ] 84 0.011% 100.074% ( 1300, 1900 ] 32 0.004% 100.079% ( 1900, 2900 ] 27 0.004% 100.082% ( 2900, 4400 ] 52 0.007% 100.090% ( 4400, 6600 ] 19 0.003% 100.092% ( 6600, 9900 ] 21 0.003% 100.095% ( 9900, 14000 ] 4 0.001% 100.096% ** Level 4 read latency histogram (micros): Count: 23164 Average: 64.3238 StdDev: 349.90 Min: 1 Median: 2.1396 Max: 7657 Percentiles: P50: 2.14 P75: 3.44 P99: 1610.24 P99.9: 4934.97 P99.99: 7657.00 ------------------------------------------------------ [ 0, 1 ] 627 2.707% 2.707% # ( 1, 2 ] 10210 44.077% 46.784% ######### ( 2, 3 ] 5336 23.036% 69.820% ##### ( 3, 4 ] 2727 11.773% 81.592% ## ( 4, 6 ] 1991 8.595% 90.187% ## ( 6, 10 ] 461 1.990% 92.178% ( 10, 15 ] 196 0.846% 93.024% ( 15, 22 ] 48 0.207% 93.231% ( 22, 34 ] 13 0.056% 93.287% ( 76, 110 ] 7 0.030% 93.317% ( 110, 170 ] 113 0.488% 93.805% ( 170, 250 ] 143 0.617% 94.422% ( 250, 380 ] 215 0.928% 95.351% ( 380, 580 ] 299 1.291% 96.641% ( 580, 870 ] 311 1.343% 97.984% ( 870, 1300 ] 179 0.773% 98.757% ( 1300, 1900 ] 109 0.471% 99.227% ( 1900, 2900 ] 90 0.389% 99.616% ( 2900, 4400 ] 60 0.259% 99.875% ( 4400, 6600 ] 24 0.104% 99.978% ( 6600, 9900 ] 5 0.022% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1228.2625 StdDev: 1422.44 Min: 88 Median: 568.2353 Max: 7748 Percentiles: P50: 568.24 P75: 1900.00 P99: 7260.00 P99.9: 7748.00 P99.99: 7748.00 ------------------------------------------------------ ( 76, 110 ] 13 8.125% 8.125% ## ( 110, 170 ] 21 13.125% 21.250% ### ( 170, 250 ] 13 8.125% 29.375% ## ( 250, 380 ] 17 10.625% 40.000% ## ( 380, 580 ] 17 10.625% 50.625% ## ( 580, 870 ] 10 6.250% 56.875% # ( 870, 1300 ] 14 8.750% 65.625% ## ( 1300, 1900 ] 15 9.375% 75.000% ## ( 1900, 2900 ] 20 12.500% 87.500% ### ( 2900, 4400 ] 14 8.750% 96.250% ## ( 4400, 6600 ] 4 2.500% 98.750% # ( 6600, 9900 ] 2 1.250% 100.000% ** DB Stats ** Uptime(secs): 47.4 total, 7.6 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 186.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.510 H:M:S, 47.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 129.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.954 H:M:S, 65.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.376 micros/op 156843 ops/sec 60.149 seconds 9433999 operations; 152.0 MB/s Microseconds per write: Count: 9433999 Average: 6.3758 StdDev: 333.96 Min: 0 Median: 1.7506 Max: 554242 Percentiles: P50: 1.75 P75: 2.78 P99: 9.30 P99.9: 1206.44 P99.99: 2742.90 ------------------------------------------------------ [ 0, 1 ] 1213199 12.860% 12.860% ### ( 1, 2 ] 4667917 49.480% 62.340% ########## ( 2, 3 ] 1539782 16.322% 78.661% ### ( 3, 4 ] 1307826 13.863% 92.524% ### ( 4, 6 ] 518120 5.492% 98.016% # ( 6, 10 ] 112445 1.192% 99.208% ( 10, 15 ] 32222 0.342% 99.550% ( 15, 22 ] 7719 0.082% 99.631% ( 22, 34 ] 1331 0.014% 99.646% ( 34, 51 ] 202 0.002% 99.648% ( 51, 76 ] 29 0.000% 99.648% ( 76, 110 ] 6604 0.070% 99.718% ( 110, 170 ] 2557 0.027% 99.745% ( 170, 250 ] 271 0.003% 99.748% ( 250, 380 ] 149 0.002% 99.750% ( 380, 580 ] 27 0.000% 99.750% ( 580, 870 ] 15 0.000% 99.750% ( 870, 1300 ] 18085 0.192% 99.942% ( 1300, 1900 ] 68 0.001% 99.942% ( 1900, 2900 ] 5324 0.056% 99.999% ( 2900, 4400 ] 68 0.001% 100.000% ( 4400, 6600 ] 18 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 170000, 250000 ] 8 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 198051 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9433999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9735886968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 561 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34136073 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30623407105 rocksdb.compact.write.bytes COUNT : 30429282275 rocksdb.flush.write.bytes COUNT : 9710606482 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 53 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 279 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9632154624 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3614720 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30712464054 rocksdb.non.last.level.read.count COUNT : 7421255 rocksdb.block.checksum.compute.count COUNT : 7420186 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.399183 P95 : 3.916947 P99 : 7.941031 P100 : 554235.000000 COUNT : 9433999 SUM : 55681303 rocksdb.compaction.times.micros P50 : 970500.000000 P95 : 3740000.000000 P99 : 17090014.000000 P100 : 17090014.000000 COUNT : 92 SUM : 128095398 rocksdb.compaction.times.cpu_micros P50 : 839285.714286 P95 : 3180000.000000 P99 : 15986954.000000 P100 : 15986954.000000 COUNT : 92 SUM : 111972048 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 671.901408 P95 : 1275.192308 P99 : 8745.000000 P100 : 38241.000000 COUNT : 135 SUM : 141064 rocksdb.compaction.outfile.sync.micros P50 : 920.459184 P95 : 44793.750000 P99 : 153800.000000 P100 : 178264.000000 COUNT : 389 SUM : 3182937 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.670213 P95 : 558.333333 P99 : 1836.400000 P100 : 5353.000000 COUNT : 253 SUM : 50851 rocksdb.table.open.io.micros P50 : 1280.841584 P95 : 6596.071429 P99 : 18547.692308 P100 : 21844.000000 COUNT : 561 SUM : 1199593 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.678080 P95 : 8.018166 P99 : 11.858141 P100 : 13964.000000 COUNT : 7418740 SUM : 42523347 rocksdb.read.block.get.micros P50 : 458.832117 P95 : 3432.142857 P99 : 7585.875000 P100 : 9563.000000 COUNT : 1122 SUM : 970860 rocksdb.write.raw.block.micros P50 : 0.513130 P95 : 0.974947 P99 : 2.954573 P100 : 15235.000000 COUNT : 9722132 SUM : 19044923 rocksdb.numfiles.in.singlecompaction P50 : 3.114035 P95 : 8.200000 P99 : 28.920000 P100 : 29.000000 COUNT : 127 SUM : 494 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561559 P95 : 1173.466142 P99 : 2511.565201 P100 : 554006.000000 COUNT : 215825 SUM : 34153677 rocksdb.sst.read.micros P50 : 1.613789 P95 : 4.843254 P99 : 8.782661 P100 : 13959.000000 COUNT : 7421688 SUM : 27428161 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9433999 SUM : 9735886968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 207142.857143 P95 : 347500.000000 P99 : 664250.000000 P100 : 679879.000000 COUNT : 135 SUM : 27571966 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 361 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0