[2024-11-27 13:48:46.996176] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-27 13:48:46.996316] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2438810 ] Set seed to 1732711726992755 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-27 13:48:47.102157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-27 13:48:47.299527] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-27 13:48:47.299577] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2438810' to capture a snapshot of events at runtime. [2024-11-27 13:48:47.299587] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2438810 for offline analysis/debug. [2024-11-27 13:48:47.299631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 27 13:48:55 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/27-13:48:58 ... thread 0: (1000000,1000000) ops and (357646.2,357646.2) ops/second in (2.796059,2.796059) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.06 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 354.2 2.31 2.07 12 0.193 0 0 0.0 0.0 L2 3/2 251.73 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 258.0 257.8 1.46 1.42 2 0.732 383K 229 0.0 0.0 L3 11/0 930.13 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1179/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 100.1 316.8 3.78 3.49 14 0.270 383K 229 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 100.1 316.8 3.78 3.49 14 0.270 383K 229 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 258.0 257.8 1.46 1.42 2 0.732 383K 229 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 354.2 2.31 2.07 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 399.75 MB/s write, 0.37 GB read, 126.25 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 427.77 MB/s write, 0.37 GB read, 135.10 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 105698 Average: 1.8555 StdDev: 8.40 Min: 1 Median: 1.2631 Max: 1284 Percentiles: P50: 1.26 P75: 1.68 P99: 3.98 P99.9: 9.97 P99.99: 355.31 ------------------------------------------------------ [ 0, 1 ] 36071 34.126% 34.126% ####### ( 1, 2 ] 63764 60.327% 94.453% ############ ( 2, 3 ] 3524 3.334% 97.787% # ( 3, 4 ] 1308 1.237% 99.025% ( 4, 6 ] 727 0.688% 99.712% ( 6, 10 ] 200 0.189% 99.902% ( 10, 15 ] 61 0.058% 99.959% ( 15, 22 ] 14 0.013% 99.973% ( 22, 34 ] 2 0.002% 99.974% ( 34, 51 ] 4 0.004% 99.978% ( 110, 170 ] 9 0.009% 99.987% ( 170, 250 ] 1 0.001% 99.988% ( 250, 380 ] 3 0.003% 99.991% ( 380, 580 ] 5 0.005% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 5 0.005% 100.001% ** Level 2 read latency histogram (micros): Count: 50659 Average: 2.4787 StdDev: 51.12 Min: 1 Median: 1.2976 Max: 6189 Percentiles: P50: 1.30 P75: 1.71 P99: 5.30 P99.9: 12.08 P99.99: 1880.23 ------------------------------------------------------ [ 0, 1 ] 16209 31.996% 31.996% ###### ( 1, 2 ] 30645 60.493% 92.489% ############ ( 2, 3 ] 1973 3.895% 96.384% # ( 3, 4 ] 951 1.877% 98.261% ( 4, 6 ] 578 1.141% 99.402% ( 6, 10 ] 235 0.464% 99.866% ( 10, 15 ] 44 0.087% 99.953% ( 15, 22 ] 6 0.012% 99.964% ( 22, 34 ] 1 0.002% 99.966% ( 34, 51 ] 1 0.002% 99.968% ( 51, 76 ] 1 0.002% 99.970% ( 250, 380 ] 3 0.006% 99.976% ( 380, 580 ] 2 0.004% 99.980% ( 580, 870 ] 3 0.006% 99.986% ( 870, 1300 ] 1 0.002% 99.988% ( 1300, 1900 ] 2 0.004% 99.992% ( 2900, 4400 ] 1 0.002% 99.994% ( 4400, 6600 ] 4 0.008% 100.002% ** Level 3 read latency histogram (micros): Count: 45 Average: 3384.6222 StdDev: 2134.42 Min: 173 Median: 3275.0000 Max: 7984 Percentiles: P50: 3275.00 P75: 5225.00 P99: 7984.00 P99.9: 7984.00 P99.99: 7984.00 ------------------------------------------------------ ( 170, 250 ] 1 2.222% 2.222% ( 250, 380 ] 1 2.222% 4.444% ( 380, 580 ] 2 4.444% 8.889% # ( 580, 870 ] 4 8.889% 17.778% ## ( 870, 1300 ] 2 4.444% 22.222% # ( 1300, 1900 ] 3 6.667% 28.889% # ( 1900, 2900 ] 7 15.556% 44.444% ### ( 2900, 4400 ] 10 22.222% 66.667% #### ( 4400, 6600 ] 10 22.222% 88.889% #### ( 6600, 9900 ] 5 11.111% 100.000% ## ** Level 4 read latency histogram (micros): Count: 25 Average: 3435.4800 StdDev: 2352.61 Min: 97 Median: 3150.0000 Max: 7885 Percentiles: P50: 3150.00 P75: 5578.57 P99: 7885.00 P99.9: 7885.00 P99.99: 7885.00 ------------------------------------------------------ ( 76, 110 ] 1 4.000% 4.000% # ( 110, 170 ] 2 8.000% 12.000% ## ( 380, 580 ] 1 4.000% 16.000% # ( 580, 870 ] 1 4.000% 20.000% # ( 1300, 1900 ] 4 16.000% 36.000% ### ( 1900, 2900 ] 3 12.000% 48.000% ## ( 2900, 4400 ] 3 12.000% 60.000% ## ( 4400, 6600 ] 7 28.000% 88.000% ###### ( 6600, 9900 ] 3 12.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 328.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.193 H:M:S, 6.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.193 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-13:49:01 ... thread 0: (1000000,2000000) ops and (319878.6,337709.8) ops/second in (3.126186,5.922245) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.17 GB 37.8 0.5 0.0 0.5 2.3 1.8 0.0 1.3 69.8 322.8 7.22 6.56 28 0.258 511K 504 0.0 0.0 L1 1/1 3.65 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.5 240.1 1.57 1.53 1 1.572 383K 639 0.0 0.0 L2 2/1 53.64 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 258.0 257.8 1.46 1.42 2 0.732 383K 229 0.0 0.0 L3 21/11 1.25 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.5 1.0 228.1 228.1 1.09 1.03 1 1.093 253K 0 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 153.9 153.9 1.46 1.08 1 1.456 227K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/22 97.92 GB 0.0 1.7 1.0 0.7 3.5 2.8 1.5 1.9 135.4 277.9 12.81 11.61 33 0.388 1760K 1372 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 1.0 0.7 3.5 2.8 1.4 1.9 135.4 277.9 12.81 11.61 33 0.388 1760K 1372 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 1.0 0.7 1.7 1.0 0.0 0.0 228.8 228.6 7.58 7.00 7 1.082 1760K 1372 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.4 5.23 4.61 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.48 GB write, 581.55 MB/s write, 1.69 GB read, 283.25 MB/s read, 12.8 seconds Interval compaction: 3.48 GB write, 600.80 MB/s write, 1.69 GB read, 292.63 MB/s read, 12.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 413432 Average: 2.2753 StdDev: 8.67 Min: 1 Median: 1.5315 Max: 2281 Percentiles: P50: 1.53 P75: 1.92 P99: 5.81 P99.9: 10.90 P99.99: 15.48 ------------------------------------------------------ [ 0, 1 ] 66368 16.053% 16.053% ### ( 1, 2 ] 264075 63.874% 79.927% ############# ( 2, 3 ] 47919 11.591% 91.517% ## ( 3, 4 ] 17644 4.268% 95.785% # ( 4, 6 ] 14664 3.547% 99.332% # ( 6, 10 ] 2269 0.549% 99.881% ( 10, 15 ] 450 0.109% 99.990% ( 15, 22 ] 39 0.009% 99.999% ( 22, 34 ] 11 0.003% 100.002% ( 34, 51 ] 8 0.002% 100.004% ( 51, 76 ] 2 0.000% 100.004% ( 110, 170 ] 12 0.003% 100.007% ( 170, 250 ] 10 0.002% 100.009% ( 250, 380 ] 6 0.001% 100.011% ( 380, 580 ] 6 0.001% 100.012% ( 580, 870 ] 7 0.002% 100.014% ( 870, 1300 ] 12 0.003% 100.017% ( 1300, 1900 ] 1 0.000% 100.017% ( 1900, 2900 ] 2 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 26 Average: 199.2692 StdDev: 383.10 Min: 1 Median: 1.7143 Max: 1414 Percentiles: P50: 1.71 P75: 210.00 P99: 1414.00 P99.9: 1414.00 P99.99: 1414.00 ------------------------------------------------------ [ 0, 1 ] 8 30.769% 30.769% ###### ( 1, 2 ] 7 26.923% 57.692% ##### ( 2, 3 ] 2 7.692% 65.385% ## ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 2 7.692% 84.615% ## ( 380, 580 ] 1 3.846% 88.462% # ( 870, 1300 ] 2 7.692% 96.154% ## ( 1300, 1900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 95643 Average: 2.3857 StdDev: 37.21 Min: 1 Median: 1.4347 Max: 6189 Percentiles: P50: 1.43 P75: 1.83 P99: 5.73 P99.9: 11.65 P99.99: 718.78 ------------------------------------------------------ [ 0, 1 ] 21561 22.543% 22.543% ##### ( 1, 2 ] 60413 63.165% 85.708% ############# ( 2, 3 ] 7472 7.812% 93.521% ## ( 3, 4 ] 3101 3.242% 96.763% # ( 4, 6 ] 2471 2.584% 99.347% # ( 6, 10 ] 497 0.520% 99.866% ( 10, 15 ] 98 0.102% 99.969% ( 15, 22 ] 10 0.010% 99.979% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 250, 380 ] 3 0.003% 99.986% ( 380, 580 ] 2 0.002% 99.988% ( 580, 870 ] 3 0.003% 99.992% ( 870, 1300 ] 1 0.001% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 2900, 4400 ] 1 0.001% 99.996% ( 4400, 6600 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 182801 Average: 3.9347 StdDev: 65.39 Min: 0 Median: 1.6481 Max: 7984 Percentiles: P50: 1.65 P75: 2.22 P99: 8.93 P99.9: 169.38 P99.99: 529.85 ------------------------------------------------------ [ 0, 1 ] 18703 10.231% 10.231% ## ( 1, 2 ] 112163 61.358% 71.589% ############ ( 2, 3 ] 28163 15.406% 86.996% ### ( 3, 4 ] 10270 5.618% 92.614% # ( 4, 6 ] 9473 5.182% 97.796% # ( 6, 10 ] 3006 1.644% 99.440% ( 10, 15 ] 506 0.277% 99.717% ( 15, 22 ] 67 0.037% 99.754% ( 22, 34 ] 10 0.005% 99.759% ( 34, 51 ] 3 0.002% 99.761% ( 76, 110 ] 84 0.046% 99.807% ( 110, 170 ] 173 0.095% 99.902% ( 170, 250 ] 65 0.036% 99.937% ( 250, 380 ] 67 0.037% 99.974% ( 380, 580 ] 41 0.022% 99.996% ( 580, 870 ] 19 0.010% 100.007% ( 870, 1300 ] 14 0.008% 100.014% ( 1300, 1900 ] 8 0.004% 100.019% ( 1900, 2900 ] 8 0.004% 100.023% ( 2900, 4400 ] 10 0.005% 100.028% ( 4400, 6600 ] 10 0.005% 100.034% ( 6600, 9900 ] 5 0.003% 100.037% ** Level 4 read latency histogram (micros): Count: 310 Average: 284.1097 StdDev: 1148.22 Min: 1 Median: 1.9339 Max: 7885 Percentiles: P50: 1.93 P75: 7.43 P99: 6568.57 P99.9: 7885.00 P99.99: 7885.00 ------------------------------------------------------ [ 0, 1 ] 42 13.548% 13.548% ### ( 1, 2 ] 121 39.032% 52.581% ######## ( 2, 3 ] 44 14.194% 66.774% ### ( 3, 4 ] 10 3.226% 70.000% # ( 4, 6 ] 13 4.194% 74.194% # ( 6, 10 ] 7 2.258% 76.452% ( 10, 15 ] 34 10.968% 87.419% ## ( 15, 22 ] 9 2.903% 90.323% # ( 22, 34 ] 1 0.323% 90.645% ( 76, 110 ] 1 0.323% 90.968% ( 110, 170 ] 3 0.968% 91.935% ( 170, 250 ] 1 0.323% 92.258% ( 250, 380 ] 1 0.323% 92.581% ( 380, 580 ] 2 0.645% 93.226% ( 580, 870 ] 1 0.323% 93.548% ( 1300, 1900 ] 4 1.290% 94.839% ( 1900, 2900 ] 3 0.968% 95.806% ( 2900, 4400 ] 3 0.968% 96.774% ( 4400, 6600 ] 7 2.258% 99.032% ( 6600, 9900 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1163.3000 StdDev: 1373.67 Min: 103 Median: 380.0000 Max: 4209 Percentiles: P50: 380.00 P75: 1300.00 P99: 4209.00 P99.9: 4209.00 P99.99: 4209.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 2 10.000% 15.000% ## ( 170, 250 ] 3 15.000% 30.000% ### ( 250, 380 ] 4 20.000% 50.000% #### ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 2900, 4400 ] 5 25.000% 100.000% ##### ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.601 H:M:S, 9.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.408 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/27-13:49:05 ... thread 0: (1000000,3000000) ops and (310193.6,328010.9) ops/second in (3.223793,9.146038) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.54 GB 37.8 1.0 0.0 1.0 3.7 2.7 0.0 1.4 83.7 313.6 12.05 10.93 43 0.280 1023K 966 0.0 0.0 L1 3/3 150.11 MB 0.0 0.9 0.9 0.0 0.9 0.9 0.2 1.0 232.1 231.7 4.09 3.95 2 2.043 962K 1832 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.8 2.0 258.0 257.8 1.46 1.42 2 0.732 383K 229 0.0 0.0 L3 24/0 973.67 MB 1.0 2.0 0.7 1.2 1.9 0.7 0.5 2.8 222.1 221.7 9.00 8.25 6 1.500 2031K 4133 0.0 0.0 L4 173/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 153.9 153.9 1.46 1.08 1 1.456 227K 0 0.0 0.0 L5 1052/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/13 98.84 GB 0.0 4.5 2.0 2.4 7.2 4.7 3.3 2.6 162.5 261.0 28.06 25.63 54 0.520 4628K 7160 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 2.0 2.4 7.2 4.7 3.1 2.6 162.5 261.0 28.06 25.63 54 0.520 4628K 7160 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 2.0 2.4 4.4 2.0 0.0 0.0 228.1 227.7 19.98 18.59 15 1.332 4628K 7160 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 343.3 8.08 7.04 39 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.15 GB write, 783.74 MB/s write, 4.45 GB read, 487.86 MB/s read, 28.1 seconds Interval compaction: 7.15 GB write, 800.54 MB/s write, 4.45 GB read, 498.31 MB/s read, 28.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 730324 Average: 2.3515 StdDev: 9.20 Min: 1 Median: 1.5667 Max: 2836 Percentiles: P50: 1.57 P75: 1.96 P99: 5.89 P99.9: 11.65 P99.99: 16.21 ------------------------------------------------------ [ 0, 1 ] 98925 13.545% 13.545% ### ( 1, 2 ] 469841 64.333% 77.879% ############# ( 2, 3 ] 93027 12.738% 90.616% ### ( 3, 4 ] 33155 4.540% 95.156% # ( 4, 6 ] 29640 4.058% 99.215% # ( 6, 10 ] 4692 0.642% 99.857% ( 10, 15 ] 957 0.131% 99.988% ( 15, 22 ] 92 0.013% 100.001% ( 22, 34 ] 12 0.002% 100.002% ( 34, 51 ] 13 0.002% 100.004% ( 51, 76 ] 4 0.001% 100.005% ( 110, 170 ] 30 0.004% 100.009% ( 170, 250 ] 28 0.004% 100.013% ( 250, 380 ] 14 0.002% 100.015% ( 380, 580 ] 14 0.002% 100.016% ( 580, 870 ] 17 0.002% 100.019% ( 870, 1300 ] 15 0.002% 100.021% ( 1300, 1900 ] 3 0.000% 100.021% ( 1900, 2900 ] 4 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 201524 Average: 2.9482 StdDev: 13.62 Min: 1 Median: 1.8771 Max: 4030 Percentiles: P50: 1.88 P75: 2.84 P99: 7.98 P99.9: 11.64 P99.99: 13.15 ------------------------------------------------------ [ 0, 1 ] 6531 3.241% 3.241% # ( 1, 2 ] 107430 53.309% 56.550% ########### ( 2, 3 ] 44154 21.910% 78.460% #### ( 3, 4 ] 18383 9.122% 87.582% ## ( 4, 6 ] 21431 10.634% 98.216% ## ( 6, 10 ] 3196 1.586% 99.802% ( 10, 15 ] 601 0.298% 100.100% ( 15, 22 ] 51 0.025% 100.126% ( 22, 34 ] 6 0.003% 100.129% ( 51, 76 ] 1 0.000% 100.129% ( 110, 170 ] 1 0.000% 100.130% ( 170, 250 ] 4 0.002% 100.131% ( 250, 380 ] 4 0.002% 100.133% ( 380, 580 ] 4 0.002% 100.135% ( 580, 870 ] 2 0.001% 100.136% ( 870, 1300 ] 5 0.002% 100.139% ( 1300, 1900 ] 3 0.001% 100.140% ( 1900, 2900 ] 1 0.000% 100.141% ( 2900, 4400 ] 1 0.000% 100.141% ** Level 2 read latency histogram (micros): Count: 140161 Average: 2.9230 StdDev: 33.76 Min: 1 Median: 1.5309 Max: 6189 Percentiles: P50: 1.53 P75: 1.94 P99: 7.86 P99.9: 167.25 P99.99: 922.88 ------------------------------------------------------ [ 0, 1 ] 24362 17.381% 17.381% ### ( 1, 2 ] 86112 61.438% 78.819% ############ ( 2, 3 ] 15520 11.073% 89.892% ## ( 3, 4 ] 6253 4.461% 94.354% # ( 4, 6 ] 5791 4.132% 98.485% # ( 6, 10 ] 1548 1.104% 99.590% ( 10, 15 ] 306 0.218% 99.808% ( 15, 22 ] 35 0.025% 99.833% ( 22, 34 ] 4 0.003% 99.836% ( 34, 51 ] 1 0.001% 99.837% ( 51, 76 ] 1 0.001% 99.837% ( 76, 110 ] 22 0.016% 99.853% ( 110, 170 ] 69 0.049% 99.902% ( 170, 250 ] 32 0.023% 99.925% ( 250, 380 ] 37 0.026% 99.951% ( 380, 580 ] 36 0.026% 99.977% ( 580, 870 ] 17 0.012% 99.989% ( 870, 1300 ] 8 0.006% 99.995% ( 1300, 1900 ] 2 0.001% 99.996% ( 2900, 4400 ] 1 0.001% 99.997% ( 4400, 6600 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 255375 Average: 3.9746 StdDev: 58.16 Min: 0 Median: 1.6815 Max: 7984 Percentiles: P50: 1.68 P75: 2.37 P99: 9.22 P99.9: 225.49 P99.99: 675.22 ------------------------------------------------------ [ 0, 1 ] 23514 9.208% 9.208% ## ( 1, 2 ] 152867 59.860% 69.067% ############ ( 2, 3 ] 40861 16.000% 85.068% ### ( 3, 4 ] 16218 6.351% 91.419% # ( 4, 6 ] 15556 6.091% 97.510% # ( 6, 10 ] 4727 1.851% 99.361% ( 10, 15 ] 824 0.323% 99.684% ( 15, 22 ] 93 0.036% 99.720% ( 22, 34 ] 11 0.004% 99.724% ( 34, 51 ] 6 0.002% 99.727% ( 76, 110 ] 104 0.041% 99.767% ( 110, 170 ] 254 0.099% 99.867% ( 170, 250 ] 122 0.048% 99.915% ( 250, 380 ] 101 0.040% 99.954% ( 380, 580 ] 78 0.031% 99.985% ( 580, 870 ] 41 0.016% 100.001% ( 870, 1300 ] 25 0.010% 100.011% ( 1300, 1900 ] 11 0.004% 100.015% ( 1900, 2900 ] 10 0.004% 100.019% ( 2900, 4400 ] 12 0.005% 100.023% ( 4400, 6600 ] 10 0.004% 100.027% ( 6600, 9900 ] 5 0.002% 100.029% ** Level 4 read latency histogram (micros): Count: 310 Average: 284.1097 StdDev: 1148.22 Min: 1 Median: 1.9339 Max: 7885 Percentiles: P50: 1.93 P75: 7.43 P99: 6568.57 P99.9: 7885.00 P99.99: 7885.00 ------------------------------------------------------ [ 0, 1 ] 42 13.548% 13.548% ### ( 1, 2 ] 121 39.032% 52.581% ######## ( 2, 3 ] 44 14.194% 66.774% ### ( 3, 4 ] 10 3.226% 70.000% # ( 4, 6 ] 13 4.194% 74.194% # ( 6, 10 ] 7 2.258% 76.452% ( 10, 15 ] 34 10.968% 87.419% ## ( 15, 22 ] 9 2.903% 90.323% # ( 22, 34 ] 1 0.323% 90.645% ( 76, 110 ] 1 0.323% 90.968% ( 110, 170 ] 3 0.968% 91.935% ( 170, 250 ] 1 0.323% 92.258% ( 250, 380 ] 1 0.323% 92.581% ( 380, 580 ] 2 0.645% 93.226% ( 580, 870 ] 1 0.323% 93.548% ( 1300, 1900 ] 4 1.290% 94.839% ( 1900, 2900 ] 3 0.968% 95.806% ( 2900, 4400 ] 3 0.968% 96.774% ( 4400, 6600 ] 7 2.258% 99.032% ( 6600, 9900 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 1027.7167 StdDev: 1207.62 Min: 103 Median: 405.0000 Max: 4209 Percentiles: P50: 405.00 P75: 1600.00 P99: 4209.00 P99.9: 4209.00 P99.99: 4209.00 ------------------------------------------------------ ( 76, 110 ] 2 3.333% 3.333% # ( 110, 170 ] 10 16.667% 20.000% ### ( 170, 250 ] 10 16.667% 36.667% ### ( 250, 380 ] 7 11.667% 48.333% ## ( 380, 580 ] 8 13.333% 61.667% ### ( 580, 870 ] 5 8.333% 70.000% ## ( 870, 1300 ] 2 3.333% 73.333% # ( 1300, 1900 ] 2 3.333% 76.667% # ( 1900, 2900 ] 5 8.333% 85.000% ## ( 2900, 4400 ] 9 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.3 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 315.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.070 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 305.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.469 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-13:49:08 ... thread 0: (1000000,4000000) ops and (326453.0,327620.0) ops/second in (3.063228,12.209266) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.66 GB 113.3 1.8 0.0 1.8 5.5 3.7 0.0 1.5 103.6 310.8 18.24 16.74 60 0.304 1918K 1886 0.0 0.0 L1 10/0 1.00 GB 102.7 1.9 1.8 0.2 1.9 1.8 0.2 1.1 227.4 226.6 8.71 8.37 3 2.902 2010K 6366 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.8 2.0 258.0 257.8 1.46 1.42 2 0.732 383K 229 0.0 0.0 L3 24/0 973.67 MB 1.0 2.0 0.7 1.2 1.9 0.7 0.5 2.8 222.1 221.7 9.00 8.25 6 1.500 2031K 4133 0.0 0.0 L4 173/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 153.9 153.9 1.46 1.08 1 1.456 227K 0 0.0 0.0 L5 1052/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/8 99.82 GB 0.0 6.3 2.9 3.4 10.0 6.6 3.3 2.7 166.5 263.4 38.87 35.86 72 0.540 6571K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 2.9 3.4 10.0 6.6 3.1 2.7 166.5 263.4 38.87 35.86 72 0.540 6571K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 2.9 3.4 6.3 2.9 0.0 0.0 231.8 231.3 27.92 26.25 19 1.469 6571K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 345.3 10.95 9.61 53 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.2 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.00 GB write, 825.24 MB/s write, 6.32 GB read, 521.63 MB/s read, 38.9 seconds Interval compaction: 10.00 GB write, 838.50 MB/s write, 6.32 GB read, 530.01 MB/s read, 38.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1071762 Average: 2.3406 StdDev: 9.21 Min: 1 Median: 1.5498 Max: 2836 Percentiles: P50: 1.55 P75: 1.93 P99: 5.89 P99.9: 12.18 P99.99: 21.10 ------------------------------------------------------ [ 0, 1 ] 151417 14.128% 14.128% ### ( 1, 2 ] 699339 65.251% 79.379% ############# ( 2, 3 ] 129561 12.089% 91.468% ## ( 3, 4 ] 44574 4.159% 95.627% # ( 4, 6 ] 38344 3.578% 99.204% # ( 6, 10 ] 6799 0.634% 99.839% ( 10, 15 ] 1505 0.140% 99.979% ( 15, 22 ] 134 0.013% 99.992% ( 22, 34 ] 17 0.002% 99.993% ( 34, 51 ] 14 0.001% 99.995% ( 51, 76 ] 5 0.000% 99.995% ( 76, 110 ] 35 0.003% 99.998% ( 110, 170 ] 100 0.009% 100.008% ( 170, 250 ] 67 0.006% 100.014% ( 250, 380 ] 34 0.003% 100.017% ( 380, 580 ] 32 0.003% 100.020% ( 580, 870 ] 31 0.003% 100.023% ( 870, 1300 ] 22 0.002% 100.025% ( 1300, 1900 ] 5 0.000% 100.025% ( 1900, 2900 ] 4 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 239685 Average: 3.0727 StdDev: 16.67 Min: 1 Median: 1.8184 Max: 4030 Percentiles: P50: 1.82 P75: 2.73 P99: 8.18 P99.9: 13.28 P99.99: 14.88 ------------------------------------------------------ [ 0, 1 ] 10503 4.382% 4.382% # ( 1, 2 ] 133594 55.737% 60.119% ########### ( 2, 3 ] 48944 20.420% 80.539% #### ( 3, 4 ] 19611 8.182% 88.721% ## ( 4, 6 ] 22580 9.421% 98.142% ## ( 6, 10 ] 3771 1.573% 99.715% ( 10, 15 ] 674 0.281% 99.997% ( 15, 22 ] 61 0.025% 100.022% ( 22, 34 ] 7 0.003% 100.025% ( 51, 76 ] 1 0.000% 100.025% ( 76, 110 ] 27 0.011% 100.037% ( 110, 170 ] 72 0.030% 100.067% ( 170, 250 ] 40 0.017% 100.083% ( 250, 380 ] 28 0.012% 100.095% ( 380, 580 ] 30 0.013% 100.108% ( 580, 870 ] 9 0.004% 100.111% ( 870, 1300 ] 9 0.004% 100.115% ( 1300, 1900 ] 6 0.003% 100.118% ( 1900, 2900 ] 2 0.001% 100.118% ( 2900, 4400 ] 1 0.000% 100.119% ** Level 2 read latency histogram (micros): Count: 140161 Average: 2.9230 StdDev: 33.76 Min: 1 Median: 1.5309 Max: 6189 Percentiles: P50: 1.53 P75: 1.94 P99: 7.86 P99.9: 167.25 P99.99: 922.88 ------------------------------------------------------ [ 0, 1 ] 24362 17.381% 17.381% ### ( 1, 2 ] 86112 61.438% 78.819% ############ ( 2, 3 ] 15520 11.073% 89.892% ## ( 3, 4 ] 6253 4.461% 94.354% # ( 4, 6 ] 5791 4.132% 98.485% # ( 6, 10 ] 1548 1.104% 99.590% ( 10, 15 ] 306 0.218% 99.808% ( 15, 22 ] 35 0.025% 99.833% ( 22, 34 ] 4 0.003% 99.836% ( 34, 51 ] 1 0.001% 99.837% ( 51, 76 ] 1 0.001% 99.837% ( 76, 110 ] 22 0.016% 99.853% ( 110, 170 ] 69 0.049% 99.902% ( 170, 250 ] 32 0.023% 99.925% ( 250, 380 ] 37 0.026% 99.951% ( 380, 580 ] 36 0.026% 99.977% ( 580, 870 ] 17 0.012% 99.989% ( 870, 1300 ] 8 0.006% 99.995% ( 1300, 1900 ] 2 0.001% 99.996% ( 2900, 4400 ] 1 0.001% 99.997% ( 4400, 6600 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 255375 Average: 3.9746 StdDev: 58.16 Min: 0 Median: 1.6815 Max: 7984 Percentiles: P50: 1.68 P75: 2.37 P99: 9.22 P99.9: 225.49 P99.99: 675.22 ------------------------------------------------------ [ 0, 1 ] 23514 9.208% 9.208% ## ( 1, 2 ] 152867 59.860% 69.067% ############ ( 2, 3 ] 40861 16.000% 85.068% ### ( 3, 4 ] 16218 6.351% 91.419% # ( 4, 6 ] 15556 6.091% 97.510% # ( 6, 10 ] 4727 1.851% 99.361% ( 10, 15 ] 824 0.323% 99.684% ( 15, 22 ] 93 0.036% 99.720% ( 22, 34 ] 11 0.004% 99.724% ( 34, 51 ] 6 0.002% 99.727% ( 76, 110 ] 104 0.041% 99.767% ( 110, 170 ] 254 0.099% 99.867% ( 170, 250 ] 122 0.048% 99.915% ( 250, 380 ] 101 0.040% 99.954% ( 380, 580 ] 78 0.031% 99.985% ( 580, 870 ] 41 0.016% 100.001% ( 870, 1300 ] 25 0.010% 100.011% ( 1300, 1900 ] 11 0.004% 100.015% ( 1900, 2900 ] 10 0.004% 100.019% ( 2900, 4400 ] 12 0.005% 100.023% ( 4400, 6600 ] 10 0.004% 100.027% ( 6600, 9900 ] 5 0.002% 100.029% ** Level 4 read latency histogram (micros): Count: 310 Average: 284.1097 StdDev: 1148.22 Min: 1 Median: 1.9339 Max: 7885 Percentiles: P50: 1.93 P75: 7.43 P99: 6568.57 P99.9: 7885.00 P99.99: 7885.00 ------------------------------------------------------ [ 0, 1 ] 42 13.548% 13.548% ### ( 1, 2 ] 121 39.032% 52.581% ######## ( 2, 3 ] 44 14.194% 66.774% ### ( 3, 4 ] 10 3.226% 70.000% # ( 4, 6 ] 13 4.194% 74.194% # ( 6, 10 ] 7 2.258% 76.452% ( 10, 15 ] 34 10.968% 87.419% ## ( 15, 22 ] 9 2.903% 90.323% # ( 22, 34 ] 1 0.323% 90.645% ( 76, 110 ] 1 0.323% 90.968% ( 110, 170 ] 3 0.968% 91.935% ( 170, 250 ] 1 0.323% 92.258% ( 250, 380 ] 1 0.323% 92.581% ( 380, 580 ] 2 0.645% 93.226% ( 580, 870 ] 1 0.323% 93.548% ( 1300, 1900 ] 4 1.290% 94.839% ( 1900, 2900 ] 3 0.968% 95.806% ( 2900, 4400 ] 3 0.968% 96.774% ( 4400, 6600 ] 7 2.258% 99.032% ( 6600, 9900 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 1027.7167 StdDev: 1207.62 Min: 103 Median: 405.0000 Max: 4209 Percentiles: P50: 405.00 P75: 1600.00 P99: 4209.00 P99.9: 4209.00 P99.99: 4209.00 ------------------------------------------------------ ( 76, 110 ] 2 3.333% 3.333% # ( 110, 170 ] 10 16.667% 20.000% ### ( 170, 250 ] 10 16.667% 36.667% ### ( 250, 380 ] 7 11.667% 48.333% ## ( 380, 580 ] 8 13.333% 61.667% ### ( 580, 870 ] 5 8.333% 70.000% ## ( 870, 1300 ] 2 3.333% 73.333% # ( 1300, 1900 ] 2 3.333% 76.667% # ( 1900, 2900 ] 5 8.333% 85.000% ## ( 2900, 4400 ] 9 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.4 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 317.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.456 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.386 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-13:49:11 ... thread 0: (1000000,5000000) ops and (331981.5,328483.1) ops/second in (3.012216,15.221482) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.64 GB 44.1 2.6 0.0 2.6 7.3 4.7 0.0 1.6 112.7 311.7 24.04 22.22 77 0.312 2750K 2669 0.0 0.0 L1 10/10 1.00 GB 0.0 1.9 1.8 0.2 1.9 1.8 0.2 1.1 227.4 226.6 8.71 8.37 3 2.902 2010K 6366 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.8 2.0 258.0 257.8 1.46 1.42 2 0.732 383K 229 0.0 0.0 L3 24/0 973.67 MB 1.0 2.0 0.7 1.2 1.9 0.7 0.5 2.8 222.1 221.7 9.00 8.25 6 1.500 2031K 4133 0.0 0.0 L4 173/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 153.9 153.9 1.46 1.08 1 1.456 227K 0 0.0 0.0 L5 1052/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1276/24 100.80 GB 0.0 7.1 2.9 4.2 11.8 7.6 3.3 2.5 163.2 270.1 44.67 41.33 89 0.502 7403K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.1 2.9 4.2 11.8 7.6 3.1 2.5 163.2 270.1 44.67 41.33 89 0.502 7403K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.1 2.9 4.2 7.1 2.9 0.0 0.0 235.6 235.2 30.94 29.23 22 1.407 7403K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 348.8 13.72 12.11 67 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.2 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.78 GB write, 782.46 MB/s write, 7.12 GB read, 472.84 MB/s read, 44.7 seconds Interval compaction: 11.78 GB write, 792.53 MB/s write, 7.12 GB read, 478.93 MB/s read, 44.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1314605 Average: 2.3009 StdDev: 10.15 Min: 1 Median: 1.5293 Max: 3428 Percentiles: P50: 1.53 P75: 1.91 P99: 5.84 P99.9: 11.97 P99.99: 20.94 ------------------------------------------------------ [ 0, 1 ] 199587 15.182% 15.182% ### ( 1, 2 ] 864821 65.786% 80.968% ############# ( 2, 3 ] 148475 11.294% 92.262% ## ( 3, 4 ] 49934 3.798% 96.061% # ( 4, 6 ] 42114 3.204% 99.264% # ( 6, 10 ] 7671 0.584% 99.848% ( 10, 15 ] 1746 0.133% 99.980% ( 15, 22 ] 149 0.011% 99.992% ( 22, 34 ] 18 0.001% 99.993% ( 34, 51 ] 15 0.001% 99.994% ( 51, 76 ] 6 0.000% 99.995% ( 76, 110 ] 38 0.003% 99.998% ( 110, 170 ] 109 0.008% 100.006% ( 170, 250 ] 79 0.006% 100.012% ( 250, 380 ] 38 0.003% 100.015% ( 380, 580 ] 37 0.003% 100.018% ( 580, 870 ] 36 0.003% 100.020% ( 870, 1300 ] 27 0.002% 100.022% ( 1300, 1900 ] 8 0.001% 100.023% ( 1900, 2900 ] 5 0.000% 100.023% ( 2900, 4400 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 276699 Average: 3.0136 StdDev: 16.03 Min: 1 Median: 1.7612 Max: 4030 Percentiles: P50: 1.76 P75: 2.61 P99: 8.30 P99.9: 14.14 P99.99: 91.92 ------------------------------------------------------ [ 0, 1 ] 17743 6.412% 6.412% # ( 1, 2 ] 158440 57.261% 63.673% ########### ( 2, 3 ] 51731 18.696% 82.369% #### ( 3, 4 ] 20337 7.350% 89.719% # ( 4, 6 ] 23153 8.368% 98.086% ## ( 6, 10 ] 4389 1.586% 99.673% ( 10, 15 ] 760 0.275% 99.947% ( 15, 22 ] 70 0.025% 99.973% ( 22, 34 ] 7 0.003% 99.975% ( 51, 76 ] 2 0.001% 99.976% ( 76, 110 ] 84 0.030% 100.006% ( 110, 170 ] 116 0.042% 100.048% ( 170, 250 ] 53 0.019% 100.067% ( 250, 380 ] 34 0.012% 100.080% ( 380, 580 ] 37 0.013% 100.093% ( 580, 870 ] 10 0.004% 100.096% ( 870, 1300 ] 9 0.003% 100.100% ( 1300, 1900 ] 6 0.002% 100.102% ( 1900, 2900 ] 2 0.001% 100.103% ( 2900, 4400 ] 1 0.000% 100.103% ** Level 2 read latency histogram (micros): Count: 140161 Average: 2.9230 StdDev: 33.76 Min: 1 Median: 1.5309 Max: 6189 Percentiles: P50: 1.53 P75: 1.94 P99: 7.86 P99.9: 167.25 P99.99: 922.88 ------------------------------------------------------ [ 0, 1 ] 24362 17.381% 17.381% ### ( 1, 2 ] 86112 61.438% 78.819% ############ ( 2, 3 ] 15520 11.073% 89.892% ## ( 3, 4 ] 6253 4.461% 94.354% # ( 4, 6 ] 5791 4.132% 98.485% # ( 6, 10 ] 1548 1.104% 99.590% ( 10, 15 ] 306 0.218% 99.808% ( 15, 22 ] 35 0.025% 99.833% ( 22, 34 ] 4 0.003% 99.836% ( 34, 51 ] 1 0.001% 99.837% ( 51, 76 ] 1 0.001% 99.837% ( 76, 110 ] 22 0.016% 99.853% ( 110, 170 ] 69 0.049% 99.902% ( 170, 250 ] 32 0.023% 99.925% ( 250, 380 ] 37 0.026% 99.951% ( 380, 580 ] 36 0.026% 99.977% ( 580, 870 ] 17 0.012% 99.989% ( 870, 1300 ] 8 0.006% 99.995% ( 1300, 1900 ] 2 0.001% 99.996% ( 2900, 4400 ] 1 0.001% 99.997% ( 4400, 6600 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 255375 Average: 3.9746 StdDev: 58.16 Min: 0 Median: 1.6815 Max: 7984 Percentiles: P50: 1.68 P75: 2.37 P99: 9.22 P99.9: 225.49 P99.99: 675.22 ------------------------------------------------------ [ 0, 1 ] 23514 9.208% 9.208% ## ( 1, 2 ] 152867 59.860% 69.067% ############ ( 2, 3 ] 40861 16.000% 85.068% ### ( 3, 4 ] 16218 6.351% 91.419% # ( 4, 6 ] 15556 6.091% 97.510% # ( 6, 10 ] 4727 1.851% 99.361% ( 10, 15 ] 824 0.323% 99.684% ( 15, 22 ] 93 0.036% 99.720% ( 22, 34 ] 11 0.004% 99.724% ( 34, 51 ] 6 0.002% 99.727% ( 76, 110 ] 104 0.041% 99.767% ( 110, 170 ] 254 0.099% 99.867% ( 170, 250 ] 122 0.048% 99.915% ( 250, 380 ] 101 0.040% 99.954% ( 380, 580 ] 78 0.031% 99.985% ( 580, 870 ] 41 0.016% 100.001% ( 870, 1300 ] 25 0.010% 100.011% ( 1300, 1900 ] 11 0.004% 100.015% ( 1900, 2900 ] 10 0.004% 100.019% ( 2900, 4400 ] 12 0.005% 100.023% ( 4400, 6600 ] 10 0.004% 100.027% ( 6600, 9900 ] 5 0.002% 100.029% ** Level 4 read latency histogram (micros): Count: 310 Average: 284.1097 StdDev: 1148.22 Min: 1 Median: 1.9339 Max: 7885 Percentiles: P50: 1.93 P75: 7.43 P99: 6568.57 P99.9: 7885.00 P99.99: 7885.00 ------------------------------------------------------ [ 0, 1 ] 42 13.548% 13.548% ### ( 1, 2 ] 121 39.032% 52.581% ######## ( 2, 3 ] 44 14.194% 66.774% ### ( 3, 4 ] 10 3.226% 70.000% # ( 4, 6 ] 13 4.194% 74.194% # ( 6, 10 ] 7 2.258% 76.452% ( 10, 15 ] 34 10.968% 87.419% ## ( 15, 22 ] 9 2.903% 90.323% # ( 22, 34 ] 1 0.323% 90.645% ( 76, 110 ] 1 0.323% 90.968% ( 110, 170 ] 3 0.968% 91.935% ( 170, 250 ] 1 0.323% 92.258% ( 250, 380 ] 1 0.323% 92.581% ( 380, 580 ] 2 0.645% 93.226% ( 580, 870 ] 1 0.323% 93.548% ( 1300, 1900 ] 4 1.290% 94.839% ( 1900, 2900 ] 3 0.968% 95.806% ( 2900, 4400 ] 3 0.968% 96.774% ( 4400, 6600 ] 7 2.258% 99.032% ( 6600, 9900 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 1027.7167 StdDev: 1207.62 Min: 103 Median: 405.0000 Max: 4209 Percentiles: P50: 405.00 P75: 1600.00 P99: 4209.00 P99.9: 4209.00 P99.99: 4209.00 ------------------------------------------------------ ( 76, 110 ] 2 3.333% 3.333% # ( 110, 170 ] 10 16.667% 20.000% ### ( 170, 250 ] 10 16.667% 36.667% ### ( 250, 380 ] 7 11.667% 48.333% ## ( 380, 580 ] 8 13.333% 61.667% ### ( 580, 870 ] 5 8.333% 70.000% ## ( 870, 1300 ] 2 3.333% 73.333% # ( 1300, 1900 ] 2 3.333% 76.667% # ( 1900, 2900 ] 5 8.333% 85.000% ## ( 2900, 4400 ] 9 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 15.4 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 319.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.825 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.369 H:M:S, 12.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-13:49:16 ... thread 0: (1000000,6000000) ops and (189905.1,292864.8) ops/second in (5.265788,20.487270) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.69 GB 94.4 3.9 0.0 3.9 9.7 5.7 0.0 1.7 125.9 308.8 32.02 29.77 98 0.327 4093K 3980 0.0 0.0 L1 10/10 1.00 GB 0.0 1.9 1.8 0.2 1.9 1.8 0.2 1.1 227.4 226.6 8.71 8.37 3 2.902 2010K 6366 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.8 2.0 258.0 257.8 1.46 1.42 2 0.732 383K 229 0.0 0.0 L3 24/0 973.67 MB 1.0 2.0 0.7 1.2 1.9 0.7 0.5 2.8 222.1 221.7 9.00 8.25 6 1.500 2031K 4133 0.0 0.0 L4 173/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 153.9 153.9 1.46 1.08 1 1.456 227K 0 0.0 0.0 L5 1052/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/24 101.84 GB 0.0 8.4 2.9 5.5 14.1 8.6 3.3 2.5 163.6 274.6 52.65 48.89 110 0.479 8746K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.4 2.9 5.5 14.1 8.6 3.1 2.5 163.6 274.6 52.65 48.89 110 0.479 8746K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.4 2.9 5.5 8.4 2.9 0.0 0.0 240.2 239.8 35.85 34.05 27 1.328 8746K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 348.8 16.80 14.84 83 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.7 total, 20.5 interval Flush(GB): cumulative 5.722, interval 5.722 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.12 GB write, 698.93 MB/s write, 8.41 GB read, 416.43 MB/s read, 52.6 seconds Interval compaction: 14.12 GB write, 705.62 MB/s write, 8.41 GB read, 420.42 MB/s read, 52.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 15, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1847611 Average: 2.2973 StdDev: 9.95 Min: 1 Median: 1.5211 Max: 3428 Percentiles: P50: 1.52 P75: 1.90 P99: 5.81 P99.9: 11.97 P99.99: 109.38 ------------------------------------------------------ [ 0, 1 ] 282015 15.264% 15.264% ### ( 1, 2 ] 1231605 66.659% 81.923% ############# ( 2, 3 ] 200576 10.856% 92.779% ## ( 3, 4 ] 66427 3.595% 96.374% # ( 4, 6 ] 53537 2.898% 99.272% # ( 6, 10 ] 10737 0.581% 99.853% ( 10, 15 ] 2197 0.119% 99.972% ( 15, 22 ] 186 0.010% 99.982% ( 22, 34 ] 25 0.001% 99.983% ( 34, 51 ] 16 0.001% 99.984% ( 51, 76 ] 11 0.001% 99.985% ( 76, 110 ] 97 0.005% 99.990% ( 110, 170 ] 241 0.013% 100.003% ( 170, 250 ] 146 0.008% 100.011% ( 250, 380 ] 71 0.004% 100.015% ( 380, 580 ] 69 0.004% 100.019% ( 580, 870 ] 58 0.003% 100.022% ( 870, 1300 ] 35 0.002% 100.024% ( 1300, 1900 ] 10 0.001% 100.024% ( 1900, 2900 ] 6 0.000% 100.025% ( 2900, 4400 ] 2 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 367340 Average: 2.9176 StdDev: 16.63 Min: 1 Median: 1.6939 Max: 4030 Percentiles: P50: 1.69 P75: 2.40 P99: 8.30 P99.9: 14.89 P99.99: 133.51 ------------------------------------------------------ [ 0, 1 ] 30743 8.369% 8.369% ## ( 1, 2 ] 220386 59.995% 68.364% ############ ( 2, 3 ] 61010 16.609% 84.973% ### ( 3, 4 ] 22976 6.255% 91.227% # ( 4, 6 ] 25184 6.856% 98.083% # ( 6, 10 ] 5850 1.593% 99.676% ( 10, 15 ] 842 0.229% 99.905% ( 15, 22 ] 80 0.022% 99.927% ( 22, 34 ] 7 0.002% 99.929% ( 34, 51 ] 1 0.000% 99.929% ( 51, 76 ] 2 0.001% 99.929% ( 76, 110 ] 149 0.041% 99.970% ( 110, 170 ] 187 0.051% 100.021% ( 170, 250 ] 81 0.022% 100.043% ( 250, 380 ] 48 0.013% 100.056% ( 380, 580 ] 47 0.013% 100.069% ( 580, 870 ] 12 0.003% 100.072% ( 870, 1300 ] 9 0.002% 100.075% ( 1300, 1900 ] 6 0.002% 100.076% ( 1900, 2900 ] 3 0.001% 100.077% ( 2900, 4400 ] 2 0.001% 100.078% ** Level 2 read latency histogram (micros): Count: 140161 Average: 2.9230 StdDev: 33.76 Min: 1 Median: 1.5309 Max: 6189 Percentiles: P50: 1.53 P75: 1.94 P99: 7.86 P99.9: 167.25 P99.99: 922.88 ------------------------------------------------------ [ 0, 1 ] 24362 17.381% 17.381% ### ( 1, 2 ] 86112 61.438% 78.819% ############ ( 2, 3 ] 15520 11.073% 89.892% ## ( 3, 4 ] 6253 4.461% 94.354% # ( 4, 6 ] 5791 4.132% 98.485% # ( 6, 10 ] 1548 1.104% 99.590% ( 10, 15 ] 306 0.218% 99.808% ( 15, 22 ] 35 0.025% 99.833% ( 22, 34 ] 4 0.003% 99.836% ( 34, 51 ] 1 0.001% 99.837% ( 51, 76 ] 1 0.001% 99.837% ( 76, 110 ] 22 0.016% 99.853% ( 110, 170 ] 69 0.049% 99.902% ( 170, 250 ] 32 0.023% 99.925% ( 250, 380 ] 37 0.026% 99.951% ( 380, 580 ] 36 0.026% 99.977% ( 580, 870 ] 17 0.012% 99.989% ( 870, 1300 ] 8 0.006% 99.995% ( 1300, 1900 ] 2 0.001% 99.996% ( 2900, 4400 ] 1 0.001% 99.997% ( 4400, 6600 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 255375 Average: 3.9746 StdDev: 58.16 Min: 0 Median: 1.6815 Max: 7984 Percentiles: P50: 1.68 P75: 2.37 P99: 9.22 P99.9: 225.49 P99.99: 675.22 ------------------------------------------------------ [ 0, 1 ] 23514 9.208% 9.208% ## ( 1, 2 ] 152867 59.860% 69.067% ############ ( 2, 3 ] 40861 16.000% 85.068% ### ( 3, 4 ] 16218 6.351% 91.419% # ( 4, 6 ] 15556 6.091% 97.510% # ( 6, 10 ] 4727 1.851% 99.361% ( 10, 15 ] 824 0.323% 99.684% ( 15, 22 ] 93 0.036% 99.720% ( 22, 34 ] 11 0.004% 99.724% ( 34, 51 ] 6 0.002% 99.727% ( 76, 110 ] 104 0.041% 99.767% ( 110, 170 ] 254 0.099% 99.867% ( 170, 250 ] 122 0.048% 99.915% ( 250, 380 ] 101 0.040% 99.954% ( 380, 580 ] 78 0.031% 99.985% ( 580, 870 ] 41 0.016% 100.001% ( 870, 1300 ] 25 0.010% 100.011% ( 1300, 1900 ] 11 0.004% 100.015% ( 1900, 2900 ] 10 0.004% 100.019% ( 2900, 4400 ] 12 0.005% 100.023% ( 4400, 6600 ] 10 0.004% 100.027% ( 6600, 9900 ] 5 0.002% 100.029% ** Level 4 read latency histogram (micros): Count: 310 Average: 284.1097 StdDev: 1148.22 Min: 1 Median: 1.9339 Max: 7885 Percentiles: P50: 1.93 P75: 7.43 P99: 6568.57 P99.9: 7885.00 P99.99: 7885.00 ------------------------------------------------------ [ 0, 1 ] 42 13.548% 13.548% ### ( 1, 2 ] 121 39.032% 52.581% ######## ( 2, 3 ] 44 14.194% 66.774% ### ( 3, 4 ] 10 3.226% 70.000% # ( 4, 6 ] 13 4.194% 74.194% # ( 6, 10 ] 7 2.258% 76.452% ( 10, 15 ] 34 10.968% 87.419% ## ( 15, 22 ] 9 2.903% 90.323% # ( 22, 34 ] 1 0.323% 90.645% ( 76, 110 ] 1 0.323% 90.968% ( 110, 170 ] 3 0.968% 91.935% ( 170, 250 ] 1 0.323% 92.258% ( 250, 380 ] 1 0.323% 92.581% ( 380, 580 ] 2 0.645% 93.226% ( 580, 870 ] 1 0.323% 93.548% ( 1300, 1900 ] 4 1.290% 94.839% ( 1900, 2900 ] 3 0.968% 95.806% ( 2900, 4400 ] 3 0.968% 96.774% ( 4400, 6600 ] 7 2.258% 99.032% ( 6600, 9900 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 1027.7167 StdDev: 1207.62 Min: 103 Median: 405.0000 Max: 4209 Percentiles: P50: 405.00 P75: 1600.00 P99: 4209.00 P99.9: 4209.00 P99.99: 4209.00 ------------------------------------------------------ ( 76, 110 ] 2 3.333% 3.333% # ( 110, 170 ] 10 16.667% 20.000% ### ( 170, 250 ] 10 16.667% 36.667% ### ( 250, 380 ] 7 11.667% 48.333% ## ( 380, 580 ] 8 13.333% 61.667% ### ( 580, 870 ] 5 8.333% 70.000% ## ( 870, 1300 ] 2 3.333% 73.333% # ( 1300, 1900 ] 2 3.333% 76.667% # ( 1900, 2900 ] 5 8.333% 85.000% ## ( 2900, 4400 ] 9 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 20.7 total, 5.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 285.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.283 H:M:S, 20.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 186.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.458 H:M:S, 46.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/27-13:49:24 ... thread 0: (1000000,7000000) ops and (119310.1,242476.4) ops/second in (8.381520,28.868790) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 2.64 GB 25.2 5.2 0.0 5.2 11.9 6.6 0.0 1.8 134.1 304.3 39.93 37.04 115 0.347 5436K 6988 0.0 0.0 L1 26/26 2.23 GB 0.0 4.9 3.8 1.2 4.9 3.7 0.2 1.3 225.6 223.5 22.26 21.33 4 5.564 5098K 45K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.5 2.0 258.0 257.8 1.46 1.42 2 0.732 383K 229 0.0 0.0 L3 24/0 991.35 MB 1.0 2.9 1.4 1.5 2.9 1.4 0.5 2.0 217.6 216.8 13.58 12.44 10 1.358 3001K 11K 0.0 0.0 L4 177/0 9.59 GB 1.0 0.8 0.7 0.0 0.8 0.7 0.9 1.0 128.0 127.8 6.22 3.75 10 0.622 808K 1431 0.0 0.0 L5 1060/0 87.29 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1300/36 102.72 GB 0.0 14.2 6.1 8.1 20.7 12.7 4.8 3.1 173.8 254.5 83.45 75.98 141 0.592 14M 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.2 6.1 8.1 20.7 12.7 4.7 3.1 173.8 254.5 83.45 75.98 141 0.592 14M 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.2 6.1 8.1 14.1 6.0 0.0 0.0 228.1 227.0 63.59 58.66 44 1.445 14M 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 342.6 19.86 17.32 97 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.1 total, 28.9 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.74 GB write, 730.82 MB/s write, 14.16 GB read, 499.02 MB/s read, 83.5 seconds Interval compaction: 20.74 GB write, 735.78 MB/s write, 14.16 GB read, 502.41 MB/s read, 83.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 17, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2501438 Average: 2.3898 StdDev: 14.58 Min: 1 Median: 1.5180 Max: 6469 Percentiles: P50: 1.52 P75: 1.89 P99: 5.90 P99.9: 13.30 P99.99: 202.84 ------------------------------------------------------ [ 0, 1 ] 385202 15.399% 15.399% ### ( 1, 2 ] 1670819 66.794% 82.194% ############# ( 2, 3 ] 264056 10.556% 92.750% ## ( 3, 4 ] 88348 3.532% 96.282% # ( 4, 6 ] 71763 2.869% 99.150% # ( 6, 10 ] 16818 0.672% 99.823% ( 10, 15 ] 2926 0.117% 99.940% ( 15, 22 ] 269 0.011% 99.951% ( 22, 34 ] 28 0.001% 99.952% ( 34, 51 ] 17 0.001% 99.952% ( 51, 76 ] 12 0.000% 99.953% ( 76, 110 ] 277 0.011% 99.964% ( 110, 170 ] 517 0.021% 99.985% ( 170, 250 ] 331 0.013% 99.998% ( 250, 380 ] 193 0.008% 100.006% ( 380, 580 ] 188 0.008% 100.013% ( 580, 870 ] 123 0.005% 100.018% ( 870, 1300 ] 64 0.003% 100.021% ( 1300, 1900 ] 15 0.001% 100.021% ( 1900, 2900 ] 11 0.000% 100.022% ( 2900, 4400 ] 4 0.000% 100.022% ( 4400, 6600 ] 5 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 682265 Average: 3.1194 StdDev: 19.56 Min: 0 Median: 1.6889 Max: 4030 Percentiles: P50: 1.69 P75: 2.39 P99: 8.64 P99.9: 89.32 P99.99: 167.01 ------------------------------------------------------ [ 0, 1 ] 57907 8.487% 8.487% ## ( 1, 2 ] 411107 60.256% 68.744% ############ ( 2, 3 ] 110181 16.149% 84.893% ### ( 3, 4 ] 43308 6.348% 91.241% # ( 4, 6 ] 45100 6.610% 97.851% # ( 6, 10 ] 11899 1.744% 99.595% ( 10, 15 ] 1732 0.254% 99.849% ( 15, 22 ] 196 0.029% 99.878% ( 22, 34 ] 13 0.002% 99.880% ( 34, 51 ] 2 0.000% 99.880% ( 51, 76 ] 3 0.000% 99.880% ( 76, 110 ] 344 0.050% 99.931% ( 110, 170 ] 426 0.062% 99.993% ( 170, 250 ] 215 0.032% 100.025% ( 250, 380 ] 157 0.023% 100.048% ( 380, 580 ] 148 0.022% 100.069% ( 580, 870 ] 63 0.009% 100.079% ( 870, 1300 ] 31 0.005% 100.083% ( 1300, 1900 ] 19 0.003% 100.086% ( 1900, 2900 ] 7 0.001% 100.087% ( 2900, 4400 ] 3 0.000% 100.087% ** Level 2 read latency histogram (micros): Count: 140161 Average: 2.9230 StdDev: 33.76 Min: 1 Median: 1.5309 Max: 6189 Percentiles: P50: 1.53 P75: 1.94 P99: 7.86 P99.9: 167.25 P99.99: 922.88 ------------------------------------------------------ [ 0, 1 ] 24362 17.381% 17.381% ### ( 1, 2 ] 86112 61.438% 78.819% ############ ( 2, 3 ] 15520 11.073% 89.892% ## ( 3, 4 ] 6253 4.461% 94.354% # ( 4, 6 ] 5791 4.132% 98.485% # ( 6, 10 ] 1548 1.104% 99.590% ( 10, 15 ] 306 0.218% 99.808% ( 15, 22 ] 35 0.025% 99.833% ( 22, 34 ] 4 0.003% 99.836% ( 34, 51 ] 1 0.001% 99.837% ( 51, 76 ] 1 0.001% 99.837% ( 76, 110 ] 22 0.016% 99.853% ( 110, 170 ] 69 0.049% 99.902% ( 170, 250 ] 32 0.023% 99.925% ( 250, 380 ] 37 0.026% 99.951% ( 380, 580 ] 36 0.026% 99.977% ( 580, 870 ] 17 0.012% 99.989% ( 870, 1300 ] 8 0.006% 99.995% ( 1300, 1900 ] 2 0.001% 99.996% ( 2900, 4400 ] 1 0.001% 99.997% ( 4400, 6600 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 450813 Average: 4.0474 StdDev: 55.43 Min: 0 Median: 1.7964 Max: 7984 Percentiles: P50: 1.80 P75: 2.71 P99: 8.79 P99.9: 116.52 P99.99: 235.46 ------------------------------------------------------ [ 0, 1 ] 27594 6.121% 6.121% # ( 1, 2 ] 248379 55.096% 61.217% ########### ( 2, 3 ] 87156 19.333% 80.550% #### ( 3, 4 ] 38048 8.440% 88.990% ## ( 4, 6 ] 39297 8.717% 97.707% ## ( 6, 10 ] 8345 1.851% 99.558% ( 10, 15 ] 1228 0.272% 99.830% ( 15, 22 ] 162 0.036% 99.866% ( 22, 34 ] 13 0.003% 99.869% ( 34, 51 ] 6 0.001% 99.870% ( 76, 110 ] 104 0.023% 99.893% ( 110, 170 ] 278 0.062% 99.955% ( 170, 250 ] 193 0.043% 99.998% ( 250, 380 ] 180 0.040% 100.038% ( 380, 580 ] 140 0.031% 100.069% ( 580, 870 ] 84 0.019% 100.087% ( 870, 1300 ] 40 0.009% 100.096% ( 1300, 1900 ] 13 0.003% 100.099% ( 1900, 2900 ] 10 0.002% 100.101% ( 2900, 4400 ] 38 0.008% 100.110% ( 4400, 6600 ] 11 0.002% 100.112% ( 6600, 9900 ] 5 0.001% 100.113% ** Level 4 read latency histogram (micros): Count: 9410 Average: 44.7051 StdDev: 302.41 Min: 1 Median: 2.0708 Max: 7916 Percentiles: P50: 2.07 P75: 3.40 P99: 800.34 P99.9: 4837.25 P99.99: 7732.45 ------------------------------------------------------ [ 0, 1 ] 317 3.369% 3.369% # ( 1, 2 ] 4242 45.080% 48.448% ######### ( 2, 3 ] 2062 21.913% 70.361% #### ( 3, 4 ] 1103 11.722% 82.083% ## ( 4, 6 ] 808 8.587% 90.670% ## ( 6, 10 ] 156 1.658% 92.327% ( 10, 15 ] 85 0.903% 93.231% ( 15, 22 ] 11 0.117% 93.348% ( 22, 34 ] 3 0.032% 93.379% ( 51, 76 ] 1 0.011% 93.390% ( 76, 110 ] 16 0.170% 93.560% ( 110, 170 ] 81 0.861% 94.421% ( 170, 250 ] 92 0.978% 95.399% ( 250, 380 ] 116 1.233% 96.631% ( 380, 580 ] 153 1.626% 98.257% ( 580, 870 ] 92 0.978% 99.235% ( 870, 1300 ] 33 0.351% 99.586% ( 1300, 1900 ] 12 0.128% 99.713% ( 1900, 2900 ] 9 0.096% 99.809% ( 2900, 4400 ] 7 0.074% 99.883% ( 4400, 6600 ] 8 0.085% 99.968% ( 6600, 9900 ] 6 0.064% 100.032% ** Level 5 read latency histogram (micros): Count: 100 Average: 1024.8500 StdDev: 1227.51 Min: 93 Median: 413.3333 Max: 4767 Percentiles: P50: 413.33 P75: 1500.00 P99: 4400.00 P99.9: 4767.00 P99.99: 4767.00 ------------------------------------------------------ ( 76, 110 ] 4 4.000% 4.000% # ( 110, 170 ] 19 19.000% 23.000% #### ( 170, 250 ] 15 15.000% 38.000% ### ( 250, 380 ] 10 10.000% 48.000% ## ( 380, 580 ] 12 12.000% 60.000% ## ( 580, 870 ] 8 8.000% 68.000% ## ( 870, 1300 ] 6 6.000% 74.000% # ( 1300, 1900 ] 3 3.000% 77.000% # ( 1900, 2900 ] 10 10.000% 87.000% ## ( 2900, 4400 ] 12 12.000% 99.000% ## ( 4400, 6600 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 29.1 total, 8.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 237.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.557 H:M:S, 32.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 117.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.273 H:M:S, 62.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-13:49:28 ... thread 0: (1000000,8000000) ops and (307295.3,249042.8) ops/second in (3.254199,32.122989) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.62 GB 94.4 6.1 0.0 6.1 13.7 7.6 0.0 1.8 135.2 304.4 46.12 42.86 132 0.349 6332K 8021 0.0 0.0 L1 26/26 2.23 GB 0.0 4.9 3.8 1.2 4.9 3.7 0.2 1.3 225.6 223.5 22.26 21.33 4 5.564 5098K 45K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.5 2.0 258.0 257.8 1.46 1.42 2 0.732 383K 229 0.0 0.0 L3 24/0 991.35 MB 1.0 2.9 1.4 1.5 2.9 1.4 0.5 2.0 217.6 216.8 13.58 12.44 10 1.358 3001K 11K 0.0 0.0 L4 177/0 9.59 GB 1.0 0.8 0.7 0.0 0.8 0.7 0.9 1.0 128.0 127.8 6.22 3.75 10 0.622 808K 1431 0.0 0.0 L5 1060/0 87.29 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/40 103.70 GB 0.0 15.0 6.1 8.9 22.6 13.6 4.8 3.0 171.6 258.0 89.64 81.79 158 0.567 15M 66K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.0 6.1 8.9 22.6 13.6 4.7 3.0 171.6 258.0 89.64 81.79 158 0.567 15M 66K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.0 6.1 8.9 15.0 6.0 0.0 0.0 229.9 228.9 66.92 61.92 47 1.424 15M 66K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 343.7 22.73 19.87 111 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.3 total, 32.1 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.59 GB write, 715.68 MB/s write, 15.03 GB read, 476.07 MB/s read, 89.6 seconds Interval compaction: 22.59 GB write, 720.05 MB/s write, 15.03 GB read, 478.97 MB/s read, 89.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 21, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2858038 Average: 2.3889 StdDev: 14.33 Min: 1 Median: 1.5214 Max: 6469 Percentiles: P50: 1.52 P75: 1.89 P99: 5.90 P99.9: 13.22 P99.99: 190.32 ------------------------------------------------------ [ 0, 1 ] 431093 15.084% 15.084% ### ( 1, 2 ] 1914103 66.973% 82.056% ############# ( 2, 3 ] 306173 10.713% 92.769% ## ( 3, 4 ] 100660 3.522% 96.291% # ( 4, 6 ] 81498 2.852% 99.142% # ( 6, 10 ] 19397 0.679% 99.821% ( 10, 15 ] 3500 0.122% 99.944% ( 15, 22 ] 305 0.011% 99.954% ( 22, 34 ] 30 0.001% 99.955% ( 34, 51 ] 21 0.001% 99.956% ( 51, 76 ] 14 0.000% 99.956% ( 76, 110 ] 288 0.010% 99.967% ( 110, 170 ] 579 0.020% 99.987% ( 170, 250 ] 363 0.013% 100.000% ( 250, 380 ] 218 0.008% 100.007% ( 380, 580 ] 210 0.007% 100.014% ( 580, 870 ] 138 0.005% 100.019% ( 870, 1300 ] 70 0.002% 100.022% ( 1300, 1900 ] 17 0.001% 100.022% ( 1900, 2900 ] 12 0.000% 100.023% ( 2900, 4400 ] 6 0.000% 100.023% ( 4400, 6600 ] 5 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 751967 Average: 3.1081 StdDev: 19.10 Min: 0 Median: 1.6802 Max: 4030 Percentiles: P50: 1.68 P75: 2.35 P99: 8.68 P99.9: 101.36 P99.99: 180.02 ------------------------------------------------------ [ 0, 1 ] 64344 8.557% 8.557% ## ( 1, 2 ] 458183 60.931% 69.488% ############ ( 2, 3 ] 119957 15.952% 85.440% ### ( 3, 4 ] 45797 6.090% 91.531% # ( 4, 6 ] 47339 6.295% 97.826% # ( 6, 10 ] 13187 1.754% 99.580% ( 10, 15 ] 1863 0.248% 99.828% ( 15, 22 ] 203 0.027% 99.855% ( 22, 34 ] 15 0.002% 99.857% ( 34, 51 ] 4 0.001% 99.857% ( 51, 76 ] 4 0.001% 99.858% ( 76, 110 ] 429 0.057% 99.915% ( 110, 170 ] 538 0.072% 99.986% ( 170, 250 ] 238 0.032% 100.018% ( 250, 380 ] 172 0.023% 100.041% ( 380, 580 ] 161 0.021% 100.062% ( 580, 870 ] 67 0.009% 100.071% ( 870, 1300 ] 34 0.005% 100.076% ( 1300, 1900 ] 19 0.003% 100.078% ( 1900, 2900 ] 7 0.001% 100.079% ( 2900, 4400 ] 3 0.000% 100.079% ** Level 2 read latency histogram (micros): Count: 140161 Average: 2.9230 StdDev: 33.76 Min: 1 Median: 1.5309 Max: 6189 Percentiles: P50: 1.53 P75: 1.94 P99: 7.86 P99.9: 167.25 P99.99: 922.88 ------------------------------------------------------ [ 0, 1 ] 24362 17.381% 17.381% ### ( 1, 2 ] 86112 61.438% 78.819% ############ ( 2, 3 ] 15520 11.073% 89.892% ## ( 3, 4 ] 6253 4.461% 94.354% # ( 4, 6 ] 5791 4.132% 98.485% # ( 6, 10 ] 1548 1.104% 99.590% ( 10, 15 ] 306 0.218% 99.808% ( 15, 22 ] 35 0.025% 99.833% ( 22, 34 ] 4 0.003% 99.836% ( 34, 51 ] 1 0.001% 99.837% ( 51, 76 ] 1 0.001% 99.837% ( 76, 110 ] 22 0.016% 99.853% ( 110, 170 ] 69 0.049% 99.902% ( 170, 250 ] 32 0.023% 99.925% ( 250, 380 ] 37 0.026% 99.951% ( 380, 580 ] 36 0.026% 99.977% ( 580, 870 ] 17 0.012% 99.989% ( 870, 1300 ] 8 0.006% 99.995% ( 1300, 1900 ] 2 0.001% 99.996% ( 2900, 4400 ] 1 0.001% 99.997% ( 4400, 6600 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 450813 Average: 4.0474 StdDev: 55.43 Min: 0 Median: 1.7964 Max: 7984 Percentiles: P50: 1.80 P75: 2.71 P99: 8.79 P99.9: 116.52 P99.99: 235.46 ------------------------------------------------------ [ 0, 1 ] 27594 6.121% 6.121% # ( 1, 2 ] 248379 55.096% 61.217% ########### ( 2, 3 ] 87156 19.333% 80.550% #### ( 3, 4 ] 38048 8.440% 88.990% ## ( 4, 6 ] 39297 8.717% 97.707% ## ( 6, 10 ] 8345 1.851% 99.558% ( 10, 15 ] 1228 0.272% 99.830% ( 15, 22 ] 162 0.036% 99.866% ( 22, 34 ] 13 0.003% 99.869% ( 34, 51 ] 6 0.001% 99.870% ( 76, 110 ] 104 0.023% 99.893% ( 110, 170 ] 278 0.062% 99.955% ( 170, 250 ] 193 0.043% 99.998% ( 250, 380 ] 180 0.040% 100.038% ( 380, 580 ] 140 0.031% 100.069% ( 580, 870 ] 84 0.019% 100.087% ( 870, 1300 ] 40 0.009% 100.096% ( 1300, 1900 ] 13 0.003% 100.099% ( 1900, 2900 ] 10 0.002% 100.101% ( 2900, 4400 ] 38 0.008% 100.110% ( 4400, 6600 ] 11 0.002% 100.112% ( 6600, 9900 ] 5 0.001% 100.113% ** Level 4 read latency histogram (micros): Count: 9410 Average: 44.7051 StdDev: 302.41 Min: 1 Median: 2.0708 Max: 7916 Percentiles: P50: 2.07 P75: 3.40 P99: 800.34 P99.9: 4837.25 P99.99: 7732.45 ------------------------------------------------------ [ 0, 1 ] 317 3.369% 3.369% # ( 1, 2 ] 4242 45.080% 48.448% ######### ( 2, 3 ] 2062 21.913% 70.361% #### ( 3, 4 ] 1103 11.722% 82.083% ## ( 4, 6 ] 808 8.587% 90.670% ## ( 6, 10 ] 156 1.658% 92.327% ( 10, 15 ] 85 0.903% 93.231% ( 15, 22 ] 11 0.117% 93.348% ( 22, 34 ] 3 0.032% 93.379% ( 51, 76 ] 1 0.011% 93.390% ( 76, 110 ] 16 0.170% 93.560% ( 110, 170 ] 81 0.861% 94.421% ( 170, 250 ] 92 0.978% 95.399% ( 250, 380 ] 116 1.233% 96.631% ( 380, 580 ] 153 1.626% 98.257% ( 580, 870 ] 92 0.978% 99.235% ( 870, 1300 ] 33 0.351% 99.586% ( 1300, 1900 ] 12 0.128% 99.713% ( 1900, 2900 ] 9 0.096% 99.809% ( 2900, 4400 ] 7 0.074% 99.883% ( 4400, 6600 ] 8 0.085% 99.968% ( 6600, 9900 ] 6 0.064% 100.032% ** Level 5 read latency histogram (micros): Count: 100 Average: 1024.8500 StdDev: 1227.51 Min: 93 Median: 413.3333 Max: 4767 Percentiles: P50: 413.33 P75: 1500.00 P99: 4400.00 P99.9: 4767.00 P99.99: 4767.00 ------------------------------------------------------ ( 76, 110 ] 4 4.000% 4.000% # ( 110, 170 ] 19 19.000% 23.000% #### ( 170, 250 ] 15 15.000% 38.000% ### ( 250, 380 ] 10 10.000% 48.000% ## ( 380, 580 ] 12 12.000% 60.000% ## ( 580, 870 ] 8 8.000% 68.000% ## ( 870, 1300 ] 6 6.000% 74.000% # ( 1300, 1900 ] 3 3.000% 77.000% # ( 1900, 2900 ] 10 10.000% 87.000% ## ( 2900, 4400 ] 12 12.000% 99.000% ## ( 4400, 6600 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 32.3 total, 3.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 243.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.173 H:M:S, 31.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.617 H:M:S, 19.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-13:49:53 ... thread 0: (1000000,9000000) ops and (38703.7,155278.6) ops/second in (25.837341,57.960330) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 2.08 GB 0.0 8.1 0.0 8.1 16.5 8.5 0.0 1.9 141.7 290.8 58.21 52.67 147 0.396 8377K 17K 0.0 0.0 L1 12/12 1.43 GB 0.0 9.5 6.1 3.4 9.4 6.0 0.2 1.5 217.5 214.7 44.85 41.66 5 8.970 8763K 45K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.6 2.0 258.0 257.8 1.46 1.42 2 0.732 383K 229 0.0 0.0 L3 21/0 927.35 MB 0.9 8.0 4.4 3.6 8.0 4.4 0.6 1.8 156.1 155.3 52.66 37.05 32 1.646 7826K 41K 0.0 0.0 L4 176/0 9.76 GB 1.0 4.0 3.9 0.2 4.0 3.9 0.9 1.0 133.8 133.5 30.90 19.40 44 0.702 4087K 2947 0.0 0.0 L5 1096/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1315/22 104.43 GB 0.0 30.0 14.6 15.4 38.3 22.9 11.0 4.5 163.4 208.6 188.08 152.20 230 0.818 29M 107K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.0 14.6 15.4 38.3 22.9 10.8 4.5 163.4 208.6 188.08 152.20 230 0.818 29M 107K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.0 14.6 15.4 29.8 14.4 0.0 0.0 190.2 188.9 161.66 130.02 107 1.511 29M 107K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 329.0 26.43 22.18 123 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.2 total, 58.0 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.31 GB write, 674.58 MB/s write, 30.02 GB read, 528.55 MB/s read, 188.1 seconds Interval compaction: 38.31 GB write, 676.86 MB/s write, 30.02 GB read, 530.34 MB/s read, 188.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 41, pending-compaction-bytes-stops: 0, total-delays: 58, total-stops: 40, interval: 98 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4116088 Average: 3.2695 StdDev: 36.77 Min: 1 Median: 1.5405 Max: 8996 Percentiles: P50: 1.54 P75: 1.93 P99: 8.35 P99.9: 168.70 P99.99: 545.16 ------------------------------------------------------ [ 0, 1 ] 626286 15.216% 15.216% ### ( 1, 2 ] 2648972 64.357% 79.572% ############# ( 2, 3 ] 466484 11.333% 90.905% ## ( 3, 4 ] 158987 3.863% 94.768% # ( 4, 6 ] 149252 3.626% 98.394% # ( 6, 10 ] 42517 1.033% 99.427% ( 10, 15 ] 7767 0.189% 99.616% ( 15, 22 ] 1040 0.025% 99.641% ( 22, 34 ] 78 0.002% 99.643% ( 34, 51 ] 33 0.001% 99.644% ( 51, 76 ] 83 0.002% 99.646% ( 76, 110 ] 3776 0.092% 99.737% ( 110, 170 ] 6846 0.166% 99.904% ( 170, 250 ] 1690 0.041% 99.945% ( 250, 380 ] 1124 0.027% 99.972% ( 380, 580 ] 899 0.022% 99.994% ( 580, 870 ] 454 0.011% 100.005% ( 870, 1300 ] 212 0.005% 100.010% ( 1300, 1900 ] 123 0.003% 100.013% ( 1900, 2900 ] 124 0.003% 100.016% ( 2900, 4400 ] 151 0.004% 100.020% ( 4400, 6600 ] 37 0.001% 100.021% ( 6600, 9900 ] 9 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 2066890 Average: 5.1492 StdDev: 74.42 Min: 0 Median: 1.7375 Max: 9102 Percentiles: P50: 1.74 P75: 2.64 P99: 9.62 P99.9: 160.98 P99.99: 516.23 ------------------------------------------------------ [ 0, 1 ] 205818 9.958% 9.958% ## ( 1, 2 ] 1122208 54.295% 64.252% ########### ( 2, 3 ] 345410 16.712% 80.964% ### ( 3, 4 ] 155539 7.525% 88.489% ## ( 4, 6 ] 176110 8.521% 97.010% ## ( 6, 10 ] 45515 2.202% 99.212% ( 10, 15 ] 9707 0.470% 99.682% ( 15, 22 ] 1347 0.065% 99.747% ( 22, 34 ] 86 0.004% 99.751% ( 34, 51 ] 18 0.001% 99.752% ( 51, 76 ] 80 0.004% 99.756% ( 76, 110 ] 1636 0.079% 99.835% ( 110, 170 ] 1589 0.077% 99.912% ( 170, 250 ] 501 0.024% 99.936% ( 250, 380 ] 572 0.028% 99.964% ( 380, 580 ] 805 0.039% 100.002% ( 580, 870 ] 777 0.038% 100.040% ( 870, 1300 ] 570 0.028% 100.068% ( 1300, 1900 ] 275 0.013% 100.081% ( 1900, 2900 ] 257 0.012% 100.093% ( 2900, 4400 ] 371 0.018% 100.111% ( 4400, 6600 ] 83 0.004% 100.115% ( 6600, 9900 ] 20 0.001% 100.116% ** Level 2 read latency histogram (micros): Count: 140161 Average: 2.9230 StdDev: 33.76 Min: 1 Median: 1.5309 Max: 6189 Percentiles: P50: 1.53 P75: 1.94 P99: 7.86 P99.9: 167.25 P99.99: 922.88 ------------------------------------------------------ [ 0, 1 ] 24362 17.381% 17.381% ### ( 1, 2 ] 86112 61.438% 78.819% ############ ( 2, 3 ] 15520 11.073% 89.892% ## ( 3, 4 ] 6253 4.461% 94.354% # ( 4, 6 ] 5791 4.132% 98.485% # ( 6, 10 ] 1548 1.104% 99.590% ( 10, 15 ] 306 0.218% 99.808% ( 15, 22 ] 35 0.025% 99.833% ( 22, 34 ] 4 0.003% 99.836% ( 34, 51 ] 1 0.001% 99.837% ( 51, 76 ] 1 0.001% 99.837% ( 76, 110 ] 22 0.016% 99.853% ( 110, 170 ] 69 0.049% 99.902% ( 170, 250 ] 32 0.023% 99.925% ( 250, 380 ] 37 0.026% 99.951% ( 380, 580 ] 36 0.026% 99.977% ( 580, 870 ] 17 0.012% 99.989% ( 870, 1300 ] 8 0.006% 99.995% ( 1300, 1900 ] 2 0.001% 99.996% ( 2900, 4400 ] 1 0.001% 99.997% ( 4400, 6600 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1806318 Average: 6.4038 StdDev: 93.43 Min: 0 Median: 2.0330 Max: 8870 Percentiles: P50: 2.03 P75: 3.16 P99: 9.45 P99.9: 18.04 P99.99: 224.50 ------------------------------------------------------ [ 0, 1 ] 40917 2.265% 2.265% ( 1, 2 ] 847879 46.940% 49.205% ######### ( 2, 3 ] 435493 24.109% 73.314% ##### ( 3, 4 ] 196093 10.856% 84.170% ## ( 4, 6 ] 231070 12.792% 96.963% ### ( 6, 10 ] 42623 2.360% 99.322% ( 10, 15 ] 9938 0.550% 99.872% ( 15, 22 ] 1148 0.064% 99.936% ( 22, 34 ] 102 0.006% 99.942% ( 34, 51 ] 44 0.002% 99.944% ( 51, 76 ] 54 0.003% 99.947% ( 76, 110 ] 132 0.007% 99.954% ( 110, 170 ] 363 0.020% 99.974% ( 170, 250 ] 413 0.023% 99.997% ( 250, 380 ] 615 0.034% 100.031% ( 380, 580 ] 754 0.042% 100.073% ( 580, 870 ] 816 0.045% 100.118% ( 870, 1300 ] 627 0.035% 100.153% ( 1300, 1900 ] 392 0.022% 100.175% ( 1900, 2900 ] 405 0.022% 100.197% ( 2900, 4400 ] 474 0.026% 100.223% ( 4400, 6600 ] 115 0.006% 100.230% ( 6600, 9900 ] 37 0.002% 100.232% ** Level 4 read latency histogram (micros): Count: 43631 Average: 89.3331 StdDev: 466.47 Min: 1 Median: 2.1737 Max: 9192 Percentiles: P50: 2.17 P75: 3.44 P99: 2749.72 P99.9: 5708.58 P99.99: 7840.12 ------------------------------------------------------ [ 0, 1 ] 991 2.271% 2.271% ( 1, 2 ] 19009 43.568% 45.839% ######### ( 2, 3 ] 10452 23.955% 69.794% ##### ( 3, 4 ] 5221 11.966% 81.761% ## ( 4, 6 ] 3763 8.625% 90.385% ## ( 6, 10 ] 871 1.996% 92.382% ( 10, 15 ] 353 0.809% 93.191% ( 15, 22 ] 33 0.076% 93.266% ( 22, 34 ] 8 0.018% 93.285% ( 34, 51 ] 1 0.002% 93.287% ( 51, 76 ] 3 0.007% 93.294% ( 76, 110 ] 23 0.053% 93.346% ( 110, 170 ] 173 0.397% 93.743% ( 170, 250 ] 205 0.470% 94.213% ( 250, 380 ] 274 0.628% 94.841% ( 380, 580 ] 426 0.976% 95.817% ( 580, 870 ] 467 1.070% 96.888% ( 870, 1300 ] 440 1.008% 97.896% ( 1300, 1900 ] 299 0.685% 98.581% ( 1900, 2900 ] 215 0.493% 99.074% ( 2900, 4400 ] 311 0.713% 99.787% ( 4400, 6600 ] 83 0.190% 99.977% ( 6600, 9900 ] 15 0.034% 100.011% ** Level 5 read latency histogram (micros): Count: 280 Average: 1467.1857 StdDev: 1507.26 Min: 93 Median: 744.5946 Max: 7735 Percentiles: P50: 744.59 P75: 2448.39 P99: 6270.00 P99.9: 7735.00 P99.99: 7735.00 ------------------------------------------------------ ( 76, 110 ] 6 2.143% 2.143% ( 110, 170 ] 25 8.929% 11.071% ## ( 170, 250 ] 24 8.571% 19.643% ## ( 250, 380 ] 23 8.214% 27.857% ## ( 380, 580 ] 41 14.643% 42.500% ### ( 580, 870 ] 37 13.214% 55.714% ### ( 870, 1300 ] 19 6.786% 62.500% # ( 1300, 1900 ] 18 6.429% 68.929% # ( 1900, 2900 ] 31 11.071% 80.000% ## ( 2900, 4400 ] 43 15.357% 95.357% ### ( 4400, 6600 ] 12 4.286% 99.643% # ( 6600, 9900 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 58.2 total, 25.8 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 152.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.782 H:M:S, 56.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 38.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:22.609 H:M:S, 87.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.248 micros/op 160041 ops/sec 60.003 seconds 9602999 operations; 155.1 MB/s Microseconds per write: Count: 9602999 Average: 6.2482 StdDev: 342.59 Min: 0 Median: 1.7737 Max: 547399 Percentiles: P50: 1.77 P75: 2.79 P99: 9.15 P99.9: 1184.85 P99.99: 2770.78 ------------------------------------------------------ [ 0, 1 ] 1099572 11.450% 11.450% ## ( 1, 2 ] 4784985 49.828% 61.278% ########## ( 2, 3 ] 1657600 17.261% 78.540% ### ( 3, 4 ] 1347908 14.036% 92.576% ### ( 4, 6 ] 530124 5.520% 98.096% # ( 6, 10 ] 110257 1.148% 99.244% ( 10, 15 ] 31517 0.328% 99.573% ( 15, 22 ] 7889 0.082% 99.655% ( 22, 34 ] 1325 0.014% 99.669% ( 34, 51 ] 166 0.002% 99.670% ( 51, 76 ] 24 0.000% 99.671% ( 76, 110 ] 6852 0.071% 99.742% ( 110, 170 ] 2543 0.026% 99.768% ( 170, 250 ] 227 0.002% 99.771% ( 250, 380 ] 111 0.001% 99.772% ( 380, 580 ] 26 0.000% 99.772% ( 580, 870 ] 23 0.000% 99.772% ( 870, 1300 ] 16726 0.174% 99.947% ( 1300, 1900 ] 105 0.001% 99.948% ( 1900, 2900 ] 4661 0.049% 99.996% ( 2900, 4400 ] 264 0.003% 99.999% ( 4400, 6600 ] 45 0.000% 99.999% ( 6600, 9900 ] 24 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 210454 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9602999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9910294968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 601 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33191695 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 35044725525 rocksdb.compact.write.bytes COUNT : 34832816741 rocksdb.flush.write.bytes COUNT : 9776564653 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 65 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 240 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9697707008 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3734528 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 35141195440 rocksdb.non.last.level.read.count COUNT : 8491141 rocksdb.block.checksum.compute.count COUNT : 8490004 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.406668 P95 : 3.909120 P99 : 7.641753 P100 : 547397.000000 COUNT : 9602999 SUM : 55237488 rocksdb.compaction.times.micros P50 : 1000975.609756 P95 : 3250000.000000 P99 : 13580000.000000 P100 : 22594125.000000 COUNT : 110 SUM : 165375939 rocksdb.compaction.times.cpu_micros P50 : 895789.473684 P95 : 3250000.000000 P99 : 13580000.000000 P100 : 20328795.000000 COUNT : 110 SUM : 133645638 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 704.551282 P95 : 1258.343750 P99 : 5918.000000 P100 : 26356.000000 COUNT : 131 SUM : 123420 rocksdb.compaction.outfile.sync.micros P50 : 1131.626506 P95 : 118062.500000 P99 : 202342.857143 P100 : 248119.000000 COUNT : 417 SUM : 7618686 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 107.315789 P95 : 1888.000000 P99 : 4678.666667 P100 : 5564.000000 COUNT : 262 SUM : 96978 rocksdb.table.open.io.micros P50 : 1593.814433 P95 : 9325.344828 P99 : 19532.307692 P100 : 23419.000000 COUNT : 601 SUM : 1576384 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.708788 P95 : 8.503867 P99 : 12.906364 P100 : 9199.000000 COUNT : 8488368 SUM : 58461484 rocksdb.read.block.get.micros P50 : 530.000000 P95 : 4282.307692 P99 : 6549.000000 P100 : 8681.000000 COUNT : 1202 SUM : 1280068 rocksdb.write.raw.block.micros P50 : 0.513852 P95 : 0.976320 P99 : 2.923000 P100 : 14872.000000 COUNT : 10819517 SUM : 21692156 rocksdb.numfiles.in.singlecompaction P50 : 2.611111 P95 : 5.000000 P99 : 18.500000 P100 : 36.000000 COUNT : 150 SUM : 527 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.554750 P95 : 1145.267352 P99 : 2491.080965 P100 : 547215.000000 COUNT : 221402 SUM : 33207326 rocksdb.sst.read.micros P50 : 1.673511 P95 : 5.235285 P99 : 9.407572 P100 : 9192.000000 COUNT : 8491504 SUM : 41328301 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9602999 SUM : 9910294968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212916.666667 P95 : 394250.000000 P99 : 560183.333333 P100 : 707406.000000 COUNT : 131 SUM : 28243385 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 385 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0