[2024-11-28 09:07:24.015398] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 22.11.4 initialization... [2024-11-28 09:07:24.015661] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid306029 ] Set seed to 1732781244008810 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-28 09:07:24.112184] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-28 09:07:24.150066] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-28 09:07:24.150111] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 306029' to capture a snapshot of events at runtime. [2024-11-28 09:07:24.150122] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-28 09:07:24.150147] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-28 09:07:24.150155] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid306029 for offline analysis/debug. [2024-11-28 09:07:24.150261] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Nov 28 09:07:28 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/28-09:07:31 ... thread 0: (1000000,1000000) ops and (351676.7,351676.7) ops/second in (2.843521,2.843521) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 504.00 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 354.5 2.31 2.09 12 0.193 0 0 0.0 0.0 L1 3/3 188.88 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 254.7 254.6 0.74 0.71 1 0.742 191K 69 0.0 0.0 L2 2/1 125.96 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 233.3 233.3 0.54 0.52 1 0.540 127K 37 0.0 0.0 L3 9/0 741.31 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1186/12 96.94 GB 0.0 0.3 0.2 0.1 1.1 1.0 0.3 1.4 87.7 315.6 3.59 3.32 14 0.257 319K 106 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.2 1.4 87.7 315.6 3.59 3.32 14 0.257 319K 106 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 245.7 245.6 1.28 1.23 2 0.641 319K 106 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 354.5 2.31 2.09 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 368.57 MB/s write, 0.31 GB read, 102.38 MB/s read, 3.6 seconds Interval compaction: 1.11 GB write, 398.41 MB/s write, 0.31 GB read, 110.67 MB/s read, 3.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 120090 Average: 1.8728 StdDev: 13.78 Min: 0 Median: 1.2177 Max: 2900 Percentiles: P50: 1.22 P75: 1.66 P99: 4.68 P99.9: 10.71 P99.99: 161.35 ------------------------------------------------------ [ 0, 1 ] 45430 37.830% 37.830% ######## ( 1, 2 ] 67136 55.905% 93.735% ########### ( 2, 3 ] 4246 3.536% 97.270% # ( 3, 4 ] 1698 1.414% 98.684% ( 4, 6 ] 1119 0.932% 99.616% ( 6, 10 ] 332 0.276% 99.893% ( 10, 15 ] 84 0.070% 99.963% ( 15, 22 ] 21 0.017% 99.980% ( 22, 34 ] 3 0.002% 99.983% ( 34, 51 ] 3 0.002% 99.985% ( 51, 76 ] 3 0.002% 99.988% ( 110, 170 ] 7 0.006% 99.993% ( 170, 250 ] 2 0.002% 99.995% ( 250, 380 ] 5 0.004% 99.999% ( 380, 580 ] 2 0.002% 100.001% ( 580, 870 ] 2 0.002% 100.002% ( 870, 1300 ] 3 0.002% 100.005% ( 1300, 1900 ] 1 0.001% 100.006% ( 1900, 2900 ] 2 0.002% 100.007% ** Level 1 read latency histogram (micros): Count: 23129 Average: 1.8488 StdDev: 7.45 Min: 0 Median: 1.2584 Max: 1013 Percentiles: P50: 1.26 P75: 1.69 P99: 4.53 P99.9: 9.13 P99.99: 294.66 ------------------------------------------------------ [ 0, 1 ] 8076 34.917% 34.917% ####### ( 1, 2 ] 13498 58.360% 93.277% ############ ( 2, 3 ] 881 3.809% 97.086% # ( 3, 4 ] 380 1.643% 98.729% ( 4, 6 ] 238 1.029% 99.758% ( 6, 10 ] 42 0.182% 99.939% ( 10, 15 ] 8 0.035% 99.974% ( 15, 22 ] 2 0.009% 99.983% ( 170, 250 ] 1 0.004% 99.987% ( 250, 380 ] 2 0.009% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 9294 Average: 3.5399 StdDev: 54.60 Min: 1 Median: 1.6606 Max: 4471 Percentiles: P50: 1.66 P75: 2.27 P99: 8.29 P99.9: 28.49 P99.99: 4471.00 ------------------------------------------------------ [ 0, 1 ] 780 8.393% 8.393% ## ( 1, 2 ] 5854 62.987% 71.379% ############# ( 2, 3 ] 1264 13.600% 84.980% ### ( 3, 4 ] 602 6.477% 91.457% # ( 4, 6 ] 617 6.639% 98.096% # ( 6, 10 ] 147 1.582% 99.677% ( 10, 15 ] 17 0.183% 99.860% ( 15, 22 ] 1 0.011% 99.871% ( 22, 34 ] 5 0.054% 99.925% ( 250, 380 ] 2 0.022% 99.946% ( 380, 580 ] 2 0.022% 99.968% ( 870, 1300 ] 1 0.011% 99.978% ( 1900, 2900 ] 1 0.011% 99.989% ( 4400, 6600 ] 1 0.011% 100.000% ** Level 3 read latency histogram (micros): Count: 40 Average: 1665.0500 StdDev: 1465.84 Min: 111 Median: 1300.0000 Max: 4959 Percentiles: P50: 1300.00 P75: 2900.00 P99: 4959.00 P99.9: 4959.00 P99.99: 4959.00 ------------------------------------------------------ ( 110, 170 ] 1 2.500% 2.500% # ( 170, 250 ] 2 5.000% 7.500% # ( 250, 380 ] 7 17.500% 25.000% #### ( 380, 580 ] 7 17.500% 42.500% #### ( 580, 870 ] 2 5.000% 47.500% # ( 870, 1300 ] 1 2.500% 50.000% # ( 1300, 1900 ] 5 12.500% 62.500% ### ( 1900, 2900 ] 5 12.500% 75.000% ### ( 2900, 4400 ] 8 20.000% 95.000% #### ( 4400, 6600 ] 2 5.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1972.8286 StdDev: 1592.52 Min: 357 Median: 1550.0000 Max: 6210 Percentiles: P50: 1550.00 P75: 2993.75 P99: 6210.00 P99.9: 6210.00 P99.99: 6210.00 ------------------------------------------------------ ( 250, 380 ] 2 5.714% 5.714% # ( 380, 580 ] 6 17.143% 22.857% ### ( 580, 870 ] 4 11.429% 34.286% ## ( 870, 1300 ] 3 8.571% 42.857% ## ( 1300, 1900 ] 6 17.143% 60.000% ### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 3.1 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 319.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.210 H:M:S, 6.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 345.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.210 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/28-09:07:34 ... thread 0: (1000000,2000000) ops and (321891.2,336125.4) ops/second in (3.106640,5.950161) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.29 GB 107.0 0.8 0.0 0.8 2.6 1.8 0.0 1.4 97.2 321.3 8.43 7.81 30 0.281 831K 832 0.0 0.0 L1 1/0 3.39 MB 0.3 0.6 0.4 0.2 0.6 0.4 0.1 1.4 244.3 244.0 2.58 2.50 2 1.289 639K 791 0.0 0.0 L2 5/3 437.68 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 233.3 233.3 0.54 0.52 1 0.540 127K 37 0.0 0.0 L3 17/1 866.30 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.1 1.0 215.9 216.0 0.58 0.52 1 0.579 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1197/8 97.98 GB 0.0 1.7 0.6 1.0 3.5 2.5 0.7 1.9 140.2 295.9 12.12 11.35 34 0.357 1725K 1660 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.6 1.0 3.5 2.5 0.6 1.9 140.2 295.9 12.12 11.35 34 0.357 1725K 1660 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.6 1.0 1.7 0.6 0.0 0.0 250.0 249.8 6.80 6.59 7 0.971 1725K 1660 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.9 5.33 4.76 27 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.50 GB write, 580.30 MB/s write, 1.66 GB read, 274.92 MB/s read, 12.1 seconds Interval compaction: 3.50 GB write, 602.76 MB/s write, 1.66 GB read, 285.56 MB/s read, 12.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 406199 Average: 2.0692 StdDev: 10.45 Min: 0 Median: 1.4098 Max: 2900 Percentiles: P50: 1.41 P75: 1.81 P99: 5.41 P99.9: 9.97 P99.99: 20.60 ------------------------------------------------------ [ 0, 1 ] 98457 24.239% 24.239% ##### ( 1, 2 ] 255376 62.870% 87.108% ############# ( 2, 3 ] 32136 7.911% 95.020% ## ( 3, 4 ] 11118 2.737% 97.757% # ( 4, 6 ] 7175 1.766% 99.523% ( 6, 10 ] 1543 0.380% 99.903% ( 10, 15 ] 327 0.081% 99.984% ( 15, 22 ] 33 0.008% 99.992% ( 22, 34 ] 6 0.001% 99.993% ( 34, 51 ] 4 0.001% 99.994% ( 51, 76 ] 6 0.001% 99.996% ( 110, 170 ] 11 0.003% 99.998% ( 170, 250 ] 11 0.003% 100.001% ( 250, 380 ] 13 0.003% 100.004% ( 380, 580 ] 3 0.001% 100.005% ( 580, 870 ] 9 0.002% 100.007% ( 870, 1300 ] 7 0.002% 100.009% ( 1300, 1900 ] 2 0.000% 100.009% ( 1900, 2900 ] 4 0.001% 100.010% ** Level 1 read latency histogram (micros): Count: 106014 Average: 2.2370 StdDev: 7.49 Min: 0 Median: 1.5424 Max: 1636 Percentiles: P50: 1.54 P75: 1.92 P99: 5.59 P99.9: 10.54 P99.99: 201.89 ------------------------------------------------------ [ 0, 1 ] 15388 14.515% 14.515% ### ( 1, 2 ] 69358 65.423% 79.938% ############# ( 2, 3 ] 14276 13.466% 93.405% ### ( 3, 4 ] 3826 3.609% 97.014% # ( 4, 6 ] 2655 2.504% 99.518% # ( 6, 10 ] 395 0.373% 99.891% ( 10, 15 ] 93 0.088% 99.978% ( 15, 22 ] 9 0.008% 99.987% ( 22, 34 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 1 0.001% 99.990% ( 170, 250 ] 1 0.001% 99.991% ( 250, 380 ] 6 0.006% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31740 Average: 2.6977 StdDev: 29.56 Min: 1 Median: 1.6355 Max: 4471 Percentiles: P50: 1.64 P75: 2.08 P99: 6.53 P99.9: 12.04 P99.99: 562.60 ------------------------------------------------------ [ 0, 1 ] 2708 8.532% 8.532% ## ( 1, 2 ] 20712 65.255% 73.787% ############# ( 2, 3 ] 4664 14.694% 88.481% ### ( 3, 4 ] 1780 5.608% 94.089% # ( 4, 6 ] 1517 4.779% 98.869% # ( 6, 10 ] 315 0.992% 99.861% ( 10, 15 ] 30 0.095% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 22, 34 ] 5 0.016% 99.978% ( 250, 380 ] 2 0.006% 99.984% ( 380, 580 ] 2 0.006% 99.991% ( 870, 1300 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 16658 Average: 6.4089 StdDev: 108.96 Min: 1 Median: 1.6206 Max: 4959 Percentiles: P50: 1.62 P75: 2.01 P99: 5.92 P99.9: 1701.04 P99.99: 4767.62 ------------------------------------------------------ [ 0, 1 ] 1563 9.383% 9.383% ## ( 1, 2 ] 10902 65.446% 74.829% ############# ( 2, 3 ] 2813 16.887% 91.716% ### ( 3, 4 ] 725 4.352% 96.068% # ( 4, 6 ] 510 3.062% 99.130% # ( 6, 10 ] 78 0.468% 99.598% ( 10, 15 ] 22 0.132% 99.730% ( 15, 22 ] 2 0.012% 99.742% ( 110, 170 ] 1 0.006% 99.748% ( 170, 250 ] 2 0.012% 99.760% ( 250, 380 ] 8 0.048% 99.808% ( 380, 580 ] 8 0.048% 99.856% ( 580, 870 ] 2 0.012% 99.868% ( 870, 1300 ] 2 0.012% 99.880% ( 1300, 1900 ] 5 0.030% 99.910% ( 1900, 2900 ] 5 0.030% 99.940% ( 2900, 4400 ] 8 0.048% 99.988% ( 4400, 6600 ] 2 0.012% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1972.8286 StdDev: 1592.52 Min: 357 Median: 1550.0000 Max: 6210 Percentiles: P50: 1550.00 P75: 2993.75 P99: 6210.00 P99.9: 6210.00 P99.99: 6210.00 ------------------------------------------------------ ( 250, 380 ] 2 5.714% 5.714% # ( 380, 580 ] 6 17.143% 22.857% ### ( 580, 870 ] 4 11.429% 34.286% ## ( 870, 1300 ] 3 8.571% 42.857% ## ( 1300, 1900 ] 6 17.143% 60.000% ### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.624 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.414 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-09:07:37 ... thread 0: (1000000,3000000) ops and (347947.1,339975.7) ops/second in (2.874000,8.824161) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 2.21 GB 37.8 1.3 0.0 1.3 4.1 2.8 0.0 1.5 101.8 319.8 13.00 12.05 46 0.283 1343K 1329 0.0 0.0 L1 1/1 3.39 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 244.3 244.0 2.58 2.50 2 1.289 639K 791 0.0 0.0 L2 2/0 51.39 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 233.3 233.3 0.54 0.52 1 0.540 127K 37 0.0 0.0 L3 42/0 972.15 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 193.8 193.7 3.22 2.76 2 1.609 633K 480 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/16 98.90 GB 0.0 2.6 1.0 1.6 5.4 3.8 1.3 2.0 139.8 286.3 19.33 17.82 51 0.379 2744K 2637 0.0 0.0 Int 0/0 0.00 KB 0.0 2.6 1.0 1.6 5.4 3.8 1.2 2.0 139.8 286.3 19.33 17.82 51 0.379 2744K 2637 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.6 1.0 1.6 2.6 1.0 0.0 0.0 238.0 237.8 11.35 10.70 10 1.135 2744K 2637 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 355.3 7.98 7.12 41 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.40 GB write, 611.10 MB/s write, 2.64 GB read, 298.40 MB/s read, 19.3 seconds Interval compaction: 5.40 GB write, 627.06 MB/s write, 2.64 GB read, 306.19 MB/s read, 19.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 741267 Average: 2.1335 StdDev: 8.95 Min: 0 Median: 1.4701 Max: 2900 Percentiles: P50: 1.47 P75: 1.85 P99: 5.49 P99.9: 10.11 P99.99: 14.68 ------------------------------------------------------ [ 0, 1 ] 143594 19.371% 19.371% #### ( 1, 2 ] 482946 65.151% 84.523% ############# ( 2, 3 ] 73248 9.881% 94.404% ## ( 3, 4 ] 23272 3.139% 97.544% # ( 4, 6 ] 14450 1.949% 99.493% ( 6, 10 ] 3003 0.405% 99.898% ( 10, 15 ] 730 0.098% 99.997% ( 15, 22 ] 51 0.007% 100.004% ( 22, 34 ] 15 0.002% 100.006% ( 34, 51 ] 7 0.001% 100.007% ( 51, 76 ] 7 0.001% 100.008% ( 110, 170 ] 14 0.002% 100.009% ( 170, 250 ] 22 0.003% 100.012% ( 250, 380 ] 23 0.003% 100.016% ( 380, 580 ] 4 0.001% 100.016% ( 580, 870 ] 12 0.002% 100.018% ( 870, 1300 ] 9 0.001% 100.019% ( 1300, 1900 ] 3 0.000% 100.019% ( 1900, 2900 ] 5 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 146063 Average: 2.2381 StdDev: 6.40 Min: 0 Median: 1.5553 Max: 1636 Percentiles: P50: 1.56 P75: 1.93 P99: 5.61 P99.9: 11.02 P99.99: 21.61 ------------------------------------------------------ [ 0, 1 ] 19610 13.426% 13.426% ### ( 1, 2 ] 96204 65.865% 79.290% ############# ( 2, 3 ] 20724 14.188% 93.479% ### ( 3, 4 ] 5124 3.508% 96.987% # ( 4, 6 ] 3656 2.503% 99.490% # ( 6, 10 ] 568 0.389% 99.879% ( 10, 15 ] 152 0.104% 99.983% ( 15, 22 ] 11 0.008% 99.990% ( 22, 34 ] 1 0.001% 99.991% ( 51, 76 ] 1 0.001% 99.992% ( 110, 170 ] 1 0.001% 99.992% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 6 0.004% 99.997% ( 580, 870 ] 2 0.001% 99.999% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31740 Average: 2.6977 StdDev: 29.56 Min: 1 Median: 1.6355 Max: 4471 Percentiles: P50: 1.64 P75: 2.08 P99: 6.53 P99.9: 12.04 P99.99: 562.60 ------------------------------------------------------ [ 0, 1 ] 2708 8.532% 8.532% ## ( 1, 2 ] 20712 65.255% 73.787% ############# ( 2, 3 ] 4664 14.694% 88.481% ### ( 3, 4 ] 1780 5.608% 94.089% # ( 4, 6 ] 1517 4.779% 98.869% # ( 6, 10 ] 315 0.992% 99.861% ( 10, 15 ] 30 0.095% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 22, 34 ] 5 0.016% 99.978% ( 250, 380 ] 2 0.006% 99.984% ( 380, 580 ] 2 0.006% 99.991% ( 870, 1300 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28929 Average: 4.7876 StdDev: 82.85 Min: 0 Median: 1.6044 Max: 4959 Percentiles: P50: 1.60 P75: 1.99 P99: 6.70 P99.9: 470.47 P99.99: 4232.58 ------------------------------------------------------ [ 0, 1 ] 3023 10.450% 10.450% ## ( 1, 2 ] 18929 65.433% 75.882% ############# ( 2, 3 ] 4696 16.233% 92.115% ### ( 3, 4 ] 1158 4.003% 96.118% # ( 4, 6 ] 806 2.786% 98.904% # ( 6, 10 ] 159 0.550% 99.454% ( 10, 15 ] 49 0.169% 99.623% ( 15, 22 ] 2 0.007% 99.630% ( 22, 34 ] 30 0.104% 99.734% ( 34, 51 ] 18 0.062% 99.796% ( 51, 76 ] 7 0.024% 99.820% ( 110, 170 ] 3 0.010% 99.831% ( 170, 250 ] 5 0.017% 99.848% ( 250, 380 ] 11 0.038% 99.886% ( 380, 580 ] 9 0.031% 99.917% ( 580, 870 ] 2 0.007% 99.924% ( 870, 1300 ] 2 0.007% 99.931% ( 1300, 1900 ] 5 0.017% 99.948% ( 1900, 2900 ] 5 0.017% 99.965% ( 2900, 4400 ] 8 0.028% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1972.8286 StdDev: 1592.52 Min: 357 Median: 1550.0000 Max: 6210 Percentiles: P50: 1550.00 P75: 2993.75 P99: 6210.00 P99.9: 6210.00 P99.99: 6210.00 ------------------------------------------------------ ( 250, 380 ] 2 5.714% 5.714% # ( 380, 580 ] 6 17.143% 22.857% ### ( 580, 870 ] 4 11.429% 34.286% ## ( 870, 1300 ] 3 8.571% 42.857% ## ( 1300, 1900 ] 6 17.143% 60.000% ### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 747.8500 StdDev: 822.70 Min: 98 Median: 250.0000 Max: 2809 Percentiles: P50: 250.00 P75: 1085.00 P99: 2809.00 P99.9: 2809.00 P99.99: 2809.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 5 25.000% 50.000% ##### ( 250, 380 ] 1 5.000% 55.000% # ( 580, 870 ] 3 15.000% 70.000% ### ( 870, 1300 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 9.1 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 325.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.814 H:M:S, 9.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 342.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.190 H:M:S, 6.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/28-09:07:40 ... thread 0: (1000000,4000000) ops and (317501.3,334064.0) ops/second in (3.149593,11.973754) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.91 GB 163.6 2.6 0.0 2.6 6.4 3.7 0.0 1.7 128.1 309.8 21.14 19.78 65 0.325 2750K 2849 0.0 0.0 L1 11/0 1.29 GB 131.8 1.9 1.7 0.2 1.9 1.7 0.1 1.1 235.0 234.0 8.32 8.05 3 2.773 1985K 8219 0.0 0.0 L2 2/0 51.39 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 233.3 233.3 0.54 0.52 1 0.540 127K 37 0.0 0.0 L3 42/0 972.15 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 193.8 193.7 3.22 2.76 2 1.609 633K 480 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/4 99.88 GB 0.0 5.3 2.3 3.0 9.0 6.0 1.3 2.4 163.0 278.3 33.22 31.11 71 0.468 5497K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 2.3 3.0 9.0 6.0 1.2 2.4 163.0 278.3 33.22 31.11 71 0.468 5497K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 2.3 3.0 5.3 2.3 0.0 0.0 241.5 241.0 22.41 21.45 16 1.401 5497K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 355.6 10.81 9.66 55 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.03 GB write, 757.35 MB/s write, 5.29 GB read, 443.52 MB/s read, 33.2 seconds Interval compaction: 9.03 GB write, 771.93 MB/s write, 5.29 GB read, 452.05 MB/s read, 33.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 10, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1169680 Average: 2.2046 StdDev: 8.82 Min: 0 Median: 1.4936 Max: 2900 Percentiles: P50: 1.49 P75: 1.87 P99: 5.55 P99.9: 10.03 P99.99: 22.02 ------------------------------------------------------ [ 0, 1 ] 202721 17.331% 17.331% ### ( 1, 2 ] 774195 66.189% 83.520% ############# ( 2, 3 ] 124327 10.629% 94.149% ## ( 3, 4 ] 38326 3.277% 97.426% # ( 4, 6 ] 23761 2.031% 99.457% ( 6, 10 ] 5176 0.443% 99.900% ( 10, 15 ] 983 0.084% 99.984% ( 15, 22 ] 75 0.006% 99.990% ( 22, 34 ] 20 0.002% 99.992% ( 34, 51 ] 10 0.001% 99.993% ( 51, 76 ] 21 0.002% 99.994% ( 76, 110 ] 89 0.008% 100.002% ( 110, 170 ] 95 0.008% 100.010% ( 170, 250 ] 61 0.005% 100.015% ( 250, 380 ] 54 0.005% 100.020% ( 380, 580 ] 48 0.004% 100.024% ( 580, 870 ] 19 0.002% 100.026% ( 870, 1300 ] 20 0.002% 100.027% ( 1300, 1900 ] 3 0.000% 100.028% ( 1900, 2900 ] 5 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 146979 Average: 2.4261 StdDev: 13.65 Min: 0 Median: 1.5557 Max: 1941 Percentiles: P50: 1.56 P75: 1.94 P99: 5.66 P99.9: 13.78 P99.99: 569.26 ------------------------------------------------------ [ 0, 1 ] 19735 13.427% 13.427% ### ( 1, 2 ] 96738 65.818% 79.245% ############# ( 2, 3 ] 20850 14.186% 93.430% ### ( 3, 4 ] 5143 3.499% 96.929% # ( 4, 6 ] 3670 2.497% 99.426% ( 6, 10 ] 581 0.395% 99.822% ( 10, 15 ] 152 0.103% 99.925% ( 15, 22 ] 11 0.007% 99.933% ( 22, 34 ] 2 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 18 0.012% 99.947% ( 110, 170 ] 33 0.022% 99.969% ( 170, 250 ] 3 0.002% 99.971% ( 250, 380 ] 15 0.010% 99.982% ( 380, 580 ] 13 0.009% 99.990% ( 580, 870 ] 5 0.003% 99.994% ( 870, 1300 ] 4 0.003% 99.997% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31740 Average: 2.6977 StdDev: 29.56 Min: 1 Median: 1.6355 Max: 4471 Percentiles: P50: 1.64 P75: 2.08 P99: 6.53 P99.9: 12.04 P99.99: 562.60 ------------------------------------------------------ [ 0, 1 ] 2708 8.532% 8.532% ## ( 1, 2 ] 20712 65.255% 73.787% ############# ( 2, 3 ] 4664 14.694% 88.481% ### ( 3, 4 ] 1780 5.608% 94.089% # ( 4, 6 ] 1517 4.779% 98.869% # ( 6, 10 ] 315 0.992% 99.861% ( 10, 15 ] 30 0.095% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 22, 34 ] 5 0.016% 99.978% ( 250, 380 ] 2 0.006% 99.984% ( 380, 580 ] 2 0.006% 99.991% ( 870, 1300 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28929 Average: 4.7876 StdDev: 82.85 Min: 0 Median: 1.6044 Max: 4959 Percentiles: P50: 1.60 P75: 1.99 P99: 6.70 P99.9: 470.47 P99.99: 4232.58 ------------------------------------------------------ [ 0, 1 ] 3023 10.450% 10.450% ## ( 1, 2 ] 18929 65.433% 75.882% ############# ( 2, 3 ] 4696 16.233% 92.115% ### ( 3, 4 ] 1158 4.003% 96.118% # ( 4, 6 ] 806 2.786% 98.904% # ( 6, 10 ] 159 0.550% 99.454% ( 10, 15 ] 49 0.169% 99.623% ( 15, 22 ] 2 0.007% 99.630% ( 22, 34 ] 30 0.104% 99.734% ( 34, 51 ] 18 0.062% 99.796% ( 51, 76 ] 7 0.024% 99.820% ( 110, 170 ] 3 0.010% 99.831% ( 170, 250 ] 5 0.017% 99.848% ( 250, 380 ] 11 0.038% 99.886% ( 380, 580 ] 9 0.031% 99.917% ( 580, 870 ] 2 0.007% 99.924% ( 870, 1300 ] 2 0.007% 99.931% ( 1300, 1900 ] 5 0.017% 99.948% ( 1900, 2900 ] 5 0.017% 99.965% ( 2900, 4400 ] 8 0.028% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1972.8286 StdDev: 1592.52 Min: 357 Median: 1550.0000 Max: 6210 Percentiles: P50: 1550.00 P75: 2993.75 P99: 6210.00 P99.9: 6210.00 P99.99: 6210.00 ------------------------------------------------------ ( 250, 380 ] 2 5.714% 5.714% # ( 380, 580 ] 6 17.143% 22.857% ### ( 580, 870 ] 4 11.429% 34.286% ## ( 870, 1300 ] 3 8.571% 42.857% ## ( 1300, 1900 ] 6 17.143% 60.000% ### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 747.8500 StdDev: 822.70 Min: 98 Median: 250.0000 Max: 2809 Percentiles: P50: 250.00 P75: 1085.00 P99: 2809.00 P99.9: 2809.00 P99.99: 2809.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 5 25.000% 50.000% ##### ( 250, 380 ] 1 5.000% 55.000% # ( 580, 870 ] 3 15.000% 70.000% ### ( 870, 1300 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 12.2 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 322.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.254 H:M:S, 10.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 312.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.439 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-09:07:43 ... thread 0: (1000000,5000000) ops and (352231.2,337546.0) ops/second in (2.839044,14.812798) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 2.83 GB 232.8 3.2 0.0 3.2 7.9 4.7 0.0 1.7 126.8 311.9 25.84 24.17 81 0.319 3326K 3446 0.0 0.0 L1 11/0 1.29 GB 131.8 1.9 1.7 0.2 1.9 1.7 0.1 1.1 235.0 234.0 8.32 8.05 3 2.773 1985K 8219 0.0 0.0 L2 2/0 51.39 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 233.3 233.3 0.54 0.52 1 0.540 127K 37 0.0 0.0 L3 42/0 972.15 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 193.8 193.7 3.22 2.76 2 1.609 633K 480 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/8 100.80 GB 0.0 5.8 2.3 3.6 10.5 6.9 1.3 2.2 157.7 283.6 37.92 35.50 87 0.436 6072K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 2.3 3.6 10.5 6.9 1.2 2.2 157.7 283.6 37.92 35.50 87 0.436 6072K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 2.3 3.6 5.8 2.3 0.0 0.0 243.9 243.3 24.53 23.52 18 1.363 6072K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.4 13.40 11.98 69 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.0 total, 14.8 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.50 GB write, 714.89 MB/s write, 5.84 GB read, 397.51 MB/s read, 37.9 seconds Interval compaction: 10.50 GB write, 726.01 MB/s write, 5.84 GB read, 403.70 MB/s read, 37.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 13, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1418518 Average: 2.1539 StdDev: 8.55 Min: 0 Median: 1.4679 Max: 2900 Percentiles: P50: 1.47 P75: 1.85 P99: 5.45 P99.9: 10.25 P99.99: 21.66 ------------------------------------------------------ [ 0, 1 ] 273528 19.283% 19.283% #### ( 1, 2 ] 931280 65.652% 84.934% ############# ( 2, 3 ] 138199 9.742% 94.677% ## ( 3, 4 ] 42641 3.006% 97.683% # ( 4, 6 ] 25696 1.811% 99.494% ( 6, 10 ] 5693 0.401% 99.896% ( 10, 15 ] 1245 0.088% 99.983% ( 15, 22 ] 99 0.007% 99.990% ( 22, 34 ] 23 0.002% 99.992% ( 34, 51 ] 12 0.001% 99.993% ( 51, 76 ] 24 0.002% 99.995% ( 76, 110 ] 89 0.006% 100.001% ( 110, 170 ] 102 0.007% 100.008% ( 170, 250 ] 66 0.005% 100.013% ( 250, 380 ] 63 0.004% 100.017% ( 380, 580 ] 50 0.004% 100.021% ( 580, 870 ] 24 0.002% 100.022% ( 870, 1300 ] 22 0.002% 100.024% ( 1300, 1900 ] 5 0.000% 100.024% ( 1900, 2900 ] 5 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 146979 Average: 2.4261 StdDev: 13.65 Min: 0 Median: 1.5557 Max: 1941 Percentiles: P50: 1.56 P75: 1.94 P99: 5.66 P99.9: 13.78 P99.99: 569.26 ------------------------------------------------------ [ 0, 1 ] 19735 13.427% 13.427% ### ( 1, 2 ] 96738 65.818% 79.245% ############# ( 2, 3 ] 20850 14.186% 93.430% ### ( 3, 4 ] 5143 3.499% 96.929% # ( 4, 6 ] 3670 2.497% 99.426% ( 6, 10 ] 581 0.395% 99.822% ( 10, 15 ] 152 0.103% 99.925% ( 15, 22 ] 11 0.007% 99.933% ( 22, 34 ] 2 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 18 0.012% 99.947% ( 110, 170 ] 33 0.022% 99.969% ( 170, 250 ] 3 0.002% 99.971% ( 250, 380 ] 15 0.010% 99.982% ( 380, 580 ] 13 0.009% 99.990% ( 580, 870 ] 5 0.003% 99.994% ( 870, 1300 ] 4 0.003% 99.997% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31740 Average: 2.6977 StdDev: 29.56 Min: 1 Median: 1.6355 Max: 4471 Percentiles: P50: 1.64 P75: 2.08 P99: 6.53 P99.9: 12.04 P99.99: 562.60 ------------------------------------------------------ [ 0, 1 ] 2708 8.532% 8.532% ## ( 1, 2 ] 20712 65.255% 73.787% ############# ( 2, 3 ] 4664 14.694% 88.481% ### ( 3, 4 ] 1780 5.608% 94.089% # ( 4, 6 ] 1517 4.779% 98.869% # ( 6, 10 ] 315 0.992% 99.861% ( 10, 15 ] 30 0.095% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 22, 34 ] 5 0.016% 99.978% ( 250, 380 ] 2 0.006% 99.984% ( 380, 580 ] 2 0.006% 99.991% ( 870, 1300 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28929 Average: 4.7876 StdDev: 82.85 Min: 0 Median: 1.6044 Max: 4959 Percentiles: P50: 1.60 P75: 1.99 P99: 6.70 P99.9: 470.47 P99.99: 4232.58 ------------------------------------------------------ [ 0, 1 ] 3023 10.450% 10.450% ## ( 1, 2 ] 18929 65.433% 75.882% ############# ( 2, 3 ] 4696 16.233% 92.115% ### ( 3, 4 ] 1158 4.003% 96.118% # ( 4, 6 ] 806 2.786% 98.904% # ( 6, 10 ] 159 0.550% 99.454% ( 10, 15 ] 49 0.169% 99.623% ( 15, 22 ] 2 0.007% 99.630% ( 22, 34 ] 30 0.104% 99.734% ( 34, 51 ] 18 0.062% 99.796% ( 51, 76 ] 7 0.024% 99.820% ( 110, 170 ] 3 0.010% 99.831% ( 170, 250 ] 5 0.017% 99.848% ( 250, 380 ] 11 0.038% 99.886% ( 380, 580 ] 9 0.031% 99.917% ( 580, 870 ] 2 0.007% 99.924% ( 870, 1300 ] 2 0.007% 99.931% ( 1300, 1900 ] 5 0.017% 99.948% ( 1900, 2900 ] 5 0.017% 99.965% ( 2900, 4400 ] 8 0.028% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1972.8286 StdDev: 1592.52 Min: 357 Median: 1550.0000 Max: 6210 Percentiles: P50: 1550.00 P75: 2993.75 P99: 6210.00 P99.9: 6210.00 P99.99: 6210.00 ------------------------------------------------------ ( 250, 380 ] 2 5.714% 5.714% # ( 380, 580 ] 6 17.143% 22.857% ### ( 580, 870 ] 4 11.429% 34.286% ## ( 870, 1300 ] 3 8.571% 42.857% ## ( 1300, 1900 ] 6 17.143% 60.000% ### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 747.8500 StdDev: 822.70 Min: 98 Median: 250.0000 Max: 2809 Percentiles: P50: 250.00 P75: 1085.00 P99: 2809.00 P99.9: 2809.00 P99.99: 2809.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 5 25.000% 50.000% ##### ( 250, 380 ] 1 5.000% 55.000% # ( 580, 870 ] 3 15.000% 70.000% ### ( 870, 1300 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 15.0 total, 2.8 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 327.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.451 H:M:S, 9.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 346.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.197 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-09:07:46 ... thread 0: (1000000,6000000) ops and (328858.4,336066.3) ops/second in (3.040822,17.853620) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 3.75 GB 352.4 4.3 0.0 4.3 10.0 5.7 0.0 1.8 133.9 309.7 32.94 30.88 99 0.333 4477K 4656 0.0 0.0 L1 11/0 1.29 GB 131.8 1.9 1.7 0.2 1.9 1.7 0.1 1.1 235.0 234.0 8.32 8.05 3 2.773 1985K 8219 0.0 0.0 L2 2/0 51.39 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 233.3 233.3 0.54 0.52 1 0.540 127K 37 0.0 0.0 L3 42/0 972.15 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 193.8 193.7 3.22 2.76 2 1.609 633K 480 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/4 101.72 GB 0.0 6.9 2.3 4.7 12.6 7.9 1.3 2.2 158.1 286.5 45.01 42.20 105 0.429 7224K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.9 2.3 4.7 12.6 7.9 1.2 2.2 158.1 286.5 45.01 42.20 105 0.429 7224K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.9 2.3 4.7 6.9 2.3 0.0 0.0 247.0 246.5 28.80 27.71 22 1.309 7224K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 357.5 16.21 14.49 83 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.1 total, 17.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.59 GB write, 713.05 MB/s write, 6.95 GB read, 393.38 MB/s read, 45.0 seconds Interval compaction: 12.59 GB write, 722.25 MB/s write, 6.95 GB read, 398.45 MB/s read, 45.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 17, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1652882 Average: 2.1159 StdDev: 9.33 Min: 0 Median: 1.4428 Max: 3110 Percentiles: P50: 1.44 P75: 1.83 P99: 5.35 P99.9: 10.10 P99.99: 21.98 ------------------------------------------------------ [ 0, 1 ] 351057 21.239% 21.239% #### ( 1, 2 ] 1073692 64.959% 86.198% ############# ( 2, 3 ] 147359 8.915% 95.113% ## ( 3, 4 ] 46066 2.787% 97.900% # ( 4, 6 ] 26981 1.632% 99.533% ( 6, 10 ] 6048 0.366% 99.898% ( 10, 15 ] 1395 0.084% 99.983% ( 15, 22 ] 120 0.007% 99.990% ( 22, 34 ] 26 0.002% 99.992% ( 34, 51 ] 13 0.001% 99.992% ( 51, 76 ] 26 0.002% 99.994% ( 76, 110 ] 89 0.005% 99.999% ( 110, 170 ] 109 0.007% 100.006% ( 170, 250 ] 70 0.004% 100.010% ( 250, 380 ] 69 0.004% 100.014% ( 380, 580 ] 53 0.003% 100.018% ( 580, 870 ] 30 0.002% 100.019% ( 870, 1300 ] 26 0.002% 100.021% ( 1300, 1900 ] 7 0.000% 100.021% ( 1900, 2900 ] 8 0.000% 100.022% ( 2900, 4400 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 146979 Average: 2.4261 StdDev: 13.65 Min: 0 Median: 1.5557 Max: 1941 Percentiles: P50: 1.56 P75: 1.94 P99: 5.66 P99.9: 13.78 P99.99: 569.26 ------------------------------------------------------ [ 0, 1 ] 19735 13.427% 13.427% ### ( 1, 2 ] 96738 65.818% 79.245% ############# ( 2, 3 ] 20850 14.186% 93.430% ### ( 3, 4 ] 5143 3.499% 96.929% # ( 4, 6 ] 3670 2.497% 99.426% ( 6, 10 ] 581 0.395% 99.822% ( 10, 15 ] 152 0.103% 99.925% ( 15, 22 ] 11 0.007% 99.933% ( 22, 34 ] 2 0.001% 99.934% ( 51, 76 ] 1 0.001% 99.935% ( 76, 110 ] 18 0.012% 99.947% ( 110, 170 ] 33 0.022% 99.969% ( 170, 250 ] 3 0.002% 99.971% ( 250, 380 ] 15 0.010% 99.982% ( 380, 580 ] 13 0.009% 99.990% ( 580, 870 ] 5 0.003% 99.994% ( 870, 1300 ] 4 0.003% 99.997% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31740 Average: 2.6977 StdDev: 29.56 Min: 1 Median: 1.6355 Max: 4471 Percentiles: P50: 1.64 P75: 2.08 P99: 6.53 P99.9: 12.04 P99.99: 562.60 ------------------------------------------------------ [ 0, 1 ] 2708 8.532% 8.532% ## ( 1, 2 ] 20712 65.255% 73.787% ############# ( 2, 3 ] 4664 14.694% 88.481% ### ( 3, 4 ] 1780 5.608% 94.089% # ( 4, 6 ] 1517 4.779% 98.869% # ( 6, 10 ] 315 0.992% 99.861% ( 10, 15 ] 30 0.095% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 22, 34 ] 5 0.016% 99.978% ( 250, 380 ] 2 0.006% 99.984% ( 380, 580 ] 2 0.006% 99.991% ( 870, 1300 ] 1 0.003% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28929 Average: 4.7876 StdDev: 82.85 Min: 0 Median: 1.6044 Max: 4959 Percentiles: P50: 1.60 P75: 1.99 P99: 6.70 P99.9: 470.47 P99.99: 4232.58 ------------------------------------------------------ [ 0, 1 ] 3023 10.450% 10.450% ## ( 1, 2 ] 18929 65.433% 75.882% ############# ( 2, 3 ] 4696 16.233% 92.115% ### ( 3, 4 ] 1158 4.003% 96.118% # ( 4, 6 ] 806 2.786% 98.904% # ( 6, 10 ] 159 0.550% 99.454% ( 10, 15 ] 49 0.169% 99.623% ( 15, 22 ] 2 0.007% 99.630% ( 22, 34 ] 30 0.104% 99.734% ( 34, 51 ] 18 0.062% 99.796% ( 51, 76 ] 7 0.024% 99.820% ( 110, 170 ] 3 0.010% 99.831% ( 170, 250 ] 5 0.017% 99.848% ( 250, 380 ] 11 0.038% 99.886% ( 380, 580 ] 9 0.031% 99.917% ( 580, 870 ] 2 0.007% 99.924% ( 870, 1300 ] 2 0.007% 99.931% ( 1300, 1900 ] 5 0.017% 99.948% ( 1900, 2900 ] 5 0.017% 99.965% ( 2900, 4400 ] 8 0.028% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1972.8286 StdDev: 1592.52 Min: 357 Median: 1550.0000 Max: 6210 Percentiles: P50: 1550.00 P75: 2993.75 P99: 6210.00 P99.9: 6210.00 P99.99: 6210.00 ------------------------------------------------------ ( 250, 380 ] 2 5.714% 5.714% # ( 380, 580 ] 6 17.143% 22.857% ### ( 580, 870 ] 4 11.429% 34.286% ## ( 870, 1300 ] 3 8.571% 42.857% ## ( 1300, 1900 ] 6 17.143% 60.000% ### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 4 11.429% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 747.8500 StdDev: 822.70 Min: 98 Median: 250.0000 Max: 2809 Percentiles: P50: 250.00 P75: 1085.00 P99: 2809.00 P99.9: 2809.00 P99.99: 2809.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 5 25.000% 50.000% ##### ( 250, 380 ] 1 5.000% 55.000% # ( 580, 870 ] 3 15.000% 70.000% ### ( 870, 1300 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 18.1 total, 3.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 326.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.838 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.386 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-09:08:18 ... thread 0: (1000000,7000000) ops and (31023.6,139756.4) ops/second in (32.233527,50.087147) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/0 818.01 MB 81.8 5.3 0.0 5.3 11.9 6.6 0.0 1.8 124.8 281.3 43.42 37.55 115 0.378 5500K 6141 0.0 0.0 L1 0/0 0.00 KB 0.0 7.2 5.7 1.5 7.1 5.6 0.1 1.2 214.5 210.4 34.32 30.73 4 8.580 7476K 142K 0.0 0.0 L2 7/3 564.51 MB 3.0 0.8 0.7 0.1 0.8 0.7 5.0 1.2 147.5 147.0 5.59 3.84 3 1.862 180K 37 0.0 0.0 L3 26/9 2.24 GB 1.6 3.1 2.3 0.8 3.0 2.3 3.0 1.3 145.3 144.7 21.50 14.23 18 1.195 1619K 7320 0.0 0.0 L4 199/13 12.84 GB 1.3 1.9 1.7 0.2 1.9 1.7 1.9 1.1 110.2 109.7 17.36 9.02 15 1.157 1943K 9124 0.0 0.0 L5 1052/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/25 102.61 GB 0.0 18.2 10.4 7.8 24.7 16.9 10.3 3.7 152.6 206.8 122.19 95.38 155 0.788 16M 165K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.2 10.4 7.8 24.7 16.9 10.2 3.7 152.6 206.8 122.19 95.38 155 0.788 16M 165K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.2 10.4 7.8 18.0 10.2 0.0 0.0 186.1 184.3 100.20 78.16 59 1.698 16M 165K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 309.4 21.99 17.21 96 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.3 total, 50.1 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.68 GB write, 502.24 MB/s write, 18.21 GB read, 370.48 MB/s read, 122.2 seconds Interval compaction: 24.68 GB write, 504.55 MB/s write, 18.21 GB read, 372.18 MB/s read, 122.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 54, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 54, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2892654 Average: 3.1166 StdDev: 26.86 Min: 0 Median: 1.3927 Max: 12090 Percentiles: P50: 1.39 P75: 1.79 P99: 8.45 P99.9: 167.30 P99.99: 514.91 ------------------------------------------------------ [ 0, 1 ] 738533 25.531% 25.531% ##### ( 1, 2 ] 1802179 62.302% 87.833% ############ ( 2, 3 ] 192833 6.666% 94.500% # ( 3, 4 ] 72041 2.490% 96.990% ( 4, 6 ] 51563 1.783% 98.773% ( 6, 10 ] 10735 0.371% 99.144% ( 10, 15 ] 2973 0.103% 99.246% ( 15, 22 ] 668 0.023% 99.270% ( 22, 34 ] 41 0.001% 99.271% ( 34, 51 ] 17 0.001% 99.272% ( 51, 76 ] 685 0.024% 99.295% ( 76, 110 ] 10658 0.368% 99.664% ( 110, 170 ] 7157 0.247% 99.911% ( 170, 250 ] 1035 0.036% 99.947% ( 250, 380 ] 786 0.027% 99.974% ( 380, 580 ] 683 0.024% 99.998% ( 580, 870 ] 213 0.007% 100.005% ( 870, 1300 ] 90 0.003% 100.008% ( 1300, 1900 ] 36 0.001% 100.009% ( 1900, 2900 ] 47 0.002% 100.011% ( 2900, 4400 ] 45 0.002% 100.013% ( 4400, 6600 ] 5 0.000% 100.013% ( 6600, 9900 ] 4 0.000% 100.013% ( 9900, 14000 ] 1 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 1463602 Average: 6.6686 StdDev: 146.55 Min: 0 Median: 1.7904 Max: 107170 Percentiles: P50: 1.79 P75: 2.76 P99: 8.96 P99.9: 113.16 P99.99: 239.52 ------------------------------------------------------ [ 0, 1 ] 154061 10.526% 10.526% ## ( 1, 2 ] 730965 49.943% 60.469% ########## ( 2, 3 ] 279907 19.125% 79.594% #### ( 3, 4 ] 131482 8.983% 88.577% ## ( 4, 6 ] 135346 9.247% 97.824% ## ( 6, 10 ] 23236 1.588% 99.412% ( 10, 15 ] 4865 0.332% 99.744% ( 15, 22 ] 544 0.037% 99.782% ( 22, 34 ] 39 0.003% 99.784% ( 34, 51 ] 23 0.002% 99.786% ( 51, 76 ] 166 0.011% 99.797% ( 76, 110 ] 1439 0.098% 99.896% ( 110, 170 ] 1241 0.085% 99.980% ( 170, 250 ] 163 0.011% 99.991% ( 250, 380 ] 235 0.016% 100.008% ( 380, 580 ] 370 0.025% 100.033% ( 580, 870 ] 448 0.031% 100.063% ( 870, 1300 ] 360 0.025% 100.088% ( 1300, 1900 ] 238 0.016% 100.104% ( 1900, 2900 ] 362 0.025% 100.129% ( 2900, 4400 ] 475 0.032% 100.161% ( 4400, 6600 ] 147 0.010% 100.171% ( 6600, 9900 ] 75 0.005% 100.177% ( 9900, 14000 ] 14 0.001% 100.178% ( 14000, 22000 ] 1 0.000% 100.178% ( 75000, 110000 ] 1 0.000% 100.178% ** Level 2 read latency histogram (micros): Count: 114527 Average: 9.5125 StdDev: 161.69 Min: 1 Median: 1.8927 Max: 16250 Percentiles: P50: 1.89 P75: 2.89 P99: 9.63 P99.9: 1449.57 P99.99: 3954.25 ------------------------------------------------------ [ 0, 1 ] 4105 3.584% 3.584% # ( 1, 2 ] 59547 51.994% 55.578% ########## ( 2, 3 ] 25105 21.921% 77.499% #### ( 3, 4 ] 11134 9.722% 87.220% ## ( 4, 6 ] 11444 9.992% 97.213% ## ( 6, 10 ] 2258 1.972% 99.184% ( 10, 15 ] 411 0.359% 99.543% ( 15, 22 ] 41 0.036% 99.579% ( 22, 34 ] 6 0.005% 99.584% ( 51, 76 ] 2 0.002% 99.586% ( 76, 110 ] 4 0.003% 99.590% ( 110, 170 ] 35 0.031% 99.620% ( 170, 250 ] 31 0.027% 99.647% ( 250, 380 ] 54 0.047% 99.694% ( 380, 580 ] 88 0.077% 99.771% ( 580, 870 ] 77 0.067% 99.838% ( 870, 1300 ] 61 0.053% 99.892% ( 1300, 1900 ] 38 0.033% 99.925% ( 1900, 2900 ] 38 0.033% 99.958% ( 2900, 4400 ] 52 0.045% 100.003% ( 4400, 6600 ] 17 0.015% 100.018% ( 6600, 9900 ] 15 0.013% 100.031% ( 9900, 14000 ] 1 0.001% 100.032% ( 14000, 22000 ] 2 0.002% 100.034% ** Level 3 read latency histogram (micros): Count: 438434 Average: 12.1513 StdDev: 156.56 Min: 0 Median: 1.9858 Max: 19897 Percentiles: P50: 1.99 P75: 3.01 P99: 11.38 P99.9: 1325.39 P99.99: 2389.58 ------------------------------------------------------ [ 0, 1 ] 8215 1.874% 1.874% ( 1, 2 ] 214049 48.821% 50.695% ########## ( 2, 3 ] 105945 24.164% 74.859% ##### ( 3, 4 ] 50624 11.547% 86.406% ## ( 4, 6 ] 47154 10.755% 97.161% ## ( 6, 10 ] 7673 1.750% 98.911% ( 10, 15 ] 1419 0.324% 99.235% ( 15, 22 ] 166 0.038% 99.273% ( 22, 34 ] 41 0.009% 99.282% ( 34, 51 ] 23 0.005% 99.287% ( 51, 76 ] 12 0.003% 99.290% ( 76, 110 ] 29 0.007% 99.297% ( 110, 170 ] 154 0.035% 99.332% ( 170, 250 ] 208 0.047% 99.379% ( 250, 380 ] 368 0.084% 99.463% ( 380, 580 ] 627 0.143% 99.606% ( 580, 870 ] 748 0.171% 99.777% ( 870, 1300 ] 529 0.121% 99.897% ( 1300, 1900 ] 297 0.068% 99.965% ( 1900, 2900 ] 225 0.051% 100.016% ( 2900, 4400 ] 267 0.061% 100.077% ( 4400, 6600 ] 65 0.015% 100.092% ( 6600, 9900 ] 17 0.004% 100.096% ( 9900, 14000 ] 2 0.000% 100.096% ( 14000, 22000 ] 4 0.001% 100.097% ** Level 4 read latency histogram (micros): Count: 26738 Average: 8.7415 StdDev: 134.26 Min: 1 Median: 2.0713 Max: 8614 Percentiles: P50: 2.07 P75: 3.04 P99: 9.42 P99.9: 1350.48 P99.99: 2694.32 ------------------------------------------------------ [ 0, 1 ] 150 0.561% 0.561% ( 1, 2 ] 12716 47.558% 48.119% ########## ( 2, 3 ] 7057 26.393% 74.512% ##### ( 3, 4 ] 3078 11.512% 86.024% ## ( 4, 6 ] 3164 11.833% 97.857% ## ( 6, 10 ] 357 1.335% 99.192% ( 10, 15 ] 110 0.411% 99.604% ( 15, 22 ] 9 0.034% 99.637% ( 22, 34 ] 2 0.007% 99.645% ( 34, 51 ] 2 0.007% 99.652% ( 51, 76 ] 1 0.004% 99.656% ( 76, 110 ] 9 0.034% 99.690% ( 170, 250 ] 26 0.097% 99.787% ( 250, 380 ] 2 0.007% 99.794% ( 380, 580 ] 7 0.026% 99.820% ( 580, 870 ] 10 0.037% 99.858% ( 870, 1300 ] 10 0.037% 99.895% ( 1300, 1900 ] 15 0.056% 99.951% ( 1900, 2900 ] 13 0.049% 100.000% ( 2900, 4400 ] 8 0.030% 100.030% ( 4400, 6600 ] 7 0.026% 100.056% ( 6600, 9900 ] 1 0.004% 100.060% ** Level 5 read latency histogram (micros): Count: 20 Average: 747.8500 StdDev: 822.70 Min: 98 Median: 250.0000 Max: 2809 Percentiles: P50: 250.00 P75: 1085.00 P99: 2809.00 P99.9: 2809.00 P99.99: 2809.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 5 25.000% 50.000% ##### ( 250, 380 ] 1 5.000% 55.000% # ( 580, 870 ] 3 15.000% 70.000% ### ( 870, 1300 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 50.3 total, 32.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 136.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.823 H:M:S, 59.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 30.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:27.986 H:M:S, 86.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/28-09:08:22 ... thread 0: (1000000,8000000) ops and (231762.3,147053.7) ops/second in (4.314766,54.401913) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/5 1.72 GB 94.4 5.8 0.0 5.8 13.4 7.6 0.0 1.8 120.9 277.3 49.50 42.20 129 0.384 6076K 6787 0.0 0.0 L1 0/0 0.00 KB 0.0 7.2 5.7 1.5 7.1 5.6 0.1 1.2 214.5 210.4 34.32 30.73 4 8.580 7476K 142K 0.0 0.0 L2 1/0 36.51 MB 0.4 0.8 0.7 0.1 0.8 0.7 5.0 1.2 147.5 147.0 5.59 3.84 3 1.862 180K 37 0.0 0.0 L3 13/0 896.69 MB 0.9 3.6 2.8 0.8 3.6 2.8 3.0 1.3 142.1 141.6 25.78 16.77 24 1.074 2167K 7990 0.0 0.0 L4 151/0 9.42 GB 1.0 4.4 3.4 1.1 4.4 3.4 2.1 1.3 121.5 121.0 37.42 21.31 29 1.290 4618K 18K 0.0 0.0 L5 1116/0 91.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/5 103.52 GB 0.0 21.9 12.6 9.3 29.2 20.0 15.8 3.9 146.7 196.2 152.61 114.85 189 0.807 20M 176K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.9 12.6 9.3 29.2 20.0 15.7 3.9 146.7 196.2 152.61 114.85 189 0.807 20M 176K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.9 12.6 9.3 21.7 12.4 0.0 0.0 176.6 175.2 126.73 95.12 81 1.565 20M 176K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 299.5 25.87 19.73 108 0.240 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.6 total, 54.4 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.24 GB write, 548.13 MB/s write, 21.86 GB read, 409.68 MB/s read, 152.6 seconds Interval compaction: 29.24 GB write, 550.45 MB/s write, 21.86 GB read, 411.42 MB/s read, 152.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 82, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 82, interval: 94 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3239696 Average: 3.1888 StdDev: 31.78 Min: 0 Median: 1.4213 Max: 12090 Percentiles: P50: 1.42 P75: 1.82 P99: 8.32 P99.9: 166.74 P99.99: 551.01 ------------------------------------------------------ [ 0, 1 ] 768920 23.734% 23.734% ##### ( 1, 2 ] 2019925 62.349% 86.084% ############ ( 2, 3 ] 248580 7.673% 93.756% ## ( 3, 4 ] 92545 2.857% 96.613% # ( 4, 6 ] 68499 2.114% 98.727% ( 6, 10 ] 15213 0.470% 99.197% ( 10, 15 ] 3742 0.116% 99.313% ( 15, 22 ] 769 0.024% 99.336% ( 22, 34 ] 48 0.001% 99.338% ( 34, 51 ] 19 0.001% 99.338% ( 51, 76 ] 686 0.021% 99.360% ( 76, 110 ] 10712 0.331% 99.690% ( 110, 170 ] 7189 0.222% 99.912% ( 170, 250 ] 1067 0.033% 99.945% ( 250, 380 ] 833 0.026% 99.971% ( 380, 580 ] 731 0.023% 99.993% ( 580, 870 ] 276 0.009% 100.002% ( 870, 1300 ] 137 0.004% 100.006% ( 1300, 1900 ] 74 0.002% 100.008% ( 1900, 2900 ] 80 0.002% 100.011% ( 2900, 4400 ] 76 0.002% 100.013% ( 4400, 6600 ] 16 0.000% 100.014% ( 6600, 9900 ] 6 0.000% 100.014% ( 9900, 14000 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 1729140 Average: 7.1181 StdDev: 144.40 Min: 0 Median: 1.8233 Max: 107170 Percentiles: P50: 1.82 P75: 2.80 P99: 9.14 P99.9: 140.21 P99.99: 554.30 ------------------------------------------------------ [ 0, 1 ] 156507 9.051% 9.051% ## ( 1, 2 ] 860070 49.740% 58.791% ########## ( 2, 3 ] 349113 20.190% 78.981% #### ( 3, 4 ] 158984 9.194% 88.175% ## ( 4, 6 ] 163305 9.444% 97.620% ## ( 6, 10 ] 30393 1.758% 99.377% ( 10, 15 ] 5998 0.347% 99.724% ( 15, 22 ] 713 0.041% 99.765% ( 22, 34 ] 51 0.003% 99.768% ( 34, 51 ] 26 0.002% 99.770% ( 51, 76 ] 172 0.010% 99.780% ( 76, 110 ] 1448 0.084% 99.864% ( 110, 170 ] 1253 0.072% 99.936% ( 170, 250 ] 185 0.011% 99.947% ( 250, 380 ] 302 0.017% 99.964% ( 380, 580 ] 513 0.030% 99.994% ( 580, 870 ] 692 0.040% 100.034% ( 870, 1300 ] 542 0.031% 100.065% ( 1300, 1900 ] 374 0.022% 100.087% ( 1900, 2900 ] 517 0.030% 100.117% ( 2900, 4400 ] 605 0.035% 100.152% ( 4400, 6600 ] 184 0.011% 100.162% ( 6600, 9900 ] 83 0.005% 100.167% ( 9900, 14000 ] 14 0.001% 100.168% ( 14000, 22000 ] 1 0.000% 100.168% ( 75000, 110000 ] 1 0.000% 100.168% ** Level 2 read latency histogram (micros): Count: 227429 Average: 9.1665 StdDev: 142.15 Min: 1 Median: 1.9345 Max: 16250 Percentiles: P50: 1.93 P75: 2.92 P99: 9.68 P99.9: 1258.75 P99.99: 3039.87 ------------------------------------------------------ [ 0, 1 ] 5177 2.276% 2.276% ( 1, 2 ] 116149 51.070% 53.347% ########## ( 2, 3 ] 53380 23.471% 76.818% ##### ( 3, 4 ] 22861 10.052% 86.870% ## ( 4, 6 ] 22987 10.107% 96.977% ## ( 6, 10 ] 5002 2.199% 99.176% ( 10, 15 ] 896 0.394% 99.570% ( 15, 22 ] 111 0.049% 99.619% ( 22, 34 ] 13 0.006% 99.625% ( 34, 51 ] 1 0.000% 99.625% ( 51, 76 ] 5 0.002% 99.628% ( 76, 110 ] 7 0.003% 99.631% ( 110, 170 ] 40 0.018% 99.648% ( 170, 250 ] 40 0.018% 99.666% ( 250, 380 ] 88 0.039% 99.705% ( 380, 580 ] 151 0.066% 99.771% ( 580, 870 ] 167 0.073% 99.844% ( 870, 1300 ] 140 0.062% 99.906% ( 1300, 1900 ] 94 0.041% 99.947% ( 1900, 2900 ] 87 0.038% 99.985% ( 2900, 4400 ] 110 0.048% 100.034% ( 4400, 6600 ] 28 0.012% 100.046% ( 6600, 9900 ] 16 0.007% 100.053% ( 9900, 14000 ] 1 0.000% 100.054% ( 14000, 22000 ] 2 0.001% 100.055% ** Level 3 read latency histogram (micros): Count: 547353 Average: 14.5420 StdDev: 173.98 Min: 0 Median: 1.9870 Max: 19897 Percentiles: P50: 1.99 P75: 3.01 P99: 13.96 P99.9: 1842.66 P99.99: 3086.22 ------------------------------------------------------ [ 0, 1 ] 9624 1.758% 1.758% ( 1, 2 ] 267535 48.878% 50.636% ########## ( 2, 3 ] 132893 24.279% 74.915% ##### ( 3, 4 ] 62397 11.400% 86.315% ## ( 4, 6 ] 57499 10.505% 96.820% ## ( 6, 10 ] 10426 1.905% 98.725% ( 10, 15 ] 1902 0.347% 99.072% ( 15, 22 ] 219 0.040% 99.112% ( 22, 34 ] 45 0.008% 99.121% ( 34, 51 ] 29 0.005% 99.126% ( 51, 76 ] 14 0.003% 99.129% ( 76, 110 ] 41 0.007% 99.136% ( 110, 170 ] 177 0.032% 99.168% ( 170, 250 ] 275 0.050% 99.219% ( 250, 380 ] 494 0.090% 99.309% ( 380, 580 ] 893 0.163% 99.472% ( 580, 870 ] 1085 0.198% 99.670% ( 870, 1300 ] 819 0.150% 99.820% ( 1300, 1900 ] 485 0.089% 99.908% ( 1900, 2900 ] 394 0.072% 99.980% ( 2900, 4400 ] 421 0.077% 100.057% ( 4400, 6600 ] 115 0.021% 100.078% ( 6600, 9900 ] 27 0.005% 100.083% ( 9900, 14000 ] 2 0.000% 100.084% ( 14000, 22000 ] 4 0.001% 100.084% ** Level 4 read latency histogram (micros): Count: 135142 Average: 8.7487 StdDev: 119.60 Min: 0 Median: 1.9403 Max: 8614 Percentiles: P50: 1.94 P75: 2.87 P99: 9.75 P99.9: 1566.42 P99.99: 3366.58 ------------------------------------------------------ [ 0, 1 ] 1393 1.031% 1.031% ( 1, 2 ] 70378 52.077% 53.108% ########## ( 2, 3 ] 33983 25.146% 78.254% ##### ( 3, 4 ] 12896 9.543% 87.797% ## ( 4, 6 ] 12668 9.374% 97.170% ## ( 6, 10 ] 2637 1.951% 99.122% ( 10, 15 ] 468 0.346% 99.468% ( 15, 22 ] 50 0.037% 99.505% ( 22, 34 ] 8 0.006% 99.511% ( 34, 51 ] 3 0.002% 99.513% ( 51, 76 ] 2 0.001% 99.515% ( 76, 110 ] 23 0.017% 99.532% ( 110, 170 ] 29 0.021% 99.553% ( 170, 250 ] 98 0.073% 99.626% ( 250, 380 ] 67 0.050% 99.675% ( 380, 580 ] 97 0.072% 99.747% ( 580, 870 ] 97 0.072% 99.819% ( 870, 1300 ] 77 0.057% 99.876% ( 1300, 1900 ] 74 0.055% 99.930% ( 1900, 2900 ] 64 0.047% 99.978% ( 2900, 4400 ] 53 0.039% 100.017% ( 4400, 6600 ] 16 0.012% 100.029% ( 6600, 9900 ] 3 0.002% 100.031% ** Level 5 read latency histogram (micros): Count: 340 Average: 1620.6324 StdDev: 1512.68 Min: 87 Median: 1062.3684 Max: 10064 Percentiles: P50: 1062.37 P75: 2677.78 P99: 6343.33 P99.9: 10064.00 P99.99: 10064.00 ------------------------------------------------------ ( 76, 110 ] 7 2.059% 2.059% ( 110, 170 ] 15 4.412% 6.471% # ( 170, 250 ] 29 8.529% 15.000% ## ( 250, 380 ] 28 8.235% 23.235% ## ( 380, 580 ] 38 11.176% 34.412% ## ( 580, 870 ] 36 10.588% 45.000% ## ( 870, 1300 ] 38 11.176% 56.176% ## ( 1300, 1900 ] 29 8.529% 64.706% ## ( 1900, 2900 ] 45 13.235% 77.941% ### ( 2900, 4400 ] 61 17.941% 95.882% #### ( 4400, 6600 ] 12 3.529% 99.412% # ( 6600, 9900 ] 1 0.294% 99.706% ( 9900, 14000 ] 1 0.294% 100.000% ** DB Stats ** Uptime(secs): 54.6 total, 4.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 144.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.282 H:M:S, 57.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 228.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.458 H:M:S, 33.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-09:08:25 ... thread 0: (1000000,9000000) ops and (324385.8,156563.5) ops/second in (3.082749,57.484662) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 1.84 GB 6.3 6.4 0.0 6.4 14.9 8.5 0.0 1.7 119.8 279.7 54.70 46.98 145 0.377 6652K 7394 0.0 0.0 L1 4/4 300.59 MB 0.0 8.0 6.5 1.5 7.8 6.4 0.1 1.2 211.9 208.1 38.61 34.37 5 7.722 8307K 144K 0.0 0.0 L2 1/0 36.51 MB 0.4 0.8 0.7 0.1 0.8 0.7 5.5 1.2 147.5 147.0 5.59 3.84 3 1.862 180K 37 0.0 0.0 L3 16/0 965.21 MB 1.0 4.2 3.1 1.1 4.2 3.0 3.2 1.4 149.8 149.2 28.76 19.58 26 1.106 2821K 11K 0.0 0.0 L4 151/0 9.54 GB 1.0 4.8 3.7 1.1 4.7 3.6 2.3 1.3 124.9 124.4 38.98 22.76 32 1.218 4946K 20K 0.0 0.0 L5 1120/0 91.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/16 104.44 GB 0.0 24.2 13.9 10.2 32.5 22.3 17.0 3.8 148.4 199.8 166.64 127.54 211 0.790 22M 184K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.2 13.9 10.2 32.5 22.3 16.9 3.8 148.4 199.8 166.64 127.54 211 0.790 22M 184K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.2 13.9 10.2 24.0 13.7 0.0 0.0 179.4 178.0 137.85 105.23 89 1.549 22M 184K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 304.2 28.79 22.31 122 0.236 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.7 total, 57.5 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.52 GB write, 576.91 MB/s write, 24.15 GB read, 428.53 MB/s read, 166.6 seconds Interval compaction: 32.52 GB write, 579.22 MB/s write, 24.15 GB read, 430.25 MB/s read, 166.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 85, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 85, interval: 97 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3484872 Average: 3.1349 StdDev: 30.86 Min: 0 Median: 1.4342 Max: 12090 Percentiles: P50: 1.43 P75: 1.83 P99: 7.95 P99.9: 164.49 P99.99: 534.15 ------------------------------------------------------ [ 0, 1 ] 796419 22.854% 22.854% ##### ( 1, 2 ] 2178715 62.519% 85.373% ############# ( 2, 3 ] 284658 8.168% 93.541% ## ( 3, 4 ] 104625 3.002% 96.543% # ( 4, 6 ] 77555 2.225% 98.769% ( 6, 10 ] 16498 0.473% 99.242% ( 10, 15 ] 4090 0.117% 99.360% ( 15, 22 ] 805 0.023% 99.383% ( 22, 34 ] 54 0.002% 99.384% ( 34, 51 ] 20 0.001% 99.385% ( 51, 76 ] 688 0.020% 99.405% ( 76, 110 ] 10712 0.307% 99.712% ( 110, 170 ] 7212 0.207% 99.919% ( 170, 250 ] 1074 0.031% 99.950% ( 250, 380 ] 834 0.024% 99.974% ( 380, 580 ] 735 0.021% 99.995% ( 580, 870 ] 282 0.008% 100.003% ( 870, 1300 ] 140 0.004% 100.007% ( 1300, 1900 ] 78 0.002% 100.009% ( 1900, 2900 ] 83 0.002% 100.012% ( 2900, 4400 ] 77 0.002% 100.014% ( 4400, 6600 ] 16 0.000% 100.014% ( 6600, 9900 ] 6 0.000% 100.014% ( 9900, 14000 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 1892571 Average: 6.7626 StdDev: 138.12 Min: 0 Median: 1.8103 Max: 107170 Percentiles: P50: 1.81 P75: 2.76 P99: 9.07 P99.9: 139.63 P99.99: 550.71 ------------------------------------------------------ [ 0, 1 ] 163827 8.656% 8.656% ## ( 1, 2 ] 965654 51.023% 59.680% ########## ( 2, 3 ] 379934 20.075% 79.755% #### ( 3, 4 ] 167992 8.876% 88.631% ## ( 4, 6 ] 170963 9.033% 97.664% ## ( 6, 10 ] 32984 1.743% 99.407% ( 10, 15 ] 6192 0.327% 99.734% ( 15, 22 ] 742 0.039% 99.774% ( 22, 34 ] 54 0.003% 99.777% ( 34, 51 ] 26 0.001% 99.778% ( 51, 76 ] 175 0.009% 99.787% ( 76, 110 ] 1484 0.078% 99.866% ( 110, 170 ] 1319 0.070% 99.935% ( 170, 250 ] 221 0.012% 99.947% ( 250, 380 ] 347 0.018% 99.965% ( 380, 580 ] 548 0.029% 99.994% ( 580, 870 ] 716 0.038% 100.032% ( 870, 1300 ] 548 0.029% 100.061% ( 1300, 1900 ] 378 0.020% 100.081% ( 1900, 2900 ] 518 0.027% 100.108% ( 2900, 4400 ] 605 0.032% 100.140% ( 4400, 6600 ] 184 0.010% 100.150% ( 6600, 9900 ] 83 0.004% 100.154% ( 9900, 14000 ] 14 0.001% 100.155% ( 14000, 22000 ] 1 0.000% 100.155% ( 75000, 110000 ] 1 0.000% 100.155% ** Level 2 read latency histogram (micros): Count: 227429 Average: 9.1665 StdDev: 142.15 Min: 1 Median: 1.9345 Max: 16250 Percentiles: P50: 1.93 P75: 2.92 P99: 9.68 P99.9: 1258.75 P99.99: 3039.87 ------------------------------------------------------ [ 0, 1 ] 5177 2.276% 2.276% ( 1, 2 ] 116149 51.070% 53.347% ########## ( 2, 3 ] 53380 23.471% 76.818% ##### ( 3, 4 ] 22861 10.052% 86.870% ## ( 4, 6 ] 22987 10.107% 96.977% ## ( 6, 10 ] 5002 2.199% 99.176% ( 10, 15 ] 896 0.394% 99.570% ( 15, 22 ] 111 0.049% 99.619% ( 22, 34 ] 13 0.006% 99.625% ( 34, 51 ] 1 0.000% 99.625% ( 51, 76 ] 5 0.002% 99.628% ( 76, 110 ] 7 0.003% 99.631% ( 110, 170 ] 40 0.018% 99.648% ( 170, 250 ] 40 0.018% 99.666% ( 250, 380 ] 88 0.039% 99.705% ( 380, 580 ] 151 0.066% 99.771% ( 580, 870 ] 167 0.073% 99.844% ( 870, 1300 ] 140 0.062% 99.906% ( 1300, 1900 ] 94 0.041% 99.947% ( 1900, 2900 ] 87 0.038% 99.985% ( 2900, 4400 ] 110 0.048% 100.034% ( 4400, 6600 ] 28 0.012% 100.046% ( 6600, 9900 ] 16 0.007% 100.053% ( 9900, 14000 ] 1 0.000% 100.054% ( 14000, 22000 ] 2 0.001% 100.055% ** Level 3 read latency histogram (micros): Count: 628558 Average: 13.0809 StdDev: 162.55 Min: 0 Median: 1.9524 Max: 19897 Percentiles: P50: 1.95 P75: 2.95 P99: 12.41 P99.9: 1625.91 P99.99: 2773.46 ------------------------------------------------------ [ 0, 1 ] 11619 1.849% 1.849% ( 1, 2 ] 317800 50.560% 52.409% ########## ( 2, 3 ] 149934 23.854% 76.262% ##### ( 3, 4 ] 68494 10.897% 87.159% ## ( 4, 6 ] 62261 9.905% 97.065% ## ( 6, 10 ] 11164 1.776% 98.841% ( 10, 15 ] 2072 0.330% 99.170% ( 15, 22 ] 238 0.038% 99.208% ( 22, 34 ] 48 0.008% 99.216% ( 34, 51 ] 29 0.005% 99.221% ( 51, 76 ] 20 0.003% 99.224% ( 76, 110 ] 97 0.015% 99.239% ( 110, 170 ] 227 0.036% 99.275% ( 170, 250 ] 307 0.049% 99.324% ( 250, 380 ] 523 0.083% 99.407% ( 380, 580 ] 918 0.146% 99.553% ( 580, 870 ] 1095 0.174% 99.728% ( 870, 1300 ] 820 0.130% 99.858% ( 1300, 1900 ] 485 0.077% 99.935% ( 1900, 2900 ] 394 0.063% 99.998% ( 2900, 4400 ] 422 0.067% 100.065% ( 4400, 6600 ] 115 0.018% 100.083% ( 6600, 9900 ] 27 0.004% 100.088% ( 9900, 14000 ] 2 0.000% 100.088% ( 14000, 22000 ] 4 0.001% 100.089% ** Level 4 read latency histogram (micros): Count: 135533 Average: 8.9748 StdDev: 119.81 Min: 0 Median: 1.9412 Max: 8614 Percentiles: P50: 1.94 P75: 2.87 P99: 9.96 P99.9: 1563.25 P99.99: 3365.47 ------------------------------------------------------ [ 0, 1 ] 1408 1.039% 1.039% ( 1, 2 ] 70502 52.018% 53.057% ########## ( 2, 3 ] 34048 25.122% 78.179% ##### ( 3, 4 ] 12926 9.537% 87.716% ## ( 4, 6 ] 12677 9.353% 97.069% ## ( 6, 10 ] 2644 1.951% 99.020% ( 10, 15 ] 468 0.345% 99.365% ( 15, 22 ] 50 0.037% 99.402% ( 22, 34 ] 9 0.007% 99.409% ( 34, 51 ] 3 0.002% 99.411% ( 51, 76 ] 2 0.001% 99.413% ( 76, 110 ] 63 0.046% 99.459% ( 110, 170 ] 63 0.046% 99.506% ( 170, 250 ] 118 0.087% 99.593% ( 250, 380 ] 88 0.065% 99.658% ( 380, 580 ] 113 0.083% 99.741% ( 580, 870 ] 104 0.077% 99.818% ( 870, 1300 ] 79 0.058% 99.876% ( 1300, 1900 ] 74 0.055% 99.931% ( 1900, 2900 ] 64 0.047% 99.978% ( 2900, 4400 ] 53 0.039% 100.017% ( 4400, 6600 ] 16 0.012% 100.029% ( 6600, 9900 ] 3 0.002% 100.031% ** Level 5 read latency histogram (micros): Count: 360 Average: 1562.8278 StdDev: 1499.98 Min: 85 Median: 994.4737 Max: 10064 Percentiles: P50: 994.47 P75: 2587.50 P99: 6306.67 P99.9: 10064.00 P99.99: 10064.00 ------------------------------------------------------ ( 76, 110 ] 14 3.889% 3.889% # ( 110, 170 ] 19 5.278% 9.167% # ( 170, 250 ] 30 8.333% 17.500% ## ( 250, 380 ] 29 8.056% 25.556% ## ( 380, 580 ] 39 10.833% 36.389% ## ( 580, 870 ] 38 10.556% 46.944% ## ( 870, 1300 ] 38 10.556% 57.500% ## ( 1300, 1900 ] 30 8.333% 65.833% ## ( 1900, 2900 ] 48 13.333% 79.167% ### ( 2900, 4400 ] 61 16.944% 96.111% ### ( 4400, 6600 ] 12 3.333% 99.444% # ( 6600, 9900 ] 1 0.278% 99.722% ( 9900, 14000 ] 1 0.278% 100.000% ** DB Stats ** Uptime(secs): 57.7 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 153.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.691 H:M:S, 54.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.409 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.122 micros/op 163344 ops/sec 60.002 seconds 9800999 operations; 158.3 MB/s Microseconds per write: Count: 9800999 Average: 6.1220 StdDev: 541.36 Min: 1 Median: 1.7706 Max: 834151 Percentiles: P50: 1.77 P75: 2.80 P99: 9.31 P99.9: 1162.18 P99.99: 2744.23 ------------------------------------------------------ [ 0, 1 ] 1100266 11.226% 11.226% ## ( 1, 2 ] 4931822 50.320% 61.546% ########## ( 2, 3 ] 1638890 16.722% 78.267% ### ( 3, 4 ] 1378113 14.061% 92.328% ### ( 4, 6 ] 558625 5.700% 98.028% # ( 6, 10 ] 114963 1.173% 99.201% ( 10, 15 ] 38513 0.393% 99.594% ( 15, 22 ] 9319 0.095% 99.689% ( 22, 34 ] 1633 0.017% 99.706% ( 34, 51 ] 176 0.002% 99.707% ( 51, 76 ] 30 0.000% 99.708% ( 76, 110 ] 6629 0.068% 99.775% ( 110, 170 ] 2822 0.029% 99.804% ( 170, 250 ] 286 0.003% 99.807% ( 250, 380 ] 153 0.002% 99.809% ( 380, 580 ] 32 0.000% 99.809% ( 580, 870 ] 24 0.000% 99.809% ( 870, 1300 ] 13101 0.134% 99.943% ( 1300, 1900 ] 47 0.000% 99.943% ( 1900, 2900 ] 5419 0.055% 99.999% ( 2900, 4400 ] 91 0.001% 100.000% ( 4400, 6600 ] 10 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 198996 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9800999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10114630968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 550 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32080257 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27675547876 rocksdb.compact.write.bytes COUNT : 27470152718 rocksdb.flush.write.bytes COUNT : 9974434165 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 83 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 309 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9894142976 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3962880 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27781196784 rocksdb.non.last.level.read.count COUNT : 6705364 rocksdb.block.checksum.compute.count COUNT : 6704347 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.411129 P95 : 3.925809 P99 : 7.796368 P100 : 834149.000000 COUNT : 9800999 SUM : 55117077 rocksdb.compaction.times.micros P50 : 1145000.000000 P95 : 2625000.000000 P99 : 22990000.000000 P100 : 26001391.000000 COUNT : 91 SUM : 140033239 rocksdb.compaction.times.cpu_micros P50 : 843888.888889 P95 : 2350000.000000 P99 : 22682349.000000 P100 : 22682349.000000 COUNT : 91 SUM : 107376267 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 705.405405 P95 : 5940.000000 P99 : 67000.000000 P100 : 127690.000000 COUNT : 132 SUM : 358129 rocksdb.compaction.outfile.sync.micros P50 : 1207.857143 P95 : 83480.769231 P99 : 146300.000000 P100 : 294063.000000 COUNT : 337 SUM : 4885200 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 118.571429 P95 : 2831.250000 P99 : 4172.500000 P100 : 4962.000000 COUNT : 282 SUM : 160109 rocksdb.table.open.io.micros P50 : 1614.851485 P95 : 9712.500000 P99 : 14666.666667 P100 : 19813.000000 COUNT : 550 SUM : 1489772 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.654148 P95 : 8.029442 P99 : 12.724678 P100 : 107176.000000 COUNT : 6702747 SUM : 50363387 rocksdb.read.block.get.micros P50 : 493.385827 P95 : 4047.058824 P99 : 6103.225806 P100 : 10589.000000 COUNT : 1100 SUM : 1163320 rocksdb.write.raw.block.micros P50 : 0.514117 P95 : 0.976823 P99 : 2.835728 P100 : 31135.000000 COUNT : 9081410 SUM : 20601455 rocksdb.numfiles.in.singlecompaction P50 : 3.042683 P95 : 3.981098 P99 : 11.450000 P100 : 28.000000 COUNT : 171 SUM : 565 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.583057 P95 : 1263.958295 P99 : 2663.525367 P100 : 833976.000000 COUNT : 130347 SUM : 32095650 rocksdb.sst.read.micros P50 : 1.601369 P95 : 4.808343 P99 : 9.205116 P100 : 107170.000000 COUNT : 6705574 SUM : 36690221 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9800999 SUM : 10114630968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210506.329114 P95 : 487666.666667 P99 : 953112.000000 P100 : 953112.000000 COUNT : 132 SUM : 30967283 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 329 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0