[2024-07-26 07:12:19.409119] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... [2024-07-26 07:12:19.409368] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1313171 ] Set seed to 1721970739402788 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-26 07:12:19.522307] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-26 07:12:19.745904] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-26 07:12:19.745954] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1313171' to capture a snapshot of events at runtime. [2024-07-26 07:12:19.745964] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1313171 for offline analysis/debug. [2024-07-26 07:12:19.745993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 26 07:12:29 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/26-07:12:32 ... thread 0: (1000000,1000000) ops and (339440.2,339440.2) ops/second in (2.946027,2.946027) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.98 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 352.5 2.50 2.25 12 0.208 0 0 0.0 0.0 L1 3/0 249.26 MB 24.9 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.3 248.0 1.02 0.98 1 1.015 255K 229 0.0 0.0 L2 3/2 191.36 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 246.5 246.4 0.78 0.75 2 0.392 196K 97 0.0 0.0 L3 12/0 993.33 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 103.6 308.5 4.30 3.98 15 0.287 452K 326 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.2 1.5 103.6 308.5 4.30 3.98 15 0.287 452K 326 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 247.5 247.3 1.80 1.73 3 0.600 452K 326 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 352.5 2.50 2.25 12 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.30 GB write, 416.88 MB/s write, 0.43 GB read, 139.92 MB/s read, 4.3 seconds Interval compaction: 1.30 GB write, 450.09 MB/s write, 0.43 GB read, 151.07 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 154627 Average: 2.0609 StdDev: 16.05 Min: 1 Median: 1.3657 Max: 3390 Percentiles: P50: 1.37 P75: 1.76 P99: 5.47 P99.9: 9.90 P99.99: 20.27 ------------------------------------------------------ [ 0, 1 ] 41819 27.045% 27.045% ##### ( 1, 2 ] 97069 62.776% 89.821% ############# ( 2, 3 ] 8479 5.484% 95.305% # ( 3, 4 ] 3840 2.483% 97.788% ( 4, 6 ] 2547 1.647% 99.435% ( 6, 10 ] 738 0.477% 99.913% ( 10, 15 ] 111 0.072% 99.984% ( 15, 22 ] 14 0.009% 99.994% ( 22, 34 ] 5 0.003% 99.997% ( 34, 51 ] 4 0.003% 99.999% ( 51, 76 ] 1 0.001% 100.000% ( 76, 110 ] 1 0.001% 100.001% ( 110, 170 ] 8 0.005% 100.006% ( 170, 250 ] 2 0.001% 100.007% ( 250, 380 ] 3 0.002% 100.009% ( 380, 580 ] 2 0.001% 100.010% ( 580, 870 ] 1 0.001% 100.011% ( 870, 1300 ] 1 0.001% 100.012% ( 1300, 1900 ] 3 0.002% 100.014% ( 1900, 2900 ] 3 0.002% 100.016% ( 2900, 4400 ] 1 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 655 Average: 7.1847 StdDev: 49.94 Min: 0 Median: 2.3466 Max: 1001 Percentiles: P50: 2.35 P75: 3.11 P99: 27.40 P99.9: 1001.00 P99.99: 1001.00 ------------------------------------------------------ [ 0, 1 ] 21 3.206% 3.206% # ( 1, 2 ] 224 34.198% 37.405% ####### ( 2, 3 ] 238 36.336% 73.740% ####### ( 3, 4 ] 76 11.603% 85.344% ## ( 4, 6 ] 57 8.702% 94.046% ## ( 6, 10 ] 24 3.664% 97.710% # ( 10, 15 ] 6 0.916% 98.626% ( 15, 22 ] 2 0.305% 98.931% ( 22, 34 ] 1 0.153% 99.084% ( 110, 170 ] 1 0.153% 99.237% ( 170, 250 ] 2 0.305% 99.542% ( 380, 580 ] 1 0.153% 99.695% ( 580, 870 ] 1 0.153% 99.847% ( 870, 1300 ] 1 0.153% 100.000% ** Level 2 read latency histogram (micros): Count: 42892 Average: 2.4566 StdDev: 28.76 Min: 0 Median: 1.5139 Max: 5261 Percentiles: P50: 1.51 P75: 1.89 P99: 5.94 P99.9: 12.35 P99.99: 361.20 ------------------------------------------------------ [ 0, 1 ] 6596 15.378% 15.378% ### ( 1, 2 ] 28896 67.369% 82.747% ############# ( 2, 3 ] 3774 8.799% 91.546% ## ( 3, 4 ] 1898 4.425% 95.971% # ( 4, 6 ] 1340 3.124% 99.095% # ( 6, 10 ] 323 0.753% 99.848% ( 10, 15 ] 47 0.110% 99.958% ( 15, 22 ] 8 0.019% 99.977% ( 34, 51 ] 1 0.002% 99.979% ( 51, 76 ] 2 0.005% 99.984% ( 110, 170 ] 1 0.002% 99.986% ( 250, 380 ] 2 0.005% 99.991% ( 380, 580 ] 1 0.002% 99.993% ( 870, 1300 ] 2 0.005% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ( 1900, 2900 ] 1 0.002% 100.002% ( 4400, 6600 ] 1 0.002% 100.005% ** Level 3 read latency histogram (micros): Count: 55 Average: 3115.0000 StdDev: 3326.80 Min: 57 Median: 2036.3636 Max: 13090 Percentiles: P50: 2036.36 P75: 3537.50 P99: 13090.00 P99.9: 13090.00 P99.99: 13090.00 ------------------------------------------------------ ( 51, 76 ] 2 3.636% 3.636% # ( 76, 110 ] 1 1.818% 5.455% ( 110, 170 ] 3 5.455% 10.909% # ( 170, 250 ] 1 1.818% 12.727% ( 250, 380 ] 3 5.455% 18.182% # ( 380, 580 ] 1 1.818% 20.000% ( 870, 1300 ] 3 5.455% 25.455% # ( 1300, 1900 ] 12 21.818% 47.273% #### ( 1900, 2900 ] 11 20.000% 67.273% #### ( 2900, 4400 ] 10 18.182% 85.455% #### ( 4400, 6600 ] 1 1.818% 87.273% ( 6600, 9900 ] 2 3.636% 90.909% # ( 9900, 14000 ] 5 9.091% 100.000% ## ** Level 4 read latency histogram (micros): Count: 20 Average: 3923.3500 StdDev: 3179.62 Min: 557 Median: 2566.6667 Max: 11171 Percentiles: P50: 2566.67 P75: 6600.00 P99: 11171.00 P99.9: 11171.00 P99.99: 11171.00 ------------------------------------------------------ ( 380, 580 ] 1 5.000% 5.000% # ( 870, 1300 ] 2 10.000% 15.000% ## ( 1300, 1900 ] 5 25.000% 40.000% ##### ( 1900, 2900 ] 3 15.000% 55.000% ### ( 2900, 4400 ] 3 15.000% 70.000% ### ( 4400, 6600 ] 1 5.000% 75.000% # ( 6600, 9900 ] 3 15.000% 90.000% ### ( 9900, 14000 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.2 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 309.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.402 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.402 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-07:12:34 ... thread 0: (1000000,2000000) ops and (337821.1,338628.7) ops/second in (2.960147,5.906174) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 1.41 GB 12.6 0.2 0.0 0.2 2.1 1.8 0.0 1.1 40.4 343.7 6.23 5.64 27 0.231 255K 247 0.0 0.0 L1 3/3 249.26 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.3 248.0 1.02 0.98 1 1.015 255K 229 0.0 0.0 L2 1/0 4.40 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 246.5 246.4 0.78 0.75 2 0.392 196K 97 0.0 0.0 L3 15/0 697.06 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.1 1.0 232.1 232.1 0.81 0.73 1 0.805 189K 0 0.0 0.0 L4 173/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 150.5 150.5 1.12 0.76 1 1.118 170K 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/19 97.98 GB 0.0 1.0 0.7 0.3 2.9 2.6 1.0 1.6 105.8 295.6 9.95 8.87 32 0.311 1068K 573 0.0 0.0 Int 0/0 0.00 KB 0.0 1.0 0.7 0.3 2.9 2.6 0.9 1.6 105.8 295.6 9.95 8.87 32 0.311 1068K 573 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.0 0.7 0.3 1.0 0.7 0.0 0.0 224.9 224.8 4.68 4.16 6 0.780 1068K 573 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 358.4 5.27 4.71 26 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.87 GB write, 478.89 MB/s write, 1.03 GB read, 171.35 MB/s read, 10.0 seconds Interval compaction: 2.87 GB write, 497.93 MB/s write, 1.03 GB read, 178.16 MB/s read, 10.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 375063 Average: 2.1719 StdDev: 14.89 Min: 1 Median: 1.4553 Max: 4457 Percentiles: P50: 1.46 P75: 1.84 P99: 5.65 P99.9: 9.93 P99.99: 14.48 ------------------------------------------------------ [ 0, 1 ] 75976 20.257% 20.257% #### ( 1, 2 ] 245018 65.327% 85.584% ############# ( 2, 3 ] 31861 8.495% 94.079% ## ( 3, 4 ] 11446 3.052% 97.131% # ( 4, 6 ] 8481 2.261% 99.392% ( 6, 10 ] 1941 0.518% 99.909% ( 10, 15 ] 340 0.091% 100.000% ( 15, 22 ] 33 0.009% 100.009% ( 22, 34 ] 7 0.002% 100.011% ( 34, 51 ] 5 0.001% 100.012% ( 51, 76 ] 3 0.001% 100.013% ( 76, 110 ] 1 0.000% 100.013% ( 110, 170 ] 15 0.004% 100.017% ( 170, 250 ] 5 0.001% 100.018% ( 250, 380 ] 6 0.002% 100.020% ( 380, 580 ] 8 0.002% 100.022% ( 580, 870 ] 6 0.002% 100.024% ( 870, 1300 ] 3 0.001% 100.025% ( 1300, 1900 ] 4 0.001% 100.026% ( 1900, 2900 ] 4 0.001% 100.027% ( 2900, 4400 ] 2 0.001% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 32195 Average: 2.2117 StdDev: 7.28 Min: 0 Median: 1.5027 Max: 1001 Percentiles: P50: 1.50 P75: 1.87 P99: 5.74 P99.9: 12.27 P99.99: 241.22 ------------------------------------------------------ [ 0, 1 ] 5187 16.111% 16.111% ### ( 1, 2 ] 21705 67.417% 83.528% ############# ( 2, 3 ] 3290 10.219% 93.747% ## ( 3, 4 ] 1021 3.171% 96.919% # ( 4, 6 ] 771 2.395% 99.314% ( 6, 10 ] 173 0.537% 99.851% ( 10, 15 ] 37 0.115% 99.966% ( 15, 22 ] 4 0.012% 99.978% ( 22, 34 ] 1 0.003% 99.981% ( 110, 170 ] 2 0.006% 99.988% ( 170, 250 ] 2 0.006% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ( 870, 1300 ] 1 0.003% 100.003% ** Level 2 read latency histogram (micros): Count: 47967 Average: 2.4254 StdDev: 27.20 Min: 0 Median: 1.5157 Max: 5261 Percentiles: P50: 1.52 P75: 1.88 P99: 5.92 P99.9: 12.23 P99.99: 328.21 ------------------------------------------------------ [ 0, 1 ] 7232 15.077% 15.077% ### ( 1, 2 ] 32483 67.719% 82.797% ############## ( 2, 3 ] 4325 9.017% 91.813% ## ( 3, 4 ] 2055 4.284% 96.097% # ( 4, 6 ] 1448 3.019% 99.116% # ( 6, 10 ] 352 0.734% 99.850% ( 10, 15 ] 54 0.113% 99.962% ( 15, 22 ] 8 0.017% 99.979% ( 34, 51 ] 1 0.002% 99.981% ( 51, 76 ] 2 0.004% 99.985% ( 110, 170 ] 1 0.002% 99.987% ( 250, 380 ] 2 0.004% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 870, 1300 ] 2 0.004% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ( 1900, 2900 ] 1 0.002% 100.002% ( 4400, 6600 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 42818 Average: 5.9858 StdDev: 163.50 Min: 1 Median: 1.3801 Max: 13090 Percentiles: P50: 1.38 P75: 1.76 P99: 5.66 P99.9: 1182.75 P99.99: 10488.92 ------------------------------------------------------ [ 0, 1 ] 10661 24.898% 24.898% ##### ( 1, 2 ] 28275 66.035% 90.934% ############# ( 2, 3 ] 2162 5.049% 95.983% # ( 3, 4 ] 808 1.887% 97.870% ( 4, 6 ] 582 1.359% 99.229% ( 6, 10 ] 225 0.525% 99.755% ( 10, 15 ] 44 0.103% 99.858% ( 15, 22 ] 1 0.002% 99.860% ( 22, 34 ] 1 0.002% 99.862% ( 51, 76 ] 2 0.005% 99.867% ( 76, 110 ] 1 0.002% 99.869% ( 110, 170 ] 4 0.009% 99.879% ( 170, 250 ] 1 0.002% 99.881% ( 250, 380 ] 4 0.009% 99.890% ( 380, 580 ] 2 0.005% 99.895% ( 870, 1300 ] 3 0.007% 99.902% ( 1300, 1900 ] 13 0.030% 99.932% ( 1900, 2900 ] 11 0.026% 99.958% ( 2900, 4400 ] 10 0.023% 99.981% ( 4400, 6600 ] 1 0.002% 99.984% ( 6600, 9900 ] 2 0.005% 99.988% ( 9900, 14000 ] 5 0.012% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 262.0164 StdDev: 1266.52 Min: 0 Median: 1.2123 Max: 11171 Percentiles: P50: 1.21 P75: 4.75 P99: 8745.00 P99.9: 11171.00 P99.99: 11171.00 ------------------------------------------------------ [ 0, 1 ] 137 44.918% 44.918% ######### ( 1, 2 ] 73 23.934% 68.852% ##### ( 2, 3 ] 10 3.279% 72.131% # ( 3, 4 ] 5 1.639% 73.770% ( 4, 6 ] 10 3.279% 77.049% # ( 6, 10 ] 44 14.426% 91.475% ### ( 10, 15 ] 2 0.656% 92.131% ( 110, 170 ] 1 0.328% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 870, 1300 ] 2 0.656% 94.426% ( 1300, 1900 ] 5 1.639% 96.066% ( 1900, 2900 ] 3 0.984% 97.049% ( 2900, 4400 ] 3 0.984% 98.033% ( 4400, 6600 ] 1 0.328% 98.361% ( 6600, 9900 ] 3 0.984% 99.344% ( 9900, 14000 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 831.5500 StdDev: 955.82 Min: 102 Median: 380.0000 Max: 3100 Percentiles: P50: 380.00 P75: 1156.67 P99: 3100.00 P99.9: 3100.00 P99.99: 3100.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 6 30.000% 40.000% ###### ( 170, 250 ] 1 5.000% 45.000% # ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 3 15.000% 80.000% ### ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.803 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.401 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/26-07:12:37 ... thread 0: (1000000,3000000) ops and (337757.4,338337.8) ops/second in (2.960705,8.866879) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.60 GB 138.5 1.4 0.0 1.4 4.1 2.8 0.0 1.5 106.1 323.0 13.06 12.12 44 0.297 1407K 1500 0.0 0.0 L1 5/0 485.34 MB 48.5 1.2 1.0 0.2 1.2 1.0 0.2 1.2 234.6 233.7 5.36 5.21 2 2.679 1276K 4625 0.0 0.0 L2 1/0 4.40 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 246.5 246.4 0.78 0.75 2 0.392 196K 97 0.0 0.0 L3 15/0 897.19 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.6 1.0 232.1 232.1 0.81 0.73 1 0.805 189K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.6 1.0 150.5 150.5 1.12 0.76 1 1.118 170K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/4 98.90 GB 0.0 3.1 1.5 1.7 5.9 4.2 2.7 2.1 151.1 284.9 21.13 19.59 50 0.423 3240K 6222 0.0 0.0 Int 0/0 0.00 KB 0.0 3.1 1.5 1.7 5.9 4.2 2.5 2.1 151.1 284.9 21.13 19.59 50 0.423 3240K 6222 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.1 1.5 1.7 3.1 1.5 0.0 0.0 241.1 240.6 13.24 12.53 11 1.204 3240K 6222 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.4 7.89 7.05 39 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.88 GB write, 661.25 MB/s write, 3.12 GB read, 350.57 MB/s read, 21.1 seconds Interval compaction: 5.88 GB write, 678.76 MB/s write, 3.12 GB read, 359.86 MB/s read, 21.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 690147 Average: 2.1546 StdDev: 12.73 Min: 1 Median: 1.4691 Max: 4457 Percentiles: P50: 1.47 P75: 1.84 P99: 5.51 P99.9: 9.93 P99.99: 14.34 ------------------------------------------------------ [ 0, 1 ] 126320 18.303% 18.303% #### ( 1, 2 ] 466318 67.568% 85.871% ############## ( 2, 3 ] 59827 8.669% 94.540% ## ( 3, 4 ] 20264 2.936% 97.476% # ( 4, 6 ] 13885 2.012% 99.488% ( 6, 10 ] 2895 0.419% 99.908% ( 10, 15 ] 656 0.095% 100.003% ( 15, 22 ] 49 0.007% 100.010% ( 22, 34 ] 8 0.001% 100.011% ( 34, 51 ] 6 0.001% 100.012% ( 51, 76 ] 3 0.000% 100.012% ( 76, 110 ] 1 0.000% 100.012% ( 110, 170 ] 22 0.003% 100.016% ( 170, 250 ] 9 0.001% 100.017% ( 250, 380 ] 8 0.001% 100.018% ( 380, 580 ] 14 0.002% 100.020% ( 580, 870 ] 14 0.002% 100.022% ( 870, 1300 ] 8 0.001% 100.023% ( 1300, 1900 ] 5 0.001% 100.024% ( 1900, 2900 ] 4 0.001% 100.024% ( 2900, 4400 ] 3 0.000% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 63980 Average: 2.3915 StdDev: 17.97 Min: 0 Median: 1.5106 Max: 2030 Percentiles: P50: 1.51 P75: 1.87 P99: 5.59 P99.9: 12.54 P99.99: 1099.62 ------------------------------------------------------ [ 0, 1 ] 9343 14.603% 14.603% ### ( 1, 2 ] 44354 69.325% 83.928% ############## ( 2, 3 ] 6560 10.253% 94.181% ## ( 3, 4 ] 1981 3.096% 97.277% # ( 4, 6 ] 1387 2.168% 99.445% ( 6, 10 ] 258 0.403% 99.848% ( 10, 15 ] 65 0.102% 99.950% ( 15, 22 ] 6 0.009% 99.959% ( 22, 34 ] 2 0.003% 99.962% ( 34, 51 ] 1 0.002% 99.964% ( 110, 170 ] 2 0.003% 99.967% ( 170, 250 ] 2 0.003% 99.970% ( 250, 380 ] 6 0.009% 99.980% ( 380, 580 ] 4 0.006% 99.986% ( 580, 870 ] 1 0.002% 99.987% ( 870, 1300 ] 3 0.005% 99.992% ( 1300, 1900 ] 4 0.006% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47967 Average: 2.4254 StdDev: 27.20 Min: 0 Median: 1.5157 Max: 5261 Percentiles: P50: 1.52 P75: 1.88 P99: 5.92 P99.9: 12.23 P99.99: 328.21 ------------------------------------------------------ [ 0, 1 ] 7232 15.077% 15.077% ### ( 1, 2 ] 32483 67.719% 82.797% ############## ( 2, 3 ] 4325 9.017% 91.813% ## ( 3, 4 ] 2055 4.284% 96.097% # ( 4, 6 ] 1448 3.019% 99.116% # ( 6, 10 ] 352 0.734% 99.850% ( 10, 15 ] 54 0.113% 99.962% ( 15, 22 ] 8 0.017% 99.979% ( 34, 51 ] 1 0.002% 99.981% ( 51, 76 ] 2 0.004% 99.985% ( 110, 170 ] 1 0.002% 99.987% ( 250, 380 ] 2 0.004% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 870, 1300 ] 2 0.004% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ( 1900, 2900 ] 1 0.002% 100.002% ( 4400, 6600 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 42818 Average: 5.9858 StdDev: 163.50 Min: 1 Median: 1.3801 Max: 13090 Percentiles: P50: 1.38 P75: 1.76 P99: 5.66 P99.9: 1182.75 P99.99: 10488.92 ------------------------------------------------------ [ 0, 1 ] 10661 24.898% 24.898% ##### ( 1, 2 ] 28275 66.035% 90.934% ############# ( 2, 3 ] 2162 5.049% 95.983% # ( 3, 4 ] 808 1.887% 97.870% ( 4, 6 ] 582 1.359% 99.229% ( 6, 10 ] 225 0.525% 99.755% ( 10, 15 ] 44 0.103% 99.858% ( 15, 22 ] 1 0.002% 99.860% ( 22, 34 ] 1 0.002% 99.862% ( 51, 76 ] 2 0.005% 99.867% ( 76, 110 ] 1 0.002% 99.869% ( 110, 170 ] 4 0.009% 99.879% ( 170, 250 ] 1 0.002% 99.881% ( 250, 380 ] 4 0.009% 99.890% ( 380, 580 ] 2 0.005% 99.895% ( 870, 1300 ] 3 0.007% 99.902% ( 1300, 1900 ] 13 0.030% 99.932% ( 1900, 2900 ] 11 0.026% 99.958% ( 2900, 4400 ] 10 0.023% 99.981% ( 4400, 6600 ] 1 0.002% 99.984% ( 6600, 9900 ] 2 0.005% 99.988% ( 9900, 14000 ] 5 0.012% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 262.0164 StdDev: 1266.52 Min: 0 Median: 1.2123 Max: 11171 Percentiles: P50: 1.21 P75: 4.75 P99: 8745.00 P99.9: 11171.00 P99.99: 11171.00 ------------------------------------------------------ [ 0, 1 ] 137 44.918% 44.918% ######### ( 1, 2 ] 73 23.934% 68.852% ##### ( 2, 3 ] 10 3.279% 72.131% # ( 3, 4 ] 5 1.639% 73.770% ( 4, 6 ] 10 3.279% 77.049% # ( 6, 10 ] 44 14.426% 91.475% ### ( 10, 15 ] 2 0.656% 92.131% ( 110, 170 ] 1 0.328% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 870, 1300 ] 2 0.656% 94.426% ( 1300, 1900 ] 5 1.639% 96.066% ( 1900, 2900 ] 3 0.984% 97.049% ( 2900, 4400 ] 3 0.984% 98.033% ( 4400, 6600 ] 1 0.328% 98.361% ( 6600, 9900 ] 3 0.984% 99.344% ( 9900, 14000 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 878.4500 StdDev: 1036.83 Min: 102 Median: 336.6667 Max: 3774 Percentiles: P50: 336.67 P75: 1228.33 P99: 3774.00 P99.9: 3774.00 P99.99: 3774.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 9 22.500% 35.000% ##### ( 170, 250 ] 4 10.000% 45.000% ## ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 1 2.500% 62.500% # ( 870, 1300 ] 6 15.000% 77.500% ### ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 3 7.500% 90.000% ## ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.198 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.395 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/26-07:12:40 ... thread 0: (1000000,4000000) ops and (334740.0,337431.1) ops/second in (2.987393,11.854272) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.58 GB 56.6 1.9 0.0 1.9 5.7 3.8 0.0 1.5 108.1 320.6 18.07 16.75 60 0.301 1982K 2147 0.0 0.0 L1 5/5 485.34 MB 0.0 1.2 1.0 0.2 1.2 1.0 0.2 1.2 234.6 233.7 5.36 5.21 2 2.679 1276K 4625 0.0 0.0 L2 1/0 4.40 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 246.5 246.4 0.78 0.75 2 0.392 196K 97 0.0 0.0 L3 15/0 897.19 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.6 1.0 232.1 232.1 0.81 0.73 1 0.805 189K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.6 1.0 150.5 150.5 1.12 0.76 1 1.118 170K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/19 99.88 GB 0.0 3.7 1.5 2.2 7.4 5.2 2.7 2.0 143.8 290.6 26.13 24.22 66 0.396 3816K 6869 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.5 2.2 7.4 5.2 2.5 2.0 143.8 290.6 26.13 24.22 66 0.396 3816K 6869 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.5 2.2 3.7 1.4 0.0 0.0 243.8 243.3 15.42 14.65 13 1.186 3816K 6869 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 358.5 10.72 9.57 53 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.42 GB write, 628.07 MB/s write, 3.67 GB read, 310.85 MB/s read, 26.1 seconds Interval compaction: 7.42 GB write, 640.51 MB/s write, 3.67 GB read, 317.00 MB/s read, 26.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1001674 Average: 2.1680 StdDev: 11.83 Min: 1 Median: 1.4809 Max: 4457 Percentiles: P50: 1.48 P75: 1.85 P99: 5.57 P99.9: 10.10 P99.99: 14.31 ------------------------------------------------------ [ 0, 1 ] 174986 17.469% 17.469% ### ( 1, 2 ] 677569 67.644% 85.113% ############## ( 2, 3 ] 92509 9.235% 94.348% ## ( 3, 4 ] 29675 2.963% 97.311% # ( 4, 6 ] 21525 2.149% 99.460% ( 6, 10 ] 4388 0.438% 99.898% ( 10, 15 ] 1071 0.107% 100.005% ( 15, 22 ] 92 0.009% 100.014% ( 22, 34 ] 13 0.001% 100.015% ( 34, 51 ] 9 0.001% 100.016% ( 51, 76 ] 4 0.000% 100.017% ( 76, 110 ] 1 0.000% 100.017% ( 110, 170 ] 31 0.003% 100.020% ( 170, 250 ] 12 0.001% 100.021% ( 250, 380 ] 10 0.001% 100.022% ( 380, 580 ] 19 0.002% 100.024% ( 580, 870 ] 19 0.002% 100.026% ( 870, 1300 ] 14 0.001% 100.027% ( 1300, 1900 ] 6 0.001% 100.028% ( 1900, 2900 ] 5 0.000% 100.028% ( 2900, 4400 ] 4 0.000% 100.029% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 63981 Average: 2.3915 StdDev: 17.97 Min: 0 Median: 1.5106 Max: 2030 Percentiles: P50: 1.51 P75: 1.87 P99: 5.59 P99.9: 12.54 P99.99: 1099.61 ------------------------------------------------------ [ 0, 1 ] 9343 14.603% 14.603% ### ( 1, 2 ] 44354 69.324% 83.926% ############## ( 2, 3 ] 6560 10.253% 94.180% ## ( 3, 4 ] 1981 3.096% 97.276% # ( 4, 6 ] 1388 2.169% 99.445% ( 6, 10 ] 258 0.403% 99.848% ( 10, 15 ] 65 0.102% 99.950% ( 15, 22 ] 6 0.009% 99.959% ( 22, 34 ] 2 0.003% 99.962% ( 34, 51 ] 1 0.002% 99.964% ( 110, 170 ] 2 0.003% 99.967% ( 170, 250 ] 2 0.003% 99.970% ( 250, 380 ] 6 0.009% 99.980% ( 380, 580 ] 4 0.006% 99.986% ( 580, 870 ] 1 0.002% 99.987% ( 870, 1300 ] 3 0.005% 99.992% ( 1300, 1900 ] 4 0.006% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47967 Average: 2.4254 StdDev: 27.20 Min: 0 Median: 1.5157 Max: 5261 Percentiles: P50: 1.52 P75: 1.88 P99: 5.92 P99.9: 12.23 P99.99: 328.21 ------------------------------------------------------ [ 0, 1 ] 7232 15.077% 15.077% ### ( 1, 2 ] 32483 67.719% 82.797% ############## ( 2, 3 ] 4325 9.017% 91.813% ## ( 3, 4 ] 2055 4.284% 96.097% # ( 4, 6 ] 1448 3.019% 99.116% # ( 6, 10 ] 352 0.734% 99.850% ( 10, 15 ] 54 0.113% 99.962% ( 15, 22 ] 8 0.017% 99.979% ( 34, 51 ] 1 0.002% 99.981% ( 51, 76 ] 2 0.004% 99.985% ( 110, 170 ] 1 0.002% 99.987% ( 250, 380 ] 2 0.004% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 870, 1300 ] 2 0.004% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ( 1900, 2900 ] 1 0.002% 100.002% ( 4400, 6600 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 42818 Average: 5.9858 StdDev: 163.50 Min: 1 Median: 1.3801 Max: 13090 Percentiles: P50: 1.38 P75: 1.76 P99: 5.66 P99.9: 1182.75 P99.99: 10488.92 ------------------------------------------------------ [ 0, 1 ] 10661 24.898% 24.898% ##### ( 1, 2 ] 28275 66.035% 90.934% ############# ( 2, 3 ] 2162 5.049% 95.983% # ( 3, 4 ] 808 1.887% 97.870% ( 4, 6 ] 582 1.359% 99.229% ( 6, 10 ] 225 0.525% 99.755% ( 10, 15 ] 44 0.103% 99.858% ( 15, 22 ] 1 0.002% 99.860% ( 22, 34 ] 1 0.002% 99.862% ( 51, 76 ] 2 0.005% 99.867% ( 76, 110 ] 1 0.002% 99.869% ( 110, 170 ] 4 0.009% 99.879% ( 170, 250 ] 1 0.002% 99.881% ( 250, 380 ] 4 0.009% 99.890% ( 380, 580 ] 2 0.005% 99.895% ( 870, 1300 ] 3 0.007% 99.902% ( 1300, 1900 ] 13 0.030% 99.932% ( 1900, 2900 ] 11 0.026% 99.958% ( 2900, 4400 ] 10 0.023% 99.981% ( 4400, 6600 ] 1 0.002% 99.984% ( 6600, 9900 ] 2 0.005% 99.988% ( 9900, 14000 ] 5 0.012% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 262.0164 StdDev: 1266.52 Min: 0 Median: 1.2123 Max: 11171 Percentiles: P50: 1.21 P75: 4.75 P99: 8745.00 P99.9: 11171.00 P99.99: 11171.00 ------------------------------------------------------ [ 0, 1 ] 137 44.918% 44.918% ######### ( 1, 2 ] 73 23.934% 68.852% ##### ( 2, 3 ] 10 3.279% 72.131% # ( 3, 4 ] 5 1.639% 73.770% ( 4, 6 ] 10 3.279% 77.049% # ( 6, 10 ] 44 14.426% 91.475% ### ( 10, 15 ] 2 0.656% 92.131% ( 110, 170 ] 1 0.328% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 870, 1300 ] 2 0.656% 94.426% ( 1300, 1900 ] 5 1.639% 96.066% ( 1900, 2900 ] 3 0.984% 97.049% ( 2900, 4400 ] 3 0.984% 98.033% ( 4400, 6600 ] 1 0.328% 98.361% ( 6600, 9900 ] 3 0.984% 99.344% ( 9900, 14000 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 878.4500 StdDev: 1036.83 Min: 102 Median: 336.6667 Max: 3774 Percentiles: P50: 336.67 P75: 1228.33 P99: 3774.00 P99.9: 3774.00 P99.99: 3774.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 9 22.500% 35.000% ##### ( 170, 250 ] 4 10.000% 45.000% ## ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 1 2.500% 62.500% # ( 870, 1300 ] 6 15.000% 77.500% ### ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 3 7.500% 90.000% ## ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.609 H:M:S, 13.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.411 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-07:12:45 ... thread 0: (1000000,5000000) ops and (227190.9,307581.5) ops/second in (4.401584,16.255856) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.56 GB 182.5 3.3 0.0 3.3 8.0 4.7 0.0 1.7 127.7 313.0 26.15 24.44 80 0.327 3390K 3633 0.0 0.0 L1 5/5 485.34 MB 0.0 1.2 1.0 0.2 1.2 1.0 0.2 1.2 234.6 233.7 5.36 5.21 2 2.679 1276K 4625 0.0 0.0 L2 1/0 4.40 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 246.5 246.4 0.78 0.75 2 0.392 196K 97 0.0 0.0 L3 15/0 897.19 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.6 1.0 232.1 232.1 0.81 0.73 1 0.805 189K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.6 1.0 150.5 150.5 1.12 0.76 1 1.118 170K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/15 100.87 GB 0.0 5.0 1.5 3.6 9.8 6.2 2.7 2.1 150.3 291.9 34.22 31.90 86 0.398 5223K 8355 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 1.5 3.6 9.8 6.2 2.5 2.1 150.3 291.9 34.22 31.90 86 0.398 5223K 8355 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 1.5 3.6 5.0 1.4 0.0 0.0 249.6 249.2 20.61 19.75 18 1.145 5223K 8355 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.6 13.60 12.15 68 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.5 total, 16.3 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.75 GB write, 605.50 MB/s write, 5.02 GB read, 311.92 MB/s read, 34.2 seconds Interval compaction: 9.75 GB write, 614.25 MB/s write, 5.02 GB read, 316.43 MB/s read, 34.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 17, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1493755 Average: 2.2276 StdDev: 12.49 Min: 1 Median: 1.4949 Max: 4457 Percentiles: P50: 1.49 P75: 1.86 P99: 5.62 P99.9: 10.83 P99.99: 15.64 ------------------------------------------------------ [ 0, 1 ] 241167 16.145% 16.145% ### ( 1, 2 ] 1021863 68.409% 84.554% ############## ( 2, 3 ] 144139 9.649% 94.203% ## ( 3, 4 ] 45440 3.042% 97.245% # ( 4, 6 ] 32283 2.161% 99.407% ( 6, 10 ] 7106 0.476% 99.882% ( 10, 15 ] 1595 0.107% 99.989% ( 15, 22 ] 138 0.009% 99.998% ( 22, 34 ] 18 0.001% 100.000% ( 34, 51 ] 12 0.001% 100.000% ( 51, 76 ] 5 0.000% 100.001% ( 76, 110 ] 112 0.007% 100.008% ( 110, 170 ] 142 0.010% 100.018% ( 170, 250 ] 59 0.004% 100.022% ( 250, 380 ] 32 0.002% 100.024% ( 380, 580 ] 53 0.004% 100.027% ( 580, 870 ] 34 0.002% 100.030% ( 870, 1300 ] 20 0.001% 100.031% ( 1300, 1900 ] 7 0.000% 100.031% ( 1900, 2900 ] 12 0.001% 100.032% ( 2900, 4400 ] 5 0.000% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 121979 Average: 2.3928 StdDev: 13.70 Min: 0 Median: 1.5204 Max: 2030 Percentiles: P50: 1.52 P75: 1.88 P99: 6.89 P99.9: 14.84 P99.99: 492.08 ------------------------------------------------------ [ 0, 1 ] 16920 13.871% 13.871% ### ( 1, 2 ] 84693 69.432% 83.304% ############## ( 2, 3 ] 12573 10.308% 93.611% ## ( 3, 4 ] 3663 3.003% 96.614% # ( 4, 6 ] 2650 2.173% 98.787% ( 6, 10 ] 1176 0.964% 99.751% ( 10, 15 ] 189 0.155% 99.906% ( 15, 22 ] 13 0.011% 99.916% ( 22, 34 ] 2 0.002% 99.918% ( 34, 51 ] 1 0.001% 99.919% ( 76, 110 ] 40 0.033% 99.952% ( 110, 170 ] 36 0.030% 99.981% ( 170, 250 ] 2 0.002% 99.983% ( 250, 380 ] 7 0.006% 99.989% ( 380, 580 ] 5 0.004% 99.993% ( 580, 870 ] 1 0.001% 99.993% ( 870, 1300 ] 4 0.003% 99.997% ( 1300, 1900 ] 4 0.003% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 47967 Average: 2.4254 StdDev: 27.20 Min: 0 Median: 1.5157 Max: 5261 Percentiles: P50: 1.52 P75: 1.88 P99: 5.92 P99.9: 12.23 P99.99: 328.21 ------------------------------------------------------ [ 0, 1 ] 7232 15.077% 15.077% ### ( 1, 2 ] 32483 67.719% 82.797% ############## ( 2, 3 ] 4325 9.017% 91.813% ## ( 3, 4 ] 2055 4.284% 96.097% # ( 4, 6 ] 1448 3.019% 99.116% # ( 6, 10 ] 352 0.734% 99.850% ( 10, 15 ] 54 0.113% 99.962% ( 15, 22 ] 8 0.017% 99.979% ( 34, 51 ] 1 0.002% 99.981% ( 51, 76 ] 2 0.004% 99.985% ( 110, 170 ] 1 0.002% 99.987% ( 250, 380 ] 2 0.004% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 870, 1300 ] 2 0.004% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ( 1900, 2900 ] 1 0.002% 100.002% ( 4400, 6600 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 42818 Average: 5.9858 StdDev: 163.50 Min: 1 Median: 1.3801 Max: 13090 Percentiles: P50: 1.38 P75: 1.76 P99: 5.66 P99.9: 1182.75 P99.99: 10488.92 ------------------------------------------------------ [ 0, 1 ] 10661 24.898% 24.898% ##### ( 1, 2 ] 28275 66.035% 90.934% ############# ( 2, 3 ] 2162 5.049% 95.983% # ( 3, 4 ] 808 1.887% 97.870% ( 4, 6 ] 582 1.359% 99.229% ( 6, 10 ] 225 0.525% 99.755% ( 10, 15 ] 44 0.103% 99.858% ( 15, 22 ] 1 0.002% 99.860% ( 22, 34 ] 1 0.002% 99.862% ( 51, 76 ] 2 0.005% 99.867% ( 76, 110 ] 1 0.002% 99.869% ( 110, 170 ] 4 0.009% 99.879% ( 170, 250 ] 1 0.002% 99.881% ( 250, 380 ] 4 0.009% 99.890% ( 380, 580 ] 2 0.005% 99.895% ( 870, 1300 ] 3 0.007% 99.902% ( 1300, 1900 ] 13 0.030% 99.932% ( 1900, 2900 ] 11 0.026% 99.958% ( 2900, 4400 ] 10 0.023% 99.981% ( 4400, 6600 ] 1 0.002% 99.984% ( 6600, 9900 ] 2 0.005% 99.988% ( 9900, 14000 ] 5 0.012% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 262.0164 StdDev: 1266.52 Min: 0 Median: 1.2123 Max: 11171 Percentiles: P50: 1.21 P75: 4.75 P99: 8745.00 P99.9: 11171.00 P99.99: 11171.00 ------------------------------------------------------ [ 0, 1 ] 137 44.918% 44.918% ######### ( 1, 2 ] 73 23.934% 68.852% ##### ( 2, 3 ] 10 3.279% 72.131% # ( 3, 4 ] 5 1.639% 73.770% ( 4, 6 ] 10 3.279% 77.049% # ( 6, 10 ] 44 14.426% 91.475% ### ( 10, 15 ] 2 0.656% 92.131% ( 110, 170 ] 1 0.328% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 870, 1300 ] 2 0.656% 94.426% ( 1300, 1900 ] 5 1.639% 96.066% ( 1900, 2900 ] 3 0.984% 97.049% ( 2900, 4400 ] 3 0.984% 98.033% ( 4400, 6600 ] 1 0.328% 98.361% ( 6600, 9900 ] 3 0.984% 99.344% ( 9900, 14000 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 878.4500 StdDev: 1036.83 Min: 102 Median: 336.6667 Max: 3774 Percentiles: P50: 336.67 P75: 1228.33 P99: 3774.00 P99.9: 3774.00 P99.99: 3774.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 9 22.500% 35.000% ##### ( 170, 250 ] 4 10.000% 45.000% ## ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 1 2.500% 62.500% # ( 870, 1300 ] 6 15.000% 77.500% ### ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 3 7.500% 90.000% ## ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 16.5 total, 4.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 298.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.320 H:M:S, 20.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 223.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.712 H:M:S, 38.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/26-07:12:51 ... thread 0: (1000000,6000000) ops and (155186.0,264320.3) ops/second in (6.443879,22.699735) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 2.64 GB 25.2 4.6 0.0 4.6 10.1 5.6 0.0 1.8 132.9 296.1 35.08 31.82 95 0.369 4732K 6523 0.0 0.0 L1 7/7 740.89 MB 0.0 3.5 2.8 0.7 3.5 2.7 0.2 1.2 229.6 227.7 15.54 15.04 3 5.180 3622K 28K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 2.1 1.5 246.5 246.4 0.78 0.75 2 0.392 196K 97 0.0 0.0 L3 38/9 1.72 GB 1.4 2.5 1.2 1.3 2.5 1.2 1.1 2.1 171.3 170.6 14.95 11.60 10 1.495 2601K 11K 0.0 0.0 L4 177/9 9.68 GB 1.0 0.6 0.6 0.0 0.6 0.6 0.8 1.0 140.7 140.5 4.50 2.95 11 0.409 634K 588 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/33 101.69 GB 0.0 11.3 4.7 6.7 16.9 10.2 5.6 3.0 164.0 244.2 70.85 62.17 121 0.586 11M 47K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.3 4.7 6.7 16.9 10.2 5.5 3.0 164.0 244.2 70.85 62.17 121 0.586 11M 47K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.3 4.7 6.7 11.3 4.6 0.0 0.0 216.5 215.6 53.66 47.68 41 1.309 11M 47K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 333.5 17.19 14.48 80 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.9 total, 22.7 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.90 GB write, 754.29 MB/s write, 11.34 GB read, 506.45 MB/s read, 70.9 seconds Interval compaction: 16.90 GB write, 762.09 MB/s write, 11.34 GB read, 511.69 MB/s read, 70.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 28, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2026342 Average: 2.4073 StdDev: 18.06 Min: 0 Median: 1.5291 Max: 6893 Percentiles: P50: 1.53 P75: 1.90 P99: 5.92 P99.9: 12.94 P99.99: 97.86 ------------------------------------------------------ [ 0, 1 ] 297428 14.678% 14.678% ### ( 1, 2 ] 1352699 66.756% 81.434% ############# ( 2, 3 ] 220031 10.859% 92.292% ## ( 3, 4 ] 75063 3.704% 95.997% # ( 4, 6 ] 63274 3.123% 99.119% # ( 6, 10 ] 13908 0.686% 99.806% ( 10, 15 ] 3257 0.161% 99.966% ( 15, 22 ] 302 0.015% 99.981% ( 22, 34 ] 29 0.001% 99.983% ( 34, 51 ] 17 0.001% 99.984% ( 51, 76 ] 6 0.000% 99.984% ( 76, 110 ] 195 0.010% 99.993% ( 110, 170 ] 236 0.012% 100.005% ( 170, 250 ] 103 0.005% 100.010% ( 250, 380 ] 90 0.004% 100.015% ( 380, 580 ] 116 0.006% 100.020% ( 580, 870 ] 81 0.004% 100.024% ( 870, 1300 ] 48 0.002% 100.027% ( 1300, 1900 ] 16 0.001% 100.027% ( 1900, 2900 ] 29 0.001% 100.029% ( 2900, 4400 ] 12 0.001% 100.030% ( 4400, 6600 ] 5 0.000% 100.030% ( 6600, 9900 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 577905 Average: 4.7016 StdDev: 66.44 Min: 0 Median: 1.8226 Max: 7798 Percentiles: P50: 1.82 P75: 2.77 P99: 9.75 P99.9: 21.23 P99.99: 236.89 ------------------------------------------------------ [ 0, 1 ] 31637 5.474% 5.474% # ( 1, 2 ] 312825 54.131% 59.605% ########### ( 2, 3 ] 115477 19.982% 79.587% #### ( 3, 4 ] 46040 7.967% 87.554% ## ( 4, 6 ] 53531 9.263% 96.817% ## ( 6, 10 ] 13447 2.327% 99.144% ( 10, 15 ] 3932 0.680% 99.824% ( 15, 22 ] 492 0.085% 99.909% ( 22, 34 ] 54 0.009% 99.919% ( 34, 51 ] 7 0.001% 99.920% ( 51, 76 ] 1 0.000% 99.920% ( 76, 110 ] 120 0.021% 99.941% ( 110, 170 ] 173 0.030% 99.971% ( 170, 250 ] 133 0.023% 99.994% ( 250, 380 ] 160 0.028% 100.021% ( 380, 580 ] 179 0.031% 100.052% ( 580, 870 ] 152 0.026% 100.079% ( 870, 1300 ] 91 0.016% 100.094% ( 1300, 1900 ] 50 0.009% 100.103% ( 1900, 2900 ] 86 0.015% 100.118% ( 2900, 4400 ] 84 0.015% 100.133% ( 4400, 6600 ] 10 0.002% 100.134% ( 6600, 9900 ] 6 0.001% 100.135% ** Level 2 read latency histogram (micros): Count: 77381 Average: 5.2132 StdDev: 81.09 Min: 0 Median: 1.6726 Max: 5913 Percentiles: P50: 1.67 P75: 2.36 P99: 9.15 P99.9: 672.57 P99.99: 3955.80 ------------------------------------------------------ [ 0, 1 ] 7636 9.868% 9.868% ## ( 1, 2 ] 46170 59.666% 69.534% ############ ( 2, 3 ] 11698 15.117% 84.651% ### ( 3, 4 ] 5149 6.654% 91.305% # ( 4, 6 ] 5043 6.517% 97.822% # ( 6, 10 ] 1157 1.495% 99.318% ( 10, 15 ] 292 0.377% 99.695% ( 15, 22 ] 31 0.040% 99.735% ( 22, 34 ] 4 0.005% 99.740% ( 34, 51 ] 3 0.004% 99.744% ( 51, 76 ] 2 0.003% 99.747% ( 76, 110 ] 2 0.003% 99.749% ( 110, 170 ] 18 0.023% 99.773% ( 170, 250 ] 17 0.022% 99.795% ( 250, 380 ] 31 0.040% 99.835% ( 380, 580 ] 42 0.054% 99.889% ( 580, 870 ] 27 0.035% 99.924% ( 870, 1300 ] 14 0.018% 99.942% ( 1300, 1900 ] 10 0.013% 99.955% ( 1900, 2900 ] 16 0.021% 99.975% ( 2900, 4400 ] 16 0.021% 99.996% ( 4400, 6600 ] 5 0.006% 100.003% ** Level 3 read latency histogram (micros): Count: 344571 Average: 4.7853 StdDev: 82.43 Min: 1 Median: 1.9245 Max: 13090 Percentiles: P50: 1.92 P75: 2.93 P99: 8.86 P99.9: 14.23 P99.99: 18.59 ------------------------------------------------------ [ 0, 1 ] 15029 4.362% 4.362% # ( 1, 2 ] 170095 49.364% 53.726% ########## ( 2, 3 ] 78940 22.910% 76.636% ##### ( 3, 4 ] 33923 9.845% 86.481% ## ( 4, 6 ] 38524 11.180% 97.661% ## ( 6, 10 ] 6460 1.875% 99.536% ( 10, 15 ] 1485 0.431% 99.967% ( 15, 22 ] 159 0.046% 100.013% ( 22, 34 ] 14 0.004% 100.017% ( 34, 51 ] 9 0.003% 100.019% ( 51, 76 ] 7 0.002% 100.021% ( 76, 110 ] 6 0.002% 100.023% ( 110, 170 ] 61 0.018% 100.041% ( 170, 250 ] 40 0.012% 100.053% ( 250, 380 ] 53 0.015% 100.068% ( 380, 580 ] 59 0.017% 100.085% ( 580, 870 ] 53 0.015% 100.100% ( 870, 1300 ] 71 0.021% 100.121% ( 1300, 1900 ] 44 0.013% 100.134% ( 1900, 2900 ] 51 0.015% 100.149% ( 2900, 4400 ] 37 0.011% 100.159% ( 4400, 6600 ] 9 0.003% 100.162% ( 6600, 9900 ] 4 0.001% 100.163% ( 9900, 14000 ] 5 0.001% 100.165% ** Level 4 read latency histogram (micros): Count: 8544 Average: 113.4838 StdDev: 456.59 Min: 0 Median: 2.1227 Max: 11171 Percentiles: P50: 2.12 P75: 3.80 P99: 2193.58 P99.9: 5486.17 P99.99: 11171.00 ------------------------------------------------------ [ 0, 1 ] 359 4.202% 4.202% # ( 1, 2 ] 3710 43.422% 47.624% ######### ( 2, 3 ] 1655 19.370% 66.994% #### ( 3, 4 ] 857 10.030% 77.025% ## ( 4, 6 ] 626 7.327% 84.352% # ( 6, 10 ] 213 2.493% 86.845% ( 10, 15 ] 62 0.726% 87.570% ( 15, 22 ] 5 0.059% 87.629% ( 34, 51 ] 2 0.023% 87.652% ( 76, 110 ] 15 0.176% 87.828% ( 110, 170 ] 64 0.749% 88.577% ( 170, 250 ] 74 0.866% 89.443% ( 250, 380 ] 152 1.779% 91.222% ( 380, 580 ] 188 2.200% 93.422% ( 580, 870 ] 220 2.575% 95.997% # ( 870, 1300 ] 160 1.873% 97.870% ( 1300, 1900 ] 81 0.948% 98.818% ( 1900, 2900 ] 53 0.620% 99.438% ( 2900, 4400 ] 36 0.421% 99.860% ( 4400, 6600 ] 7 0.082% 99.941% ( 6600, 9900 ] 3 0.035% 99.977% ( 9900, 14000 ] 2 0.023% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 1204.7000 StdDev: 1360.01 Min: 102 Median: 652.5000 Max: 6478 Percentiles: P50: 652.50 P75: 1900.00 P99: 5720.00 P99.9: 6478.00 P99.99: 6478.00 ------------------------------------------------------ ( 76, 110 ] 5 6.250% 6.250% # ( 110, 170 ] 13 16.250% 22.500% ### ( 170, 250 ] 9 11.250% 33.750% ## ( 250, 380 ] 7 8.750% 42.500% ## ( 380, 580 ] 4 5.000% 47.500% # ( 580, 870 ] 8 10.000% 57.500% ## ( 870, 1300 ] 9 11.250% 68.750% ## ( 1300, 1900 ] 5 6.250% 75.000% # ( 1900, 2900 ] 8 10.000% 85.000% ## ( 2900, 4400 ] 10 12.500% 97.500% ### ( 4400, 6600 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 22.9 total, 6.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 257.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.812 H:M:S, 29.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 152.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.491 H:M:S, 54.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/26-07:12:55 ... thread 0: (1000000,7000000) ops and (277351.2,266106.4) ops/second in (3.605537,26.305272) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.69 GB 107.0 5.1 0.0 5.1 11.7 6.6 0.0 1.8 128.0 294.4 40.85 36.75 111 0.368 5308K 7138 0.0 0.0 L1 7/7 740.89 MB 0.0 3.5 2.8 0.7 3.5 2.7 0.2 1.2 229.6 227.7 15.54 15.04 3 5.180 3622K 28K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 2.1 1.5 246.5 246.4 0.78 0.75 2 0.392 196K 97 0.0 0.0 L3 20/0 975.84 MB 1.0 2.5 1.2 1.3 2.5 1.2 1.1 2.1 171.3 170.6 14.95 11.60 10 1.495 2601K 11K 0.0 0.0 L4 183/0 9.46 GB 1.0 1.4 1.4 0.1 1.4 1.4 0.8 1.1 136.5 136.3 10.79 6.80 29 0.372 1463K 1440 0.0 0.0 L5 1068/0 87.91 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/19 102.73 GB 0.0 12.7 5.4 7.3 19.3 12.0 6.6 2.9 157.1 238.5 82.91 70.93 155 0.535 13M 48K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.7 5.4 7.3 19.3 12.0 6.4 2.9 157.1 238.5 82.91 70.93 155 0.535 13M 48K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.7 5.4 7.3 12.7 5.4 0.0 0.0 209.5 208.7 62.17 53.66 61 1.019 13M 48K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 328.0 20.74 17.27 94 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.5 total, 26.3 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.31 GB write, 745.10 MB/s write, 12.72 GB read, 490.66 MB/s read, 82.9 seconds Interval compaction: 19.31 GB write, 751.75 MB/s write, 12.72 GB read, 495.04 MB/s read, 82.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 43, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2419794 Average: 2.4273 StdDev: 18.63 Min: 0 Median: 1.5376 Max: 7346 Percentiles: P50: 1.54 P75: 1.91 P99: 5.97 P99.9: 13.00 P99.99: 101.63 ------------------------------------------------------ [ 0, 1 ] 342799 14.166% 14.166% ### ( 1, 2 ] 1612871 66.653% 80.820% ############# ( 2, 3 ] 270511 11.179% 91.999% ## ( 3, 4 ] 91442 3.779% 95.778% # ( 4, 6 ] 78968 3.263% 99.041% # ( 6, 10 ] 18417 0.761% 99.802% ( 10, 15 ] 3944 0.163% 99.965% ( 15, 22 ] 343 0.014% 99.979% ( 22, 34 ] 32 0.001% 99.981% ( 34, 51 ] 22 0.001% 99.982% ( 51, 76 ] 6 0.000% 99.982% ( 76, 110 ] 264 0.011% 99.993% ( 110, 170 ] 299 0.012% 100.005% ( 170, 250 ] 136 0.006% 100.011% ( 250, 380 ] 117 0.005% 100.016% ( 380, 580 ] 138 0.006% 100.021% ( 580, 870 ] 91 0.004% 100.025% ( 870, 1300 ] 53 0.002% 100.027% ( 1300, 1900 ] 19 0.001% 100.028% ( 1900, 2900 ] 31 0.001% 100.029% ( 2900, 4400 ] 14 0.001% 100.030% ( 4400, 6600 ] 5 0.000% 100.030% ( 6600, 9900 ] 3 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 577905 Average: 4.7016 StdDev: 66.44 Min: 0 Median: 1.8226 Max: 7798 Percentiles: P50: 1.82 P75: 2.77 P99: 9.75 P99.9: 21.23 P99.99: 236.89 ------------------------------------------------------ [ 0, 1 ] 31637 5.474% 5.474% # ( 1, 2 ] 312825 54.131% 59.605% ########### ( 2, 3 ] 115477 19.982% 79.587% #### ( 3, 4 ] 46040 7.967% 87.554% ## ( 4, 6 ] 53531 9.263% 96.817% ## ( 6, 10 ] 13447 2.327% 99.144% ( 10, 15 ] 3932 0.680% 99.824% ( 15, 22 ] 492 0.085% 99.909% ( 22, 34 ] 54 0.009% 99.919% ( 34, 51 ] 7 0.001% 99.920% ( 51, 76 ] 1 0.000% 99.920% ( 76, 110 ] 120 0.021% 99.941% ( 110, 170 ] 173 0.030% 99.971% ( 170, 250 ] 133 0.023% 99.994% ( 250, 380 ] 160 0.028% 100.021% ( 380, 580 ] 179 0.031% 100.052% ( 580, 870 ] 152 0.026% 100.079% ( 870, 1300 ] 91 0.016% 100.094% ( 1300, 1900 ] 50 0.009% 100.103% ( 1900, 2900 ] 86 0.015% 100.118% ( 2900, 4400 ] 84 0.015% 100.133% ( 4400, 6600 ] 10 0.002% 100.134% ( 6600, 9900 ] 6 0.001% 100.135% ** Level 2 read latency histogram (micros): Count: 77381 Average: 5.2132 StdDev: 81.09 Min: 0 Median: 1.6726 Max: 5913 Percentiles: P50: 1.67 P75: 2.36 P99: 9.15 P99.9: 672.57 P99.99: 3955.80 ------------------------------------------------------ [ 0, 1 ] 7636 9.868% 9.868% ## ( 1, 2 ] 46170 59.666% 69.534% ############ ( 2, 3 ] 11698 15.117% 84.651% ### ( 3, 4 ] 5149 6.654% 91.305% # ( 4, 6 ] 5043 6.517% 97.822% # ( 6, 10 ] 1157 1.495% 99.318% ( 10, 15 ] 292 0.377% 99.695% ( 15, 22 ] 31 0.040% 99.735% ( 22, 34 ] 4 0.005% 99.740% ( 34, 51 ] 3 0.004% 99.744% ( 51, 76 ] 2 0.003% 99.747% ( 76, 110 ] 2 0.003% 99.749% ( 110, 170 ] 18 0.023% 99.773% ( 170, 250 ] 17 0.022% 99.795% ( 250, 380 ] 31 0.040% 99.835% ( 380, 580 ] 42 0.054% 99.889% ( 580, 870 ] 27 0.035% 99.924% ( 870, 1300 ] 14 0.018% 99.942% ( 1300, 1900 ] 10 0.013% 99.955% ( 1900, 2900 ] 16 0.021% 99.975% ( 2900, 4400 ] 16 0.021% 99.996% ( 4400, 6600 ] 5 0.006% 100.003% ** Level 3 read latency histogram (micros): Count: 531634 Average: 4.2972 StdDev: 68.80 Min: 1 Median: 1.9880 Max: 13090 Percentiles: P50: 1.99 P75: 3.03 P99: 8.60 P99.9: 12.91 P99.99: 14.05 ------------------------------------------------------ [ 0, 1 ] 16867 3.173% 3.173% # ( 1, 2 ] 251976 47.397% 50.569% ######### ( 2, 3 ] 128270 24.128% 74.697% ##### ( 3, 4 ] 56585 10.644% 85.340% ## ( 4, 6 ] 65975 12.410% 97.750% ## ( 6, 10 ] 10204 1.919% 99.670% ( 10, 15 ] 2104 0.396% 100.065% ( 15, 22 ] 224 0.042% 100.107% ( 22, 34 ] 18 0.003% 100.111% ( 34, 51 ] 13 0.002% 100.113% ( 51, 76 ] 12 0.002% 100.115% ( 76, 110 ] 8 0.002% 100.117% ( 110, 170 ] 62 0.012% 100.129% ( 170, 250 ] 40 0.008% 100.136% ( 250, 380 ] 55 0.010% 100.147% ( 380, 580 ] 59 0.011% 100.158% ( 580, 870 ] 55 0.010% 100.168% ( 870, 1300 ] 75 0.014% 100.182% ( 1300, 1900 ] 44 0.008% 100.190% ( 1900, 2900 ] 56 0.011% 100.201% ( 2900, 4400 ] 43 0.008% 100.209% ( 4400, 6600 ] 11 0.002% 100.211% ( 6600, 9900 ] 4 0.001% 100.212% ( 9900, 14000 ] 5 0.001% 100.213% ** Level 4 read latency histogram (micros): Count: 21401 Average: 94.6412 StdDev: 447.47 Min: 0 Median: 2.1295 Max: 11171 Percentiles: P50: 2.13 P75: 3.59 P99: 2175.14 P99.9: 5810.96 P99.99: 9257.97 ------------------------------------------------------ [ 0, 1 ] 702 3.280% 3.280% # ( 1, 2 ] 9416 43.998% 47.278% ######### ( 2, 3 ] 4499 21.022% 68.301% #### ( 3, 4 ] 2442 11.411% 79.711% ## ( 4, 6 ] 1821 8.509% 88.220% ## ( 6, 10 ] 452 2.112% 90.332% ( 10, 15 ] 183 0.855% 91.187% ( 15, 22 ] 9 0.042% 91.229% ( 34, 51 ] 2 0.009% 91.239% ( 76, 110 ] 25 0.117% 91.356% ( 110, 170 ] 117 0.547% 91.902% ( 170, 250 ] 104 0.486% 92.388% ( 250, 380 ] 212 0.991% 93.379% ( 380, 580 ] 313 1.463% 94.841% ( 580, 870 ] 386 1.804% 96.645% ( 870, 1300 ] 306 1.430% 98.075% ( 1300, 1900 ] 168 0.785% 98.860% ( 1900, 2900 ] 109 0.509% 99.369% ( 2900, 4400 ] 95 0.444% 99.813% ( 4400, 6600 ] 29 0.136% 99.949% ( 6600, 9900 ] 11 0.051% 100.000% ( 9900, 14000 ] 2 0.009% 100.009% ** Level 5 read latency histogram (micros): Count: 140 Average: 1226.8571 StdDev: 1352.88 Min: 102 Median: 662.8571 Max: 6478 Percentiles: P50: 662.86 P75: 1900.00 P99: 5830.00 P99.9: 6478.00 P99.99: 6478.00 ------------------------------------------------------ ( 76, 110 ] 6 4.286% 4.286% # ( 110, 170 ] 24 17.143% 21.429% ### ( 170, 250 ] 14 10.000% 31.429% ## ( 250, 380 ] 12 8.571% 40.000% ## ( 380, 580 ] 10 7.143% 47.143% # ( 580, 870 ] 14 10.000% 57.143% ## ( 870, 1300 ] 16 11.429% 68.571% ## ( 1300, 1900 ] 9 6.429% 75.000% # ( 1900, 2900 ] 12 8.571% 83.571% ## ( 2900, 4400 ] 19 13.571% 97.143% ### ( 4400, 6600 ] 4 2.857% 100.000% # ** DB Stats ** Uptime(secs): 26.5 total, 3.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 259.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.776 H:M:S, 29.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 272.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.965 H:M:S, 26.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-07:13:00 ... thread 0: (1000000,8000000) ops and (191739.4,253801.6) ops/second in (5.215412,31.520684) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 4.61 GB 226.6 6.5 0.0 6.5 14.0 7.6 0.0 1.9 135.6 294.4 48.76 44.24 130 0.375 6715K 8588 0.0 0.0 L1 7/7 740.89 MB 0.0 3.5 2.8 0.7 3.5 2.7 0.2 1.2 229.6 227.7 15.54 15.04 3 5.180 3622K 28K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 2.1 1.5 246.5 246.4 0.78 0.75 2 0.392 196K 97 0.0 0.0 L3 20/0 975.84 MB 1.0 2.5 1.2 1.3 2.5 1.2 1.1 2.1 171.3 170.6 14.95 11.60 10 1.495 2601K 11K 0.0 0.0 L4 183/0 9.46 GB 1.0 1.4 1.4 0.1 1.4 1.4 0.8 1.1 136.5 136.3 10.79 6.80 29 0.372 1463K 1440 0.0 0.0 L5 1068/0 87.91 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/15 103.65 GB 0.0 14.1 5.4 8.6 21.6 13.0 6.6 2.9 158.6 243.4 90.83 78.42 174 0.522 14M 50K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.1 5.4 8.6 21.6 13.0 6.4 2.9 158.6 243.4 90.83 78.42 174 0.522 14M 50K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.1 5.4 8.6 14.0 5.4 0.0 0.0 214.0 213.2 67.33 58.71 66 1.020 14M 50K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 329.8 23.50 19.72 108 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.8 total, 31.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.59 GB write, 696.08 MB/s write, 14.07 GB read, 453.72 MB/s read, 90.8 seconds Interval compaction: 21.59 GB write, 701.27 MB/s write, 14.07 GB read, 457.10 MB/s read, 90.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 45, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2956368 Average: 2.3926 StdDev: 17.33 Min: 0 Median: 1.5314 Max: 7346 Percentiles: P50: 1.53 P75: 1.90 P99: 5.97 P99.9: 12.75 P99.99: 92.65 ------------------------------------------------------ [ 0, 1 ] 420951 14.239% 14.239% ### ( 1, 2 ] 1989342 67.290% 81.529% ############# ( 2, 3 ] 321100 10.861% 92.390% ## ( 3, 4 ] 107307 3.630% 96.020% # ( 4, 6 ] 89350 3.022% 99.042% # ( 6, 10 ] 22912 0.775% 99.817% ( 10, 15 ] 4457 0.151% 99.968% ( 15, 22 ] 413 0.014% 99.982% ( 22, 34 ] 38 0.001% 99.983% ( 34, 51 ] 23 0.001% 99.984% ( 51, 76 ] 7 0.000% 99.984% ( 76, 110 ] 354 0.012% 99.996% ( 110, 170 ] 354 0.012% 100.008% ( 170, 250 ] 146 0.005% 100.013% ( 250, 380 ] 128 0.004% 100.017% ( 380, 580 ] 154 0.005% 100.023% ( 580, 870 ] 104 0.004% 100.026% ( 870, 1300 ] 59 0.002% 100.028% ( 1300, 1900 ] 24 0.001% 100.029% ( 1900, 2900 ] 31 0.001% 100.030% ( 2900, 4400 ] 15 0.001% 100.030% ( 4400, 6600 ] 5 0.000% 100.031% ( 6600, 9900 ] 3 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 640822 Average: 4.4872 StdDev: 63.20 Min: 0 Median: 1.7801 Max: 7798 Percentiles: P50: 1.78 P75: 2.68 P99: 9.66 P99.9: 25.25 P99.99: 246.30 ------------------------------------------------------ [ 0, 1 ] 42321 6.604% 6.604% # ( 1, 2 ] 356467 55.627% 62.231% ########### ( 2, 3 ] 120449 18.796% 81.027% #### ( 3, 4 ] 47534 7.418% 88.444% # ( 4, 6 ] 54471 8.500% 96.945% ## ( 6, 10 ] 14411 2.249% 99.193% ( 10, 15 ] 4001 0.624% 99.818% ( 15, 22 ] 513 0.080% 99.898% ( 22, 34 ] 56 0.009% 99.907% ( 34, 51 ] 10 0.002% 99.908% ( 51, 76 ] 1 0.000% 99.908% ( 76, 110 ] 141 0.022% 99.930% ( 110, 170 ] 238 0.037% 99.967% ( 170, 250 ] 153 0.024% 99.991% ( 250, 380 ] 167 0.026% 100.017% ( 380, 580 ] 187 0.029% 100.047% ( 580, 870 ] 158 0.025% 100.071% ( 870, 1300 ] 91 0.014% 100.085% ( 1300, 1900 ] 50 0.008% 100.093% ( 1900, 2900 ] 86 0.013% 100.107% ( 2900, 4400 ] 84 0.013% 100.120% ( 4400, 6600 ] 10 0.002% 100.121% ( 6600, 9900 ] 6 0.001% 100.122% ** Level 2 read latency histogram (micros): Count: 77381 Average: 5.2132 StdDev: 81.09 Min: 0 Median: 1.6726 Max: 5913 Percentiles: P50: 1.67 P75: 2.36 P99: 9.15 P99.9: 672.57 P99.99: 3955.80 ------------------------------------------------------ [ 0, 1 ] 7636 9.868% 9.868% ## ( 1, 2 ] 46170 59.666% 69.534% ############ ( 2, 3 ] 11698 15.117% 84.651% ### ( 3, 4 ] 5149 6.654% 91.305% # ( 4, 6 ] 5043 6.517% 97.822% # ( 6, 10 ] 1157 1.495% 99.318% ( 10, 15 ] 292 0.377% 99.695% ( 15, 22 ] 31 0.040% 99.735% ( 22, 34 ] 4 0.005% 99.740% ( 34, 51 ] 3 0.004% 99.744% ( 51, 76 ] 2 0.003% 99.747% ( 76, 110 ] 2 0.003% 99.749% ( 110, 170 ] 18 0.023% 99.773% ( 170, 250 ] 17 0.022% 99.795% ( 250, 380 ] 31 0.040% 99.835% ( 380, 580 ] 42 0.054% 99.889% ( 580, 870 ] 27 0.035% 99.924% ( 870, 1300 ] 14 0.018% 99.942% ( 1300, 1900 ] 10 0.013% 99.955% ( 1900, 2900 ] 16 0.021% 99.975% ( 2900, 4400 ] 16 0.021% 99.996% ( 4400, 6600 ] 5 0.006% 100.003% ** Level 3 read latency histogram (micros): Count: 531634 Average: 4.2972 StdDev: 68.80 Min: 1 Median: 1.9880 Max: 13090 Percentiles: P50: 1.99 P75: 3.03 P99: 8.60 P99.9: 12.91 P99.99: 14.05 ------------------------------------------------------ [ 0, 1 ] 16867 3.173% 3.173% # ( 1, 2 ] 251976 47.397% 50.569% ######### ( 2, 3 ] 128270 24.128% 74.697% ##### ( 3, 4 ] 56585 10.644% 85.340% ## ( 4, 6 ] 65975 12.410% 97.750% ## ( 6, 10 ] 10204 1.919% 99.670% ( 10, 15 ] 2104 0.396% 100.065% ( 15, 22 ] 224 0.042% 100.107% ( 22, 34 ] 18 0.003% 100.111% ( 34, 51 ] 13 0.002% 100.113% ( 51, 76 ] 12 0.002% 100.115% ( 76, 110 ] 8 0.002% 100.117% ( 110, 170 ] 62 0.012% 100.129% ( 170, 250 ] 40 0.008% 100.136% ( 250, 380 ] 55 0.010% 100.147% ( 380, 580 ] 59 0.011% 100.158% ( 580, 870 ] 55 0.010% 100.168% ( 870, 1300 ] 75 0.014% 100.182% ( 1300, 1900 ] 44 0.008% 100.190% ( 1900, 2900 ] 56 0.011% 100.201% ( 2900, 4400 ] 43 0.008% 100.209% ( 4400, 6600 ] 11 0.002% 100.211% ( 6600, 9900 ] 4 0.001% 100.212% ( 9900, 14000 ] 5 0.001% 100.213% ** Level 4 read latency histogram (micros): Count: 21401 Average: 94.6412 StdDev: 447.47 Min: 0 Median: 2.1295 Max: 11171 Percentiles: P50: 2.13 P75: 3.59 P99: 2175.14 P99.9: 5810.96 P99.99: 9257.97 ------------------------------------------------------ [ 0, 1 ] 702 3.280% 3.280% # ( 1, 2 ] 9416 43.998% 47.278% ######### ( 2, 3 ] 4499 21.022% 68.301% #### ( 3, 4 ] 2442 11.411% 79.711% ## ( 4, 6 ] 1821 8.509% 88.220% ## ( 6, 10 ] 452 2.112% 90.332% ( 10, 15 ] 183 0.855% 91.187% ( 15, 22 ] 9 0.042% 91.229% ( 34, 51 ] 2 0.009% 91.239% ( 76, 110 ] 25 0.117% 91.356% ( 110, 170 ] 117 0.547% 91.902% ( 170, 250 ] 104 0.486% 92.388% ( 250, 380 ] 212 0.991% 93.379% ( 380, 580 ] 313 1.463% 94.841% ( 580, 870 ] 386 1.804% 96.645% ( 870, 1300 ] 306 1.430% 98.075% ( 1300, 1900 ] 168 0.785% 98.860% ( 1900, 2900 ] 109 0.509% 99.369% ( 2900, 4400 ] 95 0.444% 99.813% ( 4400, 6600 ] 29 0.136% 99.949% ( 6600, 9900 ] 11 0.051% 100.000% ( 9900, 14000 ] 2 0.009% 100.009% ** Level 5 read latency histogram (micros): Count: 140 Average: 1226.8571 StdDev: 1352.88 Min: 102 Median: 662.8571 Max: 6478 Percentiles: P50: 662.86 P75: 1900.00 P99: 5830.00 P99.9: 6478.00 P99.99: 6478.00 ------------------------------------------------------ ( 76, 110 ] 6 4.286% 4.286% # ( 110, 170 ] 24 17.143% 21.429% ### ( 170, 250 ] 14 10.000% 31.429% ## ( 250, 380 ] 12 8.571% 40.000% ## ( 380, 580 ] 10 7.143% 47.143% # ( 580, 870 ] 14 10.000% 57.143% ## ( 870, 1300 ] 16 11.429% 68.571% ## ( 1300, 1900 ] 9 6.429% 75.000% # ( 1900, 2900 ] 12 8.571% 83.571% ## ( 2900, 4400 ] 19 13.571% 97.143% ### ( 4400, 6600 ] 4 2.857% 100.000% # ** DB Stats ** Uptime(secs): 31.8 total, 5.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 247.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.356 H:M:S, 32.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 188.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.580 H:M:S, 49.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/26-07:13:10 ... thread 0: (1000000,9000000) ops and (99924.7,216720.1) ops/second in (10.007540,41.528224) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/13 3.19 GB 0.0 8.3 0.0 8.3 16.8 8.5 0.0 2.0 135.4 274.6 62.79 54.29 146 0.430 8633K 16K 0.0 0.0 L1 7/7 653.84 MB 0.0 6.6 5.2 1.4 6.5 5.1 0.2 1.3 222.3 219.9 30.42 28.76 4 7.604 6865K 72K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.5 1.5 246.5 246.4 0.78 0.75 2 0.392 196K 97 0.0 0.0 L3 25/3 1.21 GB 1.0 4.7 2.7 2.0 4.7 2.7 2.0 1.7 154.8 154.0 31.36 22.34 21 1.493 4931K 25K 0.0 0.0 L4 172/10 9.65 GB 1.0 4.2 3.5 0.7 4.2 3.5 0.9 1.2 129.7 129.2 33.24 19.99 54 0.616 4273K 8131 0.0 0.0 L5 1092/0 89.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1309/33 104.56 GB 0.0 24.0 11.5 12.5 32.5 19.9 11.9 3.8 155.3 209.7 158.58 126.13 227 0.699 24M 123K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.0 11.5 12.5 32.5 19.9 11.8 3.8 155.3 209.7 158.58 126.13 227 0.699 24M 123K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.0 11.5 12.5 23.9 11.4 0.0 0.0 188.8 187.8 130.40 103.69 106 1.230 24M 123K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 310.7 28.19 22.45 121 0.233 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.8 total, 41.5 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.47 GB write, 796.07 MB/s write, 24.05 GB read, 589.56 MB/s read, 158.6 seconds Interval compaction: 32.47 GB write, 800.57 MB/s write, 24.05 GB read, 592.89 MB/s read, 158.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 70, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 36, total-stops: 70, interval: 106 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3603386 Average: 2.7749 StdDev: 27.22 Min: 0 Median: 1.5503 Max: 7346 Percentiles: P50: 1.55 P75: 1.93 P99: 7.17 P99.9: 89.13 P99.99: 300.49 ------------------------------------------------------ [ 0, 1 ] 488986 13.570% 13.570% ### ( 1, 2 ] 2385511 66.202% 79.772% ############# ( 2, 3 ] 412134 11.437% 91.210% ## ( 3, 4 ] 142981 3.968% 95.177% # ( 4, 6 ] 127579 3.541% 98.718% # ( 6, 10 ] 34742 0.964% 99.682% ( 10, 15 ] 6571 0.182% 99.865% ( 15, 22 ] 624 0.017% 99.882% ( 22, 34 ] 49 0.001% 99.883% ( 34, 51 ] 23 0.001% 99.884% ( 51, 76 ] 8 0.000% 99.884% ( 76, 110 ] 1490 0.041% 99.925% ( 110, 170 ] 1705 0.047% 99.973% ( 170, 250 ] 492 0.014% 99.986% ( 250, 380 ] 339 0.009% 99.996% ( 380, 580 ] 358 0.010% 100.006% ( 580, 870 ] 318 0.009% 100.015% ( 870, 1300 ] 213 0.006% 100.020% ( 1300, 1900 ] 109 0.003% 100.023% ( 1900, 2900 ] 80 0.002% 100.026% ( 2900, 4400 ] 69 0.002% 100.028% ( 4400, 6600 ] 13 0.000% 100.028% ( 6600, 9900 ] 3 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1449774 Average: 5.8490 StdDev: 83.90 Min: 0 Median: 1.8834 Max: 13887 Percentiles: P50: 1.88 P75: 2.88 P99: 9.97 P99.9: 158.63 P99.99: 481.21 ------------------------------------------------------ [ 0, 1 ] 64269 4.433% 4.433% # ( 1, 2 ] 747823 51.582% 56.015% ########## ( 2, 3 ] 313277 21.609% 77.624% #### ( 3, 4 ] 125466 8.654% 86.278% ## ( 4, 6 ] 147553 10.178% 96.456% ## ( 6, 10 ] 37162 2.563% 99.019% # ( 10, 15 ] 10553 0.728% 99.747% ( 15, 22 ] 1172 0.081% 99.828% ( 22, 34 ] 99 0.007% 99.834% ( 34, 51 ] 32 0.002% 99.837% ( 51, 76 ] 40 0.003% 99.839% ( 76, 110 ] 289 0.020% 99.859% ( 110, 170 ] 727 0.050% 99.910% ( 170, 250 ] 376 0.026% 99.935% ( 250, 380 ] 455 0.031% 99.967% ( 380, 580 ] 664 0.046% 100.013% ( 580, 870 ] 721 0.050% 100.062% ( 870, 1300 ] 482 0.033% 100.096% ( 1300, 1900 ] 245 0.017% 100.113% ( 1900, 2900 ] 283 0.020% 100.132% ( 2900, 4400 ] 295 0.020% 100.152% ( 4400, 6600 ] 61 0.004% 100.157% ( 6600, 9900 ] 21 0.001% 100.158% ( 9900, 14000 ] 2 0.000% 100.158% ** Level 2 read latency histogram (micros): Count: 77381 Average: 5.2132 StdDev: 81.09 Min: 0 Median: 1.6726 Max: 5913 Percentiles: P50: 1.67 P75: 2.36 P99: 9.15 P99.9: 672.57 P99.99: 3955.80 ------------------------------------------------------ [ 0, 1 ] 7636 9.868% 9.868% ## ( 1, 2 ] 46170 59.666% 69.534% ############ ( 2, 3 ] 11698 15.117% 84.651% ### ( 3, 4 ] 5149 6.654% 91.305% # ( 4, 6 ] 5043 6.517% 97.822% # ( 6, 10 ] 1157 1.495% 99.318% ( 10, 15 ] 292 0.377% 99.695% ( 15, 22 ] 31 0.040% 99.735% ( 22, 34 ] 4 0.005% 99.740% ( 34, 51 ] 3 0.004% 99.744% ( 51, 76 ] 2 0.003% 99.747% ( 76, 110 ] 2 0.003% 99.749% ( 110, 170 ] 18 0.023% 99.773% ( 170, 250 ] 17 0.022% 99.795% ( 250, 380 ] 31 0.040% 99.835% ( 380, 580 ] 42 0.054% 99.889% ( 580, 870 ] 27 0.035% 99.924% ( 870, 1300 ] 14 0.018% 99.942% ( 1300, 1900 ] 10 0.013% 99.955% ( 1900, 2900 ] 16 0.021% 99.975% ( 2900, 4400 ] 16 0.021% 99.996% ( 4400, 6600 ] 5 0.006% 100.003% ** Level 3 read latency histogram (micros): Count: 1025745 Average: 4.8518 StdDev: 69.07 Min: 1 Median: 2.0497 Max: 13090 Percentiles: P50: 2.05 P75: 3.10 P99: 9.09 P99.9: 14.35 P99.99: 18.84 ------------------------------------------------------ [ 0, 1 ] 22202 2.164% 2.164% ( 1, 2 ] 477836 46.584% 48.749% ######### ( 2, 3 ] 258073 25.160% 73.908% ##### ( 3, 4 ] 110572 10.780% 84.688% ## ( 4, 6 ] 130098 12.683% 97.371% ### ( 6, 10 ] 21651 2.111% 99.482% ( 10, 15 ] 4931 0.481% 99.963% ( 15, 22 ] 513 0.050% 100.013% ( 22, 34 ] 33 0.003% 100.016% ( 34, 51 ] 17 0.002% 100.018% ( 51, 76 ] 20 0.002% 100.020% ( 76, 110 ] 24 0.002% 100.022% ( 110, 170 ] 92 0.009% 100.031% ( 170, 250 ] 103 0.010% 100.041% ( 250, 380 ] 157 0.015% 100.056% ( 380, 580 ] 313 0.031% 100.087% ( 580, 870 ] 348 0.034% 100.121% ( 870, 1300 ] 285 0.028% 100.148% ( 1300, 1900 ] 141 0.014% 100.162% ( 1900, 2900 ] 100 0.010% 100.172% ( 2900, 4400 ] 98 0.010% 100.182% ( 4400, 6600 ] 24 0.002% 100.184% ( 6600, 9900 ] 10 0.001% 100.185% ( 9900, 14000 ] 5 0.000% 100.185% ** Level 4 read latency histogram (micros): Count: 196715 Average: 34.4218 StdDev: 264.11 Min: 0 Median: 2.0641 Max: 11171 Percentiles: P50: 2.06 P75: 3.23 P99: 1005.55 P99.9: 3733.58 P99.99: 4542.68 ------------------------------------------------------ [ 0, 1 ] 3516 1.787% 1.787% ( 1, 2 ] 91802 46.668% 48.455% ######### ( 2, 3 ] 47401 24.096% 72.551% ##### ( 3, 4 ] 20699 10.522% 83.073% ## ( 4, 6 ] 21600 10.980% 94.054% ## ( 6, 10 ] 4750 2.415% 96.468% ( 10, 15 ] 1583 0.805% 97.273% ( 15, 22 ] 131 0.067% 97.340% ( 22, 34 ] 11 0.006% 97.345% ( 34, 51 ] 7 0.004% 97.349% ( 51, 76 ] 6 0.003% 97.352% ( 76, 110 ] 34 0.017% 97.369% ( 110, 170 ] 190 0.097% 97.466% ( 170, 250 ] 252 0.128% 97.594% ( 250, 380 ] 515 0.262% 97.856% ( 380, 580 ] 840 0.427% 98.283% ( 580, 870 ] 1107 0.563% 98.846% ( 870, 1300 ] 967 0.492% 99.337% ( 1300, 1900 ] 543 0.276% 99.613% ( 1900, 2900 ] 353 0.179% 99.793% ( 2900, 4400 ] 382 0.194% 99.987% ( 4400, 6600 ] 113 0.057% 100.044% ( 6600, 9900 ] 12 0.006% 100.050% ( 9900, 14000 ] 2 0.001% 100.051% ** Level 5 read latency histogram (micros): Count: 260 Average: 1419.0962 StdDev: 1530.03 Min: 81 Median: 797.5000 Max: 10603 Percentiles: P50: 797.50 P75: 2300.00 P99: 6280.00 P99.9: 10603.00 P99.99: 10603.00 ------------------------------------------------------ ( 76, 110 ] 9 3.462% 3.462% # ( 110, 170 ] 31 11.923% 15.385% ## ( 170, 250 ] 25 9.615% 25.000% ## ( 250, 380 ] 21 8.077% 33.077% ## ( 380, 580 ] 23 8.846% 41.923% ## ( 580, 870 ] 28 10.769% 52.692% ## ( 870, 1300 ] 23 8.846% 61.538% ## ( 1300, 1900 ] 25 9.615% 71.154% ## ( 1900, 2900 ] 25 9.615% 80.769% ## ( 2900, 4400 ] 38 14.615% 95.385% ### ( 4400, 6600 ] 11 4.231% 99.615% # ( 9900, 14000 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 41.8 total, 10.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 212.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.420 H:M:S, 41.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 98.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.064 H:M:S, 70.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/07/26-07:13:13 ... thread 0: (1000000,10000000) ops and (330534.6,224448.6) ops/second in (3.025402,44.553626) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/13 4.11 GB 107.0 9.2 0.0 9.2 18.7 9.5 0.0 2.0 136.6 276.6 69.17 60.28 162 0.427 9592K 18K 0.0 0.0 L1 7/7 653.84 MB 0.0 6.6 5.2 1.4 6.5 5.1 0.2 1.3 222.3 219.9 30.42 28.76 4 7.604 6865K 72K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.5 1.5 246.5 246.4 0.78 0.75 2 0.392 196K 97 0.0 0.0 L3 22/0 960.42 MB 1.0 4.7 2.7 2.0 4.7 2.7 2.0 1.7 154.8 154.0 31.36 22.34 21 1.493 4931K 25K 0.0 0.0 L4 168/0 9.61 GB 1.0 4.7 3.8 0.9 4.7 3.8 0.9 1.2 134.7 134.2 35.97 22.41 57 0.631 4814K 12K 0.0 0.0 L5 1096/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1310/20 105.48 GB 0.0 25.5 11.8 13.7 34.8 21.1 12.2 3.7 155.7 212.7 167.70 134.55 246 0.682 26M 129K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.5 11.8 13.7 34.8 21.1 12.1 3.7 155.7 212.7 167.70 134.55 246 0.682 26M 129K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.5 11.8 13.7 25.4 11.6 0.0 0.0 190.8 189.8 136.78 109.70 112 1.221 26M 129K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 313.8 30.91 24.85 134 0.231 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.8 total, 44.6 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.83 GB write, 796.31 MB/s write, 25.49 GB read, 582.78 MB/s read, 167.7 seconds Interval compaction: 34.83 GB write, 800.51 MB/s write, 25.49 GB read, 585.86 MB/s read, 167.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 76, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 36, total-stops: 76, interval: 112 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4015118 Average: 2.7477 StdDev: 25.99 Min: 0 Median: 1.5590 Max: 7346 Percentiles: P50: 1.56 P75: 1.94 P99: 7.13 P99.9: 76.88 P99.99: 230.27 ------------------------------------------------------ [ 0, 1 ] 523529 13.039% 13.039% ### ( 1, 2 ] 2655001 66.125% 79.164% ############# ( 2, 3 ] 477654 11.896% 91.060% ## ( 3, 4 ] 162440 4.046% 95.106% # ( 4, 6 ] 145356 3.620% 98.726% # ( 6, 10 ] 39044 0.972% 99.699% ( 10, 15 ] 7276 0.181% 99.880% ( 15, 22 ] 672 0.017% 99.897% ( 22, 34 ] 53 0.001% 99.898% ( 34, 51 ] 25 0.001% 99.899% ( 51, 76 ] 14 0.000% 99.899% ( 76, 110 ] 1499 0.037% 99.936% ( 110, 170 ] 1764 0.044% 99.980% ( 170, 250 ] 517 0.013% 99.993% ( 250, 380 ] 353 0.009% 100.002% ( 380, 580 ] 371 0.009% 100.011% ( 580, 870 ] 327 0.008% 100.019% ( 870, 1300 ] 220 0.005% 100.025% ( 1300, 1900 ] 111 0.003% 100.028% ( 1900, 2900 ] 82 0.002% 100.030% ( 2900, 4400 ] 70 0.002% 100.031% ( 4400, 6600 ] 13 0.000% 100.032% ( 6600, 9900 ] 3 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 1449774 Average: 5.8490 StdDev: 83.90 Min: 0 Median: 1.8834 Max: 13887 Percentiles: P50: 1.88 P75: 2.88 P99: 9.97 P99.9: 158.63 P99.99: 481.21 ------------------------------------------------------ [ 0, 1 ] 64269 4.433% 4.433% # ( 1, 2 ] 747823 51.582% 56.015% ########## ( 2, 3 ] 313277 21.609% 77.624% #### ( 3, 4 ] 125466 8.654% 86.278% ## ( 4, 6 ] 147553 10.178% 96.456% ## ( 6, 10 ] 37162 2.563% 99.019% # ( 10, 15 ] 10553 0.728% 99.747% ( 15, 22 ] 1172 0.081% 99.828% ( 22, 34 ] 99 0.007% 99.834% ( 34, 51 ] 32 0.002% 99.837% ( 51, 76 ] 40 0.003% 99.839% ( 76, 110 ] 289 0.020% 99.859% ( 110, 170 ] 727 0.050% 99.910% ( 170, 250 ] 376 0.026% 99.935% ( 250, 380 ] 455 0.031% 99.967% ( 380, 580 ] 664 0.046% 100.013% ( 580, 870 ] 721 0.050% 100.062% ( 870, 1300 ] 482 0.033% 100.096% ( 1300, 1900 ] 245 0.017% 100.113% ( 1900, 2900 ] 283 0.020% 100.132% ( 2900, 4400 ] 295 0.020% 100.152% ( 4400, 6600 ] 61 0.004% 100.157% ( 6600, 9900 ] 21 0.001% 100.158% ( 9900, 14000 ] 2 0.000% 100.158% ** Level 2 read latency histogram (micros): Count: 77381 Average: 5.2132 StdDev: 81.09 Min: 0 Median: 1.6726 Max: 5913 Percentiles: P50: 1.67 P75: 2.36 P99: 9.15 P99.9: 672.57 P99.99: 3955.80 ------------------------------------------------------ [ 0, 1 ] 7636 9.868% 9.868% ## ( 1, 2 ] 46170 59.666% 69.534% ############ ( 2, 3 ] 11698 15.117% 84.651% ### ( 3, 4 ] 5149 6.654% 91.305% # ( 4, 6 ] 5043 6.517% 97.822% # ( 6, 10 ] 1157 1.495% 99.318% ( 10, 15 ] 292 0.377% 99.695% ( 15, 22 ] 31 0.040% 99.735% ( 22, 34 ] 4 0.005% 99.740% ( 34, 51 ] 3 0.004% 99.744% ( 51, 76 ] 2 0.003% 99.747% ( 76, 110 ] 2 0.003% 99.749% ( 110, 170 ] 18 0.023% 99.773% ( 170, 250 ] 17 0.022% 99.795% ( 250, 380 ] 31 0.040% 99.835% ( 380, 580 ] 42 0.054% 99.889% ( 580, 870 ] 27 0.035% 99.924% ( 870, 1300 ] 14 0.018% 99.942% ( 1300, 1900 ] 10 0.013% 99.955% ( 1900, 2900 ] 16 0.021% 99.975% ( 2900, 4400 ] 16 0.021% 99.996% ( 4400, 6600 ] 5 0.006% 100.003% ** Level 3 read latency histogram (micros): Count: 1057815 Average: 4.7885 StdDev: 68.01 Min: 1 Median: 2.0368 Max: 13090 Percentiles: P50: 2.04 P75: 3.08 P99: 9.07 P99.9: 14.35 P99.99: 18.91 ------------------------------------------------------ [ 0, 1 ] 23049 2.179% 2.179% ( 1, 2 ] 496098 46.898% 49.077% ######### ( 2, 3 ] 265249 25.075% 74.152% ##### ( 3, 4 ] 113173 10.699% 84.851% ## ( 4, 6 ] 132653 12.540% 97.392% ### ( 6, 10 ] 22139 2.093% 99.484% ( 10, 15 ] 5054 0.478% 99.962% ( 15, 22 ] 527 0.050% 100.012% ( 22, 34 ] 33 0.003% 100.015% ( 34, 51 ] 18 0.002% 100.017% ( 51, 76 ] 21 0.002% 100.019% ( 76, 110 ] 24 0.002% 100.021% ( 110, 170 ] 92 0.009% 100.030% ( 170, 250 ] 103 0.010% 100.040% ( 250, 380 ] 157 0.015% 100.054% ( 380, 580 ] 313 0.030% 100.084% ( 580, 870 ] 348 0.033% 100.117% ( 870, 1300 ] 285 0.027% 100.144% ( 1300, 1900 ] 141 0.013% 100.157% ( 1900, 2900 ] 100 0.009% 100.167% ( 2900, 4400 ] 98 0.009% 100.176% ( 4400, 6600 ] 24 0.002% 100.178% ( 6600, 9900 ] 10 0.001% 100.179% ( 9900, 14000 ] 5 0.000% 100.180% ** Level 4 read latency histogram (micros): Count: 245849 Average: 28.3507 StdDev: 236.79 Min: 0 Median: 1.9931 Max: 11171 Percentiles: P50: 1.99 P75: 3.08 P99: 817.22 P99.9: 3450.33 P99.99: 4319.17 ------------------------------------------------------ [ 0, 1 ] 4687 1.906% 1.906% ( 1, 2 ] 119062 48.429% 50.335% ########## ( 2, 3 ] 58657 23.859% 74.194% ##### ( 3, 4 ] 24687 10.042% 84.236% ## ( 4, 6 ] 25810 10.498% 94.734% ## ( 6, 10 ] 5588 2.273% 97.007% ( 10, 15 ] 1785 0.726% 97.733% ( 15, 22 ] 150 0.061% 97.794% ( 22, 34 ] 12 0.005% 97.799% ( 34, 51 ] 7 0.003% 97.802% ( 51, 76 ] 6 0.002% 97.804% ( 76, 110 ] 62 0.025% 97.830% ( 110, 170 ] 239 0.097% 97.927% ( 170, 250 ] 306 0.124% 98.051% ( 250, 380 ] 535 0.218% 98.269% ( 380, 580 ] 874 0.356% 98.624% ( 580, 870 ] 1129 0.459% 99.084% ( 870, 1300 ] 971 0.395% 99.479% ( 1300, 1900 ] 543 0.221% 99.699% ( 1900, 2900 ] 353 0.144% 99.843% ( 2900, 4400 ] 382 0.155% 99.998% ( 4400, 6600 ] 113 0.046% 100.044% ( 6600, 9900 ] 12 0.005% 100.049% ( 9900, 14000 ] 2 0.001% 100.050% ** Level 5 read latency histogram (micros): Count: 280 Average: 1375.5000 StdDev: 1507.04 Min: 81 Median: 754.0000 Max: 10603 Percentiles: P50: 754.00 P75: 2169.23 P99: 6240.00 P99.9: 10603.00 P99.99: 10603.00 ------------------------------------------------------ ( 76, 110 ] 11 3.929% 3.929% # ( 110, 170 ] 36 12.857% 16.786% ### ( 170, 250 ] 28 10.000% 26.786% ## ( 250, 380 ] 22 7.857% 34.643% ## ( 380, 580 ] 25 8.929% 43.571% ## ( 580, 870 ] 30 10.714% 54.286% ## ( 870, 1300 ] 23 8.214% 62.500% ## ( 1300, 1900 ] 28 10.000% 72.500% ## ( 1900, 2900 ] 26 9.286% 81.786% ## ( 2900, 4400 ] 39 13.929% 95.714% ### ( 4400, 6600 ] 11 3.929% 99.643% # ( 9900, 14000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 44.8 total, 3.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 219.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.845 H:M:S, 39.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.425 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-07:13:22 ... thread 0: (1000000,11000000) ops and (118572.5,207597.0) ops/second in (8.433661,52.987287) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 5.15 GB 94.4 10.5 0.0 10.5 21.0 10.5 0.0 2.0 139.5 278.8 77.20 67.85 183 0.422 10M 19K 0.0 0.0 L1 7/7 653.84 MB 0.0 6.6 5.2 1.4 6.5 5.1 0.2 1.3 222.3 219.9 30.42 28.76 4 7.604 6865K 72K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.5 1.5 246.5 246.4 0.78 0.75 2 0.392 196K 97 0.0 0.0 L3 22/0 960.42 MB 1.0 4.7 2.7 2.0 4.7 2.7 2.0 1.7 154.8 154.0 31.36 22.34 21 1.493 4931K 25K 0.0 0.0 L4 168/0 9.61 GB 1.0 4.7 3.8 0.9 4.7 3.8 0.9 1.2 134.7 134.2 35.97 22.41 57 0.631 4814K 12K 0.0 0.0 L5 1096/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1311/22 106.52 GB 0.0 26.8 11.8 15.0 37.2 22.2 12.2 3.5 156.1 216.6 175.72 142.12 267 0.658 27M 130K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.8 11.8 15.0 37.2 22.2 12.1 3.5 156.1 216.6 175.72 142.12 267 0.658 27M 130K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.8 11.8 15.0 26.6 11.6 0.0 0.0 193.5 192.5 141.72 114.54 117 1.211 27M 130K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 316.8 34.00 27.58 150 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.2 total, 53.0 interval Flush(GB): cumulative 10.520, interval 10.520 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.17 GB write, 715.08 MB/s write, 26.78 GB read, 515.29 MB/s read, 175.7 seconds Interval compaction: 37.17 GB write, 718.25 MB/s write, 26.78 GB read, 517.58 MB/s read, 175.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 32, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 32, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 78, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 46, total-stops: 78, interval: 124 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4931042 Average: 2.6649 StdDev: 23.77 Min: 0 Median: 1.5499 Max: 7346 Percentiles: P50: 1.55 P75: 1.92 P99: 7.04 P99.9: 19.14 P99.99: 207.71 ------------------------------------------------------ [ 0, 1 ] 651870 13.220% 13.220% ### ( 1, 2 ] 3298091 66.884% 80.104% ############# ( 2, 3 ] 567601 11.511% 91.615% ## ( 3, 4 ] 189454 3.842% 95.457% # ( 4, 6 ] 162263 3.291% 98.747% # ( 6, 10 ] 47961 0.973% 99.720% ( 10, 15 ] 8289 0.168% 99.888% ( 15, 22 ] 984 0.020% 99.908% ( 22, 34 ] 65 0.001% 99.909% ( 34, 51 ] 30 0.001% 99.910% ( 51, 76 ] 18 0.000% 99.910% ( 76, 110 ] 1646 0.033% 99.944% ( 110, 170 ] 1995 0.040% 99.984% ( 170, 250 ] 598 0.012% 99.996% ( 250, 380 ] 400 0.008% 100.005% ( 380, 580 ] 417 0.008% 100.013% ( 580, 870 ] 349 0.007% 100.020% ( 870, 1300 ] 230 0.005% 100.025% ( 1300, 1900 ] 116 0.002% 100.027% ( 1900, 2900 ] 85 0.002% 100.029% ( 2900, 4400 ] 70 0.001% 100.030% ( 4400, 6600 ] 13 0.000% 100.030% ( 6600, 9900 ] 3 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 1498108 Average: 5.7462 StdDev: 82.56 Min: 0 Median: 1.8682 Max: 13887 Percentiles: P50: 1.87 P75: 2.85 P99: 9.95 P99.9: 157.72 P99.99: 481.10 ------------------------------------------------------ [ 0, 1 ] 69454 4.636% 4.636% # ( 1, 2 ] 782794 52.252% 56.888% ########## ( 2, 3 ] 318113 21.234% 78.123% #### ( 3, 4 ] 126903 8.471% 86.593% ## ( 4, 6 ] 148451 9.909% 96.503% ## ( 6, 10 ] 37925 2.532% 99.034% # ( 10, 15 ] 10646 0.711% 99.745% ( 15, 22 ] 1196 0.080% 99.825% ( 22, 34 ] 99 0.007% 99.831% ( 34, 51 ] 32 0.002% 99.833% ( 51, 76 ] 40 0.003% 99.836% ( 76, 110 ] 335 0.022% 99.858% ( 110, 170 ] 782 0.052% 99.911% ( 170, 250 ] 385 0.026% 99.936% ( 250, 380 ] 464 0.031% 99.967% ( 380, 580 ] 671 0.045% 100.012% ( 580, 870 ] 721 0.048% 100.060% ( 870, 1300 ] 482 0.032% 100.092% ( 1300, 1900 ] 246 0.016% 100.109% ( 1900, 2900 ] 283 0.019% 100.128% ( 2900, 4400 ] 295 0.020% 100.147% ( 4400, 6600 ] 61 0.004% 100.152% ( 6600, 9900 ] 21 0.001% 100.153% ( 9900, 14000 ] 2 0.000% 100.153% ** Level 2 read latency histogram (micros): Count: 77381 Average: 5.2132 StdDev: 81.09 Min: 0 Median: 1.6726 Max: 5913 Percentiles: P50: 1.67 P75: 2.36 P99: 9.15 P99.9: 672.57 P99.99: 3955.80 ------------------------------------------------------ [ 0, 1 ] 7636 9.868% 9.868% ## ( 1, 2 ] 46170 59.666% 69.534% ############ ( 2, 3 ] 11698 15.117% 84.651% ### ( 3, 4 ] 5149 6.654% 91.305% # ( 4, 6 ] 5043 6.517% 97.822% # ( 6, 10 ] 1157 1.495% 99.318% ( 10, 15 ] 292 0.377% 99.695% ( 15, 22 ] 31 0.040% 99.735% ( 22, 34 ] 4 0.005% 99.740% ( 34, 51 ] 3 0.004% 99.744% ( 51, 76 ] 2 0.003% 99.747% ( 76, 110 ] 2 0.003% 99.749% ( 110, 170 ] 18 0.023% 99.773% ( 170, 250 ] 17 0.022% 99.795% ( 250, 380 ] 31 0.040% 99.835% ( 380, 580 ] 42 0.054% 99.889% ( 580, 870 ] 27 0.035% 99.924% ( 870, 1300 ] 14 0.018% 99.942% ( 1300, 1900 ] 10 0.013% 99.955% ( 1900, 2900 ] 16 0.021% 99.975% ( 2900, 4400 ] 16 0.021% 99.996% ( 4400, 6600 ] 5 0.006% 100.003% ** Level 3 read latency histogram (micros): Count: 1057815 Average: 4.7885 StdDev: 68.01 Min: 1 Median: 2.0368 Max: 13090 Percentiles: P50: 2.04 P75: 3.08 P99: 9.07 P99.9: 14.35 P99.99: 18.91 ------------------------------------------------------ [ 0, 1 ] 23049 2.179% 2.179% ( 1, 2 ] 496098 46.898% 49.077% ######### ( 2, 3 ] 265249 25.075% 74.152% ##### ( 3, 4 ] 113173 10.699% 84.851% ## ( 4, 6 ] 132653 12.540% 97.392% ### ( 6, 10 ] 22139 2.093% 99.484% ( 10, 15 ] 5054 0.478% 99.962% ( 15, 22 ] 527 0.050% 100.012% ( 22, 34 ] 33 0.003% 100.015% ( 34, 51 ] 18 0.002% 100.017% ( 51, 76 ] 21 0.002% 100.019% ( 76, 110 ] 24 0.002% 100.021% ( 110, 170 ] 92 0.009% 100.030% ( 170, 250 ] 103 0.010% 100.040% ( 250, 380 ] 157 0.015% 100.054% ( 380, 580 ] 313 0.030% 100.084% ( 580, 870 ] 348 0.033% 100.117% ( 870, 1300 ] 285 0.027% 100.144% ( 1300, 1900 ] 141 0.013% 100.157% ( 1900, 2900 ] 100 0.009% 100.167% ( 2900, 4400 ] 98 0.009% 100.176% ( 4400, 6600 ] 24 0.002% 100.178% ( 6600, 9900 ] 10 0.001% 100.179% ( 9900, 14000 ] 5 0.000% 100.180% ** Level 4 read latency histogram (micros): Count: 245849 Average: 28.3507 StdDev: 236.79 Min: 0 Median: 1.9931 Max: 11171 Percentiles: P50: 1.99 P75: 3.08 P99: 817.22 P99.9: 3450.33 P99.99: 4319.17 ------------------------------------------------------ [ 0, 1 ] 4687 1.906% 1.906% ( 1, 2 ] 119062 48.429% 50.335% ########## ( 2, 3 ] 58657 23.859% 74.194% ##### ( 3, 4 ] 24687 10.042% 84.236% ## ( 4, 6 ] 25810 10.498% 94.734% ## ( 6, 10 ] 5588 2.273% 97.007% ( 10, 15 ] 1785 0.726% 97.733% ( 15, 22 ] 150 0.061% 97.794% ( 22, 34 ] 12 0.005% 97.799% ( 34, 51 ] 7 0.003% 97.802% ( 51, 76 ] 6 0.002% 97.804% ( 76, 110 ] 62 0.025% 97.830% ( 110, 170 ] 239 0.097% 97.927% ( 170, 250 ] 306 0.124% 98.051% ( 250, 380 ] 535 0.218% 98.269% ( 380, 580 ] 874 0.356% 98.624% ( 580, 870 ] 1129 0.459% 99.084% ( 870, 1300 ] 971 0.395% 99.479% ( 1300, 1900 ] 543 0.221% 99.699% ( 1900, 2900 ] 353 0.144% 99.843% ( 2900, 4400 ] 382 0.155% 99.998% ( 4400, 6600 ] 113 0.046% 100.044% ( 6600, 9900 ] 12 0.005% 100.049% ( 9900, 14000 ] 2 0.001% 100.050% ** Level 5 read latency histogram (micros): Count: 280 Average: 1375.5000 StdDev: 1507.04 Min: 81 Median: 754.0000 Max: 10603 Percentiles: P50: 754.00 P75: 2169.23 P99: 6240.00 P99.9: 10603.00 P99.99: 10603.00 ------------------------------------------------------ ( 76, 110 ] 11 3.929% 3.929% # ( 110, 170 ] 36 12.857% 16.786% ### ( 170, 250 ] 28 10.000% 26.786% ## ( 250, 380 ] 22 7.857% 34.643% ## ( 380, 580 ] 25 8.929% 43.571% ## ( 580, 870 ] 30 10.714% 54.286% ## ( 870, 1300 ] 23 8.214% 62.500% ## ( 1300, 1900 ] 28 10.000% 72.500% ## ( 1900, 2900 ] 26 9.286% 81.786% ## ( 2900, 4400 ] 39 13.929% 95.714% ### ( 4400, 6600 ] 11 3.929% 99.643% # ( 9900, 14000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 53.2 total, 8.4 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 203.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.595 H:M:S, 44.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 116.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.750 H:M:S, 68.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.416 micros/op 184618 ops/sec 60.005 seconds 11077999 operations; 178.9 MB/s Microseconds per write: Count: 11077999 Average: 5.4164 StdDev: 444.38 Min: 1 Median: 1.7298 Max: 672013 Percentiles: P50: 1.73 P75: 2.66 P99: 8.10 P99.9: 1085.24 P99.99: 2682.33 ------------------------------------------------------ [ 0, 1 ] 1532874 13.837% 13.837% ### ( 1, 2 ] 5489687 49.555% 63.392% ########## ( 2, 3 ] 1949178 17.595% 80.987% #### ( 3, 4 ] 1446007 13.053% 94.040% ### ( 4, 6 ] 495240 4.470% 98.510% # ( 6, 10 ] 103189 0.931% 99.442% ( 10, 15 ] 24079 0.217% 99.659% ( 15, 22 ] 6806 0.061% 99.721% ( 22, 34 ] 1506 0.014% 99.734% ( 34, 51 ] 168 0.002% 99.736% ( 51, 76 ] 49 0.000% 99.736% ( 76, 110 ] 8554 0.077% 99.813% ( 110, 170 ] 2317 0.021% 99.834% ( 170, 250 ] 261 0.002% 99.837% ( 250, 380 ] 100 0.001% 99.838% ( 380, 580 ] 24 0.000% 99.838% ( 580, 870 ] 34 0.000% 99.838% ( 870, 1300 ] 13681 0.123% 99.962% ( 1300, 1900 ] 65 0.001% 99.962% ( 1900, 2900 ] 3927 0.035% 99.998% ( 2900, 4400 ] 176 0.002% 99.999% ( 4400, 6600 ] 31 0.000% 100.000% ( 6600, 9900 ] 12 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 4 0.000% 100.000% ( 110000, 170000 ] 5 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 4 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 236891 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11077999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11432494968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 677 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30208746 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 38047714925 rocksdb.compact.write.bytes COUNT : 37797315496 rocksdb.flush.write.bytes COUNT : 11361821789 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 64 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 412 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11270253568 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4412416 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 38158266783 rocksdb.non.last.level.read.count COUNT : 9218676 rocksdb.block.checksum.compute.count COUNT : 9217386 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.370480 P95 : 3.780592 P99 : 6.244725 P100 : 672011.000000 COUNT : 11077999 SUM : 54934162 rocksdb.compaction.times.micros P50 : 1025277.777778 P95 : 3530000.000000 P99 : 16760000.000000 P100 : 16863921.000000 COUNT : 131 SUM : 179083382 rocksdb.compaction.times.cpu_micros P50 : 853958.333333 P95 : 3215000.000000 P99 : 13349000.000000 P100 : 15362794.000000 COUNT : 131 SUM : 147813331 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 711.024096 P95 : 5390.000000 P99 : 27390.000000 P100 : 78800.000000 COUNT : 151 SUM : 269170 rocksdb.compaction.outfile.sync.micros P50 : 1516.666667 P95 : 73046.875000 P99 : 207600.000000 P100 : 913689.000000 COUNT : 465 SUM : 6973125 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.785714 P95 : 1681.000000 P99 : 3552.500000 P100 : 7846.000000 COUNT : 313 SUM : 117434 rocksdb.table.open.io.micros P50 : 1581.250000 P95 : 8056.304348 P99 : 18449.230769 P100 : 22937.000000 COUNT : 677 SUM : 1642725 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.749567 P95 : 8.560864 P99 : 12.916641 P100 : 13891.000000 COUNT : 9215593 SUM : 61211586 rocksdb.read.block.get.micros P50 : 512.857143 P95 : 3772.535211 P99 : 7614.750000 P100 : 13218.000000 COUNT : 1354 SUM : 1367970 rocksdb.write.raw.block.micros P50 : 0.514005 P95 : 0.976609 P99 : 2.919833 P100 : 11732.000000 COUNT : 11909599 SUM : 25061424 rocksdb.numfiles.in.singlecompaction P50 : 2.979167 P95 : 4.912500 P99 : 15.455000 P100 : 22.000000 COUNT : 187 SUM : 640 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.557560 P95 : 1157.213957 P99 : 2503.606557 P100 : 671841.000000 COUNT : 173652 SUM : 30221648 rocksdb.sst.read.micros P50 : 1.695867 P95 : 5.240640 P99 : 9.361028 P100 : 13887.000000 COUNT : 9219147 SUM : 42495982 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11077999 SUM : 11432494968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212040.816327 P95 : 473100.000000 P99 : 823025.000000 P100 : 906169.000000 COUNT : 151 SUM : 34196757 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 455 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0