[2024-07-24 04:30:45.460161] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... [2024-07-24 04:30:45.460300] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid570686 ] Set seed to 1721788245456819 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-24 04:30:45.559507] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-24 04:30:45.595092] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-24 04:30:45.595139] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 570686' to capture a snapshot of events at runtime. [2024-07-24 04:30:45.595151] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid570686 for offline analysis/debug. [2024-07-24 04:30:45.595195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 24 04:30:49 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/24-04:30:57 ... thread 0: (1000000,1000000) ops and (127111.2,127111.2) ops/second in (7.867129,7.867129) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 566.90 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 116.9 7.00 2.39 9 0.778 0 0 0.0 0.0 L1 4/4 259.55 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.0 1.0 114.5 114.4 2.27 1.17 1 2.269 263K 193 0.0 0.0 L2 13/11 1.59 GB 2.1 0.3 0.3 0.1 0.3 0.2 0.0 1.3 97.7 96.9 3.53 1.58 1 3.530 350K 2654 0.0 0.0 L3 38/10 2.99 GB 2.2 2.6 1.6 1.0 2.5 1.6 0.2 1.6 99.3 98.1 26.57 12.09 13 2.044 1174K 0 0.0 0.0 L4 203/26 11.59 GB 1.1 2.9 1.9 1.1 2.9 1.8 0.0 1.5 115.8 113.8 25.85 13.77 20 1.293 1667K 0 0.0 0.0 L5 1100/0 90.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1364/55 107.35 GB 0.0 6.1 4.0 2.1 6.8 4.7 0.2 8.5 95.6 106.9 65.23 31.00 44 1.482 3455K 2847 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 4.0 2.1 6.8 4.7 0.2 8.5 95.6 106.9 65.23 31.00 44 1.482 3455K 2847 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 4.0 2.1 6.0 3.9 0.0 0.0 107.1 105.6 58.23 28.61 35 1.664 3455K 2847 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 116.9 7.00 2.39 9 0.778 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.1 total, 7.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.81 GB write, 864.38 MB/s write, 6.09 GB read, 773.32 MB/s read, 65.2 seconds Interval compaction: 6.81 GB write, 885.73 MB/s write, 6.09 GB read, 792.42 MB/s read, 65.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 24, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 104742 Average: 14.1919 StdDev: 237.14 Min: 1 Median: 1.8748 Max: 44906 Percentiles: P50: 1.87 P75: 2.96 P99: 12.51 P99.9: 3025.14 P99.99: 5997.84 ------------------------------------------------------ [ 0, 1 ] 4931 4.708% 4.708% # ( 1, 2 ] 54231 51.776% 56.484% ########## ( 2, 3 ] 20256 19.339% 75.822% #### ( 3, 4 ] 10678 10.195% 86.017% ## ( 4, 6 ] 10984 10.487% 96.504% ## ( 6, 10 ] 2376 2.268% 98.772% ( 10, 15 ] 475 0.453% 99.226% ( 15, 22 ] 51 0.049% 99.274% ( 22, 34 ] 6 0.006% 99.280% ( 34, 51 ] 3 0.003% 99.283% ( 51, 76 ] 6 0.006% 99.289% ( 76, 110 ] 3 0.003% 99.292% ( 110, 170 ] 2 0.002% 99.294% ( 170, 250 ] 14 0.013% 99.307% ( 250, 380 ] 47 0.045% 99.352% ( 380, 580 ] 103 0.098% 99.450% ( 580, 870 ] 130 0.124% 99.574% ( 870, 1300 ] 157 0.150% 99.724% ( 1300, 1900 ] 109 0.104% 99.828% ( 1900, 2900 ] 68 0.065% 99.893% ( 2900, 4400 ] 87 0.083% 99.976% ( 4400, 6600 ] 20 0.019% 99.995% ( 6600, 9900 ] 4 0.004% 99.999% ( 22000, 33000 ] 1 0.001% 100.000% ( 33000, 50000 ] 1 0.001% 100.001% ** Level 1 read latency histogram (micros): Count: 91820 Average: 10.5257 StdDev: 125.62 Min: 1 Median: 1.8778 Max: 7698 Percentiles: P50: 1.88 P75: 2.98 P99: 13.02 P99.9: 2209.35 P99.99: 4393.17 ------------------------------------------------------ [ 0, 1 ] 5102 5.557% 5.557% # ( 1, 2 ] 46487 50.628% 56.185% ########## ( 2, 3 ] 17597 19.165% 75.350% #### ( 3, 4 ] 9357 10.191% 85.540% ## ( 4, 6 ] 9515 10.363% 95.903% ## ( 6, 10 ] 2478 2.699% 98.602% # ( 10, 15 ] 606 0.660% 99.262% ( 15, 22 ] 94 0.102% 99.364% ( 22, 34 ] 21 0.023% 99.387% ( 34, 51 ] 3 0.003% 99.390% ( 51, 76 ] 4 0.004% 99.394% ( 76, 110 ] 2 0.002% 99.397% ( 110, 170 ] 5 0.005% 99.402% ( 170, 250 ] 21 0.023% 99.425% ( 250, 380 ] 37 0.040% 99.465% ( 380, 580 ] 85 0.093% 99.558% ( 580, 870 ] 106 0.115% 99.673% ( 870, 1300 ] 104 0.113% 99.787% ( 1300, 1900 ] 85 0.093% 99.879% ( 1900, 2900 ] 62 0.068% 99.947% ( 2900, 4400 ] 40 0.044% 99.990% ( 4400, 6600 ] 8 0.009% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 436810 Average: 13.1818 StdDev: 171.98 Min: 1 Median: 1.9063 Max: 33976 Percentiles: P50: 1.91 P75: 3.05 P99: 13.18 P99.9: 1694.23 P99.99: 2627.95 ------------------------------------------------------ [ 0, 1 ] 20486 4.690% 4.690% # ( 1, 2 ] 218378 49.994% 54.684% ########## ( 2, 3 ] 86217 19.738% 74.422% #### ( 3, 4 ] 46349 10.611% 85.032% ## ( 4, 6 ] 46910 10.739% 95.772% ## ( 6, 10 ] 12120 2.775% 98.546% # ( 10, 15 ] 3117 0.714% 99.260% ( 15, 22 ] 453 0.104% 99.364% ( 22, 34 ] 65 0.015% 99.378% ( 34, 51 ] 34 0.008% 99.386% ( 51, 76 ] 30 0.007% 99.393% ( 76, 110 ] 22 0.005% 99.398% ( 110, 170 ] 34 0.008% 99.406% ( 170, 250 ] 93 0.021% 99.427% ( 250, 380 ] 211 0.048% 99.476% ( 380, 580 ] 396 0.091% 99.566% ( 580, 870 ] 591 0.135% 99.701% ( 870, 1300 ] 584 0.134% 99.835% ( 1300, 1900 ] 431 0.099% 99.934% ( 1900, 2900 ] 337 0.077% 100.011% ( 2900, 4400 ] 313 0.072% 100.083% ( 4400, 6600 ] 75 0.017% 100.100% ( 6600, 9900 ] 10 0.002% 100.102% ( 9900, 14000 ] 1 0.000% 100.102% ( 14000, 22000 ] 1 0.000% 100.103% ( 22000, 33000 ] 1 0.000% 100.103% ( 33000, 50000 ] 1 0.000% 100.103% ** Level 3 read latency histogram (micros): Count: 718492 Average: 10.4631 StdDev: 159.93 Min: 1 Median: 1.8831 Max: 38404 Percentiles: P50: 1.88 P75: 2.97 P99: 9.76 P99.9: 769.83 P99.99: 1071.77 ------------------------------------------------------ [ 0, 1 ] 31136 4.334% 4.334% # ( 1, 2 ] 371533 51.710% 56.044% ########## ( 2, 3 ] 141138 19.644% 75.687% #### ( 3, 4 ] 74888 10.423% 86.110% ## ( 4, 6 ] 77248 10.751% 96.862% ## ( 6, 10 ] 16352 2.276% 99.137% ( 10, 15 ] 3678 0.512% 99.649% ( 15, 22 ] 402 0.056% 99.705% ( 22, 34 ] 25 0.003% 99.709% ( 34, 51 ] 49 0.007% 99.716% ( 51, 76 ] 47 0.007% 99.722% ( 76, 110 ] 12 0.002% 99.724% ( 110, 170 ] 47 0.007% 99.730% ( 170, 250 ] 94 0.013% 99.743% ( 250, 380 ] 187 0.026% 99.770% ( 380, 580 ] 459 0.064% 99.833% ( 580, 870 ] 731 0.102% 99.935% ( 870, 1300 ] 840 0.117% 100.052% ( 1300, 1900 ] 496 0.069% 100.121% ( 1900, 2900 ] 430 0.060% 100.181% ( 2900, 4400 ] 357 0.050% 100.231% ( 4400, 6600 ] 62 0.009% 100.239% ( 6600, 9900 ] 19 0.003% 100.242% ( 14000, 22000 ] 2 0.000% 100.242% ( 22000, 33000 ] 5 0.001% 100.243% ( 33000, 50000 ] 2 0.000% 100.243% ** Level 4 read latency histogram (micros): Count: 438587 Average: 21.9390 StdDev: 239.59 Min: 1 Median: 1.9122 Max: 55095 Percentiles: P50: 1.91 P75: 3.09 P99: 428.80 P99.9: 2471.63 P99.99: 3214.98 ------------------------------------------------------ [ 0, 1 ] 16805 3.832% 3.832% # ( 1, 2 ] 221986 50.614% 54.446% ########## ( 2, 3 ] 85940 19.595% 74.040% #### ( 3, 4 ] 45926 10.471% 84.512% ## ( 4, 6 ] 48221 10.995% 95.506% ## ( 6, 10 ] 11584 2.641% 98.147% # ( 10, 15 ] 2636 0.601% 98.748% ( 15, 22 ] 283 0.065% 98.813% ( 22, 34 ] 26 0.006% 98.819% ( 34, 51 ] 31 0.007% 98.826% ( 51, 76 ] 48 0.011% 98.837% ( 76, 110 ] 26 0.006% 98.843% ( 110, 170 ] 52 0.012% 98.855% ( 170, 250 ] 167 0.038% 98.893% ( 250, 380 ] 292 0.067% 98.959% ( 380, 580 ] 730 0.166% 99.126% ( 580, 870 ] 1080 0.246% 99.372% ( 870, 1300 ] 1186 0.270% 99.642% ( 1300, 1900 ] 775 0.177% 99.819% ( 1900, 2900 ] 620 0.141% 99.961% ( 2900, 4400 ] 615 0.140% 100.101% ( 4400, 6600 ] 119 0.027% 100.128% ( 6600, 9900 ] 20 0.005% 100.132% ( 9900, 14000 ] 3 0.001% 100.133% ( 14000, 22000 ] 5 0.001% 100.134% ( 22000, 33000 ] 1 0.000% 100.135% ( 33000, 50000 ] 2 0.000% 100.135% ( 50000, 75000 ] 1 0.000% 100.135% ** Level 5 read latency histogram (micros): Count: 14315 Average: 1614.3004 StdDev: 1650.71 Min: 79 Median: 1101.2469 Max: 48161 Percentiles: P50: 1101.25 P75: 2173.85 P99: 6427.12 P99.9: 9771.30 P99.99: 46523.50 ------------------------------------------------------ ( 76, 110 ] 13 0.091% 0.091% ( 110, 170 ] 109 0.761% 0.852% ( 170, 250 ] 257 1.795% 2.648% ( 250, 380 ] 787 5.498% 8.145% # ( 380, 580 ] 1748 12.211% 20.356% ## ( 580, 870 ] 2749 19.204% 39.560% #### ( 870, 1300 ] 2779 19.413% 58.973% #### ( 1300, 1900 ] 1858 12.979% 71.952% ### ( 1900, 2900 ] 1593 11.128% 83.081% ## ( 2900, 4400 ] 1726 12.057% 95.138% ## ( 4400, 6600 ] 600 4.191% 99.329% # ( 6600, 9900 ] 85 0.594% 99.923% ( 9900, 14000 ] 4 0.028% 99.951% ( 33000, 50000 ] 7 0.049% 100.000% ** DB Stats ** Uptime(secs): 8.1 total, 7.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 122.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.837 H:M:S, 47.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 125.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.837 H:M:S, 48.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/24-04:31:05 ... thread 0: (1000000,2000000) ops and (134789.5,130837.8) ops/second in (7.418973,15.286102) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 1.23 GB 12.6 0.7 0.0 0.7 2.5 1.8 0.0 1.4 38.1 141.9 18.20 8.19 25 0.728 703K 951 0.0 0.0 L1 4/4 246.78 MB 0.0 0.9 0.6 0.3 0.9 0.6 0.0 1.4 112.9 112.7 7.94 4.21 2 3.972 911K 1727 0.0 0.0 L2 2/2 257.54 MB 0.0 0.3 0.3 0.1 0.3 0.2 0.4 1.3 97.7 96.9 3.53 1.58 1 3.530 350K 2654 0.0 0.0 L3 18/3 1.33 GB 1.0 4.5 3.2 1.3 4.4 3.1 0.3 1.4 105.1 104.3 43.41 21.07 17 2.553 2561K 1692 0.0 0.0 L4 177/0 9.68 GB 1.0 8.9 4.6 4.3 8.8 4.5 0.7 1.9 118.1 115.9 77.56 42.07 48 1.616 3931K 9654 0.0 0.0 L5 1164/0 95.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1375/17 108.27 GB 0.0 15.3 8.7 6.6 16.9 10.3 6.5 9.2 103.9 115.1 150.63 77.13 93 1.620 8458K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.3 8.7 6.6 16.9 10.3 6.5 9.2 103.9 115.1 150.63 77.13 93 1.620 8458K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.3 8.7 6.6 15.1 8.5 0.0 0.0 114.5 112.9 136.75 71.76 70 1.954 8458K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 136.1 13.89 5.37 23 0.604 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.3 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.93 GB write, 1119.45 MB/s write, 15.29 GB read, 1011.32 MB/s read, 150.6 seconds Interval compaction: 16.93 GB write, 1133.68 MB/s write, 15.29 GB read, 1024.18 MB/s read, 150.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 44, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 449292 Average: 10.6408 StdDev: 156.79 Min: 1 Median: 1.7991 Max: 44906 Percentiles: P50: 1.80 P75: 2.79 P99: 11.27 P99.9: 1844.08 P99.99: 4140.62 ------------------------------------------------------ [ 0, 1 ] 29015 6.458% 6.458% # ( 1, 2 ] 244825 54.491% 60.949% ########### ( 2, 3 ] 80400 17.895% 78.844% #### ( 3, 4 ] 40300 8.970% 87.814% ## ( 4, 6 ] 41271 9.186% 97.000% ## ( 6, 10 ] 8509 1.894% 98.893% ( 10, 15 ] 1893 0.421% 99.315% ( 15, 22 ] 221 0.049% 99.364% ( 22, 34 ] 18 0.004% 99.368% ( 34, 51 ] 11 0.002% 99.370% ( 51, 76 ] 21 0.005% 99.375% ( 76, 110 ] 12 0.003% 99.378% ( 110, 170 ] 78 0.017% 99.395% ( 170, 250 ] 134 0.030% 99.425% ( 250, 380 ] 248 0.055% 99.480% ( 380, 580 ] 474 0.105% 99.586% ( 580, 870 ] 574 0.128% 99.713% ( 870, 1300 ] 545 0.121% 99.835% ( 1300, 1900 ] 325 0.072% 99.907% ( 1900, 2900 ] 207 0.046% 99.953% ( 2900, 4400 ] 202 0.045% 99.998% ( 4400, 6600 ] 64 0.014% 100.012% ( 6600, 9900 ] 11 0.002% 100.015% ( 9900, 14000 ] 1 0.000% 100.015% ( 22000, 33000 ] 1 0.000% 100.015% ( 33000, 50000 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 211866 Average: 12.0981 StdDev: 144.96 Min: 1 Median: 1.8861 Max: 8229 Percentiles: P50: 1.89 P75: 2.96 P99: 13.50 P99.9: 2393.72 P99.99: 4294.00 ------------------------------------------------------ [ 0, 1 ] 9082 4.287% 4.287% # ( 1, 2 ] 109295 51.587% 55.874% ########## ( 2, 3 ] 42382 20.004% 75.878% #### ( 3, 4 ] 20675 9.759% 85.636% ## ( 4, 6 ] 21705 10.245% 95.881% ## ( 6, 10 ] 5655 2.669% 98.550% # ( 10, 15 ] 1361 0.642% 99.192% ( 15, 22 ] 200 0.094% 99.287% ( 22, 34 ] 32 0.015% 99.302% ( 34, 51 ] 6 0.003% 99.305% ( 51, 76 ] 9 0.004% 99.309% ( 76, 110 ] 6 0.003% 99.312% ( 110, 170 ] 21 0.010% 99.322% ( 170, 250 ] 62 0.029% 99.351% ( 250, 380 ] 108 0.051% 99.402% ( 380, 580 ] 188 0.089% 99.491% ( 580, 870 ] 307 0.145% 99.636% ( 870, 1300 ] 315 0.149% 99.784% ( 1300, 1900 ] 177 0.084% 99.868% ( 1900, 2900 ] 138 0.065% 99.933% ( 2900, 4400 ] 130 0.061% 99.994% ( 4400, 6600 ] 33 0.016% 100.010% ( 6600, 9900 ] 4 0.002% 100.012% ** Level 2 read latency histogram (micros): Count: 684084 Average: 12.8429 StdDev: 167.13 Min: 1 Median: 1.9178 Max: 33976 Percentiles: P50: 1.92 P75: 3.06 P99: 13.06 P99.9: 1757.11 P99.99: 2862.43 ------------------------------------------------------ [ 0, 1 ] 26460 3.868% 3.868% # ( 1, 2 ] 343841 50.263% 54.131% ########## ( 2, 3 ] 138696 20.275% 74.406% #### ( 3, 4 ] 71789 10.494% 84.900% ## ( 4, 6 ] 74668 10.915% 95.815% ## ( 6, 10 ] 18824 2.752% 98.567% # ( 10, 15 ] 4841 0.708% 99.274% ( 15, 22 ] 673 0.098% 99.373% ( 22, 34 ] 86 0.013% 99.385% ( 34, 51 ] 64 0.009% 99.395% ( 51, 76 ] 63 0.009% 99.404% ( 76, 110 ] 41 0.006% 99.410% ( 110, 170 ] 57 0.008% 99.418% ( 170, 250 ] 131 0.019% 99.437% ( 250, 380 ] 328 0.048% 99.485% ( 380, 580 ] 603 0.088% 99.573% ( 580, 870 ] 892 0.130% 99.704% ( 870, 1300 ] 882 0.129% 99.833% ( 1300, 1900 ] 605 0.088% 99.921% ( 1900, 2900 ] 490 0.072% 99.993% ( 2900, 4400 ] 477 0.070% 100.062% ( 4400, 6600 ] 128 0.019% 100.081% ( 6600, 9900 ] 23 0.003% 100.084% ( 9900, 14000 ] 2 0.000% 100.085% ( 14000, 22000 ] 1 0.000% 100.085% ( 22000, 33000 ] 1 0.000% 100.085% ( 33000, 50000 ] 1 0.000% 100.085% ** Level 3 read latency histogram (micros): Count: 1383590 Average: 9.7372 StdDev: 142.64 Min: 1 Median: 1.8974 Max: 38404 Percentiles: P50: 1.90 P75: 2.97 P99: 9.87 P99.9: 662.82 P99.99: 946.70 ------------------------------------------------------ [ 0, 1 ] 50965 3.684% 3.684% # ( 1, 2 ] 714104 51.612% 55.296% ########## ( 2, 3 ] 279915 20.231% 75.527% #### ( 3, 4 ] 142914 10.329% 85.856% ## ( 4, 6 ] 148746 10.751% 96.607% ## ( 6, 10 ] 34246 2.475% 99.082% ( 10, 15 ] 7985 0.577% 99.659% ( 15, 22 ] 973 0.070% 99.730% ( 22, 34 ] 73 0.005% 99.735% ( 34, 51 ] 100 0.007% 99.742% ( 51, 76 ] 117 0.008% 99.751% ( 76, 110 ] 50 0.004% 99.754% ( 110, 170 ] 110 0.008% 99.762% ( 170, 250 ] 197 0.014% 99.776% ( 250, 380 ] 401 0.029% 99.805% ( 380, 580 ] 914 0.066% 99.871% ( 580, 870 ] 1388 0.100% 99.972% ( 870, 1300 ] 1422 0.103% 100.074% ( 1300, 1900 ] 815 0.059% 100.133% ( 1900, 2900 ] 733 0.053% 100.186% ( 2900, 4400 ] 592 0.043% 100.229% ( 4400, 6600 ] 145 0.010% 100.240% ( 6600, 9900 ] 32 0.002% 100.242% ( 9900, 14000 ] 2 0.000% 100.242% ( 14000, 22000 ] 2 0.000% 100.242% ( 22000, 33000 ] 5 0.000% 100.243% ( 33000, 50000 ] 2 0.000% 100.243% ** Level 4 read latency histogram (micros): Count: 1125984 Average: 18.4379 StdDev: 202.09 Min: 1 Median: 1.9174 Max: 55095 Percentiles: P50: 1.92 P75: 3.08 P99: 192.95 P99.9: 1828.93 P99.99: 2596.62 ------------------------------------------------------ [ 0, 1 ] 38763 3.443% 3.443% # ( 1, 2 ] 571415 50.748% 54.191% ########## ( 2, 3 ] 224919 19.975% 74.166% #### ( 3, 4 ] 117877 10.469% 84.635% ## ( 4, 6 ] 123869 11.001% 95.636% ## ( 6, 10 ] 29502 2.620% 98.256% # ( 10, 15 ] 6790 0.603% 98.859% ( 15, 22 ] 803 0.071% 98.930% ( 22, 34 ] 75 0.007% 98.937% ( 34, 51 ] 95 0.008% 98.945% ( 51, 76 ] 112 0.010% 98.955% ( 76, 110 ] 75 0.007% 98.962% ( 110, 170 ] 257 0.023% 98.985% ( 170, 250 ] 600 0.053% 99.038% ( 250, 380 ] 965 0.086% 99.124% ( 380, 580 ] 1898 0.169% 99.292% ( 580, 870 ] 2785 0.247% 99.540% ( 870, 1300 ] 2644 0.235% 99.774% ( 1300, 1900 ] 1604 0.142% 99.917% ( 1900, 2900 ] 1182 0.105% 100.022% ( 2900, 4400 ] 1148 0.102% 100.124% ( 4400, 6600 ] 254 0.023% 100.146% ( 6600, 9900 ] 49 0.004% 100.151% ( 9900, 14000 ] 9 0.001% 100.152% ( 14000, 22000 ] 6 0.001% 100.152% ( 22000, 33000 ] 1 0.000% 100.152% ( 33000, 50000 ] 2 0.000% 100.152% ( 50000, 75000 ] 1 0.000% 100.152% ** Level 5 read latency histogram (micros): Count: 36788 Average: 1233.1121 StdDev: 1339.59 Min: 79 Median: 822.5072 Max: 48161 Percentiles: P50: 822.51 P75: 1490.38 P99: 6034.37 P99.9: 9450.86 P99.99: 41065.77 ------------------------------------------------------ ( 76, 110 ] 223 0.606% 0.606% ( 110, 170 ] 1245 3.384% 3.990% # ( 170, 250 ] 1811 4.923% 8.913% # ( 250, 380 ] 3162 8.595% 17.508% ## ( 380, 580 ] 5606 15.239% 32.747% ### ( 580, 870 ] 7590 20.632% 53.379% #### ( 870, 1300 ] 6734 18.305% 71.684% #### ( 1300, 1900 ] 3845 10.452% 82.135% ## ( 1900, 2900 ] 2734 7.432% 89.567% # ( 2900, 4400 ] 2803 7.619% 97.187% ## ( 4400, 6600 ] 898 2.441% 99.628% ( 6600, 9900 ] 116 0.315% 99.943% ( 9900, 14000 ] 7 0.019% 99.962% ( 14000, 22000 ] 5 0.014% 99.976% ( 22000, 33000 ] 2 0.005% 99.981% ( 33000, 50000 ] 7 0.019% 100.000% ** DB Stats ** Uptime(secs): 15.5 total, 7.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 127.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.392 H:M:S, 47.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 132.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.555 H:M:S, 47.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/24-04:31:09 ... thread 0: (1000000,3000000) ops and (247602.0,155240.6) ops/second in (4.038740,19.324842) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 2.15 GB 113.3 1.8 0.0 1.8 4.6 2.8 0.0 1.6 68.7 175.1 26.61 15.42 43 0.619 1854K 2193 0.0 0.0 L1 4/4 246.78 MB 0.0 0.9 0.6 0.3 0.9 0.6 0.0 1.4 112.9 112.7 7.94 4.21 2 3.972 911K 1727 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.3 0.1 0.3 0.2 0.4 1.3 97.7 96.9 3.53 1.58 1 3.530 350K 2654 0.0 0.0 L3 19/0 948.83 MB 0.9 5.1 3.4 1.7 5.0 3.4 0.3 1.5 110.6 109.8 47.07 24.04 19 2.478 2823K 1692 0.0 0.0 L4 178/0 9.72 GB 1.0 10.0 5.2 4.8 9.8 5.0 0.7 1.9 120.5 118.3 85.00 47.58 55 1.546 4816K 10K 0.0 0.0 L5 1174/0 96.14 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1387/12 109.17 GB 0.0 18.1 9.5 8.6 20.6 12.1 7.2 7.5 108.8 124.1 170.16 92.83 120 1.418 10M 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.1 9.5 8.6 20.6 12.1 7.2 7.5 108.8 124.1 170.16 92.83 120 1.418 10M 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.1 9.5 8.6 17.9 9.3 0.0 0.0 121.4 119.9 152.57 84.77 83 1.838 10M 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 161.2 17.59 8.06 37 0.475 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.5 total, 19.3 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.63 GB write, 1081.97 MB/s write, 18.09 GB read, 948.75 MB/s read, 170.2 seconds Interval compaction: 20.63 GB write, 1092.85 MB/s write, 18.09 GB read, 958.29 MB/s read, 170.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 46, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 818466 Average: 9.5450 StdDev: 142.95 Min: 1 Median: 1.7223 Max: 44906 Percentiles: P50: 1.72 P75: 2.59 P99: 121.30 P99.9: 1145.26 P99.99: 2433.42 ------------------------------------------------------ [ 0, 1 ] 81095 9.908% 9.908% ## ( 1, 2 ] 454304 55.507% 65.415% ########### ( 2, 3 ] 132354 16.171% 81.586% ### ( 3, 4 ] 63842 7.800% 89.386% ## ( 4, 6 ] 61713 7.540% 96.926% ## ( 6, 10 ] 12568 1.536% 98.462% ( 10, 15 ] 2832 0.346% 98.808% ( 15, 22 ] 370 0.045% 98.853% ( 22, 34 ] 33 0.004% 98.857% ( 34, 51 ] 19 0.002% 98.859% ( 51, 76 ] 27 0.003% 98.863% ( 76, 110 ] 637 0.078% 98.940% ( 110, 170 ] 2592 0.317% 99.257% ( 170, 250 ] 1655 0.202% 99.459% ( 250, 380 ] 1042 0.127% 99.587% ( 380, 580 ] 1203 0.147% 99.734% ( 580, 870 ] 933 0.114% 99.848% ( 870, 1300 ] 671 0.082% 99.930% ( 1300, 1900 ] 365 0.045% 99.974% ( 1900, 2900 ] 244 0.030% 100.004% ( 2900, 4400 ] 222 0.027% 100.031% ( 4400, 6600 ] 68 0.008% 100.039% ( 6600, 9900 ] 17 0.002% 100.042% ( 9900, 14000 ] 5 0.001% 100.042% ( 14000, 22000 ] 4 0.000% 100.043% ( 22000, 33000 ] 2 0.000% 100.043% ( 33000, 50000 ] 2 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 265202 Average: 10.8824 StdDev: 135.94 Min: 1 Median: 1.8825 Max: 16427 Percentiles: P50: 1.88 P75: 2.96 P99: 13.61 P99.9: 2032.38 P99.99: 4202.40 ------------------------------------------------------ [ 0, 1 ] 11495 4.334% 4.334% # ( 1, 2 ] 137223 51.743% 56.077% ########## ( 2, 3 ] 52546 19.814% 75.891% #### ( 3, 4 ] 26101 9.842% 85.733% ## ( 4, 6 ] 26843 10.122% 95.854% ## ( 6, 10 ] 7158 2.699% 98.554% # ( 10, 15 ] 1641 0.619% 99.172% ( 15, 22 ] 273 0.103% 99.275% ( 22, 34 ] 46 0.017% 99.293% ( 34, 51 ] 7 0.003% 99.295% ( 51, 76 ] 10 0.004% 99.299% ( 76, 110 ] 63 0.024% 99.323% ( 110, 170 ] 132 0.050% 99.373% ( 170, 250 ] 117 0.044% 99.417% ( 250, 380 ] 163 0.061% 99.478% ( 380, 580 ] 244 0.092% 99.570% ( 580, 870 ] 344 0.130% 99.700% ( 870, 1300 ] 332 0.125% 99.825% ( 1300, 1900 ] 180 0.068% 99.893% ( 1900, 2900 ] 142 0.054% 99.946% ( 2900, 4400 ] 133 0.050% 99.997% ( 4400, 6600 ] 33 0.012% 100.009% ( 6600, 9900 ] 5 0.002% 100.011% ( 14000, 22000 ] 1 0.000% 100.011% ** Level 2 read latency histogram (micros): Count: 684084 Average: 12.8429 StdDev: 167.13 Min: 1 Median: 1.9178 Max: 33976 Percentiles: P50: 1.92 P75: 3.06 P99: 13.06 P99.9: 1757.11 P99.99: 2862.43 ------------------------------------------------------ [ 0, 1 ] 26460 3.868% 3.868% # ( 1, 2 ] 343841 50.263% 54.131% ########## ( 2, 3 ] 138696 20.275% 74.406% #### ( 3, 4 ] 71789 10.494% 84.900% ## ( 4, 6 ] 74668 10.915% 95.815% ## ( 6, 10 ] 18824 2.752% 98.567% # ( 10, 15 ] 4841 0.708% 99.274% ( 15, 22 ] 673 0.098% 99.373% ( 22, 34 ] 86 0.013% 99.385% ( 34, 51 ] 64 0.009% 99.395% ( 51, 76 ] 63 0.009% 99.404% ( 76, 110 ] 41 0.006% 99.410% ( 110, 170 ] 57 0.008% 99.418% ( 170, 250 ] 131 0.019% 99.437% ( 250, 380 ] 328 0.048% 99.485% ( 380, 580 ] 603 0.088% 99.573% ( 580, 870 ] 892 0.130% 99.704% ( 870, 1300 ] 882 0.129% 99.833% ( 1300, 1900 ] 605 0.088% 99.921% ( 1900, 2900 ] 490 0.072% 99.993% ( 2900, 4400 ] 477 0.070% 100.062% ( 4400, 6600 ] 128 0.019% 100.081% ( 6600, 9900 ] 23 0.003% 100.084% ( 9900, 14000 ] 2 0.000% 100.085% ( 14000, 22000 ] 1 0.000% 100.085% ( 22000, 33000 ] 1 0.000% 100.085% ( 33000, 50000 ] 1 0.000% 100.085% ** Level 3 read latency histogram (micros): Count: 1570413 Average: 9.5573 StdDev: 159.17 Min: 1 Median: 1.8954 Max: 48970 Percentiles: P50: 1.90 P75: 2.96 P99: 9.89 P99.9: 603.81 P99.99: 882.52 ------------------------------------------------------ [ 0, 1 ] 56243 3.581% 3.581% # ( 1, 2 ] 814122 51.841% 55.423% ########## ( 2, 3 ] 318653 20.291% 75.714% #### ( 3, 4 ] 160878 10.244% 85.958% ## ( 4, 6 ] 167300 10.653% 96.611% ## ( 6, 10 ] 38616 2.459% 99.070% ( 10, 15 ] 8920 0.568% 99.638% ( 15, 22 ] 1050 0.067% 99.705% ( 22, 34 ] 81 0.005% 99.710% ( 34, 51 ] 140 0.009% 99.719% ( 51, 76 ] 126 0.008% 99.727% ( 76, 110 ] 136 0.009% 99.736% ( 110, 170 ] 430 0.027% 99.763% ( 170, 250 ] 414 0.026% 99.790% ( 250, 380 ] 556 0.035% 99.825% ( 380, 580 ] 1055 0.067% 99.892% ( 580, 870 ] 1493 0.095% 99.987% ( 870, 1300 ] 1476 0.094% 100.081% ( 1300, 1900 ] 839 0.053% 100.135% ( 1900, 2900 ] 763 0.049% 100.183% ( 2900, 4400 ] 618 0.039% 100.223% ( 4400, 6600 ] 152 0.010% 100.232% ( 6600, 9900 ] 40 0.003% 100.235% ( 9900, 14000 ] 5 0.000% 100.235% ( 14000, 22000 ] 7 0.000% 100.236% ( 22000, 33000 ] 9 0.001% 100.236% ( 33000, 50000 ] 5 0.000% 100.236% ** Level 4 read latency histogram (micros): Count: 1253201 Average: 18.9640 StdDev: 215.86 Min: 0 Median: 1.9097 Max: 55095 Percentiles: P50: 1.91 P75: 3.06 P99: 287.43 P99.9: 1805.75 P99.99: 2588.19 ------------------------------------------------------ [ 0, 1 ] 43705 3.487% 3.487% # ( 1, 2 ] 640754 51.129% 54.617% ########## ( 2, 3 ] 247976 19.787% 74.404% #### ( 3, 4 ] 128779 10.276% 84.680% ## ( 4, 6 ] 134523 10.734% 95.415% ## ( 6, 10 ] 31679 2.528% 97.942% # ( 10, 15 ] 7265 0.580% 98.522% ( 15, 22 ] 850 0.068% 98.590% ( 22, 34 ] 80 0.006% 98.596% ( 34, 51 ] 109 0.009% 98.605% ( 51, 76 ] 120 0.010% 98.615% ( 76, 110 ] 581 0.046% 98.661% ( 110, 170 ] 2068 0.165% 98.826% ( 170, 250 ] 1698 0.135% 98.962% ( 250, 380 ] 1674 0.134% 99.095% ( 380, 580 ] 2585 0.206% 99.301% ( 580, 870 ] 3247 0.259% 99.560% ( 870, 1300 ] 2837 0.226% 99.787% ( 1300, 1900 ] 1682 0.134% 99.921% ( 1900, 2900 ] 1255 0.100% 100.021% ( 2900, 4400 ] 1192 0.095% 100.116% ( 4400, 6600 ] 273 0.022% 100.138% ( 6600, 9900 ] 62 0.005% 100.143% ( 9900, 14000 ] 13 0.001% 100.144% ( 14000, 22000 ] 15 0.001% 100.145% ( 22000, 33000 ] 8 0.001% 100.146% ( 33000, 50000 ] 3 0.000% 100.146% ( 50000, 75000 ] 1 0.000% 100.146% ** Level 5 read latency histogram (micros): Count: 67942 Average: 832.7400 StdDev: 1242.51 Min: 76 Median: 465.6926 Max: 48161 Percentiles: P50: 465.68 P75: 977.21 P99: 5408.50 P99.9: 9579.60 P99.99: 32375.99 ------------------------------------------------------ ( 51, 76 ] 2 0.003% 0.003% ( 76, 110 ] 3146 4.630% 4.633% # ( 110, 170 ] 11923 17.549% 22.182% #### ( 170, 250 ] 7903 11.632% 33.814% ## ( 250, 380 ] 7039 10.360% 44.174% ## ( 380, 580 ] 9240 13.600% 57.774% ### ( 580, 870 ] 9792 14.412% 72.187% ### ( 870, 1300 ] 7670 11.289% 83.476% ## ( 1300, 1900 ] 4122 6.067% 89.543% # ( 1900, 2900 ] 3044 4.480% 94.023% # ( 2900, 4400 ] 2959 4.355% 98.378% # ( 4400, 6600 ] 924 1.360% 99.738% ( 6600, 9900 ] 123 0.181% 99.919% ( 9900, 14000 ] 20 0.029% 99.948% ( 14000, 22000 ] 16 0.024% 99.972% ( 22000, 33000 ] 14 0.021% 99.993% ( 33000, 50000 ] 12 0.018% 100.010% ** DB Stats ** Uptime(secs): 19.5 total, 4.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 151.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.777 H:M:S, 39.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 243.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.385 H:M:S, 9.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-04:31:12 ... thread 0: (1000000,4000000) ops and (292187.8,175845.1) ops/second in (3.422456,22.747298) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.34 GB 214.0 2.8 0.0 2.8 6.5 3.7 0.0 1.7 84.4 198.8 33.57 21.88 63 0.533 2878K 3196 0.0 0.0 L1 10/0 1.04 GB 106.0 1.9 1.4 0.5 1.9 1.4 0.0 1.3 117.0 116.7 16.76 10.17 3 5.587 1992K 6018 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.3 0.1 0.3 0.2 0.4 1.3 97.7 96.9 3.53 1.58 1 3.530 350K 2654 0.0 0.0 L3 19/0 948.83 MB 0.9 5.1 3.4 1.7 5.0 3.4 0.3 1.5 110.6 109.8 47.07 24.04 19 2.478 2823K 1692 0.0 0.0 L4 178/0 9.72 GB 1.0 10.0 5.2 4.8 9.8 5.0 0.7 1.9 120.5 118.3 85.00 47.58 55 1.546 4816K 10K 0.0 0.0 L5 1174/0 96.14 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1393/4 110.15 GB 0.0 20.1 10.3 9.8 23.6 13.8 7.2 6.3 110.8 130.1 185.94 105.25 141 1.319 12M 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.1 10.3 9.8 23.6 13.8 7.2 6.3 110.8 130.1 185.94 105.25 141 1.319 12M 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.1 10.3 9.8 19.9 10.1 0.0 0.0 124.7 123.2 165.20 94.46 88 1.877 12M 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 185.3 20.74 10.79 53 0.391 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.9 total, 22.7 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.63 GB write, 1054.61 MB/s write, 20.11 GB read, 897.56 MB/s read, 185.9 seconds Interval compaction: 23.63 GB write, 1063.62 MB/s write, 20.11 GB read, 905.23 MB/s read, 185.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 46, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1112319 Average: 9.5585 StdDev: 125.37 Min: 0 Median: 1.6532 Max: 44906 Percentiles: P50: 1.65 P75: 2.40 P99: 164.46 P99.9: 864.74 P99.99: 1709.30 ------------------------------------------------------ [ 0, 1 ] 154278 13.870% 13.870% ### ( 1, 2 ] 615269 55.314% 69.184% ########### ( 2, 3 ] 160394 14.420% 83.604% ### ( 3, 4 ] 76203 6.851% 90.455% # ( 4, 6 ] 68985 6.202% 96.657% # ( 6, 10 ] 14176 1.274% 97.931% ( 10, 15 ] 3141 0.282% 98.213% ( 15, 22 ] 494 0.044% 98.258% ( 22, 34 ] 61 0.005% 98.263% ( 34, 51 ] 26 0.002% 98.266% ( 51, 76 ] 30 0.003% 98.268% ( 76, 110 ] 1793 0.161% 98.429% ( 110, 170 ] 6994 0.629% 99.058% ( 170, 250 ] 3951 0.355% 99.413% ( 250, 380 ] 2103 0.189% 99.603% ( 380, 580 ] 2103 0.189% 99.792% ( 580, 870 ] 1230 0.111% 99.902% ( 870, 1300 ] 725 0.065% 99.967% ( 1300, 1900 ] 372 0.033% 100.001% ( 1900, 2900 ] 254 0.023% 100.024% ( 2900, 4400 ] 224 0.020% 100.044% ( 4400, 6600 ] 68 0.006% 100.050% ( 6600, 9900 ] 17 0.002% 100.051% ( 9900, 14000 ] 5 0.000% 100.052% ( 14000, 22000 ] 4 0.000% 100.052% ( 22000, 33000 ] 2 0.000% 100.052% ( 33000, 50000 ] 2 0.000% 100.053% ** Level 1 read latency histogram (micros): Count: 293870 Average: 10.5124 StdDev: 129.72 Min: 1 Median: 1.9175 Max: 16427 Percentiles: P50: 1.92 P75: 3.09 P99: 14.69 P99.9: 1867.82 P99.99: 4158.79 ------------------------------------------------------ [ 0, 1 ] 12458 4.239% 4.239% # ( 1, 2 ] 146576 49.878% 54.117% ########## ( 2, 3 ] 58414 19.877% 73.995% #### ( 3, 4 ] 31349 10.668% 84.662% ## ( 4, 6 ] 31828 10.831% 95.493% ## ( 6, 10 ] 8510 2.896% 98.389% # ( 10, 15 ] 1915 0.652% 99.040% ( 15, 22 ] 449 0.153% 99.193% ( 22, 34 ] 59 0.020% 99.213% ( 34, 51 ] 10 0.003% 99.217% ( 51, 76 ] 10 0.003% 99.220% ( 76, 110 ] 120 0.041% 99.261% ( 110, 170 ] 329 0.112% 99.373% ( 170, 250 ] 195 0.066% 99.439% ( 250, 380 ] 207 0.070% 99.510% ( 380, 580 ] 280 0.095% 99.605% ( 580, 870 ] 355 0.121% 99.726% ( 870, 1300 ] 338 0.115% 99.841% ( 1300, 1900 ] 184 0.063% 99.903% ( 1900, 2900 ] 143 0.049% 99.952% ( 2900, 4400 ] 133 0.045% 99.997% ( 4400, 6600 ] 33 0.011% 100.009% ( 6600, 9900 ] 5 0.002% 100.010% ( 14000, 22000 ] 1 0.000% 100.011% ** Level 2 read latency histogram (micros): Count: 684084 Average: 12.8429 StdDev: 167.13 Min: 1 Median: 1.9178 Max: 33976 Percentiles: P50: 1.92 P75: 3.06 P99: 13.06 P99.9: 1757.11 P99.99: 2862.43 ------------------------------------------------------ [ 0, 1 ] 26460 3.868% 3.868% # ( 1, 2 ] 343841 50.263% 54.131% ########## ( 2, 3 ] 138696 20.275% 74.406% #### ( 3, 4 ] 71789 10.494% 84.900% ## ( 4, 6 ] 74668 10.915% 95.815% ## ( 6, 10 ] 18824 2.752% 98.567% # ( 10, 15 ] 4841 0.708% 99.274% ( 15, 22 ] 673 0.098% 99.373% ( 22, 34 ] 86 0.013% 99.385% ( 34, 51 ] 64 0.009% 99.395% ( 51, 76 ] 63 0.009% 99.404% ( 76, 110 ] 41 0.006% 99.410% ( 110, 170 ] 57 0.008% 99.418% ( 170, 250 ] 131 0.019% 99.437% ( 250, 380 ] 328 0.048% 99.485% ( 380, 580 ] 603 0.088% 99.573% ( 580, 870 ] 892 0.130% 99.704% ( 870, 1300 ] 882 0.129% 99.833% ( 1300, 1900 ] 605 0.088% 99.921% ( 1900, 2900 ] 490 0.072% 99.993% ( 2900, 4400 ] 477 0.070% 100.062% ( 4400, 6600 ] 128 0.019% 100.081% ( 6600, 9900 ] 23 0.003% 100.084% ( 9900, 14000 ] 2 0.000% 100.085% ( 14000, 22000 ] 1 0.000% 100.085% ( 22000, 33000 ] 1 0.000% 100.085% ( 33000, 50000 ] 1 0.000% 100.085% ** Level 3 read latency histogram (micros): Count: 1571539 Average: 9.6941 StdDev: 159.28 Min: 1 Median: 1.8961 Max: 48970 Percentiles: P50: 1.90 P75: 2.97 P99: 9.99 P99.9: 610.06 P99.99: 885.32 ------------------------------------------------------ [ 0, 1 ] 56243 3.579% 3.579% # ( 1, 2 ] 814125 51.804% 55.383% ########## ( 2, 3 ] 318676 20.278% 75.661% #### ( 3, 4 ] 160897 10.238% 85.899% ## ( 4, 6 ] 167323 10.647% 96.546% ## ( 6, 10 ] 38617 2.457% 99.004% ( 10, 15 ] 8921 0.568% 99.571% ( 15, 22 ] 1050 0.067% 99.638% ( 22, 34 ] 81 0.005% 99.643% ( 34, 51 ] 140 0.009% 99.652% ( 51, 76 ] 126 0.008% 99.660% ( 76, 110 ] 269 0.017% 99.677% ( 110, 170 ] 891 0.057% 99.734% ( 170, 250 ] 668 0.043% 99.777% ( 250, 380 ] 654 0.042% 99.818% ( 380, 580 ] 1129 0.072% 99.890% ( 580, 870 ] 1519 0.097% 99.987% ( 870, 1300 ] 1483 0.094% 100.081% ( 1300, 1900 ] 841 0.054% 100.135% ( 1900, 2900 ] 763 0.049% 100.183% ( 2900, 4400 ] 619 0.039% 100.222% ( 4400, 6600 ] 152 0.010% 100.232% ( 6600, 9900 ] 40 0.003% 100.235% ( 9900, 14000 ] 5 0.000% 100.235% ( 14000, 22000 ] 7 0.000% 100.235% ( 22000, 33000 ] 9 0.001% 100.236% ( 33000, 50000 ] 5 0.000% 100.236% ** Level 4 read latency histogram (micros): Count: 1260779 Average: 20.0449 StdDev: 216.01 Min: 0 Median: 1.9156 Max: 55095 Percentiles: P50: 1.92 P75: 3.10 P99: 355.31 P99.9: 1803.94 P99.99: 2586.99 ------------------------------------------------------ [ 0, 1 ] 43705 3.467% 3.467% # ( 1, 2 ] 640794 50.825% 54.292% ########## ( 2, 3 ] 248135 19.681% 73.973% #### ( 3, 4 ] 128878 10.222% 84.195% ## ( 4, 6 ] 134686 10.683% 94.878% ## ( 6, 10 ] 31698 2.514% 97.392% # ( 10, 15 ] 7272 0.577% 97.969% ( 15, 22 ] 850 0.067% 98.036% ( 22, 34 ] 80 0.006% 98.042% ( 34, 51 ] 109 0.009% 98.051% ( 51, 76 ] 120 0.010% 98.061% ( 76, 110 ] 1572 0.125% 98.185% ( 110, 170 ] 5232 0.415% 98.600% ( 170, 250 ] 3122 0.248% 98.848% ( 250, 380 ] 2368 0.188% 99.036% ( 380, 580 ] 3156 0.250% 99.286% ( 580, 870 ] 3452 0.274% 99.560% ( 870, 1300 ] 2874 0.228% 99.788% ( 1300, 1900 ] 1685 0.134% 99.921% ( 1900, 2900 ] 1259 0.100% 100.021% ( 2900, 4400 ] 1192 0.095% 100.116% ( 4400, 6600 ] 273 0.022% 100.137% ( 6600, 9900 ] 62 0.005% 100.142% ( 9900, 14000 ] 13 0.001% 100.143% ( 14000, 22000 ] 15 0.001% 100.145% ( 22000, 33000 ] 8 0.001% 100.145% ( 33000, 50000 ] 3 0.000% 100.145% ( 50000, 75000 ] 1 0.000% 100.146% ** Level 5 read latency histogram (micros): Count: 108844 Average: 598.6170 StdDev: 1031.24 Min: 75 Median: 245.3515 Max: 48161 Percentiles: P50: 245.35 P75: 655.09 P99: 4420.38 P99.9: 8321.26 P99.99: 24447.97 ------------------------------------------------------ ( 51, 76 ] 4 0.004% 0.004% ( 76, 110 ] 8478 7.789% 7.793% ## ( 110, 170 ] 30492 28.014% 35.807% ###### ( 170, 250 ] 16401 15.068% 50.876% ### ( 250, 380 ] 11031 10.135% 61.010% ## ( 380, 580 ] 12399 11.392% 72.402% ## ( 580, 870 ] 10922 10.035% 82.436% ## ( 870, 1300 ] 7848 7.210% 89.647% # ( 1300, 1900 ] 4150 3.813% 93.459% # ( 1900, 2900 ] 3063 2.814% 96.274% # ( 2900, 4400 ] 2959 2.719% 98.992% # ( 4400, 6600 ] 924 0.849% 99.841% ( 6600, 9900 ] 123 0.113% 99.954% ( 9900, 14000 ] 20 0.018% 99.972% ( 14000, 22000 ] 16 0.015% 99.987% ( 22000, 33000 ] 14 0.013% 100.000% ( 33000, 50000 ] 12 0.011% 100.011% ** DB Stats ** Uptime(secs): 22.9 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 171.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.777 H:M:S, 33.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 287.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/24-04:31:16 ... thread 0: (1000000,5000000) ops and (292405.5,191078.9) ops/second in (3.419908,26.167206) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 3.32 GB 289.5 3.5 0.0 3.5 8.2 4.7 0.0 1.7 91.2 214.2 39.38 27.28 82 0.480 3645K 3961 0.0 0.0 L1 10/0 1.04 GB 106.0 1.9 1.4 0.5 1.9 1.4 0.0 1.3 117.0 116.7 16.76 10.17 3 5.587 1992K 6018 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.3 0.1 0.3 0.2 0.4 1.3 97.7 96.9 3.53 1.58 1 3.530 350K 2654 0.0 0.0 L3 19/0 948.83 MB 0.9 5.1 3.4 1.7 5.0 3.4 0.3 1.5 110.6 109.8 47.07 24.04 19 2.478 2823K 1692 0.0 0.0 L4 178/0 9.72 GB 1.0 10.0 5.2 4.8 9.8 5.0 0.7 1.9 120.5 118.3 85.00 47.58 55 1.546 4816K 10K 0.0 0.0 L5 1174/0 96.14 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1400/8 111.14 GB 0.0 20.8 10.3 10.5 25.4 14.8 7.2 5.4 111.3 135.4 191.75 110.65 160 1.198 13M 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.8 10.3 10.5 25.4 14.8 7.2 5.4 111.3 135.4 191.75 110.65 160 1.198 13M 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.8 10.3 10.5 20.6 10.1 0.0 0.0 127.1 125.7 167.96 97.18 91 1.846 13M 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 203.9 23.79 13.47 69 0.345 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.4 total, 26.2 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.35 GB write, 984.69 MB/s write, 20.85 GB read, 809.81 MB/s read, 191.8 seconds Interval compaction: 25.35 GB write, 992.00 MB/s write, 20.85 GB read, 815.82 MB/s read, 191.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 46, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1372011 Average: 8.5312 StdDev: 113.53 Min: 0 Median: 1.5890 Max: 44906 Percentiles: P50: 1.59 P75: 2.17 P99: 155.03 P99.9: 795.70 P99.99: 1574.88 ------------------------------------------------------ [ 0, 1 ] 237122 17.283% 17.283% ### ( 1, 2 ] 762141 55.549% 72.832% ########### ( 2, 3 ] 176051 12.832% 85.664% ### ( 3, 4 ] 82196 5.991% 91.655% # ( 4, 6 ] 73355 5.347% 97.001% # ( 6, 10 ] 14925 1.088% 98.089% ( 10, 15 ] 3468 0.253% 98.342% ( 15, 22 ] 530 0.039% 98.380% ( 22, 34 ] 65 0.005% 98.385% ( 34, 51 ] 26 0.002% 98.387% ( 51, 76 ] 41 0.003% 98.390% ( 76, 110 ] 2145 0.156% 98.546% ( 110, 170 ] 8299 0.605% 99.151% ( 170, 250 ] 4672 0.341% 99.492% ( 250, 380 ] 2368 0.173% 99.664% ( 380, 580 ] 2279 0.166% 99.830% ( 580, 870 ] 1288 0.094% 99.924% ( 870, 1300 ] 733 0.053% 99.978% ( 1300, 1900 ] 375 0.027% 100.005% ( 1900, 2900 ] 257 0.019% 100.024% ( 2900, 4400 ] 225 0.016% 100.040% ( 4400, 6600 ] 68 0.005% 100.045% ( 6600, 9900 ] 17 0.001% 100.046% ( 9900, 14000 ] 5 0.000% 100.047% ( 14000, 22000 ] 4 0.000% 100.047% ( 22000, 33000 ] 2 0.000% 100.047% ( 33000, 50000 ] 2 0.000% 100.047% ** Level 1 read latency histogram (micros): Count: 295021 Average: 10.9114 StdDev: 130.08 Min: 1 Median: 1.9211 Max: 16427 Percentiles: P50: 1.92 P75: 3.12 P99: 75.47 P99.9: 1870.58 P99.99: 4157.50 ------------------------------------------------------ [ 0, 1 ] 12458 4.223% 4.223% # ( 1, 2 ] 146619 49.698% 53.921% ########## ( 2, 3 ] 58572 19.854% 73.774% #### ( 3, 4 ] 31446 10.659% 84.433% ## ( 4, 6 ] 31995 10.845% 95.278% ## ( 6, 10 ] 8531 2.892% 98.170% # ( 10, 15 ] 1920 0.651% 98.820% ( 15, 22 ] 451 0.153% 98.973% ( 22, 34 ] 59 0.020% 98.993% ( 34, 51 ] 10 0.003% 98.997% ( 51, 76 ] 10 0.003% 99.000% ( 76, 110 ] 256 0.087% 99.087% ( 110, 170 ] 638 0.216% 99.303% ( 170, 250 ] 308 0.104% 99.407% ( 250, 380 ] 254 0.086% 99.494% ( 380, 580 ] 311 0.105% 99.599% ( 580, 870 ] 372 0.126% 99.725% ( 870, 1300 ] 341 0.116% 99.841% ( 1300, 1900 ] 184 0.062% 99.903% ( 1900, 2900 ] 145 0.049% 99.952% ( 2900, 4400 ] 133 0.045% 99.997% ( 4400, 6600 ] 33 0.011% 100.008% ( 6600, 9900 ] 5 0.002% 100.010% ( 14000, 22000 ] 1 0.000% 100.011% ** Level 2 read latency histogram (micros): Count: 684084 Average: 12.8429 StdDev: 167.13 Min: 1 Median: 1.9178 Max: 33976 Percentiles: P50: 1.92 P75: 3.06 P99: 13.06 P99.9: 1757.11 P99.99: 2862.43 ------------------------------------------------------ [ 0, 1 ] 26460 3.868% 3.868% # ( 1, 2 ] 343841 50.263% 54.131% ########## ( 2, 3 ] 138696 20.275% 74.406% #### ( 3, 4 ] 71789 10.494% 84.900% ## ( 4, 6 ] 74668 10.915% 95.815% ## ( 6, 10 ] 18824 2.752% 98.567% # ( 10, 15 ] 4841 0.708% 99.274% ( 15, 22 ] 673 0.098% 99.373% ( 22, 34 ] 86 0.013% 99.385% ( 34, 51 ] 64 0.009% 99.395% ( 51, 76 ] 63 0.009% 99.404% ( 76, 110 ] 41 0.006% 99.410% ( 110, 170 ] 57 0.008% 99.418% ( 170, 250 ] 131 0.019% 99.437% ( 250, 380 ] 328 0.048% 99.485% ( 380, 580 ] 603 0.088% 99.573% ( 580, 870 ] 892 0.130% 99.704% ( 870, 1300 ] 882 0.129% 99.833% ( 1300, 1900 ] 605 0.088% 99.921% ( 1900, 2900 ] 490 0.072% 99.993% ( 2900, 4400 ] 477 0.070% 100.062% ( 4400, 6600 ] 128 0.019% 100.081% ( 6600, 9900 ] 23 0.003% 100.084% ( 9900, 14000 ] 2 0.000% 100.085% ( 14000, 22000 ] 1 0.000% 100.085% ( 22000, 33000 ] 1 0.000% 100.085% ( 33000, 50000 ] 1 0.000% 100.085% ** Level 3 read latency histogram (micros): Count: 1572830 Average: 9.8401 StdDev: 159.34 Min: 1 Median: 1.8969 Max: 48970 Percentiles: P50: 1.90 P75: 2.97 P99: 10.68 P99.9: 613.85 P99.99: 887.25 ------------------------------------------------------ [ 0, 1 ] 56243 3.576% 3.576% # ( 1, 2 ] 814125 51.762% 55.338% ########## ( 2, 3 ] 318676 20.261% 75.599% #### ( 3, 4 ] 160897 10.230% 85.829% ## ( 4, 6 ] 167323 10.638% 96.467% ## ( 6, 10 ] 38617 2.455% 98.922% ( 10, 15 ] 8921 0.567% 99.490% ( 15, 22 ] 1050 0.067% 99.556% ( 22, 34 ] 81 0.005% 99.561% ( 34, 51 ] 140 0.009% 99.570% ( 51, 76 ] 126 0.008% 99.578% ( 76, 110 ] 491 0.031% 99.610% ( 110, 170 ] 1539 0.098% 99.707% ( 170, 250 ] 907 0.058% 99.765% ( 250, 380 ] 728 0.046% 99.811% ( 380, 580 ] 1214 0.077% 99.889% ( 580, 870 ] 1535 0.098% 99.986% ( 870, 1300 ] 1489 0.095% 100.081% ( 1300, 1900 ] 841 0.053% 100.134% ( 1900, 2900 ] 764 0.049% 100.183% ( 2900, 4400 ] 619 0.039% 100.222% ( 4400, 6600 ] 152 0.010% 100.232% ( 6600, 9900 ] 40 0.003% 100.234% ( 9900, 14000 ] 5 0.000% 100.235% ( 14000, 22000 ] 7 0.000% 100.235% ( 22000, 33000 ] 9 0.001% 100.236% ( 33000, 50000 ] 5 0.000% 100.236% ** Level 4 read latency histogram (micros): Count: 1269311 Average: 21.1145 StdDev: 215.96 Min: 0 Median: 1.9222 Max: 55095 Percentiles: P50: 1.92 P75: 3.15 P99: 386.58 P99.9: 1802.20 P99.99: 2587.60 ------------------------------------------------------ [ 0, 1 ] 43705 3.443% 3.443% # ( 1, 2 ] 640811 50.485% 53.928% ########## ( 2, 3 ] 248227 19.556% 73.484% #### ( 3, 4 ] 128923 10.157% 83.641% ## ( 4, 6 ] 134785 10.619% 94.260% ## ( 6, 10 ] 31704 2.498% 96.758% ( 10, 15 ] 7275 0.573% 97.331% ( 15, 22 ] 850 0.067% 97.398% ( 22, 34 ] 80 0.006% 97.404% ( 34, 51 ] 109 0.009% 97.413% ( 51, 76 ] 120 0.009% 97.422% ( 76, 110 ] 3137 0.247% 97.669% ( 110, 170 ] 9375 0.739% 98.408% ( 170, 250 ] 4468 0.352% 98.760% ( 250, 380 ] 2929 0.231% 98.991% ( 380, 580 ] 3644 0.287% 99.278% ( 580, 870 ] 3594 0.283% 99.561% ( 870, 1300 ] 2892 0.228% 99.789% ( 1300, 1900 ] 1689 0.133% 99.922% ( 1900, 2900 ] 1261 0.099% 100.021% ( 2900, 4400 ] 1193 0.094% 100.115% ( 4400, 6600 ] 273 0.022% 100.137% ( 6600, 9900 ] 62 0.005% 100.141% ( 9900, 14000 ] 13 0.001% 100.142% ( 14000, 22000 ] 15 0.001% 100.144% ( 22000, 33000 ] 8 0.001% 100.144% ( 33000, 50000 ] 3 0.000% 100.144% ( 50000, 75000 ] 1 0.000% 100.145% ** Level 5 read latency histogram (micros): Count: 155208 Average: 475.2989 StdDev: 886.90 Min: 75 Median: 193.1489 Max: 48161 Percentiles: P50: 193.15 P75: 476.91 P99: 4164.90 P99.9: 6835.88 P99.99: 16739.60 ------------------------------------------------------ ( 51, 76 ] 11 0.007% 0.007% ( 76, 110 ] 17075 11.001% 11.008% ## ( 110, 170 ] 53512 34.478% 45.486% ####### ( 170, 250 ] 24212 15.600% 61.086% ### ( 250, 380 ] 14220 9.162% 70.248% ## ( 380, 580 ] 15223 9.808% 80.056% ## ( 580, 870 ] 11715 7.548% 87.604% ## ( 870, 1300 ] 7945 5.119% 92.723% # ( 1300, 1900 ] 4168 2.685% 95.408% # ( 1900, 2900 ] 3078 1.983% 97.391% ( 2900, 4400 ] 2961 1.908% 99.299% ( 4400, 6600 ] 924 0.595% 99.894% ( 6600, 9900 ] 123 0.079% 99.974% ( 9900, 14000 ] 20 0.013% 99.986% ( 14000, 22000 ] 16 0.010% 99.997% ( 22000, 33000 ] 14 0.009% 100.006% ( 33000, 50000 ] 12 0.008% 100.014% ** DB Stats ** Uptime(secs): 26.4 total, 3.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 186.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.777 H:M:S, 29.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 287.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-04:31:36 ... thread 0: (1000000,6000000) ops and (48588.6,128347.3) ops/second in (20.580968,46.748174) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 4.24 GB 50.3 4.7 0.0 4.7 10.4 5.7 0.0 1.8 103.2 226.3 47.02 34.45 102 0.461 4925K 5242 0.0 0.0 L1 10/10 1.04 GB 0.0 1.9 1.4 0.5 1.9 1.4 0.0 1.3 117.0 116.7 16.76 10.17 3 5.587 1992K 6018 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.3 0.1 0.3 0.2 0.4 1.3 97.7 96.9 3.53 1.58 1 3.530 350K 2654 0.0 0.0 L3 19/0 948.83 MB 0.9 5.1 3.4 1.7 5.0 3.4 0.3 1.5 110.6 109.8 47.07 24.04 19 2.478 2823K 1692 0.0 0.0 L4 178/0 9.72 GB 1.0 10.0 5.2 4.8 9.8 5.0 0.7 1.9 120.5 118.3 85.00 47.58 55 1.546 4816K 10K 0.0 0.0 L5 1174/0 96.14 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1400/27 112.06 GB 0.0 22.1 10.3 11.8 27.5 15.7 7.2 4.9 113.4 141.3 199.38 117.82 180 1.108 14M 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.1 10.3 11.8 27.5 15.7 7.2 4.9 113.4 141.3 199.38 117.82 180 1.108 14M 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.1 10.3 11.8 21.8 10.1 0.0 0.0 130.9 129.5 172.74 101.84 96 1.799 14M 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 217.5 26.65 15.98 84 0.317 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.9 total, 46.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.50 GB write, 599.93 MB/s write, 22.08 GB read, 481.62 MB/s read, 199.4 seconds Interval compaction: 27.50 GB write, 602.42 MB/s write, 22.08 GB read, 483.62 MB/s read, 199.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 46, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1957249 Average: 15.7296 StdDev: 103.90 Min: 0 Median: 1.6496 Max: 44906 Percentiles: P50: 1.65 P75: 2.56 P99: 206.45 P99.9: 684.65 P99.99: 1256.49 ------------------------------------------------------ [ 0, 1 ] 329336 16.826% 16.826% ### ( 1, 2 ] 999505 51.067% 67.893% ########## ( 2, 3 ] 248273 12.685% 80.578% ### ( 3, 4 ] 108586 5.548% 86.126% # ( 4, 6 ] 100391 5.129% 91.255% # ( 6, 10 ] 18020 0.921% 92.176% ( 10, 15 ] 4165 0.213% 92.389% ( 15, 22 ] 624 0.032% 92.421% ( 22, 34 ] 74 0.004% 92.424% ( 34, 51 ] 29 0.001% 92.426% ( 51, 76 ] 61 0.003% 92.429% ( 76, 110 ] 36873 1.884% 94.313% ( 110, 170 ] 84396 4.312% 98.625% # ( 170, 250 ] 16119 0.824% 99.448% ( 250, 380 ] 4523 0.231% 99.679% ( 380, 580 ] 3717 0.190% 99.869% ( 580, 870 ] 1662 0.085% 99.954% ( 870, 1300 ] 778 0.040% 99.994% ( 1300, 1900 ] 403 0.021% 100.015% ( 1900, 2900 ] 286 0.015% 100.029% ( 2900, 4400 ] 278 0.014% 100.043% ( 4400, 6600 ] 68 0.003% 100.047% ( 6600, 9900 ] 17 0.001% 100.048% ( 9900, 14000 ] 5 0.000% 100.048% ( 14000, 22000 ] 4 0.000% 100.048% ( 22000, 33000 ] 2 0.000% 100.048% ( 33000, 50000 ] 2 0.000% 100.048% ** Level 1 read latency histogram (micros): Count: 351378 Average: 12.5374 StdDev: 121.26 Min: 1 Median: 1.9653 Max: 16427 Percentiles: P50: 1.97 P75: 3.08 P99: 164.31 P99.9: 1684.72 P99.99: 4073.83 ------------------------------------------------------ [ 0, 1 ] 13790 3.925% 3.925% # ( 1, 2 ] 167711 47.730% 51.654% ########## ( 2, 3 ] 79217 22.545% 74.199% ##### ( 3, 4 ] 34061 9.694% 83.892% ## ( 4, 6 ] 34261 9.750% 93.643% ## ( 6, 10 ] 9265 2.637% 96.280% # ( 10, 15 ] 2245 0.639% 96.918% ( 15, 22 ] 507 0.144% 97.063% ( 22, 34 ] 60 0.017% 97.080% ( 34, 51 ] 10 0.003% 97.083% ( 51, 76 ] 12 0.003% 97.086% ( 76, 110 ] 1978 0.563% 97.649% ( 110, 170 ] 5245 1.493% 99.142% ( 170, 250 ] 1033 0.294% 99.436% ( 250, 380 ] 371 0.106% 99.541% ( 380, 580 ] 406 0.116% 99.657% ( 580, 870 ] 389 0.111% 99.767% ( 870, 1300 ] 347 0.099% 99.866% ( 1300, 1900 ] 185 0.053% 99.919% ( 1900, 2900 ] 145 0.041% 99.960% ( 2900, 4400 ] 134 0.038% 99.998% ( 4400, 6600 ] 33 0.009% 100.008% ( 6600, 9900 ] 5 0.001% 100.009% ( 14000, 22000 ] 1 0.000% 100.009% ** Level 2 read latency histogram (micros): Count: 684084 Average: 12.8429 StdDev: 167.13 Min: 1 Median: 1.9178 Max: 33976 Percentiles: P50: 1.92 P75: 3.06 P99: 13.06 P99.9: 1757.11 P99.99: 2862.43 ------------------------------------------------------ [ 0, 1 ] 26460 3.868% 3.868% # ( 1, 2 ] 343841 50.263% 54.131% ########## ( 2, 3 ] 138696 20.275% 74.406% #### ( 3, 4 ] 71789 10.494% 84.900% ## ( 4, 6 ] 74668 10.915% 95.815% ## ( 6, 10 ] 18824 2.752% 98.567% # ( 10, 15 ] 4841 0.708% 99.274% ( 15, 22 ] 673 0.098% 99.373% ( 22, 34 ] 86 0.013% 99.385% ( 34, 51 ] 64 0.009% 99.395% ( 51, 76 ] 63 0.009% 99.404% ( 76, 110 ] 41 0.006% 99.410% ( 110, 170 ] 57 0.008% 99.418% ( 170, 250 ] 131 0.019% 99.437% ( 250, 380 ] 328 0.048% 99.485% ( 380, 580 ] 603 0.088% 99.573% ( 580, 870 ] 892 0.130% 99.704% ( 870, 1300 ] 882 0.129% 99.833% ( 1300, 1900 ] 605 0.088% 99.921% ( 1900, 2900 ] 490 0.072% 99.993% ( 2900, 4400 ] 477 0.070% 100.062% ( 4400, 6600 ] 128 0.019% 100.081% ( 6600, 9900 ] 23 0.003% 100.084% ( 9900, 14000 ] 2 0.000% 100.085% ( 14000, 22000 ] 1 0.000% 100.085% ( 22000, 33000 ] 1 0.000% 100.085% ( 33000, 50000 ] 1 0.000% 100.085% ** Level 3 read latency histogram (micros): Count: 1582218 Average: 10.6403 StdDev: 159.29 Min: 1 Median: 1.9026 Max: 48970 Percentiles: P50: 1.90 P75: 2.99 P99: 78.47 P99.9: 617.79 P99.99: 888.37 ------------------------------------------------------ [ 0, 1 ] 56243 3.555% 3.555% # ( 1, 2 ] 814125 51.455% 55.009% ########## ( 2, 3 ] 318676 20.141% 75.150% #### ( 3, 4 ] 160897 10.169% 85.320% ## ( 4, 6 ] 167323 10.575% 95.895% ## ( 6, 10 ] 38617 2.441% 98.335% ( 10, 15 ] 8921 0.564% 98.899% ( 15, 22 ] 1050 0.066% 98.966% ( 22, 34 ] 81 0.005% 98.971% ( 34, 51 ] 140 0.009% 98.980% ( 51, 76 ] 128 0.008% 98.988% ( 76, 110 ] 2683 0.170% 99.157% ( 110, 170 ] 7459 0.471% 99.629% ( 170, 250 ] 1822 0.115% 99.744% ( 250, 380 ] 907 0.057% 99.801% ( 380, 580 ] 1360 0.086% 99.887% ( 580, 870 ] 1564 0.099% 99.986% ( 870, 1300 ] 1493 0.094% 100.080% ( 1300, 1900 ] 842 0.053% 100.134% ( 1900, 2900 ] 764 0.048% 100.182% ( 2900, 4400 ] 619 0.039% 100.221% ( 4400, 6600 ] 152 0.010% 100.231% ( 6600, 9900 ] 40 0.003% 100.233% ( 9900, 14000 ] 5 0.000% 100.233% ( 14000, 22000 ] 7 0.000% 100.234% ( 22000, 33000 ] 9 0.001% 100.234% ( 33000, 50000 ] 5 0.000% 100.235% ** Level 4 read latency histogram (micros): Count: 1331860 Average: 26.9049 StdDev: 213.17 Min: 0 Median: 1.9710 Max: 55095 Percentiles: P50: 1.97 P75: 3.51 P99: 405.33 P99.9: 1787.09 P99.99: 2588.48 ------------------------------------------------------ [ 0, 1 ] 43705 3.282% 3.282% # ( 1, 2 ] 640811 48.114% 51.395% ########## ( 2, 3 ] 248227 18.638% 70.033% #### ( 3, 4 ] 128923 9.680% 79.713% ## ( 4, 6 ] 134786 10.120% 89.833% ## ( 6, 10 ] 31704 2.380% 92.214% ( 10, 15 ] 7275 0.546% 92.760% ( 15, 22 ] 850 0.064% 92.824% ( 22, 34 ] 80 0.006% 92.830% ( 34, 51 ] 109 0.008% 92.838% ( 51, 76 ] 136 0.010% 92.848% ( 76, 110 ] 18289 1.373% 94.221% ( 110, 170 ] 48421 3.636% 97.857% # ( 170, 250 ] 10554 0.792% 98.649% ( 250, 380 ] 4109 0.309% 98.958% ( 380, 580 ] 4440 0.333% 99.291% ( 580, 870 ] 3799 0.285% 99.576% ( 870, 1300 ] 2926 0.220% 99.796% ( 1300, 1900 ] 1705 0.128% 99.924% ( 1900, 2900 ] 1275 0.096% 100.020% ( 2900, 4400 ] 1198 0.090% 100.110% ( 4400, 6600 ] 273 0.020% 100.130% ( 6600, 9900 ] 62 0.005% 100.135% ( 9900, 14000 ] 13 0.001% 100.136% ( 14000, 22000 ] 15 0.001% 100.137% ( 22000, 33000 ] 8 0.001% 100.138% ( 33000, 50000 ] 3 0.000% 100.138% ( 50000, 75000 ] 1 0.000% 100.138% ** Level 5 read latency histogram (micros): Count: 493615 Average: 248.4556 StdDev: 524.62 Min: 72 Median: 143.4813 Max: 48161 Percentiles: P50: 143.48 P75: 179.02 P99: 2609.05 P99.9: 5693.77 P99.99: 8307.37 ------------------------------------------------------ ( 51, 76 ] 76 0.015% 0.015% ( 76, 110 ] 99069 20.070% 20.085% #### ( 110, 170 ] 264618 53.608% 73.694% ########### ( 170, 250 ] 57200 11.588% 85.282% ## ( 250, 380 ] 20510 4.155% 89.437% # ( 380, 580 ] 19819 4.015% 93.452% # ( 580, 870 ] 12835 2.600% 96.052% # ( 870, 1300 ] 8092 1.639% 97.691% ( 1300, 1900 ] 4232 0.857% 98.549% ( 1900, 2900 ] 3142 0.637% 99.185% ( 2900, 4400 ] 2985 0.605% 99.790% ( 4400, 6600 ] 924 0.187% 99.977% ( 6600, 9900 ] 123 0.025% 100.002% ( 9900, 14000 ] 20 0.004% 100.006% ( 14000, 22000 ] 16 0.003% 100.009% ( 22000, 33000 ] 14 0.003% 100.012% ( 33000, 50000 ] 12 0.002% 100.015% ** DB Stats ** Uptime(secs): 46.9 total, 20.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 125.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.329 H:M:S, 51.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 47.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:16.552 H:M:S, 80.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 268.787 micros/op 14863 ops/sec 60.147 seconds 893996 operations; 14.4 MB/s (235999 of 235999 found) Microseconds per read: Count: 893996 Average: 268.7886 StdDev: 765.03 Min: 2 Median: 180.2477 Max: 64868 Percentiles: P50: 180.25 P75: 237.77 P99: 1778.81 P99.9: 12056.99 P99.99: 31114.31 ------------------------------------------------------ ( 1, 2 ] 5 0.001% 0.001% ( 2, 3 ] 20 0.002% 0.003% ( 3, 4 ] 45 0.005% 0.008% ( 4, 6 ] 91 0.010% 0.018% ( 6, 10 ] 307 0.034% 0.052% ( 10, 15 ] 2828 0.316% 0.369% ( 15, 22 ] 4422 0.495% 0.863% ( 22, 34 ] 9504 1.063% 1.926% ( 34, 51 ] 3378 0.378% 2.304% ( 51, 76 ] 516 0.058% 2.362% ( 76, 110 ] 13737 1.537% 3.899% ( 110, 170 ] 372327 41.648% 45.546% ######## ( 170, 250 ] 310845 34.770% 80.316% ####### ( 250, 380 ] 93963 10.510% 90.827% ## ( 380, 580 ] 39988 4.473% 95.300% # ( 580, 870 ] 19094 2.136% 97.436% ( 870, 1300 ] 10146 1.135% 98.570% ( 1300, 1900 ] 4812 0.538% 99.109% ( 1900, 2900 ] 3078 0.344% 99.453% ( 2900, 4400 ] 2600 0.291% 99.744% ( 4400, 6600 ] 810 0.091% 99.834% ( 6600, 9900 ] 344 0.038% 99.873% ( 9900, 14000 ] 460 0.051% 99.924% ( 14000, 22000 ] 459 0.051% 99.976% ( 22000, 33000 ] 154 0.017% 99.993% ( 33000, 50000 ] 53 0.006% 99.999% ( 50000, 75000 ] 10 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 18610325 rocksdb.bloom.filter.full.positive COUNT : 1074793 rocksdb.bloom.filter.full.true.positive COUNT : 893560 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 436 rocksdb.memtable.miss COUNT : 893560 rocksdb.l0.hit COUNT : 34360 rocksdb.l1.hit COUNT : 8261 rocksdb.l2andup.hit COUNT : 850939 rocksdb.compaction.key.drop.new COUNT : 279314 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6046650 rocksdb.number.keys.read COUNT : 893996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6240142800 rocksdb.bytes.read COUNT : 893996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1738 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 37480957 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 25370918080 rocksdb.compact.write.bytes COUNT : 25082219750 rocksdb.flush.write.bytes COUNT : 6209522083 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 37 rocksdb.number.superversion_acquires COUNT : 1238 rocksdb.number.superversion_releases COUNT : 1187 rocksdb.number.superversion_cleanups COUNT : 305 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 328 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6159386624 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2338816 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29127025035 rocksdb.non.last.level.read.count COUNT : 6894195 rocksdb.block.checksum.compute.count COUNT : 7232584 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 178.781382 P95 : 565.935283 P99 : 1778.204252 P100 : 64865.000000 COUNT : 893996 SUM : 239545615 rocksdb.db.write.micros P50 : 1.531670 P95 : 3.981084 P99 : 7.944245 P100 : 1002537.000000 COUNT : 6046650 SUM : 52353101 rocksdb.compaction.times.micros P50 : 1407407.407407 P95 : 4020000.000000 P99 : 9968000.000000 P100 : 12910647.000000 COUNT : 96 SUM : 172738122 rocksdb.compaction.times.cpu_micros P50 : 930344.827586 P95 : 1842727.272727 P99 : 6632000.000000 P100 : 6810640.000000 COUNT : 96 SUM : 101839493 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 813.260870 P95 : 104750.000000 P99 : 406600.000000 P100 : 475173.000000 COUNT : 86 SUM : 1643234 rocksdb.compaction.outfile.sync.micros P50 : 51209.677419 P95 : 267062.500000 P99 : 648300.000000 P100 : 955343.000000 COUNT : 319 SUM : 27322220 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 234.444444 P95 : 3863.461538 P99 : 6528.500000 P100 : 7127.000000 COUNT : 213 SUM : 193941 rocksdb.table.open.io.micros P50 : 8273.333333 P95 : 19003.846154 P99 : 21677.692308 P100 : 25039.000000 COUNT : 1738 SUM : 14509295 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.990701 P95 : 10.186359 P99 : 162.374329 P100 : 55100.000000 COUNT : 6144272 SUM : 87375110 rocksdb.read.block.get.micros P50 : 137.800196 P95 : 466.086549 P99 : 1621.444714 P100 : 48167.000000 COUNT : 1086551 SUM : 204053374 rocksdb.write.raw.block.micros P50 : 0.526203 P95 : 0.999786 P99 : 3.590339 P100 : 64962.000000 COUNT : 7579252 SUM : 23339085 rocksdb.numfiles.in.singlecompaction P50 : 2.896552 P95 : 5.657143 P99 : 13.600000 P100 : 27.000000 COUNT : 128 SUM : 457 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.581546 P95 : 2240.229550 P99 : 2775.593814 P100 : 1002359.000000 COUNT : 137602 SUM : 37491714 rocksdb.sst.read.micros P50 : 2.006051 P95 : 160.318777 P99 : 510.989288 P100 : 55095.000000 COUNT : 6894218 SUM : 270860532 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 893996 SUM : 893996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6046650 SUM : 6240142800 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226000.000000 P95 : 919500.000000 P99 : 1242906.000000 P100 : 1242906.000000 COUNT : 86 SUM : 27037236 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 338 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0