[2024-07-15 09:14:25.805691] Starting SPDK v24.09-pre git sha1 4835eb82b / DPDK 24.03.0 initialization... [2024-07-15 09:14:25.805834] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3263990 ] Set seed to 1721027665802368 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 09:14:25.908778] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 09:14:26.123879] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 09:14:26.123929] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3263990' to capture a snapshot of events at runtime. [2024-07-15 09:14:26.123939] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 09:14:26.123949] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 09:14:26.123956] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3263990 for offline analysis/debug. [2024-07-15 09:14:26.124087] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 09:14:32 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/15-09:14:35 ... thread 0: (1000000,1000000) ops and (340443.5,340443.5) ops/second in (2.937345,2.937345) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 503.14 MB 25.1 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 353.3 2.49 2.24 12 0.208 0 0 0.0 0.0 L1 2/0 238.80 MB 23.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 255.7 254.6 0.98 0.96 1 0.984 255K 969 0.0 0.0 L2 1/0 51.65 MB 0.5 0.3 0.1 0.2 0.3 0.1 0.0 2.3 246.5 245.7 1.26 1.20 3 0.420 315K 923 0.0 0.0 L3 18/0 1001.68 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 216.4 216.4 0.55 0.49 1 0.553 121K 0 0.0 0.0 L4 116/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 252/4 20.09 GB 0.0 0.7 0.5 0.2 1.5 1.4 0.1 1.8 128.9 295.0 5.29 4.88 17 0.311 692K 1892 0.0 0.0 Int 0/0 0.00 KB 0.0 0.7 0.5 0.2 1.5 1.4 0.1 1.8 128.9 295.0 5.29 4.88 17 0.311 692K 1892 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.7 0.5 0.2 0.7 0.5 0.0 0.0 243.8 243.1 2.80 2.65 5 0.559 692K 1892 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 353.3 2.49 2.24 12 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.52 GB write, 510.15 MB/s write, 0.67 GB read, 222.89 MB/s read, 5.3 seconds Interval compaction: 1.52 GB write, 530.54 MB/s write, 0.67 GB read, 231.80 MB/s read, 5.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 141157 Average: 2.0301 StdDev: 12.42 Min: 1 Median: 1.3836 Max: 3032 Percentiles: P50: 1.38 P75: 1.78 P99: 5.27 P99.9: 9.57 P99.99: 19.53 ------------------------------------------------------ [ 0, 1 ] 36247 25.678% 25.678% ##### ( 1, 2 ] 89499 63.404% 89.082% ############# ( 2, 3 ] 9273 6.569% 95.652% # ( 3, 4 ] 3366 2.385% 98.036% ( 4, 6 ] 2151 1.524% 99.560% ( 6, 10 ] 540 0.383% 99.943% ( 10, 15 ] 65 0.046% 99.989% ( 15, 22 ] 6 0.004% 99.993% ( 22, 34 ] 2 0.001% 99.994% ( 110, 170 ] 8 0.006% 100.000% ( 170, 250 ] 2 0.001% 100.001% ( 250, 380 ] 2 0.001% 100.003% ( 380, 580 ] 8 0.006% 100.009% ( 580, 870 ] 1 0.001% 100.009% ( 870, 1300 ] 1 0.001% 100.010% ( 2900, 4400 ] 2 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 2974 Average: 3.3833 StdDev: 23.58 Min: 1 Median: 1.7329 Max: 950 Percentiles: P50: 1.73 P75: 2.57 P99: 8.63 P99.9: 385.20 P99.99: 950.00 ------------------------------------------------------ [ 0, 1 ] 288 9.684% 9.684% ## ( 1, 2 ] 1636 55.010% 64.694% ########### ( 2, 3 ] 535 17.989% 82.683% #### ( 3, 4 ] 308 10.356% 93.040% ## ( 4, 6 ] 149 5.010% 98.050% # ( 6, 10 ] 43 1.446% 99.496% ( 10, 15 ] 7 0.235% 99.731% ( 15, 22 ] 3 0.101% 99.832% ( 34, 51 ] 1 0.034% 99.866% ( 250, 380 ] 1 0.034% 99.899% ( 380, 580 ] 1 0.034% 99.933% ( 580, 870 ] 1 0.034% 99.966% ( 870, 1300 ] 1 0.034% 100.000% ** Level 2 read latency histogram (micros): Count: 74325 Average: 2.4126 StdDev: 22.14 Min: 0 Median: 1.4687 Max: 4082 Percentiles: P50: 1.47 P75: 1.86 P99: 5.97 P99.9: 15.98 P99.99: 231.69 ------------------------------------------------------ [ 0, 1 ] 15015 20.202% 20.202% #### ( 1, 2 ] 47258 63.583% 83.785% ############# ( 2, 3 ] 7101 9.554% 93.339% ## ( 3, 4 ] 2410 3.243% 96.581% # ( 4, 6 ] 1824 2.454% 99.035% ( 6, 10 ] 579 0.779% 99.814% ( 10, 15 ] 62 0.083% 99.898% ( 15, 22 ] 12 0.016% 99.914% ( 22, 34 ] 1 0.001% 99.915% ( 34, 51 ] 5 0.007% 99.922% ( 51, 76 ] 23 0.031% 99.953% ( 76, 110 ] 7 0.009% 99.962% ( 110, 170 ] 9 0.012% 99.974% ( 170, 250 ] 15 0.020% 99.995% ( 250, 380 ] 12 0.016% 100.011% ( 380, 580 ] 4 0.005% 100.016% ( 580, 870 ] 2 0.003% 100.019% ( 870, 1300 ] 2 0.003% 100.022% ( 2900, 4400 ] 2 0.003% 100.024% ** Level 3 read latency histogram (micros): Count: 90 Average: 1377.4000 StdDev: 2160.96 Min: 0 Median: 190.0000 Max: 9844 Percentiles: P50: 190.00 P75: 2450.00 P99: 9157.50 P99.9: 9825.75 P99.99: 9844.00 ------------------------------------------------------ [ 0, 1 ] 17 18.889% 18.889% #### ( 1, 2 ] 7 7.778% 26.667% ## ( 2, 3 ] 1 1.111% 27.778% ( 4, 6 ] 1 1.111% 28.889% ( 6, 10 ] 3 3.333% 32.222% # ( 10, 15 ] 4 4.444% 36.667% # ( 15, 22 ] 3 3.333% 40.000% # ( 51, 76 ] 4 4.444% 44.444% # ( 76, 110 ] 2 2.222% 46.667% ( 110, 170 ] 1 1.111% 47.778% ( 170, 250 ] 8 8.889% 56.667% ## ( 250, 380 ] 6 6.667% 63.333% # ( 580, 870 ] 1 1.111% 64.444% ( 870, 1300 ] 1 1.111% 65.556% ( 1300, 1900 ] 3 3.333% 68.889% # ( 1900, 2900 ] 10 11.111% 80.000% ## ( 2900, 4400 ] 10 11.111% 91.111% ## ( 4400, 6600 ] 4 4.444% 95.556% # ( 6600, 9900 ] 4 4.444% 100.000% # ** Level 4 read latency histogram (micros): Count: 25 Average: 2426.9200 StdDev: 2277.05 Min: 140 Median: 2212.5000 Max: 9102 Percentiles: P50: 2212.50 P75: 3462.50 P99: 9102.00 P99.9: 9102.00 P99.99: 9102.00 ------------------------------------------------------ ( 110, 170 ] 3 12.000% 12.000% ## ( 170, 250 ] 2 8.000% 20.000% ## ( 250, 380 ] 1 4.000% 24.000% # ( 380, 580 ] 1 4.000% 28.000% # ( 580, 870 ] 2 8.000% 36.000% ## ( 1300, 1900 ] 1 4.000% 40.000% # ( 1900, 2900 ] 8 32.000% 72.000% ###### ( 2900, 4400 ] 2 8.000% 80.000% ## ( 4400, 6600 ] 3 12.000% 92.000% ## ( 6600, 9900 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 321.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.400 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.400 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/15-09:14:38 ... thread 0: (1000000,2000000) ops and (325263.4,332680.4) ops/second in (3.074431,6.011776) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/12 1.47 GB 0.0 0.8 0.0 0.8 2.6 1.8 0.0 1.4 96.5 318.6 8.47 7.83 29 0.292 830K 4245 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 255.7 254.6 0.98 0.96 1 0.984 255K 969 0.0 0.0 L2 1/1 51.65 MB 0.0 0.3 0.1 0.2 0.3 0.1 0.2 2.3 246.5 245.7 1.26 1.20 3 0.420 315K 923 0.0 0.0 L3 20/10 1.15 GB 0.3 0.4 0.4 0.1 0.4 0.3 0.0 1.2 221.1 220.7 1.98 1.84 3 0.658 443K 797 0.0 0.0 L4 122/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 179.7 179.7 0.32 0.28 1 0.323 58K 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 263/23 21.06 GB 0.0 1.8 0.8 1.0 3.7 2.6 0.4 2.0 144.0 288.4 13.02 12.11 37 0.352 1903K 6934 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.8 1.0 3.7 2.6 0.4 2.0 144.0 288.4 13.02 12.11 37 0.352 1903K 6934 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.8 1.0 1.8 0.8 0.0 0.0 245.1 244.2 7.65 7.33 11 0.695 1903K 6934 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.4 5.37 4.78 26 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 6.0 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.67 GB write, 612.11 MB/s write, 1.83 GB read, 305.62 MB/s read, 13.0 seconds Interval compaction: 3.67 GB write, 624.07 MB/s write, 1.83 GB read, 311.59 MB/s read, 13.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 367516 Average: 2.4019 StdDev: 12.40 Min: 1 Median: 1.5603 Max: 3032 Percentiles: P50: 1.56 P75: 1.95 P99: 5.86 P99.9: 11.57 P99.99: 155.00 ------------------------------------------------------ [ 0, 1 ] 52876 14.387% 14.387% ### ( 1, 2 ] 233577 63.556% 77.943% ############# ( 2, 3 ] 50908 13.852% 91.795% ### ( 3, 4 ] 15559 4.234% 96.028% # ( 4, 6 ] 11732 3.192% 99.221% # ( 6, 10 ] 2417 0.658% 99.878% ( 10, 15 ] 256 0.070% 99.948% ( 15, 22 ] 31 0.008% 99.956% ( 22, 34 ] 6 0.002% 99.958% ( 34, 51 ] 2 0.001% 99.959% ( 76, 110 ] 45 0.012% 99.971% ( 110, 170 ] 95 0.026% 99.997% ( 170, 250 ] 26 0.007% 100.004% ( 250, 380 ] 9 0.002% 100.006% ( 380, 580 ] 23 0.006% 100.013% ( 580, 870 ] 9 0.002% 100.015% ( 870, 1300 ] 5 0.001% 100.016% ( 1300, 1900 ] 2 0.001% 100.017% ( 1900, 2900 ] 3 0.001% 100.018% ( 2900, 4400 ] 2 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 63611 Average: 2.6447 StdDev: 5.56 Min: 1 Median: 1.7617 Max: 950 Percentiles: P50: 1.76 P75: 2.50 P99: 7.13 P99.9: 13.56 P99.99: 47.93 ------------------------------------------------------ [ 0, 1 ] 2199 3.457% 3.457% # ( 1, 2 ] 38871 61.107% 64.564% ############ ( 2, 3 ] 13405 21.073% 85.638% #### ( 3, 4 ] 4597 7.227% 92.864% # ( 4, 6 ] 3716 5.842% 98.706% # ( 6, 10 ] 659 1.036% 99.742% ( 10, 15 ] 141 0.222% 99.964% ( 15, 22 ] 14 0.022% 99.986% ( 22, 34 ] 1 0.002% 99.987% ( 34, 51 ] 2 0.003% 99.991% ( 170, 250 ] 1 0.002% 99.992% ( 250, 380 ] 1 0.002% 99.994% ( 380, 580 ] 2 0.003% 99.997% ( 580, 870 ] 1 0.002% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 77606 Average: 2.4473 StdDev: 21.96 Min: 0 Median: 1.4807 Max: 4082 Percentiles: P50: 1.48 P75: 1.88 P99: 5.99 P99.9: 18.98 P99.99: 252.39 ------------------------------------------------------ [ 0, 1 ] 15156 19.529% 19.529% #### ( 1, 2 ] 49195 63.391% 82.920% ############# ( 2, 3 ] 7930 10.218% 93.138% ## ( 3, 4 ] 2586 3.332% 96.471% # ( 4, 6 ] 1970 2.538% 99.009% # ( 6, 10 ] 617 0.795% 99.804% ( 10, 15 ] 67 0.086% 99.890% ( 15, 22 ] 13 0.017% 99.907% ( 22, 34 ] 1 0.001% 99.909% ( 34, 51 ] 6 0.008% 99.916% ( 51, 76 ] 23 0.030% 99.946% ( 76, 110 ] 9 0.012% 99.957% ( 110, 170 ] 10 0.013% 99.970% ( 170, 250 ] 15 0.019% 99.990% ( 250, 380 ] 13 0.017% 100.006% ( 380, 580 ] 6 0.008% 100.014% ( 580, 870 ] 3 0.004% 100.018% ( 870, 1300 ] 2 0.003% 100.021% ( 2900, 4400 ] 2 0.003% 100.023% ** Level 3 read latency histogram (micros): Count: 206435 Average: 3.7194 StdDev: 55.62 Min: 0 Median: 1.6754 Max: 9844 Percentiles: P50: 1.68 P75: 2.25 P99: 9.01 P99.9: 206.20 P99.99: 596.39 ------------------------------------------------------ [ 0, 1 ] 15164 7.346% 7.346% # ( 1, 2 ] 130376 63.156% 70.502% ############# ( 2, 3 ] 36992 17.919% 88.421% #### ( 3, 4 ] 10604 5.137% 93.558% # ( 4, 6 ] 8487 4.111% 97.669% # ( 6, 10 ] 3652 1.769% 99.438% ( 10, 15 ] 490 0.237% 99.675% ( 15, 22 ] 53 0.026% 99.701% ( 22, 34 ] 8 0.004% 99.705% ( 34, 51 ] 2 0.001% 99.706% ( 51, 76 ] 5 0.002% 99.708% ( 76, 110 ] 84 0.041% 99.749% ( 110, 170 ] 256 0.124% 99.873% ( 170, 250 ] 125 0.061% 99.934% ( 250, 380 ] 69 0.033% 99.967% ( 380, 580 ] 47 0.023% 99.990% ( 580, 870 ] 24 0.012% 100.001% ( 870, 1300 ] 7 0.003% 100.005% ( 1300, 1900 ] 5 0.002% 100.007% ( 1900, 2900 ] 10 0.005% 100.012% ( 2900, 4400 ] 10 0.005% 100.017% ( 4400, 6600 ] 4 0.002% 100.019% ( 6600, 9900 ] 4 0.002% 100.021% ** Level 4 read latency histogram (micros): Count: 55 Average: 1117.5818 StdDev: 1946.61 Min: 0 Median: 18.5000 Max: 9102 Percentiles: P50: 18.50 P75: 2056.25 P99: 8992.50 P99.9: 9102.00 P99.99: 9102.00 ------------------------------------------------------ [ 0, 1 ] 8 14.545% 14.545% ### ( 1, 2 ] 10 18.182% 32.727% #### ( 3, 4 ] 1 1.818% 34.545% ( 4, 6 ] 1 1.818% 36.364% ( 6, 10 ] 2 3.636% 40.000% # ( 10, 15 ] 5 9.091% 49.091% ## ( 15, 22 ] 1 1.818% 50.909% ( 110, 170 ] 3 5.455% 56.364% # ( 170, 250 ] 3 5.455% 61.818% # ( 250, 380 ] 1 1.818% 63.636% ( 380, 580 ] 2 3.636% 67.273% # ( 580, 870 ] 2 3.636% 70.909% # ( 1300, 1900 ] 1 1.818% 72.727% ( 1900, 2900 ] 8 14.545% 87.273% ### ( 2900, 4400 ] 2 3.636% 90.909% # ( 4400, 6600 ] 3 5.455% 96.364% # ( 6600, 9900 ] 2 3.636% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.873 H:M:S, 14.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.473 H:M:S, 15.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/15-09:14:41 ... thread 0: (1000000,3000000) ops and (349518.6,338109.9) ops/second in (2.861078,8.872854) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 2.33 GB 62.6 1.4 0.0 1.4 4.0 2.7 0.0 1.5 104.5 312.8 13.24 12.22 44 0.301 1405K 7353 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 255.7 254.6 0.98 0.96 1 0.984 255K 969 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.2 2.3 246.5 245.7 1.26 1.20 3 0.420 315K 923 0.0 0.0 L3 14/0 701.38 MB 0.7 1.3 0.4 0.9 1.3 0.4 0.0 3.3 225.5 222.6 6.08 5.65 4 1.519 1391K 17K 0.0 0.0 L4 122/0 9.73 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 179.7 179.7 0.32 0.28 1 0.323 58K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 267/16 21.90 GB 0.0 3.3 0.8 2.5 6.0 3.5 1.2 2.2 154.2 279.4 21.89 20.30 53 0.413 3426K 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 0.8 2.5 6.0 3.5 1.2 2.2 154.2 279.4 21.89 20.30 53 0.413 3426K 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 0.8 2.5 3.3 0.8 0.0 0.0 241.5 239.5 13.97 13.27 14 0.998 3426K 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 349.6 7.91 7.03 39 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.702, interval 2.702 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.97 GB write, 679.81 MB/s write, 3.29 GB read, 375.13 MB/s read, 21.9 seconds Interval compaction: 5.97 GB write, 688.82 MB/s write, 3.29 GB read, 380.10 MB/s read, 21.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 765620 Average: 2.7208 StdDev: 16.00 Min: 1 Median: 1.6152 Max: 3032 Percentiles: P50: 1.62 P75: 2.02 P99: 6.44 P99.9: 14.95 P99.99: 235.89 ------------------------------------------------------ [ 0, 1 ] 81423 10.635% 10.635% ## ( 1, 2 ] 489888 63.986% 74.621% ############# ( 2, 3 ] 126652 16.542% 91.163% ### ( 3, 4 ] 33187 4.335% 95.498% # ( 4, 6 ] 26035 3.401% 98.898% # ( 6, 10 ] 7095 0.927% 99.825% ( 10, 15 ] 583 0.076% 99.901% ( 15, 22 ] 70 0.009% 99.910% ( 22, 34 ] 19 0.002% 99.913% ( 34, 51 ] 4 0.001% 99.913% ( 51, 76 ] 7 0.001% 99.914% ( 76, 110 ] 124 0.016% 99.930% ( 110, 170 ] 312 0.041% 99.971% ( 170, 250 ] 179 0.023% 99.995% ( 250, 380 ] 127 0.017% 100.011% ( 380, 580 ] 128 0.017% 100.028% ( 580, 870 ] 74 0.010% 100.037% ( 870, 1300 ] 27 0.004% 100.041% ( 1300, 1900 ] 13 0.002% 100.043% ( 1900, 2900 ] 6 0.001% 100.043% ( 2900, 4400 ] 2 0.000% 100.044% ** Level 1 read latency histogram (micros): Count: 63611 Average: 2.6447 StdDev: 5.56 Min: 1 Median: 1.7617 Max: 950 Percentiles: P50: 1.76 P75: 2.50 P99: 7.13 P99.9: 13.56 P99.99: 47.93 ------------------------------------------------------ [ 0, 1 ] 2199 3.457% 3.457% # ( 1, 2 ] 38871 61.107% 64.564% ############ ( 2, 3 ] 13405 21.073% 85.638% #### ( 3, 4 ] 4597 7.227% 92.864% # ( 4, 6 ] 3716 5.842% 98.706% # ( 6, 10 ] 659 1.036% 99.742% ( 10, 15 ] 141 0.222% 99.964% ( 15, 22 ] 14 0.022% 99.986% ( 22, 34 ] 1 0.002% 99.987% ( 34, 51 ] 2 0.003% 99.991% ( 170, 250 ] 1 0.002% 99.992% ( 250, 380 ] 1 0.002% 99.994% ( 380, 580 ] 2 0.003% 99.997% ( 580, 870 ] 1 0.002% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 87442 Average: 2.8973 StdDev: 24.91 Min: 0 Median: 1.5228 Max: 4082 Percentiles: P50: 1.52 P75: 1.92 P99: 7.28 P99.9: 207.25 P99.99: 500.51 ------------------------------------------------------ [ 0, 1 ] 15291 17.487% 17.487% ### ( 1, 2 ] 54381 62.191% 79.678% ############ ( 2, 3 ] 10639 12.167% 91.845% ## ( 3, 4 ] 3318 3.795% 95.639% # ( 4, 6 ] 2671 3.055% 98.694% # ( 6, 10 ] 839 0.959% 99.653% ( 10, 15 ] 98 0.112% 99.766% ( 15, 22 ] 17 0.019% 99.785% ( 22, 34 ] 2 0.002% 99.787% ( 34, 51 ] 6 0.007% 99.794% ( 51, 76 ] 23 0.026% 99.820% ( 76, 110 ] 12 0.014% 99.834% ( 110, 170 ] 38 0.043% 99.878% ( 170, 250 ] 42 0.048% 99.926% ( 250, 380 ] 43 0.049% 99.975% ( 380, 580 ] 22 0.025% 100.000% ( 580, 870 ] 11 0.013% 100.013% ( 870, 1300 ] 4 0.005% 100.017% ( 1300, 1900 ] 1 0.001% 100.018% ( 2900, 4400 ] 2 0.002% 100.021% ** Level 3 read latency histogram (micros): Count: 258623 Average: 3.6985 StdDev: 52.26 Min: 0 Median: 1.6892 Max: 9844 Percentiles: P50: 1.69 P75: 2.29 P99: 8.97 P99.9: 212.05 P99.99: 721.82 ------------------------------------------------------ [ 0, 1 ] 17085 6.606% 6.606% # ( 1, 2 ] 162831 62.961% 69.567% ############# ( 2, 3 ] 48478 18.745% 88.312% #### ( 3, 4 ] 13444 5.198% 93.510% # ( 4, 6 ] 10740 4.153% 97.663% # ( 6, 10 ] 4656 1.800% 99.463% ( 10, 15 ] 561 0.217% 99.680% ( 15, 22 ] 55 0.021% 99.701% ( 22, 34 ] 8 0.003% 99.704% ( 34, 51 ] 2 0.001% 99.705% ( 51, 76 ] 5 0.002% 99.707% ( 76, 110 ] 102 0.039% 99.746% ( 110, 170 ] 318 0.123% 99.869% ( 170, 250 ] 151 0.058% 99.928% ( 250, 380 ] 81 0.031% 99.959% ( 380, 580 ] 64 0.025% 99.984% ( 580, 870 ] 33 0.013% 99.997% ( 870, 1300 ] 10 0.004% 100.000% ( 1300, 1900 ] 8 0.003% 100.003% ( 1900, 2900 ] 14 0.005% 100.009% ( 2900, 4400 ] 10 0.004% 100.013% ( 4400, 6600 ] 5 0.002% 100.015% ( 6600, 9900 ] 4 0.002% 100.016% ** Level 4 read latency histogram (micros): Count: 55 Average: 1117.5818 StdDev: 1946.61 Min: 0 Median: 18.5000 Max: 9102 Percentiles: P50: 18.50 P75: 2056.25 P99: 8992.50 P99.9: 9102.00 P99.99: 9102.00 ------------------------------------------------------ [ 0, 1 ] 8 14.545% 14.545% ### ( 1, 2 ] 10 18.182% 32.727% #### ( 3, 4 ] 1 1.818% 34.545% ( 4, 6 ] 1 1.818% 36.364% ( 6, 10 ] 2 3.636% 40.000% # ( 10, 15 ] 5 9.091% 49.091% ## ( 15, 22 ] 1 1.818% 50.909% ( 110, 170 ] 3 5.455% 56.364% # ( 170, 250 ] 3 5.455% 61.818% # ( 250, 380 ] 1 1.818% 63.636% ( 380, 580 ] 2 3.636% 67.273% # ( 580, 870 ] 2 3.636% 70.909% # ( 1300, 1900 ] 1 1.818% 72.727% ( 1900, 2900 ] 8 14.545% 87.273% ### ( 2900, 4400 ] 2 3.636% 90.909% # ( 4400, 6600 ] 3 5.455% 96.364% # ( 6600, 9900 ] 2 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 1175.7500 StdDev: 1009.32 Min: 187 Median: 725.0000 Max: 3829 Percentiles: P50: 725.00 P75: 1700.00 P99: 3829.00 P99.9: 3829.00 P99.99: 3829.00 ------------------------------------------------------ ( 170, 250 ] 2 10.000% 10.000% ## ( 250, 380 ] 1 5.000% 15.000% # ( 380, 580 ] 6 30.000% 45.000% ###### ( 580, 870 ] 2 10.000% 55.000% ## ( 870, 1300 ] 2 10.000% 65.000% ## ( 1300, 1900 ] 3 15.000% 80.000% ### ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.0 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 328.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.134 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 343.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.261 H:M:S, 9.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/15-09:14:44 ... thread 0: (1000000,4000000) ops and (309887.5,330583.1) ops/second in (3.226978,12.099832) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.14 GB 193.9 2.5 0.0 2.5 6.3 3.7 0.0 1.7 122.9 305.0 20.98 19.46 62 0.338 2618K 14K 0.0 0.0 L1 6/0 646.08 MB 64.6 1.4 1.4 0.0 1.4 1.4 0.1 1.0 227.0 222.2 6.35 5.98 2 3.176 1464K 30K 0.0 0.0 L2 1/1 128.78 MB 0.0 0.3 0.1 0.2 0.3 0.1 0.7 2.3 246.5 245.7 1.26 1.20 3 0.420 315K 923 0.0 0.0 L3 17/2 1.06 GB 0.9 1.8 0.8 1.0 1.8 0.8 0.0 2.3 221.5 218.8 8.45 7.85 6 1.408 1901K 22K 0.0 0.0 L4 122/0 9.73 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 179.7 179.7 0.32 0.28 1 0.323 58K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 270/7 22.85 GB 0.0 6.1 2.4 3.7 9.8 6.1 1.7 2.6 167.5 268.4 37.37 34.76 74 0.505 6358K 68K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 2.4 3.7 9.8 6.1 1.7 2.6 167.5 268.4 37.37 34.76 74 0.505 6358K 68K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 2.4 3.7 6.0 2.3 0.0 0.0 237.5 234.9 26.37 25.00 21 1.256 6358K 68K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 348.7 11.00 9.76 53 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.1 interval Flush(GB): cumulative 3.746, interval 3.746 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.79 GB write, 820.61 MB/s write, 6.11 GB read, 512.30 MB/s read, 37.4 seconds Interval compaction: 9.79 GB write, 828.58 MB/s write, 6.11 GB read, 517.27 MB/s read, 37.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1104998 Average: 2.6578 StdDev: 15.00 Min: 1 Median: 1.6163 Max: 3032 Percentiles: P50: 1.62 P75: 2.01 P99: 6.20 P99.9: 14.19 P99.99: 222.66 ------------------------------------------------------ [ 0, 1 ] 112242 10.158% 10.158% ## ( 1, 2 ] 714387 64.651% 74.808% ############# ( 2, 3 ] 183794 16.633% 91.441% ### ( 3, 4 ] 46575 4.215% 95.656% # ( 4, 6 ] 36471 3.301% 98.957% # ( 6, 10 ] 9627 0.871% 99.828% ( 10, 15 ] 950 0.086% 99.914% ( 15, 22 ] 102 0.009% 99.923% ( 22, 34 ] 23 0.002% 99.925% ( 34, 51 ] 7 0.001% 99.926% ( 51, 76 ] 9 0.001% 99.927% ( 76, 110 ] 146 0.013% 99.940% ( 110, 170 ] 411 0.037% 99.977% ( 170, 250 ] 218 0.020% 99.997% ( 250, 380 ] 149 0.013% 100.010% ( 380, 580 ] 153 0.014% 100.024% ( 580, 870 ] 81 0.007% 100.031% ( 870, 1300 ] 35 0.003% 100.035% ( 1300, 1900 ] 15 0.001% 100.036% ( 1900, 2900 ] 11 0.001% 100.037% ( 2900, 4400 ] 2 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 161720 Average: 2.9996 StdDev: 16.66 Min: 1 Median: 1.7839 Max: 2665 Percentiles: P50: 1.78 P75: 2.51 P99: 8.22 P99.9: 92.87 P99.99: 441.35 ------------------------------------------------------ [ 0, 1 ] 4578 2.831% 2.831% # ( 1, 2 ] 97310 60.172% 63.003% ############ ( 2, 3 ] 38222 23.635% 86.637% ##### ( 3, 4 ] 9823 6.074% 92.711% # ( 4, 6 ] 8799 5.441% 98.152% # ( 6, 10 ] 2470 1.527% 99.680% ( 10, 15 ] 296 0.183% 99.863% ( 15, 22 ] 27 0.017% 99.879% ( 22, 34 ] 1 0.001% 99.880% ( 34, 51 ] 3 0.002% 99.882% ( 76, 110 ] 59 0.036% 99.918% ( 110, 170 ] 57 0.035% 99.954% ( 170, 250 ] 25 0.015% 99.969% ( 250, 380 ] 28 0.017% 99.986% ( 380, 580 ] 19 0.012% 99.998% ( 580, 870 ] 10 0.006% 100.004% ( 870, 1300 ] 6 0.004% 100.008% ( 1300, 1900 ] 5 0.003% 100.011% ( 1900, 2900 ] 2 0.001% 100.012% ** Level 2 read latency histogram (micros): Count: 87442 Average: 2.8973 StdDev: 24.91 Min: 0 Median: 1.5228 Max: 4082 Percentiles: P50: 1.52 P75: 1.92 P99: 7.28 P99.9: 207.25 P99.99: 500.51 ------------------------------------------------------ [ 0, 1 ] 15291 17.487% 17.487% ### ( 1, 2 ] 54381 62.191% 79.678% ############ ( 2, 3 ] 10639 12.167% 91.845% ## ( 3, 4 ] 3318 3.795% 95.639% # ( 4, 6 ] 2671 3.055% 98.694% # ( 6, 10 ] 839 0.959% 99.653% ( 10, 15 ] 98 0.112% 99.766% ( 15, 22 ] 17 0.019% 99.785% ( 22, 34 ] 2 0.002% 99.787% ( 34, 51 ] 6 0.007% 99.794% ( 51, 76 ] 23 0.026% 99.820% ( 76, 110 ] 12 0.014% 99.834% ( 110, 170 ] 38 0.043% 99.878% ( 170, 250 ] 42 0.048% 99.926% ( 250, 380 ] 43 0.049% 99.975% ( 380, 580 ] 22 0.025% 100.000% ( 580, 870 ] 11 0.013% 100.013% ( 870, 1300 ] 4 0.005% 100.017% ( 1300, 1900 ] 1 0.001% 100.018% ( 2900, 4400 ] 2 0.002% 100.021% ** Level 3 read latency histogram (micros): Count: 296296 Average: 3.6625 StdDev: 49.19 Min: 0 Median: 1.7046 Max: 9844 Percentiles: P50: 1.70 P75: 2.34 P99: 9.02 P99.9: 208.48 P99.99: 702.57 ------------------------------------------------------ [ 0, 1 ] 18465 6.232% 6.232% # ( 1, 2 ] 184054 62.118% 68.350% ############ ( 2, 3 ] 57975 19.567% 87.917% #### ( 3, 4 ] 15939 5.379% 93.296% # ( 4, 6 ] 12822 4.327% 97.624% # ( 6, 10 ] 5398 1.822% 99.445% ( 10, 15 ] 661 0.223% 99.669% ( 15, 22 ] 70 0.024% 99.692% ( 22, 34 ] 11 0.004% 99.696% ( 34, 51 ] 4 0.001% 99.697% ( 51, 76 ] 9 0.003% 99.700% ( 76, 110 ] 119 0.040% 99.740% ( 110, 170 ] 390 0.132% 99.872% ( 170, 250 ] 174 0.059% 99.931% ( 250, 380 ] 93 0.031% 99.962% ( 380, 580 ] 69 0.023% 99.985% ( 580, 870 ] 34 0.011% 99.997% ( 870, 1300 ] 13 0.004% 100.001% ( 1300, 1900 ] 9 0.003% 100.004% ( 1900, 2900 ] 14 0.005% 100.009% ( 2900, 4400 ] 10 0.003% 100.012% ( 4400, 6600 ] 5 0.002% 100.014% ( 6600, 9900 ] 4 0.001% 100.016% ** Level 4 read latency histogram (micros): Count: 55 Average: 1117.5818 StdDev: 1946.61 Min: 0 Median: 18.5000 Max: 9102 Percentiles: P50: 18.50 P75: 2056.25 P99: 8992.50 P99.9: 9102.00 P99.99: 9102.00 ------------------------------------------------------ [ 0, 1 ] 8 14.545% 14.545% ### ( 1, 2 ] 10 18.182% 32.727% #### ( 3, 4 ] 1 1.818% 34.545% ( 4, 6 ] 1 1.818% 36.364% ( 6, 10 ] 2 3.636% 40.000% # ( 10, 15 ] 5 9.091% 49.091% ## ( 15, 22 ] 1 1.818% 50.909% ( 110, 170 ] 3 5.455% 56.364% # ( 170, 250 ] 3 5.455% 61.818% # ( 250, 380 ] 1 1.818% 63.636% ( 380, 580 ] 2 3.636% 67.273% # ( 580, 870 ] 2 3.636% 70.909% # ( 1300, 1900 ] 1 1.818% 72.727% ( 1900, 2900 ] 8 14.545% 87.273% ### ( 2900, 4400 ] 2 3.636% 90.909% # ( 4400, 6600 ] 3 5.455% 96.364% # ( 6600, 9900 ] 2 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 1175.7500 StdDev: 1009.32 Min: 187 Median: 725.0000 Max: 3829 Percentiles: P50: 725.00 P75: 1700.00 P99: 3829.00 P99.9: 3829.00 P99.99: 3829.00 ------------------------------------------------------ ( 170, 250 ] 2 10.000% 10.000% ## ( 250, 380 ] 1 5.000% 15.000% # ( 380, 580 ] 6 30.000% 45.000% ###### ( 580, 870 ] 2 10.000% 55.000% ## ( 870, 1300 ] 2 10.000% 65.000% ## ( 1300, 1900 ] 3 15.000% 80.000% ### ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.2 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 322.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.765 H:M:S, 14.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 304.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.631 H:M:S, 19.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-09:14:47 ... thread 0: (1000000,5000000) ops and (341508.6,332711.9) ops/second in (2.928184,15.028016) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 3.12 GB 68.8 3.3 0.0 3.3 8.0 4.6 0.0 1.7 126.9 304.7 26.77 24.90 78 0.343 3448K 18K 0.0 0.0 L1 6/6 646.08 MB 0.0 1.4 1.4 0.0 1.4 1.4 0.1 1.0 227.0 222.2 6.35 5.98 2 3.176 1464K 30K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.7 2.3 246.5 245.7 1.26 1.20 3 0.420 315K 923 0.0 0.0 L3 15/0 937.00 MB 0.9 2.1 0.9 1.2 2.1 0.9 0.0 2.3 222.7 220.2 9.86 9.21 7 1.408 2229K 24K 0.0 0.0 L4 121/0 9.68 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 179.7 179.7 0.32 0.28 1 0.323 58K 0 0.0 0.0 L5 116/0 9.47 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 275/20 23.82 GB 0.0 7.2 2.5 4.7 11.8 7.1 2.2 2.5 166.1 271.7 44.56 41.56 91 0.490 7516K 74K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.2 2.5 4.7 11.8 7.1 2.2 2.5 166.1 271.7 44.56 41.56 91 0.490 7516K 74K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.2 2.5 4.7 7.2 2.4 0.0 0.0 239.7 237.2 30.88 29.42 25 1.235 7516K 74K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 349.5 13.67 12.14 66 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.1 total, 15.0 interval Flush(GB): cumulative 4.667, interval 4.667 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.82 GB write, 799.16 MB/s write, 7.23 GB read, 488.58 MB/s read, 44.6 seconds Interval compaction: 11.82 GB write, 805.42 MB/s write, 7.23 GB read, 492.41 MB/s read, 44.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 23, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1416187 Average: 2.6909 StdDev: 16.08 Min: 1 Median: 1.6186 Max: 3626 Percentiles: P50: 1.62 P75: 2.01 P99: 6.37 P99.9: 19.71 P99.99: 219.73 ------------------------------------------------------ [ 0, 1 ] 139265 9.834% 9.834% ## ( 1, 2 ] 919562 64.932% 74.766% ############# ( 2, 3 ] 237698 16.784% 91.550% ### ( 3, 4 ] 58614 4.139% 95.689% # ( 4, 6 ] 45742 3.230% 98.919% # ( 6, 10 ] 12509 0.883% 99.802% ( 10, 15 ] 1296 0.092% 99.894% ( 15, 22 ] 129 0.009% 99.903% ( 22, 34 ] 25 0.002% 99.905% ( 34, 51 ] 9 0.001% 99.906% ( 51, 76 ] 16 0.001% 99.907% ( 76, 110 ] 315 0.022% 99.929% ( 110, 170 ] 684 0.048% 99.977% ( 170, 250 ] 295 0.021% 99.998% ( 250, 380 ] 190 0.013% 100.011% ( 380, 580 ] 194 0.014% 100.025% ( 580, 870 ] 101 0.007% 100.032% ( 870, 1300 ] 41 0.003% 100.035% ( 1300, 1900 ] 20 0.001% 100.037% ( 1900, 2900 ] 15 0.001% 100.038% ( 2900, 4400 ] 6 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 194424 Average: 2.9552 StdDev: 15.86 Min: 1 Median: 1.7490 Max: 2665 Percentiles: P50: 1.75 P75: 2.43 P99: 8.28 P99.9: 115.99 P99.99: 448.71 ------------------------------------------------------ [ 0, 1 ] 7733 3.977% 3.977% # ( 1, 2 ] 119464 61.445% 65.422% ############ ( 2, 3 ] 43412 22.329% 87.751% #### ( 3, 4 ] 10616 5.460% 93.211% # ( 4, 6 ] 9504 4.888% 98.100% # ( 6, 10 ] 3077 1.583% 99.682% ( 10, 15 ] 321 0.165% 99.847% ( 15, 22 ] 28 0.014% 99.862% ( 22, 34 ] 1 0.001% 99.862% ( 34, 51 ] 3 0.002% 99.864% ( 51, 76 ] 1 0.001% 99.864% ( 76, 110 ] 59 0.030% 99.895% ( 110, 170 ] 106 0.055% 99.949% ( 170, 250 ] 38 0.020% 99.969% ( 250, 380 ] 34 0.017% 99.986% ( 380, 580 ] 22 0.011% 99.997% ( 580, 870 ] 12 0.006% 100.004% ( 870, 1300 ] 6 0.003% 100.007% ( 1300, 1900 ] 5 0.003% 100.009% ( 1900, 2900 ] 2 0.001% 100.010% ** Level 2 read latency histogram (micros): Count: 87442 Average: 2.8973 StdDev: 24.91 Min: 0 Median: 1.5228 Max: 4082 Percentiles: P50: 1.52 P75: 1.92 P99: 7.28 P99.9: 207.25 P99.99: 500.51 ------------------------------------------------------ [ 0, 1 ] 15291 17.487% 17.487% ### ( 1, 2 ] 54381 62.191% 79.678% ############ ( 2, 3 ] 10639 12.167% 91.845% ## ( 3, 4 ] 3318 3.795% 95.639% # ( 4, 6 ] 2671 3.055% 98.694% # ( 6, 10 ] 839 0.959% 99.653% ( 10, 15 ] 98 0.112% 99.766% ( 15, 22 ] 17 0.019% 99.785% ( 22, 34 ] 2 0.002% 99.787% ( 34, 51 ] 6 0.007% 99.794% ( 51, 76 ] 23 0.026% 99.820% ( 76, 110 ] 12 0.014% 99.834% ( 110, 170 ] 38 0.043% 99.878% ( 170, 250 ] 42 0.048% 99.926% ( 250, 380 ] 43 0.049% 99.975% ( 380, 580 ] 22 0.025% 100.000% ( 580, 870 ] 11 0.013% 100.013% ( 870, 1300 ] 4 0.005% 100.017% ( 1300, 1900 ] 1 0.001% 100.018% ( 2900, 4400 ] 2 0.002% 100.021% ** Level 3 read latency histogram (micros): Count: 337259 Average: 3.5088 StdDev: 46.24 Min: 0 Median: 1.6950 Max: 9844 Percentiles: P50: 1.69 P75: 2.30 P99: 8.76 P99.9: 192.41 P99.99: 689.99 ------------------------------------------------------ [ 0, 1 ] 21515 6.379% 6.379% # ( 1, 2 ] 211690 62.768% 69.147% ############# ( 2, 3 ] 65406 19.393% 88.541% #### ( 3, 4 ] 17402 5.160% 93.700% # ( 4, 6 ] 14059 4.169% 97.869% # ( 6, 10 ] 5532 1.640% 99.509% ( 10, 15 ] 666 0.197% 99.707% ( 15, 22 ] 70 0.021% 99.728% ( 22, 34 ] 11 0.003% 99.731% ( 34, 51 ] 4 0.001% 99.732% ( 51, 76 ] 9 0.003% 99.735% ( 76, 110 ] 119 0.035% 99.770% ( 110, 170 ] 390 0.116% 99.886% ( 170, 250 ] 174 0.052% 99.937% ( 250, 380 ] 96 0.028% 99.966% ( 380, 580 ] 69 0.020% 99.986% ( 580, 870 ] 35 0.010% 99.996% ( 870, 1300 ] 15 0.004% 100.001% ( 1300, 1900 ] 9 0.003% 100.004% ( 1900, 2900 ] 14 0.004% 100.008% ( 2900, 4400 ] 10 0.003% 100.011% ( 4400, 6600 ] 5 0.001% 100.012% ( 6600, 9900 ] 4 0.001% 100.013% ** Level 4 read latency histogram (micros): Count: 55 Average: 1117.5818 StdDev: 1946.61 Min: 0 Median: 18.5000 Max: 9102 Percentiles: P50: 18.50 P75: 2056.25 P99: 8992.50 P99.9: 9102.00 P99.99: 9102.00 ------------------------------------------------------ [ 0, 1 ] 8 14.545% 14.545% ### ( 1, 2 ] 10 18.182% 32.727% #### ( 3, 4 ] 1 1.818% 34.545% ( 4, 6 ] 1 1.818% 36.364% ( 6, 10 ] 2 3.636% 40.000% # ( 10, 15 ] 5 9.091% 49.091% ## ( 15, 22 ] 1 1.818% 50.909% ( 110, 170 ] 3 5.455% 56.364% # ( 170, 250 ] 3 5.455% 61.818% # ( 250, 380 ] 1 1.818% 63.636% ( 380, 580 ] 2 3.636% 67.273% # ( 580, 870 ] 2 3.636% 70.909% # ( 1300, 1900 ] 1 1.818% 72.727% ( 1900, 2900 ] 8 14.545% 87.273% ### ( 2900, 4400 ] 2 3.636% 90.909% # ( 4400, 6600 ] 3 5.455% 96.364% # ( 6600, 9900 ] 2 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 1082.2750 StdDev: 1112.33 Min: 100 Median: 638.0000 Max: 4753 Percentiles: P50: 638.00 P75: 1600.00 P99: 4753.00 P99.9: 4753.00 P99.99: 4753.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 6 15.000% 20.000% ### ( 170, 250 ] 3 7.500% 27.500% ## ( 250, 380 ] 2 5.000% 32.500% # ( 380, 580 ] 6 15.000% 47.500% ### ( 580, 870 ] 5 12.500% 60.000% ### ( 870, 1300 ] 4 10.000% 70.000% ## ( 1300, 1900 ] 4 10.000% 80.000% ## ( 1900, 2900 ] 5 12.500% 92.500% ### ( 2900, 4400 ] 2 5.000% 97.500% # ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 15.1 total, 2.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 324.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.150 H:M:S, 14.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 336.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.385 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.463 micros/op 288788 ops/sec 20.042 seconds 5787999 operations; 279.8 MB/s Microseconds per write: Count: 5787999 Average: 3.4628 StdDev: 284.45 Min: 0 Median: 1.6954 Max: 229114 Percentiles: P50: 1.70 P75: 2.58 P99: 5.90 P99.9: 92.19 P99.99: 2090.76 ------------------------------------------------------ [ 0, 1 ] 879770 15.200% 15.200% ### ( 1, 2 ] 2896634 50.046% 65.245% ########## ( 2, 3 ] 979375 16.921% 82.166% ### ( 3, 4 ] 753327 13.015% 95.182% ### ( 4, 6 ] 233133 4.028% 99.209% # ( 6, 10 ] 27757 0.480% 99.689% ( 10, 15 ] 6649 0.115% 99.804% ( 15, 22 ] 2848 0.049% 99.853% ( 22, 34 ] 563 0.010% 99.863% ( 34, 51 ] 85 0.001% 99.864% ( 51, 76 ] 7 0.000% 99.864% ( 76, 110 ] 4332 0.075% 99.939% ( 110, 170 ] 1362 0.024% 99.963% ( 170, 250 ] 156 0.003% 99.965% ( 250, 380 ] 14 0.000% 99.966% ( 380, 580 ] 2 0.000% 99.966% ( 580, 870 ] 5 0.000% 99.966% ( 870, 1300 ] 1267 0.022% 99.988% ( 1300, 1900 ] 2 0.000% 99.988% ( 1900, 2900 ] 693 0.012% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 4 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 10 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 187378 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5787999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5973214968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 177 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5164158 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10818710448 rocksdb.compact.write.bytes COUNT : 10633678532 rocksdb.flush.write.bytes COUNT : 5934778628 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 17 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 87 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5897275392 rocksdb.memtable.garbage.bytes.at.flush COUNT : 11814912 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 10867482392 rocksdb.non.last.level.read.count COUNT : 2624192 rocksdb.block.checksum.compute.count COUNT : 2623855 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.322849 P95 : 3.657717 P99 : 5.549507 P100 : 229110.000000 COUNT : 5787999 SUM : 17498174 rocksdb.compaction.times.micros P50 : 1043076.923077 P95 : 3740000.000000 P99 : 5369014.000000 P100 : 5369014.000000 COUNT : 28 SUM : 33668250 rocksdb.compaction.times.cpu_micros P50 : 1005714.285714 P95 : 3740000.000000 P99 : 5020757.000000 P100 : 5020757.000000 COUNT : 28 SUM : 32156983 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 751.363636 P95 : 1647.142857 P99 : 2110.000000 P100 : 2119.000000 COUNT : 79 SUM : 64654 rocksdb.compaction.outfile.sync.micros P50 : 816.413043 P95 : 1430.000000 P99 : 2280.000000 P100 : 2280.000000 COUNT : 87 SUM : 75979 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 93.894737 P95 : 318.250000 P99 : 548.000000 P100 : 597.000000 COUNT : 116 SUM : 13919 rocksdb.table.open.io.micros P50 : 1503.571429 P95 : 13128.750000 P99 : 17407.000000 P100 : 17407.000000 COUNT : 177 SUM : 496059 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.660078 P95 : 6.717691 P99 : 9.864590 P100 : 3072.000000 COUNT : 2623687 SUM : 12542798 rocksdb.read.block.get.micros P50 : 550.000000 P95 : 4215.909091 P99 : 8223.600000 P100 : 10145.000000 COUNT : 354 SUM : 405216 rocksdb.write.raw.block.micros P50 : 0.510317 P95 : 0.969602 P99 : 2.648928 P100 : 4271.000000 COUNT : 4014442 SUM : 7317916 rocksdb.numfiles.in.singlecompaction P50 : 3.250000 P95 : 10.500000 P99 : 16.000000 P100 : 16.000000 COUNT : 38 SUM : 152 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.555305 P95 : 1203.334779 P99 : 2637.070707 P100 : 228885.000000 COUNT : 19921 SUM : 5164924 rocksdb.sst.read.micros P50 : 1.619160 P95 : 3.895444 P99 : 7.382909 P100 : 9844.000000 COUNT : 2624796 SUM : 7449620 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5787999 SUM : 5973214968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214516.129032 P95 : 337208.333333 P99 : 371441.666667 P100 : 376313.000000 COUNT : 79 SUM : 16228675 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 111 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0