[2024-12-14 21:11:20.621656] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-14 21:11:20.621803] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1996600 ] Set seed to 1734207080618160 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-14 21:11:20.727709] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-14 21:11:20.934654] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-14 21:11:20.934724] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1996600' to capture a snapshot of events at runtime. [2024-12-14 21:11:20.934735] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1996600 for offline analysis/debug. [2024-12-14 21:11:20.934759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 14 21:11:29 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/14-21:11:38 ... thread 0: (1000000,1000000) ops and (108438.8,108438.8) ops/second in (9.221790,9.221790) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.60 GB 88.1 0.9 0.0 0.9 1.7 0.9 0.0 2.0 107.9 215.7 8.17 5.88 15 0.545 895K 1001 0.0 0.0 L1 11/11 1.09 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 64.14 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 20/0 973.22 MB 1.0 1.3 0.5 0.8 1.3 0.5 0.0 2.4 99.6 98.2 13.43 6.76 8 1.679 0 0 0.0 0.0 L4 158/0 9.73 GB 1.0 2.8 1.5 1.3 2.8 1.5 0.0 1.8 117.5 116.5 24.42 15.01 16 1.527 1254K 0 0.0 0.0 L5 1112/0 91.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1320/26 106.91 GB 0.0 5.0 2.1 2.9 5.8 2.9 1.4 6.7 110.6 128.8 46.03 27.66 39 1.180 2150K 1001 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 2.1 2.9 5.8 2.9 1.4 6.7 110.6 128.8 46.03 27.66 39 1.180 2150K 1001 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 2.1 2.9 4.9 2.0 0.0 0.0 123.5 122.4 41.21 25.05 27 1.526 2150K 1001 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 183.1 4.82 2.61 12 0.401 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.4 total, 9.2 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.79 GB write, 630.27 MB/s write, 4.97 GB read, 541.29 MB/s read, 46.0 seconds Interval compaction: 5.79 GB write, 642.69 MB/s write, 4.97 GB read, 551.95 MB/s read, 46.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 6, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 313618 Average: 36.0223 StdDev: 330.44 Min: 1 Median: 1.6277 Max: 71195 Percentiles: P50: 1.63 P75: 2.44 P99: 543.76 P99.9: 2805.96 P99.99: 4379.67 ------------------------------------------------------ [ 0, 1 ] 50635 16.145% 16.145% ### ( 1, 2 ] 169159 53.938% 70.083% ########### ( 2, 3 ] 35431 11.298% 81.381% ## ( 3, 4 ] 12213 3.894% 85.275% # ( 4, 6 ] 11932 3.805% 89.080% # ( 6, 10 ] 2519 0.803% 89.883% ( 10, 15 ] 596 0.190% 90.073% ( 15, 22 ] 74 0.024% 90.097% ( 22, 34 ] 3 0.001% 90.098% ( 34, 51 ] 2 0.001% 90.098% ( 51, 76 ] 1 0.000% 90.098% ( 76, 110 ] 1353 0.431% 90.530% ( 110, 170 ] 14651 4.672% 95.201% # ( 170, 250 ] 8661 2.762% 97.963% # ( 250, 380 ] 2013 0.642% 98.605% ( 380, 580 ] 1513 0.482% 99.087% ( 580, 870 ] 982 0.313% 99.401% ( 870, 1300 ] 701 0.224% 99.624% ( 1300, 1900 ] 503 0.160% 99.784% ( 1900, 2900 ] 400 0.128% 99.912% ( 2900, 4400 ] 248 0.079% 99.991% ( 4400, 6600 ] 77 0.025% 100.016% ( 6600, 9900 ] 25 0.008% 100.024% ( 9900, 14000 ] 16 0.005% 100.029% ( 14000, 22000 ] 6 0.002% 100.031% ( 22000, 33000 ] 11 0.004% 100.034% ( 33000, 50000 ] 4 0.001% 100.035% ( 50000, 75000 ] 1 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 811 Average: 448.4217 StdDev: 1653.73 Min: 87 Median: 165.0758 Max: 39480 Percentiles: P50: 165.08 P75: 237.43 P99: 5459.67 P99.9: 36213.00 P99.99: 39480.00 ------------------------------------------------------ ( 76, 110 ] 42 5.179% 5.179% # ( 110, 170 ] 396 48.829% 54.007% ########## ( 170, 250 ] 202 24.908% 78.915% ##### ( 250, 380 ] 49 6.042% 84.957% # ( 380, 580 ] 39 4.809% 89.766% # ( 580, 870 ] 22 2.713% 92.478% # ( 870, 1300 ] 13 1.603% 94.081% ( 1300, 1900 ] 14 1.726% 95.808% ( 1900, 2900 ] 12 1.480% 97.287% ( 2900, 4400 ] 11 1.356% 98.644% ( 4400, 6600 ] 6 0.740% 99.383% ( 6600, 9900 ] 3 0.370% 99.753% ( 9900, 14000 ] 1 0.123% 99.877% ( 33000, 50000 ] 1 0.123% 100.000% ** Level 2 read latency histogram (micros): Count: 52 Average: 451.7692 StdDev: 596.84 Min: 103 Median: 203.3333 Max: 2813 Percentiles: P50: 203.33 P75: 513.33 P99: 2726.67 P99.9: 2813.00 P99.99: 2813.00 ------------------------------------------------------ ( 76, 110 ] 3 5.769% 5.769% # ( 110, 170 ] 18 34.615% 40.385% ####### ( 170, 250 ] 12 23.077% 63.462% ##### ( 250, 380 ] 4 7.692% 71.154% ## ( 380, 580 ] 3 5.769% 76.923% # ( 580, 870 ] 6 11.538% 88.462% ## ( 870, 1300 ] 1 1.923% 90.385% ( 1300, 1900 ] 2 3.846% 94.231% # ( 1900, 2900 ] 3 5.769% 100.000% # ** Level 3 read latency histogram (micros): Count: 383137 Average: 5.4797 StdDev: 86.35 Min: 0 Median: 1.8969 Max: 24528 Percentiles: P50: 1.90 P75: 2.89 P99: 9.08 P99.9: 113.70 P99.99: 163.08 ------------------------------------------------------ [ 0, 1 ] 15648 4.084% 4.084% # ( 1, 2 ] 196134 51.192% 55.276% ########## ( 2, 3 ] 85147 22.224% 77.499% #### ( 3, 4 ] 35966 9.387% 86.887% ## ( 4, 6 ] 40769 10.641% 97.528% ## ( 6, 10 ] 7316 1.909% 99.437% ( 10, 15 ] 1460 0.381% 99.818% ( 15, 22 ] 198 0.052% 99.870% ( 22, 34 ] 15 0.004% 99.874% ( 34, 51 ] 24 0.006% 99.880% ( 51, 76 ] 6 0.002% 99.882% ( 76, 110 ] 45 0.012% 99.893% ( 110, 170 ] 419 0.109% 100.003% ( 170, 250 ] 269 0.070% 100.073% ( 250, 380 ] 80 0.021% 100.094% ( 380, 580 ] 98 0.026% 100.119% ( 580, 870 ] 60 0.016% 100.135% ( 870, 1300 ] 53 0.014% 100.149% ( 1300, 1900 ] 83 0.022% 100.170% ( 1900, 2900 ] 104 0.027% 100.198% ( 2900, 4400 ] 60 0.016% 100.213% ( 4400, 6600 ] 16 0.004% 100.217% ( 6600, 9900 ] 3 0.001% 100.218% ( 22000, 33000 ] 1 0.000% 100.218% ** Level 4 read latency histogram (micros): Count: 325622 Average: 30.0064 StdDev: 367.76 Min: 1 Median: 1.8579 Max: 47973 Percentiles: P50: 1.86 P75: 2.83 P99: 522.34 P99.9: 3032.67 P99.99: 4131.64 ------------------------------------------------------ [ 0, 1 ] 15232 4.678% 4.678% # ( 1, 2 ] 172015 52.827% 57.504% ########### ( 2, 3 ] 68767 21.119% 78.623% #### ( 3, 4 ] 24878 7.640% 86.263% ## ( 4, 6 ] 26122 8.022% 94.285% ## ( 6, 10 ] 7174 2.203% 96.489% ( 10, 15 ] 2053 0.630% 97.119% ( 15, 22 ] 227 0.070% 97.189% ( 22, 34 ] 28 0.009% 97.197% ( 34, 51 ] 11 0.003% 97.201% ( 51, 76 ] 15 0.005% 97.205% ( 76, 110 ] 271 0.083% 97.289% ( 110, 170 ] 2823 0.867% 98.156% ( 170, 250 ] 1774 0.545% 98.700% ( 250, 380 ] 558 0.171% 98.872% ( 380, 580 ] 587 0.180% 99.052% ( 580, 870 ] 612 0.188% 99.240% ( 870, 1300 ] 650 0.200% 99.440% ( 1300, 1900 ] 736 0.226% 99.666% ( 1900, 2900 ] 728 0.224% 99.889% ( 2900, 4400 ] 400 0.123% 100.012% ( 4400, 6600 ] 138 0.042% 100.054% ( 6600, 9900 ] 43 0.013% 100.068% ( 9900, 14000 ] 23 0.007% 100.075% ( 14000, 22000 ] 30 0.009% 100.084% ( 22000, 33000 ] 10 0.003% 100.087% ( 33000, 50000 ] 4 0.001% 100.088% ** Level 5 read latency histogram (micros): Count: 55339 Average: 446.2876 StdDev: 1537.15 Min: 81 Median: 169.7140 Max: 118053 Percentiles: P50: 169.71 P75: 244.12 P99: 5117.22 P99.9: 13022.15 P99.99: 66165.25 ------------------------------------------------------ ( 76, 110 ] 2301 4.158% 4.158% # ( 110, 170 ] 25490 46.062% 50.220% ######### ( 170, 250 ] 14803 26.750% 76.969% ##### ( 250, 380 ] 3436 6.209% 83.178% # ( 380, 580 ] 2722 4.919% 88.097% # ( 580, 870 ] 1732 3.130% 91.227% # ( 870, 1300 ] 1162 2.100% 93.327% ( 1300, 1900 ] 1009 1.823% 95.150% ( 1900, 2900 ] 1006 1.818% 96.968% ( 2900, 4400 ] 945 1.708% 98.675% ( 4400, 6600 ] 554 1.001% 99.677% ( 6600, 9900 ] 114 0.206% 99.883% ( 9900, 14000 ] 14 0.025% 99.908% ( 14000, 22000 ] 17 0.031% 99.939% ( 22000, 33000 ] 16 0.029% 99.967% ( 33000, 50000 ] 7 0.013% 99.980% ( 50000, 75000 ] 10 0.018% 99.998% ( 110000, 170000 ] 2 0.004% 100.002% ** DB Stats ** Uptime(secs): 9.4 total, 9.2 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 104.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.542 H:M:S, 58.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 106.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.542 H:M:S, 60.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 239.152 micros/op 16711 ops/sec 60.140 seconds 1004996 operations; 16.2 MB/s (254999 of 254999 found) Microseconds per read: Count: 1004996 Average: 239.1538 StdDev: 846.00 Min: 2 Median: 200.4431 Max: 222001 Percentiles: P50: 200.44 P75: 240.95 P99: 674.19 P99.9: 7849.00 P99.99: 30464.10 ------------------------------------------------------ ( 1, 2 ] 8 0.001% 0.001% ( 2, 3 ] 36 0.004% 0.004% ( 3, 4 ] 40 0.004% 0.008% ( 4, 6 ] 67 0.007% 0.015% ( 6, 10 ] 346 0.034% 0.049% ( 10, 15 ] 3119 0.310% 0.360% ( 15, 22 ] 3327 0.331% 0.691% ( 22, 34 ] 7937 0.790% 1.481% ( 34, 51 ] 6038 0.601% 2.081% ( 51, 76 ] 381 0.038% 2.119% ( 76, 110 ] 2592 0.258% 2.377% ( 110, 170 ] 289796 28.836% 31.213% ###### ( 170, 250 ] 496168 49.370% 80.583% ########## ( 250, 380 ] 127394 12.676% 93.259% ### ( 380, 580 ] 54818 5.455% 98.714% # ( 580, 870 ] 8864 0.882% 99.596% ( 870, 1300 ] 1571 0.156% 99.752% ( 1300, 1900 ] 488 0.049% 99.800% ( 1900, 2900 ] 410 0.041% 99.841% ( 2900, 4400 ] 287 0.029% 99.870% ( 4400, 6600 ] 195 0.019% 99.889% ( 6600, 9900 ] 288 0.029% 99.918% ( 9900, 14000 ] 234 0.023% 99.941% ( 14000, 22000 ] 363 0.036% 99.977% ( 22000, 33000 ] 167 0.017% 99.994% ( 33000, 50000 ] 39 0.004% 99.998% ( 50000, 75000 ] 7 0.001% 99.998% ( 75000, 110000 ] 7 0.001% 99.999% ( 110000, 170000 ] 5 0.000% 100.000% ( 170000, 250000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 20413517 rocksdb.bloom.filter.full.positive COUNT : 1204321 rocksdb.bloom.filter.full.true.positive COUNT : 1004672 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 324 rocksdb.memtable.miss COUNT : 1004672 rocksdb.l0.hit COUNT : 40807 rocksdb.l1.hit COUNT : 10903 rocksdb.l2andup.hit COUNT : 952962 rocksdb.compaction.key.drop.new COUNT : 67525 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 1464104 rocksdb.number.keys.read COUNT : 1004996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 1510955328 rocksdb.bytes.read COUNT : 1004996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1413 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 53714594 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 8046889560 rocksdb.compact.write.bytes COUNT : 7975345036 rocksdb.flush.write.bytes COUNT : 1453305109 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 40 rocksdb.number.superversion_acquires COUNT : 297 rocksdb.number.superversion_releases COUNT : 281 rocksdb.number.superversion_cleanups COUNT : 74 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 1441570816 rocksdb.memtable.garbage.bytes.at.flush COUNT : 546816 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 12200793476 rocksdb.non.last.level.read.count COUNT : 2801686 rocksdb.block.checksum.compute.count COUNT : 3165213 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 199.481029 P95 : 441.487077 P99 : 672.137595 P100 : 221999.000000 COUNT : 1004996 SUM : 239448028 rocksdb.db.write.micros P50 : 1.650772 P95 : 7.047920 P99 : 2029.866969 P100 : 851867.000000 COUNT : 1464104 SUM : 57883049 rocksdb.compaction.times.micros P50 : 1496153.846154 P95 : 3285000.000000 P99 : 3415531.000000 P100 : 3415531.000000 COUNT : 29 SUM : 45548033 rocksdb.compaction.times.cpu_micros P50 : 945000.000000 P95 : 2450000.000000 P99 : 3384662.000000 P100 : 3384662.000000 COUNT : 29 SUM : 29338933 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 977.500000 P95 : 9900.000000 P99 : 11607.000000 P100 : 11607.000000 COUNT : 20 SUM : 51890 rocksdb.compaction.outfile.sync.micros P50 : 5744.444444 P95 : 150200.000000 P99 : 217457.000000 P100 : 217457.000000 COUNT : 93 SUM : 2281787 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 580.000000 P95 : 8030.000000 P99 : 25405.000000 P100 : 25405.000000 COUNT : 54 SUM : 118313 rocksdb.table.open.io.micros P50 : 9105.078125 P95 : 21052.892562 P99 : 49631.666667 P100 : 193847.000000 COUNT : 1413 SUM : 15559383 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.954909 P95 : 172.673800 P99 : 246.965817 P100 : 71202.000000 COUNT : 1948401 SUM : 71798734 rocksdb.read.block.get.micros P50 : 151.821751 P95 : 244.664260 P99 : 495.705127 P100 : 118158.000000 COUNT : 1215371 SUM : 203002677 rocksdb.write.raw.block.micros P50 : 0.547774 P95 : 1.626635 P99 : 3.758720 P100 : 79988.000000 COUNT : 2283783 SUM : 8623074 rocksdb.numfiles.in.singlecompaction P50 : 2.714286 P95 : 7.200000 P99 : 26.000000 P100 : 26.000000 COUNT : 34 SUM : 133 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.577895 P95 : 2175.190908 P99 : 2757.281351 P100 : 851690.000000 COUNT : 243925 SUM : 53735276 rocksdb.sst.read.micros P50 : 96.138303 P95 : 230.865703 P99 : 388.744775 P100 : 118053.000000 COUNT : 2801702 SUM : 262201667 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1004996 SUM : 1004996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 1464104 SUM : 1510955328 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 227142.857143 P95 : 860000.000000 P99 : 1248277.000000 P100 : 1248277.000000 COUNT : 20 SUM : 6467343 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 91 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0