[2024-11-18 02:41:59.697655] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-18 02:41:59.697797] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid970316 ] Set seed to 1731894119694215 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 02:41:59.798220] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 02:41:59.836011] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 02:41:59.836061] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 970316' to capture a snapshot of events at runtime. [2024-11-18 02:41:59.836073] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid970316 for offline analysis/debug. [2024-11-18 02:41:59.836101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 02:42:04 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-02:42:11 ... thread 0: (1000000,1000000) ops and (127621.7,127621.7) ops/second in (7.835657,7.835657) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.87 GB 63.0 0.5 0.0 0.5 1.4 0.9 0.0 1.6 94.9 260.8 5.31 4.37 16 0.332 511K 468 0.0 0.0 L1 19/19 1.77 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 2/0 98.82 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 11/0 880.84 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 166/0 9.53 GB 1.0 5.1 2.0 3.0 5.0 2.0 0.0 2.5 120.9 119.3 42.85 24.36 21 2.040 433K 2536 0.0 0.0 L5 1120/0 92.15 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1332/29 107.28 GB 0.0 5.6 2.0 3.5 6.3 2.8 2.1 7.4 118.0 134.9 48.16 28.73 37 1.302 945K 3004 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 2.0 3.5 6.3 2.8 2.1 7.4 118.0 134.9 48.16 28.73 37 1.302 945K 3004 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 2.0 3.5 5.5 2.0 0.0 0.0 126.9 125.3 44.79 26.27 23 1.948 945K 3004 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 262.2 3.36 2.46 14 0.240 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.8 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.34 GB write, 814.25 MB/s write, 5.55 GB read, 712.42 MB/s read, 48.2 seconds Interval compaction: 6.34 GB write, 828.88 MB/s write, 5.55 GB read, 725.22 MB/s read, 48.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 20, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 0, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 406475 Average: 11.9643 StdDev: 115.03 Min: 1 Median: 1.6760 Max: 17329 Percentiles: P50: 1.68 P75: 2.51 P99: 222.52 P99.9: 1187.20 P99.99: 2202.36 ------------------------------------------------------ [ 0, 1 ] 56371 13.868% 13.868% ### ( 1, 2 ] 217257 53.449% 67.317% ########### ( 2, 3 ] 61779 15.199% 82.516% ### ( 3, 4 ] 25876 6.366% 88.882% # ( 4, 6 ] 25741 6.333% 95.215% # ( 6, 10 ] 7557 1.859% 97.074% ( 10, 15 ] 1427 0.351% 97.425% ( 15, 22 ] 219 0.054% 97.479% ( 22, 34 ] 37 0.009% 97.488% ( 34, 51 ] 9 0.002% 97.490% ( 51, 76 ] 9 0.002% 97.492% ( 76, 110 ] 963 0.237% 97.729% ( 110, 170 ] 3781 0.930% 98.659% ( 170, 250 ] 2110 0.519% 99.179% ( 250, 380 ] 1118 0.275% 99.454% ( 380, 580 ] 920 0.226% 99.680% ( 580, 870 ] 613 0.151% 99.831% ( 870, 1300 ] 383 0.094% 99.925% ( 1300, 1900 ] 233 0.057% 99.982% ( 1900, 2900 ] 107 0.026% 100.009% ( 2900, 4400 ] 93 0.023% 100.031% ( 4400, 6600 ] 31 0.008% 100.039% ( 6600, 9900 ] 7 0.002% 100.041% ( 9900, 14000 ] 2 0.000% 100.041% ( 14000, 22000 ] 1 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 840 Average: 527.4440 StdDev: 1127.23 Min: 80 Median: 205.8788 Max: 11427 Percentiles: P50: 205.88 P75: 443.74 P99: 7260.00 P99.9: 11427.00 P99.99: 11427.00 ------------------------------------------------------ ( 76, 110 ] 78 9.286% 9.286% ## ( 110, 170 ] 268 31.905% 41.190% ###### ( 170, 250 ] 165 19.643% 60.833% #### ( 250, 380 ] 90 10.714% 71.548% ## ( 380, 580 ] 91 10.833% 82.381% ## ( 580, 870 ] 47 5.595% 87.976% # ( 870, 1300 ] 37 4.405% 92.381% # ( 1300, 1900 ] 17 2.024% 94.405% ( 1900, 2900 ] 22 2.619% 97.024% # ( 2900, 4400 ] 13 1.548% 98.571% ( 4400, 6600 ] 2 0.238% 98.810% ( 6600, 9900 ] 8 0.952% 99.762% ( 9900, 14000 ] 2 0.238% 100.000% ** Level 2 read latency histogram (micros): Count: 26621 Average: 12.5948 StdDev: 150.38 Min: 1 Median: 1.9180 Max: 8223 Percentiles: P50: 1.92 P75: 3.23 P99: 14.58 P99.9: 2189.95 P99.99: 3942.24 ------------------------------------------------------ [ 0, 1 ] 1826 6.859% 6.859% # ( 1, 2 ] 12511 46.997% 53.856% ######### ( 2, 3 ] 4959 18.628% 72.484% #### ( 3, 4 ] 2869 10.777% 83.261% ## ( 4, 6 ] 3168 11.900% 95.162% ## ( 6, 10 ] 854 3.208% 98.370% # ( 10, 15 ] 183 0.687% 99.057% ( 15, 22 ] 24 0.090% 99.147% ( 22, 34 ] 8 0.030% 99.177% ( 34, 51 ] 1 0.004% 99.181% ( 76, 110 ] 6 0.023% 99.204% ( 110, 170 ] 26 0.098% 99.301% ( 170, 250 ] 14 0.053% 99.354% ( 250, 380 ] 22 0.083% 99.437% ( 380, 580 ] 22 0.083% 99.519% ( 580, 870 ] 27 0.101% 99.621% ( 870, 1300 ] 40 0.150% 99.771% ( 1300, 1900 ] 28 0.105% 99.876% ( 1900, 2900 ] 22 0.083% 99.959% ( 2900, 4400 ] 12 0.045% 100.004% ( 4400, 6600 ] 3 0.011% 100.015% ( 6600, 9900 ] 1 0.004% 100.019% ** Level 3 read latency histogram (micros): Count: 297908 Average: 8.2319 StdDev: 102.79 Min: 1 Median: 1.8503 Max: 12267 Percentiles: P50: 1.85 P75: 2.96 P99: 10.72 P99.9: 1012.56 P99.99: 1463.44 ------------------------------------------------------ [ 0, 1 ] 18215 6.114% 6.114% # ( 1, 2 ] 153749 51.610% 57.724% ########## ( 2, 3 ] 53462 17.946% 75.670% #### ( 3, 4 ] 28899 9.701% 85.370% ## ( 4, 6 ] 31242 10.487% 95.857% ## ( 6, 10 ] 9131 3.065% 98.922% # ( 10, 15 ] 1601 0.537% 99.460% ( 15, 22 ] 246 0.083% 99.542% ( 22, 34 ] 38 0.013% 99.555% ( 34, 51 ] 16 0.005% 99.561% ( 51, 76 ] 15 0.005% 99.566% ( 76, 110 ] 45 0.015% 99.581% ( 110, 170 ] 188 0.063% 99.644% ( 170, 250 ] 131 0.044% 99.688% ( 250, 380 ] 118 0.040% 99.727% ( 380, 580 ] 172 0.058% 99.785% ( 580, 870 ] 236 0.079% 99.864% ( 870, 1300 ] 320 0.107% 99.972% ( 1300, 1900 ] 199 0.067% 100.039% ( 1900, 2900 ] 116 0.039% 100.078% ( 2900, 4400 ] 64 0.021% 100.099% ( 4400, 6600 ] 9 0.003% 100.102% ( 6600, 9900 ] 4 0.001% 100.103% ( 9900, 14000 ] 1 0.000% 100.104% ** Level 4 read latency histogram (micros): Count: 706126 Average: 16.5044 StdDev: 174.02 Min: 0 Median: 1.8748 Max: 26401 Percentiles: P50: 1.87 P75: 3.02 P99: 158.41 P99.9: 1262.80 P99.99: 1581.57 ------------------------------------------------------ [ 0, 1 ] 39450 5.587% 5.587% # ( 1, 2 ] 358486 50.768% 56.355% ########## ( 2, 3 ] 130511 18.483% 74.837% #### ( 3, 4 ] 71446 10.118% 84.956% ## ( 4, 6 ] 73217 10.369% 95.324% ## ( 6, 10 ] 19746 2.796% 98.121% # ( 10, 15 ] 3966 0.562% 98.682% ( 15, 22 ] 570 0.081% 98.763% ( 22, 34 ] 52 0.007% 98.770% ( 34, 51 ] 37 0.005% 98.776% ( 51, 76 ] 38 0.005% 98.781% ( 76, 110 ] 354 0.050% 98.831% ( 110, 170 ] 1477 0.209% 99.040% ( 170, 250 ] 1073 0.152% 99.192% ( 250, 380 ] 830 0.118% 99.310% ( 380, 580 ] 1194 0.169% 99.479% ( 580, 870 ] 1525 0.216% 99.695% ( 870, 1300 ] 1585 0.224% 99.919% ( 1300, 1900 ] 1062 0.150% 100.070% ( 1900, 2900 ] 603 0.085% 100.155% ( 2900, 4400 ] 455 0.064% 100.220% ( 4400, 6600 ] 136 0.019% 100.239% ( 6600, 9900 ] 11 0.002% 100.240% ( 9900, 14000 ] 1 0.000% 100.241% ( 14000, 22000 ] 6 0.001% 100.241% ( 22000, 33000 ] 1 0.000% 100.242% ** Level 5 read latency histogram (micros): Count: 37637 Average: 586.2882 StdDev: 1011.01 Min: 75 Median: 221.2971 Max: 27324 Percentiles: P50: 221.30 P75: 537.33 P99: 5438.96 P99.9: 8695.86 P99.99: 15648.40 ------------------------------------------------------ ( 51, 76 ] 1 0.003% 0.003% ( 76, 110 ] 2898 7.700% 7.703% ## ( 110, 170 ] 11683 31.041% 38.744% ###### ( 170, 250 ] 6607 17.555% 56.298% #### ( 250, 380 ] 4033 10.716% 67.014% ## ( 380, 580 ] 3821 10.152% 77.166% ## ( 580, 870 ] 2711 7.203% 84.369% # ( 870, 1300 ] 1963 5.216% 89.585% # ( 1300, 1900 ] 1263 3.356% 92.940% # ( 1900, 2900 ] 953 2.532% 95.473% # ( 2900, 4400 ] 1066 2.832% 98.305% # ( 4400, 6600 ] 554 1.472% 99.777% ( 6600, 9900 ] 73 0.194% 99.971% ( 9900, 14000 ] 6 0.016% 99.987% ( 14000, 22000 ] 6 0.016% 100.003% ( 22000, 33000 ] 2 0.005% 100.008% ** DB Stats ** Uptime(secs): 8.0 total, 7.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 123.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.182 H:M:S, 52.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 125.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.182 H:M:S, 53.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 198.958 micros/op 20084 ops/sec 60.144 seconds 1207996 operations; 19.5 MB/s (297999 of 297999 found) Microseconds per read: Count: 1207996 Average: 198.9612 StdDev: 518.70 Min: 2 Median: 161.2072 Max: 52713 Percentiles: P50: 161.21 P75: 214.52 P99: 611.22 P99.9: 6206.23 P99.99: 22992.96 ------------------------------------------------------ ( 1, 2 ] 11 0.001% 0.001% ( 2, 3 ] 58 0.005% 0.006% ( 3, 4 ] 61 0.005% 0.011% ( 4, 6 ] 98 0.008% 0.019% ( 6, 10 ] 501 0.041% 0.060% ( 10, 15 ] 4677 0.387% 0.448% ( 15, 22 ] 3211 0.266% 0.713% ( 22, 34 ] 10143 0.840% 1.553% ( 34, 51 ] 2550 0.211% 1.764% ( 51, 76 ] 231 0.019% 1.783% ( 76, 110 ] 38043 3.149% 4.932% # ( 110, 170 ] 637895 52.806% 57.739% ########### ( 170, 250 ] 374730 31.021% 88.759% ###### ( 250, 380 ] 94622 7.833% 96.592% ## ( 380, 580 ] 28241 2.338% 98.930% ( 580, 870 ] 7841 0.649% 99.579% ( 870, 1300 ] 2207 0.183% 99.762% ( 1300, 1900 ] 751 0.062% 99.824% ( 1900, 2900 ] 465 0.038% 99.863% ( 2900, 4400 ] 319 0.026% 99.889% ( 4400, 6600 ] 162 0.013% 99.902% ( 6600, 9900 ] 194 0.016% 99.918% ( 9900, 14000 ] 417 0.035% 99.953% ( 14000, 22000 ] 437 0.036% 99.989% ( 22000, 33000 ] 113 0.009% 99.999% ( 33000, 50000 ] 17 0.001% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13700859 rocksdb.bloom.filter.full.positive COUNT : 1340474 rocksdb.bloom.filter.full.true.positive COUNT : 1207577 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 419 rocksdb.memtable.miss COUNT : 1207577 rocksdb.l0.hit COUNT : 42787 rocksdb.l1.hit COUNT : 21351 rocksdb.l2andup.hit COUNT : 1143439 rocksdb.compaction.key.drop.new COUNT : 119189 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 1674435 rocksdb.number.keys.read COUNT : 1207996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 1728016920 rocksdb.bytes.read COUNT : 1207996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1456 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 53302910 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 11786220380 rocksdb.compact.write.bytes COUNT : 11673323533 rocksdb.flush.write.bytes COUNT : 1717662181 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 54 rocksdb.number.superversion_acquires COUNT : 332 rocksdb.number.superversion_releases COUNT : 318 rocksdb.number.superversion_cleanups COUNT : 84 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 1703650304 rocksdb.memtable.garbage.bytes.at.flush COUNT : 517120 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 16724211056 rocksdb.non.last.level.read.count COUNT : 3899589 rocksdb.block.checksum.compute.count COUNT : 4207649 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 160.420711 P95 : 352.973066 P99 : 608.844976 P100 : 52710.000000 COUNT : 1207996 SUM : 239307247 rocksdb.db.write.micros P50 : 1.631736 P95 : 5.863474 P99 : 1907.298854 P100 : 13574.000000 COUNT : 1674435 SUM : 57858613 rocksdb.compaction.times.micros P50 : 1900000.000000 P95 : 4206666.666667 P99 : 5605268.000000 P100 : 5605268.000000 COUNT : 28 SUM : 54211479 rocksdb.compaction.times.cpu_micros P50 : 1115000.000000 P95 : 2700000.000000 P99 : 5557921.000000 P100 : 5557921.000000 COUNT : 28 SUM : 35560598 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 754.000000 P95 : 8910.000000 P99 : 45580.000000 P100 : 46700.000000 COUNT : 26 SUM : 78118 rocksdb.compaction.outfile.sync.micros P50 : 19666.666667 P95 : 133250.000000 P99 : 242266.666667 P100 : 311878.000000 COUNT : 129 SUM : 4901717 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 160.869565 P95 : 4325.000000 P99 : 7887.000000 P100 : 9868.000000 COUNT : 61 SUM : 52700 rocksdb.table.open.io.micros P50 : 9014.449541 P95 : 19145.263158 P99 : 21597.473684 P100 : 39020.000000 COUNT : 1456 SUM : 13423805 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.978383 P95 : 136.785214 P99 : 229.253112 P100 : 26404.000000 COUNT : 2856950 SUM : 62833708 rocksdb.read.block.get.micros P50 : 137.435936 P95 : 242.209114 P99 : 554.218546 P100 : 27329.000000 COUNT : 1349211 SUM : 204468370 rocksdb.write.raw.block.micros P50 : 0.582742 P95 : 1.848733 P99 : 4.039588 P100 : 26159.000000 COUNT : 3243582 SUM : 7606670 rocksdb.numfiles.in.singlecompaction P50 : 3.733333 P95 : 9.360000 P99 : 25.000000 P100 : 25.000000 COUNT : 36 SUM : 180 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.579228 P95 : 2185.090298 P99 : 2766.521870 P100 : 13569.000000 COUNT : 242268 SUM : 53321970 rocksdb.sst.read.micros P50 : 3.513986 P95 : 184.252434 P99 : 399.454609 P100 : 27324.000000 COUNT : 3899624 SUM : 252544935 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1207996 SUM : 1207996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 1674435 SUM : 1728016920 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215217.391304 P95 : 360500.000000 P99 : 434109.000000 P100 : 434109.000000 COUNT : 26 SUM : 5795042 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 141 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0