[2024-11-15 11:33:47.579246] Starting SPDK v25.01-pre git sha1 dec6d3843 / DPDK 24.03.0 initialization... [2024-11-15 11:33:47.579526] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1988446 ] Set seed to 1731666827572357 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-15 11:33:47.703824] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-15 11:33:47.811241] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-15 11:33:47.811283] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1988446' to capture a snapshot of events at runtime. [2024-11-15 11:33:47.811293] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-15 11:33:47.811303] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-15 11:33:47.811311] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1988446 for offline analysis/debug. [2024-11-15 11:33:47.812716] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 15 11:33:53 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/15-11:33:59 ... thread 0: (1000000,1000000) ops and (176385.0,176385.0) ops/second in (5.669417,5.669417) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/18 3.34 GB 6.3 0.7 0.0 0.7 1.6 0.9 0.0 1.9 132.0 285.4 5.72 5.19 17 0.336 766K 3578 0.0 0.0 L1 15/15 1.26 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/4 1.24 GB 0.9 1.4 1.0 0.4 1.4 1.0 0.0 1.4 214.8 211.8 6.59 6.02 3 2.195 198K 0 0.0 0.0 L4 128/2 9.71 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.1 224.1 221.5 0.99 0.95 1 0.990 205K 0 0.0 0.0 L5 120/0 9.84 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 299/39 25.39 GB 0.0 2.3 1.2 1.1 3.2 2.0 0.7 3.7 179.9 244.2 13.29 12.16 21 0.633 1171K 3578 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 1.2 1.1 3.2 2.0 0.7 3.7 179.9 244.2 13.29 12.16 21 0.633 1171K 3578 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 1.2 1.1 2.3 1.2 0.0 0.0 229.1 226.7 10.44 9.77 7 1.491 1171K 3578 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 308.1 2.86 2.39 14 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.8 total, 5.7 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.17 GB write, 562.57 MB/s write, 2.34 GB read, 414.40 MB/s read, 13.3 seconds Interval compaction: 3.17 GB write, 572.28 MB/s write, 2.34 GB read, 421.55 MB/s read, 13.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 0, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 271829 Average: 37.6457 StdDev: 143.74 Min: 0 Median: 1.7190 Max: 16152 Percentiles: P50: 1.72 P75: 2.66 P99: 458.73 P99.9: 829.54 P99.99: 1294.21 ------------------------------------------------------ [ 0, 1 ] 28740 10.573% 10.573% ## ( 1, 2 ] 149065 54.838% 65.411% ########### ( 2, 3 ] 39557 14.552% 79.963% ### ( 3, 4 ] 8678 3.192% 83.155% # ( 4, 6 ] 6867 2.526% 85.681% # ( 6, 10 ] 1594 0.586% 86.268% ( 10, 15 ] 388 0.143% 86.411% ( 15, 22 ] 45 0.017% 86.427% ( 22, 34 ] 5 0.002% 86.429% ( 34, 51 ] 6 0.002% 86.431% ( 51, 76 ] 64 0.024% 86.455% ( 76, 110 ] 684 0.252% 86.706% ( 110, 170 ] 7866 2.894% 89.600% # ( 170, 250 ] 14949 5.499% 95.099% # ( 250, 380 ] 9354 3.441% 98.541% # ( 380, 580 ] 3172 1.167% 99.708% ( 580, 870 ] 608 0.224% 99.931% ( 870, 1300 ] 162 0.060% 99.991% ( 1300, 1900 ] 97 0.036% 100.026% ( 1900, 2900 ] 51 0.019% 100.045% ( 2900, 4400 ] 10 0.004% 100.049% ( 4400, 6600 ] 5 0.002% 100.051% ( 6600, 9900 ] 13 0.005% 100.056% ( 9900, 14000 ] 7 0.003% 100.058% ( 14000, 22000 ] 2 0.001% 100.059% ** Level 1 read latency histogram (micros): Count: 3989 Average: 281.7440 StdDev: 441.09 Min: 62 Median: 224.9222 Max: 12265 Percentiles: P50: 224.92 P75: 311.53 P99: 1141.71 P99.9: 8812.10 P99.99: 12265.00 ------------------------------------------------------ ( 51, 76 ] 4 0.100% 0.100% ( 76, 110 ] 37 0.928% 1.028% ( 110, 170 ] 807 20.231% 21.258% #### ( 170, 250 ] 1670 41.865% 63.124% ######## ( 250, 380 ] 1001 25.094% 88.218% ##### ( 380, 580 ] 342 8.574% 96.791% ## ( 580, 870 ] 78 1.955% 98.747% ( 870, 1300 ] 16 0.401% 99.148% ( 1300, 1900 ] 12 0.301% 99.448% ( 1900, 2900 ] 6 0.150% 99.599% ( 2900, 4400 ] 6 0.150% 99.749% ( 4400, 6600 ] 4 0.100% 99.850% ( 6600, 9900 ] 3 0.075% 99.925% ( 9900, 14000 ] 3 0.075% 100.000% ** Level 2 read latency histogram (micros): Count: 231063 Average: 5.5365 StdDev: 43.28 Min: 1 Median: 1.5967 Max: 4533 Percentiles: P50: 1.60 P75: 1.99 P99: 138.65 P99.9: 466.94 P99.99: 1522.34 ------------------------------------------------------ [ 0, 1 ] 27178 11.762% 11.762% ## ( 1, 2 ] 148063 64.079% 75.841% ############# ( 2, 3 ] 35216 15.241% 91.082% ### ( 3, 4 ] 7449 3.224% 94.306% # ( 4, 6 ] 5673 2.455% 96.761% ( 6, 10 ] 4185 1.811% 98.572% ( 10, 15 ] 560 0.242% 98.815% ( 15, 22 ] 80 0.035% 98.849% ( 22, 34 ] 16 0.007% 98.856% ( 34, 51 ] 3 0.001% 98.857% ( 51, 76 ] 4 0.002% 98.859% ( 76, 110 ] 57 0.025% 98.884% ( 110, 170 ] 562 0.243% 99.127% ( 170, 250 ] 1031 0.446% 99.573% ( 250, 380 ] 658 0.285% 99.858% ( 380, 580 ] 223 0.097% 99.955% ( 580, 870 ] 51 0.022% 99.977% ( 870, 1300 ] 22 0.010% 99.986% ( 1300, 1900 ] 24 0.010% 99.997% ( 1900, 2900 ] 12 0.005% 100.002% ( 2900, 4400 ] 7 0.003% 100.005% ( 4400, 6600 ] 1 0.000% 100.005% ** Level 3 read latency histogram (micros): Count: 139648 Average: 8.6041 StdDev: 54.24 Min: 1 Median: 1.7287 Max: 3241 Percentiles: P50: 1.73 P75: 2.40 P99: 237.51 P99.9: 557.13 P99.99: 1233.28 ------------------------------------------------------ [ 0, 1 ] 9772 6.998% 6.998% # ( 1, 2 ] 82412 59.014% 66.012% ############ ( 2, 3 ] 31039 22.227% 88.238% #### ( 3, 4 ] 6187 4.430% 92.669% # ( 4, 6 ] 5007 3.585% 96.254% # ( 6, 10 ] 1869 1.338% 97.593% ( 10, 15 ] 283 0.203% 97.795% ( 15, 22 ] 35 0.025% 97.820% ( 22, 34 ] 5 0.004% 97.824% ( 34, 51 ] 1 0.001% 97.825% ( 51, 76 ] 5 0.004% 97.828% ( 76, 110 ] 39 0.028% 97.856% ( 110, 170 ] 580 0.415% 98.271% ( 170, 250 ] 1207 0.864% 99.136% ( 250, 380 ] 800 0.573% 99.709% ( 380, 580 ] 303 0.217% 99.926% ( 580, 870 ] 64 0.046% 99.971% ( 870, 1300 ] 32 0.023% 99.994% ( 1300, 1900 ] 18 0.013% 100.007% ( 1900, 2900 ] 15 0.011% 100.018% ( 2900, 4400 ] 2 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 29196 Average: 224.2014 StdDev: 231.84 Min: 1 Median: 205.1403 Max: 5690 Percentiles: P50: 205.14 P75: 287.15 P99: 1088.79 P99.9: 2842.90 P99.99: 4429.48 ------------------------------------------------------ [ 0, 1 ] 325 1.113% 1.113% ( 1, 2 ] 2994 10.255% 11.368% ## ( 2, 3 ] 1101 3.771% 15.139% # ( 3, 4 ] 234 0.801% 15.941% ( 4, 6 ] 190 0.651% 16.591% ( 6, 10 ] 83 0.284% 16.876% ( 10, 15 ] 30 0.103% 16.978% ( 15, 22 ] 4 0.014% 16.992% ( 34, 51 ] 1 0.003% 16.995% ( 51, 76 ] 18 0.062% 17.057% ( 76, 110 ] 261 0.894% 17.951% ( 110, 170 ] 5022 17.201% 35.152% ### ( 170, 250 ] 9869 33.803% 68.955% ####### ( 250, 380 ] 6176 21.154% 90.108% #### ( 380, 580 ] 2126 7.282% 97.390% # ( 580, 870 ] 410 1.404% 98.794% ( 870, 1300 ] 118 0.404% 99.199% ( 1300, 1900 ] 119 0.408% 99.606% ( 1900, 2900 ] 91 0.312% 99.918% ( 2900, 4400 ] 21 0.072% 99.990% ( 4400, 6600 ] 6 0.021% 100.010% ** Level 5 read latency histogram (micros): Count: 24024 Average: 270.6891 StdDev: 241.81 Min: 57 Median: 225.3387 Max: 7141 Percentiles: P50: 225.34 P75: 312.51 P99: 1258.35 P99.9: 3627.54 P99.99: 5982.94 ------------------------------------------------------ ( 51, 76 ] 8 0.033% 0.033% ( 76, 110 ] 249 1.036% 1.070% ( 110, 170 ] 4893 20.367% 21.437% #### ( 170, 250 ] 9920 41.292% 62.729% ######## ( 250, 380 ] 6131 25.520% 88.249% ##### ( 380, 580 ] 2065 8.596% 96.845% ## ( 580, 870 ] 385 1.603% 98.447% ( 870, 1300 ] 147 0.612% 99.059% ( 1300, 1900 ] 95 0.395% 99.455% ( 1900, 2900 ] 90 0.375% 99.829% ( 2900, 4400 ] 35 0.146% 99.975% ( 4400, 6600 ] 5 0.021% 99.996% ( 6600, 9900 ] 1 0.004% 100.000% ** DB Stats ** Uptime(secs): 5.8 total, 5.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 170.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.062 H:M:S, 35.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 173.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.062 H:M:S, 36.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 280.365 micros/op 14230 ops/sec 20.168 seconds 286996 operations; 13.8 MB/s (70999 of 70999 found) Microseconds per read: Count: 286996 Average: 280.3721 StdDev: 350.09 Min: 2 Median: 236.7061 Max: 27263 Percentiles: P50: 236.71 P75: 336.42 P99: 838.54 P99.9: 3571.21 P99.99: 15927.42 ------------------------------------------------------ ( 1, 2 ] 11 0.004% 0.004% ( 2, 3 ] 65 0.023% 0.026% ( 3, 4 ] 108 0.038% 0.064% ( 4, 6 ] 161 0.056% 0.120% ( 6, 10 ] 241 0.084% 0.204% ( 10, 15 ] 1486 0.518% 0.722% ( 15, 22 ] 2797 0.975% 1.697% ( 22, 34 ] 2650 0.923% 2.620% ( 34, 51 ] 2340 0.815% 3.435% ( 51, 76 ] 144 0.050% 3.485% ( 76, 110 ] 156 0.054% 3.540% ( 110, 170 ] 26560 9.254% 12.794% ## ( 170, 250 ] 128059 44.620% 57.415% ######### ( 250, 380 ] 75916 26.452% 83.867% ##### ( 380, 580 ] 35732 12.450% 96.317% ## ( 580, 870 ] 8637 3.009% 99.326% # ( 870, 1300 ] 1397 0.487% 99.813% ( 1300, 1900 ] 166 0.058% 99.871% ( 1900, 2900 ] 66 0.023% 99.894% ( 2900, 4400 ] 38 0.013% 99.907% ( 4400, 6600 ] 60 0.021% 99.928% ( 6600, 9900 ] 137 0.048% 99.976% ( 9900, 14000 ] 35 0.012% 99.988% ( 14000, 22000 ] 22 0.008% 99.996% ( 22000, 33000 ] 12 0.004% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 5726238 rocksdb.bloom.filter.full.positive COUNT : 341873 rocksdb.bloom.filter.full.true.positive COUNT : 286387 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 609 rocksdb.memtable.miss COUNT : 286387 rocksdb.l0.hit COUNT : 47038 rocksdb.l1.hit COUNT : 15647 rocksdb.l2andup.hit COUNT : 223702 rocksdb.compaction.key.drop.new COUNT : 65414 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 1412103 rocksdb.number.keys.read COUNT : 286996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 1457290296 rocksdb.bytes.read COUNT : 286996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 345 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 14473058 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 4712981053 rocksdb.compact.write.bytes COUNT : 4645128774 rocksdb.flush.write.bytes COUNT : 1451452790 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 28 rocksdb.number.superversion_acquires COUNT : 247 rocksdb.number.superversion_releases COUNT : 238 rocksdb.number.superversion_cleanups COUNT : 61 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 1441549312 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2192384 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 6099195335 rocksdb.non.last.level.read.count COUNT : 1440580 rocksdb.block.checksum.compute.count COUNT : 1487823 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 236.021681 P95 : 558.385443 P99 : 838.180734 P100 : 27261.000000 COUNT : 286996 SUM : 80214753 rocksdb.db.write.micros P50 : 1.536269 P95 : 5.286101 P99 : 18.517559 P100 : 2548.000000 COUNT : 1412103 SUM : 18099970 rocksdb.compaction.times.micros P50 : 1086666.666667 P95 : 11480000.000000 P99 : 13496000.000000 P100 : 13558032.000000 COUNT : 12 SUM : 27901776 rocksdb.compaction.times.cpu_micros P50 : 1086666.666667 P95 : 4624996.000000 P99 : 4624996.000000 P100 : 4624996.000000 COUNT : 12 SUM : 18100388 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 766.428571 P95 : 1466.000000 P99 : 1466.000000 P100 : 1466.000000 COUNT : 22 SUM : 19228 rocksdb.compaction.outfile.sync.micros P50 : 842.812500 P95 : 1675.000000 P99 : 2550.000000 P100 : 2552.000000 COUNT : 35 SUM : 31921 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 166.250000 P95 : 315.000000 P99 : 431.000000 P100 : 431.000000 COUNT : 40 SUM : 7154 rocksdb.table.open.io.micros P50 : 5298.473282 P95 : 9807.187500 P99 : 38019.000000 P100 : 38019.000000 COUNT : 345 SUM : 2049320 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.687315 P95 : 208.228246 P99 : 332.752028 P100 : 10804.000000 COUNT : 1141599 SUM : 32998609 rocksdb.read.block.get.micros P50 : 200.628465 P95 : 370.615775 P99 : 562.308569 P100 : 16559.000000 COUNT : 345858 SUM : 71811030 rocksdb.write.raw.block.micros P50 : 0.542205 P95 : 1.517406 P99 : 3.743882 P100 : 4807.000000 COUNT : 1476866 SUM : 3123449 rocksdb.numfiles.in.singlecompaction P50 : 3.250000 P95 : 22.600000 P99 : 29.000000 P100 : 29.000000 COUNT : 19 SUM : 93 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562102 P95 : 1147.000700 P99 : 2251.000000 P100 : 2251.000000 COUNT : 107674 SUM : 14483756 rocksdb.sst.read.micros P50 : 1.997776 P95 : 276.356102 P99 : 418.739056 P100 : 16152.000000 COUNT : 1440592 SUM : 100641229 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 286996 SUM : 286996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 1412103 SUM : 1457290296 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211904.761905 P95 : 249619.047619 P99 : 267883.000000 P100 : 267883.000000 COUNT : 22 SUM : 4538185 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 45 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0