[2024-12-09 23:55:53.855672] Starting SPDK v25.01-pre git sha1 06358c250 / DPDK 24.03.0 initialization... [2024-12-09 23:55:53.855981] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1185139 ] Set seed to 1733784953848475 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-09 23:55:54.011661] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-09 23:55:54.118841] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-09 23:55:54.118895] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1185139' to capture a snapshot of events at runtime. [2024-12-09 23:55:54.118913] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-09 23:55:54.118930] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-09 23:55:54.118944] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1185139 for offline analysis/debug. [2024-12-09 23:55:54.120250] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 9 23:55:57 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/09-23:56:03 ... thread 0: (1000000,1000000) ops and (159381.0,159381.0) ops/second in (6.274275,6.274275) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 1.56 GB 56.4 0.3 0.0 0.3 1.2 0.9 0.0 1.4 40.4 153.4 7.78 4.14 12 0.648 319K 1806 0.0 0.0 L1 7/7 626.92 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 14/0 909.99 MB 0.9 1.3 1.1 0.2 1.3 1.0 0.0 1.2 111.0 108.4 11.86 7.36 5 2.372 875K 0 0.0 0.0 L4 133/0 9.47 GB 1.0 4.2 1.7 2.5 3.8 1.3 0.1 2.3 127.9 116.4 33.37 20.85 16 2.086 848K 373 0.0 0.0 L5 140/0 11.44 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 308/17 23.98 GB 0.0 5.8 2.8 3.0 6.2 3.2 2.4 7.2 111.3 120.0 53.01 32.35 33 1.606 2042K 2179 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 2.8 3.0 6.2 3.2 2.4 7.2 111.3 120.0 53.01 32.35 33 1.606 2042K 2179 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 2.8 3.0 5.4 2.3 0.0 0.0 124.7 115.9 47.30 29.62 22 2.150 2042K 2179 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 154.4 5.70 2.73 11 0.518 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.4 total, 6.3 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.21 GB write, 1001.99 MB/s write, 5.76 GB read, 928.90 MB/s read, 53.0 seconds Interval compaction: 6.21 GB write, 1013.84 MB/s write, 5.76 GB read, 939.89 MB/s read, 53.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 25, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 111012 Average: 98.5780 StdDev: 762.18 Min: 1 Median: 2.2223 Max: 70919 Percentiles: P50: 2.22 P75: 3.87 P99: 1938.92 P99.9: 5911.25 P99.99: 23386.38 ------------------------------------------------------ [ 0, 1 ] 5147 4.636% 4.636% # ( 1, 2 ] 44766 40.325% 44.962% ######## ( 2, 3 ] 25168 22.671% 67.633% ##### ( 3, 4 ] 9428 8.493% 76.126% ## ( 4, 6 ] 9641 8.685% 84.811% ## ( 6, 10 ] 2945 2.653% 87.464% # ( 10, 15 ] 595 0.536% 87.999% ( 15, 22 ] 63 0.057% 88.056% ( 22, 34 ] 27 0.024% 88.081% ( 34, 51 ] 35 0.032% 88.112% ( 51, 76 ] 19 0.017% 88.129% ( 76, 110 ] 40 0.036% 88.165% ( 110, 170 ] 1043 0.940% 89.105% ( 170, 250 ] 3033 2.732% 91.837% # ( 250, 380 ] 2144 1.931% 93.768% ( 380, 580 ] 2659 2.395% 96.163% ( 580, 870 ] 2058 1.854% 98.017% ( 870, 1300 ] 790 0.712% 98.729% ( 1300, 1900 ] 286 0.258% 98.987% ( 1900, 2900 ] 408 0.368% 99.354% ( 2900, 4400 ] 517 0.466% 99.820% ( 4400, 6600 ] 131 0.118% 99.938% ( 6600, 9900 ] 29 0.026% 99.964% ( 9900, 14000 ] 7 0.006% 99.970% ( 14000, 22000 ] 20 0.018% 99.988% ( 22000, 33000 ] 23 0.021% 100.009% ( 33000, 50000 ] 6 0.005% 100.014% ( 50000, 75000 ] 4 0.004% 100.018% ** Level 1 read latency histogram (micros): Count: 822 Average: 858.7968 StdDev: 1998.27 Min: 112 Median: 438.4270 Max: 38730 Percentiles: P50: 438.43 P75: 744.68 P99: 6465.80 P99.9: 36026.00 P99.99: 38730.00 ------------------------------------------------------ ( 110, 170 ] 60 7.299% 7.299% # ( 170, 250 ] 162 19.708% 27.007% #### ( 250, 380 ] 137 16.667% 43.674% ### ( 380, 580 ] 178 21.655% 65.328% #### ( 580, 870 ] 140 17.032% 82.360% ### ( 870, 1300 ] 51 6.204% 88.564% # ( 1300, 1900 ] 18 2.190% 90.754% ( 1900, 2900 ] 22 2.676% 93.431% # ( 2900, 4400 ] 27 3.285% 96.715% # ( 4400, 6600 ] 20 2.433% 99.148% ( 6600, 9900 ] 3 0.365% 99.513% ( 9900, 14000 ] 2 0.243% 99.757% ( 22000, 33000 ] 1 0.122% 99.878% ( 33000, 50000 ] 1 0.122% 100.000% ** Level 2 read latency histogram (micros): Count: 181225 Average: 12.0902 StdDev: 243.69 Min: 1 Median: 2.2770 Max: 38546 Percentiles: P50: 2.28 P75: 3.33 P99: 13.53 P99.9: 867.83 P99.99: 1830.72 ------------------------------------------------------ [ 0, 1 ] 1999 1.103% 1.103% ( 1, 2 ] 73841 40.745% 41.849% ######## ( 2, 3 ] 53328 29.426% 71.275% ###### ( 3, 4 ] 20644 11.391% 82.666% ## ( 4, 6 ] 21984 12.131% 94.797% ## ( 6, 10 ] 6376 3.518% 98.315% # ( 10, 15 ] 1759 0.971% 99.286% ( 15, 22 ] 272 0.150% 99.436% ( 22, 34 ] 36 0.020% 99.456% ( 34, 51 ] 60 0.033% 99.489% ( 51, 76 ] 38 0.021% 99.510% ( 76, 110 ] 11 0.006% 99.516% ( 110, 170 ] 9 0.005% 99.521% ( 170, 250 ] 36 0.020% 99.541% ( 250, 380 ] 212 0.117% 99.658% ( 380, 580 ] 276 0.152% 99.810% ( 580, 870 ] 164 0.090% 99.901% ( 870, 1300 ] 92 0.051% 99.951% ( 1300, 1900 ] 79 0.044% 99.995% ( 1900, 2900 ] 78 0.043% 100.038% ( 2900, 4400 ] 62 0.034% 100.072% ( 4400, 6600 ] 27 0.015% 100.087% ( 6600, 9900 ] 21 0.012% 100.099% ( 9900, 14000 ] 6 0.003% 100.102% ( 14000, 22000 ] 7 0.004% 100.106% ( 22000, 33000 ] 5 0.003% 100.109% ( 33000, 50000 ] 1 0.001% 100.109% ** Level 3 read latency histogram (micros): Count: 360690 Average: 16.8861 StdDev: 293.63 Min: 1 Median: 2.3581 Max: 38164 Percentiles: P50: 2.36 P75: 3.42 P99: 40.66 P99.9: 1652.81 P99.99: 3036.98 ------------------------------------------------------ [ 0, 1 ] 3313 0.919% 0.919% ( 1, 2 ] 136371 37.808% 38.727% ######## ( 2, 3 ] 113534 31.477% 70.204% ###### ( 3, 4 ] 40911 11.342% 81.546% ## ( 4, 6 ] 46506 12.894% 94.440% ### ( 6, 10 ] 12699 3.521% 97.961% # ( 10, 15 ] 3235 0.897% 98.857% ( 15, 22 ] 390 0.108% 98.966% ( 22, 34 ] 72 0.020% 98.986% ( 34, 51 ] 133 0.037% 99.022% ( 51, 76 ] 69 0.019% 99.042% ( 76, 110 ] 22 0.006% 99.048% ( 110, 170 ] 136 0.038% 99.085% ( 170, 250 ] 362 0.100% 99.186% ( 250, 380 ] 486 0.135% 99.320% ( 380, 580 ] 880 0.244% 99.564% ( 580, 870 ] 763 0.212% 99.776% ( 870, 1300 ] 335 0.093% 99.869% ( 1300, 1900 ] 191 0.053% 99.922% ( 1900, 2900 ] 221 0.061% 99.983% ( 2900, 4400 ] 273 0.076% 100.059% ( 4400, 6600 ] 68 0.019% 100.078% ( 6600, 9900 ] 30 0.008% 100.086% ( 9900, 14000 ] 15 0.004% 100.090% ( 14000, 22000 ] 21 0.006% 100.096% ( 22000, 33000 ] 11 0.003% 100.099% ( 33000, 50000 ] 4 0.001% 100.100% ** Level 4 read latency histogram (micros): Count: 635427 Average: 26.7271 StdDev: 389.79 Min: 0 Median: 2.3660 Max: 66971 Percentiles: P50: 2.37 P75: 3.49 P99: 458.93 P99.9: 1277.94 P99.99: 1833.46 ------------------------------------------------------ [ 0, 1 ] 7338 1.155% 1.155% ( 1, 2 ] 239599 37.707% 38.862% ######## ( 2, 3 ] 193369 30.431% 69.293% ###### ( 3, 4 ] 74280 11.690% 80.983% ## ( 4, 6 ] 79023 12.436% 93.419% ## ( 6, 10 ] 21932 3.452% 96.870% # ( 10, 15 ] 5560 0.875% 97.745% ( 15, 22 ] 638 0.100% 97.846% ( 22, 34 ] 151 0.024% 97.870% ( 34, 51 ] 258 0.041% 97.910% ( 51, 76 ] 135 0.021% 97.931% ( 76, 110 ] 91 0.014% 97.946% ( 110, 170 ] 803 0.126% 98.072% ( 170, 250 ] 2395 0.377% 98.449% ( 250, 380 ] 2172 0.342% 98.791% ( 380, 580 ] 3367 0.530% 99.321% ( 580, 870 ] 2674 0.421% 99.742% ( 870, 1300 ] 1061 0.167% 99.909% ( 1300, 1900 ] 582 0.092% 100.000% ( 1900, 2900 ] 680 0.107% 100.107% ( 2900, 4400 ] 765 0.120% 100.228% ( 4400, 6600 ] 190 0.030% 100.257% ( 6600, 9900 ] 63 0.010% 100.267% ( 9900, 14000 ] 16 0.003% 100.270% ( 14000, 22000 ] 48 0.008% 100.277% ( 22000, 33000 ] 26 0.004% 100.282% ( 33000, 50000 ] 12 0.002% 100.283% ( 50000, 75000 ] 5 0.001% 100.284% ** Level 5 read latency histogram (micros): Count: 9869 Average: 815.3704 StdDev: 1924.20 Min: 92 Median: 457.3448 Max: 57047 Percentiles: P50: 457.34 P75: 768.22 P99: 5346.69 P99.9: 33318.14 P99.99: 57047.00 ------------------------------------------------------ ( 76, 110 ] 20 0.203% 0.203% ( 110, 170 ] 667 6.759% 6.961% # ( 170, 250 ] 1902 19.272% 26.234% #### ( 250, 380 ] 1492 15.118% 41.352% ### ( 380, 580 ] 2207 22.363% 63.715% #### ( 580, 870 ] 1716 17.388% 81.102% ### ( 870, 1300 ] 720 7.296% 88.398% # ( 1300, 1900 ] 266 2.695% 91.093% # ( 1900, 2900 ] 353 3.577% 94.670% # ( 2900, 4400 ] 386 3.911% 98.581% # ( 4400, 6600 ] 96 0.973% 99.554% ( 6600, 9900 ] 12 0.122% 99.676% ( 9900, 14000 ] 6 0.061% 99.737% ( 14000, 22000 ] 7 0.071% 99.807% ( 22000, 33000 ] 9 0.091% 99.899% ( 33000, 50000 ] 7 0.071% 99.970% ( 50000, 75000 ] 3 0.030% 100.000% ** DB Stats ** Uptime(secs): 6.4 total, 6.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 154.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.707 H:M:S, 26.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 156.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.707 H:M:S, 27.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/09-23:56:07 ... thread 0: (1000000,2000000) ops and (275890.8,202042.7) ops/second in (3.624623,9.898898) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 2.54 GB 162.7 1.4 0.0 1.4 3.2 1.8 0.0 1.8 86.4 198.6 16.75 11.40 32 0.523 1468K 7860 0.0 0.0 L1 7/7 626.92 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 14/0 909.99 MB 0.9 1.3 1.1 0.2 1.3 1.0 0.0 1.2 111.0 108.4 11.86 7.36 5 2.372 875K 0 0.0 0.0 L4 133/0 9.47 GB 1.0 4.2 1.7 2.5 3.8 1.3 0.1 2.3 127.9 116.4 33.37 20.85 16 2.086 848K 373 0.0 0.0 L5 140/0 11.44 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 312/17 24.95 GB 0.0 6.9 2.8 4.1 8.3 4.2 2.4 4.5 113.4 137.1 61.98 39.60 53 1.169 3192K 8233 0.0 0.0 Int 0/0 0.00 KB 0.0 6.9 2.8 4.1 8.3 4.2 2.4 4.5 113.4 137.1 61.98 39.60 53 1.169 3192K 8233 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.9 2.8 4.1 6.5 2.3 0.0 0.0 132.5 124.6 53.04 34.05 26 2.040 3192K 8233 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 211.3 8.93 5.55 27 0.331 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.0 total, 9.9 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.30 GB write, 851.68 MB/s write, 6.87 GB read, 704.86 MB/s read, 62.0 seconds Interval compaction: 8.30 GB write, 858.07 MB/s write, 6.87 GB read, 710.14 MB/s read, 62.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 25, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 461252 Average: 36.3595 StdDev: 378.90 Min: 1 Median: 1.6509 Max: 70919 Percentiles: P50: 1.65 P75: 2.42 P99: 551.30 P99.9: 2760.36 P99.99: 3938.32 ------------------------------------------------------ [ 0, 1 ] 65676 14.239% 14.239% ### ( 1, 2 ] 253428 54.944% 69.182% ########### ( 2, 3 ] 64209 13.921% 83.103% ### ( 3, 4 ] 19275 4.179% 87.282% # ( 4, 6 ] 14880 3.226% 90.508% # ( 6, 10 ] 5455 1.183% 91.690% ( 10, 15 ] 1083 0.235% 91.925% ( 15, 22 ] 115 0.025% 91.950% ( 22, 34 ] 40 0.009% 91.959% ( 34, 51 ] 37 0.008% 91.967% ( 51, 76 ] 22 0.005% 91.971% ( 76, 110 ] 275 0.060% 92.031% ( 110, 170 ] 7145 1.549% 93.580% ( 170, 250 ] 16616 3.602% 97.182% # ( 250, 380 ] 5294 1.148% 98.330% ( 380, 580 ] 3607 0.782% 99.112% ( 580, 870 ] 2187 0.474% 99.586% ( 870, 1300 ] 807 0.175% 99.761% ( 1300, 1900 ] 287 0.062% 99.824% ( 1900, 2900 ] 410 0.089% 99.912% ( 2900, 4400 ] 517 0.112% 100.024% ( 4400, 6600 ] 131 0.028% 100.053% ( 6600, 9900 ] 29 0.006% 100.059% ( 9900, 14000 ] 7 0.002% 100.061% ( 14000, 22000 ] 20 0.004% 100.065% ( 22000, 33000 ] 23 0.005% 100.070% ( 33000, 50000 ] 6 0.001% 100.071% ( 50000, 75000 ] 4 0.001% 100.072% ** Level 1 read latency histogram (micros): Count: 2480 Average: 423.9294 StdDev: 1191.87 Min: 95 Median: 222.7192 Max: 38730 Percentiles: P50: 222.72 P75: 340.92 P99: 4642.00 P99.9: 13016.00 P99.99: 38730.00 ------------------------------------------------------ ( 76, 110 ] 15 0.605% 0.605% ( 110, 170 ] 481 19.395% 20.000% #### ( 170, 250 ] 1129 45.524% 65.524% ######### ( 250, 380 ] 336 13.548% 79.073% ### ( 380, 580 ] 226 9.113% 88.185% ## ( 580, 870 ] 148 5.968% 94.153% # ( 870, 1300 ] 51 2.056% 96.210% ( 1300, 1900 ] 18 0.726% 96.935% ( 1900, 2900 ] 22 0.887% 97.823% ( 2900, 4400 ] 27 1.089% 98.911% ( 4400, 6600 ] 20 0.806% 99.718% ( 6600, 9900 ] 3 0.121% 99.839% ( 9900, 14000 ] 2 0.081% 99.919% ( 22000, 33000 ] 1 0.040% 99.960% ( 33000, 50000 ] 1 0.040% 100.000% ** Level 2 read latency histogram (micros): Count: 181225 Average: 12.0902 StdDev: 243.69 Min: 1 Median: 2.2770 Max: 38546 Percentiles: P50: 2.28 P75: 3.33 P99: 13.53 P99.9: 867.83 P99.99: 1830.72 ------------------------------------------------------ [ 0, 1 ] 1999 1.103% 1.103% ( 1, 2 ] 73841 40.745% 41.849% ######## ( 2, 3 ] 53328 29.426% 71.275% ###### ( 3, 4 ] 20644 11.391% 82.666% ## ( 4, 6 ] 21984 12.131% 94.797% ## ( 6, 10 ] 6376 3.518% 98.315% # ( 10, 15 ] 1759 0.971% 99.286% ( 15, 22 ] 272 0.150% 99.436% ( 22, 34 ] 36 0.020% 99.456% ( 34, 51 ] 60 0.033% 99.489% ( 51, 76 ] 38 0.021% 99.510% ( 76, 110 ] 11 0.006% 99.516% ( 110, 170 ] 9 0.005% 99.521% ( 170, 250 ] 36 0.020% 99.541% ( 250, 380 ] 212 0.117% 99.658% ( 380, 580 ] 276 0.152% 99.810% ( 580, 870 ] 164 0.090% 99.901% ( 870, 1300 ] 92 0.051% 99.951% ( 1300, 1900 ] 79 0.044% 99.995% ( 1900, 2900 ] 78 0.043% 100.038% ( 2900, 4400 ] 62 0.034% 100.072% ( 4400, 6600 ] 27 0.015% 100.087% ( 6600, 9900 ] 21 0.012% 100.099% ( 9900, 14000 ] 6 0.003% 100.102% ( 14000, 22000 ] 7 0.004% 100.106% ( 22000, 33000 ] 5 0.003% 100.109% ( 33000, 50000 ] 1 0.001% 100.109% ** Level 3 read latency histogram (micros): Count: 363427 Average: 18.3506 StdDev: 293.08 Min: 1 Median: 2.3702 Max: 38164 Percentiles: P50: 2.37 P75: 3.47 P99: 239.00 P99.9: 1644.21 P99.99: 3035.48 ------------------------------------------------------ [ 0, 1 ] 3313 0.912% 0.912% ( 1, 2 ] 136371 37.524% 38.435% ######## ( 2, 3 ] 113534 31.240% 69.675% ###### ( 3, 4 ] 40911 11.257% 80.932% ## ( 4, 6 ] 46506 12.797% 93.729% ### ( 6, 10 ] 12699 3.494% 97.223% # ( 10, 15 ] 3235 0.890% 98.113% ( 15, 22 ] 390 0.107% 98.220% ( 22, 34 ] 72 0.020% 98.240% ( 34, 51 ] 133 0.037% 98.277% ( 51, 76 ] 69 0.019% 98.296% ( 76, 110 ] 52 0.014% 98.310% ( 110, 170 ] 838 0.231% 98.541% ( 170, 250 ] 1936 0.533% 99.073% ( 250, 380 ] 798 0.220% 99.293% ( 380, 580 ] 980 0.270% 99.562% ( 580, 870 ] 781 0.215% 99.777% ( 870, 1300 ] 336 0.092% 99.870% ( 1300, 1900 ] 191 0.053% 99.922% ( 1900, 2900 ] 221 0.061% 99.983% ( 2900, 4400 ] 273 0.075% 100.058% ( 4400, 6600 ] 68 0.019% 100.077% ( 6600, 9900 ] 30 0.008% 100.085% ( 9900, 14000 ] 15 0.004% 100.089% ( 14000, 22000 ] 21 0.006% 100.095% ( 22000, 33000 ] 11 0.003% 100.098% ( 33000, 50000 ] 4 0.001% 100.099% ** Level 4 read latency histogram (micros): Count: 661882 Average: 33.5785 StdDev: 383.81 Min: 0 Median: 2.4323 Max: 66971 Percentiles: P50: 2.43 P75: 3.74 P99: 477.94 P99.9: 1267.90 P99.99: 1829.94 ------------------------------------------------------ [ 0, 1 ] 7338 1.109% 1.109% ( 1, 2 ] 239749 36.222% 37.331% ####### ( 2, 3 ] 193955 29.304% 66.635% ###### ( 3, 4 ] 74591 11.270% 77.904% ## ( 4, 6 ] 79441 12.002% 89.906% ## ( 6, 10 ] 21970 3.319% 93.226% # ( 10, 15 ] 5574 0.842% 94.068% ( 15, 22 ] 644 0.097% 94.165% ( 22, 34 ] 155 0.023% 94.189% ( 34, 51 ] 258 0.039% 94.228% ( 51, 76 ] 135 0.020% 94.248% ( 76, 110 ] 378 0.057% 94.305% ( 110, 170 ] 7284 1.100% 95.406% ( 170, 250 ] 16545 2.500% 97.905% ( 250, 380 ] 5185 0.783% 98.689% ( 380, 580 ] 4211 0.636% 99.325% ( 580, 870 ] 2818 0.426% 99.751% ( 870, 1300 ] 1070 0.162% 99.912% ( 1300, 1900 ] 584 0.088% 100.000% ( 1900, 2900 ] 681 0.103% 100.103% ( 2900, 4400 ] 765 0.116% 100.219% ( 4400, 6600 ] 190 0.029% 100.248% ( 6600, 9900 ] 63 0.010% 100.257% ( 9900, 14000 ] 16 0.002% 100.260% ( 14000, 22000 ] 48 0.007% 100.267% ( 22000, 33000 ] 26 0.004% 100.271% ( 33000, 50000 ] 12 0.002% 100.273% ( 50000, 75000 ] 5 0.001% 100.273% ** Level 5 read latency histogram (micros): Count: 29146 Average: 415.2987 StdDev: 1157.42 Min: 91 Median: 224.0593 Max: 57047 Percentiles: P50: 224.06 P75: 355.68 P99: 3811.42 P99.9: 11850.23 P99.99: 50711.67 ------------------------------------------------------ ( 76, 110 ] 209 0.717% 0.717% ( 110, 170 ] 5676 19.474% 20.191% #### ( 170, 250 ] 12857 44.112% 64.304% ######### ( 250, 380 ] 3835 13.158% 77.462% ### ( 380, 580 ] 2889 9.912% 87.374% ## ( 580, 870 ] 1804 6.190% 93.563% # ( 870, 1300 ] 730 2.505% 96.068% # ( 1300, 1900 ] 266 0.913% 96.981% ( 1900, 2900 ] 354 1.215% 98.195% ( 2900, 4400 ] 386 1.324% 99.520% ( 4400, 6600 ] 96 0.329% 99.849% ( 6600, 9900 ] 12 0.041% 99.890% ( 9900, 14000 ] 6 0.021% 99.911% ( 14000, 22000 ] 7 0.024% 99.935% ( 22000, 33000 ] 9 0.031% 99.966% ( 33000, 50000 ] 7 0.024% 99.990% ( 50000, 75000 ] 3 0.010% 100.000% ** DB Stats ** Uptime(secs): 10.0 total, 3.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 197.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.707 H:M:S, 17.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 271.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/09-23:56:12 ... thread 0: (1000000,3000000) ops and (195658.6,199868.9) ops/second in (5.110944,15.009842) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.45 GB 125.1 2.6 0.0 2.6 5.4 2.8 0.0 2.0 110.7 225.9 24.44 18.64 52 0.470 2746K 13K 0.0 0.0 L1 7/7 626.92 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 14/0 909.99 MB 0.9 1.3 1.1 0.2 1.3 1.0 0.0 1.2 111.0 108.4 11.86 7.36 5 2.372 875K 0 0.0 0.0 L4 133/0 9.47 GB 1.0 4.2 1.7 2.5 3.8 1.3 0.1 2.3 127.9 116.4 33.37 20.85 16 2.086 848K 373 0.0 0.0 L5 140/0 11.44 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 312/20 25.87 GB 0.0 8.1 2.8 5.3 10.4 5.1 2.4 3.8 119.0 153.5 69.66 46.85 73 0.954 4470K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.1 2.8 5.3 10.4 5.1 2.4 3.8 119.0 153.5 69.66 46.85 73 0.954 4470K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.1 2.8 5.3 7.7 2.3 0.0 0.0 143.2 135.8 57.87 38.78 31 1.867 4470K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 240.0 11.79 8.07 42 0.281 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.1 total, 15.0 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.44 GB write, 708.69 MB/s write, 8.09 GB read, 549.46 MB/s read, 69.7 seconds Interval compaction: 10.44 GB write, 712.19 MB/s write, 8.09 GB read, 552.18 MB/s read, 69.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 25, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 791968 Average: 31.3777 StdDev: 292.35 Min: 0 Median: 1.5981 Max: 70919 Percentiles: P50: 1.60 P75: 2.27 P99: 401.04 P99.9: 1473.59 P99.99: 3177.96 ------------------------------------------------------ [ 0, 1 ] 137752 17.394% 17.394% ### ( 1, 2 ] 431779 54.520% 71.913% ########### ( 2, 3 ] 89613 11.315% 83.229% ## ( 3, 4 ] 28796 3.636% 86.865% # ( 4, 6 ] 20313 2.565% 89.429% # ( 6, 10 ] 6815 0.861% 90.290% ( 10, 15 ] 1473 0.186% 90.476% ( 15, 22 ] 173 0.022% 90.498% ( 22, 34 ] 78 0.010% 90.508% ( 34, 51 ] 41 0.005% 90.513% ( 51, 76 ] 24 0.003% 90.516% ( 76, 110 ] 862 0.109% 90.625% ( 110, 170 ] 19373 2.446% 93.071% ( 170, 250 ] 38374 4.845% 97.916% # ( 250, 380 ] 8121 1.025% 98.942% ( 380, 580 ] 4394 0.555% 99.497% ( 580, 870 ] 2293 0.290% 99.786% ( 870, 1300 ] 820 0.104% 99.890% ( 1300, 1900 ] 287 0.036% 99.926% ( 1900, 2900 ] 413 0.052% 99.978% ( 2900, 4400 ] 517 0.065% 100.043% ( 4400, 6600 ] 131 0.017% 100.060% ( 6600, 9900 ] 29 0.004% 100.064% ( 9900, 14000 ] 7 0.001% 100.064% ( 14000, 22000 ] 20 0.003% 100.067% ( 22000, 33000 ] 23 0.003% 100.070% ( 33000, 50000 ] 6 0.001% 100.071% ( 50000, 75000 ] 4 0.001% 100.071% ** Level 1 read latency histogram (micros): Count: 4874 Average: 311.7784 StdDev: 858.90 Min: 90 Median: 206.6601 Max: 38730 Percentiles: P50: 206.66 P75: 245.24 P99: 3192.22 P99.9: 8938.60 P99.99: 38730.00 ------------------------------------------------------ ( 76, 110 ] 53 1.087% 1.087% ( 110, 170 ] 1226 25.154% 26.241% ##### ( 170, 250 ] 2527 51.847% 78.088% ########## ( 250, 380 ] 488 10.012% 88.100% ## ( 380, 580 ] 282 5.786% 93.886% # ( 580, 870 ] 153 3.139% 97.025% # ( 870, 1300 ] 51 1.046% 98.071% ( 1300, 1900 ] 18 0.369% 98.441% ( 1900, 2900 ] 22 0.451% 98.892% ( 2900, 4400 ] 27 0.554% 99.446% ( 4400, 6600 ] 20 0.410% 99.856% ( 6600, 9900 ] 3 0.062% 99.918% ( 9900, 14000 ] 2 0.041% 99.959% ( 22000, 33000 ] 1 0.021% 99.979% ( 33000, 50000 ] 1 0.021% 100.000% ** Level 2 read latency histogram (micros): Count: 181225 Average: 12.0902 StdDev: 243.69 Min: 1 Median: 2.2770 Max: 38546 Percentiles: P50: 2.28 P75: 3.33 P99: 13.53 P99.9: 867.83 P99.99: 1830.72 ------------------------------------------------------ [ 0, 1 ] 1999 1.103% 1.103% ( 1, 2 ] 73841 40.745% 41.849% ######## ( 2, 3 ] 53328 29.426% 71.275% ###### ( 3, 4 ] 20644 11.391% 82.666% ## ( 4, 6 ] 21984 12.131% 94.797% ## ( 6, 10 ] 6376 3.518% 98.315% # ( 10, 15 ] 1759 0.971% 99.286% ( 15, 22 ] 272 0.150% 99.436% ( 22, 34 ] 36 0.020% 99.456% ( 34, 51 ] 60 0.033% 99.489% ( 51, 76 ] 38 0.021% 99.510% ( 76, 110 ] 11 0.006% 99.516% ( 110, 170 ] 9 0.005% 99.521% ( 170, 250 ] 36 0.020% 99.541% ( 250, 380 ] 212 0.117% 99.658% ( 380, 580 ] 276 0.152% 99.810% ( 580, 870 ] 164 0.090% 99.901% ( 870, 1300 ] 92 0.051% 99.951% ( 1300, 1900 ] 79 0.044% 99.995% ( 1900, 2900 ] 78 0.043% 100.038% ( 2900, 4400 ] 62 0.034% 100.072% ( 4400, 6600 ] 27 0.015% 100.087% ( 6600, 9900 ] 21 0.012% 100.099% ( 9900, 14000 ] 6 0.003% 100.102% ( 14000, 22000 ] 7 0.004% 100.106% ( 22000, 33000 ] 5 0.003% 100.109% ( 33000, 50000 ] 1 0.001% 100.109% ** Level 3 read latency histogram (micros): Count: 367375 Average: 20.2655 StdDev: 292.16 Min: 1 Median: 2.3876 Max: 38164 Percentiles: P50: 2.39 P75: 3.55 P99: 260.43 P99.9: 1631.81 P99.99: 3033.31 ------------------------------------------------------ [ 0, 1 ] 3313 0.902% 0.902% ( 1, 2 ] 136371 37.120% 38.022% ####### ( 2, 3 ] 113534 30.904% 68.926% ###### ( 3, 4 ] 40911 11.136% 80.062% ## ( 4, 6 ] 46506 12.659% 92.721% ### ( 6, 10 ] 12699 3.457% 96.178% # ( 10, 15 ] 3235 0.881% 97.059% ( 15, 22 ] 390 0.106% 97.165% ( 22, 34 ] 72 0.020% 97.184% ( 34, 51 ] 133 0.036% 97.221% ( 51, 76 ] 69 0.019% 97.239% ( 76, 110 ] 102 0.028% 97.267% ( 110, 170 ] 2103 0.572% 97.840% ( 170, 250 ] 4175 1.136% 98.976% ( 250, 380 ] 1100 0.299% 99.275% ( 380, 580 ] 1058 0.288% 99.563% ( 580, 870 ] 792 0.216% 99.779% ( 870, 1300 ] 339 0.092% 99.871% ( 1300, 1900 ] 191 0.052% 99.923% ( 1900, 2900 ] 221 0.060% 99.983% ( 2900, 4400 ] 273 0.074% 100.058% ( 4400, 6600 ] 68 0.019% 100.076% ( 6600, 9900 ] 30 0.008% 100.084% ( 9900, 14000 ] 15 0.004% 100.088% ( 14000, 22000 ] 21 0.006% 100.094% ( 22000, 33000 ] 11 0.003% 100.097% ( 33000, 50000 ] 4 0.001% 100.098% ** Level 4 read latency histogram (micros): Count: 699635 Average: 42.2663 StdDev: 375.37 Min: 0 Median: 2.5295 Max: 66971 Percentiles: P50: 2.53 P75: 4.23 P99: 482.64 P99.9: 1252.86 P99.99: 1826.06 ------------------------------------------------------ [ 0, 1 ] 7338 1.049% 1.049% ( 1, 2 ] 239757 34.269% 35.318% ####### ( 2, 3 ] 193982 27.726% 63.044% ###### ( 3, 4 ] 74599 10.663% 73.706% ## ( 4, 6 ] 79467 11.358% 85.065% ## ( 6, 10 ] 21974 3.141% 88.206% # ( 10, 15 ] 5576 0.797% 89.003% ( 15, 22 ] 644 0.092% 89.095% ( 22, 34 ] 155 0.022% 89.117% ( 34, 51 ] 258 0.037% 89.154% ( 51, 76 ] 135 0.019% 89.173% ( 76, 110 ] 933 0.133% 89.306% ( 110, 170 ] 19524 2.791% 92.097% # ( 170, 250 ] 37790 5.401% 97.498% # ( 250, 380 ] 7957 1.137% 98.636% ( 380, 580 ] 4968 0.710% 99.346% ( 580, 870 ] 2923 0.418% 99.763% ( 870, 1300 ] 1073 0.153% 99.917% ( 1300, 1900 ] 584 0.083% 100.000% ( 1900, 2900 ] 682 0.097% 100.098% ( 2900, 4400 ] 765 0.109% 100.207% ( 4400, 6600 ] 190 0.027% 100.234% ( 6600, 9900 ] 63 0.009% 100.243% ( 9900, 14000 ] 16 0.002% 100.246% ( 14000, 22000 ] 48 0.007% 100.252% ( 22000, 33000 ] 26 0.004% 100.256% ( 33000, 50000 ] 12 0.002% 100.258% ( 50000, 75000 ] 5 0.001% 100.259% ** Level 5 read latency histogram (micros): Count: 56771 Average: 308.0368 StdDev: 837.82 Min: 91 Median: 206.9072 Max: 57047 Percentiles: P50: 206.91 P75: 246.79 P99: 2782.84 P99.9: 6307.33 P99.99: 43498.47 ------------------------------------------------------ ( 76, 110 ] 666 1.173% 1.173% ( 110, 170 ] 14587 25.694% 26.868% ##### ( 170, 250 ] 28466 50.142% 77.009% ########## ( 250, 380 ] 5840 10.287% 87.296% ## ( 380, 580 ] 3462 6.098% 93.395% # ( 580, 870 ] 1867 3.289% 96.683% # ( 870, 1300 ] 735 1.295% 97.978% ( 1300, 1900 ] 266 0.469% 98.446% ( 1900, 2900 ] 356 0.627% 99.073% ( 2900, 4400 ] 386 0.680% 99.753% ( 4400, 6600 ] 96 0.169% 99.922% ( 6600, 9900 ] 12 0.021% 99.944% ( 9900, 14000 ] 6 0.011% 99.954% ( 14000, 22000 ] 7 0.012% 99.967% ( 22000, 33000 ] 9 0.016% 99.982% ( 33000, 50000 ] 7 0.012% 99.995% ( 50000, 75000 ] 3 0.005% 100.000% ** DB Stats ** Uptime(secs): 15.1 total, 5.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 195.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.127 H:M:S, 20.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 192.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.420 H:M:S, 27.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 322.724 micros/op 12337 ops/sec 20.183 seconds 248996 operations; 12.0 MB/s (60999 of 60999 found) Microseconds per read: Count: 248996 Average: 322.7324 StdDev: 1036.23 Min: 2 Median: 227.3096 Max: 137052 Percentiles: P50: 227.31 P75: 321.65 P99: 1765.54 P99.9: 12509.24 P99.99: 47127.82 ------------------------------------------------------ ( 1, 2 ] 12 0.005% 0.005% ( 2, 3 ] 74 0.030% 0.035% ( 3, 4 ] 121 0.049% 0.083% ( 4, 6 ] 222 0.089% 0.172% ( 6, 10 ] 363 0.146% 0.318% ( 10, 15 ] 2278 0.915% 1.233% ( 15, 22 ] 3920 1.574% 2.807% ( 22, 34 ] 5129 2.060% 4.867% ( 34, 51 ] 1924 0.773% 5.640% ( 51, 76 ] 336 0.135% 5.775% ( 76, 110 ] 126 0.051% 5.825% ( 110, 170 ] 20835 8.368% 14.193% ## ( 170, 250 ] 124458 49.984% 64.177% ########## ( 250, 380 ] 48899 19.638% 83.815% #### ( 380, 580 ] 25853 10.383% 94.198% ## ( 580, 870 ] 8705 3.496% 97.694% # ( 870, 1300 ] 2576 1.035% 98.729% ( 1300, 1900 ] 870 0.349% 99.078% ( 1900, 2900 ] 689 0.277% 99.355% ( 2900, 4400 ] 909 0.365% 99.720% ( 4400, 6600 ] 255 0.102% 99.822% ( 6600, 9900 ] 123 0.049% 99.872% ( 9900, 14000 ] 110 0.044% 99.916% ( 14000, 22000 ] 99 0.040% 99.956% ( 22000, 33000 ] 61 0.024% 99.980% ( 33000, 50000 ] 29 0.012% 99.992% ( 50000, 75000 ] 16 0.006% 99.998% ( 75000, 110000 ] 2 0.001% 99.999% ( 110000, 170000 ] 2 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 4220597 rocksdb.bloom.filter.full.positive COUNT : 289013 rocksdb.bloom.filter.full.true.positive COUNT : 248025 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 971 rocksdb.memtable.miss COUNT : 248025 rocksdb.l0.hit COUNT : 34114 rocksdb.l1.hit COUNT : 6773 rocksdb.l2andup.hit COUNT : 207138 rocksdb.compaction.key.drop.new COUNT : 463654 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3266820 rocksdb.number.keys.read COUNT : 248996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3371358240 rocksdb.bytes.read COUNT : 248996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 428 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 7060450 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9998179355 rocksdb.compact.write.bytes COUNT : 9516217453 rocksdb.flush.write.bytes COUNT : 3363842273 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 25 rocksdb.number.superversion_acquires COUNT : 559 rocksdb.number.superversion_releases COUNT : 541 rocksdb.number.superversion_cleanups COUNT : 138 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3341771776 rocksdb.memtable.garbage.bytes.at.flush COUNT : 5926912 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 10327206896 rocksdb.non.last.level.read.count COUNT : 2464931 rocksdb.block.checksum.compute.count COUNT : 2714704 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 226.626344 P95 : 645.024013 P99 : 1765.079585 P100 : 137049.000000 COUNT : 248996 SUM : 80131347 rocksdb.db.write.micros P50 : 1.535399 P95 : 5.112149 P99 : 8.616178 P100 : 665009.000000 COUNT : 3266820 SUM : 15942803 rocksdb.compaction.times.micros P50 : 1550000.000000 P95 : 3271174.000000 P99 : 3271174.000000 P100 : 3271174.000000 COUNT : 32 SUM : 58818205 rocksdb.compaction.times.cpu_micros P50 : 1154666.666667 P95 : 2060240.000000 P99 : 2060240.000000 P100 : 2060240.000000 COUNT : 32 SUM : 39714181 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 870.000000 P95 : 4200.000000 P99 : 8838.000000 P100 : 8838.000000 COUNT : 48 SUM : 69247 rocksdb.compaction.outfile.sync.micros P50 : 2282.352941 P95 : 8679.000000 P99 : 41755.000000 P100 : 48838.000000 COUNT : 97 SUM : 351434 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 185.652174 P95 : 1106.500000 P99 : 3065.000000 P100 : 3370.000000 COUNT : 89 SUM : 29890 rocksdb.table.open.io.micros P50 : 6501.492537 P95 : 20133.333333 P99 : 54500.000000 P100 : 88465.000000 COUNT : 428 SUM : 3265705 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.122936 P95 : 13.310275 P99 : 246.718668 P100 : 70924.000000 COUNT : 2422333 SUM : 49136778 rocksdb.read.block.get.micros P50 : 197.674790 P95 : 510.692516 P99 : 1439.592493 P100 : 66980.000000 COUNT : 292244 SUM : 70647893 rocksdb.write.raw.block.micros P50 : 0.534273 P95 : 1.341666 P99 : 4.158117 P100 : 96558.000000 COUNT : 3121452 SUM : 11483970 rocksdb.numfiles.in.singlecompaction P50 : 3.222222 P95 : 5.960000 P99 : 12.900000 P100 : 13.000000 COUNT : 42 SUM : 163 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562420 P95 : 1135.686668 P99 : 2129.333333 P100 : 664822.000000 COUNT : 41060 SUM : 7064680 rocksdb.sst.read.micros P50 : 2.025279 P95 : 224.808541 P99 : 492.349278 P100 : 70919.000000 COUNT : 2465438 SUM : 107978684 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 248996 SUM : 248996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3266820 SUM : 3371358240 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 221891.891892 P95 : 724666.666667 P99 : 903589.000000 P100 : 903589.000000 COUNT : 48 SUM : 12959723 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 113 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0