[2024-07-24 22:20:55.241051] Starting SPDK v24.09-pre git sha1 643864934 / DPDK 24.03.0 initialization... [2024-07-24 22:20:55.241384] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3214891 ] Set seed to 1721852455233671 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-24 22:20:55.403510] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-24 22:20:55.628077] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-24 22:20:55.628129] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3214891' to capture a snapshot of events at runtime. [2024-07-24 22:20:55.628158] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-24 22:20:55.628175] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-24 22:20:55.628185] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3214891 for offline analysis/debug. [2024-07-24 22:20:55.628282] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 24 22:20:59 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/24-22:21:06 ... thread 0: (1000000,1000000) ops and (149870.6,149870.6) ops/second in (6.672422,6.672422) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 1.56 GB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 145.5 6.05 2.88 11 0.550 0 0 0.0 0.0 L1 5/5 339.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 24/4 1.19 GB 1.0 2.1 1.5 0.6 2.0 1.5 0.0 1.4 98.4 96.7 21.67 13.02 10 2.167 1551K 8292 0.0 0.0 L4 147/16 10.51 GB 1.0 2.7 1.6 1.2 2.6 1.4 0.4 1.7 115.6 110.6 24.31 15.36 14 1.737 663K 0 0.0 0.0 L5 140/0 10.77 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 333/39 24.36 GB 0.0 4.8 3.1 1.8 5.5 3.8 1.9 6.4 95.0 108.9 52.03 31.26 35 1.487 2214K 8292 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 3.1 1.8 5.5 3.8 1.9 6.4 95.0 108.9 52.03 31.26 35 1.487 2214K 8292 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 3.1 1.8 4.7 2.9 0.0 0.0 107.5 104.1 45.98 28.38 24 1.916 2214K 8292 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 145.5 6.05 2.88 11 0.550 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.8 total, 6.7 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.53 GB write, 837.13 MB/s write, 4.83 GB read, 730.56 MB/s read, 52.0 seconds Interval compaction: 5.53 GB write, 848.69 MB/s write, 4.83 GB read, 740.65 MB/s read, 52.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 34, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 73847 Average: 172.3793 StdDev: 1051.71 Min: 1 Median: 2.3994 Max: 56021 Percentiles: P50: 2.40 P75: 4.61 P99: 3194.29 P99.9: 10237.37 P99.99: 32492.24 ------------------------------------------------------ [ 0, 1 ] 1532 2.075% 2.075% ( 1, 2 ] 28552 38.664% 40.738% ######## ( 2, 3 ] 17124 23.188% 63.927% ##### ( 3, 4 ] 6308 8.542% 72.469% ## ( 4, 6 ] 6129 8.300% 80.768% ## ( 6, 10 ] 1547 2.095% 82.863% ( 10, 15 ] 310 0.420% 83.283% ( 15, 22 ] 41 0.056% 83.339% ( 22, 34 ] 2 0.003% 83.341% ( 34, 51 ] 6 0.008% 83.349% ( 51, 76 ] 2 0.003% 83.352% ( 76, 110 ] 8 0.011% 83.363% ( 110, 170 ] 114 0.154% 83.517% ( 170, 250 ] 867 1.174% 84.691% ( 250, 380 ] 2669 3.614% 88.306% # ( 380, 580 ] 3402 4.607% 92.912% # ( 580, 870 ] 2565 3.473% 96.386% # ( 870, 1300 ] 949 1.285% 97.671% ( 1300, 1900 ] 371 0.502% 98.173% ( 1900, 2900 ] 495 0.670% 98.844% ( 2900, 4400 ] 599 0.811% 99.655% ( 4400, 6600 ] 138 0.187% 99.842% ( 6600, 9900 ] 44 0.060% 99.901% ( 9900, 14000 ] 14 0.019% 99.920% ( 14000, 22000 ] 25 0.034% 99.954% ( 22000, 33000 ] 30 0.041% 99.995% ( 33000, 50000 ] 16 0.022% 100.016% ( 50000, 75000 ] 2 0.003% 100.019% ** Level 1 read latency histogram (micros): Count: 388 Average: 1130.3634 StdDev: 1786.20 Min: 103 Median: 574.0000 Max: 23516 Percentiles: P50: 574.00 P75: 1002.31 P99: 6406.40 P99.9: 23516.00 P99.99: 23516.00 ------------------------------------------------------ ( 76, 110 ] 1 0.258% 0.258% ( 110, 170 ] 3 0.773% 1.031% ( 170, 250 ] 27 6.959% 7.990% # ( 250, 380 ] 66 17.010% 25.000% ### ( 380, 580 ] 100 25.773% 50.773% ##### ( 580, 870 ] 82 21.134% 71.907% #### ( 870, 1300 ] 39 10.052% 81.959% ## ( 1300, 1900 ] 8 2.062% 84.021% ( 1900, 2900 ] 17 4.381% 88.402% # ( 2900, 4400 ] 32 8.247% 96.649% ## ( 4400, 6600 ] 10 2.577% 99.227% # ( 9900, 14000 ] 2 0.515% 99.742% ( 22000, 33000 ] 1 0.258% 100.000% ** Level 2 read latency histogram (micros): Count: 260520 Average: 19.0990 StdDev: 396.55 Min: 1 Median: 2.2938 Max: 36268 Percentiles: P50: 2.29 P75: 3.33 P99: 13.38 P99.9: 1910.28 P99.99: 3674.84 ------------------------------------------------------ [ 0, 1 ] 2935 1.127% 1.127% ( 1, 2 ] 104072 39.948% 41.074% ######## ( 2, 3 ] 79142 30.378% 71.453% ###### ( 3, 4 ] 28252 10.844% 82.297% ## ( 4, 6 ] 33748 12.954% 95.251% ### ( 6, 10 ] 8268 3.174% 98.425% # ( 10, 15 ] 2214 0.850% 99.275% ( 15, 22 ] 404 0.155% 99.430% ( 22, 34 ] 57 0.022% 99.452% ( 34, 51 ] 86 0.033% 99.485% ( 51, 76 ] 56 0.021% 99.506% ( 76, 110 ] 25 0.010% 99.516% ( 110, 170 ] 12 0.005% 99.521% ( 170, 250 ] 39 0.015% 99.536% ( 250, 380 ] 162 0.062% 99.598% ( 380, 580 ] 241 0.093% 99.690% ( 580, 870 ] 255 0.098% 99.788% ( 870, 1300 ] 179 0.069% 99.857% ( 1300, 1900 ] 111 0.043% 99.899% ( 1900, 2900 ] 144 0.055% 99.955% ( 2900, 4400 ] 178 0.068% 100.023% ( 4400, 6600 ] 96 0.037% 100.060% ( 6600, 9900 ] 59 0.023% 100.083% ( 9900, 14000 ] 23 0.009% 100.091% ( 14000, 22000 ] 33 0.013% 100.104% ( 22000, 33000 ] 21 0.008% 100.112% ( 33000, 50000 ] 3 0.001% 100.113% ** Level 3 read latency histogram (micros): Count: 464371 Average: 17.0959 StdDev: 372.51 Min: 1 Median: 2.3078 Max: 79615 Percentiles: P50: 2.31 P75: 3.30 P99: 14.32 P99.9: 943.10 P99.99: 1453.04 ------------------------------------------------------ [ 0, 1 ] 3925 0.845% 0.845% ( 1, 2 ] 183312 39.475% 40.321% ######## ( 2, 3 ] 146026 31.446% 71.767% ###### ( 3, 4 ] 50834 10.947% 82.713% ## ( 4, 6 ] 58288 12.552% 95.265% ### ( 6, 10 ] 14379 3.096% 98.362% # ( 10, 15 ] 3427 0.738% 99.100% ( 15, 22 ] 475 0.102% 99.202% ( 22, 34 ] 113 0.024% 99.226% ( 34, 51 ] 158 0.034% 99.261% ( 51, 76 ] 102 0.022% 99.282% ( 76, 110 ] 37 0.008% 99.290% ( 110, 170 ] 42 0.009% 99.299% ( 170, 250 ] 245 0.053% 99.352% ( 250, 380 ] 655 0.141% 99.493% ( 380, 580 ] 952 0.205% 99.698% ( 580, 870 ] 862 0.186% 99.884% ( 870, 1300 ] 439 0.095% 99.978% ( 1300, 1900 ] 210 0.045% 100.024% ( 1900, 2900 ] 243 0.052% 100.076% ( 2900, 4400 ] 248 0.053% 100.129% ( 4400, 6600 ] 88 0.019% 100.148% ( 6600, 9900 ] 40 0.009% 100.157% ( 9900, 14000 ] 24 0.005% 100.162% ( 14000, 22000 ] 44 0.009% 100.172% ( 22000, 33000 ] 29 0.006% 100.178% ( 33000, 50000 ] 6 0.001% 100.179% ( 50000, 75000 ] 1 0.000% 100.179% ( 75000, 110000 ] 1 0.000% 100.180% ** Level 4 read latency histogram (micros): Count: 528593 Average: 28.9279 StdDev: 428.37 Min: 1 Median: 2.3274 Max: 59930 Percentiles: P50: 2.33 P75: 3.40 P99: 512.09 P99.9: 1471.05 P99.99: 2120.03 ------------------------------------------------------ [ 0, 1 ] 4079 0.772% 0.772% ( 1, 2 ] 207343 39.225% 39.997% ######## ( 2, 3 ] 161513 30.555% 70.552% ###### ( 3, 4 ] 58827 11.129% 81.681% ## ( 4, 6 ] 65479 12.387% 94.069% ## ( 6, 10 ] 16314 3.086% 97.155% # ( 10, 15 ] 3635 0.688% 97.843% ( 15, 22 ] 481 0.091% 97.934% ( 22, 34 ] 94 0.018% 97.952% ( 34, 51 ] 145 0.027% 97.979% ( 51, 76 ] 88 0.017% 97.996% ( 76, 110 ] 29 0.005% 98.001% ( 110, 170 ] 140 0.026% 98.028% ( 170, 250 ] 799 0.151% 98.179% ( 250, 380 ] 2256 0.427% 98.606% ( 380, 580 ] 3160 0.598% 99.203% ( 580, 870 ] 2518 0.476% 99.680% ( 870, 1300 ] 1029 0.195% 99.874% ( 1300, 1900 ] 482 0.091% 99.966% ( 1900, 2900 ] 596 0.113% 100.078% ( 2900, 4400 ] 653 0.124% 100.202% ( 4400, 6600 ] 164 0.031% 100.233% ( 6600, 9900 ] 67 0.013% 100.246% ( 9900, 14000 ] 30 0.006% 100.251% ( 14000, 22000 ] 33 0.006% 100.257% ( 22000, 33000 ] 31 0.006% 100.263% ( 33000, 50000 ] 16 0.003% 100.266% ( 50000, 75000 ] 4 0.001% 100.267% ** Level 5 read latency histogram (micros): Count: 8022 Average: 1091.9878 StdDev: 2498.36 Min: 95 Median: 564.6084 Max: 66038 Percentiles: P50: 564.61 P75: 905.20 P99: 7015.80 P99.9: 40817.38 P99.99: 54945.00 ------------------------------------------------------ ( 76, 110 ] 3 0.037% 0.037% ( 110, 170 ] 86 1.072% 1.109% ( 170, 250 ] 450 5.610% 6.719% # ( 250, 380 ] 1445 18.013% 24.732% #### ( 380, 580 ] 2196 27.375% 52.107% ##### ( 580, 870 ] 1776 22.139% 74.246% #### ( 870, 1300 ] 739 9.212% 83.458% ## ( 1300, 1900 ] 327 4.076% 87.534% # ( 1900, 2900 ] 395 4.924% 92.458% # ( 2900, 4400 ] 427 5.323% 97.781% # ( 4400, 6600 ] 94 1.172% 98.953% ( 6600, 9900 ] 30 0.374% 99.327% ( 9900, 14000 ] 4 0.050% 99.377% ( 14000, 22000 ] 17 0.212% 99.589% ( 22000, 33000 ] 19 0.237% 99.825% ( 33000, 50000 ] 13 0.162% 99.988% ( 50000, 75000 ] 1 0.012% 100.000% ** DB Stats ** Uptime(secs): 6.8 total, 6.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 145.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.978 H:M:S, 29.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 147.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.978 H:M:S, 29.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/24-22:21:10 ... thread 0: (1000000,2000000) ops and (247734.0,186758.6) ops/second in (4.036588,10.709010) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 2.54 GB 162.7 1.4 0.0 1.4 3.2 1.8 0.0 1.8 75.6 173.7 19.14 11.75 32 0.598 1468K 8181 0.0 0.0 L1 5/5 339.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 20/0 982.51 MB 1.0 2.1 1.5 0.6 2.0 1.5 0.0 1.4 98.4 96.7 21.67 13.02 10 2.167 1551K 8292 0.0 0.0 L4 141/0 9.76 GB 1.0 4.2 1.8 2.4 3.9 1.4 0.4 2.2 135.7 124.3 31.77 21.60 18 1.765 908K 0 0.0 0.0 L5 150/0 11.51 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 334/15 25.10 GB 0.0 7.7 3.3 4.4 9.2 4.7 2.7 5.0 108.7 129.1 72.58 46.36 60 1.210 3928K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.7 3.3 4.4 9.2 4.7 2.7 5.0 108.7 129.1 72.58 46.36 60 1.210 3928K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.7 3.3 4.4 7.3 2.9 0.0 0.0 125.1 118.6 63.11 40.57 33 1.912 3928K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 199.1 9.48 5.79 27 0.351 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.8 total, 10.7 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.15 GB write, 867.27 MB/s write, 7.71 GB read, 730.41 MB/s read, 72.6 seconds Interval compaction: 9.15 GB write, 874.73 MB/s write, 7.71 GB read, 736.69 MB/s read, 72.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 34, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 468146 Average: 41.9870 StdDev: 428.64 Min: 1 Median: 1.7184 Max: 56021 Percentiles: P50: 1.72 P75: 2.64 P99: 681.35 P99.9: 2996.66 P99.99: 3993.50 ------------------------------------------------------ [ 0, 1 ] 58233 12.439% 12.439% ## ( 1, 2 ] 244757 52.282% 64.721% ########## ( 2, 3 ] 75679 16.166% 80.887% ### ( 3, 4 ] 23536 5.027% 85.914% # ( 4, 6 ] 21905 4.679% 90.594% # ( 6, 10 ] 6389 1.365% 91.958% ( 10, 15 ] 1420 0.303% 92.262% ( 15, 22 ] 206 0.044% 92.306% ( 22, 34 ] 33 0.007% 92.313% ( 34, 51 ] 14 0.003% 92.316% ( 51, 76 ] 11 0.002% 92.318% ( 76, 110 ] 128 0.027% 92.345% ( 110, 170 ] 5389 1.151% 93.496% ( 170, 250 ] 13898 2.969% 96.465% # ( 250, 380 ] 5916 1.264% 97.729% ( 380, 580 ] 4849 1.036% 98.765% ( 580, 870 ] 3152 0.673% 99.438% ( 870, 1300 ] 1155 0.247% 99.685% ( 1300, 1900 ] 414 0.088% 99.773% ( 1900, 2900 ] 553 0.118% 99.891% ( 2900, 4400 ] 634 0.135% 100.027% ( 4400, 6600 ] 140 0.030% 100.057% ( 6600, 9900 ] 48 0.010% 100.067% ( 9900, 14000 ] 14 0.003% 100.070% ( 14000, 22000 ] 25 0.005% 100.075% ( 22000, 33000 ] 30 0.006% 100.082% ( 33000, 50000 ] 16 0.003% 100.085% ( 50000, 75000 ] 2 0.000% 100.085% ** Level 1 read latency histogram (micros): Count: 1252 Average: 518.5958 StdDev: 1093.51 Min: 100 Median: 237.4542 Max: 23516 Percentiles: P50: 237.45 P75: 448.92 P99: 4505.60 P99.9: 13483.40 P99.99: 23516.00 ------------------------------------------------------ ( 76, 110 ] 5 0.399% 0.399% ( 110, 170 ] 207 16.534% 16.933% ### ( 170, 250 ] 491 39.217% 56.150% ######## ( 250, 380 ] 185 14.776% 70.927% ### ( 380, 580 ] 148 11.821% 82.748% ## ( 580, 870 ] 99 7.907% 90.655% ## ( 870, 1300 ] 42 3.355% 94.010% # ( 1300, 1900 ] 8 0.639% 94.649% ( 1900, 2900 ] 21 1.677% 96.326% ( 2900, 4400 ] 33 2.636% 98.962% # ( 4400, 6600 ] 10 0.799% 99.760% ( 9900, 14000 ] 2 0.160% 99.920% ( 22000, 33000 ] 1 0.080% 100.000% ** Level 2 read latency histogram (micros): Count: 260520 Average: 19.0990 StdDev: 396.55 Min: 1 Median: 2.2938 Max: 36268 Percentiles: P50: 2.29 P75: 3.33 P99: 13.38 P99.9: 1910.28 P99.99: 3674.84 ------------------------------------------------------ [ 0, 1 ] 2935 1.127% 1.127% ( 1, 2 ] 104072 39.948% 41.074% ######## ( 2, 3 ] 79142 30.378% 71.453% ###### ( 3, 4 ] 28252 10.844% 82.297% ## ( 4, 6 ] 33748 12.954% 95.251% ### ( 6, 10 ] 8268 3.174% 98.425% # ( 10, 15 ] 2214 0.850% 99.275% ( 15, 22 ] 404 0.155% 99.430% ( 22, 34 ] 57 0.022% 99.452% ( 34, 51 ] 86 0.033% 99.485% ( 51, 76 ] 56 0.021% 99.506% ( 76, 110 ] 25 0.010% 99.516% ( 110, 170 ] 12 0.005% 99.521% ( 170, 250 ] 39 0.015% 99.536% ( 250, 380 ] 162 0.062% 99.598% ( 380, 580 ] 241 0.093% 99.690% ( 580, 870 ] 255 0.098% 99.788% ( 870, 1300 ] 179 0.069% 99.857% ( 1300, 1900 ] 111 0.043% 99.899% ( 1900, 2900 ] 144 0.055% 99.955% ( 2900, 4400 ] 178 0.068% 100.023% ( 4400, 6600 ] 96 0.037% 100.060% ( 6600, 9900 ] 59 0.023% 100.083% ( 9900, 14000 ] 23 0.009% 100.091% ( 14000, 22000 ] 33 0.013% 100.104% ( 22000, 33000 ] 21 0.008% 100.112% ( 33000, 50000 ] 3 0.001% 100.113% ** Level 3 read latency histogram (micros): Count: 485241 Average: 18.3765 StdDev: 365.39 Min: 1 Median: 2.3189 Max: 79615 Percentiles: P50: 2.32 P75: 3.35 P99: 215.34 P99.9: 953.91 P99.99: 1482.13 ------------------------------------------------------ [ 0, 1 ] 4072 0.839% 0.839% ( 1, 2 ] 190293 39.216% 40.055% ######## ( 2, 3 ] 151318 31.184% 71.239% ###### ( 3, 4 ] 52699 10.860% 82.100% ## ( 4, 6 ] 60391 12.446% 94.545% ## ( 6, 10 ] 14935 3.078% 97.623% # ( 10, 15 ] 3554 0.732% 98.356% ( 15, 22 ] 484 0.100% 98.455% ( 22, 34 ] 117 0.024% 98.480% ( 34, 51 ] 159 0.033% 98.512% ( 51, 76 ] 106 0.022% 98.534% ( 76, 110 ] 53 0.011% 98.545% ( 110, 170 ] 908 0.187% 98.732% ( 170, 250 ] 2293 0.473% 99.205% ( 250, 380 ] 1190 0.245% 99.450% ( 380, 580 ] 1162 0.239% 99.689% ( 580, 870 ] 932 0.192% 99.882% ( 870, 1300 ] 460 0.095% 99.976% ( 1300, 1900 ] 219 0.045% 100.021% ( 1900, 2900 ] 251 0.052% 100.073% ( 2900, 4400 ] 252 0.052% 100.125% ( 4400, 6600 ] 88 0.018% 100.143% ( 6600, 9900 ] 40 0.008% 100.151% ( 9900, 14000 ] 24 0.005% 100.156% ( 14000, 22000 ] 44 0.009% 100.165% ( 22000, 33000 ] 29 0.006% 100.171% ( 33000, 50000 ] 6 0.001% 100.173% ( 50000, 75000 ] 1 0.000% 100.173% ( 75000, 110000 ] 1 0.000% 100.173% ** Level 4 read latency histogram (micros): Count: 643907 Average: 33.1693 StdDev: 392.76 Min: 1 Median: 2.3882 Max: 59930 Percentiles: P50: 2.39 P75: 3.65 P99: 500.06 P99.9: 1276.15 P99.99: 1891.52 ------------------------------------------------------ [ 0, 1 ] 4687 0.728% 0.728% ( 1, 2 ] 243653 37.840% 38.568% ######## ( 2, 3 ] 189613 29.447% 68.015% ###### ( 3, 4 ] 69367 10.773% 78.788% ## ( 4, 6 ] 77369 12.016% 90.803% ## ( 6, 10 ] 19318 3.000% 93.803% # ( 10, 15 ] 4417 0.686% 94.489% ( 15, 22 ] 555 0.086% 94.576% ( 22, 34 ] 107 0.017% 94.592% ( 34, 51 ] 157 0.024% 94.617% ( 51, 76 ] 92 0.014% 94.631% ( 76, 110 ] 164 0.025% 94.656% ( 110, 170 ] 5911 0.918% 95.574% ( 170, 250 ] 14200 2.205% 97.780% ( 250, 380 ] 5246 0.815% 98.594% ( 380, 580 ] 4351 0.676% 99.270% ( 580, 870 ] 2968 0.461% 99.731% ( 870, 1300 ] 1152 0.179% 99.910% ( 1300, 1900 ] 523 0.081% 99.991% ( 1900, 2900 ] 641 0.100% 100.091% ( 2900, 4400 ] 682 0.106% 100.197% ( 4400, 6600 ] 164 0.025% 100.222% ( 6600, 9900 ] 72 0.011% 100.233% ( 9900, 14000 ] 30 0.005% 100.238% ( 14000, 22000 ] 33 0.005% 100.243% ( 22000, 33000 ] 31 0.005% 100.248% ( 33000, 50000 ] 16 0.002% 100.250% ( 50000, 75000 ] 4 0.001% 100.251% ** Level 5 read latency histogram (micros): Count: 26864 Average: 491.9883 StdDev: 1429.70 Min: 94 Median: 234.4708 Max: 66038 Percentiles: P50: 234.47 P75: 428.80 P99: 4099.19 P99.9: 25552.42 P99.99: 47794.71 ------------------------------------------------------ ( 76, 110 ] 113 0.421% 0.421% ( 110, 170 ] 4472 16.647% 17.067% ### ( 170, 250 ] 10978 40.865% 57.933% ######## ( 250, 380 ] 3823 14.231% 72.163% ### ( 380, 580 ] 3123 11.625% 83.789% ## ( 580, 870 ] 2113 7.866% 91.654% ## ( 870, 1300 ] 837 3.116% 94.770% # ( 1300, 1900 ] 353 1.314% 96.084% ( 1900, 2900 ] 430 1.601% 97.685% ( 2900, 4400 ] 442 1.645% 99.330% ( 4400, 6600 ] 95 0.354% 99.684% ( 6600, 9900 ] 31 0.115% 99.799% ( 9900, 14000 ] 4 0.015% 99.814% ( 14000, 22000 ] 17 0.063% 99.877% ( 22000, 33000 ] 19 0.071% 99.948% ( 33000, 50000 ] 13 0.048% 99.996% ( 50000, 75000 ] 1 0.004% 100.000% ** DB Stats ** Uptime(secs): 10.8 total, 4.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 182.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.179 H:M:S, 20.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 243.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.201 H:M:S, 5.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-22:21:15 ... thread 0: (1000000,3000000) ops and (195992.1,189738.2) ops/second in (5.102246,15.811256) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.45 GB 125.1 2.6 0.0 2.6 5.4 2.8 0.0 2.0 100.1 204.3 27.02 19.19 52 0.520 2746K 14K 0.0 0.0 L1 5/5 339.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 20/0 982.51 MB 1.0 2.1 1.5 0.6 2.0 1.5 0.0 1.4 98.4 96.7 21.67 13.02 10 2.167 1551K 8292 0.0 0.0 L4 141/0 9.76 GB 1.0 4.2 1.8 2.4 3.9 1.4 0.4 2.2 135.7 124.3 31.77 21.60 18 1.765 908K 0 0.0 0.0 L5 150/0 11.51 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 334/18 26.02 GB 0.0 8.9 3.3 5.6 11.3 5.7 2.7 4.1 113.7 143.8 80.46 53.81 80 1.006 5205K 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.9 3.3 5.6 11.3 5.7 2.7 4.1 113.7 143.8 80.46 53.81 80 1.006 5205K 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.9 3.3 5.6 8.5 2.9 0.0 0.0 134.7 128.6 67.91 45.30 38 1.787 5205K 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 225.6 12.55 8.51 42 0.299 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.9 total, 15.8 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.29 GB write, 727.12 MB/s write, 8.94 GB read, 575.23 MB/s read, 80.5 seconds Interval compaction: 11.29 GB write, 731.36 MB/s write, 8.94 GB read, 578.58 MB/s read, 80.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 34, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 812112 Average: 33.8888 StdDev: 328.28 Min: 1 Median: 1.6317 Max: 56021 Percentiles: P50: 1.63 P75: 2.44 P99: 494.90 P99.9: 2005.72 P99.99: 3450.76 ------------------------------------------------------ [ 0, 1 ] 133863 16.483% 16.483% ### ( 1, 2 ] 430903 53.060% 69.543% ########### ( 2, 3 ] 101559 12.506% 82.048% ### ( 3, 4 ] 32764 4.034% 86.083% # ( 4, 6 ] 30443 3.749% 89.831% # ( 6, 10 ] 7995 0.984% 90.816% ( 10, 15 ] 1866 0.230% 91.046% ( 15, 22 ] 301 0.037% 91.083% ( 22, 34 ] 70 0.009% 91.091% ( 34, 51 ] 19 0.002% 91.094% ( 51, 76 ] 12 0.001% 91.095% ( 76, 110 ] 396 0.049% 91.144% ( 110, 170 ] 16384 2.017% 93.161% ( 170, 250 ] 35533 4.375% 97.537% # ( 250, 380 ] 8631 1.063% 98.600% ( 380, 580 ] 5662 0.697% 99.297% ( 580, 870 ] 3253 0.401% 99.697% ( 870, 1300 ] 1168 0.144% 99.841% ( 1300, 1900 ] 420 0.052% 99.893% ( 1900, 2900 ] 557 0.069% 99.961% ( 2900, 4400 ] 634 0.078% 100.040% ( 4400, 6600 ] 140 0.017% 100.057% ( 6600, 9900 ] 48 0.006% 100.063% ( 9900, 14000 ] 14 0.002% 100.064% ( 14000, 22000 ] 25 0.003% 100.067% ( 22000, 33000 ] 30 0.004% 100.071% ( 33000, 50000 ] 16 0.002% 100.073% ( 50000, 75000 ] 2 0.000% 100.073% ** Level 1 read latency histogram (micros): Count: 2447 Average: 359.8688 StdDev: 799.82 Min: 93 Median: 211.7435 Max: 23516 Percentiles: P50: 211.74 P75: 269.93 P99: 3878.64 P99.9: 11033.65 P99.99: 23516.00 ------------------------------------------------------ ( 76, 110 ] 16 0.654% 0.654% ( 110, 170 ] 585 23.907% 24.561% ##### ( 170, 250 ] 1193 48.754% 73.314% ########## ( 250, 380 ] 269 10.993% 84.307% ## ( 380, 580 ] 167 6.825% 91.132% # ( 580, 870 ] 100 4.087% 95.219% # ( 870, 1300 ] 42 1.716% 96.935% ( 1300, 1900 ] 8 0.327% 97.262% ( 1900, 2900 ] 21 0.858% 98.120% ( 2900, 4400 ] 33 1.349% 99.469% ( 4400, 6600 ] 10 0.409% 99.877% ( 9900, 14000 ] 2 0.082% 99.959% ( 22000, 33000 ] 1 0.041% 100.000% ** Level 2 read latency histogram (micros): Count: 260520 Average: 19.0990 StdDev: 396.55 Min: 1 Median: 2.2938 Max: 36268 Percentiles: P50: 2.29 P75: 3.33 P99: 13.38 P99.9: 1910.28 P99.99: 3674.84 ------------------------------------------------------ [ 0, 1 ] 2935 1.127% 1.127% ( 1, 2 ] 104072 39.948% 41.074% ######## ( 2, 3 ] 79142 30.378% 71.453% ###### ( 3, 4 ] 28252 10.844% 82.297% ## ( 4, 6 ] 33748 12.954% 95.251% ### ( 6, 10 ] 8268 3.174% 98.425% # ( 10, 15 ] 2214 0.850% 99.275% ( 15, 22 ] 404 0.155% 99.430% ( 22, 34 ] 57 0.022% 99.452% ( 34, 51 ] 86 0.033% 99.485% ( 51, 76 ] 56 0.021% 99.506% ( 76, 110 ] 25 0.010% 99.516% ( 110, 170 ] 12 0.005% 99.521% ( 170, 250 ] 39 0.015% 99.536% ( 250, 380 ] 162 0.062% 99.598% ( 380, 580 ] 241 0.093% 99.690% ( 580, 870 ] 255 0.098% 99.788% ( 870, 1300 ] 179 0.069% 99.857% ( 1300, 1900 ] 111 0.043% 99.899% ( 1900, 2900 ] 144 0.055% 99.955% ( 2900, 4400 ] 178 0.068% 100.023% ( 4400, 6600 ] 96 0.037% 100.060% ( 6600, 9900 ] 59 0.023% 100.083% ( 9900, 14000 ] 23 0.009% 100.091% ( 14000, 22000 ] 33 0.013% 100.104% ( 22000, 33000 ] 21 0.008% 100.112% ( 33000, 50000 ] 3 0.001% 100.113% ** Level 3 read latency histogram (micros): Count: 490203 Average: 20.1847 StdDev: 364.02 Min: 1 Median: 2.3353 Max: 79615 Percentiles: P50: 2.34 P75: 3.42 P99: 241.64 P99.9: 949.27 P99.99: 1480.77 ------------------------------------------------------ [ 0, 1 ] 4072 0.831% 0.831% ( 1, 2 ] 190293 38.819% 39.650% ######## ( 2, 3 ] 151318 30.868% 70.518% ###### ( 3, 4 ] 52699 10.750% 81.269% ## ( 4, 6 ] 60391 12.320% 93.588% ## ( 6, 10 ] 14935 3.047% 96.635% # ( 10, 15 ] 3554 0.725% 97.360% ( 15, 22 ] 484 0.099% 97.459% ( 22, 34 ] 117 0.024% 97.483% ( 34, 51 ] 159 0.032% 97.515% ( 51, 76 ] 106 0.022% 97.537% ( 76, 110 ] 90 0.018% 97.555% ( 110, 170 ] 2424 0.494% 98.050% ( 170, 250 ] 5203 1.061% 99.111% ( 250, 380 ] 1553 0.317% 99.428% ( 380, 580 ] 1288 0.263% 99.691% ( 580, 870 ] 942 0.192% 99.883% ( 870, 1300 ] 460 0.094% 99.977% ( 1300, 1900 ] 219 0.045% 100.021% ( 1900, 2900 ] 251 0.051% 100.072% ( 2900, 4400 ] 252 0.051% 100.124% ( 4400, 6600 ] 88 0.018% 100.142% ( 6600, 9900 ] 40 0.008% 100.150% ( 9900, 14000 ] 24 0.005% 100.155% ( 14000, 22000 ] 44 0.009% 100.164% ( 22000, 33000 ] 29 0.006% 100.170% ( 33000, 50000 ] 6 0.001% 100.171% ( 50000, 75000 ] 1 0.000% 100.171% ( 75000, 110000 ] 1 0.000% 100.171% ** Level 4 read latency histogram (micros): Count: 679663 Average: 41.7071 StdDev: 384.30 Min: 1 Median: 2.4825 Max: 59930 Percentiles: P50: 2.48 P75: 4.06 P99: 502.38 P99.9: 1263.43 P99.99: 1888.57 ------------------------------------------------------ [ 0, 1 ] 4687 0.690% 0.690% ( 1, 2 ] 243655 35.849% 36.539% ####### ( 2, 3 ] 189618 27.899% 64.438% ###### ( 3, 4 ] 69421 10.214% 74.652% ## ( 4, 6 ] 77513 11.405% 86.056% ## ( 6, 10 ] 19328 2.844% 88.900% # ( 10, 15 ] 4423 0.651% 89.551% ( 15, 22 ] 558 0.082% 89.633% ( 22, 34 ] 108 0.016% 89.649% ( 34, 51 ] 157 0.023% 89.672% ( 51, 76 ] 92 0.014% 89.686% ( 76, 110 ] 485 0.071% 89.757% ( 110, 170 ] 16924 2.490% 92.247% ( 170, 250 ] 34873 5.131% 97.378% # ( 250, 380 ] 7875 1.159% 98.537% ( 380, 580 ] 5147 0.757% 99.294% ( 580, 870 ] 3058 0.450% 99.744% ( 870, 1300 ] 1160 0.171% 99.915% ( 1300, 1900 ] 523 0.077% 99.991% ( 1900, 2900 ] 643 0.095% 100.086% ( 2900, 4400 ] 682 0.100% 100.186% ( 4400, 6600 ] 164 0.024% 100.211% ( 6600, 9900 ] 72 0.011% 100.221% ( 9900, 14000 ] 30 0.004% 100.226% ( 14000, 22000 ] 33 0.005% 100.230% ( 22000, 33000 ] 31 0.005% 100.235% ( 33000, 50000 ] 16 0.002% 100.237% ( 50000, 75000 ] 4 0.001% 100.238% ** Level 5 read latency histogram (micros): Count: 53320 Average: 345.3952 StdDev: 1026.47 Min: 91 Median: 211.2698 Max: 66038 Percentiles: P50: 211.27 P75: 262.36 P99: 3201.36 P99.9: 10597.00 P99.99: 44335.08 ------------------------------------------------------ ( 76, 110 ] 333 0.625% 0.625% ( 110, 170 ] 12709 23.835% 24.460% ##### ( 170, 250 ] 26398 49.509% 73.968% ########## ( 250, 380 ] 5785 10.850% 84.818% ## ( 380, 580 ] 3670 6.883% 91.701% # ( 580, 870 ] 2177 4.083% 95.784% # ( 870, 1300 ] 840 1.575% 97.359% ( 1300, 1900 ] 355 0.666% 98.025% ( 1900, 2900 ] 431 0.808% 98.833% ( 2900, 4400 ] 442 0.829% 99.662% ( 4400, 6600 ] 95 0.178% 99.841% ( 6600, 9900 ] 31 0.058% 99.899% ( 9900, 14000 ] 4 0.008% 99.906% ( 14000, 22000 ] 17 0.032% 99.938% ( 22000, 33000 ] 19 0.036% 99.974% ( 33000, 50000 ] 13 0.024% 99.998% ( 50000, 75000 ] 1 0.002% 100.000% ** DB Stats ** Uptime(secs): 15.9 total, 5.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 185.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.443 H:M:S, 21.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 192.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.264 H:M:S, 24.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 361.847 micros/op 11007 ops/sec 20.168 seconds 221996 operations; 10.7 MB/s (55999 of 55999 found) Microseconds per read: Count: 221996 Average: 361.8706 StdDev: 1255.65 Min: 3 Median: 236.0714 Max: 134027 Percentiles: P50: 236.07 P75: 344.96 P99: 2544.32 P99.9: 17663.85 P99.99: 49915.17 ------------------------------------------------------ ( 2, 3 ] 14 0.006% 0.006% ( 3, 4 ] 28 0.013% 0.019% ( 4, 6 ] 159 0.072% 0.091% ( 6, 10 ] 361 0.163% 0.253% ( 10, 15 ] 403 0.182% 0.435% ( 15, 22 ] 897 0.404% 0.839% ( 22, 34 ] 7370 3.320% 4.159% # ( 34, 51 ] 3219 1.450% 5.609% ( 51, 76 ] 650 0.293% 5.901% ( 76, 110 ] 111 0.050% 5.951% ( 110, 170 ] 10134 4.565% 10.516% # ( 170, 250 ] 106130 47.807% 58.324% ########## ( 250, 380 ] 50680 22.829% 81.153% ##### ( 380, 580 ] 25523 11.497% 92.650% ## ( 580, 870 ] 9292 4.186% 96.836% # ( 870, 1300 ] 3079 1.387% 98.222% ( 1300, 1900 ] 1112 0.501% 98.723% ( 1900, 2900 ] 953 0.429% 99.153% ( 2900, 4400 ] 1097 0.494% 99.647% ( 4400, 6600 ] 276 0.124% 99.771% ( 6600, 9900 ] 158 0.071% 99.842% ( 9900, 14000 ] 79 0.036% 99.878% ( 14000, 22000 ] 107 0.048% 99.926% ( 22000, 33000 ] 102 0.046% 99.972% ( 33000, 50000 ] 40 0.018% 99.990% ( 50000, 75000 ] 14 0.006% 99.996% ( 75000, 110000 ] 6 0.003% 99.999% ( 110000, 170000 ] 2 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3740593 rocksdb.bloom.filter.full.positive COUNT : 257946 rocksdb.bloom.filter.full.true.positive COUNT : 221111 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 885 rocksdb.memtable.miss COUNT : 221111 rocksdb.l0.hit COUNT : 30539 rocksdb.l1.hit COUNT : 3232 rocksdb.l2andup.hit COUNT : 187340 rocksdb.compaction.key.drop.new COUNT : 439262 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3266846 rocksdb.number.keys.read COUNT : 221996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3371385072 rocksdb.bytes.read COUNT : 221996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 464 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 6582063 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10586611268 rocksdb.compact.write.bytes COUNT : 10127672935 rocksdb.flush.write.bytes COUNT : 3363987543 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 24 rocksdb.number.superversion_acquires COUNT : 593 rocksdb.number.superversion_releases COUNT : 573 rocksdb.number.superversion_cleanups COUNT : 148 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3341769728 rocksdb.memtable.garbage.bytes.at.flush COUNT : 5781504 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 10654059518 rocksdb.non.last.level.read.count COUNT : 2543388 rocksdb.block.checksum.compute.count COUNT : 2825403 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 235.087265 P95 : 741.983166 P99 : 2542.599581 P100 : 134025.000000 COUNT : 221996 SUM : 80088880 rocksdb.db.write.micros P50 : 1.612361 P95 : 5.196776 P99 : 8.968019 P100 : 499434.000000 COUNT : 3266846 SUM : 15766405 rocksdb.compaction.times.micros P50 : 1643333.333333 P95 : 3635000.000000 P99 : 4850501.000000 P100 : 4850501.000000 COUNT : 39 SUM : 68836069 rocksdb.compaction.times.cpu_micros P50 : 1159523.809524 P95 : 1802204.000000 P99 : 1802204.000000 P100 : 1802204.000000 COUNT : 39 SUM : 46216268 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 741.111111 P95 : 4100.000000 P99 : 7723.000000 P100 : 7723.000000 COUNT : 48 SUM : 58104 rocksdb.compaction.outfile.sync.micros P50 : 1750.000000 P95 : 8332.500000 P99 : 13344.000000 P100 : 34936.000000 COUNT : 116 SUM : 345455 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 188.000000 P95 : 1095.750000 P99 : 3191.000000 P100 : 3191.000000 COUNT : 99 SUM : 32629 rocksdb.table.open.io.micros P50 : 6496.875000 P95 : 24053.333333 P99 : 68166.666667 P100 : 114911.000000 COUNT : 464 SUM : 4096734 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.229036 P95 : 12.428042 P99 : 249.484348 P100 : 56026.000000 COUNT : 2564029 SUM : 54198098 rocksdb.read.block.get.micros P50 : 201.626673 P95 : 570.858193 P99 : 2148.994516 P100 : 79621.000000 COUNT : 261060 SUM : 69711812 rocksdb.write.raw.block.micros P50 : 0.542430 P95 : 1.537263 P99 : 5.217914 P100 : 92861.000000 COUNT : 3269344 SUM : 13454670 rocksdb.numfiles.in.singlecompaction P50 : 3.047619 P95 : 5.700000 P99 : 11.000000 P100 : 11.000000 COUNT : 52 SUM : 181 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567157 P95 : 1136.789050 P99 : 1298.826952 P100 : 499267.000000 COUNT : 34499 SUM : 6586507 rocksdb.sst.read.micros P50 : 2.119243 P95 : 221.742588 P99 : 528.193399 P100 : 79615.000000 COUNT : 2543650 SUM : 110525766 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 221996 SUM : 221996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3266846 SUM : 3371385072 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 224857.142857 P95 : 758500.000000 P99 : 920366.000000 P100 : 920366.000000 COUNT : 48 SUM : 13837325 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 127 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0