[2024-07-15 21:49:15.928112] Starting SPDK v24.09-pre git sha1 91f51bb85 / DPDK 24.03.0 initialization... [2024-07-15 21:49:15.928288] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid850174 ] Set seed to 1721072955924581 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 21:49:16.062528] app.c: 914:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 21:49:16.278468] app.c: 607:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 21:49:16.278516] app.c: 608:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 850174' to capture a snapshot of events at runtime. [2024-07-15 21:49:16.278529] app.c: 613:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 21:49:16.278543] app.c: 614:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 21:49:16.278555] app.c: 615:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid850174 for offline analysis/debug. [2024-07-15 21:49:16.278648] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 21:49:19 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/15-21:49:26 ... thread 0: (1000000,1000000) ops and (142806.7,142806.7) ops/second in (7.002473,7.002473) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.25 GB 50.1 0.3 0.0 0.3 1.1 0.8 0.0 1.4 37.8 135.9 8.31 4.00 11 0.755 319K 1868 0.0 0.0 L1 5/5 327.02 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 28/8 1.41 GB 1.0 2.2 1.7 0.5 2.2 1.6 0.0 1.3 107.1 105.2 21.17 11.54 10 2.117 1490K 7778 0.0 0.0 L4 155/24 11.12 GB 0.9 3.2 1.8 1.4 3.0 1.6 0.3 1.7 110.2 104.4 29.65 17.30 16 1.853 780K 0 0.0 0.0 L5 132/0 10.21 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 332/46 24.31 GB 0.0 5.7 3.4 2.3 6.3 4.0 1.5 7.9 98.9 109.1 59.13 32.84 37 1.598 2589K 9646 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 3.4 2.3 6.3 4.0 1.5 7.9 98.9 109.1 59.13 32.84 37 1.598 2589K 9646 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 3.4 2.3 5.5 3.2 0.0 0.0 110.8 106.7 52.81 30.26 27 1.956 2589K 9646 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 129.4 6.32 2.58 10 0.632 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.1 total, 7.0 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.30 GB write, 910.89 MB/s write, 5.71 GB read, 825.79 MB/s read, 59.1 seconds Interval compaction: 6.30 GB write, 921.22 MB/s write, 5.71 GB read, 835.16 MB/s read, 59.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 254599 Average: 33.9656 StdDev: 408.76 Min: 1 Median: 2.2287 Max: 61426 Percentiles: P50: 2.23 P75: 3.25 P99: 806.04 P99.9: 4220.54 P99.99: 9364.83 ------------------------------------------------------ [ 0, 1 ] 4767 1.872% 1.872% ( 1, 2 ] 105559 41.461% 43.333% ######## ( 2, 3 ] 74213 29.149% 72.482% ###### ( 3, 4 ] 25743 10.111% 82.593% ## ( 4, 6 ] 29136 11.444% 94.037% ## ( 6, 10 ] 7361 2.891% 96.929% # ( 10, 15 ] 1436 0.564% 97.493% ( 15, 22 ] 170 0.067% 97.559% ( 22, 34 ] 25 0.010% 97.569% ( 34, 51 ] 55 0.022% 97.591% ( 51, 76 ] 34 0.013% 97.604% ( 76, 110 ] 12 0.005% 97.609% ( 110, 170 ] 49 0.019% 97.628% ( 170, 250 ] 196 0.077% 97.705% ( 250, 380 ] 615 0.242% 97.947% ( 380, 580 ] 1394 0.548% 98.494% ( 580, 870 ] 1655 0.650% 99.144% ( 870, 1300 ] 896 0.352% 99.496% ( 1300, 1900 ] 310 0.122% 99.618% ( 1900, 2900 ] 326 0.128% 99.746% ( 2900, 4400 ] 448 0.176% 99.922% ( 4400, 6600 ] 137 0.054% 99.976% ( 6600, 9900 ] 46 0.018% 99.994% ( 9900, 14000 ] 13 0.005% 99.999% ( 14000, 22000 ] 17 0.007% 100.005% ( 22000, 33000 ] 8 0.003% 100.009% ( 33000, 50000 ] 5 0.002% 100.011% ( 50000, 75000 ] 1 0.000% 100.011% ** Level 1 read latency histogram (micros): Count: 325 Average: 1251.3877 StdDev: 1349.18 Min: 108 Median: 699.5270 Max: 7117 Percentiles: P50: 699.53 P75: 1297.17 P99: 6563.33 P99.9: 7117.00 P99.99: 7117.00 ------------------------------------------------------ ( 76, 110 ] 1 0.308% 0.308% ( 110, 170 ] 2 0.615% 0.923% ( 170, 250 ] 14 4.308% 5.231% # ( 250, 380 ] 28 8.615% 13.846% ## ( 380, 580 ] 87 26.769% 40.615% ##### ( 580, 870 ] 74 22.769% 63.385% ##### ( 870, 1300 ] 38 11.692% 75.077% ## ( 1300, 1900 ] 17 5.231% 80.308% # ( 1900, 2900 ] 21 6.462% 86.769% # ( 2900, 4400 ] 25 7.692% 94.462% ## ( 4400, 6600 ] 15 4.615% 99.077% # ( 6600, 9900 ] 3 0.923% 100.000% ** Level 2 read latency histogram (micros): Count: 271830 Average: 13.3730 StdDev: 231.86 Min: 1 Median: 2.3113 Max: 31183 Percentiles: P50: 2.31 P75: 3.30 P99: 12.46 P99.9: 1551.95 P99.99: 2906.25 ------------------------------------------------------ [ 0, 1 ] 1969 0.724% 0.724% ( 1, 2 ] 107319 39.480% 40.205% ######## ( 2, 3 ] 85524 31.462% 71.667% ###### ( 3, 4 ] 30607 11.260% 82.926% ## ( 4, 6 ] 34604 12.730% 95.656% ### ( 6, 10 ] 8170 3.006% 98.662% # ( 10, 15 ] 1868 0.687% 99.349% ( 15, 22 ] 274 0.101% 99.450% ( 22, 34 ] 33 0.012% 99.462% ( 34, 51 ] 45 0.017% 99.479% ( 51, 76 ] 40 0.015% 99.493% ( 76, 110 ] 15 0.006% 99.499% ( 110, 170 ] 33 0.012% 99.511% ( 170, 250 ] 58 0.021% 99.532% ( 250, 380 ] 191 0.070% 99.603% ( 380, 580 ] 319 0.117% 99.720% ( 580, 870 ] 281 0.103% 99.823% ( 870, 1300 ] 154 0.057% 99.880% ( 1300, 1900 ] 129 0.047% 99.928% ( 1900, 2900 ] 169 0.062% 99.990% ( 2900, 4400 ] 196 0.072% 100.062% ( 4400, 6600 ] 72 0.026% 100.088% ( 6600, 9900 ] 22 0.008% 100.096% ( 9900, 14000 ] 5 0.002% 100.098% ( 14000, 22000 ] 6 0.002% 100.100% ( 22000, 33000 ] 6 0.002% 100.103% ** Level 3 read latency histogram (micros): Count: 518193 Average: 19.0993 StdDev: 304.44 Min: 1 Median: 2.3643 Max: 41401 Percentiles: P50: 2.36 P75: 3.37 P99: 15.38 P99.9: 1637.06 P99.99: 2687.95 ------------------------------------------------------ [ 0, 1 ] 3670 0.708% 0.708% ( 1, 2 ] 193677 37.375% 38.084% ####### ( 2, 3 ] 169511 32.712% 70.796% ####### ( 3, 4 ] 59094 11.404% 82.199% ## ( 4, 6 ] 68006 13.124% 95.323% ### ( 6, 10 ] 15882 3.065% 98.388% # ( 10, 15 ] 3152 0.608% 98.996% ( 15, 22 ] 374 0.072% 99.068% ( 22, 34 ] 94 0.018% 99.087% ( 34, 51 ] 135 0.026% 99.113% ( 51, 76 ] 132 0.025% 99.138% ( 76, 110 ] 33 0.006% 99.145% ( 110, 170 ] 54 0.010% 99.155% ( 170, 250 ] 175 0.034% 99.189% ( 250, 380 ] 530 0.102% 99.291% ( 380, 580 ] 1097 0.212% 99.503% ( 580, 870 ] 1234 0.238% 99.741% ( 870, 1300 ] 632 0.122% 99.863% ( 1300, 1900 ] 345 0.067% 99.929% ( 1900, 2900 ] 400 0.077% 100.007% ( 2900, 4400 ] 513 0.099% 100.106% ( 4400, 6600 ] 155 0.030% 100.135% ( 6600, 9900 ] 71 0.014% 100.149% ( 9900, 14000 ] 21 0.004% 100.153% ( 14000, 22000 ] 28 0.005% 100.159% ( 22000, 33000 ] 15 0.003% 100.162% ( 33000, 50000 ] 5 0.001% 100.162% ** Level 4 read latency histogram (micros): Count: 542464 Average: 35.2601 StdDev: 423.95 Min: 0 Median: 2.4116 Max: 68035 Percentiles: P50: 2.41 P75: 3.54 P99: 690.49 P99.9: 2516.32 P99.99: 3149.41 ------------------------------------------------------ [ 0, 1 ] 4141 0.763% 0.763% ( 1, 2 ] 197093 36.333% 37.096% ####### ( 2, 3 ] 170046 31.347% 68.443% ###### ( 3, 4 ] 65291 12.036% 80.479% ## ( 4, 6 ] 73057 13.468% 93.947% ### ( 6, 10 ] 17075 3.148% 97.095% # ( 10, 15 ] 3664 0.675% 97.770% ( 15, 22 ] 459 0.085% 97.855% ( 22, 34 ] 83 0.015% 97.870% ( 34, 51 ] 189 0.035% 97.905% ( 51, 76 ] 132 0.024% 97.929% ( 76, 110 ] 55 0.010% 97.939% ( 110, 170 ] 109 0.020% 97.959% ( 170, 250 ] 393 0.072% 98.032% ( 250, 380 ] 1284 0.237% 98.268% ( 380, 580 ] 2786 0.514% 98.782% ( 580, 870 ] 3106 0.573% 99.355% ( 870, 1300 ] 1723 0.318% 99.672% ( 1300, 1900 ] 733 0.135% 99.807% ( 1900, 2900 ] 817 0.151% 99.958% ( 2900, 4400 ] 1051 0.194% 100.152% ( 4400, 6600 ] 306 0.056% 100.208% ( 6600, 9900 ] 112 0.021% 100.229% ( 9900, 14000 ] 30 0.006% 100.234% ( 14000, 22000 ] 55 0.010% 100.244% ( 22000, 33000 ] 20 0.004% 100.248% ( 33000, 50000 ] 9 0.002% 100.250% ( 50000, 75000 ] 2 0.000% 100.250% ** Level 5 read latency histogram (micros): Count: 7440 Average: 1165.3918 StdDev: 1924.18 Min: 98 Median: 688.5450 Max: 65997 Percentiles: P50: 688.54 P75: 1137.40 P99: 6521.32 P99.9: 26693.33 P99.99: 56400.00 ------------------------------------------------------ ( 76, 110 ] 6 0.081% 0.081% ( 110, 170 ] 54 0.726% 0.806% ( 170, 250 ] 253 3.401% 4.207% # ( 250, 380 ] 880 11.828% 16.035% ## ( 380, 580 ] 1799 24.180% 40.215% ##### ( 580, 870 ] 1945 26.142% 66.358% ##### ( 870, 1300 ] 1034 13.898% 80.255% ### ( 1300, 1900 ] 373 5.013% 85.269% # ( 1900, 2900 ] 360 4.839% 90.108% # ( 2900, 4400 ] 516 6.935% 97.043% # ( 4400, 6600 ] 151 2.030% 99.073% ( 6600, 9900 ] 41 0.551% 99.624% ( 9900, 14000 ] 5 0.067% 99.691% ( 14000, 22000 ] 13 0.175% 99.866% ( 22000, 33000 ] 6 0.081% 99.946% ( 33000, 50000 ] 3 0.040% 99.987% ( 50000, 75000 ] 1 0.013% 100.000% ** DB Stats ** Uptime(secs): 7.1 total, 7.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 138.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.134 H:M:S, 30.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 140.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.134 H:M:S, 30.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/15-21:49:31 ... thread 0: (1000000,2000000) ops and (231065.2,176518.5) ops/second in (4.327783,11.330256) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/9 2.29 GB 162.6 1.5 0.0 1.5 3.3 1.8 0.0 1.8 77.0 172.8 19.60 11.88 31 0.632 1532K 8743 0.0 0.0 L1 5/5 327.02 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 972.01 MB 1.0 2.2 1.7 0.5 2.2 1.6 0.0 1.3 107.1 105.2 21.17 11.54 10 2.117 1490K 7778 0.0 0.0 L4 144/0 9.70 GB 1.0 5.9 2.2 3.6 5.2 1.6 0.3 2.4 129.1 115.3 46.51 28.37 25 1.860 1255K 0 0.0 0.0 L5 152/0 11.63 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 336/14 24.89 GB 0.0 9.6 3.9 5.7 10.7 5.1 2.9 5.8 112.1 125.8 87.28 51.80 66 1.322 4278K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.6 3.9 5.7 10.7 5.1 2.9 5.8 112.1 125.8 87.28 51.80 66 1.322 4278K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.6 3.9 5.7 8.9 3.2 0.0 0.0 127.2 118.3 76.87 46.11 40 1.922 4278K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 181.4 10.40 5.68 26 0.400 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.4 total, 11.3 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.72 GB write, 961.95 MB/s write, 9.55 GB read, 857.04 MB/s read, 87.3 seconds Interval compaction: 10.72 GB write, 968.70 MB/s write, 9.55 GB read, 863.05 MB/s read, 87.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 26, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 550210 Average: 28.9539 StdDev: 298.78 Min: 0 Median: 1.8401 Max: 61426 Percentiles: P50: 1.84 P75: 2.78 P99: 630.52 P99.9: 3145.08 P99.99: 4337.35 ------------------------------------------------------ [ 0, 1 ] 41454 7.534% 7.534% ## ( 1, 2 ] 278137 50.551% 58.085% ########## ( 2, 3 ] 120031 21.815% 79.901% #### ( 3, 4 ] 36905 6.707% 86.608% # ( 4, 6 ] 37435 6.804% 93.412% # ( 6, 10 ] 10360 1.883% 95.295% ( 10, 15 ] 1813 0.330% 95.624% ( 15, 22 ] 241 0.044% 95.668% ( 22, 34 ] 43 0.008% 95.676% ( 34, 51 ] 59 0.011% 95.687% ( 51, 76 ] 36 0.007% 95.693% ( 76, 110 ] 145 0.026% 95.720% ( 110, 170 ] 3120 0.567% 96.287% ( 170, 250 ] 7613 1.384% 97.670% ( 250, 380 ] 3505 0.637% 98.307% ( 380, 580 ] 3300 0.600% 98.907% ( 580, 870 ] 2933 0.533% 99.440% ( 870, 1300 ] 1481 0.269% 99.709% ( 1300, 1900 ] 474 0.086% 99.796% ( 1900, 2900 ] 473 0.086% 99.881% ( 2900, 4400 ] 623 0.113% 99.995% ( 4400, 6600 ] 171 0.031% 100.026% ( 6600, 9900 ] 48 0.009% 100.035% ( 9900, 14000 ] 13 0.002% 100.037% ( 14000, 22000 ] 17 0.003% 100.040% ( 22000, 33000 ] 8 0.001% 100.041% ( 33000, 50000 ] 5 0.001% 100.042% ( 50000, 75000 ] 1 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 59059 Average: 16.6501 StdDev: 157.51 Min: 1 Median: 3.2426 Max: 9090 Percentiles: P50: 3.24 P75: 4.87 P99: 280.26 P99.9: 2439.21 P99.99: 6223.94 ------------------------------------------------------ [ 0, 1 ] 229 0.388% 0.388% ( 1, 2 ] 12197 20.652% 21.040% #### ( 2, 3 ] 14389 24.364% 45.404% ##### ( 3, 4 ] 11188 18.944% 64.348% #### ( 4, 6 ] 14392 24.369% 88.716% ##### ( 6, 10 ] 3713 6.287% 95.003% # ( 10, 15 ] 1017 1.722% 96.725% ( 15, 22 ] 475 0.804% 97.530% ( 22, 34 ] 103 0.174% 97.704% ( 34, 51 ] 20 0.034% 97.738% ( 51, 76 ] 2 0.003% 97.741% ( 76, 110 ] 7 0.012% 97.753% ( 110, 170 ] 225 0.381% 98.134% ( 170, 250 ] 473 0.801% 98.935% ( 250, 380 ] 165 0.279% 99.214% ( 380, 580 ] 163 0.276% 99.490% ( 580, 870 ] 134 0.227% 99.717% ( 870, 1300 ] 71 0.120% 99.837% ( 1300, 1900 ] 24 0.041% 99.878% ( 1900, 2900 ] 24 0.041% 99.919% ( 2900, 4400 ] 28 0.047% 99.966% ( 4400, 6600 ] 17 0.029% 99.995% ( 6600, 9900 ] 5 0.008% 100.003% ** Level 2 read latency histogram (micros): Count: 271830 Average: 13.3730 StdDev: 231.86 Min: 1 Median: 2.3113 Max: 31183 Percentiles: P50: 2.31 P75: 3.30 P99: 12.46 P99.9: 1551.95 P99.99: 2906.25 ------------------------------------------------------ [ 0, 1 ] 1969 0.724% 0.724% ( 1, 2 ] 107319 39.480% 40.205% ######## ( 2, 3 ] 85524 31.462% 71.667% ###### ( 3, 4 ] 30607 11.260% 82.926% ## ( 4, 6 ] 34604 12.730% 95.656% ### ( 6, 10 ] 8170 3.006% 98.662% # ( 10, 15 ] 1868 0.687% 99.349% ( 15, 22 ] 274 0.101% 99.450% ( 22, 34 ] 33 0.012% 99.462% ( 34, 51 ] 45 0.017% 99.479% ( 51, 76 ] 40 0.015% 99.493% ( 76, 110 ] 15 0.006% 99.499% ( 110, 170 ] 33 0.012% 99.511% ( 170, 250 ] 58 0.021% 99.532% ( 250, 380 ] 191 0.070% 99.603% ( 380, 580 ] 319 0.117% 99.720% ( 580, 870 ] 281 0.103% 99.823% ( 870, 1300 ] 154 0.057% 99.880% ( 1300, 1900 ] 129 0.047% 99.928% ( 1900, 2900 ] 169 0.062% 99.990% ( 2900, 4400 ] 196 0.072% 100.062% ( 4400, 6600 ] 72 0.026% 100.088% ( 6600, 9900 ] 22 0.008% 100.096% ( 9900, 14000 ] 5 0.002% 100.098% ( 14000, 22000 ] 6 0.002% 100.100% ( 22000, 33000 ] 6 0.002% 100.103% ** Level 3 read latency histogram (micros): Count: 599536 Average: 18.9108 StdDev: 286.28 Min: 1 Median: 2.3633 Max: 41401 Percentiles: P50: 2.36 P75: 3.39 P99: 218.36 P99.9: 1519.78 P99.99: 2604.33 ------------------------------------------------------ [ 0, 1 ] 4769 0.795% 0.795% ( 1, 2 ] 224751 37.487% 38.283% ####### ( 2, 3 ] 193366 32.253% 70.536% ###### ( 3, 4 ] 68099 11.359% 81.894% ## ( 4, 6 ] 78007 13.011% 94.905% ### ( 6, 10 ] 18412 3.071% 97.976% # ( 10, 15 ] 3638 0.607% 98.583% ( 15, 22 ] 427 0.071% 98.654% ( 22, 34 ] 99 0.017% 98.671% ( 34, 51 ] 149 0.025% 98.696% ( 51, 76 ] 138 0.023% 98.719% ( 76, 110 ] 61 0.010% 98.729% ( 110, 170 ] 664 0.111% 98.840% ( 170, 250 ] 1589 0.265% 99.105% ( 250, 380 ] 1010 0.168% 99.273% ( 380, 580 ] 1409 0.235% 99.508% ( 580, 870 ] 1457 0.243% 99.751% ( 870, 1300 ] 753 0.126% 99.877% ( 1300, 1900 ] 378 0.063% 99.940% ( 1900, 2900 ] 426 0.071% 100.011% ( 2900, 4400 ] 538 0.090% 100.101% ( 4400, 6600 ] 162 0.027% 100.128% ( 6600, 9900 ] 71 0.012% 100.140% ( 9900, 14000 ] 21 0.004% 100.143% ( 14000, 22000 ] 28 0.005% 100.148% ( 22000, 33000 ] 15 0.003% 100.150% ( 33000, 50000 ] 5 0.001% 100.151% ** Level 4 read latency histogram (micros): Count: 944628 Average: 30.1053 StdDev: 333.49 Min: 0 Median: 2.4065 Max: 68035 Percentiles: P50: 2.41 P75: 3.60 P99: 502.89 P99.9: 1379.29 P99.99: 1900.52 ------------------------------------------------------ [ 0, 1 ] 8529 0.903% 0.903% ( 1, 2 ] 347728 36.811% 37.714% ####### ( 2, 3 ] 285525 30.226% 67.940% ###### ( 3, 4 ] 110405 11.688% 79.628% ## ( 4, 6 ] 122149 12.931% 92.559% ### ( 6, 10 ] 28805 3.049% 95.608% # ( 10, 15 ] 6215 0.658% 96.266% ( 15, 22 ] 732 0.077% 96.344% ( 22, 34 ] 117 0.012% 96.356% ( 34, 51 ] 244 0.026% 96.382% ( 51, 76 ] 198 0.021% 96.403% ( 76, 110 ] 267 0.028% 96.431% ( 110, 170 ] 5076 0.537% 96.968% ( 170, 250 ] 11526 1.220% 98.188% ( 250, 380 ] 4773 0.505% 98.694% ( 380, 580 ] 4708 0.498% 99.192% ( 580, 870 ] 4240 0.449% 99.641% ( 870, 1300 ] 2317 0.245% 99.886% ( 1300, 1900 ] 979 0.104% 99.990% ( 1900, 2900 ] 1030 0.109% 100.099% ( 2900, 4400 ] 1228 0.130% 100.229% ( 4400, 6600 ] 348 0.037% 100.266% ( 6600, 9900 ] 114 0.012% 100.278% ( 9900, 14000 ] 30 0.003% 100.281% ( 14000, 22000 ] 55 0.006% 100.287% ( 22000, 33000 ] 20 0.002% 100.289% ( 33000, 50000 ] 9 0.001% 100.290% ( 50000, 75000 ] 2 0.000% 100.290% ** Level 5 read latency histogram (micros): Count: 23763 Average: 564.1690 StdDev: 1186.51 Min: 94 Median: 249.3421 Max: 65997 Percentiles: P50: 249.34 P75: 553.69 P99: 4430.67 P99.9: 13374.34 P99.99: 42200.97 ------------------------------------------------------ ( 76, 110 ] 158 0.665% 0.665% ( 110, 170 ] 3583 15.078% 15.743% ### ( 170, 250 ] 8209 34.545% 50.288% ####### ( 250, 380 ] 3280 13.803% 64.091% ### ( 380, 580 ] 2986 12.566% 76.657% ### ( 580, 870 ] 2542 10.697% 87.354% ## ( 870, 1300 ] 1303 5.483% 92.838% # ( 1300, 1900 ] 455 1.915% 94.752% ( 1900, 2900 ] 434 1.826% 96.579% ( 2900, 4400 ] 574 2.416% 98.994% ( 4400, 6600 ] 170 0.715% 99.710% ( 6600, 9900 ] 42 0.177% 99.886% ( 9900, 14000 ] 5 0.021% 99.907% ( 14000, 22000 ] 13 0.055% 99.962% ( 22000, 33000 ] 6 0.025% 99.987% ( 33000, 50000 ] 3 0.013% 100.000% ( 50000, 75000 ] 1 0.004% 100.004% ** DB Stats ** Uptime(secs): 11.4 total, 4.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 172.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.507 H:M:S, 22.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 227.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.372 H:M:S, 8.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-21:49:34 ... thread 0: (1000000,3000000) ops and (274865.4,200422.2) ops/second in (3.638145,14.968401) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.81 GB 262.8 2.5 0.0 2.5 5.3 2.8 0.0 1.9 95.0 203.7 26.49 18.33 51 0.519 2554K 13K 0.0 0.0 L1 8/0 783.18 MB 78.3 0.8 0.5 0.3 0.8 0.4 0.0 1.7 62.3 61.4 12.76 5.17 1 12.757 807K 11K 0.0 0.0 L3 19/0 972.01 MB 1.0 2.2 1.7 0.5 2.2 1.6 0.0 1.3 107.1 105.2 21.17 11.54 10 2.117 1490K 7778 0.0 0.0 L4 144/0 9.70 GB 1.0 5.9 2.2 3.6 5.2 1.6 0.3 2.4 129.1 115.3 46.51 28.37 25 1.860 1255K 0 0.0 0.0 L5 152/0 11.63 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 338/4 25.85 GB 0.0 11.3 4.4 7.0 13.4 6.5 2.9 4.8 108.3 128.8 106.92 63.42 87 1.229 6107K 32K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.3 4.4 7.0 13.4 6.5 2.9 4.8 108.3 128.8 106.92 63.42 87 1.229 6107K 32K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.3 4.4 7.0 10.6 3.7 0.0 0.0 123.8 116.3 93.53 55.07 45 2.078 6107K 32K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 216.0 13.39 8.35 42 0.319 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.0 total, 15.0 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.45 GB write, 914.89 MB/s write, 11.31 GB read, 769.54 MB/s read, 106.9 seconds Interval compaction: 13.45 GB write, 919.74 MB/s write, 11.31 GB read, 773.62 MB/s read, 106.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 26, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 819891 Average: 22.7908 StdDev: 246.18 Min: 0 Median: 1.7048 Max: 61426 Percentiles: P50: 1.70 P75: 2.52 P99: 456.78 P99.9: 2289.70 P99.99: 3978.68 ------------------------------------------------------ [ 0, 1 ] 101184 12.341% 12.341% ## ( 1, 2 ] 438082 53.432% 65.773% ########### ( 2, 3 ] 145141 17.702% 83.475% #### ( 3, 4 ] 43894 5.354% 88.829% # ( 4, 6 ] 42995 5.244% 94.073% # ( 6, 10 ] 11566 1.411% 95.484% ( 10, 15 ] 2058 0.251% 95.735% ( 15, 22 ] 282 0.034% 95.769% ( 22, 34 ] 60 0.007% 95.776% ( 34, 51 ] 61 0.007% 95.784% ( 51, 76 ] 39 0.005% 95.789% ( 76, 110 ] 309 0.038% 95.826% ( 110, 170 ] 6549 0.799% 96.625% ( 170, 250 ] 13453 1.641% 98.266% ( 250, 380 ] 4616 0.563% 98.829% ( 380, 580 ] 3655 0.446% 99.275% ( 580, 870 ] 2976 0.363% 99.638% ( 870, 1300 ] 1487 0.181% 99.819% ( 1300, 1900 ] 479 0.058% 99.877% ( 1900, 2900 ] 475 0.058% 99.935% ( 2900, 4400 ] 623 0.076% 100.011% ( 4400, 6600 ] 171 0.021% 100.032% ( 6600, 9900 ] 48 0.006% 100.038% ( 9900, 14000 ] 13 0.002% 100.040% ( 14000, 22000 ] 17 0.002% 100.042% ( 22000, 33000 ] 8 0.001% 100.043% ( 33000, 50000 ] 5 0.001% 100.043% ( 50000, 75000 ] 1 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 86179 Average: 17.0531 StdDev: 134.60 Min: 1 Median: 3.2618 Max: 9090 Percentiles: P50: 3.26 P75: 4.91 P99: 260.11 P99.9: 1607.13 P99.99: 5743.57 ------------------------------------------------------ [ 0, 1 ] 267 0.310% 0.310% ( 1, 2 ] 16098 18.680% 18.990% #### ( 2, 3 ] 22345 25.929% 44.918% ##### ( 3, 4 ] 16726 19.408% 64.327% #### ( 4, 6 ] 20323 23.582% 87.909% ##### ( 6, 10 ] 4998 5.800% 93.708% # ( 10, 15 ] 1404 1.629% 95.338% ( 15, 22 ] 645 0.748% 96.086% ( 22, 34 ] 148 0.172% 96.258% ( 34, 51 ] 22 0.026% 96.283% ( 51, 76 ] 3 0.003% 96.287% ( 76, 110 ] 44 0.051% 96.338% ( 110, 170 ] 881 1.022% 97.360% ( 170, 250 ] 1386 1.608% 98.968% ( 250, 380 ] 350 0.406% 99.375% ( 380, 580 ] 220 0.255% 99.630% ( 580, 870 ] 147 0.171% 99.800% ( 870, 1300 ] 72 0.084% 99.884% ( 1300, 1900 ] 27 0.031% 99.915% ( 1900, 2900 ] 26 0.030% 99.945% ( 2900, 4400 ] 28 0.032% 99.978% ( 4400, 6600 ] 17 0.020% 99.998% ( 6600, 9900 ] 5 0.006% 100.003% ** Level 2 read latency histogram (micros): Count: 271830 Average: 13.3730 StdDev: 231.86 Min: 1 Median: 2.3113 Max: 31183 Percentiles: P50: 2.31 P75: 3.30 P99: 12.46 P99.9: 1551.95 P99.99: 2906.25 ------------------------------------------------------ [ 0, 1 ] 1969 0.724% 0.724% ( 1, 2 ] 107319 39.480% 40.205% ######## ( 2, 3 ] 85524 31.462% 71.667% ###### ( 3, 4 ] 30607 11.260% 82.926% ## ( 4, 6 ] 34604 12.730% 95.656% ### ( 6, 10 ] 8170 3.006% 98.662% # ( 10, 15 ] 1868 0.687% 99.349% ( 15, 22 ] 274 0.101% 99.450% ( 22, 34 ] 33 0.012% 99.462% ( 34, 51 ] 45 0.017% 99.479% ( 51, 76 ] 40 0.015% 99.493% ( 76, 110 ] 15 0.006% 99.499% ( 110, 170 ] 33 0.012% 99.511% ( 170, 250 ] 58 0.021% 99.532% ( 250, 380 ] 191 0.070% 99.603% ( 380, 580 ] 319 0.117% 99.720% ( 580, 870 ] 281 0.103% 99.823% ( 870, 1300 ] 154 0.057% 99.880% ( 1300, 1900 ] 129 0.047% 99.928% ( 1900, 2900 ] 169 0.062% 99.990% ( 2900, 4400 ] 196 0.072% 100.062% ( 4400, 6600 ] 72 0.026% 100.088% ( 6600, 9900 ] 22 0.008% 100.096% ( 9900, 14000 ] 5 0.002% 100.098% ( 14000, 22000 ] 6 0.002% 100.100% ( 22000, 33000 ] 6 0.002% 100.103% ** Level 3 read latency histogram (micros): Count: 602866 Average: 19.9191 StdDev: 285.87 Min: 1 Median: 2.3719 Max: 41401 Percentiles: P50: 2.37 P75: 3.43 P99: 244.63 P99.9: 1515.52 P99.99: 2603.55 ------------------------------------------------------ [ 0, 1 ] 4769 0.791% 0.791% ( 1, 2 ] 224751 37.280% 38.071% ####### ( 2, 3 ] 193366 32.074% 70.146% ###### ( 3, 4 ] 68099 11.296% 81.442% ## ( 4, 6 ] 78007 12.939% 94.381% ### ( 6, 10 ] 18412 3.054% 97.435% # ( 10, 15 ] 3638 0.603% 98.039% ( 15, 22 ] 427 0.071% 98.110% ( 22, 34 ] 99 0.016% 98.126% ( 34, 51 ] 149 0.025% 98.151% ( 51, 76 ] 138 0.023% 98.174% ( 76, 110 ] 128 0.021% 98.195% ( 110, 170 ] 1776 0.295% 98.489% ( 170, 250 ] 3300 0.547% 99.037% ( 250, 380 ] 1303 0.216% 99.253% ( 380, 580 ] 1536 0.255% 99.508% ( 580, 870 ] 1474 0.244% 99.752% ( 870, 1300 ] 755 0.125% 99.877% ( 1300, 1900 ] 379 0.063% 99.940% ( 1900, 2900 ] 426 0.071% 100.011% ( 2900, 4400 ] 538 0.089% 100.100% ( 4400, 6600 ] 162 0.027% 100.127% ( 6600, 9900 ] 71 0.012% 100.139% ( 9900, 14000 ] 21 0.003% 100.142% ( 14000, 22000 ] 28 0.005% 100.147% ( 22000, 33000 ] 15 0.002% 100.149% ( 33000, 50000 ] 5 0.001% 100.150% ** Level 4 read latency histogram (micros): Count: 972807 Average: 34.9652 StdDev: 330.09 Min: 0 Median: 2.4556 Max: 68035 Percentiles: P50: 2.46 P75: 3.79 P99: 509.17 P99.9: 1365.90 P99.99: 1899.22 ------------------------------------------------------ [ 0, 1 ] 8529 0.877% 0.877% ( 1, 2 ] 347741 35.746% 36.623% ####### ( 2, 3 ] 285602 29.359% 65.981% ###### ( 3, 4 ] 110468 11.356% 77.337% ## ( 4, 6 ] 122244 12.566% 89.903% ### ( 6, 10 ] 28816 2.962% 92.865% # ( 10, 15 ] 6218 0.639% 93.504% ( 15, 22 ] 732 0.075% 93.580% ( 22, 34 ] 117 0.012% 93.592% ( 34, 51 ] 244 0.025% 93.617% ( 51, 76 ] 198 0.020% 93.637% ( 76, 110 ] 781 0.080% 93.717% ( 110, 170 ] 14528 1.493% 95.211% ( 170, 250 ] 25927 2.665% 97.876% # ( 250, 380 ] 7347 0.755% 98.631% ( 380, 580 ] 5554 0.571% 99.202% ( 580, 870 ] 4353 0.447% 99.650% ( 870, 1300 ] 2327 0.239% 99.889% ( 1300, 1900 ] 985 0.101% 99.990% ( 1900, 2900 ] 1031 0.106% 100.096% ( 2900, 4400 ] 1228 0.126% 100.222% ( 4400, 6600 ] 348 0.036% 100.258% ( 6600, 9900 ] 114 0.012% 100.270% ( 9900, 14000 ] 30 0.003% 100.273% ( 14000, 22000 ] 55 0.006% 100.279% ( 22000, 33000 ] 20 0.002% 100.281% ( 33000, 50000 ] 9 0.001% 100.282% ( 50000, 75000 ] 2 0.000% 100.282% ** Level 5 read latency histogram (micros): Count: 42761 Average: 402.1350 StdDev: 904.22 Min: 92 Median: 218.4298 Max: 65997 Percentiles: P50: 218.43 P75: 341.04 P99: 3909.73 P99.9: 8740.21 P99.99: 32493.82 ------------------------------------------------------ ( 76, 110 ] 533 1.246% 1.246% ( 110, 170 ] 9952 23.274% 24.520% ##### ( 170, 250 ] 17998 42.090% 66.610% ######## ( 250, 380 ] 5123 11.981% 78.590% ## ( 380, 580 ] 3527 8.248% 86.838% ## ( 580, 870 ] 2614 6.113% 92.952% # ( 870, 1300 ] 1307 3.057% 96.008% # ( 1300, 1900 ] 459 1.073% 97.081% ( 1900, 2900 ] 434 1.015% 98.096% ( 2900, 4400 ] 574 1.342% 99.439% ( 4400, 6600 ] 170 0.398% 99.836% ( 6600, 9900 ] 42 0.098% 99.935% ( 9900, 14000 ] 5 0.012% 99.946% ( 14000, 22000 ] 13 0.030% 99.977% ( 22000, 33000 ] 6 0.014% 99.991% ( 33000, 50000 ] 3 0.007% 99.998% ( 50000, 75000 ] 1 0.002% 100.000% ** DB Stats ** Uptime(secs): 15.0 total, 3.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 196.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.507 H:M:S, 16.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 270.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/07/15-21:49:38 ... thread 0: (1000000,4000000) ops and (269770.4,214187.1) ops/second in (3.706856,18.675257) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/4 3.73 GB 356.6 3.4 0.0 3.4 7.2 3.7 0.0 1.9 105.8 220.6 33.28 24.72 70 0.475 3576K 18K 0.0 0.0 L1 8/0 783.18 MB 78.3 0.8 0.5 0.3 0.8 0.4 0.0 1.7 62.3 61.4 12.76 5.17 1 12.757 807K 11K 0.0 0.0 L3 19/0 972.01 MB 1.0 2.2 1.7 0.5 2.2 1.6 0.0 1.3 107.1 105.2 21.17 11.54 10 2.117 1490K 7778 0.0 0.0 L4 144/0 9.70 GB 1.0 5.9 2.2 3.6 5.2 1.6 0.3 2.4 129.1 115.3 46.51 28.37 25 1.860 1255K 0 0.0 0.0 L5 152/0 11.63 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 341/4 26.77 GB 0.0 12.3 4.4 7.9 15.3 7.4 2.9 4.1 110.7 138.2 113.71 69.81 106 1.073 7129K 37K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.3 4.4 7.9 15.3 7.4 2.9 4.1 110.7 138.2 113.71 69.81 106 1.073 7129K 37K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.3 4.4 7.9 11.6 3.7 0.0 0.0 129.2 121.9 97.40 58.84 49 1.988 7129K 37K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 235.2 16.31 10.97 57 0.286 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.8 total, 18.7 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.35 GB write, 837.80 MB/s write, 12.29 GB read, 671.12 MB/s read, 113.7 seconds Interval compaction: 15.35 GB write, 841.36 MB/s write, 12.29 GB read, 673.98 MB/s read, 113.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 26, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1092130 Average: 19.4058 StdDev: 214.25 Min: 0 Median: 1.6319 Max: 61426 Percentiles: P50: 1.63 P75: 2.32 P99: 350.71 P99.9: 1620.51 P99.99: 3585.68 ------------------------------------------------------ [ 0, 1 ] 167671 15.353% 15.353% ### ( 1, 2 ] 598843 54.833% 70.185% ########### ( 2, 3 ] 166684 15.262% 85.448% ### ( 3, 4 ] 50389 4.614% 90.061% # ( 4, 6 ] 48131 4.407% 94.468% # ( 6, 10 ] 12743 1.167% 95.635% ( 10, 15 ] 2290 0.210% 95.845% ( 15, 22 ] 337 0.031% 95.876% ( 22, 34 ] 88 0.008% 95.884% ( 34, 51 ] 66 0.006% 95.890% ( 51, 76 ] 40 0.004% 95.894% ( 76, 110 ] 558 0.051% 95.945% ( 110, 170 ] 10506 0.962% 96.907% ( 170, 250 ] 18746 1.716% 98.623% ( 250, 380 ] 5314 0.487% 99.110% ( 380, 580 ] 3876 0.355% 99.465% ( 580, 870 ] 3005 0.275% 99.740% ( 870, 1300 ] 1495 0.137% 99.877% ( 1300, 1900 ] 479 0.044% 99.920% ( 1900, 2900 ] 475 0.043% 99.964% ( 2900, 4400 ] 623 0.057% 100.021% ( 4400, 6600 ] 171 0.016% 100.037% ( 6600, 9900 ] 48 0.004% 100.041% ( 9900, 14000 ] 13 0.001% 100.042% ( 14000, 22000 ] 17 0.002% 100.044% ( 22000, 33000 ] 8 0.001% 100.045% ( 33000, 50000 ] 5 0.000% 100.045% ( 50000, 75000 ] 1 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 88750 Average: 21.7285 StdDev: 135.89 Min: 1 Median: 3.3351 Max: 9090 Percentiles: P50: 3.34 P75: 5.08 P99: 301.51 P99.9: 1550.00 P99.99: 5710.29 ------------------------------------------------------ [ 0, 1 ] 267 0.301% 0.301% ( 1, 2 ] 16112 18.154% 18.455% #### ( 2, 3 ] 22383 25.220% 43.675% ##### ( 3, 4 ] 16748 18.871% 62.546% #### ( 4, 6 ] 20375 22.958% 85.504% ##### ( 6, 10 ] 5005 5.639% 91.144% # ( 10, 15 ] 1405 1.583% 92.727% ( 15, 22 ] 645 0.727% 93.454% ( 22, 34 ] 148 0.167% 93.620% ( 34, 51 ] 22 0.025% 93.645% ( 51, 76 ] 3 0.003% 93.648% ( 76, 110 ] 114 0.128% 93.777% ( 110, 170 ] 1778 2.003% 95.780% ( 170, 250 ] 2657 2.994% 98.774% # ( 250, 380 ] 506 0.570% 99.344% ( 380, 580 ] 258 0.291% 99.635% ( 580, 870 ] 152 0.171% 99.806% ( 870, 1300 ] 72 0.081% 99.887% ( 1300, 1900 ] 27 0.030% 99.918% ( 1900, 2900 ] 26 0.029% 99.947% ( 2900, 4400 ] 28 0.032% 99.979% ( 4400, 6600 ] 17 0.019% 99.998% ( 6600, 9900 ] 5 0.006% 100.003% ** Level 2 read latency histogram (micros): Count: 271830 Average: 13.3730 StdDev: 231.86 Min: 1 Median: 2.3113 Max: 31183 Percentiles: P50: 2.31 P75: 3.30 P99: 12.46 P99.9: 1551.95 P99.99: 2906.25 ------------------------------------------------------ [ 0, 1 ] 1969 0.724% 0.724% ( 1, 2 ] 107319 39.480% 40.205% ######## ( 2, 3 ] 85524 31.462% 71.667% ###### ( 3, 4 ] 30607 11.260% 82.926% ## ( 4, 6 ] 34604 12.730% 95.656% ### ( 6, 10 ] 8170 3.006% 98.662% # ( 10, 15 ] 1868 0.687% 99.349% ( 15, 22 ] 274 0.101% 99.450% ( 22, 34 ] 33 0.012% 99.462% ( 34, 51 ] 45 0.017% 99.479% ( 51, 76 ] 40 0.015% 99.493% ( 76, 110 ] 15 0.006% 99.499% ( 110, 170 ] 33 0.012% 99.511% ( 170, 250 ] 58 0.021% 99.532% ( 250, 380 ] 191 0.070% 99.603% ( 380, 580 ] 319 0.117% 99.720% ( 580, 870 ] 281 0.103% 99.823% ( 870, 1300 ] 154 0.057% 99.880% ( 1300, 1900 ] 129 0.047% 99.928% ( 1900, 2900 ] 169 0.062% 99.990% ( 2900, 4400 ] 196 0.072% 100.062% ( 4400, 6600 ] 72 0.026% 100.088% ( 6600, 9900 ] 22 0.008% 100.096% ( 9900, 14000 ] 5 0.002% 100.098% ( 14000, 22000 ] 6 0.002% 100.100% ( 22000, 33000 ] 6 0.002% 100.103% ** Level 3 read latency histogram (micros): Count: 606140 Average: 20.8358 StdDev: 285.40 Min: 1 Median: 2.3804 Max: 41401 Percentiles: P50: 2.38 P75: 3.47 P99: 253.32 P99.9: 1510.33 P99.99: 2602.78 ------------------------------------------------------ [ 0, 1 ] 4769 0.787% 0.787% ( 1, 2 ] 224751 37.079% 37.866% ####### ( 2, 3 ] 193366 31.901% 69.767% ###### ( 3, 4 ] 68099 11.235% 81.002% ## ( 4, 6 ] 78007 12.869% 93.871% ### ( 6, 10 ] 18412 3.038% 96.909% # ( 10, 15 ] 3638 0.600% 97.509% ( 15, 22 ] 427 0.070% 97.580% ( 22, 34 ] 99 0.016% 97.596% ( 34, 51 ] 149 0.025% 97.621% ( 51, 76 ] 138 0.023% 97.643% ( 76, 110 ] 218 0.036% 97.679% ( 110, 170 ] 3012 0.497% 98.176% ( 170, 250 ] 4955 0.817% 98.994% ( 250, 380 ] 1511 0.249% 99.243% ( 380, 580 ] 1611 0.266% 99.509% ( 580, 870 ] 1484 0.245% 99.754% ( 870, 1300 ] 755 0.125% 99.878% ( 1300, 1900 ] 379 0.063% 99.941% ( 1900, 2900 ] 426 0.070% 100.011% ( 2900, 4400 ] 538 0.089% 100.100% ( 4400, 6600 ] 162 0.027% 100.126% ( 6600, 9900 ] 71 0.012% 100.138% ( 9900, 14000 ] 21 0.003% 100.142% ( 14000, 22000 ] 28 0.005% 100.146% ( 22000, 33000 ] 15 0.002% 100.149% ( 33000, 50000 ] 5 0.001% 100.149% ** Level 4 read latency histogram (micros): Count: 1001018 Average: 39.3647 StdDev: 326.62 Min: 0 Median: 2.5050 Max: 68035 Percentiles: P50: 2.51 P75: 3.99 P99: 510.07 P99.9: 1348.67 P99.99: 1896.90 ------------------------------------------------------ [ 0, 1 ] 8529 0.852% 0.852% ( 1, 2 ] 347741 34.739% 35.591% ####### ( 2, 3 ] 285602 28.531% 64.122% ###### ( 3, 4 ] 110468 11.036% 75.157% ## ( 4, 6 ] 122244 12.212% 87.369% ## ( 6, 10 ] 28816 2.879% 90.248% # ( 10, 15 ] 6218 0.621% 90.869% ( 15, 22 ] 732 0.073% 90.942% ( 22, 34 ] 117 0.012% 90.954% ( 34, 51 ] 244 0.024% 90.978% ( 51, 76 ] 198 0.020% 90.998% ( 76, 110 ] 1456 0.145% 91.144% ( 110, 170 ] 25111 2.509% 93.652% # ( 170, 250 ] 40215 4.017% 97.670% # ( 250, 380 ] 9286 0.928% 98.597% ( 380, 580 ] 6198 0.619% 99.216% ( 580, 870 ] 4427 0.442% 99.659% ( 870, 1300 ] 2335 0.233% 99.892% ( 1300, 1900 ] 986 0.098% 99.991% ( 1900, 2900 ] 1031 0.103% 100.094% ( 2900, 4400 ] 1228 0.123% 100.216% ( 4400, 6600 ] 348 0.035% 100.251% ( 6600, 9900 ] 114 0.011% 100.262% ( 9900, 14000 ] 30 0.003% 100.265% ( 14000, 22000 ] 55 0.005% 100.271% ( 22000, 33000 ] 20 0.002% 100.273% ( 33000, 50000 ] 9 0.001% 100.274% ( 50000, 75000 ] 2 0.000% 100.274% ** Level 5 read latency histogram (micros): Count: 61783 Average: 337.0337 StdDev: 759.44 Min: 90 Median: 206.9811 Max: 65997 Percentiles: P50: 206.98 P75: 261.70 P99: 3415.25 P99.9: 7324.19 P99.99: 30839.78 ------------------------------------------------------ ( 76, 110 ] 972 1.573% 1.573% ( 110, 170 ] 17137 27.737% 29.311% ###### ( 170, 250 ] 27652 44.757% 74.067% ######### ( 250, 380 ] 6405 10.367% 84.434% ## ( 380, 580 ] 3910 6.329% 90.763% # ( 580, 870 ] 2686 4.347% 95.110% # ( 870, 1300 ] 1313 2.125% 97.235% ( 1300, 1900 ] 459 0.743% 97.978% ( 1900, 2900 ] 434 0.702% 98.681% ( 2900, 4400 ] 574 0.929% 99.610% ( 4400, 6600 ] 170 0.275% 99.885% ( 6600, 9900 ] 42 0.068% 99.953% ( 9900, 14000 ] 5 0.008% 99.961% ( 14000, 22000 ] 13 0.021% 99.982% ( 22000, 33000 ] 6 0.010% 99.992% ( 33000, 50000 ] 3 0.005% 99.997% ( 50000, 75000 ] 1 0.002% 99.998% ** DB Stats ** Uptime(secs): 18.8 total, 3.7 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 209.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.529 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 265.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.022 H:M:S, 0.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 373.698 micros/op 10661 ops/sec 20.165 seconds 214996 operations; 10.3 MB/s (53999 of 53999 found) Microseconds per read: Count: 214996 Average: 373.7069 StdDev: 1120.42 Min: 2 Median: 230.1179 Max: 175458 Percentiles: P50: 230.12 P75: 341.48 P99: 3342.05 P99.9: 15624.30 P99.99: 41500.27 ------------------------------------------------------ ( 1, 2 ] 8 0.004% 0.004% ( 2, 3 ] 61 0.028% 0.032% ( 3, 4 ] 87 0.040% 0.073% ( 4, 6 ] 214 0.100% 0.172% ( 6, 10 ] 302 0.140% 0.313% ( 10, 15 ] 1296 0.603% 0.915% ( 15, 22 ] 3660 1.702% 2.618% ( 22, 34 ] 4543 2.113% 4.731% ( 34, 51 ] 2707 1.259% 5.990% ( 51, 76 ] 485 0.226% 6.215% ( 76, 110 ] 174 0.081% 6.296% ( 110, 170 ] 19641 9.136% 15.432% ## ( 170, 250 ] 98899 46.000% 61.432% ######### ( 250, 380 ] 41453 19.281% 80.713% #### ( 380, 580 ] 21737 10.110% 90.824% ## ( 580, 870 ] 9971 4.638% 95.461% # ( 870, 1300 ] 4399 2.046% 97.507% ( 1300, 1900 ] 1639 0.762% 98.270% ( 1900, 2900 ] 1133 0.527% 98.797% ( 2900, 4400 ] 1483 0.690% 99.487% ( 4400, 6600 ] 526 0.245% 99.731% ( 6600, 9900 ] 216 0.100% 99.832% ( 9900, 14000 ] 120 0.056% 99.887% ( 14000, 22000 ] 133 0.062% 99.949% ( 22000, 33000 ] 75 0.035% 99.984% ( 33000, 50000 ] 25 0.012% 99.996% ( 50000, 75000 ] 8 0.004% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3279692 rocksdb.bloom.filter.full.positive COUNT : 245845 rocksdb.bloom.filter.full.true.positive COUNT : 214018 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 978 rocksdb.memtable.miss COUNT : 214018 rocksdb.l0.hit COUNT : 26909 rocksdb.l1.hit COUNT : 5584 rocksdb.l2andup.hit COUNT : 181525 rocksdb.compaction.key.drop.new COUNT : 724717 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4279742 rocksdb.number.keys.read COUNT : 214996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4416693744 rocksdb.bytes.read COUNT : 214996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 516 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 2964644 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 13491696682 rocksdb.compact.write.bytes COUNT : 12738639984 rocksdb.flush.write.bytes COUNT : 4353065018 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 765 rocksdb.number.superversion_releases COUNT : 733 rocksdb.number.superversion_cleanups COUNT : 189 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 173 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4324637696 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7799808 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 13375725140 rocksdb.non.last.level.read.count COUNT : 3200572 rocksdb.block.checksum.compute.count COUNT : 3515697 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 229.471616 P95 : 840.509366 P99 : 3337.456022 P100 : 175458.000000 COUNT : 214996 SUM : 80158346 rocksdb.db.write.micros P50 : 1.571638 P95 : 4.965671 P99 : 6.644758 P100 : 859785.000000 COUNT : 4279742 SUM : 14565731 rocksdb.compaction.times.micros P50 : 1705555.555556 P95 : 2872222.222222 P99 : 11900000.000000 P100 : 12757446.000000 COUNT : 50 SUM : 98350379 rocksdb.compaction.times.cpu_micros P50 : 1098000.000000 P95 : 1830000.000000 P99 : 5171241.000000 P100 : 5171241.000000 COUNT : 50 SUM : 59768821 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 773.333333 P95 : 6490.000000 P99 : 10855.000000 P100 : 10855.000000 COUNT : 62 SUM : 98453 rocksdb.compaction.outfile.sync.micros P50 : 2979.787234 P95 : 8803.928571 P99 : 17760.000000 P100 : 50123.000000 COUNT : 153 SUM : 557509 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 170.000000 P95 : 1063.500000 P99 : 3470.000000 P100 : 3789.000000 COUNT : 124 SUM : 41845 rocksdb.table.open.io.micros P50 : 5883.146067 P95 : 18480.000000 P99 : 23848.000000 P100 : 144493.000000 COUNT : 516 SUM : 3558680 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.339467 P95 : 9.592638 P99 : 89.123306 P100 : 48192.000000 COUNT : 3266387 SUM : 49528430 rocksdb.read.block.get.micros P50 : 197.667630 P95 : 749.075707 P99 : 2899.343598 P100 : 66157.000000 COUNT : 248781 SUM : 71211431 rocksdb.write.raw.block.micros P50 : 0.535482 P95 : 1.369729 P99 : 4.236985 P100 : 124247.000000 COUNT : 4139991 SUM : 16304350 rocksdb.numfiles.in.singlecompaction P50 : 3.171429 P95 : 3.968571 P99 : 25.000000 P100 : 25.000000 COUNT : 62 SUM : 239 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560656 P95 : 1103.137441 P99 : 1270.409479 P100 : 859609.000000 COUNT : 4104 SUM : 2965125 rocksdb.sst.read.micros P50 : 2.119689 P95 : 183.358667 P99 : 530.725955 P100 : 68035.000000 COUNT : 3200592 SUM : 105463020 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 214996 SUM : 214996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4279742 SUM : 4416693744 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 222173.913043 P95 : 845500.000000 P99 : 1129733.333333 P100 : 1170998.000000 COUNT : 62 SUM : 17242719 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 173 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0