[2024-12-06 15:32:50.357127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-06 15:32:50.357269] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2291944 ] Set seed to 1733495570353623 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-06 15:32:50.463426] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-06 15:32:50.675904] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-06 15:32:50.675951] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2291944' to capture a snapshot of events at runtime. [2024-12-06 15:32:50.675962] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2291944 for offline analysis/debug. [2024-12-06 15:32:50.675986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 6 15:32:59 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/06-15:33:07 ... thread 0: (1000000,1000000) ops and (124479.6,124479.6) ops/second in (8.033442,8.033442) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 2.07 GB 56.6 0.4 0.0 0.4 1.2 0.9 0.0 1.4 42.3 140.8 8.94 4.03 11 0.813 383K 586 0.0 0.0 L1 9/9 1.02 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 20/2 1.15 GB 0.9 1.6 0.9 0.7 1.6 0.9 0.1 1.8 103.8 102.8 16.05 7.83 6 2.675 915K 0 0.0 0.0 L4 166/6 9.75 GB 1.0 4.7 3.6 1.1 4.7 3.6 0.0 1.3 107.5 106.7 44.91 22.54 34 1.321 1876K 0 0.0 0.0 L5 1112/0 91.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1317/24 105.47 GB 0.0 6.7 4.5 2.2 7.5 5.3 3.5 8.7 98.3 110.2 69.91 34.41 51 1.371 3175K 586 0.0 0.0 Int 0/0 0.00 KB 0.0 6.7 4.5 2.2 7.5 5.3 3.5 8.7 98.3 110.2 69.91 34.41 51 1.371 3175K 586 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.7 4.5 2.2 6.7 4.4 0.0 0.0 108.3 107.5 63.47 31.92 41 1.548 3175K 586 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 137.0 6.44 2.49 10 0.644 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.2 total, 8.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.52 GB write, 934.45 MB/s write, 6.71 GB read, 833.87 MB/s read, 69.9 seconds Interval compaction: 7.52 GB write, 958.61 MB/s write, 6.71 GB read, 855.43 MB/s read, 69.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 19, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 382814 Average: 13.5395 StdDev: 183.44 Min: 1 Median: 2.0717 Max: 20833 Percentiles: P50: 2.07 P75: 3.09 P99: 12.61 P99.9: 2705.60 P99.99: 4182.93 ------------------------------------------------------ [ 0, 1 ] 9904 2.587% 2.587% # ( 1, 2 ] 174365 45.548% 48.135% ######### ( 2, 3 ] 99533 26.000% 74.136% ##### ( 3, 4 ] 35132 9.177% 83.313% ## ( 4, 6 ] 47142 12.315% 95.628% ## ( 6, 10 ] 11363 2.968% 98.596% # ( 10, 15 ] 2963 0.774% 99.370% ( 15, 22 ] 381 0.100% 99.469% ( 22, 34 ] 33 0.009% 99.478% ( 34, 51 ] 12 0.003% 99.481% ( 51, 76 ] 15 0.004% 99.485% ( 76, 110 ] 8 0.002% 99.487% ( 110, 170 ] 21 0.005% 99.493% ( 170, 250 ] 53 0.014% 99.507% ( 250, 380 ] 83 0.022% 99.528% ( 380, 580 ] 159 0.042% 99.570% ( 580, 870 ] 227 0.059% 99.629% ( 870, 1300 ] 298 0.078% 99.707% ( 1300, 1900 ] 398 0.104% 99.811% ( 1900, 2900 ] 426 0.111% 99.922% ( 2900, 4400 ] 306 0.080% 100.002% ( 4400, 6600 ] 83 0.022% 100.024% ( 6600, 9900 ] 16 0.004% 100.028% ( 9900, 14000 ] 7 0.002% 100.030% ( 14000, 22000 ] 3 0.001% 100.031% ** Level 1 read latency histogram (micros): Count: 127 Average: 2713.3307 StdDev: 4034.66 Min: 106 Median: 1120.8333 Max: 20759 Percentiles: P50: 1120.83 P75: 2934.09 P99: 19460.00 P99.9: 20759.00 P99.99: 20759.00 ------------------------------------------------------ ( 76, 110 ] 1 0.787% 0.787% ( 110, 170 ] 3 2.362% 3.150% ( 170, 250 ] 8 6.299% 9.449% # ( 250, 380 ] 9 7.087% 16.535% # ( 380, 580 ] 9 7.087% 23.622% # ( 580, 870 ] 23 18.110% 41.732% #### ( 870, 1300 ] 18 14.173% 55.906% ### ( 1300, 1900 ] 14 11.024% 66.929% ## ( 1900, 2900 ] 10 7.874% 74.803% ## ( 2900, 4400 ] 11 8.661% 83.465% ## ( 4400, 6600 ] 5 3.937% 87.402% # ( 6600, 9900 ] 9 7.087% 94.488% # ( 9900, 14000 ] 3 2.362% 96.850% ( 14000, 22000 ] 4 3.150% 100.000% # ** Level 2 read latency histogram (micros): Count: 218674 Average: 15.8748 StdDev: 207.61 Min: 1 Median: 1.9443 Max: 20882 Percentiles: P50: 1.94 P75: 3.00 P99: 13.05 P99.9: 2552.36 P99.99: 3555.23 ------------------------------------------------------ [ 0, 1 ] 7357 3.364% 3.364% # ( 1, 2 ] 107990 49.384% 52.748% ########## ( 2, 3 ] 48586 22.218% 74.967% #### ( 3, 4 ] 20972 9.591% 84.557% ## ( 4, 6 ] 24529 11.217% 95.775% ## ( 6, 10 ] 5972 2.731% 98.506% # ( 10, 15 ] 1772 0.810% 99.316% ( 15, 22 ] 239 0.109% 99.425% ( 22, 34 ] 24 0.011% 99.436% ( 34, 51 ] 5 0.002% 99.438% ( 51, 76 ] 4 0.002% 99.440% ( 76, 110 ] 6 0.003% 99.443% ( 110, 170 ] 12 0.005% 99.448% ( 170, 250 ] 11 0.005% 99.454% ( 250, 380 ] 26 0.012% 99.465% ( 380, 580 ] 68 0.031% 99.497% ( 580, 870 ] 113 0.052% 99.548% ( 870, 1300 ] 216 0.099% 99.647% ( 1300, 1900 ] 325 0.149% 99.796% ( 1900, 2900 ] 350 0.160% 99.956% ( 2900, 4400 ] 172 0.079% 100.034% ( 4400, 6600 ] 58 0.027% 100.061% ( 6600, 9900 ] 16 0.007% 100.068% ( 9900, 14000 ] 4 0.002% 100.070% ( 14000, 22000 ] 4 0.002% 100.072% ** Level 3 read latency histogram (micros): Count: 983742 Average: 14.2290 StdDev: 183.53 Min: 1 Median: 1.9908 Max: 15688 Percentiles: P50: 1.99 P75: 3.04 P99: 11.00 P99.9: 1590.20 P99.99: 2146.90 ------------------------------------------------------ [ 0, 1 ] 22274 2.264% 2.264% ( 1, 2 ] 473968 48.180% 50.444% ########## ( 2, 3 ] 237996 24.193% 74.637% ##### ( 3, 4 ] 97967 9.959% 84.596% ## ( 4, 6 ] 116299 11.822% 96.418% ## ( 6, 10 ] 24011 2.441% 98.859% ( 10, 15 ] 6976 0.709% 99.568% ( 15, 22 ] 842 0.086% 99.653% ( 22, 34 ] 78 0.008% 99.661% ( 34, 51 ] 37 0.004% 99.665% ( 51, 76 ] 49 0.005% 99.670% ( 76, 110 ] 23 0.002% 99.672% ( 110, 170 ] 31 0.003% 99.676% ( 170, 250 ] 50 0.005% 99.681% ( 250, 380 ] 133 0.014% 99.694% ( 380, 580 ] 237 0.024% 99.718% ( 580, 870 ] 470 0.048% 99.766% ( 870, 1300 ] 777 0.079% 99.845% ( 1300, 1900 ] 1117 0.114% 99.959% ( 1900, 2900 ] 1250 0.127% 100.086% ( 2900, 4400 ] 874 0.089% 100.175% ( 4400, 6600 ] 293 0.030% 100.204% ( 6600, 9900 ] 48 0.005% 100.209% ( 9900, 14000 ] 3 0.000% 100.210% ( 14000, 22000 ] 1 0.000% 100.210% ** Level 4 read latency histogram (micros): Count: 323173 Average: 35.1176 StdDev: 298.07 Min: 1 Median: 2.0311 Max: 14140 Percentiles: P50: 2.03 P75: 3.13 P99: 1207.01 P99.9: 3787.37 P99.99: 4363.70 ------------------------------------------------------ [ 0, 1 ] 7388 2.286% 2.286% ( 1, 2 ] 151744 46.954% 49.240% ######### ( 2, 3 ] 78909 24.417% 73.657% ##### ( 3, 4 ] 32285 9.990% 83.647% ## ( 4, 6 ] 36075 11.163% 94.810% ## ( 6, 10 ] 8674 2.684% 97.494% # ( 10, 15 ] 2289 0.708% 98.203% ( 15, 22 ] 254 0.079% 98.281% ( 22, 34 ] 21 0.006% 98.288% ( 34, 51 ] 25 0.008% 98.295% ( 51, 76 ] 21 0.006% 98.302% ( 76, 110 ] 13 0.004% 98.306% ( 110, 170 ] 69 0.021% 98.327% ( 170, 250 ] 193 0.060% 98.387% ( 250, 380 ] 224 0.069% 98.456% ( 380, 580 ] 386 0.119% 98.576% ( 580, 870 ] 622 0.192% 98.768% ( 870, 1300 ] 956 0.296% 99.064% ( 1300, 1900 ] 1108 0.343% 99.407% ( 1900, 2900 ] 1146 0.355% 99.761% ( 2900, 4400 ] 757 0.234% 99.996% ( 4400, 6600 ] 238 0.074% 100.069% ( 6600, 9900 ] 33 0.010% 100.080% ( 9900, 14000 ] 4 0.001% 100.081% ( 14000, 22000 ] 1 0.000% 100.081% ** Level 5 read latency histogram (micros): Count: 11833 Average: 1945.8334 StdDev: 1709.96 Min: 83 Median: 1393.5368 Max: 27027 Percentiles: P50: 1393.54 P75: 2793.62 P99: 8345.59 P99.9: 11585.65 P99.99: 21266.80 ------------------------------------------------------ ( 76, 110 ] 12 0.101% 0.101% ( 110, 170 ] 156 1.318% 1.420% ( 170, 250 ] 422 3.566% 4.986% # ( 250, 380 ] 743 6.279% 11.265% # ( 380, 580 ] 1073 9.068% 20.333% ## ( 580, 870 ] 1499 12.668% 33.001% ### ( 870, 1300 ] 1751 14.798% 47.799% ### ( 1300, 1900 ] 1671 14.122% 61.920% ### ( 1900, 2900 ] 1732 14.637% 76.557% ### ( 2900, 4400 ] 1644 13.893% 90.450% ### ( 4400, 6600 ] 899 7.597% 98.048% ## ( 6600, 9900 ] 213 1.800% 99.848% ( 9900, 14000 ] 15 0.127% 99.975% ( 14000, 22000 ] 2 0.017% 99.992% ( 22000, 33000 ] 1 0.008% 100.000% ** DB Stats ** Uptime(secs): 8.2 total, 8.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 119.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.222 H:M:S, 51.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 122.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.222 H:M:S, 52.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/06-15:33:10 ... thread 0: (1000000,2000000) ops and (288502.3,173918.8) ops/second in (3.466177,11.499619) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/7 3.06 GB 163.6 1.4 0.0 1.4 3.3 1.8 0.0 1.8 87.1 200.5 16.64 11.05 31 0.537 1471K 1753 0.0 0.0 L1 9/9 1.02 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 924.89 MB 0.9 1.6 0.9 0.7 1.6 0.9 0.1 1.8 103.8 102.8 16.05 7.83 6 2.675 915K 0 0.0 0.0 L4 165/0 9.69 GB 1.0 5.2 3.9 1.4 5.2 3.8 0.0 1.3 111.3 110.4 47.92 24.93 36 1.331 2179K 3459 0.0 0.0 L5 1116/0 91.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1322/16 106.45 GB 0.0 8.3 4.7 3.5 10.0 6.5 3.8 5.4 104.8 127.5 80.62 43.81 73 1.104 4566K 5212 0.0 0.0 Int 0/0 0.00 KB 0.0 8.3 4.7 3.5 10.0 6.5 3.8 5.4 104.8 127.5 80.62 43.81 73 1.104 4566K 5212 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.3 4.7 3.5 8.2 4.7 0.0 0.0 119.3 118.4 70.86 38.53 47 1.508 4566K 5212 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 193.7 9.75 5.28 26 0.375 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.7 total, 11.5 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.04 GB write, 877.92 MB/s write, 8.25 GB read, 721.72 MB/s read, 80.6 seconds Interval compaction: 10.04 GB write, 893.78 MB/s write, 8.25 GB read, 734.76 MB/s read, 80.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 19, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 667944 Average: 11.9203 StdDev: 143.54 Min: 0 Median: 1.8167 Max: 20833 Percentiles: P50: 1.82 P75: 2.76 P99: 174.99 P99.9: 1763.39 P99.99: 3261.57 ------------------------------------------------------ [ 0, 1 ] 56870 8.514% 8.514% ## ( 1, 2 ] 339315 50.800% 59.314% ########## ( 2, 3 ] 137065 20.520% 79.835% #### ( 3, 4 ] 48098 7.201% 87.035% # ( 4, 6 ] 58185 8.711% 95.746% ## ( 6, 10 ] 14068 2.106% 97.853% ( 10, 15 ] 3612 0.541% 98.393% ( 15, 22 ] 547 0.082% 98.475% ( 22, 34 ] 59 0.009% 98.484% ( 34, 51 ] 15 0.002% 98.486% ( 51, 76 ] 16 0.002% 98.489% ( 76, 110 ] 365 0.055% 98.543% ( 110, 170 ] 2893 0.433% 98.977% ( 170, 250 ] 2525 0.378% 99.355% ( 250, 380 ] 1274 0.191% 99.545% ( 380, 580 ] 1048 0.157% 99.702% ( 580, 870 ] 602 0.090% 99.792% ( 870, 1300 ] 398 0.060% 99.852% ( 1300, 1900 ] 417 0.062% 99.914% ( 1900, 2900 ] 431 0.065% 99.979% ( 2900, 4400 ] 312 0.047% 100.026% ( 4400, 6600 ] 83 0.012% 100.038% ( 6600, 9900 ] 16 0.002% 100.040% ( 9900, 14000 ] 7 0.001% 100.041% ( 14000, 22000 ] 3 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 57054 Average: 11.8635 StdDev: 231.12 Min: 1 Median: 1.9983 Max: 20759 Percentiles: P50: 2.00 P75: 3.14 P99: 155.71 P99.9: 1259.85 P99.99: 10302.62 ------------------------------------------------------ [ 0, 1 ] 2241 3.928% 3.928% # ( 1, 2 ] 26331 46.151% 50.079% ######### ( 2, 3 ] 13436 23.550% 73.628% ##### ( 3, 4 ] 5674 9.945% 83.573% ## ( 4, 6 ] 6178 10.828% 94.402% ## ( 6, 10 ] 1764 3.092% 97.494% # ( 10, 15 ] 443 0.776% 98.270% ( 15, 22 ] 168 0.294% 98.565% ( 22, 34 ] 29 0.051% 98.615% ( 34, 51 ] 2 0.004% 98.619% ( 76, 110 ] 27 0.047% 98.666% ( 110, 170 ] 250 0.438% 99.104% ( 170, 250 ] 209 0.366% 99.471% ( 250, 380 ] 107 0.188% 99.658% ( 380, 580 ] 70 0.123% 99.781% ( 580, 870 ] 48 0.084% 99.865% ( 870, 1300 ] 22 0.039% 99.904% ( 1300, 1900 ] 14 0.025% 99.928% ( 1900, 2900 ] 10 0.018% 99.946% ( 2900, 4400 ] 11 0.019% 99.965% ( 4400, 6600 ] 5 0.009% 99.974% ( 6600, 9900 ] 9 0.016% 99.989% ( 9900, 14000 ] 3 0.005% 99.995% ( 14000, 22000 ] 4 0.007% 100.002% ** Level 2 read latency histogram (micros): Count: 228654 Average: 15.3179 StdDev: 203.08 Min: 1 Median: 1.9367 Max: 20882 Percentiles: P50: 1.94 P75: 2.98 P99: 12.84 P99.9: 2523.85 P99.99: 3546.52 ------------------------------------------------------ [ 0, 1 ] 7761 3.394% 3.394% # ( 1, 2 ] 113770 49.756% 53.151% ########## ( 2, 3 ] 50732 22.187% 75.338% #### ( 3, 4 ] 21624 9.457% 84.795% ## ( 4, 6 ] 25270 11.052% 95.847% ## ( 6, 10 ] 6185 2.705% 98.552% # ( 10, 15 ] 1804 0.789% 99.340% ( 15, 22 ] 242 0.106% 99.446% ( 22, 34 ] 24 0.010% 99.457% ( 34, 51 ] 5 0.002% 99.459% ( 51, 76 ] 4 0.002% 99.461% ( 76, 110 ] 6 0.003% 99.463% ( 110, 170 ] 12 0.005% 99.469% ( 170, 250 ] 15 0.007% 99.475% ( 250, 380 ] 29 0.013% 99.488% ( 380, 580 ] 68 0.030% 99.518% ( 580, 870 ] 113 0.049% 99.567% ( 870, 1300 ] 218 0.095% 99.662% ( 1300, 1900 ] 325 0.142% 99.805% ( 1900, 2900 ] 350 0.153% 99.958% ( 2900, 4400 ] 172 0.075% 100.033% ( 4400, 6600 ] 58 0.025% 100.058% ( 6600, 9900 ] 16 0.007% 100.065% ( 9900, 14000 ] 4 0.002% 100.067% ( 14000, 22000 ] 4 0.002% 100.069% ** Level 3 read latency histogram (micros): Count: 994821 Average: 14.2281 StdDev: 182.63 Min: 1 Median: 1.9880 Max: 15688 Percentiles: P50: 1.99 P75: 3.03 P99: 11.30 P99.9: 1584.53 P99.99: 2146.01 ------------------------------------------------------ [ 0, 1 ] 22733 2.285% 2.285% ( 1, 2 ] 480442 48.294% 50.579% ########## ( 2, 3 ] 240037 24.129% 74.708% ##### ( 3, 4 ] 98652 9.917% 84.625% ## ( 4, 6 ] 116976 11.758% 96.383% ## ( 6, 10 ] 24220 2.435% 98.818% ( 10, 15 ] 6999 0.704% 99.521% ( 15, 22 ] 845 0.085% 99.606% ( 22, 34 ] 78 0.008% 99.614% ( 34, 51 ] 37 0.004% 99.618% ( 51, 76 ] 49 0.005% 99.623% ( 76, 110 ] 46 0.005% 99.627% ( 110, 170 ] 194 0.020% 99.647% ( 170, 250 ] 227 0.023% 99.670% ( 250, 380 ] 194 0.020% 99.689% ( 380, 580 ] 289 0.029% 99.718% ( 580, 870 ] 497 0.050% 99.768% ( 870, 1300 ] 781 0.079% 99.847% ( 1300, 1900 ] 1118 0.112% 99.959% ( 1900, 2900 ] 1250 0.126% 100.085% ( 2900, 4400 ] 874 0.088% 100.173% ( 4400, 6600 ] 293 0.029% 100.202% ( 6600, 9900 ] 48 0.005% 100.207% ( 9900, 14000 ] 3 0.000% 100.207% ( 14000, 22000 ] 1 0.000% 100.207% ** Level 4 read latency histogram (micros): Count: 353878 Average: 35.9477 StdDev: 287.03 Min: 1 Median: 2.0215 Max: 14140 Percentiles: P50: 2.02 P75: 3.17 P99: 1083.59 P99.9: 3717.52 P99.99: 4347.78 ------------------------------------------------------ [ 0, 1 ] 8416 2.378% 2.378% ( 1, 2 ] 166711 47.110% 49.488% ######### ( 2, 3 ] 84396 23.849% 73.337% ##### ( 3, 4 ] 33870 9.571% 82.908% ## ( 4, 6 ] 37895 10.708% 93.616% ## ( 6, 10 ] 9215 2.604% 96.220% # ( 10, 15 ] 2369 0.669% 96.890% ( 15, 22 ] 259 0.073% 96.963% ( 22, 34 ] 22 0.006% 96.969% ( 34, 51 ] 25 0.007% 96.976% ( 51, 76 ] 21 0.006% 96.982% ( 76, 110 ] 177 0.050% 97.032% ( 110, 170 ] 1960 0.554% 97.586% ( 170, 250 ] 1816 0.513% 98.099% ( 250, 380 ] 917 0.259% 98.358% ( 380, 580 ] 947 0.268% 98.626% ( 580, 870 ] 825 0.233% 98.859% ( 870, 1300 ] 1003 0.283% 99.143% ( 1300, 1900 ] 1115 0.315% 99.458% ( 1900, 2900 ] 1152 0.326% 99.783% ( 2900, 4400 ] 758 0.214% 99.997% ( 4400, 6600 ] 238 0.067% 100.065% ( 6600, 9900 ] 33 0.009% 100.074% ( 9900, 14000 ] 4 0.001% 100.075% ( 14000, 22000 ] 1 0.000% 100.075% ** Level 5 read latency histogram (micros): Count: 49189 Average: 656.4133 StdDev: 1120.80 Min: 83 Median: 231.4041 Max: 27027 Percentiles: P50: 231.40 P75: 541.38 P99: 5956.67 P99.9: 9385.80 P99.99: 12928.83 ------------------------------------------------------ ( 76, 110 ] 1452 2.952% 2.952% # ( 110, 170 ] 14057 28.578% 31.529% ###### ( 170, 250 ] 11837 24.064% 55.594% ##### ( 250, 380 ] 5730 11.649% 67.243% ## ( 380, 580 ] 4729 9.614% 76.857% ## ( 580, 870 ] 3023 6.146% 83.002% # ( 870, 1300 ] 2081 4.231% 87.233% # ( 1300, 1900 ] 1734 3.525% 90.758% # ( 1900, 2900 ] 1764 3.586% 94.344% # ( 2900, 4400 ] 1654 3.363% 97.707% # ( 4400, 6600 ] 899 1.828% 99.534% ( 6600, 9900 ] 213 0.433% 99.967% ( 9900, 14000 ] 15 0.030% 99.998% ( 14000, 22000 ] 2 0.004% 100.002% ( 22000, 33000 ] 1 0.002% 100.004% ** DB Stats ** Uptime(secs): 11.7 total, 3.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 168.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.222 H:M:S, 36.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 283.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-15:33:14 ... thread 0: (1000000,3000000) ops and (283209.7,199593.2) ops/second in (3.530953,15.030572) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/7 3.98 GB 258.0 2.4 0.0 2.4 5.2 2.8 0.0 1.9 104.7 225.3 23.47 17.38 50 0.469 2494K 2725 0.0 0.0 L1 9/9 1.02 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 924.89 MB 0.9 1.6 0.9 0.7 1.6 0.9 0.1 1.8 103.8 102.8 16.05 7.83 6 2.675 915K 0 0.0 0.0 L4 165/0 9.69 GB 1.0 5.2 3.9 1.4 5.2 3.8 0.0 1.3 111.3 110.4 47.92 24.93 36 1.331 2179K 3459 0.0 0.0 L5 1116/0 91.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1325/16 107.37 GB 0.0 9.2 4.7 4.5 11.9 7.4 3.8 4.3 108.2 139.9 87.45 50.14 92 0.951 5589K 6184 0.0 0.0 Int 0/0 0.00 KB 0.0 9.2 4.7 4.5 11.9 7.4 3.8 4.3 108.2 139.9 87.45 50.14 92 0.951 5589K 6184 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.2 4.7 4.5 9.2 4.7 0.0 0.0 126.6 125.8 74.71 42.30 51 1.465 5589K 6184 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 222.4 12.75 7.84 41 0.311 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.94 GB write, 802.60 MB/s write, 9.24 GB read, 620.64 MB/s read, 87.5 seconds Interval compaction: 11.94 GB write, 813.69 MB/s write, 9.24 GB read, 629.22 MB/s read, 87.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 19, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 954610 Average: 11.2526 StdDev: 123.42 Min: 0 Median: 1.7077 Max: 20833 Percentiles: P50: 1.71 P75: 2.53 P99: 210.12 P99.9: 1244.61 P99.99: 2763.62 ------------------------------------------------------ [ 0, 1 ] 112709 11.807% 11.807% ## ( 1, 2 ] 515180 53.968% 65.774% ########### ( 2, 3 ] 166177 17.408% 83.182% ### ( 3, 4 ] 56958 5.967% 89.149% # ( 4, 6 ] 64550 6.762% 95.911% # ( 6, 10 ] 15458 1.619% 97.530% ( 10, 15 ] 3975 0.416% 97.946% ( 15, 22 ] 601 0.063% 98.009% ( 22, 34 ] 64 0.007% 98.016% ( 34, 51 ] 17 0.002% 98.018% ( 51, 76 ] 18 0.002% 98.020% ( 76, 110 ] 655 0.069% 98.088% ( 110, 170 ] 5948 0.623% 98.712% ( 170, 250 ] 5493 0.575% 99.287% ( 250, 380 ] 2554 0.268% 99.554% ( 380, 580 ] 1970 0.206% 99.761% ( 580, 870 ] 933 0.098% 99.859% ( 870, 1300 ] 455 0.048% 99.906% ( 1300, 1900 ] 424 0.044% 99.951% ( 1900, 2900 ] 436 0.046% 99.996% ( 2900, 4400 ] 315 0.033% 100.029% ( 4400, 6600 ] 83 0.009% 100.038% ( 6600, 9900 ] 16 0.002% 100.040% ( 9900, 14000 ] 7 0.001% 100.040% ( 14000, 22000 ] 3 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 158728 Average: 7.0266 StdDev: 139.57 Min: 1 Median: 1.9041 Max: 20759 Percentiles: P50: 1.90 P75: 2.82 P99: 21.58 P99.9: 544.26 P99.99: 4280.98 ------------------------------------------------------ [ 0, 1 ] 6708 4.226% 4.226% # ( 1, 2 ] 80363 50.629% 54.855% ########## ( 2, 3 ] 39015 24.580% 79.435% ##### ( 3, 4 ] 12724 8.016% 87.451% ## ( 4, 6 ] 12815 8.074% 95.525% ## ( 6, 10 ] 4120 2.596% 98.121% # ( 10, 15 ] 1095 0.690% 98.811% ( 15, 22 ] 321 0.202% 99.013% ( 22, 34 ] 47 0.030% 99.042% ( 34, 51 ] 3 0.002% 99.044% ( 51, 76 ] 1 0.001% 99.045% ( 76, 110 ] 78 0.049% 99.094% ( 110, 170 ] 546 0.344% 99.438% ( 170, 250 ] 446 0.281% 99.719% ( 250, 380 ] 193 0.122% 99.841% ( 380, 580 ] 116 0.073% 99.914% ( 580, 870 ] 66 0.042% 99.955% ( 870, 1300 ] 22 0.014% 99.969% ( 1300, 1900 ] 14 0.009% 99.978% ( 1900, 2900 ] 10 0.006% 99.984% ( 2900, 4400 ] 11 0.007% 99.991% ( 4400, 6600 ] 5 0.003% 99.994% ( 6600, 9900 ] 9 0.006% 100.000% ( 9900, 14000 ] 3 0.002% 100.002% ( 14000, 22000 ] 4 0.003% 100.004% ** Level 2 read latency histogram (micros): Count: 228654 Average: 15.3179 StdDev: 203.08 Min: 1 Median: 1.9367 Max: 20882 Percentiles: P50: 1.94 P75: 2.98 P99: 12.84 P99.9: 2523.85 P99.99: 3546.52 ------------------------------------------------------ [ 0, 1 ] 7761 3.394% 3.394% # ( 1, 2 ] 113770 49.756% 53.151% ########## ( 2, 3 ] 50732 22.187% 75.338% #### ( 3, 4 ] 21624 9.457% 84.795% ## ( 4, 6 ] 25270 11.052% 95.847% ## ( 6, 10 ] 6185 2.705% 98.552% # ( 10, 15 ] 1804 0.789% 99.340% ( 15, 22 ] 242 0.106% 99.446% ( 22, 34 ] 24 0.010% 99.457% ( 34, 51 ] 5 0.002% 99.459% ( 51, 76 ] 4 0.002% 99.461% ( 76, 110 ] 6 0.003% 99.463% ( 110, 170 ] 12 0.005% 99.469% ( 170, 250 ] 15 0.007% 99.475% ( 250, 380 ] 29 0.013% 99.488% ( 380, 580 ] 68 0.030% 99.518% ( 580, 870 ] 113 0.049% 99.567% ( 870, 1300 ] 218 0.095% 99.662% ( 1300, 1900 ] 325 0.142% 99.805% ( 1900, 2900 ] 350 0.153% 99.958% ( 2900, 4400 ] 172 0.075% 100.033% ( 4400, 6600 ] 58 0.025% 100.058% ( 6600, 9900 ] 16 0.007% 100.065% ( 9900, 14000 ] 4 0.002% 100.067% ( 14000, 22000 ] 4 0.002% 100.069% ** Level 3 read latency histogram (micros): Count: 995407 Average: 14.3546 StdDev: 182.69 Min: 1 Median: 1.9886 Max: 15688 Percentiles: P50: 1.99 P75: 3.03 P99: 11.71 P99.9: 1584.22 P99.99: 2145.97 ------------------------------------------------------ [ 0, 1 ] 22733 2.284% 2.284% ( 1, 2 ] 480442 48.266% 50.550% ########## ( 2, 3 ] 240037 24.114% 74.664% ##### ( 3, 4 ] 98652 9.911% 84.575% ## ( 4, 6 ] 116976 11.752% 96.326% ## ( 6, 10 ] 24220 2.433% 98.760% ( 10, 15 ] 6999 0.703% 99.463% ( 15, 22 ] 845 0.085% 99.548% ( 22, 34 ] 78 0.008% 99.555% ( 34, 51 ] 37 0.004% 99.559% ( 51, 76 ] 49 0.005% 99.564% ( 76, 110 ] 81 0.008% 99.572% ( 110, 170 ] 425 0.043% 99.615% ( 170, 250 ] 401 0.040% 99.655% ( 250, 380 ] 268 0.027% 99.682% ( 380, 580 ] 336 0.034% 99.716% ( 580, 870 ] 519 0.052% 99.768% ( 870, 1300 ] 784 0.079% 99.847% ( 1300, 1900 ] 1118 0.112% 99.959% ( 1900, 2900 ] 1250 0.126% 100.085% ( 2900, 4400 ] 874 0.088% 100.172% ( 4400, 6600 ] 293 0.029% 100.202% ( 6600, 9900 ] 48 0.005% 100.207% ( 9900, 14000 ] 3 0.000% 100.207% ( 14000, 22000 ] 1 0.000% 100.207% ** Level 4 read latency histogram (micros): Count: 360419 Average: 39.3288 StdDev: 286.32 Min: 1 Median: 2.0598 Max: 14140 Percentiles: P50: 2.06 P75: 3.31 P99: 1067.21 P99.9: 3705.50 P99.99: 4346.56 ------------------------------------------------------ [ 0, 1 ] 8416 2.335% 2.335% ( 1, 2 ] 166737 46.262% 48.597% ######### ( 2, 3 ] 84530 23.453% 72.050% ##### ( 3, 4 ] 33947 9.419% 81.469% ## ( 4, 6 ] 37966 10.534% 92.003% ## ( 6, 10 ] 9227 2.560% 94.563% # ( 10, 15 ] 2371 0.658% 95.221% ( 15, 22 ] 259 0.072% 95.293% ( 22, 34 ] 22 0.006% 95.299% ( 34, 51 ] 25 0.007% 95.306% ( 51, 76 ] 21 0.006% 95.312% ( 76, 110 ] 461 0.128% 95.439% ( 110, 170 ] 4380 1.215% 96.655% ( 170, 250 ] 3747 1.040% 97.694% ( 250, 380 ] 1692 0.469% 98.164% ( 380, 580 ] 1500 0.416% 98.580% ( 580, 870 ] 1035 0.287% 98.867% ( 870, 1300 ] 1044 0.290% 99.157% ( 1300, 1900 ] 1118 0.310% 99.467% ( 1900, 2900 ] 1153 0.320% 99.787% ( 2900, 4400 ] 759 0.211% 99.998% ( 4400, 6600 ] 238 0.066% 100.064% ( 6600, 9900 ] 33 0.009% 100.073% ( 9900, 14000 ] 4 0.001% 100.074% ( 14000, 22000 ] 1 0.000% 100.074% ** Level 5 read latency histogram (micros): Count: 89788 Average: 463.8759 StdDev: 862.40 Min: 83 Median: 207.0519 Max: 27027 Percentiles: P50: 207.05 P75: 365.87 P99: 4963.14 P99.9: 8756.81 P99.99: 11819.13 ------------------------------------------------------ ( 76, 110 ] 3488 3.885% 3.885% # ( 110, 170 ] 30258 33.699% 37.584% ####### ( 170, 250 ] 24070 26.808% 64.392% ##### ( 250, 380 ] 10687 11.902% 76.294% ## ( 380, 580 ] 8334 9.282% 85.576% ## ( 580, 870 ] 4337 4.830% 90.406% # ( 870, 1300 ] 2296 2.557% 92.963% # ( 1300, 1900 ] 1753 1.952% 94.916% ( 1900, 2900 ] 1782 1.985% 96.900% ( 2900, 4400 ] 1655 1.843% 98.744% ( 4400, 6600 ] 899 1.001% 99.745% ( 6600, 9900 ] 213 0.237% 99.982% ( 9900, 14000 ] 15 0.017% 99.999% ( 14000, 22000 ] 2 0.002% 100.001% ( 22000, 33000 ] 1 0.001% 100.002% ** DB Stats ** Uptime(secs): 15.2 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 193.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.277 H:M:S, 28.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 278.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.054 H:M:S, 1.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-15:33:22 ... thread 0: (1000000,4000000) ops and (120329.1,171371.4) ops/second in (8.310544,23.341116) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/7 3.75 GB 226.5 3.4 0.0 3.4 7.1 3.7 0.0 1.9 113.1 238.4 30.64 23.95 70 0.438 3518K 3721 0.0 0.0 L1 14/0 1.65 GB 169.2 2.2 1.2 1.0 2.2 1.2 0.0 1.8 118.4 117.7 19.29 11.88 1 19.287 2319K 14K 0.0 0.0 L3 25/2 1.10 GB 1.0 2.8 1.3 1.5 2.8 1.3 0.2 2.1 127.2 126.2 22.61 13.46 12 1.884 1675K 1700 0.0 0.0 L4 167/3 9.72 GB 1.0 5.8 4.2 1.6 5.7 4.1 0.0 1.4 116.4 115.4 50.70 27.49 39 1.300 2501K 3459 0.0 0.0 L5 1120/0 92.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1344/12 108.32 GB 0.0 14.2 6.7 7.5 17.8 10.4 4.2 4.8 117.9 148.3 123.23 76.78 122 1.010 10M 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.2 6.7 7.5 17.8 10.4 4.2 4.8 117.9 148.3 123.23 76.78 122 1.010 10M 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.2 6.7 7.5 14.1 6.6 0.0 0.0 135.4 134.5 107.27 66.22 65 1.650 10M 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 240.9 15.95 10.57 57 0.280 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.6 total, 23.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.85 GB write, 776.01 MB/s write, 14.19 GB read, 616.84 MB/s read, 123.2 seconds Interval compaction: 17.85 GB write, 782.91 MB/s write, 14.19 GB read, 622.33 MB/s read, 123.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 24, pending-compaction-bytes-stops: 0, total-delays: 33, total-stops: 19, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1544159 Average: 11.1472 StdDev: 103.93 Min: 0 Median: 1.6565 Max: 20833 Percentiles: P50: 1.66 P75: 2.39 P99: 228.25 P99.9: 858.97 P99.99: 2191.12 ------------------------------------------------------ [ 0, 1 ] 210904 13.658% 13.658% ### ( 1, 2 ] 854784 55.356% 69.014% ########### ( 2, 3 ] 237429 15.376% 84.390% ### ( 3, 4 ] 84493 5.472% 89.862% # ( 4, 6 ] 90465 5.859% 95.720% # ( 6, 10 ] 20797 1.347% 97.067% ( 10, 15 ] 4928 0.319% 97.386% ( 15, 22 ] 724 0.047% 97.433% ( 22, 34 ] 76 0.005% 97.438% ( 34, 51 ] 22 0.001% 97.440% ( 51, 76 ] 29 0.002% 97.441% ( 76, 110 ] 1515 0.098% 97.540% ( 110, 170 ] 14006 0.907% 98.447% ( 170, 250 ] 11737 0.760% 99.207% ( 250, 380 ] 5195 0.336% 99.543% ( 380, 580 ] 3814 0.247% 99.790% ( 580, 870 ] 1765 0.114% 99.904% ( 870, 1300 ] 710 0.046% 99.950% ( 1300, 1900 ] 481 0.031% 99.982% ( 1900, 2900 ] 452 0.029% 100.011% ( 2900, 4400 ] 330 0.021% 100.032% ( 4400, 6600 ] 85 0.006% 100.038% ( 6600, 9900 ] 16 0.001% 100.039% ( 9900, 14000 ] 7 0.000% 100.039% ( 14000, 22000 ] 3 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 383331 Average: 6.6043 StdDev: 96.51 Min: 1 Median: 1.9181 Max: 20759 Percentiles: P50: 1.92 P75: 2.92 P99: 65.66 P99.9: 546.43 P99.99: 1114.72 ------------------------------------------------------ [ 0, 1 ] 17117 4.465% 4.465% # ( 1, 2 ] 190126 49.598% 54.064% ########## ( 2, 3 ] 87091 22.720% 76.783% ##### ( 3, 4 ] 34690 9.050% 85.833% ## ( 4, 6 ] 35635 9.296% 95.129% ## ( 6, 10 ] 11287 2.944% 98.073% # ( 10, 15 ] 2693 0.703% 98.776% ( 15, 22 ] 745 0.194% 98.970% ( 22, 34 ] 93 0.024% 98.995% ( 34, 51 ] 16 0.004% 98.999% ( 51, 76 ] 8 0.002% 99.001% ( 76, 110 ] 177 0.046% 99.047% ( 110, 170 ] 1345 0.351% 99.398% ( 170, 250 ] 1037 0.271% 99.668% ( 250, 380 ] 534 0.139% 99.808% ( 380, 580 ] 425 0.111% 99.919% ( 580, 870 ] 227 0.059% 99.978% ( 870, 1300 ] 82 0.021% 99.999% ( 1300, 1900 ] 39 0.010% 100.009% ( 1900, 2900 ] 18 0.005% 100.014% ( 2900, 4400 ] 14 0.004% 100.018% ( 4400, 6600 ] 7 0.002% 100.020% ( 6600, 9900 ] 9 0.002% 100.022% ( 9900, 14000 ] 3 0.001% 100.023% ( 14000, 22000 ] 4 0.001% 100.024% ** Level 2 read latency histogram (micros): Count: 228654 Average: 15.3179 StdDev: 203.08 Min: 1 Median: 1.9367 Max: 20882 Percentiles: P50: 1.94 P75: 2.98 P99: 12.84 P99.9: 2523.85 P99.99: 3546.52 ------------------------------------------------------ [ 0, 1 ] 7761 3.394% 3.394% # ( 1, 2 ] 113770 49.756% 53.151% ########## ( 2, 3 ] 50732 22.187% 75.338% #### ( 3, 4 ] 21624 9.457% 84.795% ## ( 4, 6 ] 25270 11.052% 95.847% ## ( 6, 10 ] 6185 2.705% 98.552% # ( 10, 15 ] 1804 0.789% 99.340% ( 15, 22 ] 242 0.106% 99.446% ( 22, 34 ] 24 0.010% 99.457% ( 34, 51 ] 5 0.002% 99.459% ( 51, 76 ] 4 0.002% 99.461% ( 76, 110 ] 6 0.003% 99.463% ( 110, 170 ] 12 0.005% 99.469% ( 170, 250 ] 15 0.007% 99.475% ( 250, 380 ] 29 0.013% 99.488% ( 380, 580 ] 68 0.030% 99.518% ( 580, 870 ] 113 0.049% 99.567% ( 870, 1300 ] 218 0.095% 99.662% ( 1300, 1900 ] 325 0.142% 99.805% ( 1900, 2900 ] 350 0.153% 99.958% ( 2900, 4400 ] 172 0.075% 100.033% ( 4400, 6600 ] 58 0.025% 100.058% ( 6600, 9900 ] 16 0.007% 100.065% ( 9900, 14000 ] 4 0.002% 100.067% ( 14000, 22000 ] 4 0.002% 100.069% ** Level 3 read latency histogram (micros): Count: 1308211 Average: 12.1307 StdDev: 160.55 Min: 0 Median: 1.9461 Max: 15688 Percentiles: P50: 1.95 P75: 2.95 P99: 11.51 P99.9: 1252.70 P99.99: 1862.50 ------------------------------------------------------ [ 0, 1 ] 34221 2.616% 2.616% # ( 1, 2 ] 655230 50.086% 52.702% ########## ( 2, 3 ] 305826 23.377% 76.079% ##### ( 3, 4 ] 122377 9.355% 85.434% ## ( 4, 6 ] 143806 10.993% 96.426% ## ( 6, 10 ] 31078 2.376% 98.802% ( 10, 15 ] 8563 0.655% 99.457% ( 15, 22 ] 995 0.076% 99.533% ( 22, 34 ] 102 0.008% 99.540% ( 34, 51 ] 77 0.006% 99.546% ( 51, 76 ] 72 0.006% 99.552% ( 76, 110 ] 159 0.012% 99.564% ( 110, 170 ] 949 0.073% 99.636% ( 170, 250 ] 813 0.062% 99.699% ( 250, 380 ] 511 0.039% 99.738% ( 380, 580 ] 585 0.045% 99.782% ( 580, 870 ] 728 0.056% 99.838% ( 870, 1300 ] 911 0.070% 99.908% ( 1300, 1900 ] 1149 0.088% 99.995% ( 1900, 2900 ] 1259 0.096% 100.092% ( 2900, 4400 ] 875 0.067% 100.159% ( 4400, 6600 ] 293 0.022% 100.181% ( 6600, 9900 ] 48 0.004% 100.185% ( 9900, 14000 ] 3 0.000% 100.185% ( 14000, 22000 ] 1 0.000% 100.185% ** Level 4 read latency histogram (micros): Count: 445902 Average: 40.1310 StdDev: 263.30 Min: 1 Median: 2.0046 Max: 14140 Percentiles: P50: 2.00 P75: 3.36 P99: 847.90 P99.9: 3507.61 P99.99: 4291.43 ------------------------------------------------------ [ 0, 1 ] 12373 2.775% 2.775% # ( 1, 2 ] 210128 47.124% 49.899% ######### ( 2, 3 ] 98013 21.981% 71.880% #### ( 3, 4 ] 38513 8.637% 80.517% ## ( 4, 6 ] 42040 9.428% 89.945% ## ( 6, 10 ] 10766 2.414% 92.360% ( 10, 15 ] 2685 0.602% 92.962% ( 15, 22 ] 298 0.067% 93.029% ( 22, 34 ] 30 0.007% 93.035% ( 34, 51 ] 25 0.006% 93.041% ( 51, 76 ] 21 0.005% 93.046% ( 76, 110 ] 1090 0.244% 93.290% ( 110, 170 ] 10027 2.249% 95.539% ( 170, 250 ] 7806 1.751% 97.289% ( 250, 380 ] 3402 0.763% 98.052% ( 380, 580 ] 2735 0.613% 98.666% ( 580, 870 ] 1614 0.362% 99.028% ( 870, 1300 ] 1251 0.281% 99.308% ( 1300, 1900 ] 1163 0.261% 99.569% ( 1900, 2900 ] 1165 0.261% 99.830% ( 2900, 4400 ] 768 0.172% 100.002% ( 4400, 6600 ] 239 0.054% 100.056% ( 6600, 9900 ] 33 0.007% 100.063% ( 9900, 14000 ] 4 0.001% 100.064% ( 14000, 22000 ] 1 0.000% 100.065% ** Level 5 read latency histogram (micros): Count: 175415 Average: 359.3096 StdDev: 645.29 Min: 82 Median: 194.5741 Max: 27027 Percentiles: P50: 194.57 P75: 317.51 P99: 3858.96 P99.9: 7430.19 P99.99: 9876.12 ------------------------------------------------------ ( 76, 110 ] 7648 4.360% 4.360% # ( 110, 170 ] 65394 37.280% 41.640% ####### ( 170, 250 ] 47743 27.217% 68.857% ##### ( 250, 380 ] 20751 11.830% 80.686% ## ( 380, 580 ] 15676 8.937% 89.623% ## ( 580, 870 ] 7860 4.481% 94.104% # ( 870, 1300 ] 3519 2.006% 96.110% ( 1300, 1900 ] 2088 1.190% 97.300% ( 1900, 2900 ] 1888 1.076% 98.376% ( 2900, 4400 ] 1711 0.975% 99.352% ( 4400, 6600 ] 908 0.518% 99.869% ( 6600, 9900 ] 213 0.121% 99.991% ( 9900, 14000 ] 15 0.009% 99.999% ( 14000, 22000 ] 2 0.001% 100.001% ( 22000, 33000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 23.6 total, 8.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 167.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.890 H:M:S, 37.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 118.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.614 H:M:S, 55.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 256.769 micros/op 15553 ops/sec 60.178 seconds 935996 operations; 15.1 MB/s (239999 of 239999 found) Microseconds per read: Count: 935996 Average: 256.7705 StdDev: 786.67 Min: 1 Median: 198.0661 Max: 77899 Percentiles: P50: 198.07 P75: 241.12 P99: 1020.50 P99.9: 15245.00 P99.99: 31625.95 ------------------------------------------------------ [ 0, 1 ] 1 0.000% 0.000% ( 1, 2 ] 4 0.000% 0.001% ( 2, 3 ] 42 0.004% 0.005% ( 3, 4 ] 51 0.005% 0.010% ( 4, 6 ] 76 0.008% 0.019% ( 6, 10 ] 410 0.044% 0.062% ( 10, 15 ] 3479 0.372% 0.434% ( 15, 22 ] 5114 0.546% 0.980% ( 22, 34 ] 8986 0.960% 1.940% ( 34, 51 ] 4396 0.470% 2.410% ( 51, 76 ] 423 0.045% 2.455% ( 76, 110 ] 3302 0.353% 2.808% ( 110, 170 ] 289183 30.896% 33.704% ###### ( 170, 250 ] 434776 46.451% 80.155% ######### ( 250, 380 ] 106692 11.399% 91.553% ## ( 380, 580 ] 50456 5.391% 96.944% # ( 580, 870 ] 17158 1.833% 98.777% ( 870, 1300 ] 5963 0.637% 99.414% ( 1300, 1900 ] 1984 0.212% 99.626% ( 1900, 2900 ] 1159 0.124% 99.750% ( 2900, 4400 ] 782 0.084% 99.833% ( 4400, 6600 ] 277 0.030% 99.863% ( 6600, 9900 ] 82 0.009% 99.872% ( 9900, 14000 ] 156 0.017% 99.888% ( 14000, 22000 ] 694 0.074% 99.963% ( 22000, 33000 ] 293 0.031% 99.994% ( 33000, 50000 ] 48 0.005% 99.999% ( 50000, 75000 ] 8 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14955211 rocksdb.bloom.filter.full.positive COUNT : 1081338 rocksdb.bloom.filter.full.true.positive COUNT : 935620 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 376 rocksdb.memtable.miss COUNT : 935620 rocksdb.l0.hit COUNT : 39186 rocksdb.l1.hit COUNT : 14265 rocksdb.l2andup.hit COUNT : 882169 rocksdb.compaction.key.drop.new COUNT : 124333 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4529485 rocksdb.number.keys.read COUNT : 935996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4674428520 rocksdb.bytes.read COUNT : 935996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1567 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 42872598 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 18578174222 rocksdb.compact.write.bytes COUNT : 18447361405 rocksdb.flush.write.bytes COUNT : 4624047971 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 32 rocksdb.number.superversion_acquires COUNT : 886 rocksdb.number.superversion_releases COUNT : 849 rocksdb.number.superversion_cleanups COUNT : 223 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 223 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4586683392 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1723392 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 22904969569 rocksdb.non.last.level.read.count COUNT : 5390540 rocksdb.block.checksum.compute.count COUNT : 5591351 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 197.075265 P95 : 506.659594 P99 : 1019.146712 P100 : 77898.000000 COUNT : 935996 SUM : 239506549 rocksdb.db.write.micros P50 : 1.552792 P95 : 4.755524 P99 : 12.392832 P100 : 611132.000000 COUNT : 4529485 SUM : 54327919 rocksdb.compaction.times.micros P50 : 1149000.000000 P95 : 3285000.000000 P99 : 16480000.000000 P100 : 19287497.000000 COUNT : 69 SUM : 117406439 rocksdb.compaction.times.cpu_micros P50 : 914642.857143 P95 : 1787222.222222 P99 : 11102000.000000 P100 : 11880470.000000 COUNT : 69 SUM : 75584178 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 870.000000 P95 : 9570.000000 P99 : 51623.000000 P100 : 51623.000000 COUNT : 66 SUM : 161309 rocksdb.compaction.outfile.sync.micros P50 : 7425.000000 P95 : 74807.692308 P99 : 335800.000000 P100 : 529586.000000 COUNT : 202 SUM : 4843431 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 210.000000 P95 : 4482.500000 P99 : 5508.000000 P100 : 5508.000000 COUNT : 154 SUM : 138516 rocksdb.table.open.io.micros P50 : 11656.560636 P95 : 21508.314607 P99 : 31478.780488 P100 : 46722.000000 COUNT : 1567 SUM : 17903006 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.931009 P95 : 16.401437 P99 : 221.568575 P100 : 15971.000000 COUNT : 4498654 SUM : 82497385 rocksdb.read.block.get.micros P50 : 154.113618 P95 : 361.359453 P99 : 891.548841 P100 : 27032.000000 COUNT : 1091122 SUM : 204743289 rocksdb.write.raw.block.micros P50 : 0.536069 P95 : 1.372305 P99 : 3.752289 P100 : 32714.000000 COUNT : 5588020 SUM : 15650992 rocksdb.numfiles.in.singlecompaction P50 : 2.947368 P95 : 4.500000 P99 : 23.200000 P100 : 26.000000 COUNT : 90 SUM : 318 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.569569 P95 : 1244.605908 P99 : 2653.225667 P100 : 610942.000000 COUNT : 239374 SUM : 42893267 rocksdb.sst.read.micros P50 : 2.210196 P95 : 209.242321 P99 : 470.139286 P100 : 27027.000000 COUNT : 5390575 SUM : 272936739 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 935996 SUM : 935996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4529485 SUM : 4674428520 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 218888.888889 P95 : 671500.000000 P99 : 1083661.000000 P100 : 1083661.000000 COUNT : 66 SUM : 17925034 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 226 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0