[2024-12-07 05:31:39.021522] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-07 05:31:39.021657] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1754299 ] Set seed to 1733545899019029 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-07 05:31:39.125476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-07 05:31:39.338498] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-07 05:31:39.338543] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1754299' to capture a snapshot of events at runtime. [2024-12-07 05:31:39.338554] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1754299 for offline analysis/debug. [2024-12-07 05:31:39.338594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 7 05:31:47 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/07-05:31:53 ... thread 0: (1000000,1000000) ops and (184375.4,184375.4) ops/second in (5.423716,5.423716) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 2.09 GB 88.1 0.6 0.0 0.6 1.5 0.9 0.0 1.7 84.2 201.9 7.48 5.05 13 0.576 639K 832 0.0 0.0 L1 4/4 362.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 9/8 1.13 GB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 14/1 1.02 GB 1.0 0.2 0.1 0.0 0.2 0.1 0.0 1.4 99.3 99.3 1.76 0.88 1 1.758 0 0 0.0 0.0 L4 165/0 9.60 GB 1.0 2.1 1.4 0.7 2.1 1.4 0.2 1.4 108.6 107.5 19.60 9.91 13 1.508 105K 0 0.0 0.0 L5 1100/0 91.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/22 105.31 GB 0.0 2.9 1.6 1.3 3.7 2.4 3.9 4.3 101.7 131.5 28.85 15.84 27 1.068 745K 832 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 1.6 1.3 3.7 2.4 3.9 4.3 101.7 131.5 28.85 15.84 27 1.068 745K 832 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 1.6 1.3 2.8 1.5 0.0 0.0 122.5 121.6 23.95 13.27 16 1.497 745K 832 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 180.1 4.90 2.57 11 0.445 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.6 total, 5.4 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.70 GB write, 673.31 MB/s write, 2.86 GB read, 520.68 MB/s read, 28.8 seconds Interval compaction: 3.70 GB write, 699.13 MB/s write, 2.86 GB read, 540.65 MB/s read, 28.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 16, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 367075 Average: 8.9719 StdDev: 127.14 Min: 1 Median: 1.6881 Max: 12033 Percentiles: P50: 1.69 P75: 2.36 P99: 9.48 P99.9: 1425.33 P99.99: 2545.17 ------------------------------------------------------ [ 0, 1 ] 29841 8.129% 8.129% ## ( 1, 2 ] 223377 60.853% 68.983% ############ ( 2, 3 ] 60888 16.587% 85.570% ### ( 3, 4 ] 22395 6.101% 91.671% # ( 4, 6 ] 22097 6.020% 97.691% # ( 6, 10 ] 5524 1.505% 99.196% ( 10, 15 ] 972 0.265% 99.460% ( 15, 22 ] 113 0.031% 99.491% ( 22, 34 ] 13 0.004% 99.495% ( 34, 51 ] 5 0.001% 99.496% ( 51, 76 ] 4 0.001% 99.497% ( 76, 110 ] 10 0.003% 99.500% ( 110, 170 ] 137 0.037% 99.537% ( 170, 250 ] 207 0.056% 99.594% ( 250, 380 ] 230 0.063% 99.656% ( 380, 580 ] 242 0.066% 99.722% ( 580, 870 ] 325 0.089% 99.811% ( 870, 1300 ] 279 0.076% 99.887% ( 1300, 1900 ] 239 0.065% 99.952% ( 1900, 2900 ] 219 0.060% 100.011% ( 2900, 4400 ] 107 0.029% 100.041% ( 4400, 6600 ] 37 0.010% 100.051% ( 6600, 9900 ] 13 0.004% 100.054% ( 9900, 14000 ] 3 0.001% 100.055% ** Level 1 read latency histogram (micros): Count: 49 Average: 2425.0000 StdDev: 3147.57 Min: 115 Median: 766.4286 Max: 11561 Percentiles: P50: 766.43 P75: 3462.50 P99: 11561.00 P99.9: 11561.00 P99.99: 11561.00 ------------------------------------------------------ ( 110, 170 ] 3 6.122% 6.122% # ( 170, 250 ] 4 8.163% 14.286% ## ( 250, 380 ] 6 12.245% 26.531% ## ( 380, 580 ] 7 14.286% 40.816% ### ( 580, 870 ] 7 14.286% 55.102% ### ( 870, 1300 ] 3 6.122% 61.224% # ( 1300, 1900 ] 4 8.163% 69.388% ## ( 1900, 2900 ] 2 4.082% 73.469% # ( 2900, 4400 ] 2 4.082% 77.551% # ( 4400, 6600 ] 3 6.122% 83.673% # ( 6600, 9900 ] 5 10.204% 93.878% ## ( 9900, 14000 ] 3 6.122% 100.000% # ** Level 2 read latency histogram (micros): Count: 177183 Average: 13.7930 StdDev: 169.62 Min: 1 Median: 1.8401 Max: 9590 Percentiles: P50: 1.84 P75: 2.76 P99: 13.87 P99.9: 2713.41 P99.99: 5689.99 ------------------------------------------------------ [ 0, 1 ] 7577 4.276% 4.276% # ( 1, 2 ] 96433 54.426% 58.702% ########### ( 2, 3 ] 37761 21.312% 80.014% #### ( 3, 4 ] 13767 7.770% 87.784% ## ( 4, 6 ] 14783 8.343% 96.127% ## ( 6, 10 ] 4236 2.391% 98.518% ( 10, 15 ] 1104 0.623% 99.141% ( 15, 22 ] 213 0.120% 99.261% ( 22, 34 ] 28 0.016% 99.277% ( 34, 51 ] 9 0.005% 99.282% ( 51, 76 ] 6 0.003% 99.285% ( 76, 110 ] 6 0.003% 99.289% ( 110, 170 ] 54 0.030% 99.319% ( 170, 250 ] 61 0.034% 99.354% ( 250, 380 ] 84 0.047% 99.401% ( 380, 580 ] 122 0.069% 99.470% ( 580, 870 ] 149 0.084% 99.554% ( 870, 1300 ] 206 0.116% 99.670% ( 1300, 1900 ] 237 0.134% 99.804% ( 1900, 2900 ] 210 0.119% 99.923% ( 2900, 4400 ] 98 0.055% 99.978% ( 4400, 6600 ] 38 0.021% 99.999% ( 6600, 9900 ] 12 0.007% 100.006% ** Level 3 read latency histogram (micros): Count: 173919 Average: 12.8238 StdDev: 162.96 Min: 1 Median: 1.9055 Max: 9273 Percentiles: P50: 1.91 P75: 2.94 P99: 11.16 P99.9: 1661.44 P99.99: 2332.81 ------------------------------------------------------ [ 0, 1 ] 6881 3.956% 3.956% # ( 1, 2 ] 88440 50.851% 54.808% ########## ( 2, 3 ] 37410 21.510% 76.318% #### ( 3, 4 ] 16470 9.470% 85.788% ## ( 4, 6 ] 18157 10.440% 96.228% ## ( 6, 10 ] 4581 2.634% 98.862% # ( 10, 15 ] 1037 0.596% 99.458% ( 15, 22 ] 171 0.098% 99.556% ( 22, 34 ] 15 0.009% 99.565% ( 34, 51 ] 5 0.003% 99.568% ( 51, 76 ] 4 0.002% 99.570% ( 76, 110 ] 4 0.002% 99.572% ( 110, 170 ] 17 0.010% 99.582% ( 170, 250 ] 29 0.017% 99.599% ( 250, 380 ] 40 0.023% 99.622% ( 380, 580 ] 69 0.040% 99.661% ( 580, 870 ] 109 0.063% 99.724% ( 870, 1300 ] 185 0.106% 99.830% ( 1300, 1900 ] 201 0.116% 99.946% ( 1900, 2900 ] 177 0.102% 100.048% ( 2900, 4400 ] 115 0.066% 100.114% ( 4400, 6600 ] 42 0.024% 100.138% ( 6600, 9900 ] 5 0.003% 100.141% ** Level 4 read latency histogram (micros): Count: 161566 Average: 26.7297 StdDev: 243.47 Min: 1 Median: 1.9051 Max: 11863 Percentiles: P50: 1.91 P75: 2.95 P99: 704.84 P99.9: 2871.78 P99.99: 3865.71 ------------------------------------------------------ [ 0, 1 ] 6515 4.032% 4.032% # ( 1, 2 ] 82059 50.790% 54.822% ########## ( 2, 3 ] 34376 21.277% 76.099% #### ( 3, 4 ] 15008 9.289% 85.388% ## ( 4, 6 ] 15718 9.729% 95.117% ## ( 6, 10 ] 4102 2.539% 97.655% # ( 10, 15 ] 907 0.561% 98.217% ( 15, 22 ] 125 0.077% 98.294% ( 22, 34 ] 15 0.009% 98.303% ( 34, 51 ] 7 0.004% 98.308% ( 51, 76 ] 4 0.002% 98.310% ( 76, 110 ] 11 0.007% 98.317% ( 110, 170 ] 124 0.077% 98.394% ( 170, 250 ] 217 0.134% 98.528% ( 250, 380 ] 269 0.166% 98.695% ( 380, 580 ] 319 0.197% 98.892% ( 580, 870 ] 405 0.251% 99.143% ( 870, 1300 ] 474 0.293% 99.436% ( 1300, 1900 ] 420 0.260% 99.696% ( 1900, 2900 ] 339 0.210% 99.906% ( 2900, 4400 ] 211 0.131% 100.037% ( 4400, 6600 ] 90 0.056% 100.092% ( 6600, 9900 ] 8 0.005% 100.097% ( 9900, 14000 ] 2 0.001% 100.098% ** Level 5 read latency histogram (micros): Count: 11845 Average: 1289.0970 StdDev: 1446.00 Min: 85 Median: 703.1867 Max: 10680 Percentiles: P50: 703.19 P75: 1744.30 P99: 6435.94 P99.9: 9478.07 P99.99: 10680.00 ------------------------------------------------------ ( 76, 110 ] 96 0.810% 0.810% ( 110, 170 ] 920 7.767% 8.577% ## ( 170, 250 ] 1331 11.237% 19.814% ## ( 250, 380 ] 1459 12.317% 32.132% ## ( 380, 580 ] 1484 12.528% 44.660% ### ( 580, 870 ] 1489 12.571% 57.231% ### ( 870, 1300 ] 1325 11.186% 68.417% ## ( 1300, 1900 ] 1053 8.890% 77.307% ## ( 1900, 2900 ] 1042 8.797% 86.104% ## ( 2900, 4400 ] 1038 8.763% 94.867% ## ( 4400, 6600 ] 529 4.466% 99.333% # ( 6600, 9900 ] 77 0.650% 99.983% ( 9900, 14000 ] 2 0.017% 100.000% ** DB Stats ** Uptime(secs): 5.6 total, 5.4 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 174.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.723 H:M:S, 30.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 181.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.723 H:M:S, 31.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/07-05:31:58 ... thread 0: (1000000,2000000) ops and (190238.8,187261.2) ops/second in (5.256551,10.680267) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 3.14 GB 195.1 1.7 0.0 1.7 3.6 1.9 0.0 1.9 103.4 222.0 16.45 12.51 33 0.498 1727K 1976 0.0 0.0 L1 4/4 362.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 990.61 MB 1.0 1.5 1.3 0.2 1.4 1.3 0.0 1.2 141.8 141.4 10.49 6.99 3 3.498 1011K 0 0.0 0.0 L4 165/0 9.73 GB 1.0 3.2 2.5 0.7 3.2 2.5 0.3 1.3 108.7 107.9 30.10 17.04 23 1.309 1230K 650 0.0 0.0 L5 1112/0 92.15 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1312/13 106.34 GB 0.0 6.3 3.8 2.6 8.2 5.6 5.0 4.3 113.3 147.0 57.04 36.55 59 0.967 3969K 2626 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 3.8 2.6 8.2 5.6 5.0 4.3 113.3 147.0 57.04 36.55 59 0.967 3969K 2626 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 3.8 2.6 6.3 3.7 0.0 0.0 135.6 135.0 47.64 30.72 32 1.489 3969K 2626 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.9 1.9 0.0 0.0 0.0 207.7 9.40 5.83 27 0.348 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.9 total, 10.7 interval Flush(GB): cumulative 1.907, interval 1.907 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.19 GB write, 769.85 MB/s write, 6.31 GB read, 593.32 MB/s read, 57.0 seconds Interval compaction: 8.19 GB write, 784.84 MB/s write, 6.31 GB read, 604.87 MB/s read, 57.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 25, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 697431 Average: 14.7127 StdDev: 204.64 Min: 1 Median: 1.6452 Max: 50992 Percentiles: P50: 1.65 P75: 2.26 P99: 249.33 P99.9: 1199.59 P99.99: 2414.00 ------------------------------------------------------ [ 0, 1 ] 79982 11.468% 11.468% ## ( 1, 2 ] 416512 59.721% 71.189% ############ ( 2, 3 ] 100389 14.394% 85.583% ### ( 3, 4 ] 36871 5.287% 90.870% # ( 4, 6 ] 34301 4.918% 95.788% # ( 6, 10 ] 7585 1.088% 96.876% ( 10, 15 ] 1334 0.191% 97.067% ( 15, 22 ] 159 0.023% 97.090% ( 22, 34 ] 17 0.002% 97.092% ( 34, 51 ] 7 0.001% 97.093% ( 51, 76 ] 8 0.001% 97.094% ( 76, 110 ] 428 0.061% 97.156% ( 110, 170 ] 6631 0.951% 98.106% ( 170, 250 ] 6285 0.901% 99.008% ( 250, 380 ] 2604 0.373% 99.381% ( 380, 580 ] 1974 0.283% 99.664% ( 580, 870 ] 1225 0.176% 99.840% ( 870, 1300 ] 550 0.079% 99.918% ( 1300, 1900 ] 343 0.049% 99.968% ( 1900, 2900 ] 304 0.044% 100.011% ( 2900, 4400 ] 184 0.026% 100.038% ( 4400, 6600 ] 65 0.009% 100.047% ( 6600, 9900 ] 26 0.004% 100.051% ( 9900, 14000 ] 13 0.002% 100.052% ( 14000, 22000 ] 13 0.002% 100.054% ( 22000, 33000 ] 10 0.001% 100.056% ( 33000, 50000 ] 2 0.000% 100.056% ( 50000, 75000 ] 1 0.000% 100.056% ** Level 1 read latency histogram (micros): Count: 240 Average: 699.2458 StdDev: 1675.23 Min: 90 Median: 231.9718 Max: 11561 Percentiles: P50: 231.97 P75: 448.57 P99: 10720.00 P99.9: 11561.00 P99.99: 11561.00 ------------------------------------------------------ ( 76, 110 ] 8 3.333% 3.333% # ( 110, 170 ] 57 23.750% 27.083% ##### ( 170, 250 ] 71 29.583% 56.667% ###### ( 250, 380 ] 32 13.333% 70.000% ### ( 380, 580 ] 35 14.583% 84.583% ### ( 580, 870 ] 13 5.417% 90.000% # ( 870, 1300 ] 5 2.083% 92.083% ( 1300, 1900 ] 4 1.667% 93.750% ( 1900, 2900 ] 2 0.833% 94.583% ( 2900, 4400 ] 2 0.833% 95.417% ( 4400, 6600 ] 3 1.250% 96.667% ( 6600, 9900 ] 5 2.083% 98.750% ( 9900, 14000 ] 3 1.250% 100.000% ** Level 2 read latency histogram (micros): Count: 294671 Average: 12.0009 StdDev: 268.88 Min: 1 Median: 1.7761 Max: 46970 Percentiles: P50: 1.78 P75: 2.59 P99: 11.87 P99.9: 2374.22 P99.99: 6467.62 ------------------------------------------------------ [ 0, 1 ] 13839 4.696% 4.696% # ( 1, 2 ] 172020 58.377% 63.073% ############ ( 2, 3 ] 59528 20.202% 83.275% #### ( 3, 4 ] 19584 6.646% 89.921% # ( 4, 6 ] 19913 6.758% 96.679% # ( 6, 10 ] 6287 2.134% 98.812% ( 10, 15 ] 1483 0.503% 99.316% ( 15, 22 ] 237 0.080% 99.396% ( 22, 34 ] 35 0.012% 99.408% ( 34, 51 ] 11 0.004% 99.412% ( 51, 76 ] 7 0.002% 99.414% ( 76, 110 ] 17 0.006% 99.420% ( 110, 170 ] 168 0.057% 99.477% ( 170, 250 ] 181 0.061% 99.538% ( 250, 380 ] 146 0.050% 99.588% ( 380, 580 ] 167 0.057% 99.644% ( 580, 870 ] 178 0.060% 99.705% ( 870, 1300 ] 225 0.076% 99.781% ( 1300, 1900 ] 246 0.083% 99.865% ( 1900, 2900 ] 220 0.075% 99.939% ( 2900, 4400 ] 111 0.038% 99.977% ( 4400, 6600 ] 41 0.014% 99.991% ( 6600, 9900 ] 16 0.005% 99.996% ( 9900, 14000 ] 2 0.001% 99.997% ( 14000, 22000 ] 5 0.002% 99.999% ( 22000, 33000 ] 9 0.003% 100.002% ( 33000, 50000 ] 5 0.002% 100.003% ** Level 3 read latency histogram (micros): Count: 476333 Average: 10.0467 StdDev: 229.45 Min: 1 Median: 1.8784 Max: 42575 Percentiles: P50: 1.88 P75: 2.84 P99: 9.27 P99.9: 477.49 P99.99: 1125.41 ------------------------------------------------------ [ 0, 1 ] 16890 3.546% 3.546% # ( 1, 2 ] 251896 52.882% 56.428% ########### ( 2, 3 ] 105513 22.151% 78.579% #### ( 3, 4 ] 44728 9.390% 87.969% ## ( 4, 6 ] 45738 9.602% 97.571% ## ( 6, 10 ] 8322 1.747% 99.319% ( 10, 15 ] 1572 0.330% 99.649% ( 15, 22 ] 235 0.049% 99.698% ( 22, 34 ] 30 0.006% 99.704% ( 34, 51 ] 37 0.008% 99.712% ( 51, 76 ] 23 0.005% 99.717% ( 76, 110 ] 40 0.008% 99.725% ( 110, 170 ] 283 0.059% 99.785% ( 170, 250 ] 291 0.061% 99.846% ( 250, 380 ] 168 0.035% 99.881% ( 380, 580 ] 186 0.039% 99.920% ( 580, 870 ] 192 0.040% 99.960% ( 870, 1300 ] 238 0.050% 100.010% ( 1300, 1900 ] 220 0.046% 100.056% ( 1900, 2900 ] 214 0.045% 100.101% ( 2900, 4400 ] 157 0.033% 100.134% ( 4400, 6600 ] 60 0.013% 100.147% ( 6600, 9900 ] 24 0.005% 100.152% ( 9900, 14000 ] 20 0.004% 100.156% ( 14000, 22000 ] 23 0.005% 100.161% ( 22000, 33000 ] 8 0.002% 100.163% ( 33000, 50000 ] 2 0.000% 100.163% ** Level 4 read latency histogram (micros): Count: 179277 Average: 40.7076 StdDev: 446.27 Min: 1 Median: 1.9349 Max: 54510 Percentiles: P50: 1.93 P75: 3.14 P99: 855.89 P99.9: 3177.42 P99.99: 4225.14 ------------------------------------------------------ [ 0, 1 ] 7172 4.001% 4.001% # ( 1, 2 ] 88209 49.203% 53.203% ########## ( 2, 3 ] 36889 20.577% 73.780% #### ( 3, 4 ] 16077 8.968% 82.747% ## ( 4, 6 ] 16472 9.188% 91.935% ## ( 6, 10 ] 4293 2.395% 94.330% ( 10, 15 ] 968 0.540% 94.870% ( 15, 22 ] 127 0.071% 94.941% ( 22, 34 ] 16 0.009% 94.950% ( 34, 51 ] 7 0.004% 94.954% ( 51, 76 ] 4 0.002% 94.956% ( 76, 110 ] 210 0.117% 95.073% ( 110, 170 ] 2168 1.209% 96.282% ( 170, 250 ] 2082 1.161% 97.444% ( 250, 380 ] 1081 0.603% 98.047% ( 380, 580 ] 951 0.530% 98.577% ( 580, 870 ] 797 0.445% 99.022% ( 870, 1300 ] 665 0.371% 99.393% ( 1300, 1900 ] 492 0.274% 99.667% ( 1900, 2900 ] 375 0.209% 99.876% ( 2900, 4400 ] 231 0.129% 100.005% ( 4400, 6600 ] 99 0.055% 100.060% ( 6600, 9900 ] 14 0.008% 100.068% ( 9900, 14000 ] 10 0.006% 100.074% ( 14000, 22000 ] 14 0.008% 100.081% ( 22000, 33000 ] 12 0.007% 100.088% ( 33000, 50000 ] 4 0.002% 100.090% ( 50000, 75000 ] 1 0.001% 100.091% ** Level 5 read latency histogram (micros): Count: 55110 Average: 534.6529 StdDev: 1218.57 Min: 81 Median: 223.5443 Max: 52012 Percentiles: P50: 223.54 P75: 444.45 P99: 5186.42 P99.9: 15003.87 P99.99: 41473.29 ------------------------------------------------------ ( 76, 110 ] 1497 2.716% 2.716% # ( 110, 170 ] 16242 29.472% 32.188% ###### ( 170, 250 ] 14666 26.612% 58.801% ##### ( 250, 380 ] 7118 12.916% 71.717% ### ( 380, 580 ] 5615 10.189% 81.905% ## ( 580, 870 ] 3528 6.402% 88.307% # ( 870, 1300 ] 2017 3.660% 91.967% # ( 1300, 1900 ] 1269 2.303% 94.270% ( 1900, 2900 ] 1210 2.196% 96.465% ( 2900, 4400 ] 1191 2.161% 98.626% ( 4400, 6600 ] 576 1.045% 99.672% ( 6600, 9900 ] 101 0.183% 99.855% ( 9900, 14000 ] 21 0.038% 99.893% ( 14000, 22000 ] 31 0.056% 99.949% ( 22000, 33000 ] 19 0.034% 99.984% ( 33000, 50000 ] 7 0.013% 99.996% ( 50000, 75000 ] 2 0.004% 100.000% ** DB Stats ** Uptime(secs): 10.9 total, 5.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 180.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.335 H:M:S, 30.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 187.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.612 H:M:S, 30.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/07-05:32:08 ... thread 0: (1000000,3000000) ops and (105102.6,148553.2) ops/second in (9.514516,20.194783) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 4.06 GB 289.3 3.3 0.0 3.3 6.1 2.8 0.0 2.2 131.8 243.9 25.81 21.30 53 0.487 3453K 4580 0.0 0.0 L1 4/4 362.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 990.61 MB 1.0 1.5 1.3 0.2 1.4 1.3 0.0 1.2 141.8 141.4 10.49 6.99 3 3.498 1011K 0 0.0 0.0 L4 165/0 9.73 GB 1.0 3.2 2.5 0.7 3.2 2.5 0.3 1.3 108.7 107.9 30.10 17.04 23 1.309 1230K 650 0.0 0.0 L5 1112/0 92.15 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1312/13 107.26 GB 0.0 8.0 3.8 4.2 10.8 6.6 5.0 3.8 122.9 166.0 66.41 45.33 79 0.841 5696K 5230 0.0 0.0 Int 0/0 0.00 KB 0.0 8.0 3.8 4.2 10.8 6.6 5.0 3.8 122.9 166.0 66.41 45.33 79 0.841 5696K 5230 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.0 3.8 4.2 7.9 3.7 0.0 0.0 151.1 150.5 54.00 36.95 37 1.459 5696K 5230 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 233.5 12.41 8.38 42 0.295 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.4 total, 20.2 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.77 GB write, 540.39 MB/s write, 7.97 GB read, 399.99 MB/s read, 66.4 seconds Interval compaction: 10.77 GB write, 545.96 MB/s write, 7.97 GB read, 404.11 MB/s read, 66.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 25, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1212061 Average: 19.4110 StdDev: 162.79 Min: 1 Median: 1.5715 Max: 50992 Percentiles: P50: 1.57 P75: 2.09 P99: 276.96 P99.9: 829.81 P99.99: 1646.69 ------------------------------------------------------ [ 0, 1 ] 217812 17.970% 17.970% #### ( 1, 2 ] 679281 56.043% 74.014% ########### ( 2, 3 ] 127302 10.503% 84.517% ## ( 3, 4 ] 47984 3.959% 88.476% # ( 4, 6 ] 42463 3.503% 91.979% # ( 6, 10 ] 8867 0.732% 92.711% ( 10, 15 ] 1639 0.135% 92.846% ( 15, 22 ] 215 0.018% 92.864% ( 22, 34 ] 30 0.002% 92.866% ( 34, 51 ] 7 0.001% 92.867% ( 51, 76 ] 16 0.001% 92.868% ( 76, 110 ] 3205 0.264% 93.132% ( 110, 170 ] 41282 3.406% 96.538% # ( 170, 250 ] 28491 2.351% 98.889% ( 250, 380 ] 6492 0.536% 99.425% ( 380, 580 ] 4190 0.346% 99.770% ( 580, 870 ] 1826 0.151% 99.921% ( 870, 1300 ] 624 0.051% 99.972% ( 1300, 1900 ] 370 0.031% 100.003% ( 1900, 2900 ] 326 0.027% 100.030% ( 2900, 4400 ] 199 0.016% 100.046% ( 4400, 6600 ] 67 0.006% 100.052% ( 6600, 9900 ] 26 0.002% 100.054% ( 9900, 14000 ] 13 0.001% 100.055% ( 14000, 22000 ] 13 0.001% 100.056% ( 22000, 33000 ] 10 0.001% 100.057% ( 33000, 50000 ] 2 0.000% 100.057% ( 50000, 75000 ] 1 0.000% 100.057% ** Level 1 read latency histogram (micros): Count: 889 Average: 316.8706 StdDev: 903.81 Min: 90 Median: 166.4989 Max: 11561 Percentiles: P50: 166.50 P75: 227.87 P99: 5947.33 P99.9: 11561.00 P99.99: 11561.00 ------------------------------------------------------ ( 76, 110 ] 33 3.712% 3.712% # ( 110, 170 ] 437 49.156% 52.868% ########## ( 170, 250 ] 272 30.596% 83.465% ###### ( 250, 380 ] 55 6.187% 89.651% # ( 380, 580 ] 48 5.399% 95.051% # ( 580, 870 ] 19 2.137% 97.188% ( 870, 1300 ] 6 0.675% 97.863% ( 1300, 1900 ] 4 0.450% 98.313% ( 1900, 2900 ] 2 0.225% 98.538% ( 2900, 4400 ] 2 0.225% 98.763% ( 4400, 6600 ] 3 0.337% 99.100% ( 6600, 9900 ] 5 0.562% 99.663% ( 9900, 14000 ] 3 0.337% 100.000% ** Level 2 read latency histogram (micros): Count: 294671 Average: 12.0009 StdDev: 268.88 Min: 1 Median: 1.7761 Max: 46970 Percentiles: P50: 1.78 P75: 2.59 P99: 11.87 P99.9: 2374.22 P99.99: 6467.62 ------------------------------------------------------ [ 0, 1 ] 13839 4.696% 4.696% # ( 1, 2 ] 172020 58.377% 63.073% ############ ( 2, 3 ] 59528 20.202% 83.275% #### ( 3, 4 ] 19584 6.646% 89.921% # ( 4, 6 ] 19913 6.758% 96.679% # ( 6, 10 ] 6287 2.134% 98.812% ( 10, 15 ] 1483 0.503% 99.316% ( 15, 22 ] 237 0.080% 99.396% ( 22, 34 ] 35 0.012% 99.408% ( 34, 51 ] 11 0.004% 99.412% ( 51, 76 ] 7 0.002% 99.414% ( 76, 110 ] 17 0.006% 99.420% ( 110, 170 ] 168 0.057% 99.477% ( 170, 250 ] 181 0.061% 99.538% ( 250, 380 ] 146 0.050% 99.588% ( 380, 580 ] 167 0.057% 99.644% ( 580, 870 ] 178 0.060% 99.705% ( 870, 1300 ] 225 0.076% 99.781% ( 1300, 1900 ] 246 0.083% 99.865% ( 1900, 2900 ] 220 0.075% 99.939% ( 2900, 4400 ] 111 0.038% 99.977% ( 4400, 6600 ] 41 0.014% 99.991% ( 6600, 9900 ] 16 0.005% 99.996% ( 9900, 14000 ] 2 0.001% 99.997% ( 14000, 22000 ] 5 0.002% 99.999% ( 22000, 33000 ] 9 0.003% 100.002% ( 33000, 50000 ] 5 0.002% 100.003% ** Level 3 read latency histogram (micros): Count: 478612 Average: 10.8795 StdDev: 229.33 Min: 1 Median: 1.8830 Max: 42575 Percentiles: P50: 1.88 P75: 2.85 P99: 12.33 P99.9: 526.61 P99.99: 1131.06 ------------------------------------------------------ [ 0, 1 ] 16890 3.529% 3.529% # ( 1, 2 ] 251897 52.631% 56.160% ########### ( 2, 3 ] 105515 22.046% 78.206% #### ( 3, 4 ] 44729 9.346% 87.551% ## ( 4, 6 ] 45740 9.557% 97.108% ## ( 6, 10 ] 8322 1.739% 98.847% ( 10, 15 ] 1572 0.328% 99.175% ( 15, 22 ] 235 0.049% 99.224% ( 22, 34 ] 30 0.006% 99.231% ( 34, 51 ] 37 0.008% 99.238% ( 51, 76 ] 23 0.005% 99.243% ( 76, 110 ] 180 0.038% 99.281% ( 110, 170 ] 1488 0.311% 99.592% ( 170, 250 ] 965 0.202% 99.793% ( 250, 380 ] 311 0.065% 99.858% ( 380, 580 ] 272 0.057% 99.915% ( 580, 870 ] 210 0.044% 99.959% ( 870, 1300 ] 244 0.051% 100.010% ( 1300, 1900 ] 220 0.046% 100.056% ( 1900, 2900 ] 215 0.045% 100.101% ( 2900, 4400 ] 157 0.033% 100.134% ( 4400, 6600 ] 60 0.013% 100.146% ( 6600, 9900 ] 24 0.005% 100.151% ( 9900, 14000 ] 20 0.004% 100.155% ( 14000, 22000 ] 23 0.005% 100.160% ( 22000, 33000 ] 8 0.002% 100.162% ( 33000, 50000 ] 2 0.000% 100.162% ** Level 4 read latency histogram (micros): Count: 198350 Average: 52.6623 StdDev: 427.36 Min: 1 Median: 2.0966 Max: 54510 Percentiles: P50: 2.10 P75: 3.96 P99: 811.11 P99.9: 3070.83 P99.99: 4215.16 ------------------------------------------------------ [ 0, 1 ] 7172 3.616% 3.616% # ( 1, 2 ] 88384 44.560% 48.175% ######### ( 2, 3 ] 37454 18.883% 67.058% #### ( 3, 4 ] 16441 8.289% 75.347% ## ( 4, 6 ] 17231 8.687% 84.034% ## ( 6, 10 ] 4360 2.198% 86.232% ( 10, 15 ] 992 0.500% 86.733% ( 15, 22 ] 131 0.066% 86.799% ( 22, 34 ] 16 0.008% 86.807% ( 34, 51 ] 7 0.004% 86.810% ( 51, 76 ] 4 0.002% 86.812% ( 76, 110 ] 1024 0.516% 87.328% ( 110, 170 ] 11455 5.775% 93.104% # ( 170, 250 ] 7492 3.777% 96.881% # ( 250, 380 ] 1958 0.987% 97.868% ( 380, 580 ] 1490 0.751% 98.619% ( 580, 870 ] 948 0.478% 99.097% ( 870, 1300 ] 689 0.347% 99.444% ( 1300, 1900 ] 498 0.251% 99.695% ( 1900, 2900 ] 379 0.191% 99.887% ( 2900, 4400 ] 234 0.118% 100.005% ( 4400, 6600 ] 99 0.050% 100.054% ( 6600, 9900 ] 14 0.007% 100.062% ( 9900, 14000 ] 10 0.005% 100.067% ( 14000, 22000 ] 14 0.007% 100.074% ( 22000, 33000 ] 12 0.006% 100.080% ( 33000, 50000 ] 4 0.002% 100.082% ( 50000, 75000 ] 1 0.001% 100.082% ** Level 5 read latency histogram (micros): Count: 185747 Average: 287.5052 StdDev: 687.95 Min: 80 Median: 168.8509 Max: 52012 Percentiles: P50: 168.85 P75: 234.11 P99: 3020.96 P99.9: 6581.87 P99.99: 27456.75 ------------------------------------------------------ ( 76, 110 ] 7883 4.244% 4.244% # ( 110, 170 ] 86650 46.649% 50.893% ######### ( 170, 250 ] 55873 30.080% 80.974% ###### ( 250, 380 ] 14012 7.544% 88.517% ## ( 380, 580 ] 9995 5.381% 93.898% # ( 580, 870 ] 4678 2.518% 96.417% # ( 870, 1300 ] 2161 1.163% 97.580% ( 1300, 1900 ] 1310 0.705% 98.285% ( 1900, 2900 ] 1231 0.663% 98.948% ( 2900, 4400 ] 1197 0.644% 99.592% ( 4400, 6600 ] 576 0.310% 99.903% ( 6600, 9900 ] 101 0.054% 99.957% ( 9900, 14000 ] 21 0.011% 99.968% ( 14000, 22000 ] 31 0.017% 99.985% ( 22000, 33000 ] 19 0.010% 99.995% ( 33000, 50000 ] 7 0.004% 99.999% ( 50000, 75000 ] 2 0.001% 100.000% ** DB Stats ** Uptime(secs): 20.4 total, 9.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 144.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.209 H:M:S, 45.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 103.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.874 H:M:S, 61.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/07-05:32:17 ... thread 0: (1000000,4000000) ops and (110625.7,136825.7) ops/second in (9.039487,29.234270) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/15 3.75 GB 0.0 4.6 0.0 4.6 8.4 3.7 0.0 2.2 139.8 253.4 33.78 28.77 71 0.476 4796K 7587 0.0 0.0 L1 17/17 1.57 GB 0.0 1.6 1.2 0.4 1.6 1.2 0.0 1.3 57.5 57.1 28.22 11.52 1 28.215 1646K 11K 0.0 0.0 L3 13/0 990.61 MB 1.0 1.5 1.3 0.2 1.4 1.3 0.0 1.2 141.8 141.4 10.49 6.99 3 3.498 1011K 0 0.0 0.0 L4 165/0 9.73 GB 1.0 3.2 2.5 0.7 3.2 2.5 0.3 1.3 108.7 107.9 30.10 17.04 23 1.309 1230K 650 0.0 0.0 L5 1112/0 92.15 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1322/32 108.17 GB 0.0 10.8 5.0 5.9 14.6 8.7 5.0 3.9 108.3 145.2 102.59 64.32 98 1.047 8685K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.8 5.0 5.9 14.6 8.7 5.0 3.9 108.3 145.2 102.59 64.32 98 1.047 8685K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.8 5.0 5.9 10.8 4.9 0.0 0.0 127.4 126.9 87.16 53.35 41 2.126 8685K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 249.1 15.43 10.97 57 0.271 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.4 total, 29.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.55 GB write, 506.08 MB/s write, 10.85 GB read, 377.18 MB/s read, 102.6 seconds Interval compaction: 14.55 GB write, 509.68 MB/s write, 10.85 GB read, 379.86 MB/s read, 102.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 25, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1614959 Average: 20.3921 StdDev: 145.85 Min: 0 Median: 1.5545 Max: 50992 Percentiles: P50: 1.55 P75: 2.05 P99: 288.82 P99.9: 784.23 P99.99: 1369.18 ------------------------------------------------------ [ 0, 1 ] 315626 19.544% 19.544% #### ( 1, 2 ] 887083 54.929% 74.473% ########### ( 2, 3 ] 158361 9.806% 84.279% ## ( 3, 4 ] 58340 3.612% 87.891% # ( 4, 6 ] 52107 3.227% 91.118% # ( 6, 10 ] 10296 0.638% 91.755% ( 10, 15 ] 1835 0.114% 91.869% ( 15, 22 ] 259 0.016% 91.885% ( 22, 34 ] 36 0.002% 91.887% ( 34, 51 ] 9 0.001% 91.888% ( 51, 76 ] 19 0.001% 91.889% ( 76, 110 ] 5188 0.321% 92.210% ( 110, 170 ] 63783 3.950% 96.160% # ( 170, 250 ] 42997 2.662% 98.822% # ( 250, 380 ] 9619 0.596% 99.418% ( 380, 580 ] 6107 0.378% 99.796% ( 580, 870 ] 2387 0.148% 99.944% ( 870, 1300 ] 703 0.044% 99.987% ( 1300, 1900 ] 386 0.024% 100.011% ( 1900, 2900 ] 341 0.021% 100.032% ( 2900, 4400 ] 217 0.013% 100.046% ( 4400, 6600 ] 67 0.004% 100.050% ( 6600, 9900 ] 26 0.002% 100.052% ( 9900, 14000 ] 13 0.001% 100.052% ( 14000, 22000 ] 13 0.001% 100.053% ( 22000, 33000 ] 10 0.001% 100.054% ( 33000, 50000 ] 2 0.000% 100.054% ( 50000, 75000 ] 1 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 96482 Average: 10.5652 StdDev: 98.97 Min: 1 Median: 3.9014 Max: 11561 Percentiles: P50: 3.90 P75: 5.20 P99: 171.94 P99.9: 603.19 P99.99: 3163.85 ------------------------------------------------------ [ 0, 1 ] 109 0.113% 0.113% ( 1, 2 ] 2249 2.331% 2.444% ( 2, 3 ] 10847 11.243% 13.686% ## ( 3, 4 ] 38870 40.287% 53.974% ######## ( 4, 6 ] 33776 35.008% 88.981% ####### ( 6, 10 ] 5861 6.075% 95.056% # ( 10, 15 ] 1278 1.325% 96.381% ( 15, 22 ] 1303 1.351% 97.731% ( 22, 34 ] 104 0.108% 97.839% ( 34, 51 ] 7 0.007% 97.846% ( 76, 110 ] 98 0.102% 97.948% ( 110, 170 ] 1001 1.037% 98.985% ( 170, 250 ] 585 0.606% 99.592% ( 250, 380 ] 169 0.175% 99.767% ( 380, 580 ] 125 0.130% 99.896% ( 580, 870 ] 44 0.046% 99.942% ( 870, 1300 ] 28 0.029% 99.971% ( 1300, 1900 ] 10 0.010% 99.981% ( 1900, 2900 ] 8 0.008% 99.990% ( 2900, 4400 ] 2 0.002% 99.992% ( 4400, 6600 ] 3 0.003% 99.995% ( 6600, 9900 ] 5 0.005% 100.000% ( 9900, 14000 ] 3 0.003% 100.003% ** Level 2 read latency histogram (micros): Count: 294671 Average: 12.0009 StdDev: 268.88 Min: 1 Median: 1.7761 Max: 46970 Percentiles: P50: 1.78 P75: 2.59 P99: 11.87 P99.9: 2374.22 P99.99: 6467.62 ------------------------------------------------------ [ 0, 1 ] 13839 4.696% 4.696% # ( 1, 2 ] 172020 58.377% 63.073% ############ ( 2, 3 ] 59528 20.202% 83.275% #### ( 3, 4 ] 19584 6.646% 89.921% # ( 4, 6 ] 19913 6.758% 96.679% # ( 6, 10 ] 6287 2.134% 98.812% ( 10, 15 ] 1483 0.503% 99.316% ( 15, 22 ] 237 0.080% 99.396% ( 22, 34 ] 35 0.012% 99.408% ( 34, 51 ] 11 0.004% 99.412% ( 51, 76 ] 7 0.002% 99.414% ( 76, 110 ] 17 0.006% 99.420% ( 110, 170 ] 168 0.057% 99.477% ( 170, 250 ] 181 0.061% 99.538% ( 250, 380 ] 146 0.050% 99.588% ( 380, 580 ] 167 0.057% 99.644% ( 580, 870 ] 178 0.060% 99.705% ( 870, 1300 ] 225 0.076% 99.781% ( 1300, 1900 ] 246 0.083% 99.865% ( 1900, 2900 ] 220 0.075% 99.939% ( 2900, 4400 ] 111 0.038% 99.977% ( 4400, 6600 ] 41 0.014% 99.991% ( 6600, 9900 ] 16 0.005% 99.996% ( 9900, 14000 ] 2 0.001% 99.997% ( 14000, 22000 ] 5 0.002% 99.999% ( 22000, 33000 ] 9 0.003% 100.002% ( 33000, 50000 ] 5 0.002% 100.003% ** Level 3 read latency histogram (micros): Count: 480792 Average: 11.6563 StdDev: 229.20 Min: 1 Median: 1.8873 Max: 42575 Percentiles: P50: 1.89 P75: 2.87 P99: 125.23 P99.9: 554.16 P99.99: 1134.74 ------------------------------------------------------ [ 0, 1 ] 16890 3.513% 3.513% # ( 1, 2 ] 251897 52.392% 55.905% ########## ( 2, 3 ] 105517 21.946% 77.852% #### ( 3, 4 ] 44731 9.304% 87.155% ## ( 4, 6 ] 45744 9.514% 96.669% ## ( 6, 10 ] 8323 1.731% 98.401% ( 10, 15 ] 1572 0.327% 98.728% ( 15, 22 ] 235 0.049% 98.776% ( 22, 34 ] 30 0.006% 98.783% ( 34, 51 ] 37 0.008% 98.790% ( 51, 76 ] 23 0.005% 98.795% ( 76, 110 ] 292 0.061% 98.856% ( 110, 170 ] 2731 0.568% 99.424% ( 170, 250 ] 1545 0.321% 99.745% ( 250, 380 ] 449 0.093% 99.839% ( 380, 580 ] 339 0.071% 99.909% ( 580, 870 ] 235 0.049% 99.958% ( 870, 1300 ] 250 0.052% 100.010% ( 1300, 1900 ] 220 0.046% 100.056% ( 1900, 2900 ] 215 0.045% 100.100% ( 2900, 4400 ] 157 0.033% 100.133% ( 4400, 6600 ] 60 0.012% 100.146% ( 6600, 9900 ] 24 0.005% 100.151% ( 9900, 14000 ] 20 0.004% 100.155% ( 14000, 22000 ] 23 0.005% 100.160% ( 22000, 33000 ] 8 0.002% 100.161% ( 33000, 50000 ] 2 0.000% 100.162% ** Level 4 read latency histogram (micros): Count: 216406 Average: 62.7508 StdDev: 411.77 Min: 1 Median: 2.3319 Max: 54510 Percentiles: P50: 2.33 P75: 5.38 P99: 784.60 P99.9: 2955.09 P99.99: 4203.59 ------------------------------------------------------ [ 0, 1 ] 7172 3.314% 3.314% # ( 1, 2 ] 88475 40.884% 44.198% ######## ( 2, 3 ] 37830 17.481% 61.679% ### ( 3, 4 ] 16669 7.703% 69.382% ## ( 4, 6 ] 17652 8.157% 77.539% ## ( 6, 10 ] 4408 2.037% 79.575% ( 10, 15 ] 1004 0.464% 80.039% ( 15, 22 ] 131 0.061% 80.100% ( 22, 34 ] 18 0.008% 80.108% ( 34, 51 ] 7 0.003% 80.111% ( 51, 76 ] 4 0.002% 80.113% ( 76, 110 ] 2150 0.994% 81.107% ( 110, 170 ] 20557 9.499% 90.606% ## ( 170, 250 ] 12191 5.633% 96.239% # ( 250, 380 ] 3026 1.398% 97.638% ( 380, 580 ] 2150 0.994% 98.631% ( 580, 870 ] 1131 0.523% 99.154% ( 870, 1300 ] 722 0.334% 99.488% ( 1300, 1900 ] 503 0.232% 99.720% ( 1900, 2900 ] 381 0.176% 99.896% ( 2900, 4400 ] 234 0.108% 100.004% ( 4400, 6600 ] 99 0.046% 100.050% ( 6600, 9900 ] 14 0.006% 100.056% ( 9900, 14000 ] 10 0.005% 100.061% ( 14000, 22000 ] 14 0.006% 100.067% ( 22000, 33000 ] 12 0.006% 100.073% ( 33000, 50000 ] 4 0.002% 100.075% ( 50000, 75000 ] 1 0.000% 100.075% ** Level 5 read latency histogram (micros): Count: 307574 Average: 246.9942 StdDev: 541.57 Min: 80 Median: 164.1518 Max: 52012 Percentiles: P50: 164.15 P75: 225.23 P99: 2017.76 P99.9: 6112.74 P99.99: 21030.35 ------------------------------------------------------ ( 76, 110 ] 15978 5.195% 5.195% # ( 110, 170 ] 152692 49.644% 54.839% ########## ( 170, 250 ] 89821 29.203% 84.042% ###### ( 250, 380 ] 21407 6.960% 91.002% # ( 380, 580 ] 14705 4.781% 95.783% # ( 580, 870 ] 6033 1.961% 97.744% ( 870, 1300 ] 2361 0.768% 98.512% ( 1300, 1900 ] 1354 0.440% 98.952% ( 1900, 2900 ] 1259 0.409% 99.361% ( 2900, 4400 ] 1209 0.393% 99.755% ( 4400, 6600 ] 576 0.187% 99.942% ( 6600, 9900 ] 101 0.033% 99.975% ( 9900, 14000 ] 21 0.007% 99.981% ( 14000, 22000 ] 31 0.010% 99.992% ( 22000, 33000 ] 19 0.006% 99.998% ( 33000, 50000 ] 7 0.002% 100.000% ( 50000, 75000 ] 2 0.001% 100.001% ** DB Stats ** Uptime(secs): 29.4 total, 9.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 133.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.716 H:M:S, 50.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 108.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.507 H:M:S, 60.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 244.445 micros/op 16351 ops/sec 60.116 seconds 982996 operations; 15.8 MB/s (239999 of 239999 found) Microseconds per read: Count: 982996 Average: 244.4463 StdDev: 692.77 Min: 2 Median: 197.7193 Max: 80362 Percentiles: P50: 197.72 P75: 240.48 P99: 831.92 P99.9: 9961.80 P99.99: 31138.94 ------------------------------------------------------ ( 1, 2 ] 7 0.001% 0.001% ( 2, 3 ] 47 0.005% 0.005% ( 3, 4 ] 64 0.007% 0.012% ( 4, 6 ] 83 0.008% 0.020% ( 6, 10 ] 431 0.044% 0.064% ( 10, 15 ] 4572 0.465% 0.529% ( 15, 22 ] 5806 0.591% 1.120% ( 22, 34 ] 8877 0.903% 2.023% ( 34, 51 ] 3199 0.325% 2.349% ( 51, 76 ] 433 0.044% 2.393% ( 76, 110 ] 3234 0.329% 2.722% ( 110, 170 ] 305425 31.071% 33.792% ###### ( 170, 250 ] 459809 46.776% 80.569% ######### ( 250, 380 ] 114755 11.674% 92.243% ## ( 380, 580 ] 52887 5.380% 97.623% # ( 580, 870 ] 15583 1.585% 99.208% ( 870, 1300 ] 4144 0.422% 99.630% ( 1300, 1900 ] 1042 0.106% 99.736% ( 1900, 2900 ] 642 0.065% 99.801% ( 2900, 4400 ] 458 0.047% 99.848% ( 4400, 6600 ] 204 0.021% 99.868% ( 6600, 9900 ] 306 0.031% 99.899% ( 9900, 14000 ] 332 0.034% 99.933% ( 14000, 22000 ] 404 0.041% 99.974% ( 22000, 33000 ] 185 0.019% 99.993% ( 33000, 50000 ] 52 0.005% 99.998% ( 50000, 75000 ] 14 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 17614786 rocksdb.bloom.filter.full.positive COUNT : 1153995 rocksdb.bloom.filter.full.true.positive COUNT : 982603 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 393 rocksdb.memtable.miss COUNT : 982603 rocksdb.l0.hit COUNT : 40157 rocksdb.l1.hit COUNT : 10966 rocksdb.l2andup.hit COUNT : 931480 rocksdb.compaction.key.drop.new COUNT : 73257 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4457019 rocksdb.number.keys.read COUNT : 982996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4599643608 rocksdb.bytes.read COUNT : 982996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1475 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 43104699 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 13654113956 rocksdb.compact.write.bytes COUNT : 13576911460 rocksdb.flush.write.bytes COUNT : 4558202218 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 65 rocksdb.number.superversion_acquires COUNT : 768 rocksdb.number.superversion_releases COUNT : 736 rocksdb.number.superversion_cleanups COUNT : 192 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 143 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4521200640 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1528832 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 18025206568 rocksdb.non.last.level.read.count COUNT : 4209532 rocksdb.block.checksum.compute.count COUNT : 4472619 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 196.797438 P95 : 481.193352 P99 : 831.188184 P100 : 80361.000000 COUNT : 982996 SUM : 239470114 rocksdb.db.write.micros P50 : 1.524973 P95 : 4.816689 P99 : 13.278447 P100 : 619781.000000 COUNT : 4457019 SUM : 54319663 rocksdb.compaction.times.micros P50 : 1183000.000000 P95 : 4020000.000000 P99 : 28160000.000000 P100 : 28215162.000000 COUNT : 44 SUM : 90027704 rocksdb.compaction.times.cpu_micros P50 : 928000.000000 P95 : 4020000.000000 P99 : 11521875.000000 P100 : 11521875.000000 COUNT : 44 SUM : 56149927 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 856.818182 P95 : 9487.500000 P99 : 25627.000000 P100 : 25627.000000 COUNT : 65 SUM : 122459 rocksdb.compaction.outfile.sync.micros P50 : 2275.000000 P95 : 52500.000000 P99 : 108133.333333 P100 : 112324.000000 COUNT : 116 SUM : 1509929 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 176.956522 P95 : 5304.444444 P99 : 6536.444444 P100 : 7198.000000 COUNT : 126 SUM : 120705 rocksdb.table.open.io.micros P50 : 8934.830097 P95 : 20622.047244 P99 : 27591.666667 P100 : 32650.000000 COUNT : 1475 SUM : 14178124 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.802116 P95 : 133.247158 P99 : 240.142578 P100 : 54518.000000 COUNT : 3306196 SUM : 68810150 rocksdb.read.block.get.micros P50 : 153.197181 P95 : 325.501687 P99 : 731.512545 P100 : 52017.000000 COUNT : 1164930 SUM : 206182113 rocksdb.write.raw.block.micros P50 : 0.551834 P95 : 1.626456 P99 : 3.787307 P100 : 68027.000000 COUNT : 4392048 SUM : 14422174 rocksdb.numfiles.in.singlecompaction P50 : 3.227273 P95 : 5.900000 P99 : 26.440000 P100 : 28.000000 COUNT : 63 SUM : 243 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.569471 P95 : 1216.789006 P99 : 2596.104928 P100 : 619615.000000 COUNT : 250695 SUM : 43126792 rocksdb.sst.read.micros P50 : 2.321906 P95 : 225.181049 P99 : 463.457120 P100 : 54510.000000 COUNT : 4209601 SUM : 259210381 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 982996 SUM : 982996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4457019 SUM : 4599643608 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 222000.000000 P95 : 558125.000000 P99 : 1003573.000000 P100 : 1003573.000000 COUNT : 65 SUM : 17132934 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 156 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0