[2024-12-15 01:30:03.132297] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 22.11.4 initialization... [2024-12-15 01:30:03.132539] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1223176 ] Set seed to 1734222603126840 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 01:30:03.228974] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 01:30:03.270788] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 01:30:03.270832] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1223176' to capture a snapshot of events at runtime. [2024-12-15 01:30:03.270843] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-15 01:30:03.270853] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-15 01:30:03.270860] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1223176 for offline analysis/debug. [2024-12-15 01:30:03.270944] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 01:30:07 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-01:30:16 ... thread 0: (1000000,1000000) ops and (118374.5,118374.5) ops/second in (8.447767,8.447767) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 2.42 GB 62.9 0.6 0.0 0.6 1.4 0.9 0.0 1.6 86.7 221.6 6.54 4.60 15 0.436 575K 623 0.0 0.0 L1 12/12 1.43 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 973.14 MB 1.0 1.9 1.2 0.6 1.8 1.2 0.0 1.5 111.2 110.0 17.17 8.91 8 2.146 765K 0 0.0 0.0 L4 171/0 9.47 GB 1.0 4.8 2.7 2.0 4.7 2.7 0.1 1.7 118.0 116.1 41.26 22.60 25 1.650 1783K 5029 0.0 0.0 L5 1128/0 92.83 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1339/18 107.11 GB 0.0 7.2 4.0 3.2 7.9 4.7 3.0 9.2 113.0 125.1 64.96 36.11 48 1.353 3125K 5652 0.0 0.0 Int 0/0 0.00 KB 0.0 7.2 4.0 3.2 7.9 4.7 3.0 9.2 113.0 125.1 64.96 36.11 48 1.353 3125K 5652 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.2 4.0 3.2 7.1 3.9 0.0 0.0 121.1 119.5 60.64 33.66 35 1.733 3125K 5652 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 204.1 4.32 2.45 13 0.332 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.7 total, 8.4 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.94 GB write, 936.94 MB/s write, 7.17 GB read, 846.51 MB/s read, 65.0 seconds Interval compaction: 7.94 GB write, 961.94 MB/s write, 7.17 GB read, 869.10 MB/s read, 65.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 19, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 4, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 458968 Average: 8.7988 StdDev: 107.79 Min: 1 Median: 1.9285 Max: 11678 Percentiles: P50: 1.93 P75: 2.84 P99: 11.89 P99.9: 1140.15 P99.99: 2087.35 ------------------------------------------------------ [ 0, 1 ] 19936 4.344% 4.344% # ( 1, 2 ] 225676 49.170% 53.514% ########## ( 2, 3 ] 117626 25.628% 79.142% ##### ( 3, 4 ] 37165 8.098% 87.240% ## ( 4, 6 ] 42102 9.173% 96.413% ## ( 6, 10 ] 11237 2.448% 98.861% ( 10, 15 ] 1690 0.368% 99.230% ( 15, 22 ] 231 0.050% 99.280% ( 22, 34 ] 32 0.007% 99.287% ( 34, 51 ] 28 0.006% 99.293% ( 51, 76 ] 22 0.005% 99.298% ( 76, 110 ] 152 0.033% 99.331% ( 110, 170 ] 541 0.118% 99.449% ( 170, 250 ] 488 0.106% 99.555% ( 250, 380 ] 448 0.098% 99.653% ( 380, 580 ] 470 0.102% 99.755% ( 580, 870 ] 445 0.097% 99.852% ( 870, 1300 ] 355 0.077% 99.929% ( 1300, 1900 ] 253 0.055% 99.985% ( 1900, 2900 ] 150 0.033% 100.017% ( 2900, 4400 ] 145 0.032% 100.049% ( 4400, 6600 ] 34 0.007% 100.056% ( 6600, 9900 ] 4 0.001% 100.057% ( 9900, 14000 ] 1 0.000% 100.057% ** Level 1 read latency histogram (micros): Count: 542 Average: 991.0793 StdDev: 1784.10 Min: 84 Median: 433.6585 Max: 12349 Percentiles: P50: 433.66 P75: 933.02 P99: 9774.00 P99.9: 12349.00 P99.99: 12349.00 ------------------------------------------------------ ( 76, 110 ] 22 4.059% 4.059% # ( 110, 170 ] 80 14.760% 18.819% ### ( 170, 250 ] 78 14.391% 33.210% ### ( 250, 380 ] 69 12.731% 45.941% ### ( 380, 580 ] 82 15.129% 61.070% ### ( 580, 870 ] 67 12.362% 73.432% ## ( 870, 1300 ] 58 10.701% 84.133% ## ( 1300, 1900 ] 31 5.720% 89.852% # ( 1900, 2900 ] 14 2.583% 92.435% # ( 2900, 4400 ] 18 3.321% 95.756% # ( 4400, 6600 ] 7 1.292% 97.048% ( 6600, 9900 ] 11 2.030% 99.077% ( 9900, 14000 ] 5 0.923% 100.000% ** Level 2 read latency histogram (micros): Count: 97273 Average: 10.0064 StdDev: 131.75 Min: 1 Median: 1.9852 Max: 11778 Percentiles: P50: 1.99 P75: 2.97 P99: 9.90 P99.9: 1930.84 P99.99: 4749.99 ------------------------------------------------------ [ 0, 1 ] 1275 1.311% 1.311% ( 1, 2 ] 48071 49.419% 50.729% ########## ( 2, 3 ] 24304 24.985% 75.715% ##### ( 3, 4 ] 9980 10.260% 85.975% ## ( 4, 6 ] 10138 10.422% 96.397% ## ( 6, 10 ] 2594 2.667% 99.063% # ( 10, 15 ] 351 0.361% 99.424% ( 15, 22 ] 39 0.040% 99.464% ( 22, 34 ] 7 0.007% 99.472% ( 34, 51 ] 10 0.010% 99.482% ( 51, 76 ] 10 0.010% 99.492% ( 76, 110 ] 2 0.002% 99.494% ( 110, 170 ] 5 0.005% 99.499% ( 170, 250 ] 11 0.011% 99.511% ( 250, 380 ] 21 0.022% 99.532% ( 380, 580 ] 62 0.064% 99.596% ( 580, 870 ] 95 0.098% 99.694% ( 870, 1300 ] 115 0.118% 99.812% ( 1300, 1900 ] 84 0.086% 99.898% ( 1900, 2900 ] 56 0.058% 99.956% ( 2900, 4400 ] 32 0.033% 99.989% ( 4400, 6600 ] 8 0.008% 99.997% ( 6600, 9900 ] 1 0.001% 99.998% ( 9900, 14000 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 694668 Average: 8.3000 StdDev: 112.34 Min: 1 Median: 2.0168 Max: 8404 Percentiles: P50: 2.02 P75: 3.03 P99: 9.45 P99.9: 460.07 P99.99: 805.97 ------------------------------------------------------ [ 0, 1 ] 10167 1.464% 1.464% ( 1, 2 ] 334229 48.113% 49.577% ########## ( 2, 3 ] 174483 25.117% 74.695% ##### ( 3, 4 ] 74318 10.698% 85.393% ## ( 4, 6 ] 78614 11.317% 96.710% ## ( 6, 10 ] 18471 2.659% 99.369% # ( 10, 15 ] 2537 0.365% 99.734% ( 15, 22 ] 369 0.053% 99.787% ( 22, 34 ] 36 0.005% 99.792% ( 34, 51 ] 33 0.005% 99.797% ( 51, 76 ] 39 0.006% 99.802% ( 76, 110 ] 52 0.007% 99.810% ( 110, 170 ] 148 0.021% 99.831% ( 170, 250 ] 148 0.021% 99.853% ( 250, 380 ] 184 0.026% 99.879% ( 380, 580 ] 363 0.052% 99.931% ( 580, 870 ] 523 0.075% 100.007% ( 870, 1300 ] 527 0.076% 100.082% ( 1300, 1900 ] 396 0.057% 100.139% ( 1900, 2900 ] 248 0.036% 100.175% ( 2900, 4400 ] 232 0.033% 100.209% ( 4400, 6600 ] 73 0.011% 100.219% ( 6600, 9900 ] 12 0.002% 100.221% ** Level 4 read latency histogram (micros): Count: 501532 Average: 19.3812 StdDev: 187.20 Min: 1 Median: 2.0624 Max: 8428 Percentiles: P50: 2.06 P75: 3.13 P99: 330.55 P99.9: 1796.68 P99.99: 2423.29 ------------------------------------------------------ [ 0, 1 ] 7169 1.429% 1.429% ( 1, 2 ] 235708 46.998% 48.427% ######### ( 2, 3 ] 126394 25.202% 73.629% ##### ( 3, 4 ] 53482 10.664% 84.292% ## ( 4, 6 ] 55462 11.059% 95.351% ## ( 6, 10 ] 13904 2.772% 98.123% # ( 10, 15 ] 1981 0.395% 98.518% ( 15, 22 ] 284 0.057% 98.575% ( 22, 34 ] 29 0.006% 98.581% ( 34, 51 ] 29 0.006% 98.586% ( 51, 76 ] 32 0.006% 98.593% ( 76, 110 ] 168 0.033% 98.626% ( 110, 170 ] 693 0.138% 98.764% ( 170, 250 ] 743 0.148% 98.913% ( 250, 380 ] 708 0.141% 99.054% ( 380, 580 ] 1049 0.209% 99.263% ( 580, 870 ] 1203 0.240% 99.503% ( 870, 1300 ] 1265 0.252% 99.755% ( 1300, 1900 ] 880 0.175% 99.930% ( 1900, 2900 ] 573 0.114% 100.045% ( 2900, 4400 ] 423 0.084% 100.129% ( 4400, 6600 ] 144 0.029% 100.158% ( 6600, 9900 ] 17 0.003% 100.161% ** Level 5 read latency histogram (micros): Count: 29208 Average: 843.2265 StdDev: 1127.62 Min: 75 Median: 414.1342 Max: 10789 Percentiles: P50: 414.13 P75: 961.28 P99: 5865.10 P99.9: 8949.56 P99.99: 9981.08 ------------------------------------------------------ ( 51, 76 ] 1 0.003% 0.003% ( 76, 110 ] 1266 4.334% 4.338% # ( 110, 170 ] 5098 17.454% 21.792% ### ( 170, 250 ] 4193 14.356% 36.148% ### ( 250, 380 ] 3393 11.617% 47.764% ## ( 380, 580 ] 3829 13.109% 60.874% ### ( 580, 870 ] 3543 12.130% 73.004% ## ( 870, 1300 ] 2750 9.415% 82.419% ## ( 1300, 1900 ] 1712 5.861% 88.281% # ( 1900, 2900 ] 1364 4.670% 92.951% # ( 2900, 4400 ] 1373 4.701% 97.651% # ( 4400, 6600 ] 593 2.030% 99.682% ( 6600, 9900 ] 91 0.312% 99.993% ( 9900, 14000 ] 4 0.014% 100.007% ** DB Stats ** Uptime(secs): 8.7 total, 8.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 113.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.676 H:M:S, 53.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 116.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.676 H:M:S, 55.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-01:30:19 ... thread 0: (1000000,2000000) ops and (292961.0,168617.1) ops/second in (3.413424,11.861191) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/6 3.41 GB 163.6 1.5 0.0 1.5 3.4 1.8 0.0 1.8 114.1 250.8 13.81 11.36 35 0.395 1599K 1622 0.0 0.0 L1 12/12 1.43 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 973.14 MB 1.0 1.9 1.2 0.6 1.8 1.2 0.0 1.5 111.2 110.0 17.17 8.91 8 2.146 765K 0 0.0 0.0 L4 171/0 9.47 GB 1.0 4.8 2.7 2.0 4.7 2.7 0.1 1.7 118.0 116.1 41.26 22.60 25 1.650 1783K 5029 0.0 0.0 L5 1128/0 92.83 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1343/18 108.09 GB 0.0 8.2 4.0 4.2 9.9 5.7 3.0 5.4 115.6 140.4 72.23 42.87 68 1.062 4148K 6651 0.0 0.0 Int 0/0 0.00 KB 0.0 8.2 4.0 4.2 9.9 5.7 3.0 5.4 115.6 140.4 72.23 42.87 68 1.062 4148K 6651 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.2 4.0 4.2 8.1 3.9 0.0 0.0 129.2 127.7 64.64 37.59 39 1.657 4148K 6651 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 248.9 7.59 5.28 29 0.262 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.90 GB write, 839.06 MB/s write, 8.16 GB read, 690.87 MB/s read, 72.2 seconds Interval compaction: 9.90 GB write, 855.00 MB/s write, 8.16 GB read, 704.00 MB/s read, 72.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 19, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 4, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 769965 Average: 7.4814 StdDev: 86.06 Min: 0 Median: 1.7537 Max: 11678 Percentiles: P50: 1.75 P75: 2.55 P99: 21.16 P99.9: 789.20 P99.99: 1613.05 ------------------------------------------------------ [ 0, 1 ] 66540 8.642% 8.642% ## ( 1, 2 ] 422512 54.874% 63.516% ########### ( 2, 3 ] 160878 20.894% 84.410% #### ( 3, 4 ] 48128 6.251% 90.661% # ( 4, 6 ] 49052 6.371% 97.032% # ( 6, 10 ] 12908 1.676% 98.708% ( 10, 15 ] 2001 0.260% 98.968% ( 15, 22 ] 280 0.036% 99.004% ( 22, 34 ] 37 0.005% 99.009% ( 34, 51 ] 30 0.004% 99.013% ( 51, 76 ] 27 0.004% 99.017% ( 76, 110 ] 582 0.076% 99.092% ( 110, 170 ] 2212 0.287% 99.379% ( 170, 250 ] 1613 0.209% 99.589% ( 250, 380 ] 1025 0.133% 99.722% ( 380, 580 ] 917 0.119% 99.841% ( 580, 870 ] 628 0.082% 99.923% ( 870, 1300 ] 386 0.050% 99.973% ( 1300, 1900 ] 253 0.033% 100.006% ( 1900, 2900 ] 153 0.020% 100.026% ( 2900, 4400 ] 145 0.019% 100.044% ( 4400, 6600 ] 34 0.004% 100.049% ( 6600, 9900 ] 4 0.001% 100.049% ( 9900, 14000 ] 1 0.000% 100.049% ** Level 1 read latency histogram (micros): Count: 115183 Average: 9.3197 StdDev: 142.23 Min: 1 Median: 1.7593 Max: 12349 Percentiles: P50: 1.76 P75: 2.48 P99: 147.14 P99.9: 1124.37 P99.99: 7944.51 ------------------------------------------------------ [ 0, 1 ] 5931 5.149% 5.149% # ( 1, 2 ] 68041 59.072% 64.221% ############ ( 2, 3 ] 25959 22.537% 86.758% ##### ( 3, 4 ] 6319 5.486% 92.245% # ( 4, 6 ] 4571 3.968% 96.213% # ( 6, 10 ] 2401 2.085% 98.297% ( 10, 15 ] 246 0.214% 98.511% ( 15, 22 ] 55 0.048% 98.559% ( 22, 34 ] 4 0.003% 98.562% ( 34, 51 ] 2 0.002% 98.564% ( 51, 76 ] 1 0.001% 98.565% ( 76, 110 ] 162 0.141% 98.706% ( 110, 170 ] 548 0.476% 99.181% ( 170, 250 ] 329 0.286% 99.467% ( 250, 380 ] 176 0.153% 99.620% ( 380, 580 ] 183 0.159% 99.779% ( 580, 870 ] 99 0.086% 99.865% ( 870, 1300 ] 69 0.060% 99.924% ( 1300, 1900 ] 31 0.027% 99.951% ( 1900, 2900 ] 15 0.013% 99.964% ( 2900, 4400 ] 18 0.016% 99.980% ( 4400, 6600 ] 7 0.006% 99.986% ( 6600, 9900 ] 11 0.010% 99.996% ( 9900, 14000 ] 5 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 97273 Average: 10.0064 StdDev: 131.75 Min: 1 Median: 1.9852 Max: 11778 Percentiles: P50: 1.99 P75: 2.97 P99: 9.90 P99.9: 1930.84 P99.99: 4749.99 ------------------------------------------------------ [ 0, 1 ] 1275 1.311% 1.311% ( 1, 2 ] 48071 49.419% 50.729% ########## ( 2, 3 ] 24304 24.985% 75.715% ##### ( 3, 4 ] 9980 10.260% 85.975% ## ( 4, 6 ] 10138 10.422% 96.397% ## ( 6, 10 ] 2594 2.667% 99.063% # ( 10, 15 ] 351 0.361% 99.424% ( 15, 22 ] 39 0.040% 99.464% ( 22, 34 ] 7 0.007% 99.472% ( 34, 51 ] 10 0.010% 99.482% ( 51, 76 ] 10 0.010% 99.492% ( 76, 110 ] 2 0.002% 99.494% ( 110, 170 ] 5 0.005% 99.499% ( 170, 250 ] 11 0.011% 99.511% ( 250, 380 ] 21 0.022% 99.532% ( 380, 580 ] 62 0.064% 99.596% ( 580, 870 ] 95 0.098% 99.694% ( 870, 1300 ] 115 0.118% 99.812% ( 1300, 1900 ] 84 0.086% 99.898% ( 1900, 2900 ] 56 0.058% 99.956% ( 2900, 4400 ] 32 0.033% 99.989% ( 4400, 6600 ] 8 0.008% 99.997% ( 6600, 9900 ] 1 0.001% 99.998% ( 9900, 14000 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 695386 Average: 8.4966 StdDev: 112.56 Min: 1 Median: 2.0188 Max: 8404 Percentiles: P50: 2.02 P75: 3.04 P99: 9.58 P99.9: 492.26 P99.99: 809.61 ------------------------------------------------------ [ 0, 1 ] 10167 1.462% 1.462% ( 1, 2 ] 334237 48.065% 49.527% ########## ( 2, 3 ] 174521 25.097% 74.624% ##### ( 3, 4 ] 74339 10.690% 85.314% ## ( 4, 6 ] 78636 11.308% 96.623% ## ( 6, 10 ] 18477 2.657% 99.280% # ( 10, 15 ] 2537 0.365% 99.645% ( 15, 22 ] 369 0.053% 99.698% ( 22, 34 ] 36 0.005% 99.703% ( 34, 51 ] 33 0.005% 99.708% ( 51, 76 ] 40 0.006% 99.713% ( 76, 110 ] 121 0.017% 99.731% ( 110, 170 ] 393 0.057% 99.787% ( 170, 250 ] 285 0.041% 99.828% ( 250, 380 ] 256 0.037% 99.865% ( 380, 580 ] 434 0.062% 99.927% ( 580, 870 ] 550 0.079% 100.006% ( 870, 1300 ] 528 0.076% 100.082% ( 1300, 1900 ] 396 0.057% 100.139% ( 1900, 2900 ] 248 0.036% 100.175% ( 2900, 4400 ] 232 0.033% 100.208% ( 4400, 6600 ] 73 0.010% 100.219% ( 6600, 9900 ] 12 0.002% 100.221% ** Level 4 read latency histogram (micros): Count: 507810 Average: 21.6976 StdDev: 188.08 Min: 1 Median: 2.0867 Max: 8428 Percentiles: P50: 2.09 P75: 3.21 P99: 438.24 P99.9: 1793.81 P99.99: 2423.03 ------------------------------------------------------ [ 0, 1 ] 7169 1.412% 1.412% ( 1, 2 ] 235756 46.426% 47.838% ######### ( 2, 3 ] 126587 24.928% 72.766% ##### ( 3, 4 ] 53600 10.555% 83.321% ## ( 4, 6 ] 55598 10.949% 94.270% ## ( 6, 10 ] 13929 2.743% 97.012% # ( 10, 15 ] 1986 0.391% 97.404% ( 15, 22 ] 284 0.056% 97.459% ( 22, 34 ] 29 0.006% 97.465% ( 34, 51 ] 29 0.006% 97.471% ( 51, 76 ] 34 0.007% 97.478% ( 76, 110 ] 843 0.166% 97.644% ( 110, 170 ] 3048 0.600% 98.244% ( 170, 250 ] 2019 0.398% 98.641% ( 250, 380 ] 1355 0.267% 98.908% ( 380, 580 ] 1600 0.315% 99.223% ( 580, 870 ] 1415 0.279% 99.502% ( 870, 1300 ] 1292 0.254% 99.756% ( 1300, 1900 ] 886 0.174% 99.931% ( 1900, 2900 ] 574 0.113% 100.044% ( 2900, 4400 ] 423 0.083% 100.127% ( 4400, 6600 ] 144 0.028% 100.156% ( 6600, 9900 ] 17 0.003% 100.159% ** Level 5 read latency histogram (micros): Count: 69801 Average: 483.6301 StdDev: 800.38 Min: 75 Median: 212.8294 Max: 10789 Percentiles: P50: 212.83 P75: 465.95 P99: 4384.72 P99.9: 7368.75 P99.99: 9646.88 ------------------------------------------------------ ( 51, 76 ] 4 0.006% 0.006% ( 76, 110 ] 6110 8.753% 8.759% ## ( 110, 170 ] 21672 31.048% 39.807% ###### ( 170, 250 ] 13289 19.038% 58.846% #### ( 250, 380 ] 7987 11.443% 70.288% ## ( 380, 580 ] 7653 10.964% 81.252% ## ( 580, 870 ] 4873 6.981% 88.234% # ( 870, 1300 ] 3039 4.354% 92.587% # ( 1300, 1900 ] 1733 2.483% 95.070% ( 1900, 2900 ] 1382 1.980% 97.050% ( 2900, 4400 ] 1375 1.970% 99.020% ( 4400, 6600 ] 593 0.850% 99.870% ( 6600, 9900 ] 91 0.130% 100.000% ( 9900, 14000 ] 4 0.006% 100.006% ** DB Stats ** Uptime(secs): 12.1 total, 3.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 162.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.676 H:M:S, 38.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-01:30:30 ... thread 0: (1000000,3000000) ops and (89047.0,129919.5) ops/second in (11.230027,23.091218) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/7 2.83 GB 132.2 2.8 0.0 2.8 5.6 2.8 0.0 2.0 129.1 260.9 21.96 18.98 56 0.392 2878K 2777 0.0 0.0 L1 9/0 1.09 GB 111.2 3.0 1.6 1.4 3.0 1.5 0.0 1.9 162.8 161.5 18.83 14.05 1 18.832 3114K 24K 0.0 0.0 L2 1/0 84.01 MB 0.8 0.0 0.0 0.0 0.0 0.0 1.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 28/8 1.71 GB 1.2 3.3 1.8 1.4 3.2 1.8 1.2 1.7 117.0 115.8 28.48 15.73 16 1.780 1857K 7456 0.0 0.0 L4 188/15 10.46 GB 1.0 7.0 3.8 3.2 6.9 3.7 0.1 1.8 124.8 122.7 57.38 33.44 37 1.551 3115K 10K 0.0 0.0 L5 1128/0 92.83 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1366/30 108.99 GB 0.0 16.0 7.2 8.8 18.7 9.8 6.1 6.6 129.5 150.9 126.65 82.20 110 1.151 10M 45K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.0 7.2 8.8 18.7 9.8 6.1 6.6 129.5 150.9 126.65 82.20 110 1.151 10M 45K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.0 7.2 8.8 15.8 7.0 0.0 0.0 141.6 140.0 115.83 74.12 65 1.782 10M 45K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 267.8 10.82 8.09 45 0.240 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.3 total, 23.1 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.66 GB write, 819.47 MB/s write, 16.01 GB read, 703.12 MB/s read, 126.6 seconds Interval compaction: 18.66 GB write, 827.47 MB/s write, 16.01 GB read, 709.98 MB/s read, 126.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 49, pending-compaction-bytes-stops: 0, total-delays: 49, total-stops: 4, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1557610 Average: 8.5254 StdDev: 80.52 Min: 0 Median: 1.6699 Max: 11678 Percentiles: P50: 1.67 P75: 2.36 P99: 158.99 P99.9: 832.59 P99.99: 1538.64 ------------------------------------------------------ [ 0, 1 ] 184531 11.847% 11.847% ## ( 1, 2 ] 887162 56.957% 68.804% ########### ( 2, 3 ] 267223 17.156% 85.960% ### ( 3, 4 ] 85878 5.513% 91.473% # ( 4, 6 ] 80747 5.184% 96.657% # ( 6, 10 ] 21115 1.356% 98.013% ( 10, 15 ] 3084 0.198% 98.211% ( 15, 22 ] 400 0.026% 98.236% ( 22, 34 ] 49 0.003% 98.240% ( 34, 51 ] 34 0.002% 98.242% ( 51, 76 ] 34 0.002% 98.244% ( 76, 110 ] 3535 0.227% 98.471% ( 110, 170 ] 10094 0.648% 99.119% ( 170, 250 ] 5140 0.330% 99.449% ( 250, 380 ] 2985 0.192% 99.641% ( 380, 580 ] 2572 0.165% 99.806% ( 580, 870 ] 1687 0.108% 99.914% ( 870, 1300 ] 981 0.063% 99.977% ( 1300, 1900 ] 511 0.033% 100.010% ( 1900, 2900 ] 252 0.016% 100.026% ( 2900, 4400 ] 206 0.013% 100.039% ( 4400, 6600 ] 49 0.003% 100.042% ( 6600, 9900 ] 4 0.000% 100.043% ( 9900, 14000 ] 2 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 683957 Average: 6.7954 StdDev: 90.21 Min: 0 Median: 1.8568 Max: 12349 Percentiles: P50: 1.86 P75: 2.75 P99: 11.91 P99.9: 588.03 P99.99: 989.97 ------------------------------------------------------ [ 0, 1 ] 25073 3.666% 3.666% # ( 1, 2 ] 369889 54.081% 57.747% ########### ( 2, 3 ] 157125 22.973% 80.720% ##### ( 3, 4 ] 53559 7.831% 88.550% ## ( 4, 6 ] 52939 7.740% 96.290% ## ( 6, 10 ] 17757 2.596% 98.887% # ( 10, 15 ] 2034 0.297% 99.184% ( 15, 22 ] 288 0.042% 99.226% ( 22, 34 ] 38 0.006% 99.232% ( 34, 51 ] 71 0.010% 99.242% ( 51, 76 ] 42 0.006% 99.248% ( 76, 110 ] 530 0.077% 99.326% ( 110, 170 ] 1652 0.242% 99.567% ( 170, 250 ] 897 0.131% 99.698% ( 250, 380 ] 704 0.103% 99.801% ( 380, 580 ] 660 0.096% 99.898% ( 580, 870 ] 543 0.079% 99.977% ( 870, 1300 ] 314 0.046% 100.023% ( 1300, 1900 ] 126 0.018% 100.042% ( 1900, 2900 ] 75 0.011% 100.052% ( 2900, 4400 ] 92 0.013% 100.066% ( 4400, 6600 ] 25 0.004% 100.070% ( 6600, 9900 ] 14 0.002% 100.072% ( 9900, 14000 ] 8 0.001% 100.073% ** Level 2 read latency histogram (micros): Count: 97273 Average: 10.0064 StdDev: 131.75 Min: 1 Median: 1.9852 Max: 11778 Percentiles: P50: 1.99 P75: 2.97 P99: 9.90 P99.9: 1930.84 P99.99: 4749.99 ------------------------------------------------------ [ 0, 1 ] 1275 1.311% 1.311% ( 1, 2 ] 48071 49.419% 50.729% ########## ( 2, 3 ] 24304 24.985% 75.715% ##### ( 3, 4 ] 9980 10.260% 85.975% ## ( 4, 6 ] 10138 10.422% 96.397% ## ( 6, 10 ] 2594 2.667% 99.063% # ( 10, 15 ] 351 0.361% 99.424% ( 15, 22 ] 39 0.040% 99.464% ( 22, 34 ] 7 0.007% 99.472% ( 34, 51 ] 10 0.010% 99.482% ( 51, 76 ] 10 0.010% 99.492% ( 76, 110 ] 2 0.002% 99.494% ( 110, 170 ] 5 0.005% 99.499% ( 170, 250 ] 11 0.011% 99.511% ( 250, 380 ] 21 0.022% 99.532% ( 380, 580 ] 62 0.064% 99.596% ( 580, 870 ] 95 0.098% 99.694% ( 870, 1300 ] 115 0.118% 99.812% ( 1300, 1900 ] 84 0.086% 99.898% ( 1900, 2900 ] 56 0.058% 99.956% ( 2900, 4400 ] 32 0.033% 99.989% ( 4400, 6600 ] 8 0.008% 99.997% ( 6600, 9900 ] 1 0.001% 99.998% ( 9900, 14000 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1105503 Average: 8.0974 StdDev: 103.67 Min: 1 Median: 2.0763 Max: 13029 Percentiles: P50: 2.08 P75: 3.14 P99: 9.74 P99.9: 466.91 P99.99: 746.40 ------------------------------------------------------ [ 0, 1 ] 13946 1.262% 1.262% ( 1, 2 ] 517367 46.799% 48.061% ######### ( 2, 3 ] 281001 25.418% 73.479% ##### ( 3, 4 ] 122200 11.054% 84.533% ## ( 4, 6 ] 132083 11.948% 96.481% ## ( 6, 10 ] 29818 2.697% 99.178% # ( 10, 15 ] 4065 0.368% 99.546% ( 15, 22 ] 551 0.050% 99.595% ( 22, 34 ] 57 0.005% 99.601% ( 34, 51 ] 109 0.010% 99.610% ( 51, 76 ] 90 0.008% 99.619% ( 76, 110 ] 337 0.030% 99.649% ( 110, 170 ] 1116 0.101% 99.750% ( 170, 250 ] 708 0.064% 99.814% ( 250, 380 ] 591 0.053% 99.868% ( 380, 580 ] 825 0.075% 99.942% ( 580, 870 ] 921 0.083% 100.026% ( 870, 1300 ] 808 0.073% 100.099% ( 1300, 1900 ] 521 0.047% 100.146% ( 1900, 2900 ] 306 0.028% 100.173% ( 2900, 4400 ] 307 0.028% 100.201% ( 4400, 6600 ] 88 0.008% 100.209% ( 6600, 9900 ] 16 0.001% 100.211% ( 9900, 14000 ] 1 0.000% 100.211% ** Level 4 read latency histogram (micros): Count: 933047 Average: 20.4203 StdDev: 165.92 Min: 1 Median: 2.1487 Max: 14445 Percentiles: P50: 2.15 P75: 3.35 P99: 383.03 P99.9: 1275.42 P99.99: 1633.08 ------------------------------------------------------ [ 0, 1 ] 10884 1.167% 1.167% ( 1, 2 ] 421133 45.135% 46.302% ######### ( 2, 3 ] 232063 24.872% 71.173% ##### ( 3, 4 ] 101736 10.904% 82.077% ## ( 4, 6 ] 107343 11.505% 93.581% ## ( 6, 10 ] 26380 2.827% 96.409% # ( 10, 15 ] 3515 0.377% 96.785% ( 15, 22 ] 446 0.048% 96.833% ( 22, 34 ] 53 0.006% 96.839% ( 34, 51 ] 114 0.012% 96.851% ( 51, 76 ] 88 0.009% 96.861% ( 76, 110 ] 2639 0.283% 97.143% ( 110, 170 ] 9385 1.006% 98.149% ( 170, 250 ] 4904 0.526% 98.675% ( 250, 380 ] 2985 0.320% 98.995% ( 380, 580 ] 3333 0.357% 99.352% ( 580, 870 ] 2920 0.313% 99.665% ( 870, 1300 ] 2328 0.250% 99.914% ( 1300, 1900 ] 1273 0.136% 100.051% ( 1900, 2900 ] 728 0.078% 100.129% ( 2900, 4400 ] 558 0.060% 100.189% ( 4400, 6600 ] 171 0.018% 100.207% ( 6600, 9900 ] 21 0.002% 100.209% ( 9900, 14000 ] 3 0.000% 100.210% ( 14000, 22000 ] 1 0.000% 100.210% ** Level 5 read latency histogram (micros): Count: 170408 Average: 373.6480 StdDev: 601.13 Min: 75 Median: 183.4034 Max: 14858 Percentiles: P50: 183.40 P75: 364.99 P99: 3608.43 P99.9: 6357.46 P99.99: 9366.29 ------------------------------------------------------ ( 51, 76 ] 8 0.005% 0.005% ( 76, 110 ] 17926 10.519% 10.524% ## ( 110, 170 ] 61885 36.316% 46.840% ####### ( 170, 250 ] 32141 18.861% 65.701% #### ( 250, 380 ] 17914 10.512% 76.214% ## ( 380, 580 ] 16564 9.720% 85.934% ## ( 580, 870 ] 10342 6.069% 92.003% # ( 870, 1300 ] 6293 3.693% 95.696% # ( 1300, 1900 ] 2975 1.746% 97.441% ( 1900, 2900 ] 1828 1.073% 98.514% ( 2900, 4400 ] 1753 1.029% 99.543% ( 4400, 6600 ] 684 0.401% 99.944% ( 6600, 9900 ] 93 0.055% 99.999% ( 9900, 14000 ] 9 0.005% 100.004% ( 14000, 22000 ] 1 0.001% 100.005% ** DB Stats ** Uptime(secs): 23.3 total, 11.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 126.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.190 H:M:S, 52.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 87.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.514 H:M:S, 66.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 0 2024/12/15-01:30:34 ... thread 0: (1000000,4000000) ops and (258655.3,148382.4) ops/second in (3.866149,26.957367) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 3.74 GB 69.2 4.8 0.0 4.8 8.5 3.7 0.0 2.3 142.7 253.9 34.43 29.61 74 0.465 4988K 14K 0.0 0.0 L1 9/9 1.09 GB 0.0 3.0 1.6 1.4 3.0 1.5 0.0 1.9 162.8 161.5 18.83 14.05 1 18.832 3114K 24K 0.0 0.0 L2 1/0 84.01 MB 0.8 0.0 0.0 0.0 0.0 0.0 1.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 992.19 MB 1.0 3.3 1.8 1.4 3.2 1.8 1.2 1.7 117.0 115.8 28.48 15.73 16 1.780 1857K 7456 0.0 0.0 L4 181/0 9.50 GB 1.0 9.0 4.5 4.5 8.8 4.4 0.1 2.0 132.2 129.8 69.52 42.81 49 1.419 4518K 20K 0.0 0.0 L5 1148/0 94.49 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1370/19 109.86 GB 0.0 20.0 7.9 12.1 23.5 11.5 7.8 6.3 135.5 159.4 151.25 102.20 140 1.080 14M 66K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.0 7.9 12.1 23.5 11.5 7.8 6.3 135.5 159.4 151.25 102.20 140 1.080 14M 66K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.0 7.9 12.1 19.8 7.7 0.0 0.0 149.4 147.7 137.22 91.50 80 1.715 14M 66K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 273.9 14.03 10.70 60 0.234 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.2 total, 27.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.54 GB write, 886.77 MB/s write, 20.02 GB read, 754.08 MB/s read, 151.3 seconds Interval compaction: 23.54 GB write, 894.18 MB/s write, 20.02 GB read, 760.39 MB/s read, 151.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 54, pending-compaction-bytes-stops: 0, total-delays: 54, total-stops: 4, interval: 57 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1756742 Average: 10.2193 StdDev: 85.20 Min: 0 Median: 1.6465 Max: 11678 Percentiles: P50: 1.65 P75: 2.30 P99: 205.79 P99.9: 874.68 P99.99: 1578.37 ------------------------------------------------------ [ 0, 1 ] 231988 13.206% 13.206% ### ( 1, 2 ] 999845 56.915% 70.120% ########### ( 2, 3 ] 282592 16.086% 86.206% ### ( 3, 4 ] 90174 5.133% 91.339% # ( 4, 6 ] 83117 4.731% 96.071% # ( 6, 10 ] 21609 1.230% 97.301% ( 10, 15 ] 3159 0.180% 97.481% ( 15, 22 ] 410 0.023% 97.504% ( 22, 34 ] 52 0.003% 97.507% ( 34, 51 ] 35 0.002% 97.509% ( 51, 76 ] 38 0.002% 97.511% ( 76, 110 ] 5234 0.298% 97.809% ( 110, 170 ] 17064 0.971% 98.780% ( 170, 250 ] 8626 0.491% 99.271% ( 250, 380 ] 4662 0.265% 99.537% ( 380, 580 ] 3971 0.226% 99.763% ( 580, 870 ] 2396 0.136% 99.899% ( 870, 1300 ] 1310 0.075% 99.974% ( 1300, 1900 ] 615 0.035% 100.009% ( 1900, 2900 ] 326 0.019% 100.027% ( 2900, 4400 ] 238 0.014% 100.041% ( 4400, 6600 ] 51 0.003% 100.044% ( 6600, 9900 ] 4 0.000% 100.044% ( 9900, 14000 ] 3 0.000% 100.044% ** Level 1 read latency histogram (micros): Count: 697979 Average: 7.1620 StdDev: 91.22 Min: 0 Median: 1.8600 Max: 12349 Percentiles: P50: 1.86 P75: 2.76 P99: 14.10 P99.9: 632.51 P99.99: 1049.21 ------------------------------------------------------ [ 0, 1 ] 25232 3.615% 3.615% # ( 1, 2 ] 376475 53.938% 57.553% ########### ( 2, 3 ] 160322 22.969% 80.522% ##### ( 3, 4 ] 54903 7.866% 88.388% ## ( 4, 6 ] 54247 7.772% 96.160% ## ( 6, 10 ] 18124 2.597% 98.757% # ( 10, 15 ] 2067 0.296% 99.053% ( 15, 22 ] 290 0.042% 99.095% ( 22, 34 ] 38 0.005% 99.100% ( 34, 51 ] 74 0.011% 99.111% ( 51, 76 ] 42 0.006% 99.117% ( 76, 110 ] 632 0.091% 99.207% ( 110, 170 ] 2056 0.295% 99.502% ( 170, 250 ] 1089 0.156% 99.658% ( 250, 380 ] 811 0.116% 99.774% ( 380, 580 ] 772 0.111% 99.885% ( 580, 870 ] 591 0.085% 99.969% ( 870, 1300 ] 346 0.050% 100.019% ( 1300, 1900 ] 139 0.020% 100.039% ( 1900, 2900 ] 83 0.012% 100.051% ( 2900, 4400 ] 96 0.014% 100.064% ( 4400, 6600 ] 26 0.004% 100.068% ( 6600, 9900 ] 14 0.002% 100.070% ( 9900, 14000 ] 8 0.001% 100.071% ** Level 2 read latency histogram (micros): Count: 97273 Average: 10.0064 StdDev: 131.75 Min: 1 Median: 1.9852 Max: 11778 Percentiles: P50: 1.99 P75: 2.97 P99: 9.90 P99.9: 1930.84 P99.99: 4749.99 ------------------------------------------------------ [ 0, 1 ] 1275 1.311% 1.311% ( 1, 2 ] 48071 49.419% 50.729% ########## ( 2, 3 ] 24304 24.985% 75.715% ##### ( 3, 4 ] 9980 10.260% 85.975% ## ( 4, 6 ] 10138 10.422% 96.397% ## ( 6, 10 ] 2594 2.667% 99.063% # ( 10, 15 ] 351 0.361% 99.424% ( 15, 22 ] 39 0.040% 99.464% ( 22, 34 ] 7 0.007% 99.472% ( 34, 51 ] 10 0.010% 99.482% ( 51, 76 ] 10 0.010% 99.492% ( 76, 110 ] 2 0.002% 99.494% ( 110, 170 ] 5 0.005% 99.499% ( 170, 250 ] 11 0.011% 99.511% ( 250, 380 ] 21 0.022% 99.532% ( 380, 580 ] 62 0.064% 99.596% ( 580, 870 ] 95 0.098% 99.694% ( 870, 1300 ] 115 0.118% 99.812% ( 1300, 1900 ] 84 0.086% 99.898% ( 1900, 2900 ] 56 0.058% 99.956% ( 2900, 4400 ] 32 0.033% 99.989% ( 4400, 6600 ] 8 0.008% 99.997% ( 6600, 9900 ] 1 0.001% 99.998% ( 9900, 14000 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1195093 Average: 8.0522 StdDev: 102.00 Min: 1 Median: 2.0542 Max: 13029 Percentiles: P50: 2.05 P75: 3.10 P99: 9.75 P99.9: 503.53 P99.99: 783.78 ------------------------------------------------------ [ 0, 1 ] 16647 1.393% 1.393% ( 1, 2 ] 564494 47.234% 48.627% ######### ( 2, 3 ] 302508 25.313% 73.940% ##### ( 3, 4 ] 129716 10.854% 84.794% ## ( 4, 6 ] 139632 11.684% 96.478% ## ( 6, 10 ] 32140 2.689% 99.167% # ( 10, 15 ] 4298 0.360% 99.527% ( 15, 22 ] 585 0.049% 99.576% ( 22, 34 ] 58 0.005% 99.580% ( 34, 51 ] 115 0.010% 99.590% ( 51, 76 ] 96 0.008% 99.598% ( 76, 110 ] 373 0.031% 99.629% ( 110, 170 ] 1241 0.104% 99.733% ( 170, 250 ] 784 0.066% 99.799% ( 250, 380 ] 655 0.055% 99.853% ( 380, 580 ] 900 0.075% 99.929% ( 580, 870 ] 1041 0.087% 100.016% ( 870, 1300 ] 901 0.075% 100.091% ( 1300, 1900 ] 553 0.046% 100.138% ( 1900, 2900 ] 325 0.027% 100.165% ( 2900, 4400 ] 320 0.027% 100.192% ( 4400, 6600 ] 88 0.007% 100.199% ( 6600, 9900 ] 16 0.001% 100.200% ( 9900, 14000 ] 1 0.000% 100.200% ** Level 4 read latency histogram (micros): Count: 1163875 Average: 18.7241 StdDev: 153.60 Min: 0 Median: 2.1018 Max: 14445 Percentiles: P50: 2.10 P75: 3.26 P99: 329.31 P99.9: 1157.34 P99.99: 1373.43 ------------------------------------------------------ [ 0, 1 ] 15514 1.333% 1.333% ( 1, 2 ] 537074 46.145% 47.478% ######### ( 2, 3 ] 288358 24.776% 72.254% ##### ( 3, 4 ] 122599 10.534% 82.788% ## ( 4, 6 ] 128588 11.048% 93.836% ## ( 6, 10 ] 32125 2.760% 96.596% # ( 10, 15 ] 4182 0.359% 96.955% ( 15, 22 ] 528 0.045% 97.001% ( 22, 34 ] 64 0.005% 97.006% ( 34, 51 ] 141 0.012% 97.018% ( 51, 76 ] 99 0.009% 97.027% ( 76, 110 ] 3175 0.273% 97.300% ( 110, 170 ] 11615 0.998% 98.298% ( 170, 250 ] 5986 0.514% 98.812% ( 250, 380 ] 3587 0.308% 99.120% ( 380, 580 ] 3948 0.339% 99.459% ( 580, 870 ] 3362 0.289% 99.748% ( 870, 1300 ] 2643 0.227% 99.975% ( 1300, 1900 ] 1394 0.120% 100.095% ( 1900, 2900 ] 771 0.066% 100.161% ( 2900, 4400 ] 586 0.050% 100.212% ( 4400, 6600 ] 174 0.015% 100.227% ( 6600, 9900 ] 21 0.002% 100.228% ( 9900, 14000 ] 3 0.000% 100.229% ( 14000, 22000 ] 1 0.000% 100.229% ** Level 5 read latency histogram (micros): Count: 207094 Average: 356.7128 StdDev: 563.40 Min: 75 Median: 179.4797 Max: 14858 Percentiles: P50: 179.48 P75: 352.39 P99: 3353.05 P99.9: 6226.11 P99.99: 9058.70 ------------------------------------------------------ ( 51, 76 ] 9 0.004% 0.004% ( 76, 110 ] 21732 10.494% 10.498% ## ( 110, 170 ] 77125 37.242% 47.740% ####### ( 170, 250 ] 39512 19.079% 66.819% #### ( 250, 380 ] 21513 10.388% 77.207% ## ( 380, 580 ] 19887 9.603% 86.810% ## ( 580, 870 ] 12135 5.860% 92.670% # ( 870, 1300 ] 7220 3.486% 96.156% # ( 1300, 1900 ] 3351 1.618% 97.774% ( 1900, 2900 ] 1981 0.957% 98.731% ( 2900, 4400 ] 1851 0.894% 99.624% ( 4400, 6600 ] 689 0.333% 99.957% ( 6600, 9900 ] 93 0.045% 100.002% ( 9900, 14000 ] 9 0.004% 100.006% ( 14000, 22000 ] 1 0.000% 100.007% ** DB Stats ** Uptime(secs): 27.2 total, 3.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 144.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.522 H:M:S, 46.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 254.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.331 H:M:S, 8.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 243.174 micros/op 16436 ops/sec 60.169 seconds 988996 operations; 15.9 MB/s (243999 of 243999 found) Microseconds per read: Count: 988996 Average: 243.1757 StdDev: 631.72 Min: 2 Median: 171.1662 Max: 55131 Percentiles: P50: 171.17 P75: 232.03 P99: 1258.42 P99.9: 10886.91 P99.99: 25447.36 ------------------------------------------------------ ( 1, 2 ] 9 0.001% 0.001% ( 2, 3 ] 30 0.003% 0.004% ( 3, 4 ] 35 0.004% 0.007% ( 4, 6 ] 97 0.010% 0.017% ( 6, 10 ] 349 0.035% 0.053% ( 10, 15 ] 3173 0.321% 0.373% ( 15, 22 ] 4283 0.433% 0.806% ( 22, 34 ] 11981 1.211% 2.018% ( 34, 51 ] 3297 0.333% 2.351% ( 51, 76 ] 341 0.034% 2.386% ( 76, 110 ] 18997 1.921% 4.307% ( 110, 170 ] 447168 45.214% 49.521% ######### ( 170, 250 ] 325013 32.863% 82.384% ####### ( 250, 380 ] 92872 9.391% 91.774% ## ( 380, 580 ] 42863 4.334% 96.108% # ( 580, 870 ] 20125 2.035% 98.143% ( 870, 1300 ] 9380 0.948% 99.092% ( 1300, 1900 ] 3934 0.398% 99.489% ( 1900, 2900 ] 2053 0.208% 99.697% ( 2900, 4400 ] 1300 0.131% 99.829% ( 4400, 6600 ] 389 0.039% 99.868% ( 6600, 9900 ] 208 0.021% 99.889% ( 9900, 14000 ] 457 0.046% 99.935% ( 14000, 22000 ] 508 0.051% 99.986% ( 22000, 33000 ] 112 0.011% 99.998% ( 33000, 50000 ] 21 0.002% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 12005266 rocksdb.bloom.filter.full.positive COUNT : 1105107 rocksdb.bloom.filter.full.true.positive COUNT : 988608 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 388 rocksdb.memtable.miss COUNT : 988608 rocksdb.l0.hit COUNT : 39144 rocksdb.l1.hit COUNT : 11520 rocksdb.l2andup.hit COUNT : 937944 rocksdb.compaction.key.drop.new COUNT : 255085 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4307087 rocksdb.number.keys.read COUNT : 988996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4444913784 rocksdb.bytes.read COUNT : 988996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1649 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 43704742 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 24573107099 rocksdb.compact.write.bytes COUNT : 24303891551 rocksdb.flush.write.bytes COUNT : 4426154576 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 30 rocksdb.number.superversion_acquires COUNT : 955 rocksdb.number.superversion_releases COUNT : 911 rocksdb.number.superversion_cleanups COUNT : 236 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 239 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4390167552 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1444864 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28069368874 rocksdb.non.last.level.read.count COUNT : 6639590 rocksdb.block.checksum.compute.count COUNT : 7064970 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 169.541224 P95 : 527.869437 P99 : 1257.742188 P100 : 55128.000000 COUNT : 988996 SUM : 239533389 rocksdb.db.write.micros P50 : 1.567958 P95 : 4.941631 P99 : 13.581561 P100 : 334697.000000 COUNT : 4307087 SUM : 54747295 rocksdb.compaction.times.micros P50 : 1251851.851852 P95 : 2884615.384615 P99 : 15280000.000000 P100 : 18832379.000000 COUNT : 84 SUM : 144727403 rocksdb.compaction.times.cpu_micros P50 : 949473.684211 P95 : 1886000.000000 P99 : 14048302.000000 P100 : 14048302.000000 COUNT : 84 SUM : 98919777 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 790.250000 P95 : 5940.000000 P99 : 444600.000000 P100 : 533475.000000 COUNT : 66 SUM : 653964 rocksdb.compaction.outfile.sync.micros P50 : 35000.000000 P95 : 230210.526316 P99 : 351725.000000 P100 : 812104.000000 COUNT : 274 SUM : 17540003 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 191.666667 P95 : 2692.857143 P99 : 5841.000000 P100 : 7975.000000 COUNT : 169 SUM : 108171 rocksdb.table.open.io.micros P50 : 8615.460526 P95 : 19032.323232 P99 : 21697.373737 P100 : 24883.000000 COUNT : 1649 SUM : 14180620 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.968367 P95 : 11.602245 P99 : 167.055236 P100 : 18469.000000 COUNT : 5949546 SUM : 82023891 rocksdb.read.block.get.micros P50 : 142.641737 P95 : 450.010286 P99 : 1210.233712 P100 : 18555.000000 COUNT : 1113766 SUM : 206701621 rocksdb.write.raw.block.micros P50 : 0.523172 P95 : 0.994028 P99 : 3.543902 P100 : 12635.000000 COUNT : 6958612 SUM : 14880089 rocksdb.numfiles.in.singlecompaction P50 : 3.094340 P95 : 4.750000 P99 : 12.250000 P100 : 15.000000 COUNT : 110 SUM : 392 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.569128 P95 : 1241.675875 P99 : 2663.847389 P100 : 334539.000000 COUNT : 252061 SUM : 43726899 rocksdb.sst.read.micros P50 : 2.055548 P95 : 165.913581 P99 : 485.587613 P100 : 14858.000000 COUNT : 6639623 SUM : 268495013 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 988996 SUM : 988996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4307087 SUM : 4444913784 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214137.931034 P95 : 370250.000000 P99 : 975600.000000 P100 : 1029231.000000 COUNT : 66 SUM : 15341330 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 286 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0