[2024-11-17 13:29:40.087686] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-17 13:29:40.087945] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid963777 ] Set seed to 1731846580080916 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 13:29:40.197488] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 13:29:40.234426] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 13:29:40.234471] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 963777' to capture a snapshot of events at runtime. [2024-11-17 13:29:40.234487] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid963777 for offline analysis/debug. [2024-11-17 13:29:40.234515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 13:29:44 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-13:29:52 ... thread 0: (1000000,1000000) ops and (128918.3,128918.3) ops/second in (7.756853,7.756853) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 1.96 GB 56.6 0.4 0.0 0.4 1.2 0.9 0.0 1.4 40.5 134.8 9.34 4.04 11 0.849 383K 525 0.0 0.0 L1 7/7 832.62 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 31/8 1.58 GB 1.0 2.4 1.5 0.9 2.4 1.5 0.1 1.6 102.9 102.1 24.23 11.40 15 1.615 598K 0 0.0 0.0 L4 183/15 10.68 GB 1.0 3.7 2.7 1.0 3.6 2.6 0.0 1.4 110.6 109.8 33.80 17.15 26 1.300 1865K 397 0.0 0.0 L5 1108/0 90.98 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1343/41 106.01 GB 0.0 6.5 4.2 2.3 7.3 5.0 1.8 8.4 98.1 110.5 67.37 32.59 52 1.296 2847K 922 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 4.2 2.3 7.3 5.0 1.8 8.4 98.1 110.5 67.37 32.59 52 1.296 2847K 922 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 4.2 2.3 6.4 4.1 0.0 0.0 109.8 109.0 60.19 30.05 42 1.433 2847K 922 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 122.9 7.18 2.54 10 0.718 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.8 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.27 GB write, 939.70 MB/s write, 6.46 GB read, 834.36 MB/s read, 67.4 seconds Interval compaction: 7.27 GB write, 959.55 MB/s write, 6.46 GB read, 851.98 MB/s read, 67.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 36, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 349443 Average: 12.6088 StdDev: 151.73 Min: 1 Median: 1.8309 Max: 7656 Percentiles: P50: 1.83 P75: 2.89 P99: 12.33 P99.9: 2323.30 P99.99: 4067.80 ------------------------------------------------------ [ 0, 1 ] 21992 6.293% 6.293% # ( 1, 2 ] 183804 52.599% 58.893% ########### ( 2, 3 ] 63197 18.085% 76.978% #### ( 3, 4 ] 34755 9.946% 86.923% ## ( 4, 6 ] 33932 9.710% 96.634% ## ( 6, 10 ] 7558 2.163% 98.797% ( 10, 15 ] 1526 0.437% 99.233% ( 15, 22 ] 167 0.048% 99.281% ( 22, 34 ] 23 0.007% 99.288% ( 34, 51 ] 8 0.002% 99.290% ( 51, 76 ] 10 0.003% 99.293% ( 76, 110 ] 12 0.003% 99.296% ( 110, 170 ] 31 0.009% 99.305% ( 170, 250 ] 84 0.024% 99.329% ( 250, 380 ] 198 0.057% 99.386% ( 380, 580 ] 353 0.101% 99.487% ( 580, 870 ] 501 0.143% 99.630% ( 870, 1300 ] 501 0.143% 99.774% ( 1300, 1900 ] 338 0.097% 99.870% ( 1900, 2900 ] 247 0.071% 99.941% ( 2900, 4400 ] 221 0.063% 100.004% ( 4400, 6600 ] 66 0.019% 100.023% ( 6600, 9900 ] 4 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 19641 Average: 25.8293 StdDev: 252.46 Min: 1 Median: 2.0200 Max: 7722 Percentiles: P50: 2.02 P75: 3.33 P99: 684.32 P99.9: 4133.45 P99.99: 6659.23 ------------------------------------------------------ [ 0, 1 ] 495 2.520% 2.520% # ( 1, 2 ] 9240 47.044% 49.565% ######### ( 2, 3 ] 4281 21.796% 71.361% #### ( 3, 4 ] 2191 11.155% 82.516% ## ( 4, 6 ] 2492 12.688% 95.204% ### ( 6, 10 ] 540 2.749% 97.953% # ( 10, 15 ] 124 0.631% 98.585% ( 15, 22 ] 17 0.087% 98.671% ( 22, 34 ] 2 0.010% 98.681% ( 34, 51 ] 1 0.005% 98.686% ( 51, 76 ] 4 0.020% 98.707% ( 76, 110 ] 3 0.015% 98.722% ( 110, 170 ] 3 0.015% 98.737% ( 170, 250 ] 6 0.031% 98.768% ( 250, 380 ] 11 0.056% 98.824% ( 380, 580 ] 22 0.112% 98.936% ( 580, 870 ] 35 0.178% 99.114% ( 870, 1300 ] 44 0.224% 99.338% ( 1300, 1900 ] 39 0.199% 99.537% ( 1900, 2900 ] 36 0.183% 99.720% ( 2900, 4400 ] 43 0.219% 99.939% ( 4400, 6600 ] 10 0.051% 99.990% ( 6600, 9900 ] 2 0.010% 100.000% ** Level 2 read latency histogram (micros): Count: 244343 Average: 11.9210 StdDev: 140.02 Min: 1 Median: 1.8986 Max: 8336 Percentiles: P50: 1.90 P75: 3.02 P99: 12.96 P99.9: 1433.60 P99.99: 2123.54 ------------------------------------------------------ [ 0, 1 ] 13279 5.435% 5.435% # ( 1, 2 ] 121178 49.593% 55.028% ########## ( 2, 3 ] 48323 19.777% 74.805% #### ( 3, 4 ] 25486 10.430% 85.235% ## ( 4, 6 ] 25574 10.466% 95.702% ## ( 6, 10 ] 7129 2.918% 98.619% # ( 10, 15 ] 1576 0.645% 99.264% ( 15, 22 ] 257 0.105% 99.369% ( 22, 34 ] 42 0.017% 99.387% ( 34, 51 ] 9 0.004% 99.390% ( 51, 76 ] 14 0.006% 99.396% ( 76, 110 ] 14 0.006% 99.402% ( 110, 170 ] 25 0.010% 99.412% ( 170, 250 ] 63 0.026% 99.438% ( 250, 380 ] 123 0.050% 99.488% ( 380, 580 ] 243 0.099% 99.587% ( 580, 870 ] 378 0.155% 99.742% ( 870, 1300 ] 335 0.137% 99.879% ( 1300, 1900 ] 232 0.095% 99.974% ( 1900, 2900 ] 177 0.072% 100.047% ( 2900, 4400 ] 119 0.049% 100.095% ( 4400, 6600 ] 30 0.012% 100.108% ( 6600, 9900 ] 6 0.002% 100.110% ** Level 3 read latency histogram (micros): Count: 944550 Average: 11.2465 StdDev: 145.21 Min: 1 Median: 1.8963 Max: 10791 Percentiles: P50: 1.90 P75: 2.99 P99: 9.90 P99.9: 971.24 P99.99: 1362.36 ------------------------------------------------------ [ 0, 1 ] 39024 4.131% 4.131% # ( 1, 2 ] 483382 51.176% 55.307% ########## ( 2, 3 ] 188452 19.952% 75.259% #### ( 3, 4 ] 102457 10.847% 86.106% ## ( 4, 6 ] 100410 10.630% 96.737% ## ( 6, 10 ] 21930 2.322% 99.058% ( 10, 15 ] 4790 0.507% 99.565% ( 15, 22 ] 543 0.057% 99.623% ( 22, 34 ] 57 0.006% 99.629% ( 34, 51 ] 51 0.005% 99.634% ( 51, 76 ] 46 0.005% 99.639% ( 76, 110 ] 23 0.002% 99.642% ( 110, 170 ] 78 0.008% 99.650% ( 170, 250 ] 157 0.017% 99.667% ( 250, 380 ] 341 0.036% 99.703% ( 380, 580 ] 610 0.065% 99.767% ( 580, 870 ] 1015 0.107% 99.875% ( 870, 1300 ] 1017 0.108% 99.982% ( 1300, 1900 ] 698 0.074% 100.056% ( 1900, 2900 ] 646 0.068% 100.125% ( 2900, 4400 ] 579 0.061% 100.186% ( 4400, 6600 ] 158 0.017% 100.203% ( 6600, 9900 ] 24 0.003% 100.205% ( 9900, 14000 ] 1 0.000% 100.205% ** Level 4 read latency histogram (micros): Count: 370111 Average: 24.7553 StdDev: 231.73 Min: 0 Median: 1.9004 Max: 10184 Percentiles: P50: 1.90 P75: 3.02 P99: 652.60 P99.9: 2978.40 P99.99: 3823.83 ------------------------------------------------------ [ 0, 1 ] 15527 4.195% 4.195% # ( 1, 2 ] 188282 50.872% 55.067% ########## ( 2, 3 ] 72799 19.670% 74.736% #### ( 3, 4 ] 39792 10.751% 85.488% ## ( 4, 6 ] 37686 10.182% 95.670% ## ( 6, 10 ] 8818 2.383% 98.053% ( 10, 15 ] 1648 0.445% 98.498% ( 15, 22 ] 199 0.054% 98.552% ( 22, 34 ] 24 0.006% 98.558% ( 34, 51 ] 15 0.004% 98.562% ( 51, 76 ] 26 0.007% 98.569% ( 76, 110 ] 28 0.008% 98.577% ( 110, 170 ] 63 0.017% 98.594% ( 170, 250 ] 175 0.047% 98.641% ( 250, 380 ] 338 0.091% 98.733% ( 380, 580 ] 717 0.194% 98.926% ( 580, 870 ] 1094 0.296% 99.222% ( 870, 1300 ] 1126 0.304% 99.526% ( 1300, 1900 ] 753 0.203% 99.730% ( 1900, 2900 ] 601 0.162% 99.892% ( 2900, 4400 ] 591 0.160% 100.052% ( 4400, 6600 ] 159 0.043% 100.095% ( 6600, 9900 ] 17 0.005% 100.099% ( 9900, 14000 ] 1 0.000% 100.099% ** Level 5 read latency histogram (micros): Count: 13570 Average: 1621.2769 StdDev: 1434.53 Min: 91 Median: 1097.3525 Max: 11342 Percentiles: P50: 1097.35 P75: 2223.57 P99: 6537.64 P99.9: 9729.81 P99.99: 11342.00 ------------------------------------------------------ ( 76, 110 ] 7 0.052% 0.052% ( 110, 170 ] 100 0.737% 0.789% ( 170, 250 ] 307 2.262% 3.051% ( 250, 380 ] 790 5.822% 8.873% # ( 380, 580 ] 1653 12.181% 21.054% ## ( 580, 870 ] 2566 18.909% 39.963% #### ( 870, 1300 ] 2576 18.983% 58.946% #### ( 1300, 1900 ] 1698 12.513% 71.459% ### ( 1900, 2900 ] 1485 10.943% 82.402% ## ( 2900, 4400 ] 1577 11.621% 94.024% ## ( 4400, 6600 ] 695 5.122% 99.145% # ( 6600, 9900 ] 108 0.796% 99.941% ( 9900, 14000 ] 8 0.059% 100.000% ** DB Stats ** Uptime(secs): 7.9 total, 7.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 124.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.864 H:M:S, 48.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.864 H:M:S, 49.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/17-13:29:55 ... thread 0: (1000000,2000000) ops and (263716.1,173178.0) ops/second in (3.791956,11.548809) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 2.94 GB 163.6 1.5 0.0 1.5 3.3 1.8 0.0 1.8 84.9 190.9 17.81 11.12 30 0.594 1535K 1703 0.0 0.0 L1 7/7 832.62 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 23/0 999.43 MB 1.0 2.4 1.5 0.9 2.4 1.5 0.1 1.6 102.9 102.1 24.23 11.40 15 1.615 598K 0 0.0 0.0 L4 172/0 9.60 GB 1.0 4.9 3.3 1.7 4.9 3.2 0.0 1.5 114.4 113.4 44.30 23.05 34 1.303 2516K 2676 0.0 0.0 L5 1128/0 92.64 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/18 106.98 GB 0.0 8.9 4.8 4.1 10.6 6.6 3.5 5.8 105.1 126.2 86.34 45.56 79 1.093 4649K 4379 0.0 0.0 Int 0/0 0.00 KB 0.0 8.9 4.8 4.1 10.6 6.6 3.5 5.8 105.1 126.2 86.34 45.56 79 1.093 4649K 4379 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.9 4.8 4.1 8.8 4.7 0.0 0.0 119.8 119.0 75.69 40.28 54 1.402 4649K 4379 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 177.4 10.65 5.28 25 0.426 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.7 total, 11.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.64 GB write, 930.15 MB/s write, 8.86 GB read, 774.32 MB/s read, 86.3 seconds Interval compaction: 10.64 GB write, 943.34 MB/s write, 8.86 GB read, 785.30 MB/s read, 86.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 39, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 654648 Average: 13.4821 StdDev: 120.90 Min: 0 Median: 1.6662 Max: 7656 Percentiles: P50: 1.67 P75: 2.53 P99: 228.08 P99.9: 1311.76 P99.99: 2720.50 ------------------------------------------------------ [ 0, 1 ] 95564 14.598% 14.598% ### ( 1, 2 ] 347880 53.140% 67.738% ########### ( 2, 3 ] 89831 13.722% 81.460% ### ( 3, 4 ] 47054 7.188% 88.647% # ( 4, 6 ] 42130 6.436% 95.083% # ( 6, 10 ] 9691 1.480% 96.563% ( 10, 15 ] 1913 0.292% 96.856% ( 15, 22 ] 220 0.034% 96.889% ( 22, 34 ] 37 0.006% 96.895% ( 34, 51 ] 10 0.002% 96.896% ( 51, 76 ] 12 0.002% 96.898% ( 76, 110 ] 2218 0.339% 97.237% ( 110, 170 ] 8724 1.333% 98.570% ( 170, 250 ] 3882 0.593% 99.163% ( 250, 380 ] 1678 0.256% 99.419% ( 380, 580 ] 1573 0.240% 99.659% ( 580, 870 ] 960 0.147% 99.806% ( 870, 1300 ] 610 0.093% 99.899% ( 1300, 1900 ] 375 0.057% 99.956% ( 1900, 2900 ] 270 0.041% 99.998% ( 2900, 4400 ] 239 0.037% 100.034% ( 4400, 6600 ] 69 0.011% 100.045% ( 6600, 9900 ] 4 0.001% 100.045% ** Level 1 read latency histogram (micros): Count: 20101 Average: 30.6050 StdDev: 255.31 Min: 1 Median: 2.0737 Max: 7722 Percentiles: P50: 2.07 P75: 3.48 P99: 789.00 P99.9: 4152.29 P99.99: 6597.98 ------------------------------------------------------ [ 0, 1 ] 495 2.463% 2.463% ( 1, 2 ] 9240 45.968% 48.430% ######### ( 2, 3 ] 4281 21.297% 69.728% #### ( 3, 4 ] 2191 10.900% 80.628% ## ( 4, 6 ] 2492 12.397% 93.025% ## ( 6, 10 ] 540 2.686% 95.712% # ( 10, 15 ] 124 0.617% 96.329% ( 15, 22 ] 17 0.085% 96.413% ( 22, 34 ] 2 0.010% 96.423% ( 34, 51 ] 1 0.005% 96.428% ( 51, 76 ] 4 0.020% 96.448% ( 76, 110 ] 63 0.313% 96.761% ( 110, 170 ] 223 1.109% 97.871% ( 170, 250 ] 89 0.443% 98.314% ( 250, 380 ] 47 0.234% 98.547% ( 380, 580 ] 60 0.298% 98.846% ( 580, 870 ] 43 0.214% 99.060% ( 870, 1300 ] 57 0.284% 99.343% ( 1300, 1900 ] 39 0.194% 99.537% ( 1900, 2900 ] 37 0.184% 99.721% ( 2900, 4400 ] 43 0.214% 99.935% ( 4400, 6600 ] 11 0.055% 99.990% ( 6600, 9900 ] 2 0.010% 100.000% ** Level 2 read latency histogram (micros): Count: 261156 Average: 11.4297 StdDev: 135.93 Min: 1 Median: 1.8932 Max: 8336 Percentiles: P50: 1.89 P75: 2.99 P99: 12.68 P99.9: 1394.88 P99.99: 2119.69 ------------------------------------------------------ [ 0, 1 ] 13849 5.303% 5.303% # ( 1, 2 ] 130683 50.040% 55.343% ########## ( 2, 3 ] 51778 19.826% 75.170% #### ( 3, 4 ] 26979 10.331% 85.500% ## ( 4, 6 ] 26861 10.285% 95.786% ## ( 6, 10 ] 7510 2.876% 98.661% # ( 10, 15 ] 1651 0.632% 99.294% ( 15, 22 ] 272 0.104% 99.398% ( 22, 34 ] 44 0.017% 99.415% ( 34, 51 ] 9 0.003% 99.418% ( 51, 76 ] 14 0.005% 99.423% ( 76, 110 ] 14 0.005% 99.429% ( 110, 170 ] 26 0.010% 99.439% ( 170, 250 ] 64 0.025% 99.463% ( 250, 380 ] 124 0.047% 99.511% ( 380, 580 ] 246 0.094% 99.605% ( 580, 870 ] 390 0.149% 99.754% ( 870, 1300 ] 344 0.132% 99.886% ( 1300, 1900 ] 233 0.089% 99.975% ( 1900, 2900 ] 177 0.068% 100.043% ( 2900, 4400 ] 120 0.046% 100.089% ( 4400, 6600 ] 30 0.011% 100.100% ( 6600, 9900 ] 6 0.002% 100.103% ** Level 3 read latency histogram (micros): Count: 984640 Average: 11.0735 StdDev: 142.64 Min: 1 Median: 1.8889 Max: 10791 Percentiles: P50: 1.89 P75: 2.97 P99: 9.98 P99.9: 958.08 P99.99: 1359.60 ------------------------------------------------------ [ 0, 1 ] 41610 4.226% 4.226% # ( 1, 2 ] 507018 51.493% 55.719% ########## ( 2, 3 ] 194749 19.779% 75.497% #### ( 3, 4 ] 105652 10.730% 86.227% ## ( 4, 6 ] 103184 10.479% 96.707% ## ( 6, 10 ] 22694 2.305% 99.012% ( 10, 15 ] 4917 0.499% 99.511% ( 15, 22 ] 549 0.056% 99.567% ( 22, 34 ] 57 0.006% 99.572% ( 34, 51 ] 51 0.005% 99.578% ( 51, 76 ] 46 0.005% 99.582% ( 76, 110 ] 112 0.011% 99.594% ( 110, 170 ] 405 0.041% 99.635% ( 170, 250 ] 282 0.029% 99.663% ( 250, 380 ] 405 0.041% 99.705% ( 380, 580 ] 668 0.068% 99.772% ( 580, 870 ] 1046 0.106% 99.879% ( 870, 1300 ] 1027 0.104% 99.983% ( 1300, 1900 ] 700 0.071% 100.054% ( 1900, 2900 ] 646 0.066% 100.120% ( 2900, 4400 ] 582 0.059% 100.179% ( 4400, 6600 ] 159 0.016% 100.195% ( 6600, 9900 ] 24 0.002% 100.197% ( 9900, 14000 ] 1 0.000% 100.197% ** Level 4 read latency histogram (micros): Count: 444972 Average: 24.8813 StdDev: 217.73 Min: 0 Median: 1.8927 Max: 10184 Percentiles: P50: 1.89 P75: 3.03 P99: 599.03 P99.9: 2782.86 P99.99: 3704.37 ------------------------------------------------------ [ 0, 1 ] 18869 4.240% 4.240% # ( 1, 2 ] 228101 51.262% 55.502% ########## ( 2, 3 ] 85177 19.142% 74.644% #### ( 3, 4 ] 45876 10.310% 84.954% ## ( 4, 6 ] 43120 9.690% 94.645% ## ( 6, 10 ] 10344 2.325% 96.969% ( 10, 15 ] 1885 0.424% 97.393% ( 15, 22 ] 232 0.052% 97.445% ( 22, 34 ] 26 0.006% 97.451% ( 34, 51 ] 18 0.004% 97.455% ( 51, 76 ] 30 0.007% 97.462% ( 76, 110 ] 682 0.153% 97.615% ( 110, 170 ] 2639 0.593% 98.208% ( 170, 250 ] 1383 0.311% 98.519% ( 250, 380 ] 850 0.191% 98.710% ( 380, 580 ] 1196 0.269% 98.979% ( 580, 870 ] 1437 0.323% 99.302% ( 870, 1300 ] 1284 0.289% 99.590% ( 1300, 1900 ] 813 0.183% 99.773% ( 1900, 2900 ] 640 0.144% 99.917% ( 2900, 4400 ] 607 0.136% 100.053% ( 4400, 6600 ] 162 0.036% 100.090% ( 6600, 9900 ] 17 0.004% 100.093% ( 9900, 14000 ] 1 0.000% 100.094% ** Level 5 read latency histogram (micros): Count: 54512 Average: 582.4201 StdDev: 963.88 Min: 75 Median: 200.0684 Max: 11342 Percentiles: P50: 200.07 P75: 556.03 P99: 5260.90 P99.9: 8461.56 P99.99: 10693.76 ------------------------------------------------------ ( 51, 76 ] 2 0.004% 0.004% ( 76, 110 ] 5095 9.347% 9.350% ## ( 110, 170 ] 18974 34.807% 44.157% ####### ( 170, 250 ] 8474 15.545% 59.702% ### ( 250, 380 ] 4124 7.565% 67.268% ## ( 380, 580 ] 4789 8.785% 76.053% ## ( 580, 870 ] 3937 7.222% 83.275% # ( 870, 1300 ] 3146 5.771% 89.046% # ( 1300, 1900 ] 1874 3.438% 92.484% # ( 1900, 2900 ] 1621 2.974% 95.458% # ( 2900, 4400 ] 1655 3.036% 98.494% # ( 4400, 6600 ] 705 1.293% 99.787% ( 6600, 9900 ] 109 0.200% 99.987% ( 9900, 14000 ] 8 0.015% 100.002% ** DB Stats ** Uptime(secs): 11.7 total, 3.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 168.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.196 H:M:S, 35.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 259.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.332 H:M:S, 8.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-13:30:03 ... thread 0: (1000000,3000000) ops and (135115.4,158312.2) ops/second in (7.401083,18.949892) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.93 GB 138.4 2.7 0.0 2.7 5.5 2.8 0.0 2.0 108.2 221.1 25.63 18.45 51 0.503 2814K 2866 0.0 0.0 L1 7/7 832.62 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 23/0 999.43 MB 1.0 2.4 1.5 0.9 2.4 1.5 0.1 1.6 102.9 102.1 24.23 11.40 15 1.615 598K 0 0.0 0.0 L4 172/0 9.60 GB 1.0 4.9 3.3 1.7 4.9 3.2 0.0 1.5 114.4 113.4 44.30 23.05 34 1.303 2516K 2676 0.0 0.0 L5 1128/0 92.64 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1348/20 107.96 GB 0.0 10.1 4.8 5.3 12.9 7.5 3.5 4.5 109.7 139.8 94.16 52.89 100 0.942 5929K 5542 0.0 0.0 Int 0/0 0.00 KB 0.0 10.1 4.8 5.3 12.9 7.5 3.5 4.5 109.7 139.8 94.16 52.89 100 0.942 5929K 5542 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.1 4.8 5.3 10.0 4.7 0.0 0.0 128.4 127.6 80.44 44.94 59 1.363 5929K 5542 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 211.3 13.71 7.95 41 0.334 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.1 total, 19.0 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.85 GB write, 688.61 MB/s write, 10.09 GB read, 540.44 MB/s read, 94.2 seconds Interval compaction: 12.85 GB write, 694.56 MB/s write, 10.09 GB read, 545.11 MB/s read, 94.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 39, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1190341 Average: 14.0119 StdDev: 97.55 Min: 0 Median: 1.5621 Max: 7656 Percentiles: P50: 1.56 P75: 2.16 P99: 238.48 P99.9: 837.97 P99.99: 1661.51 ------------------------------------------------------ [ 0, 1 ] 239808 20.146% 20.146% #### ( 1, 2 ] 632173 53.109% 73.255% ########### ( 2, 3 ] 130653 10.976% 84.231% ## ( 3, 4 ] 62715 5.269% 89.499% # ( 4, 6 ] 53373 4.484% 93.983% # ( 6, 10 ] 11710 0.984% 94.967% ( 10, 15 ] 2212 0.186% 95.153% ( 15, 22 ] 262 0.022% 95.175% ( 22, 34 ] 43 0.004% 95.179% ( 34, 51 ] 12 0.001% 95.180% ( 51, 76 ] 24 0.002% 95.182% ( 76, 110 ] 7967 0.669% 95.851% ( 110, 170 ] 28135 2.364% 98.214% ( 170, 250 ] 10924 0.918% 99.132% ( 250, 380 ] 4258 0.358% 99.490% ( 380, 580 ] 3560 0.299% 99.789% ( 580, 870 ] 1488 0.125% 99.914% ( 870, 1300 ] 675 0.057% 99.971% ( 1300, 1900 ] 385 0.032% 100.003% ( 1900, 2900 ] 283 0.024% 100.027% ( 2900, 4400 ] 244 0.020% 100.047% ( 4400, 6600 ] 69 0.006% 100.053% ( 6600, 9900 ] 4 0.000% 100.053% ** Level 1 read latency histogram (micros): Count: 115133 Average: 10.6947 StdDev: 109.73 Min: 1 Median: 2.8809 Max: 7722 Percentiles: P50: 2.88 P75: 3.93 P99: 151.34 P99.9: 1508.01 P99.99: 4312.33 ------------------------------------------------------ [ 0, 1 ] 1472 1.279% 1.279% ( 1, 2 ] 26719 23.207% 24.486% ##### ( 2, 3 ] 33347 28.964% 53.449% ###### ( 3, 4 ] 26774 23.255% 76.704% ##### ( 4, 6 ] 17959 15.598% 92.303% ### ( 6, 10 ] 5016 4.357% 96.660% # ( 10, 15 ] 1157 1.005% 97.664% ( 15, 22 ] 568 0.493% 98.158% ( 22, 34 ] 33 0.029% 98.186% ( 34, 51 ] 3 0.003% 98.189% ( 51, 76 ] 4 0.003% 98.193% ( 76, 110 ] 273 0.237% 98.430% ( 110, 170 ] 953 0.828% 99.257% ( 170, 250 ] 319 0.277% 99.534% ( 250, 380 ] 145 0.126% 99.660% ( 380, 580 ] 137 0.119% 99.779% ( 580, 870 ] 66 0.057% 99.837% ( 870, 1300 ] 59 0.051% 99.888% ( 1300, 1900 ] 40 0.035% 99.923% ( 1900, 2900 ] 37 0.032% 99.955% ( 2900, 4400 ] 43 0.037% 99.992% ( 4400, 6600 ] 11 0.010% 100.002% ( 6600, 9900 ] 2 0.002% 100.003% ** Level 2 read latency histogram (micros): Count: 261156 Average: 11.4297 StdDev: 135.93 Min: 1 Median: 1.8932 Max: 8336 Percentiles: P50: 1.89 P75: 2.99 P99: 12.68 P99.9: 1394.88 P99.99: 2119.69 ------------------------------------------------------ [ 0, 1 ] 13849 5.303% 5.303% # ( 1, 2 ] 130683 50.040% 55.343% ########## ( 2, 3 ] 51778 19.826% 75.170% #### ( 3, 4 ] 26979 10.331% 85.500% ## ( 4, 6 ] 26861 10.285% 95.786% ## ( 6, 10 ] 7510 2.876% 98.661% # ( 10, 15 ] 1651 0.632% 99.294% ( 15, 22 ] 272 0.104% 99.398% ( 22, 34 ] 44 0.017% 99.415% ( 34, 51 ] 9 0.003% 99.418% ( 51, 76 ] 14 0.005% 99.423% ( 76, 110 ] 14 0.005% 99.429% ( 110, 170 ] 26 0.010% 99.439% ( 170, 250 ] 64 0.025% 99.463% ( 250, 380 ] 124 0.047% 99.511% ( 380, 580 ] 246 0.094% 99.605% ( 580, 870 ] 390 0.149% 99.754% ( 870, 1300 ] 344 0.132% 99.886% ( 1300, 1900 ] 233 0.089% 99.975% ( 1900, 2900 ] 177 0.068% 100.043% ( 2900, 4400 ] 120 0.046% 100.089% ( 4400, 6600 ] 30 0.011% 100.100% ( 6600, 9900 ] 6 0.002% 100.103% ** Level 3 read latency histogram (micros): Count: 986359 Average: 11.3612 StdDev: 142.76 Min: 1 Median: 1.8906 Max: 10791 Percentiles: P50: 1.89 P75: 2.98 P99: 11.62 P99.9: 959.10 P99.99: 1360.31 ------------------------------------------------------ [ 0, 1 ] 41610 4.219% 4.219% # ( 1, 2 ] 507018 51.403% 55.622% ########## ( 2, 3 ] 194749 19.744% 75.366% #### ( 3, 4 ] 105652 10.711% 86.077% ## ( 4, 6 ] 103184 10.461% 96.538% ## ( 6, 10 ] 22694 2.301% 98.839% ( 10, 15 ] 4917 0.499% 99.337% ( 15, 22 ] 549 0.056% 99.393% ( 22, 34 ] 57 0.006% 99.399% ( 34, 51 ] 51 0.005% 99.404% ( 51, 76 ] 46 0.005% 99.409% ( 76, 110 ] 446 0.045% 99.454% ( 110, 170 ] 1294 0.131% 99.585% ( 170, 250 ] 568 0.058% 99.643% ( 250, 380 ] 512 0.052% 99.695% ( 380, 580 ] 748 0.076% 99.770% ( 580, 870 ] 1064 0.108% 99.878% ( 870, 1300 ] 1031 0.105% 99.983% ( 1300, 1900 ] 700 0.071% 100.054% ( 1900, 2900 ] 647 0.066% 100.119% ( 2900, 4400 ] 582 0.059% 100.178% ( 4400, 6600 ] 159 0.016% 100.195% ( 6600, 9900 ] 24 0.002% 100.197% ( 9900, 14000 ] 1 0.000% 100.197% ** Level 4 read latency histogram (micros): Count: 461497 Average: 29.8566 StdDev: 216.64 Min: 0 Median: 1.9285 Max: 10184 Percentiles: P50: 1.93 P75: 3.29 P99: 607.44 P99.9: 2759.48 P99.99: 3700.12 ------------------------------------------------------ [ 0, 1 ] 18869 4.089% 4.089% # ( 1, 2 ] 228195 49.447% 53.535% ########## ( 2, 3 ] 85610 18.550% 72.086% #### ( 3, 4 ] 46138 9.997% 82.083% ## ( 4, 6 ] 43508 9.428% 91.511% ## ( 6, 10 ] 10394 2.252% 93.763% ( 10, 15 ] 1895 0.411% 94.174% ( 15, 22 ] 235 0.051% 94.225% ( 22, 34 ] 26 0.006% 94.230% ( 34, 51 ] 18 0.004% 94.234% ( 51, 76 ] 30 0.007% 94.241% ( 76, 110 ] 3470 0.752% 94.993% ( 110, 170 ] 10638 2.305% 97.298% ( 170, 250 ] 4035 0.874% 98.172% ( 250, 380 ] 1789 0.388% 98.560% ( 380, 580 ] 1878 0.407% 98.967% ( 580, 870 ] 1628 0.353% 99.319% ( 870, 1300 ] 1308 0.283% 99.603% ( 1300, 1900 ] 818 0.177% 99.780% ( 1900, 2900 ] 644 0.140% 99.920% ( 2900, 4400 ] 609 0.132% 100.052% ( 4400, 6600 ] 162 0.035% 100.087% ( 6600, 9900 ] 17 0.004% 100.090% ( 9900, 14000 ] 1 0.000% 100.091% ** Level 5 read latency histogram (micros): Count: 158911 Average: 315.8679 StdDev: 603.87 Min: 73 Median: 155.0666 Max: 11342 Percentiles: P50: 155.07 P75: 234.64 P99: 3699.17 P99.9: 6444.25 P99.99: 9418.89 ------------------------------------------------------ ( 51, 76 ] 8 0.005% 0.005% ( 76, 110 ] 23595 14.848% 14.853% ### ( 110, 170 ] 74361 46.794% 61.647% ######### ( 170, 250 ] 26263 16.527% 78.174% ### ( 250, 380 ] 10401 6.545% 84.719% # ( 380, 580 ] 9654 6.075% 90.794% # ( 580, 870 ] 5318 3.347% 94.141% # ( 870, 1300 ] 3300 2.077% 96.217% ( 1300, 1900 ] 1893 1.191% 97.409% ( 1900, 2900 ] 1646 1.036% 98.444% ( 2900, 4400 ] 1659 1.044% 99.488% ( 4400, 6600 ] 705 0.444% 99.932% ( 6600, 9900 ] 109 0.069% 100.001% ( 9900, 14000 ] 8 0.005% 100.006% ** DB Stats ** Uptime(secs): 19.1 total, 7.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 154.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.980 H:M:S, 41.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 132.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.784 H:M:S, 51.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/17-13:30:17 ... thread 0: (1000000,4000000) ops and (72688.4,122297.0) ops/second in (13.757360,32.707252) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 3.80 GB 6.3 4.9 0.0 4.9 8.7 3.8 0.0 2.3 135.4 240.0 37.22 29.49 71 0.524 5115K 13K 0.0 0.0 L1 24/24 1.90 GB 0.0 1.9 1.1 0.8 1.9 1.1 0.0 1.7 78.5 77.9 24.95 12.19 1 24.948 1987K 14K 0.0 0.0 L3 23/0 999.43 MB 1.0 2.4 1.5 0.9 2.4 1.5 0.1 1.6 102.9 102.1 24.23 11.40 15 1.615 598K 0 0.0 0.0 L4 172/0 9.60 GB 1.0 4.9 3.3 1.7 4.9 3.2 0.0 1.5 114.4 113.4 44.30 23.05 34 1.303 2516K 2676 0.0 0.0 L5 1128/0 92.64 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1360/36 108.92 GB 0.0 14.2 5.9 8.3 17.9 9.6 3.5 4.7 111.4 140.6 130.69 76.13 121 1.080 10M 30K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.2 5.9 8.3 17.9 9.6 3.5 4.7 111.4 140.6 130.69 76.13 121 1.080 10M 30K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.2 5.9 8.3 14.1 5.8 0.0 0.0 127.9 127.1 113.82 65.42 64 1.778 10M 30K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 231.5 16.87 10.70 57 0.296 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.9 total, 32.7 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.94 GB write, 558.80 MB/s write, 14.21 GB read, 442.75 MB/s read, 130.7 seconds Interval compaction: 17.94 GB write, 561.60 MB/s write, 14.21 GB read, 444.97 MB/s read, 130.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 39, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1700619 Average: 17.3705 StdDev: 90.87 Min: 0 Median: 1.5542 Max: 7656 Percentiles: P50: 1.55 P75: 2.25 P99: 242.65 P99.9: 762.50 P99.99: 1386.91 ------------------------------------------------------ [ 0, 1 ] 372642 21.912% 21.912% #### ( 1, 2 ] 861888 50.681% 72.593% ########## ( 2, 3 ] 166290 9.778% 82.371% ## ( 3, 4 ] 84177 4.950% 87.321% # ( 4, 6 ] 66127 3.888% 91.209% # ( 6, 10 ] 13685 0.805% 92.014% ( 10, 15 ] 2599 0.153% 92.167% ( 15, 22 ] 313 0.018% 92.185% ( 22, 34 ] 47 0.003% 92.188% ( 34, 51 ] 15 0.001% 92.189% ( 51, 76 ] 48 0.003% 92.192% ( 76, 110 ] 22529 1.325% 93.517% ( 110, 170 ] 74249 4.366% 97.883% # ( 170, 250 ] 20927 1.231% 99.113% ( 250, 380 ] 6809 0.400% 99.513% ( 380, 580 ] 5328 0.313% 99.827% ( 580, 870 ] 1979 0.116% 99.943% ( 870, 1300 ] 739 0.043% 99.987% ( 1300, 1900 ] 400 0.024% 100.010% ( 1900, 2900 ] 307 0.018% 100.028% ( 2900, 4400 ] 283 0.017% 100.045% ( 4400, 6600 ] 70 0.004% 100.049% ( 6600, 9900 ] 4 0.000% 100.049% ** Level 1 read latency histogram (micros): Count: 232153 Average: 10.0449 StdDev: 81.76 Min: 1 Median: 3.0520 Max: 7722 Percentiles: P50: 3.05 P75: 4.03 P99: 156.56 P99.9: 811.02 P99.99: 3834.35 ------------------------------------------------------ [ 0, 1 ] 2244 0.967% 0.967% ( 1, 2 ] 45459 19.581% 20.548% #### ( 2, 3 ] 65214 28.091% 48.639% ###### ( 3, 4 ] 60702 26.147% 74.786% ##### ( 4, 6 ] 39136 16.858% 91.644% ### ( 6, 10 ] 9453 4.072% 95.716% # ( 10, 15 ] 2414 1.040% 96.756% ( 15, 22 ] 1285 0.554% 97.310% ( 22, 34 ] 78 0.034% 97.343% ( 34, 51 ] 6 0.003% 97.346% ( 51, 76 ] 4 0.002% 97.347% ( 76, 110 ] 1199 0.516% 97.864% ( 110, 170 ] 3399 1.464% 99.328% ( 170, 250 ] 726 0.313% 99.641% ( 250, 380 ] 273 0.118% 99.758% ( 380, 580 ] 246 0.106% 99.864% ( 580, 870 ] 104 0.045% 99.909% ( 870, 1300 ] 73 0.031% 99.941% ( 1300, 1900 ] 49 0.021% 99.962% ( 1900, 2900 ] 39 0.017% 99.978% ( 2900, 4400 ] 43 0.019% 99.997% ( 4400, 6600 ] 11 0.005% 100.002% ( 6600, 9900 ] 2 0.001% 100.003% ** Level 2 read latency histogram (micros): Count: 261156 Average: 11.4297 StdDev: 135.93 Min: 1 Median: 1.8932 Max: 8336 Percentiles: P50: 1.89 P75: 2.99 P99: 12.68 P99.9: 1394.88 P99.99: 2119.69 ------------------------------------------------------ [ 0, 1 ] 13849 5.303% 5.303% # ( 1, 2 ] 130683 50.040% 55.343% ########## ( 2, 3 ] 51778 19.826% 75.170% #### ( 3, 4 ] 26979 10.331% 85.500% ## ( 4, 6 ] 26861 10.285% 95.786% ## ( 6, 10 ] 7510 2.876% 98.661% # ( 10, 15 ] 1651 0.632% 99.294% ( 15, 22 ] 272 0.104% 99.398% ( 22, 34 ] 44 0.017% 99.415% ( 34, 51 ] 9 0.003% 99.418% ( 51, 76 ] 14 0.005% 99.423% ( 76, 110 ] 14 0.005% 99.429% ( 110, 170 ] 26 0.010% 99.439% ( 170, 250 ] 64 0.025% 99.463% ( 250, 380 ] 124 0.047% 99.511% ( 380, 580 ] 246 0.094% 99.605% ( 580, 870 ] 390 0.149% 99.754% ( 870, 1300 ] 344 0.132% 99.886% ( 1300, 1900 ] 233 0.089% 99.975% ( 1900, 2900 ] 177 0.068% 100.043% ( 2900, 4400 ] 120 0.046% 100.089% ( 4400, 6600 ] 30 0.011% 100.100% ( 6600, 9900 ] 6 0.002% 100.103% ** Level 3 read latency histogram (micros): Count: 990119 Average: 11.9026 StdDev: 142.87 Min: 1 Median: 1.8943 Max: 10791 Percentiles: P50: 1.89 P75: 3.00 P99: 20.02 P99.9: 958.28 P99.99: 1360.85 ------------------------------------------------------ [ 0, 1 ] 41610 4.203% 4.203% # ( 1, 2 ] 507018 51.208% 55.410% ########## ( 2, 3 ] 194749 19.669% 75.080% #### ( 3, 4 ] 105652 10.671% 85.750% ## ( 4, 6 ] 103184 10.421% 96.172% ## ( 6, 10 ] 22694 2.292% 98.464% ( 10, 15 ] 4917 0.497% 98.960% ( 15, 22 ] 549 0.055% 99.016% ( 22, 34 ] 57 0.006% 99.021% ( 34, 51 ] 51 0.005% 99.027% ( 51, 76 ] 47 0.005% 99.031% ( 76, 110 ] 1269 0.128% 99.159% ( 110, 170 ] 3540 0.358% 99.517% ( 170, 250 ] 1024 0.103% 99.620% ( 250, 380 ] 628 0.063% 99.684% ( 380, 580 ] 838 0.085% 99.769% ( 580, 870 ] 1090 0.110% 99.879% ( 870, 1300 ] 1032 0.104% 99.983% ( 1300, 1900 ] 700 0.071% 100.054% ( 1900, 2900 ] 648 0.065% 100.119% ( 2900, 4400 ] 582 0.059% 100.178% ( 4400, 6600 ] 159 0.016% 100.194% ( 6600, 9900 ] 24 0.002% 100.196% ( 9900, 14000 ] 1 0.000% 100.196% ** Level 4 read latency histogram (micros): Count: 497151 Average: 38.7393 StdDev: 212.74 Min: 0 Median: 2.0176 Max: 10184 Percentiles: P50: 2.02 P75: 3.87 P99: 594.40 P99.9: 2710.83 P99.99: 3694.82 ------------------------------------------------------ [ 0, 1 ] 18869 3.795% 3.795% # ( 1, 2 ] 228199 45.901% 49.697% ######### ( 2, 3 ] 85659 17.230% 66.927% ### ( 3, 4 ] 46151 9.283% 76.210% ## ( 4, 6 ] 43550 8.760% 84.970% ## ( 6, 10 ] 10398 2.092% 87.061% ( 10, 15 ] 1896 0.381% 87.443% ( 15, 22 ] 235 0.047% 87.490% ( 22, 34 ] 26 0.005% 87.495% ( 34, 51 ] 18 0.004% 87.499% ( 51, 76 ] 39 0.008% 87.507% ( 76, 110 ] 11548 2.323% 89.829% ( 110, 170 ] 31859 6.408% 96.238% # ( 170, 250 ] 7984 1.606% 97.844% ( 250, 380 ] 2965 0.596% 98.440% ( 380, 580 ] 2693 0.542% 98.982% ( 580, 870 ] 1862 0.375% 99.356% ( 870, 1300 ] 1352 0.272% 99.628% ( 1300, 1900 ] 825 0.166% 99.794% ( 1900, 2900 ] 651 0.131% 99.925% ( 2900, 4400 ] 612 0.123% 100.048% ( 4400, 6600 ] 162 0.033% 100.081% ( 6600, 9900 ] 17 0.003% 100.084% ( 9900, 14000 ] 1 0.000% 100.084% ** Level 5 read latency histogram (micros): Count: 382364 Average: 220.9620 StdDev: 404.21 Min: 73 Median: 143.5187 Max: 11342 Percentiles: P50: 143.52 P75: 176.38 P99: 2110.37 P99.9: 5737.59 P99.99: 8651.56 ------------------------------------------------------ ( 51, 76 ] 43 0.011% 0.011% ( 76, 110 ] 75322 19.699% 19.710% #### ( 110, 170 ] 207318 54.220% 73.930% ########### ( 170, 250 ] 51281 13.412% 87.342% ### ( 250, 380 ] 17306 4.526% 91.868% # ( 380, 580 ] 14609 3.821% 95.689% # ( 580, 870 ] 6822 1.784% 97.473% ( 870, 1300 ] 3528 0.923% 98.396% ( 1300, 1900 ] 1955 0.511% 98.907% ( 1900, 2900 ] 1694 0.443% 99.350% ( 2900, 4400 ] 1675 0.438% 99.788% ( 4400, 6600 ] 705 0.184% 99.972% ( 6600, 9900 ] 109 0.029% 100.001% ( 9900, 14000 ] 8 0.002% 100.003% ** DB Stats ** Uptime(secs): 32.9 total, 13.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 119.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.903 H:M:S, 54.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 71.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.923 H:M:S, 72.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 221.163 micros/op 18069 ops/sec 60.155 seconds 1086996 operations; 17.5 MB/s (260999 of 260999 found) Microseconds per read: Count: 1086996 Average: 221.1655 StdDev: 629.61 Min: 2 Median: 165.6178 Max: 67685 Percentiles: P50: 165.62 P75: 224.10 P99: 856.65 P99.9: 10106.67 P99.99: 27293.78 ------------------------------------------------------ ( 1, 2 ] 7 0.001% 0.001% ( 2, 3 ] 36 0.003% 0.004% ( 3, 4 ] 69 0.006% 0.010% ( 4, 6 ] 103 0.009% 0.020% ( 6, 10 ] 394 0.036% 0.056% ( 10, 15 ] 3948 0.363% 0.419% ( 15, 22 ] 5736 0.528% 0.947% ( 22, 34 ] 9059 0.833% 1.780% ( 34, 51 ] 2617 0.241% 2.021% ( 51, 76 ] 331 0.030% 2.052% ( 76, 110 ] 27322 2.514% 4.565% # ( 110, 170 ] 532789 49.015% 53.580% ########## ( 170, 250 ] 344283 31.673% 85.253% ###### ( 250, 380 ] 100772 9.271% 94.523% ## ( 380, 580 ] 36434 3.352% 97.875% # ( 580, 870 ] 12816 1.179% 99.054% ( 870, 1300 ] 4615 0.425% 99.479% ( 1300, 1900 ] 1766 0.162% 99.641% ( 1900, 2900 ] 1334 0.123% 99.764% ( 2900, 4400 ] 979 0.090% 99.854% ( 4400, 6600 ] 300 0.028% 99.882% ( 6600, 9900 ] 180 0.017% 99.898% ( 9900, 14000 ] 377 0.035% 99.933% ( 14000, 22000 ] 551 0.051% 99.984% ( 22000, 33000 ] 144 0.013% 99.997% ( 33000, 50000 ] 28 0.003% 99.999% ( 50000, 75000 ] 6 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 17941874 rocksdb.bloom.filter.full.positive COUNT : 1261551 rocksdb.bloom.filter.full.true.positive COUNT : 1086545 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 451 rocksdb.memtable.miss COUNT : 1086545 rocksdb.l0.hit COUNT : 41836 rocksdb.l1.hit COUNT : 17554 rocksdb.l2andup.hit COUNT : 1027155 rocksdb.compaction.key.drop.new COUNT : 118475 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4100292 rocksdb.number.keys.read COUNT : 1086996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4231501344 rocksdb.bytes.read COUNT : 1086996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1566 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 44449887 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16593027327 rocksdb.compact.write.bytes COUNT : 16470501925 rocksdb.flush.write.bytes COUNT : 4227780669 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 792 rocksdb.number.superversion_releases COUNT : 761 rocksdb.number.superversion_cleanups COUNT : 198 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 204 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4193611776 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1562624 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 21542816520 rocksdb.non.last.level.read.count COUNT : 5062159 rocksdb.block.checksum.compute.count COUNT : 5292433 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 164.862036 P95 : 406.728223 P99 : 856.127488 P100 : 67681.000000 COUNT : 1086996 SUM : 239523617 rocksdb.db.write.micros P50 : 1.516701 P95 : 4.699200 P99 : 12.939607 P100 : 903890.000000 COUNT : 4100292 SUM : 54785438 rocksdb.compaction.times.micros P50 : 1334615.384615 P95 : 2766666.666667 P99 : 24948154.000000 P100 : 24948154.000000 COUNT : 64 SUM : 113819613 rocksdb.compaction.times.cpu_micros P50 : 796956.521739 P95 : 1732000.000000 P99 : 11312000.000000 P100 : 12187658.000000 COUNT : 64 SUM : 65422741 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 832.407407 P95 : 76750.000000 P99 : 498965.000000 P100 : 498965.000000 COUNT : 59 SUM : 1218120 rocksdb.compaction.outfile.sync.micros P50 : 31350.000000 P95 : 293136.363636 P99 : 392350.000000 P100 : 449359.000000 COUNT : 187 SUM : 14927312 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 186.000000 P95 : 5206.666667 P99 : 6516.888889 P100 : 6926.000000 COUNT : 134 SUM : 136981 rocksdb.table.open.io.micros P50 : 9376.923077 P95 : 19846.400000 P99 : 21850.880000 P100 : 26237.000000 COUNT : 1566 SUM : 14739752 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.889060 P95 : 109.954903 P99 : 208.852266 P100 : 14783.000000 COUNT : 4018585 SUM : 73366214 rocksdb.read.block.get.micros P50 : 136.853510 P95 : 281.792706 P99 : 801.557177 P100 : 12805.000000 COUNT : 1272291 SUM : 202844787 rocksdb.write.raw.block.micros P50 : 0.544591 P95 : 1.535150 P99 : 3.833196 P100 : 13290.000000 COUNT : 5013397 SUM : 13888592 rocksdb.numfiles.in.singlecompaction P50 : 2.687500 P95 : 3.969643 P99 : 36.000000 P100 : 36.000000 COUNT : 77 SUM : 282 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.585012 P95 : 2055.604813 P99 : 2731.917127 P100 : 903728.000000 COUNT : 186882 SUM : 44470050 rocksdb.sst.read.micros P50 : 2.417252 P95 : 169.181007 P99 : 448.807217 P100 : 11342.000000 COUNT : 5062209 SUM : 261869697 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1086996 SUM : 1086996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4100292 SUM : 4231501344 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 221304.347826 P95 : 865666.666667 P99 : 1133133.333333 P100 : 1135644.000000 COUNT : 59 SUM : 17350909 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 210 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0