[2024-07-14 10:23:23.816394] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 23.11.0 initialization... [2024-07-14 10:23:23.816558] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid540977 ] Set seed to 1720945403812970 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-14 10:23:23.917502] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-14 10:23:23.958584] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-14 10:23:23.958636] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 540977' to capture a snapshot of events at runtime. [2024-07-14 10:23:23.958646] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-14 10:23:23.958677] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-14 10:23:23.958684] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid540977 for offline analysis/debug. [2024-07-14 10:23:23.958773] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Jul 14 10:23:28 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/14-10:23:36 ... thread 0: (1000000,1000000) ops and (124797.1,124797.1) ops/second in (8.013009,8.013009) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 881.24 MB 56.6 0.4 0.0 0.4 1.2 0.9 0.0 1.4 36.9 123.0 10.24 4.11 11 0.931 383K 570 0.0 0.0 L1 6/0 438.41 MB 43.8 0.7 0.6 0.2 0.7 0.6 0.0 1.3 103.2 102.9 7.43 3.62 1 7.428 778K 2346 0.0 0.0 L2 6/4 583.20 MB 1.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 33/9 2.55 GB 2.0 3.1 1.9 1.2 3.0 1.8 0.0 1.6 101.8 101.0 30.73 14.80 15 2.048 1691K 1848 0.0 0.0 L4 189/8 12.26 GB 1.2 3.7 2.4 1.3 3.7 2.4 0.2 1.5 111.6 110.2 34.41 17.74 30 1.147 1788K 0 0.0 0.0 L5 1088/0 89.51 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1329/25 106.17 GB 0.0 7.9 4.8 3.1 8.7 5.6 0.5 10.1 97.9 107.7 82.81 40.27 57 1.453 4641K 4764 0.0 0.0 Int 0/0 0.00 KB 0.0 7.9 4.8 3.1 8.7 5.6 0.5 10.1 97.9 107.7 82.81 40.27 57 1.453 4641K 4764 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.9 4.8 3.1 7.9 4.8 0.0 0.0 107.5 106.6 75.43 37.70 47 1.605 4641K 4764 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 119.5 7.38 2.57 10 0.738 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.2 total, 8.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.71 GB write, 1087.63 MB/s write, 7.92 GB read, 988.85 MB/s read, 82.8 seconds Interval compaction: 8.71 GB write, 1113.03 MB/s write, 7.92 GB read, 1011.94 MB/s read, 82.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 35, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 320543 Average: 12.7167 StdDev: 184.02 Min: 1 Median: 1.8624 Max: 38513 Percentiles: P50: 1.86 P75: 2.84 P99: 11.30 P99.9: 2132.19 P99.99: 3983.34 ------------------------------------------------------ [ 0, 1 ] 11584 3.614% 3.614% # ( 1, 2 ] 172418 53.789% 57.403% ########### ( 2, 3 ] 66924 20.878% 78.282% #### ( 3, 4 ] 30199 9.421% 87.703% ## ( 4, 6 ] 29152 9.095% 96.797% ## ( 6, 10 ] 6751 2.106% 98.903% ( 10, 15 ] 1189 0.371% 99.274% ( 15, 22 ] 163 0.051% 99.325% ( 22, 34 ] 19 0.006% 99.331% ( 34, 51 ] 9 0.003% 99.334% ( 51, 76 ] 7 0.002% 99.336% ( 76, 110 ] 2 0.001% 99.337% ( 110, 170 ] 22 0.007% 99.344% ( 170, 250 ] 42 0.013% 99.357% ( 250, 380 ] 139 0.043% 99.400% ( 380, 580 ] 291 0.091% 99.491% ( 580, 870 ] 455 0.142% 99.633% ( 870, 1300 ] 473 0.148% 99.780% ( 1300, 1900 ] 334 0.104% 99.885% ( 1900, 2900 ] 213 0.066% 99.951% ( 2900, 4400 ] 173 0.054% 100.005% ( 4400, 6600 ] 50 0.016% 100.021% ( 6600, 9900 ] 9 0.003% 100.023% ( 9900, 14000 ] 4 0.001% 100.025% ( 14000, 22000 ] 5 0.002% 100.026% ( 22000, 33000 ] 1 0.000% 100.027% ( 33000, 50000 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 58176 Average: 18.2628 StdDev: 192.10 Min: 1 Median: 1.9249 Max: 7832 Percentiles: P50: 1.92 P75: 2.93 P99: 97.08 P99.9: 3439.65 P99.99: 5900.11 ------------------------------------------------------ [ 0, 1 ] 1617 2.779% 2.779% # ( 1, 2 ] 29700 51.052% 53.831% ########## ( 2, 3 ] 13218 22.721% 76.552% ##### ( 3, 4 ] 5762 9.904% 86.457% ## ( 4, 6 ] 5246 9.017% 95.474% ## ( 6, 10 ] 1674 2.877% 98.352% # ( 10, 15 ] 320 0.550% 98.902% ( 15, 22 ] 45 0.077% 98.979% ( 22, 34 ] 8 0.014% 98.993% ( 34, 51 ] 1 0.002% 98.994% ( 51, 76 ] 2 0.003% 98.998% ( 76, 110 ] 2 0.003% 99.001% ( 110, 170 ] 6 0.010% 99.012% ( 170, 250 ] 12 0.021% 99.032% ( 250, 380 ] 24 0.041% 99.074% ( 380, 580 ] 59 0.101% 99.175% ( 580, 870 ] 105 0.180% 99.355% ( 870, 1300 ] 128 0.220% 99.575% ( 1300, 1900 ] 81 0.139% 99.715% ( 1900, 2900 ] 83 0.143% 99.857% ( 2900, 4400 ] 69 0.119% 99.976% ( 4400, 6600 ] 12 0.021% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 363417 Average: 14.8716 StdDev: 192.78 Min: 1 Median: 1.9429 Max: 18730 Percentiles: P50: 1.94 P75: 2.96 P99: 12.55 P99.9: 1723.12 P99.99: 2435.66 ------------------------------------------------------ [ 0, 1 ] 9858 2.713% 2.713% # ( 1, 2 ] 182261 50.152% 52.865% ########## ( 2, 3 ] 83802 23.059% 75.924% ##### ( 3, 4 ] 37560 10.335% 86.259% ## ( 4, 6 ] 35183 9.681% 95.940% ## ( 6, 10 ] 9954 2.739% 98.679% # ( 10, 15 ] 2282 0.628% 99.307% ( 15, 22 ] 320 0.088% 99.395% ( 22, 34 ] 65 0.018% 99.413% ( 34, 51 ] 25 0.007% 99.420% ( 51, 76 ] 15 0.004% 99.424% ( 76, 110 ] 11 0.003% 99.427% ( 110, 170 ] 30 0.008% 99.436% ( 170, 250 ] 50 0.014% 99.449% ( 250, 380 ] 123 0.034% 99.483% ( 380, 580 ] 240 0.066% 99.549% ( 580, 870 ] 429 0.118% 99.667% ( 870, 1300 ] 536 0.147% 99.815% ( 1300, 1900 ] 439 0.121% 99.936% ( 1900, 2900 ] 369 0.102% 100.037% ( 2900, 4400 ] 295 0.081% 100.118% ( 4400, 6600 ] 74 0.020% 100.139% ( 6600, 9900 ] 18 0.005% 100.144% ( 9900, 14000 ] 4 0.001% 100.145% ( 14000, 22000 ] 10 0.003% 100.147% ** Level 3 read latency histogram (micros): Count: 829885 Average: 13.4008 StdDev: 193.73 Min: 1 Median: 1.9266 Max: 31977 Percentiles: P50: 1.93 P75: 2.93 P99: 9.89 P99.9: 1030.81 P99.99: 1334.91 ------------------------------------------------------ [ 0, 1 ] 17290 2.083% 2.083% ( 1, 2 ] 429173 51.715% 53.798% ########## ( 2, 3 ] 189675 22.856% 76.654% ##### ( 3, 4 ] 84836 10.223% 86.876% ## ( 4, 6 ] 82182 9.903% 96.779% ## ( 6, 10 ] 18953 2.284% 99.063% ( 10, 15 ] 3956 0.477% 99.540% ( 15, 22 ] 529 0.064% 99.603% ( 22, 34 ] 55 0.007% 99.610% ( 34, 51 ] 45 0.005% 99.615% ( 51, 76 ] 64 0.008% 99.623% ( 76, 110 ] 24 0.003% 99.626% ( 110, 170 ] 38 0.005% 99.631% ( 170, 250 ] 112 0.013% 99.644% ( 250, 380 ] 233 0.028% 99.672% ( 380, 580 ] 496 0.060% 99.732% ( 580, 870 ] 979 0.118% 99.850% ( 870, 1300 ] 1110 0.134% 99.984% ( 1300, 1900 ] 894 0.108% 100.091% ( 1900, 2900 ] 653 0.079% 100.170% ( 2900, 4400 ] 543 0.065% 100.236% ( 4400, 6600 ] 155 0.019% 100.254% ( 6600, 9900 ] 44 0.005% 100.260% ( 9900, 14000 ] 13 0.002% 100.261% ( 14000, 22000 ] 17 0.002% 100.263% ( 22000, 33000 ] 5 0.001% 100.264% ** Level 4 read latency histogram (micros): Count: 349798 Average: 24.1273 StdDev: 258.82 Min: 0 Median: 1.9227 Max: 46655 Percentiles: P50: 1.92 P75: 2.95 P99: 458.77 P99.9: 2423.75 P99.99: 3013.91 ------------------------------------------------------ [ 0, 1 ] 7213 2.062% 2.062% ( 1, 2 ] 181731 51.953% 54.015% ########## ( 2, 3 ] 77224 22.077% 76.092% #### ( 3, 4 ] 34980 10.000% 86.092% ## ( 4, 6 ] 33931 9.700% 95.792% ## ( 6, 10 ] 8901 2.545% 98.337% # ( 10, 15 ] 1428 0.408% 98.745% ( 15, 22 ] 200 0.057% 98.802% ( 22, 34 ] 18 0.005% 98.807% ( 34, 51 ] 16 0.005% 98.812% ( 51, 76 ] 32 0.009% 98.821% ( 76, 110 ] 17 0.005% 98.826% ( 110, 170 ] 42 0.012% 98.838% ( 170, 250 ] 131 0.037% 98.875% ( 250, 380 ] 233 0.067% 98.942% ( 380, 580 ] 518 0.148% 99.090% ( 580, 870 ] 853 0.244% 99.334% ( 870, 1300 ] 966 0.276% 99.610% ( 1300, 1900 ] 713 0.204% 99.814% ( 1900, 2900 ] 577 0.165% 99.979% ( 2900, 4400 ] 527 0.151% 100.130% ( 4400, 6600 ] 143 0.041% 100.170% ( 6600, 9900 ] 23 0.007% 100.177% ( 9900, 14000 ] 2 0.001% 100.178% ( 14000, 22000 ] 6 0.002% 100.179% ( 22000, 33000 ] 1 0.000% 100.180% ( 33000, 50000 ] 1 0.000% 100.180% ** Level 5 read latency histogram (micros): Count: 13617 Average: 1694.4395 StdDev: 1739.41 Min: 82 Median: 1140.0699 Max: 59384 Percentiles: P50: 1140.07 P75: 2277.86 P99: 7179.53 P99.9: 17866.29 P99.99: 46925.55 ------------------------------------------------------ ( 76, 110 ] 16 0.118% 0.118% ( 110, 170 ] 63 0.463% 0.580% ( 170, 250 ] 223 1.638% 2.218% ( 250, 380 ] 644 4.729% 6.947% # ( 380, 580 ] 1647 12.095% 19.042% ## ( 580, 870 ] 2553 18.749% 37.791% #### ( 870, 1300 ] 2647 19.439% 57.230% #### ( 1300, 1900 ] 1825 13.402% 70.632% ### ( 1900, 2900 ] 1574 11.559% 82.191% ## ( 2900, 4400 ] 1588 11.662% 93.853% ## ( 4400, 6600 ] 678 4.979% 98.832% # ( 6600, 9900 ] 130 0.955% 99.787% ( 9900, 14000 ] 12 0.088% 99.875% ( 14000, 22000 ] 7 0.051% 99.927% ( 22000, 33000 ] 7 0.051% 99.978% ( 33000, 50000 ] 2 0.015% 99.993% ( 50000, 75000 ] 1 0.007% 100.000% ** DB Stats ** Uptime(secs): 8.2 total, 8.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 119.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.004 H:M:S, 48.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 122.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.004 H:M:S, 49.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/14-10:23:42 ... thread 0: (1000000,2000000) ops and (164687.6,141993.9) ops/second in (6.072104,14.085113) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 1.84 GB 31.5 1.0 0.0 1.0 2.8 1.8 0.0 1.5 52.3 150.4 19.25 9.46 26 0.740 1023K 1289 0.0 0.0 L1 6/6 438.41 MB 0.0 0.7 0.6 0.2 0.7 0.6 0.0 1.3 103.2 102.9 7.43 3.62 1 7.428 778K 2346 0.0 0.0 L2 1/0 64.60 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 939.96 MB 0.9 3.9 2.4 1.5 3.8 2.3 0.0 1.6 105.8 105.0 37.45 18.74 19 1.971 2470K 5479 0.0 0.0 L4 169/0 9.69 GB 1.0 7.9 4.3 3.7 7.8 4.2 0.4 1.8 120.4 118.5 67.48 37.59 52 1.298 3185K 2724 0.0 0.0 L5 1144/0 94.12 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/19 107.07 GB 0.0 13.5 7.2 6.3 15.2 8.9 5.4 8.2 105.3 118.4 131.60 69.41 98 1.343 7457K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.5 7.2 6.3 15.2 8.9 5.4 8.2 105.3 118.4 131.60 69.41 98 1.343 7457K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.5 7.2 6.3 13.4 7.1 0.0 0.0 117.2 115.8 118.29 64.00 75 1.577 7457K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 141.9 13.32 5.41 23 0.579 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.3 total, 14.1 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.22 GB write, 1091.92 MB/s write, 13.54 GB read, 971.11 MB/s read, 131.6 seconds Interval compaction: 15.22 GB write, 1106.44 MB/s write, 13.54 GB read, 984.02 MB/s read, 131.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 59, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 613553 Average: 11.3936 StdDev: 157.46 Min: 1 Median: 1.8113 Max: 38513 Percentiles: P50: 1.81 P75: 2.73 P99: 14.35 P99.9: 1790.19 P99.99: 3666.91 ------------------------------------------------------ [ 0, 1 ] 33197 5.411% 5.411% # ( 1, 2 ] 337233 54.964% 60.375% ########### ( 2, 3 ] 122341 19.940% 80.314% #### ( 3, 4 ] 52004 8.476% 88.790% ## ( 4, 6 ] 49280 8.032% 96.822% ## ( 6, 10 ] 11659 1.900% 98.722% ( 10, 15 ] 1961 0.320% 99.042% ( 15, 22 ] 282 0.046% 99.088% ( 22, 34 ] 38 0.006% 99.094% ( 34, 51 ] 31 0.005% 99.099% ( 51, 76 ] 37 0.006% 99.105% ( 76, 110 ] 256 0.042% 99.147% ( 110, 170 ] 905 0.148% 99.294% ( 170, 250 ] 567 0.092% 99.387% ( 250, 380 ] 470 0.077% 99.463% ( 380, 580 ] 726 0.118% 99.582% ( 580, 870 ] 819 0.133% 99.715% ( 870, 1300 ] 760 0.124% 99.839% ( 1300, 1900 ] 462 0.075% 99.914% ( 1900, 2900 ] 325 0.053% 99.967% ( 2900, 4400 ] 279 0.045% 100.013% ( 4400, 6600 ] 75 0.012% 100.025% ( 6600, 9900 ] 12 0.002% 100.027% ( 9900, 14000 ] 4 0.001% 100.028% ( 14000, 22000 ] 5 0.001% 100.029% ( 22000, 33000 ] 2 0.000% 100.029% ( 33000, 50000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 164831 Average: 15.0832 StdDev: 197.90 Min: 1 Median: 1.9345 Max: 25410 Percentiles: P50: 1.93 P75: 2.95 P99: 14.84 P99.9: 3038.28 P99.99: 6360.54 ------------------------------------------------------ [ 0, 1 ] 3640 2.208% 2.208% ( 1, 2 ] 84295 51.140% 53.349% ########## ( 2, 3 ] 37647 22.840% 76.188% ##### ( 3, 4 ] 16193 9.824% 86.012% ## ( 4, 6 ] 16090 9.762% 95.774% ## ( 6, 10 ] 4554 2.763% 98.537% # ( 10, 15 ] 789 0.479% 99.015% ( 15, 22 ] 114 0.069% 99.085% ( 22, 34 ] 14 0.008% 99.093% ( 34, 51 ] 9 0.005% 99.098% ( 51, 76 ] 19 0.012% 99.110% ( 76, 110 ] 32 0.019% 99.129% ( 110, 170 ] 79 0.048% 99.177% ( 170, 250 ] 68 0.041% 99.219% ( 250, 380 ] 107 0.065% 99.284% ( 380, 580 ] 165 0.100% 99.384% ( 580, 870 ] 265 0.161% 99.544% ( 870, 1300 ] 287 0.174% 99.718% ( 1300, 1900 ] 142 0.086% 99.805% ( 1900, 2900 ] 145 0.088% 99.893% ( 2900, 4400 ] 132 0.080% 99.973% ( 4400, 6600 ] 32 0.019% 99.992% ( 6600, 9900 ] 11 0.007% 99.999% ( 9900, 14000 ] 1 0.001% 99.999% ( 14000, 22000 ] 3 0.002% 100.001% ( 22000, 33000 ] 1 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 420127 Average: 14.6735 StdDev: 192.66 Min: 1 Median: 1.9377 Max: 18730 Percentiles: P50: 1.94 P75: 2.95 P99: 12.33 P99.9: 1796.43 P99.99: 2638.77 ------------------------------------------------------ [ 0, 1 ] 10973 2.612% 2.612% # ( 1, 2 ] 212324 50.538% 53.150% ########## ( 2, 3 ] 96527 22.976% 76.126% ##### ( 3, 4 ] 42849 10.199% 86.325% ## ( 4, 6 ] 40668 9.680% 96.005% ## ( 6, 10 ] 11383 2.709% 98.714% # ( 10, 15 ] 2584 0.615% 99.329% ( 15, 22 ] 349 0.083% 99.412% ( 22, 34 ] 66 0.016% 99.428% ( 34, 51 ] 31 0.007% 99.435% ( 51, 76 ] 21 0.005% 99.440% ( 76, 110 ] 11 0.003% 99.443% ( 110, 170 ] 32 0.008% 99.450% ( 170, 250 ] 55 0.013% 99.463% ( 250, 380 ] 134 0.032% 99.495% ( 380, 580 ] 269 0.064% 99.559% ( 580, 870 ] 469 0.112% 99.671% ( 870, 1300 ] 573 0.136% 99.807% ( 1300, 1900 ] 470 0.112% 99.919% ( 1900, 2900 ] 402 0.096% 100.015% ( 2900, 4400 ] 368 0.088% 100.103% ( 4400, 6600 ] 87 0.021% 100.123% ( 6600, 9900 ] 23 0.005% 100.129% ( 9900, 14000 ] 5 0.001% 100.130% ( 14000, 22000 ] 10 0.002% 100.132% ** Level 3 read latency histogram (micros): Count: 1378944 Average: 11.2374 StdDev: 170.67 Min: 1 Median: 1.9221 Max: 31977 Percentiles: P50: 1.92 P75: 2.92 P99: 9.69 P99.9: 800.65 P99.99: 1133.00 ------------------------------------------------------ [ 0, 1 ] 28368 2.057% 2.057% ( 1, 2 ] 716979 51.995% 54.052% ########## ( 2, 3 ] 314000 22.771% 76.823% ##### ( 3, 4 ] 139643 10.127% 86.950% ## ( 4, 6 ] 136756 9.917% 96.867% ## ( 6, 10 ] 31913 2.314% 99.182% ( 10, 15 ] 6239 0.452% 99.634% ( 15, 22 ] 817 0.059% 99.693% ( 22, 34 ] 78 0.006% 99.699% ( 34, 51 ] 96 0.007% 99.706% ( 51, 76 ] 151 0.011% 99.717% ( 76, 110 ] 52 0.004% 99.721% ( 110, 170 ] 139 0.010% 99.731% ( 170, 250 ] 193 0.014% 99.745% ( 250, 380 ] 339 0.025% 99.769% ( 380, 580 ] 749 0.054% 99.824% ( 580, 870 ] 1384 0.100% 99.924% ( 870, 1300 ] 1488 0.108% 100.032% ( 1300, 1900 ] 1087 0.079% 100.111% ( 1900, 2900 ] 816 0.059% 100.170% ( 2900, 4400 ] 741 0.054% 100.224% ( 4400, 6600 ] 197 0.014% 100.238% ( 6600, 9900 ] 60 0.004% 100.242% ( 9900, 14000 ] 20 0.001% 100.244% ( 14000, 22000 ] 22 0.002% 100.245% ( 22000, 33000 ] 5 0.000% 100.246% ** Level 4 read latency histogram (micros): Count: 952743 Average: 18.2223 StdDev: 225.06 Min: 0 Median: 1.9146 Max: 46655 Percentiles: P50: 1.91 P75: 2.93 P99: 18.82 P99.9: 1609.35 P99.99: 2163.74 ------------------------------------------------------ [ 0, 1 ] 19307 2.026% 2.026% ( 1, 2 ] 499731 52.452% 54.478% ########## ( 2, 3 ] 210406 22.084% 76.563% #### ( 3, 4 ] 93736 9.839% 86.401% ## ( 4, 6 ] 91536 9.608% 96.009% ## ( 6, 10 ] 24208 2.541% 98.550% # ( 10, 15 ] 4010 0.421% 98.970% ( 15, 22 ] 516 0.054% 99.025% ( 22, 34 ] 51 0.005% 99.030% ( 34, 51 ] 65 0.007% 99.037% ( 51, 76 ] 130 0.014% 99.050% ( 76, 110 ] 190 0.020% 99.070% ( 110, 170 ] 670 0.070% 99.141% ( 170, 250 ] 605 0.064% 99.204% ( 250, 380 ] 772 0.081% 99.285% ( 380, 580 ] 1321 0.139% 99.424% ( 580, 870 ] 1917 0.201% 99.625% ( 870, 1300 ] 1982 0.208% 99.833% ( 1300, 1900 ] 1236 0.130% 99.963% ( 1900, 2900 ] 981 0.103% 100.066% ( 2900, 4400 ] 977 0.103% 100.168% ( 4400, 6600 ] 276 0.029% 100.197% ( 6600, 9900 ] 53 0.006% 100.203% ( 9900, 14000 ] 6 0.001% 100.204% ( 14000, 22000 ] 14 0.001% 100.205% ( 22000, 33000 ] 3 0.000% 100.205% ( 33000, 50000 ] 4 0.000% 100.206% ** Level 5 read latency histogram (micros): Count: 36143 Average: 1145.9294 StdDev: 1455.04 Min: 77 Median: 717.6628 Max: 59384 Percentiles: P50: 717.66 P75: 1348.41 P99: 6280.10 P99.9: 11029.55 P99.99: 34639.22 ------------------------------------------------------ ( 76, 110 ] 1131 3.129% 3.129% # ( 110, 170 ] 3899 10.788% 13.917% ## ( 170, 250 ] 2598 7.188% 21.105% # ( 250, 380 ] 2862 7.919% 29.024% ## ( 380, 580 ] 4739 13.112% 42.135% ### ( 580, 870 ] 5988 16.568% 58.703% ### ( 870, 1300 ] 5629 15.574% 74.277% ### ( 1300, 1900 ] 3238 8.959% 83.236% ## ( 1900, 2900 ] 2385 6.599% 89.835% # ( 2900, 4400 ] 2499 6.914% 96.749% # ( 4400, 6600 ] 952 2.634% 99.383% # ( 6600, 9900 ] 183 0.506% 99.889% ( 9900, 14000 ] 14 0.039% 99.928% ( 14000, 22000 ] 11 0.030% 99.958% ( 22000, 33000 ] 11 0.030% 99.989% ( 33000, 50000 ] 4 0.011% 100.000% ( 50000, 75000 ] 1 0.003% 100.003% ** DB Stats ** Uptime(secs): 14.3 total, 6.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 137.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.191 H:M:S, 43.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 162.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.187 H:M:S, 36.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/14-10:23:45 ... thread 0: (1000000,3000000) ops and (285457.3,170568.3) ops/second in (3.503151,17.588264) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 2.77 GB 163.6 2.1 0.0 2.1 4.9 2.8 0.0 1.8 80.4 186.8 26.63 16.32 45 0.592 2174K 2605 0.0 0.0 L1 6/6 438.41 MB 0.0 0.7 0.6 0.2 0.7 0.6 0.0 1.3 103.2 102.9 7.43 3.62 1 7.428 778K 2346 0.0 0.0 L2 1/0 64.60 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 939.96 MB 0.9 3.9 2.4 1.5 3.8 2.3 0.0 1.6 105.8 105.0 37.45 18.74 19 1.971 2470K 5479 0.0 0.0 L4 169/0 9.69 GB 1.0 7.9 4.3 3.7 7.8 4.2 0.4 1.8 120.4 118.5 67.48 37.59 52 1.298 3185K 2724 0.0 0.0 L5 1144/0 94.12 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1350/15 107.99 GB 0.0 14.6 7.2 7.4 17.2 9.8 5.4 6.2 107.9 127.1 138.98 76.28 117 1.188 8608K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 7.2 7.4 17.2 9.8 5.4 6.2 107.9 127.1 138.98 76.28 117 1.188 8608K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 7.2 7.4 14.5 7.0 0.0 0.0 122.3 120.9 122.61 68.21 79 1.552 8608K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 173.2 16.37 8.07 38 0.431 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.8 total, 17.6 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.25 GB write, 993.62 MB/s write, 14.64 GB read, 843.54 MB/s read, 139.0 seconds Interval compaction: 17.25 GB write, 1004.20 MB/s write, 14.64 GB read, 852.52 MB/s read, 139.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 59, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 925443 Average: 11.8897 StdDev: 132.78 Min: 1 Median: 1.6913 Max: 38513 Percentiles: P50: 1.69 P75: 2.48 P99: 205.54 P99.9: 1230.02 P99.99: 2566.05 ------------------------------------------------------ [ 0, 1 ] 107204 11.584% 11.584% ## ( 1, 2 ] 514305 55.574% 67.158% ########### ( 2, 3 ] 149779 16.185% 83.343% ### ( 3, 4 ] 62237 6.725% 90.068% # ( 4, 6 ] 54820 5.924% 95.991% # ( 6, 10 ] 12949 1.399% 97.391% ( 10, 15 ] 2311 0.250% 97.640% ( 15, 22 ] 370 0.040% 97.680% ( 22, 34 ] 56 0.006% 97.686% ( 34, 51 ] 32 0.003% 97.690% ( 51, 76 ] 40 0.004% 97.694% ( 76, 110 ] 2144 0.232% 97.926% ( 110, 170 ] 8066 0.872% 98.797% ( 170, 250 ] 4222 0.456% 99.254% ( 250, 380 ] 2072 0.224% 99.477% ( 380, 580 ] 1962 0.212% 99.689% ( 580, 870 ] 1262 0.136% 99.826% ( 870, 1300 ] 820 0.089% 99.914% ( 1300, 1900 ] 471 0.051% 99.965% ( 1900, 2900 ] 343 0.037% 100.002% ( 2900, 4400 ] 281 0.030% 100.033% ( 4400, 6600 ] 75 0.008% 100.041% ( 6600, 9900 ] 12 0.001% 100.042% ( 9900, 14000 ] 4 0.000% 100.043% ( 14000, 22000 ] 5 0.001% 100.043% ( 22000, 33000 ] 2 0.000% 100.043% ( 33000, 50000 ] 1 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 180793 Average: 14.9241 StdDev: 189.63 Min: 1 Median: 1.9851 Max: 25410 Percentiles: P50: 1.99 P75: 3.11 P99: 147.90 P99.9: 2874.02 P99.99: 6250.80 ------------------------------------------------------ [ 0, 1 ] 3899 2.157% 2.157% ( 1, 2 ] 87810 48.569% 50.726% ########## ( 2, 3 ] 41770 23.104% 73.830% ##### ( 3, 4 ] 18982 10.499% 84.329% ## ( 4, 6 ] 19489 10.780% 95.109% ## ( 6, 10 ] 5373 2.972% 98.081% # ( 10, 15 ] 967 0.535% 98.616% ( 15, 22 ] 223 0.123% 98.739% ( 22, 34 ] 28 0.015% 98.754% ( 34, 51 ] 9 0.005% 98.759% ( 51, 76 ] 19 0.011% 98.770% ( 76, 110 ] 135 0.075% 98.845% ( 110, 170 ] 445 0.246% 99.091% ( 170, 250 ] 221 0.122% 99.213% ( 250, 380 ] 170 0.094% 99.307% ( 380, 580 ] 216 0.119% 99.426% ( 580, 870 ] 282 0.156% 99.582% ( 870, 1300 ] 290 0.160% 99.743% ( 1300, 1900 ] 142 0.079% 99.821% ( 1900, 2900 ] 146 0.081% 99.902% ( 2900, 4400 ] 132 0.073% 99.975% ( 4400, 6600 ] 32 0.018% 99.993% ( 6600, 9900 ] 11 0.006% 99.999% ( 9900, 14000 ] 1 0.001% 99.999% ( 14000, 22000 ] 3 0.002% 100.001% ( 22000, 33000 ] 1 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 420127 Average: 14.6735 StdDev: 192.66 Min: 1 Median: 1.9377 Max: 18730 Percentiles: P50: 1.94 P75: 2.95 P99: 12.33 P99.9: 1796.43 P99.99: 2638.77 ------------------------------------------------------ [ 0, 1 ] 10973 2.612% 2.612% # ( 1, 2 ] 212324 50.538% 53.150% ########## ( 2, 3 ] 96527 22.976% 76.126% ##### ( 3, 4 ] 42849 10.199% 86.325% ## ( 4, 6 ] 40668 9.680% 96.005% ## ( 6, 10 ] 11383 2.709% 98.714% # ( 10, 15 ] 2584 0.615% 99.329% ( 15, 22 ] 349 0.083% 99.412% ( 22, 34 ] 66 0.016% 99.428% ( 34, 51 ] 31 0.007% 99.435% ( 51, 76 ] 21 0.005% 99.440% ( 76, 110 ] 11 0.003% 99.443% ( 110, 170 ] 32 0.008% 99.450% ( 170, 250 ] 55 0.013% 99.463% ( 250, 380 ] 134 0.032% 99.495% ( 380, 580 ] 269 0.064% 99.559% ( 580, 870 ] 469 0.112% 99.671% ( 870, 1300 ] 573 0.136% 99.807% ( 1300, 1900 ] 470 0.112% 99.919% ( 1900, 2900 ] 402 0.096% 100.015% ( 2900, 4400 ] 368 0.088% 100.103% ( 4400, 6600 ] 87 0.021% 100.123% ( 6600, 9900 ] 23 0.005% 100.129% ( 9900, 14000 ] 5 0.001% 100.130% ( 14000, 22000 ] 10 0.002% 100.132% ** Level 3 read latency histogram (micros): Count: 1379727 Average: 11.3293 StdDev: 170.70 Min: 1 Median: 1.9226 Max: 31977 Percentiles: P50: 1.92 P75: 2.92 P99: 9.77 P99.9: 801.86 P99.99: 1133.31 ------------------------------------------------------ [ 0, 1 ] 28368 2.056% 2.056% ( 1, 2 ] 716987 51.966% 54.022% ########## ( 2, 3 ] 314029 22.760% 76.782% ##### ( 3, 4 ] 139658 10.122% 86.904% ## ( 4, 6 ] 136785 9.914% 96.818% ## ( 6, 10 ] 31918 2.313% 99.132% ( 10, 15 ] 6241 0.452% 99.584% ( 15, 22 ] 817 0.059% 99.643% ( 22, 34 ] 78 0.006% 99.649% ( 34, 51 ] 96 0.007% 99.656% ( 51, 76 ] 151 0.011% 99.667% ( 76, 110 ] 146 0.011% 99.677% ( 110, 170 ] 456 0.033% 99.710% ( 170, 250 ] 369 0.027% 99.737% ( 250, 380 ] 393 0.028% 99.766% ( 380, 580 ] 785 0.057% 99.822% ( 580, 870 ] 1399 0.101% 99.924% ( 870, 1300 ] 1491 0.108% 100.032% ( 1300, 1900 ] 1087 0.079% 100.111% ( 1900, 2900 ] 816 0.059% 100.170% ( 2900, 4400 ] 741 0.054% 100.224% ( 4400, 6600 ] 197 0.014% 100.238% ( 6600, 9900 ] 60 0.004% 100.242% ( 9900, 14000 ] 20 0.001% 100.244% ( 14000, 22000 ] 22 0.002% 100.245% ( 22000, 33000 ] 5 0.000% 100.246% ** Level 4 read latency histogram (micros): Count: 960241 Average: 19.5179 StdDev: 225.09 Min: 0 Median: 1.9220 Max: 46655 Percentiles: P50: 1.92 P75: 2.95 P99: 220.55 P99.9: 1609.81 P99.99: 2168.74 ------------------------------------------------------ [ 0, 1 ] 19307 2.011% 2.011% ( 1, 2 ] 499799 52.049% 54.060% ########## ( 2, 3 ] 210661 21.938% 75.998% #### ( 3, 4 ] 93908 9.780% 85.778% ## ( 4, 6 ] 91756 9.556% 95.333% ## ( 6, 10 ] 24242 2.525% 97.858% # ( 10, 15 ] 4016 0.418% 98.276% ( 15, 22 ] 516 0.054% 98.330% ( 22, 34 ] 51 0.005% 98.335% ( 34, 51 ] 65 0.007% 98.342% ( 51, 76 ] 130 0.014% 98.356% ( 76, 110 ] 1051 0.109% 98.465% ( 110, 170 ] 3850 0.401% 98.866% ( 170, 250 ] 2036 0.212% 99.078% ( 250, 380 ] 1369 0.143% 99.221% ( 380, 580 ] 1804 0.188% 99.408% ( 580, 870 ] 2072 0.216% 99.624% ( 870, 1300 ] 2008 0.209% 99.833% ( 1300, 1900 ] 1239 0.129% 99.962% ( 1900, 2900 ] 986 0.103% 100.065% ( 2900, 4400 ] 979 0.102% 100.167% ( 4400, 6600 ] 276 0.029% 100.196% ( 6600, 9900 ] 53 0.006% 100.201% ( 9900, 14000 ] 6 0.001% 100.202% ( 14000, 22000 ] 14 0.001% 100.203% ( 22000, 33000 ] 3 0.000% 100.204% ( 33000, 50000 ] 4 0.000% 100.204% ** Level 5 read latency histogram (micros): Count: 80138 Average: 628.2269 StdDev: 1089.36 Min: 73 Median: 227.8696 Max: 59384 Percentiles: P50: 227.87 P75: 664.90 P99: 5249.54 P99.9: 9068.00 P99.99: 22986.20 ------------------------------------------------------ ( 51, 76 ] 5 0.006% 0.006% ( 76, 110 ] 7033 8.776% 8.782% ## ( 110, 170 ] 24522 30.600% 39.382% ###### ( 170, 250 ] 11764 14.680% 54.062% ### ( 250, 380 ] 6818 8.508% 62.570% ## ( 380, 580 ] 7927 9.892% 72.461% ## ( 580, 870 ] 6953 8.676% 81.138% ## ( 870, 1300 ] 5779 7.211% 88.349% # ( 1300, 1900 ] 3258 4.065% 92.414% # ( 1900, 2900 ] 2410 3.007% 95.422% # ( 2900, 4400 ] 2501 3.121% 98.543% # ( 4400, 6600 ] 952 1.188% 99.730% ( 6600, 9900 ] 183 0.228% 99.959% ( 9900, 14000 ] 14 0.017% 99.976% ( 14000, 22000 ] 11 0.014% 99.990% ( 22000, 33000 ] 11 0.014% 100.004% ( 33000, 50000 ] 4 0.005% 100.009% ( 50000, 75000 ] 1 0.001% 100.010% ** DB Stats ** Uptime(secs): 17.8 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 166.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.191 H:M:S, 34.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 280.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-10:23:50 ... thread 0: (1000000,4000000) ops and (233029.7,182819.0) ops/second in (4.291298,21.879562) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/5 3.75 GB 289.5 3.3 0.0 3.3 7.1 3.7 0.0 1.9 98.3 209.3 34.59 23.74 66 0.524 3453K 3761 0.0 0.0 L1 6/6 438.41 MB 0.0 0.7 0.6 0.2 0.7 0.6 0.0 1.3 103.2 102.9 7.43 3.62 1 7.428 778K 2346 0.0 0.0 L2 1/0 64.60 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 939.96 MB 0.9 3.9 2.4 1.5 3.8 2.3 0.0 1.6 105.8 105.0 37.45 18.74 19 1.971 2470K 5479 0.0 0.0 L4 169/0 9.69 GB 1.0 7.9 4.3 3.7 7.8 4.2 0.4 1.8 120.4 118.5 67.48 37.59 52 1.298 3185K 2724 0.0 0.0 L5 1144/0 94.12 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1351/11 108.97 GB 0.0 15.9 7.2 8.7 19.5 10.8 5.4 5.2 110.6 135.6 146.94 83.70 138 1.065 9887K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.9 7.2 8.7 19.5 10.8 5.4 5.2 110.6 135.6 146.94 83.70 138 1.065 9887K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.9 7.2 8.7 15.7 7.0 0.0 0.0 127.7 126.3 127.34 72.85 84 1.516 9887K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 196.1 19.60 10.84 54 0.363 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.1 total, 21.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.46 GB write, 903.12 MB/s write, 15.87 GB read, 736.60 MB/s read, 146.9 seconds Interval compaction: 19.46 GB write, 910.85 MB/s write, 15.87 GB read, 742.91 MB/s read, 146.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 59, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1225346 Average: 12.9158 StdDev: 119.77 Min: 1 Median: 1.6303 Max: 38513 Percentiles: P50: 1.63 P75: 2.33 P99: 231.27 P99.9: 1015.77 P99.99: 2017.96 ------------------------------------------------------ [ 0, 1 ] 187976 15.341% 15.341% ### ( 1, 2 ] 673830 54.991% 70.332% ########### ( 2, 3 ] 172373 14.067% 84.399% ### ( 3, 4 ] 70902 5.786% 90.185% # ( 4, 6 ] 59910 4.889% 95.074% # ( 6, 10 ] 13959 1.139% 96.214% ( 10, 15 ] 2589 0.211% 96.425% ( 15, 22 ] 427 0.035% 96.460% ( 22, 34 ] 64 0.005% 96.465% ( 34, 51 ] 34 0.003% 96.468% ( 51, 76 ] 43 0.004% 96.471% ( 76, 110 ] 5147 0.420% 96.891% ( 110, 170 ] 19159 1.564% 98.455% ( 170, 250 ] 8723 0.712% 99.167% ( 250, 380 ] 3738 0.305% 99.472% ( 380, 580 ] 3292 0.269% 99.740% ( 580, 870 ] 1657 0.135% 99.876% ( 870, 1300 ] 881 0.072% 99.948% ( 1300, 1900 ] 478 0.039% 99.987% ( 1900, 2900 ] 360 0.029% 100.016% ( 2900, 4400 ] 289 0.024% 100.040% ( 4400, 6600 ] 75 0.006% 100.046% ( 6600, 9900 ] 12 0.001% 100.047% ( 9900, 14000 ] 4 0.000% 100.047% ( 14000, 22000 ] 5 0.000% 100.047% ( 22000, 33000 ] 2 0.000% 100.048% ( 33000, 50000 ] 1 0.000% 100.048% ** Level 1 read latency histogram (micros): Count: 197369 Average: 14.8677 StdDev: 182.09 Min: 1 Median: 2.0893 Max: 25410 Percentiles: P50: 2.09 P75: 3.33 P99: 168.44 P99.9: 2760.49 P99.99: 6136.84 ------------------------------------------------------ [ 0, 1 ] 4063 2.059% 2.059% ( 1, 2 ] 90529 45.868% 47.926% ######### ( 2, 3 ] 45845 23.228% 71.155% ##### ( 3, 4 ] 22797 11.550% 82.705% ## ( 4, 6 ] 23311 11.811% 94.516% ## ( 6, 10 ] 6114 3.098% 97.614% # ( 10, 15 ] 1162 0.589% 98.202% ( 15, 22 ] 331 0.168% 98.370% ( 22, 34 ] 42 0.021% 98.391% ( 34, 51 ] 10 0.005% 98.396% ( 51, 76 ] 19 0.010% 98.406% ( 76, 110 ] 283 0.143% 98.549% ( 110, 170 ] 913 0.463% 99.012% ( 170, 250 ] 387 0.196% 99.208% ( 250, 380 ] 237 0.120% 99.328% ( 380, 580 ] 269 0.136% 99.464% ( 580, 870 ] 300 0.152% 99.616% ( 870, 1300 ] 292 0.148% 99.764% ( 1300, 1900 ] 142 0.072% 99.836% ( 1900, 2900 ] 146 0.074% 99.910% ( 2900, 4400 ] 132 0.067% 99.977% ( 4400, 6600 ] 32 0.016% 99.993% ( 6600, 9900 ] 11 0.006% 99.999% ( 9900, 14000 ] 1 0.001% 99.999% ( 14000, 22000 ] 3 0.002% 100.001% ( 22000, 33000 ] 1 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 420127 Average: 14.6735 StdDev: 192.66 Min: 1 Median: 1.9377 Max: 18730 Percentiles: P50: 1.94 P75: 2.95 P99: 12.33 P99.9: 1796.43 P99.99: 2638.77 ------------------------------------------------------ [ 0, 1 ] 10973 2.612% 2.612% # ( 1, 2 ] 212324 50.538% 53.150% ########## ( 2, 3 ] 96527 22.976% 76.126% ##### ( 3, 4 ] 42849 10.199% 86.325% ## ( 4, 6 ] 40668 9.680% 96.005% ## ( 6, 10 ] 11383 2.709% 98.714% # ( 10, 15 ] 2584 0.615% 99.329% ( 15, 22 ] 349 0.083% 99.412% ( 22, 34 ] 66 0.016% 99.428% ( 34, 51 ] 31 0.007% 99.435% ( 51, 76 ] 21 0.005% 99.440% ( 76, 110 ] 11 0.003% 99.443% ( 110, 170 ] 32 0.008% 99.450% ( 170, 250 ] 55 0.013% 99.463% ( 250, 380 ] 134 0.032% 99.495% ( 380, 580 ] 269 0.064% 99.559% ( 580, 870 ] 469 0.112% 99.671% ( 870, 1300 ] 573 0.136% 99.807% ( 1300, 1900 ] 470 0.112% 99.919% ( 1900, 2900 ] 402 0.096% 100.015% ( 2900, 4400 ] 368 0.088% 100.103% ( 4400, 6600 ] 87 0.021% 100.123% ( 6600, 9900 ] 23 0.005% 100.129% ( 9900, 14000 ] 5 0.001% 100.130% ( 14000, 22000 ] 10 0.002% 100.132% ** Level 3 read latency histogram (micros): Count: 1380724 Average: 11.4530 StdDev: 170.74 Min: 1 Median: 1.9233 Max: 31977 Percentiles: P50: 1.92 P75: 2.92 P99: 9.89 P99.9: 802.71 P99.99: 1133.97 ------------------------------------------------------ [ 0, 1 ] 28368 2.055% 2.055% ( 1, 2 ] 716989 51.928% 53.983% ########## ( 2, 3 ] 314041 22.745% 76.728% ##### ( 3, 4 ] 139658 10.115% 86.843% ## ( 4, 6 ] 136792 9.907% 96.750% ## ( 6, 10 ] 31918 2.312% 99.062% ( 10, 15 ] 6241 0.452% 99.514% ( 15, 22 ] 817 0.059% 99.573% ( 22, 34 ] 78 0.006% 99.578% ( 34, 51 ] 96 0.007% 99.585% ( 51, 76 ] 151 0.011% 99.596% ( 76, 110 ] 307 0.022% 99.618% ( 110, 170 ] 931 0.067% 99.686% ( 170, 250 ] 568 0.041% 99.727% ( 250, 380 ] 463 0.034% 99.761% ( 380, 580 ] 844 0.061% 99.822% ( 580, 870 ] 1408 0.102% 99.924% ( 870, 1300 ] 1492 0.108% 100.032% ( 1300, 1900 ] 1088 0.079% 100.111% ( 1900, 2900 ] 817 0.059% 100.170% ( 2900, 4400 ] 741 0.054% 100.223% ( 4400, 6600 ] 197 0.014% 100.238% ( 6600, 9900 ] 60 0.004% 100.242% ( 9900, 14000 ] 20 0.001% 100.243% ( 14000, 22000 ] 22 0.002% 100.245% ( 22000, 33000 ] 5 0.000% 100.245% ** Level 4 read latency histogram (micros): Count: 970121 Average: 21.1707 StdDev: 224.91 Min: 0 Median: 1.9318 Max: 46655 Percentiles: P50: 1.93 P75: 2.99 P99: 285.97 P99.9: 1608.15 P99.99: 2171.43 ------------------------------------------------------ [ 0, 1 ] 19307 1.990% 1.990% ( 1, 2 ] 499836 51.523% 53.513% ########## ( 2, 3 ] 210755 21.725% 75.238% #### ( 3, 4 ] 93960 9.685% 84.923% ## ( 4, 6 ] 91823 9.465% 94.388% ## ( 6, 10 ] 24248 2.499% 96.888% ( 10, 15 ] 4017 0.414% 97.302% ( 15, 22 ] 516 0.053% 97.355% ( 22, 34 ] 51 0.005% 97.360% ( 34, 51 ] 65 0.007% 97.367% ( 51, 76 ] 131 0.014% 97.381% ( 76, 110 ] 2558 0.264% 97.644% ( 110, 170 ] 8794 0.906% 98.551% ( 170, 250 ] 3791 0.391% 98.941% ( 250, 380 ] 2052 0.212% 99.153% ( 380, 580 ] 2342 0.241% 99.394% ( 580, 870 ] 2239 0.231% 99.625% ( 870, 1300 ] 2028 0.209% 99.834% ( 1300, 1900 ] 1242 0.128% 99.962% ( 1900, 2900 ] 991 0.102% 100.064% ( 2900, 4400 ] 979 0.101% 100.165% ( 4400, 6600 ] 276 0.028% 100.194% ( 6600, 9900 ] 53 0.005% 100.199% ( 9900, 14000 ] 6 0.001% 100.200% ( 14000, 22000 ] 14 0.001% 100.201% ( 22000, 33000 ] 3 0.000% 100.202% ( 33000, 50000 ] 4 0.000% 100.202% ** Level 5 read latency histogram (micros): Count: 137436 Average: 443.6512 StdDev: 864.14 Min: 73 Median: 168.5215 Max: 59384 Percentiles: P50: 168.52 P75: 378.16 P99: 4273.99 P99.9: 7944.60 P99.99: 14913.75 ------------------------------------------------------ ( 51, 76 ] 12 0.009% 0.009% ( 76, 110 ] 16221 11.803% 11.811% ## ( 110, 170 ] 53811 39.153% 50.965% ######## ( 170, 250 ] 22435 16.324% 67.289% ### ( 250, 380 ] 10750 7.822% 75.111% ## ( 380, 580 ] 11093 8.071% 83.182% ## ( 580, 870 ] 7815 5.686% 88.868% # ( 870, 1300 ] 5911 4.301% 93.169% # ( 1300, 1900 ] 3282 2.388% 95.557% ( 1900, 2900 ] 2438 1.774% 97.331% ( 2900, 4400 ] 2504 1.822% 99.153% ( 4400, 6600 ] 952 0.693% 99.846% ( 6600, 9900 ] 183 0.133% 99.979% ( 9900, 14000 ] 14 0.010% 99.989% ( 14000, 22000 ] 11 0.008% 99.997% ( 22000, 33000 ] 11 0.008% 100.005% ( 33000, 50000 ] 4 0.003% 100.008% ( 50000, 75000 ] 1 0.001% 100.009% ** DB Stats ** Uptime(secs): 22.1 total, 4.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 178.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.894 H:M:S, 31.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 229.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.704 H:M:S, 16.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 236.552 micros/op 16906 ops/sec 60.094 seconds 1015996 operations; 16.4 MB/s (257999 of 257999 found) Microseconds per read: Count: 1015996 Average: 236.5541 StdDev: 727.44 Min: 2 Median: 162.8979 Max: 150654 Percentiles: P50: 162.90 P75: 222.98 P99: 1283.20 P99.9: 11289.70 P99.99: 29270.76 ------------------------------------------------------ ( 1, 2 ] 12 0.001% 0.001% ( 2, 3 ] 64 0.006% 0.007% ( 3, 4 ] 56 0.006% 0.013% ( 4, 6 ] 83 0.008% 0.021% ( 6, 10 ] 687 0.068% 0.089% ( 10, 15 ] 6474 0.637% 0.726% ( 15, 22 ] 3946 0.388% 1.114% ( 22, 34 ] 10064 0.991% 2.105% ( 34, 51 ] 1838 0.181% 2.286% ( 51, 76 ] 248 0.024% 2.310% ( 76, 110 ] 37462 3.687% 5.997% # ( 110, 170 ] 507087 49.910% 55.908% ########## ( 170, 250 ] 292882 28.827% 84.735% ###### ( 250, 380 ] 85993 8.464% 93.199% ## ( 380, 580 ] 35351 3.479% 96.678% # ( 580, 870 ] 15990 1.574% 98.252% ( 870, 1300 ] 7908 0.778% 99.030% ( 1300, 1900 ] 3489 0.343% 99.374% ( 1900, 2900 ] 2301 0.226% 99.600% ( 2900, 4400 ] 1974 0.194% 99.795% ( 4400, 6600 ] 658 0.065% 99.859% ( 6600, 9900 ] 272 0.027% 99.886% ( 9900, 14000 ] 416 0.041% 99.927% ( 14000, 22000 ] 531 0.052% 99.979% ( 22000, 33000 ] 164 0.016% 99.995% ( 33000, 50000 ] 38 0.004% 99.999% ( 50000, 75000 ] 5 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13762276 rocksdb.bloom.filter.full.positive COUNT : 1149814 rocksdb.bloom.filter.full.true.positive COUNT : 1015568 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 428 rocksdb.memtable.miss COUNT : 1015568 rocksdb.l0.hit COUNT : 36880 rocksdb.l1.hit COUNT : 11534 rocksdb.l2andup.hit COUNT : 967154 rocksdb.compaction.key.drop.new COUNT : 219593 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4965497 rocksdb.number.keys.read COUNT : 1015996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5124392904 rocksdb.bytes.read COUNT : 1015996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1632 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 40586364 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 22797736610 rocksdb.compact.write.bytes COUNT : 22571552813 rocksdb.flush.write.bytes COUNT : 5086410071 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 28 rocksdb.number.superversion_acquires COUNT : 1014 rocksdb.number.superversion_releases COUNT : 992 rocksdb.number.superversion_cleanups COUNT : 256 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 280 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5045392384 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1964032 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27225184899 rocksdb.non.last.level.read.count COUNT : 6436804 rocksdb.block.checksum.compute.count COUNT : 6682243 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 162.219873 P95 : 482.495662 P99 : 1282.573426 P100 : 150652.000000 COUNT : 1015996 SUM : 239562304 rocksdb.db.write.micros P50 : 1.574794 P95 : 4.623459 P99 : 10.259672 P100 : 898732.000000 COUNT : 4965497 SUM : 53356170 rocksdb.compaction.times.micros P50 : 1230434.782609 P95 : 2873684.210526 P99 : 14800000.000000 P100 : 17193705.000000 COUNT : 90 SUM : 154095286 rocksdb.compaction.times.cpu_micros P50 : 844736.842105 P95 : 1830000.000000 P99 : 6830000.000000 P100 : 8233937.000000 COUNT : 90 SUM : 90485174 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 807.297297 P95 : 101250.000000 P99 : 187563.000000 P100 : 187563.000000 COUNT : 70 SUM : 1050816 rocksdb.compaction.outfile.sync.micros P50 : 49527.777778 P95 : 208000.000000 P99 : 358225.000000 P100 : 919817.000000 COUNT : 267 SUM : 18136386 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 328.000000 P95 : 4400.000000 P99 : 6160.000000 P100 : 6474.000000 COUNT : 180 SUM : 192555 rocksdb.table.open.io.micros P50 : 9033.561644 P95 : 19921.991701 P99 : 23842.500000 P100 : 113911.000000 COUNT : 1632 SUM : 15044967 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.938399 P95 : 9.992831 P99 : 169.946048 P100 : 46660.000000 COUNT : 5521250 SUM : 84114505 rocksdb.read.block.get.micros P50 : 137.936542 P95 : 370.348857 P99 : 1255.551312 P100 : 59456.000000 COUNT : 1159363 SUM : 207155592 rocksdb.write.raw.block.micros P50 : 0.543319 P95 : 1.506401 P99 : 3.565254 P100 : 56055.000000 COUNT : 6699009 SUM : 20751166 rocksdb.numfiles.in.singlecompaction P50 : 2.666667 P95 : 5.000000 P99 : 14.500000 P100 : 23.000000 COUNT : 110 SUM : 371 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.574376 P95 : 1226.702029 P99 : 2604.961298 P100 : 898587.000000 COUNT : 199607 SUM : 40603913 rocksdb.sst.read.micros P50 : 2.096311 P95 : 163.923824 P99 : 474.853310 P100 : 59384.000000 COUNT : 6436851 SUM : 273520901 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1015996 SUM : 1015996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4965497 SUM : 5124392904 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226000.000000 P95 : 962000.000000 P99 : 1152400.000000 P100 : 1153891.000000 COUNT : 70 SUM : 22685504 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 284 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0