[2024-07-13 13:26:55.181280] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 24.03.0 initialization... [2024-07-13 13:26:55.181551] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2780672 ] Set seed to 1720870015174871 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-13 13:26:55.290261] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-13 13:26:55.508684] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-13 13:26:55.508732] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2780672' to capture a snapshot of events at runtime. [2024-07-13 13:26:55.508742] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-13 13:26:55.508752] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-13 13:26:55.508759] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2780672 for offline analysis/debug. [2024-07-13 13:26:55.508852] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Jul 13 13:27:04 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/13-13:27:14 ... thread 0: (1000000,1000000) ops and (104985.2,104985.2) ops/second in (9.525152,9.525152) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.97 GB 56.6 0.4 0.0 0.4 1.2 0.9 0.0 1.4 39.3 131.1 9.61 4.02 11 0.873 383K 512 0.0 0.0 L1 8/8 1.00 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 886.51 MB 0.9 2.1 1.3 0.8 2.1 1.3 0.2 1.6 109.5 108.1 20.07 10.27 9 2.230 789K 0 0.0 0.0 L4 171/4 9.79 GB 1.0 6.2 4.0 2.2 6.1 3.9 0.0 1.5 112.6 111.1 56.57 29.42 35 1.616 2743K 1581 0.0 0.0 L5 1128/0 92.64 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1335/20 106.28 GB 0.0 8.7 5.3 3.5 9.5 6.0 3.8 11.0 103.7 112.6 86.25 43.71 55 1.568 3916K 2093 0.0 0.0 Int 0/0 0.00 KB 0.0 8.7 5.3 3.5 9.5 6.0 3.8 11.0 103.7 112.6 86.25 43.71 55 1.568 3916K 2093 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.7 5.3 3.5 8.6 5.2 0.0 0.0 112.9 111.5 79.23 41.23 45 1.761 3916K 2093 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 125.8 7.01 2.48 10 0.701 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.7 total, 9.5 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.49 GB write, 1002.20 MB/s write, 8.73 GB read, 922.60 MB/s read, 86.2 seconds Interval compaction: 9.49 GB write, 1019.56 MB/s write, 8.73 GB read, 938.58 MB/s read, 86.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 29, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 418679 Average: 14.7327 StdDev: 189.27 Min: 1 Median: 2.1297 Max: 18376 Percentiles: P50: 2.13 P75: 3.04 P99: 12.69 P99.9: 3104.39 P99.99: 4842.24 ------------------------------------------------------ [ 0, 1 ] 7360 1.758% 1.758% ( 1, 2 ] 186638 44.578% 46.336% ######### ( 2, 3 ] 118336 28.264% 74.600% ###### ( 3, 4 ] 40402 9.650% 84.250% ## ( 4, 6 ] 48434 11.568% 95.818% ## ( 6, 10 ] 11932 2.850% 98.668% # ( 10, 15 ] 2590 0.619% 99.287% ( 15, 22 ] 351 0.084% 99.370% ( 22, 34 ] 27 0.006% 99.377% ( 34, 51 ] 26 0.006% 99.383% ( 51, 76 ] 24 0.006% 99.389% ( 76, 110 ] 6 0.001% 99.390% ( 110, 170 ] 41 0.010% 99.400% ( 170, 250 ] 75 0.018% 99.418% ( 250, 380 ] 126 0.030% 99.448% ( 380, 580 ] 223 0.053% 99.501% ( 580, 870 ] 303 0.072% 99.574% ( 870, 1300 ] 453 0.108% 99.682% ( 1300, 1900 ] 414 0.099% 99.781% ( 1900, 2900 ] 445 0.106% 99.887% ( 2900, 4400 ] 406 0.097% 99.984% ( 4400, 6600 ] 130 0.031% 100.015% ( 6600, 9900 ] 17 0.004% 100.019% ( 9900, 14000 ] 2 0.000% 100.020% ( 14000, 22000 ] 3 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 28563 Average: 21.2936 StdDev: 360.38 Min: 1 Median: 2.2127 Max: 21314 Percentiles: P50: 2.21 P75: 3.12 P99: 16.09 P99.9: 3543.43 P99.99: 18191.60 ------------------------------------------------------ [ 0, 1 ] 177 0.620% 0.620% ( 1, 2 ] 12263 42.933% 43.553% ######### ( 2, 3 ] 8656 30.305% 73.858% ###### ( 3, 4 ] 2836 9.929% 83.787% ## ( 4, 6 ] 3201 11.207% 94.994% ## ( 6, 10 ] 963 3.371% 98.365% # ( 10, 15 ] 177 0.620% 98.985% ( 15, 22 ] 28 0.098% 99.083% ( 22, 34 ] 1 0.004% 99.086% ( 34, 51 ] 2 0.007% 99.093% ( 51, 76 ] 7 0.025% 99.118% ( 76, 110 ] 1 0.004% 99.121% ( 110, 170 ] 3 0.011% 99.132% ( 170, 250 ] 7 0.025% 99.156% ( 250, 380 ] 11 0.039% 99.195% ( 380, 580 ] 19 0.067% 99.261% ( 580, 870 ] 43 0.151% 99.412% ( 870, 1300 ] 54 0.189% 99.601% ( 1300, 1900 ] 48 0.168% 99.769% ( 1900, 2900 ] 28 0.098% 99.867% ( 2900, 4400 ] 22 0.077% 99.944% ( 4400, 6600 ] 5 0.018% 99.961% ( 9900, 14000 ] 5 0.018% 99.979% ( 14000, 22000 ] 6 0.021% 100.000% ** Level 2 read latency histogram (micros): Count: 249902 Average: 15.8570 StdDev: 210.28 Min: 1 Median: 2.2290 Max: 18813 Percentiles: P50: 2.23 P75: 3.30 P99: 12.76 P99.9: 2698.42 P99.99: 3987.90 ------------------------------------------------------ [ 0, 1 ] 3264 1.306% 1.306% ( 1, 2 ] 105464 42.202% 43.508% ######## ( 2, 3 ] 70835 28.345% 71.853% ###### ( 3, 4 ] 26189 10.480% 82.333% ## ( 4, 6 ] 32014 12.811% 95.144% ### ( 6, 10 ] 8629 3.453% 98.597% # ( 10, 15 ] 1823 0.729% 99.326% ( 15, 22 ] 260 0.104% 99.430% ( 22, 34 ] 24 0.010% 99.440% ( 34, 51 ] 11 0.004% 99.444% ( 51, 76 ] 16 0.006% 99.451% ( 76, 110 ] 5 0.002% 99.453% ( 110, 170 ] 7 0.003% 99.455% ( 170, 250 ] 15 0.006% 99.461% ( 250, 380 ] 41 0.016% 99.478% ( 380, 580 ] 83 0.033% 99.511% ( 580, 870 ] 167 0.067% 99.578% ( 870, 1300 ] 240 0.096% 99.674% ( 1300, 1900 ] 312 0.125% 99.799% ( 1900, 2900 ] 317 0.127% 99.926% ( 2900, 4400 ] 222 0.089% 100.014% ( 4400, 6600 ] 75 0.030% 100.044% ( 6600, 9900 ] 25 0.010% 100.054% ( 9900, 14000 ] 5 0.002% 100.056% ( 14000, 22000 ] 4 0.002% 100.058% ** Level 3 read latency histogram (micros): Count: 1018317 Average: 12.0435 StdDev: 166.82 Min: 1 Median: 2.2035 Max: 9291 Percentiles: P50: 2.20 P75: 3.12 P99: 9.79 P99.9: 1066.21 P99.99: 1732.87 ------------------------------------------------------ [ 0, 1 ] 8532 0.838% 0.838% ( 1, 2 ] 438818 43.092% 43.930% ######### ( 2, 3 ] 303778 29.831% 73.762% ###### ( 3, 4 ] 105385 10.349% 84.111% ## ( 4, 6 ] 124957 12.271% 96.382% ## ( 6, 10 ] 28163 2.766% 99.147% # ( 10, 15 ] 5664 0.556% 99.703% ( 15, 22 ] 729 0.072% 99.775% ( 22, 34 ] 67 0.007% 99.782% ( 34, 51 ] 46 0.005% 99.786% ( 51, 76 ] 74 0.007% 99.793% ( 76, 110 ] 32 0.003% 99.797% ( 110, 170 ] 20 0.002% 99.798% ( 170, 250 ] 39 0.004% 99.802% ( 250, 380 ] 87 0.009% 99.811% ( 380, 580 ] 215 0.021% 99.832% ( 580, 870 ] 397 0.039% 99.871% ( 870, 1300 ] 648 0.064% 99.935% ( 1300, 1900 ] 782 0.077% 100.011% ( 1900, 2900 ] 848 0.083% 100.095% ( 2900, 4400 ] 841 0.083% 100.177% ( 4400, 6600 ] 272 0.027% 100.204% ( 6600, 9900 ] 51 0.005% 100.209% ** Level 4 read latency histogram (micros): Count: 572508 Average: 24.5189 StdDev: 247.85 Min: 0 Median: 2.1981 Max: 12850 Percentiles: P50: 2.20 P75: 3.15 P99: 264.15 P99.9: 3004.58 P99.99: 3880.87 ------------------------------------------------------ [ 0, 1 ] 5460 0.954% 0.954% ( 1, 2 ] 247598 43.248% 44.202% ######### ( 2, 3 ] 167551 29.266% 73.468% ###### ( 3, 4 ] 59528 10.398% 83.866% ## ( 4, 6 ] 65717 11.479% 95.344% ## ( 6, 10 ] 16788 2.932% 98.277% # ( 10, 15 ] 3302 0.577% 98.853% ( 15, 22 ] 445 0.078% 98.931% ( 22, 34 ] 45 0.008% 98.939% ( 34, 51 ] 41 0.007% 98.946% ( 51, 76 ] 60 0.010% 98.957% ( 76, 110 ] 24 0.004% 98.961% ( 110, 170 ] 52 0.009% 98.970% ( 170, 250 ] 152 0.027% 98.997% ( 250, 380 ] 183 0.032% 99.028% ( 380, 580 ] 479 0.084% 99.112% ( 580, 870 ] 842 0.147% 99.259% ( 870, 1300 ] 1186 0.207% 99.466% ( 1300, 1900 ] 1226 0.214% 99.681% ( 1900, 2900 ] 1195 0.209% 99.889% ( 2900, 4400 ] 882 0.154% 100.043% ( 4400, 6600 ] 355 0.062% 100.105% ( 6600, 9900 ] 46 0.008% 100.113% ( 9900, 14000 ] 4 0.001% 100.114% ** Level 5 read latency histogram (micros): Count: 13659 Average: 2015.2946 StdDev: 1705.06 Min: 84 Median: 1416.4113 Max: 13883 Percentiles: P50: 1416.41 P75: 2919.37 P99: 8235.20 P99.9: 9999.86 P99.99: 13599.99 ------------------------------------------------------ ( 76, 110 ] 25 0.183% 0.183% ( 110, 170 ] 175 1.281% 1.464% ( 170, 250 ] 362 2.650% 4.115% # ( 250, 380 ] 615 4.503% 8.617% # ( 380, 580 ] 1110 8.127% 16.744% ## ( 580, 870 ] 1805 13.215% 29.958% ### ( 870, 1300 ] 2345 17.168% 47.126% ### ( 1300, 1900 ] 2023 14.811% 61.937% ### ( 1900, 2900 ] 1759 12.878% 74.815% ### ( 2900, 4400 ] 1955 14.313% 89.128% ### ( 4400, 6600 ] 1228 8.990% 98.118% ## ( 6600, 9900 ] 243 1.779% 99.898% ( 9900, 14000 ] 14 0.102% 100.000% ** DB Stats ** Uptime(secs): 9.7 total, 9.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 101.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.637 H:M:S, 58.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 103.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.637 H:M:S, 59.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/13-13:27:17 ... thread 0: (1000000,2000000) ops and (295085.1,154870.6) ops/second in (3.388853,12.914005) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 2.95 GB 163.6 1.4 0.0 1.4 3.3 1.8 0.0 1.8 84.5 194.6 17.15 10.88 31 0.553 1471K 1671 0.0 0.0 L1 8/8 1.00 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 886.51 MB 0.9 2.1 1.3 0.8 2.1 1.3 0.2 1.6 109.5 108.1 20.07 10.27 9 2.230 789K 0 0.0 0.0 L4 167/0 9.42 GB 1.0 6.2 4.0 2.2 6.1 3.9 0.0 1.5 112.6 111.1 56.57 29.42 35 1.616 2743K 1581 0.0 0.0 L5 1132/0 93.01 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1339/16 107.26 GB 0.0 9.8 5.3 4.5 11.5 7.0 4.2 6.2 106.8 125.7 93.79 50.57 75 1.251 5003K 3252 0.0 0.0 Int 0/0 0.00 KB 0.0 9.8 5.3 4.5 11.5 7.0 4.2 6.2 106.8 125.7 93.79 50.57 75 1.251 5003K 3252 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.8 5.3 4.5 9.7 5.2 0.0 0.0 119.8 118.5 83.56 45.38 49 1.705 5003K 3252 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 184.7 10.23 5.19 26 0.394 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.1 total, 12.9 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.51 GB write, 901.40 MB/s write, 9.78 GB read, 765.46 MB/s read, 93.8 seconds Interval compaction: 11.51 GB write, 912.92 MB/s write, 9.78 GB read, 775.24 MB/s read, 93.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 29, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 663967 Average: 12.8970 StdDev: 153.82 Min: 1 Median: 1.8408 Max: 18376 Percentiles: P50: 1.84 P75: 2.75 P99: 182.91 P99.9: 2248.09 P99.99: 4006.12 ------------------------------------------------------ [ 0, 1 ] 46783 7.046% 7.046% # ( 1, 2 ] 339221 51.090% 58.136% ########## ( 2, 3 ] 150053 22.599% 80.735% ##### ( 3, 4 ] 47762 7.193% 87.929% # ( 4, 6 ] 53720 8.091% 96.020% ## ( 6, 10 ] 13005 1.959% 97.978% ( 10, 15 ] 2915 0.439% 98.417% ( 15, 22 ] 417 0.063% 98.480% ( 22, 34 ] 31 0.005% 98.485% ( 34, 51 ] 27 0.004% 98.489% ( 51, 76 ] 25 0.004% 98.493% ( 76, 110 ] 280 0.042% 98.535% ( 110, 170 ] 2690 0.405% 98.940% ( 170, 250 ] 2469 0.372% 99.312% ( 250, 380 ] 1205 0.181% 99.493% ( 380, 580 ] 1026 0.155% 99.648% ( 580, 870 ] 579 0.087% 99.735% ( 870, 1300 ] 514 0.077% 99.812% ( 1300, 1900 ] 423 0.064% 99.876% ( 1900, 2900 ] 454 0.068% 99.945% ( 2900, 4400 ] 409 0.062% 100.006% ( 4400, 6600 ] 130 0.020% 100.026% ( 6600, 9900 ] 17 0.003% 100.028% ( 9900, 14000 ] 2 0.000% 100.029% ( 14000, 22000 ] 3 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 134102 Average: 8.0639 StdDev: 167.85 Min: 1 Median: 1.9053 Max: 21314 Percentiles: P50: 1.91 P75: 2.76 P99: 13.90 P99.9: 1151.25 P99.99: 4659.51 ------------------------------------------------------ [ 0, 1 ] 6073 4.529% 4.529% # ( 1, 2 ] 67356 50.227% 54.756% ########## ( 2, 3 ] 35729 26.643% 81.399% ##### ( 3, 4 ] 10272 7.660% 89.059% ## ( 4, 6 ] 9391 7.003% 96.062% # ( 6, 10 ] 3445 2.569% 98.631% # ( 10, 15 ] 636 0.474% 99.105% ( 15, 22 ] 141 0.105% 99.210% ( 22, 34 ] 7 0.005% 99.216% ( 34, 51 ] 5 0.004% 99.219% ( 51, 76 ] 7 0.005% 99.224% ( 76, 110 ] 38 0.028% 99.253% ( 110, 170 ] 312 0.233% 99.485% ( 170, 250 ] 249 0.186% 99.671% ( 250, 380 ] 105 0.078% 99.749% ( 380, 580 ] 94 0.070% 99.820% ( 580, 870 ] 69 0.051% 99.871% ( 870, 1300 ] 61 0.045% 99.916% ( 1300, 1900 ] 49 0.037% 99.953% ( 1900, 2900 ] 28 0.021% 99.974% ( 2900, 4400 ] 22 0.016% 99.990% ( 4400, 6600 ] 5 0.004% 99.994% ( 9900, 14000 ] 5 0.004% 99.998% ( 14000, 22000 ] 6 0.004% 100.002% ** Level 2 read latency histogram (micros): Count: 249979 Average: 15.9192 StdDev: 210.28 Min: 1 Median: 2.2296 Max: 18813 Percentiles: P50: 2.23 P75: 3.30 P99: 12.97 P99.9: 2698.17 P99.99: 3987.85 ------------------------------------------------------ [ 0, 1 ] 3264 1.306% 1.306% ( 1, 2 ] 105464 42.189% 43.495% ######## ( 2, 3 ] 70835 28.336% 71.831% ###### ( 3, 4 ] 26189 10.476% 82.308% ## ( 4, 6 ] 32014 12.807% 95.114% ### ( 6, 10 ] 8629 3.452% 98.566% # ( 10, 15 ] 1823 0.729% 99.296% ( 15, 22 ] 260 0.104% 99.400% ( 22, 34 ] 24 0.010% 99.409% ( 34, 51 ] 11 0.004% 99.414% ( 51, 76 ] 16 0.006% 99.420% ( 76, 110 ] 6 0.002% 99.422% ( 110, 170 ] 35 0.014% 99.436% ( 170, 250 ] 48 0.019% 99.456% ( 250, 380 ] 49 0.020% 99.475% ( 380, 580 ] 89 0.036% 99.511% ( 580, 870 ] 168 0.067% 99.578% ( 870, 1300 ] 240 0.096% 99.674% ( 1300, 1900 ] 312 0.125% 99.799% ( 1900, 2900 ] 317 0.127% 99.926% ( 2900, 4400 ] 222 0.089% 100.014% ( 4400, 6600 ] 75 0.030% 100.044% ( 6600, 9900 ] 25 0.010% 100.054% ( 9900, 14000 ] 5 0.002% 100.056% ( 14000, 22000 ] 4 0.002% 100.058% ** Level 3 read latency histogram (micros): Count: 1018775 Average: 12.1398 StdDev: 166.87 Min: 1 Median: 2.2042 Max: 9291 Percentiles: P50: 2.20 P75: 3.12 P99: 9.85 P99.9: 1066.63 P99.99: 1732.83 ------------------------------------------------------ [ 0, 1 ] 8532 0.837% 0.837% ( 1, 2 ] 438818 43.073% 43.911% ######### ( 2, 3 ] 303778 29.818% 73.729% ###### ( 3, 4 ] 105385 10.344% 84.073% ## ( 4, 6 ] 124957 12.265% 96.338% ## ( 6, 10 ] 28163 2.764% 99.103% # ( 10, 15 ] 5664 0.556% 99.659% ( 15, 22 ] 729 0.072% 99.730% ( 22, 34 ] 67 0.007% 99.737% ( 34, 51 ] 46 0.005% 99.741% ( 51, 76 ] 74 0.007% 99.749% ( 76, 110 ] 56 0.005% 99.754% ( 110, 170 ] 197 0.019% 99.773% ( 170, 250 ] 173 0.017% 99.790% ( 250, 380 ] 160 0.016% 99.806% ( 380, 580 ] 254 0.025% 99.831% ( 580, 870 ] 406 0.040% 99.871% ( 870, 1300 ] 650 0.064% 99.935% ( 1300, 1900 ] 782 0.077% 100.011% ( 1900, 2900 ] 848 0.083% 100.095% ( 2900, 4400 ] 841 0.083% 100.177% ( 4400, 6600 ] 272 0.027% 100.204% ( 6600, 9900 ] 51 0.005% 100.209% ** Level 4 read latency histogram (micros): Count: 578809 Average: 26.5177 StdDev: 247.91 Min: 0 Median: 2.2163 Max: 12850 Percentiles: P50: 2.22 P75: 3.22 P99: 486.68 P99.9: 2993.76 P99.99: 3878.68 ------------------------------------------------------ [ 0, 1 ] 5460 0.943% 0.943% ( 1, 2 ] 247644 42.785% 43.728% ######### ( 2, 3 ] 167849 28.999% 72.727% ###### ( 3, 4 ] 59700 10.314% 83.042% ## ( 4, 6 ] 65961 11.396% 94.438% ## ( 6, 10 ] 16821 2.906% 97.344% # ( 10, 15 ] 3312 0.572% 97.916% ( 15, 22 ] 447 0.077% 97.993% ( 22, 34 ] 45 0.008% 98.001% ( 34, 51 ] 41 0.007% 98.008% ( 51, 76 ] 60 0.010% 98.019% ( 76, 110 ] 275 0.048% 98.066% ( 110, 170 ] 2180 0.377% 98.443% ( 170, 250 ] 1804 0.312% 98.754% ( 250, 380 ] 896 0.155% 98.909% ( 380, 580 ] 986 0.170% 99.079% ( 580, 870 ] 1044 0.180% 99.260% ( 870, 1300 ] 1218 0.210% 99.470% ( 1300, 1900 ] 1235 0.213% 99.684% ( 1900, 2900 ] 1197 0.207% 99.890% ( 2900, 4400 ] 883 0.153% 100.043% ( 4400, 6600 ] 355 0.061% 100.104% ( 6600, 9900 ] 46 0.008% 100.112% ( 9900, 14000 ] 4 0.001% 100.113% ** Level 5 read latency histogram (micros): Count: 51961 Average: 704.4151 StdDev: 1182.87 Min: 84 Median: 230.6234 Max: 13883 Percentiles: P50: 230.62 P75: 580.07 P99: 6129.53 P99.9: 9384.48 P99.99: 12478.28 ------------------------------------------------------ ( 76, 110 ] 1864 3.587% 3.587% # ( 110, 170 ] 15049 28.962% 32.549% ###### ( 170, 250 ] 11967 23.031% 55.580% ##### ( 250, 380 ] 5487 10.560% 66.140% ## ( 380, 580 ] 4604 8.860% 75.000% ## ( 580, 870 ] 3090 5.947% 80.947% # ( 870, 1300 ] 2590 4.985% 85.932% # ( 1300, 1900 ] 2072 3.988% 89.919% # ( 1900, 2900 ] 1790 3.445% 93.364% # ( 2900, 4400 ] 1964 3.780% 97.144% # ( 4400, 6600 ] 1228 2.363% 99.507% ( 6600, 9900 ] 243 0.468% 99.975% ( 9900, 14000 ] 14 0.027% 100.002% ** DB Stats ** Uptime(secs): 13.1 total, 3.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 150.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.637 H:M:S, 43.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 290.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-13:27:21 ... thread 0: (1000000,3000000) ops and (268147.6,180252.8) ops/second in (3.729290,16.643295) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.87 GB 258.0 2.4 0.0 2.4 5.2 2.8 0.0 1.9 102.1 219.7 24.08 17.25 50 0.482 2494K 2609 0.0 0.0 L1 8/8 1.00 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 886.51 MB 0.9 2.1 1.3 0.8 2.1 1.3 0.2 1.6 109.5 108.1 20.07 10.27 9 2.230 789K 0 0.0 0.0 L4 167/0 9.42 GB 1.0 6.2 4.0 2.2 6.1 3.9 0.0 1.5 112.6 111.1 56.57 29.42 35 1.616 2743K 1581 0.0 0.0 L5 1132/0 93.01 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1342/16 108.18 GB 0.0 10.8 5.3 5.5 13.4 7.9 4.2 4.8 109.4 136.5 100.71 56.95 94 1.071 6027K 4190 0.0 0.0 Int 0/0 0.00 KB 0.0 10.8 5.3 5.5 13.4 7.9 4.2 4.8 109.4 136.5 100.71 56.95 94 1.071 6027K 4190 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.8 5.3 5.5 10.7 5.2 0.0 0.0 126.0 124.7 87.46 49.20 53 1.650 6027K 4190 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 214.0 13.25 7.75 41 0.323 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.8 total, 16.6 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.42 GB write, 817.55 MB/s write, 10.76 GB read, 655.61 MB/s read, 100.7 seconds Interval compaction: 13.42 GB write, 825.66 MB/s write, 10.76 GB read, 662.11 MB/s read, 100.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 29, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 939471 Average: 12.5345 StdDev: 132.97 Min: 1 Median: 1.7386 Max: 18376 Percentiles: P50: 1.74 P75: 2.56 P99: 224.38 P99.9: 1593.73 P99.99: 3495.83 ------------------------------------------------------ [ 0, 1 ] 96161 10.236% 10.236% ## ( 1, 2 ] 505801 53.839% 64.075% ########### ( 2, 3 ] 183314 19.512% 83.587% #### ( 3, 4 ] 55617 5.920% 89.507% # ( 4, 6 ] 59720 6.357% 95.864% # ( 6, 10 ] 14053 1.496% 97.360% ( 10, 15 ] 3209 0.342% 97.701% ( 15, 22 ] 469 0.050% 97.751% ( 22, 34 ] 40 0.004% 97.755% ( 34, 51 ] 31 0.003% 97.759% ( 51, 76 ] 28 0.003% 97.762% ( 76, 110 ] 626 0.067% 97.828% ( 110, 170 ] 6799 0.724% 98.552% ( 170, 250 ] 6192 0.659% 99.211% ( 250, 380 ] 2664 0.284% 99.495% ( 380, 580 ] 2077 0.221% 99.716% ( 580, 870 ] 947 0.101% 99.817% ( 870, 1300 ] 575 0.061% 99.878% ( 1300, 1900 ] 428 0.046% 99.923% ( 1900, 2900 ] 463 0.049% 99.973% ( 2900, 4400 ] 413 0.044% 100.017% ( 4400, 6600 ] 130 0.014% 100.030% ( 6600, 9900 ] 17 0.002% 100.032% ( 9900, 14000 ] 2 0.000% 100.032% ( 14000, 22000 ] 3 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 223624 Average: 6.9069 StdDev: 130.98 Min: 1 Median: 2.0223 Max: 21314 Percentiles: P50: 2.02 P75: 2.95 P99: 15.67 P99.9: 721.34 P99.99: 3789.41 ------------------------------------------------------ [ 0, 1 ] 8528 3.814% 3.814% # ( 1, 2 ] 101937 45.584% 49.398% ######### ( 2, 3 ] 60489 27.049% 76.447% ##### ( 3, 4 ] 21290 9.520% 85.968% ## ( 4, 6 ] 21112 9.441% 95.408% ## ( 6, 10 ] 6635 2.967% 98.375% # ( 10, 15 ] 1357 0.607% 98.982% ( 15, 22 ] 413 0.185% 99.167% ( 22, 34 ] 33 0.015% 99.182% ( 34, 51 ] 9 0.004% 99.186% ( 51, 76 ] 7 0.003% 99.189% ( 76, 110 ] 69 0.031% 99.220% ( 110, 170 ] 647 0.289% 99.509% ( 170, 250 ] 478 0.214% 99.723% ( 250, 380 ] 203 0.091% 99.814% ( 380, 580 ] 150 0.067% 99.881% ( 580, 870 ] 89 0.040% 99.920% ( 870, 1300 ] 65 0.029% 99.949% ( 1300, 1900 ] 49 0.022% 99.971% ( 1900, 2900 ] 28 0.013% 99.984% ( 2900, 4400 ] 23 0.010% 99.994% ( 4400, 6600 ] 5 0.002% 99.996% ( 9900, 14000 ] 5 0.002% 99.999% ( 14000, 22000 ] 6 0.003% 100.001% ** Level 2 read latency histogram (micros): Count: 250059 Average: 15.9854 StdDev: 210.29 Min: 1 Median: 2.2301 Max: 18813 Percentiles: P50: 2.23 P75: 3.30 P99: 13.19 P99.9: 2697.92 P99.99: 3987.80 ------------------------------------------------------ [ 0, 1 ] 3264 1.305% 1.305% ( 1, 2 ] 105464 42.176% 43.481% ######## ( 2, 3 ] 70835 28.327% 71.808% ###### ( 3, 4 ] 26189 10.473% 82.281% ## ( 4, 6 ] 32014 12.803% 95.084% ### ( 6, 10 ] 8629 3.451% 98.535% # ( 10, 15 ] 1823 0.729% 99.264% ( 15, 22 ] 260 0.104% 99.368% ( 22, 34 ] 24 0.010% 99.377% ( 34, 51 ] 11 0.004% 99.382% ( 51, 76 ] 16 0.006% 99.388% ( 76, 110 ] 8 0.003% 99.391% ( 110, 170 ] 68 0.027% 99.419% ( 170, 250 ] 70 0.028% 99.447% ( 250, 380 ] 63 0.025% 99.472% ( 380, 580 ] 98 0.039% 99.511% ( 580, 870 ] 168 0.067% 99.578% ( 870, 1300 ] 240 0.096% 99.674% ( 1300, 1900 ] 312 0.125% 99.799% ( 1900, 2900 ] 317 0.127% 99.926% ( 2900, 4400 ] 222 0.089% 100.014% ( 4400, 6600 ] 75 0.030% 100.044% ( 6600, 9900 ] 25 0.010% 100.054% ( 9900, 14000 ] 5 0.002% 100.056% ( 14000, 22000 ] 4 0.002% 100.058% ** Level 3 read latency histogram (micros): Count: 1019341 Average: 12.2577 StdDev: 166.93 Min: 1 Median: 2.2052 Max: 9291 Percentiles: P50: 2.21 P75: 3.13 P99: 9.93 P99.9: 1066.97 P99.99: 1732.79 ------------------------------------------------------ [ 0, 1 ] 8532 0.837% 0.837% ( 1, 2 ] 438818 43.049% 43.886% ######### ( 2, 3 ] 303778 29.801% 73.688% ###### ( 3, 4 ] 105385 10.339% 84.026% ## ( 4, 6 ] 124957 12.259% 96.285% ## ( 6, 10 ] 28163 2.763% 99.048% # ( 10, 15 ] 5664 0.556% 99.603% ( 15, 22 ] 729 0.072% 99.675% ( 22, 34 ] 67 0.007% 99.681% ( 34, 51 ] 46 0.005% 99.686% ( 51, 76 ] 74 0.007% 99.693% ( 76, 110 ] 85 0.008% 99.701% ( 110, 170 ] 446 0.044% 99.745% ( 170, 250 ] 333 0.033% 99.778% ( 250, 380 ] 214 0.021% 99.799% ( 380, 580 ] 306 0.030% 99.829% ( 580, 870 ] 426 0.042% 99.871% ( 870, 1300 ] 652 0.064% 99.935% ( 1300, 1900 ] 782 0.077% 100.011% ( 1900, 2900 ] 848 0.083% 100.095% ( 2900, 4400 ] 841 0.083% 100.177% ( 4400, 6600 ] 272 0.027% 100.204% ( 6600, 9900 ] 51 0.005% 100.209% ** Level 4 read latency histogram (micros): Count: 585920 Average: 28.7650 StdDev: 247.85 Min: 0 Median: 2.2371 Max: 12850 Percentiles: P50: 2.24 P75: 3.31 P99: 542.23 P99.9: 2983.28 P99.99: 3878.07 ------------------------------------------------------ [ 0, 1 ] 5460 0.932% 0.932% ( 1, 2 ] 247666 42.270% 43.201% ######## ( 2, 3 ] 167986 28.670% 71.872% ###### ( 3, 4 ] 59789 10.204% 82.076% ## ( 4, 6 ] 66065 11.275% 93.352% ## ( 6, 10 ] 16844 2.875% 96.226% # ( 10, 15 ] 3319 0.566% 96.793% ( 15, 22 ] 448 0.076% 96.869% ( 22, 34 ] 45 0.008% 96.877% ( 34, 51 ] 41 0.007% 96.884% ( 51, 76 ] 60 0.010% 96.894% ( 76, 110 ] 620 0.106% 97.000% ( 110, 170 ] 4989 0.851% 97.852% ( 170, 250 ] 3862 0.659% 98.511% ( 250, 380 ] 1642 0.280% 98.791% ( 380, 580 ] 1510 0.258% 99.049% ( 580, 870 ] 1251 0.214% 99.262% ( 870, 1300 ] 1247 0.213% 99.475% ( 1300, 1900 ] 1241 0.212% 99.687% ( 1900, 2900 ] 1200 0.205% 99.892% ( 2900, 4400 ] 884 0.151% 100.042% ( 4400, 6600 ] 355 0.061% 100.103% ( 6600, 9900 ] 46 0.008% 100.111% ( 9900, 14000 ] 4 0.001% 100.112% ** Level 5 read latency histogram (micros): Count: 95271 Average: 485.6953 StdDev: 911.15 Min: 80 Median: 203.6318 Max: 13883 Percentiles: P50: 203.63 P75: 364.44 P99: 5353.61 P99.9: 8796.32 P99.99: 11209.92 ------------------------------------------------------ ( 76, 110 ] 4107 4.311% 4.311% # ( 110, 170 ] 32982 34.619% 38.930% ####### ( 170, 250 ] 25087 26.332% 65.262% ##### ( 250, 380 ] 10539 11.062% 76.324% ## ( 380, 580 ] 8207 8.614% 84.939% ## ( 580, 870 ] 4271 4.483% 89.422% # ( 870, 1300 ] 2729 2.864% 92.286% # ( 1300, 1900 ] 2089 2.193% 94.479% ( 1900, 2900 ] 1804 1.894% 96.372% ( 2900, 4400 ] 1971 2.069% 98.441% ( 4400, 6600 ] 1228 1.289% 99.730% ( 6600, 9900 ] 243 0.255% 99.985% ( 9900, 14000 ] 14 0.015% 100.000% ** DB Stats ** Uptime(secs): 16.8 total, 3.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 175.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.912 H:M:S, 35.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 263.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.275 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-13:27:46 ... thread 0: (1000000,4000000) ops and (40194.6,96333.9) ops/second in (24.878933,41.522228) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.81 GB 63.0 3.4 0.0 3.4 7.2 3.8 0.0 1.9 110.9 235.7 31.26 23.84 71 0.440 3518K 3584 0.0 0.0 L1 24/24 2.10 GB 0.0 2.1 1.1 1.0 2.1 1.1 0.0 1.9 118.6 117.9 18.24 10.99 1 18.236 2196K 13K 0.0 0.0 L3 17/0 886.51 MB 0.9 2.1 1.3 0.8 2.1 1.3 0.2 1.6 109.5 108.1 20.07 10.27 9 2.230 789K 0 0.0 0.0 L4 167/0 9.42 GB 1.0 6.2 4.0 2.2 6.1 3.9 0.0 1.5 112.6 111.1 56.57 29.42 35 1.616 2743K 1581 0.0 0.0 L5 1132/0 93.01 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1359/39 109.21 GB 0.0 13.9 6.4 7.5 17.5 10.1 4.2 4.6 112.5 142.5 126.13 74.52 116 1.087 9247K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 6.4 7.5 17.5 10.1 4.2 4.6 112.5 142.5 126.13 74.52 116 1.087 9247K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 6.4 7.5 13.7 6.3 0.0 0.0 129.5 128.3 109.60 64.02 58 1.890 9247K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 236.2 16.53 10.51 58 0.285 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.7 total, 41.5 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.55 GB write, 431.06 MB/s write, 13.86 GB read, 340.42 MB/s read, 126.1 seconds Interval compaction: 17.55 GB write, 432.78 MB/s write, 13.86 GB read, 341.77 MB/s read, 126.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 29, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1468501 Average: 23.5345 StdDev: 117.94 Min: 0 Median: 1.8506 Max: 18376 Percentiles: P50: 1.85 P75: 3.15 P99: 246.46 P99.9: 947.21 P99.99: 2664.53 ------------------------------------------------------ [ 0, 1 ] 158678 10.805% 10.805% ## ( 1, 2 ] 676669 46.079% 56.884% ######### ( 2, 3 ] 248073 16.893% 73.777% ### ( 3, 4 ] 122132 8.317% 82.094% ## ( 4, 6 ] 88204 6.006% 88.100% # ( 6, 10 ] 17620 1.200% 89.300% ( 10, 15 ] 4317 0.294% 89.594% ( 15, 22 ] 570 0.039% 89.633% ( 22, 34 ] 53 0.004% 89.637% ( 34, 51 ] 36 0.002% 89.639% ( 51, 76 ] 37 0.003% 89.642% ( 76, 110 ] 8155 0.555% 90.197% ( 110, 170 ] 87964 5.990% 96.187% # ( 170, 250 ] 43220 2.943% 99.130% # ( 250, 380 ] 5910 0.402% 99.533% ( 380, 580 ] 3848 0.262% 99.795% ( 580, 870 ] 1436 0.098% 99.892% ( 870, 1300 ] 621 0.042% 99.935% ( 1300, 1900 ] 436 0.030% 99.964% ( 1900, 2900 ] 492 0.034% 99.998% ( 2900, 4400 ] 430 0.029% 100.027% ( 4400, 6600 ] 130 0.009% 100.036% ( 6600, 9900 ] 17 0.001% 100.037% ( 9900, 14000 ] 2 0.000% 100.037% ( 14000, 22000 ] 3 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 337240 Average: 11.4270 StdDev: 112.20 Min: 1 Median: 2.4672 Max: 21314 Percentiles: P50: 2.47 P75: 3.96 P99: 191.96 P99.9: 592.95 P99.99: 3048.43 ------------------------------------------------------ [ 0, 1 ] 11547 3.424% 3.424% # ( 1, 2 ] 121379 35.992% 39.416% ####### ( 2, 3 ] 76400 22.654% 62.070% ##### ( 3, 4 ] 45457 13.479% 75.549% ### ( 4, 6 ] 55624 16.494% 92.043% ### ( 6, 10 ] 9556 2.834% 94.877% # ( 10, 15 ] 2586 0.767% 95.644% ( 15, 22 ] 1154 0.342% 95.986% ( 22, 34 ] 79 0.023% 96.009% ( 34, 51 ] 15 0.004% 96.014% ( 51, 76 ] 8 0.002% 96.016% ( 76, 110 ] 997 0.296% 96.312% ( 110, 170 ] 8199 2.431% 98.743% ( 170, 250 ] 3161 0.937% 99.680% ( 250, 380 ] 429 0.127% 99.808% ( 380, 580 ] 307 0.091% 99.899% ( 580, 870 ] 129 0.038% 99.937% ( 870, 1300 ] 88 0.026% 99.963% ( 1300, 1900 ] 58 0.017% 99.980% ( 1900, 2900 ] 32 0.009% 99.990% ( 2900, 4400 ] 23 0.007% 99.996% ( 4400, 6600 ] 6 0.002% 99.998% ( 9900, 14000 ] 5 0.001% 100.000% ( 14000, 22000 ] 6 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 250794 Average: 16.4133 StdDev: 210.18 Min: 1 Median: 2.2353 Max: 18813 Percentiles: P50: 2.24 P75: 3.33 P99: 16.83 P99.9: 2696.25 P99.99: 3987.30 ------------------------------------------------------ [ 0, 1 ] 3264 1.301% 1.301% ( 1, 2 ] 105464 42.052% 43.354% ######## ( 2, 3 ] 70835 28.244% 71.598% ###### ( 3, 4 ] 26189 10.442% 82.040% ## ( 4, 6 ] 32014 12.765% 94.805% ### ( 6, 10 ] 8629 3.441% 98.246% # ( 10, 15 ] 1823 0.727% 98.973% ( 15, 22 ] 260 0.104% 99.077% ( 22, 34 ] 24 0.010% 99.086% ( 34, 51 ] 11 0.004% 99.090% ( 51, 76 ] 16 0.006% 99.097% ( 76, 110 ] 53 0.021% 99.118% ( 110, 170 ] 552 0.220% 99.338% ( 170, 250 ] 249 0.099% 99.437% ( 250, 380 ] 78 0.031% 99.468% ( 380, 580 ] 108 0.043% 99.512% ( 580, 870 ] 169 0.067% 99.579% ( 870, 1300 ] 240 0.096% 99.675% ( 1300, 1900 ] 312 0.124% 99.799% ( 1900, 2900 ] 318 0.127% 99.926% ( 2900, 4400 ] 222 0.089% 100.014% ( 4400, 6600 ] 75 0.030% 100.044% ( 6600, 9900 ] 25 0.010% 100.054% ( 9900, 14000 ] 5 0.002% 100.056% ( 14000, 22000 ] 4 0.002% 100.058% ** Level 3 read latency histogram (micros): Count: 1024114 Average: 12.9590 StdDev: 166.93 Min: 1 Median: 2.2130 Max: 9291 Percentiles: P50: 2.21 P75: 3.16 P99: 13.74 P99.9: 1066.22 P99.99: 1732.85 ------------------------------------------------------ [ 0, 1 ] 8532 0.833% 0.833% ( 1, 2 ] 438818 42.849% 43.682% ######### ( 2, 3 ] 303778 29.663% 73.344% ###### ( 3, 4 ] 105385 10.290% 83.635% ## ( 4, 6 ] 124957 12.201% 95.836% ## ( 6, 10 ] 28163 2.750% 98.586% # ( 10, 15 ] 5664 0.553% 99.139% ( 15, 22 ] 729 0.071% 99.210% ( 22, 34 ] 67 0.007% 99.217% ( 34, 51 ] 46 0.004% 99.221% ( 51, 76 ] 74 0.007% 99.229% ( 76, 110 ] 456 0.045% 99.273% ( 110, 170 ] 3485 0.340% 99.613% ( 170, 250 ] 1490 0.145% 99.759% ( 250, 380 ] 320 0.031% 99.790% ( 380, 580 ] 375 0.037% 99.827% ( 580, 870 ] 452 0.044% 99.871% ( 870, 1300 ] 655 0.064% 99.935% ( 1300, 1900 ] 784 0.077% 100.011% ( 1900, 2900 ] 848 0.083% 100.094% ( 2900, 4400 ] 841 0.082% 100.176% ( 4400, 6600 ] 272 0.027% 100.203% ( 6600, 9900 ] 51 0.005% 100.208% ** Level 4 read latency histogram (micros): Count: 650355 Average: 41.8490 StdDev: 239.65 Min: 0 Median: 2.4289 Max: 12850 Percentiles: P50: 2.43 P75: 4.21 P99: 530.14 P99.9: 2888.92 P99.99: 3868.34 ------------------------------------------------------ [ 0, 1 ] 5460 0.840% 0.840% ( 1, 2 ] 247666 38.082% 38.921% ######## ( 2, 3 ] 167990 25.831% 64.752% ##### ( 3, 4 ] 59793 9.194% 73.946% ## ( 4, 6 ] 66068 10.159% 84.104% ## ( 6, 10 ] 16846 2.590% 86.695% # ( 10, 15 ] 3319 0.510% 87.205% ( 15, 22 ] 448 0.069% 87.274% ( 22, 34 ] 45 0.007% 87.281% ( 34, 51 ] 41 0.006% 87.287% ( 51, 76 ] 60 0.009% 87.296% ( 76, 110 ] 6126 0.942% 88.238% ( 110, 170 ] 46090 7.087% 95.325% # ( 170, 250 ] 18994 2.921% 98.246% # ( 250, 380 ] 3067 0.472% 98.717% ( 380, 580 ] 2449 0.377% 99.094% ( 580, 870 ] 1508 0.232% 99.326% ( 870, 1300 ] 1293 0.199% 99.525% ( 1300, 1900 ] 1250 0.192% 99.717% ( 1900, 2900 ] 1205 0.185% 99.902% ( 2900, 4400 ] 886 0.136% 100.038% ( 4400, 6600 ] 355 0.055% 100.093% ( 6600, 9900 ] 46 0.007% 100.100% ( 9900, 14000 ] 4 0.001% 100.101% ** Level 5 read latency histogram (micros): Count: 488559 Average: 224.1276 StdDev: 427.41 Min: 78 Median: 153.7822 Max: 13883 Percentiles: P50: 153.78 P75: 200.66 P99: 2129.19 P99.9: 6179.78 P99.99: 9385.91 ------------------------------------------------------ ( 76, 110 ] 36762 7.525% 7.525% ## ( 110, 170 ] 284387 58.209% 65.734% ############ ( 170, 250 ] 118117 24.177% 89.911% ##### ( 250, 380 ] 19608 4.013% 93.924% # ( 380, 580 ] 13511 2.765% 96.689% # ( 580, 870 ] 5769 1.181% 97.870% ( 870, 1300 ] 2964 0.607% 98.477% ( 1300, 1900 ] 2134 0.437% 98.914% ( 1900, 2900 ] 1843 0.377% 99.291% ( 2900, 4400 ] 1983 0.406% 99.697% ( 4400, 6600 ] 1228 0.251% 99.948% ( 6600, 9900 ] 243 0.050% 99.998% ( 9900, 14000 ] 14 0.003% 100.001% ** DB Stats ** Uptime(secs): 41.7 total, 24.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 94.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.709 H:M:S, 64.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 39.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:20.797 H:M:S, 83.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 249.144 micros/op 16030 ops/sec 60.198 seconds 964996 operations; 15.5 MB/s (243999 of 243999 found) Microseconds per read: Count: 964996 Average: 249.1485 StdDev: 815.87 Min: 2 Median: 193.8390 Max: 89508 Percentiles: P50: 193.84 P75: 237.65 P99: 865.34 P99.9: 15315.60 P99.99: 32180.86 ------------------------------------------------------ ( 1, 2 ] 13 0.001% 0.001% ( 2, 3 ] 54 0.006% 0.007% ( 3, 4 ] 53 0.005% 0.012% ( 4, 6 ] 87 0.009% 0.021% ( 6, 10 ] 501 0.052% 0.073% ( 10, 15 ] 4863 0.504% 0.577% ( 15, 22 ] 5832 0.604% 1.182% ( 22, 34 ] 7799 0.808% 1.990% ( 34, 51 ] 3035 0.315% 2.304% ( 51, 76 ] 360 0.037% 2.342% ( 76, 110 ] 4061 0.421% 2.762% ( 110, 170 ] 324559 33.633% 36.396% ####### ( 170, 250 ] 440559 45.654% 82.050% ######### ( 250, 380 ] 107166 11.105% 93.155% ## ( 380, 580 ] 44270 4.588% 97.743% # ( 580, 870 ] 12332 1.278% 99.021% ( 870, 1300 ] 3812 0.395% 99.416% ( 1300, 1900 ] 1692 0.175% 99.591% ( 1900, 2900 ] 1253 0.130% 99.721% ( 2900, 4400 ] 993 0.103% 99.824% ( 4400, 6600 ] 399 0.041% 99.865% ( 6600, 9900 ] 85 0.009% 99.874% ( 9900, 14000 ] 142 0.015% 99.888% ( 14000, 22000 ] 675 0.070% 99.958% ( 22000, 33000 ] 329 0.034% 99.993% ( 33000, 50000 ] 60 0.006% 99.999% ( 50000, 75000 ] 11 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 19191466 rocksdb.bloom.filter.full.positive COUNT : 1151688 rocksdb.bloom.filter.full.true.positive COUNT : 964636 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 360 rocksdb.memtable.miss COUNT : 964636 rocksdb.l0.hit COUNT : 36496 rocksdb.l1.hit COUNT : 18753 rocksdb.l2andup.hit COUNT : 909387 rocksdb.compaction.key.drop.new COUNT : 160148 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4056004 rocksdb.number.keys.read COUNT : 964996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4185796128 rocksdb.bytes.read COUNT : 964996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1553 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 44742893 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16540576742 rocksdb.compact.write.bytes COUNT : 16375561421 rocksdb.flush.write.bytes COUNT : 4161761949 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 765 rocksdb.number.superversion_releases COUNT : 740 rocksdb.number.superversion_cleanups COUNT : 195 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 185 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4128093184 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1509376 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 20638929416 rocksdb.non.last.level.read.count COUNT : 4842828 rocksdb.block.checksum.compute.count COUNT : 5170777 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 192.902809 P95 : 458.913128 P99 : 864.843498 P100 : 89506.000000 COUNT : 964996 SUM : 239690647 rocksdb.db.write.micros P50 : 1.530926 P95 : 4.650999 P99 : 12.856427 P100 : 858378.000000 COUNT : 4056004 SUM : 54998797 rocksdb.compaction.times.micros P50 : 1611764.705882 P95 : 2855000.000000 P99 : 17360000.000000 P100 : 18236273.000000 COUNT : 58 SUM : 109598829 rocksdb.compaction.times.cpu_micros P50 : 966857.142857 P95 : 1690000.000000 P99 : 10987480.000000 P100 : 10987480.000000 COUNT : 58 SUM : 64015867 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 837.258065 P95 : 22275.000000 P99 : 81365.000000 P100 : 81365.000000 COUNT : 59 SUM : 261129 rocksdb.compaction.outfile.sync.micros P50 : 16571.428571 P95 : 179142.857143 P99 : 334933.333333 P100 : 663110.000000 COUNT : 204 SUM : 8805306 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 246.190476 P95 : 4532.000000 P99 : 8778.000000 P100 : 13316.000000 COUNT : 134 SUM : 184853 rocksdb.table.open.io.micros P50 : 12427.226721 P95 : 22055.797101 P99 : 31958.985507 P100 : 42594.000000 COUNT : 1553 SUM : 19073435 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.365906 P95 : 17.616349 P99 : 226.496168 P100 : 12088.000000 COUNT : 4005877 SUM : 77999751 rocksdb.read.block.get.micros P50 : 149.383896 P95 : 296.785486 P99 : 830.287495 P100 : 27674.000000 COUNT : 1163328 SUM : 204585074 rocksdb.write.raw.block.micros P50 : 0.553588 P95 : 1.629170 P99 : 3.717640 P100 : 16969.000000 COUNT : 4974363 SUM : 15290648 rocksdb.numfiles.in.singlecompaction P50 : 3.065789 P95 : 3.953947 P99 : 38.250000 P100 : 39.000000 COUNT : 75 SUM : 284 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.581044 P95 : 2132.261496 P99 : 2754.110620 P100 : 858183.000000 COUNT : 190006 SUM : 44761776 rocksdb.sst.read.micros P50 : 2.706885 P95 : 209.609263 P99 : 440.155095 P100 : 21314.000000 COUNT : 4842842 SUM : 267899228 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 964996 SUM : 964996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4056004 SUM : 4185796128 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 218163.265306 P95 : 865666.666667 P99 : 1114544.000000 P100 : 1114544.000000 COUNT : 59 SUM : 16757737 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 201 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0