[2024-07-11 05:25:07.018465] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... [2024-07-11 05:25:07.018727] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3249178 ] Set seed to 1720668307011933 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-11 05:25:07.171760] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-11 05:25:07.218293] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-11 05:25:07.218356] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3249178' to capture a snapshot of events at runtime. [2024-07-11 05:25:07.218374] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3249178 for offline analysis/debug. [2024-07-11 05:25:07.218407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Jul 11 05:25:11 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/11-05:25:24 ... thread 0: (1000000,1000000) ops and (81122.7,81122.7) ops/second in (12.327004,12.327004) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.85 GB 50.4 0.3 0.0 0.3 1.1 0.8 0.0 1.4 23.2 83.5 13.58 5.55 11 1.234 319K 354 0.0 0.0 L1 8/8 895.66 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 128.78 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 25/8 1.50 GB 1.0 2.8 1.7 1.0 2.7 1.7 0.0 1.6 86.1 85.3 32.74 18.56 14 2.338 1134K 3221 0.0 0.0 L4 189/14 10.15 GB 1.0 4.7 3.1 1.5 4.6 3.0 0.0 1.5 79.0 77.8 60.40 33.74 33 1.830 2332K 0 0.0 0.0 L5 1152/0 91.97 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1387/39 106.47 GB 0.0 7.7 4.8 2.9 8.4 5.5 2.6 10.5 74.1 80.8 106.72 57.85 58 1.840 3786K 3575 0.0 0.0 Int 0/0 0.00 KB 0.0 7.7 4.8 2.9 8.4 5.5 2.6 10.5 74.1 80.8 106.72 57.85 58 1.840 3786K 3575 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.7 4.8 2.9 7.6 4.7 0.0 0.0 81.8 80.8 96.68 54.63 48 2.014 3786K 3575 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 81.6 10.04 3.22 10 1.004 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.6 total, 12.3 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.42 GB write, 687.25 MB/s write, 7.72 GB read, 629.97 MB/s read, 106.7 seconds Interval compaction: 8.42 GB write, 699.56 MB/s write, 7.72 GB read, 641.25 MB/s read, 106.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 21, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 399504 Average: 21.3417 StdDev: 381.66 Min: 1 Median: 2.7266 Max: 58758 Percentiles: P50: 2.73 P75: 4.37 P99: 14.87 P99.9: 4003.45 P99.99: 9805.34 ------------------------------------------------------ [ 0, 1 ] 2939 0.736% 0.736% ( 1, 2 ] 90390 22.626% 23.361% ##### ( 2, 3 ] 146478 36.665% 60.026% ####### ( 3, 4 ] 47091 11.787% 71.814% ## ( 4, 6 ] 68268 17.088% 88.902% ### ( 6, 10 ] 34054 8.524% 97.426% ## ( 10, 15 ] 6461 1.617% 99.043% ( 15, 22 ] 1065 0.267% 99.310% ( 22, 34 ] 131 0.033% 99.342% ( 34, 51 ] 36 0.009% 99.351% ( 51, 76 ] 27 0.007% 99.358% ( 76, 110 ] 21 0.005% 99.363% ( 110, 170 ] 23 0.006% 99.369% ( 170, 250 ] 37 0.009% 99.378% ( 250, 380 ] 87 0.022% 99.400% ( 380, 580 ] 197 0.049% 99.450% ( 580, 870 ] 341 0.085% 99.535% ( 870, 1300 ] 519 0.130% 99.665% ( 1300, 1900 ] 413 0.103% 99.768% ( 1900, 2900 ] 287 0.072% 99.840% ( 2900, 4400 ] 331 0.083% 99.923% ( 4400, 6600 ] 206 0.052% 99.974% ( 6600, 9900 ] 68 0.017% 99.991% ( 9900, 14000 ] 36 0.009% 100.001% ( 14000, 22000 ] 44 0.011% 100.012% ( 22000, 33000 ] 24 0.006% 100.018% ( 33000, 50000 ] 2 0.001% 100.018% ( 50000, 75000 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 31893 Average: 30.5317 StdDev: 507.97 Min: 1 Median: 2.7854 Max: 35863 Percentiles: P50: 2.79 P75: 4.56 P99: 20.35 P99.9: 5773.11 P99.99: 28183.54 ------------------------------------------------------ [ 0, 1 ] 263 0.825% 0.825% ( 1, 2 ] 5846 18.330% 19.155% #### ( 2, 3 ] 12526 39.275% 58.430% ######## ( 3, 4 ] 3686 11.557% 69.987% ## ( 4, 6 ] 5734 17.979% 87.966% #### ( 6, 10 ] 2848 8.930% 96.896% ## ( 10, 15 ] 591 1.853% 98.749% ( 15, 22 ] 106 0.332% 99.081% ( 22, 34 ] 10 0.031% 99.113% ( 34, 51 ] 4 0.013% 99.125% ( 51, 76 ] 8 0.025% 99.150% ( 76, 110 ] 3 0.009% 99.160% ( 110, 170 ] 4 0.013% 99.172% ( 170, 250 ] 4 0.013% 99.185% ( 250, 380 ] 5 0.016% 99.200% ( 380, 580 ] 13 0.041% 99.241% ( 580, 870 ] 30 0.094% 99.335% ( 870, 1300 ] 54 0.169% 99.505% ( 1300, 1900 ] 30 0.094% 99.599% ( 1900, 2900 ] 35 0.110% 99.708% ( 2900, 4400 ] 49 0.154% 99.862% ( 4400, 6600 ] 21 0.066% 99.928% ( 6600, 9900 ] 12 0.038% 99.966% ( 9900, 14000 ] 3 0.009% 99.975% ( 14000, 22000 ] 3 0.009% 99.984% ( 22000, 33000 ] 5 0.016% 100.000% ( 33000, 50000 ] 1 0.003% 100.003% ** Level 2 read latency histogram (micros): Count: 282605 Average: 20.0693 StdDev: 302.91 Min: 1 Median: 2.8674 Max: 30368 Percentiles: P50: 2.87 P75: 4.84 P99: 15.89 P99.9: 2921.06 P99.99: 4139.97 ------------------------------------------------------ [ 0, 1 ] 2025 0.717% 0.717% ( 1, 2 ] 56937 20.147% 20.864% #### ( 2, 3 ] 94927 33.590% 54.454% ####### ( 3, 4 ] 35359 12.512% 66.966% ### ( 4, 6 ] 54285 19.209% 86.174% #### ( 6, 10 ] 29810 10.548% 96.723% ## ( 10, 15 ] 6264 2.217% 98.939% ( 15, 22 ] 1359 0.481% 99.420% ( 22, 34 ] 254 0.090% 99.510% ( 34, 51 ] 55 0.019% 99.529% ( 51, 76 ] 43 0.015% 99.545% ( 76, 110 ] 17 0.006% 99.551% ( 110, 170 ] 21 0.007% 99.558% ( 170, 250 ] 21 0.007% 99.565% ( 250, 380 ] 46 0.016% 99.582% ( 380, 580 ] 76 0.027% 99.609% ( 580, 870 ] 122 0.043% 99.652% ( 870, 1300 ] 205 0.073% 99.724% ( 1300, 1900 ] 241 0.085% 99.810% ( 1900, 2900 ] 251 0.089% 99.898% ( 2900, 4400 ] 313 0.111% 100.009% ( 4400, 6600 ] 178 0.063% 100.072% ( 6600, 9900 ] 63 0.022% 100.094% ( 9900, 14000 ] 14 0.005% 100.099% ( 14000, 22000 ] 15 0.005% 100.105% ( 22000, 33000 ] 8 0.003% 100.108% ** Level 3 read latency histogram (micros): Count: 1040759 Average: 17.5228 StdDev: 318.98 Min: 1 Median: 2.7770 Max: 51163 Percentiles: P50: 2.78 P75: 4.55 P99: 13.52 P99.9: 207.73 P99.99: 901.97 ------------------------------------------------------ [ 0, 1 ] 7622 0.732% 0.732% ( 1, 2 ] 218685 21.012% 21.744% #### ( 2, 3 ] 378493 36.367% 58.111% ####### ( 3, 4 ] 123142 11.832% 69.943% ## ( 4, 6 ] 193131 18.557% 88.500% #### ( 6, 10 ] 97059 9.326% 97.826% ## ( 10, 15 ] 17347 1.667% 99.493% ( 15, 22 ] 3309 0.318% 99.811% ( 22, 34 ] 481 0.046% 99.857% ( 34, 51 ] 122 0.012% 99.869% ( 51, 76 ] 170 0.016% 99.885% ( 76, 110 ] 84 0.008% 99.893% ( 110, 170 ] 46 0.004% 99.897% ( 170, 250 ] 62 0.006% 99.903% ( 250, 380 ] 131 0.013% 99.916% ( 380, 580 ] 234 0.022% 99.938% ( 580, 870 ] 477 0.046% 99.984% ( 870, 1300 ] 833 0.080% 100.064% ( 1300, 1900 ] 842 0.081% 100.145% ( 1900, 2900 ] 746 0.072% 100.217% ( 2900, 4400 ] 889 0.085% 100.302% ( 4400, 6600 ] 438 0.042% 100.344% ( 6600, 9900 ] 169 0.016% 100.361% ( 9900, 14000 ] 52 0.005% 100.366% ( 14000, 22000 ] 54 0.005% 100.371% ( 22000, 33000 ] 32 0.003% 100.374% ( 33000, 50000 ] 11 0.001% 100.375% ( 50000, 75000 ] 1 0.000% 100.375% ** Level 4 read latency histogram (micros): Count: 517550 Average: 35.5806 StdDev: 551.42 Min: 1 Median: 2.8167 Max: 80291 Percentiles: P50: 2.82 P75: 4.69 P99: 50.31 P99.9: 2789.75 P99.99: 3644.59 ------------------------------------------------------ [ 0, 1 ] 4031 0.779% 0.779% ( 1, 2 ] 107863 20.841% 21.620% #### ( 2, 3 ] 179852 34.751% 56.371% ####### ( 3, 4 ] 62727 12.120% 68.491% ## ( 4, 6 ] 98150 18.964% 87.455% #### ( 6, 10 ] 48151 9.304% 96.759% ## ( 10, 15 ] 9503 1.836% 98.595% ( 15, 22 ] 1778 0.344% 98.938% ( 22, 34 ] 261 0.050% 98.989% ( 34, 51 ] 62 0.012% 99.001% ( 51, 76 ] 112 0.022% 99.022% ( 76, 110 ] 43 0.008% 99.031% ( 110, 170 ] 38 0.007% 99.038% ( 170, 250 ] 105 0.020% 99.058% ( 250, 380 ] 176 0.034% 99.092% ( 380, 580 ] 422 0.082% 99.174% ( 580, 870 ] 799 0.154% 99.328% ( 870, 1300 ] 1187 0.229% 99.558% ( 1300, 1900 ] 1075 0.208% 99.765% ( 1900, 2900 ] 785 0.152% 99.917% ( 2900, 4400 ] 764 0.148% 100.065% ( 4400, 6600 ] 400 0.077% 100.142% ( 6600, 9900 ] 139 0.027% 100.169% ( 9900, 14000 ] 62 0.012% 100.181% ( 14000, 22000 ] 92 0.018% 100.198% ( 22000, 33000 ] 65 0.013% 100.211% ( 33000, 50000 ] 13 0.003% 100.214% ( 50000, 75000 ] 3 0.001% 100.214% ( 75000, 110000 ] 1 0.000% 100.214% ** Level 5 read latency histogram (micros): Count: 13525 Average: 2610.2539 StdDev: 3838.01 Min: 97 Median: 1637.2867 Max: 96986 Percentiles: P50: 1637.29 P75: 3367.60 P99: 17709.68 P99.9: 49752.08 P99.99: 86331.25 ------------------------------------------------------ ( 76, 110 ] 5 0.037% 0.037% ( 110, 170 ] 43 0.318% 0.355% ( 170, 250 ] 124 0.917% 1.272% ( 250, 380 ] 354 2.617% 3.889% # ( 380, 580 ] 788 5.826% 9.715% # ( 580, 870 ] 1653 12.222% 21.937% ## ( 870, 1300 ] 2511 18.566% 40.503% #### ( 1300, 1900 ] 2285 16.895% 57.397% ### ( 1900, 2900 ] 1771 13.094% 70.492% ### ( 2900, 4400 ] 1956 14.462% 84.954% ### ( 4400, 6600 ] 1381 10.211% 95.165% ## ( 6600, 9900 ] 436 3.224% 98.388% # ( 9900, 14000 ] 54 0.399% 98.787% ( 14000, 22000 ] 62 0.458% 99.246% ( 22000, 33000 ] 53 0.392% 99.638% ( 33000, 50000 ] 36 0.266% 99.904% ( 50000, 75000 ] 11 0.081% 99.985% ( 75000, 110000 ] 2 0.015% 100.000% ** DB Stats ** Uptime(secs): 12.6 total, 12.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 78.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.050 H:M:S, 48.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 79.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.050 H:M:S, 49.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/07/11-05:25:28 ... thread 0: (1000000,2000000) ops and (205004.9,116245.7) ops/second in (4.877933,17.204937) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 2.89 GB 163.6 1.4 0.0 1.4 3.2 1.8 0.0 1.7 56.8 134.1 24.42 14.49 32 0.763 1407K 1409 0.0 0.0 L1 8/8 895.66 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 14/0 975.06 MB 1.0 2.8 1.7 1.0 2.7 1.7 0.1 1.6 86.1 85.3 32.74 18.56 14 2.338 1134K 3221 0.0 0.0 L4 183/0 9.51 GB 1.0 6.1 3.8 2.3 6.0 3.7 0.0 1.6 83.9 82.6 74.39 43.33 42 1.771 2887K 0 0.0 0.0 L5 1168/0 93.26 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1390/17 107.49 GB 0.0 10.2 5.5 4.7 11.9 7.2 4.0 6.5 79.4 92.8 131.55 76.39 88 1.495 5429K 4630 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 5.5 4.7 11.9 7.2 4.0 6.5 79.4 92.8 131.55 76.39 88 1.495 5429K 4630 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 5.5 4.7 10.1 5.4 0.0 0.0 89.2 88.1 117.10 69.89 61 1.920 5429K 4630 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 130.8 14.44 6.50 27 0.535 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.4 total, 17.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.92 GB write, 700.53 MB/s write, 10.20 GB read, 599.41 MB/s read, 131.5 seconds Interval compaction: 11.92 GB write, 709.52 MB/s write, 10.20 GB read, 607.10 MB/s read, 131.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 21, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 654690 Average: 20.5358 StdDev: 306.52 Min: 1 Median: 2.4754 Max: 58758 Percentiles: P50: 2.48 P75: 3.68 P99: 297.27 P99.9: 2728.81 P99.99: 6176.04 ------------------------------------------------------ [ 0, 1 ] 8650 1.321% 1.321% ( 1, 2 ] 207278 31.660% 32.982% ###### ( 2, 3 ] 234389 35.802% 68.783% ####### ( 3, 4 ] 59672 9.115% 77.898% ## ( 4, 6 ] 81136 12.393% 90.291% ## ( 6, 10 ] 38106 5.820% 96.111% # ( 10, 15 ] 6873 1.050% 97.161% ( 15, 22 ] 1115 0.170% 97.331% ( 22, 34 ] 140 0.021% 97.353% ( 34, 51 ] 39 0.006% 97.359% ( 51, 76 ] 31 0.005% 97.363% ( 76, 110 ] 261 0.040% 97.403% ( 110, 170 ] 4318 0.660% 98.063% ( 170, 250 ] 5220 0.797% 98.860% ( 250, 380 ] 2522 0.385% 99.245% ( 380, 580 ] 1824 0.279% 99.524% ( 580, 870 ] 1022 0.156% 99.680% ( 870, 1300 ] 695 0.106% 99.786% ( 1300, 1900 ] 467 0.071% 99.858% ( 1900, 2900 ] 337 0.051% 99.909% ( 2900, 4400 ] 362 0.055% 99.964% ( 4400, 6600 ] 210 0.032% 99.996% ( 6600, 9900 ] 68 0.010% 100.007% ( 9900, 14000 ] 40 0.006% 100.013% ( 14000, 22000 ] 46 0.007% 100.020% ( 22000, 33000 ] 24 0.004% 100.024% ( 33000, 50000 ] 2 0.000% 100.024% ( 50000, 75000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 97427 Average: 15.1149 StdDev: 300.04 Min: 1 Median: 2.9675 Max: 35863 Percentiles: P50: 2.97 P75: 4.75 P99: 115.81 P99.9: 2834.41 P99.99: 14514.60 ------------------------------------------------------ [ 0, 1 ] 806 0.827% 0.827% ( 1, 2 ] 17847 18.318% 19.146% #### ( 2, 3 ] 31070 31.891% 51.036% ###### ( 3, 4 ] 15051 15.448% 66.485% ### ( 4, 6 ] 22075 22.658% 89.143% ##### ( 6, 10 ] 7399 7.594% 96.737% ## ( 10, 15 ] 1489 1.528% 98.265% ( 15, 22 ] 587 0.603% 98.868% ( 22, 34 ] 65 0.067% 98.935% ( 34, 51 ] 7 0.007% 98.942% ( 51, 76 ] 14 0.014% 98.956% ( 76, 110 ] 22 0.023% 98.979% ( 110, 170 ] 214 0.220% 99.198% ( 170, 250 ] 277 0.284% 99.483% ( 250, 380 ] 106 0.109% 99.591% ( 380, 580 ] 97 0.100% 99.691% ( 580, 870 ] 68 0.070% 99.761% ( 870, 1300 ] 69 0.071% 99.832% ( 1300, 1900 ] 32 0.033% 99.865% ( 1900, 2900 ] 37 0.038% 99.902% ( 2900, 4400 ] 49 0.050% 99.953% ( 4400, 6600 ] 21 0.022% 99.974% ( 6600, 9900 ] 12 0.012% 99.987% ( 9900, 14000 ] 3 0.003% 99.990% ( 14000, 22000 ] 4 0.004% 99.994% ( 22000, 33000 ] 5 0.005% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 282696 Average: 20.1578 StdDev: 302.96 Min: 1 Median: 2.8679 Max: 30368 Percentiles: P50: 2.87 P75: 4.84 P99: 16.35 P99.9: 2920.63 P99.99: 4139.92 ------------------------------------------------------ [ 0, 1 ] 2025 0.716% 0.716% ( 1, 2 ] 56937 20.141% 20.857% #### ( 2, 3 ] 94927 33.579% 54.436% ####### ( 3, 4 ] 35359 12.508% 66.944% ### ( 4, 6 ] 54285 19.203% 86.147% #### ( 6, 10 ] 29810 10.545% 96.691% ## ( 10, 15 ] 6264 2.216% 98.907% ( 15, 22 ] 1359 0.481% 99.388% ( 22, 34 ] 254 0.090% 99.478% ( 34, 51 ] 55 0.019% 99.497% ( 51, 76 ] 43 0.015% 99.513% ( 76, 110 ] 19 0.007% 99.519% ( 110, 170 ] 51 0.018% 99.537% ( 170, 250 ] 55 0.019% 99.557% ( 250, 380 ] 59 0.021% 99.578% ( 380, 580 ] 82 0.029% 99.607% ( 580, 870 ] 123 0.044% 99.650% ( 870, 1300 ] 207 0.073% 99.723% ( 1300, 1900 ] 243 0.086% 99.809% ( 1900, 2900 ] 252 0.089% 99.898% ( 2900, 4400 ] 313 0.111% 100.009% ( 4400, 6600 ] 178 0.063% 100.072% ( 6600, 9900 ] 63 0.022% 100.094% ( 9900, 14000 ] 14 0.005% 100.099% ( 14000, 22000 ] 15 0.005% 100.105% ( 22000, 33000 ] 8 0.003% 100.108% ** Level 3 read latency histogram (micros): Count: 1119605 Average: 16.9406 StdDev: 311.69 Min: 1 Median: 2.7595 Max: 51163 Percentiles: P50: 2.76 P75: 4.50 P99: 13.69 P99.9: 326.93 P99.99: 871.04 ------------------------------------------------------ [ 0, 1 ] 9583 0.856% 0.856% ( 1, 2 ] 242595 21.668% 22.524% #### ( 2, 3 ] 405045 36.177% 58.701% ####### ( 3, 4 ] 130925 11.694% 70.395% ## ( 4, 6 ] 204635 18.277% 88.673% #### ( 6, 10 ] 102006 9.111% 97.784% ## ( 10, 15 ] 18467 1.649% 99.433% ( 15, 22 ] 3554 0.317% 99.750% ( 22, 34 ] 513 0.046% 99.796% ( 34, 51 ] 123 0.011% 99.807% ( 51, 76 ] 178 0.016% 99.823% ( 76, 110 ] 97 0.009% 99.832% ( 110, 170 ] 246 0.022% 99.854% ( 170, 250 ] 345 0.031% 99.885% ( 250, 380 ] 293 0.026% 99.911% ( 380, 580 ] 352 0.031% 99.942% ( 580, 870 ] 534 0.048% 99.990% ( 870, 1300 ] 843 0.075% 100.065% ( 1300, 1900 ] 846 0.076% 100.141% ( 1900, 2900 ] 748 0.067% 100.207% ( 2900, 4400 ] 891 0.080% 100.287% ( 4400, 6600 ] 440 0.039% 100.326% ( 6600, 9900 ] 170 0.015% 100.342% ( 9900, 14000 ] 59 0.005% 100.347% ( 14000, 22000 ] 60 0.005% 100.352% ( 22000, 33000 ] 32 0.003% 100.355% ( 33000, 50000 ] 11 0.001% 100.356% ( 50000, 75000 ] 1 0.000% 100.356% ** Level 4 read latency histogram (micros): Count: 611444 Average: 34.1362 StdDev: 511.89 Min: 1 Median: 2.7884 Max: 80291 Percentiles: P50: 2.79 P75: 4.66 P99: 353.68 P99.9: 2602.79 P99.99: 3495.11 ------------------------------------------------------ [ 0, 1 ] 5996 0.981% 0.981% ( 1, 2 ] 133582 21.847% 22.828% #### ( 2, 3 ] 210748 34.467% 57.295% ####### ( 3, 4 ] 71428 11.682% 68.977% ## ( 4, 6 ] 110933 18.143% 87.120% #### ( 6, 10 ] 53443 8.740% 95.860% ## ( 10, 15 ] 10776 1.762% 97.622% ( 15, 22 ] 2041 0.334% 97.956% ( 22, 34 ] 286 0.047% 98.003% ( 34, 51 ] 68 0.011% 98.014% ( 51, 76 ] 118 0.019% 98.033% ( 76, 110 ] 169 0.028% 98.061% ( 110, 170 ] 2184 0.357% 98.418% ( 170, 250 ] 2492 0.408% 98.826% ( 250, 380 ] 1336 0.218% 99.044% ( 380, 580 ] 1149 0.188% 99.232% ( 580, 870 ] 1129 0.185% 99.417% ( 870, 1300 ] 1280 0.209% 99.626% ( 1300, 1900 ] 1106 0.181% 99.807% ( 1900, 2900 ] 809 0.132% 99.939% ( 2900, 4400 ] 781 0.128% 100.067% ( 4400, 6600 ] 403 0.066% 100.133% ( 6600, 9900 ] 143 0.023% 100.156% ( 9900, 14000 ] 66 0.011% 100.167% ( 14000, 22000 ] 96 0.016% 100.183% ( 22000, 33000 ] 65 0.011% 100.193% ( 33000, 50000 ] 13 0.002% 100.196% ( 50000, 75000 ] 3 0.000% 100.196% ( 75000, 110000 ] 1 0.000% 100.196% ** Level 5 read latency histogram (micros): Count: 61476 Average: 787.5531 StdDev: 2073.87 Min: 86 Median: 237.4580 Max: 96986 Percentiles: P50: 237.46 P75: 574.43 P99: 7119.71 P99.9: 30203.09 P99.99: 63300.91 ------------------------------------------------------ ( 76, 110 ] 892 1.451% 1.451% ( 110, 170 ] 15738 25.600% 27.051% ##### ( 170, 250 ] 16731 27.215% 54.267% ##### ( 250, 380 ] 7443 12.107% 66.374% ## ( 380, 580 ] 5455 8.873% 75.247% ## ( 580, 870 ] 3766 6.126% 81.373% # ( 870, 1300 ] 3095 5.034% 86.408% # ( 1300, 1900 ] 2428 3.950% 90.357% # ( 1900, 2900 ] 1858 3.022% 93.380% # ( 2900, 4400 ] 2000 3.253% 96.633% # ( 4400, 6600 ] 1385 2.253% 98.886% ( 6600, 9900 ] 446 0.725% 99.611% ( 9900, 14000 ] 64 0.104% 99.715% ( 14000, 22000 ] 74 0.120% 99.836% ( 22000, 33000 ] 53 0.086% 99.922% ( 33000, 50000 ] 36 0.059% 99.980% ( 50000, 75000 ] 11 0.018% 99.998% ( 75000, 110000 ] 2 0.003% 100.002% ** DB Stats ** Uptime(secs): 17.4 total, 4.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 112.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.050 H:M:S, 34.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 201.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/11-05:25:34 ... thread 0: (1000000,3000000) ops and (165826.5,129113.7) ops/second in (6.030400,23.235337) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.88 GB 132.2 2.6 0.0 2.6 5.4 2.8 0.0 1.9 78.3 163.9 33.80 23.22 53 0.638 2686K 2646 0.0 0.0 L1 8/8 895.66 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 14/0 975.06 MB 1.0 2.8 1.7 1.0 2.7 1.7 0.1 1.6 86.1 85.3 32.74 18.56 14 2.338 1134K 3221 0.0 0.0 L4 183/0 9.51 GB 1.0 6.1 3.8 2.3 6.0 3.7 0.0 1.6 83.9 82.6 74.39 43.33 42 1.771 2887K 0 0.0 0.0 L5 1168/0 93.26 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1391/20 108.47 GB 0.0 11.4 5.5 5.9 14.1 8.2 4.0 5.0 83.1 102.7 140.93 85.11 109 1.293 6708K 5867 0.0 0.0 Int 0/0 0.00 KB 0.0 11.4 5.5 5.9 14.1 8.2 4.0 5.0 83.1 102.7 140.93 85.11 109 1.293 6708K 5867 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.4 5.5 5.9 11.3 5.4 0.0 0.0 95.4 94.3 122.74 75.43 66 1.860 6708K 5867 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 159.3 18.19 9.68 43 0.423 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.5 total, 23.2 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.14 GB write, 617.08 MB/s write, 11.43 GB read, 499.04 MB/s read, 140.9 seconds Interval compaction: 14.14 GB write, 622.94 MB/s write, 11.43 GB read, 503.78 MB/s read, 140.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 21, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 984822 Average: 19.7303 StdDev: 253.18 Min: 0 Median: 2.1983 Max: 58758 Percentiles: P50: 2.20 P75: 3.06 P99: 317.30 P99.9: 1681.36 P99.99: 4361.35 ------------------------------------------------------ [ 0, 1 ] 49883 5.065% 5.065% # ( 1, 2 ] 382624 38.852% 43.917% ######## ( 2, 3 ] 302079 30.673% 74.591% ###### ( 3, 4 ] 70411 7.150% 81.740% # ( 4, 6 ] 90957 9.236% 90.976% ## ( 6, 10 ] 39979 4.060% 95.036% # ( 10, 15 ] 7182 0.729% 95.765% ( 15, 22 ] 1150 0.117% 95.882% ( 22, 34 ] 144 0.015% 95.896% ( 34, 51 ] 40 0.004% 95.900% ( 51, 76 ] 31 0.003% 95.904% ( 76, 110 ] 778 0.079% 95.983% ( 110, 170 ] 13004 1.320% 97.303% ( 170, 250 ] 13807 1.402% 98.705% ( 250, 380 ] 5611 0.570% 99.275% ( 380, 580 ] 3505 0.356% 99.631% ( 580, 870 ] 1584 0.161% 99.792% ( 870, 1300 ] 765 0.078% 99.869% ( 1300, 1900 ] 477 0.048% 99.918% ( 1900, 2900 ] 354 0.036% 99.954% ( 2900, 4400 ] 368 0.037% 99.991% ( 4400, 6600 ] 210 0.021% 100.012% ( 6600, 9900 ] 68 0.007% 100.019% ( 9900, 14000 ] 40 0.004% 100.023% ( 14000, 22000 ] 46 0.005% 100.028% ( 22000, 33000 ] 24 0.002% 100.030% ( 33000, 50000 ] 2 0.000% 100.031% ( 50000, 75000 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 196581 Average: 10.4553 StdDev: 212.04 Min: 1 Median: 2.9366 Max: 35863 Percentiles: P50: 2.94 P75: 4.57 P99: 110.70 P99.9: 1118.94 P99.99: 8069.02 ------------------------------------------------------ [ 0, 1 ] 5021 2.554% 2.554% # ( 1, 2 ] 46323 23.564% 26.118% ##### ( 2, 3 ] 50123 25.497% 51.616% ##### ( 3, 4 ] 33565 17.074% 68.690% ### ( 4, 6 ] 43555 22.156% 90.847% #### ( 6, 10 ] 12218 6.215% 97.062% # ( 10, 15 ] 2374 1.208% 98.269% ( 15, 22 ] 1244 0.633% 98.902% ( 22, 34 ] 120 0.061% 98.963% ( 34, 51 ] 11 0.006% 98.969% ( 51, 76 ] 14 0.007% 98.976% ( 76, 110 ] 41 0.021% 98.997% ( 110, 170 ] 612 0.311% 99.308% ( 170, 250 ] 672 0.342% 99.650% ( 250, 380 ] 206 0.105% 99.755% ( 380, 580 ] 157 0.080% 99.835% ( 580, 870 ] 86 0.044% 99.878% ( 870, 1300 ] 75 0.038% 99.917% ( 1300, 1900 ] 33 0.017% 99.933% ( 1900, 2900 ] 37 0.019% 99.952% ( 2900, 4400 ] 49 0.025% 99.977% ( 4400, 6600 ] 21 0.011% 99.988% ( 6600, 9900 ] 12 0.006% 99.994% ( 9900, 14000 ] 3 0.002% 99.995% ( 14000, 22000 ] 4 0.002% 99.997% ( 22000, 33000 ] 5 0.003% 100.000% ( 33000, 50000 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 282844 Average: 20.2538 StdDev: 302.92 Min: 1 Median: 2.8687 Max: 30368 Percentiles: P50: 2.87 P75: 4.84 P99: 17.10 P99.9: 2919.92 P99.99: 4139.85 ------------------------------------------------------ [ 0, 1 ] 2025 0.716% 0.716% ( 1, 2 ] 56937 20.130% 20.846% #### ( 2, 3 ] 94927 33.562% 54.408% ####### ( 3, 4 ] 35359 12.501% 66.909% ### ( 4, 6 ] 54285 19.193% 86.102% #### ( 6, 10 ] 29810 10.539% 96.641% ## ( 10, 15 ] 6264 2.215% 98.856% ( 15, 22 ] 1359 0.480% 99.336% ( 22, 34 ] 254 0.090% 99.426% ( 34, 51 ] 55 0.019% 99.445% ( 51, 76 ] 43 0.015% 99.460% ( 76, 110 ] 22 0.008% 99.468% ( 110, 170 ] 111 0.039% 99.508% ( 170, 250 ] 118 0.042% 99.549% ( 250, 380 ] 73 0.026% 99.575% ( 380, 580 ] 88 0.031% 99.606% ( 580, 870 ] 125 0.044% 99.650% ( 870, 1300 ] 207 0.073% 99.724% ( 1300, 1900 ] 243 0.086% 99.809% ( 1900, 2900 ] 252 0.089% 99.899% ( 2900, 4400 ] 313 0.111% 100.009% ( 4400, 6600 ] 178 0.063% 100.072% ( 6600, 9900 ] 63 0.022% 100.094% ( 9900, 14000 ] 14 0.005% 100.099% ( 14000, 22000 ] 15 0.005% 100.105% ( 22000, 33000 ] 8 0.003% 100.107% ** Level 3 read latency histogram (micros): Count: 1120549 Average: 17.1115 StdDev: 311.64 Min: 1 Median: 2.7606 Max: 51163 Percentiles: P50: 2.76 P75: 4.51 P99: 13.94 P99.9: 366.98 P99.99: 873.53 ------------------------------------------------------ [ 0, 1 ] 9583 0.855% 0.855% ( 1, 2 ] 242595 21.650% 22.505% #### ( 2, 3 ] 405045 36.147% 58.652% ####### ( 3, 4 ] 130925 11.684% 70.336% ## ( 4, 6 ] 204635 18.262% 88.598% #### ( 6, 10 ] 102006 9.103% 97.701% ## ( 10, 15 ] 18467 1.648% 99.349% ( 15, 22 ] 3554 0.317% 99.666% ( 22, 34 ] 513 0.046% 99.712% ( 34, 51 ] 123 0.011% 99.723% ( 51, 76 ] 178 0.016% 99.739% ( 76, 110 ] 114 0.010% 99.749% ( 110, 170 ] 626 0.056% 99.805% ( 170, 250 ] 700 0.062% 99.867% ( 250, 380 ] 405 0.036% 99.904% ( 380, 580 ] 408 0.036% 99.940% ( 580, 870 ] 553 0.049% 99.989% ( 870, 1300 ] 846 0.075% 100.065% ( 1300, 1900 ] 847 0.076% 100.140% ( 1900, 2900 ] 749 0.067% 100.207% ( 2900, 4400 ] 891 0.080% 100.287% ( 4400, 6600 ] 440 0.039% 100.326% ( 6600, 9900 ] 170 0.015% 100.341% ( 9900, 14000 ] 59 0.005% 100.347% ( 14000, 22000 ] 60 0.005% 100.352% ( 22000, 33000 ] 32 0.003% 100.355% ( 33000, 50000 ] 11 0.001% 100.356% ( 50000, 75000 ] 1 0.000% 100.356% ** Level 4 read latency histogram (micros): Count: 623418 Average: 37.2655 StdDev: 507.78 Min: 1 Median: 2.8152 Max: 80291 Percentiles: P50: 2.82 P75: 4.81 P99: 435.08 P99.9: 2589.52 P99.99: 3492.06 ------------------------------------------------------ [ 0, 1 ] 5996 0.962% 0.962% ( 1, 2 ] 133657 21.439% 22.401% #### ( 2, 3 ] 211058 33.855% 56.256% ####### ( 3, 4 ] 71654 11.494% 67.750% ## ( 4, 6 ] 111259 17.847% 85.597% #### ( 6, 10 ] 53493 8.581% 94.177% ## ( 10, 15 ] 10784 1.730% 95.907% ( 15, 22 ] 2041 0.327% 96.234% ( 22, 34 ] 286 0.046% 96.280% ( 34, 51 ] 68 0.011% 96.291% ( 51, 76 ] 118 0.019% 96.310% ( 76, 110 ] 410 0.066% 96.376% ( 110, 170 ] 6640 1.065% 97.441% ( 170, 250 ] 6655 1.068% 98.508% ( 250, 380 ] 2569 0.412% 98.920% ( 380, 580 ] 1804 0.289% 99.210% ( 580, 870 ] 1330 0.213% 99.423% ( 870, 1300 ] 1305 0.209% 99.633% ( 1300, 1900 ] 1108 0.178% 99.810% ( 1900, 2900 ] 813 0.130% 99.941% ( 2900, 4400 ] 782 0.125% 100.066% ( 4400, 6600 ] 403 0.065% 100.131% ( 6600, 9900 ] 143 0.023% 100.154% ( 9900, 14000 ] 66 0.011% 100.164% ( 14000, 22000 ] 96 0.015% 100.180% ( 22000, 33000 ] 65 0.010% 100.190% ( 33000, 50000 ] 13 0.002% 100.192% ( 50000, 75000 ] 3 0.000% 100.193% ( 75000, 110000 ] 1 0.000% 100.193% ** Level 5 read latency histogram (micros): Count: 132403 Average: 481.6723 StdDev: 1444.62 Min: 86 Median: 205.6057 Max: 96986 Percentiles: P50: 205.61 P75: 326.76 P99: 5584.93 P99.9: 18605.08 P99.99: 49414.30 ------------------------------------------------------ ( 76, 110 ] 2487 1.878% 1.878% ( 110, 170 ] 44572 33.664% 35.542% ####### ( 170, 250 ] 43010 32.484% 68.026% ###### ( 250, 380 ] 15638 11.811% 79.837% ## ( 380, 580 ] 9867 7.452% 87.290% # ( 580, 870 ] 5134 3.878% 91.167% # ( 870, 1300 ] 3289 2.484% 93.651% ( 1300, 1900 ] 2452 1.852% 95.503% ( 1900, 2900 ] 1880 1.420% 96.923% ( 2900, 4400 ] 2004 1.514% 98.437% ( 4400, 6600 ] 1385 1.046% 99.483% ( 6600, 9900 ] 446 0.337% 99.819% ( 9900, 14000 ] 64 0.048% 99.868% ( 14000, 22000 ] 74 0.056% 99.924% ( 22000, 33000 ] 53 0.040% 99.964% ( 33000, 50000 ] 36 0.027% 99.991% ( 50000, 75000 ] 11 0.008% 99.999% ( 75000, 110000 ] 2 0.002% 100.001% ** DB Stats ** Uptime(secs): 23.5 total, 6.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 125.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.249 H:M:S, 30.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 163.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.199 H:M:S, 19.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/07/11-05:25:43 ... thread 0: (1000000,4000000) ops and (111270.7,124137.1) ops/second in (8.987090,32.222427) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/7 3.75 GB 226.6 3.4 0.0 3.4 7.1 3.7 0.0 1.9 78.1 164.7 44.36 30.66 70 0.634 3518K 3490 0.0 0.0 L1 8/0 1018.29 MB 101.8 1.9 1.1 0.9 1.9 1.0 0.0 1.8 79.4 78.8 24.83 13.83 1 24.835 2001K 14K 0.0 0.0 L2 1/0 70.95 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 919.77 MB 0.9 3.9 2.1 1.8 3.9 2.1 0.6 1.8 95.3 94.4 42.16 26.01 19 2.219 1761K 5367 0.0 0.0 L4 184/0 9.68 GB 1.0 8.2 4.7 3.6 8.1 4.5 0.0 1.7 89.2 87.7 94.54 57.66 54 1.751 4267K 9764 0.0 0.0 L5 1176/0 93.94 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1403/7 109.33 GB 0.0 17.5 7.9 9.6 21.0 11.4 6.0 5.6 86.9 104.6 205.89 128.16 144 1.430 11M 32K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.5 7.9 9.6 21.0 11.4 6.0 5.6 86.9 104.6 205.89 128.16 144 1.430 11M 32K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.5 7.9 9.6 17.3 7.7 0.0 0.0 98.3 97.2 181.93 115.33 87 2.091 11M 32K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 160.4 23.96 12.82 57 0.420 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.4 total, 32.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.03 GB write, 663.69 MB/s write, 17.47 GB read, 551.39 MB/s read, 205.9 seconds Interval compaction: 21.03 GB write, 668.24 MB/s write, 17.47 GB read, 555.17 MB/s read, 205.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 22, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 30, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1517450 Average: 18.9283 StdDev: 221.74 Min: 0 Median: 2.2434 Max: 58758 Percentiles: P50: 2.24 P75: 3.20 P99: 315.89 P99.9: 1286.01 P99.99: 3473.09 ------------------------------------------------------ [ 0, 1 ] 65064 4.288% 4.288% # ( 1, 2 ] 578996 38.156% 42.444% ######## ( 2, 3 ] 471084 31.044% 73.488% ###### ( 3, 4 ] 114698 7.559% 81.047% ## ( 4, 6 ] 148903 9.813% 90.859% ## ( 6, 10 ] 63224 4.166% 95.026% # ( 10, 15 ] 9850 0.649% 95.675% ( 15, 22 ] 1508 0.099% 95.774% ( 22, 34 ] 179 0.012% 95.786% ( 34, 51 ] 63 0.004% 95.790% ( 51, 76 ] 87 0.006% 95.796% ( 76, 110 ] 1171 0.077% 95.873% ( 110, 170 ] 20430 1.346% 97.219% ( 170, 250 ] 22526 1.484% 98.704% ( 250, 380 ] 8864 0.584% 99.288% ( 380, 580 ] 5468 0.360% 99.648% ( 580, 870 ] 2615 0.172% 99.821% ( 870, 1300 ] 1243 0.082% 99.903% ( 1300, 1900 ] 662 0.044% 99.946% ( 1900, 2900 ] 460 0.030% 99.977% ( 2900, 4400 ] 532 0.035% 100.012% ( 4400, 6600 ] 256 0.017% 100.029% ( 6600, 9900 ] 82 0.005% 100.034% ( 9900, 14000 ] 44 0.003% 100.037% ( 14000, 22000 ] 51 0.003% 100.040% ( 22000, 33000 ] 27 0.002% 100.042% ( 33000, 50000 ] 2 0.000% 100.042% ( 50000, 75000 ] 1 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 339810 Average: 10.4928 StdDev: 179.49 Min: 0 Median: 2.7938 Max: 35863 Percentiles: P50: 2.79 P75: 4.49 P99: 119.66 P99.9: 711.04 P99.99: 1435.37 ------------------------------------------------------ [ 0, 1 ] 7705 2.267% 2.267% ( 1, 2 ] 87395 25.719% 27.986% ##### ( 2, 3 ] 94237 27.732% 55.718% ###### ( 3, 4 ] 48758 14.349% 70.067% ### ( 4, 6 ] 68416 20.134% 90.201% #### ( 6, 10 ] 23154 6.814% 97.015% # ( 10, 15 ] 4500 1.324% 98.339% ( 15, 22 ] 1749 0.515% 98.853% ( 22, 34 ] 191 0.056% 98.910% ( 34, 51 ] 24 0.007% 98.917% ( 51, 76 ] 42 0.012% 98.929% ( 76, 110 ] 77 0.023% 98.952% ( 110, 170 ] 1018 0.300% 99.251% ( 170, 250 ] 1153 0.339% 99.591% ( 250, 380 ] 500 0.147% 99.738% ( 380, 580 ] 445 0.131% 99.869% ( 580, 870 ] 235 0.069% 99.938% ( 870, 1300 ] 161 0.047% 99.985% ( 1300, 1900 ] 71 0.021% 100.006% ( 1900, 2900 ] 58 0.017% 100.023% ( 2900, 4400 ] 97 0.029% 100.052% ( 4400, 6600 ] 31 0.009% 100.061% ( 6600, 9900 ] 16 0.005% 100.066% ( 9900, 14000 ] 4 0.001% 100.067% ( 14000, 22000 ] 6 0.002% 100.069% ( 22000, 33000 ] 5 0.001% 100.070% ( 33000, 50000 ] 1 0.000% 100.070% ** Level 2 read latency histogram (micros): Count: 315604 Average: 19.0950 StdDev: 288.75 Min: 1 Median: 2.8769 Max: 30368 Percentiles: P50: 2.88 P75: 4.86 P99: 17.06 P99.9: 2845.51 P99.99: 4139.75 ------------------------------------------------------ [ 0, 1 ] 2144 0.679% 0.679% ( 1, 2 ] 62694 19.865% 20.544% #### ( 2, 3 ] 106016 33.591% 54.136% ####### ( 3, 4 ] 39255 12.438% 66.574% ## ( 4, 6 ] 61513 19.491% 86.064% #### ( 6, 10 ] 33392 10.580% 96.645% ## ( 10, 15 ] 6983 2.213% 98.857% ( 15, 22 ] 1531 0.485% 99.342% ( 22, 34 ] 283 0.090% 99.432% ( 34, 51 ] 58 0.018% 99.450% ( 51, 76 ] 54 0.017% 99.467% ( 76, 110 ] 31 0.010% 99.477% ( 110, 170 ] 136 0.043% 99.520% ( 170, 250 ] 138 0.044% 99.564% ( 250, 380 ] 79 0.025% 99.589% ( 380, 580 ] 103 0.033% 99.622% ( 580, 870 ] 153 0.048% 99.670% ( 870, 1300 ] 223 0.071% 99.741% ( 1300, 1900 ] 249 0.079% 99.820% ( 1900, 2900 ] 268 0.085% 99.905% ( 2900, 4400 ] 326 0.103% 100.008% ( 4400, 6600 ] 179 0.057% 100.065% ( 6600, 9900 ] 63 0.020% 100.085% ( 9900, 14000 ] 14 0.004% 100.089% ( 14000, 22000 ] 15 0.005% 100.094% ( 22000, 33000 ] 8 0.003% 100.096% ** Level 3 read latency histogram (micros): Count: 1514342 Average: 14.4761 StdDev: 272.35 Min: 1 Median: 2.7551 Max: 51163 Percentiles: P50: 2.76 P75: 4.48 P99: 13.73 P99.9: 276.60 P99.99: 682.61 ------------------------------------------------------ [ 0, 1 ] 11642 0.769% 0.769% ( 1, 2 ] 325817 21.515% 22.284% #### ( 2, 3 ] 555858 36.706% 58.990% ####### ( 3, 4 ] 175893 11.615% 70.606% ## ( 4, 6 ] 274963 18.157% 88.763% #### ( 6, 10 ] 137138 9.056% 97.819% ## ( 10, 15 ] 23947 1.581% 99.400% ( 15, 22 ] 4334 0.286% 99.686% ( 22, 34 ] 586 0.039% 99.725% ( 34, 51 ] 179 0.012% 99.737% ( 51, 76 ] 304 0.020% 99.757% ( 76, 110 ] 174 0.011% 99.768% ( 110, 170 ] 896 0.059% 99.828% ( 170, 250 ] 978 0.065% 99.892% ( 250, 380 ] 580 0.038% 99.930% ( 380, 580 ] 633 0.042% 99.972% ( 580, 870 ] 759 0.050% 100.022% ( 870, 1300 ] 977 0.065% 100.087% ( 1300, 1900 ] 902 0.060% 100.146% ( 1900, 2900 ] 801 0.053% 100.199% ( 2900, 4400 ] 968 0.064% 100.263% ( 4400, 6600 ] 454 0.030% 100.293% ( 6600, 9900 ] 174 0.011% 100.305% ( 9900, 14000 ] 62 0.004% 100.309% ( 14000, 22000 ] 62 0.004% 100.313% ( 22000, 33000 ] 32 0.002% 100.315% ( 33000, 50000 ] 11 0.001% 100.316% ( 50000, 75000 ] 1 0.000% 100.316% ** Level 4 read latency histogram (micros): Count: 957440 Average: 32.8455 StdDev: 436.54 Min: 1 Median: 2.8277 Max: 80291 Percentiles: P50: 2.83 P75: 4.82 P99: 388.57 P99.9: 1898.56 P99.99: 2784.80 ------------------------------------------------------ [ 0, 1 ] 7587 0.792% 0.792% ( 1, 2 ] 198091 20.690% 21.482% #### ( 2, 3 ] 329861 34.452% 55.934% ####### ( 3, 4 ] 111155 11.610% 67.544% ## ( 4, 6 ] 173513 18.123% 85.667% #### ( 6, 10 ] 82443 8.611% 94.277% ## ( 10, 15 ] 16925 1.768% 96.045% ( 15, 22 ] 3192 0.333% 96.379% ( 22, 34 ] 444 0.046% 96.425% ( 34, 51 ] 106 0.011% 96.436% ( 51, 76 ] 225 0.024% 96.460% ( 76, 110 ] 594 0.062% 96.522% ( 110, 170 ] 9626 1.005% 97.527% ( 170, 250 ] 9927 1.037% 98.564% ( 250, 380 ] 4046 0.423% 98.986% ( 380, 580 ] 3049 0.318% 99.305% ( 580, 870 ] 2289 0.239% 99.544% ( 870, 1300 ] 1983 0.207% 99.751% ( 1300, 1900 ] 1430 0.149% 99.900% ( 1900, 2900 ] 970 0.101% 100.002% ( 2900, 4400 ] 1057 0.110% 100.112% ( 4400, 6600 ] 529 0.055% 100.167% ( 6600, 9900 ] 185 0.019% 100.187% ( 9900, 14000 ] 85 0.009% 100.196% ( 14000, 22000 ] 112 0.012% 100.207% ( 22000, 33000 ] 68 0.007% 100.214% ( 33000, 50000 ] 13 0.001% 100.216% ( 50000, 75000 ] 3 0.000% 100.216% ( 75000, 110000 ] 1 0.000% 100.216% ** Level 5 read latency histogram (micros): Count: 193035 Average: 453.5811 StdDev: 1262.22 Min: 86 Median: 209.2117 Max: 96986 Percentiles: P50: 209.21 P75: 340.23 P99: 4985.34 P99.9: 14605.65 P99.99: 46551.12 ------------------------------------------------------ ( 76, 110 ] 3263 1.690% 1.690% ( 110, 170 ] 62615 32.437% 34.127% ###### ( 170, 250 ] 62511 32.383% 66.511% ###### ( 250, 380 ] 23610 12.231% 78.742% ## ( 380, 580 ] 15799 8.185% 86.926% ## ( 580, 870 ] 8998 4.661% 91.588% # ( 870, 1300 ] 5463 2.830% 94.418% # ( 1300, 1900 ] 3417 1.770% 96.188% ( 1900, 2900 ] 2352 1.218% 97.406% ( 2900, 4400 ] 2656 1.376% 98.782% ( 4400, 6600 ] 1581 0.819% 99.601% ( 6600, 9900 ] 493 0.255% 99.857% ( 9900, 14000 ] 77 0.040% 99.896% ( 14000, 22000 ] 92 0.048% 99.944% ( 22000, 33000 ] 60 0.031% 99.975% ( 33000, 50000 ] 36 0.019% 99.994% ( 50000, 75000 ] 11 0.006% 99.999% ( 75000, 110000 ] 2 0.001% 100.001% ** DB Stats ** Uptime(secs): 32.4 total, 9.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 121.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.983 H:M:S, 33.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 109.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.734 H:M:S, 41.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 329.415 micros/op 12131 ops/sec 60.175 seconds 729996 operations; 11.8 MB/s (181999 of 181999 found) Microseconds per read: Count: 729996 Average: 329.4178 StdDev: 1531.69 Min: 2 Median: 214.7759 Max: 320978 Percentiles: P50: 214.78 P75: 276.81 P99: 1841.82 P99.9: 20317.25 P99.99: 47676.31 ------------------------------------------------------ ( 1, 2 ] 9 0.001% 0.001% ( 2, 3 ] 30 0.004% 0.005% ( 3, 4 ] 53 0.007% 0.013% ( 4, 6 ] 75 0.010% 0.023% ( 6, 10 ] 342 0.047% 0.070% ( 10, 15 ] 3869 0.530% 0.600% ( 15, 22 ] 3994 0.547% 1.147% ( 22, 34 ] 6168 0.845% 1.992% ( 34, 51 ] 3465 0.475% 2.466% ( 51, 76 ] 366 0.050% 2.517% ( 76, 110 ] 569 0.078% 2.595% ( 110, 170 ] 141826 19.428% 22.023% #### ( 170, 250 ] 364896 49.986% 72.009% ########## ( 250, 380 ] 105880 14.504% 86.513% ### ( 380, 580 ] 58082 7.956% 94.470% ## ( 580, 870 ] 21233 2.909% 97.378% # ( 870, 1300 ] 8412 1.152% 98.531% ( 1300, 1900 ] 3795 0.520% 99.050% ( 1900, 2900 ] 2219 0.304% 99.354% ( 2900, 4400 ] 1970 0.270% 99.624% ( 4400, 6600 ] 952 0.130% 99.755% ( 6600, 9900 ] 340 0.047% 99.801% ( 9900, 14000 ] 248 0.034% 99.835% ( 14000, 22000 ] 599 0.082% 99.917% ( 22000, 33000 ] 411 0.056% 99.974% ( 33000, 50000 ] 139 0.019% 99.993% ( 50000, 75000 ] 28 0.004% 99.996% ( 75000, 110000 ] 10 0.001% 99.998% ( 110000, 170000 ] 3 0.000% 99.998% ( 170000, 250000 ] 11 0.002% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 11083938 rocksdb.bloom.filter.full.positive COUNT : 837573 rocksdb.bloom.filter.full.true.positive COUNT : 729636 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 360 rocksdb.memtable.miss COUNT : 729636 rocksdb.l0.hit COUNT : 28424 rocksdb.l1.hit COUNT : 7034 rocksdb.l2andup.hit COUNT : 694178 rocksdb.compaction.key.drop.new COUNT : 224440 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4379597 rocksdb.number.keys.read COUNT : 729996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4519744104 rocksdb.bytes.read COUNT : 729996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1678 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36525697 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 22616339560 rocksdb.compact.write.bytes COUNT : 22377218224 rocksdb.flush.write.bytes COUNT : 4492028224 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 22 rocksdb.number.superversion_acquires COUNT : 991 rocksdb.number.superversion_releases COUNT : 951 rocksdb.number.superversion_cleanups COUNT : 243 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 284 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4455690240 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1633280 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 25588096937 rocksdb.non.last.level.read.count COUNT : 6037040 rocksdb.block.checksum.compute.count COUNT : 6322896 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 214.150160 P95 : 630.971529 P99 : 1841.307245 P100 : 320976.000000 COUNT : 729996 SUM : 239862648 rocksdb.db.write.micros P50 : 2.234518 P95 : 5.945427 P99 : 13.097962 P100 : 1886628.000000 COUNT : 4379597 SUM : 52364296 rocksdb.compaction.times.micros P50 : 1747435.897436 P95 : 3938333.333333 P99 : 26847534.000000 P100 : 26847534.000000 COUNT : 91 SUM : 216110184 rocksdb.compaction.times.cpu_micros P50 : 1145357.142857 P95 : 2678571.428571 P99 : 12089000.000000 P100 : 13831272.000000 COUNT : 91 SUM : 132897664 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1188.518519 P95 : 13180.000000 P99 : 19299.000000 P100 : 19299.000000 COUNT : 64 SUM : 176936 rocksdb.compaction.outfile.sync.micros P50 : 7500.000000 P95 : 32010.000000 P99 : 67100.000000 P100 : 182098.000000 COUNT : 258 SUM : 2803208 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 336.666667 P95 : 4444.000000 P99 : 8431.500000 P100 : 9603.000000 COUNT : 178 SUM : 195308 rocksdb.table.open.io.micros P50 : 11918.298969 P95 : 29507.142857 P99 : 78850.000000 P100 : 247227.000000 COUNT : 1678 SUM : 22846183 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 5.318395 P95 : 14.571174 P99 : 230.831169 P100 : 64752.000000 COUNT : 5475339 SUM : 112693073 rocksdb.read.block.get.micros P50 : 176.918472 P95 : 511.530374 P99 : 1838.100260 P100 : 97063.000000 COUNT : 845919 SUM : 207102901 rocksdb.write.raw.block.micros P50 : 0.577735 P95 : 1.782768 P99 : 4.215701 P100 : 94486.000000 COUNT : 6507937 SUM : 30146954 rocksdb.numfiles.in.singlecompaction P50 : 2.520000 P95 : 5.280000 P99 : 14.200000 P100 : 16.000000 COUNT : 116 SUM : 377 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565192 P95 : 1180.043078 P99 : 2517.757696 P100 : 1886463.000000 COUNT : 212659 SUM : 36546659 rocksdb.sst.read.micros P50 : 2.780457 P95 : 216.561544 P99 : 523.832572 P100 : 96986.000000 COUNT : 6037129 SUM : 300283450 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 729996 SUM : 729996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4379597 SUM : 4519744104 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 245294.117647 P95 : 1386666.666667 P99 : 2260000.000000 P100 : 2304678.000000 COUNT : 64 SUM : 25670256 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 284 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0