[2024-12-14 10:35:54.672965] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-12-14 10:35:54.673272] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid712750 ] Set seed to 1734168954666379 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-14 10:35:54.770903] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-14 10:35:54.807013] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-14 10:35:54.807069] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 712750' to capture a snapshot of events at runtime. [2024-12-14 10:35:54.807081] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid712750 for offline analysis/debug. [2024-12-14 10:35:54.807108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 14 10:35:59 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/14-10:36:06 ... thread 0: (1000000,1000000) ops and (127778.6,127778.6) ops/second in (7.826035,7.826035) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/6 951.73 MB 12.6 0.4 0.0 0.4 1.2 0.8 0.0 1.5 40.0 124.9 9.63 3.93 10 0.963 391K 650 0.0 0.0 L2 2/0 257.56 MB 2.6 0.3 0.3 0.1 0.3 0.2 0.0 1.2 102.6 101.9 3.09 1.52 1 3.094 322K 2065 0.0 0.0 L3 57/10 4.03 GB 3.0 4.3 2.7 1.6 4.3 2.7 0.0 1.6 105.8 105.1 41.99 20.60 22 1.908 2730K 6939 0.0 0.0 L4 175/19 11.42 GB 1.1 1.9 1.6 0.3 1.9 1.6 0.1 1.2 110.2 109.6 17.45 8.84 14 1.247 537K 0 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1321/35 105.47 GB 0.0 6.9 4.6 2.3 7.7 5.3 0.2 9.6 97.9 108.7 72.17 34.90 47 1.535 3982K 9654 0.0 0.0 Int 0/0 0.00 KB 0.0 6.9 4.6 2.3 7.7 5.3 0.2 9.6 97.9 108.7 72.17 34.90 47 1.535 3982K 9654 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.9 4.6 2.3 6.9 4.5 0.0 0.0 108.0 107.4 65.41 32.56 38 1.721 3982K 9654 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 121.3 6.75 2.34 9 0.750 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.66 GB write, 978.94 MB/s write, 6.90 GB read, 881.97 MB/s read, 72.2 seconds Interval compaction: 7.66 GB write, 1002.01 MB/s write, 6.90 GB read, 902.75 MB/s read, 72.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 31, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 138118 Average: 12.6405 StdDev: 139.41 Min: 1 Median: 1.8233 Max: 5775 Percentiles: P50: 1.82 P75: 2.94 P99: 12.96 P99.9: 2457.87 P99.99: 4350.96 ------------------------------------------------------ [ 0, 1 ] 9920 7.182% 7.182% # ( 1, 2 ] 71835 52.010% 59.192% ########## ( 2, 3 ] 23262 16.842% 76.034% ### ( 3, 4 ] 14024 10.154% 86.188% ## ( 4, 6 ] 13982 10.123% 96.311% ## ( 6, 10 ] 3373 2.442% 98.753% ( 10, 15 ] 578 0.418% 99.172% ( 15, 22 ] 58 0.042% 99.214% ( 22, 34 ] 7 0.005% 99.219% ( 34, 51 ] 4 0.003% 99.222% ( 51, 76 ] 8 0.006% 99.227% ( 76, 110 ] 1 0.001% 99.228% ( 110, 170 ] 4 0.003% 99.231% ( 170, 250 ] 22 0.016% 99.247% ( 250, 380 ] 61 0.044% 99.291% ( 380, 580 ] 146 0.106% 99.397% ( 580, 870 ] 230 0.167% 99.563% ( 870, 1300 ] 255 0.185% 99.748% ( 1300, 1900 ] 159 0.115% 99.863% ( 1900, 2900 ] 93 0.067% 99.930% ( 2900, 4400 ] 86 0.062% 99.993% ( 4400, 6600 ] 11 0.008% 100.001% ** Level 1 read latency histogram (micros): Count: 65420 Average: 14.2254 StdDev: 186.32 Min: 1 Median: 1.9040 Max: 19512 Percentiles: P50: 1.90 P75: 3.03 P99: 14.20 P99.9: 3049.46 P99.99: 6467.51 ------------------------------------------------------ [ 0, 1 ] 3625 5.541% 5.541% # ( 1, 2 ] 32174 49.181% 54.722% ########## ( 2, 3 ] 13085 20.002% 74.723% #### ( 3, 4 ] 6592 10.076% 84.800% ## ( 4, 6 ] 6902 10.550% 95.350% ## ( 6, 10 ] 1969 3.010% 98.360% # ( 10, 15 ] 498 0.761% 99.121% ( 15, 22 ] 90 0.138% 99.259% ( 22, 34 ] 15 0.023% 99.282% ( 34, 51 ] 8 0.012% 99.294% ( 51, 76 ] 4 0.006% 99.300% ( 76, 110 ] 3 0.005% 99.304% ( 110, 170 ] 7 0.011% 99.315% ( 170, 250 ] 15 0.023% 99.338% ( 250, 380 ] 28 0.043% 99.381% ( 380, 580 ] 43 0.066% 99.447% ( 580, 870 ] 79 0.121% 99.567% ( 870, 1300 ] 75 0.115% 99.682% ( 1300, 1900 ] 73 0.112% 99.794% ( 1900, 2900 ] 64 0.098% 99.891% ( 2900, 4400 ] 56 0.086% 99.977% ( 4400, 6600 ] 9 0.014% 99.991% ( 6600, 9900 ] 5 0.008% 99.998% ( 14000, 22000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 584397 Average: 13.1546 StdDev: 175.96 Min: 1 Median: 1.8872 Max: 24723 Percentiles: P50: 1.89 P75: 2.98 P99: 11.96 P99.9: 1663.63 P99.99: 2470.57 ------------------------------------------------------ [ 0, 1 ] 28219 4.829% 4.829% # ( 1, 2 ] 297552 50.916% 55.745% ########## ( 2, 3 ] 114952 19.670% 75.415% #### ( 3, 4 ] 58336 9.982% 85.397% ## ( 4, 6 ] 62511 10.697% 96.094% ## ( 6, 10 ] 15489 2.650% 98.744% # ( 10, 15 ] 3820 0.654% 99.398% ( 15, 22 ] 493 0.084% 99.482% ( 22, 34 ] 94 0.016% 99.498% ( 34, 51 ] 32 0.005% 99.504% ( 51, 76 ] 40 0.007% 99.511% ( 76, 110 ] 10 0.002% 99.512% ( 110, 170 ] 41 0.007% 99.520% ( 170, 250 ] 76 0.013% 99.533% ( 250, 380 ] 188 0.032% 99.565% ( 380, 580 ] 365 0.062% 99.627% ( 580, 870 ] 618 0.106% 99.733% ( 870, 1300 ] 616 0.105% 99.838% ( 1300, 1900 ] 595 0.102% 99.940% ( 1900, 2900 ] 511 0.087% 100.028% ( 2900, 4400 ] 471 0.081% 100.108% ( 4400, 6600 ] 111 0.019% 100.127% ( 6600, 9900 ] 17 0.003% 100.130% ( 9900, 14000 ] 3 0.001% 100.131% ( 14000, 22000 ] 5 0.001% 100.131% ( 22000, 33000 ] 2 0.000% 100.132% ** Level 3 read latency histogram (micros): Count: 969530 Average: 12.0237 StdDev: 149.43 Min: 1 Median: 1.9080 Max: 16099 Percentiles: P50: 1.91 P75: 2.99 P99: 10.23 P99.9: 1016.54 P99.99: 1384.57 ------------------------------------------------------ [ 0, 1 ] 33883 3.495% 3.495% # ( 1, 2 ] 496545 51.215% 54.710% ########## ( 2, 3 ] 197851 20.407% 75.117% #### ( 3, 4 ] 101371 10.456% 85.572% ## ( 4, 6 ] 105622 10.894% 96.467% ## ( 6, 10 ] 24308 2.507% 98.974% # ( 10, 15 ] 5446 0.562% 99.535% ( 15, 22 ] 608 0.063% 99.598% ( 22, 34 ] 61 0.006% 99.604% ( 34, 51 ] 47 0.005% 99.609% ( 51, 76 ] 73 0.008% 99.617% ( 76, 110 ] 23 0.002% 99.619% ( 110, 170 ] 70 0.007% 99.626% ( 170, 250 ] 167 0.017% 99.644% ( 250, 380 ] 323 0.033% 99.677% ( 380, 580 ] 693 0.071% 99.748% ( 580, 870 ] 1083 0.112% 99.860% ( 870, 1300 ] 1137 0.117% 99.977% ( 1300, 1900 ] 873 0.090% 100.067% ( 1900, 2900 ] 776 0.080% 100.147% ( 2900, 4400 ] 650 0.067% 100.215% ( 4400, 6600 ] 142 0.015% 100.229% ( 6600, 9900 ] 17 0.002% 100.231% ( 14000, 22000 ] 2 0.000% 100.231% ** Level 4 read latency histogram (micros): Count: 143552 Average: 42.2144 StdDev: 356.30 Min: 1 Median: 1.9071 Max: 49193 Percentiles: P50: 1.91 P75: 3.05 P99: 1238.60 P99.9: 3888.87 P99.99: 4387.06 ------------------------------------------------------ [ 0, 1 ] 4942 3.443% 3.443% # ( 1, 2 ] 73678 51.325% 54.768% ########## ( 2, 3 ] 28329 19.734% 74.502% #### ( 3, 4 ] 15098 10.517% 85.019% ## ( 4, 6 ] 14110 9.829% 94.849% ## ( 6, 10 ] 2827 1.969% 96.818% ( 10, 15 ] 622 0.433% 97.251% ( 15, 22 ] 78 0.054% 97.306% ( 22, 34 ] 6 0.004% 97.310% ( 34, 51 ] 9 0.006% 97.316% ( 51, 76 ] 9 0.006% 97.322% ( 76, 110 ] 10 0.007% 97.329% ( 110, 170 ] 55 0.038% 97.368% ( 170, 250 ] 122 0.085% 97.452% ( 250, 380 ] 238 0.166% 97.618% ( 380, 580 ] 559 0.389% 98.008% ( 580, 870 ] 749 0.522% 98.529% ( 870, 1300 ] 788 0.549% 99.078% ( 1300, 1900 ] 532 0.371% 99.449% ( 1900, 2900 ] 391 0.272% 99.721% ( 2900, 4400 ] 389 0.271% 99.992% ( 4400, 6600 ] 110 0.077% 100.069% ( 6600, 9900 ] 11 0.008% 100.077% ( 33000, 50000 ] 3 0.002% 100.079% ** Level 5 read latency histogram (micros): Count: 14021 Average: 1622.8047 StdDev: 1580.19 Min: 82 Median: 1116.7022 Max: 54061 Percentiles: P50: 1116.70 P75: 2169.36 P99: 6474.55 P99.9: 9758.84 P99.99: 46582.15 ------------------------------------------------------ ( 76, 110 ] 11 0.078% 0.078% ( 110, 170 ] 88 0.628% 0.706% ( 170, 250 ] 281 2.004% 2.710% ( 250, 380 ] 671 4.786% 7.496% # ( 380, 580 ] 1682 11.996% 19.492% ## ( 580, 870 ] 2690 19.186% 38.678% #### ( 870, 1300 ] 2767 19.735% 58.412% #### ( 1300, 1900 ] 1898 13.537% 71.949% ### ( 1900, 2900 ] 1588 11.326% 83.275% ## ( 2900, 4400 ] 1606 11.454% 94.729% ## ( 4400, 6600 ] 635 4.529% 99.258% # ( 6600, 9900 ] 94 0.670% 99.929% ( 9900, 14000 ] 5 0.036% 99.964% ( 22000, 33000 ] 2 0.014% 99.979% ( 33000, 50000 ] 2 0.014% 99.993% ( 50000, 75000 ] 1 0.007% 100.000% ** DB Stats ** Uptime(secs): 8.0 total, 7.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 122.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.839 H:M:S, 47.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 125.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.839 H:M:S, 49.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/14-10:36:13 ... thread 0: (1000000,2000000) ops and (145682.8,136144.6) ops/second in (6.864230,14.690265) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.11 GB 88.1 1.1 0.0 1.1 2.9 1.8 0.0 1.6 53.8 139.7 21.23 10.26 25 0.849 1158K 1694 0.0 0.0 L1 0/0 0.00 KB 0.0 0.8 0.8 0.0 0.8 0.8 0.0 1.0 120.9 120.5 6.83 4.06 1 6.830 838K 2457 0.0 0.0 L2 5/5 632.14 MB 0.0 0.3 0.3 0.1 0.3 0.2 0.8 1.2 102.6 101.9 3.09 1.52 1 3.094 322K 2065 0.0 0.0 L3 20/18 1.14 GB 0.2 4.3 2.7 1.6 4.3 2.7 0.5 1.6 105.8 105.1 41.99 20.60 22 1.908 2730K 6939 0.0 0.0 L4 177/0 9.75 GB 1.0 7.2 4.7 2.5 7.2 4.6 0.4 1.5 110.7 109.3 67.01 36.25 48 1.396 3428K 5598 0.0 0.0 L5 1140/0 93.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1350/27 106.36 GB 0.0 13.8 8.5 5.3 15.5 10.1 6.6 8.7 100.9 113.0 140.16 72.69 97 1.445 8479K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.8 8.5 5.3 15.5 10.1 6.6 8.7 100.9 113.0 140.16 72.69 97 1.445 8479K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.8 8.5 5.3 13.7 8.3 0.0 0.0 111.8 110.7 126.55 67.29 75 1.687 8479K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 134.3 13.60 5.39 22 0.618 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.9 total, 14.7 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.47 GB write, 1064.85 MB/s write, 13.81 GB read, 950.81 MB/s read, 140.2 seconds Interval compaction: 15.47 GB write, 1078.22 MB/s write, 13.81 GB read, 962.74 MB/s read, 140.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 60, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 554246 Average: 12.2822 StdDev: 214.34 Min: 1 Median: 1.7797 Max: 31144 Percentiles: P50: 1.78 P75: 2.76 P99: 11.36 P99.9: 1797.86 P99.99: 3912.79 ------------------------------------------------------ [ 0, 1 ] 41197 7.433% 7.433% # ( 1, 2 ] 302584 54.594% 62.027% ########### ( 2, 3 ] 94552 17.060% 79.086% ### ( 3, 4 ] 49482 8.928% 88.014% ## ( 4, 6 ] 49299 8.895% 96.909% ## ( 6, 10 ] 11039 1.992% 98.901% ( 10, 15 ] 2030 0.366% 99.267% ( 15, 22 ] 201 0.036% 99.303% ( 22, 34 ] 12 0.002% 99.305% ( 34, 51 ] 15 0.003% 99.308% ( 51, 76 ] 22 0.004% 99.312% ( 76, 110 ] 22 0.004% 99.316% ( 110, 170 ] 104 0.019% 99.335% ( 170, 250 ] 203 0.037% 99.371% ( 250, 380 ] 356 0.064% 99.436% ( 380, 580 ] 626 0.113% 99.549% ( 580, 870 ] 847 0.153% 99.701% ( 870, 1300 ] 735 0.133% 99.834% ( 1300, 1900 ] 442 0.080% 99.914% ( 1900, 2900 ] 246 0.044% 99.958% ( 2900, 4400 ] 263 0.047% 100.006% ( 4400, 6600 ] 62 0.011% 100.017% ( 6600, 9900 ] 16 0.003% 100.020% ( 9900, 14000 ] 12 0.002% 100.022% ( 14000, 22000 ] 22 0.004% 100.026% ( 22000, 33000 ] 10 0.002% 100.028% ** Level 1 read latency histogram (micros): Count: 175014 Average: 9.7719 StdDev: 133.01 Min: 1 Median: 1.9183 Max: 19512 Percentiles: P50: 1.92 P75: 2.99 P99: 11.61 P99.9: 1378.70 P99.99: 2629.58 ------------------------------------------------------ [ 0, 1 ] 5714 3.265% 3.265% # ( 1, 2 ] 89067 50.891% 54.156% ########## ( 2, 3 ] 37014 21.149% 75.305% #### ( 3, 4 ] 17639 10.079% 85.384% ## ( 4, 6 ] 18944 10.824% 96.208% ## ( 6, 10 ] 4560 2.606% 98.814% # ( 10, 15 ] 1017 0.581% 99.395% ( 15, 22 ] 137 0.078% 99.473% ( 22, 34 ] 22 0.013% 99.486% ( 34, 51 ] 32 0.018% 99.504% ( 51, 76 ] 27 0.015% 99.519% ( 76, 110 ] 13 0.007% 99.527% ( 110, 170 ] 23 0.013% 99.540% ( 170, 250 ] 61 0.035% 99.575% ( 250, 380 ] 115 0.066% 99.641% ( 380, 580 ] 134 0.077% 99.717% ( 580, 870 ] 176 0.101% 99.818% ( 870, 1300 ] 132 0.075% 99.893% ( 1300, 1900 ] 99 0.057% 99.950% ( 1900, 2900 ] 98 0.056% 100.006% ( 2900, 4400 ] 89 0.051% 100.057% ( 4400, 6600 ] 10 0.006% 100.062% ( 6600, 9900 ] 5 0.003% 100.065% ( 14000, 22000 ] 1 0.001% 100.066% ** Level 2 read latency histogram (micros): Count: 649884 Average: 12.4596 StdDev: 168.88 Min: 1 Median: 1.8738 Max: 24723 Percentiles: P50: 1.87 P75: 2.95 P99: 11.71 P99.9: 1628.10 P99.99: 2490.06 ------------------------------------------------------ [ 0, 1 ] 31335 4.822% 4.822% # ( 1, 2 ] 336014 51.704% 56.525% ########## ( 2, 3 ] 126879 19.523% 76.049% #### ( 3, 4 ] 63328 9.745% 85.793% ## ( 4, 6 ] 67456 10.380% 96.173% ## ( 6, 10 ] 16965 2.610% 98.783% # ( 10, 15 ] 4110 0.632% 99.416% ( 15, 22 ] 522 0.080% 99.496% ( 22, 34 ] 97 0.015% 99.511% ( 34, 51 ] 39 0.006% 99.517% ( 51, 76 ] 42 0.006% 99.523% ( 76, 110 ] 11 0.002% 99.525% ( 110, 170 ] 46 0.007% 99.532% ( 170, 250 ] 92 0.014% 99.546% ( 250, 380 ] 222 0.034% 99.581% ( 380, 580 ] 421 0.065% 99.645% ( 580, 870 ] 669 0.103% 99.748% ( 870, 1300 ] 652 0.100% 99.849% ( 1300, 1900 ] 611 0.094% 99.943% ( 1900, 2900 ] 522 0.080% 100.023% ( 2900, 4400 ] 483 0.074% 100.097% ( 4400, 6600 ] 115 0.018% 100.115% ( 6600, 9900 ] 17 0.003% 100.118% ( 9900, 14000 ] 3 0.000% 100.118% ( 14000, 22000 ] 5 0.001% 100.119% ( 22000, 33000 ] 2 0.000% 100.119% ** Level 3 read latency histogram (micros): Count: 1621181 Average: 12.7217 StdDev: 206.82 Min: 1 Median: 1.9087 Max: 55995 Percentiles: P50: 1.91 P75: 2.99 P99: 10.34 P99.9: 1050.76 P99.99: 1488.64 ------------------------------------------------------ [ 0, 1 ] 54340 3.352% 3.352% # ( 1, 2 ] 832207 51.333% 54.685% ########## ( 2, 3 ] 331555 20.451% 75.137% #### ( 3, 4 ] 166214 10.253% 85.389% ## ( 4, 6 ] 177798 10.967% 96.357% ## ( 6, 10 ] 42220 2.604% 98.961% # ( 10, 15 ] 9232 0.569% 99.530% ( 15, 22 ] 995 0.061% 99.592% ( 22, 34 ] 87 0.005% 99.597% ( 34, 51 ] 88 0.005% 99.602% ( 51, 76 ] 147 0.009% 99.612% ( 76, 110 ] 48 0.003% 99.614% ( 110, 170 ] 122 0.008% 99.622% ( 170, 250 ] 262 0.016% 99.638% ( 250, 380 ] 553 0.034% 99.672% ( 380, 580 ] 1108 0.068% 99.741% ( 580, 870 ] 1813 0.112% 99.852% ( 870, 1300 ] 1836 0.113% 99.966% ( 1300, 1900 ] 1256 0.077% 100.043% ( 1900, 2900 ] 1139 0.070% 100.113% ( 2900, 4400 ] 1039 0.064% 100.178% ( 4400, 6600 ] 280 0.017% 100.195% ( 6600, 9900 ] 63 0.004% 100.199% ( 9900, 14000 ] 20 0.001% 100.200% ( 14000, 22000 ] 52 0.003% 100.203% ( 22000, 33000 ] 13 0.001% 100.204% ( 33000, 50000 ] 2 0.000% 100.204% ( 50000, 75000 ] 1 0.000% 100.204% ** Level 4 read latency histogram (micros): Count: 662896 Average: 23.7239 StdDev: 323.48 Min: 1 Median: 1.8952 Max: 61823 Percentiles: P50: 1.90 P75: 2.98 P99: 485.86 P99.9: 2383.52 P99.99: 3358.42 ------------------------------------------------------ [ 0, 1 ] 24021 3.624% 3.624% # ( 1, 2 ] 343422 51.806% 55.430% ########## ( 2, 3 ] 131706 19.868% 75.298% #### ( 3, 4 ] 65556 9.889% 85.188% ## ( 4, 6 ] 69257 10.448% 95.635% ## ( 6, 10 ] 16298 2.459% 98.094% ( 10, 15 ] 3226 0.487% 98.580% ( 15, 22 ] 354 0.053% 98.634% ( 22, 34 ] 35 0.005% 98.639% ( 34, 51 ] 35 0.005% 98.644% ( 51, 76 ] 66 0.010% 98.654% ( 76, 110 ] 46 0.007% 98.661% ( 110, 170 ] 249 0.038% 98.699% ( 170, 250 ] 495 0.075% 98.774% ( 250, 380 ] 741 0.112% 98.885% ( 380, 580 ] 1436 0.217% 99.102% ( 580, 870 ] 1935 0.292% 99.394% ( 870, 1300 ] 1903 0.287% 99.681% ( 1300, 1900 ] 1103 0.166% 99.847% ( 1900, 2900 ] 722 0.109% 99.956% ( 2900, 4400 ] 732 0.110% 100.067% ( 4400, 6600 ] 219 0.033% 100.100% ( 6600, 9900 ] 69 0.010% 100.110% ( 9900, 14000 ] 19 0.003% 100.113% ( 14000, 22000 ] 44 0.007% 100.120% ( 22000, 33000 ] 18 0.003% 100.122% ( 33000, 50000 ] 5 0.001% 100.123% ( 50000, 75000 ] 1 0.000% 100.123% ** Level 5 read latency histogram (micros): Count: 33926 Average: 1275.8083 StdDev: 1728.03 Min: 80 Median: 824.9384 Max: 61578 Percentiles: P50: 824.92 P75: 1484.75 P99: 6301.05 P99.9: 22991.43 P99.99: 47847.65 ------------------------------------------------------ ( 76, 110 ] 145 0.427% 0.427% ( 110, 170 ] 1133 3.340% 3.767% # ( 170, 250 ] 1781 5.250% 9.017% # ( 250, 380 ] 2884 8.501% 17.518% ## ( 380, 580 ] 5194 15.310% 32.827% ### ( 580, 870 ] 6899 20.335% 53.163% #### ( 870, 1300 ] 6306 18.588% 71.750% #### ( 1300, 1900 ] 3583 10.561% 82.312% ## ( 1900, 2900 ] 2442 7.198% 89.510% # ( 2900, 4400 ] 2475 7.295% 96.805% # ( 4400, 6600 ] 863 2.544% 99.349% # ( 6600, 9900 ] 140 0.413% 99.761% ( 9900, 14000 ] 19 0.056% 99.817% ( 14000, 22000 ] 27 0.080% 99.897% ( 22000, 33000 ] 23 0.068% 99.965% ( 33000, 50000 ] 11 0.032% 99.997% ( 50000, 75000 ] 4 0.012% 100.009% ** DB Stats ** Uptime(secs): 14.9 total, 6.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 132.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.792 H:M:S, 45.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 143.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.953 H:M:S, 43.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/12/14-10:36:18 ... thread 0: (1000000,3000000) ops and (225906.4,156929.4) ops/second in (4.426613,19.116878) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 2.09 GB 69.2 1.9 0.0 1.9 4.7 2.8 0.0 1.7 68.3 167.0 28.70 16.22 41 0.700 1990K 2526 0.0 0.0 L1 0/0 0.00 KB 0.0 0.8 0.8 0.0 0.8 0.8 0.0 1.0 120.9 120.5 6.83 4.06 1 6.830 838K 2457 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.3 0.1 0.3 0.2 0.8 1.2 102.6 101.9 3.09 1.52 1 3.094 322K 2065 0.0 0.0 L3 18/1 1.10 GB 1.0 5.9 3.3 2.6 5.9 3.3 0.5 1.8 117.5 116.8 51.44 27.89 27 1.905 4360K 15K 0.0 0.0 L4 180/4 10.00 GB 1.0 8.6 5.3 3.3 8.5 5.1 0.5 1.6 116.7 115.0 75.32 42.62 56 1.345 4275K 9163 0.0 0.0 L5 1144/0 94.12 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1354/14 107.31 GB 0.0 17.5 9.6 7.9 20.1 12.2 7.0 7.3 108.5 124.6 165.39 92.31 126 1.313 11M 31K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.5 9.6 7.9 20.1 12.2 7.0 7.3 108.5 124.6 165.39 92.31 126 1.313 11M 31K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.5 9.6 7.9 17.4 9.5 0.0 0.0 121.5 120.4 147.64 84.11 91 1.622 11M 31K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 159.8 17.74 8.20 35 0.507 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.3 total, 19.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.12 GB write, 1067.34 MB/s write, 17.52 GB read, 929.20 MB/s read, 165.4 seconds Interval compaction: 20.12 GB write, 1077.64 MB/s write, 17.52 GB read, 938.16 MB/s read, 165.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 66, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 947323 Average: 9.4032 StdDev: 170.54 Min: 1 Median: 1.7321 Max: 31144 Percentiles: P50: 1.73 P75: 2.60 P99: 9.86 P99.9: 1270.87 P99.99: 3020.14 ------------------------------------------------------ [ 0, 1 ] 79749 8.418% 8.418% ## ( 1, 2 ] 538089 56.801% 65.219% ########### ( 2, 3 ] 154305 16.289% 81.508% ### ( 3, 4 ] 76462 8.071% 89.579% ## ( 4, 6 ] 73759 7.786% 97.365% ## ( 6, 10 ] 16044 1.694% 99.059% ( 10, 15 ] 2785 0.294% 99.353% ( 15, 22 ] 257 0.027% 99.380% ( 22, 34 ] 15 0.002% 99.382% ( 34, 51 ] 28 0.003% 99.385% ( 51, 76 ] 29 0.003% 99.388% ( 76, 110 ] 99 0.010% 99.398% ( 110, 170 ] 497 0.052% 99.451% ( 170, 250 ] 630 0.067% 99.517% ( 250, 380 ] 743 0.078% 99.595% ( 380, 580 ] 999 0.105% 99.701% ( 580, 870 ] 1085 0.115% 99.815% ( 870, 1300 ] 861 0.091% 99.906% ( 1300, 1900 ] 496 0.052% 99.959% ( 1900, 2900 ] 274 0.029% 99.988% ( 2900, 4400 ] 303 0.032% 100.020% ( 4400, 6600 ] 69 0.007% 100.027% ( 6600, 9900 ] 18 0.002% 100.029% ( 9900, 14000 ] 14 0.001% 100.030% ( 14000, 22000 ] 23 0.002% 100.033% ( 22000, 33000 ] 10 0.001% 100.034% ** Level 1 read latency histogram (micros): Count: 226007 Average: 8.9105 StdDev: 120.99 Min: 1 Median: 1.8842 Max: 19512 Percentiles: P50: 1.88 P75: 2.91 P99: 11.12 P99.9: 1211.38 P99.99: 2473.99 ------------------------------------------------------ [ 0, 1 ] 7733 3.422% 3.422% # ( 1, 2 ] 119057 52.678% 56.100% ########### ( 2, 3 ] 46817 20.715% 76.815% #### ( 3, 4 ] 21691 9.597% 86.412% ## ( 4, 6 ] 22551 9.978% 96.390% ## ( 6, 10 ] 5633 2.492% 98.883% ( 10, 15 ] 1178 0.521% 99.404% ( 15, 22 ] 162 0.072% 99.476% ( 22, 34 ] 22 0.010% 99.485% ( 34, 51 ] 32 0.014% 99.500% ( 51, 76 ] 28 0.012% 99.512% ( 76, 110 ] 18 0.008% 99.520% ( 110, 170 ] 58 0.026% 99.546% ( 170, 250 ] 97 0.043% 99.589% ( 250, 380 ] 162 0.072% 99.660% ( 380, 580 ] 184 0.081% 99.742% ( 580, 870 ] 227 0.100% 99.842% ( 870, 1300 ] 165 0.073% 99.915% ( 1300, 1900 ] 112 0.050% 99.965% ( 1900, 2900 ] 100 0.044% 100.009% ( 2900, 4400 ] 91 0.040% 100.049% ( 4400, 6600 ] 12 0.005% 100.054% ( 6600, 9900 ] 5 0.002% 100.057% ( 14000, 22000 ] 1 0.000% 100.057% ** Level 2 read latency histogram (micros): Count: 662709 Average: 12.2986 StdDev: 167.28 Min: 1 Median: 1.8684 Max: 24723 Percentiles: P50: 1.87 P75: 2.93 P99: 11.69 P99.9: 1615.97 P99.99: 2487.60 ------------------------------------------------------ [ 0, 1 ] 31971 4.824% 4.824% # ( 1, 2 ] 344772 52.025% 56.849% ########## ( 2, 3 ] 128828 19.440% 76.289% #### ( 3, 4 ] 63984 9.655% 85.943% ## ( 4, 6 ] 67957 10.254% 96.198% ## ( 6, 10 ] 17174 2.591% 98.789% # ( 10, 15 ] 4138 0.624% 99.414% ( 15, 22 ] 527 0.080% 99.493% ( 22, 34 ] 97 0.015% 99.508% ( 34, 51 ] 39 0.006% 99.514% ( 51, 76 ] 42 0.006% 99.520% ( 76, 110 ] 22 0.003% 99.523% ( 110, 170 ] 73 0.011% 99.534% ( 170, 250 ] 109 0.016% 99.551% ( 250, 380 ] 234 0.035% 99.586% ( 380, 580 ] 429 0.065% 99.651% ( 580, 870 ] 676 0.102% 99.753% ( 870, 1300 ] 652 0.098% 99.851% ( 1300, 1900 ] 612 0.092% 99.944% ( 1900, 2900 ] 522 0.079% 100.022% ( 2900, 4400 ] 483 0.073% 100.095% ( 4400, 6600 ] 115 0.017% 100.113% ( 6600, 9900 ] 17 0.003% 100.115% ( 9900, 14000 ] 3 0.000% 100.116% ( 14000, 22000 ] 5 0.001% 100.116% ( 22000, 33000 ] 2 0.000% 100.117% ** Level 3 read latency histogram (micros): Count: 1995137 Average: 11.4628 StdDev: 190.14 Min: 1 Median: 1.8912 Max: 55995 Percentiles: P50: 1.89 P75: 2.95 P99: 9.99 P99.9: 957.19 P99.99: 1401.66 ------------------------------------------------------ [ 0, 1 ] 67016 3.359% 3.359% # ( 1, 2 ] 1044107 52.333% 55.692% ########## ( 2, 3 ] 405186 20.309% 76.000% #### ( 3, 4 ] 198837 9.966% 85.966% ## ( 4, 6 ] 210512 10.551% 96.518% ## ( 6, 10 ] 49704 2.491% 99.009% ( 10, 15 ] 10549 0.529% 99.538% ( 15, 22 ] 1143 0.057% 99.595% ( 22, 34 ] 102 0.005% 99.600% ( 34, 51 ] 118 0.006% 99.606% ( 51, 76 ] 177 0.009% 99.615% ( 76, 110 ] 85 0.004% 99.619% ( 110, 170 ] 312 0.016% 99.635% ( 170, 250 ] 508 0.025% 99.660% ( 250, 380 ] 862 0.043% 99.703% ( 380, 580 ] 1410 0.071% 99.774% ( 580, 870 ] 2114 0.106% 99.880% ( 870, 1300 ] 1972 0.099% 99.979% ( 1300, 1900 ] 1319 0.066% 100.045% ( 1900, 2900 ] 1212 0.061% 100.106% ( 2900, 4400 ] 1081 0.054% 100.160% ( 4400, 6600 ] 285 0.014% 100.174% ( 6600, 9900 ] 65 0.003% 100.177% ( 9900, 14000 ] 22 0.001% 100.178% ( 14000, 22000 ] 55 0.003% 100.181% ( 22000, 33000 ] 13 0.001% 100.182% ( 33000, 50000 ] 2 0.000% 100.182% ( 50000, 75000 ] 1 0.000% 100.182% ** Level 4 read latency histogram (micros): Count: 872926 Average: 22.3781 StdDev: 293.12 Min: 1 Median: 1.8977 Max: 61823 Percentiles: P50: 1.90 P75: 2.99 P99: 462.85 P99.9: 2099.62 P99.99: 3075.29 ------------------------------------------------------ [ 0, 1 ] 30561 3.501% 3.501% # ( 1, 2 ] 452181 51.801% 55.302% ########## ( 2, 3 ] 172943 19.812% 75.113% #### ( 3, 4 ] 85909 9.841% 84.955% ## ( 4, 6 ] 90390 10.355% 95.310% ## ( 6, 10 ] 21389 2.450% 97.760% ( 10, 15 ] 4467 0.512% 98.272% ( 15, 22 ] 465 0.053% 98.325% ( 22, 34 ] 39 0.004% 98.330% ( 34, 51 ] 51 0.006% 98.335% ( 51, 76 ] 89 0.010% 98.346% ( 76, 110 ] 206 0.024% 98.369% ( 110, 170 ] 1129 0.129% 98.498% ( 170, 250 ] 1555 0.178% 98.677% ( 250, 380 ] 1802 0.206% 98.883% ( 380, 580 ] 2464 0.282% 99.165% ( 580, 870 ] 2703 0.310% 99.475% ( 870, 1300 ] 2293 0.263% 99.738% ( 1300, 1900 ] 1245 0.143% 99.880% ( 1900, 2900 ] 862 0.099% 99.979% ( 2900, 4400 ] 819 0.094% 100.073% ( 4400, 6600 ] 235 0.027% 100.100% ( 6600, 9900 ] 73 0.008% 100.108% ( 9900, 14000 ] 27 0.003% 100.111% ( 14000, 22000 ] 45 0.005% 100.116% ( 22000, 33000 ] 19 0.002% 100.119% ( 33000, 50000 ] 5 0.001% 100.119% ( 50000, 75000 ] 1 0.000% 100.119% ** Level 5 read latency histogram (micros): Count: 59944 Average: 936.2297 StdDev: 1424.47 Min: 78 Median: 564.9091 Max: 61578 Percentiles: P50: 564.91 P75: 1079.00 P99: 5726.12 P99.9: 15895.53 P99.99: 39190.47 ------------------------------------------------------ ( 76, 110 ] 1047 1.747% 1.747% ( 110, 170 ] 5677 9.471% 11.217% ## ( 170, 250 ] 6661 11.112% 22.329% ## ( 250, 380 ] 7483 12.483% 34.812% ## ( 380, 580 ] 9847 16.427% 51.239% ### ( 580, 870 ] 10343 17.254% 68.494% ### ( 870, 1300 ] 8024 13.386% 81.880% ### ( 1300, 1900 ] 4181 6.975% 88.855% # ( 1900, 2900 ] 2740 4.571% 93.426% # ( 2900, 4400 ] 2787 4.649% 98.075% # ( 4400, 6600 ] 920 1.535% 99.610% ( 6600, 9900 ] 142 0.237% 99.847% ( 9900, 14000 ] 24 0.040% 99.887% ( 14000, 22000 ] 34 0.057% 99.943% ( 22000, 33000 ] 24 0.040% 99.983% ( 33000, 50000 ] 11 0.018% 100.002% ( 50000, 75000 ] 4 0.007% 100.008% ** DB Stats ** Uptime(secs): 19.3 total, 4.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 152.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.439 H:M:S, 38.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 222.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.647 H:M:S, 14.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/14-10:36:21 ... thread 0: (1000000,4000000) ops and (287778.9,177055.6) ops/second in (3.474890,22.591768) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.97 GB 176.2 3.0 0.0 3.0 6.7 3.7 0.0 1.8 84.2 190.7 36.02 23.01 61 0.590 3077K 3660 0.0 0.0 L1 13/0 1.10 GB 112.8 1.9 1.9 0.0 1.9 1.9 0.0 1.0 148.5 148.0 13.18 9.36 2 6.592 1988K 7188 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.3 0.1 0.3 0.2 0.8 1.2 102.6 101.9 3.09 1.52 1 3.094 322K 2065 0.0 0.0 L3 17/0 998.81 MB 1.0 5.9 3.3 2.6 5.9 3.3 0.5 1.8 117.5 116.8 51.44 27.89 27 1.905 4360K 15K 0.0 0.0 L4 175/0 9.51 GB 1.0 8.9 5.4 3.6 8.8 5.3 0.5 1.6 118.3 116.6 77.47 44.36 57 1.359 4654K 11K 0.0 0.0 L5 1152/0 94.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1368/4 108.29 GB 0.0 20.0 10.9 9.2 23.6 14.4 7.7 6.3 113.2 133.4 181.20 106.14 148 1.224 14M 39K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.0 10.9 9.2 23.6 14.4 7.7 6.3 113.2 133.4 181.20 106.14 148 1.224 14M 39K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.0 10.9 9.2 19.9 10.7 0.0 0.0 128.0 126.9 160.27 95.18 97 1.652 14M 39K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 183.6 20.93 10.95 51 0.410 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.8 total, 22.6 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.61 GB write, 1061.54 MB/s write, 20.03 GB read, 900.58 MB/s read, 181.2 seconds Interval compaction: 23.61 GB write, 1070.21 MB/s write, 20.03 GB read, 907.93 MB/s read, 181.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 66, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1289644 Average: 8.6815 StdDev: 147.87 Min: 1 Median: 1.6573 Max: 31144 Percentiles: P50: 1.66 P75: 2.37 P99: 18.48 P99.9: 1004.49 P99.99: 2050.81 ------------------------------------------------------ [ 0, 1 ] 159646 12.379% 12.379% ## ( 1, 2 ] 738085 57.232% 69.611% ########### ( 2, 3 ] 187735 14.557% 84.168% ### ( 3, 4 ] 88865 6.891% 91.059% # ( 4, 6 ] 80708 6.258% 97.317% # ( 6, 10 ] 18248 1.415% 98.732% ( 10, 15 ] 3276 0.254% 98.986% ( 15, 22 ] 371 0.029% 99.014% ( 22, 34 ] 32 0.002% 99.017% ( 34, 51 ] 31 0.002% 99.019% ( 51, 76 ] 32 0.002% 99.022% ( 76, 110 ] 851 0.066% 99.088% ( 110, 170 ] 3537 0.274% 99.362% ( 170, 250 ] 2231 0.173% 99.535% ( 250, 380 ] 1515 0.117% 99.653% ( 380, 580 ] 1600 0.124% 99.777% ( 580, 870 ] 1313 0.102% 99.878% ( 870, 1300 ] 890 0.069% 99.947% ( 1300, 1900 ] 505 0.039% 99.987% ( 1900, 2900 ] 292 0.023% 100.009% ( 2900, 4400 ] 306 0.024% 100.033% ( 4400, 6600 ] 70 0.005% 100.038% ( 6600, 9900 ] 18 0.001% 100.040% ( 9900, 14000 ] 14 0.001% 100.041% ( 14000, 22000 ] 23 0.002% 100.043% ( 22000, 33000 ] 10 0.001% 100.043% ** Level 1 read latency histogram (micros): Count: 226732 Average: 9.3097 StdDev: 121.80 Min: 0 Median: 1.8867 Max: 19512 Percentiles: P50: 1.89 P75: 2.92 P99: 12.77 P99.9: 1224.80 P99.99: 2491.44 ------------------------------------------------------ [ 0, 1 ] 7751 3.419% 3.419% # ( 1, 2 ] 119110 52.533% 55.952% ########### ( 2, 3 ] 46899 20.685% 76.637% #### ( 3, 4 ] 21746 9.591% 86.228% ## ( 4, 6 ] 22651 9.990% 96.218% ## ( 6, 10 ] 5649 2.491% 98.709% ( 10, 15 ] 1187 0.524% 99.233% ( 15, 22 ] 162 0.071% 99.304% ( 22, 34 ] 22 0.010% 99.314% ( 34, 51 ] 32 0.014% 99.328% ( 51, 76 ] 28 0.012% 99.341% ( 76, 110 ] 74 0.033% 99.373% ( 110, 170 ] 225 0.099% 99.473% ( 170, 250 ] 172 0.076% 99.548% ( 250, 380 ] 206 0.091% 99.639% ( 380, 580 ] 211 0.093% 99.732% ( 580, 870 ] 240 0.106% 99.838% ( 870, 1300 ] 170 0.075% 99.913% ( 1300, 1900 ] 114 0.050% 99.963% ( 1900, 2900 ] 102 0.045% 100.008% ( 2900, 4400 ] 92 0.041% 100.049% ( 4400, 6600 ] 12 0.005% 100.054% ( 6600, 9900 ] 5 0.002% 100.056% ( 14000, 22000 ] 1 0.000% 100.057% ** Level 2 read latency histogram (micros): Count: 662709 Average: 12.2986 StdDev: 167.28 Min: 1 Median: 1.8684 Max: 24723 Percentiles: P50: 1.87 P75: 2.93 P99: 11.69 P99.9: 1615.97 P99.99: 2487.60 ------------------------------------------------------ [ 0, 1 ] 31971 4.824% 4.824% # ( 1, 2 ] 344772 52.025% 56.849% ########## ( 2, 3 ] 128828 19.440% 76.289% #### ( 3, 4 ] 63984 9.655% 85.943% ## ( 4, 6 ] 67957 10.254% 96.198% ## ( 6, 10 ] 17174 2.591% 98.789% # ( 10, 15 ] 4138 0.624% 99.414% ( 15, 22 ] 527 0.080% 99.493% ( 22, 34 ] 97 0.015% 99.508% ( 34, 51 ] 39 0.006% 99.514% ( 51, 76 ] 42 0.006% 99.520% ( 76, 110 ] 22 0.003% 99.523% ( 110, 170 ] 73 0.011% 99.534% ( 170, 250 ] 109 0.016% 99.551% ( 250, 380 ] 234 0.035% 99.586% ( 380, 580 ] 429 0.065% 99.651% ( 580, 870 ] 676 0.102% 99.753% ( 870, 1300 ] 652 0.098% 99.851% ( 1300, 1900 ] 612 0.092% 99.944% ( 1900, 2900 ] 522 0.079% 100.022% ( 2900, 4400 ] 483 0.073% 100.095% ( 4400, 6600 ] 115 0.017% 100.113% ( 6600, 9900 ] 17 0.003% 100.115% ( 9900, 14000 ] 3 0.000% 100.116% ( 14000, 22000 ] 5 0.001% 100.116% ( 22000, 33000 ] 2 0.000% 100.117% ** Level 3 read latency histogram (micros): Count: 1997626 Average: 11.5354 StdDev: 190.08 Min: 1 Median: 1.8914 Max: 55995 Percentiles: P50: 1.89 P75: 2.95 P99: 10.30 P99.9: 957.52 P99.99: 1401.55 ------------------------------------------------------ [ 0, 1 ] 67069 3.357% 3.357% # ( 1, 2 ] 1045214 52.323% 55.680% ########## ( 2, 3 ] 405496 20.299% 75.979% #### ( 3, 4 ] 198920 9.958% 85.937% ## ( 4, 6 ] 210586 10.542% 96.479% ## ( 6, 10 ] 49737 2.490% 98.969% ( 10, 15 ] 10554 0.528% 99.497% ( 15, 22 ] 1143 0.057% 99.554% ( 22, 34 ] 102 0.005% 99.559% ( 34, 51 ] 118 0.006% 99.565% ( 51, 76 ] 177 0.009% 99.574% ( 76, 110 ] 215 0.011% 99.585% ( 110, 170 ] 668 0.033% 99.618% ( 170, 250 ] 679 0.034% 99.652% ( 250, 380 ] 936 0.047% 99.699% ( 380, 580 ] 1477 0.074% 99.773% ( 580, 870 ] 2135 0.107% 99.880% ( 870, 1300 ] 1977 0.099% 99.979% ( 1300, 1900 ] 1319 0.066% 100.045% ( 1900, 2900 ] 1212 0.061% 100.106% ( 2900, 4400 ] 1081 0.054% 100.160% ( 4400, 6600 ] 285 0.014% 100.174% ( 6600, 9900 ] 65 0.003% 100.177% ( 9900, 14000 ] 22 0.001% 100.178% ( 14000, 22000 ] 55 0.003% 100.181% ( 22000, 33000 ] 13 0.001% 100.182% ( 33000, 50000 ] 2 0.000% 100.182% ( 50000, 75000 ] 1 0.000% 100.182% ** Level 4 read latency histogram (micros): Count: 881074 Average: 23.9767 StdDev: 292.70 Min: 1 Median: 1.9065 Max: 61823 Percentiles: P50: 1.91 P75: 3.06 P99: 497.71 P99.9: 2099.69 P99.99: 3075.41 ------------------------------------------------------ [ 0, 1 ] 30568 3.469% 3.469% # ( 1, 2 ] 452260 51.331% 54.800% ########## ( 2, 3 ] 173167 19.654% 74.454% #### ( 3, 4 ] 86028 9.764% 84.218% ## ( 4, 6 ] 90613 10.284% 94.502% ## ( 6, 10 ] 21429 2.432% 96.935% ( 10, 15 ] 4477 0.508% 97.443% ( 15, 22 ] 468 0.053% 97.496% ( 22, 34 ] 40 0.005% 97.500% ( 34, 51 ] 51 0.006% 97.506% ( 51, 76 ] 90 0.010% 97.516% ( 76, 110 ] 1235 0.140% 97.656% ( 110, 170 ] 4446 0.505% 98.161% ( 170, 250 ] 3047 0.346% 98.507% ( 250, 380 ] 2545 0.289% 98.796% ( 380, 580 ] 3057 0.347% 99.143% ( 580, 870 ] 2923 0.332% 99.475% ( 870, 1300 ] 2324 0.264% 99.738% ( 1300, 1900 ] 1251 0.142% 99.880% ( 1900, 2900 ] 871 0.099% 99.979% ( 2900, 4400 ] 820 0.093% 100.072% ( 4400, 6600 ] 235 0.027% 100.099% ( 6600, 9900 ] 73 0.008% 100.107% ( 9900, 14000 ] 27 0.003% 100.110% ( 14000, 22000 ] 45 0.005% 100.115% ( 22000, 33000 ] 19 0.002% 100.117% ( 33000, 50000 ] 5 0.001% 100.118% ( 50000, 75000 ] 1 0.000% 100.118% ** Level 5 read latency histogram (micros): Count: 102025 Average: 636.6035 StdDev: 1153.35 Min: 76 Median: 298.5840 Max: 61578 Percentiles: P50: 298.58 P75: 709.38 P99: 4707.88 P99.9: 9550.83 P99.99: 30615.52 ------------------------------------------------------ ( 51, 76 ] 1 0.001% 0.001% ( 76, 110 ] 6783 6.648% 6.649% # ( 110, 170 ] 24835 24.342% 30.991% ##### ( 170, 250 ] 15114 14.814% 45.805% ### ( 250, 380 ] 11451 11.224% 57.029% ## ( 380, 580 ] 13197 12.935% 69.964% ### ( 580, 870 ] 11516 11.287% 81.252% ## ( 870, 1300 ] 8220 8.057% 89.309% ## ( 1300, 1900 ] 4202 4.119% 93.427% # ( 1900, 2900 ] 2767 2.712% 96.139% # ( 2900, 4400 ] 2790 2.735% 98.874% # ( 4400, 6600 ] 920 0.902% 99.776% ( 6600, 9900 ] 142 0.139% 99.915% ( 9900, 14000 ] 24 0.024% 99.938% ( 14000, 22000 ] 34 0.033% 99.972% ( 22000, 33000 ] 24 0.024% 99.995% ( 33000, 50000 ] 11 0.011% 100.006% ( 50000, 75000 ] 4 0.004% 100.010% ** DB Stats ** Uptime(secs): 22.8 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 172.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.439 H:M:S, 32.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 283.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-10:36:25 ... thread 0: (1000000,5000000) ops and (294361.9,192389.5) ops/second in (3.397179,25.988947) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 2.95 GB 251.7 3.7 0.0 3.7 8.4 4.7 0.0 1.8 90.4 206.1 41.89 28.43 80 0.524 3845K 4394 0.0 0.0 L1 13/0 1.10 GB 112.8 1.9 1.9 0.0 1.9 1.9 0.0 1.0 148.5 148.0 13.18 9.36 2 6.592 1988K 7188 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.3 0.1 0.3 0.2 0.8 1.2 102.6 101.9 3.09 1.52 1 3.094 322K 2065 0.0 0.0 L3 17/0 998.81 MB 1.0 5.9 3.3 2.6 5.9 3.3 0.5 1.8 117.5 116.8 51.44 27.89 27 1.905 4360K 15K 0.0 0.0 L4 175/0 9.51 GB 1.0 8.9 5.4 3.6 8.8 5.3 0.5 1.6 118.3 116.6 77.47 44.36 57 1.359 4654K 11K 0.0 0.0 L5 1152/0 94.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1375/8 109.27 GB 0.0 20.8 10.9 9.9 25.3 15.4 7.7 5.3 113.7 138.7 187.07 111.56 167 1.120 15M 40K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.8 10.9 9.9 25.3 15.4 7.7 5.3 113.7 138.7 187.07 111.56 167 1.120 15M 40K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.8 10.9 9.9 20.6 10.7 0.0 0.0 130.4 129.3 163.09 97.95 100 1.631 15M 40K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 202.3 23.98 13.60 67 0.358 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.2 total, 26.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.34 GB write, 991.14 MB/s write, 20.77 GB read, 812.58 MB/s read, 187.1 seconds Interval compaction: 25.34 GB write, 998.17 MB/s write, 20.77 GB read, 818.34 MB/s read, 187.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 66, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1542845 Average: 7.9417 StdDev: 135.74 Min: 0 Median: 1.6028 Max: 31144 Percentiles: P50: 1.60 P75: 2.18 P99: 34.84 P99.9: 866.62 P99.99: 1854.05 ------------------------------------------------------ [ 0, 1 ] 240383 15.581% 15.581% ### ( 1, 2 ] 880977 57.101% 72.681% ########### ( 2, 3 ] 202873 13.149% 85.831% ### ( 3, 4 ] 94828 6.146% 91.977% # ( 4, 6 ] 85342 5.531% 97.508% # ( 6, 10 ] 19101 1.238% 98.746% ( 10, 15 ] 3485 0.226% 98.972% ( 15, 22 ] 393 0.025% 98.998% ( 22, 34 ] 35 0.002% 99.000% ( 34, 51 ] 31 0.002% 99.002% ( 51, 76 ] 34 0.002% 99.004% ( 76, 110 ] 1144 0.074% 99.078% ( 110, 170 ] 4854 0.315% 99.393% ( 170, 250 ] 2958 0.192% 99.585% ( 250, 380 ] 1751 0.113% 99.698% ( 380, 580 ] 1771 0.115% 99.813% ( 580, 870 ] 1360 0.088% 99.901% ( 870, 1300 ] 899 0.058% 99.959% ( 1300, 1900 ] 513 0.033% 99.993% ( 1900, 2900 ] 297 0.019% 100.012% ( 2900, 4400 ] 308 0.020% 100.032% ( 4400, 6600 ] 70 0.005% 100.036% ( 6600, 9900 ] 18 0.001% 100.038% ( 9900, 14000 ] 14 0.001% 100.039% ( 14000, 22000 ] 23 0.001% 100.040% ( 22000, 33000 ] 10 0.001% 100.041% ** Level 1 read latency histogram (micros): Count: 228087 Average: 9.8882 StdDev: 122.03 Min: 0 Median: 1.8921 Max: 19512 Percentiles: P50: 1.89 P75: 2.94 P99: 76.54 P99.9: 1224.34 P99.99: 2490.11 ------------------------------------------------------ [ 0, 1 ] 7753 3.399% 3.399% # ( 1, 2 ] 119146 52.237% 55.636% ########## ( 2, 3 ] 47037 20.622% 76.259% #### ( 3, 4 ] 21872 9.589% 85.848% ## ( 4, 6 ] 22886 10.034% 95.882% ## ( 6, 10 ] 5672 2.487% 98.369% ( 10, 15 ] 1193 0.523% 98.892% ( 15, 22 ] 162 0.071% 98.963% ( 22, 34 ] 22 0.010% 98.972% ( 34, 51 ] 32 0.014% 98.986% ( 51, 76 ] 28 0.012% 98.999% ( 76, 110 ] 198 0.087% 99.085% ( 110, 170 ] 651 0.285% 99.371% ( 170, 250 ] 306 0.134% 99.505% ( 250, 380 ] 266 0.117% 99.622% ( 380, 580 ] 242 0.106% 99.728% ( 580, 870 ] 252 0.110% 99.838% ( 870, 1300 ] 171 0.075% 99.913% ( 1300, 1900 ] 115 0.050% 99.964% ( 1900, 2900 ] 102 0.045% 100.008% ( 2900, 4400 ] 92 0.040% 100.049% ( 4400, 6600 ] 12 0.005% 100.054% ( 6600, 9900 ] 5 0.002% 100.056% ( 14000, 22000 ] 1 0.000% 100.057% ** Level 2 read latency histogram (micros): Count: 662709 Average: 12.2986 StdDev: 167.28 Min: 1 Median: 1.8684 Max: 24723 Percentiles: P50: 1.87 P75: 2.93 P99: 11.69 P99.9: 1615.97 P99.99: 2487.60 ------------------------------------------------------ [ 0, 1 ] 31971 4.824% 4.824% # ( 1, 2 ] 344772 52.025% 56.849% ########## ( 2, 3 ] 128828 19.440% 76.289% #### ( 3, 4 ] 63984 9.655% 85.943% ## ( 4, 6 ] 67957 10.254% 96.198% ## ( 6, 10 ] 17174 2.591% 98.789% # ( 10, 15 ] 4138 0.624% 99.414% ( 15, 22 ] 527 0.080% 99.493% ( 22, 34 ] 97 0.015% 99.508% ( 34, 51 ] 39 0.006% 99.514% ( 51, 76 ] 42 0.006% 99.520% ( 76, 110 ] 22 0.003% 99.523% ( 110, 170 ] 73 0.011% 99.534% ( 170, 250 ] 109 0.016% 99.551% ( 250, 380 ] 234 0.035% 99.586% ( 380, 580 ] 429 0.065% 99.651% ( 580, 870 ] 676 0.102% 99.753% ( 870, 1300 ] 652 0.098% 99.851% ( 1300, 1900 ] 612 0.092% 99.944% ( 1900, 2900 ] 522 0.079% 100.022% ( 2900, 4400 ] 483 0.073% 100.095% ( 4400, 6600 ] 115 0.017% 100.113% ( 6600, 9900 ] 17 0.003% 100.115% ( 9900, 14000 ] 3 0.000% 100.116% ( 14000, 22000 ] 5 0.001% 100.116% ( 22000, 33000 ] 2 0.000% 100.117% ** Level 3 read latency histogram (micros): Count: 1998501 Average: 11.6158 StdDev: 190.12 Min: 1 Median: 1.8919 Max: 55995 Percentiles: P50: 1.89 P75: 2.95 P99: 10.71 P99.9: 958.97 P99.99: 1402.42 ------------------------------------------------------ [ 0, 1 ] 67069 3.356% 3.356% # ( 1, 2 ] 1045214 52.300% 55.656% ########## ( 2, 3 ] 405496 20.290% 75.946% #### ( 3, 4 ] 198920 9.953% 85.899% ## ( 4, 6 ] 210586 10.537% 96.437% ## ( 6, 10 ] 49737 2.489% 98.925% ( 10, 15 ] 10554 0.528% 99.453% ( 15, 22 ] 1143 0.057% 99.511% ( 22, 34 ] 102 0.005% 99.516% ( 34, 51 ] 118 0.006% 99.522% ( 51, 76 ] 177 0.009% 99.530% ( 76, 110 ] 371 0.019% 99.549% ( 110, 170 ] 1085 0.054% 99.603% ( 170, 250 ] 853 0.043% 99.646% ( 250, 380 ] 992 0.050% 99.696% ( 380, 580 ] 1527 0.076% 99.772% ( 580, 870 ] 2148 0.107% 99.879% ( 870, 1300 ] 1984 0.099% 99.979% ( 1300, 1900 ] 1319 0.066% 100.045% ( 1900, 2900 ] 1213 0.061% 100.105% ( 2900, 4400 ] 1082 0.054% 100.160% ( 4400, 6600 ] 285 0.014% 100.174% ( 6600, 9900 ] 65 0.003% 100.177% ( 9900, 14000 ] 22 0.001% 100.178% ( 14000, 22000 ] 55 0.003% 100.181% ( 22000, 33000 ] 13 0.001% 100.182% ( 33000, 50000 ] 2 0.000% 100.182% ( 50000, 75000 ] 1 0.000% 100.182% ** Level 4 read latency histogram (micros): Count: 889497 Average: 25.4447 StdDev: 292.00 Min: 1 Median: 1.9157 Max: 61823 Percentiles: P50: 1.92 P75: 3.13 P99: 513.01 P99.9: 2095.78 P99.99: 3075.49 ------------------------------------------------------ [ 0, 1 ] 30568 3.437% 3.437% # ( 1, 2 ] 452287 50.848% 54.284% ########## ( 2, 3 ] 173257 19.478% 73.762% #### ( 3, 4 ] 86117 9.682% 83.444% ## ( 4, 6 ] 90760 10.204% 93.647% ## ( 6, 10 ] 21447 2.411% 96.058% ( 10, 15 ] 4485 0.504% 96.563% ( 15, 22 ] 469 0.053% 96.615% ( 22, 34 ] 40 0.004% 96.620% ( 34, 51 ] 51 0.006% 96.626% ( 51, 76 ] 91 0.010% 96.636% ( 76, 110 ] 2555 0.287% 96.923% ( 110, 170 ] 8479 0.953% 97.876% ( 170, 250 ] 4585 0.515% 98.392% ( 250, 380 ] 3068 0.345% 98.737% ( 380, 580 ] 3523 0.396% 99.133% ( 580, 870 ] 3060 0.344% 99.477% ( 870, 1300 ] 2339 0.263% 99.740% ( 1300, 1900 ] 1255 0.141% 99.881% ( 1900, 2900 ] 876 0.098% 99.979% ( 2900, 4400 ] 821 0.092% 100.072% ( 4400, 6600 ] 235 0.026% 100.098% ( 6600, 9900 ] 73 0.008% 100.106% ( 9900, 14000 ] 27 0.003% 100.109% ( 14000, 22000 ] 45 0.005% 100.114% ( 22000, 33000 ] 19 0.002% 100.116% ( 33000, 50000 ] 5 0.001% 100.117% ( 50000, 75000 ] 1 0.000% 100.117% ** Level 5 read latency histogram (micros): Count: 146986 Average: 499.8617 StdDev: 985.87 Min: 74 Median: 210.9658 Max: 61578 Percentiles: P50: 210.97 P75: 515.21 P99: 4225.91 P99.9: 8413.00 P99.99: 26721.47 ------------------------------------------------------ ( 51, 76 ] 4 0.003% 0.003% ( 76, 110 ] 14299 9.728% 9.731% ## ( 110, 170 ] 47271 32.160% 41.891% ###### ( 170, 250 ] 23276 15.836% 57.727% ### ( 250, 380 ] 14585 9.923% 67.649% ## ( 380, 580 ] 15982 10.873% 78.522% ## ( 580, 870 ] 12267 8.346% 86.868% ## ( 870, 1300 ] 8343 5.676% 92.544% # ( 1300, 1900 ] 4224 2.874% 95.418% # ( 1900, 2900 ] 2791 1.899% 97.317% ( 2900, 4400 ] 2799 1.904% 99.221% ( 4400, 6600 ] 920 0.626% 99.847% ( 6600, 9900 ] 142 0.097% 99.944% ( 9900, 14000 ] 24 0.016% 99.960% ( 14000, 22000 ] 34 0.023% 99.983% ( 22000, 33000 ] 24 0.016% 99.999% ( 33000, 50000 ] 11 0.007% 100.007% ( 50000, 75000 ] 4 0.003% 100.010% ** DB Stats ** Uptime(secs): 26.2 total, 3.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 188.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.439 H:M:S, 28.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 289.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-10:36:30 ... thread 0: (1000000,6000000) ops and (169789.1,188214.0) ops/second in (5.889660,31.878607) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 3.87 GB 25.2 4.9 0.0 4.9 10.6 5.7 0.0 1.9 102.0 219.0 49.48 35.58 100 0.495 5124K 5644 0.0 0.0 L1 13/13 1.10 GB 0.0 1.9 1.9 0.0 1.9 1.9 0.0 1.0 148.5 148.0 13.18 9.36 2 6.592 1988K 7188 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.3 0.1 0.3 0.2 0.8 1.2 102.6 101.9 3.09 1.52 1 3.094 322K 2065 0.0 0.0 L3 17/0 998.81 MB 1.0 5.9 3.3 2.6 5.9 3.3 0.5 1.8 117.5 116.8 51.44 27.89 27 1.905 4360K 15K 0.0 0.0 L4 175/0 9.51 GB 1.0 8.9 5.4 3.6 8.8 5.3 0.5 1.6 118.3 116.6 77.47 44.36 57 1.359 4654K 11K 0.0 0.0 L5 1152/0 94.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1375/30 110.19 GB 0.0 22.0 10.9 11.1 27.5 16.3 7.7 4.9 115.7 144.6 194.66 118.71 187 1.041 16M 41K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.0 10.9 11.1 27.5 16.3 7.7 4.9 115.7 144.6 194.66 118.71 187 1.041 16M 41K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.0 10.9 11.1 21.8 10.7 0.0 0.0 134.2 133.1 167.89 102.65 105 1.599 16M 41K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 216.5 26.77 16.06 82 0.327 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.1 total, 31.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.49 GB write, 877.81 MB/s write, 22.00 GB read, 702.62 MB/s read, 194.7 seconds Interval compaction: 27.49 GB write, 882.89 MB/s write, 22.00 GB read, 706.69 MB/s read, 194.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 66, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1860593 Average: 8.4207 StdDev: 125.13 Min: 0 Median: 1.5832 Max: 31144 Percentiles: P50: 1.58 P75: 2.14 P99: 148.16 P99.9: 782.35 P99.99: 1643.95 ------------------------------------------------------ [ 0, 1 ] 325388 17.488% 17.488% ### ( 1, 2 ] 1037147 55.743% 73.231% ########### ( 2, 3 ] 231673 12.452% 85.683% ## ( 3, 4 ] 113538 6.102% 91.785% # ( 4, 6 ] 95725 5.145% 96.930% # ( 6, 10 ] 21121 1.135% 98.065% ( 10, 15 ] 3929 0.211% 98.276% ( 15, 22 ] 456 0.025% 98.301% ( 22, 34 ] 43 0.002% 98.303% ( 34, 51 ] 32 0.002% 98.305% ( 51, 76 ] 40 0.002% 98.307% ( 76, 110 ] 3865 0.208% 98.515% ( 110, 170 ] 14200 0.763% 99.278% ( 170, 250 ] 5694 0.306% 99.584% ( 250, 380 ] 2478 0.133% 99.717% ( 380, 580 ] 2340 0.126% 99.843% ( 580, 870 ] 1524 0.082% 99.925% ( 870, 1300 ] 917 0.049% 99.974% ( 1300, 1900 ] 518 0.028% 100.002% ( 1900, 2900 ] 305 0.016% 100.018% ( 2900, 4400 ] 315 0.017% 100.035% ( 4400, 6600 ] 70 0.004% 100.039% ( 6600, 9900 ] 18 0.001% 100.040% ( 9900, 14000 ] 14 0.001% 100.041% ( 14000, 22000 ] 23 0.001% 100.042% ( 22000, 33000 ] 10 0.001% 100.042% ** Level 1 read latency histogram (micros): Count: 241163 Average: 11.0687 StdDev: 120.01 Min: 0 Median: 1.9391 Max: 19512 Percentiles: P50: 1.94 P75: 3.14 P99: 155.25 P99.9: 1192.09 P99.99: 2477.29 ------------------------------------------------------ [ 0, 1 ] 7784 3.228% 3.228% # ( 1, 2 ] 120113 49.806% 53.033% ########## ( 2, 3 ] 49435 20.499% 73.532% #### ( 3, 4 ] 25495 10.572% 84.104% ## ( 4, 6 ] 25877 10.730% 94.834% ## ( 6, 10 ] 6227 2.582% 97.416% # ( 10, 15 ] 1302 0.540% 97.956% ( 15, 22 ] 267 0.111% 98.066% ( 22, 34 ] 26 0.011% 98.077% ( 34, 51 ] 33 0.014% 98.091% ( 51, 76 ] 30 0.012% 98.103% ( 76, 110 ] 715 0.296% 98.400% ( 110, 170 ] 1919 0.796% 99.196% ( 170, 250 ] 628 0.260% 99.456% ( 250, 380 ] 362 0.150% 99.606% ( 380, 580 ] 314 0.130% 99.736% ( 580, 870 ] 266 0.110% 99.847% ( 870, 1300 ] 172 0.071% 99.918% ( 1300, 1900 ] 115 0.048% 99.966% ( 1900, 2900 ] 102 0.042% 100.008% ( 2900, 4400 ] 93 0.039% 100.046% ( 4400, 6600 ] 12 0.005% 100.051% ( 6600, 9900 ] 5 0.002% 100.053% ( 14000, 22000 ] 1 0.000% 100.054% ** Level 2 read latency histogram (micros): Count: 662709 Average: 12.2986 StdDev: 167.28 Min: 1 Median: 1.8684 Max: 24723 Percentiles: P50: 1.87 P75: 2.93 P99: 11.69 P99.9: 1615.97 P99.99: 2487.60 ------------------------------------------------------ [ 0, 1 ] 31971 4.824% 4.824% # ( 1, 2 ] 344772 52.025% 56.849% ########## ( 2, 3 ] 128828 19.440% 76.289% #### ( 3, 4 ] 63984 9.655% 85.943% ## ( 4, 6 ] 67957 10.254% 96.198% ## ( 6, 10 ] 17174 2.591% 98.789% # ( 10, 15 ] 4138 0.624% 99.414% ( 15, 22 ] 527 0.080% 99.493% ( 22, 34 ] 97 0.015% 99.508% ( 34, 51 ] 39 0.006% 99.514% ( 51, 76 ] 42 0.006% 99.520% ( 76, 110 ] 22 0.003% 99.523% ( 110, 170 ] 73 0.011% 99.534% ( 170, 250 ] 109 0.016% 99.551% ( 250, 380 ] 234 0.035% 99.586% ( 380, 580 ] 429 0.065% 99.651% ( 580, 870 ] 676 0.102% 99.753% ( 870, 1300 ] 652 0.098% 99.851% ( 1300, 1900 ] 612 0.092% 99.944% ( 1900, 2900 ] 522 0.079% 100.022% ( 2900, 4400 ] 483 0.073% 100.095% ( 4400, 6600 ] 115 0.017% 100.113% ( 6600, 9900 ] 17 0.003% 100.115% ( 9900, 14000 ] 3 0.000% 100.116% ( 14000, 22000 ] 5 0.001% 100.116% ( 22000, 33000 ] 2 0.000% 100.117% ** Level 3 read latency histogram (micros): Count: 2000224 Average: 11.7459 StdDev: 190.12 Min: 1 Median: 1.8927 Max: 55995 Percentiles: P50: 1.89 P75: 2.96 P99: 11.52 P99.9: 959.54 P99.99: 1403.17 ------------------------------------------------------ [ 0, 1 ] 67069 3.353% 3.353% # ( 1, 2 ] 1045214 52.255% 55.608% ########## ( 2, 3 ] 405496 20.273% 75.880% #### ( 3, 4 ] 198920 9.945% 85.825% ## ( 4, 6 ] 210586 10.528% 96.353% ## ( 6, 10 ] 49737 2.487% 98.840% ( 10, 15 ] 10554 0.528% 99.368% ( 15, 22 ] 1143 0.057% 99.425% ( 22, 34 ] 102 0.005% 99.430% ( 34, 51 ] 118 0.006% 99.436% ( 51, 76 ] 177 0.009% 99.445% ( 76, 110 ] 765 0.038% 99.483% ( 110, 170 ] 2046 0.102% 99.585% ( 170, 250 ] 1087 0.054% 99.640% ( 250, 380 ] 1050 0.052% 99.692% ( 380, 580 ] 1582 0.079% 99.771% ( 580, 870 ] 2164 0.108% 99.879% ( 870, 1300 ] 1987 0.099% 99.979% ( 1300, 1900 ] 1320 0.066% 100.045% ( 1900, 2900 ] 1213 0.061% 100.105% ( 2900, 4400 ] 1083 0.054% 100.159% ( 4400, 6600 ] 285 0.014% 100.174% ( 6600, 9900 ] 65 0.003% 100.177% ( 9900, 14000 ] 22 0.001% 100.178% ( 14000, 22000 ] 55 0.003% 100.181% ( 22000, 33000 ] 13 0.001% 100.181% ( 33000, 50000 ] 2 0.000% 100.182% ( 50000, 75000 ] 1 0.000% 100.182% ** Level 4 read latency histogram (micros): Count: 905942 Average: 27.9563 StdDev: 290.28 Min: 1 Median: 1.9339 Max: 61823 Percentiles: P50: 1.93 P75: 3.27 P99: 523.41 P99.9: 2081.88 P99.99: 3074.10 ------------------------------------------------------ [ 0, 1 ] 30568 3.374% 3.374% # ( 1, 2 ] 452290 49.925% 53.299% ########## ( 2, 3 ] 173282 19.127% 72.426% #### ( 3, 4 ] 86133 9.508% 81.934% ## ( 4, 6 ] 90793 10.022% 91.956% ## ( 6, 10 ] 21450 2.368% 94.323% ( 10, 15 ] 4486 0.495% 94.819% ( 15, 22 ] 469 0.052% 94.870% ( 22, 34 ] 40 0.004% 94.875% ( 34, 51 ] 51 0.006% 94.880% ( 51, 76 ] 92 0.010% 94.891% ( 76, 110 ] 5934 0.655% 95.546% ( 110, 170 ] 17642 1.947% 97.493% ( 170, 250 ] 6934 0.765% 98.258% ( 250, 380 ] 3778 0.417% 98.675% ( 380, 580 ] 4101 0.453% 99.128% ( 580, 870 ] 3216 0.355% 99.483% ( 870, 1300 ] 2359 0.260% 99.743% ( 1300, 1900 ] 1258 0.139% 99.882% ( 1900, 2900 ] 880 0.097% 99.979% ( 2900, 4400 ] 822 0.091% 100.070% ( 4400, 6600 ] 235 0.026% 100.096% ( 6600, 9900 ] 73 0.008% 100.104% ( 9900, 14000 ] 27 0.003% 100.107% ( 14000, 22000 ] 45 0.005% 100.112% ( 22000, 33000 ] 19 0.002% 100.114% ( 33000, 50000 ] 5 0.001% 100.115% ( 50000, 75000 ] 1 0.000% 100.115% ** Level 5 read latency histogram (micros): Count: 234169 Average: 375.0539 StdDev: 800.48 Min: 74 Median: 162.6428 Max: 61578 Percentiles: P50: 162.64 P75: 331.10 P99: 3758.53 P99.9: 6573.29 P99.99: 21901.91 ------------------------------------------------------ ( 51, 76 ] 13 0.006% 0.006% ( 76, 110 ] 32493 13.876% 13.881% ### ( 110, 170 ] 96399 41.166% 55.048% ######## ( 170, 250 ] 35201 15.032% 70.080% ### ( 250, 380 ] 18467 7.886% 77.966% ## ( 380, 580 ] 19086 8.151% 86.117% ## ( 580, 870 ] 13039 5.568% 91.685% # ( 870, 1300 ] 8459 3.612% 95.297% # ( 1300, 1900 ] 4248 1.814% 97.111% ( 1900, 2900 ] 2818 1.203% 98.315% ( 2900, 4400 ] 2803 1.197% 99.512% ( 4400, 6600 ] 920 0.393% 99.905% ( 6600, 9900 ] 142 0.061% 99.965% ( 9900, 14000 ] 24 0.010% 99.976% ( 14000, 22000 ] 34 0.015% 99.990% ( 22000, 33000 ] 24 0.010% 100.000% ( 33000, 50000 ] 11 0.005% 100.005% ( 50000, 75000 ] 4 0.002% 100.007% ** DB Stats ** Uptime(secs): 32.1 total, 5.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 184.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.755 H:M:S, 30.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 167.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.315 H:M:S, 39.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 266.733 micros/op 14977 ops/sec 60.155 seconds 900996 operations; 14.5 MB/s (213999 of 213999 found) Microseconds per read: Count: 900996 Average: 266.7356 StdDev: 809.89 Min: 2 Median: 174.7269 Max: 120894 Percentiles: P50: 174.73 P75: 236.76 P99: 1710.22 P99.9: 13162.92 P99.99: 30681.27 ------------------------------------------------------ ( 1, 2 ] 11 0.001% 0.001% ( 2, 3 ] 45 0.005% 0.006% ( 3, 4 ] 75 0.008% 0.015% ( 4, 6 ] 85 0.009% 0.024% ( 6, 10 ] 431 0.048% 0.072% ( 10, 15 ] 3781 0.420% 0.491% ( 15, 22 ] 5109 0.567% 1.058% ( 22, 34 ] 8518 0.945% 2.004% ( 34, 51 ] 3372 0.374% 2.378% ( 51, 76 ] 472 0.052% 2.431% ( 76, 110 ] 19908 2.210% 4.640% ( 110, 170 ] 391526 43.455% 48.095% ######### ( 170, 250 ] 290505 32.243% 80.338% ###### ( 250, 380 ] 93733 10.403% 90.741% ## ( 380, 580 ] 40475 4.492% 95.233% # ( 580, 870 ] 19995 2.219% 97.452% ( 870, 1300 ] 10597 1.176% 98.628% ( 1300, 1900 ] 4897 0.544% 99.172% ( 1900, 2900 ] 2884 0.320% 99.492% ( 2900, 4400 ] 2321 0.258% 99.750% ( 4400, 6600 ] 726 0.081% 99.830% ( 6600, 9900 ] 286 0.032% 99.862% ( 9900, 14000 ] 431 0.048% 99.910% ( 14000, 22000 ] 584 0.065% 99.975% ( 22000, 33000 ] 176 0.020% 99.994% ( 33000, 50000 ] 39 0.004% 99.998% ( 50000, 75000 ] 10 0.001% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 18832420 rocksdb.bloom.filter.full.positive COUNT : 1084886 rocksdb.bloom.filter.full.true.positive COUNT : 900529 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 467 rocksdb.memtable.miss COUNT : 900529 rocksdb.l0.hit COUNT : 33438 rocksdb.l1.hit COUNT : 8834 rocksdb.l2andup.hit COUNT : 858257 rocksdb.compaction.key.drop.new COUNT : 214756 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6297392 rocksdb.number.keys.read COUNT : 900996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6498908544 rocksdb.bytes.read COUNT : 900996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1715 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36189027 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 25522557650 rocksdb.compact.write.bytes COUNT : 25303859053 rocksdb.flush.write.bytes COUNT : 6473652919 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 29 rocksdb.number.superversion_acquires COUNT : 1282 rocksdb.number.superversion_releases COUNT : 1238 rocksdb.number.superversion_cleanups COUNT : 319 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 329 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6421415936 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2460672 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29961362955 rocksdb.non.last.level.read.count COUNT : 7098636 rocksdb.block.checksum.compute.count COUNT : 7280198 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 173.119413 P95 : 568.961920 P99 : 1709.257728 P100 : 120892.000000 COUNT : 900996 SUM : 239566912 rocksdb.db.write.micros P50 : 1.542252 P95 : 4.177405 P99 : 8.171446 P100 : 886322.000000 COUNT : 6297392 SUM : 51978954 rocksdb.compaction.times.micros P50 : 1453191.489362 P95 : 2883333.333333 P99 : 6368000.000000 P100 : 6829842.000000 COUNT : 106 SUM : 168841400 rocksdb.compaction.times.cpu_micros P50 : 915510.204082 P95 : 1721111.111111 P99 : 4216000.000000 P100 : 5298828.000000 COUNT : 106 SUM : 103584925 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 817.948718 P95 : 65000.000000 P99 : 193033.000000 P100 : 193033.000000 COUNT : 88 SUM : 907255 rocksdb.compaction.outfile.sync.micros P50 : 23833.333333 P95 : 228857.142857 P99 : 364163.636364 P100 : 848704.000000 COUNT : 334 SUM : 20459370 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 235.454545 P95 : 3216.666667 P99 : 5379.000000 P100 : 5463.000000 COUNT : 222 SUM : 167639 rocksdb.table.open.io.micros P50 : 8576.451613 P95 : 19826.839827 P99 : 25575.000000 P100 : 97359.000000 COUNT : 1715 SUM : 15016362 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.908861 P95 : 9.849527 P99 : 159.030147 P100 : 61828.000000 COUNT : 6181633 SUM : 87273028 rocksdb.read.block.get.micros P50 : 136.640132 P95 : 473.155598 P99 : 1534.001210 P100 : 61583.000000 COUNT : 1096837 SUM : 204756646 rocksdb.write.raw.block.micros P50 : 0.532280 P95 : 1.258677 P99 : 3.573698 P100 : 63366.000000 COUNT : 7696776 SUM : 24810448 rocksdb.numfiles.in.singlecompaction P50 : 2.693182 P95 : 4.060000 P99 : 8.520000 P100 : 30.000000 COUNT : 137 SUM : 457 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.585278 P95 : 2206.664811 P99 : 2763.114699 P100 : 886158.000000 COUNT : 124923 SUM : 36201849 rocksdb.sst.read.micros P50 : 1.983986 P95 : 159.284002 P99 : 505.028887 P100 : 61823.000000 COUNT : 7098662 SUM : 273291968 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 900996 SUM : 900996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6297392 SUM : 6498908544 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226393.442623 P95 : 950666.666667 P99 : 1150133.333333 P100 : 1160150.000000 COUNT : 88 SUM : 27943521 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 340 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0