[2024-11-19 17:57:20.690732] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-11-19 17:57:20.690990] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid871814 ] Set seed to 1732035440684096 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 17:57:20.785410] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 17:57:20.821784] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 17:57:20.821826] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 871814' to capture a snapshot of events at runtime. [2024-11-19 17:57:20.821838] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid871814 for offline analysis/debug. [2024-11-19 17:57:20.821862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 17:57:25 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/19-17:57:27 ... thread 0: (1000000,1000000) ops and (359010.0,359010.0) ops/second in (2.785438,2.785438) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 504.04 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 355.8 2.30 2.06 12 0.192 0 0 0.0 0.0 L1 3/3 188.88 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 260.0 259.8 0.73 0.70 1 0.727 191K 79 0.0 0.0 L2 2/1 125.95 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 237.3 237.2 0.53 0.51 1 0.531 127K 49 0.0 0.0 L3 9/0 741.26 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/12 96.94 GB 0.0 0.3 0.2 0.1 1.1 1.0 1.0 1.4 88.5 318.5 3.56 3.27 14 0.254 319K 128 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.6 1.4 88.5 318.5 3.56 3.27 14 0.254 319K 128 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 250.4 250.3 1.26 1.20 2 0.629 319K 128 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 355.8 2.30 2.06 12 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 375.63 MB/s write, 0.31 GB read, 104.35 MB/s read, 3.6 seconds Interval compaction: 1.11 GB write, 406.80 MB/s write, 0.31 GB read, 113.01 MB/s read, 3.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 113518 Average: 1.8177 StdDev: 18.69 Min: 0 Median: 1.1135 Max: 3769 Percentiles: P50: 1.11 P75: 1.60 P99: 3.99 P99.9: 9.35 P99.99: 152.36 ------------------------------------------------------ [ 0, 1 ] 50179 44.204% 44.204% ######### ( 1, 2 ] 57970 51.067% 95.270% ########## ( 2, 3 ] 2915 2.568% 97.838% # ( 3, 4 ] 1333 1.174% 99.012% ( 4, 6 ] 775 0.683% 99.695% ( 6, 10 ] 279 0.246% 99.941% ( 10, 15 ] 39 0.034% 99.975% ( 15, 22 ] 10 0.009% 99.984% ( 22, 34 ] 1 0.001% 99.985% ( 51, 76 ] 1 0.001% 99.986% ( 110, 170 ] 8 0.007% 99.993% ( 170, 250 ] 4 0.004% 99.996% ( 250, 380 ] 4 0.004% 100.000% ( 580, 870 ] 1 0.001% 100.001% ( 870, 1300 ] 1 0.001% 100.002% ( 1300, 1900 ] 2 0.002% 100.004% ( 1900, 2900 ] 3 0.003% 100.006% ( 2900, 4400 ] 1 0.001% 100.007% ** Level 1 read latency histogram (micros): Count: 26601 Average: 1.7448 StdDev: 7.62 Min: 0 Median: 1.1587 Max: 1134 Percentiles: P50: 1.16 P75: 1.62 P99: 3.90 P99.9: 7.76 P99.99: 272.09 ------------------------------------------------------ [ 0, 1 ] 11036 41.487% 41.487% ######## ( 1, 2 ] 14273 53.656% 95.143% ########### ( 2, 3 ] 724 2.722% 97.865% # ( 3, 4 ] 335 1.259% 99.124% ( 4, 6 ] 192 0.722% 99.846% ( 6, 10 ] 35 0.132% 99.977% ( 10, 15 ] 2 0.008% 99.985% ( 51, 76 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.992% ( 250, 380 ] 2 0.008% 100.000% ( 870, 1300 ] 1 0.004% 100.004% ** Level 2 read latency histogram (micros): Count: 7239 Average: 3.5477 StdDev: 36.99 Min: 0 Median: 1.5958 Max: 1875 Percentiles: P50: 1.60 P75: 2.18 P99: 8.85 P99.9: 282.98 P99.99: 1755.22 ------------------------------------------------------ [ 0, 1 ] 1190 16.439% 16.439% ### ( 1, 2 ] 4078 56.334% 72.772% ########### ( 2, 3 ] 885 12.225% 84.998% ## ( 3, 4 ] 512 7.073% 92.071% # ( 4, 6 ] 406 5.609% 97.679% # ( 6, 10 ] 134 1.851% 99.530% ( 10, 15 ] 18 0.249% 99.779% ( 15, 22 ] 3 0.041% 99.820% ( 34, 51 ] 2 0.028% 99.848% ( 170, 250 ] 3 0.041% 99.889% ( 250, 380 ] 3 0.041% 99.931% ( 580, 870 ] 1 0.014% 99.945% ( 870, 1300 ] 1 0.014% 99.959% ( 1300, 1900 ] 3 0.041% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1527.4545 StdDev: 1279.33 Min: 77 Median: 1138.7500 Max: 5176 Percentiles: P50: 1138.75 P75: 2275.00 P99: 5176.00 P99.9: 5176.00 P99.99: 5176.00 ------------------------------------------------------ ( 76, 110 ] 1 1.818% 1.818% ( 170, 250 ] 4 7.273% 9.091% # ( 250, 380 ] 3 5.455% 14.545% # ( 380, 580 ] 4 7.273% 21.818% # ( 580, 870 ] 13 23.636% 45.455% ##### ( 870, 1300 ] 4 7.273% 52.727% # ( 1300, 1900 ] 10 18.182% 70.909% #### ( 1900, 2900 ] 6 10.909% 81.818% ## ( 2900, 4400 ] 8 14.545% 96.364% ### ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 4 read latency histogram (micros): Count: 15 Average: 1802.4000 StdDev: 1393.61 Min: 365 Median: 1480.0000 Max: 5092 Percentiles: P50: 1480.00 P75: 2150.00 P99: 5092.00 P99.9: 5092.00 P99.99: 5092.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 580, 870 ] 4 26.667% 33.333% ##### ( 870, 1300 ] 1 6.667% 40.000% # ( 1300, 1900 ] 5 33.333% 73.333% ####### ( 1900, 2900 ] 1 6.667% 80.000% # ( 2900, 4400 ] 1 6.667% 86.667% # ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 637.7500 StdDev: 938.04 Min: 73 Median: 130.0000 Max: 3251 Percentiles: P50: 130.00 P75: 870.00 P99: 3251.00 P99.9: 3251.00 P99.99: 3251.00 ------------------------------------------------------ ( 51, 76 ] 3 15.000% 15.000% ### ( 76, 110 ] 6 30.000% 45.000% ###### ( 110, 170 ] 3 15.000% 60.000% ### ( 250, 380 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 326.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.180 H:M:S, 6.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 353.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.180 H:M:S, 6.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/19-17:57:30 ... thread 0: (1000000,2000000) ops and (323482.3,340321.4) ops/second in (3.091359,5.876797) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.29 GB 100.7 0.9 0.0 0.9 2.6 1.8 0.0 1.5 103.3 317.2 8.54 7.91 29 0.294 895K 1054 0.0 0.0 L1 1/0 2.82 MB 0.3 0.6 0.4 0.2 0.6 0.4 0.1 1.5 247.9 247.6 2.29 2.21 2 1.144 575K 571 0.0 0.0 L2 2/2 117.98 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 237.3 237.2 0.53 0.51 1 0.531 127K 49 0.0 0.0 L3 74/31 1.10 GB 0.3 0.5 0.4 0.1 0.5 0.4 0.1 1.3 187.1 187.0 2.65 2.19 2 1.323 502K 345 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1246/37 97.92 GB 0.0 2.0 0.8 1.2 3.8 2.6 1.3 2.1 147.8 278.2 14.00 12.81 34 0.412 2101K 2019 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.2 3.8 2.6 0.9 2.1 147.8 278.2 14.00 12.81 34 0.412 2101K 2019 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.2 2.0 0.8 0.0 0.0 233.9 233.6 8.85 8.23 8 1.106 2101K 2019 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.7 5.15 4.59 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.80 GB write, 637.45 MB/s write, 2.02 GB read, 338.78 MB/s read, 14.0 seconds Interval compaction: 3.80 GB write, 662.53 MB/s write, 2.02 GB read, 352.11 MB/s read, 14.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 387701 Average: 2.1373 StdDev: 11.62 Min: 0 Median: 1.4251 Max: 3769 Percentiles: P50: 1.43 P75: 1.84 P99: 5.71 P99.9: 9.86 P99.99: 18.63 ------------------------------------------------------ [ 0, 1 ] 95636 24.667% 24.667% ##### ( 1, 2 ] 231058 59.597% 84.264% ############ ( 2, 3 ] 31204 8.048% 92.313% ## ( 3, 4 ] 16625 4.288% 96.601% # ( 4, 6 ] 10872 2.804% 99.405% # ( 6, 10 ] 1987 0.513% 99.918% ( 10, 15 ] 260 0.067% 99.985% ( 15, 22 ] 39 0.010% 99.995% ( 22, 34 ] 7 0.002% 99.997% ( 34, 51 ] 4 0.001% 99.998% ( 51, 76 ] 1 0.000% 99.998% ( 110, 170 ] 11 0.003% 100.001% ( 170, 250 ] 17 0.004% 100.005% ( 250, 380 ] 11 0.003% 100.008% ( 380, 580 ] 2 0.001% 100.009% ( 580, 870 ] 4 0.001% 100.010% ( 870, 1300 ] 6 0.002% 100.011% ( 1300, 1900 ] 3 0.001% 100.012% ( 1900, 2900 ] 3 0.001% 100.013% ( 2900, 4400 ] 1 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 122681 Average: 2.2261 StdDev: 5.14 Min: 0 Median: 1.5093 Max: 1134 Percentiles: P50: 1.51 P75: 1.91 P99: 5.82 P99.9: 11.16 P99.99: 57.10 ------------------------------------------------------ [ 0, 1 ] 22564 18.392% 18.392% #### ( 1, 2 ] 76132 62.057% 80.449% ############ ( 2, 3 ] 12200 9.944% 90.394% ## ( 3, 4 ] 6157 5.019% 95.412% # ( 4, 6 ] 4846 3.950% 99.363% # ( 6, 10 ] 634 0.517% 99.879% ( 10, 15 ] 113 0.092% 99.971% ( 15, 22 ] 19 0.015% 99.987% ( 22, 34 ] 2 0.002% 99.989% ( 34, 51 ] 2 0.002% 99.990% ( 51, 76 ] 3 0.002% 99.993% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 5 0.004% 99.998% ( 380, 580 ] 1 0.001% 99.998% ( 580, 870 ] 2 0.002% 100.000% ( 870, 1300 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 31939 Average: 2.5116 StdDev: 17.65 Min: 0 Median: 1.5364 Max: 1875 Percentiles: P50: 1.54 P75: 1.95 P99: 6.65 P99.9: 14.05 P99.99: 1216.62 ------------------------------------------------------ [ 0, 1 ] 5612 17.571% 17.571% #### ( 1, 2 ] 19311 60.462% 78.033% ############ ( 2, 3 ] 3461 10.836% 88.869% ## ( 3, 4 ] 1870 5.855% 94.724% # ( 4, 6 ] 1317 4.123% 98.848% # ( 6, 10 ] 298 0.933% 99.781% ( 10, 15 ] 47 0.147% 99.928% ( 15, 22 ] 7 0.022% 99.950% ( 22, 34 ] 3 0.009% 99.959% ( 34, 51 ] 2 0.006% 99.966% ( 170, 250 ] 3 0.009% 99.975% ( 250, 380 ] 3 0.009% 99.984% ( 580, 870 ] 1 0.003% 99.987% ( 870, 1300 ] 1 0.003% 99.991% ( 1300, 1900 ] 3 0.009% 100.000% ** Level 3 read latency histogram (micros): Count: 178098 Average: 3.5322 StdDev: 39.12 Min: 0 Median: 1.5784 Max: 5176 Percentiles: P50: 1.58 P75: 2.03 P99: 9.42 P99.9: 225.07 P99.99: 795.14 ------------------------------------------------------ [ 0, 1 ] 28923 16.240% 16.240% ### ( 1, 2 ] 103957 58.371% 74.611% ############ ( 2, 3 ] 21658 12.161% 86.771% ## ( 3, 4 ] 10681 5.997% 92.769% # ( 4, 6 ] 8391 4.711% 97.480% # ( 6, 10 ] 3169 1.779% 99.259% ( 10, 15 ] 576 0.323% 99.583% ( 15, 22 ] 141 0.079% 99.662% ( 22, 34 ] 63 0.035% 99.697% ( 34, 51 ] 2 0.001% 99.698% ( 51, 76 ] 1 0.001% 99.699% ( 76, 110 ] 123 0.069% 99.768% ( 110, 170 ] 165 0.093% 99.861% ( 170, 250 ] 103 0.058% 99.919% ( 250, 380 ] 60 0.034% 99.952% ( 380, 580 ] 40 0.022% 99.975% ( 580, 870 ] 38 0.021% 99.996% ( 870, 1300 ] 9 0.005% 100.001% ( 1300, 1900 ] 14 0.008% 100.009% ( 1900, 2900 ] 7 0.004% 100.013% ( 2900, 4400 ] 8 0.004% 100.017% ( 4400, 6600 ] 2 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 15 Average: 1802.4000 StdDev: 1393.61 Min: 365 Median: 1480.0000 Max: 5092 Percentiles: P50: 1480.00 P75: 2150.00 P99: 5092.00 P99.9: 5092.00 P99.99: 5092.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 580, 870 ] 4 26.667% 33.333% ##### ( 870, 1300 ] 1 6.667% 40.000% # ( 1300, 1900 ] 5 33.333% 73.333% ####### ( 1900, 2900 ] 1 6.667% 80.000% # ( 2900, 4400 ] 1 6.667% 86.667% # ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 637.7500 StdDev: 938.04 Min: 73 Median: 130.0000 Max: 3251 Percentiles: P50: 130.00 P75: 870.00 P99: 3251.00 P99.9: 3251.00 P99.99: 3251.00 ------------------------------------------------------ ( 51, 76 ] 3 15.000% 15.000% ### ( 76, 110 ] 6 30.000% 45.000% ###### ( 110, 170 ] 3 15.000% 60.000% ### ( 250, 380 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 322.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.555 H:M:S, 9.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.375 H:M:S, 12.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/19-17:57:33 ... thread 0: (1000000,3000000) ops and (328765.2,336380.2) ops/second in (3.041684,8.918481) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.27 GB 37.8 1.7 0.0 1.7 4.4 2.8 0.0 1.6 118.3 315.4 14.38 13.36 46 0.313 1727K 1901 0.0 0.0 L1 1/1 2.82 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.5 247.9 247.6 2.29 2.21 2 1.144 575K 571 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 237.3 237.2 0.53 0.51 1 0.531 127K 49 0.0 0.0 L3 31/0 989.82 MB 1.0 1.4 0.5 0.9 1.4 0.5 0.1 2.8 214.1 213.9 6.54 5.74 4 1.635 1388K 1307 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1238/13 98.90 GB 0.0 3.7 0.9 2.8 6.5 3.7 1.9 2.3 159.8 279.1 23.73 21.83 53 0.448 3818K 3828 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 0.9 2.8 6.5 3.7 1.5 2.3 159.8 279.1 23.73 21.83 53 0.448 3818K 3828 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 0.9 2.8 3.7 0.9 0.0 0.0 240.1 239.9 15.80 14.77 13 1.215 3818K 3828 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 357.3 7.93 7.06 40 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.47 GB write, 723.85 MB/s write, 3.70 GB read, 414.53 MB/s read, 23.7 seconds Interval compaction: 6.47 GB write, 742.62 MB/s write, 3.70 GB read, 425.28 MB/s read, 23.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 707807 Average: 2.1356 StdDev: 11.36 Min: 0 Median: 1.4289 Max: 3769 Percentiles: P50: 1.43 P75: 1.84 P99: 5.66 P99.9: 9.74 P99.99: 14.85 ------------------------------------------------------ [ 0, 1 ] 167672 23.689% 23.689% ##### ( 1, 2 ] 434235 61.349% 85.038% ############ ( 2, 3 ] 55304 7.813% 92.852% ## ( 3, 4 ] 28213 3.986% 96.838% # ( 4, 6 ] 18430 2.604% 99.442% # ( 6, 10 ] 3475 0.491% 99.932% ( 10, 15 ] 423 0.060% 99.992% ( 15, 22 ] 56 0.008% 100.000% ( 22, 34 ] 10 0.001% 100.002% ( 34, 51 ] 4 0.001% 100.002% ( 51, 76 ] 3 0.000% 100.003% ( 76, 110 ] 13 0.002% 100.004% ( 110, 170 ] 27 0.004% 100.008% ( 170, 250 ] 31 0.004% 100.013% ( 250, 380 ] 23 0.003% 100.016% ( 380, 580 ] 7 0.001% 100.017% ( 580, 870 ] 9 0.001% 100.018% ( 870, 1300 ] 11 0.002% 100.020% ( 1300, 1900 ] 6 0.001% 100.020% ( 1900, 2900 ] 5 0.001% 100.021% ( 2900, 4400 ] 2 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 143078 Average: 2.2700 StdDev: 4.79 Min: 0 Median: 1.5349 Max: 1134 Percentiles: P50: 1.53 P75: 1.94 P99: 5.89 P99.9: 11.79 P99.99: 48.38 ------------------------------------------------------ [ 0, 1 ] 24025 16.792% 16.792% ### ( 1, 2 ] 88827 62.083% 78.874% ############ ( 2, 3 ] 15423 10.779% 89.654% ## ( 3, 4 ] 7566 5.288% 94.942% # ( 4, 6 ] 6143 4.293% 99.235% # ( 6, 10 ] 897 0.627% 99.862% ( 10, 15 ] 151 0.106% 99.968% ( 15, 22 ] 27 0.019% 99.987% ( 22, 34 ] 3 0.002% 99.989% ( 34, 51 ] 2 0.001% 99.990% ( 51, 76 ] 4 0.003% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 5 0.003% 99.997% ( 380, 580 ] 1 0.001% 99.998% ( 580, 870 ] 2 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 60265 Average: 2.9973 StdDev: 22.86 Min: 0 Median: 1.5409 Max: 3074 Percentiles: P50: 1.54 P75: 1.96 P99: 8.40 P99.9: 204.77 P99.99: 845.19 ------------------------------------------------------ [ 0, 1 ] 10521 17.458% 17.458% ### ( 1, 2 ] 36257 60.163% 77.621% ############ ( 2, 3 ] 6051 10.041% 87.661% ## ( 3, 4 ] 3731 6.191% 93.852% # ( 4, 6 ] 2623 4.352% 98.205% # ( 6, 10 ] 800 1.327% 99.532% ( 10, 15 ] 122 0.202% 99.735% ( 15, 22 ] 13 0.022% 99.756% ( 22, 34 ] 3 0.005% 99.761% ( 34, 51 ] 3 0.005% 99.766% ( 76, 110 ] 19 0.032% 99.798% ( 110, 170 ] 50 0.083% 99.881% ( 170, 250 ] 27 0.045% 99.925% ( 250, 380 ] 17 0.028% 99.954% ( 380, 580 ] 11 0.018% 99.972% ( 580, 870 ] 12 0.020% 99.992% ( 870, 1300 ] 1 0.002% 99.993% ( 1300, 1900 ] 3 0.005% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 200497 Average: 3.4500 StdDev: 37.28 Min: 0 Median: 1.5714 Max: 5176 Percentiles: P50: 1.57 P75: 2.00 P99: 9.33 P99.9: 223.90 P99.99: 802.71 ------------------------------------------------------ [ 0, 1 ] 32975 16.447% 16.447% ### ( 1, 2 ] 117739 58.724% 75.170% ############ ( 2, 3 ] 23738 11.840% 87.010% ## ( 3, 4 ] 12022 5.996% 93.006% # ( 4, 6 ] 9095 4.536% 97.542% # ( 6, 10 ] 3516 1.754% 99.296% ( 10, 15 ] 618 0.308% 99.604% ( 15, 22 ] 150 0.075% 99.679% ( 22, 34 ] 66 0.033% 99.712% ( 34, 51 ] 3 0.001% 99.713% ( 51, 76 ] 1 0.000% 99.714% ( 76, 110 ] 125 0.062% 99.776% ( 110, 170 ] 169 0.084% 99.860% ( 170, 250 ] 118 0.059% 99.919% ( 250, 380 ] 67 0.033% 99.953% ( 380, 580 ] 45 0.022% 99.975% ( 580, 870 ] 39 0.019% 99.995% ( 870, 1300 ] 12 0.006% 100.000% ( 1300, 1900 ] 14 0.007% 100.007% ( 1900, 2900 ] 7 0.003% 100.011% ( 2900, 4400 ] 8 0.004% 100.015% ( 4400, 6600 ] 2 0.001% 100.016% ** Level 4 read latency histogram (micros): Count: 15 Average: 1802.4000 StdDev: 1393.61 Min: 365 Median: 1480.0000 Max: 5092 Percentiles: P50: 1480.00 P75: 2150.00 P99: 5092.00 P99.9: 5092.00 P99.99: 5092.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 580, 870 ] 4 26.667% 33.333% ##### ( 870, 1300 ] 1 6.667% 40.000% # ( 1300, 1900 ] 5 33.333% 73.333% ####### ( 1900, 2900 ] 1 6.667% 80.000% # ( 2900, 4400 ] 1 6.667% 86.667% # ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 783.5000 StdDev: 1068.12 Min: 73 Median: 276.0000 Max: 3545 Percentiles: P50: 276.00 P75: 1013.33 P99: 3545.00 P99.9: 3545.00 P99.99: 3545.00 ------------------------------------------------------ ( 51, 76 ] 3 7.500% 7.500% ## ( 76, 110 ] 9 22.500% 30.000% ##### ( 110, 170 ] 6 15.000% 45.000% ### ( 170, 250 ] 1 2.500% 47.500% # ( 250, 380 ] 5 12.500% 60.000% ### ( 380, 580 ] 2 5.000% 65.000% # ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 2 5.000% 85.000% # ( 1900, 2900 ] 2 5.000% 90.000% # ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.933 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.378 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-17:57:37 ... thread 0: (1000000,4000000) ops and (297535.0,325748.0) ops/second in (3.360949,12.279430) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/8 3.26 GB 163.7 2.7 0.0 2.7 6.5 3.7 0.0 1.7 130.9 312.2 21.18 19.79 65 0.326 2814K 2995 0.0 0.0 L1 1/1 2.82 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.5 247.9 247.6 2.29 2.21 2 1.144 575K 571 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 237.3 237.2 0.53 0.51 1 0.531 127K 49 0.0 0.0 L3 31/0 989.82 MB 1.0 1.4 0.5 0.9 1.4 0.5 0.1 2.8 214.1 213.9 6.54 5.74 4 1.635 1388K 1307 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/9 99.88 GB 0.0 4.8 0.9 3.8 8.5 4.7 1.9 2.3 159.3 285.0 30.53 28.26 72 0.424 4906K 4922 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 0.9 3.8 8.5 4.7 1.5 2.3 159.3 285.0 30.53 28.26 72 0.424 4906K 4922 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 0.9 3.8 4.7 0.9 0.0 0.0 245.7 245.5 19.80 18.69 17 1.165 4906K 4922 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 357.9 10.74 9.56 55 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.50 GB write, 695.47 MB/s write, 4.75 GB read, 388.78 MB/s read, 30.5 seconds Interval compaction: 8.50 GB write, 708.57 MB/s write, 4.75 GB read, 396.10 MB/s read, 30.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 12, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1142153 Average: 2.1312 StdDev: 10.49 Min: 0 Median: 1.4379 Max: 3769 Percentiles: P50: 1.44 P75: 1.83 P99: 5.66 P99.9: 9.80 P99.99: 14.57 ------------------------------------------------------ [ 0, 1 ] 254238 22.260% 22.260% #### ( 1, 2 ] 723623 63.356% 85.616% ############# ( 2, 3 ] 88387 7.739% 93.354% ## ( 3, 4 ] 42855 3.752% 97.106% # ( 4, 6 ] 26068 2.282% 99.389% ( 6, 10 ] 6153 0.539% 99.927% ( 10, 15 ] 783 0.069% 99.996% ( 15, 22 ] 82 0.007% 100.003% ( 22, 34 ] 17 0.001% 100.005% ( 34, 51 ] 7 0.001% 100.005% ( 51, 76 ] 10 0.001% 100.006% ( 76, 110 ] 36 0.003% 100.009% ( 110, 170 ] 43 0.004% 100.013% ( 170, 250 ] 44 0.004% 100.017% ( 250, 380 ] 31 0.003% 100.020% ( 380, 580 ] 16 0.001% 100.021% ( 580, 870 ] 16 0.001% 100.022% ( 870, 1300 ] 20 0.002% 100.024% ( 1300, 1900 ] 6 0.001% 100.025% ( 1900, 2900 ] 6 0.001% 100.025% ( 2900, 4400 ] 3 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 143078 Average: 2.2700 StdDev: 4.79 Min: 0 Median: 1.5349 Max: 1134 Percentiles: P50: 1.53 P75: 1.94 P99: 5.89 P99.9: 11.79 P99.99: 48.38 ------------------------------------------------------ [ 0, 1 ] 24025 16.792% 16.792% ### ( 1, 2 ] 88827 62.083% 78.874% ############ ( 2, 3 ] 15423 10.779% 89.654% ## ( 3, 4 ] 7566 5.288% 94.942% # ( 4, 6 ] 6143 4.293% 99.235% # ( 6, 10 ] 897 0.627% 99.862% ( 10, 15 ] 151 0.106% 99.968% ( 15, 22 ] 27 0.019% 99.987% ( 22, 34 ] 3 0.002% 99.989% ( 34, 51 ] 2 0.001% 99.990% ( 51, 76 ] 4 0.003% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 5 0.003% 99.997% ( 380, 580 ] 1 0.001% 99.998% ( 580, 870 ] 2 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 60265 Average: 2.9973 StdDev: 22.86 Min: 0 Median: 1.5409 Max: 3074 Percentiles: P50: 1.54 P75: 1.96 P99: 8.40 P99.9: 204.77 P99.99: 845.19 ------------------------------------------------------ [ 0, 1 ] 10521 17.458% 17.458% ### ( 1, 2 ] 36257 60.163% 77.621% ############ ( 2, 3 ] 6051 10.041% 87.661% ## ( 3, 4 ] 3731 6.191% 93.852% # ( 4, 6 ] 2623 4.352% 98.205% # ( 6, 10 ] 800 1.327% 99.532% ( 10, 15 ] 122 0.202% 99.735% ( 15, 22 ] 13 0.022% 99.756% ( 22, 34 ] 3 0.005% 99.761% ( 34, 51 ] 3 0.005% 99.766% ( 76, 110 ] 19 0.032% 99.798% ( 110, 170 ] 50 0.083% 99.881% ( 170, 250 ] 27 0.045% 99.925% ( 250, 380 ] 17 0.028% 99.954% ( 380, 580 ] 11 0.018% 99.972% ( 580, 870 ] 12 0.020% 99.992% ( 870, 1300 ] 1 0.002% 99.993% ( 1300, 1900 ] 3 0.005% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 200497 Average: 3.4500 StdDev: 37.28 Min: 0 Median: 1.5714 Max: 5176 Percentiles: P50: 1.57 P75: 2.00 P99: 9.33 P99.9: 223.90 P99.99: 802.71 ------------------------------------------------------ [ 0, 1 ] 32975 16.447% 16.447% ### ( 1, 2 ] 117739 58.724% 75.170% ############ ( 2, 3 ] 23738 11.840% 87.010% ## ( 3, 4 ] 12022 5.996% 93.006% # ( 4, 6 ] 9095 4.536% 97.542% # ( 6, 10 ] 3516 1.754% 99.296% ( 10, 15 ] 618 0.308% 99.604% ( 15, 22 ] 150 0.075% 99.679% ( 22, 34 ] 66 0.033% 99.712% ( 34, 51 ] 3 0.001% 99.713% ( 51, 76 ] 1 0.000% 99.714% ( 76, 110 ] 125 0.062% 99.776% ( 110, 170 ] 169 0.084% 99.860% ( 170, 250 ] 118 0.059% 99.919% ( 250, 380 ] 67 0.033% 99.953% ( 380, 580 ] 45 0.022% 99.975% ( 580, 870 ] 39 0.019% 99.995% ( 870, 1300 ] 12 0.006% 100.000% ( 1300, 1900 ] 14 0.007% 100.007% ( 1900, 2900 ] 7 0.003% 100.011% ( 2900, 4400 ] 8 0.004% 100.015% ( 4400, 6600 ] 2 0.001% 100.016% ** Level 4 read latency histogram (micros): Count: 15 Average: 1802.4000 StdDev: 1393.61 Min: 365 Median: 1480.0000 Max: 5092 Percentiles: P50: 1480.00 P75: 2150.00 P99: 5092.00 P99.9: 5092.00 P99.99: 5092.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 580, 870 ] 4 26.667% 33.333% ##### ( 870, 1300 ] 1 6.667% 40.000% # ( 1300, 1900 ] 5 33.333% 73.333% ####### ( 1900, 2900 ] 1 6.667% 80.000% # ( 2900, 4400 ] 1 6.667% 86.667% # ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 783.5000 StdDev: 1068.12 Min: 73 Median: 276.0000 Max: 3545 Percentiles: P50: 276.00 P75: 1013.33 P99: 3545.00 P99.9: 3545.00 P99.99: 3545.00 ------------------------------------------------------ ( 51, 76 ] 3 7.500% 7.500% ## ( 76, 110 ] 9 22.500% 30.000% ##### ( 110, 170 ] 6 15.000% 45.000% ### ( 170, 250 ] 1 2.500% 47.500% # ( 250, 380 ] 5 12.500% 60.000% ### ( 380, 580 ] 2 5.000% 65.000% # ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 2 5.000% 85.000% # ( 1900, 2900 ] 2 5.000% 90.000% # ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.5 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 314.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.646 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 292.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.712 H:M:S, 21.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/19-17:57:41 ... thread 0: (1000000,5000000) ops and (252941.2,308016.1) ops/second in (3.953488,16.232918) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.58 GB 25.2 3.4 0.0 3.4 8.2 4.7 0.0 1.7 131.6 312.4 26.81 25.05 83 0.323 3582K 3751 0.0 0.0 L1 19/19 1.65 GB 0.0 2.2 2.0 0.2 2.2 2.0 0.1 1.1 236.7 235.3 9.58 9.26 3 3.195 2303K 13K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 237.3 237.2 0.53 0.51 1 0.531 127K 49 0.0 0.0 L3 31/0 989.82 MB 1.0 1.4 0.5 0.9 1.4 0.5 0.1 2.8 214.1 213.9 6.54 5.74 4 1.635 1388K 1307 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/33 100.86 GB 0.0 7.2 2.6 4.6 11.9 7.3 1.9 2.5 168.5 279.7 43.46 40.56 91 0.478 7401K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.2 2.6 4.6 11.9 7.3 1.5 2.5 168.5 279.7 43.46 40.56 91 0.478 7401K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.2 2.6 4.6 7.1 2.6 0.0 0.0 245.1 244.5 29.88 28.45 21 1.423 7401K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.1 13.59 12.11 70 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.5 total, 16.2 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.87 GB write, 738.15 MB/s write, 7.15 GB read, 444.71 MB/s read, 43.5 seconds Interval compaction: 11.87 GB write, 748.67 MB/s write, 7.15 GB read, 451.04 MB/s read, 43.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 15, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1511257 Average: 2.1479 StdDev: 11.08 Min: 0 Median: 1.4321 Max: 4131 Percentiles: P50: 1.43 P75: 1.82 P99: 5.67 P99.9: 9.96 P99.99: 84.67 ------------------------------------------------------ [ 0, 1 ] 338287 22.384% 22.384% #### ( 1, 2 ] 965783 63.906% 86.290% ############# ( 2, 3 ] 112715 7.458% 93.749% # ( 3, 4 ] 53177 3.519% 97.268% # ( 4, 6 ] 31323 2.073% 99.340% ( 6, 10 ] 8555 0.566% 99.906% ( 10, 15 ] 1047 0.069% 99.976% ( 15, 22 ] 150 0.010% 99.985% ( 22, 34 ] 19 0.001% 99.987% ( 34, 51 ] 9 0.001% 99.987% ( 51, 76 ] 10 0.001% 99.988% ( 76, 110 ] 125 0.008% 99.996% ( 110, 170 ] 170 0.011% 100.007% ( 170, 250 ] 68 0.004% 100.012% ( 250, 380 ] 64 0.004% 100.016% ( 380, 580 ] 39 0.003% 100.019% ( 580, 870 ] 29 0.002% 100.021% ( 870, 1300 ] 26 0.002% 100.022% ( 1300, 1900 ] 8 0.001% 100.023% ( 1900, 2900 ] 7 0.000% 100.023% ( 2900, 4400 ] 5 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 189120 Average: 2.4980 StdDev: 12.35 Min: 0 Median: 1.5019 Max: 1830 Percentiles: P50: 1.50 P75: 1.90 P99: 6.55 P99.9: 103.90 P99.99: 654.09 ------------------------------------------------------ [ 0, 1 ] 35517 18.780% 18.780% #### ( 1, 2 ] 117629 62.198% 80.978% ############ ( 2, 3 ] 18293 9.673% 90.651% ## ( 3, 4 ] 8791 4.648% 95.299% # ( 4, 6 ] 6779 3.584% 98.884% # ( 6, 10 ] 1600 0.846% 99.730% ( 10, 15 ] 226 0.120% 99.849% ( 15, 22 ] 34 0.018% 99.867% ( 22, 34 ] 3 0.002% 99.869% ( 34, 51 ] 2 0.001% 99.870% ( 51, 76 ] 6 0.003% 99.873% ( 76, 110 ] 62 0.033% 99.906% ( 110, 170 ] 85 0.045% 99.951% ( 170, 250 ] 23 0.012% 99.963% ( 250, 380 ] 29 0.015% 99.978% ( 380, 580 ] 18 0.010% 99.988% ( 580, 870 ] 16 0.008% 99.996% ( 870, 1300 ] 5 0.003% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 60265 Average: 2.9973 StdDev: 22.86 Min: 0 Median: 1.5409 Max: 3074 Percentiles: P50: 1.54 P75: 1.96 P99: 8.40 P99.9: 204.77 P99.99: 845.19 ------------------------------------------------------ [ 0, 1 ] 10521 17.458% 17.458% ### ( 1, 2 ] 36257 60.163% 77.621% ############ ( 2, 3 ] 6051 10.041% 87.661% ## ( 3, 4 ] 3731 6.191% 93.852% # ( 4, 6 ] 2623 4.352% 98.205% # ( 6, 10 ] 800 1.327% 99.532% ( 10, 15 ] 122 0.202% 99.735% ( 15, 22 ] 13 0.022% 99.756% ( 22, 34 ] 3 0.005% 99.761% ( 34, 51 ] 3 0.005% 99.766% ( 76, 110 ] 19 0.032% 99.798% ( 110, 170 ] 50 0.083% 99.881% ( 170, 250 ] 27 0.045% 99.925% ( 250, 380 ] 17 0.028% 99.954% ( 380, 580 ] 11 0.018% 99.972% ( 580, 870 ] 12 0.020% 99.992% ( 870, 1300 ] 1 0.002% 99.993% ( 1300, 1900 ] 3 0.005% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 200497 Average: 3.4500 StdDev: 37.28 Min: 0 Median: 1.5714 Max: 5176 Percentiles: P50: 1.57 P75: 2.00 P99: 9.33 P99.9: 223.90 P99.99: 802.71 ------------------------------------------------------ [ 0, 1 ] 32975 16.447% 16.447% ### ( 1, 2 ] 117739 58.724% 75.170% ############ ( 2, 3 ] 23738 11.840% 87.010% ## ( 3, 4 ] 12022 5.996% 93.006% # ( 4, 6 ] 9095 4.536% 97.542% # ( 6, 10 ] 3516 1.754% 99.296% ( 10, 15 ] 618 0.308% 99.604% ( 15, 22 ] 150 0.075% 99.679% ( 22, 34 ] 66 0.033% 99.712% ( 34, 51 ] 3 0.001% 99.713% ( 51, 76 ] 1 0.000% 99.714% ( 76, 110 ] 125 0.062% 99.776% ( 110, 170 ] 169 0.084% 99.860% ( 170, 250 ] 118 0.059% 99.919% ( 250, 380 ] 67 0.033% 99.953% ( 380, 580 ] 45 0.022% 99.975% ( 580, 870 ] 39 0.019% 99.995% ( 870, 1300 ] 12 0.006% 100.000% ( 1300, 1900 ] 14 0.007% 100.007% ( 1900, 2900 ] 7 0.003% 100.011% ( 2900, 4400 ] 8 0.004% 100.015% ( 4400, 6600 ] 2 0.001% 100.016% ** Level 4 read latency histogram (micros): Count: 15 Average: 1802.4000 StdDev: 1393.61 Min: 365 Median: 1480.0000 Max: 5092 Percentiles: P50: 1480.00 P75: 2150.00 P99: 5092.00 P99.9: 5092.00 P99.99: 5092.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 580, 870 ] 4 26.667% 33.333% ##### ( 870, 1300 ] 1 6.667% 40.000% # ( 1300, 1900 ] 5 33.333% 73.333% ####### ( 1900, 2900 ] 1 6.667% 80.000% # ( 2900, 4400 ] 1 6.667% 86.667% # ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 783.5000 StdDev: 1068.12 Min: 73 Median: 276.0000 Max: 3545 Percentiles: P50: 276.00 P75: 1013.33 P99: 3545.00 P99.9: 3545.00 P99.99: 3545.00 ------------------------------------------------------ ( 51, 76 ] 3 7.500% 7.500% ## ( 76, 110 ] 9 22.500% 30.000% ##### ( 110, 170 ] 6 15.000% 45.000% ### ( 170, 250 ] 1 2.500% 47.500% # ( 250, 380 ] 5 12.500% 60.000% ### ( 380, 580 ] 2 5.000% 65.000% # ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 2 5.000% 85.000% # ( 1900, 2900 ] 2 5.000% 90.000% # ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 16.5 total, 4.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 298.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.959 H:M:S, 18.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 248.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.314 H:M:S, 33.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-17:57:44 ... thread 0: (1000000,6000000) ops and (280242.4,303011.1) ops/second in (3.568339,19.801257) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.56 GB 157.3 4.6 0.0 4.6 10.3 5.7 0.0 1.8 137.7 310.7 33.85 31.69 102 0.332 4733K 4967 0.0 0.0 L1 19/19 1.65 GB 0.0 2.2 2.0 0.2 2.2 2.0 0.1 1.1 236.7 235.3 9.58 9.26 3 3.195 2303K 13K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 237.3 237.2 0.53 0.51 1 0.531 127K 49 0.0 0.0 L3 31/0 989.82 MB 1.0 1.4 0.5 0.9 1.4 0.5 0.1 2.8 214.1 213.9 6.54 5.74 4 1.635 1388K 1307 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/29 101.84 GB 0.0 8.3 2.6 5.7 14.0 8.3 1.9 2.4 167.4 283.1 50.50 47.20 110 0.459 8553K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.3 2.6 5.7 14.0 8.3 1.5 2.4 167.4 283.1 50.50 47.20 110 0.459 8553K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.3 2.6 5.7 8.2 2.6 0.0 0.0 248.3 247.7 34.06 32.56 25 1.362 8553K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 356.4 16.44 14.64 85 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.0 total, 19.8 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.96 GB write, 713.53 MB/s write, 8.26 GB read, 422.10 MB/s read, 50.5 seconds Interval compaction: 13.96 GB write, 721.86 MB/s write, 8.26 GB read, 427.03 MB/s read, 50.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 17, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1910536 Average: 2.1662 StdDev: 11.34 Min: 0 Median: 1.4419 Max: 5063 Percentiles: P50: 1.44 P75: 1.83 P99: 5.67 P99.9: 10.00 P99.99: 94.53 ------------------------------------------------------ [ 0, 1 ] 409893 21.454% 21.454% #### ( 1, 2 ] 1234237 64.602% 86.056% ############# ( 2, 3 ] 146262 7.656% 93.712% ## ( 3, 4 ] 67794 3.548% 97.260% # ( 4, 6 ] 39729 2.079% 99.339% ( 6, 10 ] 10719 0.561% 99.900% ( 10, 15 ] 1410 0.074% 99.974% ( 15, 22 ] 167 0.009% 99.983% ( 22, 34 ] 21 0.001% 99.984% ( 34, 51 ] 10 0.001% 99.985% ( 51, 76 ] 13 0.001% 99.985% ( 76, 110 ] 165 0.009% 99.994% ( 110, 170 ] 234 0.012% 100.006% ( 170, 250 ] 109 0.006% 100.012% ( 250, 380 ] 86 0.005% 100.016% ( 380, 580 ] 52 0.003% 100.019% ( 580, 870 ] 39 0.002% 100.021% ( 870, 1300 ] 33 0.002% 100.023% ( 1300, 1900 ] 9 0.000% 100.023% ( 1900, 2900 ] 9 0.000% 100.024% ( 2900, 4400 ] 5 0.000% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 281348 Average: 2.5287 StdDev: 11.66 Min: 0 Median: 1.5083 Max: 1830 Percentiles: P50: 1.51 P75: 1.90 P99: 7.48 P99.9: 119.34 P99.99: 567.44 ------------------------------------------------------ [ 0, 1 ] 48616 17.280% 17.280% ### ( 1, 2 ] 181121 64.376% 81.656% ############# ( 2, 3 ] 26660 9.476% 91.132% ## ( 3, 4 ] 12040 4.279% 95.411% # ( 4, 6 ] 8942 3.178% 98.589% # ( 6, 10 ] 3126 1.111% 99.700% ( 10, 15 ] 352 0.125% 99.825% ( 15, 22 ] 44 0.016% 99.841% ( 22, 34 ] 4 0.001% 99.843% ( 34, 51 ] 2 0.001% 99.843% ( 51, 76 ] 7 0.002% 99.846% ( 76, 110 ] 129 0.046% 99.892% ( 110, 170 ] 152 0.054% 99.946% ( 170, 250 ] 44 0.016% 99.961% ( 250, 380 ] 49 0.017% 99.979% ( 380, 580 ] 34 0.012% 99.991% ( 580, 870 ] 19 0.007% 99.998% ( 870, 1300 ] 5 0.002% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 60265 Average: 2.9973 StdDev: 22.86 Min: 0 Median: 1.5409 Max: 3074 Percentiles: P50: 1.54 P75: 1.96 P99: 8.40 P99.9: 204.77 P99.99: 845.19 ------------------------------------------------------ [ 0, 1 ] 10521 17.458% 17.458% ### ( 1, 2 ] 36257 60.163% 77.621% ############ ( 2, 3 ] 6051 10.041% 87.661% ## ( 3, 4 ] 3731 6.191% 93.852% # ( 4, 6 ] 2623 4.352% 98.205% # ( 6, 10 ] 800 1.327% 99.532% ( 10, 15 ] 122 0.202% 99.735% ( 15, 22 ] 13 0.022% 99.756% ( 22, 34 ] 3 0.005% 99.761% ( 34, 51 ] 3 0.005% 99.766% ( 76, 110 ] 19 0.032% 99.798% ( 110, 170 ] 50 0.083% 99.881% ( 170, 250 ] 27 0.045% 99.925% ( 250, 380 ] 17 0.028% 99.954% ( 380, 580 ] 11 0.018% 99.972% ( 580, 870 ] 12 0.020% 99.992% ( 870, 1300 ] 1 0.002% 99.993% ( 1300, 1900 ] 3 0.005% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 200497 Average: 3.4500 StdDev: 37.28 Min: 0 Median: 1.5714 Max: 5176 Percentiles: P50: 1.57 P75: 2.00 P99: 9.33 P99.9: 223.90 P99.99: 802.71 ------------------------------------------------------ [ 0, 1 ] 32975 16.447% 16.447% ### ( 1, 2 ] 117739 58.724% 75.170% ############ ( 2, 3 ] 23738 11.840% 87.010% ## ( 3, 4 ] 12022 5.996% 93.006% # ( 4, 6 ] 9095 4.536% 97.542% # ( 6, 10 ] 3516 1.754% 99.296% ( 10, 15 ] 618 0.308% 99.604% ( 15, 22 ] 150 0.075% 99.679% ( 22, 34 ] 66 0.033% 99.712% ( 34, 51 ] 3 0.001% 99.713% ( 51, 76 ] 1 0.000% 99.714% ( 76, 110 ] 125 0.062% 99.776% ( 110, 170 ] 169 0.084% 99.860% ( 170, 250 ] 118 0.059% 99.919% ( 250, 380 ] 67 0.033% 99.953% ( 380, 580 ] 45 0.022% 99.975% ( 580, 870 ] 39 0.019% 99.995% ( 870, 1300 ] 12 0.006% 100.000% ( 1300, 1900 ] 14 0.007% 100.007% ( 1900, 2900 ] 7 0.003% 100.011% ( 2900, 4400 ] 8 0.004% 100.015% ( 4400, 6600 ] 2 0.001% 100.016% ** Level 4 read latency histogram (micros): Count: 15 Average: 1802.4000 StdDev: 1393.61 Min: 365 Median: 1480.0000 Max: 5092 Percentiles: P50: 1480.00 P75: 2150.00 P99: 5092.00 P99.9: 5092.00 P99.99: 5092.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 580, 870 ] 4 26.667% 33.333% ##### ( 870, 1300 ] 1 6.667% 40.000% # ( 1300, 1900 ] 5 33.333% 73.333% ####### ( 1900, 2900 ] 1 6.667% 80.000% # ( 2900, 4400 ] 1 6.667% 86.667% # ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 40 Average: 783.5000 StdDev: 1068.12 Min: 73 Median: 276.0000 Max: 3545 Percentiles: P50: 276.00 P75: 1013.33 P99: 3545.00 P99.9: 3545.00 P99.99: 3545.00 ------------------------------------------------------ ( 51, 76 ] 3 7.500% 7.500% ## ( 76, 110 ] 9 22.500% 30.000% ##### ( 110, 170 ] 6 15.000% 45.000% ### ( 170, 250 ] 1 2.500% 47.500% # ( 250, 380 ] 5 12.500% 60.000% ### ( 380, 580 ] 2 5.000% 65.000% # ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 2 5.000% 85.000% # ( 1900, 2900 ] 2 5.000% 90.000% # ( 2900, 4400 ] 4 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 20.0 total, 3.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 294.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.868 H:M:S, 19.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 275.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.909 H:M:S, 25.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/19-17:57:56 ... thread 0: (1000000,7000000) ops and (86378.1,223084.4) ops/second in (11.577008,31.378265) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 2.46 GB 0.0 6.3 0.0 6.3 13.0 6.6 0.0 2.0 149.9 306.8 43.29 40.72 122 0.355 6587K 8386 0.0 0.0 L1 28/28 2.11 GB 0.0 5.9 4.1 1.8 5.8 4.0 0.1 1.4 229.4 226.8 26.31 25.11 4 6.577 6128K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 1.9 2.0 237.3 237.2 0.53 0.51 1 0.531 127K 49 0.0 0.0 L3 23/9 1.69 GB 1.0 1.4 0.5 0.9 1.4 0.5 1.6 2.8 214.1 213.9 6.54 5.74 4 1.635 1388K 1307 0.0 0.0 L4 156/15 9.58 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/60 102.70 GB 0.0 13.7 4.6 9.1 20.3 11.2 6.4 3.1 183.2 271.0 76.67 72.09 131 0.585 14M 78K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.7 4.6 9.1 20.3 11.2 6.0 3.1 183.2 271.0 76.67 72.09 131 0.585 14M 78K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.7 4.6 9.1 13.6 4.5 0.0 0.0 244.3 242.9 57.51 55.02 31 1.855 14M 78K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 355.1 19.16 17.07 100 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.6 total, 31.4 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.29 GB write, 657.16 MB/s write, 13.72 GB read, 444.43 MB/s read, 76.7 seconds Interval compaction: 20.29 GB write, 662.00 MB/s write, 13.72 GB read, 447.70 MB/s read, 76.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 17, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2732456 Average: 2.2455 StdDev: 12.93 Min: 0 Median: 1.4258 Max: 5063 Percentiles: P50: 1.43 P75: 1.81 P99: 5.73 P99.9: 14.24 P99.99: 168.52 ------------------------------------------------------ [ 0, 1 ] 614128 22.475% 22.475% #### ( 1, 2 ] 1766414 64.646% 87.121% ############# ( 2, 3 ] 192200 7.034% 94.155% # ( 3, 4 ] 88868 3.252% 97.407% # ( 4, 6 ] 50179 1.836% 99.244% ( 6, 10 ] 16323 0.597% 99.841% ( 10, 15 ] 1902 0.070% 99.911% ( 15, 22 ] 256 0.009% 99.920% ( 22, 34 ] 25 0.001% 99.921% ( 34, 51 ] 12 0.000% 99.921% ( 51, 76 ] 20 0.001% 99.922% ( 76, 110 ] 896 0.033% 99.955% ( 110, 170 ] 984 0.036% 99.991% ( 170, 250 ] 281 0.010% 100.001% ( 250, 380 ] 214 0.008% 100.009% ( 380, 580 ] 149 0.005% 100.014% ( 580, 870 ] 101 0.004% 100.018% ( 870, 1300 ] 53 0.002% 100.020% ( 1300, 1900 ] 21 0.001% 100.021% ( 1900, 2900 ] 18 0.001% 100.022% ( 2900, 4400 ] 7 0.000% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 580250 Average: 2.6819 StdDev: 18.06 Min: 0 Median: 1.4431 Max: 4330 Percentiles: P50: 1.44 P75: 1.84 P99: 8.09 P99.9: 155.65 P99.99: 776.33 ------------------------------------------------------ [ 0, 1 ] 127299 21.939% 21.939% #### ( 1, 2 ] 367507 63.336% 85.275% ############# ( 2, 3 ] 42892 7.392% 92.667% # ( 3, 4 ] 19397 3.343% 96.009% # ( 4, 6 ] 13610 2.346% 98.355% ( 6, 10 ] 7169 1.236% 99.591% ( 10, 15 ] 627 0.108% 99.699% ( 15, 22 ] 108 0.019% 99.717% ( 22, 34 ] 10 0.002% 99.719% ( 34, 51 ] 3 0.001% 99.719% ( 51, 76 ] 39 0.007% 99.726% ( 76, 110 ] 639 0.110% 99.836% ( 110, 170 ] 486 0.084% 99.920% ( 170, 250 ] 122 0.021% 99.941% ( 250, 380 ] 130 0.022% 99.963% ( 380, 580 ] 112 0.019% 99.983% ( 580, 870 ] 62 0.011% 99.993% ( 870, 1300 ] 26 0.004% 99.998% ( 1300, 1900 ] 17 0.003% 100.001% ( 1900, 2900 ] 2 0.000% 100.001% ( 2900, 4400 ] 1 0.000% 100.001% ** Level 2 read latency histogram (micros): Count: 60265 Average: 2.9973 StdDev: 22.86 Min: 0 Median: 1.5409 Max: 3074 Percentiles: P50: 1.54 P75: 1.96 P99: 8.40 P99.9: 204.77 P99.99: 845.19 ------------------------------------------------------ [ 0, 1 ] 10521 17.458% 17.458% ### ( 1, 2 ] 36257 60.163% 77.621% ############ ( 2, 3 ] 6051 10.041% 87.661% ## ( 3, 4 ] 3731 6.191% 93.852% # ( 4, 6 ] 2623 4.352% 98.205% # ( 6, 10 ] 800 1.327% 99.532% ( 10, 15 ] 122 0.202% 99.735% ( 15, 22 ] 13 0.022% 99.756% ( 22, 34 ] 3 0.005% 99.761% ( 34, 51 ] 3 0.005% 99.766% ( 76, 110 ] 19 0.032% 99.798% ( 110, 170 ] 50 0.083% 99.881% ( 170, 250 ] 27 0.045% 99.925% ( 250, 380 ] 17 0.028% 99.954% ( 380, 580 ] 11 0.018% 99.972% ( 580, 870 ] 12 0.020% 99.992% ( 870, 1300 ] 1 0.002% 99.993% ( 1300, 1900 ] 3 0.005% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 207013 Average: 4.3266 StdDev: 45.34 Min: 0 Median: 1.5830 Max: 5176 Percentiles: P50: 1.58 P75: 2.06 P99: 9.81 P99.9: 451.28 P99.99: 1088.57 ------------------------------------------------------ [ 0, 1 ] 33390 16.129% 16.129% ### ( 1, 2 ] 120278 58.102% 74.231% ############ ( 2, 3 ] 25240 12.192% 86.424% ## ( 3, 4 ] 12793 6.180% 92.603% # ( 4, 6 ] 9663 4.668% 97.271% # ( 6, 10 ] 3756 1.814% 99.086% ( 10, 15 ] 682 0.329% 99.415% ( 15, 22 ] 171 0.083% 99.498% ( 22, 34 ] 68 0.033% 99.530% ( 34, 51 ] 3 0.001% 99.532% ( 51, 76 ] 1 0.000% 99.532% ( 76, 110 ] 134 0.065% 99.597% ( 110, 170 ] 210 0.101% 99.699% ( 170, 250 ] 200 0.097% 99.795% ( 250, 380 ] 178 0.086% 99.881% ( 380, 580 ] 115 0.056% 99.937% ( 580, 870 ] 94 0.045% 99.982% ( 870, 1300 ] 36 0.017% 100.000% ( 1300, 1900 ] 22 0.011% 100.010% ( 1900, 2900 ] 13 0.006% 100.016% ( 2900, 4400 ] 9 0.004% 100.021% ( 4400, 6600 ] 2 0.001% 100.022% ** Level 4 read latency histogram (micros): Count: 15 Average: 1802.4000 StdDev: 1393.61 Min: 365 Median: 1480.0000 Max: 5092 Percentiles: P50: 1480.00 P75: 2150.00 P99: 5092.00 P99.9: 5092.00 P99.99: 5092.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 580, 870 ] 4 26.667% 33.333% ##### ( 870, 1300 ] 1 6.667% 40.000% # ( 1300, 1900 ] 5 33.333% 73.333% ####### ( 1900, 2900 ] 1 6.667% 80.000% # ( 2900, 4400 ] 1 6.667% 86.667% # ( 4400, 6600 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 80 Average: 1002.2750 StdDev: 1174.05 Min: 73 Median: 413.3333 Max: 4158 Percentiles: P50: 413.33 P75: 1300.00 P99: 4158.00 P99.9: 4158.00 P99.99: 4158.00 ------------------------------------------------------ ( 51, 76 ] 3 3.750% 3.750% # ( 76, 110 ] 9 11.250% 15.000% ## ( 110, 170 ] 8 10.000% 25.000% ## ( 170, 250 ] 6 7.500% 32.500% ## ( 250, 380 ] 13 16.250% 48.750% ### ( 380, 580 ] 6 7.500% 56.250% ## ( 580, 870 ] 7 8.750% 65.000% ## ( 870, 1300 ] 8 10.000% 75.000% ## ( 1300, 1900 ] 2 2.500% 77.500% # ( 1900, 2900 ] 8 10.000% 87.500% ## ( 2900, 4400 ] 10 12.500% 100.000% ### ** DB Stats ** Uptime(secs): 31.6 total, 11.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 217.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.663 H:M:S, 40.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 85.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.795 H:M:S, 76.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/11/19-17:57:59 ... thread 0: (1000000,8000000) ops and (300309.8,230493.3) ops/second in (3.329895,34.708160) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 3.38 GB 62.9 6.9 0.0 6.9 14.4 7.6 0.0 1.9 145.6 305.4 48.45 45.23 137 0.354 7163K 8997 0.0 0.0 L1 28/28 2.11 GB 0.0 5.9 4.1 1.8 5.8 4.0 0.1 1.4 229.4 226.8 26.31 25.11 4 6.577 6128K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 1.9 2.0 237.3 237.2 0.53 0.51 1 0.531 127K 49 0.0 0.0 L3 14/0 951.25 MB 1.0 1.4 0.5 0.9 1.4 0.5 1.6 2.8 214.1 213.9 6.54 5.74 4 1.635 1388K 1307 0.0 0.0 L4 171/0 9.66 GB 1.0 0.9 0.8 0.1 0.9 0.8 1.3 1.1 150.5 149.9 5.96 4.12 6 0.994 879K 2721 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/40 103.62 GB 0.0 15.1 5.4 9.8 22.6 12.9 7.0 3.0 176.7 264.0 87.79 80.71 152 0.578 15M 81K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.1 5.4 9.8 22.6 12.9 6.6 3.0 176.7 264.0 87.79 80.71 152 0.578 15M 81K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.1 5.4 9.8 15.1 5.3 0.0 0.0 236.6 235.3 65.58 61.21 39 1.681 15M 81K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 348.9 22.21 19.50 113 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.9 total, 34.7 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.64 GB write, 663.38 MB/s write, 15.15 GB read, 443.99 MB/s read, 87.8 seconds Interval compaction: 22.64 GB write, 667.80 MB/s write, 15.15 GB read, 446.95 MB/s read, 87.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 30, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3074165 Average: 2.3208 StdDev: 17.04 Min: 0 Median: 1.4344 Max: 5071 Percentiles: P50: 1.43 P75: 1.82 P99: 5.81 P99.9: 14.22 P99.99: 196.08 ------------------------------------------------------ [ 0, 1 ] 672948 21.890% 21.890% #### ( 1, 2 ] 1989276 64.709% 86.600% ############# ( 2, 3 ] 224202 7.293% 93.893% # ( 3, 4 ] 102849 3.346% 97.239% # ( 4, 6 ] 59906 1.949% 99.187% ( 6, 10 ] 19867 0.646% 99.834% ( 10, 15 ] 2422 0.079% 99.912% ( 15, 22 ] 299 0.010% 99.922% ( 22, 34 ] 27 0.001% 99.923% ( 34, 51 ] 12 0.000% 99.923% ( 51, 76 ] 23 0.001% 99.924% ( 76, 110 ] 910 0.030% 99.954% ( 110, 170 ] 1009 0.033% 99.987% ( 170, 250 ] 330 0.011% 99.997% ( 250, 380 ] 268 0.009% 100.006% ( 380, 580 ] 212 0.007% 100.013% ( 580, 870 ] 157 0.005% 100.018% ( 870, 1300 ] 90 0.003% 100.021% ( 1300, 1900 ] 37 0.001% 100.022% ( 1900, 2900 ] 30 0.001% 100.023% ( 2900, 4400 ] 20 0.001% 100.024% ( 4400, 6600 ] 5 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 735776 Average: 3.0152 StdDev: 29.22 Min: 0 Median: 1.5174 Max: 4859 Percentiles: P50: 1.52 P75: 1.92 P99: 8.28 P99.9: 123.58 P99.99: 369.10 ------------------------------------------------------ [ 0, 1 ] 133690 18.170% 18.170% #### ( 1, 2 ] 452648 61.520% 79.690% ############ ( 2, 3 ] 72545 9.860% 89.549% ## ( 3, 4 ] 35212 4.786% 94.335% # ( 4, 6 ] 28478 3.870% 98.206% # ( 6, 10 ] 10275 1.396% 99.602% ( 10, 15 ] 1190 0.162% 99.764% ( 15, 22 ] 183 0.025% 99.789% ( 22, 34 ] 20 0.003% 99.791% ( 34, 51 ] 8 0.001% 99.792% ( 51, 76 ] 40 0.005% 99.798% ( 76, 110 ] 639 0.087% 99.885% ( 110, 170 ] 496 0.067% 99.952% ( 170, 250 ] 141 0.019% 99.971% ( 250, 380 ] 150 0.020% 99.992% ( 380, 580 ] 148 0.020% 100.012% ( 580, 870 ] 114 0.015% 100.027% ( 870, 1300 ] 55 0.007% 100.035% ( 1300, 1900 ] 31 0.004% 100.039% ( 1900, 2900 ] 21 0.003% 100.042% ( 2900, 4400 ] 17 0.002% 100.044% ( 4400, 6600 ] 1 0.000% 100.044% ** Level 2 read latency histogram (micros): Count: 60265 Average: 2.9973 StdDev: 22.86 Min: 0 Median: 1.5409 Max: 3074 Percentiles: P50: 1.54 P75: 1.96 P99: 8.40 P99.9: 204.77 P99.99: 845.19 ------------------------------------------------------ [ 0, 1 ] 10521 17.458% 17.458% ### ( 1, 2 ] 36257 60.163% 77.621% ############ ( 2, 3 ] 6051 10.041% 87.661% ## ( 3, 4 ] 3731 6.191% 93.852% # ( 4, 6 ] 2623 4.352% 98.205% # ( 6, 10 ] 800 1.327% 99.532% ( 10, 15 ] 122 0.202% 99.735% ( 15, 22 ] 13 0.022% 99.756% ( 22, 34 ] 3 0.005% 99.761% ( 34, 51 ] 3 0.005% 99.766% ( 76, 110 ] 19 0.032% 99.798% ( 110, 170 ] 50 0.083% 99.881% ( 170, 250 ] 27 0.045% 99.925% ( 250, 380 ] 17 0.028% 99.954% ( 380, 580 ] 11 0.018% 99.972% ( 580, 870 ] 12 0.020% 99.992% ( 870, 1300 ] 1 0.002% 99.993% ( 1300, 1900 ] 3 0.005% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 264842 Average: 6.4328 StdDev: 74.57 Min: 0 Median: 1.6249 Max: 5262 Percentiles: P50: 1.62 P75: 2.26 P99: 11.96 P99.9: 822.87 P99.99: 2046.82 ------------------------------------------------------ [ 0, 1 ] 37199 14.046% 14.046% ### ( 1, 2 ] 152386 57.538% 71.584% ############ ( 2, 3 ] 35121 13.261% 84.845% ### ( 3, 4 ] 18208 6.875% 91.720% # ( 4, 6 ] 13847 5.228% 96.949% # ( 6, 10 ] 5072 1.915% 98.864% ( 10, 15 ] 919 0.347% 99.211% ( 15, 22 ] 200 0.076% 99.286% ( 22, 34 ] 69 0.026% 99.312% ( 34, 51 ] 3 0.001% 99.314% ( 51, 76 ] 2 0.001% 99.314% ( 76, 110 ] 146 0.055% 99.369% ( 110, 170 ] 276 0.104% 99.474% ( 170, 250 ] 300 0.113% 99.587% ( 250, 380 ] 308 0.116% 99.703% ( 380, 580 ] 321 0.121% 99.824% ( 580, 870 ] 239 0.090% 99.915% ( 870, 1300 ] 131 0.049% 99.964% ( 1300, 1900 ] 60 0.023% 99.987% ( 1900, 2900 ] 58 0.022% 100.009% ( 2900, 4400 ] 33 0.012% 100.021% ( 4400, 6600 ] 8 0.003% 100.024% ** Level 4 read latency histogram (micros): Count: 205 Average: 203.2098 StdDev: 624.20 Min: 1 Median: 2.1800 Max: 5092 Percentiles: P50: 2.18 P75: 28.33 P99: 4325.00 P99.9: 5092.00 P99.99: 5092.00 ------------------------------------------------------ [ 0, 1 ] 39 19.024% 19.024% #### ( 1, 2 ] 59 28.780% 47.805% ###### ( 2, 3 ] 25 12.195% 60.000% ## ( 3, 4 ] 10 4.878% 64.878% # ( 4, 6 ] 5 2.439% 67.317% ( 10, 15 ] 4 1.951% 69.268% ( 15, 22 ] 7 3.415% 72.683% # ( 22, 34 ] 9 4.390% 77.073% # ( 34, 51 ] 1 0.488% 77.561% ( 51, 76 ] 1 0.488% 78.049% ( 110, 170 ] 4 1.951% 80.000% ( 170, 250 ] 11 5.366% 85.366% # ( 250, 380 ] 4 1.951% 87.317% ( 380, 580 ] 4 1.951% 89.268% ( 580, 870 ] 8 3.902% 93.171% # ( 870, 1300 ] 3 1.463% 94.634% ( 1300, 1900 ] 7 3.415% 98.049% # ( 1900, 2900 ] 1 0.488% 98.537% ( 2900, 4400 ] 1 0.488% 99.024% ( 4400, 6600 ] 2 0.976% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 985.8417 StdDev: 1140.44 Min: 73 Median: 446.6667 Max: 4158 Percentiles: P50: 446.67 P75: 1260.91 P99: 4158.00 P99.9: 4158.00 P99.99: 4158.00 ------------------------------------------------------ ( 51, 76 ] 3 2.500% 2.500% # ( 76, 110 ] 11 9.167% 11.667% ## ( 110, 170 ] 18 15.000% 26.667% ### ( 170, 250 ] 7 5.833% 32.500% # ( 250, 380 ] 17 14.167% 46.667% ### ( 380, 580 ] 12 10.000% 56.667% ## ( 580, 870 ] 12 10.000% 66.667% ## ( 870, 1300 ] 11 9.167% 75.833% ## ( 1300, 1900 ] 2 1.667% 77.500% ( 1900, 2900 ] 13 10.833% 88.333% ## ( 2900, 4400 ] 14 11.667% 100.000% ## ** DB Stats ** Uptime(secs): 34.9 total, 3.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 225.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.309 H:M:S, 38.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 295.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.646 H:M:S, 19.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-17:58:22 ... thread 0: (1000000,9000000) ops and (44490.3,157384.0) ops/second in (22.476824,57.184984) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/6 1.90 GB 6.3 9.2 0.0 9.2 17.7 8.5 0.0 2.1 152.3 294.1 61.62 56.55 154 0.400 9528K 18K 0.0 0.0 L1 12/12 1.46 GB 0.0 10.5 6.5 4.0 10.3 6.4 0.1 1.6 228.0 224.8 47.00 44.14 5 9.399 9285K 68K 0.0 0.0 L2 1/0 86.10 MB 0.9 0.1 0.1 0.1 0.1 0.1 5.0 2.0 237.3 237.2 0.53 0.51 1 0.531 127K 49 0.0 0.0 L3 18/1 1.06 GB 1.0 2.6 1.0 1.6 2.6 1.0 4.1 2.6 157.2 155.9 17.12 11.64 10 1.712 2699K 20K 0.0 0.0 L4 164/3 9.85 GB 1.0 4.3 3.5 0.8 4.3 3.5 1.4 1.2 131.9 131.4 33.53 20.32 31 1.082 4420K 15K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/22 104.48 GB 0.0 26.7 11.1 15.6 35.0 19.5 15.1 4.1 171.1 224.6 159.80 133.16 201 0.795 26M 123K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.7 11.1 15.6 35.0 19.5 14.7 4.1 171.1 224.6 159.80 133.16 201 0.795 26M 123K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.7 11.1 15.6 26.5 10.9 0.0 0.0 204.6 203.0 133.62 110.99 75 1.782 26M 123K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 334.5 26.18 22.17 126 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.4 total, 57.2 interval Flush(GB): cumulative 8.552, interval 8.552 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.05 GB write, 625.01 MB/s write, 26.70 GB read, 476.13 MB/s read, 159.8 seconds Interval compaction: 35.05 GB write, 627.54 MB/s write, 26.70 GB read, 478.06 MB/s read, 159.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 29, pending-compaction-bytes-stops: 0, total-delays: 50, total-stops: 41, interval: 91 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4306722 Average: 2.7331 StdDev: 29.07 Min: 0 Median: 1.4454 Max: 7733 Percentiles: P50: 1.45 P75: 1.84 P99: 6.93 P99.9: 134.76 P99.99: 398.37 ------------------------------------------------------ [ 0, 1 ] 931728 21.634% 21.634% #### ( 1, 2 ] 2742571 63.681% 85.315% ############# ( 2, 3 ] 328635 7.631% 92.946% ## ( 3, 4 ] 151327 3.514% 96.460% # ( 4, 6 ] 101153 2.349% 98.809% ( 6, 10 ] 35642 0.828% 99.636% ( 10, 15 ] 4847 0.113% 99.749% ( 15, 22 ] 826 0.019% 99.768% ( 22, 34 ] 49 0.001% 99.769% ( 34, 51 ] 17 0.000% 99.769% ( 51, 76 ] 118 0.003% 99.772% ( 76, 110 ] 3958 0.092% 99.864% ( 110, 170 ] 3747 0.087% 99.951% ( 170, 250 ] 924 0.021% 99.973% ( 250, 380 ] 702 0.016% 99.989% ( 380, 580 ] 537 0.012% 100.001% ( 580, 870 ] 334 0.008% 100.009% ( 870, 1300 ] 167 0.004% 100.013% ( 1300, 1900 ] 93 0.002% 100.015% ( 1900, 2900 ] 114 0.003% 100.018% ( 2900, 4400 ] 109 0.003% 100.020% ( 4400, 6600 ] 22 0.001% 100.021% ( 6600, 9900 ] 4 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 2067033 Average: 4.7725 StdDev: 73.60 Min: 0 Median: 1.5906 Max: 8037 Percentiles: P50: 1.59 P75: 2.14 P99: 9.11 P99.9: 143.65 P99.99: 452.30 ------------------------------------------------------ [ 0, 1 ] 334829 16.199% 16.199% ### ( 1, 2 ] 1183024 57.233% 73.431% ########### ( 2, 3 ] 238099 11.519% 84.950% ## ( 3, 4 ] 133664 6.466% 91.417% # ( 4, 6 ] 126216 6.106% 97.523% # ( 6, 10 ] 39213 1.897% 99.420% ( 10, 15 ] 6083 0.294% 99.714% ( 15, 22 ] 942 0.046% 99.760% ( 22, 34 ] 74 0.004% 99.763% ( 34, 51 ] 18 0.001% 99.764% ( 51, 76 ] 219 0.011% 99.775% ( 76, 110 ] 1737 0.084% 99.859% ( 110, 170 ] 1512 0.073% 99.932% ( 170, 250 ] 422 0.020% 99.953% ( 250, 380 ] 548 0.027% 99.979% ( 380, 580 ] 626 0.030% 100.009% ( 580, 870 ] 622 0.030% 100.039% ( 870, 1300 ] 425 0.021% 100.060% ( 1300, 1900 ] 315 0.015% 100.075% ( 1900, 2900 ] 298 0.014% 100.090% ( 2900, 4400 ] 381 0.018% 100.108% ( 4400, 6600 ] 75 0.004% 100.112% ( 6600, 9900 ] 14 0.001% 100.112% ** Level 2 read latency histogram (micros): Count: 60265 Average: 2.9973 StdDev: 22.86 Min: 0 Median: 1.5409 Max: 3074 Percentiles: P50: 1.54 P75: 1.96 P99: 8.40 P99.9: 204.77 P99.99: 845.19 ------------------------------------------------------ [ 0, 1 ] 10521 17.458% 17.458% ### ( 1, 2 ] 36257 60.163% 77.621% ############ ( 2, 3 ] 6051 10.041% 87.661% ## ( 3, 4 ] 3731 6.191% 93.852% # ( 4, 6 ] 2623 4.352% 98.205% # ( 6, 10 ] 800 1.327% 99.532% ( 10, 15 ] 122 0.202% 99.735% ( 15, 22 ] 13 0.022% 99.756% ( 22, 34 ] 3 0.005% 99.761% ( 34, 51 ] 3 0.005% 99.766% ( 76, 110 ] 19 0.032% 99.798% ( 110, 170 ] 50 0.083% 99.881% ( 170, 250 ] 27 0.045% 99.925% ( 250, 380 ] 17 0.028% 99.954% ( 380, 580 ] 11 0.018% 99.972% ( 580, 870 ] 12 0.020% 99.992% ( 870, 1300 ] 1 0.002% 99.993% ( 1300, 1900 ] 3 0.005% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 605301 Average: 7.6269 StdDev: 93.01 Min: 0 Median: 1.7678 Max: 7563 Percentiles: P50: 1.77 P75: 2.73 P99: 9.88 P99.9: 861.07 P99.99: 1610.01 ------------------------------------------------------ [ 0, 1 ] 47847 7.905% 7.905% ## ( 1, 2 ] 331841 54.822% 62.727% ########### ( 2, 3 ] 101124 16.706% 79.434% ### ( 3, 4 ] 57542 9.506% 88.940% ## ( 4, 6 ] 50394 8.325% 97.265% ## ( 6, 10 ] 10828 1.789% 99.054% ( 10, 15 ] 1974 0.326% 99.380% ( 15, 22 ] 317 0.052% 99.433% ( 22, 34 ] 86 0.014% 99.447% ( 34, 51 ] 13 0.002% 99.449% ( 51, 76 ] 10 0.002% 99.451% ( 76, 110 ] 168 0.028% 99.478% ( 110, 170 ] 326 0.054% 99.532% ( 170, 250 ] 420 0.069% 99.602% ( 250, 380 ] 524 0.087% 99.688% ( 380, 580 ] 674 0.111% 99.800% ( 580, 870 ] 627 0.104% 99.903% ( 870, 1300 ] 418 0.069% 99.972% ( 1300, 1900 ] 208 0.034% 100.007% ( 1900, 2900 ] 199 0.033% 100.039% ( 2900, 4400 ] 163 0.027% 100.066% ( 4400, 6600 ] 21 0.003% 100.070% ( 6600, 9900 ] 1 0.000% 100.070% ** Level 4 read latency histogram (micros): Count: 139332 Average: 17.5861 StdDev: 182.96 Min: 1 Median: 1.8858 Max: 7506 Percentiles: P50: 1.89 P75: 2.98 P99: 292.79 P99.9: 2857.21 P99.99: 4016.25 ------------------------------------------------------ [ 0, 1 ] 4567 3.278% 3.278% # ( 1, 2 ] 73489 52.744% 56.022% ########### ( 2, 3 ] 27021 19.393% 75.415% #### ( 3, 4 ] 15082 10.825% 86.239% ## ( 4, 6 ] 14084 10.108% 96.348% ## ( 6, 10 ] 2697 1.936% 98.283% ( 10, 15 ] 631 0.453% 98.736% ( 15, 22 ] 85 0.061% 98.797% ( 22, 34 ] 24 0.017% 98.814% ( 34, 51 ] 8 0.006% 98.820% ( 51, 76 ] 9 0.006% 98.827% ( 76, 110 ] 10 0.007% 98.834% ( 110, 170 ] 45 0.032% 98.866% ( 170, 250 ] 135 0.097% 98.963% ( 250, 380 ] 160 0.115% 99.078% ( 380, 580 ] 260 0.187% 99.264% ( 580, 870 ] 317 0.228% 99.492% ( 870, 1300 ] 258 0.185% 99.677% ( 1300, 1900 ] 170 0.122% 99.799% ( 1900, 2900 ] 148 0.106% 99.905% ( 2900, 4400 ] 160 0.115% 100.020% ( 4400, 6600 ] 27 0.019% 100.039% ( 6600, 9900 ] 3 0.002% 100.042% ** Level 5 read latency histogram (micros): Count: 280 Average: 1275.4821 StdDev: 1430.01 Min: 73 Median: 652.5000 Max: 7465 Percentiles: P50: 652.50 P75: 1900.00 P99: 6424.00 P99.9: 7465.00 P99.99: 7465.00 ------------------------------------------------------ ( 51, 76 ] 3 1.071% 1.071% ( 76, 110 ] 15 5.357% 6.429% # ( 110, 170 ] 30 10.714% 17.143% ## ( 170, 250 ] 12 4.286% 21.429% # ( 250, 380 ] 38 13.571% 35.000% ### ( 380, 580 ] 34 12.143% 47.143% ## ( 580, 870 ] 32 11.429% 58.571% ## ( 870, 1300 ] 31 11.071% 69.643% ## ( 1300, 1900 ] 15 5.357% 75.000% # ( 1900, 2900 ] 25 8.929% 83.929% ## ( 2900, 4400 ] 33 11.786% 95.714% ## ( 4400, 6600 ] 10 3.571% 99.286% # ( 6600, 9900 ] 2 0.714% 100.000% ** DB Stats ** Uptime(secs): 57.4 total, 22.5 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 154.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.468 H:M:S, 56.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 43.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:19.159 H:M:S, 85.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.057 micros/op 165097 ops/sec 60.001 seconds 9905999 operations; 160.0 MB/s Microseconds per write: Count: 9905999 Average: 6.0570 StdDev: 340.40 Min: 1 Median: 1.7604 Max: 707815 Percentiles: P50: 1.76 P75: 2.78 P99: 8.22 P99.9: 1179.38 P99.99: 2726.70 ------------------------------------------------------ [ 0, 1 ] 1187350 11.986% 11.986% ## ( 1, 2 ] 4951980 49.990% 61.976% ########## ( 2, 3 ] 1659864 16.756% 78.732% ### ( 3, 4 ] 1404127 14.175% 92.907% ### ( 4, 6 ] 553855 5.591% 98.498% # ( 6, 10 ] 89712 0.906% 99.403% ( 10, 15 ] 18469 0.186% 99.590% ( 15, 22 ] 6306 0.064% 99.653% ( 22, 34 ] 1629 0.016% 99.670% ( 34, 51 ] 205 0.002% 99.672% ( 51, 76 ] 38 0.000% 99.672% ( 76, 110 ] 6747 0.068% 99.740% ( 110, 170 ] 2935 0.030% 99.770% ( 170, 250 ] 309 0.003% 99.773% ( 250, 380 ] 67 0.001% 99.774% ( 380, 580 ] 15 0.000% 99.774% ( 580, 870 ] 17 0.000% 99.774% ( 870, 1300 ] 17329 0.175% 99.949% ( 1300, 1900 ] 54 0.001% 99.950% ( 1900, 2900 ] 4839 0.049% 99.998% ( 2900, 4400 ] 102 0.001% 99.999% ( 4400, 6600 ] 21 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 11 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 214556 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9905999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10222990968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 572 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32867622 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31442582316 rocksdb.compact.write.bytes COUNT : 31223755661 rocksdb.flush.write.bytes COUNT : 10106944576 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 67 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 260 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10025268224 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3721216 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31543637910 rocksdb.non.last.level.read.count COUNT : 7618336 rocksdb.block.checksum.compute.count COUNT : 7617259 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.423286 P95 : 3.883634 P99 : 6.526599 P100 : 707812.000000 COUNT : 9905999 SUM : 55469845 rocksdb.compaction.times.micros P50 : 1119722.222222 P95 : 4410000.000000 P99 : 18840000.000000 P100 : 20688713.000000 COUNT : 79 SUM : 138322320 rocksdb.compaction.times.cpu_micros P50 : 934102.564103 P95 : 4410000.000000 P99 : 18840000.000000 P100 : 19026078.000000 COUNT : 79 SUM : 115466156 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 689.176471 P95 : 1261.300000 P99 : 12442.000000 P100 : 22310.000000 COUNT : 138 SUM : 143169 rocksdb.compaction.outfile.sync.micros P50 : 1012.364865 P95 : 117875.000000 P99 : 318412.500000 P100 : 378035.000000 COUNT : 379 SUM : 6864994 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 99.891892 P95 : 1480.000000 P99 : 4150.000000 P100 : 5483.000000 COUNT : 250 SUM : 77756 rocksdb.table.open.io.micros P50 : 1326.315789 P95 : 8077.142857 P99 : 13203.428571 P100 : 24197.000000 COUNT : 572 SUM : 1207549 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.558587 P95 : 7.462515 P99 : 11.338988 P100 : 10649.000000 COUNT : 7615660 SUM : 45709182 rocksdb.read.block.get.micros P50 : 417.410072 P95 : 3567.241379 P99 : 5820.571429 P100 : 15914.000000 COUNT : 1144 SUM : 982057 rocksdb.write.raw.block.micros P50 : 0.512828 P95 : 0.974373 P99 : 2.847776 P100 : 10709.000000 COUNT : 10020515 SUM : 19240106 rocksdb.numfiles.in.singlecompaction P50 : 3.320225 P95 : 5.366667 P99 : 31.660000 P100 : 36.000000 COUNT : 139 SUM : 581 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558556 P95 : 1159.244979 P99 : 2484.563508 P100 : 707631.000000 COUNT : 213622 SUM : 32884265 rocksdb.sst.read.micros P50 : 1.521159 P95 : 4.415238 P99 : 8.490315 P100 : 8037.000000 COUNT : 7618632 SUM : 30383456 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9905999 SUM : 10222990968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 209595.959596 P95 : 362357.142857 P99 : 551950.000000 P100 : 892271.000000 COUNT : 138 SUM : 28694836 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 365 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0