[2024-12-15 06:53:34.175050] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-12-15 06:53:34.175202] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid698233 ] Set seed to 1734242014171543 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 06:53:34.260997] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 06:53:34.297659] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 06:53:34.297703] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 698233' to capture a snapshot of events at runtime. [2024-12-15 06:53:34.297715] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid698233 for offline analysis/debug. [2024-12-15 06:53:34.297740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 06:53:38 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-06:53:41 ... thread 0: (1000000,1000000) ops and (356598.7,356598.7) ops/second in (2.804273,2.804273) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 629.97 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 347.7 2.36 2.12 12 0.196 0 0 0.0 0.0 L1 1/1 63.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 1.16 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 237.0 236.9 0.53 0.50 1 0.532 127K 41 0.0 0.0 L3 18/0 992.24 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.1 1.0 210.9 210.9 0.59 0.52 1 0.592 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/9 96.94 GB 0.0 0.2 0.2 0.1 1.0 1.0 0.5 1.3 72.1 307.5 3.48 3.14 14 0.248 254K 41 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.2 0.1 1.0 1.0 0.4 1.3 72.1 307.5 3.48 3.14 14 0.248 254K 41 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.2 0.1 0.2 0.2 0.0 0.0 223.3 223.2 1.12 1.02 2 0.562 254K 41 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 347.7 2.36 2.12 12 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.04 GB write, 357.69 MB/s write, 0.24 GB read, 83.86 MB/s read, 3.5 seconds Interval compaction: 1.04 GB write, 381.28 MB/s write, 0.24 GB read, 89.39 MB/s read, 3.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 116657 Average: 1.8837 StdDev: 15.88 Min: 0 Median: 1.2234 Max: 3194 Percentiles: P50: 1.22 P75: 1.67 P99: 4.47 P99.9: 9.86 P99.99: 165.01 ------------------------------------------------------ [ 0, 1 ] 43656 37.423% 37.423% ####### ( 1, 2 ] 65680 56.302% 93.724% ########### ( 2, 3 ] 4014 3.441% 97.165% # ( 3, 4 ] 1918 1.644% 98.809% ( 4, 6 ] 958 0.821% 99.631% ( 6, 10 ] 327 0.280% 99.911% ( 10, 15 ] 71 0.061% 99.972% ( 15, 22 ] 12 0.010% 99.982% ( 22, 34 ] 2 0.002% 99.984% ( 51, 76 ] 1 0.001% 99.985% ( 110, 170 ] 8 0.007% 99.991% ( 170, 250 ] 4 0.003% 99.995% ( 250, 380 ] 5 0.004% 99.999% ( 870, 1300 ] 3 0.003% 100.002% ( 1900, 2900 ] 3 0.003% 100.004% ( 2900, 4400 ] 1 0.001% 100.005% ** Level 1 read latency histogram (micros): Count: 5 Average: 911.4000 StdDev: 823.45 Min: 167 Median: 347.5000 Max: 2118 Percentiles: P50: 347.50 P75: 1750.00 P99: 2118.00 P99.9: 2118.00 P99.99: 2118.00 ------------------------------------------------------ ( 110, 170 ] 1 20.000% 20.000% #### ( 250, 380 ] 2 40.000% 60.000% ######## ( 1300, 1900 ] 1 20.000% 80.000% #### ( 1900, 2900 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7828 StdDev: 4.93 Min: 1 Median: 1.2206 Max: 766 Percentiles: P50: 1.22 P75: 1.69 P99: 3.86 P99.9: 9.47 P99.99: 20.82 ------------------------------------------------------ [ 0, 1 ] 12106 38.204% 38.204% ######## ( 1, 2 ] 16944 53.471% 91.675% ########### ( 2, 3 ] 1912 6.034% 97.709% # ( 3, 4 ] 478 1.508% 99.217% ( 4, 6 ] 153 0.483% 99.700% ( 6, 10 ] 73 0.230% 99.931% ( 10, 15 ] 18 0.057% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 915.3882 StdDev: 1259.90 Min: 1 Median: 430.0000 Max: 5510 Percentiles: P50: 430.00 P75: 1232.81 P99: 5510.00 P99.9: 5510.00 P99.99: 5510.00 ------------------------------------------------------ [ 0, 1 ] 14 16.471% 16.471% ### ( 1, 2 ] 16 18.824% 35.294% #### ( 2, 3 ] 1 1.176% 36.471% ( 3, 4 ] 3 3.529% 40.000% # ( 4, 6 ] 3 3.529% 43.529% # ( 6, 10 ] 1 1.176% 44.706% ( 250, 380 ] 2 2.353% 47.059% ( 380, 580 ] 10 11.765% 58.824% ## ( 580, 870 ] 7 8.235% 67.059% ## ( 870, 1300 ] 8 9.412% 76.471% ## ( 1300, 1900 ] 4 4.706% 81.176% # ( 1900, 2900 ] 6 7.059% 88.235% # ( 2900, 4400 ] 8 9.412% 97.647% ## ( 4400, 6600 ] 2 2.353% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1736.6333 StdDev: 1315.63 Min: 193 Median: 1156.6667 Max: 5184 Percentiles: P50: 1156.67 P75: 2600.00 P99: 5184.00 P99.9: 5184.00 P99.99: 5184.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 580, 870 ] 10 33.333% 36.667% ####### ( 870, 1300 ] 6 20.000% 56.667% #### ( 1300, 1900 ] 2 6.667% 63.333% # ( 1900, 2900 ] 5 16.667% 80.000% ### ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 329.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.205 H:M:S, 6.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 350.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.205 H:M:S, 7.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-06:53:44 ... thread 0: (1000000,2000000) ops and (304665.9,328593.0) ops/second in (3.282284,6.086557) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 1.35 GB 25.2 0.5 0.0 0.5 2.3 1.8 0.0 1.3 69.1 328.2 7.29 6.69 28 0.260 511K 488 0.0 0.0 L1 4/4 377.35 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.2 1.2 251.5 251.1 1.50 1.46 1 1.503 383K 552 0.0 0.0 L2 1/0 1.16 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 237.0 236.9 0.53 0.50 1 0.532 127K 41 0.0 0.0 L3 18/0 992.24 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.1 1.0 210.9 210.9 0.59 0.52 1 0.592 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1196/16 97.98 GB 0.0 1.1 0.5 0.6 3.0 2.3 0.5 1.6 114.2 304.6 9.92 9.18 31 0.320 1150K 1081 0.0 0.0 Int 0/0 0.00 KB 0.0 1.1 0.5 0.6 3.0 2.3 0.4 1.6 114.2 304.6 9.92 9.18 31 0.320 1150K 1081 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.1 0.5 0.6 1.1 0.5 0.0 0.0 252.6 252.4 4.48 4.30 5 0.897 1150K 1081 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 347.8 5.43 4.87 26 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.95 GB write, 481.67 MB/s write, 1.11 GB read, 180.58 MB/s read, 9.9 seconds Interval compaction: 2.95 GB write, 496.31 MB/s write, 1.11 GB read, 186.07 MB/s read, 9.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 421655 Average: 2.0125 StdDev: 15.04 Min: 0 Median: 1.3619 Max: 4692 Percentiles: P50: 1.36 P75: 1.76 P99: 5.10 P99.9: 9.62 P99.99: 14.80 ------------------------------------------------------ [ 0, 1 ] 115156 27.310% 27.310% ##### ( 1, 2 ] 264378 62.700% 90.011% ############# ( 2, 3 ] 24156 5.729% 95.739% # ( 3, 4 ] 10675 2.532% 98.271% # ( 4, 6 ] 5577 1.323% 99.594% ( 6, 10 ] 1428 0.339% 99.932% ( 10, 15 ] 255 0.060% 99.993% ( 15, 22 ] 30 0.007% 100.000% ( 22, 34 ] 8 0.002% 100.002% ( 51, 76 ] 4 0.001% 100.003% ( 110, 170 ] 15 0.004% 100.006% ( 170, 250 ] 6 0.001% 100.008% ( 250, 380 ] 13 0.003% 100.011% ( 380, 580 ] 1 0.000% 100.011% ( 580, 870 ] 4 0.001% 100.012% ( 870, 1300 ] 6 0.001% 100.014% ( 1300, 1900 ] 2 0.000% 100.014% ( 1900, 2900 ] 6 0.001% 100.015% ( 2900, 4400 ] 2 0.000% 100.016% ( 4400, 6600 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 69827 Average: 2.0535 StdDev: 12.13 Min: 1 Median: 1.3990 Max: 2118 Percentiles: P50: 1.40 P75: 1.78 P99: 4.89 P99.9: 9.70 P99.99: 381.73 ------------------------------------------------------ [ 0, 1 ] 16559 23.714% 23.714% ##### ( 1, 2 ] 46005 65.884% 89.599% ############# ( 2, 3 ] 4416 6.324% 95.923% # ( 3, 4 ] 1744 2.498% 98.420% ( 4, 6 ] 912 1.306% 99.726% ( 6, 10 ] 131 0.188% 99.914% ( 10, 15 ] 41 0.059% 99.973% ( 15, 22 ] 7 0.010% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 110, 170 ] 1 0.001% 99.986% ( 250, 380 ] 3 0.004% 99.990% ( 380, 580 ] 2 0.003% 99.993% ( 580, 870 ] 2 0.003% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7828 StdDev: 4.93 Min: 1 Median: 1.2206 Max: 766 Percentiles: P50: 1.22 P75: 1.69 P99: 3.86 P99.9: 9.47 P99.99: 20.82 ------------------------------------------------------ [ 0, 1 ] 12106 38.204% 38.204% ######## ( 1, 2 ] 16944 53.471% 91.675% ########### ( 2, 3 ] 1912 6.034% 97.709% # ( 3, 4 ] 478 1.508% 99.217% ( 4, 6 ] 153 0.483% 99.700% ( 6, 10 ] 73 0.230% 99.931% ( 10, 15 ] 18 0.057% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 915.3882 StdDev: 1259.90 Min: 1 Median: 430.0000 Max: 5510 Percentiles: P50: 430.00 P75: 1232.81 P99: 5510.00 P99.9: 5510.00 P99.99: 5510.00 ------------------------------------------------------ [ 0, 1 ] 14 16.471% 16.471% ### ( 1, 2 ] 16 18.824% 35.294% #### ( 2, 3 ] 1 1.176% 36.471% ( 3, 4 ] 3 3.529% 40.000% # ( 4, 6 ] 3 3.529% 43.529% # ( 6, 10 ] 1 1.176% 44.706% ( 250, 380 ] 2 2.353% 47.059% ( 380, 580 ] 10 11.765% 58.824% ## ( 580, 870 ] 7 8.235% 67.059% ## ( 870, 1300 ] 8 9.412% 76.471% ## ( 1300, 1900 ] 4 4.706% 81.176% # ( 1900, 2900 ] 6 7.059% 88.235% # ( 2900, 4400 ] 8 9.412% 97.647% ## ( 4400, 6600 ] 2 2.353% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1736.6333 StdDev: 1315.63 Min: 193 Median: 1156.6667 Max: 5184 Percentiles: P50: 1156.67 P75: 2600.00 P99: 5184.00 P99.9: 5184.00 P99.99: 5184.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 580, 870 ] 10 33.333% 36.667% ####### ( 870, 1300 ] 6 20.000% 56.667% #### ( 1300, 1900 ] 2 6.667% 63.333% # ( 1900, 2900 ] 5 16.667% 80.000% ### ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 6.3 total, 3.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 313.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.851 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.646 H:M:S, 19.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-06:53:47 ... thread 0: (1000000,3000000) ops and (347813.4,334759.3) ops/second in (2.875105,8.961662) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 1.78 GB 125.9 1.4 0.0 1.4 4.1 2.8 0.0 1.5 104.2 317.3 13.30 12.33 45 0.295 1407K 1479 0.0 0.0 L1 4/0 362.99 MB 36.3 1.2 0.8 0.4 1.2 0.8 0.2 1.5 242.3 241.6 5.20 5.08 2 2.598 1278K 3429 0.0 0.0 L2 5/4 516.24 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.7 2.0 237.0 236.9 0.53 0.50 1 0.532 127K 41 0.0 0.0 L3 18/1 992.24 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 210.9 210.9 0.59 0.52 1 0.592 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1201/13 98.90 GB 0.0 2.8 1.0 1.8 5.6 3.7 1.0 2.0 147.6 291.9 19.61 18.43 49 0.400 2940K 4949 0.0 0.0 Int 0/0 0.00 KB 0.0 2.8 1.0 1.8 5.6 3.7 0.9 2.0 147.6 291.9 19.61 18.43 49 0.400 2940K 4949 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.8 1.0 1.8 2.8 1.0 0.0 0.0 251.2 250.8 11.53 11.19 9 1.281 2940K 4949 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 350.5 8.09 7.24 40 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.59 GB write, 625.86 MB/s write, 2.83 GB read, 316.54 MB/s read, 19.6 seconds Interval compaction: 5.59 GB write, 638.78 MB/s write, 2.83 GB read, 323.08 MB/s read, 19.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 714103 Average: 2.0728 StdDev: 12.45 Min: 0 Median: 1.4129 Max: 4692 Percentiles: P50: 1.41 P75: 1.80 P99: 5.39 P99.9: 9.58 P99.99: 14.19 ------------------------------------------------------ [ 0, 1 ] 167910 23.513% 23.513% ##### ( 1, 2 ] 458135 64.155% 87.669% ############# ( 2, 3 ] 49095 6.875% 94.544% # ( 3, 4 ] 22702 3.179% 97.723% # ( 4, 6 ] 13123 1.838% 99.561% ( 6, 10 ] 2713 0.380% 99.940% ( 10, 15 ] 423 0.059% 100.000% ( 15, 22 ] 47 0.007% 100.006% ( 22, 34 ] 13 0.002% 100.008% ( 34, 51 ] 6 0.001% 100.009% ( 51, 76 ] 8 0.001% 100.010% ( 110, 170 ] 22 0.003% 100.013% ( 170, 250 ] 13 0.002% 100.015% ( 250, 380 ] 19 0.003% 100.018% ( 380, 580 ] 6 0.001% 100.018% ( 580, 870 ] 7 0.001% 100.019% ( 870, 1300 ] 9 0.001% 100.021% ( 1300, 1900 ] 4 0.001% 100.021% ( 1900, 2900 ] 7 0.001% 100.022% ( 2900, 4400 ] 2 0.000% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 181071 Average: 2.1966 StdDev: 11.71 Min: 1 Median: 1.4845 Max: 2118 Percentiles: P50: 1.48 P75: 1.85 P99: 5.48 P99.9: 10.54 P99.99: 427.32 ------------------------------------------------------ [ 0, 1 ] 31008 17.125% 17.125% ### ( 1, 2 ] 122859 67.851% 84.976% ############## ( 2, 3 ] 16225 8.961% 93.937% ## ( 3, 4 ] 6243 3.448% 97.384% # ( 4, 6 ] 3947 2.180% 99.564% ( 6, 10 ] 591 0.326% 99.891% ( 10, 15 ] 156 0.086% 99.977% ( 15, 22 ] 13 0.007% 99.984% ( 22, 34 ] 1 0.001% 99.985% ( 34, 51 ] 1 0.001% 99.985% ( 51, 76 ] 2 0.001% 99.986% ( 110, 170 ] 1 0.001% 99.987% ( 250, 380 ] 4 0.002% 99.989% ( 380, 580 ] 8 0.004% 99.993% ( 580, 870 ] 3 0.002% 99.995% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 4 0.002% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7828 StdDev: 4.93 Min: 1 Median: 1.2206 Max: 766 Percentiles: P50: 1.22 P75: 1.69 P99: 3.86 P99.9: 9.47 P99.99: 20.82 ------------------------------------------------------ [ 0, 1 ] 12106 38.204% 38.204% ######## ( 1, 2 ] 16944 53.471% 91.675% ########### ( 2, 3 ] 1912 6.034% 97.709% # ( 3, 4 ] 478 1.508% 99.217% ( 4, 6 ] 153 0.483% 99.700% ( 6, 10 ] 73 0.230% 99.931% ( 10, 15 ] 18 0.057% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 12236 Average: 8.5080 StdDev: 129.54 Min: 1 Median: 1.5258 Max: 5510 Percentiles: P50: 1.53 P75: 1.90 P99: 6.04 P99.9: 2527.33 P99.99: 5254.04 ------------------------------------------------------ [ 0, 1 ] 1809 14.784% 14.784% ### ( 1, 2 ] 8195 66.975% 81.759% ############# ( 2, 3 ] 1283 10.485% 92.244% ## ( 3, 4 ] 496 4.054% 96.298% # ( 4, 6 ] 330 2.697% 98.995% # ( 6, 10 ] 64 0.523% 99.518% ( 10, 15 ] 12 0.098% 99.616% ( 250, 380 ] 2 0.016% 99.632% ( 380, 580 ] 10 0.082% 99.714% ( 580, 870 ] 7 0.057% 99.771% ( 870, 1300 ] 8 0.065% 99.837% ( 1300, 1900 ] 4 0.033% 99.869% ( 1900, 2900 ] 6 0.049% 99.918% ( 2900, 4400 ] 8 0.065% 99.984% ( 4400, 6600 ] 2 0.016% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1736.6333 StdDev: 1315.63 Min: 193 Median: 1156.6667 Max: 5184 Percentiles: P50: 1156.67 P75: 2600.00 P99: 5184.00 P99.9: 5184.00 P99.99: 5184.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 580, 870 ] 10 33.333% 36.667% ####### ( 870, 1300 ] 6 20.000% 56.667% #### ( 1300, 1900 ] 2 6.667% 63.333% # ( 1900, 2900 ] 5 16.667% 80.000% ### ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.054 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 342.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.203 H:M:S, 7.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-06:53:50 ... thread 0: (1000000,4000000) ops and (324816.5,332217.0) ops/second in (3.078661,12.040323) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.70 GB 56.7 2.4 0.0 2.4 6.1 3.7 0.0 1.6 122.6 311.0 20.05 18.74 62 0.323 2494K 2567 0.0 0.0 L1 4/4 362.99 MB 0.0 1.2 0.8 0.4 1.2 0.8 0.2 1.5 242.3 241.6 5.20 5.08 2 2.598 1278K 3429 0.0 0.0 L2 1/0 1.16 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.7 2.0 237.0 236.9 0.53 0.50 1 0.532 127K 41 0.0 0.0 L3 39/0 944.10 MB 0.9 0.7 0.6 0.1 0.7 0.6 0.1 1.2 205.4 205.2 3.66 3.23 2 1.831 763K 668 0.0 0.0 L4 148/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/14 99.82 GB 0.0 4.5 1.5 3.0 8.2 5.2 1.9 2.2 156.1 284.2 29.44 27.54 67 0.439 4664K 6705 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 1.5 3.0 8.2 5.2 1.8 2.2 156.1 284.2 29.44 27.54 67 0.439 4664K 6705 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 1.5 3.0 4.5 1.5 0.0 0.0 246.5 246.1 18.64 17.87 14 1.331 4664K 6705 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 350.0 10.80 9.68 53 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.17 GB write, 684.31 MB/s write, 4.49 GB read, 375.74 MB/s read, 29.4 seconds Interval compaction: 8.17 GB write, 694.82 MB/s write, 4.49 GB read, 381.51 MB/s read, 29.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 979372 Average: 2.0888 StdDev: 13.32 Min: 0 Median: 1.4114 Max: 4692 Percentiles: P50: 1.41 P75: 1.80 P99: 5.39 P99.9: 9.71 P99.99: 14.98 ------------------------------------------------------ [ 0, 1 ] 229932 23.477% 23.477% ##### ( 1, 2 ] 631398 64.470% 87.947% ############# ( 2, 3 ] 66211 6.761% 94.708% # ( 3, 4 ] 30021 3.065% 97.773% # ( 4, 6 ] 17240 1.760% 99.533% ( 6, 10 ] 3874 0.396% 99.929% ( 10, 15 ] 600 0.061% 99.990% ( 15, 22 ] 64 0.007% 99.997% ( 22, 34 ] 16 0.002% 99.998% ( 34, 51 ] 9 0.001% 99.999% ( 51, 76 ] 10 0.001% 100.000% ( 76, 110 ] 19 0.002% 100.002% ( 110, 170 ] 62 0.006% 100.009% ( 170, 250 ] 25 0.003% 100.011% ( 250, 380 ] 29 0.003% 100.014% ( 380, 580 ] 12 0.001% 100.015% ( 580, 870 ] 15 0.002% 100.017% ( 870, 1300 ] 13 0.001% 100.018% ( 1300, 1900 ] 7 0.001% 100.019% ( 1900, 2900 ] 7 0.001% 100.020% ( 2900, 4400 ] 6 0.001% 100.020% ( 4400, 6600 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 226653 Average: 2.1839 StdDev: 10.48 Min: 1 Median: 1.4916 Max: 2118 Percentiles: P50: 1.49 P75: 1.86 P99: 5.48 P99.9: 10.14 P99.99: 293.38 ------------------------------------------------------ [ 0, 1 ] 37049 16.346% 16.346% ### ( 1, 2 ] 155170 68.461% 84.808% ############## ( 2, 3 ] 20540 9.062% 93.870% ## ( 3, 4 ] 7997 3.528% 97.398% # ( 4, 6 ] 4912 2.167% 99.565% ( 6, 10 ] 753 0.332% 99.898% ( 10, 15 ] 189 0.083% 99.981% ( 15, 22 ] 14 0.006% 99.987% ( 22, 34 ] 1 0.000% 99.988% ( 34, 51 ] 1 0.000% 99.988% ( 51, 76 ] 2 0.001% 99.989% ( 110, 170 ] 1 0.000% 99.989% ( 250, 380 ] 4 0.002% 99.991% ( 380, 580 ] 8 0.004% 99.995% ( 580, 870 ] 3 0.001% 99.996% ( 870, 1300 ] 3 0.001% 99.997% ( 1300, 1900 ] 4 0.002% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7828 StdDev: 4.93 Min: 1 Median: 1.2206 Max: 766 Percentiles: P50: 1.22 P75: 1.69 P99: 3.86 P99.9: 9.47 P99.99: 20.82 ------------------------------------------------------ [ 0, 1 ] 12106 38.204% 38.204% ######## ( 1, 2 ] 16944 53.471% 91.675% ########### ( 2, 3 ] 1912 6.034% 97.709% # ( 3, 4 ] 478 1.508% 99.217% ( 4, 6 ] 153 0.483% 99.700% ( 6, 10 ] 73 0.230% 99.931% ( 10, 15 ] 18 0.057% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28849 Average: 5.1189 StdDev: 84.87 Min: 1 Median: 1.5464 Max: 5510 Percentiles: P50: 1.55 P75: 1.92 P99: 5.94 P99.9: 842.64 P99.99: 4234.08 ------------------------------------------------------ [ 0, 1 ] 3753 13.009% 13.009% ### ( 1, 2 ] 19530 67.697% 80.706% ############## ( 2, 3 ] 3494 12.111% 92.818% ## ( 3, 4 ] 1069 3.706% 96.523% # ( 4, 6 ] 736 2.551% 99.074% # ( 6, 10 ] 126 0.437% 99.511% ( 10, 15 ] 34 0.118% 99.629% ( 15, 22 ] 9 0.031% 99.660% ( 22, 34 ] 5 0.017% 99.678% ( 34, 51 ] 3 0.010% 99.688% ( 51, 76 ] 24 0.083% 99.771% ( 76, 110 ] 7 0.024% 99.795% ( 170, 250 ] 4 0.014% 99.809% ( 250, 380 ] 5 0.017% 99.827% ( 380, 580 ] 13 0.045% 99.872% ( 580, 870 ] 9 0.031% 99.903% ( 870, 1300 ] 8 0.028% 99.931% ( 1300, 1900 ] 4 0.014% 99.945% ( 1900, 2900 ] 6 0.021% 99.965% ( 2900, 4400 ] 8 0.028% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1736.6333 StdDev: 1315.63 Min: 193 Median: 1156.6667 Max: 5184 Percentiles: P50: 1156.67 P75: 2600.00 P99: 5184.00 P99.9: 5184.00 P99.99: 5184.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 580, 870 ] 10 33.333% 36.667% ####### ( 870, 1300 ] 6 20.000% 56.667% #### ( 1300, 1900 ] 2 6.667% 63.333% # ( 1900, 2900 ] 5 16.667% 80.000% ### ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 852.6000 StdDev: 760.65 Min: 87 Median: 500.0000 Max: 2296 Percentiles: P50: 500.00 P75: 1300.00 P99: 2296.00 P99.9: 2296.00 P99.99: 2296.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 2 10.000% 15.000% ## ( 170, 250 ] 1 5.000% 20.000% # ( 250, 380 ] 3 15.000% 35.000% ### ( 380, 580 ] 5 25.000% 60.000% ##### ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 12.2 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.446 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.392 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-06:53:54 ... thread 0: (1000000,5000000) ops and (235555.0,307019.4) ops/second in (4.245293,16.285616) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.69 GB 157.4 3.4 0.0 3.4 8.1 4.7 0.0 1.7 131.4 309.5 26.85 25.17 81 0.332 3582K 3652 0.0 0.0 L1 4/4 362.99 MB 0.0 1.2 0.8 0.4 1.2 0.8 0.2 1.5 242.3 241.6 5.20 5.08 2 2.598 1278K 3429 0.0 0.0 L2 1/0 1.16 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.7 2.0 237.0 236.9 0.53 0.50 1 0.532 127K 41 0.0 0.0 L3 39/0 944.10 MB 0.9 0.7 0.6 0.1 0.7 0.6 0.1 1.2 205.4 205.2 3.66 3.23 2 1.831 763K 668 0.0 0.0 L4 148/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/14 100.80 GB 0.0 5.5 1.5 4.0 10.2 6.2 1.9 2.2 156.3 288.2 36.24 33.98 86 0.421 5752K 7790 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.5 4.0 10.2 6.2 1.8 2.2 156.3 288.2 36.24 33.98 86 0.421 5752K 7790 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.5 4.0 5.5 1.5 0.0 0.0 251.0 250.6 22.57 21.73 18 1.254 5752K 7790 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 350.2 13.67 12.24 68 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.5 total, 16.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.20 GB write, 634.09 MB/s write, 5.53 GB read, 343.92 MB/s read, 36.2 seconds Interval compaction: 10.20 GB write, 641.29 MB/s write, 5.53 GB read, 347.83 MB/s read, 36.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 17, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1496109 Average: 2.1064 StdDev: 11.62 Min: 0 Median: 1.4254 Max: 4692 Percentiles: P50: 1.43 P75: 1.81 P99: 5.47 P99.9: 9.73 P99.99: 15.83 ------------------------------------------------------ [ 0, 1 ] 331409 22.151% 22.151% #### ( 1, 2 ] 979499 65.470% 87.621% ############# ( 2, 3 ] 104453 6.982% 94.603% # ( 3, 4 ] 46358 3.099% 97.701% # ( 4, 6 ] 26445 1.768% 99.469% ( 6, 10 ] 6923 0.463% 99.932% ( 10, 15 ] 862 0.058% 99.989% ( 15, 22 ] 88 0.006% 99.995% ( 22, 34 ] 22 0.001% 99.997% ( 34, 51 ] 12 0.001% 99.997% ( 51, 76 ] 13 0.001% 99.998% ( 76, 110 ] 66 0.004% 100.003% ( 110, 170 ] 130 0.009% 100.011% ( 170, 250 ] 57 0.004% 100.015% ( 250, 380 ] 41 0.003% 100.018% ( 380, 580 ] 35 0.002% 100.020% ( 580, 870 ] 28 0.002% 100.022% ( 870, 1300 ] 17 0.001% 100.023% ( 1300, 1900 ] 10 0.001% 100.024% ( 1900, 2900 ] 7 0.000% 100.024% ( 2900, 4400 ] 6 0.000% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 233553 Average: 2.2097 StdDev: 10.68 Min: 1 Median: 1.4862 Max: 2118 Percentiles: P50: 1.49 P75: 1.85 P99: 5.52 P99.9: 11.70 P99.99: 354.83 ------------------------------------------------------ [ 0, 1 ] 39329 16.839% 16.839% ### ( 1, 2 ] 159289 68.203% 85.042% ############## ( 2, 3 ] 20720 8.872% 93.914% ## ( 3, 4 ] 8091 3.464% 97.378% # ( 4, 6 ] 4986 2.135% 99.513% ( 6, 10 ] 839 0.359% 99.872% ( 10, 15 ] 193 0.083% 99.955% ( 15, 22 ] 14 0.006% 99.961% ( 22, 34 ] 1 0.000% 99.961% ( 34, 51 ] 1 0.000% 99.961% ( 51, 76 ] 7 0.003% 99.964% ( 76, 110 ] 37 0.016% 99.980% ( 110, 170 ] 12 0.005% 99.985% ( 170, 250 ] 5 0.002% 99.988% ( 250, 380 ] 7 0.003% 99.991% ( 380, 580 ] 8 0.003% 99.994% ( 580, 870 ] 5 0.002% 99.996% ( 870, 1300 ] 3 0.001% 99.997% ( 1300, 1900 ] 4 0.002% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7828 StdDev: 4.93 Min: 1 Median: 1.2206 Max: 766 Percentiles: P50: 1.22 P75: 1.69 P99: 3.86 P99.9: 9.47 P99.99: 20.82 ------------------------------------------------------ [ 0, 1 ] 12106 38.204% 38.204% ######## ( 1, 2 ] 16944 53.471% 91.675% ########### ( 2, 3 ] 1912 6.034% 97.709% # ( 3, 4 ] 478 1.508% 99.217% ( 4, 6 ] 153 0.483% 99.700% ( 6, 10 ] 73 0.230% 99.931% ( 10, 15 ] 18 0.057% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28849 Average: 5.1189 StdDev: 84.87 Min: 1 Median: 1.5464 Max: 5510 Percentiles: P50: 1.55 P75: 1.92 P99: 5.94 P99.9: 842.64 P99.99: 4234.08 ------------------------------------------------------ [ 0, 1 ] 3753 13.009% 13.009% ### ( 1, 2 ] 19530 67.697% 80.706% ############## ( 2, 3 ] 3494 12.111% 92.818% ## ( 3, 4 ] 1069 3.706% 96.523% # ( 4, 6 ] 736 2.551% 99.074% # ( 6, 10 ] 126 0.437% 99.511% ( 10, 15 ] 34 0.118% 99.629% ( 15, 22 ] 9 0.031% 99.660% ( 22, 34 ] 5 0.017% 99.678% ( 34, 51 ] 3 0.010% 99.688% ( 51, 76 ] 24 0.083% 99.771% ( 76, 110 ] 7 0.024% 99.795% ( 170, 250 ] 4 0.014% 99.809% ( 250, 380 ] 5 0.017% 99.827% ( 380, 580 ] 13 0.045% 99.872% ( 580, 870 ] 9 0.031% 99.903% ( 870, 1300 ] 8 0.028% 99.931% ( 1300, 1900 ] 4 0.014% 99.945% ( 1900, 2900 ] 6 0.021% 99.965% ( 2900, 4400 ] 8 0.028% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1736.6333 StdDev: 1315.63 Min: 193 Median: 1156.6667 Max: 5184 Percentiles: P50: 1156.67 P75: 2600.00 P99: 5184.00 P99.9: 5184.00 P99.99: 5184.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 580, 870 ] 10 33.333% 36.667% ####### ( 870, 1300 ] 6 20.000% 56.667% #### ( 1300, 1900 ] 2 6.667% 63.333% # ( 1900, 2900 ] 5 16.667% 80.000% ### ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 852.6000 StdDev: 760.65 Min: 87 Median: 500.0000 Max: 2296 Percentiles: P50: 500.00 P75: 1300.00 P99: 2296.00 P99.9: 2296.00 P99.99: 2296.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 2 10.000% 15.000% ## ( 170, 250 ] 1 5.000% 20.000% # ( 250, 380 ] 3 15.000% 35.000% ### ( 380, 580 ] 5 25.000% 60.000% ##### ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 16.5 total, 4.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 298.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.970 H:M:S, 18.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 231.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.524 H:M:S, 35.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-06:54:01 ... thread 0: (1000000,6000000) ops and (149592.8,261205.4) ops/second in (6.684814,22.970430) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.46 GB 12.6 4.7 0.0 4.7 10.3 5.6 0.0 1.8 140.4 306.1 34.56 32.43 99 0.349 4924K 6513 0.0 0.0 L1 13/13 1.47 GB 0.0 3.7 3.0 0.8 3.7 2.9 0.2 1.3 233.0 230.9 16.42 15.84 3 5.472 3883K 33K 0.0 0.0 L2 1/0 1.16 MB 0.0 0.1 0.1 0.1 0.1 0.1 1.7 2.0 237.0 236.9 0.53 0.50 1 0.532 127K 41 0.0 0.0 L3 14/0 914.06 MB 0.9 0.7 0.6 0.1 0.7 0.6 1.1 1.2 205.4 205.2 3.66 3.23 2 1.831 763K 668 0.0 0.0 L4 169/0 9.77 GB 1.0 0.2 0.1 0.1 0.2 0.1 1.5 1.5 207.9 206.4 0.92 0.83 1 0.918 193K 1306 0.0 0.0 L5 1060/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/25 101.69 GB 0.0 9.5 3.8 5.8 15.1 9.3 5.8 2.7 173.7 275.2 56.09 52.83 106 0.529 9893K 42K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.5 3.8 5.8 15.1 9.3 5.7 2.7 173.7 275.2 56.09 52.83 106 0.529 9893K 42K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.5 3.8 5.8 9.5 3.7 0.0 0.0 246.0 244.9 39.61 38.11 23 1.722 9893K 42K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 347.9 16.48 14.72 83 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.2 total, 23.0 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.07 GB write, 666.49 MB/s write, 9.52 GB read, 420.77 MB/s read, 56.1 seconds Interval compaction: 15.07 GB write, 671.86 MB/s write, 9.52 GB read, 424.16 MB/s read, 56.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 18, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2152636 Average: 2.1907 StdDev: 12.84 Min: 0 Median: 1.4292 Max: 4692 Percentiles: P50: 1.43 P75: 1.81 P99: 5.60 P99.9: 11.34 P99.99: 155.66 ------------------------------------------------------ [ 0, 1 ] 466142 21.654% 21.654% #### ( 1, 2 ] 1421520 66.036% 87.691% ############# ( 2, 3 ] 149120 6.927% 94.618% # ( 3, 4 ] 65284 3.033% 97.651% # ( 4, 6 ] 36254 1.684% 99.335% ( 6, 10 ] 11806 0.548% 99.883% ( 10, 15 ] 1337 0.062% 99.946% ( 15, 22 ] 134 0.006% 99.952% ( 22, 34 ] 26 0.001% 99.953% ( 34, 51 ] 13 0.001% 99.954% ( 51, 76 ] 37 0.002% 99.955% ( 76, 110 ] 335 0.016% 99.971% ( 110, 170 ] 545 0.025% 99.996% ( 170, 250 ] 209 0.010% 100.006% ( 250, 380 ] 118 0.005% 100.011% ( 380, 580 ] 109 0.005% 100.016% ( 580, 870 ] 70 0.003% 100.020% ( 870, 1300 ] 25 0.001% 100.021% ( 1300, 1900 ] 13 0.001% 100.021% ( 1900, 2900 ] 10 0.000% 100.022% ( 2900, 4400 ] 11 0.001% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 351625 Average: 2.3571 StdDev: 15.27 Min: 1 Median: 1.4801 Max: 2952 Percentiles: P50: 1.48 P75: 1.85 P99: 5.82 P99.9: 15.95 P99.99: 687.91 ------------------------------------------------------ [ 0, 1 ] 61135 17.386% 17.386% ### ( 1, 2 ] 238869 67.933% 85.319% ############## ( 2, 3 ] 29882 8.498% 93.818% ## ( 3, 4 ] 11704 3.329% 97.146% # ( 4, 6 ] 7150 2.033% 99.180% ( 6, 10 ] 2222 0.632% 99.811% ( 10, 15 ] 308 0.088% 99.899% ( 15, 22 ] 25 0.007% 99.906% ( 22, 34 ] 3 0.001% 99.907% ( 34, 51 ] 2 0.001% 99.908% ( 51, 76 ] 9 0.003% 99.910% ( 76, 110 ] 162 0.046% 99.956% ( 110, 170 ] 43 0.012% 99.968% ( 170, 250 ] 15 0.004% 99.973% ( 250, 380 ] 27 0.008% 99.980% ( 380, 580 ] 29 0.008% 99.989% ( 580, 870 ] 13 0.004% 99.992% ( 870, 1300 ] 12 0.003% 99.996% ( 1300, 1900 ] 11 0.003% 99.999% ( 1900, 2900 ] 3 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7828 StdDev: 4.93 Min: 1 Median: 1.2206 Max: 766 Percentiles: P50: 1.22 P75: 1.69 P99: 3.86 P99.9: 9.47 P99.99: 20.82 ------------------------------------------------------ [ 0, 1 ] 12106 38.204% 38.204% ######## ( 1, 2 ] 16944 53.471% 91.675% ########### ( 2, 3 ] 1912 6.034% 97.709% # ( 3, 4 ] 478 1.508% 99.217% ( 4, 6 ] 153 0.483% 99.700% ( 6, 10 ] 73 0.230% 99.931% ( 10, 15 ] 18 0.057% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 44621 Average: 5.2611 StdDev: 71.06 Min: 1 Median: 1.5013 Max: 5510 Percentiles: P50: 1.50 P75: 1.89 P99: 10.11 P99.9: 587.85 P99.99: 3938.36 ------------------------------------------------------ [ 0, 1 ] 7779 17.433% 17.433% ### ( 1, 2 ] 28990 64.969% 82.403% ############# ( 2, 3 ] 4623 10.361% 92.763% ## ( 3, 4 ] 1519 3.404% 96.168% # ( 4, 6 ] 898 2.013% 98.180% ( 6, 10 ] 364 0.816% 98.996% ( 10, 15 ] 78 0.175% 99.171% ( 15, 22 ] 14 0.031% 99.202% ( 22, 34 ] 6 0.013% 99.216% ( 34, 51 ] 4 0.009% 99.225% ( 51, 76 ] 24 0.054% 99.278% ( 76, 110 ] 48 0.108% 99.386% ( 110, 170 ] 101 0.226% 99.612% ( 170, 250 ] 52 0.117% 99.729% ( 250, 380 ] 40 0.090% 99.818% ( 380, 580 ] 36 0.081% 99.899% ( 580, 870 ] 14 0.031% 99.931% ( 870, 1300 ] 11 0.025% 99.955% ( 1300, 1900 ] 4 0.009% 99.964% ( 1900, 2900 ] 6 0.013% 99.978% ( 2900, 4400 ] 8 0.018% 99.996% ( 4400, 6600 ] 2 0.004% 100.000% ** Level 4 read latency histogram (micros): Count: 55 Average: 998.9273 StdDev: 1271.80 Min: 1 Median: 664.5833 Max: 5184 Percentiles: P50: 664.58 P75: 1246.25 P99: 5184.00 P99.9: 5184.00 P99.99: 5184.00 ------------------------------------------------------ [ 0, 1 ] 9 16.364% 16.364% ### ( 1, 2 ] 5 9.091% 25.455% ## ( 3, 4 ] 2 3.636% 29.091% # ( 4, 6 ] 1 1.818% 30.909% ( 110, 170 ] 4 7.273% 38.182% # ( 170, 250 ] 1 1.818% 40.000% ( 250, 380 ] 1 1.818% 41.818% ( 380, 580 ] 1 1.818% 43.636% ( 580, 870 ] 12 21.818% 65.455% #### ( 870, 1300 ] 6 10.909% 76.364% ## ( 1300, 1900 ] 2 3.636% 80.000% # ( 1900, 2900 ] 5 9.091% 89.091% ## ( 2900, 4400 ] 4 7.273% 96.364% # ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 777.3125 StdDev: 923.61 Min: 86 Median: 344.5455 Max: 4492 Percentiles: P50: 344.55 P75: 1013.33 P99: 4492.00 P99.9: 4492.00 P99.99: 4492.00 ------------------------------------------------------ ( 76, 110 ] 7 8.750% 8.750% ## ( 110, 170 ] 15 18.750% 27.500% #### ( 170, 250 ] 10 12.500% 40.000% ### ( 250, 380 ] 11 13.750% 53.750% ### ( 380, 580 ] 10 12.500% 66.250% ### ( 580, 870 ] 5 6.250% 72.500% # ( 870, 1300 ] 6 7.500% 80.000% ## ( 1300, 1900 ] 4 5.000% 85.000% # ( 1900, 2900 ] 9 11.250% 96.250% ## ( 2900, 4400 ] 2 2.500% 98.750% # ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 23.2 total, 6.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 255.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.889 H:M:S, 29.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 147.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.918 H:M:S, 58.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-06:54:04 ... thread 0: (1000000,7000000) ops and (324665.6,268708.6) ops/second in (3.080092,26.050522) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 3.44 GB 81.8 5.5 0.0 5.5 12.1 6.6 0.0 1.8 139.8 305.9 40.54 38.05 116 0.350 5756K 7352 0.0 0.0 L1 13/13 1.47 GB 0.0 3.7 3.0 0.8 3.7 2.9 0.2 1.3 233.0 230.9 16.42 15.84 3 5.472 3883K 33K 0.0 0.0 L2 1/0 1.16 MB 0.0 0.1 0.1 0.1 0.1 0.1 1.7 2.0 237.0 236.9 0.53 0.50 1 0.532 127K 41 0.0 0.0 L3 14/0 914.06 MB 0.9 0.7 0.6 0.1 0.7 0.6 1.1 1.2 205.4 205.2 3.66 3.23 2 1.831 763K 668 0.0 0.0 L4 169/0 9.77 GB 1.0 0.2 0.1 0.1 0.2 0.1 1.5 1.5 207.9 206.4 0.92 0.83 1 0.918 193K 1306 0.0 0.0 L5 1060/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1276/29 102.68 GB 0.0 10.3 3.8 6.6 16.9 10.3 5.8 2.6 170.2 278.1 62.07 58.45 123 0.505 10M 43K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.3 3.8 6.6 16.9 10.3 5.7 2.6 170.2 278.1 62.07 58.45 123 0.505 10M 43K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.3 3.8 6.6 10.3 3.7 0.0 0.0 247.5 246.4 42.68 41.13 26 1.642 10M 43K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 347.7 19.39 17.32 97 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.2 total, 26.1 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.86 GB write, 657.84 MB/s write, 10.32 GB read, 402.59 MB/s read, 62.1 seconds Interval compaction: 16.86 GB write, 662.51 MB/s write, 10.32 GB read, 405.45 MB/s read, 62.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 22, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2573952 Average: 2.1822 StdDev: 12.06 Min: 0 Median: 1.4383 Max: 4692 Percentiles: P50: 1.44 P75: 1.81 P99: 5.63 P99.9: 10.27 P99.99: 140.39 ------------------------------------------------------ [ 0, 1 ] 537374 20.877% 20.877% #### ( 1, 2 ] 1710058 66.437% 87.314% ############# ( 2, 3 ] 183845 7.143% 94.457% # ( 3, 4 ] 80256 3.118% 97.575% # ( 4, 6 ] 44888 1.744% 99.319% ( 6, 10 ] 14876 0.578% 99.897% ( 10, 15 ] 1550 0.060% 99.957% ( 15, 22 ] 153 0.006% 99.963% ( 22, 34 ] 27 0.001% 99.964% ( 34, 51 ] 17 0.001% 99.965% ( 51, 76 ] 39 0.002% 99.966% ( 76, 110 ] 335 0.013% 99.979% ( 110, 170 ] 552 0.021% 100.001% ( 170, 250 ] 214 0.008% 100.009% ( 250, 380 ] 124 0.005% 100.014% ( 380, 580 ] 113 0.004% 100.018% ( 580, 870 ] 77 0.003% 100.021% ( 870, 1300 ] 29 0.001% 100.022% ( 1300, 1900 ] 13 0.001% 100.023% ( 1900, 2900 ] 10 0.000% 100.023% ( 2900, 4400 ] 12 0.000% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 351625 Average: 2.3571 StdDev: 15.27 Min: 1 Median: 1.4801 Max: 2952 Percentiles: P50: 1.48 P75: 1.85 P99: 5.82 P99.9: 15.95 P99.99: 687.91 ------------------------------------------------------ [ 0, 1 ] 61135 17.386% 17.386% ### ( 1, 2 ] 238869 67.933% 85.319% ############## ( 2, 3 ] 29882 8.498% 93.818% ## ( 3, 4 ] 11704 3.329% 97.146% # ( 4, 6 ] 7150 2.033% 99.180% ( 6, 10 ] 2222 0.632% 99.811% ( 10, 15 ] 308 0.088% 99.899% ( 15, 22 ] 25 0.007% 99.906% ( 22, 34 ] 3 0.001% 99.907% ( 34, 51 ] 2 0.001% 99.908% ( 51, 76 ] 9 0.003% 99.910% ( 76, 110 ] 162 0.046% 99.956% ( 110, 170 ] 43 0.012% 99.968% ( 170, 250 ] 15 0.004% 99.973% ( 250, 380 ] 27 0.008% 99.980% ( 380, 580 ] 29 0.008% 99.989% ( 580, 870 ] 13 0.004% 99.992% ( 870, 1300 ] 12 0.003% 99.996% ( 1300, 1900 ] 11 0.003% 99.999% ( 1900, 2900 ] 3 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7828 StdDev: 4.93 Min: 1 Median: 1.2206 Max: 766 Percentiles: P50: 1.22 P75: 1.69 P99: 3.86 P99.9: 9.47 P99.99: 20.82 ------------------------------------------------------ [ 0, 1 ] 12106 38.204% 38.204% ######## ( 1, 2 ] 16944 53.471% 91.675% ########### ( 2, 3 ] 1912 6.034% 97.709% # ( 3, 4 ] 478 1.508% 99.217% ( 4, 6 ] 153 0.483% 99.700% ( 6, 10 ] 73 0.230% 99.931% ( 10, 15 ] 18 0.057% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 44621 Average: 5.2611 StdDev: 71.06 Min: 1 Median: 1.5013 Max: 5510 Percentiles: P50: 1.50 P75: 1.89 P99: 10.11 P99.9: 587.85 P99.99: 3938.36 ------------------------------------------------------ [ 0, 1 ] 7779 17.433% 17.433% ### ( 1, 2 ] 28990 64.969% 82.403% ############# ( 2, 3 ] 4623 10.361% 92.763% ## ( 3, 4 ] 1519 3.404% 96.168% # ( 4, 6 ] 898 2.013% 98.180% ( 6, 10 ] 364 0.816% 98.996% ( 10, 15 ] 78 0.175% 99.171% ( 15, 22 ] 14 0.031% 99.202% ( 22, 34 ] 6 0.013% 99.216% ( 34, 51 ] 4 0.009% 99.225% ( 51, 76 ] 24 0.054% 99.278% ( 76, 110 ] 48 0.108% 99.386% ( 110, 170 ] 101 0.226% 99.612% ( 170, 250 ] 52 0.117% 99.729% ( 250, 380 ] 40 0.090% 99.818% ( 380, 580 ] 36 0.081% 99.899% ( 580, 870 ] 14 0.031% 99.931% ( 870, 1300 ] 11 0.025% 99.955% ( 1300, 1900 ] 4 0.009% 99.964% ( 1900, 2900 ] 6 0.013% 99.978% ( 2900, 4400 ] 8 0.018% 99.996% ( 4400, 6600 ] 2 0.004% 100.000% ** Level 4 read latency histogram (micros): Count: 55 Average: 998.9273 StdDev: 1271.80 Min: 1 Median: 664.5833 Max: 5184 Percentiles: P50: 664.58 P75: 1246.25 P99: 5184.00 P99.9: 5184.00 P99.99: 5184.00 ------------------------------------------------------ [ 0, 1 ] 9 16.364% 16.364% ### ( 1, 2 ] 5 9.091% 25.455% ## ( 3, 4 ] 2 3.636% 29.091% # ( 4, 6 ] 1 1.818% 30.909% ( 110, 170 ] 4 7.273% 38.182% # ( 170, 250 ] 1 1.818% 40.000% ( 250, 380 ] 1 1.818% 41.818% ( 380, 580 ] 1 1.818% 43.636% ( 580, 870 ] 12 21.818% 65.455% #### ( 870, 1300 ] 6 10.909% 76.364% ## ( 1300, 1900 ] 2 3.636% 80.000% # ( 1900, 2900 ] 5 9.091% 89.091% ## ( 2900, 4400 ] 4 7.273% 96.364% # ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 777.3125 StdDev: 923.61 Min: 86 Median: 344.5455 Max: 4492 Percentiles: P50: 344.55 P75: 1013.33 P99: 4492.00 P99.9: 4492.00 P99.99: 4492.00 ------------------------------------------------------ ( 76, 110 ] 7 8.750% 8.750% ## ( 110, 170 ] 15 18.750% 27.500% #### ( 170, 250 ] 10 12.500% 40.000% ### ( 250, 380 ] 11 13.750% 53.750% ### ( 380, 580 ] 10 12.500% 66.250% ### ( 580, 870 ] 5 6.250% 72.500% # ( 870, 1300 ] 6 7.500% 80.000% ## ( 1300, 1900 ] 4 5.000% 85.000% # ( 1900, 2900 ] 9 11.250% 96.250% ## ( 2900, 4400 ] 2 2.500% 98.750% # ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 26.2 total, 3.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 262.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.291 H:M:S, 27.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.402 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-06:54:19 ... thread 0: (1000000,8000000) ops and (67325.3,195580.9) ops/second in (14.853265,40.903787) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 2.33 GB 18.9 7.5 0.0 7.5 15.1 7.6 0.0 2.0 146.4 293.8 52.47 48.26 132 0.398 7802K 14K 0.0 0.0 L1 14/14 1.49 GB 0.0 7.3 5.0 2.3 7.2 5.0 0.2 1.4 233.2 230.5 32.02 30.77 4 8.006 7556K 58K 0.0 0.0 L2 4/2 515.11 MB 2.6 0.1 0.1 0.1 0.1 0.1 3.7 2.0 237.0 236.9 0.53 0.50 1 0.532 127K 41 0.0 0.0 L3 24/6 1.45 GB 1.0 1.9 1.1 0.7 1.9 1.1 2.1 1.6 180.5 179.7 10.59 8.45 6 1.764 1940K 8849 0.0 0.0 L4 170/0 9.72 GB 1.0 1.3 1.1 0.2 1.3 1.1 1.5 1.2 141.0 140.1 9.48 6.06 13 0.730 1309K 6640 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1294/30 103.59 GB 0.0 18.1 7.3 10.8 25.5 14.8 9.8 3.4 176.3 248.9 105.10 94.05 156 0.674 18M 87K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.1 7.3 10.8 25.5 14.8 9.7 3.4 176.3 248.9 105.10 94.05 156 0.674 18M 87K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.1 7.3 10.8 18.0 7.2 0.0 0.0 227.7 226.3 81.35 73.91 47 1.731 18M 87K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 326.3 23.75 20.14 109 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.1 total, 40.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.54 GB write, 636.56 MB/s write, 18.09 GB read, 450.84 MB/s read, 105.1 seconds Interval compaction: 25.54 GB write, 639.44 MB/s write, 18.09 GB read, 452.88 MB/s read, 105.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 37, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3522688 Average: 2.4092 StdDev: 25.99 Min: 0 Median: 1.4525 Max: 13011 Percentiles: P50: 1.45 P75: 1.83 P99: 5.90 P99.9: 14.40 P99.99: 208.51 ------------------------------------------------------ [ 0, 1 ] 715865 20.322% 20.322% #### ( 1, 2 ] 2310277 65.583% 85.904% ############# ( 2, 3 ] 267923 7.606% 93.510% ## ( 3, 4 ] 119212 3.384% 96.894% # ( 4, 6 ] 77893 2.211% 99.105% ( 6, 10 ] 25311 0.719% 99.824% ( 10, 15 ] 3052 0.087% 99.910% ( 15, 22 ] 329 0.009% 99.920% ( 22, 34 ] 35 0.001% 99.921% ( 34, 51 ] 30 0.001% 99.922% ( 51, 76 ] 45 0.001% 99.923% ( 76, 110 ] 901 0.026% 99.948% ( 110, 170 ] 1263 0.036% 99.984% ( 170, 250 ] 417 0.012% 99.996% ( 250, 380 ] 280 0.008% 100.004% ( 380, 580 ] 267 0.008% 100.012% ( 580, 870 ] 153 0.004% 100.016% ( 870, 1300 ] 69 0.002% 100.018% ( 1300, 1900 ] 41 0.001% 100.019% ( 1900, 2900 ] 33 0.001% 100.020% ( 2900, 4400 ] 52 0.001% 100.022% ( 4400, 6600 ] 17 0.000% 100.022% ( 6600, 9900 ] 7 0.000% 100.022% ( 9900, 14000 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1238354 Average: 3.3176 StdDev: 46.77 Min: 1 Median: 1.5784 Max: 10529 Percentiles: P50: 1.58 P75: 1.99 P99: 8.38 P99.9: 22.94 P99.99: 148.84 ------------------------------------------------------ [ 0, 1 ] 187057 15.105% 15.105% ### ( 1, 2 ] 747154 60.334% 75.440% ############ ( 2, 3 ] 143096 11.555% 86.995% ## ( 3, 4 ] 72062 5.819% 92.814% # ( 4, 6 ] 65149 5.261% 98.075% # ( 6, 10 ] 19257 1.555% 99.630% ( 10, 15 ] 3020 0.244% 99.874% ( 15, 22 ] 320 0.026% 99.900% ( 22, 34 ] 21 0.002% 99.902% ( 34, 51 ] 7 0.001% 99.902% ( 51, 76 ] 51 0.004% 99.906% ( 76, 110 ] 709 0.057% 99.964% ( 110, 170 ] 507 0.041% 100.005% ( 170, 250 ] 207 0.017% 100.021% ( 250, 380 ] 228 0.018% 100.040% ( 380, 580 ] 221 0.018% 100.057% ( 580, 870 ] 150 0.012% 100.070% ( 870, 1300 ] 109 0.009% 100.078% ( 1300, 1900 ] 61 0.005% 100.083% ( 1900, 2900 ] 45 0.004% 100.087% ( 2900, 4400 ] 69 0.006% 100.093% ( 4400, 6600 ] 12 0.001% 100.094% ( 6600, 9900 ] 8 0.001% 100.094% ( 9900, 14000 ] 2 0.000% 100.094% ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7828 StdDev: 4.93 Min: 1 Median: 1.2206 Max: 766 Percentiles: P50: 1.22 P75: 1.69 P99: 3.86 P99.9: 9.47 P99.99: 20.82 ------------------------------------------------------ [ 0, 1 ] 12106 38.204% 38.204% ######## ( 1, 2 ] 16944 53.471% 91.675% ########### ( 2, 3 ] 1912 6.034% 97.709% # ( 3, 4 ] 478 1.508% 99.217% ( 4, 6 ] 153 0.483% 99.700% ( 6, 10 ] 73 0.230% 99.931% ( 10, 15 ] 18 0.057% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 293983 Average: 6.6571 StdDev: 88.44 Min: 1 Median: 1.8237 Max: 9526 Percentiles: P50: 1.82 P75: 2.84 P99: 9.17 P99.9: 423.80 P99.99: 617.31 ------------------------------------------------------ [ 0, 1 ] 16499 5.612% 5.612% # ( 1, 2 ] 158431 53.891% 59.503% ########### ( 2, 3 ] 54189 18.433% 77.936% #### ( 3, 4 ] 29642 10.083% 88.019% ## ( 4, 6 ] 28537 9.707% 97.726% ## ( 6, 10 ] 4723 1.607% 99.333% ( 10, 15 ] 819 0.279% 99.611% ( 15, 22 ] 89 0.030% 99.641% ( 22, 34 ] 14 0.005% 99.646% ( 34, 51 ] 6 0.002% 99.648% ( 51, 76 ] 29 0.010% 99.658% ( 76, 110 ] 66 0.022% 99.681% ( 110, 170 ] 189 0.064% 99.745% ( 170, 250 ] 184 0.063% 99.807% ( 250, 380 ] 205 0.070% 99.877% ( 380, 580 ] 306 0.104% 99.981% ( 580, 870 ] 199 0.068% 100.049% ( 870, 1300 ] 137 0.047% 100.096% ( 1300, 1900 ] 58 0.020% 100.115% ( 1900, 2900 ] 64 0.022% 100.137% ( 2900, 4400 ] 72 0.024% 100.162% ( 4400, 6600 ] 8 0.003% 100.164% ( 6600, 9900 ] 4 0.001% 100.166% ** Level 4 read latency histogram (micros): Count: 195 Average: 469.7487 StdDev: 993.72 Min: 1 Median: 3.5000 Max: 5930 Percentiles: P50: 3.50 P75: 584.26 P99: 5170.00 P99.9: 5930.00 P99.99: 5930.00 ------------------------------------------------------ [ 0, 1 ] 27 13.846% 13.846% ### ( 1, 2 ] 45 23.077% 36.923% ##### ( 2, 3 ] 22 11.282% 48.205% ## ( 3, 4 ] 7 3.590% 51.795% # ( 4, 6 ] 4 2.051% 53.846% ( 6, 10 ] 2 1.026% 54.872% ( 10, 15 ] 3 1.538% 56.410% ( 15, 22 ] 2 1.026% 57.436% ( 22, 34 ] 2 1.026% 58.462% ( 34, 51 ] 1 0.513% 58.974% ( 51, 76 ] 7 3.590% 62.564% # ( 110, 170 ] 4 2.051% 64.615% ( 170, 250 ] 15 7.692% 72.308% ## ( 250, 380 ] 3 1.538% 73.846% ( 380, 580 ] 2 1.026% 74.872% ( 580, 870 ] 17 8.718% 83.590% ## ( 870, 1300 ] 12 6.154% 89.744% # ( 1300, 1900 ] 4 2.051% 91.795% ( 1900, 2900 ] 7 3.590% 95.385% # ( 2900, 4400 ] 6 3.077% 98.462% # ( 4400, 6600 ] 3 1.538% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 973.1286 StdDev: 1180.42 Min: 82 Median: 420.0000 Max: 5702 Percentiles: P50: 420.00 P75: 1257.00 P99: 5702.00 P99.9: 5702.00 P99.99: 5702.00 ------------------------------------------------------ ( 76, 110 ] 8 5.714% 5.714% # ( 110, 170 ] 19 13.571% 19.286% ### ( 170, 250 ] 21 15.000% 34.286% ### ( 250, 380 ] 19 13.571% 47.857% ### ( 380, 580 ] 15 10.714% 58.571% ## ( 580, 870 ] 14 10.000% 68.571% ## ( 870, 1300 ] 10 7.143% 75.714% # ( 1300, 1900 ] 10 7.143% 82.857% # ( 1900, 2900 ] 12 8.571% 91.429% ## ( 2900, 4400 ] 7 5.000% 96.429% # ( 4400, 6600 ] 5 3.571% 100.000% # ** DB Stats ** Uptime(secs): 41.1 total, 14.9 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 191.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.830 H:M:S, 45.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 66.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.539 H:M:S, 77.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/15-06:54:23 ... thread 0: (1000000,9000000) ops and (258275.9,201002.3) ops/second in (3.871828,44.775615) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 3.25 GB 119.6 8.5 0.0 8.5 17.0 8.5 0.0 2.0 143.1 286.0 60.72 54.76 148 0.410 8825K 15K 0.0 0.0 L1 14/14 1.49 GB 0.0 7.3 5.0 2.3 7.2 5.0 0.2 1.4 233.2 230.5 32.02 30.77 4 8.006 7556K 58K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.7 2.0 237.0 236.9 0.53 0.50 1 0.532 127K 41 0.0 0.0 L3 17/0 933.49 MB 0.9 3.3 1.6 1.6 3.2 1.6 2.1 2.0 179.9 178.8 18.58 14.81 10 1.858 3395K 20K 0.0 0.0 L4 174/0 9.75 GB 1.0 2.6 2.1 0.5 2.6 2.1 1.5 1.2 147.0 146.0 17.94 12.03 29 0.618 2504K 12K 0.0 0.0 L5 1084/0 89.08 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1303/22 104.49 GB 0.0 21.7 8.8 12.9 30.1 17.2 10.8 3.5 171.5 237.4 129.80 112.88 192 0.676 22M 105K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.7 8.8 12.9 30.1 17.2 10.7 3.5 171.5 237.4 129.80 112.88 192 0.676 22M 105K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.7 8.8 12.9 21.6 8.7 0.0 0.0 217.2 215.9 102.49 90.32 70 1.464 22M 105K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 318.4 27.31 22.56 122 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.0 total, 44.8 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.10 GB write, 685.43 MB/s write, 21.74 GB read, 495.20 MB/s read, 129.8 seconds Interval compaction: 30.10 GB write, 688.26 MB/s write, 21.74 GB read, 497.25 MB/s read, 129.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 48, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3937068 Average: 2.5490 StdDev: 32.60 Min: 0 Median: 1.4778 Max: 13011 Percentiles: P50: 1.48 P75: 1.86 P99: 6.01 P99.9: 14.40 P99.99: 220.27 ------------------------------------------------------ [ 0, 1 ] 749942 19.048% 19.048% #### ( 1, 2 ] 2550161 64.773% 83.821% ############# ( 2, 3 ] 336020 8.535% 92.356% ## ( 3, 4 ] 150465 3.822% 96.178% # ( 4, 6 ] 111034 2.820% 98.998% # ( 6, 10 ] 31883 0.810% 99.808% ( 10, 15 ] 4125 0.105% 99.913% ( 15, 22 ] 403 0.010% 99.923% ( 22, 34 ] 48 0.001% 99.924% ( 34, 51 ] 33 0.001% 99.925% ( 51, 76 ] 48 0.001% 99.926% ( 76, 110 ] 934 0.024% 99.950% ( 110, 170 ] 1289 0.033% 99.983% ( 170, 250 ] 462 0.012% 99.994% ( 250, 380 ] 318 0.008% 100.002% ( 380, 580 ] 316 0.008% 100.010% ( 580, 870 ] 189 0.005% 100.015% ( 870, 1300 ] 85 0.002% 100.017% ( 1300, 1900 ] 55 0.001% 100.019% ( 1900, 2900 ] 60 0.002% 100.020% ( 2900, 4400 ] 87 0.002% 100.023% ( 4400, 6600 ] 29 0.001% 100.023% ( 6600, 9900 ] 18 0.000% 100.024% ( 9900, 14000 ] 3 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1329806 Average: 3.3748 StdDev: 47.25 Min: 1 Median: 1.5911 Max: 10529 Percentiles: P50: 1.59 P75: 2.03 P99: 8.49 P99.9: 77.15 P99.99: 163.92 ------------------------------------------------------ [ 0, 1 ] 191823 14.425% 14.425% ### ( 1, 2 ] 800281 60.180% 74.605% ############ ( 2, 3 ] 158719 11.936% 86.541% ## ( 3, 4 ] 79620 5.987% 92.528% # ( 4, 6 ] 72715 5.468% 97.996% # ( 6, 10 ] 21424 1.611% 99.607% ( 10, 15 ] 3423 0.257% 99.865% ( 15, 22 ] 362 0.027% 99.892% ( 22, 34 ] 25 0.002% 99.894% ( 34, 51 ] 9 0.001% 99.894% ( 51, 76 ] 51 0.004% 99.898% ( 76, 110 ] 716 0.054% 99.952% ( 110, 170 ] 562 0.042% 99.994% ( 170, 250 ] 236 0.018% 100.012% ( 250, 380 ] 261 0.020% 100.032% ( 380, 580 ] 251 0.019% 100.051% ( 580, 870 ] 171 0.013% 100.063% ( 870, 1300 ] 125 0.009% 100.073% ( 1300, 1900 ] 68 0.005% 100.078% ( 1900, 2900 ] 48 0.004% 100.082% ( 2900, 4400 ] 74 0.006% 100.087% ( 4400, 6600 ] 15 0.001% 100.088% ( 6600, 9900 ] 9 0.001% 100.089% ( 9900, 14000 ] 2 0.000% 100.089% ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7828 StdDev: 4.93 Min: 1 Median: 1.2206 Max: 766 Percentiles: P50: 1.22 P75: 1.69 P99: 3.86 P99.9: 9.47 P99.99: 20.82 ------------------------------------------------------ [ 0, 1 ] 12106 38.204% 38.204% ######## ( 1, 2 ] 16944 53.471% 91.675% ########### ( 2, 3 ] 1912 6.034% 97.709% # ( 3, 4 ] 478 1.508% 99.217% ( 4, 6 ] 153 0.483% 99.700% ( 6, 10 ] 73 0.230% 99.931% ( 10, 15 ] 18 0.057% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 731770 Average: 5.6258 StdDev: 75.08 Min: 1 Median: 1.8628 Max: 9526 Percentiles: P50: 1.86 P75: 2.92 P99: 8.83 P99.9: 203.10 P99.99: 372.08 ------------------------------------------------------ [ 0, 1 ] 30984 4.234% 4.234% # ( 1, 2 ] 388167 53.045% 57.279% ########### ( 2, 3 ] 141083 19.280% 76.559% #### ( 3, 4 ] 77945 10.652% 87.210% ## ( 4, 6 ] 77564 10.600% 97.810% ## ( 6, 10 ] 12305 1.682% 99.491% ( 10, 15 ] 2065 0.282% 99.774% ( 15, 22 ] 218 0.030% 99.803% ( 22, 34 ] 20 0.003% 99.806% ( 34, 51 ] 10 0.001% 99.807% ( 51, 76 ] 36 0.005% 99.812% ( 76, 110 ] 125 0.017% 99.829% ( 110, 170 ] 347 0.047% 99.877% ( 170, 250 ] 409 0.056% 99.933% ( 250, 380 ] 446 0.061% 99.994% ( 380, 580 ] 553 0.076% 100.069% ( 580, 870 ] 353 0.048% 100.118% ( 870, 1300 ] 218 0.030% 100.147% ( 1300, 1900 ] 98 0.013% 100.161% ( 1900, 2900 ] 112 0.015% 100.176% ( 2900, 4400 ] 120 0.016% 100.192% ( 4400, 6600 ] 17 0.002% 100.195% ( 6600, 9900 ] 10 0.001% 100.196% ** Level 4 read latency histogram (micros): Count: 355 Average: 330.9803 StdDev: 795.89 Min: 1 Median: 2.9432 Max: 5930 Percentiles: P50: 2.94 P75: 215.62 P99: 4262.50 P99.9: 5930.00 P99.99: 5930.00 ------------------------------------------------------ [ 0, 1 ] 52 14.648% 14.648% ### ( 1, 2 ] 84 23.662% 38.310% ##### ( 2, 3 ] 44 12.394% 50.704% ## ( 3, 4 ] 16 4.507% 55.211% # ( 4, 6 ] 5 1.408% 56.620% ( 6, 10 ] 5 1.408% 58.028% ( 10, 15 ] 5 1.408% 59.437% ( 15, 22 ] 7 1.972% 61.408% ( 22, 34 ] 4 1.127% 62.535% ( 34, 51 ] 1 0.282% 62.817% ( 51, 76 ] 21 5.915% 68.732% # ( 110, 170 ] 4 1.127% 69.859% ( 170, 250 ] 32 9.014% 78.873% ## ( 250, 380 ] 5 1.408% 80.282% ( 380, 580 ] 5 1.408% 81.690% ( 580, 870 ] 25 7.042% 88.732% # ( 870, 1300 ] 14 3.944% 92.676% # ( 1300, 1900 ] 9 2.535% 95.211% # ( 1900, 2900 ] 8 2.254% 97.465% ( 2900, 4400 ] 6 1.690% 99.155% ( 4400, 6600 ] 3 0.845% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1043.8200 StdDev: 1181.01 Min: 82 Median: 506.3158 Max: 5702 Percentiles: P50: 506.32 P75: 1476.47 P99: 5702.00 P99.9: 5702.00 P99.99: 5702.00 ------------------------------------------------------ ( 76, 110 ] 12 6.000% 6.000% # ( 110, 170 ] 26 13.000% 19.000% ### ( 170, 250 ] 25 12.500% 31.500% ### ( 250, 380 ] 25 12.500% 44.000% ### ( 380, 580 ] 19 9.500% 53.500% ## ( 580, 870 ] 20 10.000% 63.500% ## ( 870, 1300 ] 18 9.000% 72.500% ## ( 1300, 1900 ] 17 8.500% 81.000% ## ( 1900, 2900 ] 19 9.500% 90.500% ## ( 2900, 4400 ] 14 7.000% 97.500% # ( 4400, 6600 ] 5 2.500% 100.000% # ** DB Stats ** Uptime(secs): 45.0 total, 3.9 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 197.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.718 H:M:S, 43.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 254.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.888 H:M:S, 22.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-06:54:26 ... thread 0: (1000000,10000000) ops and (324098.9,208938.0) ops/second in (3.085478,47.861093) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 4.24 GB 195.0 9.3 0.0 9.3 18.8 9.5 0.0 2.0 142.9 287.4 67.00 60.65 165 0.406 9720K 16K 0.0 0.0 L1 14/14 1.49 GB 0.0 7.3 5.0 2.3 7.2 5.0 0.2 1.4 233.2 230.5 32.02 30.77 4 8.006 7556K 58K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.7 2.0 237.0 236.9 0.53 0.50 1 0.532 127K 41 0.0 0.0 L3 17/0 933.49 MB 0.9 3.3 1.6 1.6 3.2 1.6 2.1 2.0 179.9 178.8 18.58 14.81 10 1.858 3395K 20K 0.0 0.0 L4 174/0 9.75 GB 1.0 2.6 2.1 0.5 2.6 2.1 1.5 1.2 147.0 146.0 17.94 12.03 29 0.618 2504K 12K 0.0 0.0 L5 1084/0 89.08 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1308/26 105.47 GB 0.0 22.6 8.8 13.8 31.9 18.2 10.8 3.4 170.1 240.4 136.08 118.77 209 0.651 23M 106K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.6 8.8 13.8 31.9 18.2 10.7 3.4 170.1 240.4 136.08 118.77 209 0.651 23M 106K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.6 8.8 13.8 22.5 8.7 0.0 0.0 218.6 217.2 105.91 93.65 73 1.451 23M 106K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 321.6 30.17 25.12 136 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.0 total, 47.9 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.94 GB write, 680.73 MB/s write, 22.60 GB read, 481.76 MB/s read, 136.1 seconds Interval compaction: 31.94 GB write, 683.36 MB/s write, 22.60 GB read, 483.62 MB/s read, 136.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 52, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 52, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4249578 Average: 2.5305 StdDev: 31.49 Min: 0 Median: 1.4811 Max: 13011 Percentiles: P50: 1.48 P75: 1.87 P99: 5.99 P99.9: 14.19 P99.99: 212.66 ------------------------------------------------------ [ 0, 1 ] 796901 18.752% 18.752% #### ( 1, 2 ] 2760198 64.952% 83.705% ############# ( 2, 3 ] 368221 8.665% 92.370% ## ( 3, 4 ] 163215 3.841% 96.210% # ( 4, 6 ] 119437 2.811% 99.021% # ( 6, 10 ] 33575 0.790% 99.811% ( 10, 15 ] 4518 0.106% 99.917% ( 15, 22 ] 418 0.010% 99.927% ( 22, 34 ] 51 0.001% 99.928% ( 34, 51 ] 35 0.001% 99.929% ( 51, 76 ] 50 0.001% 99.930% ( 76, 110 ] 952 0.022% 99.953% ( 110, 170 ] 1326 0.031% 99.984% ( 170, 250 ] 482 0.011% 99.995% ( 250, 380 ] 334 0.008% 100.003% ( 380, 580 ] 331 0.008% 100.011% ( 580, 870 ] 194 0.005% 100.016% ( 870, 1300 ] 90 0.002% 100.018% ( 1300, 1900 ] 61 0.001% 100.019% ( 1900, 2900 ] 61 0.001% 100.021% ( 2900, 4400 ] 87 0.002% 100.023% ( 4400, 6600 ] 29 0.001% 100.023% ( 6600, 9900 ] 18 0.000% 100.024% ( 9900, 14000 ] 3 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1458570 Average: 3.3174 StdDev: 45.24 Min: 1 Median: 1.5899 Max: 10529 Percentiles: P50: 1.59 P75: 2.00 P99: 8.49 P99.9: 82.90 P99.99: 176.66 ------------------------------------------------------ [ 0, 1 ] 205265 14.073% 14.073% ### ( 1, 2 ] 888378 60.907% 74.980% ############ ( 2, 3 ] 174545 11.967% 86.947% ## ( 3, 4 ] 84595 5.800% 92.747% # ( 4, 6 ] 76469 5.243% 97.990% # ( 6, 10 ] 23660 1.622% 99.612% ( 10, 15 ] 3590 0.246% 99.858% ( 15, 22 ] 371 0.025% 99.884% ( 22, 34 ] 25 0.002% 99.885% ( 34, 51 ] 9 0.001% 99.886% ( 51, 76 ] 54 0.004% 99.890% ( 76, 110 ] 746 0.051% 99.941% ( 110, 170 ] 696 0.048% 99.989% ( 170, 250 ] 266 0.018% 100.007% ( 250, 380 ] 294 0.020% 100.027% ( 380, 580 ] 269 0.018% 100.045% ( 580, 870 ] 180 0.012% 100.058% ( 870, 1300 ] 127 0.009% 100.066% ( 1300, 1900 ] 68 0.005% 100.071% ( 1900, 2900 ] 48 0.003% 100.074% ( 2900, 4400 ] 74 0.005% 100.079% ( 4400, 6600 ] 15 0.001% 100.080% ( 6600, 9900 ] 9 0.001% 100.081% ( 9900, 14000 ] 2 0.000% 100.081% ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7828 StdDev: 4.93 Min: 1 Median: 1.2206 Max: 766 Percentiles: P50: 1.22 P75: 1.69 P99: 3.86 P99.9: 9.47 P99.99: 20.82 ------------------------------------------------------ [ 0, 1 ] 12106 38.204% 38.204% ######## ( 1, 2 ] 16944 53.471% 91.675% ########### ( 2, 3 ] 1912 6.034% 97.709% # ( 3, 4 ] 478 1.508% 99.217% ( 4, 6 ] 153 0.483% 99.700% ( 6, 10 ] 73 0.230% 99.931% ( 10, 15 ] 18 0.057% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 731770 Average: 5.6258 StdDev: 75.08 Min: 1 Median: 1.8628 Max: 9526 Percentiles: P50: 1.86 P75: 2.92 P99: 8.83 P99.9: 203.10 P99.99: 372.08 ------------------------------------------------------ [ 0, 1 ] 30984 4.234% 4.234% # ( 1, 2 ] 388167 53.045% 57.279% ########### ( 2, 3 ] 141083 19.280% 76.559% #### ( 3, 4 ] 77945 10.652% 87.210% ## ( 4, 6 ] 77564 10.600% 97.810% ## ( 6, 10 ] 12305 1.682% 99.491% ( 10, 15 ] 2065 0.282% 99.774% ( 15, 22 ] 218 0.030% 99.803% ( 22, 34 ] 20 0.003% 99.806% ( 34, 51 ] 10 0.001% 99.807% ( 51, 76 ] 36 0.005% 99.812% ( 76, 110 ] 125 0.017% 99.829% ( 110, 170 ] 347 0.047% 99.877% ( 170, 250 ] 409 0.056% 99.933% ( 250, 380 ] 446 0.061% 99.994% ( 380, 580 ] 553 0.076% 100.069% ( 580, 870 ] 353 0.048% 100.118% ( 870, 1300 ] 218 0.030% 100.147% ( 1300, 1900 ] 98 0.013% 100.161% ( 1900, 2900 ] 112 0.015% 100.176% ( 2900, 4400 ] 120 0.016% 100.192% ( 4400, 6600 ] 17 0.002% 100.195% ( 6600, 9900 ] 10 0.001% 100.196% ** Level 4 read latency histogram (micros): Count: 355 Average: 330.9803 StdDev: 795.89 Min: 1 Median: 2.9432 Max: 5930 Percentiles: P50: 2.94 P75: 215.62 P99: 4262.50 P99.9: 5930.00 P99.99: 5930.00 ------------------------------------------------------ [ 0, 1 ] 52 14.648% 14.648% ### ( 1, 2 ] 84 23.662% 38.310% ##### ( 2, 3 ] 44 12.394% 50.704% ## ( 3, 4 ] 16 4.507% 55.211% # ( 4, 6 ] 5 1.408% 56.620% ( 6, 10 ] 5 1.408% 58.028% ( 10, 15 ] 5 1.408% 59.437% ( 15, 22 ] 7 1.972% 61.408% ( 22, 34 ] 4 1.127% 62.535% ( 34, 51 ] 1 0.282% 62.817% ( 51, 76 ] 21 5.915% 68.732% # ( 110, 170 ] 4 1.127% 69.859% ( 170, 250 ] 32 9.014% 78.873% ## ( 250, 380 ] 5 1.408% 80.282% ( 380, 580 ] 5 1.408% 81.690% ( 580, 870 ] 25 7.042% 88.732% # ( 870, 1300 ] 14 3.944% 92.676% # ( 1300, 1900 ] 9 2.535% 95.211% # ( 1900, 2900 ] 8 2.254% 97.465% ( 2900, 4400 ] 6 1.690% 99.155% ( 4400, 6600 ] 3 0.845% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1043.8200 StdDev: 1181.01 Min: 82 Median: 506.3158 Max: 5702 Percentiles: P50: 506.32 P75: 1476.47 P99: 5702.00 P99.9: 5702.00 P99.99: 5702.00 ------------------------------------------------------ ( 76, 110 ] 12 6.000% 6.000% # ( 110, 170 ] 26 13.000% 19.000% ### ( 170, 250 ] 25 12.500% 31.500% ### ( 250, 380 ] 25 12.500% 44.000% ### ( 380, 580 ] 19 9.500% 53.500% ## ( 580, 870 ] 20 10.000% 63.500% ## ( 870, 1300 ] 18 9.000% 72.500% ## ( 1300, 1900 ] 17 8.500% 81.000% ## ( 1900, 2900 ] 19 9.500% 90.500% ## ( 2900, 4400 ] 14 7.000% 97.500% # ( 4400, 6600 ] 5 2.500% 100.000% # ** DB Stats ** Uptime(secs): 48.0 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 204.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.120 H:M:S, 41.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.402 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-06:54:38 ... thread 0: (1000000,11000000) ops and (84424.6,184236.1) ops/second in (11.844892,59.705985) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 3.43 GB 50.4 11.8 0.0 11.8 22.2 10.4 0.0 2.1 150.6 283.6 80.31 72.70 184 0.436 12M 25K 0.0 0.0 L1 10/10 1016.23 MB 0.0 10.6 6.8 3.7 10.4 6.7 0.2 1.5 224.2 221.6 48.26 45.01 5 9.652 9926K 58K 0.0 0.0 L2 1/0 45.83 MB 0.5 0.1 0.1 0.1 0.1 0.1 5.9 2.0 237.0 236.9 0.53 0.50 1 0.532 127K 41 0.0 0.0 L3 21/0 950.65 MB 1.0 4.7 2.3 2.4 4.6 2.2 3.7 2.0 162.1 161.0 29.52 21.41 18 1.640 4860K 34K 0.0 0.0 L4 169/0 9.63 GB 1.0 5.5 4.3 1.2 5.4 4.2 1.5 1.3 148.9 148.0 37.57 25.61 50 0.751 5491K 26K 0.0 0.0 L5 1112/0 91.35 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1326/19 106.38 GB 0.0 32.6 13.4 19.2 42.9 23.7 16.9 4.1 170.3 223.8 196.18 165.23 258 0.760 32M 144K 0.0 0.0 Int 0/0 0.00 KB 0.0 32.6 13.4 19.2 42.9 23.7 16.8 4.1 170.3 223.8 196.18 165.23 258 0.760 32M 144K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 32.6 13.4 19.2 32.4 13.2 0.0 0.0 205.3 203.9 162.77 137.49 108 1.507 32M 144K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 320.5 33.41 27.74 150 0.223 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.9 total, 59.7 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 42.88 GB write, 733.10 MB/s write, 32.63 GB read, 557.92 MB/s read, 196.2 seconds Interval compaction: 42.88 GB write, 735.37 MB/s write, 32.63 GB read, 559.65 MB/s read, 196.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 40, pending-compaction-bytes-stops: 0, total-delays: 51, total-stops: 60, interval: 111 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5135616 Average: 2.6268 StdDev: 33.76 Min: 0 Median: 1.4912 Max: 20685 Percentiles: P50: 1.49 P75: 1.88 P99: 6.31 P99.9: 19.47 P99.99: 283.90 ------------------------------------------------------ [ 0, 1 ] 932392 18.155% 18.155% #### ( 1, 2 ] 3329679 64.835% 82.990% ############# ( 2, 3 ] 460869 8.974% 91.964% ## ( 3, 4 ] 204404 3.980% 95.945% # ( 4, 6 ] 153530 2.990% 98.934% # ( 6, 10 ] 43454 0.846% 99.780% ( 10, 15 ] 5808 0.113% 99.893% ( 15, 22 ] 541 0.011% 99.904% ( 22, 34 ] 56 0.001% 99.905% ( 34, 51 ] 39 0.001% 99.906% ( 51, 76 ] 60 0.001% 99.907% ( 76, 110 ] 1589 0.031% 99.938% ( 110, 170 ] 1911 0.037% 99.975% ( 170, 250 ] 646 0.013% 99.988% ( 250, 380 ] 481 0.009% 99.997% ( 380, 580 ] 469 0.009% 100.006% ( 580, 870 ] 308 0.006% 100.012% ( 870, 1300 ] 150 0.003% 100.015% ( 1300, 1900 ] 104 0.002% 100.017% ( 1900, 2900 ] 85 0.002% 100.019% ( 2900, 4400 ] 117 0.002% 100.021% ( 4400, 6600 ] 39 0.001% 100.022% ( 6600, 9900 ] 20 0.000% 100.022% ( 9900, 14000 ] 3 0.000% 100.022% ( 14000, 22000 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 2295628 Average: 4.3662 StdDev: 66.77 Min: 1 Median: 1.6596 Max: 19305 Percentiles: P50: 1.66 P75: 2.36 P99: 9.01 P99.9: 105.45 P99.99: 344.98 ------------------------------------------------------ [ 0, 1 ] 254973 11.107% 11.107% ## ( 1, 2 ] 1353630 58.966% 70.072% ############ ( 2, 3 ] 316463 13.785% 83.858% ### ( 3, 4 ] 159588 6.952% 90.810% # ( 4, 6 ] 154434 6.727% 97.537% # ( 6, 10 ] 44652 1.945% 99.482% ( 10, 15 ] 7619 0.332% 99.814% ( 15, 22 ] 842 0.037% 99.851% ( 22, 34 ] 71 0.003% 99.854% ( 34, 51 ] 23 0.001% 99.855% ( 51, 76 ] 95 0.004% 99.859% ( 76, 110 ] 1088 0.047% 99.906% ( 110, 170 ] 1011 0.044% 99.950% ( 170, 250 ] 474 0.021% 99.971% ( 250, 380 ] 596 0.026% 99.997% ( 380, 580 ] 745 0.032% 100.029% ( 580, 870 ] 700 0.030% 100.060% ( 870, 1300 ] 519 0.023% 100.083% ( 1300, 1900 ] 236 0.010% 100.093% ( 1900, 2900 ] 168 0.007% 100.100% ( 2900, 4400 ] 263 0.011% 100.112% ( 4400, 6600 ] 72 0.003% 100.115% ( 6600, 9900 ] 22 0.001% 100.116% ( 9900, 14000 ] 3 0.000% 100.116% ( 14000, 22000 ] 2 0.000% 100.116% ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7828 StdDev: 4.93 Min: 1 Median: 1.2206 Max: 766 Percentiles: P50: 1.22 P75: 1.69 P99: 3.86 P99.9: 9.47 P99.99: 20.82 ------------------------------------------------------ [ 0, 1 ] 12106 38.204% 38.204% ######## ( 1, 2 ] 16944 53.471% 91.675% ########### ( 2, 3 ] 1912 6.034% 97.709% # ( 3, 4 ] 478 1.508% 99.217% ( 4, 6 ] 153 0.483% 99.700% ( 6, 10 ] 73 0.230% 99.931% ( 10, 15 ] 18 0.057% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1103598 Average: 6.4116 StdDev: 87.56 Min: 1 Median: 1.8802 Max: 20489 Percentiles: P50: 1.88 P75: 2.97 P99: 9.03 P99.9: 336.01 P99.99: 563.78 ------------------------------------------------------ [ 0, 1 ] 42529 3.854% 3.854% # ( 1, 2 ] 578561 52.425% 56.279% ########## ( 2, 3 ] 213669 19.361% 75.640% #### ( 3, 4 ] 121297 10.991% 86.631% ## ( 4, 6 ] 121752 11.032% 97.663% ## ( 6, 10 ] 19488 1.766% 99.429% ( 10, 15 ] 3306 0.300% 99.729% ( 15, 22 ] 359 0.033% 99.761% ( 22, 34 ] 35 0.003% 99.764% ( 34, 51 ] 12 0.001% 99.765% ( 51, 76 ] 48 0.004% 99.770% ( 76, 110 ] 139 0.013% 99.782% ( 110, 170 ] 386 0.035% 99.817% ( 170, 250 ] 486 0.044% 99.861% ( 250, 380 ] 646 0.059% 99.920% ( 380, 580 ] 843 0.076% 99.996% ( 580, 870 ] 739 0.067% 100.063% ( 870, 1300 ] 507 0.046% 100.109% ( 1300, 1900 ] 273 0.025% 100.134% ( 1900, 2900 ] 207 0.019% 100.153% ( 2900, 4400 ] 227 0.021% 100.173% ( 4400, 6600 ] 44 0.004% 100.177% ( 6600, 9900 ] 15 0.001% 100.179% ( 14000, 22000 ] 1 0.000% 100.179% ** Level 4 read latency histogram (micros): Count: 154584 Average: 8.2447 StdDev: 94.00 Min: 1 Median: 1.8615 Max: 6282 Percentiles: P50: 1.86 P75: 2.91 P99: 12.11 P99.9: 995.65 P99.99: 1570.36 ------------------------------------------------------ [ 0, 1 ] 5296 3.426% 3.426% # ( 1, 2 ] 83566 54.059% 57.485% ########### ( 2, 3 ] 29856 19.314% 76.798% #### ( 3, 4 ] 15550 10.059% 86.858% ## ( 4, 6 ] 14971 9.685% 96.542% ## ( 6, 10 ] 3485 2.254% 98.797% ( 10, 15 ] 744 0.481% 99.278% ( 15, 22 ] 79 0.051% 99.329% ( 22, 34 ] 21 0.014% 99.343% ( 34, 51 ] 3 0.002% 99.345% ( 51, 76 ] 22 0.014% 99.359% ( 76, 110 ] 16 0.010% 99.369% ( 110, 170 ] 105 0.068% 99.437% ( 170, 250 ] 170 0.110% 99.547% ( 250, 380 ] 151 0.098% 99.645% ( 380, 580 ] 160 0.104% 99.748% ( 580, 870 ] 190 0.123% 99.871% ( 870, 1300 ] 152 0.098% 99.970% ( 1300, 1900 ] 70 0.045% 100.015% ( 1900, 2900 ] 42 0.027% 100.042% ( 2900, 4400 ] 28 0.018% 100.060% ( 4400, 6600 ] 9 0.006% 100.066% ** Level 5 read latency histogram (micros): Count: 340 Average: 1226.6235 StdDev: 1364.14 Min: 82 Median: 654.3590 Max: 8294 Percentiles: P50: 654.36 P75: 1766.67 P99: 6320.00 P99.9: 8294.00 P99.99: 8294.00 ------------------------------------------------------ ( 76, 110 ] 26 7.647% 7.647% ## ( 110, 170 ] 32 9.412% 17.059% ## ( 170, 250 ] 28 8.235% 25.294% ## ( 250, 380 ] 38 11.176% 36.471% ## ( 380, 580 ] 36 10.588% 47.059% ## ( 580, 870 ] 39 11.471% 58.529% ## ( 870, 1300 ] 35 10.294% 68.824% ## ( 1300, 1900 ] 27 7.941% 76.765% ## ( 1900, 2900 ] 34 10.000% 86.765% ## ( 2900, 4400 ] 32 9.412% 96.176% ## ( 4400, 6600 ] 11 3.235% 99.412% # ( 6600, 9900 ] 2 0.588% 100.000% ** DB Stats ** Uptime(secs): 59.9 total, 11.8 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 180.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.044 H:M:S, 48.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 83.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.924 H:M:S, 75.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.399 micros/op 185213 ops/sec 60.001 seconds 11112999 operations; 179.5 MB/s Microseconds per write: Count: 11112999 Average: 5.3992 StdDev: 377.62 Min: 0 Median: 1.7694 Max: 681123 Percentiles: P50: 1.77 P75: 2.79 P99: 8.35 P99.9: 1084.81 P99.99: 2707.98 ------------------------------------------------------ [ 0, 1 ] 1288685 11.596% 11.596% ## ( 1, 2 ] 5546841 49.913% 61.509% ########## ( 2, 3 ] 1888213 16.991% 78.500% ### ( 3, 4 ] 1573220 14.157% 92.657% ### ( 4, 6 ] 642020 5.777% 98.434% # ( 6, 10 ] 107241 0.965% 99.399% ( 10, 15 ] 28439 0.256% 99.655% ( 15, 22 ] 7499 0.067% 99.722% ( 22, 34 ] 1898 0.017% 99.740% ( 34, 51 ] 233 0.002% 99.742% ( 51, 76 ] 44 0.000% 99.742% ( 76, 110 ] 7554 0.068% 99.810% ( 110, 170 ] 3275 0.029% 99.839% ( 170, 250 ] 324 0.003% 99.842% ( 250, 380 ] 121 0.001% 99.843% ( 380, 580 ] 16 0.000% 99.844% ( 580, 870 ] 21 0.000% 99.844% ( 870, 1300 ] 12495 0.112% 99.956% ( 1300, 1900 ] 116 0.001% 99.957% ( 1900, 2900 ] 4496 0.040% 99.998% ( 2900, 4400 ] 178 0.002% 99.999% ( 4400, 6600 ] 31 0.000% 100.000% ( 6600, 9900 ] 9 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 226263 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11112999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11468614968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 623 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29044450 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 36246055712 rocksdb.compact.write.bytes COUNT : 36011505884 rocksdb.flush.write.bytes COUNT : 11295762172 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 78 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 318 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11204724736 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4386816 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 36358696534 rocksdb.non.last.level.read.count COUNT : 8781180 rocksdb.block.checksum.compute.count COUNT : 8780012 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.409643 P95 : 3.887264 P99 : 6.429970 P100 : 681121.000000 COUNT : 11112999 SUM : 54595566 rocksdb.compaction.times.micros P50 : 1025405.405405 P95 : 4113333.333333 P99 : 16235211.000000 P100 : 16235211.000000 COUNT : 108 SUM : 162773518 rocksdb.compaction.times.cpu_micros P50 : 860000.000000 P95 : 4020000.000000 P99 : 14929680.000000 P100 : 14929680.000000 COUNT : 108 SUM : 137488306 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 683.312500 P95 : 1286.088235 P99 : 17920.000000 P100 : 28773.000000 COUNT : 151 SUM : 170357 rocksdb.compaction.outfile.sync.micros P50 : 1110.460526 P95 : 98068.181818 P99 : 191000.000000 P100 : 373277.000000 COUNT : 395 SUM : 6852370 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 124.693878 P95 : 783.000000 P99 : 2900.000000 P100 : 4130.000000 COUNT : 300 SUM : 77849 rocksdb.table.open.io.micros P50 : 1471.910112 P95 : 8013.500000 P99 : 12554.750000 P100 : 18872.000000 COUNT : 623 SUM : 1401912 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.619983 P95 : 7.820344 P99 : 10.794626 P100 : 20699.000000 COUNT : 8778628 SUM : 50504621 rocksdb.read.block.get.micros P50 : 504.444444 P95 : 3607.142857 P99 : 5799.538462 P100 : 8432.000000 COUNT : 1246 SUM : 1144310 rocksdb.write.raw.block.micros P50 : 0.512514 P95 : 0.973778 P99 : 2.837014 P100 : 22483.000000 COUNT : 11468873 SUM : 23099792 rocksdb.numfiles.in.singlecompaction P50 : 3.146739 P95 : 4.842857 P99 : 15.665000 P100 : 21.000000 COUNT : 181 SUM : 634 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558993 P95 : 1181.308855 P99 : 2570.537826 P100 : 680883.000000 COUNT : 163832 SUM : 29057281 rocksdb.sst.read.micros P50 : 1.581756 P95 : 4.717168 P99 : 8.208752 P100 : 20685.000000 COUNT : 8782111 SUM : 32567276 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11112999 SUM : 11468614968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214074.074074 P95 : 464550.000000 P99 : 641050.000000 P100 : 844767.000000 COUNT : 151 SUM : 33594916 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 382 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0