[2024-11-18 06:57:10.168861] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 22.11.4 initialization... [2024-11-18 06:57:10.169134] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid180036 ] Set seed to 1731909430162197 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 06:57:10.283673] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 06:57:10.305674] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 06:57:10.305717] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 180036' to capture a snapshot of events at runtime. [2024-11-18 06:57:10.305728] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-18 06:57:10.305738] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-18 06:57:10.305747] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid180036 for offline analysis/debug. [2024-11-18 06:57:10.306297] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 06:57:14 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-06:57:17 ... thread 0: (1000000,1000000) ops and (329091.6,329091.6) ops/second in (3.038668,3.038668) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.96 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 343.4 2.57 2.30 12 0.214 0 0 0.0 0.0 L1 3/0 249.84 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 246.0 245.7 1.02 0.98 1 1.025 255K 245 0.0 0.0 L2 3/2 190.79 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 238.5 238.4 0.81 0.78 2 0.403 195K 78 0.0 0.0 L3 9/0 741.34 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 1.0 1.5 101.0 301.4 4.40 4.07 15 0.293 451K 323 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.9 1.5 101.0 301.4 4.40 4.07 15 0.293 451K 323 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 242.7 242.5 1.83 1.76 3 0.610 451K 323 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 343.4 2.57 2.30 12 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.29 GB write, 406.93 MB/s write, 0.43 GB read, 136.36 MB/s read, 4.4 seconds Interval compaction: 1.29 GB write, 436.14 MB/s write, 0.43 GB read, 146.15 MB/s read, 4.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 155036 Average: 1.9943 StdDev: 16.01 Min: 0 Median: 1.3193 Max: 3936 Percentiles: P50: 1.32 P75: 1.74 P99: 5.26 P99.9: 9.73 P99.99: 19.73 ------------------------------------------------------ [ 0, 1 ] 48360 31.193% 31.193% ###### ( 1, 2 ] 91329 58.908% 90.101% ############ ( 2, 3 ] 8716 5.622% 95.723% # ( 3, 4 ] 3624 2.338% 98.060% ( 4, 6 ] 2308 1.489% 99.549% ( 6, 10 ] 586 0.378% 99.927% ( 10, 15 ] 88 0.057% 99.984% ( 15, 22 ] 17 0.011% 99.995% ( 22, 34 ] 1 0.001% 99.995% ( 34, 51 ] 3 0.002% 99.997% ( 51, 76 ] 2 0.001% 99.999% ( 110, 170 ] 7 0.005% 100.003% ( 170, 250 ] 4 0.003% 100.006% ( 250, 380 ] 5 0.003% 100.009% ( 580, 870 ] 1 0.001% 100.010% ( 870, 1300 ] 1 0.001% 100.010% ( 1300, 1900 ] 3 0.002% 100.012% ( 1900, 2900 ] 1 0.001% 100.013% ( 2900, 4400 ] 2 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 506 Average: 10.8577 StdDev: 76.10 Min: 1 Median: 3.2919 Max: 1314 Percentiles: P50: 3.29 P75: 4.29 P99: 166.40 P99.9: 1314.00 P99.99: 1314.00 ------------------------------------------------------ [ 0, 1 ] 6 1.186% 1.186% ( 1, 2 ] 56 11.067% 12.253% ## ( 2, 3 ] 144 28.458% 40.711% ###### ( 3, 4 ] 161 31.818% 72.530% ###### ( 4, 6 ] 85 16.798% 89.328% ### ( 6, 10 ] 41 8.103% 97.431% ## ( 10, 15 ] 4 0.791% 98.221% ( 15, 22 ] 1 0.198% 98.419% ( 22, 34 ] 2 0.395% 98.814% ( 110, 170 ] 1 0.198% 99.012% ( 170, 250 ] 1 0.198% 99.209% ( 250, 380 ] 1 0.198% 99.407% ( 380, 580 ] 1 0.198% 99.605% ( 870, 1300 ] 1 0.198% 99.802% ( 1300, 1900 ] 1 0.198% 100.000% ** Level 2 read latency histogram (micros): Count: 38543 Average: 2.6533 StdDev: 28.01 Min: 0 Median: 1.5532 Max: 3011 Percentiles: P50: 1.55 P75: 1.92 P99: 6.55 P99.9: 13.77 P99.99: 1643.71 ------------------------------------------------------ [ 0, 1 ] 4841 12.560% 12.560% ### ( 1, 2 ] 26085 67.678% 80.238% ############## ( 2, 3 ] 4043 10.490% 90.727% ## ( 3, 4 ] 1882 4.883% 95.610% # ( 4, 6 ] 1259 3.266% 98.877% # ( 6, 10 ] 351 0.911% 99.787% ( 10, 15 ] 59 0.153% 99.940% ( 15, 22 ] 7 0.018% 99.958% ( 22, 34 ] 3 0.008% 99.966% ( 170, 250 ] 3 0.008% 99.974% ( 250, 380 ] 3 0.008% 99.982% ( 380, 580 ] 1 0.003% 99.984% ( 580, 870 ] 1 0.003% 99.987% ( 870, 1300 ] 1 0.003% 99.990% ( 1300, 1900 ] 2 0.005% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ( 2900, 4400 ] 1 0.003% 100.003% ** Level 3 read latency histogram (micros): Count: 55 Average: 1683.6545 StdDev: 1413.72 Min: 97 Median: 853.8889 Max: 4593 Percentiles: P50: 853.89 P75: 2931.25 P99: 4593.00 P99.9: 4593.00 P99.99: 4593.00 ------------------------------------------------------ ( 76, 110 ] 1 1.818% 1.818% ( 170, 250 ] 1 1.818% 3.636% ( 250, 380 ] 6 10.909% 14.545% ## ( 380, 580 ] 11 20.000% 34.545% #### ( 580, 870 ] 9 16.364% 50.909% ### ( 870, 1300 ] 3 5.455% 56.364% # ( 1300, 1900 ] 1 1.818% 58.182% ( 1900, 2900 ] 9 16.364% 74.545% ### ( 2900, 4400 ] 12 21.818% 96.364% #### ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 4 read latency histogram (micros): Count: 15 Average: 1702.2000 StdDev: 1770.28 Min: 285 Median: 1085.0000 Max: 5207 Percentiles: P50: 1085.00 P75: 1750.00 P99: 5207.00 P99.9: 5207.00 P99.99: 5207.00 ------------------------------------------------------ ( 250, 380 ] 3 20.000% 20.000% #### ( 380, 580 ] 3 20.000% 40.000% #### ( 870, 1300 ] 3 20.000% 60.000% #### ( 1300, 1900 ] 3 20.000% 80.000% #### ( 4400, 6600 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 598.9000 StdDev: 709.47 Min: 101 Median: 158.0000 Max: 2274 Percentiles: P50: 158.00 P75: 870.00 P99: 2274.00 P99.9: 2274.00 P99.99: 2274.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 10 50.000% 60.000% ########## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.3 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 302.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.447 H:M:S, 13.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.447 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-06:57:20 ... thread 0: (1000000,2000000) ops and (358283.2,343067.5) ops/second in (2.791088,5.829756) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 1.35 GB 56.7 0.5 0.0 0.5 2.3 1.8 0.0 1.3 70.7 327.0 7.13 6.54 28 0.255 511K 521 0.0 0.0 L1 3/3 249.84 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 246.0 245.7 1.02 0.98 1 1.025 255K 245 0.0 0.0 L2 1/0 3.31 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 238.5 238.4 0.81 0.78 2 0.403 195K 78 0.0 0.0 L3 18/0 928.82 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 211.6 211.6 0.89 0.82 1 0.886 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1196/12 97.92 GB 0.0 1.1 0.6 0.6 2.9 2.3 1.0 1.6 115.4 300.9 9.84 9.12 32 0.308 1153K 844 0.0 0.0 Int 0/0 0.00 KB 0.0 1.1 0.6 0.6 2.9 2.3 0.9 1.6 115.4 300.9 9.84 9.12 32 0.308 1153K 844 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.1 0.6 0.6 1.1 0.6 0.0 0.0 244.6 244.4 4.64 4.47 6 0.774 1153K 844 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.4 5.20 4.65 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.89 GB write, 489.62 MB/s write, 1.11 GB read, 187.76 MB/s read, 9.8 seconds Interval compaction: 2.89 GB write, 507.94 MB/s write, 1.11 GB read, 194.78 MB/s read, 9.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 379733 Average: 2.0451 StdDev: 12.87 Min: 0 Median: 1.3905 Max: 3936 Percentiles: P50: 1.39 P75: 1.79 P99: 5.26 P99.9: 9.79 P99.99: 14.75 ------------------------------------------------------ [ 0, 1 ] 96250 25.347% 25.347% ##### ( 1, 2 ] 239760 63.139% 88.486% ############# ( 2, 3 ] 27294 7.188% 95.674% # ( 3, 4 ] 9181 2.418% 98.091% ( 4, 6 ] 5459 1.438% 99.529% ( 6, 10 ] 1489 0.392% 99.921% ( 10, 15 ] 277 0.073% 99.994% ( 15, 22 ] 34 0.009% 100.003% ( 22, 34 ] 3 0.001% 100.004% ( 34, 51 ] 4 0.001% 100.005% ( 51, 76 ] 6 0.002% 100.006% ( 110, 170 ] 14 0.004% 100.010% ( 170, 250 ] 11 0.003% 100.013% ( 250, 380 ] 12 0.003% 100.016% ( 380, 580 ] 2 0.001% 100.017% ( 580, 870 ] 4 0.001% 100.018% ( 870, 1300 ] 2 0.001% 100.018% ( 1300, 1900 ] 6 0.002% 100.020% ( 1900, 2900 ] 3 0.001% 100.021% ( 2900, 4400 ] 2 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 45046 Average: 2.0612 StdDev: 8.16 Min: 1 Median: 1.4287 Max: 1314 Percentiles: P50: 1.43 P75: 1.81 P99: 5.03 P99.9: 10.78 P99.99: 209.63 ------------------------------------------------------ [ 0, 1 ] 9940 22.066% 22.066% #### ( 1, 2 ] 29354 65.164% 87.231% ############# ( 2, 3 ] 3826 8.494% 95.724% ## ( 3, 4 ] 1199 2.662% 98.386% # ( 4, 6 ] 537 1.192% 99.578% ( 6, 10 ] 139 0.309% 99.887% ( 10, 15 ] 38 0.084% 99.971% ( 15, 22 ] 3 0.007% 99.978% ( 22, 34 ] 2 0.004% 99.982% ( 34, 51 ] 2 0.004% 99.987% ( 110, 170 ] 1 0.002% 99.989% ( 170, 250 ] 1 0.002% 99.991% ( 250, 380 ] 1 0.002% 99.993% ( 380, 580 ] 1 0.002% 99.996% ( 870, 1300 ] 1 0.002% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47982 Average: 2.5585 StdDev: 25.11 Min: 0 Median: 1.5513 Max: 3011 Percentiles: P50: 1.55 P75: 1.92 P99: 6.17 P99.9: 13.18 P99.99: 1360.54 ------------------------------------------------------ [ 0, 1 ] 5978 12.459% 12.459% ## ( 1, 2 ] 32676 68.101% 80.559% ############## ( 2, 3 ] 5199 10.835% 91.395% ## ( 3, 4 ] 2188 4.560% 95.955% # ( 4, 6 ] 1444 3.009% 98.964% # ( 6, 10 ] 407 0.848% 99.812% ( 10, 15 ] 66 0.138% 99.950% ( 15, 22 ] 7 0.015% 99.965% ( 22, 34 ] 3 0.006% 99.971% ( 170, 250 ] 3 0.006% 99.977% ( 250, 380 ] 3 0.006% 99.983% ( 380, 580 ] 1 0.002% 99.985% ( 580, 870 ] 1 0.002% 99.987% ( 870, 1300 ] 1 0.002% 99.990% ( 1300, 1900 ] 2 0.004% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 100 Average: 941.8500 StdDev: 1334.95 Min: 0 Median: 358.3333 Max: 4593 Percentiles: P50: 358.33 P75: 1192.50 P99: 4593.00 P99.9: 4593.00 P99.99: 4593.00 ------------------------------------------------------ [ 0, 1 ] 19 19.000% 19.000% #### ( 1, 2 ] 15 15.000% 34.000% ### ( 2, 3 ] 1 1.000% 35.000% ( 3, 4 ] 2 2.000% 37.000% ( 4, 6 ] 4 4.000% 41.000% # ( 15, 22 ] 1 1.000% 42.000% ( 76, 110 ] 1 1.000% 43.000% ( 110, 170 ] 1 1.000% 44.000% ( 170, 250 ] 1 1.000% 45.000% ( 250, 380 ] 6 6.000% 51.000% # ( 380, 580 ] 12 12.000% 63.000% ## ( 580, 870 ] 9 9.000% 72.000% ## ( 870, 1300 ] 4 4.000% 76.000% # ( 1300, 1900 ] 1 1.000% 77.000% ( 1900, 2900 ] 9 9.000% 86.000% ## ( 2900, 4400 ] 12 12.000% 98.000% ## ( 4400, 6600 ] 2 2.000% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1702.2000 StdDev: 1770.28 Min: 285 Median: 1085.0000 Max: 5207 Percentiles: P50: 1085.00 P75: 1750.00 P99: 5207.00 P99.9: 5207.00 P99.99: 5207.00 ------------------------------------------------------ ( 250, 380 ] 3 20.000% 20.000% #### ( 380, 580 ] 3 20.000% 40.000% #### ( 870, 1300 ] 3 20.000% 60.000% #### ( 1300, 1900 ] 3 20.000% 80.000% #### ( 4400, 6600 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 598.9000 StdDev: 709.47 Min: 101 Median: 158.0000 Max: 2274 Percentiles: P50: 158.00 P75: 870.00 P99: 2274.00 P99.9: 2274.00 P99.99: 2274.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 10 50.000% 60.000% ########## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.0 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 325.38 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.639 H:M:S, 10.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 352.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.192 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-06:57:23 ... thread 0: (1000000,3000000) ops and (326263.1,337277.0) ops/second in (3.065011,8.894767) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 1.78 GB 125.9 1.3 0.0 1.3 4.1 2.8 0.0 1.5 100.8 316.6 13.13 12.18 45 0.292 1343K 1370 0.0 0.0 L1 4/0 298.70 MB 29.9 1.0 0.8 0.2 1.0 0.8 0.2 1.3 233.3 232.7 4.58 4.46 2 2.290 1084K 2861 0.0 0.0 L2 5/4 518.40 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 238.5 238.4 0.81 0.78 2 0.403 195K 78 0.0 0.0 L3 18/1 928.82 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.1 1.0 211.6 211.6 0.89 0.82 1 0.886 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1201/13 98.90 GB 0.0 2.7 1.1 1.6 5.5 3.9 1.5 2.0 142.8 288.7 19.40 18.23 50 0.388 2813K 4309 0.0 0.0 Int 0/0 0.00 KB 0.0 2.7 1.1 1.6 5.5 3.9 1.4 2.0 142.8 288.7 19.40 18.23 50 0.388 2813K 4309 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.7 1.1 1.6 2.7 1.1 0.0 0.0 244.1 243.7 11.35 11.03 10 1.135 2813K 4309 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.3 8.05 7.20 40 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.47 GB write, 614.60 MB/s write, 2.71 GB read, 304.06 MB/s read, 19.4 seconds Interval compaction: 5.47 GB write, 629.68 MB/s write, 2.71 GB read, 311.52 MB/s read, 19.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 669300 Average: 2.1105 StdDev: 11.32 Min: 0 Median: 1.4446 Max: 3936 Percentiles: P50: 1.44 P75: 1.83 P99: 5.44 P99.9: 9.77 P99.99: 14.51 ------------------------------------------------------ [ 0, 1 ] 140445 20.984% 20.984% #### ( 1, 2 ] 436791 65.261% 86.245% ############# ( 2, 3 ] 57614 8.608% 94.853% ## ( 3, 4 ] 19440 2.905% 97.757% # ( 4, 6 ] 11562 1.727% 99.485% ( 6, 10 ] 2947 0.440% 99.925% ( 10, 15 ] 483 0.072% 99.997% ( 15, 22 ] 65 0.010% 100.007% ( 22, 34 ] 9 0.001% 100.008% ( 34, 51 ] 5 0.001% 100.009% ( 51, 76 ] 7 0.001% 100.010% ( 110, 170 ] 16 0.002% 100.013% ( 170, 250 ] 21 0.003% 100.016% ( 250, 380 ] 20 0.003% 100.019% ( 380, 580 ] 5 0.001% 100.019% ( 580, 870 ] 7 0.001% 100.020% ( 870, 1300 ] 7 0.001% 100.022% ( 1300, 1900 ] 8 0.001% 100.023% ( 1900, 2900 ] 4 0.001% 100.023% ( 2900, 4400 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 145792 Average: 2.2568 StdDev: 7.81 Min: 1 Median: 1.5488 Max: 1314 Percentiles: P50: 1.55 P75: 1.92 P99: 5.56 P99.9: 11.68 P99.99: 302.45 ------------------------------------------------------ [ 0, 1 ] 18819 12.908% 12.908% ### ( 1, 2 ] 98541 67.590% 80.498% ############## ( 2, 3 ] 19347 13.270% 93.769% ### ( 3, 4 ] 5142 3.527% 97.295% # ( 4, 6 ] 3181 2.182% 99.477% ( 6, 10 ] 561 0.385% 99.862% ( 10, 15 ] 164 0.112% 99.975% ( 15, 22 ] 11 0.008% 99.982% ( 22, 34 ] 4 0.003% 99.985% ( 34, 51 ] 2 0.001% 99.986% ( 110, 170 ] 2 0.001% 99.988% ( 170, 250 ] 1 0.001% 99.988% ( 250, 380 ] 6 0.004% 99.992% ( 380, 580 ] 4 0.003% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 5 0.003% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 47982 Average: 2.5585 StdDev: 25.11 Min: 0 Median: 1.5513 Max: 3011 Percentiles: P50: 1.55 P75: 1.92 P99: 6.17 P99.9: 13.18 P99.99: 1360.54 ------------------------------------------------------ [ 0, 1 ] 5978 12.459% 12.459% ## ( 1, 2 ] 32676 68.101% 80.559% ############## ( 2, 3 ] 5199 10.835% 91.395% ## ( 3, 4 ] 2188 4.560% 95.955% # ( 4, 6 ] 1444 3.009% 98.964% # ( 6, 10 ] 407 0.848% 99.812% ( 10, 15 ] 66 0.138% 99.950% ( 15, 22 ] 7 0.015% 99.965% ( 22, 34 ] 3 0.006% 99.971% ( 170, 250 ] 3 0.006% 99.977% ( 250, 380 ] 3 0.006% 99.983% ( 380, 580 ] 1 0.002% 99.985% ( 580, 870 ] 1 0.002% 99.987% ( 870, 1300 ] 1 0.002% 99.990% ( 1300, 1900 ] 2 0.004% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 19161 Average: 7.1484 StdDev: 117.83 Min: 0 Median: 1.5919 Max: 4593 Percentiles: P50: 1.59 P75: 1.96 P99: 5.83 P99.9: 2326.56 P99.99: 4492.29 ------------------------------------------------------ [ 0, 1 ] 1960 10.229% 10.229% ## ( 1, 2 ] 12874 67.189% 77.418% ############# ( 2, 3 ] 2927 15.276% 92.693% ### ( 3, 4 ] 764 3.987% 96.681% # ( 4, 6 ] 487 2.542% 99.222% # ( 6, 10 ] 74 0.386% 99.609% ( 10, 15 ] 14 0.073% 99.682% ( 15, 22 ] 3 0.016% 99.697% ( 76, 110 ] 1 0.005% 99.703% ( 110, 170 ] 1 0.005% 99.708% ( 170, 250 ] 1 0.005% 99.713% ( 250, 380 ] 6 0.031% 99.744% ( 380, 580 ] 12 0.063% 99.807% ( 580, 870 ] 9 0.047% 99.854% ( 870, 1300 ] 4 0.021% 99.875% ( 1300, 1900 ] 1 0.005% 99.880% ( 1900, 2900 ] 9 0.047% 99.927% ( 2900, 4400 ] 12 0.063% 99.990% ( 4400, 6600 ] 2 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1702.2000 StdDev: 1770.28 Min: 285 Median: 1085.0000 Max: 5207 Percentiles: P50: 1085.00 P75: 1750.00 P99: 5207.00 P99.9: 5207.00 P99.99: 5207.00 ------------------------------------------------------ ( 250, 380 ] 3 20.000% 20.000% #### ( 380, 580 ] 3 20.000% 40.000% #### ( 870, 1300 ] 3 20.000% 60.000% #### ( 1300, 1900 ] 3 20.000% 80.000% #### ( 4400, 6600 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 598.9000 StdDev: 709.47 Min: 101 Median: 158.0000 Max: 2274 Percentiles: P50: 158.00 P75: 870.00 P99: 2274.00 P99.9: 2274.00 P99.99: 2274.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 10 50.000% 60.000% ########## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.1 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.066 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.427 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-06:57:26 ... thread 0: (1000000,4000000) ops and (336056.7,336971.1) ops/second in (2.975688,11.870455) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.70 GB 245.4 2.4 0.0 2.4 6.1 3.7 0.0 1.6 121.7 308.8 20.19 18.87 62 0.326 2494K 2555 0.0 0.0 L1 4/0 298.70 MB 29.9 1.0 0.8 0.2 1.0 0.8 0.2 1.3 233.3 232.7 4.58 4.46 2 2.290 1084K 2861 0.0 0.0 L2 1/0 3.31 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 238.5 238.4 0.81 0.78 2 0.403 195K 78 0.0 0.0 L3 29/0 945.37 MB 0.9 0.8 0.7 0.1 0.8 0.7 0.1 1.2 207.7 207.4 4.00 3.62 2 2.002 844K 1057 0.0 0.0 L4 144/0 9.71 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/4 99.82 GB 0.0 4.4 1.6 2.8 8.1 5.3 2.3 2.2 153.8 281.4 29.58 27.72 68 0.435 4619K 6551 0.0 0.0 Int 0/0 0.00 KB 0.0 4.4 1.6 2.8 8.1 5.3 2.2 2.2 153.8 281.4 29.58 27.72 68 0.435 4619K 6551 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.4 1.6 2.8 4.4 1.6 0.0 0.0 240.8 240.5 18.89 18.16 15 1.259 4619K 6551 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 353.7 10.69 9.56 53 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.13 GB write, 688.34 MB/s write, 4.44 GB read, 376.27 MB/s read, 29.6 seconds Interval compaction: 8.13 GB write, 700.99 MB/s write, 4.44 GB read, 383.19 MB/s read, 29.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 915051 Average: 2.0963 StdDev: 11.98 Min: 0 Median: 1.4314 Max: 3936 Percentiles: P50: 1.43 P75: 1.82 P99: 5.40 P99.9: 9.78 P99.99: 14.70 ------------------------------------------------------ [ 0, 1 ] 201983 22.073% 22.073% #### ( 1, 2 ] 592425 64.742% 86.816% ############# ( 2, 3 ] 75045 8.201% 95.017% ## ( 3, 4 ] 25829 2.823% 97.840% # ( 4, 6 ] 15163 1.657% 99.497% ( 6, 10 ] 3910 0.427% 99.924% ( 10, 15 ] 644 0.070% 99.994% ( 15, 22 ] 96 0.010% 100.005% ( 22, 34 ] 12 0.001% 100.006% ( 34, 51 ] 8 0.001% 100.007% ( 51, 76 ] 7 0.001% 100.008% ( 110, 170 ] 22 0.002% 100.010% ( 170, 250 ] 28 0.003% 100.013% ( 250, 380 ] 24 0.003% 100.016% ( 380, 580 ] 9 0.001% 100.017% ( 580, 870 ] 10 0.001% 100.018% ( 870, 1300 ] 11 0.001% 100.019% ( 1300, 1900 ] 10 0.001% 100.020% ( 1900, 2900 ] 5 0.001% 100.021% ( 2900, 4400 ] 5 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 194756 Average: 2.2535 StdDev: 6.77 Min: 1 Median: 1.5614 Max: 1314 Percentiles: P50: 1.56 P75: 1.93 P99: 5.54 P99.9: 11.29 P99.99: 125.73 ------------------------------------------------------ [ 0, 1 ] 23090 11.856% 11.856% ## ( 1, 2 ] 132336 67.950% 79.806% ############## ( 2, 3 ] 27177 13.954% 93.760% ### ( 3, 4 ] 6910 3.548% 97.308% # ( 4, 6 ] 4287 2.201% 99.509% ( 6, 10 ] 707 0.363% 99.872% ( 10, 15 ] 210 0.108% 99.980% ( 15, 22 ] 13 0.007% 99.987% ( 22, 34 ] 4 0.002% 99.989% ( 34, 51 ] 2 0.001% 99.990% ( 110, 170 ] 2 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.991% ( 250, 380 ] 6 0.003% 99.994% ( 380, 580 ] 4 0.002% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 5 0.003% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 47982 Average: 2.5585 StdDev: 25.11 Min: 0 Median: 1.5513 Max: 3011 Percentiles: P50: 1.55 P75: 1.92 P99: 6.17 P99.9: 13.18 P99.99: 1360.54 ------------------------------------------------------ [ 0, 1 ] 5978 12.459% 12.459% ## ( 1, 2 ] 32676 68.101% 80.559% ############## ( 2, 3 ] 5199 10.835% 91.395% ## ( 3, 4 ] 2188 4.560% 95.955% # ( 4, 6 ] 1444 3.009% 98.964% # ( 6, 10 ] 407 0.848% 99.812% ( 10, 15 ] 66 0.138% 99.950% ( 15, 22 ] 7 0.015% 99.965% ( 22, 34 ] 3 0.006% 99.971% ( 170, 250 ] 3 0.006% 99.977% ( 250, 380 ] 3 0.006% 99.983% ( 380, 580 ] 1 0.002% 99.985% ( 580, 870 ] 1 0.002% 99.987% ( 870, 1300 ] 1 0.002% 99.990% ( 1300, 1900 ] 2 0.004% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 33007 Average: 5.2917 StdDev: 90.19 Min: 0 Median: 1.5917 Max: 4593 Percentiles: P50: 1.59 P75: 1.96 P99: 5.88 P99.9: 753.80 P99.99: 4237.41 ------------------------------------------------------ [ 0, 1 ] 3332 10.095% 10.095% ## ( 1, 2 ] 22262 67.446% 77.541% ############# ( 2, 3 ] 5123 15.521% 93.062% ### ( 3, 4 ] 1238 3.751% 96.813% # ( 4, 6 ] 768 2.327% 99.140% ( 6, 10 ] 124 0.376% 99.515% ( 10, 15 ] 40 0.121% 99.636% ( 15, 22 ] 7 0.021% 99.658% ( 22, 34 ] 2 0.006% 99.664% ( 34, 51 ] 21 0.064% 99.727% ( 51, 76 ] 13 0.039% 99.767% ( 76, 110 ] 6 0.018% 99.785% ( 110, 170 ] 1 0.003% 99.788% ( 170, 250 ] 10 0.030% 99.818% ( 250, 380 ] 8 0.024% 99.842% ( 380, 580 ] 13 0.039% 99.882% ( 580, 870 ] 10 0.030% 99.912% ( 870, 1300 ] 5 0.015% 99.927% ( 1300, 1900 ] 1 0.003% 99.930% ( 1900, 2900 ] 9 0.027% 99.958% ( 2900, 4400 ] 12 0.036% 99.994% ( 4400, 6600 ] 2 0.006% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1702.2000 StdDev: 1770.28 Min: 285 Median: 1085.0000 Max: 5207 Percentiles: P50: 1085.00 P75: 1750.00 P99: 5207.00 P99.9: 5207.00 P99.99: 5207.00 ------------------------------------------------------ ( 250, 380 ] 3 20.000% 20.000% #### ( 380, 580 ] 3 20.000% 40.000% #### ( 870, 1300 ] 3 20.000% 60.000% #### ( 1300, 1900 ] 3 20.000% 80.000% #### ( 4400, 6600 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 40 Average: 583.5750 StdDev: 671.70 Min: 101 Median: 166.8421 Max: 2274 Percentiles: P50: 166.84 P75: 870.00 P99: 2274.00 P99.9: 2274.00 P99.99: 2274.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 19 47.500% 52.500% ########## ( 170, 250 ] 3 7.500% 60.000% ## ( 250, 380 ] 1 2.500% 62.500% # ( 380, 580 ] 3 7.500% 70.000% ## ( 580, 870 ] 2 5.000% 75.000% # ( 870, 1300 ] 2 5.000% 80.000% # ( 1300, 1900 ] 5 12.500% 92.500% ### ( 1900, 2900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.446 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.380 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/18-06:57:31 ... thread 0: (1000000,5000000) ops and (203641.5,297955.2) ops/second in (4.910590,16.781045) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.75 GB 62.9 3.5 0.0 3.5 8.2 4.7 0.0 1.7 130.6 306.9 27.49 25.81 81 0.339 3645K 3868 0.0 0.0 L1 4/4 298.70 MB 0.0 1.0 0.8 0.2 1.0 0.8 0.2 1.3 233.3 232.7 4.58 4.46 2 2.290 1084K 2861 0.0 0.0 L2 1/0 3.31 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 238.5 238.4 0.81 0.78 2 0.403 195K 78 0.0 0.0 L3 29/0 945.37 MB 0.9 0.8 0.7 0.1 0.8 0.7 0.1 1.2 207.7 207.4 4.00 3.62 2 2.002 844K 1057 0.0 0.0 L4 144/0 9.71 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/19 100.87 GB 0.0 5.5 1.6 3.9 10.3 6.3 2.3 2.2 154.1 285.4 36.88 34.66 87 0.424 5770K 7864 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.6 3.9 10.3 6.3 2.2 2.2 154.1 285.4 36.88 34.66 87 0.424 5770K 7864 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.6 3.9 5.5 1.6 0.0 0.0 245.2 244.8 23.18 22.38 19 1.220 5770K 7864 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.9 13.71 12.28 68 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.0 total, 16.8 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.28 GB write, 619.12 MB/s write, 5.55 GB read, 334.28 MB/s read, 36.9 seconds Interval compaction: 10.28 GB write, 627.18 MB/s write, 5.55 GB read, 338.63 MB/s read, 36.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 13, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1371740 Average: 2.1166 StdDev: 12.08 Min: 0 Median: 1.4255 Max: 3936 Percentiles: P50: 1.43 P75: 1.81 P99: 5.35 P99.9: 9.92 P99.99: 108.54 ------------------------------------------------------ [ 0, 1 ] 305957 22.304% 22.304% #### ( 1, 2 ] 892831 65.087% 87.392% ############# ( 2, 3 ] 108641 7.920% 95.312% ## ( 3, 4 ] 37063 2.702% 98.014% # ( 4, 6 ] 20121 1.467% 99.480% ( 6, 10 ] 5867 0.428% 99.908% ( 10, 15 ] 894 0.065% 99.973% ( 15, 22 ] 126 0.009% 99.983% ( 22, 34 ] 15 0.001% 99.984% ( 34, 51 ] 10 0.001% 99.984% ( 51, 76 ] 8 0.001% 99.985% ( 76, 110 ] 74 0.005% 99.990% ( 110, 170 ] 180 0.013% 100.003% ( 170, 250 ] 77 0.006% 100.009% ( 250, 380 ] 47 0.003% 100.012% ( 380, 580 ] 35 0.003% 100.015% ( 580, 870 ] 26 0.002% 100.017% ( 870, 1300 ] 16 0.001% 100.018% ( 1300, 1900 ] 11 0.001% 100.019% ( 1900, 2900 ] 8 0.001% 100.019% ( 2900, 4400 ] 7 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 194757 Average: 2.2552 StdDev: 6.82 Min: 1 Median: 1.5614 Max: 1314 Percentiles: P50: 1.56 P75: 1.93 P99: 5.54 P99.9: 11.32 P99.99: 155.73 ------------------------------------------------------ [ 0, 1 ] 23090 11.856% 11.856% ## ( 1, 2 ] 132336 67.949% 79.805% ############## ( 2, 3 ] 27177 13.954% 93.759% ### ( 3, 4 ] 6910 3.548% 97.307% # ( 4, 6 ] 4287 2.201% 99.509% ( 6, 10 ] 707 0.363% 99.872% ( 10, 15 ] 210 0.108% 99.979% ( 15, 22 ] 13 0.007% 99.986% ( 22, 34 ] 4 0.002% 99.988% ( 34, 51 ] 2 0.001% 99.989% ( 110, 170 ] 2 0.001% 99.990% ( 170, 250 ] 1 0.001% 99.991% ( 250, 380 ] 7 0.004% 99.994% ( 380, 580 ] 4 0.002% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 5 0.003% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 47982 Average: 2.5585 StdDev: 25.11 Min: 0 Median: 1.5513 Max: 3011 Percentiles: P50: 1.55 P75: 1.92 P99: 6.17 P99.9: 13.18 P99.99: 1360.54 ------------------------------------------------------ [ 0, 1 ] 5978 12.459% 12.459% ## ( 1, 2 ] 32676 68.101% 80.559% ############## ( 2, 3 ] 5199 10.835% 91.395% ## ( 3, 4 ] 2188 4.560% 95.955% # ( 4, 6 ] 1444 3.009% 98.964% # ( 6, 10 ] 407 0.848% 99.812% ( 10, 15 ] 66 0.138% 99.950% ( 15, 22 ] 7 0.015% 99.965% ( 22, 34 ] 3 0.006% 99.971% ( 170, 250 ] 3 0.006% 99.977% ( 250, 380 ] 3 0.006% 99.983% ( 380, 580 ] 1 0.002% 99.985% ( 580, 870 ] 1 0.002% 99.987% ( 870, 1300 ] 1 0.002% 99.990% ( 1300, 1900 ] 2 0.004% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 33007 Average: 5.2917 StdDev: 90.19 Min: 0 Median: 1.5917 Max: 4593 Percentiles: P50: 1.59 P75: 1.96 P99: 5.88 P99.9: 753.80 P99.99: 4237.41 ------------------------------------------------------ [ 0, 1 ] 3332 10.095% 10.095% ## ( 1, 2 ] 22262 67.446% 77.541% ############# ( 2, 3 ] 5123 15.521% 93.062% ### ( 3, 4 ] 1238 3.751% 96.813% # ( 4, 6 ] 768 2.327% 99.140% ( 6, 10 ] 124 0.376% 99.515% ( 10, 15 ] 40 0.121% 99.636% ( 15, 22 ] 7 0.021% 99.658% ( 22, 34 ] 2 0.006% 99.664% ( 34, 51 ] 21 0.064% 99.727% ( 51, 76 ] 13 0.039% 99.767% ( 76, 110 ] 6 0.018% 99.785% ( 110, 170 ] 1 0.003% 99.788% ( 170, 250 ] 10 0.030% 99.818% ( 250, 380 ] 8 0.024% 99.842% ( 380, 580 ] 13 0.039% 99.882% ( 580, 870 ] 10 0.030% 99.912% ( 870, 1300 ] 5 0.015% 99.927% ( 1300, 1900 ] 1 0.003% 99.930% ( 1900, 2900 ] 9 0.027% 99.958% ( 2900, 4400 ] 12 0.036% 99.994% ( 4400, 6600 ] 2 0.006% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1702.2000 StdDev: 1770.28 Min: 285 Median: 1085.0000 Max: 5207 Percentiles: P50: 1085.00 P75: 1750.00 P99: 5207.00 P99.9: 5207.00 P99.99: 5207.00 ------------------------------------------------------ ( 250, 380 ] 3 20.000% 20.000% #### ( 380, 580 ] 3 20.000% 40.000% #### ( 870, 1300 ] 3 20.000% 60.000% #### ( 1300, 1900 ] 3 20.000% 80.000% #### ( 4400, 6600 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 40 Average: 583.5750 StdDev: 671.70 Min: 101 Median: 166.8421 Max: 2274 Percentiles: P50: 166.84 P75: 870.00 P99: 2274.00 P99.9: 2274.00 P99.99: 2274.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 19 47.500% 52.500% ########## ( 170, 250 ] 3 7.500% 60.000% ## ( 250, 380 ] 1 2.500% 62.500% # ( 380, 580 ] 3 7.500% 70.000% ## ( 580, 870 ] 2 5.000% 75.000% # ( 870, 1300 ] 2 5.000% 80.000% # ( 1300, 1900 ] 5 12.500% 92.500% ### ( 1900, 2900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 17.0 total, 4.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 289.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.661 H:M:S, 21.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 200.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.215 H:M:S, 45.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/18-06:57:47 ... thread 0: (1000000,6000000) ops and (62953.8,183678.9) ops/second in (15.884664,32.665709) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/7 1.53 GB 0.0 5.0 0.0 5.0 10.7 5.7 0.0 1.9 136.2 288.7 37.93 34.45 97 0.391 5243K 8719 0.0 0.0 L1 8/8 874.61 MB 0.0 4.5 3.9 0.5 4.4 3.9 0.2 1.1 213.1 210.2 21.48 19.76 3 7.160 4647K 60K 0.0 0.0 L2 5/4 518.43 MB 1.3 0.2 0.1 0.1 0.2 0.1 3.1 1.5 238.5 238.4 0.81 0.78 2 0.403 195K 78 0.0 0.0 L3 32/14 2.08 GB 1.1 1.5 1.2 0.3 1.5 1.2 1.6 1.3 174.4 174.0 8.81 6.85 6 1.469 1483K 1261 0.0 0.0 L4 147/1 9.57 GB 1.0 0.9 0.6 0.2 0.9 0.6 1.0 1.4 103.7 103.0 8.46 4.26 5 1.692 843K 5313 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/34 101.72 GB 0.0 12.1 5.9 6.2 17.6 11.5 7.6 3.1 159.4 233.1 77.49 66.10 113 0.686 12M 76K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.1 5.9 6.2 17.6 11.5 7.4 3.1 159.4 233.1 77.49 66.10 113 0.686 12M 76K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.1 5.9 6.2 12.0 5.8 0.0 0.0 206.3 204.9 59.86 51.23 32 1.871 12M 76K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 328.7 17.63 14.86 81 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.9 total, 32.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.64 GB write, 549.29 MB/s write, 12.06 GB read, 375.49 MB/s read, 77.5 seconds Interval compaction: 17.64 GB write, 552.96 MB/s write, 12.06 GB read, 378.00 MB/s read, 77.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 20, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2479801 Average: 2.8581 StdDev: 21.69 Min: 0 Median: 1.4305 Max: 5983 Percentiles: P50: 1.43 P75: 1.83 P99: 7.16 P99.9: 163.41 P99.99: 420.45 ------------------------------------------------------ [ 0, 1 ] 569628 22.971% 22.971% ##### ( 1, 2 ] 1557101 62.791% 85.762% ############# ( 2, 3 ] 200495 8.085% 93.847% ## ( 3, 4 ] 72364 2.918% 96.765% # ( 4, 6 ] 50668 2.043% 98.809% ( 6, 10 ] 16341 0.659% 99.468% ( 10, 15 ] 2297 0.093% 99.560% ( 15, 22 ] 331 0.013% 99.574% ( 22, 34 ] 26 0.001% 99.575% ( 34, 51 ] 22 0.001% 99.575% ( 51, 76 ] 49 0.002% 99.577% ( 76, 110 ] 4252 0.171% 99.749% ( 110, 170 ] 4211 0.170% 99.919% ( 170, 250 ] 996 0.040% 99.959% ( 250, 380 ] 664 0.027% 99.986% ( 380, 580 ] 539 0.022% 100.007% ( 580, 870 ] 203 0.008% 100.016% ( 870, 1300 ] 65 0.003% 100.018% ( 1300, 1900 ] 28 0.001% 100.019% ( 1900, 2900 ] 34 0.001% 100.021% ( 2900, 4400 ] 29 0.001% 100.022% ( 4400, 6600 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 649800 Average: 4.9720 StdDev: 76.44 Min: 1 Median: 1.7770 Max: 13724 Percentiles: P50: 1.78 P75: 2.64 P99: 8.89 P99.9: 21.37 P99.99: 140.84 ------------------------------------------------------ [ 0, 1 ] 45444 6.994% 6.994% # ( 1, 2 ] 359667 55.350% 62.344% ########### ( 2, 3 ] 129033 19.857% 82.201% #### ( 3, 4 ] 51135 7.869% 90.071% ## ( 4, 6 ] 49294 7.586% 97.657% ## ( 6, 10 ] 12066 1.857% 99.514% ( 10, 15 ] 2259 0.348% 99.861% ( 15, 22 ] 277 0.043% 99.904% ( 22, 34 ] 20 0.003% 99.907% ( 34, 51 ] 7 0.001% 99.908% ( 51, 76 ] 17 0.003% 99.911% ( 76, 110 ] 296 0.046% 99.956% ( 110, 170 ] 428 0.066% 100.022% ( 170, 250 ] 134 0.021% 100.043% ( 250, 380 ] 178 0.027% 100.070% ( 380, 580 ] 227 0.035% 100.105% ( 580, 870 ] 202 0.031% 100.136% ( 870, 1300 ] 147 0.023% 100.159% ( 1300, 1900 ] 72 0.011% 100.170% ( 1900, 2900 ] 101 0.016% 100.185% ( 2900, 4400 ] 94 0.014% 100.200% ( 4400, 6600 ] 36 0.006% 100.205% ( 6600, 9900 ] 6 0.001% 100.206% ( 9900, 14000 ] 1 0.000% 100.206% ** Level 2 read latency histogram (micros): Count: 48395 Average: 5.7552 StdDev: 116.58 Min: 0 Median: 1.5559 Max: 9325 Percentiles: P50: 1.56 P75: 1.92 P99: 6.83 P99.9: 1111.02 P99.99: 6705.93 ------------------------------------------------------ [ 0, 1 ] 5978 12.353% 12.353% ## ( 1, 2 ] 32777 67.728% 80.081% ############## ( 2, 3 ] 5354 11.063% 91.144% ## ( 3, 4 ] 2226 4.600% 95.743% # ( 4, 6 ] 1490 3.079% 98.822% # ( 6, 10 ] 415 0.858% 99.680% ( 10, 15 ] 67 0.138% 99.818% ( 15, 22 ] 7 0.014% 99.833% ( 22, 34 ] 3 0.006% 99.839% ( 170, 250 ] 4 0.008% 99.847% ( 250, 380 ] 8 0.017% 99.864% ( 380, 580 ] 6 0.012% 99.876% ( 580, 870 ] 6 0.012% 99.888% ( 870, 1300 ] 10 0.021% 99.909% ( 1300, 1900 ] 8 0.017% 99.926% ( 1900, 2900 ] 14 0.029% 99.955% ( 2900, 4400 ] 15 0.031% 99.986% ( 4400, 6600 ] 2 0.004% 99.990% ( 6600, 9900 ] 5 0.010% 100.000% ** Level 3 read latency histogram (micros): Count: 235915 Average: 10.6037 StdDev: 130.59 Min: 0 Median: 1.9120 Max: 8066 Percentiles: P50: 1.91 P75: 2.89 P99: 12.65 P99.9: 993.32 P99.99: 1666.11 ------------------------------------------------------ [ 0, 1 ] 6503 2.757% 2.757% # ( 1, 2 ] 122209 51.802% 54.559% ########## ( 2, 3 ] 54028 22.901% 77.460% ##### ( 3, 4 ] 24753 10.492% 87.952% ## ( 4, 6 ] 20213 8.568% 96.520% ## ( 6, 10 ] 5335 2.261% 98.782% ( 10, 15 ] 972 0.412% 99.194% ( 15, 22 ] 134 0.057% 99.251% ( 22, 34 ] 11 0.005% 99.255% ( 34, 51 ] 25 0.011% 99.266% ( 51, 76 ] 20 0.008% 99.274% ( 76, 110 ] 33 0.014% 99.288% ( 110, 170 ] 110 0.047% 99.335% ( 170, 250 ] 186 0.079% 99.414% ( 250, 380 ] 270 0.114% 99.528% ( 380, 580 ] 416 0.176% 99.705% ( 580, 870 ] 401 0.170% 99.875% ( 870, 1300 ] 213 0.090% 99.965% ( 1300, 1900 ] 99 0.042% 100.007% ( 1900, 2900 ] 88 0.037% 100.044% ( 2900, 4400 ] 108 0.046% 100.090% ( 4400, 6600 ] 33 0.014% 100.104% ( 6600, 9900 ] 9 0.004% 100.108% ** Level 4 read latency histogram (micros): Count: 115 Average: 502.2174 StdDev: 1130.35 Min: 1 Median: 2.9643 Max: 5207 Percentiles: P50: 2.96 P75: 360.50 P99: 5207.00 P99.9: 5207.00 P99.99: 5207.00 ------------------------------------------------------ [ 0, 1 ] 17 14.783% 14.783% ### ( 1, 2 ] 27 23.478% 38.261% ##### ( 2, 3 ] 14 12.174% 50.435% ## ( 3, 4 ] 5 4.348% 54.783% # ( 4, 6 ] 1 0.870% 55.652% ( 6, 10 ] 2 1.739% 57.391% ( 10, 15 ] 1 0.870% 58.261% ( 34, 51 ] 1 0.870% 59.130% ( 110, 170 ] 3 2.609% 61.739% # ( 170, 250 ] 11 9.565% 71.304% ## ( 250, 380 ] 5 4.348% 75.652% # ( 380, 580 ] 3 2.609% 78.261% # ( 580, 870 ] 6 5.217% 83.478% # ( 870, 1300 ] 6 5.217% 88.696% # ( 1300, 1900 ] 6 5.217% 93.913% # ( 2900, 4400 ] 2 1.739% 95.652% ( 4400, 6600 ] 5 4.348% 100.000% # ** Level 5 read latency histogram (micros): Count: 100 Average: 1286.8600 StdDev: 1424.56 Min: 101 Median: 725.0000 Max: 6864 Percentiles: P50: 725.00 P75: 1800.00 P99: 6600.00 P99.9: 6864.00 P99.99: 6864.00 ------------------------------------------------------ ( 76, 110 ] 2 2.000% 2.000% ( 110, 170 ] 19 19.000% 21.000% #### ( 170, 250 ] 4 4.000% 25.000% # ( 250, 380 ] 7 7.000% 32.000% # ( 380, 580 ] 13 13.000% 45.000% ### ( 580, 870 ] 10 10.000% 55.000% ## ( 870, 1300 ] 10 10.000% 65.000% ## ( 1300, 1900 ] 12 12.000% 77.000% ## ( 1900, 2900 ] 8 8.000% 85.000% ## ( 2900, 4400 ] 10 10.000% 95.000% ## ( 4400, 6600 ] 4 4.000% 99.000% # ( 6600, 9900 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 32.9 total, 15.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 179.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.318 H:M:S, 49.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 61.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.657 H:M:S, 79.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/11/18-06:57:50 ... thread 0: (1000000,7000000) ops and (276815.2,192953.2) ops/second in (3.612518,36.278227) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.52 GB 75.5 5.7 0.0 5.7 12.4 6.6 0.0 1.9 132.1 285.4 44.33 39.96 112 0.396 5947K 9598 0.0 0.0 L1 8/8 874.61 MB 0.0 4.5 3.9 0.5 4.4 3.9 0.2 1.1 213.1 210.2 21.48 19.76 3 7.160 4647K 60K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.1 1.5 238.5 238.4 0.81 0.78 2 0.403 195K 78 0.0 0.0 L3 14/0 875.24 MB 0.9 2.6 1.6 1.1 2.6 1.6 1.7 1.7 162.2 161.8 16.70 12.35 8 2.087 2673K 5424 0.0 0.0 L4 157/0 9.64 GB 1.0 1.7 1.3 0.4 1.7 1.3 2.1 1.3 128.3 127.5 13.76 8.35 12 1.147 1698K 8218 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/19 102.69 GB 0.0 14.7 6.9 7.8 21.3 13.5 10.4 3.2 155.6 224.7 97.08 81.21 137 0.709 15M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.7 6.9 7.8 21.3 13.5 10.3 3.2 155.6 224.7 97.08 81.21 137 0.709 15M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.7 6.9 7.8 14.7 6.8 0.0 0.0 198.5 197.4 76.06 63.67 43 1.769 15M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 323.7 21.02 17.53 94 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.5 total, 36.3 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.30 GB write, 597.71 MB/s write, 14.75 GB read, 413.75 MB/s read, 97.1 seconds Interval compaction: 21.30 GB write, 601.30 MB/s write, 14.75 GB read, 416.24 MB/s read, 97.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 37, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2892885 Average: 2.9274 StdDev: 25.06 Min: 0 Median: 1.4777 Max: 7652 Percentiles: P50: 1.48 P75: 1.88 P99: 7.42 P99.9: 157.07 P99.99: 364.96 ------------------------------------------------------ [ 0, 1 ] 588143 20.331% 20.331% #### ( 1, 2 ] 1796763 62.110% 82.440% ############ ( 2, 3 ] 289381 10.003% 92.444% ## ( 3, 4 ] 101286 3.501% 95.945% # ( 4, 6 ] 80305 2.776% 98.721% # ( 6, 10 ] 22691 0.784% 99.505% ( 10, 15 ] 3252 0.112% 99.618% ( 15, 22 ] 439 0.015% 99.633% ( 22, 34 ] 41 0.001% 99.634% ( 34, 51 ] 27 0.001% 99.635% ( 51, 76 ] 51 0.002% 99.637% ( 76, 110 ] 4278 0.148% 99.785% ( 110, 170 ] 4254 0.147% 99.932% ( 170, 250 ] 1050 0.036% 99.968% ( 250, 380 ] 720 0.025% 99.993% ( 380, 580 ] 586 0.020% 100.013% ( 580, 870 ] 241 0.008% 100.022% ( 870, 1300 ] 88 0.003% 100.025% ( 1300, 1900 ] 41 0.001% 100.026% ( 1900, 2900 ] 63 0.002% 100.028% ( 2900, 4400 ] 44 0.002% 100.030% ( 4400, 6600 ] 3 0.000% 100.030% ( 6600, 9900 ] 3 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 753228 Average: 5.0858 StdDev: 79.43 Min: 1 Median: 1.7903 Max: 13724 Percentiles: P50: 1.79 P75: 2.66 P99: 9.00 P99.9: 84.64 P99.99: 166.40 ------------------------------------------------------ [ 0, 1 ] 48212 6.401% 6.401% # ( 1, 2 ] 415553 55.170% 61.570% ########### ( 2, 3 ] 153253 20.346% 81.916% #### ( 3, 4 ] 59894 7.952% 89.868% ## ( 4, 6 ] 57763 7.669% 97.537% ## ( 6, 10 ] 14714 1.953% 99.490% ( 10, 15 ] 2639 0.350% 99.841% ( 15, 22 ] 316 0.042% 99.883% ( 22, 34 ] 23 0.003% 99.886% ( 34, 51 ] 8 0.001% 99.887% ( 51, 76 ] 20 0.003% 99.889% ( 76, 110 ] 314 0.042% 99.931% ( 110, 170 ] 472 0.063% 99.994% ( 170, 250 ] 161 0.021% 100.015% ( 250, 380 ] 217 0.029% 100.044% ( 380, 580 ] 262 0.035% 100.079% ( 580, 870 ] 229 0.030% 100.109% ( 870, 1300 ] 156 0.021% 100.130% ( 1300, 1900 ] 84 0.011% 100.141% ( 1900, 2900 ] 125 0.017% 100.158% ( 2900, 4400 ] 116 0.015% 100.173% ( 4400, 6600 ] 48 0.006% 100.179% ( 6600, 9900 ] 8 0.001% 100.180% ( 9900, 14000 ] 1 0.000% 100.181% ** Level 2 read latency histogram (micros): Count: 77111 Average: 5.0301 StdDev: 93.69 Min: 0 Median: 1.6213 Max: 9325 Percentiles: P50: 1.62 P75: 2.00 P99: 8.38 P99.9: 494.62 P99.99: 4328.89 ------------------------------------------------------ [ 0, 1 ] 6728 8.725% 8.725% ## ( 1, 2 ] 51227 66.433% 75.158% ############# ( 2, 3 ] 11051 14.331% 89.489% ### ( 3, 4 ] 4059 5.264% 94.753% # ( 4, 6 ] 2667 3.459% 98.212% # ( 6, 10 ] 1021 1.324% 99.536% ( 10, 15 ] 120 0.156% 99.691% ( 15, 22 ] 13 0.017% 99.708% ( 22, 34 ] 3 0.004% 99.712% ( 51, 76 ] 1 0.001% 99.713% ( 76, 110 ] 44 0.057% 99.770% ( 110, 170 ] 33 0.043% 99.813% ( 170, 250 ] 27 0.035% 99.848% ( 250, 380 ] 29 0.038% 99.886% ( 380, 580 ] 19 0.025% 99.911% ( 580, 870 ] 12 0.016% 99.926% ( 870, 1300 ] 11 0.014% 99.940% ( 1300, 1900 ] 8 0.010% 99.951% ( 1900, 2900 ] 16 0.021% 99.971% ( 2900, 4400 ] 15 0.019% 99.991% ( 4400, 6600 ] 2 0.003% 99.994% ( 6600, 9900 ] 5 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 465975 Average: 8.5589 StdDev: 111.67 Min: 0 Median: 1.9039 Max: 9273 Percentiles: P50: 1.90 P75: 2.86 P99: 9.88 P99.9: 675.95 P99.99: 967.59 ------------------------------------------------------ [ 0, 1 ] 11742 2.520% 2.520% # ( 1, 2 ] 244778 52.530% 55.050% ########### ( 2, 3 ] 107657 23.104% 78.154% ##### ( 3, 4 ] 47251 10.140% 88.294% ## ( 4, 6 ] 39916 8.566% 96.860% ## ( 6, 10 ] 10275 2.205% 99.065% ( 10, 15 ] 1696 0.364% 99.429% ( 15, 22 ] 206 0.044% 99.473% ( 22, 34 ] 15 0.003% 99.477% ( 34, 51 ] 26 0.006% 99.482% ( 51, 76 ] 20 0.004% 99.486% ( 76, 110 ] 60 0.013% 99.499% ( 110, 170 ] 260 0.056% 99.555% ( 170, 250 ] 379 0.081% 99.636% ( 250, 380 ] 449 0.096% 99.733% ( 380, 580 ] 605 0.130% 99.863% ( 580, 870 ] 526 0.113% 99.976% ( 870, 1300 ] 297 0.064% 100.039% ( 1300, 1900 ] 139 0.030% 100.069% ( 1900, 2900 ] 140 0.030% 100.099% ( 2900, 4400 ] 157 0.034% 100.133% ( 4400, 6600 ] 44 0.009% 100.142% ( 6600, 9900 ] 13 0.003% 100.145% ** Level 4 read latency histogram (micros): Count: 4333 Average: 19.5779 StdDev: 211.77 Min: 0 Median: 2.0696 Max: 5207 Percentiles: P50: 2.07 P75: 3.22 P99: 318.16 P99.9: 4693.48 P99.99: 5207.00 ------------------------------------------------------ [ 0, 1 ] 109 2.516% 2.516% # ( 1, 2 ] 1985 45.811% 48.327% ######### ( 2, 3 ] 1042 24.048% 72.375% ##### ( 3, 4 ] 524 12.093% 84.468% ## ( 4, 6 ] 446 10.293% 94.761% ## ( 6, 10 ] 130 3.000% 97.761% # ( 10, 15 ] 16 0.369% 98.131% ( 15, 22 ] 3 0.069% 98.200% ( 22, 34 ] 1 0.023% 98.223% ( 34, 51 ] 1 0.023% 98.246% ( 110, 170 ] 4 0.092% 98.338% ( 170, 250 ] 25 0.577% 98.915% ( 250, 380 ] 7 0.162% 99.077% ( 380, 580 ] 10 0.231% 99.308% ( 580, 870 ] 7 0.162% 99.469% ( 870, 1300 ] 9 0.208% 99.677% ( 1300, 1900 ] 6 0.138% 99.815% ( 2900, 4400 ] 3 0.069% 99.885% ( 4400, 6600 ] 5 0.115% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1078.2600 StdDev: 1243.70 Min: 83 Median: 553.9130 Max: 6864 Percentiles: P50: 553.91 P75: 1521.05 P99: 6050.00 P99.9: 6864.00 P99.99: 6864.00 ------------------------------------------------------ ( 76, 110 ] 17 8.500% 8.500% ## ( 110, 170 ] 33 16.500% 25.000% ### ( 170, 250 ] 13 6.500% 31.500% # ( 250, 380 ] 17 8.500% 40.000% ## ( 380, 580 ] 23 11.500% 51.500% ## ( 580, 870 ] 15 7.500% 59.000% ## ( 870, 1300 ] 25 12.500% 71.500% ### ( 1300, 1900 ] 19 9.500% 81.000% ## ( 1900, 2900 ] 16 8.000% 89.000% ## ( 2900, 4400 ] 17 8.500% 97.500% ## ( 4400, 6600 ] 4 2.000% 99.500% ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 36.5 total, 3.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 188.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.130 H:M:S, 46.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 272.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.812 H:M:S, 22.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-06:57:53 ... thread 0: (1000000,8000000) ops and (329165.2,203478.4) ops/second in (3.037988,39.316215) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/7 3.44 GB 201.4 6.9 0.0 6.9 14.4 7.6 0.0 1.9 136.3 285.7 51.77 47.04 129 0.401 7162K 10K 0.0 0.0 L1 8/8 874.61 MB 0.0 4.5 3.9 0.5 4.4 3.9 0.2 1.1 213.1 210.2 21.48 19.76 3 7.160 4647K 60K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.1 1.5 238.5 238.4 0.81 0.78 2 0.403 195K 78 0.0 0.0 L3 14/0 875.24 MB 0.9 2.6 1.6 1.1 2.6 1.6 1.7 1.7 162.2 161.8 16.70 12.35 8 2.087 2673K 5424 0.0 0.0 L4 157/0 9.64 GB 1.0 1.7 1.3 0.4 1.7 1.3 2.1 1.3 128.3 127.5 13.76 8.35 12 1.147 1698K 8218 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1274/15 103.61 GB 0.0 15.9 6.9 9.0 23.4 14.4 10.4 3.1 155.9 229.2 104.52 88.28 154 0.679 16M 85K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.9 6.9 9.0 23.4 14.4 10.3 3.1 155.9 229.2 104.52 88.28 154 0.679 16M 85K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.9 6.9 9.0 15.8 6.8 0.0 0.0 201.7 200.5 80.82 68.34 47 1.719 16M 85K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 326.9 23.71 19.95 107 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.5 total, 39.3 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.39 GB write, 605.92 MB/s write, 15.92 GB read, 412.23 MB/s read, 104.5 seconds Interval compaction: 23.39 GB write, 609.28 MB/s write, 15.92 GB read, 414.52 MB/s read, 104.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 42, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3175714 Average: 2.8701 StdDev: 24.09 Min: 0 Median: 1.4843 Max: 7652 Percentiles: P50: 1.48 P75: 1.88 P99: 7.14 P99.9: 152.47 P99.99: 347.05 ------------------------------------------------------ [ 0, 1 ] 624578 19.667% 19.667% #### ( 1, 2 ] 1988861 62.627% 82.295% ############# ( 2, 3 ] 324598 10.221% 92.516% ## ( 3, 4 ] 112021 3.527% 96.043% # ( 4, 6 ] 86990 2.739% 98.782% # ( 6, 10 ] 24213 0.762% 99.545% ( 10, 15 ] 3390 0.107% 99.652% ( 15, 22 ] 456 0.014% 99.666% ( 22, 34 ] 42 0.001% 99.667% ( 34, 51 ] 29 0.001% 99.668% ( 51, 76 ] 51 0.002% 99.670% ( 76, 110 ] 4293 0.135% 99.805% ( 110, 170 ] 4261 0.134% 99.939% ( 170, 250 ] 1064 0.034% 99.973% ( 250, 380 ] 736 0.023% 99.996% ( 380, 580 ] 590 0.019% 100.014% ( 580, 870 ] 249 0.008% 100.022% ( 870, 1300 ] 96 0.003% 100.025% ( 1300, 1900 ] 41 0.001% 100.027% ( 1900, 2900 ] 63 0.002% 100.029% ( 2900, 4400 ] 45 0.001% 100.030% ( 4400, 6600 ] 3 0.000% 100.030% ( 6600, 9900 ] 3 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 885226 Average: 4.7284 StdDev: 73.39 Min: 1 Median: 1.7586 Max: 13724 Percentiles: P50: 1.76 P75: 2.57 P99: 8.91 P99.9: 94.13 P99.99: 186.52 ------------------------------------------------------ [ 0, 1 ] 58767 6.639% 6.639% # ( 1, 2 ] 505968 57.157% 63.796% ########### ( 2, 3 ] 173844 19.638% 83.434% #### ( 3, 4 ] 64370 7.272% 90.706% # ( 4, 6 ] 61229 6.917% 97.622% # ( 6, 10 ] 16781 1.896% 99.518% ( 10, 15 ] 2786 0.315% 99.833% ( 15, 22 ] 333 0.038% 99.870% ( 22, 34 ] 25 0.003% 99.873% ( 34, 51 ] 9 0.001% 99.874% ( 51, 76 ] 23 0.003% 99.877% ( 76, 110 ] 386 0.044% 99.920% ( 110, 170 ] 576 0.065% 99.985% ( 170, 250 ] 196 0.022% 100.008% ( 250, 380 ] 240 0.027% 100.035% ( 380, 580 ] 278 0.031% 100.066% ( 580, 870 ] 235 0.027% 100.093% ( 870, 1300 ] 158 0.018% 100.110% ( 1300, 1900 ] 84 0.009% 100.120% ( 1900, 2900 ] 125 0.014% 100.134% ( 2900, 4400 ] 116 0.013% 100.147% ( 4400, 6600 ] 48 0.005% 100.153% ( 6600, 9900 ] 8 0.001% 100.154% ( 9900, 14000 ] 1 0.000% 100.154% ** Level 2 read latency histogram (micros): Count: 77111 Average: 5.0301 StdDev: 93.69 Min: 0 Median: 1.6213 Max: 9325 Percentiles: P50: 1.62 P75: 2.00 P99: 8.38 P99.9: 494.62 P99.99: 4328.89 ------------------------------------------------------ [ 0, 1 ] 6728 8.725% 8.725% ## ( 1, 2 ] 51227 66.433% 75.158% ############# ( 2, 3 ] 11051 14.331% 89.489% ### ( 3, 4 ] 4059 5.264% 94.753% # ( 4, 6 ] 2667 3.459% 98.212% # ( 6, 10 ] 1021 1.324% 99.536% ( 10, 15 ] 120 0.156% 99.691% ( 15, 22 ] 13 0.017% 99.708% ( 22, 34 ] 3 0.004% 99.712% ( 51, 76 ] 1 0.001% 99.713% ( 76, 110 ] 44 0.057% 99.770% ( 110, 170 ] 33 0.043% 99.813% ( 170, 250 ] 27 0.035% 99.848% ( 250, 380 ] 29 0.038% 99.886% ( 380, 580 ] 19 0.025% 99.911% ( 580, 870 ] 12 0.016% 99.926% ( 870, 1300 ] 11 0.014% 99.940% ( 1300, 1900 ] 8 0.010% 99.951% ( 1900, 2900 ] 16 0.021% 99.971% ( 2900, 4400 ] 15 0.019% 99.991% ( 4400, 6600 ] 2 0.003% 99.994% ( 6600, 9900 ] 5 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 465975 Average: 8.5589 StdDev: 111.67 Min: 0 Median: 1.9039 Max: 9273 Percentiles: P50: 1.90 P75: 2.86 P99: 9.88 P99.9: 675.95 P99.99: 967.59 ------------------------------------------------------ [ 0, 1 ] 11742 2.520% 2.520% # ( 1, 2 ] 244778 52.530% 55.050% ########### ( 2, 3 ] 107657 23.104% 78.154% ##### ( 3, 4 ] 47251 10.140% 88.294% ## ( 4, 6 ] 39916 8.566% 96.860% ## ( 6, 10 ] 10275 2.205% 99.065% ( 10, 15 ] 1696 0.364% 99.429% ( 15, 22 ] 206 0.044% 99.473% ( 22, 34 ] 15 0.003% 99.477% ( 34, 51 ] 26 0.006% 99.482% ( 51, 76 ] 20 0.004% 99.486% ( 76, 110 ] 60 0.013% 99.499% ( 110, 170 ] 260 0.056% 99.555% ( 170, 250 ] 379 0.081% 99.636% ( 250, 380 ] 449 0.096% 99.733% ( 380, 580 ] 605 0.130% 99.863% ( 580, 870 ] 526 0.113% 99.976% ( 870, 1300 ] 297 0.064% 100.039% ( 1300, 1900 ] 139 0.030% 100.069% ( 1900, 2900 ] 140 0.030% 100.099% ( 2900, 4400 ] 157 0.034% 100.133% ( 4400, 6600 ] 44 0.009% 100.142% ( 6600, 9900 ] 13 0.003% 100.145% ** Level 4 read latency histogram (micros): Count: 4333 Average: 19.5779 StdDev: 211.77 Min: 0 Median: 2.0696 Max: 5207 Percentiles: P50: 2.07 P75: 3.22 P99: 318.16 P99.9: 4693.48 P99.99: 5207.00 ------------------------------------------------------ [ 0, 1 ] 109 2.516% 2.516% # ( 1, 2 ] 1985 45.811% 48.327% ######### ( 2, 3 ] 1042 24.048% 72.375% ##### ( 3, 4 ] 524 12.093% 84.468% ## ( 4, 6 ] 446 10.293% 94.761% ## ( 6, 10 ] 130 3.000% 97.761% # ( 10, 15 ] 16 0.369% 98.131% ( 15, 22 ] 3 0.069% 98.200% ( 22, 34 ] 1 0.023% 98.223% ( 34, 51 ] 1 0.023% 98.246% ( 110, 170 ] 4 0.092% 98.338% ( 170, 250 ] 25 0.577% 98.915% ( 250, 380 ] 7 0.162% 99.077% ( 380, 580 ] 10 0.231% 99.308% ( 580, 870 ] 7 0.162% 99.469% ( 870, 1300 ] 9 0.208% 99.677% ( 1300, 1900 ] 6 0.138% 99.815% ( 2900, 4400 ] 3 0.069% 99.885% ( 4400, 6600 ] 5 0.115% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1078.2600 StdDev: 1243.70 Min: 83 Median: 553.9130 Max: 6864 Percentiles: P50: 553.91 P75: 1521.05 P99: 6050.00 P99.9: 6864.00 P99.99: 6864.00 ------------------------------------------------------ ( 76, 110 ] 17 8.500% 8.500% ## ( 110, 170 ] 33 16.500% 25.000% ### ( 170, 250 ] 13 6.500% 31.500% # ( 250, 380 ] 17 8.500% 40.000% ## ( 380, 580 ] 23 11.500% 51.500% ## ( 580, 870 ] 15 7.500% 59.000% ## ( 870, 1300 ] 25 12.500% 71.500% ### ( 1300, 1900 ] 19 9.500% 81.000% ## ( 1900, 2900 ] 16 8.000% 89.000% ## ( 2900, 4400 ] 17 8.500% 97.500% ## ( 4400, 6600 ] 4 2.000% 99.500% ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 39.5 total, 3.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 199.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.543 H:M:S, 44.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.413 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-06:57:56 ... thread 0: (1000000,9000000) ops and (328114.8,212444.9) ops/second in (3.047714,42.363929) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/4 3.20 GB 295.7 7.8 0.0 7.8 16.2 8.5 0.0 1.9 136.8 286.5 58.00 52.90 145 0.400 8058K 11K 0.0 0.0 L1 30/0 2.01 GB 205.4 6.5 5.1 1.4 6.4 5.0 0.2 1.3 206.5 204.2 32.17 29.00 4 8.043 5857K 60K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.1 1.5 238.5 238.4 0.81 0.78 2 0.403 195K 78 0.0 0.0 L3 14/0 875.24 MB 0.9 2.6 1.6 1.1 2.6 1.6 1.7 1.7 162.2 161.8 16.70 12.35 8 2.087 2673K 5424 0.0 0.0 L4 157/0 9.64 GB 1.0 1.7 1.3 0.4 1.7 1.3 2.1 1.3 128.3 127.5 13.76 8.35 12 1.147 1698K 8218 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/4 104.52 GB 0.0 18.8 8.1 10.7 27.2 16.5 10.4 3.2 158.5 229.2 121.44 103.38 171 0.710 18M 86K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.8 8.1 10.7 27.2 16.5 10.3 3.2 158.5 229.2 121.44 103.38 171 0.710 18M 86K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.8 8.1 10.7 18.7 8.0 0.0 0.0 202.6 201.5 95.01 80.99 51 1.863 18M 86K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 328.9 26.43 22.39 120 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.6 total, 42.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.18 GB write, 653.66 MB/s write, 18.79 GB read, 451.95 MB/s read, 121.4 seconds Interval compaction: 27.18 GB write, 657.03 MB/s write, 18.79 GB read, 454.28 MB/s read, 121.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 45, interval: 57 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3435075 Average: 2.8162 StdDev: 23.32 Min: 0 Median: 1.4819 Max: 7652 Percentiles: P50: 1.48 P75: 1.88 P99: 6.89 P99.9: 148.69 P99.99: 334.49 ------------------------------------------------------ [ 0, 1 ] 678911 19.764% 19.764% #### ( 1, 2 ] 2155378 62.746% 82.510% ############# ( 2, 3 ] 349281 10.168% 92.678% ## ( 3, 4 ] 120177 3.499% 96.177% # ( 4, 6 ] 91351 2.659% 98.836% # ( 6, 10 ] 25233 0.735% 99.571% ( 10, 15 ] 3641 0.106% 99.677% ( 15, 22 ] 487 0.014% 99.691% ( 22, 34 ] 43 0.001% 99.692% ( 34, 51 ] 32 0.001% 99.693% ( 51, 76 ] 51 0.001% 99.695% ( 76, 110 ] 4293 0.125% 99.820% ( 110, 170 ] 4285 0.125% 99.944% ( 170, 250 ] 1084 0.032% 99.976% ( 250, 380 ] 747 0.022% 99.998% ( 380, 580 ] 599 0.017% 100.015% ( 580, 870 ] 255 0.007% 100.023% ( 870, 1300 ] 104 0.003% 100.026% ( 1300, 1900 ] 42 0.001% 100.027% ( 1900, 2900 ] 64 0.002% 100.029% ( 2900, 4400 ] 45 0.001% 100.030% ( 4400, 6600 ] 3 0.000% 100.030% ( 6600, 9900 ] 3 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 948413 Average: 4.6633 StdDev: 71.39 Min: 1 Median: 1.7494 Max: 13724 Percentiles: P50: 1.75 P75: 2.54 P99: 8.92 P99.9: 109.43 P99.99: 226.51 ------------------------------------------------------ [ 0, 1 ] 63512 6.697% 6.697% # ( 1, 2 ] 548028 57.784% 64.480% ############ ( 2, 3 ] 184375 19.440% 83.921% #### ( 3, 4 ] 66892 7.053% 90.974% # ( 4, 6 ] 63079 6.651% 97.625% # ( 6, 10 ] 17869 1.884% 99.509% ( 10, 15 ] 2878 0.303% 99.812% ( 15, 22 ] 340 0.036% 99.848% ( 22, 34 ] 25 0.003% 99.851% ( 34, 51 ] 11 0.001% 99.852% ( 51, 76 ] 24 0.003% 99.854% ( 76, 110 ] 439 0.046% 99.901% ( 110, 170 ] 683 0.072% 99.973% ( 170, 250 ] 231 0.024% 99.997% ( 250, 380 ] 275 0.029% 100.026% ( 380, 580 ] 301 0.032% 100.058% ( 580, 870 ] 244 0.026% 100.084% ( 870, 1300 ] 179 0.019% 100.102% ( 1300, 1900 ] 88 0.009% 100.112% ( 1900, 2900 ] 125 0.013% 100.125% ( 2900, 4400 ] 118 0.012% 100.137% ( 4400, 6600 ] 48 0.005% 100.142% ( 6600, 9900 ] 8 0.001% 100.143% ( 9900, 14000 ] 1 0.000% 100.143% ** Level 2 read latency histogram (micros): Count: 77111 Average: 5.0301 StdDev: 93.69 Min: 0 Median: 1.6213 Max: 9325 Percentiles: P50: 1.62 P75: 2.00 P99: 8.38 P99.9: 494.62 P99.99: 4328.89 ------------------------------------------------------ [ 0, 1 ] 6728 8.725% 8.725% ## ( 1, 2 ] 51227 66.433% 75.158% ############# ( 2, 3 ] 11051 14.331% 89.489% ### ( 3, 4 ] 4059 5.264% 94.753% # ( 4, 6 ] 2667 3.459% 98.212% # ( 6, 10 ] 1021 1.324% 99.536% ( 10, 15 ] 120 0.156% 99.691% ( 15, 22 ] 13 0.017% 99.708% ( 22, 34 ] 3 0.004% 99.712% ( 51, 76 ] 1 0.001% 99.713% ( 76, 110 ] 44 0.057% 99.770% ( 110, 170 ] 33 0.043% 99.813% ( 170, 250 ] 27 0.035% 99.848% ( 250, 380 ] 29 0.038% 99.886% ( 380, 580 ] 19 0.025% 99.911% ( 580, 870 ] 12 0.016% 99.926% ( 870, 1300 ] 11 0.014% 99.940% ( 1300, 1900 ] 8 0.010% 99.951% ( 1900, 2900 ] 16 0.021% 99.971% ( 2900, 4400 ] 15 0.019% 99.991% ( 4400, 6600 ] 2 0.003% 99.994% ( 6600, 9900 ] 5 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 465975 Average: 8.5589 StdDev: 111.67 Min: 0 Median: 1.9039 Max: 9273 Percentiles: P50: 1.90 P75: 2.86 P99: 9.88 P99.9: 675.95 P99.99: 967.59 ------------------------------------------------------ [ 0, 1 ] 11742 2.520% 2.520% # ( 1, 2 ] 244778 52.530% 55.050% ########### ( 2, 3 ] 107657 23.104% 78.154% ##### ( 3, 4 ] 47251 10.140% 88.294% ## ( 4, 6 ] 39916 8.566% 96.860% ## ( 6, 10 ] 10275 2.205% 99.065% ( 10, 15 ] 1696 0.364% 99.429% ( 15, 22 ] 206 0.044% 99.473% ( 22, 34 ] 15 0.003% 99.477% ( 34, 51 ] 26 0.006% 99.482% ( 51, 76 ] 20 0.004% 99.486% ( 76, 110 ] 60 0.013% 99.499% ( 110, 170 ] 260 0.056% 99.555% ( 170, 250 ] 379 0.081% 99.636% ( 250, 380 ] 449 0.096% 99.733% ( 380, 580 ] 605 0.130% 99.863% ( 580, 870 ] 526 0.113% 99.976% ( 870, 1300 ] 297 0.064% 100.039% ( 1300, 1900 ] 139 0.030% 100.069% ( 1900, 2900 ] 140 0.030% 100.099% ( 2900, 4400 ] 157 0.034% 100.133% ( 4400, 6600 ] 44 0.009% 100.142% ( 6600, 9900 ] 13 0.003% 100.145% ** Level 4 read latency histogram (micros): Count: 4333 Average: 19.5779 StdDev: 211.77 Min: 0 Median: 2.0696 Max: 5207 Percentiles: P50: 2.07 P75: 3.22 P99: 318.16 P99.9: 4693.48 P99.99: 5207.00 ------------------------------------------------------ [ 0, 1 ] 109 2.516% 2.516% # ( 1, 2 ] 1985 45.811% 48.327% ######### ( 2, 3 ] 1042 24.048% 72.375% ##### ( 3, 4 ] 524 12.093% 84.468% ## ( 4, 6 ] 446 10.293% 94.761% ## ( 6, 10 ] 130 3.000% 97.761% # ( 10, 15 ] 16 0.369% 98.131% ( 15, 22 ] 3 0.069% 98.200% ( 22, 34 ] 1 0.023% 98.223% ( 34, 51 ] 1 0.023% 98.246% ( 110, 170 ] 4 0.092% 98.338% ( 170, 250 ] 25 0.577% 98.915% ( 250, 380 ] 7 0.162% 99.077% ( 380, 580 ] 10 0.231% 99.308% ( 580, 870 ] 7 0.162% 99.469% ( 870, 1300 ] 9 0.208% 99.677% ( 1300, 1900 ] 6 0.138% 99.815% ( 2900, 4400 ] 3 0.069% 99.885% ( 4400, 6600 ] 5 0.115% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1078.2600 StdDev: 1243.70 Min: 83 Median: 553.9130 Max: 6864 Percentiles: P50: 553.91 P75: 1521.05 P99: 6050.00 P99.9: 6864.00 P99.99: 6864.00 ------------------------------------------------------ ( 76, 110 ] 17 8.500% 8.500% ## ( 110, 170 ] 33 16.500% 25.000% ### ( 170, 250 ] 13 6.500% 31.500% # ( 250, 380 ] 17 8.500% 40.000% ## ( 380, 580 ] 23 11.500% 51.500% ## ( 580, 870 ] 15 7.500% 59.000% ## ( 870, 1300 ] 25 12.500% 71.500% ### ( 1300, 1900 ] 19 9.500% 81.000% ## ( 1900, 2900 ] 16 8.000% 89.000% ## ( 2900, 4400 ] 17 8.500% 97.500% ## ( 4400, 6600 ] 4 2.000% 99.500% ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 42.6 total, 3.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 208.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.969 H:M:S, 42.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.426 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.149 micros/op 162640 ops/sec 60.047 seconds 9765999 operations; 157.6 MB/s Microseconds per write: Count: 9765999 Average: 6.1485 StdDev: 426.76 Min: 0 Median: 1.7299 Max: 899130 Percentiles: P50: 1.73 P75: 2.75 P99: 9.81 P99.9: 1170.85 P99.99: 2700.43 ------------------------------------------------------ [ 0, 1 ] 1348080 13.804% 13.804% ### ( 1, 2 ] 4842849 49.589% 63.393% ########## ( 2, 3 ] 1508508 15.447% 78.839% ### ( 3, 4 ] 1320632 13.523% 92.362% ### ( 4, 6 ] 520430 5.329% 97.691% # ( 6, 10 ] 134208 1.374% 99.065% ( 10, 15 ] 47189 0.483% 99.548% ( 15, 22 ] 10358 0.106% 99.654% ( 22, 34 ] 1956 0.020% 99.674% ( 34, 51 ] 256 0.003% 99.677% ( 51, 76 ] 22 0.000% 99.677% ( 76, 110 ] 6632 0.068% 99.745% ( 110, 170 ] 2671 0.027% 99.773% ( 170, 250 ] 341 0.003% 99.776% ( 250, 380 ] 218 0.002% 99.778% ( 380, 580 ] 17 0.000% 99.778% ( 580, 870 ] 16 0.000% 99.779% ( 870, 1300 ] 16937 0.173% 99.952% ( 1300, 1900 ] 22 0.000% 99.952% ( 1900, 2900 ] 4598 0.047% 99.999% ( 2900, 4400 ] 27 0.000% 100.000% ( 4400, 6600 ] 4 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 170000, 250000 ] 18 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 187950 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9765999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10078510968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 420 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32967384 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 24937399623 rocksdb.compact.write.bytes COUNT : 24759082435 rocksdb.flush.write.bytes COUNT : 10040611647 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 47 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 236 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9959773184 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3969024 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 25026287995 rocksdb.non.last.level.read.count COUNT : 6044810 rocksdb.block.checksum.compute.count COUNT : 6044017 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.381095 P95 : 3.950846 P99 : 8.510646 P100 : 899128.000000 COUNT : 9765999 SUM : 55480755 rocksdb.compaction.times.micros P50 : 1164583.333333 P95 : 5675000.000000 P99 : 16900268.000000 P100 : 16900268.000000 COUNT : 55 SUM : 99383925 rocksdb.compaction.times.cpu_micros P50 : 1037083.333333 P95 : 3950000.000000 P99 : 15308675.000000 P100 : 15308675.000000 COUNT : 55 SUM : 85295449 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 680.533333 P95 : 1242.666667 P99 : 19440.000000 P100 : 148734.000000 COUNT : 132 SUM : 261669 rocksdb.compaction.outfile.sync.micros P50 : 854.362745 P95 : 133800.000000 P99 : 197800.000000 P100 : 210393.000000 COUNT : 261 SUM : 3898308 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 100.846154 P95 : 432.500000 P99 : 2852.500000 P100 : 4722.000000 COUNT : 219 SUM : 46975 rocksdb.table.open.io.micros P50 : 1463.636364 P95 : 7700.000000 P99 : 12360.000000 P100 : 15565.000000 COUNT : 420 SUM : 912454 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.574396 P95 : 7.126793 P99 : 10.430394 P100 : 13730.000000 COUNT : 6042710 SUM : 33561889 rocksdb.read.block.get.micros P50 : 466.868687 P95 : 3542.857143 P99 : 5347.692308 P100 : 6943.000000 COUNT : 840 SUM : 735183 rocksdb.write.raw.block.micros P50 : 0.512945 P95 : 0.974596 P99 : 2.838187 P100 : 13145.000000 COUNT : 8427968 SUM : 16312975 rocksdb.numfiles.in.singlecompaction P50 : 3.416667 P95 : 6.000000 P99 : 22.000000 P100 : 45.000000 COUNT : 100 SUM : 431 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566090 P95 : 1181.843247 P99 : 2501.928945 P100 : 898953.000000 COUNT : 185535 SUM : 32988311 rocksdb.sst.read.micros P50 : 1.510934 P95 : 3.986581 P99 : 7.990141 P100 : 13724.000000 COUNT : 6044810 SUM : 21152388 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9765999 SUM : 10078510968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215000.000000 P95 : 375666.666667 P99 : 767200.000000 P100 : 1077068.000000 COUNT : 132 SUM : 28926123 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 252 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0