[2024-12-07 08:19:30.917985] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-12-07 08:19:30.918090] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid449618 ] Set seed to 1733555970915274 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-07 08:19:31.004294] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-07 08:19:31.044543] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-07 08:19:31.044586] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 449618' to capture a snapshot of events at runtime. [2024-12-07 08:19:31.044598] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid449618 for offline analysis/debug. [2024-12-07 08:19:31.044625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 7 08:19:35 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/07-08:19:38 ... thread 0: (1000000,1000000) ops and (348978.3,348978.3) ops/second in (2.865508,2.865508) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.04 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 349.2 2.35 2.10 12 0.195 0 0 0.0 0.0 L2 3/2 251.74 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 248.7 248.6 1.52 1.47 2 0.760 383K 214 0.0 0.0 L3 10/0 804.42 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 97.8 309.7 3.86 3.57 14 0.276 383K 214 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 97.8 309.7 3.86 3.57 14 0.276 383K 214 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 248.7 248.6 1.52 1.47 2 0.760 383K 214 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 349.2 2.35 2.10 12 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 386.91 MB/s write, 0.37 GB read, 122.19 MB/s read, 3.9 seconds Interval compaction: 1.17 GB write, 417.36 MB/s write, 0.37 GB read, 131.81 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 104071 Average: 1.9127 StdDev: 18.43 Min: 1 Median: 1.2362 Max: 3189 Percentiles: P50: 1.24 P75: 1.67 P99: 4.01 P99.9: 9.79 P99.99: 319.03 ------------------------------------------------------ [ 0, 1 ] 37755 36.278% 36.278% ####### ( 1, 2 ] 60466 58.101% 94.379% ############ ( 2, 3 ] 3429 3.295% 97.674% # ( 3, 4 ] 1378 1.324% 98.998% ( 4, 6 ] 722 0.694% 99.692% ( 6, 10 ] 229 0.220% 99.912% ( 10, 15 ] 60 0.058% 99.969% ( 15, 22 ] 6 0.006% 99.975% ( 22, 34 ] 1 0.001% 99.976% ( 51, 76 ] 1 0.001% 99.977% ( 110, 170 ] 5 0.005% 99.982% ( 170, 250 ] 7 0.007% 99.988% ( 250, 380 ] 3 0.003% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1900, 2900 ] 2 0.002% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 53642 Average: 2.1575 StdDev: 25.81 Min: 1 Median: 1.2932 Max: 3506 Percentiles: P50: 1.29 P75: 1.71 P99: 5.29 P99.9: 11.29 P99.99: 843.60 ------------------------------------------------------ [ 0, 1 ] 17354 32.352% 32.352% ###### ( 1, 2 ] 32293 60.201% 92.552% ############ ( 2, 3 ] 2054 3.829% 96.382% # ( 3, 4 ] 1013 1.888% 98.270% ( 4, 6 ] 609 1.135% 99.405% ( 6, 10 ] 256 0.477% 99.883% ( 10, 15 ] 40 0.075% 99.957% ( 15, 22 ] 4 0.007% 99.965% ( 22, 34 ] 3 0.006% 99.970% ( 51, 76 ] 1 0.002% 99.972% ( 170, 250 ] 1 0.002% 99.974% ( 380, 580 ] 6 0.011% 99.985% ( 580, 870 ] 4 0.007% 99.993% ( 870, 1300 ] 2 0.004% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 40 Average: 1621.1000 StdDev: 1538.30 Min: 70 Median: 812.0000 Max: 5870 Percentiles: P50: 812.00 P75: 2300.00 P99: 5870.00 P99.9: 5870.00 P99.99: 5870.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 110, 170 ] 2 5.000% 7.500% # ( 170, 250 ] 2 5.000% 12.500% # ( 250, 380 ] 1 2.500% 15.000% # ( 380, 580 ] 6 15.000% 30.000% ### ( 580, 870 ] 10 25.000% 55.000% ##### ( 1300, 1900 ] 6 15.000% 70.000% ### ( 1900, 2900 ] 5 12.500% 82.500% ### ( 2900, 4400 ] 3 7.500% 90.000% ## ( 4400, 6600 ] 4 10.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 30 Average: 1675.2000 StdDev: 1581.27 Min: 275 Median: 1042.0000 Max: 5796 Percentiles: P50: 1042.00 P75: 2275.00 P99: 5796.00 P99.9: 5796.00 P99.99: 5796.00 ------------------------------------------------------ ( 250, 380 ] 5 16.667% 16.667% ### ( 380, 580 ] 3 10.000% 26.667% ## ( 580, 870 ] 5 16.667% 43.333% ### ( 870, 1300 ] 5 16.667% 60.000% ### ( 1300, 1900 ] 3 10.000% 70.000% ## ( 1900, 2900 ] 4 13.333% 83.333% ### ( 2900, 4400 ] 1 3.333% 86.667% # ( 4400, 6600 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 318.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.209 H:M:S, 6.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 343.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.209 H:M:S, 7.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/07-08:19:41 ... thread 0: (1000000,2000000) ops and (320723.6,334254.9) ops/second in (3.117950,5.983458) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/7 1.17 GB 50.4 0.5 0.0 0.5 2.3 1.8 0.0 1.3 70.9 327.8 7.11 6.50 28 0.254 511K 480 0.0 0.0 L1 5/5 377.34 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.2 236.8 1.59 1.54 1 1.594 383K 639 0.0 0.0 L2 1/0 2.06 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 248.7 248.6 1.52 1.47 2 0.760 383K 214 0.0 0.0 L3 17/0 829.46 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.1 1.0 232.1 232.1 1.08 1.01 1 1.076 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 143.2 143.2 1.57 1.12 1 1.569 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/12 97.92 GB 0.0 1.7 1.0 0.7 3.5 2.8 0.4 1.9 134.8 276.7 12.87 11.64 33 0.390 1760K 1333 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 1.0 0.7 3.5 2.8 0.3 1.9 134.8 276.7 12.87 11.64 33 0.390 1760K 1333 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 1.0 0.7 1.7 1.0 0.0 0.0 226.5 226.3 7.66 7.01 7 1.094 1760K 1333 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.7 5.21 4.63 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.48 GB write, 573.16 MB/s write, 1.69 GB read, 279.24 MB/s read, 12.9 seconds Interval compaction: 3.48 GB write, 594.77 MB/s write, 1.69 GB read, 289.77 MB/s read, 12.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 353110 Average: 2.1188 StdDev: 18.17 Min: 1 Median: 1.4229 Max: 8070 Percentiles: P50: 1.42 P75: 1.81 P99: 5.40 P99.9: 9.91 P99.99: 16.56 ------------------------------------------------------ [ 0, 1 ] 81079 22.961% 22.961% ##### ( 1, 2 ] 225785 63.942% 86.903% ############# ( 2, 3 ] 26847 7.603% 94.506% ## ( 3, 4 ] 11377 3.222% 97.728% # ( 4, 6 ] 6435 1.822% 99.551% ( 6, 10 ] 1263 0.358% 99.908% ( 10, 15 ] 285 0.081% 99.989% ( 15, 22 ] 21 0.006% 99.995% ( 22, 34 ] 5 0.001% 99.996% ( 34, 51 ] 2 0.001% 99.997% ( 51, 76 ] 1 0.000% 99.997% ( 110, 170 ] 10 0.003% 100.000% ( 170, 250 ] 13 0.004% 100.004% ( 250, 380 ] 12 0.003% 100.007% ( 380, 580 ] 2 0.001% 100.008% ( 580, 870 ] 7 0.002% 100.010% ( 870, 1300 ] 3 0.001% 100.010% ( 1300, 1900 ] 3 0.001% 100.011% ( 1900, 2900 ] 3 0.001% 100.012% ( 2900, 4400 ] 2 0.001% 100.013% ( 6600, 9900 ] 1 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 35601 Average: 2.1943 StdDev: 14.67 Min: 1 Median: 1.4653 Max: 2380 Percentiles: P50: 1.47 P75: 1.84 P99: 5.31 P99.9: 9.68 P99.99: 475.99 ------------------------------------------------------ [ 0, 1 ] 6617 18.587% 18.587% #### ( 1, 2 ] 24036 67.515% 86.102% ############## ( 2, 3 ] 3202 8.994% 95.096% ## ( 3, 4 ] 1007 2.829% 97.924% # ( 4, 6 ] 583 1.638% 99.562% ( 6, 10 ] 131 0.368% 99.930% ( 10, 15 ] 14 0.039% 99.969% ( 15, 22 ] 3 0.008% 99.978% ( 110, 170 ] 1 0.003% 99.980% ( 170, 250 ] 1 0.003% 99.983% ( 250, 380 ] 1 0.003% 99.986% ( 380, 580 ] 3 0.008% 99.994% ( 870, 1300 ] 1 0.003% 99.997% ( 1900, 2900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 95399 Average: 2.2052 StdDev: 19.37 Min: 1 Median: 1.4191 Max: 3506 Percentiles: P50: 1.42 P75: 1.82 P99: 5.70 P99.9: 11.23 P99.99: 562.00 ------------------------------------------------------ [ 0, 1 ] 22480 23.564% 23.564% ##### ( 1, 2 ] 60172 63.074% 86.638% ############# ( 2, 3 ] 6633 6.953% 93.591% # ( 3, 4 ] 3258 3.415% 97.006% # ( 4, 6 ] 2235 2.343% 99.349% ( 6, 10 ] 504 0.528% 99.877% ( 10, 15 ] 88 0.092% 99.970% ( 15, 22 ] 8 0.008% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 380, 580 ] 6 0.006% 99.991% ( 580, 870 ] 4 0.004% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57114 Average: 3.4102 StdDev: 59.54 Min: 1 Median: 1.5615 Max: 5870 Percentiles: P50: 1.56 P75: 1.94 P99: 5.91 P99.9: 14.86 P99.99: 3544.30 ------------------------------------------------------ [ 0, 1 ] 7553 13.224% 13.224% ### ( 1, 2 ] 37407 65.495% 78.720% ############# ( 2, 3 ] 8270 14.480% 93.200% ### ( 3, 4 ] 1758 3.078% 96.278% # ( 4, 6 ] 1624 2.843% 99.121% # ( 6, 10 ] 370 0.648% 99.769% ( 10, 15 ] 77 0.135% 99.904% ( 15, 22 ] 7 0.012% 99.916% ( 22, 34 ] 2 0.004% 99.919% ( 34, 51 ] 1 0.002% 99.921% ( 51, 76 ] 2 0.004% 99.925% ( 110, 170 ] 2 0.004% 99.928% ( 170, 250 ] 2 0.004% 99.932% ( 250, 380 ] 2 0.004% 99.935% ( 380, 580 ] 7 0.012% 99.947% ( 580, 870 ] 10 0.018% 99.965% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 7 0.012% 99.979% ( 1900, 2900 ] 5 0.009% 99.988% ( 2900, 4400 ] 3 0.005% 99.993% ( 4400, 6600 ] 4 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 165.6594 StdDev: 686.55 Min: 1 Median: 2.5263 Max: 5796 Percentiles: P50: 2.53 P75: 11.17 P99: 4840.00 P99.9: 5796.00 P99.99: 5796.00 ------------------------------------------------------ [ 0, 1 ] 40 12.500% 12.500% ### ( 1, 2 ] 90 28.125% 40.625% ###### ( 2, 3 ] 57 17.812% 58.438% #### ( 3, 4 ] 22 6.875% 65.312% # ( 4, 6 ] 13 4.062% 69.375% # ( 6, 10 ] 11 3.438% 72.812% # ( 10, 15 ] 30 9.375% 82.188% ## ( 15, 22 ] 15 4.688% 86.875% # ( 22, 34 ] 5 1.562% 88.438% ( 34, 51 ] 3 0.938% 89.375% ( 110, 170 ] 1 0.312% 89.688% ( 250, 380 ] 7 2.188% 91.875% ( 380, 580 ] 4 1.250% 93.125% ( 580, 870 ] 5 1.562% 94.688% ( 870, 1300 ] 5 1.562% 96.250% ( 1300, 1900 ] 3 0.938% 97.188% ( 1900, 2900 ] 4 1.250% 98.438% ( 2900, 4400 ] 1 0.312% 98.750% ( 4400, 6600 ] 4 1.250% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 316.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.598 H:M:S, 9.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.389 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/07-08:19:44 ... thread 0: (1000000,3000000) ops and (343976.5,337433.8) ops/second in (2.907175,8.890633) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 2.09 GB 88.1 1.0 0.0 1.0 3.8 2.7 0.0 1.4 89.9 322.5 11.91 10.98 44 0.271 1087K 1095 0.0 0.0 L1 5/5 377.34 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.2 236.8 1.59 1.54 1 1.594 383K 639 0.0 0.0 L2 1/0 2.06 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 248.7 248.6 1.52 1.47 2 0.760 383K 214 0.0 0.0 L3 17/0 829.46 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.1 1.0 232.1 232.1 1.08 1.01 1 1.076 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 143.2 143.2 1.57 1.12 1 1.569 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/20 98.84 GB 0.0 2.2 1.0 1.2 5.0 3.7 0.4 1.8 130.2 287.0 17.67 16.12 49 0.361 2336K 1948 0.0 0.0 Int 0/0 0.00 KB 0.0 2.2 1.0 1.2 5.0 3.7 0.3 1.8 130.2 287.0 17.67 16.12 49 0.361 2336K 1948 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.2 1.0 1.2 2.2 1.0 0.0 0.0 235.7 235.5 9.76 9.08 9 1.085 2336K 1948 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 350.6 7.91 7.04 40 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.95 GB write, 556.16 MB/s write, 2.25 GB read, 252.39 MB/s read, 17.7 seconds Interval compaction: 4.95 GB write, 570.28 MB/s write, 2.25 GB read, 258.79 MB/s read, 17.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 709229 Average: 2.1403 StdDev: 13.35 Min: 1 Median: 1.4646 Max: 8070 Percentiles: P50: 1.46 P75: 1.84 P99: 5.47 P99.9: 9.85 P99.99: 13.99 ------------------------------------------------------ [ 0, 1 ] 137478 19.384% 19.384% #### ( 1, 2 ] 467382 65.900% 85.284% ############# ( 2, 3 ] 61715 8.702% 93.986% ## ( 3, 4 ] 25005 3.526% 97.512% # ( 4, 6 ] 14352 2.024% 99.535% ( 6, 10 ] 2694 0.380% 99.915% ( 10, 15 ] 670 0.094% 100.009% ( 15, 22 ] 39 0.005% 100.015% ( 22, 34 ] 10 0.001% 100.016% ( 34, 51 ] 5 0.001% 100.017% ( 51, 76 ] 3 0.000% 100.017% ( 76, 110 ] 2 0.000% 100.018% ( 110, 170 ] 14 0.002% 100.020% ( 170, 250 ] 22 0.003% 100.023% ( 250, 380 ] 19 0.003% 100.026% ( 380, 580 ] 4 0.001% 100.026% ( 580, 870 ] 13 0.002% 100.028% ( 870, 1300 ] 7 0.001% 100.029% ( 1300, 1900 ] 3 0.000% 100.029% ( 1900, 2900 ] 3 0.000% 100.030% ( 2900, 4400 ] 2 0.000% 100.030% ( 6600, 9900 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 95713 Average: 2.1701 StdDev: 8.98 Min: 1 Median: 1.5079 Max: 2380 Percentiles: P50: 1.51 P75: 1.87 P99: 5.44 P99.9: 9.40 P99.99: 41.29 ------------------------------------------------------ [ 0, 1 ] 14483 15.132% 15.132% ### ( 1, 2 ] 65712 68.655% 83.787% ############## ( 2, 3 ] 9851 10.292% 94.079% ## ( 3, 4 ] 3301 3.449% 97.528% # ( 4, 6 ] 1955 2.043% 99.571% ( 6, 10 ] 372 0.389% 99.959% ( 10, 15 ] 23 0.024% 99.983% ( 15, 22 ] 6 0.006% 99.990% ( 22, 34 ] 1 0.001% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 110, 170 ] 1 0.001% 99.994% ( 170, 250 ] 1 0.001% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 3 0.003% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 95399 Average: 2.2052 StdDev: 19.37 Min: 1 Median: 1.4191 Max: 3506 Percentiles: P50: 1.42 P75: 1.82 P99: 5.70 P99.9: 11.23 P99.99: 562.00 ------------------------------------------------------ [ 0, 1 ] 22480 23.564% 23.564% ##### ( 1, 2 ] 60172 63.074% 86.638% ############# ( 2, 3 ] 6633 6.953% 93.591% # ( 3, 4 ] 3258 3.415% 97.006% # ( 4, 6 ] 2235 2.343% 99.349% ( 6, 10 ] 504 0.528% 99.877% ( 10, 15 ] 88 0.092% 99.970% ( 15, 22 ] 8 0.008% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 380, 580 ] 6 0.006% 99.991% ( 580, 870 ] 4 0.004% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57114 Average: 3.4102 StdDev: 59.54 Min: 1 Median: 1.5615 Max: 5870 Percentiles: P50: 1.56 P75: 1.94 P99: 5.91 P99.9: 14.86 P99.99: 3544.30 ------------------------------------------------------ [ 0, 1 ] 7553 13.224% 13.224% ### ( 1, 2 ] 37407 65.495% 78.720% ############# ( 2, 3 ] 8270 14.480% 93.200% ### ( 3, 4 ] 1758 3.078% 96.278% # ( 4, 6 ] 1624 2.843% 99.121% # ( 6, 10 ] 370 0.648% 99.769% ( 10, 15 ] 77 0.135% 99.904% ( 15, 22 ] 7 0.012% 99.916% ( 22, 34 ] 2 0.004% 99.919% ( 34, 51 ] 1 0.002% 99.921% ( 51, 76 ] 2 0.004% 99.925% ( 110, 170 ] 2 0.004% 99.928% ( 170, 250 ] 2 0.004% 99.932% ( 250, 380 ] 2 0.004% 99.935% ( 380, 580 ] 7 0.012% 99.947% ( 580, 870 ] 10 0.018% 99.965% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 7 0.012% 99.979% ( 1900, 2900 ] 5 0.009% 99.988% ( 2900, 4400 ] 3 0.005% 99.993% ( 4400, 6600 ] 4 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 165.6594 StdDev: 686.55 Min: 1 Median: 2.5263 Max: 5796 Percentiles: P50: 2.53 P75: 11.17 P99: 4840.00 P99.9: 5796.00 P99.99: 5796.00 ------------------------------------------------------ [ 0, 1 ] 40 12.500% 12.500% ### ( 1, 2 ] 90 28.125% 40.625% ###### ( 2, 3 ] 57 17.812% 58.438% #### ( 3, 4 ] 22 6.875% 65.312% # ( 4, 6 ] 13 4.062% 69.375% # ( 6, 10 ] 11 3.438% 72.812% # ( 10, 15 ] 30 9.375% 82.188% ## ( 15, 22 ] 15 4.688% 86.875% # ( 22, 34 ] 5 1.562% 88.438% ( 34, 51 ] 3 0.938% 89.375% ( 110, 170 ] 1 0.312% 89.688% ( 250, 380 ] 7 2.188% 91.875% ( 380, 580 ] 4 1.250% 93.125% ( 580, 870 ] 5 1.562% 94.688% ( 870, 1300 ] 5 1.562% 96.250% ( 1300, 1900 ] 3 0.938% 97.188% ( 1900, 2900 ] 4 1.250% 98.438% ( 2900, 4400 ] 1 0.312% 98.750% ( 4400, 6600 ] 4 1.250% 100.000% ** DB Stats ** Uptime(secs): 9.1 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.788 H:M:S, 8.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 338.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.190 H:M:S, 6.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/07-08:19:47 ... thread 0: (1000000,4000000) ops and (325036.8,334246.7) ops/second in (3.076575,11.967208) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.46 GB 220.2 2.4 0.0 2.4 6.1 3.8 0.0 1.6 122.3 313.4 20.09 18.72 64 0.314 2494K 2560 0.0 0.0 L1 9/0 1.04 GB 106.5 1.4 1.0 0.4 1.4 1.0 0.2 1.3 232.7 231.8 6.22 6.06 2 3.111 1470K 5421 0.0 0.0 L2 1/0 2.06 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 248.7 248.6 1.52 1.47 2 0.760 383K 214 0.0 0.0 L3 17/0 829.46 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.1 1.0 232.1 232.1 1.08 1.01 1 1.076 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 143.2 143.2 1.57 1.12 1 1.569 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/4 99.88 GB 0.0 4.6 1.7 3.0 8.4 5.4 0.4 2.2 156.1 281.9 30.48 28.38 70 0.435 4830K 8195 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 1.7 3.0 8.4 5.4 0.3 2.2 156.1 281.9 30.48 28.38 70 0.435 4830K 8195 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 1.7 3.0 4.6 1.7 0.0 0.0 242.2 241.8 19.64 18.71 15 1.309 4830K 8195 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 354.5 10.84 9.67 55 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.39 GB write, 704.54 MB/s write, 4.65 GB read, 390.11 MB/s read, 30.5 seconds Interval compaction: 8.39 GB write, 717.82 MB/s write, 4.65 GB read, 397.47 MB/s read, 30.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 10, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 960456 Average: 2.0897 StdDev: 13.63 Min: 0 Median: 1.4255 Max: 8070 Percentiles: P50: 1.43 P75: 1.81 P99: 5.34 P99.9: 9.83 P99.99: 14.35 ------------------------------------------------------ [ 0, 1 ] 215926 22.482% 22.482% #### ( 1, 2 ] 621213 64.679% 87.161% ############# ( 2, 3 ] 73113 7.612% 94.773% ## ( 3, 4 ] 29518 3.073% 97.846% # ( 4, 6 ] 16479 1.716% 99.562% ( 6, 10 ] 3392 0.353% 99.915% ( 10, 15 ] 827 0.086% 100.001% ( 15, 22 ] 66 0.007% 100.008% ( 22, 34 ] 15 0.002% 100.010% ( 34, 51 ] 7 0.001% 100.010% ( 51, 76 ] 5 0.001% 100.011% ( 76, 110 ] 2 0.000% 100.011% ( 110, 170 ] 19 0.002% 100.013% ( 170, 250 ] 31 0.003% 100.016% ( 250, 380 ] 24 0.002% 100.019% ( 380, 580 ] 6 0.001% 100.019% ( 580, 870 ] 19 0.002% 100.021% ( 870, 1300 ] 14 0.001% 100.023% ( 1300, 1900 ] 5 0.001% 100.023% ( 1900, 2900 ] 5 0.001% 100.024% ( 2900, 4400 ] 4 0.000% 100.024% ( 6600, 9900 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 95869 Average: 2.2858 StdDev: 13.23 Min: 1 Median: 1.5079 Max: 2380 Percentiles: P50: 1.51 P75: 1.87 P99: 5.46 P99.9: 9.59 P99.99: 609.95 ------------------------------------------------------ [ 0, 1 ] 14519 15.145% 15.145% ### ( 1, 2 ] 65795 68.630% 83.775% ############## ( 2, 3 ] 9862 10.287% 94.062% ## ( 3, 4 ] 3304 3.446% 97.508% # ( 4, 6 ] 1957 2.041% 99.549% ( 6, 10 ] 374 0.390% 99.940% ( 10, 15 ] 23 0.024% 99.963% ( 15, 22 ] 6 0.006% 99.970% ( 22, 34 ] 1 0.001% 99.971% ( 34, 51 ] 2 0.002% 99.973% ( 51, 76 ] 1 0.001% 99.974% ( 110, 170 ] 2 0.002% 99.976% ( 170, 250 ] 1 0.001% 99.977% ( 250, 380 ] 5 0.005% 99.982% ( 380, 580 ] 7 0.007% 99.990% ( 580, 870 ] 4 0.004% 99.994% ( 870, 1300 ] 5 0.005% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 95399 Average: 2.2052 StdDev: 19.37 Min: 1 Median: 1.4191 Max: 3506 Percentiles: P50: 1.42 P75: 1.82 P99: 5.70 P99.9: 11.23 P99.99: 562.00 ------------------------------------------------------ [ 0, 1 ] 22480 23.564% 23.564% ##### ( 1, 2 ] 60172 63.074% 86.638% ############# ( 2, 3 ] 6633 6.953% 93.591% # ( 3, 4 ] 3258 3.415% 97.006% # ( 4, 6 ] 2235 2.343% 99.349% ( 6, 10 ] 504 0.528% 99.877% ( 10, 15 ] 88 0.092% 99.970% ( 15, 22 ] 8 0.008% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 380, 580 ] 6 0.006% 99.991% ( 580, 870 ] 4 0.004% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57114 Average: 3.4102 StdDev: 59.54 Min: 1 Median: 1.5615 Max: 5870 Percentiles: P50: 1.56 P75: 1.94 P99: 5.91 P99.9: 14.86 P99.99: 3544.30 ------------------------------------------------------ [ 0, 1 ] 7553 13.224% 13.224% ### ( 1, 2 ] 37407 65.495% 78.720% ############# ( 2, 3 ] 8270 14.480% 93.200% ### ( 3, 4 ] 1758 3.078% 96.278% # ( 4, 6 ] 1624 2.843% 99.121% # ( 6, 10 ] 370 0.648% 99.769% ( 10, 15 ] 77 0.135% 99.904% ( 15, 22 ] 7 0.012% 99.916% ( 22, 34 ] 2 0.004% 99.919% ( 34, 51 ] 1 0.002% 99.921% ( 51, 76 ] 2 0.004% 99.925% ( 110, 170 ] 2 0.004% 99.928% ( 170, 250 ] 2 0.004% 99.932% ( 250, 380 ] 2 0.004% 99.935% ( 380, 580 ] 7 0.012% 99.947% ( 580, 870 ] 10 0.018% 99.965% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 7 0.012% 99.979% ( 1900, 2900 ] 5 0.009% 99.988% ( 2900, 4400 ] 3 0.005% 99.993% ( 4400, 6600 ] 4 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 165.6594 StdDev: 686.55 Min: 1 Median: 2.5263 Max: 5796 Percentiles: P50: 2.53 P75: 11.17 P99: 4840.00 P99.9: 5796.00 P99.99: 5796.00 ------------------------------------------------------ [ 0, 1 ] 40 12.500% 12.500% ### ( 1, 2 ] 90 28.125% 40.625% ###### ( 2, 3 ] 57 17.812% 58.438% #### ( 3, 4 ] 22 6.875% 65.312% # ( 4, 6 ] 13 4.062% 69.375% # ( 6, 10 ] 11 3.438% 72.812% # ( 10, 15 ] 30 9.375% 82.188% ## ( 15, 22 ] 15 4.688% 86.875% # ( 22, 34 ] 5 1.562% 88.438% ( 34, 51 ] 3 0.938% 89.375% ( 110, 170 ] 1 0.312% 89.688% ( 250, 380 ] 7 2.188% 91.875% ( 380, 580 ] 4 1.250% 93.125% ( 580, 870 ] 5 1.562% 94.688% ( 870, 1300 ] 5 1.562% 96.250% ( 1300, 1900 ] 3 0.938% 97.188% ( 1900, 2900 ] 4 1.250% 98.438% ( 2900, 4400 ] 1 0.312% 98.750% ( 4400, 6600 ] 4 1.250% 100.000% ** DB Stats ** Uptime(secs): 12.2 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 322.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.166 H:M:S, 9.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.378 H:M:S, 12.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/07-08:19:50 ... thread 0: (1000000,5000000) ops and (346893.6,336701.8) ops/second in (2.882728,14.849936) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/4 3.38 GB 320.9 3.3 0.0 3.3 7.9 4.7 0.0 1.7 128.7 313.2 25.94 24.25 81 0.320 3390K 3554 0.0 0.0 L1 9/0 1.04 GB 106.5 1.4 1.0 0.4 1.4 1.0 0.2 1.3 232.7 231.8 6.22 6.06 2 3.111 1470K 5421 0.0 0.0 L2 1/0 2.06 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 248.7 248.6 1.52 1.47 2 0.760 383K 214 0.0 0.0 L3 17/0 829.46 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.1 1.0 232.1 232.1 1.08 1.01 1 1.076 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 143.2 143.2 1.57 1.12 1 1.569 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/4 100.80 GB 0.0 5.5 1.7 3.8 10.2 6.4 0.4 2.2 155.3 286.8 36.32 33.91 87 0.418 5725K 9189 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.7 3.8 10.2 6.4 0.3 2.2 155.3 286.8 36.32 33.91 87 0.418 5725K 9189 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.7 3.8 5.5 1.7 0.0 0.0 246.1 245.7 22.92 21.93 18 1.273 5725K 9189 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.1 13.41 11.98 69 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.1 total, 14.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.17 GB write, 690.93 MB/s write, 5.51 GB read, 374.02 MB/s read, 36.3 seconds Interval compaction: 10.17 GB write, 701.43 MB/s write, 5.51 GB read, 379.70 MB/s read, 36.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 12, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1214451 Average: 2.0513 StdDev: 12.45 Min: 0 Median: 1.4058 Max: 8070 Percentiles: P50: 1.41 P75: 1.80 P99: 5.26 P99.9: 9.81 P99.99: 14.45 ------------------------------------------------------ [ 0, 1 ] 290638 23.932% 23.932% ##### ( 1, 2 ] 780085 64.234% 88.165% ############# ( 2, 3 ] 85279 7.022% 95.187% # ( 3, 4 ] 34419 2.834% 98.021% # ( 4, 6 ] 18835 1.551% 99.572% ( 6, 10 ] 4178 0.344% 99.916% ( 10, 15 ] 1006 0.083% 99.999% ( 15, 22 ] 84 0.007% 100.006% ( 22, 34 ] 19 0.002% 100.008% ( 34, 51 ] 7 0.001% 100.008% ( 51, 76 ] 5 0.000% 100.009% ( 76, 110 ] 2 0.000% 100.009% ( 110, 170 ] 22 0.002% 100.011% ( 170, 250 ] 40 0.003% 100.014% ( 250, 380 ] 35 0.003% 100.017% ( 380, 580 ] 8 0.001% 100.017% ( 580, 870 ] 24 0.002% 100.019% ( 870, 1300 ] 17 0.001% 100.021% ( 1300, 1900 ] 6 0.000% 100.021% ( 1900, 2900 ] 5 0.000% 100.022% ( 2900, 4400 ] 4 0.000% 100.022% ( 6600, 9900 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 95869 Average: 2.2858 StdDev: 13.23 Min: 1 Median: 1.5079 Max: 2380 Percentiles: P50: 1.51 P75: 1.87 P99: 5.46 P99.9: 9.59 P99.99: 609.95 ------------------------------------------------------ [ 0, 1 ] 14519 15.145% 15.145% ### ( 1, 2 ] 65795 68.630% 83.775% ############## ( 2, 3 ] 9862 10.287% 94.062% ## ( 3, 4 ] 3304 3.446% 97.508% # ( 4, 6 ] 1957 2.041% 99.549% ( 6, 10 ] 374 0.390% 99.940% ( 10, 15 ] 23 0.024% 99.963% ( 15, 22 ] 6 0.006% 99.970% ( 22, 34 ] 1 0.001% 99.971% ( 34, 51 ] 2 0.002% 99.973% ( 51, 76 ] 1 0.001% 99.974% ( 110, 170 ] 2 0.002% 99.976% ( 170, 250 ] 1 0.001% 99.977% ( 250, 380 ] 5 0.005% 99.982% ( 380, 580 ] 7 0.007% 99.990% ( 580, 870 ] 4 0.004% 99.994% ( 870, 1300 ] 5 0.005% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 95399 Average: 2.2052 StdDev: 19.37 Min: 1 Median: 1.4191 Max: 3506 Percentiles: P50: 1.42 P75: 1.82 P99: 5.70 P99.9: 11.23 P99.99: 562.00 ------------------------------------------------------ [ 0, 1 ] 22480 23.564% 23.564% ##### ( 1, 2 ] 60172 63.074% 86.638% ############# ( 2, 3 ] 6633 6.953% 93.591% # ( 3, 4 ] 3258 3.415% 97.006% # ( 4, 6 ] 2235 2.343% 99.349% ( 6, 10 ] 504 0.528% 99.877% ( 10, 15 ] 88 0.092% 99.970% ( 15, 22 ] 8 0.008% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 380, 580 ] 6 0.006% 99.991% ( 580, 870 ] 4 0.004% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57114 Average: 3.4102 StdDev: 59.54 Min: 1 Median: 1.5615 Max: 5870 Percentiles: P50: 1.56 P75: 1.94 P99: 5.91 P99.9: 14.86 P99.99: 3544.30 ------------------------------------------------------ [ 0, 1 ] 7553 13.224% 13.224% ### ( 1, 2 ] 37407 65.495% 78.720% ############# ( 2, 3 ] 8270 14.480% 93.200% ### ( 3, 4 ] 1758 3.078% 96.278% # ( 4, 6 ] 1624 2.843% 99.121% # ( 6, 10 ] 370 0.648% 99.769% ( 10, 15 ] 77 0.135% 99.904% ( 15, 22 ] 7 0.012% 99.916% ( 22, 34 ] 2 0.004% 99.919% ( 34, 51 ] 1 0.002% 99.921% ( 51, 76 ] 2 0.004% 99.925% ( 110, 170 ] 2 0.004% 99.928% ( 170, 250 ] 2 0.004% 99.932% ( 250, 380 ] 2 0.004% 99.935% ( 380, 580 ] 7 0.012% 99.947% ( 580, 870 ] 10 0.018% 99.965% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 7 0.012% 99.979% ( 1900, 2900 ] 5 0.009% 99.988% ( 2900, 4400 ] 3 0.005% 99.993% ( 4400, 6600 ] 4 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 165.6594 StdDev: 686.55 Min: 1 Median: 2.5263 Max: 5796 Percentiles: P50: 2.53 P75: 11.17 P99: 4840.00 P99.9: 5796.00 P99.99: 5796.00 ------------------------------------------------------ [ 0, 1 ] 40 12.500% 12.500% ### ( 1, 2 ] 90 28.125% 40.625% ###### ( 2, 3 ] 57 17.812% 58.438% #### ( 3, 4 ] 22 6.875% 65.312% # ( 4, 6 ] 13 4.062% 69.375% # ( 6, 10 ] 11 3.438% 72.812% # ( 10, 15 ] 30 9.375% 82.188% ## ( 15, 22 ] 15 4.688% 86.875% # ( 22, 34 ] 5 1.562% 88.438% ( 34, 51 ] 3 0.938% 89.375% ( 110, 170 ] 1 0.312% 89.688% ( 250, 380 ] 7 2.188% 91.875% ( 380, 580 ] 4 1.250% 93.125% ( 580, 870 ] 5 1.562% 94.688% ( 870, 1300 ] 5 1.562% 96.250% ( 1300, 1900 ] 3 0.938% 97.188% ( 1900, 2900 ] 4 1.250% 98.438% ( 2900, 4400 ] 1 0.312% 98.750% ( 4400, 6600 ] 4 1.250% 100.000% ** DB Stats ** Uptime(secs): 15.1 total, 2.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 326.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.365 H:M:S, 9.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 341.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.199 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/07-08:20:10 ... thread 0: (1000000,6000000) ops and (48551.5,169268.6) ops/second in (20.596678,35.446614) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 4.42 GB 25.2 4.6 0.0 4.6 10.3 5.7 0.0 1.8 137.7 310.5 33.87 31.75 102 0.332 4733K 4875 0.0 0.0 L1 9/9 1.04 GB 0.0 1.4 1.0 0.4 1.4 1.0 0.2 1.3 232.7 231.8 6.22 6.06 2 3.111 1470K 5421 0.0 0.0 L2 1/0 2.06 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 248.7 248.6 1.52 1.47 2 0.760 383K 214 0.0 0.0 L3 17/0 829.46 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.1 1.0 232.1 232.1 1.08 1.01 1 1.076 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 143.2 143.2 1.57 1.12 1 1.569 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/26 101.85 GB 0.0 6.8 1.7 5.1 12.5 7.4 0.4 2.2 157.3 289.5 44.25 41.41 108 0.410 7069K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.8 1.7 5.1 12.5 7.4 0.3 2.2 157.3 289.5 44.25 41.41 108 0.410 7069K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.8 1.7 5.1 6.8 1.7 0.0 0.0 249.5 249.1 27.90 26.83 23 1.213 7069K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 358.4 16.35 14.58 85 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.7 total, 35.4 interval Flush(GB): cumulative 5.722, interval 5.722 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.51 GB write, 359.08 MB/s write, 6.80 GB read, 195.16 MB/s read, 44.3 seconds Interval compaction: 12.51 GB write, 361.37 MB/s write, 6.80 GB read, 196.40 MB/s read, 44.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 13, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2317537 Average: 2.3733 StdDev: 14.84 Min: 0 Median: 1.3516 Max: 8070 Percentiles: P50: 1.35 P75: 1.75 P99: 5.75 P99.9: 131.54 P99.99: 284.59 ------------------------------------------------------ [ 0, 1 ] 645727 27.863% 27.863% ###### ( 1, 2 ] 1459199 62.963% 90.826% ############# ( 2, 3 ] 115236 4.972% 95.798% # ( 3, 4 ] 51144 2.207% 98.005% ( 4, 6 ] 26317 1.136% 99.141% ( 6, 10 ] 10704 0.462% 99.603% ( 10, 15 ] 1870 0.081% 99.683% ( 15, 22 ] 284 0.012% 99.696% ( 22, 34 ] 31 0.001% 99.697% ( 34, 51 ] 11 0.000% 99.697% ( 51, 76 ] 53 0.002% 99.700% ( 76, 110 ] 3727 0.161% 99.860% ( 110, 170 ] 2561 0.111% 99.971% ( 170, 250 ] 374 0.016% 99.987% ( 250, 380 ] 264 0.011% 99.998% ( 380, 580 ] 187 0.008% 100.007% ( 580, 870 ] 119 0.005% 100.012% ( 870, 1300 ] 24 0.001% 100.013% ( 1300, 1900 ] 10 0.000% 100.013% ( 1900, 2900 ] 8 0.000% 100.014% ( 2900, 4400 ] 9 0.000% 100.014% ( 4400, 6600 ] 1 0.000% 100.014% ( 6600, 9900 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 294731 Average: 2.4146 StdDev: 12.04 Min: 1 Median: 1.3404 Max: 2380 Percentiles: P50: 1.34 P75: 1.75 P99: 7.55 P99.9: 141.33 P99.99: 484.05 ------------------------------------------------------ [ 0, 1 ] 85655 29.062% 29.062% ###### ( 1, 2 ] 181304 61.515% 90.577% ############ ( 2, 3 ] 13621 4.622% 95.199% # ( 3, 4 ] 6544 2.220% 97.419% ( 4, 6 ] 3656 1.240% 98.659% ( 6, 10 ] 2595 0.880% 99.540% ( 10, 15 ] 202 0.069% 99.608% ( 15, 22 ] 50 0.017% 99.625% ( 22, 34 ] 4 0.001% 99.627% ( 34, 51 ] 3 0.001% 99.628% ( 51, 76 ] 19 0.006% 99.634% ( 76, 110 ] 577 0.196% 99.830% ( 110, 170 ] 397 0.135% 99.965% ( 170, 250 ] 28 0.010% 99.974% ( 250, 380 ] 34 0.012% 99.986% ( 380, 580 ] 26 0.009% 99.995% ( 580, 870 ] 10 0.003% 99.998% ( 870, 1300 ] 5 0.002% 100.000% ( 1300, 1900 ] 1 0.000% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 95399 Average: 2.2052 StdDev: 19.37 Min: 1 Median: 1.4191 Max: 3506 Percentiles: P50: 1.42 P75: 1.82 P99: 5.70 P99.9: 11.23 P99.99: 562.00 ------------------------------------------------------ [ 0, 1 ] 22480 23.564% 23.564% ##### ( 1, 2 ] 60172 63.074% 86.638% ############# ( 2, 3 ] 6633 6.953% 93.591% # ( 3, 4 ] 3258 3.415% 97.006% # ( 4, 6 ] 2235 2.343% 99.349% ( 6, 10 ] 504 0.528% 99.877% ( 10, 15 ] 88 0.092% 99.970% ( 15, 22 ] 8 0.008% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 380, 580 ] 6 0.006% 99.991% ( 580, 870 ] 4 0.004% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57114 Average: 3.4102 StdDev: 59.54 Min: 1 Median: 1.5615 Max: 5870 Percentiles: P50: 1.56 P75: 1.94 P99: 5.91 P99.9: 14.86 P99.99: 3544.30 ------------------------------------------------------ [ 0, 1 ] 7553 13.224% 13.224% ### ( 1, 2 ] 37407 65.495% 78.720% ############# ( 2, 3 ] 8270 14.480% 93.200% ### ( 3, 4 ] 1758 3.078% 96.278% # ( 4, 6 ] 1624 2.843% 99.121% # ( 6, 10 ] 370 0.648% 99.769% ( 10, 15 ] 77 0.135% 99.904% ( 15, 22 ] 7 0.012% 99.916% ( 22, 34 ] 2 0.004% 99.919% ( 34, 51 ] 1 0.002% 99.921% ( 51, 76 ] 2 0.004% 99.925% ( 110, 170 ] 2 0.004% 99.928% ( 170, 250 ] 2 0.004% 99.932% ( 250, 380 ] 2 0.004% 99.935% ( 380, 580 ] 7 0.012% 99.947% ( 580, 870 ] 10 0.018% 99.965% ( 870, 1300 ] 1 0.002% 99.967% ( 1300, 1900 ] 7 0.012% 99.979% ( 1900, 2900 ] 5 0.009% 99.988% ( 2900, 4400 ] 3 0.005% 99.993% ( 4400, 6600 ] 4 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 165.6594 StdDev: 686.55 Min: 1 Median: 2.5263 Max: 5796 Percentiles: P50: 2.53 P75: 11.17 P99: 4840.00 P99.9: 5796.00 P99.99: 5796.00 ------------------------------------------------------ [ 0, 1 ] 40 12.500% 12.500% ### ( 1, 2 ] 90 28.125% 40.625% ###### ( 2, 3 ] 57 17.812% 58.438% #### ( 3, 4 ] 22 6.875% 65.312% # ( 4, 6 ] 13 4.062% 69.375% # ( 6, 10 ] 11 3.438% 72.812% # ( 10, 15 ] 30 9.375% 82.188% ## ( 15, 22 ] 15 4.688% 86.875% # ( 22, 34 ] 5 1.562% 88.438% ( 34, 51 ] 3 0.938% 89.375% ( 110, 170 ] 1 0.312% 89.688% ( 250, 380 ] 7 2.188% 91.875% ( 380, 580 ] 4 1.250% 93.125% ( 580, 870 ] 5 1.562% 94.688% ( 870, 1300 ] 5 1.562% 96.250% ( 1300, 1900 ] 3 0.938% 97.188% ( 1900, 2900 ] 4 1.250% 98.438% ( 2900, 4400 ] 1 0.312% 98.750% ( 4400, 6600 ] 4 1.250% 100.000% ** DB Stats ** Uptime(secs): 35.7 total, 20.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 165.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.519 H:M:S, 51.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 47.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:17.154 H:M:S, 83.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/07-08:20:26 ... thread 0: (1000000,7000000) ops and (65745.0,138184.5) ops/second in (15.210281,50.656895) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 881.83 MB 12.6 4.6 0.0 4.6 11.2 6.6 0.0 1.7 118.5 291.3 39.35 34.32 113 0.348 4733K 4875 0.0 0.0 L1 7/6 374.69 MB 0.0 7.0 5.5 1.5 6.9 5.4 0.2 1.2 202.5 198.6 35.40 30.81 4 8.850 7217K 138K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 5.1 2.0 248.7 248.6 1.52 1.47 2 0.760 383K 214 0.0 0.0 L3 13/1 1.04 GB 0.9 0.9 0.7 0.1 0.9 0.7 4.6 1.1 141.1 140.9 6.23 3.93 5 1.247 893K 1330 0.0 0.0 L4 152/3 9.62 GB 1.0 5.0 4.1 1.0 5.0 4.0 1.0 1.2 118.9 118.7 43.16 24.07 32 1.349 3772K 3456 0.0 0.0 L5 1104/0 90.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/18 102.63 GB 0.0 17.8 10.5 7.3 24.3 17.0 15.9 3.7 145.0 197.9 125.66 94.61 156 0.806 16M 148K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.8 10.5 7.3 24.3 17.0 15.8 3.7 145.0 197.9 125.66 94.61 156 0.806 16M 148K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.8 10.5 7.3 17.6 10.4 0.0 0.0 175.5 174.0 103.83 77.46 60 1.731 16M 148K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 311.7 21.83 17.15 96 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.9 total, 50.7 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.28 GB write, 488.71 MB/s write, 17.79 GB read, 358.06 MB/s read, 125.7 seconds Interval compaction: 24.28 GB write, 490.89 MB/s write, 17.79 GB read, 359.65 MB/s read, 125.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 57, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 57, interval: 73 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2768961 Average: 3.2975 StdDev: 31.48 Min: 0 Median: 1.3740 Max: 8070 Percentiles: P50: 1.37 P75: 1.78 P99: 9.59 P99.9: 169.77 P99.99: 555.79 ------------------------------------------------------ [ 0, 1 ] 744399 26.884% 26.884% ##### ( 1, 2 ] 1711639 61.815% 88.699% ############ ( 2, 3 ] 152760 5.517% 94.216% # ( 3, 4 ] 72670 2.624% 96.840% # ( 4, 6 ] 44639 1.612% 98.452% ( 6, 10 ] 16899 0.610% 99.063% ( 10, 15 ] 3194 0.115% 99.178% ( 15, 22 ] 510 0.018% 99.196% ( 22, 34 ] 45 0.002% 99.198% ( 34, 51 ] 14 0.001% 99.199% ( 51, 76 ] 98 0.004% 99.202% ( 76, 110 ] 11113 0.401% 99.603% ( 110, 170 ] 8244 0.298% 99.901% ( 170, 250 ] 1063 0.038% 99.940% ( 250, 380 ] 789 0.028% 99.968% ( 380, 580 ] 693 0.025% 99.993% ( 580, 870 ] 271 0.010% 100.003% ( 870, 1300 ] 50 0.002% 100.005% ( 1300, 1900 ] 39 0.001% 100.006% ( 1900, 2900 ] 73 0.003% 100.009% ( 2900, 4400 ] 60 0.002% 100.011% ( 4400, 6600 ] 16 0.001% 100.011% ( 6600, 9900 ] 6 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 1538847 Average: 7.7820 StdDev: 115.31 Min: 1 Median: 1.7949 Max: 10109 Percentiles: P50: 1.79 P75: 2.77 P99: 9.76 P99.9: 131.79 P99.99: 314.55 ------------------------------------------------------ [ 0, 1 ] 133465 8.673% 8.673% ## ( 1, 2 ] 800076 51.992% 60.665% ########## ( 2, 3 ] 285160 18.531% 79.196% #### ( 3, 4 ] 137641 8.944% 88.140% ## ( 4, 6 ] 136832 8.892% 97.032% ## ( 6, 10 ] 32215 2.093% 99.125% ( 10, 15 ] 8464 0.550% 99.675% ( 15, 22 ] 1160 0.075% 99.751% ( 22, 34 ] 98 0.006% 99.757% ( 34, 51 ] 28 0.002% 99.759% ( 51, 76 ] 55 0.004% 99.763% ( 76, 110 ] 1663 0.108% 99.871% ( 110, 170 ] 1245 0.081% 99.952% ( 170, 250 ] 322 0.021% 99.973% ( 250, 380 ] 544 0.035% 100.008% ( 380, 580 ] 800 0.052% 100.060% ( 580, 870 ] 850 0.055% 100.115% ( 870, 1300 ] 673 0.044% 100.159% ( 1300, 1900 ] 473 0.031% 100.190% ( 1900, 2900 ] 623 0.040% 100.230% ( 2900, 4400 ] 636 0.041% 100.271% ( 4400, 6600 ] 162 0.011% 100.282% ( 6600, 9900 ] 31 0.002% 100.284% ( 9900, 14000 ] 2 0.000% 100.284% ** Level 2 read latency histogram (micros): Count: 95399 Average: 2.2052 StdDev: 19.37 Min: 1 Median: 1.4191 Max: 3506 Percentiles: P50: 1.42 P75: 1.82 P99: 5.70 P99.9: 11.23 P99.99: 562.00 ------------------------------------------------------ [ 0, 1 ] 22480 23.564% 23.564% ##### ( 1, 2 ] 60172 63.074% 86.638% ############# ( 2, 3 ] 6633 6.953% 93.591% # ( 3, 4 ] 3258 3.415% 97.006% # ( 4, 6 ] 2235 2.343% 99.349% ( 6, 10 ] 504 0.528% 99.877% ( 10, 15 ] 88 0.092% 99.970% ( 15, 22 ] 8 0.008% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 380, 580 ] 6 0.006% 99.991% ( 580, 870 ] 4 0.004% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 102441 Average: 11.9977 StdDev: 152.21 Min: 1 Median: 1.6743 Max: 9159 Percentiles: P50: 1.67 P75: 2.31 P99: 12.74 P99.9: 2763.17 P99.99: 5693.15 ------------------------------------------------------ [ 0, 1 ] 9482 9.256% 9.256% ## ( 1, 2 ] 61903 60.428% 69.684% ############ ( 2, 3 ] 17494 17.077% 86.761% ### ( 3, 4 ] 5902 5.761% 92.523% # ( 4, 6 ] 5174 5.051% 97.573% # ( 6, 10 ] 1253 1.223% 98.796% ( 10, 15 ] 380 0.371% 99.167% ( 15, 22 ] 59 0.058% 99.225% ( 22, 34 ] 4 0.004% 99.229% ( 34, 51 ] 1 0.001% 99.230% ( 51, 76 ] 2 0.002% 99.232% ( 76, 110 ] 8 0.008% 99.240% ( 110, 170 ] 44 0.043% 99.283% ( 170, 250 ] 46 0.045% 99.327% ( 250, 380 ] 80 0.078% 99.406% ( 380, 580 ] 104 0.102% 99.507% ( 580, 870 ] 142 0.139% 99.646% ( 870, 1300 ] 123 0.120% 99.766% ( 1300, 1900 ] 78 0.076% 99.842% ( 1900, 2900 ] 69 0.067% 99.909% ( 2900, 4400 ] 71 0.069% 99.979% ( 4400, 6600 ] 20 0.020% 99.998% ( 6600, 9900 ] 2 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 255548 Average: 22.4469 StdDev: 204.27 Min: 1 Median: 1.9502 Max: 7370 Percentiles: P50: 1.95 P75: 3.02 P99: 508.60 P99.9: 2216.45 P99.99: 2841.43 ------------------------------------------------------ [ 0, 1 ] 5651 2.211% 2.211% ( 1, 2 ] 128521 50.292% 52.504% ########## ( 2, 3 ] 56987 22.300% 74.804% #### ( 3, 4 ] 28278 11.066% 85.869% ## ( 4, 6 ] 25438 9.954% 95.823% ## ( 6, 10 ] 5033 1.969% 97.793% ( 10, 15 ] 1380 0.540% 98.333% ( 15, 22 ] 200 0.078% 98.411% ( 22, 34 ] 28 0.011% 98.422% ( 34, 51 ] 9 0.004% 98.426% ( 51, 76 ] 6 0.002% 98.428% ( 76, 110 ] 94 0.037% 98.465% ( 110, 170 ] 218 0.085% 98.550% ( 170, 250 ] 296 0.116% 98.666% ( 250, 380 ] 415 0.162% 98.828% ( 380, 580 ] 682 0.267% 99.095% ( 580, 870 ] 820 0.321% 99.416% ( 870, 1300 ] 680 0.266% 99.682% ( 1300, 1900 ] 440 0.172% 99.854% ( 1900, 2900 ] 368 0.144% 99.998% ( 2900, 4400 ] 349 0.137% 100.135% ( 4400, 6600 ] 65 0.025% 100.160% ( 6600, 9900 ] 5 0.002% 100.162% ** Level 5 read latency histogram (micros): Count: 300 Average: 1786.4333 StdDev: 1671.01 Min: 98 Median: 1130.6061 Max: 7301 Percentiles: P50: 1130.61 P75: 2872.97 P99: 7301.00 P99.9: 7301.00 P99.99: 7301.00 ------------------------------------------------------ ( 76, 110 ] 5 1.667% 1.667% ( 110, 170 ] 11 3.667% 5.333% # ( 170, 250 ] 18 6.000% 11.333% # ( 250, 380 ] 28 9.333% 20.667% ## ( 380, 580 ] 33 11.000% 31.667% ## ( 580, 870 ] 35 11.667% 43.333% ## ( 870, 1300 ] 33 11.000% 54.333% ## ( 1300, 1900 ] 26 8.667% 63.000% ## ( 1900, 2900 ] 37 12.333% 75.333% ## ( 2900, 4400 ] 46 15.333% 90.667% ### ( 4400, 6600 ] 24 8.000% 98.667% ## ( 6600, 9900 ] 4 1.333% 100.000% ** DB Stats ** Uptime(secs): 50.9 total, 15.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 135.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.422 H:M:S, 59.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 64.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.903 H:M:S, 78.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/07-08:20:29 ... thread 0: (1000000,8000000) ops and (323389.0,148839.6) ops/second in (3.092251,53.749146) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.48 GB 12.6 5.4 0.0 5.4 13.0 7.6 0.0 1.7 121.5 292.5 45.64 40.23 130 0.351 5628K 5907 0.0 0.0 L1 8/8 750.55 MB 0.0 7.7 5.9 1.8 7.6 5.8 0.2 1.3 200.4 196.8 39.52 34.17 5 7.904 7981K 140K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 5.1 2.0 248.7 248.6 1.52 1.47 2 0.760 383K 214 0.0 0.0 L3 12/0 939.73 MB 0.9 0.9 0.7 0.1 0.9 0.7 4.6 1.1 141.1 140.9 6.23 3.93 5 1.247 893K 1330 0.0 0.0 L4 153/0 9.75 GB 1.0 5.2 4.2 1.0 5.2 4.2 1.0 1.2 120.7 120.5 44.17 24.96 33 1.339 3839K 3456 0.0 0.0 L5 1104/0 90.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1288/18 103.61 GB 0.0 19.6 11.0 8.6 27.1 18.5 15.9 3.5 146.3 202.1 137.09 104.77 175 0.783 18M 151K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.6 11.0 8.6 27.1 18.5 15.8 3.5 146.3 202.1 137.09 104.77 175 0.783 18M 151K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.6 11.0 8.6 19.4 10.9 0.0 0.0 178.4 177.0 112.41 85.07 65 1.729 18M 151K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 316.6 24.67 19.70 110 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.0 total, 53.8 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.06 GB write, 513.28 MB/s write, 19.58 GB read, 371.51 MB/s read, 137.1 seconds Interval compaction: 27.06 GB write, 515.44 MB/s write, 19.58 GB read, 373.07 MB/s read, 137.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 60, interval: 76 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3064197 Average: 3.2039 StdDev: 30.14 Min: 0 Median: 1.3884 Max: 8070 Percentiles: P50: 1.39 P75: 1.79 P99: 9.07 P99.9: 167.29 P99.99: 515.83 ------------------------------------------------------ [ 0, 1 ] 792834 25.874% 25.874% ##### ( 1, 2 ] 1903522 62.121% 87.996% ############ ( 2, 3 ] 183897 6.001% 93.997% # ( 3, 4 ] 85581 2.793% 96.790% # ( 4, 6 ] 53422 1.743% 98.533% ( 6, 10 ] 18647 0.609% 99.142% ( 10, 15 ] 3517 0.115% 99.257% ( 15, 22 ] 525 0.017% 99.274% ( 22, 34 ] 47 0.002% 99.275% ( 34, 51 ] 16 0.001% 99.276% ( 51, 76 ] 100 0.003% 99.279% ( 76, 110 ] 11124 0.363% 99.642% ( 110, 170 ] 8276 0.270% 99.912% ( 170, 250 ] 1090 0.036% 99.948% ( 250, 380 ] 809 0.026% 99.974% ( 380, 580 ] 715 0.023% 99.998% ( 580, 870 ] 277 0.009% 100.007% ( 870, 1300 ] 57 0.002% 100.008% ( 1300, 1900 ] 41 0.001% 100.010% ( 1900, 2900 ] 73 0.002% 100.012% ( 2900, 4400 ] 61 0.002% 100.014% ( 4400, 6600 ] 16 0.001% 100.015% ( 6600, 9900 ] 6 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 1632893 Average: 7.5107 StdDev: 112.05 Min: 1 Median: 1.7818 Max: 10109 Percentiles: P50: 1.78 P75: 2.74 P99: 9.71 P99.9: 134.96 P99.99: 323.26 ------------------------------------------------------ [ 0, 1 ] 143240 8.772% 8.772% ## ( 1, 2 ] 861092 52.734% 61.506% ########### ( 2, 3 ] 298442 18.277% 79.783% #### ( 3, 4 ] 141842 8.687% 88.470% ## ( 4, 6 ] 140424 8.600% 97.069% ## ( 6, 10 ] 33952 2.079% 99.149% ( 10, 15 ] 8626 0.528% 99.677% ( 15, 22 ] 1172 0.072% 99.749% ( 22, 34 ] 99 0.006% 99.755% ( 34, 51 ] 30 0.002% 99.757% ( 51, 76 ] 55 0.003% 99.760% ( 76, 110 ] 1734 0.106% 99.866% ( 110, 170 ] 1327 0.081% 99.947% ( 170, 250 ] 369 0.023% 99.970% ( 250, 380 ] 578 0.035% 100.005% ( 380, 580 ] 827 0.051% 100.056% ( 580, 870 ] 856 0.052% 100.109% ( 870, 1300 ] 674 0.041% 100.150% ( 1300, 1900 ] 477 0.029% 100.179% ( 1900, 2900 ] 624 0.038% 100.217% ( 2900, 4400 ] 636 0.039% 100.256% ( 4400, 6600 ] 162 0.010% 100.266% ( 6600, 9900 ] 31 0.002% 100.268% ( 9900, 14000 ] 2 0.000% 100.268% ** Level 2 read latency histogram (micros): Count: 95399 Average: 2.2052 StdDev: 19.37 Min: 1 Median: 1.4191 Max: 3506 Percentiles: P50: 1.42 P75: 1.82 P99: 5.70 P99.9: 11.23 P99.99: 562.00 ------------------------------------------------------ [ 0, 1 ] 22480 23.564% 23.564% ##### ( 1, 2 ] 60172 63.074% 86.638% ############# ( 2, 3 ] 6633 6.953% 93.591% # ( 3, 4 ] 3258 3.415% 97.006% # ( 4, 6 ] 2235 2.343% 99.349% ( 6, 10 ] 504 0.528% 99.877% ( 10, 15 ] 88 0.092% 99.970% ( 15, 22 ] 8 0.008% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 380, 580 ] 6 0.006% 99.991% ( 580, 870 ] 4 0.004% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 102441 Average: 11.9977 StdDev: 152.21 Min: 1 Median: 1.6743 Max: 9159 Percentiles: P50: 1.67 P75: 2.31 P99: 12.74 P99.9: 2763.17 P99.99: 5693.15 ------------------------------------------------------ [ 0, 1 ] 9482 9.256% 9.256% ## ( 1, 2 ] 61903 60.428% 69.684% ############ ( 2, 3 ] 17494 17.077% 86.761% ### ( 3, 4 ] 5902 5.761% 92.523% # ( 4, 6 ] 5174 5.051% 97.573% # ( 6, 10 ] 1253 1.223% 98.796% ( 10, 15 ] 380 0.371% 99.167% ( 15, 22 ] 59 0.058% 99.225% ( 22, 34 ] 4 0.004% 99.229% ( 34, 51 ] 1 0.001% 99.230% ( 51, 76 ] 2 0.002% 99.232% ( 76, 110 ] 8 0.008% 99.240% ( 110, 170 ] 44 0.043% 99.283% ( 170, 250 ] 46 0.045% 99.327% ( 250, 380 ] 80 0.078% 99.406% ( 380, 580 ] 104 0.102% 99.507% ( 580, 870 ] 142 0.139% 99.646% ( 870, 1300 ] 123 0.120% 99.766% ( 1300, 1900 ] 78 0.076% 99.842% ( 1900, 2900 ] 69 0.067% 99.909% ( 2900, 4400 ] 71 0.069% 99.979% ( 4400, 6600 ] 20 0.020% 99.998% ( 6600, 9900 ] 2 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 266774 Average: 21.6915 StdDev: 200.05 Min: 1 Median: 1.9416 Max: 7370 Percentiles: P50: 1.94 P75: 2.99 P99: 479.21 P99.9: 2185.94 P99.99: 2838.38 ------------------------------------------------------ [ 0, 1 ] 5903 2.213% 2.213% ( 1, 2 ] 135397 50.753% 52.966% ########## ( 2, 3 ] 59124 22.163% 75.129% #### ( 3, 4 ] 29101 10.908% 86.037% ## ( 4, 6 ] 26237 9.835% 95.872% ## ( 6, 10 ] 5258 1.971% 97.843% ( 10, 15 ] 1421 0.533% 98.376% ( 15, 22 ] 200 0.075% 98.451% ( 22, 34 ] 28 0.010% 98.461% ( 34, 51 ] 9 0.003% 98.465% ( 51, 76 ] 7 0.003% 98.467% ( 76, 110 ] 111 0.042% 98.509% ( 110, 170 ] 233 0.087% 98.596% ( 170, 250 ] 310 0.116% 98.712% ( 250, 380 ] 424 0.159% 98.871% ( 380, 580 ] 692 0.259% 99.131% ( 580, 870 ] 824 0.309% 99.440% ( 870, 1300 ] 683 0.256% 99.696% ( 1300, 1900 ] 440 0.165% 99.861% ( 1900, 2900 ] 368 0.138% 99.999% ( 2900, 4400 ] 349 0.131% 100.129% ( 4400, 6600 ] 65 0.024% 100.154% ( 6600, 9900 ] 5 0.002% 100.156% ** Level 5 read latency histogram (micros): Count: 300 Average: 1786.4333 StdDev: 1671.01 Min: 98 Median: 1130.6061 Max: 7301 Percentiles: P50: 1130.61 P75: 2872.97 P99: 7301.00 P99.9: 7301.00 P99.99: 7301.00 ------------------------------------------------------ ( 76, 110 ] 5 1.667% 1.667% ( 110, 170 ] 11 3.667% 5.333% # ( 170, 250 ] 18 6.000% 11.333% # ( 250, 380 ] 28 9.333% 20.667% ## ( 380, 580 ] 33 11.000% 31.667% ## ( 580, 870 ] 35 11.667% 43.333% ## ( 870, 1300 ] 33 11.000% 54.333% ## ( 1300, 1900 ] 26 8.667% 63.000% ## ( 1900, 2900 ] 37 12.333% 75.333% ## ( 2900, 4400 ] 46 15.333% 90.667% ### ( 4400, 6600 ] 24 8.000% 98.667% ## ( 6600, 9900 ] 4 1.333% 100.000% ** DB Stats ** Uptime(secs): 54.0 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 145.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.793 H:M:S, 57.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.370 H:M:S, 12.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/07-08:20:32 ... thread 0: (1000000,9000000) ops and (343475.4,158840.6) ops/second in (2.911417,56.660563) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.34 GB 69.2 5.9 0.0 5.9 14.4 8.5 0.0 1.7 120.9 294.6 50.02 44.31 145 0.345 6140K 6412 0.0 0.0 L1 8/8 750.55 MB 0.0 7.7 5.9 1.8 7.6 5.8 0.2 1.3 200.4 196.8 39.52 34.17 5 7.904 7981K 140K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 5.1 2.0 248.7 248.6 1.52 1.47 2 0.760 383K 214 0.0 0.0 L3 12/0 939.73 MB 0.9 0.9 0.7 0.1 0.9 0.7 4.6 1.1 141.1 140.9 6.23 3.93 5 1.247 893K 1330 0.0 0.0 L4 153/0 9.75 GB 1.0 5.2 4.2 1.0 5.2 4.2 1.0 1.2 120.7 120.5 44.17 24.96 33 1.339 3839K 3456 0.0 0.0 L5 1104/0 90.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/22 104.47 GB 0.0 20.1 11.0 9.1 28.4 19.3 15.9 3.3 145.3 205.6 141.46 108.85 190 0.745 19M 152K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.1 11.0 9.1 28.4 19.3 15.8 3.3 145.3 205.6 141.46 108.85 190 0.745 19M 152K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.1 11.0 9.1 19.9 10.9 0.0 0.0 179.9 178.5 114.30 86.93 67 1.706 19M 152K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 320.0 27.17 21.92 123 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.9 total, 56.7 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.41 GB write, 511.37 MB/s write, 20.08 GB read, 361.36 MB/s read, 141.5 seconds Interval compaction: 28.41 GB write, 513.41 MB/s write, 20.08 GB read, 362.80 MB/s read, 141.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 63, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3371256 Average: 3.1079 StdDev: 28.92 Min: 0 Median: 1.3983 Max: 8070 Percentiles: P50: 1.40 P75: 1.80 P99: 8.49 P99.9: 164.60 P99.99: 484.85 ------------------------------------------------------ [ 0, 1 ] 843787 25.029% 25.029% ##### ( 1, 2 ] 2113571 62.694% 87.723% ############# ( 2, 3 ] 212687 6.309% 94.032% # ( 3, 4 ] 96017 2.848% 96.880% # ( 4, 6 ] 59320 1.760% 98.639% ( 6, 10 ] 19530 0.579% 99.219% ( 10, 15 ] 3598 0.107% 99.325% ( 15, 22 ] 541 0.016% 99.341% ( 22, 34 ] 52 0.002% 99.343% ( 34, 51 ] 21 0.001% 99.344% ( 51, 76 ] 101 0.003% 99.347% ( 76, 110 ] 11124 0.330% 99.676% ( 110, 170 ] 8281 0.246% 99.922% ( 170, 250 ] 1099 0.033% 99.955% ( 250, 380 ] 814 0.024% 99.979% ( 380, 580 ] 717 0.021% 100.000% ( 580, 870 ] 282 0.008% 100.008% ( 870, 1300 ] 58 0.002% 100.010% ( 1300, 1900 ] 44 0.001% 100.012% ( 1900, 2900 ] 75 0.002% 100.014% ( 2900, 4400 ] 62 0.002% 100.016% ( 4400, 6600 ] 16 0.000% 100.016% ( 6600, 9900 ] 6 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 1697217 Average: 7.3111 StdDev: 109.91 Min: 1 Median: 1.7692 Max: 10109 Percentiles: P50: 1.77 P75: 2.71 P99: 9.66 P99.9: 132.53 P99.99: 322.14 ------------------------------------------------------ [ 0, 1 ] 152037 8.958% 8.958% ## ( 1, 2 ] 905563 53.356% 62.314% ########### ( 2, 3 ] 305225 17.984% 80.298% #### ( 3, 4 ] 143921 8.480% 88.777% ## ( 4, 6 ] 141676 8.348% 97.125% ## ( 6, 10 ] 34801 2.050% 99.175% ( 10, 15 ] 8699 0.513% 99.688% ( 15, 22 ] 1178 0.069% 99.757% ( 22, 34 ] 99 0.006% 99.763% ( 34, 51 ] 30 0.002% 99.765% ( 51, 76 ] 56 0.003% 99.768% ( 76, 110 ] 1736 0.102% 99.871% ( 110, 170 ] 1331 0.078% 99.949% ( 170, 250 ] 375 0.022% 99.971% ( 250, 380 ] 579 0.034% 100.005% ( 380, 580 ] 827 0.049% 100.054% ( 580, 870 ] 856 0.050% 100.104% ( 870, 1300 ] 675 0.040% 100.144% ( 1300, 1900 ] 477 0.028% 100.172% ( 1900, 2900 ] 624 0.037% 100.209% ( 2900, 4400 ] 636 0.037% 100.247% ( 4400, 6600 ] 162 0.010% 100.256% ( 6600, 9900 ] 31 0.002% 100.258% ( 9900, 14000 ] 2 0.000% 100.258% ** Level 2 read latency histogram (micros): Count: 95399 Average: 2.2052 StdDev: 19.37 Min: 1 Median: 1.4191 Max: 3506 Percentiles: P50: 1.42 P75: 1.82 P99: 5.70 P99.9: 11.23 P99.99: 562.00 ------------------------------------------------------ [ 0, 1 ] 22480 23.564% 23.564% ##### ( 1, 2 ] 60172 63.074% 86.638% ############# ( 2, 3 ] 6633 6.953% 93.591% # ( 3, 4 ] 3258 3.415% 97.006% # ( 4, 6 ] 2235 2.343% 99.349% ( 6, 10 ] 504 0.528% 99.877% ( 10, 15 ] 88 0.092% 99.970% ( 15, 22 ] 8 0.008% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 380, 580 ] 6 0.006% 99.991% ( 580, 870 ] 4 0.004% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 102441 Average: 11.9977 StdDev: 152.21 Min: 1 Median: 1.6743 Max: 9159 Percentiles: P50: 1.67 P75: 2.31 P99: 12.74 P99.9: 2763.17 P99.99: 5693.15 ------------------------------------------------------ [ 0, 1 ] 9482 9.256% 9.256% ## ( 1, 2 ] 61903 60.428% 69.684% ############ ( 2, 3 ] 17494 17.077% 86.761% ### ( 3, 4 ] 5902 5.761% 92.523% # ( 4, 6 ] 5174 5.051% 97.573% # ( 6, 10 ] 1253 1.223% 98.796% ( 10, 15 ] 380 0.371% 99.167% ( 15, 22 ] 59 0.058% 99.225% ( 22, 34 ] 4 0.004% 99.229% ( 34, 51 ] 1 0.001% 99.230% ( 51, 76 ] 2 0.002% 99.232% ( 76, 110 ] 8 0.008% 99.240% ( 110, 170 ] 44 0.043% 99.283% ( 170, 250 ] 46 0.045% 99.327% ( 250, 380 ] 80 0.078% 99.406% ( 380, 580 ] 104 0.102% 99.507% ( 580, 870 ] 142 0.139% 99.646% ( 870, 1300 ] 123 0.120% 99.766% ( 1300, 1900 ] 78 0.076% 99.842% ( 1900, 2900 ] 69 0.067% 99.909% ( 2900, 4400 ] 71 0.069% 99.979% ( 4400, 6600 ] 20 0.020% 99.998% ( 6600, 9900 ] 2 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 266774 Average: 21.6915 StdDev: 200.05 Min: 1 Median: 1.9416 Max: 7370 Percentiles: P50: 1.94 P75: 2.99 P99: 479.21 P99.9: 2185.94 P99.99: 2838.38 ------------------------------------------------------ [ 0, 1 ] 5903 2.213% 2.213% ( 1, 2 ] 135397 50.753% 52.966% ########## ( 2, 3 ] 59124 22.163% 75.129% #### ( 3, 4 ] 29101 10.908% 86.037% ## ( 4, 6 ] 26237 9.835% 95.872% ## ( 6, 10 ] 5258 1.971% 97.843% ( 10, 15 ] 1421 0.533% 98.376% ( 15, 22 ] 200 0.075% 98.451% ( 22, 34 ] 28 0.010% 98.461% ( 34, 51 ] 9 0.003% 98.465% ( 51, 76 ] 7 0.003% 98.467% ( 76, 110 ] 111 0.042% 98.509% ( 110, 170 ] 233 0.087% 98.596% ( 170, 250 ] 310 0.116% 98.712% ( 250, 380 ] 424 0.159% 98.871% ( 380, 580 ] 692 0.259% 99.131% ( 580, 870 ] 824 0.309% 99.440% ( 870, 1300 ] 683 0.256% 99.696% ( 1300, 1900 ] 440 0.165% 99.861% ( 1900, 2900 ] 368 0.138% 99.999% ( 2900, 4400 ] 349 0.131% 100.129% ( 4400, 6600 ] 65 0.024% 100.154% ( 6600, 9900 ] 5 0.002% 100.156% ** Level 5 read latency histogram (micros): Count: 300 Average: 1786.4333 StdDev: 1671.01 Min: 98 Median: 1130.6061 Max: 7301 Percentiles: P50: 1130.61 P75: 2872.97 P99: 7301.00 P99.9: 7301.00 P99.99: 7301.00 ------------------------------------------------------ ( 76, 110 ] 5 1.667% 1.667% ( 110, 170 ] 11 3.667% 5.333% # ( 170, 250 ] 18 6.000% 11.333% # ( 250, 380 ] 28 9.333% 20.667% ## ( 380, 580 ] 33 11.000% 31.667% ## ( 580, 870 ] 35 11.667% 43.333% ## ( 870, 1300 ] 33 11.000% 54.333% ## ( 1300, 1900 ] 26 8.667% 63.000% ## ( 1900, 2900 ] 37 12.333% 75.333% ## ( 2900, 4400 ] 46 15.333% 90.667% ### ( 4400, 6600 ] 24 8.000% 98.667% ## ( 6600, 9900 ] 4 1.333% 100.000% ** DB Stats ** Uptime(secs): 56.9 total, 2.9 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 155.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.000 H:M:S, 54.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 338.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.208 H:M:S, 7.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.042 micros/op 165496 ops/sec 60.001 seconds 9929999 operations; 160.4 MB/s Microseconds per write: Count: 9929999 Average: 6.0424 StdDev: 523.08 Min: 1 Median: 1.7881 Max: 985084 Percentiles: P50: 1.79 P75: 2.83 P99: 9.40 P99.9: 1167.68 P99.99: 2737.60 ------------------------------------------------------ [ 0, 1 ] 989751 9.967% 9.967% ## ( 1, 2 ] 5044060 50.796% 60.763% ########## ( 2, 3 ] 1704275 17.163% 77.926% ### ( 3, 4 ] 1413807 14.238% 92.164% ### ( 4, 6 ] 578232 5.823% 97.987% # ( 6, 10 ] 118300 1.191% 99.179% ( 10, 15 ] 40592 0.409% 99.587% ( 15, 22 ] 9580 0.096% 99.684% ( 22, 34 ] 1916 0.019% 99.703% ( 34, 51 ] 229 0.002% 99.705% ( 51, 76 ] 34 0.000% 99.706% ( 76, 110 ] 6655 0.067% 99.773% ( 110, 170 ] 2939 0.030% 99.802% ( 170, 250 ] 299 0.003% 99.805% ( 250, 380 ] 168 0.002% 99.807% ( 380, 580 ] 31 0.000% 99.807% ( 580, 870 ] 29 0.000% 99.808% ( 870, 1300 ] 13249 0.133% 99.941% ( 1300, 1900 ] 22 0.000% 99.941% ( 1900, 2900 ] 5776 0.058% 99.999% ( 2900, 4400 ] 27 0.000% 100.000% ( 4400, 6600 ] 3 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 172584 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9929999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10247758968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 500 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31817596 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 24758454863 rocksdb.compact.write.bytes COUNT : 24584681202 rocksdb.flush.write.bytes COUNT : 10172958225 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 70 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 272 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10090817536 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3812352 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 24858722608 rocksdb.non.last.level.read.count COUNT : 5999515 rocksdb.block.checksum.compute.count COUNT : 5998585 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.458219 P95 : 3.941258 P99 : 7.902821 P100 : 985081.000000 COUNT : 9929999 SUM : 55191032 rocksdb.compaction.times.micros P50 : 1200000.000000 P95 : 2300000.000000 P99 : 25080000.000000 P100 : 26499541.000000 COUNT : 72 SUM : 119566099 rocksdb.compaction.times.cpu_micros P50 : 945000.000000 P95 : 1760000.000000 P99 : 23046238.000000 P100 : 23046238.000000 COUNT : 72 SUM : 92087447 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 697.380952 P95 : 4620.000000 P99 : 30910.000000 P100 : 108706.000000 COUNT : 138 SUM : 301482 rocksdb.compaction.outfile.sync.micros P50 : 1164.935897 P95 : 93316.666667 P99 : 145011.000000 P100 : 145011.000000 COUNT : 303 SUM : 5117104 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 97.857143 P95 : 2220.000000 P99 : 4220.000000 P100 : 5257.000000 COUNT : 236 SUM : 92091 rocksdb.table.open.io.micros P50 : 1612.328767 P95 : 11147.826087 P99 : 17555.555556 P100 : 18952.000000 COUNT : 500 SUM : 1364431 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.571786 P95 : 7.774132 P99 : 13.492261 P100 : 10310.000000 COUNT : 5997310 SUM : 43898348 rocksdb.read.block.get.micros P50 : 488.333333 P95 : 4247.826087 P99 : 6362.162162 P100 : 10755.000000 COUNT : 1000 SUM : 1073607 rocksdb.write.raw.block.micros P50 : 0.515076 P95 : 0.978645 P99 : 2.869585 P100 : 13238.000000 COUNT : 8420198 SUM : 17908577 rocksdb.numfiles.in.singlecompaction P50 : 3.335366 P95 : 3.988415 P99 : 14.525000 P100 : 26.000000 COUNT : 119 SUM : 473 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.575800 P95 : 1252.259906 P99 : 2652.308094 P100 : 984912.000000 COUNT : 144999 SUM : 31834317 rocksdb.sst.read.micros P50 : 1.529503 P95 : 4.548524 P99 : 9.627172 P100 : 10109.000000 COUNT : 5999946 SUM : 31918851 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9929999 SUM : 10247758968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 206853.932584 P95 : 386333.333333 P99 : 823266.666667 P100 : 935973.000000 COUNT : 138 SUM : 30060272 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 303 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0