[2024-12-06 14:31:56.258327] Starting SPDK v25.01-pre git sha1 a5e6ecf28 / DPDK 24.03.0 initialization... [2024-12-06 14:31:56.258598] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1988232 ] Set seed to 1733491916251598 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-06 14:31:56.388703] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-06 14:31:56.497319] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-06 14:31:56.497370] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1988232' to capture a snapshot of events at runtime. [2024-12-06 14:31:56.497381] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-06 14:31:56.497391] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-06 14:31:56.497399] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1988232 for offline analysis/debug. [2024-12-06 14:31:56.498817] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 6 14:32:04 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/06-14:32:07 ... thread 0: (1000000,1000000) ops and (341666.6,341666.6) ops/second in (2.926830,2.926830) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 692.92 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 350.5 2.52 2.26 12 0.210 0 0 0.0 0.0 L1 1/1 63.01 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 1.06 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 254.6 254.5 0.49 0.48 1 0.495 127K 46 0.0 0.0 L3 17/0 929.15 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.2 1.0 230.0 230.0 0.54 0.48 1 0.543 126K 0 0.0 0.0 L4 112/0 9.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/8 97.00 GB 0.0 0.2 0.2 0.1 1.1 1.0 0.4 1.3 70.6 318.7 3.55 3.21 14 0.254 254K 46 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.2 0.1 1.1 1.0 0.2 1.3 70.6 318.7 3.55 3.21 14 0.254 254K 46 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.2 0.1 0.2 0.2 0.0 0.0 241.7 241.7 1.04 0.95 2 0.519 254K 46 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 350.5 2.52 2.26 12 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 364.87 MB/s write, 0.25 GB read, 80.81 MB/s read, 3.6 seconds Interval compaction: 1.11 GB write, 386.85 MB/s write, 0.25 GB read, 85.68 MB/s read, 3.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 140625 Average: 2.0346 StdDev: 19.82 Min: 0 Median: 1.3419 Max: 4165 Percentiles: P50: 1.34 P75: 1.74 P99: 4.92 P99.9: 10.30 P99.99: 75.48 ------------------------------------------------------ [ 0, 1 ] 40332 28.681% 28.681% ###### ( 1, 2 ] 87682 62.352% 91.032% ############ ( 2, 3 ] 7928 5.638% 96.670% # ( 3, 4 ] 2597 1.847% 98.517% ( 4, 6 ] 1477 1.050% 99.567% ( 6, 10 ] 464 0.330% 99.897% ( 10, 15 ] 107 0.076% 99.973% ( 15, 22 ] 19 0.014% 99.986% ( 22, 34 ] 3 0.002% 99.989% ( 34, 51 ] 1 0.001% 99.989% ( 51, 76 ] 3 0.002% 99.991% ( 76, 110 ] 1 0.001% 99.992% ( 110, 170 ] 5 0.004% 99.996% ( 170, 250 ] 2 0.001% 99.997% ( 250, 380 ] 4 0.003% 100.000% ( 380, 580 ] 4 0.003% 100.003% ( 580, 870 ] 3 0.002% 100.005% ( 1300, 1900 ] 2 0.001% 100.006% ( 1900, 2900 ] 1 0.001% 100.007% ( 2900, 4400 ] 3 0.002% 100.009% ** Level 2 read latency histogram (micros): Count: 31723 Average: 2.4179 StdDev: 45.50 Min: 1 Median: 1.2370 Max: 4596 Percentiles: P50: 1.24 P75: 1.66 P99: 3.63 P99.9: 9.87 P99.99: 2727.70 ------------------------------------------------------ [ 0, 1 ] 11372 35.848% 35.848% ####### ( 1, 2 ] 18945 59.720% 95.568% ############ ( 2, 3 ] 909 2.865% 98.433% # ( 3, 4 ] 284 0.895% 99.329% ( 4, 6 ] 99 0.312% 99.641% ( 6, 10 ] 85 0.268% 99.909% ( 10, 15 ] 15 0.047% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 1 0.003% 99.968% ( 380, 580 ] 1 0.003% 99.972% ( 580, 870 ] 1 0.003% 99.975% ( 870, 1300 ] 2 0.006% 99.981% ( 1300, 1900 ] 2 0.006% 99.987% ( 1900, 2900 ] 1 0.003% 99.991% ( 2900, 4400 ] 2 0.006% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 75 Average: 1295.6133 StdDev: 1916.95 Min: 1 Median: 8.0000 Max: 6793 Percentiles: P50: 8.00 P75: 1950.00 P99: 6793.00 P99.9: 6793.00 P99.99: 6793.00 ------------------------------------------------------ [ 0, 1 ] 21 28.000% 28.000% ###### ( 1, 2 ] 10 13.333% 41.333% ### ( 2, 3 ] 4 5.333% 46.667% # ( 4, 6 ] 2 2.667% 49.333% # ( 6, 10 ] 1 1.333% 50.667% ( 76, 110 ] 1 1.333% 52.000% ( 110, 170 ] 2 2.667% 54.667% # ( 170, 250 ] 1 1.333% 56.000% ( 380, 580 ] 3 4.000% 60.000% # ( 580, 870 ] 1 1.333% 61.333% ( 870, 1300 ] 3 4.000% 65.333% # ( 1300, 1900 ] 7 9.333% 74.667% ## ( 1900, 2900 ] 5 6.667% 81.333% # ( 2900, 4400 ] 6 8.000% 89.333% ## ( 4400, 6600 ] 7 9.333% 98.667% ## ( 6600, 9900 ] 1 1.333% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3138.2286 StdDev: 1879.63 Min: 314 Median: 3221.4286 Max: 6336 Percentiles: P50: 3221.43 P75: 4995.83 P99: 6336.00 P99.9: 6336.00 P99.99: 6336.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 580, 870 ] 4 11.429% 17.143% ## ( 870, 1300 ] 3 8.571% 25.714% ## ( 1300, 1900 ] 3 8.571% 34.286% ## ( 1900, 2900 ] 4 11.429% 45.714% ## ( 2900, 4400 ] 7 20.000% 65.714% #### ( 4400, 6600 ] 12 34.286% 100.000% ####### ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 316.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.364 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 336.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.364 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-14:32:10 ... thread 0: (1000000,2000000) ops and (336573.9,339101.1) ops/second in (2.971116,5.897946) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.41 GB 119.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 97.7 322.9 8.39 7.75 29 0.289 831K 845 0.0 0.0 L1 1/0 2.64 MB 0.3 0.3 0.2 0.1 0.3 0.2 0.2 1.2 249.9 249.6 1.26 1.21 1 1.260 319K 354 0.0 0.0 L2 2/0 55.48 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 254.6 254.5 0.49 0.48 1 0.495 127K 46 0.0 0.0 L3 46/0 994.62 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.2 1.3 192.6 192.4 2.57 2.13 2 1.286 502K 339 0.0 0.0 L4 140/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1240/4 97.98 GB 0.0 1.7 0.7 1.0 3.6 2.5 0.9 1.9 138.1 286.6 12.71 11.57 33 0.385 1782K 1584 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.7 1.0 3.6 2.5 0.7 1.9 138.1 286.6 12.71 11.57 33 0.385 1782K 1584 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.7 1.0 1.7 0.7 0.0 0.0 236.8 236.5 7.41 6.84 7 1.059 1782K 1584 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.6 5.30 4.73 26 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.56 GB write, 599.66 MB/s write, 1.71 GB read, 288.88 MB/s read, 12.7 seconds Interval compaction: 3.56 GB write, 617.60 MB/s write, 1.71 GB read, 297.52 MB/s read, 12.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 369944 Average: 2.1072 StdDev: 14.93 Min: 0 Median: 1.4185 Max: 4165 Percentiles: P50: 1.42 P75: 1.81 P99: 5.38 P99.9: 11.93 P99.99: 51.03 ------------------------------------------------------ [ 0, 1 ] 85594 23.137% 23.137% ##### ( 1, 2 ] 237488 64.196% 87.333% ############# ( 2, 3 ] 31127 8.414% 95.747% ## ( 3, 4 ] 8363 2.261% 98.007% ( 4, 6 ] 5325 1.439% 99.447% ( 6, 10 ] 1509 0.408% 99.855% ( 10, 15 ] 438 0.118% 99.973% ( 15, 22 ] 51 0.014% 99.987% ( 22, 34 ] 8 0.002% 99.989% ( 34, 51 ] 5 0.001% 99.990% ( 51, 76 ] 4 0.001% 99.991% ( 76, 110 ] 1 0.000% 99.992% ( 110, 170 ] 7 0.002% 99.994% ( 170, 250 ] 9 0.002% 99.996% ( 250, 380 ] 9 0.002% 99.998% ( 380, 580 ] 10 0.003% 100.001% ( 580, 870 ] 9 0.002% 100.004% ( 870, 1300 ] 4 0.001% 100.005% ( 1300, 1900 ] 3 0.001% 100.005% ( 1900, 2900 ] 4 0.001% 100.006% ( 2900, 4400 ] 3 0.001% 100.007% ** Level 1 read latency histogram (micros): Count: 65398 Average: 2.3642 StdDev: 6.49 Min: 1 Median: 1.6341 Max: 1219 Percentiles: P50: 1.63 P75: 2.04 P99: 5.84 P99.9: 11.06 P99.99: 62.50 ------------------------------------------------------ [ 0, 1 ] 5264 8.049% 8.049% ## ( 1, 2 ] 43269 66.163% 74.212% ############# ( 2, 3 ] 12550 19.190% 93.402% #### ( 3, 4 ] 2073 3.170% 96.572% # ( 4, 6 ] 1724 2.636% 99.208% # ( 6, 10 ] 438 0.670% 99.878% ( 10, 15 ] 69 0.106% 99.983% ( 15, 22 ] 2 0.003% 99.986% ( 22, 34 ] 2 0.003% 99.989% ( 51, 76 ] 1 0.002% 99.991% ( 110, 170 ] 1 0.002% 99.992% ( 250, 380 ] 1 0.002% 99.994% ( 380, 580 ] 2 0.003% 99.997% ( 580, 870 ] 1 0.002% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31723 Average: 2.4179 StdDev: 45.50 Min: 1 Median: 1.2370 Max: 4596 Percentiles: P50: 1.24 P75: 1.66 P99: 3.63 P99.9: 9.87 P99.99: 2727.70 ------------------------------------------------------ [ 0, 1 ] 11372 35.848% 35.848% ####### ( 1, 2 ] 18945 59.720% 95.568% ############ ( 2, 3 ] 909 2.865% 98.433% # ( 3, 4 ] 284 0.895% 99.329% ( 4, 6 ] 99 0.312% 99.641% ( 6, 10 ] 85 0.268% 99.909% ( 10, 15 ] 15 0.047% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 1 0.003% 99.968% ( 380, 580 ] 1 0.003% 99.972% ( 580, 870 ] 1 0.003% 99.975% ( 870, 1300 ] 2 0.006% 99.981% ( 1300, 1900 ] 2 0.006% 99.987% ( 1900, 2900 ] 1 0.003% 99.991% ( 2900, 4400 ] 2 0.006% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28986 Average: 5.7634 StdDev: 117.67 Min: 1 Median: 1.6460 Max: 6793 Percentiles: P50: 1.65 P75: 2.12 P99: 6.85 P99.9: 872.01 P99.99: 6003.30 ------------------------------------------------------ [ 0, 1 ] 2571 8.870% 8.870% ## ( 1, 2 ] 18456 63.672% 72.542% ############# ( 2, 3 ] 5727 19.758% 92.300% #### ( 3, 4 ] 1043 3.598% 95.898% # ( 4, 6 ] 852 2.939% 98.837% # ( 6, 10 ] 221 0.762% 99.600% ( 10, 15 ] 55 0.190% 99.790% ( 15, 22 ] 9 0.031% 99.821% ( 22, 34 ] 8 0.028% 99.848% ( 76, 110 ] 1 0.003% 99.852% ( 110, 170 ] 5 0.017% 99.869% ( 170, 250 ] 2 0.007% 99.876% ( 250, 380 ] 1 0.003% 99.879% ( 380, 580 ] 5 0.017% 99.897% ( 580, 870 ] 1 0.003% 99.900% ( 870, 1300 ] 3 0.010% 99.910% ( 1300, 1900 ] 7 0.024% 99.934% ( 1900, 2900 ] 5 0.017% 99.952% ( 2900, 4400 ] 6 0.021% 99.972% ( 4400, 6600 ] 7 0.024% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3138.2286 StdDev: 1879.63 Min: 314 Median: 3221.4286 Max: 6336 Percentiles: P50: 3221.43 P75: 4995.83 P99: 6336.00 P99.9: 6336.00 P99.99: 6336.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 580, 870 ] 4 11.429% 17.143% ## ( 870, 1300 ] 3 8.571% 25.714% ## ( 1300, 1900 ] 3 8.571% 34.286% ## ( 1900, 2900 ] 4 11.429% 45.714% ## ( 2900, 4400 ] 7 20.000% 65.714% #### ( 4400, 6600 ] 12 34.286% 100.000% ####### ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.726 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.362 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/06-14:32:13 ... thread 0: (1000000,3000000) ops and (337715.6,338638.0) ops/second in (2.961071,8.859017) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/15 2.34 GB 0.0 1.6 0.0 1.6 4.4 2.8 0.0 1.6 116.6 318.2 14.05 13.09 45 0.312 1663K 1734 0.0 0.0 L1 1/1 2.64 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 249.9 249.6 1.26 1.21 1 1.260 319K 354 0.0 0.0 L2 2/0 55.48 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 254.6 254.5 0.49 0.48 1 0.495 127K 46 0.0 0.0 L3 46/0 994.62 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.2 1.3 192.6 192.4 2.57 2.13 2 1.286 502K 339 0.0 0.0 L4 140/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/16 98.90 GB 0.0 2.5 0.7 1.8 5.3 3.4 0.9 1.9 140.1 294.2 18.38 16.91 49 0.375 2613K 2473 0.0 0.0 Int 0/0 0.00 KB 0.0 2.5 0.7 1.8 5.3 3.4 0.7 1.9 140.1 294.2 18.38 16.91 49 0.375 2613K 2473 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.5 0.7 1.8 2.5 0.7 0.0 0.0 245.7 245.4 10.48 9.85 10 1.048 2613K 2473 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 358.8 7.90 7.07 39 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.28 GB write, 598.25 MB/s write, 2.51 GB read, 284.85 MB/s read, 18.4 seconds Interval compaction: 5.28 GB write, 610.17 MB/s write, 2.51 GB read, 290.52 MB/s read, 18.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 604811 Average: 2.0628 StdDev: 14.06 Min: 0 Median: 1.4011 Max: 4361 Percentiles: P50: 1.40 P75: 1.79 P99: 5.24 P99.9: 11.25 P99.99: 21.76 ------------------------------------------------------ [ 0, 1 ] 145943 24.130% 24.130% ##### ( 1, 2 ] 390113 64.502% 88.632% ############# ( 2, 3 ] 45276 7.486% 96.118% # ( 3, 4 ] 12724 2.104% 98.222% ( 4, 6 ] 7612 1.259% 99.480% ( 6, 10 ] 2380 0.394% 99.874% ( 10, 15 ] 633 0.105% 99.979% ( 15, 22 ] 72 0.012% 99.990% ( 22, 34 ] 14 0.002% 99.993% ( 34, 51 ] 7 0.001% 99.994% ( 51, 76 ] 4 0.001% 99.995% ( 76, 110 ] 1 0.000% 99.995% ( 110, 170 ] 11 0.002% 99.997% ( 170, 250 ] 15 0.002% 99.999% ( 250, 380 ] 14 0.002% 100.001% ( 380, 580 ] 14 0.002% 100.004% ( 580, 870 ] 19 0.003% 100.007% ( 870, 1300 ] 5 0.001% 100.008% ( 1300, 1900 ] 3 0.000% 100.008% ( 1900, 2900 ] 4 0.001% 100.009% ( 2900, 4400 ] 5 0.001% 100.010% ** Level 1 read latency histogram (micros): Count: 65399 Average: 2.3642 StdDev: 6.49 Min: 1 Median: 1.6341 Max: 1219 Percentiles: P50: 1.63 P75: 2.04 P99: 5.84 P99.9: 11.06 P99.99: 62.50 ------------------------------------------------------ [ 0, 1 ] 5264 8.049% 8.049% ## ( 1, 2 ] 43269 66.162% 74.211% ############# ( 2, 3 ] 12551 19.191% 93.402% #### ( 3, 4 ] 2073 3.170% 96.572% # ( 4, 6 ] 1724 2.636% 99.208% # ( 6, 10 ] 438 0.670% 99.878% ( 10, 15 ] 69 0.106% 99.983% ( 15, 22 ] 2 0.003% 99.986% ( 22, 34 ] 2 0.003% 99.989% ( 51, 76 ] 1 0.002% 99.991% ( 110, 170 ] 1 0.002% 99.992% ( 250, 380 ] 1 0.002% 99.994% ( 380, 580 ] 2 0.003% 99.997% ( 580, 870 ] 1 0.002% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31723 Average: 2.4179 StdDev: 45.50 Min: 1 Median: 1.2370 Max: 4596 Percentiles: P50: 1.24 P75: 1.66 P99: 3.63 P99.9: 9.87 P99.99: 2727.70 ------------------------------------------------------ [ 0, 1 ] 11372 35.848% 35.848% ####### ( 1, 2 ] 18945 59.720% 95.568% ############ ( 2, 3 ] 909 2.865% 98.433% # ( 3, 4 ] 284 0.895% 99.329% ( 4, 6 ] 99 0.312% 99.641% ( 6, 10 ] 85 0.268% 99.909% ( 10, 15 ] 15 0.047% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 1 0.003% 99.968% ( 380, 580 ] 1 0.003% 99.972% ( 580, 870 ] 1 0.003% 99.975% ( 870, 1300 ] 2 0.006% 99.981% ( 1300, 1900 ] 2 0.006% 99.987% ( 1900, 2900 ] 1 0.003% 99.991% ( 2900, 4400 ] 2 0.006% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28986 Average: 5.7634 StdDev: 117.67 Min: 1 Median: 1.6460 Max: 6793 Percentiles: P50: 1.65 P75: 2.12 P99: 6.85 P99.9: 872.01 P99.99: 6003.30 ------------------------------------------------------ [ 0, 1 ] 2571 8.870% 8.870% ## ( 1, 2 ] 18456 63.672% 72.542% ############# ( 2, 3 ] 5727 19.758% 92.300% #### ( 3, 4 ] 1043 3.598% 95.898% # ( 4, 6 ] 852 2.939% 98.837% # ( 6, 10 ] 221 0.762% 99.600% ( 10, 15 ] 55 0.190% 99.790% ( 15, 22 ] 9 0.031% 99.821% ( 22, 34 ] 8 0.028% 99.848% ( 76, 110 ] 1 0.003% 99.852% ( 110, 170 ] 5 0.017% 99.869% ( 170, 250 ] 2 0.007% 99.876% ( 250, 380 ] 1 0.003% 99.879% ( 380, 580 ] 5 0.017% 99.897% ( 580, 870 ] 1 0.003% 99.900% ( 870, 1300 ] 3 0.010% 99.910% ( 1300, 1900 ] 7 0.024% 99.934% ( 1900, 2900 ] 5 0.017% 99.952% ( 2900, 4400 ] 6 0.021% 99.972% ( 4400, 6600 ] 7 0.024% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3138.2286 StdDev: 1879.63 Min: 314 Median: 3221.4286 Max: 6336 Percentiles: P50: 3221.43 P75: 4995.83 P99: 6336.00 P99.9: 6336.00 P99.99: 6336.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 580, 870 ] 4 11.429% 17.143% ## ( 870, 1300 ] 3 8.571% 25.714% ## ( 1300, 1900 ] 3 8.571% 34.286% ## ( 1900, 2900 ] 4 11.429% 45.714% ## ( 2900, 4400 ] 7 20.000% 65.714% #### ( 4400, 6600 ] 12 34.286% 100.000% ####### ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.72 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.119 H:M:S, 12.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.393 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-14:32:17 ... thread 0: (1000000,4000000) ops and (278772.1,321383.9) ops/second in (3.587159,12.446176) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.32 GB 107.0 2.6 0.0 2.6 6.4 3.7 0.0 1.7 129.0 311.9 20.99 19.63 65 0.323 2750K 2873 0.0 0.0 L1 1/1 2.64 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 249.9 249.6 1.26 1.21 1 1.260 319K 354 0.0 0.0 L2 2/0 55.48 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 254.6 254.5 0.49 0.48 1 0.495 127K 46 0.0 0.0 L3 46/0 994.62 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.2 1.3 192.6 192.4 2.57 2.13 2 1.286 502K 339 0.0 0.0 L4 140/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/16 99.89 GB 0.0 3.6 0.7 2.9 7.3 4.4 0.9 1.9 144.0 295.6 25.32 23.45 69 0.367 3701K 3612 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 0.7 2.9 7.3 4.4 0.7 1.9 144.0 295.6 25.32 23.45 69 0.367 3701K 3612 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 0.7 2.9 3.6 0.7 0.0 0.0 250.3 250.0 14.56 13.85 14 1.040 3701K 3612 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 357.2 10.76 9.60 55 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.6 total, 12.4 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.31 GB write, 592.85 MB/s write, 3.56 GB read, 288.74 MB/s read, 25.3 seconds Interval compaction: 7.31 GB write, 601.25 MB/s write, 3.56 GB read, 292.84 MB/s read, 25.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 14, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1075886 Average: 2.1907 StdDev: 12.04 Min: 0 Median: 1.4811 Max: 4361 Percentiles: P50: 1.48 P75: 1.86 P99: 5.55 P99.9: 11.40 P99.99: 18.05 ------------------------------------------------------ [ 0, 1 ] 198233 18.425% 18.425% #### ( 1, 2 ] 706048 65.625% 84.050% ############# ( 2, 3 ] 117364 10.909% 94.958% ## ( 3, 4 ] 28557 2.654% 97.613% # ( 4, 6 ] 19273 1.791% 99.404% ( 6, 10 ] 4977 0.463% 99.867% ( 10, 15 ] 1279 0.119% 99.986% ( 15, 22 ] 111 0.010% 99.996% ( 22, 34 ] 23 0.002% 99.998% ( 34, 51 ] 10 0.001% 99.999% ( 51, 76 ] 6 0.001% 100.000% ( 76, 110 ] 23 0.002% 100.002% ( 110, 170 ] 85 0.008% 100.010% ( 170, 250 ] 52 0.005% 100.014% ( 250, 380 ] 18 0.002% 100.016% ( 380, 580 ] 40 0.004% 100.020% ( 580, 870 ] 31 0.003% 100.023% ( 870, 1300 ] 14 0.001% 100.024% ( 1300, 1900 ] 5 0.000% 100.024% ( 1900, 2900 ] 5 0.000% 100.025% ( 2900, 4400 ] 5 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 65399 Average: 2.3642 StdDev: 6.49 Min: 1 Median: 1.6341 Max: 1219 Percentiles: P50: 1.63 P75: 2.04 P99: 5.84 P99.9: 11.06 P99.99: 62.50 ------------------------------------------------------ [ 0, 1 ] 5264 8.049% 8.049% ## ( 1, 2 ] 43269 66.162% 74.211% ############# ( 2, 3 ] 12551 19.191% 93.402% #### ( 3, 4 ] 2073 3.170% 96.572% # ( 4, 6 ] 1724 2.636% 99.208% # ( 6, 10 ] 438 0.670% 99.878% ( 10, 15 ] 69 0.106% 99.983% ( 15, 22 ] 2 0.003% 99.986% ( 22, 34 ] 2 0.003% 99.989% ( 51, 76 ] 1 0.002% 99.991% ( 110, 170 ] 1 0.002% 99.992% ( 250, 380 ] 1 0.002% 99.994% ( 380, 580 ] 2 0.003% 99.997% ( 580, 870 ] 1 0.002% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31723 Average: 2.4179 StdDev: 45.50 Min: 1 Median: 1.2370 Max: 4596 Percentiles: P50: 1.24 P75: 1.66 P99: 3.63 P99.9: 9.87 P99.99: 2727.70 ------------------------------------------------------ [ 0, 1 ] 11372 35.848% 35.848% ####### ( 1, 2 ] 18945 59.720% 95.568% ############ ( 2, 3 ] 909 2.865% 98.433% # ( 3, 4 ] 284 0.895% 99.329% ( 4, 6 ] 99 0.312% 99.641% ( 6, 10 ] 85 0.268% 99.909% ( 10, 15 ] 15 0.047% 99.956% ( 15, 22 ] 2 0.006% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 1 0.003% 99.968% ( 380, 580 ] 1 0.003% 99.972% ( 580, 870 ] 1 0.003% 99.975% ( 870, 1300 ] 2 0.006% 99.981% ( 1300, 1900 ] 2 0.006% 99.987% ( 1900, 2900 ] 1 0.003% 99.991% ( 2900, 4400 ] 2 0.006% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28986 Average: 5.7634 StdDev: 117.67 Min: 1 Median: 1.6460 Max: 6793 Percentiles: P50: 1.65 P75: 2.12 P99: 6.85 P99.9: 872.01 P99.99: 6003.30 ------------------------------------------------------ [ 0, 1 ] 2571 8.870% 8.870% ## ( 1, 2 ] 18456 63.672% 72.542% ############# ( 2, 3 ] 5727 19.758% 92.300% #### ( 3, 4 ] 1043 3.598% 95.898% # ( 4, 6 ] 852 2.939% 98.837% # ( 6, 10 ] 221 0.762% 99.600% ( 10, 15 ] 55 0.190% 99.790% ( 15, 22 ] 9 0.031% 99.821% ( 22, 34 ] 8 0.028% 99.848% ( 76, 110 ] 1 0.003% 99.852% ( 110, 170 ] 5 0.017% 99.869% ( 170, 250 ] 2 0.007% 99.876% ( 250, 380 ] 1 0.003% 99.879% ( 380, 580 ] 5 0.017% 99.897% ( 580, 870 ] 1 0.003% 99.900% ( 870, 1300 ] 3 0.010% 99.910% ( 1300, 1900 ] 7 0.024% 99.934% ( 1900, 2900 ] 5 0.017% 99.952% ( 2900, 4400 ] 6 0.021% 99.972% ( 4400, 6600 ] 7 0.024% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3138.2286 StdDev: 1879.63 Min: 314 Median: 3221.4286 Max: 6336 Percentiles: P50: 3221.43 P75: 4995.83 P99: 6336.00 P99.9: 6336.00 P99.99: 6336.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 580, 870 ] 4 11.429% 17.143% ## ( 870, 1300 ] 3 8.571% 25.714% ## ( 1300, 1900 ] 3 8.571% 34.286% ## ( 1900, 2900 ] 4 11.429% 45.714% ## ( 2900, 4400 ] 7 20.000% 65.714% #### ( 4400, 6600 ] 12 34.286% 100.000% ####### ** DB Stats ** Uptime(secs): 12.6 total, 3.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 311.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.999 H:M:S, 15.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.880 H:M:S, 24.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-14:32:23 ... thread 0: (1000000,5000000) ops and (154598.1,264346.6) ops/second in (6.468385,18.914561) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 2.21 GB 62.9 3.4 0.0 3.4 8.1 4.7 0.0 1.7 127.9 304.4 27.10 24.96 82 0.330 3518K 3599 0.0 0.0 L1 4/3 385.62 MB 1.9 2.3 2.3 0.1 2.3 2.3 0.2 1.0 232.4 230.5 10.30 9.95 2 5.151 2431K 19K 0.0 0.0 L2 5/4 441.81 MB 1.3 0.1 0.1 0.1 0.1 0.1 2.0 2.0 254.6 254.5 0.49 0.48 1 0.495 127K 46 0.0 0.0 L3 39/16 1.77 GB 0.9 1.1 0.9 0.2 1.1 0.9 0.9 1.2 171.4 171.1 6.55 5.08 6 1.092 1038K 339 0.0 0.0 L4 154/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/33 100.79 GB 0.0 6.9 3.2 3.7 11.6 7.9 4.1 2.5 159.9 267.1 44.45 40.46 91 0.488 7116K 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.9 3.2 3.7 11.6 7.9 3.9 2.5 159.9 267.1 44.45 40.46 91 0.488 7116K 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.9 3.2 3.7 6.9 3.2 0.0 0.0 232.9 232.0 30.53 28.39 22 1.388 7116K 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 344.0 13.92 12.07 69 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.1 total, 18.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.59 GB write, 621.75 MB/s write, 6.94 GB read, 372.36 MB/s read, 44.4 seconds Interval compaction: 11.59 GB write, 627.55 MB/s write, 6.94 GB read, 375.84 MB/s read, 44.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 22, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1799081 Average: 2.3830 StdDev: 15.01 Min: 0 Median: 1.5410 Max: 4972 Percentiles: P50: 1.54 P75: 1.93 P99: 5.96 P99.9: 13.10 P99.99: 132.44 ------------------------------------------------------ [ 0, 1 ] 273246 15.188% 15.188% ### ( 1, 2 ] 1157647 64.347% 79.535% ############# ( 2, 3 ] 238037 13.231% 92.766% ### ( 3, 4 ] 62521 3.475% 96.241% # ( 4, 6 ] 50758 2.821% 99.062% # ( 6, 10 ] 13289 0.739% 99.801% ( 10, 15 ] 2881 0.160% 99.961% ( 15, 22 ] 265 0.015% 99.976% ( 22, 34 ] 29 0.002% 99.977% ( 34, 51 ] 13 0.001% 99.978% ( 51, 76 ] 9 0.001% 99.979% ( 76, 110 ] 101 0.006% 99.984% ( 110, 170 ] 281 0.016% 100.000% ( 170, 250 ] 170 0.009% 100.009% ( 250, 380 ] 70 0.004% 100.013% ( 380, 580 ] 92 0.005% 100.018% ( 580, 870 ] 67 0.004% 100.022% ( 870, 1300 ] 27 0.002% 100.023% ( 1300, 1900 ] 10 0.001% 100.024% ( 1900, 2900 ] 16 0.001% 100.025% ( 2900, 4400 ] 12 0.001% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 321691 Average: 3.5502 StdDev: 33.01 Min: 1 Median: 2.0180 Max: 5543 Percentiles: P50: 2.02 P75: 2.87 P99: 8.46 P99.9: 13.92 P99.99: 18.07 ------------------------------------------------------ [ 0, 1 ] 6592 2.049% 2.049% ( 1, 2 ] 152557 47.423% 49.473% ######### ( 2, 3 ] 94558 29.394% 78.867% ###### ( 3, 4 ] 29396 9.138% 88.005% ## ( 4, 6 ] 32154 9.995% 98.000% ## ( 6, 10 ] 5223 1.624% 99.624% ( 10, 15 ] 1136 0.353% 99.977% ( 15, 22 ] 100 0.031% 100.008% ( 22, 34 ] 6 0.002% 100.010% ( 34, 51 ] 2 0.001% 100.010% ( 51, 76 ] 3 0.001% 100.011% ( 76, 110 ] 33 0.010% 100.021% ( 110, 170 ] 41 0.013% 100.034% ( 170, 250 ] 38 0.012% 100.046% ( 250, 380 ] 38 0.012% 100.058% ( 380, 580 ] 49 0.015% 100.073% ( 580, 870 ] 32 0.010% 100.083% ( 870, 1300 ] 22 0.007% 100.090% ( 1300, 1900 ] 11 0.003% 100.093% ( 1900, 2900 ] 24 0.007% 100.101% ( 2900, 4400 ] 6 0.002% 100.103% ( 4400, 6600 ] 1 0.000% 100.103% ** Level 2 read latency histogram (micros): Count: 31855 Average: 4.3318 StdDev: 79.53 Min: 1 Median: 1.2404 Max: 4923 Percentiles: P50: 1.24 P75: 1.66 P99: 3.91 P99.9: 729.21 P99.99: 4353.62 ------------------------------------------------------ [ 0, 1 ] 11372 35.699% 35.699% ####### ( 1, 2 ] 18953 59.498% 95.197% ############ ( 2, 3 ] 945 2.967% 98.164% # ( 3, 4 ] 294 0.923% 99.086% ( 4, 6 ] 111 0.348% 99.435% ( 6, 10 ] 87 0.273% 99.708% ( 10, 15 ] 15 0.047% 99.755% ( 15, 22 ] 2 0.006% 99.761% ( 110, 170 ] 9 0.028% 99.790% ( 170, 250 ] 5 0.016% 99.805% ( 250, 380 ] 11 0.035% 99.840% ( 380, 580 ] 14 0.044% 99.884% ( 580, 870 ] 10 0.031% 99.915% ( 870, 1300 ] 10 0.031% 99.947% ( 1300, 1900 ] 2 0.006% 99.953% ( 1900, 2900 ] 6 0.019% 99.972% ( 2900, 4400 ] 6 0.019% 99.991% ( 4400, 6600 ] 3 0.009% 100.000% ** Level 3 read latency histogram (micros): Count: 163965 Average: 9.5508 StdDev: 109.17 Min: 0 Median: 1.9895 Max: 10927 Percentiles: P50: 1.99 P75: 2.89 P99: 91.20 P99.9: 1178.96 P99.99: 2857.21 ------------------------------------------------------ [ 0, 1 ] 3803 2.319% 2.319% ( 1, 2 ] 79013 48.189% 50.508% ########## ( 2, 3 ] 44928 27.401% 77.909% ##### ( 3, 4 ] 15153 9.242% 87.151% ## ( 4, 6 ] 14641 8.929% 96.080% ## ( 6, 10 ] 3905 2.382% 98.462% ( 10, 15 ] 746 0.455% 98.917% ( 15, 22 ] 98 0.060% 98.977% ( 22, 34 ] 11 0.007% 98.983% ( 34, 51 ] 3 0.002% 98.985% ( 51, 76 ] 2 0.001% 98.986% ( 76, 110 ] 50 0.030% 99.017% ( 110, 170 ] 299 0.182% 99.199% ( 170, 250 ] 254 0.155% 99.354% ( 250, 380 ] 304 0.185% 99.540% ( 380, 580 ] 303 0.185% 99.724% ( 580, 870 ] 209 0.127% 99.852% ( 870, 1300 ] 110 0.067% 99.919% ( 1300, 1900 ] 63 0.038% 99.957% ( 1900, 2900 ] 56 0.034% 99.991% ( 2900, 4400 ] 49 0.030% 100.021% ( 4400, 6600 ] 11 0.007% 100.028% ( 6600, 9900 ] 1 0.001% 100.029% ( 9900, 14000 ] 1 0.001% 100.029% ** Level 4 read latency histogram (micros): Count: 35 Average: 3138.2286 StdDev: 1879.63 Min: 314 Median: 3221.4286 Max: 6336 Percentiles: P50: 3221.43 P75: 4995.83 P99: 6336.00 P99.9: 6336.00 P99.99: 6336.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 580, 870 ] 4 11.429% 17.143% ## ( 870, 1300 ] 3 8.571% 25.714% ## ( 1300, 1900 ] 3 8.571% 34.286% ## ( 1900, 2900 ] 4 11.429% 45.714% ## ( 2900, 4400 ] 7 20.000% 65.714% #### ( 4400, 6600 ] 12 34.286% 100.000% ####### ** Level 5 read latency histogram (micros): Count: 20 Average: 1659.2000 StdDev: 1811.52 Min: 154 Median: 725.0000 Max: 7061 Percentiles: P50: 725.00 P75: 2900.00 P99: 7061.00 P99.9: 7061.00 P99.99: 7061.00 ------------------------------------------------------ ( 110, 170 ] 2 10.000% 10.000% ## ( 170, 250 ] 5 25.000% 35.000% ##### ( 380, 580 ] 2 10.000% 45.000% ## ( 580, 870 ] 2 10.000% 55.000% ## ( 1300, 1900 ] 1 5.000% 60.000% # ( 1900, 2900 ] 3 15.000% 75.000% ### ( 2900, 4400 ] 4 20.000% 95.000% #### ( 6600, 9900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 19.1 total, 6.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 257.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.512 H:M:S, 28.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 152.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.513 H:M:S, 54.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/06-14:32:28 ... thread 0: (1000000,6000000) ops and (238719.8,259700.1) ops/second in (4.189012,23.103573) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 3.19 GB 50.4 5.3 0.0 5.3 10.9 5.6 0.0 1.9 137.8 284.9 39.31 35.29 98 0.401 5499K 11K 0.0 0.0 L1 1/1 19.34 MB 0.0 2.3 2.3 0.1 2.3 2.3 0.2 1.0 232.4 230.5 10.30 9.95 2 5.151 2431K 19K 0.0 0.0 L2 2/0 72.71 MB 0.7 0.5 0.4 0.1 0.5 0.4 2.0 1.3 213.9 213.4 2.56 2.33 2 1.278 555K 1186 0.0 0.0 L3 16/0 992.55 MB 1.0 2.7 1.6 1.1 2.7 1.6 0.9 1.7 157.5 157.3 17.81 12.45 15 1.187 2711K 1874 0.0 0.0 L4 166/0 9.54 GB 1.0 0.6 0.5 0.1 0.6 0.5 1.6 1.1 141.1 140.8 4.41 2.94 9 0.490 603K 888 0.0 0.0 L5 1064/0 87.97 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1264/12 101.76 GB 0.0 11.5 4.8 6.7 17.1 10.4 6.8 3.0 158.4 235.8 74.39 62.96 126 0.590 11M 35K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.5 4.8 6.7 17.1 10.4 6.6 3.0 158.4 235.8 74.39 62.96 126 0.590 11M 35K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.5 4.8 6.7 11.5 4.8 0.0 0.0 207.9 207.2 56.68 48.22 44 1.288 11M 35K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 327.3 17.71 14.74 82 0.216 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.3 total, 23.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.13 GB write, 753.49 MB/s write, 11.51 GB read, 506.23 MB/s read, 74.4 seconds Interval compaction: 17.13 GB write, 759.24 MB/s write, 11.51 GB read, 510.10 MB/s read, 74.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 39, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2203393 Average: 2.4943 StdDev: 18.50 Min: 0 Median: 1.5763 Max: 5698 Percentiles: P50: 1.58 P75: 1.97 P99: 6.35 P99.9: 13.28 P99.99: 134.05 ------------------------------------------------------ [ 0, 1 ] 298746 13.558% 13.558% ### ( 1, 2 ] 1393210 63.230% 76.789% ############# ( 2, 3 ] 326130 14.801% 91.590% ### ( 3, 4 ] 86287 3.916% 95.506% # ( 4, 6 ] 75303 3.418% 98.924% # ( 6, 10 ] 19013 0.863% 99.787% ( 10, 15 ] 3813 0.173% 99.960% ( 15, 22 ] 347 0.016% 99.975% ( 22, 34 ] 35 0.002% 99.977% ( 34, 51 ] 15 0.001% 99.978% ( 51, 76 ] 13 0.001% 99.978% ( 76, 110 ] 137 0.006% 99.984% ( 110, 170 ] 311 0.014% 99.999% ( 170, 250 ] 214 0.010% 100.008% ( 250, 380 ] 107 0.005% 100.013% ( 380, 580 ] 130 0.006% 100.019% ( 580, 870 ] 90 0.004% 100.023% ( 870, 1300 ] 44 0.002% 100.025% ( 1300, 1900 ] 16 0.001% 100.026% ( 1900, 2900 ] 23 0.001% 100.027% ( 2900, 4400 ] 21 0.001% 100.028% ( 4400, 6600 ] 6 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 401060 Average: 4.3317 StdDev: 65.62 Min: 1 Median: 2.0795 Max: 11301 Percentiles: P50: 2.08 P75: 2.92 P99: 8.82 P99.9: 14.58 P99.99: 155.19 ------------------------------------------------------ [ 0, 1 ] 6841 1.706% 1.706% ( 1, 2 ] 184165 45.920% 47.625% ######### ( 2, 3 ] 119804 29.872% 77.497% ###### ( 3, 4 ] 38499 9.599% 87.096% ## ( 4, 6 ] 42498 10.596% 97.693% ## ( 6, 10 ] 7429 1.852% 99.545% ( 10, 15 ] 1553 0.387% 99.932% ( 15, 22 ] 150 0.037% 99.970% ( 22, 34 ] 7 0.002% 99.972% ( 34, 51 ] 2 0.000% 99.972% ( 51, 76 ] 4 0.001% 99.973% ( 76, 110 ] 34 0.008% 99.982% ( 110, 170 ] 45 0.011% 99.993% ( 170, 250 ] 51 0.013% 100.005% ( 250, 380 ] 62 0.015% 100.021% ( 380, 580 ] 80 0.020% 100.041% ( 580, 870 ] 62 0.015% 100.056% ( 870, 1300 ] 45 0.011% 100.068% ( 1300, 1900 ] 25 0.006% 100.074% ( 1900, 2900 ] 45 0.011% 100.085% ( 2900, 4400 ] 24 0.006% 100.091% ( 4400, 6600 ] 15 0.004% 100.095% ( 6600, 9900 ] 5 0.001% 100.096% ( 9900, 14000 ] 2 0.000% 100.096% ** Level 2 read latency histogram (micros): Count: 164122 Average: 3.8333 StdDev: 46.77 Min: 1 Median: 1.8534 Max: 4923 Percentiles: P50: 1.85 P75: 2.76 P99: 8.75 P99.9: 18.48 P99.99: 358.10 ------------------------------------------------------ [ 0, 1 ] 14812 9.025% 9.025% ## ( 1, 2 ] 78799 48.012% 57.037% ########## ( 2, 3 ] 38920 23.714% 80.752% ##### ( 3, 4 ] 13238 8.066% 88.817% ## ( 4, 6 ] 14735 8.978% 97.796% ## ( 6, 10 ] 2873 1.751% 99.546% ( 10, 15 ] 555 0.338% 99.884% ( 15, 22 ] 52 0.032% 99.916% ( 22, 34 ] 5 0.003% 99.919% ( 34, 51 ] 1 0.001% 99.920% ( 51, 76 ] 1 0.001% 99.920% ( 76, 110 ] 2 0.001% 99.921% ( 110, 170 ] 44 0.027% 99.948% ( 170, 250 ] 32 0.019% 99.968% ( 250, 380 ] 44 0.027% 99.995% ( 380, 580 ] 40 0.024% 100.019% ( 580, 870 ] 24 0.015% 100.034% ( 870, 1300 ] 20 0.012% 100.046% ( 1300, 1900 ] 6 0.004% 100.049% ( 1900, 2900 ] 13 0.008% 100.057% ( 2900, 4400 ] 11 0.007% 100.064% ( 4400, 6600 ] 3 0.002% 100.066% ** Level 3 read latency histogram (micros): Count: 411130 Average: 10.6599 StdDev: 133.19 Min: 0 Median: 2.1140 Max: 11908 Percentiles: P50: 2.11 P75: 2.96 P99: 12.21 P99.9: 919.98 P99.99: 1383.73 ------------------------------------------------------ [ 0, 1 ] 5347 1.301% 1.301% ( 1, 2 ] 186326 45.320% 46.621% ######### ( 2, 3 ] 121907 29.652% 76.273% ###### ( 3, 4 ] 41196 10.020% 86.293% ## ( 4, 6 ] 42163 10.255% 96.548% ## ( 6, 10 ] 9237 2.247% 98.795% ( 10, 15 ] 1910 0.465% 99.260% ( 15, 22 ] 225 0.055% 99.314% ( 22, 34 ] 18 0.004% 99.319% ( 34, 51 ] 17 0.004% 99.323% ( 51, 76 ] 7 0.002% 99.325% ( 76, 110 ] 63 0.015% 99.340% ( 110, 170 ] 364 0.089% 99.428% ( 170, 250 ] 361 0.088% 99.516% ( 250, 380 ] 477 0.116% 99.632% ( 380, 580 ] 550 0.134% 99.766% ( 580, 870 ] 506 0.123% 99.889% ( 870, 1300 ] 386 0.094% 99.983% ( 1300, 1900 ] 207 0.050% 100.033% ( 1900, 2900 ] 204 0.050% 100.083% ( 2900, 4400 ] 175 0.043% 100.126% ( 4400, 6600 ] 60 0.015% 100.140% ( 6600, 9900 ] 12 0.003% 100.143% ( 9900, 14000 ] 2 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 150 Average: 884.7333 StdDev: 1649.52 Min: 1 Median: 5.6000 Max: 6336 Percentiles: P50: 5.60 P75: 849.29 P99: 6336.00 P99.9: 6336.00 P99.99: 6336.00 ------------------------------------------------------ [ 0, 1 ] 17 11.333% 11.333% ## ( 1, 2 ] 35 23.333% 34.667% ##### ( 2, 3 ] 17 11.333% 46.000% ## ( 3, 4 ] 2 1.333% 47.333% ( 4, 6 ] 5 3.333% 50.667% # ( 6, 10 ] 1 0.667% 51.333% ( 10, 15 ] 2 1.333% 52.667% ( 15, 22 ] 2 1.333% 54.000% ( 22, 34 ] 4 2.667% 56.667% # ( 76, 110 ] 2 1.333% 58.000% ( 110, 170 ] 14 9.333% 67.333% ## ( 250, 380 ] 2 1.333% 68.667% ( 380, 580 ] 3 2.000% 70.667% ( 580, 870 ] 7 4.667% 75.333% # ( 870, 1300 ] 5 3.333% 78.667% # ( 1300, 1900 ] 6 4.000% 82.667% # ( 1900, 2900 ] 6 4.000% 86.667% # ( 2900, 4400 ] 7 4.667% 91.333% # ( 4400, 6600 ] 13 8.667% 100.000% ## ** Level 5 read latency histogram (micros): Count: 120 Average: 1268.4000 StdDev: 1394.34 Min: 81 Median: 621.4286 Max: 7061 Percentiles: P50: 621.43 P75: 2011.11 P99: 6380.00 P99.9: 7061.00 P99.99: 7061.00 ------------------------------------------------------ ( 76, 110 ] 2 1.667% 1.667% ( 110, 170 ] 17 14.167% 15.833% ### ( 170, 250 ] 15 12.500% 28.333% ### ( 250, 380 ] 11 9.167% 37.500% ## ( 380, 580 ] 13 10.833% 48.333% ## ( 580, 870 ] 14 11.667% 60.000% ## ( 870, 1300 ] 7 5.833% 65.833% # ( 1300, 1900 ] 10 8.333% 74.167% ## ( 1900, 2900 ] 9 7.500% 81.667% ## ( 2900, 4400 ] 19 15.833% 97.500% ### ( 4400, 6600 ] 2 1.667% 99.167% ( 6600, 9900 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 23.3 total, 4.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 253.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.886 H:M:S, 29.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 234.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.374 H:M:S, 32.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-14:32:31 ... thread 0: (1000000,7000000) ops and (322664.6,267147.4) ops/second in (3.099193,26.202766) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 4.11 GB 144.7 6.4 0.0 6.4 13.0 6.6 0.0 2.0 141.0 285.8 46.46 42.03 115 0.404 6651K 12K 0.0 0.0 L1 1/1 19.34 MB 0.0 2.3 2.3 0.1 2.3 2.3 0.2 1.0 232.4 230.5 10.30 9.95 2 5.151 2431K 19K 0.0 0.0 L2 2/0 72.71 MB 0.7 0.5 0.4 0.1 0.5 0.4 2.0 1.3 213.9 213.4 2.56 2.33 2 1.278 555K 1186 0.0 0.0 L3 16/0 992.55 MB 1.0 2.7 1.6 1.1 2.7 1.6 0.9 1.7 157.5 157.3 17.81 12.45 15 1.187 2711K 1874 0.0 0.0 L4 166/0 9.54 GB 1.0 0.6 0.5 0.1 0.6 0.5 1.6 1.1 141.1 140.8 4.41 2.94 9 0.490 603K 888 0.0 0.0 L5 1064/0 87.97 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/12 102.68 GB 0.0 12.6 4.8 7.8 19.2 11.4 6.8 2.9 158.5 240.6 81.53 69.71 143 0.570 12M 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.6 4.8 7.8 19.2 11.4 6.6 2.9 158.5 240.6 81.53 69.71 143 0.570 12M 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.6 4.8 7.8 12.6 4.8 0.0 0.0 211.4 210.8 61.10 52.56 48 1.273 12M 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 329.9 20.43 17.15 95 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.4 total, 26.2 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.16 GB write, 743.72 MB/s write, 12.62 GB read, 489.74 MB/s read, 81.5 seconds Interval compaction: 19.16 GB write, 748.73 MB/s write, 12.62 GB read, 493.04 MB/s read, 81.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 44, interval: 57 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2632603 Average: 2.4924 StdDev: 17.39 Min: 0 Median: 1.5892 Max: 5698 Percentiles: P50: 1.59 P75: 1.98 P99: 6.41 P99.9: 13.05 P99.99: 102.39 ------------------------------------------------------ [ 0, 1 ] 333454 12.666% 12.666% ### ( 1, 2 ] 1668202 63.367% 76.033% ############# ( 2, 3 ] 410448 15.591% 91.624% ### ( 3, 4 ] 102059 3.877% 95.501% # ( 4, 6 ] 89694 3.407% 98.908% # ( 6, 10 ] 23374 0.888% 99.796% ( 10, 15 ] 4496 0.171% 99.967% ( 15, 22 ] 409 0.016% 99.982% ( 22, 34 ] 39 0.001% 99.984% ( 34, 51 ] 17 0.001% 99.984% ( 51, 76 ] 15 0.001% 99.985% ( 76, 110 ] 171 0.006% 99.991% ( 110, 170 ] 332 0.013% 100.004% ( 170, 250 ] 234 0.009% 100.013% ( 250, 380 ] 126 0.005% 100.018% ( 380, 580 ] 148 0.006% 100.023% ( 580, 870 ] 99 0.004% 100.027% ( 870, 1300 ] 51 0.002% 100.029% ( 1300, 1900 ] 18 0.001% 100.030% ( 1900, 2900 ] 24 0.001% 100.031% ( 2900, 4400 ] 22 0.001% 100.031% ( 4400, 6600 ] 6 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 401060 Average: 4.3317 StdDev: 65.62 Min: 1 Median: 2.0795 Max: 11301 Percentiles: P50: 2.08 P75: 2.92 P99: 8.82 P99.9: 14.58 P99.99: 155.19 ------------------------------------------------------ [ 0, 1 ] 6841 1.706% 1.706% ( 1, 2 ] 184165 45.920% 47.625% ######### ( 2, 3 ] 119804 29.872% 77.497% ###### ( 3, 4 ] 38499 9.599% 87.096% ## ( 4, 6 ] 42498 10.596% 97.693% ## ( 6, 10 ] 7429 1.852% 99.545% ( 10, 15 ] 1553 0.387% 99.932% ( 15, 22 ] 150 0.037% 99.970% ( 22, 34 ] 7 0.002% 99.972% ( 34, 51 ] 2 0.000% 99.972% ( 51, 76 ] 4 0.001% 99.973% ( 76, 110 ] 34 0.008% 99.982% ( 110, 170 ] 45 0.011% 99.993% ( 170, 250 ] 51 0.013% 100.005% ( 250, 380 ] 62 0.015% 100.021% ( 380, 580 ] 80 0.020% 100.041% ( 580, 870 ] 62 0.015% 100.056% ( 870, 1300 ] 45 0.011% 100.068% ( 1300, 1900 ] 25 0.006% 100.074% ( 1900, 2900 ] 45 0.011% 100.085% ( 2900, 4400 ] 24 0.006% 100.091% ( 4400, 6600 ] 15 0.004% 100.095% ( 6600, 9900 ] 5 0.001% 100.096% ( 9900, 14000 ] 2 0.000% 100.096% ** Level 2 read latency histogram (micros): Count: 164122 Average: 3.8333 StdDev: 46.77 Min: 1 Median: 1.8534 Max: 4923 Percentiles: P50: 1.85 P75: 2.76 P99: 8.75 P99.9: 18.48 P99.99: 358.10 ------------------------------------------------------ [ 0, 1 ] 14812 9.025% 9.025% ## ( 1, 2 ] 78799 48.012% 57.037% ########## ( 2, 3 ] 38920 23.714% 80.752% ##### ( 3, 4 ] 13238 8.066% 88.817% ## ( 4, 6 ] 14735 8.978% 97.796% ## ( 6, 10 ] 2873 1.751% 99.546% ( 10, 15 ] 555 0.338% 99.884% ( 15, 22 ] 52 0.032% 99.916% ( 22, 34 ] 5 0.003% 99.919% ( 34, 51 ] 1 0.001% 99.920% ( 51, 76 ] 1 0.001% 99.920% ( 76, 110 ] 2 0.001% 99.921% ( 110, 170 ] 44 0.027% 99.948% ( 170, 250 ] 32 0.019% 99.968% ( 250, 380 ] 44 0.027% 99.995% ( 380, 580 ] 40 0.024% 100.019% ( 580, 870 ] 24 0.015% 100.034% ( 870, 1300 ] 20 0.012% 100.046% ( 1300, 1900 ] 6 0.004% 100.049% ( 1900, 2900 ] 13 0.008% 100.057% ( 2900, 4400 ] 11 0.007% 100.064% ( 4400, 6600 ] 3 0.002% 100.066% ** Level 3 read latency histogram (micros): Count: 411130 Average: 10.6599 StdDev: 133.19 Min: 0 Median: 2.1140 Max: 11908 Percentiles: P50: 2.11 P75: 2.96 P99: 12.21 P99.9: 919.98 P99.99: 1383.73 ------------------------------------------------------ [ 0, 1 ] 5347 1.301% 1.301% ( 1, 2 ] 186326 45.320% 46.621% ######### ( 2, 3 ] 121907 29.652% 76.273% ###### ( 3, 4 ] 41196 10.020% 86.293% ## ( 4, 6 ] 42163 10.255% 96.548% ## ( 6, 10 ] 9237 2.247% 98.795% ( 10, 15 ] 1910 0.465% 99.260% ( 15, 22 ] 225 0.055% 99.314% ( 22, 34 ] 18 0.004% 99.319% ( 34, 51 ] 17 0.004% 99.323% ( 51, 76 ] 7 0.002% 99.325% ( 76, 110 ] 63 0.015% 99.340% ( 110, 170 ] 364 0.089% 99.428% ( 170, 250 ] 361 0.088% 99.516% ( 250, 380 ] 477 0.116% 99.632% ( 380, 580 ] 550 0.134% 99.766% ( 580, 870 ] 506 0.123% 99.889% ( 870, 1300 ] 386 0.094% 99.983% ( 1300, 1900 ] 207 0.050% 100.033% ( 1900, 2900 ] 204 0.050% 100.083% ( 2900, 4400 ] 175 0.043% 100.126% ( 4400, 6600 ] 60 0.015% 100.140% ( 6600, 9900 ] 12 0.003% 100.143% ( 9900, 14000 ] 2 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 150 Average: 884.7333 StdDev: 1649.52 Min: 1 Median: 5.6000 Max: 6336 Percentiles: P50: 5.60 P75: 849.29 P99: 6336.00 P99.9: 6336.00 P99.99: 6336.00 ------------------------------------------------------ [ 0, 1 ] 17 11.333% 11.333% ## ( 1, 2 ] 35 23.333% 34.667% ##### ( 2, 3 ] 17 11.333% 46.000% ## ( 3, 4 ] 2 1.333% 47.333% ( 4, 6 ] 5 3.333% 50.667% # ( 6, 10 ] 1 0.667% 51.333% ( 10, 15 ] 2 1.333% 52.667% ( 15, 22 ] 2 1.333% 54.000% ( 22, 34 ] 4 2.667% 56.667% # ( 76, 110 ] 2 1.333% 58.000% ( 110, 170 ] 14 9.333% 67.333% ## ( 250, 380 ] 2 1.333% 68.667% ( 380, 580 ] 3 2.000% 70.667% ( 580, 870 ] 7 4.667% 75.333% # ( 870, 1300 ] 5 3.333% 78.667% # ( 1300, 1900 ] 6 4.000% 82.667% # ( 1900, 2900 ] 6 4.000% 86.667% # ( 2900, 4400 ] 7 4.667% 91.333% # ( 4400, 6600 ] 13 8.667% 100.000% ## ** Level 5 read latency histogram (micros): Count: 120 Average: 1268.4000 StdDev: 1394.34 Min: 81 Median: 621.4286 Max: 7061 Percentiles: P50: 621.43 P75: 2011.11 P99: 6380.00 P99.9: 7061.00 P99.99: 7061.00 ------------------------------------------------------ ( 76, 110 ] 2 1.667% 1.667% ( 110, 170 ] 17 14.167% 15.833% ### ( 170, 250 ] 15 12.500% 28.333% ### ( 250, 380 ] 11 9.167% 37.500% ## ( 380, 580 ] 13 10.833% 48.333% ## ( 580, 870 ] 14 11.667% 60.000% ## ( 870, 1300 ] 7 5.833% 65.833% # ( 1300, 1900 ] 10 8.333% 74.167% ## ( 1900, 2900 ] 9 7.500% 81.667% ## ( 2900, 4400 ] 19 15.833% 97.500% ### ( 4400, 6600 ] 2 1.667% 99.167% ( 6600, 9900 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 26.4 total, 3.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 261.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.313 H:M:S, 27.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.427 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-14:32:35 ... thread 0: (1000000,8000000) ops and (208723.3,258116.2) ops/second in (4.791032,30.993798) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 5.09 GB 207.7 7.4 0.0 7.4 15.0 7.6 0.0 2.0 142.9 287.9 53.34 48.53 134 0.398 7738K 13K 0.0 0.0 L1 1/1 19.34 MB 0.0 2.3 2.3 0.1 2.3 2.3 0.2 1.0 232.4 230.5 10.30 9.95 2 5.151 2431K 19K 0.0 0.0 L2 2/0 72.71 MB 0.7 0.5 0.4 0.1 0.5 0.4 2.0 1.3 213.9 213.4 2.56 2.33 2 1.278 555K 1186 0.0 0.0 L3 16/0 992.55 MB 1.0 2.7 1.6 1.1 2.7 1.6 0.9 1.7 157.5 157.3 17.81 12.45 15 1.187 2711K 1874 0.0 0.0 L4 166/0 9.54 GB 1.0 0.6 0.5 0.1 0.6 0.5 1.6 1.1 141.1 140.8 4.41 2.94 9 0.490 603K 888 0.0 0.0 L5 1064/0 87.97 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/12 103.66 GB 0.0 13.7 4.8 8.8 21.2 12.3 6.8 2.8 158.2 245.4 88.42 76.21 162 0.546 14M 37K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.7 4.8 8.8 21.2 12.3 6.6 2.8 158.2 245.4 88.42 76.21 162 0.546 14M 37K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.7 4.8 8.8 13.6 4.8 0.0 0.0 214.7 214.1 65.16 56.54 52 1.253 14M 37K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 333.2 23.26 19.67 110 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.2 total, 31.0 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.19 GB write, 696.07 MB/s write, 13.66 GB read, 448.83 MB/s read, 88.4 seconds Interval compaction: 21.19 GB write, 700.03 MB/s write, 13.66 GB read, 451.38 MB/s read, 88.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 45, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3199354 Average: 2.4700 StdDev: 16.18 Min: 0 Median: 1.5893 Max: 5698 Percentiles: P50: 1.59 P75: 1.98 P99: 6.41 P99.9: 12.78 P99.99: 88.55 ------------------------------------------------------ [ 0, 1 ] 394737 12.338% 12.338% ## ( 1, 2 ] 2044733 63.911% 76.249% ############# ( 2, 3 ] 501015 15.660% 91.909% ### ( 3, 4 ] 119225 3.727% 95.635% # ( 4, 6 ] 104728 3.273% 98.909% # ( 6, 10 ] 28876 0.903% 99.811% ( 10, 15 ] 5106 0.160% 99.971% ( 15, 22 ] 459 0.014% 99.985% ( 22, 34 ] 43 0.001% 99.986% ( 34, 51 ] 20 0.001% 99.987% ( 51, 76 ] 18 0.001% 99.988% ( 76, 110 ] 206 0.006% 99.994% ( 110, 170 ] 404 0.013% 100.007% ( 170, 250 ] 265 0.008% 100.015% ( 250, 380 ] 144 0.005% 100.020% ( 380, 580 ] 167 0.005% 100.025% ( 580, 870 ] 115 0.004% 100.028% ( 870, 1300 ] 56 0.002% 100.030% ( 1300, 1900 ] 18 0.001% 100.031% ( 1900, 2900 ] 26 0.001% 100.031% ( 2900, 4400 ] 23 0.001% 100.032% ( 4400, 6600 ] 6 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 401060 Average: 4.3317 StdDev: 65.62 Min: 1 Median: 2.0795 Max: 11301 Percentiles: P50: 2.08 P75: 2.92 P99: 8.82 P99.9: 14.58 P99.99: 155.19 ------------------------------------------------------ [ 0, 1 ] 6841 1.706% 1.706% ( 1, 2 ] 184165 45.920% 47.625% ######### ( 2, 3 ] 119804 29.872% 77.497% ###### ( 3, 4 ] 38499 9.599% 87.096% ## ( 4, 6 ] 42498 10.596% 97.693% ## ( 6, 10 ] 7429 1.852% 99.545% ( 10, 15 ] 1553 0.387% 99.932% ( 15, 22 ] 150 0.037% 99.970% ( 22, 34 ] 7 0.002% 99.972% ( 34, 51 ] 2 0.000% 99.972% ( 51, 76 ] 4 0.001% 99.973% ( 76, 110 ] 34 0.008% 99.982% ( 110, 170 ] 45 0.011% 99.993% ( 170, 250 ] 51 0.013% 100.005% ( 250, 380 ] 62 0.015% 100.021% ( 380, 580 ] 80 0.020% 100.041% ( 580, 870 ] 62 0.015% 100.056% ( 870, 1300 ] 45 0.011% 100.068% ( 1300, 1900 ] 25 0.006% 100.074% ( 1900, 2900 ] 45 0.011% 100.085% ( 2900, 4400 ] 24 0.006% 100.091% ( 4400, 6600 ] 15 0.004% 100.095% ( 6600, 9900 ] 5 0.001% 100.096% ( 9900, 14000 ] 2 0.000% 100.096% ** Level 2 read latency histogram (micros): Count: 164122 Average: 3.8333 StdDev: 46.77 Min: 1 Median: 1.8534 Max: 4923 Percentiles: P50: 1.85 P75: 2.76 P99: 8.75 P99.9: 18.48 P99.99: 358.10 ------------------------------------------------------ [ 0, 1 ] 14812 9.025% 9.025% ## ( 1, 2 ] 78799 48.012% 57.037% ########## ( 2, 3 ] 38920 23.714% 80.752% ##### ( 3, 4 ] 13238 8.066% 88.817% ## ( 4, 6 ] 14735 8.978% 97.796% ## ( 6, 10 ] 2873 1.751% 99.546% ( 10, 15 ] 555 0.338% 99.884% ( 15, 22 ] 52 0.032% 99.916% ( 22, 34 ] 5 0.003% 99.919% ( 34, 51 ] 1 0.001% 99.920% ( 51, 76 ] 1 0.001% 99.920% ( 76, 110 ] 2 0.001% 99.921% ( 110, 170 ] 44 0.027% 99.948% ( 170, 250 ] 32 0.019% 99.968% ( 250, 380 ] 44 0.027% 99.995% ( 380, 580 ] 40 0.024% 100.019% ( 580, 870 ] 24 0.015% 100.034% ( 870, 1300 ] 20 0.012% 100.046% ( 1300, 1900 ] 6 0.004% 100.049% ( 1900, 2900 ] 13 0.008% 100.057% ( 2900, 4400 ] 11 0.007% 100.064% ( 4400, 6600 ] 3 0.002% 100.066% ** Level 3 read latency histogram (micros): Count: 411130 Average: 10.6599 StdDev: 133.19 Min: 0 Median: 2.1140 Max: 11908 Percentiles: P50: 2.11 P75: 2.96 P99: 12.21 P99.9: 919.98 P99.99: 1383.73 ------------------------------------------------------ [ 0, 1 ] 5347 1.301% 1.301% ( 1, 2 ] 186326 45.320% 46.621% ######### ( 2, 3 ] 121907 29.652% 76.273% ###### ( 3, 4 ] 41196 10.020% 86.293% ## ( 4, 6 ] 42163 10.255% 96.548% ## ( 6, 10 ] 9237 2.247% 98.795% ( 10, 15 ] 1910 0.465% 99.260% ( 15, 22 ] 225 0.055% 99.314% ( 22, 34 ] 18 0.004% 99.319% ( 34, 51 ] 17 0.004% 99.323% ( 51, 76 ] 7 0.002% 99.325% ( 76, 110 ] 63 0.015% 99.340% ( 110, 170 ] 364 0.089% 99.428% ( 170, 250 ] 361 0.088% 99.516% ( 250, 380 ] 477 0.116% 99.632% ( 380, 580 ] 550 0.134% 99.766% ( 580, 870 ] 506 0.123% 99.889% ( 870, 1300 ] 386 0.094% 99.983% ( 1300, 1900 ] 207 0.050% 100.033% ( 1900, 2900 ] 204 0.050% 100.083% ( 2900, 4400 ] 175 0.043% 100.126% ( 4400, 6600 ] 60 0.015% 100.140% ( 6600, 9900 ] 12 0.003% 100.143% ( 9900, 14000 ] 2 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 150 Average: 884.7333 StdDev: 1649.52 Min: 1 Median: 5.6000 Max: 6336 Percentiles: P50: 5.60 P75: 849.29 P99: 6336.00 P99.9: 6336.00 P99.99: 6336.00 ------------------------------------------------------ [ 0, 1 ] 17 11.333% 11.333% ## ( 1, 2 ] 35 23.333% 34.667% ##### ( 2, 3 ] 17 11.333% 46.000% ## ( 3, 4 ] 2 1.333% 47.333% ( 4, 6 ] 5 3.333% 50.667% # ( 6, 10 ] 1 0.667% 51.333% ( 10, 15 ] 2 1.333% 52.667% ( 15, 22 ] 2 1.333% 54.000% ( 22, 34 ] 4 2.667% 56.667% # ( 76, 110 ] 2 1.333% 58.000% ( 110, 170 ] 14 9.333% 67.333% ## ( 250, 380 ] 2 1.333% 68.667% ( 380, 580 ] 3 2.000% 70.667% ( 580, 870 ] 7 4.667% 75.333% # ( 870, 1300 ] 5 3.333% 78.667% # ( 1300, 1900 ] 6 4.000% 82.667% # ( 1900, 2900 ] 6 4.000% 86.667% # ( 2900, 4400 ] 7 4.667% 91.333% # ( 4400, 6600 ] 13 8.667% 100.000% ## ** Level 5 read latency histogram (micros): Count: 120 Average: 1268.4000 StdDev: 1394.34 Min: 81 Median: 621.4286 Max: 7061 Percentiles: P50: 621.43 P75: 2011.11 P99: 6380.00 P99.9: 7061.00 P99.99: 7061.00 ------------------------------------------------------ ( 76, 110 ] 2 1.667% 1.667% ( 110, 170 ] 17 14.167% 15.833% ### ( 170, 250 ] 15 12.500% 28.333% ### ( 250, 380 ] 11 9.167% 37.500% ## ( 380, 580 ] 13 10.833% 48.333% ## ( 580, 870 ] 14 11.667% 60.000% ## ( 870, 1300 ] 7 5.833% 65.833% # ( 1300, 1900 ] 10 8.333% 74.167% ## ( 1900, 2900 ] 9 7.500% 81.667% ## ( 2900, 4400 ] 19 15.833% 97.500% ### ( 4400, 6600 ] 2 1.667% 99.167% ( 6600, 9900 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 31.2 total, 4.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 252.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.350 H:M:S, 30.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 205.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.037 H:M:S, 42.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-14:32:42 ... thread 0: (1000000,9000000) ops and (149921.4,238955.2) ops/second in (6.670161,37.663959) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 3.69 GB 44.1 8.7 0.0 8.7 17.2 8.5 0.0 2.0 144.4 286.5 61.50 56.03 151 0.407 9017K 16K 0.0 0.0 L1 16/16 1.89 GB 0.0 4.7 4.7 0.1 4.7 4.6 0.2 1.0 227.8 225.9 21.34 20.55 3 7.113 4936K 40K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.5 0.4 0.1 0.5 0.4 2.5 1.3 213.9 213.4 2.56 2.33 2 1.278 555K 1186 0.0 0.0 L3 19/0 961.81 MB 1.0 4.1 2.2 1.9 4.1 2.2 0.9 1.9 173.4 172.8 24.26 18.48 20 1.213 4135K 12K 0.0 0.0 L4 168/0 9.45 GB 1.0 1.2 1.1 0.1 1.2 1.1 1.7 1.1 136.5 136.1 9.01 5.83 17 0.530 1221K 3371 0.0 0.0 L5 1072/0 88.65 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/30 104.61 GB 0.0 19.3 8.3 10.9 27.7 16.8 8.0 3.2 166.2 239.3 118.68 103.22 193 0.615 19M 74K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.3 8.3 10.9 27.7 16.8 7.8 3.2 166.2 239.3 118.68 103.22 193 0.615 19M 74K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.3 8.3 10.9 19.2 8.2 0.0 0.0 214.1 213.3 92.13 80.86 69 1.335 19M 74K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 329.9 26.55 22.35 124 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.8 total, 37.7 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.74 GB write, 750.62 MB/s write, 19.26 GB read, 521.29 MB/s read, 118.7 seconds Interval compaction: 27.74 GB write, 754.14 MB/s write, 19.26 GB read, 523.74 MB/s read, 118.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 31, total-stops: 49, interval: 80 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3743873 Average: 2.4893 StdDev: 15.54 Min: 0 Median: 1.5977 Max: 5698 Percentiles: P50: 1.60 P75: 1.99 P99: 6.43 P99.9: 13.00 P99.99: 115.13 ------------------------------------------------------ [ 0, 1 ] 444439 11.871% 11.871% ## ( 1, 2 ] 2388461 63.797% 75.668% ############# ( 2, 3 ] 597769 15.967% 91.634% ### ( 3, 4 ] 145288 3.881% 95.515% # ( 4, 6 ] 126802 3.387% 98.902% # ( 6, 10 ] 33819 0.903% 99.805% ( 10, 15 ] 5919 0.158% 99.963% ( 15, 22 ] 536 0.014% 99.978% ( 22, 34 ] 49 0.001% 99.979% ( 34, 51 ] 23 0.001% 99.979% ( 51, 76 ] 20 0.001% 99.980% ( 76, 110 ] 322 0.009% 99.989% ( 110, 170 ] 604 0.016% 100.005% ( 170, 250 ] 335 0.009% 100.014% ( 250, 380 ] 178 0.005% 100.018% ( 380, 580 ] 203 0.005% 100.024% ( 580, 870 ] 141 0.004% 100.028% ( 870, 1300 ] 64 0.002% 100.029% ( 1300, 1900 ] 23 0.001% 100.030% ( 1900, 2900 ] 29 0.001% 100.031% ( 2900, 4400 ] 23 0.001% 100.031% ( 4400, 6600 ] 6 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 703126 Average: 3.8908 StdDev: 51.70 Min: 1 Median: 1.9095 Max: 11301 Percentiles: P50: 1.91 P75: 2.76 P99: 8.88 P99.9: 87.46 P99.99: 278.70 ------------------------------------------------------ [ 0, 1 ] 19644 2.794% 2.794% # ( 1, 2 ] 364952 51.904% 54.698% ########## ( 2, 3 ] 187695 26.694% 81.392% ##### ( 3, 4 ] 55335 7.870% 89.262% ## ( 4, 6 ] 58769 8.358% 97.620% ## ( 6, 10 ] 13496 1.919% 99.540% ( 10, 15 ] 2203 0.313% 99.853% ( 15, 22 ] 235 0.033% 99.887% ( 22, 34 ] 8 0.001% 99.888% ( 34, 51 ] 3 0.000% 99.888% ( 51, 76 ] 6 0.001% 99.889% ( 76, 110 ] 231 0.033% 99.922% ( 110, 170 ] 286 0.041% 99.963% ( 170, 250 ] 163 0.023% 99.986% ( 250, 380 ] 139 0.020% 100.006% ( 380, 580 ] 142 0.020% 100.026% ( 580, 870 ] 101 0.014% 100.040% ( 870, 1300 ] 69 0.010% 100.050% ( 1300, 1900 ] 30 0.004% 100.054% ( 1900, 2900 ] 51 0.007% 100.061% ( 2900, 4400 ] 26 0.004% 100.065% ( 4400, 6600 ] 15 0.002% 100.067% ( 6600, 9900 ] 5 0.001% 100.068% ( 9900, 14000 ] 2 0.000% 100.068% ** Level 2 read latency histogram (micros): Count: 182582 Average: 3.8831 StdDev: 44.78 Min: 1 Median: 1.8879 Max: 4923 Percentiles: P50: 1.89 P75: 2.81 P99: 9.10 P99.9: 122.20 P99.99: 394.97 ------------------------------------------------------ [ 0, 1 ] 14872 8.145% 8.145% ## ( 1, 2 ] 86066 47.138% 55.284% ######### ( 2, 3 ] 44253 24.237% 79.521% ##### ( 3, 4 ] 15656 8.575% 88.096% ## ( 4, 6 ] 17057 9.342% 97.438% ## ( 6, 10 ] 3683 2.017% 99.455% ( 10, 15 ] 700 0.383% 99.838% ( 15, 22 ] 85 0.047% 99.885% ( 22, 34 ] 10 0.005% 99.890% ( 34, 51 ] 1 0.001% 99.891% ( 51, 76 ] 1 0.001% 99.892% ( 76, 110 ] 2 0.001% 99.893% ( 110, 170 ] 66 0.036% 99.929% ( 170, 250 ] 51 0.028% 99.957% ( 250, 380 ] 57 0.031% 99.988% ( 380, 580 ] 50 0.027% 100.015% ( 580, 870 ] 26 0.014% 100.030% ( 870, 1300 ] 20 0.011% 100.041% ( 1300, 1900 ] 7 0.004% 100.044% ( 1900, 2900 ] 13 0.007% 100.051% ( 2900, 4400 ] 11 0.006% 100.058% ( 4400, 6600 ] 3 0.002% 100.059% ** Level 3 read latency histogram (micros): Count: 640227 Average: 8.4888 StdDev: 111.49 Min: 0 Median: 2.0846 Max: 11908 Percentiles: P50: 2.08 P75: 2.93 P99: 9.93 P99.9: 552.45 P99.99: 819.75 ------------------------------------------------------ [ 0, 1 ] 8671 1.354% 1.354% ( 1, 2 ] 295512 46.157% 47.512% ######### ( 2, 3 ] 188311 29.413% 76.925% ###### ( 3, 4 ] 63387 9.901% 86.826% ## ( 4, 6 ] 65432 10.220% 97.046% ## ( 6, 10 ] 12728 1.988% 99.034% ( 10, 15 ] 2872 0.449% 99.482% ( 15, 22 ] 318 0.050% 99.532% ( 22, 34 ] 28 0.004% 99.536% ( 34, 51 ] 19 0.003% 99.539% ( 51, 76 ] 9 0.001% 99.541% ( 76, 110 ] 81 0.013% 99.553% ( 110, 170 ] 486 0.076% 99.629% ( 170, 250 ] 513 0.080% 99.709% ( 250, 380 ] 630 0.098% 99.808% ( 380, 580 ] 684 0.107% 99.915% ( 580, 870 ] 583 0.091% 100.006% ( 870, 1300 ] 409 0.064% 100.070% ( 1300, 1900 ] 213 0.033% 100.103% ( 1900, 2900 ] 207 0.032% 100.135% ( 2900, 4400 ] 206 0.032% 100.167% ( 4400, 6600 ] 61 0.010% 100.177% ( 6600, 9900 ] 12 0.002% 100.179% ( 9900, 14000 ] 2 0.000% 100.179% ** Level 4 read latency histogram (micros): Count: 230 Average: 649.3435 StdDev: 1425.06 Min: 0 Median: 3.5000 Max: 6336 Percentiles: P50: 3.50 P75: 341.00 P99: 6210.77 P99.9: 6336.00 P99.99: 6336.00 ------------------------------------------------------ [ 0, 1 ] 29 12.609% 12.609% ### ( 1, 2 ] 56 24.348% 36.957% ##### ( 2, 3 ] 28 12.174% 49.130% ## ( 3, 4 ] 4 1.739% 50.870% ( 4, 6 ] 7 3.043% 53.913% # ( 6, 10 ] 5 2.174% 56.087% ( 10, 15 ] 3 1.304% 57.391% ( 15, 22 ] 3 1.304% 58.696% ( 22, 34 ] 9 3.913% 62.609% # ( 34, 51 ] 2 0.870% 63.478% ( 51, 76 ] 1 0.435% 63.913% ( 76, 110 ] 2 0.870% 64.783% ( 110, 170 ] 14 6.087% 70.870% # ( 170, 250 ] 6 2.609% 73.478% # ( 250, 380 ] 5 2.174% 75.652% ( 380, 580 ] 7 3.043% 78.696% # ( 580, 870 ] 7 3.043% 81.739% # ( 870, 1300 ] 6 2.609% 84.348% # ( 1300, 1900 ] 7 3.043% 87.391% # ( 1900, 2900 ] 7 3.043% 90.435% # ( 2900, 4400 ] 9 3.913% 94.348% # ( 4400, 6600 ] 13 5.652% 100.000% # ** Level 5 read latency histogram (micros): Count: 160 Average: 1199.7250 StdDev: 1333.31 Min: 81 Median: 580.0000 Max: 7061 Percentiles: P50: 580.00 P75: 1857.14 P99: 5940.00 P99.9: 7061.00 P99.99: 7061.00 ------------------------------------------------------ ( 76, 110 ] 6 3.750% 3.750% # ( 110, 170 ] 25 15.625% 19.375% ### ( 170, 250 ] 20 12.500% 31.875% ### ( 250, 380 ] 15 9.375% 41.250% ## ( 380, 580 ] 14 8.750% 50.000% ## ( 580, 870 ] 18 11.250% 61.250% ## ( 870, 1300 ] 9 5.625% 66.875% # ( 1300, 1900 ] 14 8.750% 75.625% ## ( 1900, 2900 ] 13 8.125% 83.750% ## ( 2900, 4400 ] 23 14.375% 98.125% ### ( 4400, 6600 ] 2 1.250% 99.375% ( 6600, 9900 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 37.8 total, 6.7 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 234.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.150 H:M:S, 34.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 147.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.800 H:M:S, 57.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.153 micros/op 162519 ops/sec 60.245 seconds 9790999 operations; 157.5 MB/s Microseconds per write: Count: 9790999 Average: 6.1531 StdDev: 434.15 Min: 0 Median: 1.7500 Max: 750478 Percentiles: P50: 1.75 P75: 2.80 P99: 9.74 P99.9: 1170.69 P99.99: 2714.87 ------------------------------------------------------ [ 0, 1 ] 1257247 12.841% 12.841% ### ( 1, 2 ] 4851163 49.547% 62.388% ########## ( 2, 3 ] 1545683 15.787% 78.175% ### ( 3, 4 ] 1357747 13.867% 92.042% ### ( 4, 6 ] 556004 5.679% 97.721% # ( 6, 10 ] 133887 1.367% 99.088% ( 10, 15 ] 46787 0.478% 99.566% ( 15, 22 ] 9245 0.094% 99.661% ( 22, 34 ] 1437 0.015% 99.675% ( 34, 51 ] 199 0.002% 99.677% ( 51, 76 ] 28 0.000% 99.678% ( 76, 110 ] 6726 0.069% 99.746% ( 110, 170 ] 2757 0.028% 99.774% ( 170, 250 ] 253 0.003% 99.777% ( 250, 380 ] 219 0.002% 99.779% ( 380, 580 ] 25 0.000% 99.779% ( 580, 870 ] 26 0.000% 99.780% ( 870, 1300 ] 16839 0.172% 99.952% ( 1300, 1900 ] 59 0.001% 99.952% ( 1900, 2900 ] 4527 0.046% 99.999% ( 2900, 4400 ] 86 0.001% 99.999% ( 4400, 6600 ] 24 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 4 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 226365 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9790999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10104310968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 545 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32701413 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32970869697 rocksdb.compact.write.bytes COUNT : 32732637178 rocksdb.flush.write.bytes COUNT : 10040696713 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 43 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 298 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9959773184 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3901440 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33062587666 rocksdb.non.last.level.read.count COUNT : 7988637 rocksdb.block.checksum.compute.count COUNT : 7987590 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.404242 P95 : 3.963118 P99 : 8.409619 P100 : 750476.000000 COUNT : 9790999 SUM : 55564187 rocksdb.compaction.times.micros P50 : 1024687.500000 P95 : 5216666.666667 P99 : 22550000.000000 P100 : 23040393.000000 COUNT : 95 SUM : 150698139 rocksdb.compaction.times.cpu_micros P50 : 909354.838710 P95 : 4575000.000000 P99 : 14400000.000000 P100 : 21146307.000000 COUNT : 95 SUM : 127368710 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 696.337209 P95 : 1375.000000 P99 : 20600.000000 P100 : 73796.000000 COUNT : 135 SUM : 212441 rocksdb.compaction.outfile.sync.micros P50 : 1122.625000 P95 : 127000.000000 P99 : 282200.000000 P100 : 282200.000000 COUNT : 372 SUM : 7474804 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.542857 P95 : 1862.500000 P99 : 2840.909091 P100 : 4844.000000 COUNT : 265 SUM : 85153 rocksdb.table.open.io.micros P50 : 1466.019417 P95 : 7579.687500 P99 : 18366.666667 P100 : 18504.000000 COUNT : 545 SUM : 1247855 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.754299 P95 : 8.176972 P99 : 11.761435 P100 : 16455.000000 COUNT : 7986246 SUM : 49246891 rocksdb.read.block.get.micros P50 : 509.600000 P95 : 3792.241379 P99 : 6168.800000 P100 : 8095.000000 COUNT : 1090 SUM : 1013187 rocksdb.write.raw.block.micros P50 : 0.513236 P95 : 0.975149 P99 : 2.930843 P100 : 16415.000000 COUNT : 10362424 SUM : 21341973 rocksdb.numfiles.in.singlecompaction P50 : 3.074324 P95 : 5.128571 P99 : 11.950000 P100 : 26.000000 COUNT : 161 SUM : 568 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559220 P95 : 1157.325729 P99 : 2466.970103 P100 : 750295.000000 COUNT : 204084 SUM : 32722603 rocksdb.sst.read.micros P50 : 1.700204 P95 : 4.970152 P99 : 8.792801 P100 : 16450.000000 COUNT : 7989168 SUM : 33043890 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9790999 SUM : 10104310968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214040.404040 P95 : 374264.705882 P99 : 924307.000000 P100 : 924307.000000 COUNT : 135 SUM : 29889960 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 354 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0