[2024-12-15 16:48:30.908227] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 24.03.0 initialization... [2024-12-15 16:48:30.908366] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1708277 ] Set seed to 1734277710904770 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 16:48:31.016782] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 16:48:31.122744] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 16:48:31.122788] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1708277' to capture a snapshot of events at runtime. [2024-12-15 16:48:31.122798] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-15 16:48:31.122808] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-15 16:48:31.122816] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1708277 for offline analysis/debug. [2024-12-15 16:48:31.124173] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 16:48:39 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-16:48:42 ... thread 0: (1000000,1000000) ops and (359814.6,359814.6) ops/second in (2.779209,2.779209) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.04 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 353.8 2.32 2.07 12 0.193 0 0 0.0 0.0 L2 3/2 251.75 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 247.3 247.2 1.53 1.48 2 0.764 383K 192 0.0 0.0 L3 10/0 867.27 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 98.3 311.4 3.84 3.54 14 0.275 383K 192 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 98.3 311.4 3.84 3.54 14 0.275 383K 192 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 247.3 247.2 1.53 1.48 2 0.764 383K 192 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 353.8 2.32 2.07 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 400.81 MB/s write, 0.37 GB read, 126.57 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 430.37 MB/s write, 0.37 GB read, 135.91 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 98037 Average: 2.0392 StdDev: 24.57 Min: 1 Median: 1.2882 Max: 4377 Percentiles: P50: 1.29 P75: 1.70 P99: 4.16 P99.9: 9.74 P99.99: 489.81 ------------------------------------------------------ [ 0, 1 ] 31813 32.450% 32.450% ###### ( 1, 2 ] 59702 60.897% 93.347% ############ ( 2, 3 ] 4043 4.124% 97.471% # ( 3, 4 ] 1445 1.474% 98.945% ( 4, 6 ] 679 0.693% 99.638% ( 6, 10 ] 276 0.282% 99.919% ( 10, 15 ] 45 0.046% 99.965% ( 15, 22 ] 9 0.009% 99.974% ( 34, 51 ] 1 0.001% 99.976% ( 51, 76 ] 1 0.001% 99.977% ( 110, 170 ] 6 0.006% 99.983% ( 170, 250 ] 3 0.003% 99.986% ( 250, 380 ] 3 0.003% 99.989% ( 380, 580 ] 4 0.004% 99.993% ( 580, 870 ] 1 0.001% 99.994% ( 1300, 1900 ] 1 0.001% 99.995% ( 1900, 2900 ] 4 0.004% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 1 read latency histogram (micros): Count: 5 Average: 1165.8000 StdDev: 972.33 Min: 116 Median: 725.0000 Max: 2327 Percentiles: P50: 725.00 P75: 2275.00 P99: 2327.00 P99.9: 2327.00 P99.99: 2327.00 ------------------------------------------------------ ( 110, 170 ] 1 20.000% 20.000% #### ( 250, 380 ] 1 20.000% 40.000% #### ( 580, 870 ] 1 20.000% 60.000% #### ( 1900, 2900 ] 2 40.000% 100.000% ######## ** Level 2 read latency histogram (micros): Count: 49666 Average: 1.9608 StdDev: 9.28 Min: 0 Median: 1.3320 Max: 1296 Percentiles: P50: 1.33 P75: 1.73 P99: 5.36 P99.9: 9.99 P99.99: 294.78 ------------------------------------------------------ [ 0, 1 ] 14569 29.334% 29.334% ###### ( 1, 2 ] 30918 62.252% 91.586% ############ ( 2, 3 ] 2392 4.816% 96.402% # ( 3, 4 ] 868 1.748% 98.150% ( 4, 6 ] 624 1.256% 99.406% ( 6, 10 ] 247 0.497% 99.903% ( 10, 15 ] 32 0.064% 99.968% ( 15, 22 ] 7 0.014% 99.982% ( 22, 34 ] 3 0.006% 99.988% ( 51, 76 ] 1 0.002% 99.990% ( 250, 380 ] 3 0.006% 99.996% ( 870, 1300 ] 3 0.006% 100.002% ** Level 3 read latency histogram (micros): Count: 45 Average: 3316.6444 StdDev: 2374.64 Min: 285 Median: 2337.5000 Max: 7711 Percentiles: P50: 2337.50 P75: 5561.11 P99: 7711.00 P99.9: 7711.00 P99.99: 7711.00 ------------------------------------------------------ ( 250, 380 ] 2 4.444% 4.444% # ( 380, 580 ] 2 4.444% 8.889% # ( 580, 870 ] 1 2.222% 11.111% ( 870, 1300 ] 5 11.111% 22.222% ## ( 1300, 1900 ] 9 20.000% 42.222% #### ( 1900, 2900 ] 8 17.778% 60.000% #### ( 2900, 4400 ] 2 4.444% 64.444% # ( 4400, 6600 ] 9 20.000% 84.444% #### ( 6600, 9900 ] 7 15.556% 100.000% ### ** Level 4 read latency histogram (micros): Count: 30 Average: 4320.6667 StdDev: 2768.94 Min: 1174 Median: 3900.0000 Max: 11225 Percentiles: P50: 3900.00 P75: 6187.50 P99: 11225.00 P99.9: 11225.00 P99.99: 11225.00 ------------------------------------------------------ ( 870, 1300 ] 2 6.667% 6.667% # ( 1300, 1900 ] 7 23.333% 30.000% ##### ( 1900, 2900 ] 4 13.333% 43.333% ### ( 2900, 4400 ] 3 10.000% 53.333% ## ( 4400, 6600 ] 8 26.667% 80.000% ##### ( 6600, 9900 ] 5 16.667% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 329.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.213 H:M:S, 7.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 353.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.213 H:M:S, 7.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-16:48:45 ... thread 0: (1000000,2000000) ops and (320560.6,339055.2) ops/second in (3.119535,5.898744) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.17 GB 12.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 96.6 312.1 8.48 7.80 29 0.292 831K 860 0.0 0.0 L1 1/1 3.44 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 232.4 232.0 1.63 1.57 1 1.626 383K 610 0.0 0.0 L2 2/1 54.70 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 247.3 247.2 1.53 1.48 2 0.764 383K 192 0.0 0.0 L3 20/10 1.19 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 230.4 230.4 1.08 1.01 1 1.083 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 156.3 156.3 1.44 1.06 1 1.436 227K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/18 97.92 GB 0.0 2.0 1.0 1.0 3.8 2.8 1.2 2.1 144.8 273.8 14.15 12.93 34 0.416 2080K 1662 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 1.0 1.0 3.8 2.8 1.2 2.1 144.8 273.8 14.15 12.93 34 0.416 2080K 1662 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 1.0 1.0 2.0 1.0 0.0 0.0 229.9 229.7 8.91 8.29 8 1.114 2080K 1662 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 348.8 5.24 4.64 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.78 GB write, 634.56 MB/s write, 2.00 GB read, 335.60 MB/s read, 14.1 seconds Interval compaction: 3.78 GB write, 656.62 MB/s write, 2.00 GB read, 347.27 MB/s read, 14.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 383776 Average: 2.3793 StdDev: 18.53 Min: 0 Median: 1.5632 Max: 5825 Percentiles: P50: 1.56 P75: 1.95 P99: 5.79 P99.9: 10.29 P99.99: 14.85 ------------------------------------------------------ [ 0, 1 ] 53798 14.018% 14.018% ### ( 1, 2 ] 245198 63.891% 77.909% ############# ( 2, 3 ] 54838 14.289% 92.198% ### ( 3, 4 ] 14918 3.887% 96.085% # ( 4, 6 ] 12529 3.265% 99.350% # ( 6, 10 ] 2090 0.545% 99.894% ( 10, 15 ] 379 0.099% 99.993% ( 15, 22 ] 40 0.010% 100.004% ( 22, 34 ] 7 0.002% 100.005% ( 34, 51 ] 5 0.001% 100.007% ( 51, 76 ] 1 0.000% 100.007% ( 76, 110 ] 1 0.000% 100.007% ( 110, 170 ] 7 0.002% 100.009% ( 170, 250 ] 11 0.003% 100.012% ( 250, 380 ] 5 0.001% 100.013% ( 380, 580 ] 8 0.002% 100.015% ( 580, 870 ] 7 0.002% 100.017% ( 870, 1300 ] 5 0.001% 100.019% ( 1300, 1900 ] 3 0.001% 100.019% ( 1900, 2900 ] 9 0.002% 100.022% ( 2900, 4400 ] 2 0.001% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 31 Average: 355.9355 StdDev: 629.00 Min: 1 Median: 2.5000 Max: 2327 Percentiles: P50: 2.50 P75: 347.50 P99: 2327.00 P99.9: 2327.00 P99.99: 2327.00 ------------------------------------------------------ [ 0, 1 ] 4 12.903% 12.903% ### ( 1, 2 ] 11 35.484% 48.387% ####### ( 2, 3 ] 1 3.226% 51.613% # ( 3, 4 ] 1 3.226% 54.839% # ( 4, 6 ] 1 3.226% 58.065% # ( 110, 170 ] 2 6.452% 64.516% # ( 170, 250 ] 1 3.226% 67.742% # ( 250, 380 ] 3 9.677% 77.419% ## ( 580, 870 ] 2 6.452% 83.871% # ( 870, 1300 ] 3 9.677% 93.548% ## ( 1900, 2900 ] 2 6.452% 100.000% # ** Level 2 read latency histogram (micros): Count: 95650 Average: 2.1395 StdDev: 6.73 Min: 0 Median: 1.4780 Max: 1296 Percentiles: P50: 1.48 P75: 1.87 P99: 5.74 P99.9: 11.54 P99.99: 23.74 ------------------------------------------------------ [ 0, 1 ] 18353 19.188% 19.188% #### ( 1, 2 ] 61656 64.460% 83.648% ############# ( 2, 3 ] 10044 10.501% 94.148% ## ( 3, 4 ] 2649 2.769% 96.918% # ( 4, 6 ] 2295 2.399% 99.317% ( 6, 10 ] 526 0.550% 99.867% ( 10, 15 ] 102 0.107% 99.974% ( 15, 22 ] 15 0.016% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 178526 Average: 3.8625 StdDev: 66.41 Min: 1 Median: 1.6963 Max: 7711 Percentiles: P50: 1.70 P75: 2.31 P99: 8.55 P99.9: 168.31 P99.99: 733.94 ------------------------------------------------------ [ 0, 1 ] 11253 6.303% 6.303% # ( 1, 2 ] 112035 62.756% 69.059% ############# ( 2, 3 ] 34429 19.285% 88.344% #### ( 3, 4 ] 9044 5.066% 93.410% # ( 4, 6 ] 8217 4.603% 98.013% # ( 6, 10 ] 2771 1.552% 99.565% ( 10, 15 ] 316 0.177% 99.742% ( 15, 22 ] 36 0.020% 99.762% ( 22, 34 ] 2 0.001% 99.763% ( 34, 51 ] 3 0.002% 99.765% ( 51, 76 ] 1 0.001% 99.765% ( 76, 110 ] 51 0.029% 99.794% ( 110, 170 ] 196 0.110% 99.904% ( 170, 250 ] 71 0.040% 99.943% ( 250, 380 ] 45 0.025% 99.969% ( 380, 580 ] 28 0.016% 99.984% ( 580, 870 ] 21 0.012% 99.996% ( 870, 1300 ] 10 0.006% 100.002% ( 1300, 1900 ] 10 0.006% 100.007% ( 1900, 2900 ] 9 0.005% 100.012% ( 2900, 4400 ] 2 0.001% 100.013% ( 4400, 6600 ] 9 0.005% 100.018% ( 6600, 9900 ] 7 0.004% 100.022% ** Level 4 read latency histogram (micros): Count: 320 Average: 409.3531 StdDev: 1517.12 Min: 0 Median: 1.5472 Max: 11225 Percentiles: P50: 1.55 P75: 6.28 P99: 8448.00 P99.9: 11225.00 P99.99: 11225.00 ------------------------------------------------------ [ 0, 1 ] 102 31.875% 31.875% ###### ( 1, 2 ] 106 33.125% 65.000% ####### ( 2, 3 ] 18 5.625% 70.625% # ( 3, 4 ] 3 0.938% 71.562% ( 4, 6 ] 9 2.812% 74.375% # ( 6, 10 ] 29 9.062% 83.438% ## ( 10, 15 ] 20 6.250% 89.688% # ( 15, 22 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 870, 1300 ] 2 0.625% 91.250% ( 1300, 1900 ] 7 2.188% 93.438% ( 1900, 2900 ] 4 1.250% 94.688% ( 2900, 4400 ] 3 0.938% 95.625% ( 4400, 6600 ] 8 2.500% 98.125% # ( 6600, 9900 ] 5 1.562% 99.688% ( 9900, 14000 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 322.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.657 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.443 H:M:S, 14.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-16:48:48 ... thread 0: (1000000,3000000) ops and (321310.5,332926.5) ops/second in (3.112254,9.010998) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.09 GB 75.5 1.4 0.0 1.4 4.1 2.7 0.0 1.5 103.4 310.0 13.41 12.38 44 0.305 1407K 1489 0.0 0.0 L1 1/1 3.44 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 232.4 232.0 1.63 1.57 1 1.626 383K 610 0.0 0.0 L2 1/0 52.47 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 247.3 247.2 1.53 1.48 2 0.764 383K 192 0.0 0.0 L3 20/0 956.21 MB 1.0 1.1 0.2 0.8 1.1 0.2 0.4 4.4 234.0 233.6 4.78 4.43 2 2.391 1136K 2261 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 156.3 156.3 1.44 1.06 1 1.436 227K 0 0.0 0.0 L5 1048/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/11 98.84 GB 0.0 3.4 1.0 2.4 6.1 3.7 1.8 2.3 153.0 274.5 22.78 20.92 50 0.456 3539K 4552 0.0 0.0 Int 0/0 0.00 KB 0.0 3.4 1.0 2.4 6.1 3.7 1.8 2.3 153.0 274.5 22.78 20.92 50 0.456 3539K 4552 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.4 1.0 2.4 3.4 1.0 0.0 0.0 235.5 235.2 14.80 13.86 11 1.346 3539K 4552 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 347.5 7.98 7.06 39 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.11 GB write, 678.35 MB/s write, 3.40 GB read, 378.13 MB/s read, 22.8 seconds Interval compaction: 6.11 GB write, 693.79 MB/s write, 3.40 GB read, 386.74 MB/s read, 22.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 766026 Average: 2.3848 StdDev: 14.44 Min: 0 Median: 1.5978 Max: 5825 Percentiles: P50: 1.60 P75: 1.98 P99: 5.79 P99.9: 10.10 P99.99: 14.25 ------------------------------------------------------ [ 0, 1 ] 86072 11.236% 11.236% ## ( 1, 2 ] 496708 64.842% 76.078% ############# ( 2, 3 ] 121136 15.814% 91.892% ### ( 3, 4 ] 31046 4.053% 95.945% # ( 4, 6 ] 26120 3.410% 99.355% # ( 6, 10 ] 4163 0.543% 99.898% ( 10, 15 ] 830 0.108% 100.006% ( 15, 22 ] 76 0.010% 100.016% ( 22, 34 ] 10 0.001% 100.018% ( 34, 51 ] 8 0.001% 100.019% ( 51, 76 ] 7 0.001% 100.020% ( 76, 110 ] 1 0.000% 100.020% ( 110, 170 ] 13 0.002% 100.021% ( 170, 250 ] 19 0.002% 100.024% ( 250, 380 ] 7 0.001% 100.025% ( 380, 580 ] 16 0.002% 100.027% ( 580, 870 ] 9 0.001% 100.028% ( 870, 1300 ] 10 0.001% 100.029% ( 1300, 1900 ] 5 0.001% 100.030% ( 1900, 2900 ] 11 0.001% 100.031% ( 2900, 4400 ] 2 0.000% 100.032% ( 4400, 6600 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 28311 Average: 3.6147 StdDev: 27.23 Min: 1 Median: 1.8205 Max: 2327 Percentiles: P50: 1.82 P75: 2.63 P99: 9.22 P99.9: 215.04 P99.99: 1180.88 ------------------------------------------------------ [ 0, 1 ] 794 2.805% 2.805% # ( 1, 2 ] 16284 57.518% 60.323% ############ ( 2, 3 ] 6617 23.373% 83.695% ##### ( 3, 4 ] 2045 7.223% 90.919% # ( 4, 6 ] 1796 6.344% 97.263% # ( 6, 10 ] 611 2.158% 99.421% ( 10, 15 ] 68 0.240% 99.661% ( 15, 22 ] 9 0.032% 99.693% ( 22, 34 ] 1 0.004% 99.696% ( 34, 51 ] 1 0.004% 99.700% ( 76, 110 ] 23 0.081% 99.781% ( 110, 170 ] 32 0.113% 99.894% ( 170, 250 ] 3 0.011% 99.905% ( 250, 380 ] 8 0.028% 99.933% ( 380, 580 ] 9 0.032% 99.965% ( 580, 870 ] 5 0.018% 99.982% ( 870, 1300 ] 3 0.011% 99.993% ( 1900, 2900 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 95908 Average: 2.1413 StdDev: 6.72 Min: 0 Median: 1.4791 Max: 1296 Percentiles: P50: 1.48 P75: 1.87 P99: 5.74 P99.9: 11.56 P99.99: 23.64 ------------------------------------------------------ [ 0, 1 ] 18358 19.141% 19.141% #### ( 1, 2 ] 61772 64.408% 83.549% ############# ( 2, 3 ] 10150 10.583% 94.132% ## ( 3, 4 ] 2659 2.772% 96.904% # ( 4, 6 ] 2310 2.409% 99.313% ( 6, 10 ] 531 0.554% 99.867% ( 10, 15 ] 103 0.107% 99.974% ( 15, 22 ] 15 0.016% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 249013 Average: 3.6662 StdDev: 57.25 Min: 1 Median: 1.6777 Max: 7711 Percentiles: P50: 1.68 P75: 2.25 P99: 8.65 P99.9: 177.76 P99.99: 789.33 ------------------------------------------------------ [ 0, 1 ] 17334 6.961% 6.961% # ( 1, 2 ] 158133 63.504% 70.465% ############# ( 2, 3 ] 46004 18.475% 88.940% #### ( 3, 4 ] 11994 4.817% 93.756% # ( 4, 6 ] 10320 4.144% 97.901% # ( 6, 10 ] 4126 1.657% 99.557% ( 10, 15 ] 406 0.163% 99.720% ( 15, 22 ] 41 0.016% 99.737% ( 22, 34 ] 5 0.002% 99.739% ( 34, 51 ] 5 0.002% 99.741% ( 51, 76 ] 2 0.001% 99.742% ( 76, 110 ] 96 0.039% 99.780% ( 110, 170 ] 288 0.116% 99.896% ( 170, 250 ] 103 0.041% 99.937% ( 250, 380 ] 60 0.024% 99.961% ( 380, 580 ] 48 0.019% 99.981% ( 580, 870 ] 32 0.013% 99.994% ( 870, 1300 ] 16 0.006% 100.000% ( 1300, 1900 ] 11 0.004% 100.004% ( 1900, 2900 ] 10 0.004% 100.008% ( 2900, 4400 ] 2 0.001% 100.009% ( 4400, 6600 ] 9 0.004% 100.013% ( 6600, 9900 ] 7 0.003% 100.016% ** Level 4 read latency histogram (micros): Count: 320 Average: 409.3531 StdDev: 1517.12 Min: 0 Median: 1.5472 Max: 11225 Percentiles: P50: 1.55 P75: 6.28 P99: 8448.00 P99.9: 11225.00 P99.99: 11225.00 ------------------------------------------------------ [ 0, 1 ] 102 31.875% 31.875% ###### ( 1, 2 ] 106 33.125% 65.000% ####### ( 2, 3 ] 18 5.625% 70.625% # ( 3, 4 ] 3 0.938% 71.562% ( 4, 6 ] 9 2.812% 74.375% # ( 6, 10 ] 29 9.062% 83.438% ## ( 10, 15 ] 20 6.250% 89.688% # ( 15, 22 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 870, 1300 ] 2 0.625% 91.250% ( 1300, 1900 ] 7 2.188% 93.438% ( 1900, 2900 ] 4 1.250% 94.688% ( 2900, 4400 ] 3 0.938% 95.625% ( 4400, 6600 ] 8 2.500% 98.125% # ( 6600, 9900 ] 5 1.562% 99.688% ( 9900, 14000 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1000.6000 StdDev: 1288.64 Min: 118 Median: 354.0000 Max: 4444 Percentiles: P50: 354.00 P75: 870.00 P99: 4444.00 P99.9: 4444.00 P99.99: 4444.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 2 10.000% 30.000% ## ( 250, 380 ] 5 25.000% 55.000% ##### ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 2 10.000% 75.000% ## ( 1900, 2900 ] 3 15.000% 90.000% ### ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 320.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.124 H:M:S, 12.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.468 H:M:S, 15.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-16:48:51 ... thread 0: (1000000,4000000) ops and (325891.2,331139.3) ops/second in (3.068509,12.079507) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.03 GB 6.3 2.2 0.0 2.2 5.8 3.7 0.0 1.6 113.2 307.1 19.48 18.06 61 0.319 2238K 2326 0.0 0.0 L1 9/9 1.04 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 232.8 231.9 6.24 6.05 2 3.118 1473K 5316 0.0 0.0 L2 1/0 52.47 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 247.3 247.2 1.53 1.48 2 0.764 383K 192 0.0 0.0 L3 20/0 956.21 MB 1.0 1.1 0.2 0.8 1.1 0.2 0.4 4.4 234.0 233.6 4.78 4.43 2 2.391 1136K 2261 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 156.3 156.3 1.44 1.06 1 1.436 227K 0 0.0 0.0 L5 1048/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/22 99.82 GB 0.0 5.3 2.1 3.2 8.9 5.7 1.8 2.4 160.7 273.4 33.46 31.07 68 0.492 5460K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 2.1 3.2 8.9 5.7 1.8 2.4 160.7 273.4 33.46 31.07 68 0.492 5460K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 2.1 3.2 5.2 2.1 0.0 0.0 238.4 238.0 22.55 21.42 15 1.504 5460K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 346.6 10.91 9.66 53 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.93 GB write, 744.53 MB/s write, 5.25 GB read, 437.72 MB/s read, 33.5 seconds Interval compaction: 8.93 GB write, 757.17 MB/s write, 5.25 GB read, 445.15 MB/s read, 33.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1038251 Average: 2.3567 StdDev: 14.16 Min: 0 Median: 1.5730 Max: 5825 Percentiles: P50: 1.57 P75: 1.96 P99: 5.76 P99.9: 10.11 P99.99: 14.64 ------------------------------------------------------ [ 0, 1 ] 130872 12.605% 12.605% ### ( 1, 2 ] 677618 65.265% 77.870% ############# ( 2, 3 ] 152183 14.658% 92.528% ### ( 3, 4 ] 39464 3.801% 96.329% # ( 4, 6 ] 31494 3.033% 99.362% # ( 6, 10 ] 5560 0.536% 99.898% ( 10, 15 ] 1030 0.099% 99.997% ( 15, 22 ] 93 0.009% 100.006% ( 22, 34 ] 13 0.001% 100.007% ( 34, 51 ] 14 0.001% 100.009% ( 51, 76 ] 8 0.001% 100.009% ( 76, 110 ] 14 0.001% 100.011% ( 110, 170 ] 94 0.009% 100.020% ( 170, 250 ] 32 0.003% 100.023% ( 250, 380 ] 22 0.002% 100.025% ( 380, 580 ] 27 0.003% 100.028% ( 580, 870 ] 14 0.001% 100.029% ( 870, 1300 ] 14 0.001% 100.030% ( 1300, 1900 ] 7 0.001% 100.031% ( 1900, 2900 ] 12 0.001% 100.032% ( 2900, 4400 ] 4 0.000% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 48213 Average: 3.7858 StdDev: 31.33 Min: 1 Median: 1.6397 Max: 2327 Percentiles: P50: 1.64 P75: 2.19 P99: 9.34 P99.9: 386.05 P99.99: 1561.44 ------------------------------------------------------ [ 0, 1 ] 5387 11.173% 11.173% ## ( 1, 2 ] 29264 60.697% 71.871% ############ ( 2, 3 ] 7936 16.460% 88.331% ### ( 3, 4 ] 2365 4.905% 93.236% # ( 4, 6 ] 2011 4.171% 97.407% # ( 6, 10 ] 919 1.906% 99.313% ( 10, 15 ] 87 0.180% 99.494% ( 15, 22 ] 11 0.023% 99.517% ( 22, 34 ] 1 0.002% 99.519% ( 34, 51 ] 2 0.004% 99.523% ( 51, 76 ] 3 0.006% 99.529% ( 76, 110 ] 58 0.120% 99.649% ( 110, 170 ] 78 0.162% 99.811% ( 170, 250 ] 22 0.046% 99.857% ( 250, 380 ] 20 0.041% 99.898% ( 380, 580 ] 26 0.054% 99.952% ( 580, 870 ] 8 0.017% 99.969% ( 870, 1300 ] 8 0.017% 99.985% ( 1300, 1900 ] 5 0.010% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 95908 Average: 2.1413 StdDev: 6.72 Min: 0 Median: 1.4791 Max: 1296 Percentiles: P50: 1.48 P75: 1.87 P99: 5.74 P99.9: 11.56 P99.99: 23.64 ------------------------------------------------------ [ 0, 1 ] 18358 19.141% 19.141% #### ( 1, 2 ] 61772 64.408% 83.549% ############# ( 2, 3 ] 10150 10.583% 94.132% ## ( 3, 4 ] 2659 2.772% 96.904% # ( 4, 6 ] 2310 2.409% 99.313% ( 6, 10 ] 531 0.554% 99.867% ( 10, 15 ] 103 0.107% 99.974% ( 15, 22 ] 15 0.016% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 249013 Average: 3.6662 StdDev: 57.25 Min: 1 Median: 1.6777 Max: 7711 Percentiles: P50: 1.68 P75: 2.25 P99: 8.65 P99.9: 177.76 P99.99: 789.33 ------------------------------------------------------ [ 0, 1 ] 17334 6.961% 6.961% # ( 1, 2 ] 158133 63.504% 70.465% ############# ( 2, 3 ] 46004 18.475% 88.940% #### ( 3, 4 ] 11994 4.817% 93.756% # ( 4, 6 ] 10320 4.144% 97.901% # ( 6, 10 ] 4126 1.657% 99.557% ( 10, 15 ] 406 0.163% 99.720% ( 15, 22 ] 41 0.016% 99.737% ( 22, 34 ] 5 0.002% 99.739% ( 34, 51 ] 5 0.002% 99.741% ( 51, 76 ] 2 0.001% 99.742% ( 76, 110 ] 96 0.039% 99.780% ( 110, 170 ] 288 0.116% 99.896% ( 170, 250 ] 103 0.041% 99.937% ( 250, 380 ] 60 0.024% 99.961% ( 380, 580 ] 48 0.019% 99.981% ( 580, 870 ] 32 0.013% 99.994% ( 870, 1300 ] 16 0.006% 100.000% ( 1300, 1900 ] 11 0.004% 100.004% ( 1900, 2900 ] 10 0.004% 100.008% ( 2900, 4400 ] 2 0.001% 100.009% ( 4400, 6600 ] 9 0.004% 100.013% ( 6600, 9900 ] 7 0.003% 100.016% ** Level 4 read latency histogram (micros): Count: 320 Average: 409.3531 StdDev: 1517.12 Min: 0 Median: 1.5472 Max: 11225 Percentiles: P50: 1.55 P75: 6.28 P99: 8448.00 P99.9: 11225.00 P99.99: 11225.00 ------------------------------------------------------ [ 0, 1 ] 102 31.875% 31.875% ###### ( 1, 2 ] 106 33.125% 65.000% ####### ( 2, 3 ] 18 5.625% 70.625% # ( 3, 4 ] 3 0.938% 71.562% ( 4, 6 ] 9 2.812% 74.375% # ( 6, 10 ] 29 9.062% 83.438% ## ( 10, 15 ] 20 6.250% 89.688% # ( 15, 22 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 870, 1300 ] 2 0.625% 91.250% ( 1300, 1900 ] 7 2.188% 93.438% ( 1900, 2900 ] 4 1.250% 94.688% ( 2900, 4400 ] 3 0.938% 95.625% ( 4400, 6600 ] 8 2.500% 98.125% # ( 6600, 9900 ] 5 1.562% 99.688% ( 9900, 14000 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1000.6000 StdDev: 1288.64 Min: 118 Median: 354.0000 Max: 4444 Percentiles: P50: 354.00 P75: 870.00 P99: 4444.00 P99.9: 4444.00 P99.99: 4444.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 2 10.000% 30.000% ## ( 250, 380 ] 5 25.000% 55.000% ##### ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 2 10.000% 75.000% ## ( 1900, 2900 ] 3 15.000% 90.000% ### ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.3 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 320.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.576 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.452 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-16:48:54 ... thread 0: (1000000,5000000) ops and (310351.5,326761.9) ops/second in (3.222153,15.301660) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.07 GB 113.3 3.0 0.0 3.0 7.7 4.7 0.0 1.6 118.0 307.2 25.62 23.83 78 0.328 3070K 3184 0.0 0.0 L1 9/9 1.04 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 232.8 231.9 6.24 6.05 2 3.118 1473K 5316 0.0 0.0 L2 1/0 52.47 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 247.3 247.2 1.53 1.48 2 0.764 383K 192 0.0 0.0 L3 20/0 956.21 MB 1.0 1.1 0.2 0.8 1.1 0.2 0.4 4.4 234.0 233.6 4.78 4.43 2 2.391 1136K 2261 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 156.3 156.3 1.44 1.06 1 1.436 227K 0 0.0 0.0 L5 1048/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/22 100.86 GB 0.0 6.1 2.1 4.0 10.8 6.8 1.8 2.3 156.5 278.7 39.60 36.85 85 0.466 6292K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 2.1 4.0 10.8 6.8 1.8 2.3 156.5 278.7 39.60 36.85 85 0.466 6292K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 2.1 4.0 6.0 2.1 0.0 0.0 241.3 240.9 25.68 24.49 18 1.427 6292K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 348.5 13.92 12.36 67 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.3 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.78 GB write, 711.64 MB/s write, 6.05 GB read, 399.59 MB/s read, 39.6 seconds Interval compaction: 10.78 GB write, 721.18 MB/s write, 6.05 GB read, 404.94 MB/s read, 39.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1383088 Average: 2.3617 StdDev: 13.54 Min: 0 Median: 1.5732 Max: 5825 Percentiles: P50: 1.57 P75: 1.95 P99: 5.72 P99.9: 9.92 P99.99: 15.79 ------------------------------------------------------ [ 0, 1 ] 169913 12.285% 12.285% ## ( 1, 2 ] 909996 65.795% 78.080% ############# ( 2, 3 ] 205019 14.823% 92.903% ### ( 3, 4 ] 49914 3.609% 96.512% # ( 4, 6 ] 40067 2.897% 99.409% # ( 6, 10 ] 6938 0.502% 99.910% ( 10, 15 ] 1092 0.079% 99.989% ( 15, 22 ] 103 0.007% 99.997% ( 22, 34 ] 18 0.001% 99.998% ( 34, 51 ] 17 0.001% 99.999% ( 51, 76 ] 9 0.001% 100.000% ( 76, 110 ] 52 0.004% 100.004% ( 110, 170 ] 146 0.011% 100.014% ( 170, 250 ] 65 0.005% 100.019% ( 250, 380 ] 41 0.003% 100.022% ( 380, 580 ] 54 0.004% 100.026% ( 580, 870 ] 22 0.002% 100.027% ( 870, 1300 ] 20 0.001% 100.029% ( 1300, 1900 ] 12 0.001% 100.030% ( 1900, 2900 ] 12 0.001% 100.031% ( 2900, 4400 ] 5 0.000% 100.031% ( 4400, 6600 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 116650 Average: 3.1374 StdDev: 21.67 Min: 1 Median: 1.6240 Max: 2327 Percentiles: P50: 1.62 P75: 2.06 P99: 8.71 P99.9: 198.86 P99.99: 1049.26 ------------------------------------------------------ [ 0, 1 ] 11747 10.070% 10.070% ## ( 1, 2 ] 74642 63.988% 74.058% ############# ( 2, 3 ] 19393 16.625% 90.683% ### ( 3, 4 ] 4376 3.751% 94.435% # ( 4, 6 ] 3923 3.363% 97.798% # ( 6, 10 ] 2072 1.776% 99.574% ( 10, 15 ] 125 0.107% 99.681% ( 15, 22 ] 11 0.009% 99.691% ( 22, 34 ] 1 0.001% 99.691% ( 34, 51 ] 2 0.002% 99.693% ( 51, 76 ] 3 0.003% 99.696% ( 76, 110 ] 105 0.090% 99.786% ( 110, 170 ] 120 0.103% 99.889% ( 170, 250 ] 37 0.032% 99.920% ( 250, 380 ] 29 0.025% 99.945% ( 380, 580 ] 35 0.030% 99.975% ( 580, 870 ] 14 0.012% 99.987% ( 870, 1300 ] 8 0.007% 99.994% ( 1300, 1900 ] 5 0.004% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 95908 Average: 2.1413 StdDev: 6.72 Min: 0 Median: 1.4791 Max: 1296 Percentiles: P50: 1.48 P75: 1.87 P99: 5.74 P99.9: 11.56 P99.99: 23.64 ------------------------------------------------------ [ 0, 1 ] 18358 19.141% 19.141% #### ( 1, 2 ] 61772 64.408% 83.549% ############# ( 2, 3 ] 10150 10.583% 94.132% ## ( 3, 4 ] 2659 2.772% 96.904% # ( 4, 6 ] 2310 2.409% 99.313% ( 6, 10 ] 531 0.554% 99.867% ( 10, 15 ] 103 0.107% 99.974% ( 15, 22 ] 15 0.016% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 249013 Average: 3.6662 StdDev: 57.25 Min: 1 Median: 1.6777 Max: 7711 Percentiles: P50: 1.68 P75: 2.25 P99: 8.65 P99.9: 177.76 P99.99: 789.33 ------------------------------------------------------ [ 0, 1 ] 17334 6.961% 6.961% # ( 1, 2 ] 158133 63.504% 70.465% ############# ( 2, 3 ] 46004 18.475% 88.940% #### ( 3, 4 ] 11994 4.817% 93.756% # ( 4, 6 ] 10320 4.144% 97.901% # ( 6, 10 ] 4126 1.657% 99.557% ( 10, 15 ] 406 0.163% 99.720% ( 15, 22 ] 41 0.016% 99.737% ( 22, 34 ] 5 0.002% 99.739% ( 34, 51 ] 5 0.002% 99.741% ( 51, 76 ] 2 0.001% 99.742% ( 76, 110 ] 96 0.039% 99.780% ( 110, 170 ] 288 0.116% 99.896% ( 170, 250 ] 103 0.041% 99.937% ( 250, 380 ] 60 0.024% 99.961% ( 380, 580 ] 48 0.019% 99.981% ( 580, 870 ] 32 0.013% 99.994% ( 870, 1300 ] 16 0.006% 100.000% ( 1300, 1900 ] 11 0.004% 100.004% ( 1900, 2900 ] 10 0.004% 100.008% ( 2900, 4400 ] 2 0.001% 100.009% ( 4400, 6600 ] 9 0.004% 100.013% ( 6600, 9900 ] 7 0.003% 100.016% ** Level 4 read latency histogram (micros): Count: 320 Average: 409.3531 StdDev: 1517.12 Min: 0 Median: 1.5472 Max: 11225 Percentiles: P50: 1.55 P75: 6.28 P99: 8448.00 P99.9: 11225.00 P99.99: 11225.00 ------------------------------------------------------ [ 0, 1 ] 102 31.875% 31.875% ###### ( 1, 2 ] 106 33.125% 65.000% ####### ( 2, 3 ] 18 5.625% 70.625% # ( 3, 4 ] 3 0.938% 71.562% ( 4, 6 ] 9 2.812% 74.375% # ( 6, 10 ] 29 9.062% 83.438% ## ( 10, 15 ] 20 6.250% 89.688% # ( 15, 22 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 870, 1300 ] 2 0.625% 91.250% ( 1300, 1900 ] 7 2.188% 93.438% ( 1900, 2900 ] 4 1.250% 94.688% ( 2900, 4400 ] 3 0.938% 95.625% ( 4400, 6600 ] 8 2.500% 98.125% # ( 6600, 9900 ] 5 1.562% 99.688% ( 9900, 14000 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1000.6000 StdDev: 1288.64 Min: 118 Median: 354.0000 Max: 4444 Percentiles: P50: 354.00 P75: 870.00 P99: 4444.00 P99.9: 4444.00 P99.99: 4444.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 2 10.000% 30.000% ## ( 250, 380 ] 5 25.000% 55.000% ##### ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 2 10.000% 75.000% ## ( 1900, 2900 ] 3 15.000% 90.000% ### ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.5 total, 3.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 317.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.169 H:M:S, 14.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 305.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.593 H:M:S, 18.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-16:49:01 ... thread 0: (1000000,6000000) ops and (157970.6,277367.5) ops/second in (6.330292,21.631952) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.99 GB 88.1 4.2 0.0 4.2 9.9 5.7 0.0 1.7 130.2 303.6 33.39 31.20 98 0.341 4413K 4542 0.0 0.0 L1 9/9 1.04 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 232.8 231.9 6.24 6.05 2 3.118 1473K 5316 0.0 0.0 L2 1/0 52.47 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 247.3 247.2 1.53 1.48 2 0.764 383K 192 0.0 0.0 L3 20/0 956.21 MB 1.0 1.1 0.2 0.8 1.1 0.2 0.4 4.4 234.0 233.6 4.78 4.43 2 2.391 1136K 2261 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 156.3 156.3 1.44 1.06 1 1.436 227K 0 0.0 0.0 L5 1048/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/24 101.78 GB 0.0 7.3 2.1 5.3 13.0 7.7 1.8 2.3 158.7 280.8 47.38 44.22 105 0.451 7635K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.3 2.1 5.3 13.0 7.7 1.8 2.3 158.7 280.8 47.38 44.22 105 0.451 7635K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.3 2.1 5.3 7.3 2.1 0.0 0.0 244.9 244.5 30.71 29.42 23 1.335 7635K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 347.7 16.67 14.80 82 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.8 total, 21.6 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.99 GB write, 609.14 MB/s write, 7.34 GB read, 344.34 MB/s read, 47.4 seconds Interval compaction: 12.99 GB write, 614.92 MB/s write, 7.34 GB read, 347.60 MB/s read, 47.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 15, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1929184 Average: 2.3655 StdDev: 13.52 Min: 0 Median: 1.5582 Max: 5825 Percentiles: P50: 1.56 P75: 1.93 P99: 5.74 P99.9: 10.44 P99.99: 126.63 ------------------------------------------------------ [ 0, 1 ] 248994 12.907% 12.907% ### ( 1, 2 ] 1282025 66.454% 79.361% ############# ( 2, 3 ] 271885 14.093% 93.454% ### ( 3, 4 ] 63356 3.284% 96.738% # ( 4, 6 ] 50193 2.602% 99.340% # ( 6, 10 ] 10687 0.554% 99.894% ( 10, 15 ] 1331 0.069% 99.963% ( 15, 22 ] 144 0.007% 99.971% ( 22, 34 ] 21 0.001% 99.972% ( 34, 51 ] 19 0.001% 99.973% ( 51, 76 ] 12 0.001% 99.973% ( 76, 110 ] 225 0.012% 99.985% ( 110, 170 ] 361 0.019% 100.004% ( 170, 250 ] 138 0.007% 100.011% ( 250, 380 ] 82 0.004% 100.015% ( 380, 580 ] 98 0.005% 100.020% ( 580, 870 ] 41 0.002% 100.022% ( 870, 1300 ] 28 0.001% 100.024% ( 1300, 1900 ] 16 0.001% 100.024% ( 1900, 2900 ] 13 0.001% 100.025% ( 2900, 4400 ] 7 0.000% 100.026% ( 4400, 6600 ] 2 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 253636 Average: 2.7609 StdDev: 15.80 Min: 1 Median: 1.5651 Max: 2327 Percentiles: P50: 1.57 P75: 1.94 P99: 8.23 P99.9: 151.47 P99.99: 676.04 ------------------------------------------------------ [ 0, 1 ] 32393 12.771% 12.771% ### ( 1, 2 ] 167108 65.885% 78.656% ############# ( 2, 3 ] 35208 13.881% 92.538% ### ( 3, 4 ] 7556 2.979% 95.517% # ( 4, 6 ] 6660 2.626% 98.143% # ( 6, 10 ] 3893 1.535% 99.677% ( 10, 15 ] 173 0.068% 99.746% ( 15, 22 ] 25 0.010% 99.756% ( 22, 34 ] 2 0.001% 99.756% ( 34, 51 ] 4 0.002% 99.758% ( 51, 76 ] 3 0.001% 99.759% ( 76, 110 ] 197 0.078% 99.837% ( 110, 170 ] 232 0.091% 99.928% ( 170, 250 ] 67 0.026% 99.955% ( 250, 380 ] 37 0.015% 99.969% ( 380, 580 ] 48 0.019% 99.988% ( 580, 870 ] 14 0.006% 99.994% ( 870, 1300 ] 9 0.004% 99.997% ( 1300, 1900 ] 5 0.002% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 95908 Average: 2.1413 StdDev: 6.72 Min: 0 Median: 1.4791 Max: 1296 Percentiles: P50: 1.48 P75: 1.87 P99: 5.74 P99.9: 11.56 P99.99: 23.64 ------------------------------------------------------ [ 0, 1 ] 18358 19.141% 19.141% #### ( 1, 2 ] 61772 64.408% 83.549% ############# ( 2, 3 ] 10150 10.583% 94.132% ## ( 3, 4 ] 2659 2.772% 96.904% # ( 4, 6 ] 2310 2.409% 99.313% ( 6, 10 ] 531 0.554% 99.867% ( 10, 15 ] 103 0.107% 99.974% ( 15, 22 ] 15 0.016% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 249013 Average: 3.6662 StdDev: 57.25 Min: 1 Median: 1.6777 Max: 7711 Percentiles: P50: 1.68 P75: 2.25 P99: 8.65 P99.9: 177.76 P99.99: 789.33 ------------------------------------------------------ [ 0, 1 ] 17334 6.961% 6.961% # ( 1, 2 ] 158133 63.504% 70.465% ############# ( 2, 3 ] 46004 18.475% 88.940% #### ( 3, 4 ] 11994 4.817% 93.756% # ( 4, 6 ] 10320 4.144% 97.901% # ( 6, 10 ] 4126 1.657% 99.557% ( 10, 15 ] 406 0.163% 99.720% ( 15, 22 ] 41 0.016% 99.737% ( 22, 34 ] 5 0.002% 99.739% ( 34, 51 ] 5 0.002% 99.741% ( 51, 76 ] 2 0.001% 99.742% ( 76, 110 ] 96 0.039% 99.780% ( 110, 170 ] 288 0.116% 99.896% ( 170, 250 ] 103 0.041% 99.937% ( 250, 380 ] 60 0.024% 99.961% ( 380, 580 ] 48 0.019% 99.981% ( 580, 870 ] 32 0.013% 99.994% ( 870, 1300 ] 16 0.006% 100.000% ( 1300, 1900 ] 11 0.004% 100.004% ( 1900, 2900 ] 10 0.004% 100.008% ( 2900, 4400 ] 2 0.001% 100.009% ( 4400, 6600 ] 9 0.004% 100.013% ( 6600, 9900 ] 7 0.003% 100.016% ** Level 4 read latency histogram (micros): Count: 320 Average: 409.3531 StdDev: 1517.12 Min: 0 Median: 1.5472 Max: 11225 Percentiles: P50: 1.55 P75: 6.28 P99: 8448.00 P99.9: 11225.00 P99.99: 11225.00 ------------------------------------------------------ [ 0, 1 ] 102 31.875% 31.875% ###### ( 1, 2 ] 106 33.125% 65.000% ####### ( 2, 3 ] 18 5.625% 70.625% # ( 3, 4 ] 3 0.938% 71.562% ( 4, 6 ] 9 2.812% 74.375% # ( 6, 10 ] 29 9.062% 83.438% ## ( 10, 15 ] 20 6.250% 89.688% # ( 15, 22 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 870, 1300 ] 2 0.625% 91.250% ( 1300, 1900 ] 7 2.188% 93.438% ( 1900, 2900 ] 4 1.250% 94.688% ( 2900, 4400 ] 3 0.938% 95.625% ( 4400, 6600 ] 8 2.500% 98.125% # ( 6600, 9900 ] 5 1.562% 99.688% ( 9900, 14000 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1000.6000 StdDev: 1288.64 Min: 118 Median: 354.0000 Max: 4444 Percentiles: P50: 354.00 P75: 870.00 P99: 4444.00 P99.9: 4444.00 P99.99: 4444.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 2 10.000% 30.000% ## ( 250, 380 ] 5 25.000% 55.000% ##### ( 380, 580 ] 2 10.000% 65.000% ## ( 580, 870 ] 2 10.000% 75.000% ## ( 1900, 2900 ] 3 15.000% 90.000% ### ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 21.8 total, 6.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 270.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.691 H:M:S, 26.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 155.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.523 H:M:S, 55.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-16:49:08 ... thread 0: (1000000,7000000) ops and (143820.3,244883.0) ops/second in (6.953122,28.585074) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 3.19 GB 25.2 6.2 0.0 6.2 12.8 6.6 0.0 1.9 139.9 287.8 45.47 41.67 114 0.399 6459K 14K 0.0 0.0 L1 7/7 737.06 MB 0.0 4.2 3.1 1.0 4.1 3.1 0.2 1.3 224.7 222.6 19.06 18.24 3 6.354 4348K 38K 0.0 0.0 L2 5/3 643.89 MB 2.6 0.4 0.2 0.2 0.4 0.2 2.5 2.0 247.3 247.2 1.53 1.48 2 0.764 383K 192 0.0 0.0 L3 29/3 1.14 GB 1.0 2.9 1.7 1.2 2.9 1.7 0.4 1.7 201.7 201.2 14.55 12.82 6 2.425 2980K 7911 0.0 0.0 L4 181/0 9.56 GB 1.0 0.9 0.8 0.0 0.9 0.8 0.8 1.1 133.0 132.7 6.88 4.39 14 0.491 897K 693 0.0 0.0 L5 1064/0 87.42 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/22 102.66 GB 0.0 14.5 5.8 8.7 21.0 12.4 5.7 3.2 170.0 246.3 87.49 78.60 139 0.629 15M 61K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.5 5.8 8.7 21.0 12.4 5.7 3.2 170.0 246.3 87.49 78.60 139 0.629 15M 61K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.5 5.8 8.7 14.5 5.8 0.0 0.0 221.7 220.8 67.07 61.16 44 1.524 15M 61K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 330.0 20.42 17.44 95 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.8 total, 28.6 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.04 GB write, 748.43 MB/s write, 14.52 GB read, 516.50 MB/s read, 87.5 seconds Interval compaction: 21.04 GB write, 753.80 MB/s write, 14.52 GB read, 520.21 MB/s read, 87.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 24, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2555634 Average: 2.6636 StdDev: 19.83 Min: 0 Median: 1.5988 Max: 6377 Percentiles: P50: 1.60 P75: 1.99 P99: 6.37 P99.9: 85.05 P99.99: 230.34 ------------------------------------------------------ [ 0, 1 ] 292386 11.441% 11.441% ## ( 1, 2 ] 1645727 64.396% 75.837% ############# ( 2, 3 ] 400398 15.667% 91.504% ### ( 3, 4 ] 99433 3.891% 95.395% # ( 4, 6 ] 90111 3.526% 98.921% # ( 6, 10 ] 21794 0.853% 99.774% ( 10, 15 ] 2657 0.104% 99.878% ( 15, 22 ] 314 0.012% 99.890% ( 22, 34 ] 28 0.001% 99.891% ( 34, 51 ] 20 0.001% 99.892% ( 51, 76 ] 16 0.001% 99.892% ( 76, 110 ] 734 0.029% 99.921% ( 110, 170 ] 1416 0.055% 99.977% ( 170, 250 ] 458 0.018% 99.994% ( 250, 380 ] 269 0.011% 100.005% ( 380, 580 ] 282 0.011% 100.016% ( 580, 870 ] 117 0.005% 100.021% ( 870, 1300 ] 50 0.002% 100.023% ( 1300, 1900 ] 24 0.001% 100.023% ( 1900, 2900 ] 36 0.001% 100.025% ( 2900, 4400 ] 22 0.001% 100.026% ( 4400, 6600 ] 7 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 818463 Average: 3.9437 StdDev: 50.73 Min: 0 Median: 1.8111 Max: 8968 Percentiles: P50: 1.81 P75: 2.62 P99: 9.02 P99.9: 133.64 P99.99: 328.67 ------------------------------------------------------ [ 0, 1 ] 41865 5.115% 5.115% # ( 1, 2 ] 452922 55.338% 60.453% ########### ( 2, 3 ] 192533 23.524% 83.977% ##### ( 3, 4 ] 52699 6.439% 90.416% # ( 4, 6 ] 56875 6.949% 97.365% # ( 6, 10 ] 17748 2.168% 99.533% ( 10, 15 ] 2149 0.263% 99.796% ( 15, 22 ] 284 0.035% 99.830% ( 22, 34 ] 16 0.002% 99.832% ( 34, 51 ] 7 0.001% 99.833% ( 51, 76 ] 5 0.001% 99.834% ( 76, 110 ] 331 0.040% 99.874% ( 110, 170 ] 537 0.066% 99.940% ( 170, 250 ] 275 0.034% 99.973% ( 250, 380 ] 225 0.027% 100.001% ( 380, 580 ] 248 0.030% 100.031% ( 580, 870 ] 134 0.016% 100.048% ( 870, 1300 ] 106 0.013% 100.061% ( 1300, 1900 ] 47 0.006% 100.066% ( 1900, 2900 ] 29 0.004% 100.070% ( 2900, 4400 ] 48 0.006% 100.076% ( 4400, 6600 ] 21 0.003% 100.078% ( 6600, 9900 ] 6 0.001% 100.079% ** Level 2 read latency histogram (micros): Count: 95908 Average: 2.1413 StdDev: 6.72 Min: 0 Median: 1.4791 Max: 1296 Percentiles: P50: 1.48 P75: 1.87 P99: 5.74 P99.9: 11.56 P99.99: 23.64 ------------------------------------------------------ [ 0, 1 ] 18358 19.141% 19.141% #### ( 1, 2 ] 61772 64.408% 83.549% ############# ( 2, 3 ] 10150 10.583% 94.132% ## ( 3, 4 ] 2659 2.772% 96.904% # ( 4, 6 ] 2310 2.409% 99.313% ( 6, 10 ] 531 0.554% 99.867% ( 10, 15 ] 103 0.107% 99.974% ( 15, 22 ] 15 0.016% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 438277 Average: 4.4026 StdDev: 60.53 Min: 1 Median: 1.8651 Max: 8017 Percentiles: P50: 1.87 P75: 2.75 P99: 8.95 P99.9: 123.49 P99.99: 217.21 ------------------------------------------------------ [ 0, 1 ] 18168 4.145% 4.145% # ( 1, 2 ] 232298 53.003% 57.148% ########### ( 2, 3 ] 104042 23.739% 80.887% ##### ( 3, 4 ] 34977 7.981% 88.867% ## ( 4, 6 ] 38103 8.694% 97.561% ## ( 6, 10 ] 8559 1.953% 99.514% ( 10, 15 ] 1354 0.309% 99.823% ( 15, 22 ] 118 0.027% 99.850% ( 22, 34 ] 13 0.003% 99.853% ( 34, 51 ] 7 0.002% 99.854% ( 51, 76 ] 7 0.002% 99.856% ( 76, 110 ] 110 0.025% 99.881% ( 110, 170 ] 368 0.084% 99.965% ( 170, 250 ] 185 0.042% 100.007% ( 250, 380 ] 164 0.037% 100.045% ( 380, 580 ] 163 0.037% 100.082% ( 580, 870 ] 121 0.028% 100.110% ( 870, 1300 ] 58 0.013% 100.123% ( 1300, 1900 ] 28 0.006% 100.129% ( 1900, 2900 ] 22 0.005% 100.134% ( 2900, 4400 ] 33 0.008% 100.142% ( 4400, 6600 ] 11 0.003% 100.144% ( 6600, 9900 ] 8 0.002% 100.146% ** Level 4 read latency histogram (micros): Count: 13284 Average: 76.3208 StdDev: 431.81 Min: 0 Median: 2.2581 Max: 11225 Percentiles: P50: 2.26 P75: 3.50 P99: 1715.44 P99.9: 5786.78 P99.99: 8471.63 ------------------------------------------------------ [ 0, 1 ] 267 2.010% 2.010% ( 1, 2 ] 5505 41.441% 43.451% ######## ( 2, 3 ] 3371 25.376% 68.827% ##### ( 3, 4 ] 1630 12.270% 81.098% ## ( 4, 6 ] 1143 8.604% 89.702% ## ( 6, 10 ] 364 2.740% 92.442% # ( 10, 15 ] 107 0.805% 93.248% ( 15, 22 ] 9 0.068% 93.315% ( 76, 110 ] 4 0.030% 93.345% ( 110, 170 ] 37 0.279% 93.624% ( 170, 250 ] 56 0.422% 94.045% ( 250, 380 ] 91 0.685% 94.731% ( 380, 580 ] 179 1.347% 96.078% ( 580, 870 ] 189 1.423% 97.501% ( 870, 1300 ] 150 1.129% 98.630% ( 1300, 1900 ] 71 0.534% 99.164% ( 1900, 2900 ] 44 0.331% 99.496% ( 2900, 4400 ] 43 0.324% 99.819% ( 4400, 6600 ] 17 0.128% 99.947% ( 6600, 9900 ] 10 0.075% 100.023% ( 9900, 14000 ] 1 0.008% 100.030% ** Level 5 read latency histogram (micros): Count: 100 Average: 1176.9600 StdDev: 1467.20 Min: 92 Median: 492.5000 Max: 8364 Percentiles: P50: 492.50 P75: 1780.00 P99: 6600.00 P99.9: 8364.00 P99.99: 8364.00 ------------------------------------------------------ ( 76, 110 ] 2 2.000% 2.000% ( 110, 170 ] 15 15.000% 17.000% ### ( 170, 250 ] 11 11.000% 28.000% ## ( 250, 380 ] 13 13.000% 41.000% ### ( 380, 580 ] 16 16.000% 57.000% ### ( 580, 870 ] 9 9.000% 66.000% ## ( 870, 1300 ] 5 5.000% 71.000% # ( 1300, 1900 ] 5 5.000% 76.000% # ( 1900, 2900 ] 12 12.000% 88.000% ## ( 2900, 4400 ] 9 9.000% 97.000% ## ( 4400, 6600 ] 2 2.000% 99.000% ( 6600, 9900 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 28.8 total, 7.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 239.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.609 H:M:S, 33.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 141.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.917 H:M:S, 56.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-16:49:11 ... thread 0: (1000000,8000000) ops and (263134.1,247024.8) ops/second in (3.800344,32.385418) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 4.17 GB 69.2 6.9 0.0 6.9 14.4 7.6 0.0 1.9 135.9 284.9 51.90 47.12 129 0.402 7162K 14K 0.0 0.0 L1 7/7 737.06 MB 0.0 4.2 3.1 1.0 4.1 3.1 0.2 1.3 224.7 222.6 19.06 18.24 3 6.354 4348K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.5 2.0 247.3 247.2 1.53 1.48 2 0.764 383K 192 0.0 0.0 L3 26/0 973.41 MB 1.0 3.9 2.3 1.6 3.9 2.3 0.4 1.7 195.3 194.8 20.42 17.57 10 2.042 4051K 10K 0.0 0.0 L4 188/0 9.76 GB 1.0 1.8 1.7 0.1 1.8 1.7 0.8 1.1 134.1 133.8 13.57 8.71 31 0.438 1784K 1889 0.0 0.0 L5 1072/0 88.03 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1312/24 103.64 GB 0.0 17.1 7.3 9.8 24.6 14.8 6.3 3.3 164.6 236.7 106.48 93.11 175 0.608 17M 66K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.1 7.3 9.8 24.6 14.8 6.3 3.3 164.6 236.7 106.48 93.11 175 0.608 17M 66K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.1 7.3 9.8 17.0 7.2 0.0 0.0 212.2 211.4 82.58 73.03 67 1.233 17M 66K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 324.3 23.90 20.08 108 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.6 total, 32.4 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.61 GB write, 773.29 MB/s write, 17.11 GB read, 537.65 MB/s read, 106.5 seconds Interval compaction: 24.61 GB write, 778.18 MB/s write, 17.11 GB read, 541.05 MB/s read, 106.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 37, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2979583 Average: 2.7492 StdDev: 23.98 Min: 0 Median: 1.6283 Max: 8011 Percentiles: P50: 1.63 P75: 2.09 P99: 6.77 P99.9: 20.37 P99.99: 216.71 ------------------------------------------------------ [ 0, 1 ] 310275 10.413% 10.413% ## ( 1, 2 ] 1877309 63.006% 73.419% ############# ( 2, 3 ] 506053 16.984% 90.403% ### ( 3, 4 ] 128340 4.307% 94.710% # ( 4, 6 ] 122328 4.106% 98.816% # ( 6, 10 ] 28423 0.954% 99.770% ( 10, 15 ] 3552 0.119% 99.889% ( 15, 22 ] 424 0.014% 99.903% ( 22, 34 ] 34 0.001% 99.905% ( 34, 51 ] 23 0.001% 99.905% ( 51, 76 ] 21 0.001% 99.906% ( 76, 110 ] 744 0.025% 99.931% ( 110, 170 ] 1465 0.049% 99.980% ( 170, 250 ] 507 0.017% 99.997% ( 250, 380 ] 305 0.010% 100.007% ( 380, 580 ] 341 0.011% 100.019% ( 580, 870 ] 141 0.005% 100.024% ( 870, 1300 ] 65 0.002% 100.026% ( 1300, 1900 ] 35 0.001% 100.027% ( 1900, 2900 ] 42 0.001% 100.028% ( 2900, 4400 ] 39 0.001% 100.030% ( 4400, 6600 ] 10 0.000% 100.030% ( 6600, 9900 ] 5 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 917356 Average: 4.0276 StdDev: 55.11 Min: 0 Median: 1.8235 Max: 11089 Percentiles: P50: 1.82 P75: 2.64 P99: 9.03 P99.9: 136.35 P99.99: 357.60 ------------------------------------------------------ [ 0, 1 ] 42925 4.679% 4.679% # ( 1, 2 ] 504871 55.035% 59.715% ########### ( 2, 3 ] 220398 24.025% 83.740% ##### ( 3, 4 ] 59984 6.539% 90.279% # ( 4, 6 ] 64824 7.066% 97.345% # ( 6, 10 ] 20056 2.186% 99.531% ( 10, 15 ] 2453 0.267% 99.799% ( 15, 22 ] 306 0.033% 99.832% ( 22, 34 ] 16 0.002% 99.834% ( 34, 51 ] 8 0.001% 99.835% ( 51, 76 ] 7 0.001% 99.836% ( 76, 110 ] 339 0.037% 99.873% ( 110, 170 ] 573 0.062% 99.935% ( 170, 250 ] 299 0.033% 99.968% ( 250, 380 ] 248 0.027% 99.995% ( 380, 580 ] 271 0.030% 100.024% ( 580, 870 ] 148 0.016% 100.040% ( 870, 1300 ] 114 0.012% 100.053% ( 1300, 1900 ] 49 0.005% 100.058% ( 1900, 2900 ] 46 0.005% 100.063% ( 2900, 4400 ] 59 0.006% 100.070% ( 4400, 6600 ] 24 0.003% 100.072% ( 6600, 9900 ] 10 0.001% 100.073% ( 9900, 14000 ] 1 0.000% 100.073% ** Level 2 read latency histogram (micros): Count: 95908 Average: 2.1413 StdDev: 6.72 Min: 0 Median: 1.4791 Max: 1296 Percentiles: P50: 1.48 P75: 1.87 P99: 5.74 P99.9: 11.56 P99.99: 23.64 ------------------------------------------------------ [ 0, 1 ] 18358 19.141% 19.141% #### ( 1, 2 ] 61772 64.408% 83.549% ############# ( 2, 3 ] 10150 10.583% 94.132% ## ( 3, 4 ] 2659 2.772% 96.904% # ( 4, 6 ] 2310 2.409% 99.313% ( 6, 10 ] 531 0.554% 99.867% ( 10, 15 ] 103 0.107% 99.974% ( 15, 22 ] 15 0.016% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 732709 Average: 4.3231 StdDev: 63.33 Min: 0 Median: 1.9498 Max: 19053 Percentiles: P50: 1.95 P75: 2.85 P99: 8.70 P99.9: 15.29 P99.99: 155.49 ------------------------------------------------------ [ 0, 1 ] 19903 2.716% 2.716% # ( 1, 2 ] 364773 49.784% 52.501% ########## ( 2, 3 ] 193220 26.371% 78.871% ##### ( 3, 4 ] 65709 8.968% 87.839% ## ( 4, 6 ] 72343 9.873% 97.712% ## ( 6, 10 ] 13963 1.906% 99.618% ( 10, 15 ] 2057 0.281% 99.899% ( 15, 22 ] 199 0.027% 99.926% ( 22, 34 ] 16 0.002% 99.928% ( 34, 51 ] 8 0.001% 99.929% ( 51, 76 ] 11 0.002% 99.931% ( 76, 110 ] 113 0.015% 99.946% ( 110, 170 ] 423 0.058% 100.004% ( 170, 250 ] 235 0.032% 100.036% ( 250, 380 ] 211 0.029% 100.065% ( 380, 580 ] 221 0.030% 100.095% ( 580, 870 ] 180 0.025% 100.120% ( 870, 1300 ] 92 0.013% 100.132% ( 1300, 1900 ] 40 0.005% 100.138% ( 1900, 2900 ] 37 0.005% 100.143% ( 2900, 4400 ] 56 0.008% 100.150% ( 4400, 6600 ] 12 0.002% 100.152% ( 6600, 9900 ] 13 0.002% 100.154% ( 9900, 14000 ] 1 0.000% 100.154% ( 14000, 22000 ] 1 0.000% 100.154% ** Level 4 read latency histogram (micros): Count: 30273 Average: 61.6341 StdDev: 379.95 Min: 0 Median: 2.1896 Max: 12105 Percentiles: P50: 2.19 P75: 3.37 P99: 1263.01 P99.9: 5355.53 P99.99: 8679.47 ------------------------------------------------------ [ 0, 1 ] 524 1.731% 1.731% ( 1, 2 ] 13148 43.431% 45.162% ######### ( 2, 3 ] 7723 25.511% 70.674% ##### ( 3, 4 ] 3495 11.545% 82.218% ## ( 4, 6 ] 2460 8.126% 90.345% ## ( 6, 10 ] 730 2.411% 92.756% ( 10, 15 ] 165 0.545% 93.301% ( 15, 22 ] 14 0.046% 93.347% ( 34, 51 ] 1 0.003% 93.351% ( 51, 76 ] 1 0.003% 93.354% ( 76, 110 ] 30 0.099% 93.453% ( 110, 170 ] 156 0.515% 93.968% ( 170, 250 ] 225 0.743% 94.711% ( 250, 380 ] 277 0.915% 95.626% ( 380, 580 ] 413 1.364% 96.991% ( 580, 870 ] 388 1.282% 98.272% ( 870, 1300 ] 241 0.796% 99.068% ( 1300, 1900 ] 105 0.347% 99.415% ( 1900, 2900 ] 70 0.231% 99.647% ( 2900, 4400 ] 65 0.215% 99.861% ( 4400, 6600 ] 27 0.089% 99.950% ( 6600, 9900 ] 19 0.063% 100.013% ( 9900, 14000 ] 3 0.010% 100.023% ** Level 5 read latency histogram (micros): Count: 140 Average: 1123.0429 StdDev: 1418.59 Min: 92 Median: 450.5882 Max: 8364 Percentiles: P50: 450.59 P75: 1675.00 P99: 6380.00 P99.9: 8364.00 P99.99: 8364.00 ------------------------------------------------------ ( 76, 110 ] 2 1.429% 1.429% ( 110, 170 ] 28 20.000% 21.429% #### ( 170, 250 ] 19 13.571% 35.000% ### ( 250, 380 ] 15 10.714% 45.714% ## ( 380, 580 ] 17 12.143% 57.857% ## ( 580, 870 ] 12 8.571% 66.429% ## ( 870, 1300 ] 7 5.000% 71.429% # ( 1300, 1900 ] 8 5.714% 77.143% # ( 1900, 2900 ] 15 10.714% 87.857% ## ( 2900, 4400 ] 12 8.571% 96.429% ## ( 4400, 6600 ] 4 2.857% 99.286% # ( 6600, 9900 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 32.6 total, 3.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 241.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.454 H:M:S, 32.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 258.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.846 H:M:S, 22.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-16:49:27 ... thread 0: (1000000,9000000) ops and (64940.0,188346.6) ops/second in (15.398829,47.784247) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 2.15 GB 0.0 8.2 0.0 8.2 16.7 8.5 0.0 2.0 140.2 285.5 59.74 54.54 149 0.401 8505K 16K 0.0 0.0 L1 15/15 1.76 GB 0.0 7.8 6.1 1.8 7.8 6.0 0.2 1.3 222.9 220.2 36.04 34.18 4 9.009 7863K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.4 2.0 247.3 247.2 1.53 1.48 2 0.764 383K 192 0.0 0.0 L3 42/11 2.22 GB 1.3 6.4 4.0 2.5 6.4 4.0 0.6 1.6 171.0 170.2 38.60 30.18 23 1.678 6703K 29K 0.0 0.0 L4 190/25 9.96 GB 1.0 2.4 2.2 0.2 2.4 2.2 0.8 1.1 124.8 124.5 19.59 11.88 40 0.490 2382K 2471 0.0 0.0 L5 1076/0 88.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1333/61 104.48 GB 0.0 25.2 12.5 12.7 33.6 20.8 8.7 4.0 166.1 221.1 155.49 132.25 218 0.713 25M 86K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.2 12.5 12.7 33.6 20.8 8.7 4.0 166.1 221.1 155.49 132.25 218 0.713 25M 86K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.2 12.5 12.7 25.1 12.3 0.0 0.0 200.5 199.4 128.83 109.73 95 1.356 25M 86K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 326.0 26.67 22.53 123 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.0 total, 47.8 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.57 GB write, 716.35 MB/s write, 25.23 GB read, 538.24 MB/s read, 155.5 seconds Interval compaction: 33.57 GB write, 719.42 MB/s write, 25.23 GB read, 540.56 MB/s read, 155.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 30, pending-compaction-bytes-stops: 0, total-delays: 50, total-stops: 37, interval: 87 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3895334 Average: 2.8058 StdDev: 27.57 Min: 0 Median: 1.6155 Max: 11554 Percentiles: P50: 1.62 P75: 2.04 P99: 7.01 P99.9: 20.35 P99.99: 283.37 ------------------------------------------------------ [ 0, 1 ] 433363 11.125% 11.125% ## ( 1, 2 ] 2460342 63.161% 74.286% ############# ( 2, 3 ] 633649 16.267% 90.553% ### ( 3, 4 ] 161016 4.134% 94.687% # ( 4, 6 ] 158088 4.058% 98.745% # ( 6, 10 ] 39309 1.009% 99.754% ( 10, 15 ] 5118 0.131% 99.886% ( 15, 22 ] 726 0.019% 99.904% ( 22, 34 ] 43 0.001% 99.906% ( 34, 51 ] 27 0.001% 99.906% ( 51, 76 ] 29 0.001% 99.907% ( 76, 110 ] 898 0.023% 99.930% ( 110, 170 ] 1635 0.042% 99.972% ( 170, 250 ] 598 0.015% 99.987% ( 250, 380 ] 407 0.010% 99.998% ( 380, 580 ] 506 0.013% 100.011% ( 580, 870 ] 319 0.008% 100.019% ( 870, 1300 ] 157 0.004% 100.023% ( 1300, 1900 ] 73 0.002% 100.025% ( 1900, 2900 ] 58 0.001% 100.026% ( 2900, 4400 ] 62 0.002% 100.028% ( 4400, 6600 ] 14 0.000% 100.028% ( 6600, 9900 ] 9 0.000% 100.029% ( 9900, 14000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 1540103 Average: 4.6199 StdDev: 68.80 Min: 0 Median: 1.8441 Max: 15080 Percentiles: P50: 1.84 P75: 2.74 P99: 9.20 P99.9: 108.86 P99.99: 288.65 ------------------------------------------------------ [ 0, 1 ] 105241 6.833% 6.833% # ( 1, 2 ] 787576 51.138% 57.971% ########## ( 2, 3 ] 352118 22.863% 80.835% ##### ( 3, 4 ] 116836 7.586% 88.421% ## ( 4, 6 ] 134306 8.721% 97.141% ## ( 6, 10 ] 35796 2.324% 99.466% ( 10, 15 ] 5301 0.344% 99.810% ( 15, 22 ] 698 0.045% 99.855% ( 22, 34 ] 49 0.003% 99.858% ( 34, 51 ] 34 0.002% 99.861% ( 51, 76 ] 87 0.006% 99.866% ( 76, 110 ] 539 0.035% 99.901% ( 110, 170 ] 852 0.055% 99.956% ( 170, 250 ] 403 0.026% 99.983% ( 250, 380 ] 380 0.025% 100.007% ( 380, 580 ] 504 0.033% 100.040% ( 580, 870 ] 415 0.027% 100.067% ( 870, 1300 ] 334 0.022% 100.089% ( 1300, 1900 ] 168 0.011% 100.100% ( 1900, 2900 ] 110 0.007% 100.107% ( 2900, 4400 ] 157 0.010% 100.117% ( 4400, 6600 ] 51 0.003% 100.120% ( 6600, 9900 ] 27 0.002% 100.122% ( 9900, 14000 ] 3 0.000% 100.122% ( 14000, 22000 ] 1 0.000% 100.122% ** Level 2 read latency histogram (micros): Count: 95908 Average: 2.1413 StdDev: 6.72 Min: 0 Median: 1.4791 Max: 1296 Percentiles: P50: 1.48 P75: 1.87 P99: 5.74 P99.9: 11.56 P99.99: 23.64 ------------------------------------------------------ [ 0, 1 ] 18358 19.141% 19.141% #### ( 1, 2 ] 61772 64.408% 83.549% ############# ( 2, 3 ] 10150 10.583% 94.132% ## ( 3, 4 ] 2659 2.772% 96.904% # ( 4, 6 ] 2310 2.409% 99.313% ( 6, 10 ] 531 0.554% 99.867% ( 10, 15 ] 103 0.107% 99.974% ( 15, 22 ] 15 0.016% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1196193 Average: 5.2839 StdDev: 76.29 Min: 0 Median: 2.0720 Max: 19053 Percentiles: P50: 2.07 P75: 2.98 P99: 9.12 P99.9: 86.10 P99.99: 310.57 ------------------------------------------------------ [ 0, 1 ] 22655 1.894% 1.894% ( 1, 2 ] 551683 46.120% 48.014% ######### ( 2, 3 ] 329909 27.580% 75.594% ###### ( 3, 4 ] 119958 10.028% 85.622% ## ( 4, 6 ] 138873 11.610% 97.232% ## ( 6, 10 ] 27137 2.269% 99.500% ( 10, 15 ] 4191 0.350% 99.851% ( 15, 22 ] 442 0.037% 99.888% ( 22, 34 ] 37 0.003% 99.891% ( 34, 51 ] 15 0.001% 99.892% ( 51, 76 ] 60 0.005% 99.897% ( 76, 110 ] 134 0.011% 99.908% ( 110, 170 ] 471 0.039% 99.948% ( 170, 250 ] 325 0.027% 99.975% ( 250, 380 ] 400 0.033% 100.008% ( 380, 580 ] 551 0.046% 100.054% ( 580, 870 ] 562 0.047% 100.101% ( 870, 1300 ] 388 0.032% 100.134% ( 1300, 1900 ] 144 0.012% 100.146% ( 1900, 2900 ] 99 0.008% 100.154% ( 2900, 4400 ] 148 0.012% 100.166% ( 4400, 6600 ] 31 0.003% 100.169% ( 6600, 9900 ] 23 0.002% 100.171% ( 9900, 14000 ] 2 0.000% 100.171% ( 14000, 22000 ] 3 0.000% 100.171% ** Level 4 read latency histogram (micros): Count: 92741 Average: 49.0697 StdDev: 336.23 Min: 0 Median: 2.2020 Max: 17513 Percentiles: P50: 2.20 P75: 3.35 P99: 1182.28 P99.9: 3987.17 P99.99: 5411.55 ------------------------------------------------------ [ 0, 1 ] 1170 1.262% 1.262% ( 1, 2 ] 40249 43.399% 44.661% ######### ( 2, 3 ] 24508 26.426% 71.087% ##### ( 3, 4 ] 10346 11.156% 82.243% ## ( 4, 6 ] 9303 10.031% 92.274% ## ( 6, 10 ] 2453 2.645% 94.919% # ( 10, 15 ] 435 0.469% 95.388% ( 15, 22 ] 41 0.044% 95.432% ( 22, 34 ] 5 0.005% 95.438% ( 34, 51 ] 5 0.005% 95.443% ( 51, 76 ] 5 0.005% 95.449% ( 76, 110 ] 38 0.041% 95.490% ( 110, 170 ] 223 0.240% 95.730% ( 170, 250 ] 366 0.395% 96.125% ( 250, 380 ] 522 0.563% 96.688% ( 380, 580 ] 822 0.886% 97.574% ( 580, 870 ] 844 0.910% 98.484% ( 870, 1300 ] 659 0.711% 99.195% ( 1300, 1900 ] 324 0.349% 99.544% ( 1900, 2900 ] 194 0.209% 99.753% ( 2900, 4400 ] 188 0.203% 99.956% ( 4400, 6600 ] 69 0.074% 100.030% ( 6600, 9900 ] 28 0.030% 100.060% ( 9900, 14000 ] 5 0.005% 100.066% ( 14000, 22000 ] 2 0.002% 100.068% ** Level 5 read latency histogram (micros): Count: 160 Average: 1252.4125 StdDev: 1474.06 Min: 92 Median: 537.8947 Max: 8364 Percentiles: P50: 537.89 P75: 1958.82 P99: 6380.00 P99.9: 8364.00 P99.99: 8364.00 ------------------------------------------------------ ( 76, 110 ] 2 1.250% 1.250% ( 110, 170 ] 28 17.500% 18.750% #### ( 170, 250 ] 19 11.875% 30.625% ## ( 250, 380 ] 16 10.000% 40.625% ## ( 380, 580 ] 19 11.875% 52.500% ## ( 580, 870 ] 13 8.125% 60.625% ## ( 870, 1300 ] 12 7.500% 68.125% ## ( 1300, 1900 ] 10 6.250% 74.375% # ( 1900, 2900 ] 17 10.625% 85.000% ## ( 2900, 4400 ] 17 10.625% 95.625% ## ( 4400, 6600 ] 6 3.750% 99.375% # ( 6600, 9900 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 48.0 total, 15.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 184.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.803 H:M:S, 47.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 63.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.349 H:M:S, 80.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/15-16:49:31 ... thread 0: (1000000,10000000) ops and (245462.4,192833.6) ops/second in (4.073943,51.858190) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.20 GB 81.8 8.8 0.0 8.8 18.3 9.5 0.0 1.9 136.0 283.2 66.23 59.79 166 0.399 9145K 17K 0.0 0.0 L1 15/15 1.76 GB 0.0 7.8 6.1 1.8 7.8 6.0 0.2 1.3 222.9 220.2 36.04 34.18 4 9.009 7863K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.4 2.0 247.3 247.2 1.53 1.48 2 0.764 383K 192 0.0 0.0 L3 25/0 980.83 MB 1.0 6.4 4.0 2.5 6.4 4.0 0.6 1.6 171.0 170.2 38.60 30.18 23 1.678 6703K 29K 0.0 0.0 L4 179/0 9.54 GB 1.0 4.2 3.5 0.7 4.2 3.5 0.8 1.2 126.6 126.0 34.19 20.70 55 0.622 4248K 11K 0.0 0.0 L5 1096/0 90.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1334/29 105.51 GB 0.0 27.7 13.7 13.9 37.1 23.1 10.4 3.9 160.5 214.9 176.59 146.32 250 0.706 28M 96K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.7 13.7 13.9 37.1 23.1 10.4 3.9 160.5 214.9 176.59 146.32 250 0.706 28M 96K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.7 13.7 13.9 27.5 13.6 0.0 0.0 194.2 193.1 145.93 120.97 112 1.303 28M 96K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 318.5 30.66 25.35 138 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.1 total, 51.9 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.06 GB write, 728.83 MB/s write, 27.68 GB read, 544.42 MB/s read, 176.6 seconds Interval compaction: 37.06 GB write, 731.72 MB/s write, 27.68 GB read, 546.57 MB/s read, 176.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 30, pending-compaction-bytes-stops: 0, total-delays: 52, total-stops: 48, interval: 100 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4308704 Average: 2.8423 StdDev: 28.82 Min: 0 Median: 1.6194 Max: 11554 Percentiles: P50: 1.62 P75: 2.06 P99: 7.03 P99.9: 18.50 P99.99: 302.92 ------------------------------------------------------ [ 0, 1 ] 468210 10.867% 10.867% ## ( 1, 2 ] 2722326 63.182% 74.049% ############# ( 2, 3 ] 709935 16.477% 90.525% ### ( 3, 4 ] 178501 4.143% 94.668% # ( 4, 6 ] 175277 4.068% 98.736% # ( 6, 10 ] 44148 1.025% 99.761% ( 10, 15 ] 5610 0.130% 99.891% ( 15, 22 ] 782 0.018% 99.909% ( 22, 34 ] 49 0.001% 99.910% ( 34, 51 ] 35 0.001% 99.911% ( 51, 76 ] 31 0.001% 99.912% ( 76, 110 ] 903 0.021% 99.933% ( 110, 170 ] 1667 0.039% 99.971% ( 170, 250 ] 623 0.014% 99.986% ( 250, 380 ] 440 0.010% 99.996% ( 380, 580 ] 561 0.013% 100.009% ( 580, 870 ] 392 0.009% 100.018% ( 870, 1300 ] 214 0.005% 100.023% ( 1300, 1900 ] 104 0.002% 100.026% ( 1900, 2900 ] 71 0.002% 100.027% ( 2900, 4400 ] 77 0.002% 100.029% ( 4400, 6600 ] 22 0.001% 100.030% ( 6600, 9900 ] 9 0.000% 100.030% ( 9900, 14000 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 1540103 Average: 4.6199 StdDev: 68.80 Min: 0 Median: 1.8441 Max: 15080 Percentiles: P50: 1.84 P75: 2.74 P99: 9.20 P99.9: 108.86 P99.99: 288.65 ------------------------------------------------------ [ 0, 1 ] 105241 6.833% 6.833% # ( 1, 2 ] 787576 51.138% 57.971% ########## ( 2, 3 ] 352118 22.863% 80.835% ##### ( 3, 4 ] 116836 7.586% 88.421% ## ( 4, 6 ] 134306 8.721% 97.141% ## ( 6, 10 ] 35796 2.324% 99.466% ( 10, 15 ] 5301 0.344% 99.810% ( 15, 22 ] 698 0.045% 99.855% ( 22, 34 ] 49 0.003% 99.858% ( 34, 51 ] 34 0.002% 99.861% ( 51, 76 ] 87 0.006% 99.866% ( 76, 110 ] 539 0.035% 99.901% ( 110, 170 ] 852 0.055% 99.956% ( 170, 250 ] 403 0.026% 99.983% ( 250, 380 ] 380 0.025% 100.007% ( 380, 580 ] 504 0.033% 100.040% ( 580, 870 ] 415 0.027% 100.067% ( 870, 1300 ] 334 0.022% 100.089% ( 1300, 1900 ] 168 0.011% 100.100% ( 1900, 2900 ] 110 0.007% 100.107% ( 2900, 4400 ] 157 0.010% 100.117% ( 4400, 6600 ] 51 0.003% 100.120% ( 6600, 9900 ] 27 0.002% 100.122% ( 9900, 14000 ] 3 0.000% 100.122% ( 14000, 22000 ] 1 0.000% 100.122% ** Level 2 read latency histogram (micros): Count: 95908 Average: 2.1413 StdDev: 6.72 Min: 0 Median: 1.4791 Max: 1296 Percentiles: P50: 1.48 P75: 1.87 P99: 5.74 P99.9: 11.56 P99.99: 23.64 ------------------------------------------------------ [ 0, 1 ] 18358 19.141% 19.141% #### ( 1, 2 ] 61772 64.408% 83.549% ############# ( 2, 3 ] 10150 10.583% 94.132% ## ( 3, 4 ] 2659 2.772% 96.904% # ( 4, 6 ] 2310 2.409% 99.313% ( 6, 10 ] 531 0.554% 99.867% ( 10, 15 ] 103 0.107% 99.974% ( 15, 22 ] 15 0.016% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1428965 Average: 5.2131 StdDev: 76.58 Min: 0 Median: 2.0910 Max: 19053 Percentiles: P50: 2.09 P75: 2.99 P99: 9.08 P99.9: 18.14 P99.99: 221.73 ------------------------------------------------------ [ 0, 1 ] 24568 1.719% 1.719% ( 1, 2 ] 653636 45.742% 47.461% ######### ( 2, 3 ] 398694 27.901% 75.362% ###### ( 3, 4 ] 145030 10.149% 85.511% ## ( 4, 6 ] 167644 11.732% 97.243% ## ( 6, 10 ] 32621 2.283% 99.526% ( 10, 15 ] 5096 0.357% 99.883% ( 15, 22 ] 551 0.039% 99.921% ( 22, 34 ] 46 0.003% 99.924% ( 34, 51 ] 26 0.002% 99.926% ( 51, 76 ] 68 0.005% 99.931% ( 76, 110 ] 137 0.010% 99.941% ( 110, 170 ] 482 0.034% 99.974% ( 170, 250 ] 345 0.024% 99.999% ( 250, 380 ] 424 0.030% 100.028% ( 380, 580 ] 590 0.041% 100.069% ( 580, 870 ] 610 0.043% 100.112% ( 870, 1300 ] 428 0.030% 100.142% ( 1300, 1900 ] 160 0.011% 100.153% ( 1900, 2900 ] 125 0.009% 100.162% ( 2900, 4400 ] 184 0.013% 100.175% ( 4400, 6600 ] 38 0.003% 100.178% ( 6600, 9900 ] 27 0.002% 100.180% ( 9900, 14000 ] 4 0.000% 100.180% ( 14000, 22000 ] 3 0.000% 100.180% ** Level 4 read latency histogram (micros): Count: 192883 Average: 31.4818 StdDev: 264.27 Min: 0 Median: 2.1774 Max: 17513 Percentiles: P50: 2.18 P75: 3.24 P99: 804.05 P99.9: 2916.64 P99.99: 3843.30 ------------------------------------------------------ [ 0, 1 ] 2206 1.144% 1.144% ( 1, 2 ] 84884 44.008% 45.152% ######### ( 2, 3 ] 52718 27.332% 72.483% ##### ( 3, 4 ] 20541 10.649% 83.133% ## ( 4, 6 ] 20829 10.799% 93.932% ## ( 6, 10 ] 5429 2.815% 96.746% # ( 10, 15 ] 1038 0.538% 97.284% ( 15, 22 ] 103 0.053% 97.338% ( 22, 34 ] 17 0.009% 97.347% ( 34, 51 ] 12 0.006% 97.353% ( 51, 76 ] 16 0.008% 97.361% ( 76, 110 ] 43 0.022% 97.383% ( 110, 170 ] 260 0.135% 97.518% ( 170, 250 ] 454 0.235% 97.754% ( 250, 380 ] 636 0.330% 98.083% ( 380, 580 ] 967 0.501% 98.585% ( 580, 870 ] 1037 0.538% 99.122% ( 870, 1300 ] 824 0.427% 99.549% ( 1300, 1900 ] 405 0.210% 99.759% ( 1900, 2900 ] 268 0.139% 99.898% ( 2900, 4400 ] 281 0.146% 100.044% ( 4400, 6600 ] 90 0.047% 100.091% ( 6600, 9900 ] 34 0.018% 100.108% ( 9900, 14000 ] 5 0.003% 100.111% ( 14000, 22000 ] 2 0.001% 100.112% ** Level 5 read latency histogram (micros): Count: 260 Average: 1381.2385 StdDev: 1638.40 Min: 86 Median: 621.4286 Max: 13047 Percentiles: P50: 621.43 P75: 2222.58 P99: 6468.00 P99.9: 12934.00 P99.99: 13047.00 ------------------------------------------------------ ( 76, 110 ] 8 3.077% 3.077% # ( 110, 170 ] 40 15.385% 18.462% ### ( 170, 250 ] 24 9.231% 27.692% ## ( 250, 380 ] 21 8.077% 35.769% ## ( 380, 580 ] 34 13.077% 48.846% ### ( 580, 870 ] 21 8.077% 56.923% ## ( 870, 1300 ] 22 8.462% 65.385% ## ( 1300, 1900 ] 15 5.769% 71.154% # ( 1900, 2900 ] 31 11.923% 83.077% ## ( 2900, 4400 ] 32 12.308% 95.385% ## ( 4400, 6600 ] 10 3.846% 99.231% # ( 6600, 9900 ] 1 0.385% 99.615% ( 9900, 14000 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 52.1 total, 4.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 189.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.071 H:M:S, 46.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 241.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.268 H:M:S, 31.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.524 micros/op 181034 ops/sec 60.049 seconds 10870999 operations; 175.4 MB/s Microseconds per write: Count: 10870999 Average: 5.5238 StdDev: 400.04 Min: 0 Median: 1.7518 Max: 674841 Percentiles: P50: 1.75 P75: 2.79 P99: 9.34 P99.9: 1104.07 P99.99: 2627.33 ------------------------------------------------------ [ 0, 1 ] 1439919 13.246% 13.246% ### ( 1, 2 ] 5314944 48.891% 62.137% ########## ( 2, 3 ] 1770076 16.283% 78.419% ### ( 3, 4 ] 1509080 13.882% 92.301% ### ( 4, 6 ] 617011 5.676% 97.977% # ( 6, 10 ] 133434 1.227% 99.204% ( 10, 15 ] 43104 0.397% 99.600% ( 15, 22 ] 10288 0.095% 99.695% ( 22, 34 ] 1973 0.018% 99.713% ( 34, 51 ] 263 0.002% 99.716% ( 51, 76 ] 69 0.001% 99.716% ( 76, 110 ] 7395 0.068% 99.784% ( 110, 170 ] 3148 0.029% 99.813% ( 170, 250 ] 309 0.003% 99.816% ( 250, 380 ] 199 0.002% 99.818% ( 380, 580 ] 57 0.001% 99.819% ( 580, 870 ] 32 0.000% 99.819% ( 870, 1300 ] 16216 0.149% 99.968% ( 1300, 1900 ] 90 0.001% 99.969% ( 1900, 2900 ] 3169 0.029% 99.998% ( 2900, 4400 ] 166 0.002% 99.999% ( 4400, 6600 ] 28 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 215396 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10870999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11218870968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 631 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29639710 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 35307627788 rocksdb.compact.write.bytes COUNT : 35098456765 rocksdb.flush.write.bytes COUNT : 11163731133 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 62 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 268 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11073691648 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4284416 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 35410574974 rocksdb.non.last.level.read.count COUNT : 8558310 rocksdb.block.checksum.compute.count COUNT : 8557110 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.397106 P95 : 3.942201 P99 : 7.913217 P100 : 674838.000000 COUNT : 10870999 SUM : 54881838 rocksdb.compaction.times.micros P50 : 957878.787879 P95 : 3436666.666667 P99 : 13286000.000000 P100 : 16973510.000000 COUNT : 117 SUM : 150691241 rocksdb.compaction.times.cpu_micros P50 : 797857.142857 P95 : 3436666.666667 P99 : 13286000.000000 P100 : 15943804.000000 COUNT : 117 SUM : 125632745 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 723.370787 P95 : 2300.000000 P99 : 20613.333333 P100 : 36736.000000 COUNT : 152 SUM : 216701 rocksdb.compaction.outfile.sync.micros P50 : 1221.020408 P95 : 89921.052632 P99 : 146109.090909 P100 : 159236.000000 COUNT : 438 SUM : 6284170 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.948454 P95 : 1457.500000 P99 : 3282.500000 P100 : 3667.000000 COUNT : 298 SUM : 93002 rocksdb.table.open.io.micros P50 : 1400.000000 P95 : 8755.312500 P99 : 20578.461538 P100 : 24344.000000 COUNT : 631 SUM : 1522682 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.777648 P95 : 8.197739 P99 : 11.295928 P100 : 19058.000000 COUNT : 8555287 SUM : 53435351 rocksdb.read.block.get.micros P50 : 485.590062 P95 : 3933.636364 P99 : 7632.428571 P100 : 13133.000000 COUNT : 1262 SUM : 1240359 rocksdb.write.raw.block.micros P50 : 0.513818 P95 : 0.976255 P99 : 2.963092 P100 : 36480.000000 COUNT : 11206379 SUM : 23403232 rocksdb.numfiles.in.singlecompaction P50 : 2.875000 P95 : 5.825000 P99 : 20.110000 P100 : 25.000000 COUNT : 154 SUM : 544 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558905 P95 : 1140.590472 P99 : 2352.234921 P100 : 674659.000000 COUNT : 187546 SUM : 29657109 rocksdb.sst.read.micros P50 : 1.710015 P95 : 5.004480 P99 : 8.568602 P100 : 19053.000000 COUNT : 8558514 SUM : 35975972 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10870999 SUM : 11218870968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212807.017544 P95 : 392666.666667 P99 : 709200.000000 P100 : 908692.000000 COUNT : 152 SUM : 33233434 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 409 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0