[2024-11-29 03:58:37.161107] Starting SPDK v25.01-pre git sha1 35cd3e84d / DPDK 22.11.4 initialization... [2024-11-29 03:58:37.161403] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2145190 ] Set seed to 1732849117154514 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-29 03:58:37.265078] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-29 03:58:37.286132] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-29 03:58:37.286171] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2145190' to capture a snapshot of events at runtime. [2024-11-29 03:58:37.286182] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-29 03:58:37.286209] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-29 03:58:37.286217] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2145190 for offline analysis/debug. [2024-11-29 03:58:37.286779] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 29 03:58:41 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/29-03:58:44 ... thread 0: (1000000,1000000) ops and (322066.7,322066.7) ops/second in (3.104947,3.104947) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.97 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 332.4 2.65 2.39 12 0.221 0 0 0.0 0.0 L1 3/0 249.71 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 239.8 239.6 1.05 1.02 1 1.051 255K 230 0.0 0.0 L2 3/2 190.89 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 239.1 238.9 0.81 0.77 2 0.403 195K 109 0.0 0.0 L3 10/0 804.28 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 98.6 294.1 4.51 4.18 15 0.301 451K 339 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.2 1.5 98.6 294.1 4.51 4.18 15 0.301 451K 339 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 239.5 239.3 1.86 1.79 3 0.619 451K 339 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 332.4 2.65 2.39 12 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.30 GB write, 400.83 MB/s write, 0.43 GB read, 134.38 MB/s read, 4.5 seconds Interval compaction: 1.30 GB write, 426.92 MB/s write, 0.43 GB read, 143.13 MB/s read, 4.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 154743 Average: 1.9930 StdDev: 19.91 Min: 1 Median: 1.3312 Max: 4753 Percentiles: P50: 1.33 P75: 1.74 P99: 4.98 P99.9: 9.68 P99.99: 115.26 ------------------------------------------------------ [ 0, 1 ] 45929 29.681% 29.681% ###### ( 1, 2 ] 94927 61.345% 91.026% ############ ( 2, 3 ] 8217 5.310% 96.336% # ( 3, 4 ] 3184 2.058% 98.393% ( 4, 6 ] 1912 1.236% 99.629% ( 6, 10 ] 457 0.295% 99.924% ( 10, 15 ] 89 0.058% 99.982% ( 15, 22 ] 10 0.006% 99.988% ( 22, 34 ] 2 0.001% 99.990% ( 51, 76 ] 1 0.001% 99.990% ( 110, 170 ] 6 0.004% 99.994% ( 170, 250 ] 5 0.003% 99.997% ( 250, 380 ] 8 0.005% 100.003% ( 580, 870 ] 1 0.001% 100.003% ( 2900, 4400 ] 3 0.002% 100.005% ( 4400, 6600 ] 1 0.001% 100.006% ** Level 1 read latency histogram (micros): Count: 540 Average: 8.6741 StdDev: 61.02 Min: 1 Median: 2.9072 Max: 1289 Percentiles: P50: 2.91 P75: 4.16 P99: 146.00 P99.9: 1067.80 P99.99: 1276.78 ------------------------------------------------------ [ 0, 1 ] 2 0.370% 0.370% ( 1, 2 ] 92 17.037% 17.407% ### ( 2, 3 ] 194 35.926% 53.333% ####### ( 3, 4 ] 109 20.185% 73.519% #### ( 4, 6 ] 99 18.333% 91.852% #### ( 6, 10 ] 31 5.741% 97.593% # ( 10, 15 ] 4 0.741% 98.333% ( 15, 22 ] 1 0.185% 98.519% ( 22, 34 ] 2 0.370% 98.889% ( 110, 170 ] 1 0.185% 99.074% ( 170, 250 ] 1 0.185% 99.259% ( 250, 380 ] 3 0.556% 99.815% ( 870, 1300 ] 1 0.185% 100.000% ** Level 2 read latency histogram (micros): Count: 42537 Average: 2.6285 StdDev: 33.89 Min: 1 Median: 1.5448 Max: 5684 Percentiles: P50: 1.54 P75: 1.91 P99: 6.22 P99.9: 13.80 P99.99: 1190.87 ------------------------------------------------------ [ 0, 1 ] 5306 12.474% 12.474% ## ( 1, 2 ] 29299 68.879% 81.353% ############## ( 2, 3 ] 4499 10.577% 91.929% ## ( 3, 4 ] 1833 4.309% 96.239% # ( 4, 6 ] 1156 2.718% 98.956% # ( 6, 10 ] 353 0.830% 99.786% ( 10, 15 ] 65 0.153% 99.939% ( 15, 22 ] 9 0.021% 99.960% ( 22, 34 ] 2 0.005% 99.965% ( 34, 51 ] 2 0.005% 99.969% ( 170, 250 ] 2 0.005% 99.974% ( 380, 580 ] 5 0.012% 99.986% ( 580, 870 ] 2 0.005% 99.991% ( 870, 1300 ] 1 0.002% 99.993% ( 1300, 1900 ] 1 0.002% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ( 4400, 6600 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 40 Average: 1808.7500 StdDev: 1579.78 Min: 220 Median: 1013.3333 Max: 5705 Percentiles: P50: 1013.33 P75: 2733.33 P99: 5705.00 P99.9: 5705.00 P99.99: 5705.00 ------------------------------------------------------ ( 170, 250 ] 1 2.500% 2.500% # ( 250, 380 ] 3 7.500% 10.000% ## ( 380, 580 ] 1 2.500% 12.500% # ( 580, 870 ] 14 35.000% 47.500% ####### ( 870, 1300 ] 3 7.500% 55.000% ## ( 1300, 1900 ] 3 7.500% 62.500% ## ( 1900, 2900 ] 6 15.000% 77.500% ### ( 2900, 4400 ] 4 10.000% 87.500% ## ( 4400, 6600 ] 5 12.500% 100.000% ### ** Level 4 read latency histogram (micros): Count: 30 Average: 1855.9000 StdDev: 1606.52 Min: 327 Median: 977.5000 Max: 6377 Percentiles: P50: 977.50 P75: 2775.00 P99: 6377.00 P99.9: 6377.00 P99.99: 6377.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 10 33.333% 46.667% ####### ( 870, 1300 ] 4 13.333% 60.000% ### ( 1300, 1900 ] 1 3.333% 63.333% # ( 1900, 2900 ] 4 13.333% 76.667% ### ( 2900, 4400 ] 4 13.333% 90.000% ### ( 4400, 6600 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.3 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 297.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.466 H:M:S, 14.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.466 H:M:S, 15.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-03:58:47 ... thread 0: (1000000,2000000) ops and (324821.1,323438.0) ops/second in (3.078618,6.183565) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 1.41 GB 25.2 0.5 0.0 0.5 2.3 1.8 0.0 1.3 67.0 318.3 7.52 6.93 28 0.269 511K 466 0.0 0.0 L1 3/3 249.71 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 239.8 239.6 1.05 1.02 1 1.051 255K 230 0.0 0.0 L2 1/0 3.65 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 239.1 238.9 0.81 0.77 2 0.403 195K 109 0.0 0.0 L3 19/0 991.53 MB 1.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 222.9 222.9 0.84 0.77 1 0.840 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1197/16 97.98 GB 0.0 1.1 0.6 0.6 3.0 2.4 0.4 1.6 111.2 296.1 10.22 9.49 32 0.319 1153K 805 0.0 0.0 Int 0/0 0.00 KB 0.0 1.1 0.6 0.6 3.0 2.4 0.2 1.6 111.2 296.1 10.22 9.49 32 0.319 1153K 805 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.1 0.6 0.6 1.1 0.6 0.0 0.0 243.7 243.5 4.66 4.49 6 0.777 1153K 805 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 340.2 5.56 5.00 26 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.4 total, 6.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.95 GB write, 473.59 MB/s write, 1.11 GB read, 177.84 MB/s read, 10.2 seconds Interval compaction: 2.95 GB write, 489.07 MB/s write, 1.11 GB read, 183.65 MB/s read, 10.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 416872 Average: 2.0680 StdDev: 15.97 Min: 0 Median: 1.4132 Max: 4753 Percentiles: P50: 1.41 P75: 1.80 P99: 4.99 P99.9: 9.75 P99.99: 15.72 ------------------------------------------------------ [ 0, 1 ] 96025 23.035% 23.035% ##### ( 1, 2 ] 272019 65.252% 88.287% ############# ( 2, 3 ] 32437 7.781% 96.068% ## ( 3, 4 ] 9778 2.346% 98.414% ( 4, 6 ] 4939 1.185% 99.598% ( 6, 10 ] 1343 0.322% 99.921% ( 10, 15 ] 287 0.069% 99.989% ( 15, 22 ] 32 0.008% 99.997% ( 22, 34 ] 7 0.002% 99.999% ( 34, 51 ] 4 0.001% 100.000% ( 51, 76 ] 4 0.001% 100.001% ( 110, 170 ] 14 0.003% 100.004% ( 170, 250 ] 9 0.002% 100.006% ( 250, 380 ] 14 0.003% 100.010% ( 380, 580 ] 2 0.000% 100.010% ( 580, 870 ] 4 0.001% 100.011% ( 870, 1300 ] 3 0.001% 100.012% ( 1300, 1900 ] 1 0.000% 100.012% ( 1900, 2900 ] 4 0.001% 100.013% ( 2900, 4400 ] 4 0.001% 100.014% ( 4400, 6600 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 48479 Average: 2.0830 StdDev: 6.53 Min: 1 Median: 1.4636 Max: 1289 Percentiles: P50: 1.46 P75: 1.84 P99: 5.11 P99.9: 9.59 P99.99: 182.17 ------------------------------------------------------ [ 0, 1 ] 9163 18.901% 18.901% #### ( 1, 2 ] 32518 67.076% 85.977% ############# ( 2, 3 ] 4686 9.666% 95.643% ## ( 3, 4 ] 1250 2.578% 98.222% # ( 4, 6 ] 678 1.399% 99.620% ( 6, 10 ] 151 0.311% 99.932% ( 10, 15 ] 21 0.043% 99.975% ( 15, 22 ] 2 0.004% 99.979% ( 22, 34 ] 2 0.004% 99.983% ( 34, 51 ] 2 0.004% 99.988% ( 110, 170 ] 1 0.002% 99.990% ( 170, 250 ] 1 0.002% 99.992% ( 250, 380 ] 3 0.006% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47972 Average: 2.5834 StdDev: 31.92 Min: 1 Median: 1.5504 Max: 5684 Percentiles: P50: 1.55 P75: 1.91 P99: 5.99 P99.9: 13.50 P99.99: 957.20 ------------------------------------------------------ [ 0, 1 ] 5731 11.947% 11.947% ## ( 1, 2 ] 33165 69.134% 81.081% ############## ( 2, 3 ] 5354 11.161% 92.241% ## ( 3, 4 ] 1996 4.161% 96.402% # ( 4, 6 ] 1253 2.612% 99.014% # ( 6, 10 ] 376 0.784% 99.798% ( 10, 15 ] 70 0.146% 99.944% ( 15, 22 ] 9 0.019% 99.962% ( 22, 34 ] 2 0.004% 99.967% ( 34, 51 ] 2 0.004% 99.971% ( 170, 250 ] 2 0.004% 99.975% ( 380, 580 ] 5 0.010% 99.985% ( 580, 870 ] 2 0.004% 99.990% ( 870, 1300 ] 1 0.002% 99.992% ( 1300, 1900 ] 1 0.002% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 875.5412 StdDev: 1401.63 Min: 1 Median: 210.0000 Max: 5705 Percentiles: P50: 210.00 P75: 950.62 P99: 5705.00 P99.9: 5705.00 P99.99: 5705.00 ------------------------------------------------------ [ 0, 1 ] 6 7.059% 7.059% # ( 1, 2 ] 24 28.235% 35.294% ###### ( 2, 3 ] 4 4.706% 40.000% # ( 4, 6 ] 2 2.353% 42.353% ( 6, 10 ] 3 3.529% 45.882% # ( 10, 15 ] 2 2.353% 48.235% ( 110, 170 ] 1 1.176% 49.412% ( 170, 250 ] 1 1.176% 50.588% ( 250, 380 ] 4 4.706% 55.294% # ( 380, 580 ] 2 2.353% 57.647% ( 580, 870 ] 14 16.471% 74.118% ### ( 870, 1300 ] 4 4.706% 78.824% # ( 1300, 1900 ] 3 3.529% 82.353% # ( 1900, 2900 ] 6 7.059% 89.412% # ( 2900, 4400 ] 4 4.706% 94.118% # ( 4400, 6600 ] 5 5.882% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1855.9000 StdDev: 1606.52 Min: 327 Median: 977.5000 Max: 6377 Percentiles: P50: 977.50 P75: 2775.00 P99: 6377.00 P99.9: 6377.00 P99.99: 6377.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 10 33.333% 46.667% ####### ( 870, 1300 ] 4 13.333% 60.000% ### ( 1300, 1900 ] 1 3.333% 63.333% # ( 1900, 2900 ] 4 13.333% 76.667% ### ( 2900, 4400 ] 4 13.333% 90.000% ### ( 4400, 6600 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.4 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 308.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.911 H:M:S, 14.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.445 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/29-03:58:50 ... thread 0: (1000000,3000000) ops and (326026.6,324296.3) ops/second in (3.067234,9.250799) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.78 GB 151.0 1.7 0.0 1.7 4.4 2.8 0.0 1.6 113.6 302.7 14.98 14.01 45 0.333 1727K 1805 0.0 0.0 L1 4/0 298.52 MB 29.9 1.0 0.8 0.2 1.0 0.8 0.2 1.3 227.3 226.6 4.70 4.57 2 2.350 1084K 2948 0.0 0.0 L2 5/4 518.73 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 239.1 238.9 0.81 0.77 2 0.403 195K 109 0.0 0.0 L3 19/1 991.53 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 222.9 222.9 0.84 0.77 1 0.840 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1198/9 98.90 GB 0.0 3.1 1.1 2.0 5.8 3.9 0.9 2.1 147.7 280.4 21.32 20.12 50 0.426 3197K 4862 0.0 0.0 Int 0/0 0.00 KB 0.0 3.1 1.1 2.0 5.8 3.9 0.7 2.1 147.7 280.4 21.32 20.12 50 0.426 3197K 4862 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.1 1.1 2.0 3.1 1.1 0.0 0.0 241.9 241.5 13.02 12.65 11 1.183 3197K 4862 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 341.2 8.31 7.47 39 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.5 total, 9.3 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.84 GB write, 632.40 MB/s write, 3.08 GB read, 333.10 MB/s read, 21.3 seconds Interval compaction: 5.84 GB write, 646.22 MB/s write, 3.08 GB read, 340.38 MB/s read, 21.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 707071 Average: 2.1215 StdDev: 12.89 Min: 0 Median: 1.4607 Max: 4753 Percentiles: P50: 1.46 P75: 1.83 P99: 5.27 P99.9: 9.75 P99.99: 14.69 ------------------------------------------------------ [ 0, 1 ] 135676 19.188% 19.188% #### ( 1, 2 ] 472878 66.878% 86.067% ############# ( 2, 3 ] 64098 9.065% 95.132% ## ( 3, 4 ] 20530 2.904% 98.036% # ( 4, 6 ] 10758 1.521% 99.557% ( 6, 10 ] 2584 0.365% 99.923% ( 10, 15 ] 508 0.072% 99.994% ( 15, 22 ] 57 0.008% 100.003% ( 22, 34 ] 12 0.002% 100.004% ( 34, 51 ] 6 0.001% 100.005% ( 51, 76 ] 5 0.001% 100.006% ( 110, 170 ] 17 0.002% 100.008% ( 170, 250 ] 19 0.003% 100.011% ( 250, 380 ] 21 0.003% 100.014% ( 380, 580 ] 6 0.001% 100.015% ( 580, 870 ] 9 0.001% 100.016% ( 870, 1300 ] 6 0.001% 100.017% ( 1300, 1900 ] 3 0.000% 100.017% ( 1900, 2900 ] 4 0.001% 100.018% ( 2900, 4400 ] 4 0.001% 100.018% ( 4400, 6600 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 154477 Average: 2.2581 StdDev: 7.87 Min: 1 Median: 1.5536 Max: 1293 Percentiles: P50: 1.55 P75: 1.92 P99: 5.57 P99.9: 11.29 P99.99: 275.22 ------------------------------------------------------ [ 0, 1 ] 18696 12.103% 12.103% ## ( 1, 2 ] 105746 68.454% 80.557% ############## ( 2, 3 ] 20851 13.498% 94.055% ### ( 3, 4 ] 5114 3.311% 97.365% # ( 4, 6 ] 3225 2.088% 99.453% ( 6, 10 ] 653 0.423% 99.876% ( 10, 15 ] 145 0.094% 99.970% ( 15, 22 ] 18 0.012% 99.981% ( 22, 34 ] 5 0.003% 99.984% ( 34, 51 ] 2 0.001% 99.986% ( 51, 76 ] 2 0.001% 99.987% ( 110, 170 ] 2 0.001% 99.988% ( 170, 250 ] 1 0.001% 99.989% ( 250, 380 ] 8 0.005% 99.994% ( 380, 580 ] 2 0.001% 99.995% ( 580, 870 ] 3 0.002% 99.997% ( 870, 1300 ] 4 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 47972 Average: 2.5834 StdDev: 31.92 Min: 1 Median: 1.5504 Max: 5684 Percentiles: P50: 1.55 P75: 1.91 P99: 5.99 P99.9: 13.50 P99.99: 957.20 ------------------------------------------------------ [ 0, 1 ] 5731 11.947% 11.947% ## ( 1, 2 ] 33165 69.134% 81.081% ############## ( 2, 3 ] 5354 11.161% 92.241% ## ( 3, 4 ] 1996 4.161% 96.402% # ( 4, 6 ] 1253 2.612% 99.014% # ( 6, 10 ] 376 0.784% 99.798% ( 10, 15 ] 70 0.146% 99.944% ( 15, 22 ] 9 0.019% 99.962% ( 22, 34 ] 2 0.004% 99.967% ( 34, 51 ] 2 0.004% 99.971% ( 170, 250 ] 2 0.004% 99.975% ( 380, 580 ] 5 0.010% 99.985% ( 580, 870 ] 2 0.004% 99.990% ( 870, 1300 ] 1 0.002% 99.992% ( 1300, 1900 ] 1 0.002% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 21078 Average: 5.7547 StdDev: 104.82 Min: 1 Median: 1.5791 Max: 5705 Percentiles: P50: 1.58 P75: 1.95 P99: 5.97 P99.9: 969.12 P99.99: 5672.57 ------------------------------------------------------ [ 0, 1 ] 2218 10.523% 10.523% ## ( 1, 2 ] 14370 68.175% 78.698% ############## ( 2, 3 ] 3062 14.527% 93.225% ### ( 3, 4 ] 791 3.753% 96.978% # ( 4, 6 ] 432 2.050% 99.027% ( 6, 10 ] 123 0.584% 99.611% ( 10, 15 ] 35 0.166% 99.777% ( 15, 22 ] 3 0.014% 99.791% ( 110, 170 ] 1 0.005% 99.796% ( 170, 250 ] 1 0.005% 99.801% ( 250, 380 ] 4 0.019% 99.820% ( 380, 580 ] 2 0.009% 99.829% ( 580, 870 ] 14 0.066% 99.896% ( 870, 1300 ] 4 0.019% 99.915% ( 1300, 1900 ] 3 0.014% 99.929% ( 1900, 2900 ] 6 0.028% 99.957% ( 2900, 4400 ] 4 0.019% 99.976% ( 4400, 6600 ] 5 0.024% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1855.9000 StdDev: 1606.52 Min: 327 Median: 977.5000 Max: 6377 Percentiles: P50: 977.50 P75: 2775.00 P99: 6377.00 P99.9: 6377.00 P99.99: 6377.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 10 33.333% 46.667% ####### ( 870, 1300 ] 4 13.333% 60.000% ### ( 1300, 1900 ] 1 3.333% 63.333% # ( 1900, 2900 ] 4 13.333% 76.667% ### ( 2900, 4400 ] 4 13.333% 90.000% ### ( 4400, 6600 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.5 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 312.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.304 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.393 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-03:58:53 ... thread 0: (1000000,4000000) ops and (326804.2,324919.7) ops/second in (3.059936,12.310735) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.70 GB 18.9 2.2 0.0 2.2 5.9 3.7 0.0 1.6 112.9 301.0 20.09 18.76 60 0.335 2302K 2441 0.0 0.0 L1 4/4 298.52 MB 0.0 1.0 0.8 0.2 1.0 0.8 0.2 1.3 227.3 226.6 4.70 4.57 2 2.350 1084K 2948 0.0 0.0 L2 1/0 3.65 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 239.1 238.9 0.81 0.77 2 0.403 195K 109 0.0 0.0 L3 26/0 946.32 MB 0.9 0.8 0.7 0.1 0.8 0.7 0.1 1.2 208.3 208.1 3.99 3.63 2 1.995 844K 1025 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/18 99.82 GB 0.0 4.3 1.6 2.6 7.9 5.3 2.0 2.2 147.4 274.9 29.58 27.73 66 0.448 4427K 6523 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.6 2.6 7.9 5.3 1.9 2.2 147.4 274.9 29.58 27.73 66 0.448 4427K 6523 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.6 2.6 4.3 1.6 0.0 0.0 236.0 235.7 18.47 17.76 14 1.319 4427K 6523 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 340.2 11.11 9.98 52 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.3 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.94 GB write, 649.90 MB/s write, 4.26 GB read, 348.40 MB/s read, 29.6 seconds Interval compaction: 7.94 GB write, 660.57 MB/s write, 4.26 GB read, 354.13 MB/s read, 29.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 963976 Average: 2.1458 StdDev: 13.20 Min: 0 Median: 1.4604 Max: 4753 Percentiles: P50: 1.46 P75: 1.83 P99: 5.29 P99.9: 9.95 P99.99: 21.67 ------------------------------------------------------ [ 0, 1 ] 185683 19.262% 19.262% #### ( 1, 2 ] 643593 66.764% 86.027% ############# ( 2, 3 ] 87809 9.109% 95.136% ## ( 3, 4 ] 27787 2.883% 98.018% # ( 4, 6 ] 14646 1.519% 99.538% ( 6, 10 ] 3544 0.368% 99.905% ( 10, 15 ] 732 0.076% 99.981% ( 15, 22 ] 92 0.010% 99.991% ( 22, 34 ] 15 0.002% 99.992% ( 34, 51 ] 8 0.001% 99.993% ( 51, 76 ] 8 0.001% 99.994% ( 76, 110 ] 50 0.005% 99.999% ( 110, 170 ] 70 0.007% 100.006% ( 170, 250 ] 30 0.003% 100.009% ( 250, 380 ] 35 0.004% 100.013% ( 380, 580 ] 14 0.001% 100.015% ( 580, 870 ] 14 0.001% 100.016% ( 870, 1300 ] 9 0.001% 100.017% ( 1300, 1900 ] 7 0.001% 100.018% ( 1900, 2900 ] 7 0.001% 100.018% ( 2900, 4400 ] 5 0.001% 100.019% ( 4400, 6600 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 194758 Average: 2.2714 StdDev: 7.02 Min: 1 Median: 1.5698 Max: 1293 Percentiles: P50: 1.57 P75: 1.93 P99: 5.61 P99.9: 11.42 P99.99: 125.73 ------------------------------------------------------ [ 0, 1 ] 21419 10.998% 10.998% ## ( 1, 2 ] 133317 68.453% 79.450% ############## ( 2, 3 ] 27810 14.279% 93.730% ### ( 3, 4 ] 6763 3.473% 97.202% # ( 4, 6 ] 4340 2.228% 99.431% ( 6, 10 ] 858 0.441% 99.871% ( 10, 15 ] 198 0.102% 99.973% ( 15, 22 ] 23 0.012% 99.985% ( 22, 34 ] 5 0.003% 99.987% ( 34, 51 ] 2 0.001% 99.988% ( 51, 76 ] 3 0.002% 99.990% ( 110, 170 ] 2 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.991% ( 250, 380 ] 8 0.004% 99.995% ( 380, 580 ] 2 0.001% 99.996% ( 580, 870 ] 3 0.002% 99.998% ( 870, 1300 ] 4 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47972 Average: 2.5834 StdDev: 31.92 Min: 1 Median: 1.5504 Max: 5684 Percentiles: P50: 1.55 P75: 1.91 P99: 5.99 P99.9: 13.50 P99.99: 957.20 ------------------------------------------------------ [ 0, 1 ] 5731 11.947% 11.947% ## ( 1, 2 ] 33165 69.134% 81.081% ############## ( 2, 3 ] 5354 11.161% 92.241% ## ( 3, 4 ] 1996 4.161% 96.402% # ( 4, 6 ] 1253 2.612% 99.014% # ( 6, 10 ] 376 0.784% 99.798% ( 10, 15 ] 70 0.146% 99.944% ( 15, 22 ] 9 0.019% 99.962% ( 22, 34 ] 2 0.004% 99.967% ( 34, 51 ] 2 0.004% 99.971% ( 170, 250 ] 2 0.004% 99.975% ( 380, 580 ] 5 0.010% 99.985% ( 580, 870 ] 2 0.004% 99.990% ( 870, 1300 ] 1 0.002% 99.992% ( 1300, 1900 ] 1 0.002% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 32992 Average: 4.6774 StdDev: 84.02 Min: 0 Median: 1.5989 Max: 5705 Percentiles: P50: 1.60 P75: 1.97 P99: 6.66 P99.9: 657.49 P99.99: 5148.35 ------------------------------------------------------ [ 0, 1 ] 3149 9.545% 9.545% ## ( 1, 2 ] 22284 67.544% 77.088% ############## ( 2, 3 ] 5221 15.825% 92.913% ### ( 3, 4 ] 1240 3.758% 96.672% # ( 4, 6 ] 736 2.231% 98.903% ( 6, 10 ] 194 0.588% 99.491% ( 10, 15 ] 64 0.194% 99.685% ( 15, 22 ] 8 0.024% 99.709% ( 22, 34 ] 2 0.006% 99.715% ( 34, 51 ] 18 0.055% 99.770% ( 51, 76 ] 19 0.058% 99.827% ( 110, 170 ] 4 0.012% 99.839% ( 170, 250 ] 8 0.024% 99.864% ( 250, 380 ] 5 0.015% 99.879% ( 380, 580 ] 3 0.009% 99.888% ( 580, 870 ] 15 0.045% 99.933% ( 870, 1300 ] 4 0.012% 99.945% ( 1300, 1900 ] 3 0.009% 99.955% ( 1900, 2900 ] 6 0.018% 99.973% ( 2900, 4400 ] 4 0.012% 99.985% ( 4400, 6600 ] 5 0.015% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1855.9000 StdDev: 1606.52 Min: 327 Median: 977.5000 Max: 6377 Percentiles: P50: 977.50 P75: 2775.00 P99: 6377.00 P99.9: 6377.00 P99.99: 6377.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 10 33.333% 46.667% ####### ( 870, 1300 ] 4 13.333% 60.000% ### ( 1300, 1900 ] 1 3.333% 63.333% # ( 1900, 2900 ] 4 13.333% 76.667% ### ( 2900, 4400 ] 4 13.333% 90.000% ### ( 4400, 6600 ] 3 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 40 Average: 750.8000 StdDev: 951.76 Min: 47 Median: 336.6667 Max: 3666 Percentiles: P50: 336.67 P75: 1013.33 P99: 3666.00 P99.9: 3666.00 P99.99: 3666.00 ------------------------------------------------------ ( 34, 51 ] 1 2.500% 2.500% # ( 76, 110 ] 3 7.500% 10.000% ## ( 110, 170 ] 10 25.000% 35.000% ##### ( 170, 250 ] 2 5.000% 40.000% # ( 250, 380 ] 6 15.000% 55.000% ### ( 380, 580 ] 7 17.500% 72.500% #### ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 2 5.000% 85.000% # ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.5 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 314.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.708 H:M:S, 13.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.404 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-03:58:57 ... thread 0: (1000000,5000000) ops and (269071.6,311969.3) ops/second in (3.716483,16.027218) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.69 GB 151.1 3.5 0.0 3.5 8.2 4.7 0.0 1.7 127.1 296.4 28.25 26.51 81 0.349 3646K 3773 0.0 0.0 L1 4/4 298.52 MB 0.0 1.0 0.8 0.2 1.0 0.8 0.2 1.3 227.3 226.6 4.70 4.57 2 2.350 1084K 2948 0.0 0.0 L2 1/0 3.65 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 239.1 238.9 0.81 0.77 2 0.403 195K 109 0.0 0.0 L3 26/0 946.32 MB 0.9 0.8 0.7 0.1 0.8 0.7 0.1 1.2 208.3 208.1 3.99 3.63 2 1.995 844K 1025 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/14 100.80 GB 0.0 5.5 1.6 3.9 10.2 6.3 2.0 2.2 150.6 277.2 37.75 35.48 87 0.434 5770K 7855 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.6 3.9 10.2 6.3 1.9 2.2 150.6 277.2 37.75 35.48 87 0.434 5770K 7855 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.6 3.9 5.5 1.6 0.0 0.0 239.7 239.3 23.71 22.91 19 1.248 5770K 7855 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 341.1 14.03 12.57 68 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.2 total, 16.0 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.22 GB write, 644.62 MB/s write, 5.55 GB read, 350.14 MB/s read, 37.7 seconds Interval compaction: 10.22 GB write, 652.75 MB/s write, 5.55 GB read, 354.56 MB/s read, 37.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 21, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1463670 Average: 2.1830 StdDev: 11.80 Min: 0 Median: 1.4914 Max: 4753 Percentiles: P50: 1.49 P75: 1.86 P99: 5.47 P99.9: 9.84 P99.99: 14.65 ------------------------------------------------------ [ 0, 1 ] 248531 16.980% 16.980% ### ( 1, 2 ] 983590 67.200% 84.180% ############# ( 2, 3 ] 151972 10.383% 94.563% ## ( 3, 4 ] 45766 3.127% 97.690% # ( 4, 6 ] 26080 1.782% 99.472% ( 6, 10 ] 6526 0.446% 99.918% ( 10, 15 ] 1139 0.078% 99.995% ( 15, 22 ] 131 0.009% 100.004% ( 22, 34 ] 22 0.002% 100.006% ( 34, 51 ] 11 0.001% 100.007% ( 51, 76 ] 10 0.001% 100.007% ( 76, 110 ] 55 0.004% 100.011% ( 110, 170 ] 84 0.006% 100.017% ( 170, 250 ] 43 0.003% 100.020% ( 250, 380 ] 42 0.003% 100.023% ( 380, 580 ] 20 0.001% 100.024% ( 580, 870 ] 23 0.002% 100.026% ( 870, 1300 ] 15 0.001% 100.027% ( 1300, 1900 ] 10 0.001% 100.027% ( 1900, 2900 ] 7 0.000% 100.028% ( 2900, 4400 ] 6 0.000% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 194758 Average: 2.2714 StdDev: 7.02 Min: 1 Median: 1.5698 Max: 1293 Percentiles: P50: 1.57 P75: 1.93 P99: 5.61 P99.9: 11.42 P99.99: 125.73 ------------------------------------------------------ [ 0, 1 ] 21419 10.998% 10.998% ## ( 1, 2 ] 133317 68.453% 79.450% ############## ( 2, 3 ] 27810 14.279% 93.730% ### ( 3, 4 ] 6763 3.473% 97.202% # ( 4, 6 ] 4340 2.228% 99.431% ( 6, 10 ] 858 0.441% 99.871% ( 10, 15 ] 198 0.102% 99.973% ( 15, 22 ] 23 0.012% 99.985% ( 22, 34 ] 5 0.003% 99.987% ( 34, 51 ] 2 0.001% 99.988% ( 51, 76 ] 3 0.002% 99.990% ( 110, 170 ] 2 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.991% ( 250, 380 ] 8 0.004% 99.995% ( 380, 580 ] 2 0.001% 99.996% ( 580, 870 ] 3 0.002% 99.998% ( 870, 1300 ] 4 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47972 Average: 2.5834 StdDev: 31.92 Min: 1 Median: 1.5504 Max: 5684 Percentiles: P50: 1.55 P75: 1.91 P99: 5.99 P99.9: 13.50 P99.99: 957.20 ------------------------------------------------------ [ 0, 1 ] 5731 11.947% 11.947% ## ( 1, 2 ] 33165 69.134% 81.081% ############## ( 2, 3 ] 5354 11.161% 92.241% ## ( 3, 4 ] 1996 4.161% 96.402% # ( 4, 6 ] 1253 2.612% 99.014% # ( 6, 10 ] 376 0.784% 99.798% ( 10, 15 ] 70 0.146% 99.944% ( 15, 22 ] 9 0.019% 99.962% ( 22, 34 ] 2 0.004% 99.967% ( 34, 51 ] 2 0.004% 99.971% ( 170, 250 ] 2 0.004% 99.975% ( 380, 580 ] 5 0.010% 99.985% ( 580, 870 ] 2 0.004% 99.990% ( 870, 1300 ] 1 0.002% 99.992% ( 1300, 1900 ] 1 0.002% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 32992 Average: 4.6774 StdDev: 84.02 Min: 0 Median: 1.5989 Max: 5705 Percentiles: P50: 1.60 P75: 1.97 P99: 6.66 P99.9: 657.49 P99.99: 5148.35 ------------------------------------------------------ [ 0, 1 ] 3149 9.545% 9.545% ## ( 1, 2 ] 22284 67.544% 77.088% ############## ( 2, 3 ] 5221 15.825% 92.913% ### ( 3, 4 ] 1240 3.758% 96.672% # ( 4, 6 ] 736 2.231% 98.903% ( 6, 10 ] 194 0.588% 99.491% ( 10, 15 ] 64 0.194% 99.685% ( 15, 22 ] 8 0.024% 99.709% ( 22, 34 ] 2 0.006% 99.715% ( 34, 51 ] 18 0.055% 99.770% ( 51, 76 ] 19 0.058% 99.827% ( 110, 170 ] 4 0.012% 99.839% ( 170, 250 ] 8 0.024% 99.864% ( 250, 380 ] 5 0.015% 99.879% ( 380, 580 ] 3 0.009% 99.888% ( 580, 870 ] 15 0.045% 99.933% ( 870, 1300 ] 4 0.012% 99.945% ( 1300, 1900 ] 3 0.009% 99.955% ( 1900, 2900 ] 6 0.018% 99.973% ( 2900, 4400 ] 4 0.012% 99.985% ( 4400, 6600 ] 5 0.015% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1855.9000 StdDev: 1606.52 Min: 327 Median: 977.5000 Max: 6377 Percentiles: P50: 977.50 P75: 2775.00 P99: 6377.00 P99.9: 6377.00 P99.99: 6377.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 10 33.333% 46.667% ####### ( 870, 1300 ] 4 13.333% 60.000% ### ( 1300, 1900 ] 1 3.333% 63.333% # ( 1900, 2900 ] 4 13.333% 76.667% ### ( 2900, 4400 ] 4 13.333% 90.000% ### ( 4400, 6600 ] 3 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 40 Average: 750.8000 StdDev: 951.76 Min: 47 Median: 336.6667 Max: 3666 Percentiles: P50: 336.67 P75: 1013.33 P99: 3666.00 P99.9: 3666.00 P99.99: 3666.00 ------------------------------------------------------ ( 34, 51 ] 1 2.500% 2.500% # ( 76, 110 ] 3 7.500% 10.000% ## ( 110, 170 ] 10 25.000% 35.000% ##### ( 170, 250 ] 2 5.000% 40.000% # ( 250, 380 ] 6 15.000% 55.000% ### ( 380, 580 ] 7 17.500% 72.500% #### ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 2 5.000% 85.000% # ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 16.2 total, 3.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 303.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.669 H:M:S, 16.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 264.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.961 H:M:S, 25.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-03:59:06 ... thread 0: (1000000,6000000) ops and (111814.1,240282.3) ops/second in (8.943412,24.970630) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 2.46 GB 56.6 4.2 0.0 4.2 9.9 5.7 0.0 1.7 122.2 284.9 35.58 32.17 98 0.363 4413K 4481 0.0 0.0 L1 1/0 22.74 MB 2.3 3.5 3.0 0.5 3.5 3.0 0.2 1.2 223.3 221.2 16.27 15.76 3 5.423 3688K 32K 0.0 0.0 L2 8/4 840.58 MB 4.5 0.2 0.1 0.1 0.2 0.1 3.0 1.5 239.1 238.9 0.81 0.77 2 0.403 195K 109 0.0 0.0 L3 28/13 2.03 GB 1.0 1.2 1.1 0.2 1.2 1.1 1.4 1.2 171.8 171.6 7.44 5.74 5 1.488 1245K 1278 0.0 0.0 L4 150/9 9.62 GB 1.0 0.5 0.4 0.1 0.5 0.3 0.7 1.4 129.3 128.5 3.88 2.45 3 1.292 508K 3059 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/37 101.75 GB 0.0 9.7 4.6 5.2 15.3 10.2 6.3 2.7 155.6 245.5 63.97 56.90 111 0.576 10M 41K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.7 4.6 5.2 15.3 10.2 6.2 2.7 155.6 245.5 63.97 56.90 111 0.576 10M 41K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.7 4.6 5.2 9.7 4.5 0.0 0.0 216.5 215.6 45.96 41.60 29 1.585 10M 41K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 321.9 18.01 15.30 82 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.2 total, 25.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.34 GB write, 623.81 MB/s write, 9.72 GB read, 395.30 MB/s read, 64.0 seconds Interval compaction: 15.34 GB write, 628.86 MB/s write, 9.72 GB read, 398.50 MB/s read, 64.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 28, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2332730 Average: 2.4292 StdDev: 21.92 Min: 0 Median: 1.5149 Max: 10048 Percentiles: P50: 1.51 P75: 1.89 P99: 5.87 P99.9: 12.47 P99.99: 149.91 ------------------------------------------------------ [ 0, 1 ] 366849 15.726% 15.726% ### ( 1, 2 ] 1552637 66.559% 82.285% ############# ( 2, 3 ] 256008 10.975% 93.260% ## ( 3, 4 ] 83430 3.576% 96.836% # ( 4, 6 ] 54025 2.316% 99.152% ( 6, 10 ] 16324 0.700% 99.852% ( 10, 15 ] 2274 0.097% 99.949% ( 15, 22 ] 246 0.011% 99.960% ( 22, 34 ] 29 0.001% 99.961% ( 34, 51 ] 14 0.001% 99.962% ( 51, 76 ] 16 0.001% 99.962% ( 76, 110 ] 386 0.017% 99.979% ( 110, 170 ] 389 0.017% 99.996% ( 170, 250 ] 151 0.006% 100.002% ( 250, 380 ] 153 0.007% 100.009% ( 380, 580 ] 134 0.006% 100.014% ( 580, 870 ] 114 0.005% 100.019% ( 870, 1300 ] 83 0.004% 100.023% ( 1300, 1900 ] 33 0.001% 100.024% ( 1900, 2900 ] 21 0.001% 100.025% ( 2900, 4400 ] 30 0.001% 100.026% ( 4400, 6600 ] 4 0.000% 100.027% ( 6600, 9900 ] 1 0.000% 100.027% ( 9900, 14000 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 576040 Average: 3.6416 StdDev: 47.69 Min: 1 Median: 1.7360 Max: 8760 Percentiles: P50: 1.74 P75: 2.48 P99: 8.26 P99.9: 18.92 P99.99: 365.02 ------------------------------------------------------ [ 0, 1 ] 35577 6.176% 6.176% # ( 1, 2 ] 342998 59.544% 65.720% ############ ( 2, 3 ] 111198 19.304% 85.024% #### ( 3, 4 ] 39422 6.844% 91.868% # ( 4, 6 ] 36273 6.297% 98.165% # ( 6, 10 ] 8509 1.477% 99.642% ( 10, 15 ] 1405 0.244% 99.886% ( 15, 22 ] 148 0.026% 99.911% ( 22, 34 ] 16 0.003% 99.914% ( 34, 51 ] 7 0.001% 99.915% ( 51, 76 ] 11 0.002% 99.917% ( 76, 110 ] 91 0.016% 99.933% ( 110, 170 ] 144 0.025% 99.958% ( 170, 250 ] 103 0.018% 99.976% ( 250, 380 ] 92 0.016% 99.992% ( 380, 580 ] 137 0.024% 100.016% ( 580, 870 ] 105 0.018% 100.034% ( 870, 1300 ] 59 0.010% 100.044% ( 1300, 1900 ] 40 0.007% 100.051% ( 1900, 2900 ] 26 0.005% 100.056% ( 2900, 4400 ] 39 0.007% 100.062% ( 4400, 6600 ] 9 0.002% 100.064% ( 6600, 9900 ] 3 0.001% 100.065% ** Level 2 read latency histogram (micros): Count: 48435 Average: 4.1065 StdDev: 68.30 Min: 1 Median: 1.5550 Max: 5684 Percentiles: P50: 1.55 P75: 1.92 P99: 6.67 P99.9: 480.57 P99.99: 3973.47 ------------------------------------------------------ [ 0, 1 ] 5732 11.834% 11.834% ## ( 1, 2 ] 33309 68.771% 80.605% ############## ( 2, 3 ] 5512 11.380% 91.985% ## ( 3, 4 ] 2047 4.226% 96.211% # ( 4, 6 ] 1286 2.655% 98.867% # ( 6, 10 ] 387 0.799% 99.666% ( 10, 15 ] 71 0.147% 99.812% ( 15, 22 ] 9 0.019% 99.831% ( 22, 34 ] 2 0.004% 99.835% ( 34, 51 ] 2 0.004% 99.839% ( 110, 170 ] 3 0.006% 99.845% ( 170, 250 ] 3 0.006% 99.851% ( 250, 380 ] 12 0.025% 99.876% ( 380, 580 ] 23 0.047% 99.924% ( 580, 870 ] 9 0.019% 99.942% ( 870, 1300 ] 7 0.014% 99.957% ( 1300, 1900 ] 5 0.010% 99.967% ( 1900, 2900 ] 4 0.008% 99.975% ( 2900, 4400 ] 10 0.021% 99.996% ( 4400, 6600 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 238490 Average: 10.0625 StdDev: 114.95 Min: 0 Median: 1.8467 Max: 9712 Percentiles: P50: 1.85 P75: 2.78 P99: 14.03 P99.9: 1086.77 P99.99: 1761.91 ------------------------------------------------------ [ 0, 1 ] 8177 3.429% 3.429% # ( 1, 2 ] 131174 55.002% 58.431% ########### ( 2, 3 ] 50747 21.278% 79.709% #### ( 3, 4 ] 21845 9.160% 88.869% ## ( 4, 6 ] 18214 7.637% 96.506% ## ( 6, 10 ] 5213 2.186% 98.692% ( 10, 15 ] 912 0.382% 99.074% ( 15, 22 ] 135 0.057% 99.131% ( 22, 34 ] 11 0.005% 99.135% ( 34, 51 ] 22 0.009% 99.145% ( 51, 76 ] 23 0.010% 99.154% ( 76, 110 ] 30 0.013% 99.167% ( 110, 170 ] 147 0.062% 99.228% ( 170, 250 ] 240 0.101% 99.329% ( 250, 380 ] 359 0.151% 99.480% ( 380, 580 ] 442 0.185% 99.665% ( 580, 870 ] 437 0.183% 99.848% ( 870, 1300 ] 245 0.103% 99.951% ( 1300, 1900 ] 121 0.051% 100.002% ( 1900, 2900 ] 68 0.029% 100.030% ( 2900, 4400 ] 83 0.035% 100.065% ( 4400, 6600 ] 21 0.009% 100.074% ( 6600, 9900 ] 4 0.002% 100.075% ** Level 4 read latency histogram (micros): Count: 1251 Average: 70.4237 StdDev: 473.85 Min: 1 Median: 1.7646 Max: 7214 Percentiles: P50: 1.76 P75: 2.65 P99: 2798.00 P99.9: 6415.93 P99.99: 7214.00 ------------------------------------------------------ [ 0, 1 ] 49 3.917% 3.917% # ( 1, 2 ] 754 60.272% 64.189% ############ ( 2, 3 ] 207 16.547% 80.735% ### ( 3, 4 ] 109 8.713% 89.448% ## ( 4, 6 ] 62 4.956% 94.404% # ( 6, 10 ] 17 1.359% 95.763% ( 10, 15 ] 1 0.080% 95.843% ( 76, 110 ] 1 0.080% 95.923% ( 110, 170 ] 5 0.400% 96.323% ( 170, 250 ] 5 0.400% 96.723% ( 250, 380 ] 1 0.080% 96.803% ( 380, 580 ] 4 0.320% 97.122% ( 580, 870 ] 11 0.879% 98.002% ( 870, 1300 ] 7 0.560% 98.561% ( 1300, 1900 ] 1 0.080% 98.641% ( 1900, 2900 ] 5 0.400% 99.041% ( 2900, 4400 ] 8 0.639% 99.680% ( 4400, 6600 ] 3 0.240% 99.920% ( 6600, 9900 ] 1 0.080% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 1137.4333 StdDev: 1285.81 Min: 47 Median: 480.0000 Max: 5323 Percentiles: P50: 480.00 P75: 1900.00 P99: 5280.00 P99.9: 5323.00 P99.99: 5323.00 ------------------------------------------------------ ( 34, 51 ] 1 1.667% 1.667% ( 76, 110 ] 3 5.000% 6.667% # ( 110, 170 ] 10 16.667% 23.333% ### ( 170, 250 ] 3 5.000% 28.333% # ( 250, 380 ] 9 15.000% 43.333% ### ( 380, 580 ] 8 13.333% 56.667% ### ( 580, 870 ] 2 3.333% 60.000% # ( 870, 1300 ] 6 10.000% 70.000% ## ( 1300, 1900 ] 3 5.000% 75.000% # ( 1900, 2900 ] 7 11.667% 86.667% ## ( 2900, 4400 ] 7 11.667% 98.333% ## ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 25.2 total, 8.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 234.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.534 H:M:S, 33.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 110.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.865 H:M:S, 65.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/29-03:59:10 ... thread 0: (1000000,7000000) ops and (285017.0,245793.5) ops/second in (3.508563,28.479193) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 3.43 GB 326.2 6.8 0.0 6.8 13.4 6.6 0.0 2.0 140.7 278.4 49.26 45.05 115 0.428 7034K 16K 0.0 0.0 L1 1/0 22.74 MB 2.3 3.5 3.0 0.5 3.5 3.0 0.2 1.2 223.3 221.2 16.27 15.76 3 5.423 3688K 32K 0.0 0.0 L2 1/0 64.25 MB 0.6 0.2 0.1 0.1 0.2 0.1 3.0 1.5 239.1 238.9 0.81 0.77 2 0.403 195K 109 0.0 0.0 L3 13/0 974.74 MB 1.0 3.0 1.8 1.1 3.0 1.8 1.4 1.6 175.4 175.0 17.33 13.62 10 1.733 3034K 6401 0.0 0.0 L4 156/0 9.48 GB 1.0 1.2 0.9 0.3 1.2 0.9 2.0 1.4 155.5 154.7 7.85 5.80 8 0.981 1175K 5044 0.0 0.0 L5 1080/0 88.77 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/4 102.72 GB 0.0 14.7 5.8 8.8 21.2 12.4 9.6 3.2 164.1 237.7 91.51 81.01 138 0.663 15M 61K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.7 5.8 8.8 21.2 12.4 9.4 3.2 164.1 237.7 91.51 81.01 138 0.663 15M 61K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.7 5.8 8.8 14.6 5.8 0.0 0.0 213.4 212.5 70.37 63.00 43 1.636 15M 61K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 321.8 21.14 18.01 95 0.223 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.7 total, 28.5 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.24 GB write, 758.42 MB/s write, 14.66 GB read, 523.43 MB/s read, 91.5 seconds Interval compaction: 21.24 GB write, 763.80 MB/s write, 14.66 GB read, 527.15 MB/s read, 91.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 41, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2615496 Average: 2.4344 StdDev: 21.73 Min: 0 Median: 1.5252 Max: 10048 Percentiles: P50: 1.53 P75: 1.90 P99: 5.88 P99.9: 12.46 P99.99: 146.86 ------------------------------------------------------ [ 0, 1 ] 399049 15.257% 15.257% ### ( 1, 2 ] 1730125 66.149% 81.406% ############# ( 2, 3 ] 299084 11.435% 92.841% ## ( 3, 4 ] 98823 3.778% 96.620% # ( 4, 6 ] 66378 2.538% 99.157% # ( 6, 10 ] 18103 0.692% 99.850% ( 10, 15 ] 2677 0.102% 99.952% ( 15, 22 ] 302 0.012% 99.963% ( 22, 34 ] 32 0.001% 99.965% ( 34, 51 ] 16 0.001% 99.965% ( 51, 76 ] 17 0.001% 99.966% ( 76, 110 ] 388 0.015% 99.981% ( 110, 170 ] 393 0.015% 99.996% ( 170, 250 ] 163 0.006% 100.002% ( 250, 380 ] 166 0.006% 100.008% ( 380, 580 ] 138 0.005% 100.014% ( 580, 870 ] 120 0.005% 100.018% ( 870, 1300 ] 88 0.003% 100.022% ( 1300, 1900 ] 35 0.001% 100.023% ( 1900, 2900 ] 24 0.001% 100.024% ( 2900, 4400 ] 30 0.001% 100.025% ( 4400, 6600 ] 4 0.000% 100.025% ( 6600, 9900 ] 2 0.000% 100.025% ( 9900, 14000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 694787 Average: 3.6901 StdDev: 46.18 Min: 1 Median: 1.7556 Max: 8760 Percentiles: P50: 1.76 P75: 2.53 P99: 8.47 P99.9: 26.81 P99.99: 406.58 ------------------------------------------------------ [ 0, 1 ] 36999 5.325% 5.325% # ( 1, 2 ] 410819 59.129% 64.454% ############ ( 2, 3 ] 139127 20.024% 84.478% #### ( 3, 4 ] 48846 7.030% 91.509% # ( 4, 6 ] 45113 6.493% 98.002% # ( 6, 10 ] 11240 1.618% 99.620% ( 10, 15 ] 1758 0.253% 99.873% ( 15, 22 ] 183 0.026% 99.899% ( 22, 34 ] 18 0.003% 99.902% ( 34, 51 ] 8 0.001% 99.903% ( 51, 76 ] 11 0.002% 99.904% ( 76, 110 ] 102 0.015% 99.919% ( 110, 170 ] 190 0.027% 99.946% ( 170, 250 ] 138 0.020% 99.966% ( 250, 380 ] 142 0.020% 99.987% ( 380, 580 ] 177 0.025% 100.012% ( 580, 870 ] 140 0.020% 100.032% ( 870, 1300 ] 71 0.010% 100.042% ( 1300, 1900 ] 45 0.006% 100.049% ( 1900, 2900 ] 37 0.005% 100.054% ( 2900, 4400 ] 43 0.006% 100.060% ( 4400, 6600 ] 9 0.001% 100.062% ( 6600, 9900 ] 3 0.000% 100.062% ** Level 2 read latency histogram (micros): Count: 77174 Average: 4.2084 StdDev: 57.19 Min: 1 Median: 1.6216 Max: 5684 Percentiles: P50: 1.62 P75: 2.00 P99: 8.47 P99.9: 472.56 P99.99: 3542.39 ------------------------------------------------------ [ 0, 1 ] 6954 9.011% 9.011% ## ( 1, 2 ] 50891 65.943% 74.954% ############# ( 2, 3 ] 10927 14.159% 89.113% ### ( 3, 4 ] 4096 5.307% 94.420% # ( 4, 6 ] 2936 3.804% 98.225% # ( 6, 10 ] 969 1.256% 99.480% ( 10, 15 ] 112 0.145% 99.626% ( 15, 22 ] 22 0.029% 99.654% ( 22, 34 ] 2 0.003% 99.657% ( 34, 51 ] 2 0.003% 99.659% ( 76, 110 ] 37 0.048% 99.707% ( 110, 170 ] 42 0.054% 99.762% ( 170, 250 ] 39 0.051% 99.812% ( 250, 380 ] 47 0.061% 99.873% ( 380, 580 ] 45 0.058% 99.931% ( 580, 870 ] 23 0.030% 99.961% ( 870, 1300 ] 7 0.009% 99.970% ( 1300, 1900 ] 6 0.008% 99.978% ( 1900, 2900 ] 5 0.006% 99.984% ( 2900, 4400 ] 10 0.013% 99.997% ( 4400, 6600 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 447964 Average: 7.3773 StdDev: 87.12 Min: 0 Median: 1.8268 Max: 9712 Percentiles: P50: 1.83 P75: 2.70 P99: 10.29 P99.9: 811.15 P99.99: 1326.97 ------------------------------------------------------ [ 0, 1 ] 13535 3.021% 3.021% # ( 1, 2 ] 254526 56.818% 59.840% ########### ( 2, 3 ] 97470 21.758% 81.598% #### ( 3, 4 ] 37282 8.323% 89.921% ## ( 4, 6 ] 31813 7.102% 97.023% # ( 6, 10 ] 8772 1.958% 98.981% ( 10, 15 ] 1479 0.330% 99.311% ( 15, 22 ] 200 0.045% 99.356% ( 22, 34 ] 15 0.003% 99.359% ( 34, 51 ] 23 0.005% 99.364% ( 51, 76 ] 29 0.006% 99.370% ( 76, 110 ] 115 0.026% 99.396% ( 110, 170 ] 337 0.075% 99.471% ( 170, 250 ] 392 0.088% 99.559% ( 250, 380 ] 513 0.115% 99.673% ( 380, 580 ] 591 0.132% 99.805% ( 580, 870 ] 532 0.119% 99.924% ( 870, 1300 ] 289 0.065% 99.989% ( 1300, 1900 ] 138 0.031% 100.019% ( 1900, 2900 ] 74 0.017% 100.036% ( 2900, 4400 ] 85 0.019% 100.055% ( 4400, 6600 ] 21 0.005% 100.060% ( 6600, 9900 ] 4 0.001% 100.060% ** Level 4 read latency histogram (micros): Count: 1341 Average: 76.0000 StdDev: 465.77 Min: 1 Median: 1.7719 Max: 7214 Percentiles: P50: 1.77 P75: 2.73 P99: 2618.00 P99.9: 6349.93 P99.99: 7214.00 ------------------------------------------------------ [ 0, 1 ] 70 5.220% 5.220% # ( 1, 2 ] 778 58.016% 63.236% ############ ( 2, 3 ] 215 16.033% 79.269% ### ( 3, 4 ] 113 8.427% 87.696% ## ( 4, 6 ] 63 4.698% 92.394% # ( 6, 10 ] 19 1.417% 93.811% ( 10, 15 ] 1 0.075% 93.885% ( 76, 110 ] 1 0.075% 93.960% ( 110, 170 ] 17 1.268% 95.227% ( 170, 250 ] 8 0.597% 95.824% ( 250, 380 ] 5 0.373% 96.197% ( 380, 580 ] 6 0.447% 96.644% ( 580, 870 ] 15 1.119% 97.763% ( 870, 1300 ] 11 0.820% 98.583% ( 1300, 1900 ] 2 0.149% 98.732% ( 1900, 2900 ] 5 0.373% 99.105% ( 2900, 4400 ] 8 0.597% 99.702% ( 4400, 6600 ] 3 0.224% 99.925% ( 6600, 9900 ] 1 0.075% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 1042.4500 StdDev: 1174.23 Min: 47 Median: 480.0000 Max: 5323 Percentiles: P50: 480.00 P75: 1572.73 P99: 5280.00 P99.9: 5323.00 P99.99: 5323.00 ------------------------------------------------------ ( 34, 51 ] 1 0.556% 0.556% ( 76, 110 ] 8 4.444% 5.000% # ( 110, 170 ] 24 13.333% 18.333% ### ( 170, 250 ] 17 9.444% 27.778% ## ( 250, 380 ] 29 16.111% 43.889% ### ( 380, 580 ] 22 12.222% 56.111% ## ( 580, 870 ] 13 7.222% 63.333% # ( 870, 1300 ] 16 8.889% 72.222% ## ( 1300, 1900 ] 11 6.111% 78.333% # ( 1900, 2900 ] 22 12.222% 90.556% ## ( 2900, 4400 ] 14 7.778% 98.333% ## ( 4400, 6600 ] 3 1.667% 100.000% ** DB Stats ** Uptime(secs): 28.7 total, 3.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 240.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.253 H:M:S, 32.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 280.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.719 H:M:S, 20.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-03:59:13 ... thread 0: (1000000,8000000) ops and (320520.4,253171.6) ops/second in (3.119926,31.599119) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 4.42 GB 50.4 7.3 0.0 7.3 14.9 7.6 0.0 1.9 137.1 280.9 54.20 49.62 131 0.414 7546K 17K 0.0 0.0 L1 1/1 22.74 MB 0.0 3.5 3.0 0.5 3.5 3.0 0.2 1.2 223.3 221.2 16.27 15.76 3 5.423 3688K 32K 0.0 0.0 L2 1/0 64.25 MB 0.6 0.2 0.1 0.1 0.2 0.1 3.0 1.5 239.1 238.9 0.81 0.77 2 0.403 195K 109 0.0 0.0 L3 13/0 974.74 MB 1.0 3.0 1.8 1.1 3.0 1.8 1.4 1.6 175.4 175.0 17.33 13.62 10 1.733 3034K 6401 0.0 0.0 L4 156/0 9.48 GB 1.0 1.2 0.9 0.3 1.2 0.9 2.0 1.4 155.5 154.7 7.85 5.80 8 0.981 1175K 5044 0.0 0.0 L5 1080/0 88.77 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/16 103.70 GB 0.0 15.2 5.8 9.3 22.7 13.4 9.6 3.0 160.9 241.2 96.45 85.58 154 0.626 15M 61K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.2 5.8 9.3 22.7 13.4 9.4 3.0 160.9 241.2 96.45 85.58 154 0.626 15M 61K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.2 5.8 9.3 15.1 5.8 0.0 0.0 214.4 213.5 72.39 64.96 45 1.609 15M 61K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 324.7 24.06 20.62 109 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.8 total, 31.6 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.72 GB write, 731.54 MB/s write, 15.15 GB read, 487.93 MB/s read, 96.4 seconds Interval compaction: 22.72 GB write, 736.22 MB/s write, 15.15 GB read, 491.05 MB/s read, 96.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 45, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2905778 Average: 2.4180 StdDev: 21.03 Min: 0 Median: 1.5204 Max: 10048 Percentiles: P50: 1.52 P75: 1.90 P99: 5.86 P99.9: 12.54 P99.99: 153.07 ------------------------------------------------------ [ 0, 1 ] 451834 15.550% 15.550% ### ( 1, 2 ] 1923687 66.202% 81.752% ############# ( 2, 3 ] 329392 11.336% 93.087% ## ( 3, 4 ] 106156 3.653% 96.741% # ( 4, 6 ] 70415 2.423% 99.164% ( 6, 10 ] 19936 0.686% 99.850% ( 10, 15 ] 2861 0.098% 99.948% ( 15, 22 ] 320 0.011% 99.959% ( 22, 34 ] 34 0.001% 99.961% ( 34, 51 ] 18 0.001% 99.961% ( 51, 76 ] 20 0.001% 99.962% ( 76, 110 ] 463 0.016% 99.978% ( 110, 170 ] 491 0.017% 99.995% ( 170, 250 ] 202 0.007% 100.002% ( 250, 380 ] 189 0.007% 100.008% ( 380, 580 ] 153 0.005% 100.014% ( 580, 870 ] 128 0.004% 100.018% ( 870, 1300 ] 94 0.003% 100.021% ( 1300, 1900 ] 36 0.001% 100.022% ( 1900, 2900 ] 24 0.001% 100.023% ( 2900, 4400 ] 30 0.001% 100.024% ( 4400, 6600 ] 5 0.000% 100.024% ( 6600, 9900 ] 2 0.000% 100.025% ( 9900, 14000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 694788 Average: 3.6903 StdDev: 46.18 Min: 1 Median: 1.7556 Max: 8760 Percentiles: P50: 1.76 P75: 2.53 P99: 8.47 P99.9: 27.47 P99.99: 406.58 ------------------------------------------------------ [ 0, 1 ] 36999 5.325% 5.325% # ( 1, 2 ] 410819 59.129% 64.454% ############ ( 2, 3 ] 139127 20.024% 84.478% #### ( 3, 4 ] 48846 7.030% 91.509% # ( 4, 6 ] 45113 6.493% 98.002% # ( 6, 10 ] 11240 1.618% 99.619% ( 10, 15 ] 1758 0.253% 99.872% ( 15, 22 ] 183 0.026% 99.899% ( 22, 34 ] 18 0.003% 99.901% ( 34, 51 ] 8 0.001% 99.903% ( 51, 76 ] 11 0.002% 99.904% ( 76, 110 ] 102 0.015% 99.919% ( 110, 170 ] 191 0.027% 99.946% ( 170, 250 ] 138 0.020% 99.966% ( 250, 380 ] 142 0.020% 99.987% ( 380, 580 ] 177 0.025% 100.012% ( 580, 870 ] 140 0.020% 100.032% ( 870, 1300 ] 71 0.010% 100.042% ( 1300, 1900 ] 45 0.006% 100.049% ( 1900, 2900 ] 37 0.005% 100.054% ( 2900, 4400 ] 43 0.006% 100.060% ( 4400, 6600 ] 9 0.001% 100.062% ( 6600, 9900 ] 3 0.000% 100.062% ** Level 2 read latency histogram (micros): Count: 77174 Average: 4.2084 StdDev: 57.19 Min: 1 Median: 1.6216 Max: 5684 Percentiles: P50: 1.62 P75: 2.00 P99: 8.47 P99.9: 472.56 P99.99: 3542.39 ------------------------------------------------------ [ 0, 1 ] 6954 9.011% 9.011% ## ( 1, 2 ] 50891 65.943% 74.954% ############# ( 2, 3 ] 10927 14.159% 89.113% ### ( 3, 4 ] 4096 5.307% 94.420% # ( 4, 6 ] 2936 3.804% 98.225% # ( 6, 10 ] 969 1.256% 99.480% ( 10, 15 ] 112 0.145% 99.626% ( 15, 22 ] 22 0.029% 99.654% ( 22, 34 ] 2 0.003% 99.657% ( 34, 51 ] 2 0.003% 99.659% ( 76, 110 ] 37 0.048% 99.707% ( 110, 170 ] 42 0.054% 99.762% ( 170, 250 ] 39 0.051% 99.812% ( 250, 380 ] 47 0.061% 99.873% ( 380, 580 ] 45 0.058% 99.931% ( 580, 870 ] 23 0.030% 99.961% ( 870, 1300 ] 7 0.009% 99.970% ( 1300, 1900 ] 6 0.008% 99.978% ( 1900, 2900 ] 5 0.006% 99.984% ( 2900, 4400 ] 10 0.013% 99.997% ( 4400, 6600 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 447964 Average: 7.3773 StdDev: 87.12 Min: 0 Median: 1.8268 Max: 9712 Percentiles: P50: 1.83 P75: 2.70 P99: 10.29 P99.9: 811.15 P99.99: 1326.97 ------------------------------------------------------ [ 0, 1 ] 13535 3.021% 3.021% # ( 1, 2 ] 254526 56.818% 59.840% ########### ( 2, 3 ] 97470 21.758% 81.598% #### ( 3, 4 ] 37282 8.323% 89.921% ## ( 4, 6 ] 31813 7.102% 97.023% # ( 6, 10 ] 8772 1.958% 98.981% ( 10, 15 ] 1479 0.330% 99.311% ( 15, 22 ] 200 0.045% 99.356% ( 22, 34 ] 15 0.003% 99.359% ( 34, 51 ] 23 0.005% 99.364% ( 51, 76 ] 29 0.006% 99.370% ( 76, 110 ] 115 0.026% 99.396% ( 110, 170 ] 337 0.075% 99.471% ( 170, 250 ] 392 0.088% 99.559% ( 250, 380 ] 513 0.115% 99.673% ( 380, 580 ] 591 0.132% 99.805% ( 580, 870 ] 532 0.119% 99.924% ( 870, 1300 ] 289 0.065% 99.989% ( 1300, 1900 ] 138 0.031% 100.019% ( 1900, 2900 ] 74 0.017% 100.036% ( 2900, 4400 ] 85 0.019% 100.055% ( 4400, 6600 ] 21 0.005% 100.060% ( 6600, 9900 ] 4 0.001% 100.060% ** Level 4 read latency histogram (micros): Count: 1341 Average: 76.0000 StdDev: 465.77 Min: 1 Median: 1.7719 Max: 7214 Percentiles: P50: 1.77 P75: 2.73 P99: 2618.00 P99.9: 6349.93 P99.99: 7214.00 ------------------------------------------------------ [ 0, 1 ] 70 5.220% 5.220% # ( 1, 2 ] 778 58.016% 63.236% ############ ( 2, 3 ] 215 16.033% 79.269% ### ( 3, 4 ] 113 8.427% 87.696% ## ( 4, 6 ] 63 4.698% 92.394% # ( 6, 10 ] 19 1.417% 93.811% ( 10, 15 ] 1 0.075% 93.885% ( 76, 110 ] 1 0.075% 93.960% ( 110, 170 ] 17 1.268% 95.227% ( 170, 250 ] 8 0.597% 95.824% ( 250, 380 ] 5 0.373% 96.197% ( 380, 580 ] 6 0.447% 96.644% ( 580, 870 ] 15 1.119% 97.763% ( 870, 1300 ] 11 0.820% 98.583% ( 1300, 1900 ] 2 0.149% 98.732% ( 1900, 2900 ] 5 0.373% 99.105% ( 2900, 4400 ] 8 0.597% 99.702% ( 4400, 6600 ] 3 0.224% 99.925% ( 6600, 9900 ] 1 0.075% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 1042.4500 StdDev: 1174.23 Min: 47 Median: 480.0000 Max: 5323 Percentiles: P50: 480.00 P75: 1572.73 P99: 5280.00 P99.9: 5323.00 P99.99: 5323.00 ------------------------------------------------------ ( 34, 51 ] 1 0.556% 0.556% ( 76, 110 ] 8 4.444% 5.000% # ( 110, 170 ] 24 13.333% 18.333% ### ( 170, 250 ] 17 9.444% 27.778% ## ( 250, 380 ] 29 16.111% 43.889% ### ( 380, 580 ] 22 12.222% 56.111% ## ( 580, 870 ] 13 7.222% 63.333% # ( 870, 1300 ] 16 8.889% 72.222% ## ( 1300, 1900 ] 11 6.111% 78.333% # ( 1900, 2900 ] 22 12.222% 90.556% ## ( 2900, 4400 ] 14 7.778% 98.333% ## ( 4400, 6600 ] 3 1.667% 100.000% ** DB Stats ** Uptime(secs): 31.8 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 247.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.695 H:M:S, 30.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.441 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-03:59:28 ... thread 0: (1000000,9000000) ops and (64934.5,191492.4) ops/second in (15.400125,46.999244) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 2/2 1.71 GB 0.0 10.9 0.0 10.9 19.4 8.5 0.0 2.3 154.6 275.7 72.07 66.60 153 0.471 11M 28K 0.0 0.0 L1 14/14 1.57 GB 0.0 7.2 6.6 0.6 7.1 6.5 0.2 1.1 217.1 214.5 33.88 32.06 4 8.471 7448K 65K 0.0 0.0 L2 12/9 1.45 GB 3.9 0.2 0.1 0.1 0.2 0.1 5.0 1.5 239.1 238.9 0.81 0.77 2 0.403 195K 109 0.0 0.0 L3 18/8 1.58 GB 1.0 3.0 1.8 1.1 3.0 1.8 2.0 1.6 175.4 175.0 17.33 13.62 10 1.733 3034K 6401 0.0 0.0 L4 156/0 9.48 GB 1.0 1.2 0.9 0.3 1.2 0.9 2.0 1.4 155.5 154.7 7.85 5.80 8 0.981 1175K 5044 0.0 0.0 L5 1080/0 88.77 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/33 104.56 GB 0.0 22.4 9.4 13.0 30.8 17.9 12.2 3.6 174.0 239.4 131.93 118.86 177 0.745 23M 105K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.4 9.4 13.0 30.8 17.9 12.1 3.6 174.0 239.4 131.93 118.86 177 0.745 23M 105K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.4 9.4 13.0 22.3 9.3 0.0 0.0 218.6 217.3 105.02 95.69 53 1.981 23M 105K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 325.3 26.92 23.16 124 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.2 total, 47.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.84 GB write, 669.03 MB/s write, 22.42 GB read, 486.30 MB/s read, 131.9 seconds Interval compaction: 30.84 GB write, 671.91 MB/s write, 22.42 GB read, 488.39 MB/s read, 131.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 31, total-stops: 45, interval: 76 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4608228 Average: 2.6342 StdDev: 19.47 Min: 0 Median: 1.5211 Max: 10048 Percentiles: P50: 1.52 P75: 1.89 P99: 6.48 P99.9: 125.10 P99.99: 281.23 ------------------------------------------------------ [ 0, 1 ] 697658 15.139% 15.139% ### ( 1, 2 ] 3082556 66.892% 82.032% ############# ( 2, 3 ] 518750 11.257% 93.289% ## ( 3, 4 ] 157307 3.414% 96.702% # ( 4, 6 ] 101628 2.205% 98.908% ( 6, 10 ] 35447 0.769% 99.677% ( 10, 15 ] 4118 0.089% 99.766% ( 15, 22 ] 791 0.017% 99.784% ( 22, 34 ] 60 0.001% 99.785% ( 34, 51 ] 24 0.001% 99.785% ( 51, 76 ] 137 0.003% 99.788% ( 76, 110 ] 4140 0.090% 99.878% ( 110, 170 ] 3992 0.087% 99.965% ( 170, 250 ] 993 0.022% 99.986% ( 250, 380 ] 696 0.015% 100.001% ( 380, 580 ] 516 0.011% 100.013% ( 580, 870 ] 265 0.006% 100.018% ( 870, 1300 ] 125 0.003% 100.021% ( 1300, 1900 ] 40 0.001% 100.022% ( 1900, 2900 ] 32 0.001% 100.023% ( 2900, 4400 ] 34 0.001% 100.023% ( 4400, 6600 ] 6 0.000% 100.024% ( 6600, 9900 ] 2 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 742320 Average: 4.2399 StdDev: 53.62 Min: 0 Median: 1.7644 Max: 8760 Percentiles: P50: 1.76 P75: 2.55 P99: 8.76 P99.9: 194.93 P99.99: 542.39 ------------------------------------------------------ [ 0, 1 ] 38408 5.174% 5.174% # ( 1, 2 ] 435328 58.644% 63.818% ############ ( 2, 3 ] 150152 20.227% 84.046% #### ( 3, 4 ] 53329 7.184% 91.230% # ( 4, 6 ] 49104 6.615% 97.845% # ( 6, 10 ] 12440 1.676% 99.521% ( 10, 15 ] 2023 0.273% 99.793% ( 15, 22 ] 215 0.029% 99.822% ( 22, 34 ] 21 0.003% 99.825% ( 34, 51 ] 12 0.002% 99.826% ( 51, 76 ] 33 0.004% 99.831% ( 76, 110 ] 156 0.021% 99.852% ( 110, 170 ] 286 0.039% 99.890% ( 170, 250 ] 230 0.031% 99.921% ( 250, 380 ] 267 0.036% 99.957% ( 380, 580 ] 299 0.040% 99.998% ( 580, 870 ] 237 0.032% 100.030% ( 870, 1300 ] 137 0.018% 100.048% ( 1300, 1900 ] 74 0.010% 100.058% ( 1900, 2900 ] 58 0.008% 100.066% ( 2900, 4400 ] 65 0.009% 100.075% ( 4400, 6600 ] 10 0.001% 100.076% ( 6600, 9900 ] 3 0.000% 100.076% ** Level 2 read latency histogram (micros): Count: 77174 Average: 4.2084 StdDev: 57.19 Min: 1 Median: 1.6216 Max: 5684 Percentiles: P50: 1.62 P75: 2.00 P99: 8.47 P99.9: 472.56 P99.99: 3542.39 ------------------------------------------------------ [ 0, 1 ] 6954 9.011% 9.011% ## ( 1, 2 ] 50891 65.943% 74.954% ############# ( 2, 3 ] 10927 14.159% 89.113% ### ( 3, 4 ] 4096 5.307% 94.420% # ( 4, 6 ] 2936 3.804% 98.225% # ( 6, 10 ] 969 1.256% 99.480% ( 10, 15 ] 112 0.145% 99.626% ( 15, 22 ] 22 0.029% 99.654% ( 22, 34 ] 2 0.003% 99.657% ( 34, 51 ] 2 0.003% 99.659% ( 76, 110 ] 37 0.048% 99.707% ( 110, 170 ] 42 0.054% 99.762% ( 170, 250 ] 39 0.051% 99.812% ( 250, 380 ] 47 0.061% 99.873% ( 380, 580 ] 45 0.058% 99.931% ( 580, 870 ] 23 0.030% 99.961% ( 870, 1300 ] 7 0.009% 99.970% ( 1300, 1900 ] 6 0.008% 99.978% ( 1900, 2900 ] 5 0.006% 99.984% ( 2900, 4400 ] 10 0.013% 99.997% ( 4400, 6600 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 449061 Average: 7.5762 StdDev: 89.09 Min: 0 Median: 1.8284 Max: 9712 Percentiles: P50: 1.83 P75: 2.70 P99: 10.74 P99.9: 829.97 P99.99: 1404.56 ------------------------------------------------------ [ 0, 1 ] 13539 3.015% 3.015% # ( 1, 2 ] 254704 56.719% 59.734% ########### ( 2, 3 ] 97834 21.786% 81.521% #### ( 3, 4 ] 37516 8.354% 89.875% ## ( 4, 6 ] 31950 7.115% 96.990% # ( 6, 10 ] 8807 1.961% 98.951% ( 10, 15 ] 1491 0.332% 99.283% ( 15, 22 ] 205 0.046% 99.329% ( 22, 34 ] 15 0.003% 99.332% ( 34, 51 ] 23 0.005% 99.337% ( 51, 76 ] 29 0.006% 99.344% ( 76, 110 ] 136 0.030% 99.374% ( 110, 170 ] 354 0.079% 99.453% ( 170, 250 ] 405 0.090% 99.543% ( 250, 380 ] 524 0.117% 99.660% ( 380, 580 ] 605 0.135% 99.794% ( 580, 870 ] 551 0.123% 99.917% ( 870, 1300 ] 303 0.067% 99.984% ( 1300, 1900 ] 144 0.032% 100.016% ( 1900, 2900 ] 81 0.018% 100.035% ( 2900, 4400 ] 91 0.020% 100.055% ( 4400, 6600 ] 21 0.005% 100.059% ( 6600, 9900 ] 4 0.001% 100.060% ** Level 4 read latency histogram (micros): Count: 1341 Average: 76.0000 StdDev: 465.77 Min: 1 Median: 1.7719 Max: 7214 Percentiles: P50: 1.77 P75: 2.73 P99: 2618.00 P99.9: 6349.93 P99.99: 7214.00 ------------------------------------------------------ [ 0, 1 ] 70 5.220% 5.220% # ( 1, 2 ] 778 58.016% 63.236% ############ ( 2, 3 ] 215 16.033% 79.269% ### ( 3, 4 ] 113 8.427% 87.696% ## ( 4, 6 ] 63 4.698% 92.394% # ( 6, 10 ] 19 1.417% 93.811% ( 10, 15 ] 1 0.075% 93.885% ( 76, 110 ] 1 0.075% 93.960% ( 110, 170 ] 17 1.268% 95.227% ( 170, 250 ] 8 0.597% 95.824% ( 250, 380 ] 5 0.373% 96.197% ( 380, 580 ] 6 0.447% 96.644% ( 580, 870 ] 15 1.119% 97.763% ( 870, 1300 ] 11 0.820% 98.583% ( 1300, 1900 ] 2 0.149% 98.732% ( 1900, 2900 ] 5 0.373% 99.105% ( 2900, 4400 ] 8 0.597% 99.702% ( 4400, 6600 ] 3 0.224% 99.925% ( 6600, 9900 ] 1 0.075% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 1042.4500 StdDev: 1174.23 Min: 47 Median: 480.0000 Max: 5323 Percentiles: P50: 480.00 P75: 1572.73 P99: 5280.00 P99.9: 5323.00 P99.99: 5323.00 ------------------------------------------------------ ( 34, 51 ] 1 0.556% 0.556% ( 76, 110 ] 8 4.444% 5.000% # ( 110, 170 ] 24 13.333% 18.333% ### ( 170, 250 ] 17 9.444% 27.778% ## ( 250, 380 ] 29 16.111% 43.889% ### ( 380, 580 ] 22 12.222% 56.111% ## ( 580, 870 ] 13 7.222% 63.333% # ( 870, 1300 ] 16 8.889% 72.222% ## ( 1300, 1900 ] 11 6.111% 78.333% # ( 1900, 2900 ] 22 12.222% 90.556% ## ( 2900, 4400 ] 14 7.778% 98.333% ## ( 4400, 6600 ] 3 1.667% 100.000% ** DB Stats ** Uptime(secs): 47.2 total, 15.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 187.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.995 H:M:S, 46.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 63.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.301 H:M:S, 79.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/11/29-03:59:34 ... thread 0: (1000000,10000000) ops and (169470.4,189036.0) ops/second in (5.900736,52.899980) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/6 2.63 GB 56.6 11.3 0.0 11.3 20.7 9.4 0.0 2.2 144.4 265.7 79.78 70.90 165 0.484 11M 28K 0.0 0.0 L1 14/14 1.57 GB 0.0 7.2 6.6 0.6 7.1 6.5 0.2 1.1 217.1 214.5 33.88 32.06 4 8.471 7448K 65K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 5.0 1.5 239.1 238.9 0.81 0.77 2 0.403 195K 109 0.0 0.0 L3 16/0 999.17 MB 1.0 5.4 3.3 2.1 5.3 3.2 2.0 1.6 158.8 157.9 34.54 25.19 19 1.818 5516K 28K 0.0 0.0 L4 154/0 9.51 GB 1.0 4.0 2.9 1.1 3.9 2.8 2.1 1.4 142.1 140.8 28.58 19.15 32 0.893 3998K 30K 0.0 0.0 L5 1104/0 90.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/20 105.43 GB 0.0 27.9 12.9 15.1 37.2 22.2 14.2 3.9 161.1 214.7 177.59 148.07 222 0.800 28M 153K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.9 12.9 15.1 37.2 22.2 14.1 3.9 161.1 214.7 177.59 148.07 222 0.800 28M 153K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.9 12.9 15.1 27.8 12.7 0.0 0.0 197.2 195.9 145.11 122.17 87 1.668 28M 153K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 298.7 32.47 25.90 135 0.241 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.1 total, 52.9 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.24 GB write, 718.14 MB/s write, 27.95 GB read, 538.88 MB/s read, 177.6 seconds Interval compaction: 37.24 GB write, 720.88 MB/s write, 27.95 GB read, 540.94 MB/s read, 177.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 76, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 31, total-stops: 76, interval: 107 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4981075 Average: 2.8431 StdDev: 31.87 Min: 0 Median: 1.5450 Max: 10048 Percentiles: P50: 1.54 P75: 1.93 P99: 7.01 P99.9: 125.04 P99.99: 333.94 ------------------------------------------------------ [ 0, 1 ] 706597 14.186% 14.186% ### ( 1, 2 ] 3273310 65.715% 79.901% ############# ( 2, 3 ] 611403 12.275% 92.175% ## ( 3, 4 ] 189768 3.810% 95.985% # ( 4, 6 ] 139091 2.792% 98.777% # ( 6, 10 ] 44020 0.884% 99.661% ( 10, 15 ] 5556 0.112% 99.773% ( 15, 22 ] 963 0.019% 99.792% ( 22, 34 ] 74 0.001% 99.793% ( 34, 51 ] 28 0.001% 99.794% ( 51, 76 ] 140 0.003% 99.797% ( 76, 110 ] 4141 0.083% 99.880% ( 110, 170 ] 4005 0.080% 99.960% ( 170, 250 ] 1017 0.020% 99.981% ( 250, 380 ] 720 0.014% 99.995% ( 380, 580 ] 573 0.012% 100.007% ( 580, 870 ] 334 0.007% 100.013% ( 870, 1300 ] 178 0.004% 100.017% ( 1300, 1900 ] 74 0.001% 100.018% ( 1900, 2900 ] 88 0.002% 100.020% ( 2900, 4400 ] 140 0.003% 100.023% ( 4400, 6600 ] 33 0.001% 100.024% ( 6600, 9900 ] 12 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1303178 Average: 5.6833 StdDev: 91.83 Min: 0 Median: 1.8341 Max: 10121 Percentiles: P50: 1.83 P75: 2.73 P99: 9.10 P99.9: 173.60 P99.99: 559.81 ------------------------------------------------------ [ 0, 1 ] 46748 3.587% 3.587% # ( 1, 2 ] 725174 55.647% 59.234% ########### ( 2, 3 ] 282879 21.707% 80.941% #### ( 3, 4 ] 109816 8.427% 89.367% ## ( 4, 6 ] 104582 8.025% 97.393% ## ( 6, 10 ] 27040 2.075% 99.468% ( 10, 15 ] 4527 0.347% 99.815% ( 15, 22 ] 513 0.039% 99.854% ( 22, 34 ] 44 0.003% 99.858% ( 34, 51 ] 19 0.001% 99.859% ( 51, 76 ] 38 0.003% 99.862% ( 76, 110 ] 167 0.013% 99.875% ( 110, 170 ] 315 0.024% 99.899% ( 170, 250 ] 285 0.022% 99.921% ( 250, 380 ] 417 0.032% 99.953% ( 380, 580 ] 538 0.041% 99.994% ( 580, 870 ] 492 0.038% 100.032% ( 870, 1300 ] 335 0.026% 100.058% ( 1300, 1900 ] 194 0.015% 100.073% ( 1900, 2900 ] 222 0.017% 100.090% ( 2900, 4400 ] 281 0.022% 100.111% ( 4400, 6600 ] 85 0.007% 100.118% ( 6600, 9900 ] 40 0.003% 100.121% ( 9900, 14000 ] 1 0.000% 100.121% ** Level 2 read latency histogram (micros): Count: 77174 Average: 4.2084 StdDev: 57.19 Min: 1 Median: 1.6216 Max: 5684 Percentiles: P50: 1.62 P75: 2.00 P99: 8.47 P99.9: 472.56 P99.99: 3542.39 ------------------------------------------------------ [ 0, 1 ] 6954 9.011% 9.011% ## ( 1, 2 ] 50891 65.943% 74.954% ############# ( 2, 3 ] 10927 14.159% 89.113% ### ( 3, 4 ] 4096 5.307% 94.420% # ( 4, 6 ] 2936 3.804% 98.225% # ( 6, 10 ] 969 1.256% 99.480% ( 10, 15 ] 112 0.145% 99.626% ( 15, 22 ] 22 0.029% 99.654% ( 22, 34 ] 2 0.003% 99.657% ( 34, 51 ] 2 0.003% 99.659% ( 76, 110 ] 37 0.048% 99.707% ( 110, 170 ] 42 0.054% 99.762% ( 170, 250 ] 39 0.051% 99.812% ( 250, 380 ] 47 0.061% 99.873% ( 380, 580 ] 45 0.058% 99.931% ( 580, 870 ] 23 0.030% 99.961% ( 870, 1300 ] 7 0.009% 99.970% ( 1300, 1900 ] 6 0.008% 99.978% ( 1900, 2900 ] 5 0.006% 99.984% ( 2900, 4400 ] 10 0.013% 99.997% ( 4400, 6600 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1057527 Average: 6.9012 StdDev: 90.56 Min: 0 Median: 1.8949 Max: 9712 Percentiles: P50: 1.89 P75: 2.84 P99: 9.41 P99.9: 537.30 P99.99: 821.75 ------------------------------------------------------ [ 0, 1 ] 21648 2.047% 2.047% ( 1, 2 ] 566647 53.582% 55.629% ########### ( 2, 3 ] 244081 23.080% 78.710% ##### ( 3, 4 ] 103848 9.820% 88.530% ## ( 4, 6 ] 94579 8.943% 97.473% ## ( 6, 10 ] 18949 1.792% 99.265% ( 10, 15 ] 3599 0.340% 99.605% ( 15, 22 ] 405 0.038% 99.643% ( 22, 34 ] 28 0.003% 99.646% ( 34, 51 ] 32 0.003% 99.649% ( 51, 76 ] 31 0.003% 99.652% ( 76, 110 ] 178 0.017% 99.669% ( 110, 170 ] 427 0.040% 99.709% ( 170, 250 ] 519 0.049% 99.758% ( 250, 380 ] 756 0.071% 99.830% ( 380, 580 ] 944 0.089% 99.919% ( 580, 870 ] 900 0.085% 100.004% ( 870, 1300 ] 557 0.053% 100.057% ( 1300, 1900 ] 274 0.026% 100.083% ( 1900, 2900 ] 225 0.021% 100.104% ( 2900, 4400 ] 239 0.023% 100.127% ( 4400, 6600 ] 60 0.006% 100.132% ( 6600, 9900 ] 14 0.001% 100.134% ** Level 4 read latency histogram (micros): Count: 126501 Average: 12.0201 StdDev: 139.67 Min: 1 Median: 1.9388 Max: 7214 Percentiles: P50: 1.94 P75: 2.94 P99: 14.24 P99.9: 1823.16 P99.99: 3943.52 ------------------------------------------------------ [ 0, 1 ] 1987 1.571% 1.571% ( 1, 2 ] 65260 51.589% 53.159% ########## ( 2, 3 ] 29531 23.344% 76.504% ##### ( 3, 4 ] 12379 9.786% 86.289% ## ( 4, 6 ] 12442 9.835% 96.125% ## ( 6, 10 ] 3164 2.501% 98.626% # ( 10, 15 ] 558 0.441% 99.067% ( 15, 22 ] 53 0.042% 99.109% ( 22, 34 ] 5 0.004% 99.113% ( 34, 51 ] 5 0.004% 99.117% ( 51, 76 ] 2 0.002% 99.119% ( 76, 110 ] 20 0.016% 99.134% ( 110, 170 ] 81 0.064% 99.198% ( 170, 250 ] 99 0.078% 99.277% ( 250, 380 ] 112 0.089% 99.365% ( 380, 580 ] 203 0.160% 99.526% ( 580, 870 ] 224 0.177% 99.703% ( 870, 1300 ] 178 0.141% 99.843% ( 1300, 1900 ] 82 0.065% 99.908% ( 1900, 2900 ] 47 0.037% 99.945% ( 2900, 4400 ] 81 0.064% 100.009% ( 4400, 6600 ] 19 0.015% 100.025% ( 6600, 9900 ] 2 0.002% 100.026% ** Level 5 read latency histogram (micros): Count: 300 Average: 1165.4600 StdDev: 1315.04 Min: 47 Median: 580.0000 Max: 6567 Percentiles: P50: 580.00 P75: 1728.57 P99: 6000.00 P99.9: 6540.00 P99.99: 6567.00 ------------------------------------------------------ ( 34, 51 ] 1 0.333% 0.333% ( 51, 76 ] 1 0.333% 0.667% ( 76, 110 ] 12 4.000% 4.667% # ( 110, 170 ] 38 12.667% 17.333% ### ( 170, 250 ] 24 8.000% 25.333% ## ( 250, 380 ] 39 13.000% 38.333% ### ( 380, 580 ] 35 11.667% 50.000% ## ( 580, 870 ] 36 12.000% 62.000% ## ( 870, 1300 ] 24 8.000% 70.000% ## ( 1300, 1900 ] 21 7.000% 77.000% # ( 1900, 2900 ] 31 10.333% 87.333% ## ( 2900, 4400 ] 27 9.000% 96.333% ## ( 4400, 6600 ] 11 3.667% 100.000% # ** DB Stats ** Uptime(secs): 53.1 total, 5.9 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 185.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.871 H:M:S, 46.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 166.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.876 H:M:S, 48.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-03:59:37 ... thread 0: (1000000,11000000) ops and (301803.2,195682.9) ops/second in (3.313418,56.213398) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/6 3.62 GB 163.6 12.1 0.0 12.1 22.5 10.4 0.0 2.2 143.7 267.4 86.33 77.07 181 0.477 12M 29K 0.0 0.0 L1 14/14 1.57 GB 0.0 7.2 6.6 0.6 7.1 6.5 0.2 1.1 217.1 214.5 33.88 32.06 4 8.471 7448K 65K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 5.0 1.5 239.1 238.9 0.81 0.77 2 0.403 195K 109 0.0 0.0 L3 16/0 999.17 MB 1.0 5.4 3.3 2.1 5.3 3.2 2.0 1.6 158.8 157.9 34.54 25.19 19 1.818 5516K 28K 0.0 0.0 L4 154/0 9.51 GB 1.0 4.0 2.9 1.1 3.9 2.8 2.1 1.4 142.1 140.8 28.58 19.15 32 0.893 3998K 30K 0.0 0.0 L5 1104/0 90.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/20 106.42 GB 0.0 28.8 12.9 15.9 39.1 23.2 14.2 3.7 160.2 217.4 184.13 154.25 238 0.774 29M 154K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.8 12.9 15.9 39.1 23.2 14.1 3.7 160.2 217.4 184.13 154.25 238 0.774 29M 154K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.8 12.9 15.9 28.6 12.7 0.0 0.0 198.4 197.2 148.69 125.67 90 1.652 29M 154K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 302.2 35.44 28.58 148 0.239 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.4 total, 56.2 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 39.09 GB write, 709.44 MB/s write, 28.81 GB read, 522.87 MB/s read, 184.1 seconds Interval compaction: 39.09 GB write, 711.99 MB/s write, 28.81 GB read, 524.75 MB/s read, 184.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 81, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 31, total-stops: 81, interval: 112 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5289033 Average: 2.8148 StdDev: 31.04 Min: 0 Median: 1.5462 Max: 10048 Percentiles: P50: 1.55 P75: 1.93 P99: 6.90 P99.9: 120.78 P99.99: 321.73 ------------------------------------------------------ [ 0, 1 ] 741300 14.016% 14.016% ### ( 1, 2 ] 3484283 65.878% 79.893% ############# ( 2, 3 ] 653538 12.356% 92.250% ## ( 3, 4 ] 200656 3.794% 96.044% # ( 4, 6 ] 146068 2.762% 98.805% # ( 6, 10 ] 45925 0.868% 99.674% ( 10, 15 ] 5853 0.111% 99.784% ( 15, 22 ] 982 0.019% 99.803% ( 22, 34 ] 75 0.001% 99.804% ( 34, 51 ] 29 0.001% 99.805% ( 51, 76 ] 144 0.003% 99.808% ( 76, 110 ] 4166 0.079% 99.886% ( 110, 170 ] 4040 0.076% 99.963% ( 170, 250 ] 1035 0.020% 99.982% ( 250, 380 ] 745 0.014% 99.996% ( 380, 580 ] 591 0.011% 100.008% ( 580, 870 ] 343 0.006% 100.014% ( 870, 1300 ] 181 0.003% 100.017% ( 1300, 1900 ] 75 0.001% 100.019% ( 1900, 2900 ] 89 0.002% 100.021% ( 2900, 4400 ] 141 0.003% 100.023% ( 4400, 6600 ] 33 0.001% 100.024% ( 6600, 9900 ] 12 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1421983 Average: 5.4300 StdDev: 88.03 Min: 0 Median: 1.8063 Max: 10121 Percentiles: P50: 1.81 P75: 2.67 P99: 9.05 P99.9: 163.47 P99.99: 558.55 ------------------------------------------------------ [ 0, 1 ] 59701 4.198% 4.198% # ( 1, 2 ] 807716 56.802% 61.001% ########### ( 2, 3 ] 297507 20.922% 81.922% #### ( 3, 4 ] 113662 7.993% 89.916% ## ( 4, 6 ] 107128 7.534% 97.449% ## ( 6, 10 ] 28908 2.033% 99.482% ( 10, 15 ] 4686 0.330% 99.812% ( 15, 22 ] 522 0.037% 99.849% ( 22, 34 ] 44 0.003% 99.852% ( 34, 51 ] 19 0.001% 99.853% ( 51, 76 ] 38 0.003% 99.856% ( 76, 110 ] 271 0.019% 99.875% ( 110, 170 ] 404 0.028% 99.903% ( 170, 250 ] 311 0.022% 99.925% ( 250, 380 ] 432 0.030% 99.955% ( 380, 580 ] 552 0.039% 99.994% ( 580, 870 ] 497 0.035% 100.029% ( 870, 1300 ] 335 0.024% 100.053% ( 1300, 1900 ] 194 0.014% 100.066% ( 1900, 2900 ] 222 0.016% 100.082% ( 2900, 4400 ] 283 0.020% 100.102% ( 4400, 6600 ] 85 0.006% 100.108% ( 6600, 9900 ] 40 0.003% 100.111% ( 9900, 14000 ] 1 0.000% 100.111% ** Level 2 read latency histogram (micros): Count: 77174 Average: 4.2084 StdDev: 57.19 Min: 1 Median: 1.6216 Max: 5684 Percentiles: P50: 1.62 P75: 2.00 P99: 8.47 P99.9: 472.56 P99.99: 3542.39 ------------------------------------------------------ [ 0, 1 ] 6954 9.011% 9.011% ## ( 1, 2 ] 50891 65.943% 74.954% ############# ( 2, 3 ] 10927 14.159% 89.113% ### ( 3, 4 ] 4096 5.307% 94.420% # ( 4, 6 ] 2936 3.804% 98.225% # ( 6, 10 ] 969 1.256% 99.480% ( 10, 15 ] 112 0.145% 99.626% ( 15, 22 ] 22 0.029% 99.654% ( 22, 34 ] 2 0.003% 99.657% ( 34, 51 ] 2 0.003% 99.659% ( 76, 110 ] 37 0.048% 99.707% ( 110, 170 ] 42 0.054% 99.762% ( 170, 250 ] 39 0.051% 99.812% ( 250, 380 ] 47 0.061% 99.873% ( 380, 580 ] 45 0.058% 99.931% ( 580, 870 ] 23 0.030% 99.961% ( 870, 1300 ] 7 0.009% 99.970% ( 1300, 1900 ] 6 0.008% 99.978% ( 1900, 2900 ] 5 0.006% 99.984% ( 2900, 4400 ] 10 0.013% 99.997% ( 4400, 6600 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1057527 Average: 6.9012 StdDev: 90.56 Min: 0 Median: 1.8949 Max: 9712 Percentiles: P50: 1.89 P75: 2.84 P99: 9.41 P99.9: 537.30 P99.99: 821.75 ------------------------------------------------------ [ 0, 1 ] 21648 2.047% 2.047% ( 1, 2 ] 566647 53.582% 55.629% ########### ( 2, 3 ] 244081 23.080% 78.710% ##### ( 3, 4 ] 103848 9.820% 88.530% ## ( 4, 6 ] 94579 8.943% 97.473% ## ( 6, 10 ] 18949 1.792% 99.265% ( 10, 15 ] 3599 0.340% 99.605% ( 15, 22 ] 405 0.038% 99.643% ( 22, 34 ] 28 0.003% 99.646% ( 34, 51 ] 32 0.003% 99.649% ( 51, 76 ] 31 0.003% 99.652% ( 76, 110 ] 178 0.017% 99.669% ( 110, 170 ] 427 0.040% 99.709% ( 170, 250 ] 519 0.049% 99.758% ( 250, 380 ] 756 0.071% 99.830% ( 380, 580 ] 944 0.089% 99.919% ( 580, 870 ] 900 0.085% 100.004% ( 870, 1300 ] 557 0.053% 100.057% ( 1300, 1900 ] 274 0.026% 100.083% ( 1900, 2900 ] 225 0.021% 100.104% ( 2900, 4400 ] 239 0.023% 100.127% ( 4400, 6600 ] 60 0.006% 100.132% ( 6600, 9900 ] 14 0.001% 100.134% ** Level 4 read latency histogram (micros): Count: 126501 Average: 12.0201 StdDev: 139.67 Min: 1 Median: 1.9388 Max: 7214 Percentiles: P50: 1.94 P75: 2.94 P99: 14.24 P99.9: 1823.16 P99.99: 3943.52 ------------------------------------------------------ [ 0, 1 ] 1987 1.571% 1.571% ( 1, 2 ] 65260 51.589% 53.159% ########## ( 2, 3 ] 29531 23.344% 76.504% ##### ( 3, 4 ] 12379 9.786% 86.289% ## ( 4, 6 ] 12442 9.835% 96.125% ## ( 6, 10 ] 3164 2.501% 98.626% # ( 10, 15 ] 558 0.441% 99.067% ( 15, 22 ] 53 0.042% 99.109% ( 22, 34 ] 5 0.004% 99.113% ( 34, 51 ] 5 0.004% 99.117% ( 51, 76 ] 2 0.002% 99.119% ( 76, 110 ] 20 0.016% 99.134% ( 110, 170 ] 81 0.064% 99.198% ( 170, 250 ] 99 0.078% 99.277% ( 250, 380 ] 112 0.089% 99.365% ( 380, 580 ] 203 0.160% 99.526% ( 580, 870 ] 224 0.177% 99.703% ( 870, 1300 ] 178 0.141% 99.843% ( 1300, 1900 ] 82 0.065% 99.908% ( 1900, 2900 ] 47 0.037% 99.945% ( 2900, 4400 ] 81 0.064% 100.009% ( 4400, 6600 ] 19 0.015% 100.025% ( 6600, 9900 ] 2 0.002% 100.026% ** Level 5 read latency histogram (micros): Count: 300 Average: 1165.4600 StdDev: 1315.04 Min: 47 Median: 580.0000 Max: 6567 Percentiles: P50: 580.00 P75: 1728.57 P99: 6000.00 P99.9: 6540.00 P99.99: 6567.00 ------------------------------------------------------ ( 34, 51 ] 1 0.333% 0.333% ( 51, 76 ] 1 0.333% 0.667% ( 76, 110 ] 12 4.000% 4.667% # ( 110, 170 ] 38 12.667% 17.333% ### ( 170, 250 ] 24 8.000% 25.333% ## ( 250, 380 ] 39 13.000% 38.333% ### ( 380, 580 ] 35 11.667% 50.000% ## ( 580, 870 ] 36 12.000% 62.000% ## ( 870, 1300 ] 24 8.000% 70.000% ## ( 1300, 1900 ] 21 7.000% 77.000% # ( 1900, 2900 ] 31 10.333% 87.333% ## ( 2900, 4400 ] 27 9.000% 96.333% ## ( 4400, 6600 ] 11 3.667% 100.000% # ** DB Stats ** Uptime(secs): 56.4 total, 3.3 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 191.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.524 H:M:S, 45.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 297.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.652 H:M:S, 19.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.156 micros/op 193936 ops/sec 60.071 seconds 11649999 operations; 187.9 MB/s Microseconds per write: Count: 11649999 Average: 5.1563 StdDev: 524.53 Min: 0 Median: 1.7734 Max: 830628 Percentiles: P50: 1.77 P75: 2.79 P99: 8.40 P99.9: 1007.18 P99.99: 2608.92 ------------------------------------------------------ [ 0, 1 ] 1300479 11.163% 11.163% ## ( 1, 2 ] 5850056 50.215% 61.378% ########## ( 2, 3 ] 2001782 17.183% 78.561% ### ( 3, 4 ] 1649954 14.163% 92.723% ### ( 4, 6 ] 662804 5.689% 98.413% # ( 6, 10 ] 114202 0.980% 99.393% ( 10, 15 ] 32386 0.278% 99.671% ( 15, 22 ] 8958 0.077% 99.748% ( 22, 34 ] 1932 0.017% 99.764% ( 34, 51 ] 229 0.002% 99.766% ( 51, 76 ] 35 0.000% 99.767% ( 76, 110 ] 8072 0.069% 99.836% ( 110, 170 ] 3253 0.028% 99.864% ( 170, 250 ] 353 0.003% 99.867% ( 250, 380 ] 130 0.001% 99.868% ( 380, 580 ] 29 0.000% 99.868% ( 580, 870 ] 27 0.000% 99.869% ( 870, 1300 ] 11498 0.099% 99.967% ( 1300, 1900 ] 32 0.000% 99.967% ( 1900, 2900 ] 3700 0.032% 99.999% ( 2900, 4400 ] 41 0.000% 100.000% ( 4400, 6600 ] 7 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 5 0.000% 100.000% ( 22000, 33000 ] 4 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 208162 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11649999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 12022798968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 562 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 27612459 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 34976512135 rocksdb.compact.write.bytes COUNT : 34771055437 rocksdb.flush.write.bytes COUNT : 12022391057 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 70 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 238 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11925497856 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4660224 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 35087968327 rocksdb.non.last.level.read.count COUNT : 8475535 rocksdb.block.checksum.compute.count COUNT : 8474481 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.429049 P95 : 3.896061 P99 : 6.498752 P100 : 830625.000000 COUNT : 11649999 SUM : 54537594 rocksdb.compaction.times.micros P50 : 1104375.000000 P95 : 4520000.000000 P99 : 14480000.000000 P100 : 17613317.000000 COUNT : 94 SUM : 153114654 rocksdb.compaction.times.cpu_micros P50 : 991612.903226 P95 : 3973333.333333 P99 : 14480000.000000 P100 : 16293650.000000 COUNT : 94 SUM : 130018731 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 701.117647 P95 : 3925.000000 P99 : 89350.000000 P100 : 266719.000000 COUNT : 159 SUM : 526191 rocksdb.compaction.outfile.sync.micros P50 : 1137.735849 P95 : 101342.105263 P99 : 157300.000000 P100 : 255596.000000 COUNT : 354 SUM : 6105453 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.698276 P95 : 1220.450000 P99 : 2738.333333 P100 : 5993.000000 COUNT : 297 SUM : 85552 rocksdb.table.open.io.micros P50 : 1431.868132 P95 : 8085.000000 P99 : 12939.857143 P100 : 15286.000000 COUNT : 562 SUM : 1276265 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.670762 P95 : 7.527087 P99 : 10.295422 P100 : 11938.000000 COUNT : 8472867 SUM : 50438284 rocksdb.read.block.get.micros P50 : 449.491525 P95 : 3870.000000 P99 : 6033.500000 P100 : 11770.000000 COUNT : 1124 SUM : 1056342 rocksdb.write.raw.block.micros P50 : 0.512207 P95 : 0.973194 P99 : 2.811911 P100 : 21791.000000 COUNT : 11333322 SUM : 23664656 rocksdb.numfiles.in.singlecompaction P50 : 3.294118 P95 : 5.680000 P99 : 14.133333 P100 : 16.000000 COUNT : 152 SUM : 564 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562967 P95 : 1182.645989 P99 : 2536.448445 P100 : 830367.000000 COUNT : 137078 SUM : 27625118 rocksdb.sst.read.micros P50 : 1.628685 P95 : 4.500531 P99 : 8.245666 P100 : 10121.000000 COUNT : 8475759 SUM : 33345807 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11649999 SUM : 12022798968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 219600.000000 P95 : 507722.222222 P99 : 929700.000000 P100 : 981635.000000 COUNT : 159 SUM : 37718677 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 363 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0