[2024-11-29 03:08:47.758841] Starting SPDK v25.01-pre git sha1 35cd3e84d / DPDK 24.11.0-rc4 initialization... [2024-11-29 03:08:47.758979] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1896222 ] Set seed to 1732846127755414 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-29 03:08:47.924309] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.11.0-rc4 is used. There is no support for it in SPDK. Enabled only for validation. [2024-11-29 03:08:47.974502] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-29 03:08:47.995724] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-29 03:08:47.995762] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1896222' to capture a snapshot of events at runtime. [2024-11-29 03:08:47.995774] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-29 03:08:47.995783] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-29 03:08:47.995792] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1896222 for offline analysis/debug. [2024-11-29 03:08:47.996319] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 29 03:08:52 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/29-03:08:55 ... thread 0: (1000000,1000000) ops and (355915.7,355915.7) ops/second in (2.809654,2.809654) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 629.97 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 348.8 2.35 2.12 12 0.196 0 0 0.0 0.0 L1 1/1 63.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 1.18 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 236.0 235.9 0.53 0.51 1 0.534 127K 44 0.0 0.0 L3 19/1 1.03 GB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 233.7 233.7 0.53 0.47 1 0.534 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1186/10 96.94 GB 0.0 0.2 0.2 0.1 1.0 1.0 0.5 1.3 73.4 313.2 3.42 3.10 14 0.244 254K 44 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.2 0.1 1.0 1.0 0.4 1.3 73.4 313.2 3.42 3.10 14 0.244 254K 44 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.2 0.1 0.2 0.2 0.0 0.0 234.9 234.8 1.07 0.98 2 0.534 254K 44 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 348.8 2.35 2.12 12 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.04 GB write, 354.69 MB/s write, 0.24 GB read, 83.16 MB/s read, 3.4 seconds Interval compaction: 1.04 GB write, 380.53 MB/s write, 0.24 GB read, 89.22 MB/s read, 3.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 117044 Average: 1.8855 StdDev: 10.85 Min: 1 Median: 1.2576 Max: 3057 Percentiles: P50: 1.26 P75: 1.70 P99: 5.01 P99.9: 9.74 P99.99: 18.15 ------------------------------------------------------ [ 0, 1 ] 41473 35.434% 35.434% ####### ( 1, 2 ] 66187 56.549% 91.983% ########### ( 2, 3 ] 5254 4.489% 96.471% # ( 3, 4 ] 2263 1.933% 98.405% ( 4, 6 ] 1377 1.176% 99.581% ( 6, 10 ] 401 0.343% 99.924% ( 10, 15 ] 73 0.062% 99.986% ( 15, 22 ] 14 0.012% 99.998% ( 22, 34 ] 1 0.001% 99.999% ( 51, 76 ] 2 0.002% 100.001% ( 110, 170 ] 7 0.006% 100.007% ( 170, 250 ] 6 0.005% 100.012% ( 250, 380 ] 7 0.006% 100.018% ( 580, 870 ] 2 0.002% 100.020% ( 1300, 1900 ] 1 0.001% 100.021% ( 2900, 4400 ] 1 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 5 Average: 1229.8000 StdDev: 839.48 Min: 435 Median: 797.5000 Max: 2492 Percentiles: P50: 797.50 P75: 2275.00 P99: 2492.00 P99.9: 2492.00 P99.99: 2492.00 ------------------------------------------------------ ( 380, 580 ] 1 20.000% 20.000% #### ( 580, 870 ] 2 40.000% 60.000% ######## ( 1900, 2900 ] 2 40.000% 100.000% ######## ** Level 2 read latency histogram (micros): Count: 31688 Average: 1.7125 StdDev: 5.54 Min: 1 Median: 1.1845 Max: 895 Percentiles: P50: 1.18 P75: 1.63 P99: 3.33 P99.9: 8.85 P99.99: 19.27 ------------------------------------------------------ [ 0, 1 ] 12547 39.595% 39.595% ######## ( 1, 2 ] 17867 56.384% 95.980% ########### ( 2, 3 ] 888 2.802% 98.782% # ( 3, 4 ] 208 0.656% 99.438% ( 4, 6 ] 110 0.347% 99.785% ( 6, 10 ] 51 0.161% 99.946% ( 10, 15 ] 12 0.038% 99.984% ( 15, 22 ] 3 0.009% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 9616 Average: 10.7636 StdDev: 145.48 Min: 0 Median: 1.7713 Max: 4649 Percentiles: P50: 1.77 P75: 2.52 P99: 9.48 P99.9: 2964.00 P99.99: 4484.48 ------------------------------------------------------ [ 0, 1 ] 480 4.992% 4.992% # ( 1, 2 ] 5611 58.351% 63.342% ############ ( 2, 3 ] 2165 22.515% 85.857% ##### ( 3, 4 ] 572 5.948% 91.805% # ( 4, 6 ] 571 5.938% 97.743% # ( 6, 10 ] 139 1.446% 99.189% ( 10, 15 ] 21 0.218% 99.407% ( 15, 22 ] 4 0.042% 99.449% ( 22, 34 ] 1 0.010% 99.459% ( 110, 170 ] 1 0.010% 99.470% ( 250, 380 ] 7 0.073% 99.542% ( 380, 580 ] 10 0.104% 99.646% ( 580, 870 ] 10 0.104% 99.750% ( 870, 1300 ] 3 0.031% 99.782% ( 1300, 1900 ] 4 0.042% 99.823% ( 1900, 2900 ] 7 0.073% 99.896% ( 2900, 4400 ] 9 0.094% 99.990% ( 4400, 6600 ] 1 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 1607.6400 StdDev: 1246.66 Min: 95 Median: 1146.4286 Max: 4144 Percentiles: P50: 1146.43 P75: 2483.33 P99: 4144.00 P99.9: 4144.00 P99.99: 4144.00 ------------------------------------------------------ ( 76, 110 ] 1 4.000% 4.000% # ( 110, 170 ] 1 4.000% 8.000% # ( 250, 380 ] 1 4.000% 12.000% # ( 380, 580 ] 2 8.000% 20.000% ## ( 580, 870 ] 3 12.000% 32.000% ## ( 870, 1300 ] 7 28.000% 60.000% ###### ( 1300, 1900 ] 2 8.000% 68.000% ## ( 1900, 2900 ] 3 12.000% 80.000% ## ( 2900, 4400 ] 5 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 326.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.206 H:M:S, 6.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 350.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.206 H:M:S, 7.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/29-03:08:58 ... thread 0: (1000000,2000000) ops and (326373.7,340505.2) ops/second in (3.063972,5.873626) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 107.0 0.9 0.0 0.9 2.6 1.8 0.0 1.5 103.1 316.6 8.55 7.94 29 0.295 895K 1014 0.0 0.0 L1 1/0 2.99 MB 0.3 0.3 0.2 0.1 0.3 0.2 0.2 1.2 241.4 241.1 1.30 1.26 1 1.305 319K 323 0.0 0.0 L2 2/1 55.26 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 236.0 235.9 0.53 0.51 1 0.534 127K 44 0.0 0.0 L3 20/11 1.17 GB 0.3 0.1 0.1 0.0 0.1 0.1 0.4 1.0 233.7 233.7 0.53 0.47 1 0.534 126K 0 0.0 0.0 L4 173/0 9.64 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 110.4 110.4 1.02 0.66 1 1.018 114K 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1246/16 97.92 GB 0.0 1.5 0.5 1.0 3.3 2.3 1.0 1.9 130.6 283.5 11.94 10.84 33 0.362 1584K 1381 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.5 1.0 3.3 2.3 0.9 1.9 130.6 283.5 11.94 10.84 33 0.362 1584K 1381 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.5 1.0 1.5 0.5 0.0 0.0 231.0 230.8 6.75 6.21 7 0.965 1584K 1381 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.1 5.19 4.63 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.31 GB write, 556.84 MB/s write, 1.52 GB read, 256.60 MB/s read, 11.9 seconds Interval compaction: 3.31 GB write, 576.25 MB/s write, 1.52 GB read, 265.54 MB/s read, 11.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 379093 Average: 2.1240 StdDev: 11.52 Min: 1 Median: 1.4477 Max: 4351 Percentiles: P50: 1.45 P75: 1.84 P99: 5.56 P99.9: 9.94 P99.99: 15.99 ------------------------------------------------------ [ 0, 1 ] 80167 21.147% 21.147% #### ( 1, 2 ] 244296 64.442% 85.589% ############# ( 2, 3 ] 32681 8.621% 94.210% ## ( 3, 4 ] 12356 3.259% 97.469% # ( 4, 6 ] 7417 1.957% 99.426% ( 6, 10 ] 1824 0.481% 99.907% ( 10, 15 ] 309 0.082% 99.989% ( 15, 22 ] 43 0.011% 100.000% ( 22, 34 ] 8 0.002% 100.002% ( 51, 76 ] 3 0.001% 100.003% ( 110, 170 ] 9 0.002% 100.005% ( 170, 250 ] 17 0.004% 100.010% ( 250, 380 ] 17 0.004% 100.014% ( 380, 580 ] 1 0.000% 100.015% ( 580, 870 ] 5 0.001% 100.016% ( 870, 1300 ] 3 0.001% 100.017% ( 1300, 1900 ] 3 0.001% 100.017% ( 1900, 2900 ] 1 0.000% 100.018% ( 2900, 4400 ] 2 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 25 Average: 424.8800 StdDev: 754.05 Min: 1 Median: 2.5000 Max: 2618 Percentiles: P50: 2.50 P75: 530.00 P99: 2618.00 P99.9: 2618.00 P99.99: 2618.00 ------------------------------------------------------ [ 0, 1 ] 6 24.000% 24.000% ##### ( 1, 2 ] 6 24.000% 48.000% ##### ( 2, 3 ] 1 4.000% 52.000% # ( 4, 6 ] 1 4.000% 56.000% # ( 110, 170 ] 1 4.000% 60.000% # ( 250, 380 ] 3 12.000% 72.000% ## ( 380, 580 ] 1 4.000% 76.000% # ( 580, 870 ] 3 12.000% 88.000% ## ( 1900, 2900 ] 3 12.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 31907 Average: 1.7191 StdDev: 5.52 Min: 1 Median: 1.1896 Max: 895 Percentiles: P50: 1.19 P75: 1.63 P99: 3.39 P99.9: 8.90 P99.99: 19.22 ------------------------------------------------------ [ 0, 1 ] 12547 39.324% 39.324% ######## ( 1, 2 ] 17970 56.320% 95.644% ########### ( 2, 3 ] 984 3.084% 98.728% # ( 3, 4 ] 223 0.699% 99.426% ( 4, 6 ] 112 0.351% 99.777% ( 6, 10 ] 54 0.169% 99.947% ( 10, 15 ] 12 0.038% 99.984% ( 15, 22 ] 3 0.009% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 202355 Average: 3.3564 StdDev: 36.83 Min: 0 Median: 1.6063 Max: 4649 Percentiles: P50: 1.61 P75: 2.04 P99: 8.78 P99.9: 183.65 P99.99: 627.47 ------------------------------------------------------ [ 0, 1 ] 25074 12.391% 12.391% ## ( 1, 2 ] 125525 62.032% 74.423% ############ ( 2, 3 ] 32470 16.046% 90.469% ### ( 3, 4 ] 8428 4.165% 94.634% # ( 4, 6 ] 6650 3.286% 97.920% # ( 6, 10 ] 3140 1.552% 99.472% ( 10, 15 ] 372 0.184% 99.656% ( 15, 22 ] 84 0.042% 99.698% ( 22, 34 ] 28 0.014% 99.711% ( 34, 51 ] 3 0.001% 99.713% ( 51, 76 ] 6 0.003% 99.716% ( 76, 110 ] 122 0.060% 99.776% ( 110, 170 ] 237 0.117% 99.893% ( 170, 250 ] 80 0.040% 99.933% ( 250, 380 ] 57 0.028% 99.961% ( 380, 580 ] 55 0.027% 99.988% ( 580, 870 ] 23 0.011% 100.000% ( 870, 1300 ] 9 0.004% 100.004% ( 1300, 1900 ] 9 0.004% 100.008% ( 1900, 2900 ] 9 0.004% 100.013% ( 2900, 4400 ] 10 0.005% 100.018% ( 4400, 6600 ] 1 0.000% 100.018% ** Level 4 read latency histogram (micros): Count: 310 Average: 133.6355 StdDev: 562.40 Min: 1 Median: 1.7445 Max: 4144 Percentiles: P50: 1.74 P75: 3.39 P99: 3470.00 P99.9: 4144.00 P99.99: 4144.00 ------------------------------------------------------ [ 0, 1 ] 53 17.097% 17.097% ### ( 1, 2 ] 137 44.194% 61.290% ######### ( 2, 3 ] 34 10.968% 72.258% ## ( 3, 4 ] 22 7.097% 79.355% # ( 4, 6 ] 20 6.452% 85.806% # ( 6, 10 ] 16 5.161% 90.968% # ( 15, 22 ] 1 0.323% 91.290% ( 76, 110 ] 1 0.323% 91.613% ( 110, 170 ] 2 0.645% 92.258% ( 250, 380 ] 2 0.645% 92.903% ( 380, 580 ] 2 0.645% 93.548% ( 580, 870 ] 3 0.968% 94.516% ( 870, 1300 ] 7 2.258% 96.774% ( 1300, 1900 ] 2 0.645% 97.419% ( 1900, 2900 ] 3 0.968% 98.387% ( 2900, 4400 ] 5 1.613% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.592 H:M:S, 9.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.386 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-03:09:01 ... thread 0: (1000000,3000000) ops and (326342.4,335649.6) ops/second in (3.064266,8.937892) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 2.34 GB 31.5 1.7 0.0 1.7 4.4 2.8 0.0 1.6 117.5 313.3 14.47 13.51 46 0.315 1727K 1847 0.0 0.0 L1 1/1 2.99 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 241.4 241.1 1.30 1.26 1 1.305 319K 323 0.0 0.0 L2 1/0 54.08 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 236.0 235.9 0.53 0.51 1 0.534 127K 44 0.0 0.0 L3 20/0 942.66 MB 0.9 1.0 0.1 0.9 1.0 0.1 0.4 8.4 242.4 242.1 4.36 4.00 2 2.179 1072K 1193 0.0 0.0 L4 173/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 110.4 110.4 1.02 0.66 1 1.018 114K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/14 98.90 GB 0.0 3.2 0.5 2.7 6.0 3.3 1.6 2.2 152.7 283.2 21.69 19.94 51 0.425 3361K 3407 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 0.5 2.7 6.0 3.3 1.5 2.2 152.7 283.2 21.69 19.94 51 0.425 3361K 3407 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 0.5 2.7 3.2 0.5 0.0 0.0 241.8 241.6 13.69 12.79 11 1.244 3361K 3407 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 354.5 8.00 7.14 40 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.00 GB write, 671.66 MB/s write, 3.23 GB read, 362.03 MB/s read, 21.7 seconds Interval compaction: 6.00 GB write, 687.05 MB/s write, 3.23 GB read, 370.32 MB/s read, 21.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 684426 Average: 2.1305 StdDev: 9.87 Min: 0 Median: 1.4622 Max: 4351 Percentiles: P50: 1.46 P75: 1.84 P99: 5.53 P99.9: 10.60 P99.99: 14.76 ------------------------------------------------------ [ 0, 1 ] 134144 19.599% 19.599% #### ( 1, 2 ] 450136 65.768% 85.368% ############# ( 2, 3 ] 61317 8.959% 94.327% ## ( 3, 4 ] 22365 3.268% 97.594% # ( 4, 6 ] 12591 1.840% 99.434% ( 6, 10 ] 3101 0.453% 99.887% ( 10, 15 ] 740 0.108% 99.995% ( 15, 22 ] 64 0.009% 100.005% ( 22, 34 ] 15 0.002% 100.007% ( 34, 51 ] 1 0.000% 100.007% ( 51, 76 ] 6 0.001% 100.008% ( 76, 110 ] 1 0.000% 100.008% ( 110, 170 ] 20 0.003% 100.011% ( 170, 250 ] 19 0.003% 100.014% ( 250, 380 ] 23 0.003% 100.017% ( 380, 580 ] 4 0.001% 100.018% ( 580, 870 ] 12 0.002% 100.019% ( 870, 1300 ] 9 0.001% 100.021% ( 1300, 1900 ] 4 0.001% 100.021% ( 1900, 2900 ] 1 0.000% 100.021% ( 2900, 4400 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 28299 Average: 2.9716 StdDev: 28.18 Min: 1 Median: 1.5033 Max: 2618 Percentiles: P50: 1.50 P75: 1.87 P99: 8.28 P99.9: 179.35 P99.99: 1956.70 ------------------------------------------------------ [ 0, 1 ] 4432 15.661% 15.661% ### ( 1, 2 ] 19307 68.225% 83.886% ############## ( 2, 3 ] 2699 9.537% 93.424% ## ( 3, 4 ] 819 2.894% 96.318% # ( 4, 6 ] 517 1.827% 98.145% ( 6, 10 ] 425 1.502% 99.647% ( 10, 15 ] 20 0.071% 99.717% ( 15, 22 ] 5 0.018% 99.735% ( 76, 110 ] 5 0.018% 99.753% ( 110, 170 ] 41 0.145% 99.898% ( 170, 250 ] 6 0.021% 99.919% ( 250, 380 ] 7 0.025% 99.943% ( 380, 580 ] 8 0.028% 99.972% ( 580, 870 ] 5 0.018% 99.989% ( 1900, 2900 ] 3 0.011% 100.000% ** Level 2 read latency histogram (micros): Count: 31987 Average: 1.7218 StdDev: 5.52 Min: 1 Median: 1.1914 Max: 895 Percentiles: P50: 1.19 P75: 1.64 P99: 3.42 P99.9: 8.91 P99.99: 19.20 ------------------------------------------------------ [ 0, 1 ] 12548 39.228% 39.228% ######## ( 1, 2 ] 18001 56.276% 95.504% ########### ( 2, 3 ] 1024 3.201% 98.706% # ( 3, 4 ] 225 0.703% 99.409% ( 4, 6 ] 117 0.366% 99.775% ( 6, 10 ] 55 0.172% 99.947% ( 10, 15 ] 12 0.038% 99.984% ( 15, 22 ] 3 0.009% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 236601 Average: 3.3588 StdDev: 34.86 Min: 0 Median: 1.6048 Max: 4649 Percentiles: P50: 1.60 P75: 2.01 P99: 8.85 P99.9: 199.74 P99.99: 693.78 ------------------------------------------------------ [ 0, 1 ] 28457 12.027% 12.027% ## ( 1, 2 ] 148558 62.788% 74.816% ############# ( 2, 3 ] 36519 15.435% 90.251% ### ( 3, 4 ] 10311 4.358% 94.609% # ( 4, 6 ] 7710 3.259% 97.867% # ( 6, 10 ] 3759 1.589% 99.456% ( 10, 15 ] 420 0.178% 99.634% ( 15, 22 ] 88 0.037% 99.671% ( 22, 34 ] 28 0.012% 99.683% ( 34, 51 ] 3 0.001% 99.684% ( 51, 76 ] 6 0.003% 99.686% ( 76, 110 ] 159 0.067% 99.754% ( 110, 170 ] 307 0.130% 99.883% ( 170, 250 ] 106 0.045% 99.928% ( 250, 380 ] 68 0.029% 99.957% ( 380, 580 ] 65 0.027% 99.984% ( 580, 870 ] 34 0.014% 99.999% ( 870, 1300 ] 11 0.005% 100.003% ( 1300, 1900 ] 9 0.004% 100.007% ( 1900, 2900 ] 9 0.004% 100.011% ( 2900, 4400 ] 10 0.004% 100.015% ( 4400, 6600 ] 1 0.000% 100.016% ** Level 4 read latency histogram (micros): Count: 310 Average: 133.6355 StdDev: 562.40 Min: 1 Median: 1.7445 Max: 4144 Percentiles: P50: 1.74 P75: 3.39 P99: 3470.00 P99.9: 4144.00 P99.99: 4144.00 ------------------------------------------------------ [ 0, 1 ] 53 17.097% 17.097% ### ( 1, 2 ] 137 44.194% 61.290% ######### ( 2, 3 ] 34 10.968% 72.258% ## ( 3, 4 ] 22 7.097% 79.355% # ( 4, 6 ] 20 6.452% 85.806% # ( 6, 10 ] 16 5.161% 90.968% # ( 15, 22 ] 1 0.323% 91.290% ( 76, 110 ] 1 0.323% 91.613% ( 110, 170 ] 2 0.645% 92.258% ( 250, 380 ] 2 0.645% 92.903% ( 380, 580 ] 2 0.645% 93.548% ( 580, 870 ] 3 0.968% 94.516% ( 870, 1300 ] 7 2.258% 96.774% ( 1300, 1900 ] 2 0.645% 97.419% ( 1900, 2900 ] 3 0.968% 98.387% ( 2900, 4400 ] 5 1.613% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 784.0500 StdDev: 965.63 Min: 79 Median: 380.0000 Max: 3235 Percentiles: P50: 380.00 P75: 725.00 P99: 3235.00 P99.9: 3235.00 P99.99: 3235.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 4 20.000% 45.000% #### ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 4 20.000% 70.000% #### ( 580, 870 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.1 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.005 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.412 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-03:09:04 ... thread 0: (1000000,4000000) ops and (290753.6,323174.1) ops/second in (3.439338,12.377230) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.32 GB 138.4 2.8 0.0 2.8 6.5 3.7 0.0 1.7 131.6 309.8 21.54 20.21 65 0.331 2878K 3072 0.0 0.0 L1 1/1 2.99 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 241.4 241.1 1.30 1.26 1 1.305 319K 323 0.0 0.0 L2 1/0 54.08 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 236.0 235.9 0.53 0.51 1 0.534 127K 44 0.0 0.0 L3 20/0 942.66 MB 0.9 1.0 0.1 0.9 1.0 0.1 0.4 8.4 242.4 242.1 4.36 4.00 2 2.179 1072K 1193 0.0 0.0 L4 173/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 110.4 110.4 1.02 0.66 1 1.018 114K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/14 99.88 GB 0.0 4.3 0.5 3.8 8.1 4.3 1.6 2.2 154.6 288.0 28.76 26.64 70 0.411 4513K 4632 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 0.5 3.8 8.1 4.3 1.5 2.2 154.6 288.0 28.76 26.64 70 0.411 4513K 4632 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 0.5 3.8 4.3 0.5 0.0 0.0 247.8 247.6 17.93 16.97 15 1.196 4513K 4632 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 355.1 10.82 9.67 55 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.6 total, 12.4 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.09 GB write, 658.20 MB/s write, 4.34 GB read, 353.20 MB/s read, 28.8 seconds Interval compaction: 8.09 GB write, 669.09 MB/s write, 4.34 GB read, 359.04 MB/s read, 28.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 15, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1180390 Average: 2.1774 StdDev: 9.75 Min: 0 Median: 1.4886 Max: 4351 Percentiles: P50: 1.49 P75: 1.86 P99: 5.59 P99.9: 10.30 P99.99: 14.02 ------------------------------------------------------ [ 0, 1 ] 202672 17.170% 17.170% ### ( 1, 2 ] 793118 67.191% 84.361% ############# ( 2, 3 ] 113783 9.639% 94.001% ## ( 3, 4 ] 41619 3.526% 97.526% # ( 4, 6 ] 21887 1.854% 99.381% ( 6, 10 ] 6047 0.512% 99.893% ( 10, 15 ] 1428 0.121% 100.014% ( 15, 22 ] 119 0.010% 100.024% ( 22, 34 ] 18 0.002% 100.026% ( 34, 51 ] 2 0.000% 100.026% ( 51, 76 ] 8 0.001% 100.026% ( 76, 110 ] 21 0.002% 100.028% ( 110, 170 ] 74 0.006% 100.034% ( 170, 250 ] 46 0.004% 100.038% ( 250, 380 ] 37 0.003% 100.041% ( 380, 580 ] 14 0.001% 100.043% ( 580, 870 ] 23 0.002% 100.045% ( 870, 1300 ] 14 0.001% 100.046% ( 1300, 1900 ] 4 0.000% 100.046% ( 1900, 2900 ] 1 0.000% 100.046% ( 2900, 4400 ] 4 0.000% 100.047% ** Level 1 read latency histogram (micros): Count: 28299 Average: 2.9716 StdDev: 28.18 Min: 1 Median: 1.5033 Max: 2618 Percentiles: P50: 1.50 P75: 1.87 P99: 8.28 P99.9: 179.35 P99.99: 1956.70 ------------------------------------------------------ [ 0, 1 ] 4432 15.661% 15.661% ### ( 1, 2 ] 19307 68.225% 83.886% ############## ( 2, 3 ] 2699 9.537% 93.424% ## ( 3, 4 ] 819 2.894% 96.318% # ( 4, 6 ] 517 1.827% 98.145% ( 6, 10 ] 425 1.502% 99.647% ( 10, 15 ] 20 0.071% 99.717% ( 15, 22 ] 5 0.018% 99.735% ( 76, 110 ] 5 0.018% 99.753% ( 110, 170 ] 41 0.145% 99.898% ( 170, 250 ] 6 0.021% 99.919% ( 250, 380 ] 7 0.025% 99.943% ( 380, 580 ] 8 0.028% 99.972% ( 580, 870 ] 5 0.018% 99.989% ( 1900, 2900 ] 3 0.011% 100.000% ** Level 2 read latency histogram (micros): Count: 31987 Average: 1.7218 StdDev: 5.52 Min: 1 Median: 1.1914 Max: 895 Percentiles: P50: 1.19 P75: 1.64 P99: 3.42 P99.9: 8.91 P99.99: 19.20 ------------------------------------------------------ [ 0, 1 ] 12548 39.228% 39.228% ######## ( 1, 2 ] 18001 56.276% 95.504% ########### ( 2, 3 ] 1024 3.201% 98.706% # ( 3, 4 ] 225 0.703% 99.409% ( 4, 6 ] 117 0.366% 99.775% ( 6, 10 ] 55 0.172% 99.947% ( 10, 15 ] 12 0.038% 99.984% ( 15, 22 ] 3 0.009% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 236601 Average: 3.3588 StdDev: 34.86 Min: 0 Median: 1.6048 Max: 4649 Percentiles: P50: 1.60 P75: 2.01 P99: 8.85 P99.9: 199.74 P99.99: 693.78 ------------------------------------------------------ [ 0, 1 ] 28457 12.027% 12.027% ## ( 1, 2 ] 148558 62.788% 74.816% ############# ( 2, 3 ] 36519 15.435% 90.251% ### ( 3, 4 ] 10311 4.358% 94.609% # ( 4, 6 ] 7710 3.259% 97.867% # ( 6, 10 ] 3759 1.589% 99.456% ( 10, 15 ] 420 0.178% 99.634% ( 15, 22 ] 88 0.037% 99.671% ( 22, 34 ] 28 0.012% 99.683% ( 34, 51 ] 3 0.001% 99.684% ( 51, 76 ] 6 0.003% 99.686% ( 76, 110 ] 159 0.067% 99.754% ( 110, 170 ] 307 0.130% 99.883% ( 170, 250 ] 106 0.045% 99.928% ( 250, 380 ] 68 0.029% 99.957% ( 380, 580 ] 65 0.027% 99.984% ( 580, 870 ] 34 0.014% 99.999% ( 870, 1300 ] 11 0.005% 100.003% ( 1300, 1900 ] 9 0.004% 100.007% ( 1900, 2900 ] 9 0.004% 100.011% ( 2900, 4400 ] 10 0.004% 100.015% ( 4400, 6600 ] 1 0.000% 100.016% ** Level 4 read latency histogram (micros): Count: 310 Average: 133.6355 StdDev: 562.40 Min: 1 Median: 1.7445 Max: 4144 Percentiles: P50: 1.74 P75: 3.39 P99: 3470.00 P99.9: 4144.00 P99.99: 4144.00 ------------------------------------------------------ [ 0, 1 ] 53 17.097% 17.097% ### ( 1, 2 ] 137 44.194% 61.290% ######### ( 2, 3 ] 34 10.968% 72.258% ## ( 3, 4 ] 22 7.097% 79.355% # ( 4, 6 ] 20 6.452% 85.806% # ( 6, 10 ] 16 5.161% 90.968% # ( 15, 22 ] 1 0.323% 91.290% ( 76, 110 ] 1 0.323% 91.613% ( 110, 170 ] 2 0.645% 92.258% ( 250, 380 ] 2 0.645% 92.903% ( 380, 580 ] 2 0.645% 93.548% ( 580, 870 ] 3 0.968% 94.516% ( 870, 1300 ] 7 2.258% 96.774% ( 1300, 1900 ] 2 0.645% 97.419% ( 1900, 2900 ] 3 0.968% 98.387% ( 2900, 4400 ] 5 1.613% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 784.0500 StdDev: 965.63 Min: 79 Median: 380.0000 Max: 3235 Percentiles: P50: 380.00 P75: 725.00 P99: 3235.00 P99.9: 3235.00 P99.99: 3235.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 4 20.000% 45.000% #### ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 4 20.000% 70.000% #### ( 580, 870 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.6 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 312.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.804 H:M:S, 14.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.800 H:M:S, 23.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-03:09:08 ... thread 0: (1000000,5000000) ops and (281355.6,313844.6) ops/second in (3.554221,15.931451) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.52 GB 232.9 3.5 0.0 3.5 8.2 4.7 0.0 1.7 133.0 310.1 27.00 25.33 83 0.325 3646K 3779 0.0 0.0 L1 15/0 1.71 GB 175.1 2.0 2.0 0.1 2.0 2.0 0.2 1.0 231.5 229.9 8.99 8.74 2 4.493 2112K 14K 0.0 0.0 L2 1/0 54.08 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 236.0 235.9 0.53 0.51 1 0.534 127K 44 0.0 0.0 L3 20/0 942.66 MB 0.9 1.0 0.1 0.9 1.0 0.1 0.4 8.4 242.4 242.1 4.36 4.00 2 2.179 1072K 1193 0.0 0.0 L4 173/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 110.4 110.4 1.02 0.66 1 1.018 114K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/4 100.79 GB 0.0 6.8 2.3 4.5 11.5 6.9 1.6 2.5 166.2 280.0 41.90 39.24 89 0.471 7073K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.8 2.3 4.5 11.5 6.9 1.5 2.5 166.2 280.0 41.90 39.24 89 0.471 7073K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.8 2.3 4.5 6.8 2.2 0.0 0.0 244.9 244.3 28.44 27.22 19 1.497 7073K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.7 13.46 12.02 70 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.1 total, 15.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.46 GB write, 727.11 MB/s write, 6.80 GB read, 431.63 MB/s read, 41.9 seconds Interval compaction: 11.46 GB write, 736.45 MB/s write, 6.80 GB read, 437.18 MB/s read, 41.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 15, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1510148 Average: 2.1500 StdDev: 10.05 Min: 0 Median: 1.4645 Max: 4351 Percentiles: P50: 1.46 P75: 1.84 P99: 5.57 P99.9: 10.43 P99.99: 14.37 ------------------------------------------------------ [ 0, 1 ] 288114 19.079% 19.079% #### ( 1, 2 ] 1005196 66.563% 85.641% ############# ( 2, 3 ] 133106 8.814% 94.455% ## ( 3, 4 ] 48594 3.218% 97.673% # ( 4, 6 ] 25540 1.691% 99.364% ( 6, 10 ] 7939 0.526% 99.890% ( 10, 15 ] 1725 0.114% 100.004% ( 15, 22 ] 134 0.009% 100.013% ( 22, 34 ] 22 0.001% 100.015% ( 34, 51 ] 2 0.000% 100.015% ( 51, 76 ] 9 0.001% 100.015% ( 76, 110 ] 49 0.003% 100.019% ( 110, 170 ] 130 0.009% 100.027% ( 170, 250 ] 69 0.005% 100.032% ( 250, 380 ] 56 0.004% 100.036% ( 380, 580 ] 27 0.002% 100.037% ( 580, 870 ] 31 0.002% 100.039% ( 870, 1300 ] 16 0.001% 100.040% ( 1300, 1900 ] 6 0.000% 100.041% ( 1900, 2900 ] 2 0.000% 100.041% ( 2900, 4400 ] 5 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 29132 Average: 4.0726 StdDev: 40.67 Min: 0 Median: 1.5033 Max: 2618 Percentiles: P50: 1.50 P75: 1.87 P99: 9.10 P99.9: 538.68 P99.99: 1928.93 ------------------------------------------------------ [ 0, 1 ] 4604 15.804% 15.804% ### ( 1, 2 ] 19795 67.949% 83.753% ############## ( 2, 3 ] 2744 9.419% 93.172% ## ( 3, 4 ] 834 2.863% 96.035% # ( 4, 6 ] 526 1.806% 97.841% ( 6, 10 ] 436 1.497% 99.337% ( 10, 15 ] 20 0.069% 99.406% ( 15, 22 ] 5 0.017% 99.423% ( 51, 76 ] 1 0.003% 99.427% ( 76, 110 ] 29 0.100% 99.526% ( 110, 170 ] 67 0.230% 99.756% ( 170, 250 ] 11 0.038% 99.794% ( 250, 380 ] 15 0.051% 99.846% ( 380, 580 ] 20 0.069% 99.914% ( 580, 870 ] 10 0.034% 99.949% ( 870, 1300 ] 6 0.021% 99.969% ( 1300, 1900 ] 6 0.021% 99.990% ( 1900, 2900 ] 3 0.010% 100.000% ** Level 2 read latency histogram (micros): Count: 31987 Average: 1.7218 StdDev: 5.52 Min: 1 Median: 1.1914 Max: 895 Percentiles: P50: 1.19 P75: 1.64 P99: 3.42 P99.9: 8.91 P99.99: 19.20 ------------------------------------------------------ [ 0, 1 ] 12548 39.228% 39.228% ######## ( 1, 2 ] 18001 56.276% 95.504% ########### ( 2, 3 ] 1024 3.201% 98.706% # ( 3, 4 ] 225 0.703% 99.409% ( 4, 6 ] 117 0.366% 99.775% ( 6, 10 ] 55 0.172% 99.947% ( 10, 15 ] 12 0.038% 99.984% ( 15, 22 ] 3 0.009% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 236601 Average: 3.3588 StdDev: 34.86 Min: 0 Median: 1.6048 Max: 4649 Percentiles: P50: 1.60 P75: 2.01 P99: 8.85 P99.9: 199.74 P99.99: 693.78 ------------------------------------------------------ [ 0, 1 ] 28457 12.027% 12.027% ## ( 1, 2 ] 148558 62.788% 74.816% ############# ( 2, 3 ] 36519 15.435% 90.251% ### ( 3, 4 ] 10311 4.358% 94.609% # ( 4, 6 ] 7710 3.259% 97.867% # ( 6, 10 ] 3759 1.589% 99.456% ( 10, 15 ] 420 0.178% 99.634% ( 15, 22 ] 88 0.037% 99.671% ( 22, 34 ] 28 0.012% 99.683% ( 34, 51 ] 3 0.001% 99.684% ( 51, 76 ] 6 0.003% 99.686% ( 76, 110 ] 159 0.067% 99.754% ( 110, 170 ] 307 0.130% 99.883% ( 170, 250 ] 106 0.045% 99.928% ( 250, 380 ] 68 0.029% 99.957% ( 380, 580 ] 65 0.027% 99.984% ( 580, 870 ] 34 0.014% 99.999% ( 870, 1300 ] 11 0.005% 100.003% ( 1300, 1900 ] 9 0.004% 100.007% ( 1900, 2900 ] 9 0.004% 100.011% ( 2900, 4400 ] 10 0.004% 100.015% ( 4400, 6600 ] 1 0.000% 100.016% ** Level 4 read latency histogram (micros): Count: 310 Average: 133.6355 StdDev: 562.40 Min: 1 Median: 1.7445 Max: 4144 Percentiles: P50: 1.74 P75: 3.39 P99: 3470.00 P99.9: 4144.00 P99.99: 4144.00 ------------------------------------------------------ [ 0, 1 ] 53 17.097% 17.097% ### ( 1, 2 ] 137 44.194% 61.290% ######### ( 2, 3 ] 34 10.968% 72.258% ## ( 3, 4 ] 22 7.097% 79.355% # ( 4, 6 ] 20 6.452% 85.806% # ( 6, 10 ] 16 5.161% 90.968% # ( 15, 22 ] 1 0.323% 91.290% ( 76, 110 ] 1 0.323% 91.613% ( 110, 170 ] 2 0.645% 92.258% ( 250, 380 ] 2 0.645% 92.903% ( 380, 580 ] 2 0.645% 93.548% ( 580, 870 ] 3 0.968% 94.516% ( 870, 1300 ] 7 2.258% 96.774% ( 1300, 1900 ] 2 0.645% 97.419% ( 1900, 2900 ] 3 0.968% 98.387% ( 2900, 4400 ] 5 1.613% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 784.0500 StdDev: 965.63 Min: 79 Median: 380.0000 Max: 3235 Percentiles: P50: 380.00 P75: 725.00 P99: 3235.00 P99.9: 3235.00 P99.99: 3235.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 4 20.000% 45.000% #### ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 4 20.000% 70.000% #### ( 580, 870 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 16.1 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 304.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.768 H:M:S, 17.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 276.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.963 H:M:S, 27.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-03:09:14 ... thread 0: (1000000,6000000) ops and (148829.1,264894.0) ops/second in (6.719117,22.650568) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.57 GB 69.3 4.5 0.0 4.5 10.2 5.7 0.0 1.8 136.2 309.6 33.76 31.70 102 0.331 4669K 4731 0.0 0.0 L1 15/15 1.71 GB 0.0 2.0 2.0 0.1 2.0 2.0 0.2 1.0 231.5 229.9 8.99 8.74 2 4.493 2112K 14K 0.0 0.0 L2 1/0 54.08 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.5 2.0 236.0 235.9 0.53 0.51 1 0.534 127K 44 0.0 0.0 L3 20/0 942.66 MB 0.9 1.0 0.1 0.9 1.0 0.1 0.4 8.4 242.4 242.1 4.36 4.00 2 2.179 1072K 1193 0.0 0.0 L4 173/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 110.4 110.4 1.02 0.66 1 1.018 114K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/29 101.84 GB 0.0 7.8 2.3 5.5 13.5 8.0 1.6 2.4 163.9 283.9 48.66 45.61 108 0.451 8096K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.8 2.3 5.5 13.5 8.0 1.5 2.4 163.9 283.9 48.66 45.61 108 0.451 8096K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.8 2.3 5.5 7.8 2.2 0.0 0.0 247.4 246.8 32.23 30.95 23 1.401 8096K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 356.7 16.43 14.66 85 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.9 total, 22.7 interval Flush(GB): cumulative 5.722, interval 5.722 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.49 GB write, 604.26 MB/s write, 7.79 GB read, 348.84 MB/s read, 48.7 seconds Interval compaction: 13.49 GB write, 609.73 MB/s write, 7.79 GB read, 352.00 MB/s read, 48.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 19, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1934953 Average: 2.1259 StdDev: 9.90 Min: 0 Median: 1.4420 Max: 4351 Percentiles: P50: 1.44 P75: 1.82 P99: 5.48 P99.9: 11.07 P99.99: 16.52 ------------------------------------------------------ [ 0, 1 ] 402410 20.797% 20.797% #### ( 1, 2 ] 1278401 66.069% 86.866% ############# ( 2, 3 ] 156212 8.073% 94.939% ## ( 3, 4 ] 56597 2.925% 97.864% # ( 4, 6 ] 29665 1.533% 99.397% ( 6, 10 ] 9269 0.479% 99.876% ( 10, 15 ] 2159 0.112% 99.988% ( 15, 22 ] 214 0.011% 99.999% ( 22, 34 ] 22 0.001% 100.000% ( 34, 51 ] 4 0.000% 100.000% ( 51, 76 ] 17 0.001% 100.001% ( 76, 110 ] 168 0.009% 100.010% ( 110, 170 ] 219 0.011% 100.021% ( 170, 250 ] 93 0.005% 100.026% ( 250, 380 ] 83 0.004% 100.030% ( 380, 580 ] 48 0.002% 100.032% ( 580, 870 ] 40 0.002% 100.035% ( 870, 1300 ] 20 0.001% 100.036% ( 1300, 1900 ] 10 0.001% 100.036% ( 1900, 2900 ] 3 0.000% 100.036% ( 2900, 4400 ] 5 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 152809 Average: 2.5240 StdDev: 19.40 Min: 0 Median: 1.3528 Max: 2618 Percentiles: P50: 1.35 P75: 1.76 P99: 7.45 P99.9: 150.97 P99.99: 962.40 ------------------------------------------------------ [ 0, 1 ] 43048 28.171% 28.171% ###### ( 1, 2 ] 94539 61.867% 90.039% ############ ( 2, 3 ] 8091 5.295% 95.333% # ( 3, 4 ] 2708 1.772% 97.106% ( 4, 6 ] 2387 1.562% 98.668% ( 6, 10 ] 1399 0.916% 99.583% ( 10, 15 ] 165 0.108% 99.691% ( 15, 22 ] 46 0.030% 99.721% ( 22, 34 ] 1 0.001% 99.722% ( 51, 76 ] 27 0.018% 99.740% ( 76, 110 ] 153 0.100% 99.840% ( 110, 170 ] 135 0.088% 99.928% ( 170, 250 ] 30 0.020% 99.948% ( 250, 380 ] 22 0.014% 99.962% ( 380, 580 ] 29 0.019% 99.981% ( 580, 870 ] 12 0.008% 99.989% ( 870, 1300 ] 8 0.005% 99.994% ( 1300, 1900 ] 6 0.004% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31987 Average: 1.7218 StdDev: 5.52 Min: 1 Median: 1.1914 Max: 895 Percentiles: P50: 1.19 P75: 1.64 P99: 3.42 P99.9: 8.91 P99.99: 19.20 ------------------------------------------------------ [ 0, 1 ] 12548 39.228% 39.228% ######## ( 1, 2 ] 18001 56.276% 95.504% ########### ( 2, 3 ] 1024 3.201% 98.706% # ( 3, 4 ] 225 0.703% 99.409% ( 4, 6 ] 117 0.366% 99.775% ( 6, 10 ] 55 0.172% 99.947% ( 10, 15 ] 12 0.038% 99.984% ( 15, 22 ] 3 0.009% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 236601 Average: 3.3588 StdDev: 34.86 Min: 0 Median: 1.6048 Max: 4649 Percentiles: P50: 1.60 P75: 2.01 P99: 8.85 P99.9: 199.74 P99.99: 693.78 ------------------------------------------------------ [ 0, 1 ] 28457 12.027% 12.027% ## ( 1, 2 ] 148558 62.788% 74.816% ############# ( 2, 3 ] 36519 15.435% 90.251% ### ( 3, 4 ] 10311 4.358% 94.609% # ( 4, 6 ] 7710 3.259% 97.867% # ( 6, 10 ] 3759 1.589% 99.456% ( 10, 15 ] 420 0.178% 99.634% ( 15, 22 ] 88 0.037% 99.671% ( 22, 34 ] 28 0.012% 99.683% ( 34, 51 ] 3 0.001% 99.684% ( 51, 76 ] 6 0.003% 99.686% ( 76, 110 ] 159 0.067% 99.754% ( 110, 170 ] 307 0.130% 99.883% ( 170, 250 ] 106 0.045% 99.928% ( 250, 380 ] 68 0.029% 99.957% ( 380, 580 ] 65 0.027% 99.984% ( 580, 870 ] 34 0.014% 99.999% ( 870, 1300 ] 11 0.005% 100.003% ( 1300, 1900 ] 9 0.004% 100.007% ( 1900, 2900 ] 9 0.004% 100.011% ( 2900, 4400 ] 10 0.004% 100.015% ( 4400, 6600 ] 1 0.000% 100.016% ** Level 4 read latency histogram (micros): Count: 310 Average: 133.6355 StdDev: 562.40 Min: 1 Median: 1.7445 Max: 4144 Percentiles: P50: 1.74 P75: 3.39 P99: 3470.00 P99.9: 4144.00 P99.99: 4144.00 ------------------------------------------------------ [ 0, 1 ] 53 17.097% 17.097% ### ( 1, 2 ] 137 44.194% 61.290% ######### ( 2, 3 ] 34 10.968% 72.258% ## ( 3, 4 ] 22 7.097% 79.355% # ( 4, 6 ] 20 6.452% 85.806% # ( 6, 10 ] 16 5.161% 90.968% # ( 15, 22 ] 1 0.323% 91.290% ( 76, 110 ] 1 0.323% 91.613% ( 110, 170 ] 2 0.645% 92.258% ( 250, 380 ] 2 0.645% 92.903% ( 380, 580 ] 2 0.645% 93.548% ( 580, 870 ] 3 0.968% 94.516% ( 870, 1300 ] 7 2.258% 96.774% ( 1300, 1900 ] 2 0.645% 97.419% ( 1900, 2900 ] 3 0.968% 98.387% ( 2900, 4400 ] 5 1.613% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 784.0500 StdDev: 965.63 Min: 79 Median: 380.0000 Max: 3235 Percentiles: P50: 380.00 P75: 725.00 P99: 3235.00 P99.9: 3235.00 P99.99: 3235.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 4 20.000% 45.000% #### ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 4 20.000% 70.000% #### ( 580, 870 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 22.9 total, 6.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 258.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.680 H:M:S, 29.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 146.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.912 H:M:S, 58.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/29-03:09:35 ... thread 0: (1000000,7000000) ops and (49290.7,163024.3) ops/second in (20.287814,42.938382) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.54 GB 132.2 5.0 0.0 5.0 11.6 6.6 0.0 1.8 132.5 305.3 38.98 36.33 117 0.333 5245K 5348 0.0 0.0 L1 0/0 0.00 KB 0.0 6.6 4.9 1.8 6.5 4.8 0.2 1.3 221.7 218.2 30.63 28.26 3 10.210 6894K 107K 0.0 0.0 L2 34/29 3.71 GB 4.1 1.0 0.9 0.1 1.0 0.9 4.2 1.1 221.7 221.1 4.60 4.38 2 2.299 182K 44 0.0 0.0 L3 27/9 1.52 GB 1.3 1.7 0.6 1.0 1.7 0.6 0.7 2.6 230.8 230.4 7.37 6.80 3 2.455 1726K 2904 0.0 0.0 L4 173/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 110.4 110.4 1.02 0.66 1 1.018 114K 0 0.0 0.0 L5 1048/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/42 102.60 GB 0.0 14.4 6.5 8.0 20.9 12.9 6.2 3.2 179.0 259.2 82.59 76.42 126 0.655 14M 115K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.4 6.5 8.0 20.9 12.9 6.1 3.2 179.0 259.2 82.59 76.42 126 0.655 14M 115K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.4 6.5 8.0 14.3 6.4 0.0 0.0 233.7 231.8 63.27 59.36 28 2.260 14M 115K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 349.0 19.32 17.06 98 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.1 total, 42.9 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.91 GB write, 496.22 MB/s write, 14.44 GB read, 342.73 MB/s read, 82.6 seconds Interval compaction: 20.91 GB write, 498.58 MB/s write, 14.44 GB read, 344.36 MB/s read, 82.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 22, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2659744 Average: 2.6797 StdDev: 16.85 Min: 0 Median: 1.4206 Max: 4351 Percentiles: P50: 1.42 P75: 1.81 P99: 6.21 P99.9: 148.36 P99.99: 305.22 ------------------------------------------------------ [ 0, 1 ] 613612 23.070% 23.070% ##### ( 1, 2 ] 1702940 64.026% 87.097% ############# ( 2, 3 ] 192616 7.242% 94.339% # ( 3, 4 ] 75301 2.831% 97.170% # ( 4, 6 ] 48023 1.806% 98.975% ( 6, 10 ] 12596 0.474% 99.449% ( 10, 15 ] 3152 0.119% 99.567% ( 15, 22 ] 478 0.018% 99.585% ( 22, 34 ] 25 0.001% 99.586% ( 34, 51 ] 5 0.000% 99.587% ( 51, 76 ] 220 0.008% 99.595% ( 76, 110 ] 5386 0.203% 99.797% ( 110, 170 ] 4271 0.161% 99.958% ( 170, 250 ] 633 0.024% 99.982% ( 250, 380 ] 518 0.019% 100.001% ( 380, 580 ] 450 0.017% 100.018% ( 580, 870 ] 139 0.005% 100.023% ( 870, 1300 ] 35 0.001% 100.025% ( 1300, 1900 ] 16 0.001% 100.025% ( 1900, 2900 ] 16 0.001% 100.026% ( 2900, 4400 ] 18 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 1190359 Average: 3.0531 StdDev: 21.15 Min: 0 Median: 1.5674 Max: 4177 Percentiles: P50: 1.57 P75: 1.98 P99: 8.13 P99.9: 100.73 P99.99: 140.93 ------------------------------------------------------ [ 0, 1 ] 188986 15.876% 15.876% ### ( 1, 2 ] 715830 60.136% 76.012% ############ ( 2, 3 ] 156396 13.139% 89.151% ### ( 3, 4 ] 59300 4.982% 94.132% # ( 4, 6 ] 50323 4.228% 98.360% # ( 6, 10 ] 14287 1.200% 99.560% ( 10, 15 ] 2424 0.204% 99.764% ( 15, 22 ] 399 0.034% 99.797% ( 22, 34 ] 9 0.001% 99.798% ( 34, 51 ] 2 0.000% 99.798% ( 51, 76 ] 86 0.007% 99.805% ( 76, 110 ] 1549 0.130% 99.935% ( 110, 170 ] 1259 0.106% 100.041% ( 170, 250 ] 317 0.027% 100.068% ( 250, 380 ] 280 0.024% 100.091% ( 380, 580 ] 308 0.026% 100.117% ( 580, 870 ] 169 0.014% 100.131% ( 870, 1300 ] 70 0.006% 100.137% ( 1300, 1900 ] 32 0.003% 100.140% ( 1900, 2900 ] 14 0.001% 100.141% ( 2900, 4400 ] 7 0.001% 100.142% ** Level 2 read latency histogram (micros): Count: 39534 Average: 2.5316 StdDev: 26.10 Min: 1 Median: 1.3339 Max: 2950 Percentiles: P50: 1.33 P75: 1.79 P99: 5.78 P99.9: 13.10 P99.99: 348.26 ------------------------------------------------------ [ 0, 1 ] 12603 31.879% 31.879% ###### ( 1, 2 ] 21453 54.265% 86.144% ########### ( 2, 3 ] 3101 7.844% 93.987% ## ( 3, 4 ] 1056 2.671% 96.659% # ( 4, 6 ] 1039 2.628% 99.287% # ( 6, 10 ] 209 0.529% 99.815% ( 10, 15 ] 54 0.137% 99.952% ( 15, 22 ] 5 0.013% 99.965% ( 110, 170 ] 1 0.003% 99.967% ( 170, 250 ] 3 0.008% 99.975% ( 250, 380 ] 8 0.020% 99.995% ( 380, 580 ] 4 0.010% 100.005% ( 580, 870 ] 5 0.013% 100.018% ( 870, 1300 ] 7 0.018% 100.035% ( 1300, 1900 ] 3 0.008% 100.043% ( 2900, 4400 ] 1 0.003% 100.046% ** Level 3 read latency histogram (micros): Count: 247994 Average: 4.3615 StdDev: 59.47 Min: 0 Median: 1.6183 Max: 6040 Percentiles: P50: 1.62 P75: 2.08 P99: 9.04 P99.9: 402.93 P99.99: 1804.01 ------------------------------------------------------ [ 0, 1 ] 28633 11.546% 11.546% ## ( 1, 2 ] 154235 62.193% 73.739% ############ ( 2, 3 ] 39617 15.975% 89.714% ### ( 3, 4 ] 11392 4.594% 94.308% # ( 4, 6 ] 8645 3.486% 97.793% # ( 6, 10 ] 3943 1.590% 99.383% ( 10, 15 ] 455 0.183% 99.567% ( 15, 22 ] 90 0.036% 99.603% ( 22, 34 ] 28 0.011% 99.615% ( 34, 51 ] 3 0.001% 99.616% ( 51, 76 ] 6 0.002% 99.618% ( 76, 110 ] 163 0.066% 99.684% ( 110, 170 ] 313 0.126% 99.810% ( 170, 250 ] 127 0.051% 99.861% ( 250, 380 ] 85 0.034% 99.896% ( 380, 580 ] 96 0.039% 99.934% ( 580, 870 ] 68 0.027% 99.962% ( 870, 1300 ] 45 0.018% 99.980% ( 1300, 1900 ] 30 0.012% 99.992% ( 1900, 2900 ] 24 0.010% 100.002% ( 2900, 4400 ] 32 0.013% 100.015% ( 4400, 6600 ] 6 0.002% 100.017% ** Level 4 read latency histogram (micros): Count: 310 Average: 133.6355 StdDev: 562.40 Min: 1 Median: 1.7445 Max: 4144 Percentiles: P50: 1.74 P75: 3.39 P99: 3470.00 P99.9: 4144.00 P99.99: 4144.00 ------------------------------------------------------ [ 0, 1 ] 53 17.097% 17.097% ### ( 1, 2 ] 137 44.194% 61.290% ######### ( 2, 3 ] 34 10.968% 72.258% ## ( 3, 4 ] 22 7.097% 79.355% # ( 4, 6 ] 20 6.452% 85.806% # ( 6, 10 ] 16 5.161% 90.968% # ( 15, 22 ] 1 0.323% 91.290% ( 76, 110 ] 1 0.323% 91.613% ( 110, 170 ] 2 0.645% 92.258% ( 250, 380 ] 2 0.645% 92.903% ( 380, 580 ] 2 0.645% 93.548% ( 580, 870 ] 3 0.968% 94.516% ( 870, 1300 ] 7 2.258% 96.774% ( 1300, 1900 ] 2 0.645% 97.419% ( 1900, 2900 ] 3 0.968% 98.387% ( 2900, 4400 ] 5 1.613% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 797.4000 StdDev: 908.02 Min: 79 Median: 380.0000 Max: 3235 Percentiles: P50: 380.00 P75: 870.00 P99: 3235.00 P99.9: 3235.00 P99.99: 3235.00 ------------------------------------------------------ ( 76, 110 ] 3 7.500% 7.500% ## ( 110, 170 ] 7 17.500% 25.000% #### ( 170, 250 ] 8 20.000% 45.000% #### ( 250, 380 ] 2 5.000% 50.000% # ( 380, 580 ] 6 15.000% 65.000% ### ( 580, 870 ] 4 10.000% 75.000% ## ( 870, 1300 ] 2 5.000% 80.000% # ( 1300, 1900 ] 1 2.500% 82.500% # ( 1900, 2900 ] 5 12.500% 95.000% ### ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 43.1 total, 20.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 159.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.862 H:M:S, 55.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 48.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:17.182 H:M:S, 84.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/29-03:09:40 ... thread 0: (1000000,8000000) ops and (183679.5,165348.5) ops/second in (5.444267,48.382649) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.52 GB 69.2 6.0 0.0 6.0 13.5 7.6 0.0 1.8 126.3 286.3 48.38 42.95 132 0.367 6204K 6522 0.0 0.0 L1 0/0 0.00 KB 0.0 6.6 4.9 1.8 6.5 4.8 0.2 1.3 221.7 218.2 30.63 28.26 3 10.210 6894K 107K 0.0 0.0 L2 17/15 2.05 GB 1.7 1.0 0.9 0.1 1.0 0.9 4.2 1.1 221.7 221.1 4.60 4.38 2 2.299 182K 44 0.0 0.0 L3 20/3 1.23 GB 1.0 3.8 2.3 1.6 3.8 2.3 0.7 1.7 175.4 174.2 22.36 17.11 13 1.720 3983K 28K 0.0 0.0 L4 178/0 9.73 GB 1.0 1.7 1.7 0.0 1.7 1.7 0.9 1.0 117.4 117.3 14.85 8.60 21 0.707 1759K 1438 0.0 0.0 L5 1068/0 88.03 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/30 103.56 GB 0.0 19.1 9.7 9.4 26.6 17.1 8.3 3.5 162.1 225.0 120.82 101.29 171 0.707 19M 143K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.1 9.7 9.4 26.6 17.1 8.2 3.5 162.1 225.0 120.82 101.29 171 0.707 19M 143K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.1 9.7 9.4 19.0 9.5 0.0 0.0 203.1 201.6 96.44 81.44 61 1.581 19M 143K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 317.8 24.39 19.85 110 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.6 total, 48.4 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.55 GB write, 559.54 MB/s write, 19.13 GB read, 403.09 MB/s read, 120.8 seconds Interval compaction: 26.55 GB write, 561.91 MB/s write, 19.13 GB read, 404.79 MB/s read, 120.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 45, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3067157 Average: 2.9915 StdDev: 31.50 Min: 0 Median: 1.4735 Max: 18911 Percentiles: P50: 1.47 P75: 1.87 P99: 7.48 P99.9: 150.88 P99.99: 375.49 ------------------------------------------------------ [ 0, 1 ] 624832 20.372% 20.372% #### ( 1, 2 ] 1919045 62.568% 82.939% ############# ( 2, 3 ] 280933 9.159% 92.099% ## ( 3, 4 ] 114408 3.730% 95.829% # ( 4, 6 ] 89305 2.912% 98.740% # ( 6, 10 ] 21490 0.701% 99.441% ( 10, 15 ] 4709 0.154% 99.595% ( 15, 22 ] 663 0.022% 99.616% ( 22, 34 ] 35 0.001% 99.617% ( 34, 51 ] 7 0.000% 99.618% ( 51, 76 ] 223 0.007% 99.625% ( 76, 110 ] 5458 0.178% 99.803% ( 110, 170 ] 4378 0.143% 99.946% ( 170, 250 ] 761 0.025% 99.970% ( 250, 380 ] 626 0.020% 99.991% ( 380, 580 ] 626 0.020% 100.011% ( 580, 870 ] 328 0.011% 100.022% ( 870, 1300 ] 144 0.005% 100.027% ( 1300, 1900 ] 85 0.003% 100.029% ( 1900, 2900 ] 57 0.002% 100.031% ( 2900, 4400 ] 62 0.002% 100.033% ( 4400, 6600 ] 7 0.000% 100.033% ( 6600, 9900 ] 2 0.000% 100.033% ( 9900, 14000 ] 1 0.000% 100.034% ( 14000, 22000 ] 2 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 1624742 Average: 4.5195 StdDev: 70.42 Min: 0 Median: 1.6604 Max: 17586 Percentiles: P50: 1.66 P75: 2.34 P99: 8.91 P99.9: 131.60 P99.99: 300.15 ------------------------------------------------------ [ 0, 1 ] 193442 11.906% 11.906% ## ( 1, 2 ] 937245 57.686% 69.592% ############ ( 2, 3 ] 260555 16.037% 85.628% ### ( 3, 4 ] 104169 6.411% 92.040% # ( 4, 6 ] 94136 5.794% 97.834% # ( 6, 10 ] 26078 1.605% 99.439% ( 10, 15 ] 4633 0.285% 99.724% ( 15, 22 ] 697 0.043% 99.767% ( 22, 34 ] 22 0.001% 99.768% ( 34, 51 ] 5 0.000% 99.769% ( 51, 76 ] 88 0.005% 99.774% ( 76, 110 ] 1568 0.097% 99.871% ( 110, 170 ] 1334 0.082% 99.953% ( 170, 250 ] 433 0.027% 99.979% ( 250, 380 ] 455 0.028% 100.007% ( 380, 580 ] 566 0.035% 100.042% ( 580, 870 ] 466 0.029% 100.071% ( 870, 1300 ] 267 0.016% 100.087% ( 1300, 1900 ] 173 0.011% 100.098% ( 1900, 2900 ] 189 0.012% 100.109% ( 2900, 4400 ] 206 0.013% 100.122% ( 4400, 6600 ] 32 0.002% 100.124% ( 6600, 9900 ] 32 0.002% 100.126% ( 9900, 14000 ] 3 0.000% 100.126% ( 14000, 22000 ] 1 0.000% 100.126% ** Level 2 read latency histogram (micros): Count: 199133 Average: 4.2807 StdDev: 57.55 Min: 1 Median: 1.9100 Max: 7630 Percentiles: P50: 1.91 P75: 2.95 P99: 8.55 P99.9: 12.77 P99.99: 13.82 ------------------------------------------------------ [ 0, 1 ] 13717 6.888% 6.888% # ( 1, 2 ] 94344 47.377% 54.266% ######### ( 2, 3 ] 43353 21.771% 76.037% #### ( 3, 4 ] 21012 10.552% 86.588% ## ( 4, 6 ] 22410 11.254% 97.842% ## ( 6, 10 ] 3623 1.819% 99.662% ( 10, 15 ] 856 0.430% 100.091% ( 15, 22 ] 103 0.052% 100.143% ( 22, 34 ] 6 0.003% 100.146% ( 34, 51 ] 2 0.001% 100.147% ( 110, 170 ] 9 0.005% 100.152% ( 170, 250 ] 17 0.009% 100.160% ( 250, 380 ] 34 0.017% 100.177% ( 380, 580 ] 50 0.025% 100.202% ( 580, 870 ] 43 0.022% 100.224% ( 870, 1300 ] 29 0.015% 100.239% ( 1300, 1900 ] 18 0.009% 100.248% ( 1900, 2900 ] 25 0.013% 100.260% ( 2900, 4400 ] 19 0.010% 100.270% ( 4400, 6600 ] 2 0.001% 100.271% ( 6600, 9900 ] 2 0.001% 100.272% ** Level 3 read latency histogram (micros): Count: 763878 Average: 8.0654 StdDev: 119.53 Min: 0 Median: 1.8649 Max: 17712 Percentiles: P50: 1.86 P75: 2.80 P99: 9.60 P99.9: 528.57 P99.99: 924.82 ------------------------------------------------------ [ 0, 1 ] 33346 4.365% 4.365% # ( 1, 2 ] 403022 52.760% 57.125% ########### ( 2, 3 ] 169808 22.230% 79.355% #### ( 3, 4 ] 68196 8.928% 88.283% ## ( 4, 6 ] 67024 8.774% 97.057% ## ( 6, 10 ] 16515 2.162% 99.219% ( 10, 15 ] 3156 0.413% 99.632% ( 15, 22 ] 422 0.055% 99.687% ( 22, 34 ] 54 0.007% 99.694% ( 34, 51 ] 13 0.002% 99.696% ( 51, 76 ] 15 0.002% 99.698% ( 76, 110 ] 204 0.027% 99.725% ( 110, 170 ] 414 0.054% 99.779% ( 170, 250 ] 287 0.038% 99.816% ( 250, 380 ] 312 0.041% 99.857% ( 380, 580 ] 439 0.057% 99.915% ( 580, 870 ] 524 0.069% 99.983% ( 870, 1300 ] 397 0.052% 100.035% ( 1300, 1900 ] 261 0.034% 100.070% ( 1900, 2900 ] 317 0.041% 100.111% ( 2900, 4400 ] 321 0.042% 100.153% ( 4400, 6600 ] 66 0.009% 100.162% ( 6600, 9900 ] 12 0.002% 100.163% ( 9900, 14000 ] 2 0.000% 100.164% ( 14000, 22000 ] 3 0.000% 100.164% ** Level 4 read latency histogram (micros): Count: 11072 Average: 176.9043 StdDev: 643.77 Min: 1 Median: 2.3011 Max: 16793 Percentiles: P50: 2.30 P75: 3.77 P99: 3588.71 P99.9: 6215.23 P99.99: 13560.48 ------------------------------------------------------ [ 0, 1 ] 215 1.942% 1.942% ( 1, 2 ] 4515 40.779% 42.720% ######## ( 2, 3 ] 2677 24.178% 66.898% ##### ( 3, 4 ] 1170 10.567% 77.466% ## ( 4, 6 ] 746 6.738% 84.203% # ( 6, 10 ] 249 2.249% 86.452% ( 10, 15 ] 54 0.488% 86.940% ( 15, 22 ] 9 0.081% 87.021% ( 22, 34 ] 10 0.090% 87.112% ( 34, 51 ] 4 0.036% 87.148% ( 51, 76 ] 5 0.045% 87.193% ( 76, 110 ] 6 0.054% 87.247% ( 110, 170 ] 28 0.253% 87.500% ( 170, 250 ] 66 0.596% 88.096% ( 250, 380 ] 100 0.903% 88.999% ( 380, 580 ] 204 1.842% 90.842% ( 580, 870 ] 249 2.249% 93.091% ( 870, 1300 ] 262 2.366% 95.457% ( 1300, 1900 ] 197 1.779% 97.236% ( 1900, 2900 ] 131 1.183% 98.419% ( 2900, 4400 ] 140 1.264% 99.684% ( 4400, 6600 ] 29 0.262% 99.946% ( 6600, 9900 ] 4 0.036% 99.982% ( 9900, 14000 ] 1 0.009% 99.991% ( 14000, 22000 ] 1 0.009% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1256.7500 StdDev: 1451.50 Min: 79 Median: 524.4444 Max: 8420 Percentiles: P50: 524.44 P75: 2050.00 P99: 6424.00 P99.9: 8420.00 P99.99: 8420.00 ------------------------------------------------------ ( 76, 110 ] 4 2.857% 2.857% # ( 110, 170 ] 17 12.143% 15.000% ## ( 170, 250 ] 17 12.143% 27.143% ## ( 250, 380 ] 19 13.571% 40.714% ### ( 380, 580 ] 18 12.857% 53.571% ### ( 580, 870 ] 12 8.571% 62.143% ## ( 870, 1300 ] 5 3.571% 65.714% # ( 1300, 1900 ] 10 7.143% 72.857% # ( 1900, 2900 ] 20 14.286% 87.143% ### ( 2900, 4400 ] 12 8.571% 95.714% ## ( 4400, 6600 ] 5 3.571% 99.286% # ( 6600, 9900 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 48.6 total, 5.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 162.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.350 H:M:S, 54.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 180.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.488 H:M:S, 45.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/29-03:09:45 ... thread 0: (1000000,9000000) ops and (216584.3,169812.0) ops/second in (4.617139,52.999788) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/8 1.97 GB 144.7 6.6 0.0 6.6 15.1 8.5 0.0 1.8 121.8 279.9 55.34 48.12 147 0.376 6844K 7266 0.0 0.0 L1 27/0 1.27 GB 130.0 8.2 6.4 1.8 8.1 6.3 0.2 1.3 209.9 206.9 39.84 35.52 4 9.960 8492K 118K 0.0 0.0 L2 1/0 42.74 MB 0.4 1.0 0.9 0.1 1.0 0.9 4.4 1.1 221.7 221.1 4.60 4.38 2 2.299 182K 44 0.0 0.0 L3 19/3 1.17 GB 1.0 6.2 4.3 1.9 6.2 4.3 1.0 1.4 175.3 174.4 36.44 28.25 16 2.277 5835K 29K 0.0 0.0 L4 179/3 9.46 GB 1.0 3.9 3.8 0.1 3.9 3.8 1.0 1.0 117.6 117.5 34.20 19.46 50 0.684 3717K 1941 0.0 0.0 L5 1100/0 90.61 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1339/14 104.52 GB 0.0 25.9 15.4 10.5 34.3 23.8 11.5 4.0 155.7 206.1 170.41 135.74 219 0.778 25M 156K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.9 15.4 10.5 34.3 23.8 11.4 4.0 155.7 206.1 170.41 135.74 219 0.778 25M 156K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.9 15.4 10.5 25.7 15.2 0.0 0.0 187.1 186.0 141.78 113.24 96 1.477 25M 156K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 305.8 28.64 22.50 123 0.233 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.2 total, 53.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.30 GB write, 660.11 MB/s write, 25.91 GB read, 498.69 MB/s read, 170.4 seconds Interval compaction: 34.30 GB write, 662.66 MB/s write, 25.91 GB read, 500.61 MB/s read, 170.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 68, interval: 95 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3500940 Average: 3.1119 StdDev: 35.07 Min: 0 Median: 1.5065 Max: 18911 Percentiles: P50: 1.51 P75: 1.91 P99: 7.81 P99.9: 149.07 P99.99: 399.41 ------------------------------------------------------ [ 0, 1 ] 651398 18.606% 18.606% #### ( 1, 2 ] 2169871 61.980% 80.586% ############ ( 2, 3 ] 361225 10.318% 90.904% ## ( 3, 4 ] 148899 4.253% 95.157% # ( 4, 6 ] 121520 3.471% 98.628% # ( 6, 10 ] 28833 0.824% 99.452% ( 10, 15 ] 6186 0.177% 99.628% ( 15, 22 ] 829 0.024% 99.652% ( 22, 34 ] 43 0.001% 99.653% ( 34, 51 ] 13 0.000% 99.654% ( 51, 76 ] 225 0.006% 99.660% ( 76, 110 ] 5494 0.157% 99.817% ( 110, 170 ] 4460 0.127% 99.944% ( 170, 250 ] 826 0.024% 99.968% ( 250, 380 ] 700 0.020% 99.988% ( 380, 580 ] 710 0.020% 100.008% ( 580, 870 ] 413 0.012% 100.020% ( 870, 1300 ] 218 0.006% 100.026% ( 1300, 1900 ] 121 0.003% 100.030% ( 1900, 2900 ] 90 0.003% 100.032% ( 2900, 4400 ] 98 0.003% 100.035% ( 4400, 6600 ] 20 0.001% 100.036% ( 6600, 9900 ] 2 0.000% 100.036% ( 9900, 14000 ] 1 0.000% 100.036% ( 14000, 22000 ] 2 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 1710394 Average: 4.6196 StdDev: 71.44 Min: 0 Median: 1.6720 Max: 17586 Percentiles: P50: 1.67 P75: 2.37 P99: 8.98 P99.9: 141.62 P99.99: 358.84 ------------------------------------------------------ [ 0, 1 ] 194474 11.370% 11.370% ## ( 1, 2 ] 983273 57.488% 68.858% ########### ( 2, 3 ] 280362 16.392% 85.250% ### ( 3, 4 ] 112561 6.581% 91.831% # ( 4, 6 ] 101570 5.938% 97.769% # ( 6, 10 ] 28254 1.652% 99.421% ( 10, 15 ] 5009 0.293% 99.714% ( 15, 22 ] 752 0.044% 99.758% ( 22, 34 ] 23 0.001% 99.759% ( 34, 51 ] 5 0.000% 99.760% ( 51, 76 ] 92 0.005% 99.765% ( 76, 110 ] 1585 0.093% 99.858% ( 110, 170 ] 1373 0.080% 99.938% ( 170, 250 ] 468 0.027% 99.965% ( 250, 380 ] 504 0.029% 99.995% ( 380, 580 ] 621 0.036% 100.031% ( 580, 870 ] 516 0.030% 100.061% ( 870, 1300 ] 302 0.018% 100.079% ( 1300, 1900 ] 193 0.011% 100.090% ( 1900, 2900 ] 211 0.012% 100.103% ( 2900, 4400 ] 224 0.013% 100.116% ( 4400, 6600 ] 38 0.002% 100.118% ( 6600, 9900 ] 32 0.002% 100.120% ( 9900, 14000 ] 3 0.000% 100.120% ( 14000, 22000 ] 1 0.000% 100.120% ** Level 2 read latency histogram (micros): Count: 199133 Average: 4.2807 StdDev: 57.55 Min: 1 Median: 1.9100 Max: 7630 Percentiles: P50: 1.91 P75: 2.95 P99: 8.55 P99.9: 12.77 P99.99: 13.82 ------------------------------------------------------ [ 0, 1 ] 13717 6.888% 6.888% # ( 1, 2 ] 94344 47.377% 54.266% ######### ( 2, 3 ] 43353 21.771% 76.037% #### ( 3, 4 ] 21012 10.552% 86.588% ## ( 4, 6 ] 22410 11.254% 97.842% ## ( 6, 10 ] 3623 1.819% 99.662% ( 10, 15 ] 856 0.430% 100.091% ( 15, 22 ] 103 0.052% 100.143% ( 22, 34 ] 6 0.003% 100.146% ( 34, 51 ] 2 0.001% 100.147% ( 110, 170 ] 9 0.005% 100.152% ( 170, 250 ] 17 0.009% 100.160% ( 250, 380 ] 34 0.017% 100.177% ( 380, 580 ] 50 0.025% 100.202% ( 580, 870 ] 43 0.022% 100.224% ( 870, 1300 ] 29 0.015% 100.239% ( 1300, 1900 ] 18 0.009% 100.248% ( 1900, 2900 ] 25 0.013% 100.260% ( 2900, 4400 ] 19 0.010% 100.270% ( 4400, 6600 ] 2 0.001% 100.271% ( 6600, 9900 ] 2 0.001% 100.272% ** Level 3 read latency histogram (micros): Count: 1369877 Average: 9.1931 StdDev: 129.74 Min: 0 Median: 1.9240 Max: 17712 Percentiles: P50: 1.92 P75: 2.90 P99: 9.70 P99.9: 429.52 P99.99: 736.74 ------------------------------------------------------ [ 0, 1 ] 38183 2.787% 2.787% # ( 1, 2 ] 699988 51.099% 53.886% ########## ( 2, 3 ] 321739 23.487% 77.373% ##### ( 3, 4 ] 133288 9.730% 87.103% ## ( 4, 6 ] 133586 9.752% 96.854% ## ( 6, 10 ] 31749 2.318% 99.172% ( 10, 15 ] 6994 0.511% 99.682% ( 15, 22 ] 839 0.061% 99.744% ( 22, 34 ] 86 0.006% 99.750% ( 34, 51 ] 26 0.002% 99.752% ( 51, 76 ] 15 0.001% 99.753% ( 76, 110 ] 221 0.016% 99.769% ( 110, 170 ] 513 0.037% 99.807% ( 170, 250 ] 433 0.032% 99.838% ( 250, 380 ] 626 0.046% 99.884% ( 380, 580 ] 893 0.065% 99.949% ( 580, 870 ] 1038 0.076% 100.025% ( 870, 1300 ] 848 0.062% 100.087% ( 1300, 1900 ] 576 0.042% 100.129% ( 1900, 2900 ] 721 0.053% 100.181% ( 2900, 4400 ] 706 0.052% 100.233% ( 4400, 6600 ] 167 0.012% 100.245% ( 6600, 9900 ] 28 0.002% 100.247% ( 9900, 14000 ] 2 0.000% 100.247% ( 14000, 22000 ] 3 0.000% 100.248% ** Level 4 read latency histogram (micros): Count: 25778 Average: 164.3653 StdDev: 582.17 Min: 1 Median: 2.2997 Max: 16793 Percentiles: P50: 2.30 P75: 3.80 P99: 3280.33 P99.9: 5749.75 P99.99: 9156.18 ------------------------------------------------------ [ 0, 1 ] 396 1.536% 1.536% ( 1, 2 ] 10650 41.314% 42.850% ######## ( 2, 3 ] 6150 23.858% 66.708% ##### ( 3, 4 ] 2676 10.381% 77.089% ## ( 4, 6 ] 1778 6.897% 83.986% # ( 6, 10 ] 565 2.192% 86.178% ( 10, 15 ] 148 0.574% 86.752% ( 15, 22 ] 24 0.093% 86.845% ( 22, 34 ] 16 0.062% 86.907% ( 34, 51 ] 12 0.047% 86.954% ( 51, 76 ] 18 0.070% 87.024% ( 76, 110 ] 34 0.132% 87.156% ( 110, 170 ] 98 0.380% 87.536% ( 170, 250 ] 159 0.617% 88.153% ( 250, 380 ] 248 0.962% 89.115% ( 380, 580 ] 446 1.730% 90.845% ( 580, 870 ] 626 2.428% 93.273% ( 870, 1300 ] 659 2.556% 95.830% # ( 1300, 1900 ] 442 1.715% 97.544% ( 1900, 2900 ] 306 1.187% 98.731% ( 2900, 4400 ] 273 1.059% 99.791% ( 4400, 6600 ] 46 0.178% 99.969% ( 6600, 9900 ] 7 0.027% 99.996% ( 9900, 14000 ] 1 0.004% 100.000% ( 14000, 22000 ] 1 0.004% 100.004% ** Level 5 read latency histogram (micros): Count: 300 Average: 1412.5867 StdDev: 1488.46 Min: 79 Median: 684.4000 Max: 8420 Percentiles: P50: 684.40 P75: 2280.95 P99: 6462.50 P99.9: 8420.00 P99.99: 8420.00 ------------------------------------------------------ ( 76, 110 ] 9 3.000% 3.000% # ( 110, 170 ] 23 7.667% 10.667% ## ( 170, 250 ] 36 12.000% 22.667% ## ( 250, 380 ] 37 12.333% 35.000% ## ( 380, 580 ] 36 12.000% 47.000% ## ( 580, 870 ] 25 8.333% 55.333% ## ( 870, 1300 ] 18 6.000% 61.333% # ( 1300, 1900 ] 25 8.333% 69.667% ## ( 1900, 2900 ] 42 14.000% 83.667% ### ( 2900, 4400 ] 31 10.333% 94.000% ## ( 4400, 6600 ] 16 5.333% 99.333% # ( 6600, 9900 ] 2 0.667% 100.000% ** DB Stats ** Uptime(secs): 53.2 total, 4.6 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 166.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.145 H:M:S, 52.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 213.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.795 H:M:S, 38.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/29-03:09:48 ... thread 0: (1000000,10000000) ops and (330696.1,178495.8) ops/second in (3.023924,56.023712) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.89 GB 12.6 7.7 0.0 7.7 17.2 9.5 0.0 1.8 126.1 281.2 62.46 54.82 164 0.381 7995K 8512 0.0 0.0 L1 27/27 1.27 GB 0.0 8.2 6.4 1.8 8.1 6.3 0.2 1.3 209.9 206.9 39.84 35.52 4 9.960 8492K 118K 0.0 0.0 L2 1/0 42.74 MB 0.4 1.0 0.9 0.1 1.0 0.9 4.4 1.1 221.7 221.1 4.60 4.38 2 2.299 182K 44 0.0 0.0 L3 16/0 980.10 MB 1.0 6.2 4.3 1.9 6.2 4.3 1.0 1.4 175.3 174.4 36.44 28.25 16 2.277 5835K 29K 0.0 0.0 L4 182/0 9.67 GB 1.0 4.1 4.0 0.1 4.1 4.0 1.0 1.0 119.5 119.4 35.51 20.52 53 0.670 3873K 1941 0.0 0.0 L5 1100/0 90.61 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1340/39 105.45 GB 0.0 27.2 15.6 11.6 36.5 24.9 11.5 3.9 155.9 209.2 178.85 143.49 239 0.748 26M 157K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.2 15.6 11.6 36.5 24.9 11.4 3.9 155.9 209.2 178.85 143.49 239 0.748 26M 157K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.2 15.6 11.6 27.1 15.4 0.0 0.0 189.0 187.9 147.54 118.63 103 1.432 26M 157K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 309.8 31.31 24.87 136 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.2 total, 56.0 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.55 GB write, 665.53 MB/s write, 27.24 GB read, 496.01 MB/s read, 178.9 seconds Interval compaction: 36.55 GB write, 667.96 MB/s write, 27.24 GB read, 497.82 MB/s read, 178.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 72, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 72, interval: 99 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3724272 Average: 3.0526 StdDev: 34.14 Min: 0 Median: 1.4967 Max: 18911 Percentiles: P50: 1.50 P75: 1.90 P99: 7.64 P99.9: 146.85 P99.99: 393.53 ------------------------------------------------------ [ 0, 1 ] 716379 19.235% 19.235% #### ( 1, 2 ] 2306667 61.936% 81.171% ############ ( 2, 3 ] 373520 10.029% 91.201% ## ( 3, 4 ] 153949 4.134% 95.334% # ( 4, 6 ] 124421 3.341% 98.675% # ( 6, 10 ] 29559 0.794% 99.469% ( 10, 15 ] 6465 0.174% 99.643% ( 15, 22 ] 857 0.023% 99.666% ( 22, 34 ] 44 0.001% 99.667% ( 34, 51 ] 14 0.000% 99.667% ( 51, 76 ] 240 0.006% 99.674% ( 76, 110 ] 5657 0.152% 99.825% ( 110, 170 ] 4519 0.121% 99.947% ( 170, 250 ] 843 0.023% 99.969% ( 250, 380 ] 717 0.019% 99.989% ( 380, 580 ] 718 0.019% 100.008% ( 580, 870 ] 419 0.011% 100.019% ( 870, 1300 ] 223 0.006% 100.025% ( 1300, 1900 ] 122 0.003% 100.028% ( 1900, 2900 ] 91 0.002% 100.031% ( 2900, 4400 ] 99 0.003% 100.034% ( 4400, 6600 ] 20 0.001% 100.034% ( 6600, 9900 ] 2 0.000% 100.034% ( 9900, 14000 ] 1 0.000% 100.034% ( 14000, 22000 ] 2 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 1710395 Average: 4.6197 StdDev: 71.44 Min: 0 Median: 1.6720 Max: 17586 Percentiles: P50: 1.67 P75: 2.37 P99: 8.98 P99.9: 141.67 P99.99: 358.84 ------------------------------------------------------ [ 0, 1 ] 194474 11.370% 11.370% ## ( 1, 2 ] 983273 57.488% 68.858% ########### ( 2, 3 ] 280362 16.392% 85.250% ### ( 3, 4 ] 112561 6.581% 91.831% # ( 4, 6 ] 101570 5.938% 97.769% # ( 6, 10 ] 28254 1.652% 99.421% ( 10, 15 ] 5009 0.293% 99.714% ( 15, 22 ] 752 0.044% 99.758% ( 22, 34 ] 23 0.001% 99.759% ( 34, 51 ] 5 0.000% 99.760% ( 51, 76 ] 92 0.005% 99.765% ( 76, 110 ] 1585 0.093% 99.858% ( 110, 170 ] 1373 0.080% 99.938% ( 170, 250 ] 469 0.027% 99.965% ( 250, 380 ] 504 0.029% 99.995% ( 380, 580 ] 621 0.036% 100.031% ( 580, 870 ] 516 0.030% 100.061% ( 870, 1300 ] 302 0.018% 100.079% ( 1300, 1900 ] 193 0.011% 100.090% ( 1900, 2900 ] 211 0.012% 100.103% ( 2900, 4400 ] 224 0.013% 100.116% ( 4400, 6600 ] 38 0.002% 100.118% ( 6600, 9900 ] 32 0.002% 100.120% ( 9900, 14000 ] 3 0.000% 100.120% ( 14000, 22000 ] 1 0.000% 100.120% ** Level 2 read latency histogram (micros): Count: 199133 Average: 4.2807 StdDev: 57.55 Min: 1 Median: 1.9100 Max: 7630 Percentiles: P50: 1.91 P75: 2.95 P99: 8.55 P99.9: 12.77 P99.99: 13.82 ------------------------------------------------------ [ 0, 1 ] 13717 6.888% 6.888% # ( 1, 2 ] 94344 47.377% 54.266% ######### ( 2, 3 ] 43353 21.771% 76.037% #### ( 3, 4 ] 21012 10.552% 86.588% ## ( 4, 6 ] 22410 11.254% 97.842% ## ( 6, 10 ] 3623 1.819% 99.662% ( 10, 15 ] 856 0.430% 100.091% ( 15, 22 ] 103 0.052% 100.143% ( 22, 34 ] 6 0.003% 100.146% ( 34, 51 ] 2 0.001% 100.147% ( 110, 170 ] 9 0.005% 100.152% ( 170, 250 ] 17 0.009% 100.160% ( 250, 380 ] 34 0.017% 100.177% ( 380, 580 ] 50 0.025% 100.202% ( 580, 870 ] 43 0.022% 100.224% ( 870, 1300 ] 29 0.015% 100.239% ( 1300, 1900 ] 18 0.009% 100.248% ( 1900, 2900 ] 25 0.013% 100.260% ( 2900, 4400 ] 19 0.010% 100.270% ( 4400, 6600 ] 2 0.001% 100.271% ( 6600, 9900 ] 2 0.001% 100.272% ** Level 3 read latency histogram (micros): Count: 1424775 Average: 8.9769 StdDev: 127.28 Min: 0 Median: 1.9233 Max: 17712 Percentiles: P50: 1.92 P75: 2.90 P99: 9.70 P99.9: 407.52 P99.99: 716.50 ------------------------------------------------------ [ 0, 1 ] 38875 2.729% 2.729% # ( 1, 2 ] 729463 51.198% 53.927% ########## ( 2, 3 ] 335016 23.514% 77.441% ##### ( 3, 4 ] 138278 9.705% 87.146% ## ( 4, 6 ] 138103 9.693% 96.839% ## ( 6, 10 ] 33330 2.339% 99.178% ( 10, 15 ] 7304 0.513% 99.691% ( 15, 22 ] 890 0.062% 99.753% ( 22, 34 ] 88 0.006% 99.759% ( 34, 51 ] 26 0.002% 99.761% ( 51, 76 ] 15 0.001% 99.762% ( 76, 110 ] 224 0.016% 99.778% ( 110, 170 ] 525 0.037% 99.815% ( 170, 250 ] 445 0.031% 99.846% ( 250, 380 ] 643 0.045% 99.891% ( 380, 580 ] 910 0.064% 99.955% ( 580, 870 ] 1057 0.074% 100.029% ( 870, 1300 ] 852 0.060% 100.089% ( 1300, 1900 ] 577 0.040% 100.130% ( 1900, 2900 ] 721 0.051% 100.180% ( 2900, 4400 ] 706 0.050% 100.230% ( 4400, 6600 ] 167 0.012% 100.241% ( 6600, 9900 ] 28 0.002% 100.243% ( 9900, 14000 ] 2 0.000% 100.244% ( 14000, 22000 ] 3 0.000% 100.244% ** Level 4 read latency histogram (micros): Count: 27370 Average: 158.9657 StdDev: 567.76 Min: 1 Median: 2.2724 Max: 16793 Percentiles: P50: 2.27 P75: 3.77 P99: 3192.86 P99.9: 5673.61 P99.99: 9081.13 ------------------------------------------------------ [ 0, 1 ] 453 1.655% 1.655% ( 1, 2 ] 11475 41.925% 43.581% ######## ( 2, 3 ] 6449 23.562% 67.143% ##### ( 3, 4 ] 2797 10.219% 77.362% ## ( 4, 6 ] 1827 6.675% 84.037% # ( 6, 10 ] 602 2.199% 86.237% ( 10, 15 ] 152 0.555% 86.792% ( 15, 22 ] 26 0.095% 86.887% ( 22, 34 ] 17 0.062% 86.949% ( 34, 51 ] 12 0.044% 86.993% ( 51, 76 ] 18 0.066% 87.059% ( 76, 110 ] 34 0.124% 87.183% ( 110, 170 ] 107 0.391% 87.574% ( 170, 250 ] 181 0.661% 88.235% ( 250, 380 ] 284 1.038% 89.273% ( 380, 580 ] 499 1.823% 91.096% ( 580, 870 ] 672 2.455% 93.551% ( 870, 1300 ] 684 2.499% 96.050% ( 1300, 1900 ] 448 1.637% 97.687% ( 1900, 2900 ] 306 1.118% 98.805% ( 2900, 4400 ] 273 0.997% 99.803% ( 4400, 6600 ] 46 0.168% 99.971% ( 6600, 9900 ] 7 0.026% 99.996% ( 9900, 14000 ] 1 0.004% 100.000% ( 14000, 22000 ] 1 0.004% 100.004% ** Level 5 read latency histogram (micros): Count: 300 Average: 1412.5867 StdDev: 1488.46 Min: 79 Median: 684.4000 Max: 8420 Percentiles: P50: 684.40 P75: 2280.95 P99: 6462.50 P99.9: 8420.00 P99.99: 8420.00 ------------------------------------------------------ ( 76, 110 ] 9 3.000% 3.000% # ( 110, 170 ] 23 7.667% 10.667% ## ( 170, 250 ] 36 12.000% 22.667% ## ( 250, 380 ] 37 12.333% 35.000% ## ( 380, 580 ] 36 12.000% 47.000% ## ( 580, 870 ] 25 8.333% 55.333% ## ( 870, 1300 ] 18 6.000% 61.333% # ( 1300, 1900 ] 25 8.333% 69.667% ## ( 1900, 2900 ] 42 14.000% 83.667% ### ( 2900, 4400 ] 31 10.333% 94.000% ## ( 4400, 6600 ] 16 5.333% 99.333% # ( 6600, 9900 ] 2 0.667% 100.000% ** DB Stats ** Uptime(secs): 56.2 total, 3.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 175.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.561 H:M:S, 50.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.415 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.544 micros/op 180366 ops/sec 60.089 seconds 10837999 operations; 174.8 MB/s Microseconds per write: Count: 10837999 Average: 5.5443 StdDev: 482.60 Min: 1 Median: 1.7464 Max: 685062 Percentiles: P50: 1.75 P75: 2.75 P99: 8.33 P99.9: 1098.46 P99.99: 2715.13 ------------------------------------------------------ [ 0, 1 ] 1385172 12.781% 12.781% ### ( 1, 2 ] 5404562 49.867% 62.647% ########## ( 2, 3 ] 1784925 16.469% 79.117% ### ( 3, 4 ] 1509878 13.931% 93.048% ### ( 4, 6 ] 586216 5.409% 98.457% # ( 6, 10 ] 101246 0.934% 99.391% ( 10, 15 ] 28020 0.259% 99.650% ( 15, 22 ] 7986 0.074% 99.723% ( 22, 34 ] 1865 0.017% 99.740% ( 34, 51 ] 192 0.002% 99.742% ( 51, 76 ] 37 0.000% 99.743% ( 76, 110 ] 7322 0.068% 99.810% ( 110, 170 ] 3188 0.029% 99.840% ( 170, 250 ] 320 0.003% 99.842% ( 250, 380 ] 119 0.001% 99.844% ( 380, 580 ] 26 0.000% 99.844% ( 580, 870 ] 45 0.000% 99.844% ( 870, 1300 ] 11372 0.105% 99.949% ( 1300, 1900 ] 29 0.000% 99.949% ( 1900, 2900 ] 5392 0.050% 99.999% ( 2900, 4400 ] 41 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 4 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 185760 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10837999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11184814968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 617 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30353588 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31125208912 rocksdb.compact.write.bytes COUNT : 30934666291 rocksdb.flush.write.bytes COUNT : 11163532864 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 69 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 353 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11073623040 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4397056 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31231907082 rocksdb.non.last.level.read.count COUNT : 7540953 rocksdb.block.checksum.compute.count COUNT : 7539788 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.380077 P95 : 3.868363 P99 : 6.486049 P100 : 685060.000000 COUNT : 10837999 SUM : 54948078 rocksdb.compaction.times.micros P50 : 809250.000000 P95 : 4195000.000000 P99 : 13748000.000000 P100 : 21644212.000000 COUNT : 106 SUM : 150634471 rocksdb.compaction.times.cpu_micros P50 : 503500.000000 P95 : 3693333.333333 P99 : 9734000.000000 P100 : 19515617.000000 COUNT : 106 SUM : 121666820 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 728.258427 P95 : 7507.500000 P99 : 20040.000000 P100 : 34687.000000 COUNT : 149 SUM : 228256 rocksdb.compaction.outfile.sync.micros P50 : 1192.500000 P95 : 35680.769231 P99 : 75116.666667 P100 : 152168.000000 COUNT : 399 SUM : 2581406 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 113.076923 P95 : 1975.000000 P99 : 3930.000000 P100 : 5429.000000 COUNT : 288 SUM : 117459 rocksdb.table.open.io.micros P50 : 1409.821429 P95 : 8031.964286 P99 : 13191.181818 P100 : 16662.000000 COUNT : 617 SUM : 1359483 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.694975 P95 : 8.143575 P99 : 12.545542 P100 : 18914.000000 COUNT : 7538012 SUM : 54393009 rocksdb.read.block.get.micros P50 : 452.566372 P95 : 3592.142857 P99 : 5566.000000 P100 : 7893.000000 COUNT : 1234 SUM : 1092975 rocksdb.write.raw.block.micros P50 : 0.514692 P95 : 0.977915 P99 : 2.992554 P100 : 47773.000000 COUNT : 10196299 SUM : 22301175 rocksdb.numfiles.in.singlecompaction P50 : 2.083333 P95 : 7.240000 P99 : 28.120000 P100 : 39.000000 COUNT : 149 SUM : 532 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565320 P95 : 1229.450642 P99 : 2636.453953 P100 : 684870.000000 COUNT : 145856 SUM : 30366478 rocksdb.sst.read.micros P50 : 1.616372 P95 : 4.875812 P99 : 9.142700 P100 : 18911.000000 COUNT : 7541158 SUM : 38849342 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10837999 SUM : 11184814968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213106.796117 P95 : 476357.142857 P99 : 751975.000000 P100 : 830639.000000 COUNT : 149 SUM : 34006132 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 368 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0