[2024-11-28 03:27:26.816038] Starting SPDK v25.01-pre git sha1 35cd3e84d / DPDK 24.03.0 initialization... [2024-11-28 03:27:26.816180] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2753427 ] Set seed to 1732760846812538 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-28 03:27:26.934069] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-28 03:27:27.043232] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-28 03:27:27.043281] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2753427' to capture a snapshot of events at runtime. [2024-11-28 03:27:27.043291] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-28 03:27:27.043317] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-28 03:27:27.043325] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2753427 for offline analysis/debug. [2024-11-28 03:27:27.044739] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Nov 28 03:27:35 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/28-03:27:38 ... thread 0: (1000000,1000000) ops and (342583.8,342583.8) ops/second in (2.918994,2.918994) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.99 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 355.4 2.48 2.23 12 0.207 0 0 0.0 0.0 L1 3/3 251.75 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 251.9 251.7 1.00 0.98 1 1.000 255K 207 0.0 0.0 L2 1/0 48.62 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.3 237.3 0.47 0.45 1 0.469 112K 27 0.0 0.0 L3 17/0 818.49 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 199.7 199.7 0.31 0.25 1 0.313 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 99.8 306.6 4.26 3.91 15 0.284 432K 234 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 99.8 306.6 4.26 3.91 15 0.284 432K 234 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 238.9 238.8 1.78 1.68 3 0.594 432K 234 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 355.4 2.48 2.23 12 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 420.47 MB/s write, 0.42 GB read, 136.91 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 447.74 MB/s write, 0.42 GB read, 145.79 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 102601 Average: 1.9018 StdDev: 19.80 Min: 0 Median: 1.2263 Max: 3756 Percentiles: P50: 1.23 P75: 1.64 P99: 3.57 P99.9: 9.68 P99.99: 347.24 ------------------------------------------------------ [ 0, 1 ] 37366 36.419% 36.419% ####### ( 1, 2 ] 61574 60.013% 96.432% ############ ( 2, 3 ] 2066 2.014% 98.445% ( 3, 4 ] 992 0.967% 99.412% ( 4, 6 ] 336 0.327% 99.740% ( 6, 10 ] 180 0.175% 99.915% ( 10, 15 ] 57 0.056% 99.971% ( 15, 22 ] 5 0.005% 99.976% ( 22, 34 ] 1 0.001% 99.977% ( 34, 51 ] 1 0.001% 99.978% ( 110, 170 ] 10 0.010% 99.987% ( 250, 380 ] 5 0.005% 99.992% ( 870, 1300 ] 3 0.003% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 1 read latency histogram (micros): Count: 18034 Average: 1.8651 StdDev: 10.77 Min: 0 Median: 1.2540 Max: 992 Percentiles: P50: 1.25 P75: 1.65 P99: 3.46 P99.9: 9.63 P99.99: 912.27 ------------------------------------------------------ [ 0, 1 ] 6152 34.113% 34.113% ####### ( 1, 2 ] 11280 62.549% 96.662% ############# ( 2, 3 ] 341 1.891% 98.553% ( 3, 4 ] 177 0.981% 99.534% ( 4, 6 ] 36 0.200% 99.734% ( 6, 10 ] 33 0.183% 99.917% ( 10, 15 ] 10 0.055% 99.972% ( 15, 22 ] 1 0.006% 99.978% ( 250, 380 ] 2 0.011% 99.989% ( 870, 1300 ] 2 0.011% 100.000% ** Level 2 read latency histogram (micros): Count: 28134 Average: 2.4219 StdDev: 39.26 Min: 1 Median: 1.2363 Max: 5429 Percentiles: P50: 1.24 P75: 1.67 P99: 5.75 P99.9: 96.68 P99.99: 791.37 ------------------------------------------------------ [ 0, 1 ] 10201 36.259% 36.259% ####### ( 1, 2 ] 16358 58.143% 94.402% ############ ( 2, 3 ] 876 3.114% 97.515% # ( 3, 4 ] 269 0.956% 98.472% ( 4, 6 ] 170 0.604% 99.076% ( 6, 10 ] 151 0.537% 99.613% ( 10, 15 ] 32 0.114% 99.726% ( 15, 22 ] 4 0.014% 99.741% ( 34, 51 ] 1 0.004% 99.744% ( 51, 76 ] 39 0.139% 99.883% ( 76, 110 ] 8 0.028% 99.911% ( 110, 170 ] 2 0.007% 99.918% ( 170, 250 ] 14 0.050% 99.968% ( 250, 380 ] 1 0.004% 99.972% ( 380, 580 ] 3 0.011% 99.982% ( 580, 870 ] 3 0.011% 99.993% ( 2900, 4400 ] 1 0.004% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 1617.9647 StdDev: 2455.03 Min: 1 Median: 220.0000 Max: 9440 Percentiles: P50: 220.00 P75: 1862.50 P99: 9432.50 P99.9: 9440.00 P99.99: 9440.00 ------------------------------------------------------ [ 0, 1 ] 18 21.176% 21.176% #### ( 1, 2 ] 19 22.353% 43.529% #### ( 2, 3 ] 1 1.176% 44.706% ( 76, 110 ] 1 1.176% 45.882% ( 110, 170 ] 1 1.176% 47.059% ( 170, 250 ] 4 4.706% 51.765% # ( 250, 380 ] 1 1.176% 52.941% ( 380, 580 ] 3 3.529% 56.471% # ( 580, 870 ] 4 4.706% 61.176% # ( 870, 1300 ] 8 9.412% 70.588% ## ( 1300, 1900 ] 4 4.706% 75.294% # ( 1900, 2900 ] 1 1.176% 76.471% ( 2900, 4400 ] 5 5.882% 82.353% # ( 4400, 6600 ] 9 10.588% 92.941% ## ( 6600, 9900 ] 6 7.059% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 3837.1667 StdDev: 2274.16 Min: 952 Median: 3650.0000 Max: 9582 Percentiles: P50: 3650.00 P75: 5362.50 P99: 9570.00 P99.9: 9582.00 P99.99: 9582.00 ------------------------------------------------------ ( 870, 1300 ] 4 13.333% 13.333% ### ( 1300, 1900 ] 4 13.333% 26.667% ### ( 1900, 2900 ] 3 10.000% 36.667% ## ( 2900, 4400 ] 8 26.667% 63.333% ##### ( 4400, 6600 ] 8 26.667% 90.000% ##### ( 6600, 9900 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 316.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.396 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 336.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.396 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-03:27:41 ... thread 0: (1000000,2000000) ops and (326217.1,334200.2) ops/second in (3.065443,5.984437) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.23 GB 18.9 0.6 0.0 0.6 2.4 1.8 0.0 1.3 75.8 328.4 7.48 6.87 28 0.267 575K 590 0.0 0.0 L1 6/6 565.46 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 241.1 240.7 3.40 3.32 2 1.698 831K 1438 0.0 0.0 L2 1/0 48.62 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.3 237.3 0.47 0.45 1 0.469 112K 27 0.0 0.0 L3 17/0 818.49 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 199.7 199.7 0.31 0.25 1 0.313 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1195/15 97.98 GB 0.0 1.5 0.6 0.9 3.4 2.5 0.1 1.8 133.8 295.7 11.66 10.89 32 0.364 1583K 2055 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.4 2.5 0.1 1.8 133.8 295.7 11.66 10.89 32 0.364 1583K 2055 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 247.1 246.8 6.31 6.11 6 1.052 1583K 2055 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.4 5.35 4.78 26 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.37 GB write, 558.27 MB/s write, 1.52 GB read, 252.55 MB/s read, 11.7 seconds Interval compaction: 3.37 GB write, 575.93 MB/s write, 1.52 GB read, 260.54 MB/s read, 11.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 388707 Average: 2.1467 StdDev: 15.48 Min: 0 Median: 1.4510 Max: 3756 Percentiles: P50: 1.45 P75: 1.82 P99: 5.36 P99.9: 10.68 P99.99: 14.65 ------------------------------------------------------ [ 0, 1 ] 76963 19.800% 19.800% #### ( 1, 2 ] 260310 66.968% 86.768% ############# ( 2, 3 ] 34184 8.794% 95.562% ## ( 3, 4 ] 9644 2.481% 98.043% ( 4, 6 ] 5473 1.408% 99.451% ( 6, 10 ] 1686 0.434% 99.885% ( 10, 15 ] 441 0.113% 99.998% ( 15, 22 ] 35 0.009% 100.007% ( 22, 34 ] 7 0.002% 100.009% ( 34, 51 ] 2 0.001% 100.010% ( 51, 76 ] 1 0.000% 100.010% ( 110, 170 ] 15 0.004% 100.014% ( 170, 250 ] 7 0.002% 100.016% ( 250, 380 ] 7 0.002% 100.017% ( 380, 580 ] 4 0.001% 100.019% ( 580, 870 ] 5 0.001% 100.020% ( 870, 1300 ] 6 0.002% 100.021% ( 1300, 1900 ] 2 0.001% 100.022% ( 1900, 2900 ] 6 0.002% 100.023% ( 2900, 4400 ] 4 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 93776 Average: 2.1314 StdDev: 9.34 Min: 0 Median: 1.4649 Max: 1451 Percentiles: P50: 1.46 P75: 1.83 P99: 5.27 P99.9: 10.80 P99.99: 328.49 ------------------------------------------------------ [ 0, 1 ] 17335 18.486% 18.486% #### ( 1, 2 ] 63571 67.790% 86.276% ############## ( 2, 3 ] 8812 9.397% 95.673% ## ( 3, 4 ] 2268 2.419% 98.091% ( 4, 6 ] 1345 1.434% 99.525% ( 6, 10 ] 339 0.361% 99.887% ( 10, 15 ] 83 0.089% 99.975% ( 15, 22 ] 7 0.007% 99.983% ( 22, 34 ] 2 0.002% 99.985% ( 51, 76 ] 1 0.001% 99.986% ( 110, 170 ] 1 0.001% 99.987% ( 250, 380 ] 6 0.006% 99.994% ( 380, 580 ] 1 0.001% 99.995% ( 870, 1300 ] 5 0.005% 100.000% ( 1300, 1900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 28134 Average: 2.4219 StdDev: 39.26 Min: 1 Median: 1.2363 Max: 5429 Percentiles: P50: 1.24 P75: 1.67 P99: 5.75 P99.9: 96.68 P99.99: 791.37 ------------------------------------------------------ [ 0, 1 ] 10201 36.259% 36.259% ####### ( 1, 2 ] 16358 58.143% 94.402% ############ ( 2, 3 ] 876 3.114% 97.515% # ( 3, 4 ] 269 0.956% 98.472% ( 4, 6 ] 170 0.604% 99.076% ( 6, 10 ] 151 0.537% 99.613% ( 10, 15 ] 32 0.114% 99.726% ( 15, 22 ] 4 0.014% 99.741% ( 34, 51 ] 1 0.004% 99.744% ( 51, 76 ] 39 0.139% 99.883% ( 76, 110 ] 8 0.028% 99.911% ( 110, 170 ] 2 0.007% 99.918% ( 170, 250 ] 14 0.050% 99.968% ( 250, 380 ] 1 0.004% 99.972% ( 380, 580 ] 3 0.011% 99.982% ( 580, 870 ] 3 0.011% 99.993% ( 2900, 4400 ] 1 0.004% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 1617.9647 StdDev: 2455.03 Min: 1 Median: 220.0000 Max: 9440 Percentiles: P50: 220.00 P75: 1862.50 P99: 9432.50 P99.9: 9440.00 P99.99: 9440.00 ------------------------------------------------------ [ 0, 1 ] 18 21.176% 21.176% #### ( 1, 2 ] 19 22.353% 43.529% #### ( 2, 3 ] 1 1.176% 44.706% ( 76, 110 ] 1 1.176% 45.882% ( 110, 170 ] 1 1.176% 47.059% ( 170, 250 ] 4 4.706% 51.765% # ( 250, 380 ] 1 1.176% 52.941% ( 380, 580 ] 3 3.529% 56.471% # ( 580, 870 ] 4 4.706% 61.176% # ( 870, 1300 ] 8 9.412% 70.588% ## ( 1300, 1900 ] 4 4.706% 75.294% # ( 1900, 2900 ] 1 1.176% 76.471% ( 2900, 4400 ] 5 5.882% 82.353% # ( 4400, 6600 ] 9 10.588% 92.941% ## ( 6600, 9900 ] 6 7.059% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 3837.1667 StdDev: 2274.16 Min: 952 Median: 3650.0000 Max: 9582 Percentiles: P50: 3650.00 P75: 5362.50 P99: 9570.00 P99.9: 9582.00 P99.99: 9582.00 ------------------------------------------------------ ( 870, 1300 ] 4 13.333% 13.333% ### ( 1300, 1900 ] 4 13.333% 26.667% ### ( 1900, 2900 ] 3 10.000% 36.667% ## ( 2900, 4400 ] 8 26.667% 63.333% ##### ( 4400, 6600 ] 8 26.667% 90.000% ##### ( 6600, 9900 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.854 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.459 H:M:S, 15.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-03:27:44 ... thread 0: (1000000,3000000) ops and (329320.2,332557.6) ops/second in (3.036558,9.020995) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 2.15 GB 113.3 1.4 0.0 1.4 4.1 2.8 0.0 1.5 103.7 315.6 13.37 12.39 44 0.304 1407K 1506 0.0 0.0 L1 6/6 565.46 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 241.1 240.7 3.40 3.32 2 1.698 831K 1438 0.0 0.0 L2 1/0 48.62 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.3 237.3 0.47 0.45 1 0.469 112K 27 0.0 0.0 L3 17/0 818.49 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 199.7 199.7 0.31 0.25 1 0.313 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1199/15 98.90 GB 0.0 2.3 0.6 1.7 5.1 3.4 0.1 1.8 135.6 297.0 17.54 16.40 48 0.366 2415K 2971 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 0.6 1.7 5.1 3.4 0.1 1.8 135.6 297.0 17.54 16.40 48 0.366 2415K 2971 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 0.6 1.7 2.3 0.6 0.0 0.0 250.8 250.4 9.49 9.22 9 1.054 2415K 2971 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 351.8 8.06 7.18 39 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.09 GB write, 565.62 MB/s write, 2.32 GB read, 258.21 MB/s read, 17.5 seconds Interval compaction: 5.09 GB write, 577.50 MB/s write, 2.32 GB read, 263.63 MB/s read, 17.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 711230 Average: 2.1900 StdDev: 13.28 Min: 0 Median: 1.4961 Max: 3756 Percentiles: P50: 1.50 P75: 1.86 P99: 5.45 P99.9: 10.36 P99.99: 14.39 ------------------------------------------------------ [ 0, 1 ] 114075 16.039% 16.039% ### ( 1, 2 ] 486847 68.451% 84.491% ############## ( 2, 3 ] 74828 10.521% 95.011% ## ( 3, 4 ] 19782 2.781% 97.793% # ( 4, 6 ] 11838 1.664% 99.457% ( 6, 10 ] 3092 0.435% 99.892% ( 10, 15 ] 794 0.112% 100.004% ( 15, 22 ] 60 0.008% 100.012% ( 22, 34 ] 11 0.002% 100.014% ( 34, 51 ] 3 0.000% 100.014% ( 51, 76 ] 3 0.000% 100.014% ( 110, 170 ] 19 0.003% 100.017% ( 170, 250 ] 15 0.002% 100.019% ( 250, 380 ] 10 0.001% 100.021% ( 380, 580 ] 11 0.002% 100.022% ( 580, 870 ] 9 0.001% 100.023% ( 870, 1300 ] 8 0.001% 100.025% ( 1300, 1900 ] 5 0.001% 100.025% ( 1900, 2900 ] 7 0.001% 100.026% ( 2900, 4400 ] 5 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 167323 Average: 2.1494 StdDev: 7.07 Min: 0 Median: 1.5046 Max: 1451 Percentiles: P50: 1.50 P75: 1.87 P99: 5.30 P99.9: 10.43 P99.99: 29.61 ------------------------------------------------------ [ 0, 1 ] 25268 15.101% 15.101% ### ( 1, 2 ] 115713 69.155% 84.257% ############## ( 2, 3 ] 18427 11.013% 95.270% ## ( 3, 4 ] 4486 2.681% 97.951% # ( 4, 6 ] 2703 1.615% 99.566% ( 6, 10 ] 546 0.326% 99.892% ( 10, 15 ] 149 0.089% 99.981% ( 15, 22 ] 13 0.008% 99.989% ( 22, 34 ] 2 0.001% 99.990% ( 51, 76 ] 1 0.001% 99.991% ( 110, 170 ] 1 0.001% 99.992% ( 250, 380 ] 7 0.004% 99.996% ( 380, 580 ] 1 0.001% 99.996% ( 870, 1300 ] 5 0.003% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28134 Average: 2.4219 StdDev: 39.26 Min: 1 Median: 1.2363 Max: 5429 Percentiles: P50: 1.24 P75: 1.67 P99: 5.75 P99.9: 96.68 P99.99: 791.37 ------------------------------------------------------ [ 0, 1 ] 10201 36.259% 36.259% ####### ( 1, 2 ] 16358 58.143% 94.402% ############ ( 2, 3 ] 876 3.114% 97.515% # ( 3, 4 ] 269 0.956% 98.472% ( 4, 6 ] 170 0.604% 99.076% ( 6, 10 ] 151 0.537% 99.613% ( 10, 15 ] 32 0.114% 99.726% ( 15, 22 ] 4 0.014% 99.741% ( 34, 51 ] 1 0.004% 99.744% ( 51, 76 ] 39 0.139% 99.883% ( 76, 110 ] 8 0.028% 99.911% ( 110, 170 ] 2 0.007% 99.918% ( 170, 250 ] 14 0.050% 99.968% ( 250, 380 ] 1 0.004% 99.972% ( 380, 580 ] 3 0.011% 99.982% ( 580, 870 ] 3 0.011% 99.993% ( 2900, 4400 ] 1 0.004% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 1617.9647 StdDev: 2455.03 Min: 1 Median: 220.0000 Max: 9440 Percentiles: P50: 220.00 P75: 1862.50 P99: 9432.50 P99.9: 9440.00 P99.99: 9440.00 ------------------------------------------------------ [ 0, 1 ] 18 21.176% 21.176% #### ( 1, 2 ] 19 22.353% 43.529% #### ( 2, 3 ] 1 1.176% 44.706% ( 76, 110 ] 1 1.176% 45.882% ( 110, 170 ] 1 1.176% 47.059% ( 170, 250 ] 4 4.706% 51.765% # ( 250, 380 ] 1 1.176% 52.941% ( 380, 580 ] 3 3.529% 56.471% # ( 580, 870 ] 4 4.706% 61.176% # ( 870, 1300 ] 8 9.412% 70.588% ## ( 1300, 1900 ] 4 4.706% 75.294% # ( 1900, 2900 ] 1 1.176% 76.471% ( 2900, 4400 ] 5 5.882% 82.353% # ( 4400, 6600 ] 9 10.588% 92.941% ## ( 6600, 9900 ] 6 7.059% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 3837.1667 StdDev: 2274.16 Min: 952 Median: 3650.0000 Max: 9582 Percentiles: P50: 3650.00 P75: 5362.50 P99: 9570.00 P99.9: 9582.00 P99.99: 9582.00 ------------------------------------------------------ ( 870, 1300 ] 4 13.333% 13.333% ### ( 1300, 1900 ] 4 13.333% 26.667% ### ( 1900, 2900 ] 3 10.000% 36.667% ## ( 2900, 4400 ] 8 26.667% 63.333% ##### ( 4400, 6600 ] 8 26.667% 90.000% ##### ( 6600, 9900 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 320.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.292 H:M:S, 14.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.437 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-03:27:47 ... thread 0: (1000000,4000000) ops and (332236.7,332477.3) ops/second in (3.009902,12.030897) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.34 GB 6.3 2.5 0.0 2.5 6.2 3.7 0.0 1.7 122.3 308.7 20.60 19.20 62 0.332 2558K 2648 0.0 0.0 L1 12/12 1.34 GB 0.0 2.2 1.3 0.9 2.1 1.3 0.1 1.7 232.9 231.9 9.46 9.18 3 3.152 2236K 8731 0.0 0.0 L2 1/0 48.62 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.3 237.3 0.47 0.45 1 0.469 112K 27 0.0 0.0 L3 17/0 818.49 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 199.7 199.7 0.31 0.25 1 0.313 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1202/23 99.88 GB 0.0 4.8 1.4 3.4 8.5 5.2 0.1 2.3 158.8 283.0 30.84 29.08 67 0.460 4971K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 1.4 3.4 8.5 5.2 0.1 2.3 158.8 283.0 30.84 29.08 67 0.460 4971K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 1.4 3.4 4.8 1.4 0.0 0.0 246.2 245.6 19.89 19.34 14 1.420 4971K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 350.9 10.95 9.74 53 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.52 GB write, 714.09 MB/s write, 4.78 GB read, 400.63 MB/s read, 30.8 seconds Interval compaction: 8.52 GB write, 725.33 MB/s write, 4.78 GB read, 406.93 MB/s read, 30.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1007051 Average: 2.2056 StdDev: 12.77 Min: 0 Median: 1.4967 Max: 4040 Percentiles: P50: 1.50 P75: 1.86 P99: 5.40 P99.9: 10.32 P99.99: 15.00 ------------------------------------------------------ [ 0, 1 ] 160144 15.902% 15.902% ### ( 1, 2 ] 691374 68.653% 84.556% ############## ( 2, 3 ] 106034 10.529% 95.085% ## ( 3, 4 ] 27876 2.768% 97.853% # ( 4, 6 ] 16462 1.635% 99.488% ( 6, 10 ] 4092 0.406% 99.894% ( 10, 15 ] 970 0.096% 99.990% ( 15, 22 ] 77 0.008% 99.998% ( 22, 34 ] 11 0.001% 99.999% ( 34, 51 ] 4 0.000% 99.999% ( 51, 76 ] 5 0.000% 100.000% ( 76, 110 ] 35 0.003% 100.003% ( 110, 170 ] 72 0.007% 100.010% ( 170, 250 ] 42 0.004% 100.015% ( 250, 380 ] 26 0.003% 100.017% ( 380, 580 ] 25 0.002% 100.020% ( 580, 870 ] 20 0.002% 100.022% ( 870, 1300 ] 16 0.002% 100.023% ( 1300, 1900 ] 6 0.001% 100.024% ( 1900, 2900 ] 7 0.001% 100.025% ( 2900, 4400 ] 6 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 207652 Average: 2.3782 StdDev: 13.93 Min: 0 Median: 1.5201 Max: 2135 Percentiles: P50: 1.52 P75: 1.88 P99: 5.45 P99.9: 14.52 P99.99: 571.00 ------------------------------------------------------ [ 0, 1 ] 29068 13.998% 13.998% ### ( 1, 2 ] 143746 69.224% 83.223% ############## ( 2, 3 ] 24420 11.760% 94.983% ## ( 3, 4 ] 5803 2.795% 97.778% # ( 4, 6 ] 3497 1.684% 99.462% ( 6, 10 ] 733 0.353% 99.815% ( 10, 15 ] 196 0.094% 99.909% ( 15, 22 ] 18 0.009% 99.918% ( 22, 34 ] 2 0.001% 99.919% ( 51, 76 ] 1 0.000% 99.919% ( 76, 110 ] 21 0.010% 99.929% ( 110, 170 ] 73 0.035% 99.964% ( 170, 250 ] 19 0.009% 99.974% ( 250, 380 ] 18 0.009% 99.982% ( 380, 580 ] 17 0.008% 99.990% ( 580, 870 ] 3 0.001% 99.992% ( 870, 1300 ] 10 0.005% 99.997% ( 1300, 1900 ] 6 0.003% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28134 Average: 2.4219 StdDev: 39.26 Min: 1 Median: 1.2363 Max: 5429 Percentiles: P50: 1.24 P75: 1.67 P99: 5.75 P99.9: 96.68 P99.99: 791.37 ------------------------------------------------------ [ 0, 1 ] 10201 36.259% 36.259% ####### ( 1, 2 ] 16358 58.143% 94.402% ############ ( 2, 3 ] 876 3.114% 97.515% # ( 3, 4 ] 269 0.956% 98.472% ( 4, 6 ] 170 0.604% 99.076% ( 6, 10 ] 151 0.537% 99.613% ( 10, 15 ] 32 0.114% 99.726% ( 15, 22 ] 4 0.014% 99.741% ( 34, 51 ] 1 0.004% 99.744% ( 51, 76 ] 39 0.139% 99.883% ( 76, 110 ] 8 0.028% 99.911% ( 110, 170 ] 2 0.007% 99.918% ( 170, 250 ] 14 0.050% 99.968% ( 250, 380 ] 1 0.004% 99.972% ( 380, 580 ] 3 0.011% 99.982% ( 580, 870 ] 3 0.011% 99.993% ( 2900, 4400 ] 1 0.004% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 1617.9647 StdDev: 2455.03 Min: 1 Median: 220.0000 Max: 9440 Percentiles: P50: 220.00 P75: 1862.50 P99: 9432.50 P99.9: 9440.00 P99.99: 9440.00 ------------------------------------------------------ [ 0, 1 ] 18 21.176% 21.176% #### ( 1, 2 ] 19 22.353% 43.529% #### ( 2, 3 ] 1 1.176% 44.706% ( 76, 110 ] 1 1.176% 45.882% ( 110, 170 ] 1 1.176% 47.059% ( 170, 250 ] 4 4.706% 51.765% # ( 250, 380 ] 1 1.176% 52.941% ( 380, 580 ] 3 3.529% 56.471% # ( 580, 870 ] 4 4.706% 61.176% # ( 870, 1300 ] 8 9.412% 70.588% ## ( 1300, 1900 ] 4 4.706% 75.294% # ( 1900, 2900 ] 1 1.176% 76.471% ( 2900, 4400 ] 5 5.882% 82.353% # ( 4400, 6600 ] 9 10.588% 92.941% ## ( 6600, 9900 ] 6 7.059% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 3837.1667 StdDev: 2274.16 Min: 952 Median: 3650.0000 Max: 9582 Percentiles: P50: 3650.00 P75: 5362.50 P99: 9570.00 P99.9: 9582.00 P99.99: 9582.00 ------------------------------------------------------ ( 870, 1300 ] 4 13.333% 13.333% ### ( 1300, 1900 ] 4 13.333% 26.667% ### ( 1900, 2900 ] 3 10.000% 36.667% ## ( 2900, 4400 ] 8 26.667% 63.333% ##### ( 4400, 6600 ] 8 26.667% 90.000% ##### ( 6600, 9900 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 322.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.708 H:M:S, 14.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.416 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-03:27:50 ... thread 0: (1000000,5000000) ops and (310210.7,327771.9) ops/second in (3.223615,15.254512) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.26 GB 69.2 3.0 0.0 3.0 7.6 4.7 0.0 1.6 120.0 309.7 25.21 23.49 77 0.327 3070K 3174 0.0 0.0 L1 12/12 1.34 GB 0.0 2.2 1.3 0.9 2.1 1.3 0.1 1.7 232.9 231.9 9.46 9.18 3 3.152 2236K 8731 0.0 0.0 L2 1/0 48.62 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.3 237.3 0.47 0.45 1 0.469 112K 27 0.0 0.0 L3 17/0 818.49 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 199.7 199.7 0.31 0.25 1 0.313 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1209/27 100.80 GB 0.0 5.3 1.4 3.9 9.9 6.1 0.1 2.1 152.3 287.1 35.45 33.37 82 0.432 5483K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 1.4 3.9 9.9 6.1 0.1 2.1 152.3 287.1 35.45 33.37 82 0.432 5483K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 1.4 3.9 5.3 1.4 0.0 0.0 247.8 247.2 21.79 21.22 16 1.362 5483K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 350.6 13.66 12.15 66 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.94 GB write, 658.83 MB/s write, 5.27 GB read, 349.64 MB/s read, 35.4 seconds Interval compaction: 9.94 GB write, 667.01 MB/s write, 5.27 GB read, 353.98 MB/s read, 35.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 20, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1280791 Average: 2.2242 StdDev: 12.55 Min: 0 Median: 1.5022 Max: 4040 Percentiles: P50: 1.50 P75: 1.86 P99: 5.45 P99.9: 10.75 P99.99: 27.08 ------------------------------------------------------ [ 0, 1 ] 196801 15.366% 15.366% ### ( 1, 2 ] 883299 68.965% 84.331% ############## ( 2, 3 ] 138041 10.778% 95.108% ## ( 3, 4 ] 34743 2.713% 97.821% # ( 4, 6 ] 20884 1.631% 99.452% ( 6, 10 ] 5557 0.434% 99.886% ( 10, 15 ] 1228 0.096% 99.981% ( 15, 22 ] 104 0.008% 99.990% ( 22, 34 ] 14 0.001% 99.991% ( 34, 51 ] 6 0.000% 99.991% ( 51, 76 ] 6 0.000% 99.992% ( 76, 110 ] 47 0.004% 99.995% ( 110, 170 ] 150 0.012% 100.007% ( 170, 250 ] 60 0.005% 100.012% ( 250, 380 ] 37 0.003% 100.015% ( 380, 580 ] 36 0.003% 100.017% ( 580, 870 ] 28 0.002% 100.020% ( 870, 1300 ] 20 0.002% 100.021% ( 1300, 1900 ] 10 0.001% 100.022% ( 1900, 2900 ] 8 0.001% 100.022% ( 2900, 4400 ] 7 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 275415 Average: 2.4227 StdDev: 14.26 Min: 0 Median: 1.5223 Max: 3152 Percentiles: P50: 1.52 P75: 1.88 P99: 5.88 P99.9: 84.86 P99.99: 551.67 ------------------------------------------------------ [ 0, 1 ] 38215 13.875% 13.875% ### ( 1, 2 ] 190472 69.158% 83.034% ############## ( 2, 3 ] 32258 11.713% 94.746% ## ( 3, 4 ] 7391 2.684% 97.430% # ( 4, 6 ] 4611 1.674% 99.104% ( 6, 10 ] 1855 0.674% 99.777% ( 10, 15 ] 290 0.105% 99.883% ( 15, 22 ] 22 0.008% 99.891% ( 22, 34 ] 3 0.001% 99.892% ( 34, 51 ] 1 0.000% 99.892% ( 51, 76 ] 1 0.000% 99.893% ( 76, 110 ] 79 0.029% 99.921% ( 110, 170 ] 106 0.038% 99.960% ( 170, 250 ] 33 0.012% 99.972% ( 250, 380 ] 29 0.011% 99.982% ( 380, 580 ] 25 0.009% 99.991% ( 580, 870 ] 6 0.002% 99.993% ( 870, 1300 ] 10 0.004% 99.997% ( 1300, 1900 ] 6 0.002% 99.999% ( 1900, 2900 ] 1 0.000% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28134 Average: 2.4219 StdDev: 39.26 Min: 1 Median: 1.2363 Max: 5429 Percentiles: P50: 1.24 P75: 1.67 P99: 5.75 P99.9: 96.68 P99.99: 791.37 ------------------------------------------------------ [ 0, 1 ] 10201 36.259% 36.259% ####### ( 1, 2 ] 16358 58.143% 94.402% ############ ( 2, 3 ] 876 3.114% 97.515% # ( 3, 4 ] 269 0.956% 98.472% ( 4, 6 ] 170 0.604% 99.076% ( 6, 10 ] 151 0.537% 99.613% ( 10, 15 ] 32 0.114% 99.726% ( 15, 22 ] 4 0.014% 99.741% ( 34, 51 ] 1 0.004% 99.744% ( 51, 76 ] 39 0.139% 99.883% ( 76, 110 ] 8 0.028% 99.911% ( 110, 170 ] 2 0.007% 99.918% ( 170, 250 ] 14 0.050% 99.968% ( 250, 380 ] 1 0.004% 99.972% ( 380, 580 ] 3 0.011% 99.982% ( 580, 870 ] 3 0.011% 99.993% ( 2900, 4400 ] 1 0.004% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 1617.9647 StdDev: 2455.03 Min: 1 Median: 220.0000 Max: 9440 Percentiles: P50: 220.00 P75: 1862.50 P99: 9432.50 P99.9: 9440.00 P99.99: 9440.00 ------------------------------------------------------ [ 0, 1 ] 18 21.176% 21.176% #### ( 1, 2 ] 19 22.353% 43.529% #### ( 2, 3 ] 1 1.176% 44.706% ( 76, 110 ] 1 1.176% 45.882% ( 110, 170 ] 1 1.176% 47.059% ( 170, 250 ] 4 4.706% 51.765% # ( 250, 380 ] 1 1.176% 52.941% ( 380, 580 ] 3 3.529% 56.471% # ( 580, 870 ] 4 4.706% 61.176% # ( 870, 1300 ] 8 9.412% 70.588% ## ( 1300, 1900 ] 4 4.706% 75.294% # ( 1900, 2900 ] 1 1.176% 76.471% ( 2900, 4400 ] 5 5.882% 82.353% # ( 4400, 6600 ] 9 10.588% 92.941% ## ( 6600, 9900 ] 6 7.059% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 3837.1667 StdDev: 2274.16 Min: 952 Median: 3650.0000 Max: 9582 Percentiles: P50: 3650.00 P75: 5362.50 P99: 9570.00 P99.9: 9582.00 P99.99: 9582.00 ------------------------------------------------------ ( 870, 1300 ] 4 13.333% 13.333% ### ( 1300, 1900 ] 4 13.333% 26.667% ### ( 1900, 2900 ] 3 10.000% 36.667% ## ( 2900, 4400 ] 8 26.667% 63.333% ##### ( 4400, 6600 ] 8 26.667% 90.000% ##### ( 6600, 9900 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 15.4 total, 3.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 318.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.329 H:M:S, 15.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 305.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.621 H:M:S, 19.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-03:28:05 ... thread 0: (1000000,6000000) ops and (68376.2,200806.7) ops/second in (14.624962,29.879474) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/3 1.96 GB 6.3 5.7 0.0 5.7 11.3 5.6 0.0 2.0 148.2 296.2 39.09 36.44 99 0.395 5883K 13K 0.0 0.0 L1 13/13 1.55 GB 0.0 5.8 3.6 2.2 5.7 3.5 0.1 1.6 220.6 218.1 26.79 25.35 4 6.696 5999K 66K 0.0 0.0 L2 17/5 2.06 GB 15.5 0.1 0.1 0.0 0.1 0.1 2.0 1.8 237.3 237.3 0.47 0.45 1 0.469 112K 27 0.0 0.0 L3 17/10 818.49 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 199.7 199.7 0.31 0.25 1 0.313 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1211/31 101.72 GB 0.0 11.6 3.7 7.9 17.2 9.3 2.1 3.0 178.2 263.9 66.66 62.49 105 0.635 12M 79K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.6 3.7 7.9 17.2 9.3 2.1 3.0 178.2 263.9 66.66 62.49 105 0.635 12M 79K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.6 3.7 7.9 11.5 3.6 0.0 0.0 237.4 235.8 50.03 47.73 23 2.175 12M 79K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 348.5 16.63 14.77 82 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.1 total, 29.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.18 GB write, 585.02 MB/s write, 11.60 GB read, 394.94 MB/s read, 66.7 seconds Interval compaction: 17.18 GB write, 588.73 MB/s write, 11.60 GB read, 397.44 MB/s read, 66.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 20, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2449598 Average: 2.6798 StdDev: 15.81 Min: 0 Median: 1.5038 Max: 4389 Percentiles: P50: 1.50 P75: 1.87 P99: 6.44 P99.9: 152.34 P99.99: 341.96 ------------------------------------------------------ [ 0, 1 ] 371160 15.152% 15.152% ### ( 1, 2 ] 1694560 69.177% 84.329% ############## ( 2, 3 ] 253422 10.345% 94.674% ## ( 3, 4 ] 63939 2.610% 97.285% # ( 4, 6 ] 40147 1.639% 98.923% ( 6, 10 ] 17009 0.694% 99.618% ( 10, 15 ] 1976 0.081% 99.699% ( 15, 22 ] 277 0.011% 99.710% ( 22, 34 ] 19 0.001% 99.711% ( 34, 51 ] 10 0.000% 99.711% ( 51, 76 ] 16 0.001% 99.712% ( 76, 110 ] 1992 0.081% 99.793% ( 110, 170 ] 3716 0.152% 99.945% ( 170, 250 ] 763 0.031% 99.976% ( 250, 380 ] 492 0.020% 99.996% ( 380, 580 ] 361 0.015% 100.011% ( 580, 870 ] 145 0.006% 100.017% ( 870, 1300 ] 46 0.002% 100.018% ( 1300, 1900 ] 18 0.001% 100.019% ( 1900, 2900 ] 15 0.001% 100.020% ( 2900, 4400 ] 9 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 579113 Average: 2.7242 StdDev: 18.70 Min: 0 Median: 1.5191 Max: 3825 Percentiles: P50: 1.52 P75: 1.88 P99: 7.68 P99.9: 152.62 P99.99: 871.03 ------------------------------------------------------ [ 0, 1 ] 83990 14.503% 14.503% ### ( 1, 2 ] 396027 68.385% 82.888% ############## ( 2, 3 ] 63623 10.986% 93.875% ## ( 3, 4 ] 15825 2.733% 96.607% # ( 4, 6 ] 11312 1.953% 98.561% ( 6, 10 ] 6045 1.044% 99.604% ( 10, 15 ] 695 0.120% 99.724% ( 15, 22 ] 102 0.018% 99.742% ( 22, 34 ] 6 0.001% 99.743% ( 34, 51 ] 2 0.000% 99.743% ( 51, 76 ] 2 0.000% 99.744% ( 76, 110 ] 505 0.087% 99.831% ( 110, 170 ] 563 0.097% 99.928% ( 170, 250 ] 150 0.026% 99.954% ( 250, 380 ] 92 0.016% 99.970% ( 380, 580 ] 77 0.013% 99.983% ( 580, 870 ] 39 0.007% 99.990% ( 870, 1300 ] 37 0.006% 99.996% ( 1300, 1900 ] 10 0.002% 99.998% ( 1900, 2900 ] 9 0.002% 100.000% ( 2900, 4400 ] 2 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28148 Average: 2.5671 StdDev: 40.03 Min: 1 Median: 1.2368 Max: 5429 Percentiles: P50: 1.24 P75: 1.67 P99: 5.91 P99.9: 188.13 P99.99: 830.62 ------------------------------------------------------ [ 0, 1 ] 10201 36.241% 36.241% ####### ( 1, 2 ] 16358 58.114% 94.355% ############ ( 2, 3 ] 876 3.112% 97.467% # ( 3, 4 ] 269 0.956% 98.423% ( 4, 6 ] 170 0.604% 99.027% ( 6, 10 ] 151 0.536% 99.563% ( 10, 15 ] 32 0.114% 99.677% ( 15, 22 ] 4 0.014% 99.691% ( 34, 51 ] 1 0.004% 99.694% ( 51, 76 ] 39 0.139% 99.833% ( 76, 110 ] 8 0.028% 99.861% ( 110, 170 ] 7 0.025% 99.886% ( 170, 250 ] 17 0.060% 99.947% ( 250, 380 ] 4 0.014% 99.961% ( 380, 580 ] 3 0.011% 99.972% ( 580, 870 ] 6 0.021% 99.993% ( 2900, 4400 ] 1 0.004% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 24224 Average: 10.8547 StdDev: 178.16 Min: 1 Median: 1.6603 Max: 9440 Percentiles: P50: 1.66 P75: 2.13 P99: 110.77 P99.9: 1677.60 P99.99: 9117.68 ------------------------------------------------------ [ 0, 1 ] 1358 5.606% 5.606% # ( 1, 2 ] 16286 67.231% 72.837% ############# ( 2, 3 ] 4092 16.892% 89.729% ### ( 3, 4 ] 1056 4.359% 94.089% # ( 4, 6 ] 716 2.956% 97.044% # ( 6, 10 ] 425 1.754% 98.799% ( 10, 15 ] 39 0.161% 98.960% ( 15, 22 ] 2 0.008% 98.968% ( 22, 34 ] 2 0.008% 98.976% ( 34, 51 ] 1 0.004% 98.980% ( 76, 110 ] 4 0.017% 98.997% ( 110, 170 ] 59 0.244% 99.240% ( 170, 250 ] 45 0.186% 99.426% ( 250, 380 ] 40 0.165% 99.591% ( 380, 580 ] 33 0.136% 99.728% ( 580, 870 ] 20 0.083% 99.810% ( 870, 1300 ] 18 0.074% 99.884% ( 1300, 1900 ] 6 0.025% 99.909% ( 1900, 2900 ] 1 0.004% 99.913% ( 2900, 4400 ] 5 0.021% 99.934% ( 4400, 6600 ] 9 0.037% 99.971% ( 6600, 9900 ] 6 0.025% 99.996% ** Level 4 read latency histogram (micros): Count: 30 Average: 3837.1667 StdDev: 2274.16 Min: 952 Median: 3650.0000 Max: 9582 Percentiles: P50: 3650.00 P75: 5362.50 P99: 9570.00 P99.9: 9582.00 P99.99: 9582.00 ------------------------------------------------------ ( 870, 1300 ] 4 13.333% 13.333% ### ( 1300, 1900 ] 4 13.333% 26.667% ### ( 1900, 2900 ] 3 10.000% 36.667% ## ( 2900, 4400 ] 8 26.667% 63.333% ##### ( 4400, 6600 ] 8 26.667% 90.000% ##### ( 6600, 9900 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 30.1 total, 14.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 196.38 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.773 H:M:S, 45.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 67.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.443 H:M:S, 78.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/28-03:28:11 ... thread 0: (1000000,7000000) ops and (164799.6,194728.7) ops/second in (6.067976,35.947450) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/7 2.88 GB 69.2 6.2 0.0 6.2 12.8 6.6 0.0 1.9 142.9 294.1 44.50 41.16 114 0.390 6459K 13K 0.0 0.0 L1 13/13 1.55 GB 0.0 5.8 3.6 2.2 5.7 3.5 0.1 1.6 220.6 218.1 26.79 25.35 4 6.696 5999K 66K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.0 1.8 237.3 237.3 0.47 0.45 1 0.469 112K 27 0.0 0.0 L3 17/0 817.85 MB 0.8 2.9 1.9 1.0 2.9 1.9 0.3 1.5 191.9 191.8 15.36 13.04 13 1.182 2980K 997 0.0 0.0 L4 166/0 9.69 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.8 1.0 202.1 202.1 1.13 1.05 3 0.377 231K 0 0.0 0.0 L5 1068/0 87.72 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/20 102.64 GB 0.0 15.2 5.7 9.5 21.7 12.2 6.2 3.3 176.3 251.7 88.25 81.04 135 0.654 15M 81K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.2 5.7 9.5 21.7 12.2 6.2 3.3 176.3 251.7 88.25 81.04 135 0.654 15M 81K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.2 5.7 9.5 15.1 5.6 0.0 0.0 227.1 225.9 68.51 63.80 40 1.713 15M 81K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 341.5 19.74 17.24 95 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.1 total, 35.9 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.69 GB write, 614.72 MB/s write, 15.19 GB read, 430.46 MB/s read, 88.3 seconds Interval compaction: 21.69 GB write, 617.96 MB/s write, 15.19 GB read, 432.73 MB/s read, 88.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 26, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2908445 Average: 2.7030 StdDev: 15.46 Min: 0 Median: 1.5420 Max: 4389 Percentiles: P50: 1.54 P75: 1.91 P99: 6.88 P99.9: 145.47 P99.99: 322.68 ------------------------------------------------------ [ 0, 1 ] 386303 13.282% 13.282% ### ( 1, 2 ] 1970217 67.741% 81.023% ############## ( 2, 3 ] 358409 12.323% 93.346% ## ( 3, 4 ] 91337 3.140% 96.487% # ( 4, 6 ] 67840 2.333% 98.819% ( 6, 10 ] 23993 0.825% 99.644% ( 10, 15 ] 2817 0.097% 99.741% ( 15, 22 ] 364 0.013% 99.754% ( 22, 34 ] 28 0.001% 99.755% ( 34, 51 ] 11 0.000% 99.755% ( 51, 76 ] 17 0.001% 99.756% ( 76, 110 ] 1993 0.069% 99.824% ( 110, 170 ] 3736 0.128% 99.953% ( 170, 250 ] 800 0.028% 99.980% ( 250, 380 ] 519 0.018% 99.998% ( 380, 580 ] 399 0.014% 100.012% ( 580, 870 ] 180 0.006% 100.018% ( 870, 1300 ] 63 0.002% 100.020% ( 1300, 1900 ] 21 0.001% 100.021% ( 1900, 2900 ] 19 0.001% 100.021% ( 2900, 4400 ] 9 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1059136 Average: 3.2431 StdDev: 23.65 Min: 0 Median: 1.6614 Max: 3849 Percentiles: P50: 1.66 P75: 2.22 P99: 8.77 P99.9: 141.95 P99.99: 273.97 ------------------------------------------------------ [ 0, 1 ] 89488 8.449% 8.449% ## ( 1, 2 ] 665329 62.818% 71.267% ############# ( 2, 3 ] 182612 17.242% 88.509% ### ( 3, 4 ] 52182 4.927% 93.436% # ( 4, 6 ] 46465 4.387% 97.823% # ( 6, 10 ] 17987 1.698% 99.521% ( 10, 15 ] 2503 0.236% 99.757% ( 15, 22 ] 389 0.037% 99.794% ( 22, 34 ] 41 0.004% 99.798% ( 34, 51 ] 3 0.000% 99.798% ( 51, 76 ] 8 0.001% 99.799% ( 76, 110 ] 588 0.056% 99.855% ( 110, 170 ] 905 0.085% 99.940% ( 170, 250 ] 472 0.045% 99.985% ( 250, 380 ] 315 0.030% 100.014% ( 380, 580 ] 273 0.026% 100.040% ( 580, 870 ] 158 0.015% 100.055% ( 870, 1300 ] 80 0.008% 100.063% ( 1300, 1900 ] 38 0.004% 100.066% ( 1900, 2900 ] 24 0.002% 100.068% ( 2900, 4400 ] 8 0.001% 100.069% ** Level 2 read latency histogram (micros): Count: 40482 Average: 3.6401 StdDev: 47.41 Min: 1 Median: 1.4330 Max: 5535 Percentiles: P50: 1.43 P75: 1.88 P99: 9.00 P99.9: 456.14 P99.99: 1074.64 ------------------------------------------------------ [ 0, 1 ] 10441 25.792% 25.792% ##### ( 1, 2 ] 22631 55.904% 81.696% ########### ( 2, 3 ] 3764 9.298% 90.994% ## ( 3, 4 ] 1412 3.488% 94.481% # ( 4, 6 ] 1434 3.542% 98.024% # ( 6, 10 ] 527 1.302% 99.326% ( 10, 15 ] 73 0.180% 99.506% ( 15, 22 ] 19 0.047% 99.553% ( 22, 34 ] 2 0.005% 99.558% ( 34, 51 ] 1 0.002% 99.560% ( 51, 76 ] 39 0.096% 99.657% ( 76, 110 ] 10 0.025% 99.681% ( 110, 170 ] 19 0.047% 99.728% ( 170, 250 ] 40 0.099% 99.827% ( 250, 380 ] 20 0.049% 99.876% ( 380, 580 ] 25 0.062% 99.938% ( 580, 870 ] 20 0.049% 99.988% ( 870, 1300 ] 2 0.005% 99.993% ( 2900, 4400 ] 1 0.002% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 320724 Average: 3.7267 StdDev: 52.04 Min: 1 Median: 1.7512 Max: 9440 Percentiles: P50: 1.75 P75: 2.45 P99: 8.52 P99.9: 177.18 P99.99: 483.28 ------------------------------------------------------ [ 0, 1 ] 12113 3.777% 3.777% # ( 1, 2 ] 197340 61.530% 65.306% ############ ( 2, 3 ] 68626 21.397% 86.704% #### ( 3, 4 ] 20054 6.253% 92.956% # ( 4, 6 ] 16260 5.070% 98.026% # ( 6, 10 ] 4952 1.544% 99.570% ( 10, 15 ] 562 0.175% 99.745% ( 15, 22 ] 74 0.023% 99.768% ( 22, 34 ] 11 0.003% 99.772% ( 34, 51 ] 5 0.002% 99.773% ( 51, 76 ] 1 0.000% 99.774% ( 76, 110 ] 90 0.028% 99.802% ( 110, 170 ] 302 0.094% 99.896% ( 170, 250 ] 148 0.046% 99.942% ( 250, 380 ] 109 0.034% 99.976% ( 380, 580 ] 87 0.027% 100.003% ( 580, 870 ] 46 0.014% 100.017% ( 870, 1300 ] 31 0.010% 100.027% ( 1300, 1900 ] 16 0.005% 100.032% ( 1900, 2900 ] 5 0.002% 100.034% ( 2900, 4400 ] 5 0.002% 100.035% ( 4400, 6600 ] 9 0.003% 100.038% ( 6600, 9900 ] 6 0.002% 100.040% ** Level 4 read latency histogram (micros): Count: 65 Average: 1822.4308 StdDev: 2426.94 Min: 1 Median: 628.3333 Max: 9582 Percentiles: P50: 628.33 P75: 3415.62 P99: 9185.00 P99.9: 9582.00 P99.99: 9582.00 ------------------------------------------------------ [ 0, 1 ] 8 12.308% 12.308% ## ( 1, 2 ] 11 16.923% 29.231% ### ( 2, 3 ] 6 9.231% 38.462% ## ( 3, 4 ] 1 1.538% 40.000% ( 4, 6 ] 1 1.538% 41.538% ( 110, 170 ] 1 1.538% 43.077% ( 170, 250 ] 3 4.615% 47.692% # ( 380, 580 ] 1 1.538% 49.231% ( 580, 870 ] 3 4.615% 53.846% # ( 870, 1300 ] 4 6.154% 60.000% # ( 1300, 1900 ] 4 6.154% 66.154% # ( 1900, 2900 ] 3 4.615% 70.769% # ( 2900, 4400 ] 8 12.308% 83.077% ## ( 4400, 6600 ] 8 12.308% 95.385% ## ( 6600, 9900 ] 3 4.615% 100.000% # ** Level 5 read latency histogram (micros): Count: 120 Average: 1210.2333 StdDev: 1284.57 Min: 83 Median: 604.1667 Max: 4651 Percentiles: P50: 604.17 P75: 2150.00 P99: 4382.35 P99.9: 4651.00 P99.99: 4651.00 ------------------------------------------------------ ( 76, 110 ] 6 5.000% 5.000% # ( 110, 170 ] 19 15.833% 20.833% ### ( 170, 250 ] 16 13.333% 34.167% ### ( 250, 380 ] 11 9.167% 43.333% ## ( 380, 580 ] 7 5.833% 49.167% # ( 580, 870 ] 12 10.000% 59.167% ## ( 870, 1300 ] 8 6.667% 65.833% # ( 1300, 1900 ] 7 5.833% 71.667% # ( 1900, 2900 ] 16 13.333% 85.000% ### ( 2900, 4400 ] 17 14.167% 99.167% ### ( 4400, 6600 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 36.1 total, 6.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 190.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.998 H:M:S, 47.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 162.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.226 H:M:S, 53.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-03:28:14 ... thread 0: (1000000,8000000) ops and (325332.8,205016.6) ops/second in (3.073776,39.021226) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 3.86 GB 144.7 7.1 0.0 7.1 14.6 7.6 0.0 1.9 142.6 294.9 50.79 47.04 131 0.388 7354K 14K 0.0 0.0 L1 13/13 1.55 GB 0.0 5.8 3.6 2.2 5.7 3.5 0.1 1.6 220.6 218.1 26.79 25.35 4 6.696 5999K 66K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.0 1.8 237.3 237.3 0.47 0.45 1 0.469 112K 27 0.0 0.0 L3 17/0 817.85 MB 0.8 2.9 1.9 1.0 2.9 1.9 0.3 1.5 191.9 191.8 15.36 13.04 13 1.182 2980K 997 0.0 0.0 L4 166/0 9.69 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.8 1.0 202.1 202.1 1.13 1.05 3 0.377 231K 0 0.0 0.0 L5 1068/0 87.72 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1280/24 103.62 GB 0.0 16.1 5.7 10.3 23.5 13.2 6.2 3.1 173.9 255.0 94.53 86.92 152 0.622 16M 81K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.1 5.7 10.3 23.5 13.2 6.2 3.1 173.9 255.0 94.53 86.92 152 0.622 16M 81K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.1 5.7 10.3 16.0 5.6 0.0 0.0 228.5 227.3 71.95 67.15 43 1.673 16M 81K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 343.0 22.59 19.77 109 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.2 total, 39.0 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.54 GB write, 614.70 MB/s write, 16.05 GB read, 419.21 MB/s read, 94.5 seconds Interval compaction: 23.54 GB write, 617.69 MB/s write, 16.05 GB read, 421.24 MB/s read, 94.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 32, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3212981 Average: 2.6670 StdDev: 15.12 Min: 0 Median: 1.5447 Max: 4389 Percentiles: P50: 1.54 P75: 1.91 P99: 6.64 P99.9: 140.09 P99.99: 299.76 ------------------------------------------------------ [ 0, 1 ] 416963 12.977% 12.977% ### ( 1, 2 ] 2183894 67.971% 80.948% ############## ( 2, 3 ] 400283 12.458% 93.407% ## ( 3, 4 ] 101363 3.155% 96.562% # ( 4, 6 ] 74259 2.311% 98.873% ( 6, 10 ] 25735 0.801% 99.674% ( 10, 15 ] 2940 0.092% 99.765% ( 15, 22 ] 387 0.012% 99.777% ( 22, 34 ] 31 0.001% 99.778% ( 34, 51 ] 12 0.000% 99.779% ( 51, 76 ] 20 0.001% 99.779% ( 76, 110 ] 1998 0.062% 99.841% ( 110, 170 ] 3757 0.117% 99.958% ( 170, 250 ] 817 0.025% 99.984% ( 250, 380 ] 527 0.016% 100.000% ( 380, 580 ] 408 0.013% 100.013% ( 580, 870 ] 185 0.006% 100.019% ( 870, 1300 ] 71 0.002% 100.021% ( 1300, 1900 ] 24 0.001% 100.022% ( 1900, 2900 ] 20 0.001% 100.022% ( 2900, 4400 ] 10 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1174144 Average: 3.1817 StdDev: 22.69 Min: 0 Median: 1.6544 Max: 3849 Percentiles: P50: 1.65 P75: 2.18 P99: 8.71 P99.9: 140.37 P99.99: 282.43 ------------------------------------------------------ [ 0, 1 ] 98039 8.350% 8.350% ## ( 1, 2 ] 747350 63.651% 72.000% ############# ( 2, 3 ] 198798 16.931% 88.932% ### ( 3, 4 ] 55606 4.736% 93.668% # ( 4, 6 ] 49109 4.183% 97.850% # ( 6, 10 ] 19908 1.696% 99.546% ( 10, 15 ] 2562 0.218% 99.764% ( 15, 22 ] 395 0.034% 99.798% ( 22, 34 ] 43 0.004% 99.801% ( 34, 51 ] 4 0.000% 99.802% ( 51, 76 ] 8 0.001% 99.802% ( 76, 110 ] 665 0.057% 99.859% ( 110, 170 ] 956 0.081% 99.940% ( 170, 250 ] 503 0.043% 99.983% ( 250, 380 ] 327 0.028% 100.011% ( 380, 580 ] 290 0.025% 100.036% ( 580, 870 ] 161 0.014% 100.049% ( 870, 1300 ] 83 0.007% 100.056% ( 1300, 1900 ] 38 0.003% 100.060% ( 1900, 2900 ] 24 0.002% 100.062% ( 2900, 4400 ] 8 0.001% 100.062% ** Level 2 read latency histogram (micros): Count: 40482 Average: 3.6401 StdDev: 47.41 Min: 1 Median: 1.4330 Max: 5535 Percentiles: P50: 1.43 P75: 1.88 P99: 9.00 P99.9: 456.14 P99.99: 1074.64 ------------------------------------------------------ [ 0, 1 ] 10441 25.792% 25.792% ##### ( 1, 2 ] 22631 55.904% 81.696% ########### ( 2, 3 ] 3764 9.298% 90.994% ## ( 3, 4 ] 1412 3.488% 94.481% # ( 4, 6 ] 1434 3.542% 98.024% # ( 6, 10 ] 527 1.302% 99.326% ( 10, 15 ] 73 0.180% 99.506% ( 15, 22 ] 19 0.047% 99.553% ( 22, 34 ] 2 0.005% 99.558% ( 34, 51 ] 1 0.002% 99.560% ( 51, 76 ] 39 0.096% 99.657% ( 76, 110 ] 10 0.025% 99.681% ( 110, 170 ] 19 0.047% 99.728% ( 170, 250 ] 40 0.099% 99.827% ( 250, 380 ] 20 0.049% 99.876% ( 380, 580 ] 25 0.062% 99.938% ( 580, 870 ] 20 0.049% 99.988% ( 870, 1300 ] 2 0.005% 99.993% ( 2900, 4400 ] 1 0.002% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 320724 Average: 3.7267 StdDev: 52.04 Min: 1 Median: 1.7512 Max: 9440 Percentiles: P50: 1.75 P75: 2.45 P99: 8.52 P99.9: 177.18 P99.99: 483.28 ------------------------------------------------------ [ 0, 1 ] 12113 3.777% 3.777% # ( 1, 2 ] 197340 61.530% 65.306% ############ ( 2, 3 ] 68626 21.397% 86.704% #### ( 3, 4 ] 20054 6.253% 92.956% # ( 4, 6 ] 16260 5.070% 98.026% # ( 6, 10 ] 4952 1.544% 99.570% ( 10, 15 ] 562 0.175% 99.745% ( 15, 22 ] 74 0.023% 99.768% ( 22, 34 ] 11 0.003% 99.772% ( 34, 51 ] 5 0.002% 99.773% ( 51, 76 ] 1 0.000% 99.774% ( 76, 110 ] 90 0.028% 99.802% ( 110, 170 ] 302 0.094% 99.896% ( 170, 250 ] 148 0.046% 99.942% ( 250, 380 ] 109 0.034% 99.976% ( 380, 580 ] 87 0.027% 100.003% ( 580, 870 ] 46 0.014% 100.017% ( 870, 1300 ] 31 0.010% 100.027% ( 1300, 1900 ] 16 0.005% 100.032% ( 1900, 2900 ] 5 0.002% 100.034% ( 2900, 4400 ] 5 0.002% 100.035% ( 4400, 6600 ] 9 0.003% 100.038% ( 6600, 9900 ] 6 0.002% 100.040% ** Level 4 read latency histogram (micros): Count: 65 Average: 1822.4308 StdDev: 2426.94 Min: 1 Median: 628.3333 Max: 9582 Percentiles: P50: 628.33 P75: 3415.62 P99: 9185.00 P99.9: 9582.00 P99.99: 9582.00 ------------------------------------------------------ [ 0, 1 ] 8 12.308% 12.308% ## ( 1, 2 ] 11 16.923% 29.231% ### ( 2, 3 ] 6 9.231% 38.462% ## ( 3, 4 ] 1 1.538% 40.000% ( 4, 6 ] 1 1.538% 41.538% ( 110, 170 ] 1 1.538% 43.077% ( 170, 250 ] 3 4.615% 47.692% # ( 380, 580 ] 1 1.538% 49.231% ( 580, 870 ] 3 4.615% 53.846% # ( 870, 1300 ] 4 6.154% 60.000% # ( 1300, 1900 ] 4 6.154% 66.154% # ( 1900, 2900 ] 3 4.615% 70.769% # ( 2900, 4400 ] 8 12.308% 83.077% ## ( 4400, 6600 ] 8 12.308% 95.385% ## ( 6600, 9900 ] 3 4.615% 100.000% # ** Level 5 read latency histogram (micros): Count: 120 Average: 1210.2333 StdDev: 1284.57 Min: 83 Median: 604.1667 Max: 4651 Percentiles: P50: 604.17 P75: 2150.00 P99: 4382.35 P99.9: 4651.00 P99.99: 4651.00 ------------------------------------------------------ ( 76, 110 ] 6 5.000% 5.000% # ( 110, 170 ] 19 15.833% 20.833% ### ( 170, 250 ] 16 13.333% 34.167% ### ( 250, 380 ] 11 9.167% 43.333% ## ( 380, 580 ] 7 5.833% 49.167% # ( 580, 870 ] 12 10.000% 59.167% ## ( 870, 1300 ] 8 6.667% 65.833% # ( 1300, 1900 ] 7 5.833% 71.667% # ( 1900, 2900 ] 16 13.333% 85.000% ### ( 2900, 4400 ] 17 14.167% 99.167% ### ( 4400, 6600 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 39.2 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 200.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.412 H:M:S, 44.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.414 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/28-03:28:31 ... thread 0: (1000000,9000000) ops and (58227.8,160156.2) ops/second in (17.173919,56.195145) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 3.01 GB 44.1 8.1 0.0 8.1 16.7 8.6 0.0 1.9 143.3 295.1 58.00 53.84 150 0.387 8442K 15K 0.0 0.0 L1 19/19 2.34 GB 0.0 9.2 5.5 3.8 9.1 5.4 0.1 1.7 221.7 219.2 42.57 40.35 5 8.515 8494K 66K 0.0 0.0 L2 1/0 68.38 MB 0.7 0.1 0.1 0.0 0.1 0.1 3.1 1.8 237.3 237.3 0.47 0.45 1 0.469 112K 27 0.0 0.0 L3 22/0 950.31 MB 1.0 3.5 2.1 1.4 3.5 2.1 1.0 1.6 191.1 190.7 18.92 16.12 17 1.113 3659K 8774 0.0 0.0 L4 164/0 9.56 GB 1.0 0.9 0.8 0.1 0.9 0.8 2.1 1.2 196.5 196.5 4.90 4.41 9 0.544 977K 368 0.0 0.0 L5 1080/0 88.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/31 104.62 GB 0.0 21.9 8.5 13.5 30.4 16.9 9.3 3.5 179.7 249.3 124.86 115.16 182 0.686 21M 91K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.9 8.5 13.5 30.4 16.9 9.3 3.5 179.7 249.3 124.86 115.16 182 0.686 21M 91K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.9 8.5 13.5 21.8 8.3 0.0 0.0 226.2 224.9 99.21 92.67 58 1.711 21M 91K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 343.8 25.65 22.49 124 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.4 total, 56.2 interval Flush(GB): cumulative 8.613, interval 8.613 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.40 GB write, 552.07 MB/s write, 21.92 GB read, 398.00 MB/s read, 124.9 seconds Interval compaction: 30.40 GB write, 553.93 MB/s write, 21.92 GB read, 399.34 MB/s read, 124.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 47, total-stops: 34, interval: 81 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4018380 Average: 2.6381 StdDev: 15.65 Min: 0 Median: 1.5288 Max: 4389 Percentiles: P50: 1.53 P75: 1.90 P99: 6.56 P99.9: 137.58 P99.99: 338.77 ------------------------------------------------------ [ 0, 1 ] 567149 14.114% 14.114% ### ( 1, 2 ] 2726912 67.861% 81.975% ############## ( 2, 3 ] 465157 11.576% 93.551% ## ( 3, 4 ] 122145 3.040% 96.590% # ( 4, 6 ] 92357 2.298% 98.889% ( 6, 10 ] 31898 0.794% 99.682% ( 10, 15 ] 3892 0.097% 99.779% ( 15, 22 ] 689 0.017% 99.796% ( 22, 34 ] 40 0.001% 99.797% ( 34, 51 ] 14 0.000% 99.798% ( 51, 76 ] 21 0.001% 99.798% ( 76, 110 ] 2219 0.055% 99.853% ( 110, 170 ] 4065 0.101% 99.955% ( 170, 250 ] 964 0.024% 99.979% ( 250, 380 ] 668 0.017% 99.995% ( 380, 580 ] 554 0.014% 100.009% ( 580, 870 ] 266 0.007% 100.016% ( 870, 1300 ] 112 0.003% 100.018% ( 1300, 1900 ] 45 0.001% 100.020% ( 1900, 2900 ] 24 0.001% 100.020% ( 2900, 4400 ] 12 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1715117 Average: 3.0685 StdDev: 22.27 Min: 0 Median: 1.5924 Max: 4001 Percentiles: P50: 1.59 P75: 1.99 P99: 8.56 P99.9: 145.59 P99.99: 341.14 ------------------------------------------------------ [ 0, 1 ] 217727 12.695% 12.695% ### ( 1, 2 ] 1080127 62.977% 75.671% ############# ( 2, 3 ] 243970 14.225% 89.896% ### ( 3, 4 ] 73267 4.272% 94.168% # ( 4, 6 ] 66024 3.850% 98.018% # ( 6, 10 ] 26346 1.536% 99.554% ( 10, 15 ] 3361 0.196% 99.750% ( 15, 22 ] 620 0.036% 99.786% ( 22, 34 ] 52 0.003% 99.789% ( 34, 51 ] 6 0.000% 99.789% ( 51, 76 ] 12 0.001% 99.790% ( 76, 110 ] 1025 0.060% 99.850% ( 110, 170 ] 1458 0.085% 99.935% ( 170, 250 ] 642 0.037% 99.972% ( 250, 380 ] 440 0.026% 99.998% ( 380, 580 ] 392 0.023% 100.021% ( 580, 870 ] 258 0.015% 100.036% ( 870, 1300 ] 138 0.008% 100.044% ( 1300, 1900 ] 57 0.003% 100.047% ( 1900, 2900 ] 27 0.002% 100.049% ( 2900, 4400 ] 10 0.001% 100.049% ** Level 2 read latency histogram (micros): Count: 40482 Average: 3.6401 StdDev: 47.41 Min: 1 Median: 1.4330 Max: 5535 Percentiles: P50: 1.43 P75: 1.88 P99: 9.00 P99.9: 456.14 P99.99: 1074.64 ------------------------------------------------------ [ 0, 1 ] 10441 25.792% 25.792% ##### ( 1, 2 ] 22631 55.904% 81.696% ########### ( 2, 3 ] 3764 9.298% 90.994% ## ( 3, 4 ] 1412 3.488% 94.481% # ( 4, 6 ] 1434 3.542% 98.024% # ( 6, 10 ] 527 1.302% 99.326% ( 10, 15 ] 73 0.180% 99.506% ( 15, 22 ] 19 0.047% 99.553% ( 22, 34 ] 2 0.005% 99.558% ( 34, 51 ] 1 0.002% 99.560% ( 51, 76 ] 39 0.096% 99.657% ( 76, 110 ] 10 0.025% 99.681% ( 110, 170 ] 19 0.047% 99.728% ( 170, 250 ] 40 0.099% 99.827% ( 250, 380 ] 20 0.049% 99.876% ( 380, 580 ] 25 0.062% 99.938% ( 580, 870 ] 20 0.049% 99.988% ( 870, 1300 ] 2 0.005% 99.993% ( 2900, 4400 ] 1 0.002% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 541106 Average: 4.0552 StdDev: 45.43 Min: 1 Median: 1.8083 Max: 9440 Percentiles: P50: 1.81 P75: 2.61 P99: 8.76 P99.9: 198.00 P99.99: 370.57 ------------------------------------------------------ [ 0, 1 ] 15626 2.888% 2.888% # ( 1, 2 ] 315372 58.283% 61.171% ############ ( 2, 3 ] 121715 22.494% 83.664% #### ( 3, 4 ] 40814 7.543% 91.207% ## ( 4, 6 ] 36141 6.679% 97.886% # ( 6, 10 ] 8733 1.614% 99.500% ( 10, 15 ] 1275 0.236% 99.736% ( 15, 22 ] 141 0.026% 99.762% ( 22, 34 ] 13 0.002% 99.764% ( 34, 51 ] 6 0.001% 99.765% ( 51, 76 ] 4 0.001% 99.766% ( 76, 110 ] 140 0.026% 99.792% ( 110, 170 ] 468 0.086% 99.878% ( 170, 250 ] 334 0.062% 99.940% ( 250, 380 ] 291 0.054% 99.994% ( 380, 580 ] 274 0.051% 100.045% ( 580, 870 ] 158 0.029% 100.074% ( 870, 1300 ] 78 0.014% 100.088% ( 1300, 1900 ] 35 0.006% 100.095% ( 1900, 2900 ] 8 0.001% 100.096% ( 2900, 4400 ] 6 0.001% 100.097% ( 4400, 6600 ] 9 0.002% 100.099% ( 6600, 9900 ] 6 0.001% 100.100% ** Level 4 read latency histogram (micros): Count: 145 Average: 879.0000 StdDev: 1840.58 Min: 1 Median: 3.1667 Max: 9582 Percentiles: P50: 3.17 P75: 652.50 P99: 8305.00 P99.9: 9582.00 P99.99: 9582.00 ------------------------------------------------------ [ 0, 1 ] 27 18.621% 18.621% #### ( 1, 2 ] 30 20.690% 39.310% #### ( 2, 3 ] 15 10.345% 49.655% ## ( 3, 4 ] 3 2.069% 51.724% ( 4, 6 ] 2 1.379% 53.103% ( 6, 10 ] 2 1.379% 54.483% ( 10, 15 ] 1 0.690% 55.172% ( 34, 51 ] 1 0.690% 55.862% ( 51, 76 ] 2 1.379% 57.241% ( 76, 110 ] 1 0.690% 57.931% ( 110, 170 ] 2 1.379% 59.310% ( 170, 250 ] 12 8.276% 67.586% ## ( 250, 380 ] 7 4.828% 72.414% # ( 380, 580 ] 2 1.379% 73.793% ( 580, 870 ] 7 4.828% 78.621% # ( 870, 1300 ] 5 3.448% 82.069% # ( 1300, 1900 ] 4 2.759% 84.828% # ( 1900, 2900 ] 3 2.069% 86.897% ( 2900, 4400 ] 8 5.517% 92.414% # ( 4400, 6600 ] 8 5.517% 97.931% # ( 6600, 9900 ] 3 2.069% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 1113.1889 StdDev: 1256.48 Min: 83 Median: 487.6923 Max: 5468 Percentiles: P50: 487.69 P75: 1941.67 P99: 4620.00 P99.9: 5468.00 P99.99: 5468.00 ------------------------------------------------------ ( 76, 110 ] 13 7.222% 7.222% # ( 110, 170 ] 31 17.222% 24.444% ### ( 170, 250 ] 23 12.778% 37.222% ### ( 250, 380 ] 16 8.889% 46.111% ## ( 380, 580 ] 13 7.222% 53.333% # ( 580, 870 ] 19 10.556% 63.889% ## ( 870, 1300 ] 10 5.556% 69.444% # ( 1300, 1900 ] 9 5.000% 74.444% # ( 1900, 2900 ] 24 13.333% 87.778% ### ( 2900, 4400 ] 20 11.111% 98.889% ## ( 4400, 6600 ] 2 1.111% 100.000% ** DB Stats ** Uptime(secs): 56.4 total, 17.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 157.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.660 H:M:S, 56.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 57.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:14.248 H:M:S, 83.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.656 micros/op 150235 ops/sec 60.039 seconds 9019999 operations; 145.6 MB/s Microseconds per write: Count: 9019999 Average: 6.6562 StdDev: 292.38 Min: 0 Median: 1.7345 Max: 292410 Percentiles: P50: 1.73 P75: 2.73 P99: 9.78 P99.9: 1233.52 P99.99: 2763.76 ------------------------------------------------------ [ 0, 1 ] 1225576 13.587% 13.587% ### ( 1, 2 ] 4471862 49.577% 63.165% ########## ( 2, 3 ] 1453746 16.117% 79.281% ### ( 3, 4 ] 1211508 13.431% 92.713% ### ( 4, 6 ] 454476 5.039% 97.751% # ( 6, 10 ] 119231 1.322% 99.073% ( 10, 15 ] 40526 0.449% 99.522% ( 15, 22 ] 8720 0.097% 99.619% ( 22, 34 ] 1320 0.015% 99.634% ( 34, 51 ] 168 0.002% 99.636% ( 51, 76 ] 18 0.000% 99.636% ( 76, 110 ] 6616 0.073% 99.709% ( 110, 170 ] 2168 0.024% 99.733% ( 170, 250 ] 208 0.002% 99.736% ( 250, 380 ] 160 0.002% 99.737% ( 380, 580 ] 11 0.000% 99.737% ( 580, 870 ] 11 0.000% 99.738% ( 870, 1300 ] 17334 0.192% 99.930% ( 1300, 1900 ] 68 0.001% 99.930% ( 1900, 2900 ] 6217 0.069% 99.999% ( 2900, 4400 ] 25 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 7 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 190757 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9019999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9308638968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 434 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35308395 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27007401161 rocksdb.compact.write.bytes COUNT : 26826147143 rocksdb.flush.write.bytes COUNT : 9248110877 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 46 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 220 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9173498880 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3518464 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27089831107 rocksdb.non.last.level.read.count COUNT : 6546412 rocksdb.block.checksum.compute.count COUNT : 6545590 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.368779 P95 : 3.928487 P99 : 8.526035 P100 : 292408.000000 COUNT : 9019999 SUM : 55772039 rocksdb.compaction.times.micros P50 : 990769.230769 P95 : 5510000.000000 P99 : 17328100.000000 P100 : 17328100.000000 COUNT : 58 SUM : 99210528 rocksdb.compaction.times.cpu_micros P50 : 945000.000000 P95 : 5510000.000000 P99 : 16169032.000000 P100 : 16169032.000000 COUNT : 58 SUM : 92674426 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 715.068493 P95 : 1294.941176 P99 : 2660.000000 P100 : 53762.000000 COUNT : 124 SUM : 143808 rocksdb.compaction.outfile.sync.micros P50 : 807.410072 P95 : 13765.714286 P99 : 69777.777778 P100 : 75850.000000 COUNT : 288 SUM : 1145788 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 97.734177 P95 : 330.708333 P99 : 509.666667 P100 : 561.000000 COUNT : 211 SUM : 26049 rocksdb.table.open.io.micros P50 : 1510.000000 P95 : 8190.000000 P99 : 19520.000000 P100 : 21497.000000 COUNT : 434 SUM : 1063719 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.607820 P95 : 6.649167 P99 : 9.951650 P100 : 10903.000000 COUNT : 6544242 SUM : 32177259 rocksdb.read.block.get.micros P50 : 527.967480 P95 : 3654.054054 P99 : 7035.600000 P100 : 9631.000000 COUNT : 868 SUM : 836271 rocksdb.write.raw.block.micros P50 : 0.511401 P95 : 0.971662 P99 : 2.888043 P100 : 7437.000000 COUNT : 8737020 SUM : 15950733 rocksdb.numfiles.in.singlecompaction P50 : 3.315385 P95 : 7.300000 P99 : 27.580000 P100 : 31.000000 COUNT : 107 SUM : 436 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561920 P95 : 1189.154647 P99 : 2561.095736 P100 : 292208.000000 COUNT : 215829 SUM : 35330357 rocksdb.sst.read.micros P50 : 1.557905 P95 : 3.872198 P99 : 7.796745 P100 : 9582.000000 COUNT : 6546412 SUM : 19134726 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9019999 SUM : 9308638968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210449.438202 P95 : 345875.000000 P99 : 443780.000000 P100 : 443780.000000 COUNT : 124 SUM : 25653234 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 259 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0