[2024-07-15 15:11:26.574534] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 22.11.4 initialization... [2024-07-15 15:11:26.574672] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2364070 ] Set seed to 1721049086571119 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 15:11:26.663470] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 15:11:26.704784] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 15:11:26.704836] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2364070' to capture a snapshot of events at runtime. [2024-07-15 15:11:26.704846] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 15:11:26.704856] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 15:11:26.704863] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2364070 for offline analysis/debug. [2024-07-15 15:11:26.704952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 15:11:30 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/15-15:11:33 ... thread 0: (1000000,1000000) ops and (335702.4,335702.4) ops/second in (2.978829,2.978829) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 630.00 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 351.3 2.51 2.25 12 0.209 0 0 0.0 0.0 L2 3/2 251.75 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 253.1 252.9 1.49 1.45 2 0.747 383K 205 0.0 0.0 L3 9/0 741.17 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1173/8 97.00 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.8 1.4 94.4 314.6 4.00 3.70 14 0.286 383K 205 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.7 1.4 94.4 314.6 4.00 3.70 14 0.286 383K 205 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 253.1 252.9 1.49 1.45 2 0.747 383K 205 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 351.3 2.51 2.25 12 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 392.36 MB/s write, 0.37 GB read, 117.71 MB/s read, 4.0 seconds Interval compaction: 1.23 GB write, 422.59 MB/s write, 0.37 GB read, 126.78 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 114986 Average: 1.9460 StdDev: 23.30 Min: 0 Median: 1.2047 Max: 3688 Percentiles: P50: 1.20 P75: 1.65 P99: 3.94 P99.9: 9.05 P99.99: 652.70 ------------------------------------------------------ [ 0, 1 ] 44408 38.620% 38.620% ######## ( 1, 2 ] 63919 55.589% 94.209% ########### ( 2, 3 ] 4201 3.653% 97.862% # ( 3, 4 ] 1392 1.211% 99.073% ( 4, 6 ] 811 0.705% 99.778% ( 6, 10 ] 185 0.161% 99.939% ( 10, 15 ] 26 0.023% 99.962% ( 15, 22 ] 14 0.012% 99.974% ( 22, 34 ] 4 0.003% 99.977% ( 34, 51 ] 2 0.002% 99.979% ( 51, 76 ] 1 0.001% 99.980% ( 110, 170 ] 7 0.006% 99.986% ( 250, 380 ] 3 0.003% 99.989% ( 380, 580 ] 2 0.002% 99.990% ( 580, 870 ] 2 0.002% 99.992% ( 870, 1300 ] 4 0.003% 99.996% ( 1900, 2900 ] 2 0.002% 99.997% ( 2900, 4400 ] 4 0.003% 100.001% ** Level 2 read latency histogram (micros): Count: 64038 Average: 2.0069 StdDev: 19.56 Min: 1 Median: 1.2595 Max: 2657 Percentiles: P50: 1.26 P75: 1.69 P99: 4.71 P99.9: 9.61 P99.99: 811.45 ------------------------------------------------------ [ 0, 1 ] 22402 34.982% 34.982% ####### ( 1, 2 ] 37064 57.878% 92.860% ############ ( 2, 3 ] 2652 4.141% 97.002% # ( 3, 4 ] 1061 1.657% 98.659% ( 4, 6 ] 620 0.968% 99.627% ( 6, 10 ] 194 0.303% 99.930% ( 10, 15 ] 18 0.028% 99.958% ( 15, 22 ] 9 0.014% 99.972% ( 34, 51 ] 1 0.002% 99.973% ( 51, 76 ] 1 0.002% 99.975% ( 76, 110 ] 1 0.002% 99.977% ( 110, 170 ] 1 0.002% 99.978% ( 170, 250 ] 2 0.003% 99.981% ( 250, 380 ] 3 0.005% 99.986% ( 380, 580 ] 1 0.002% 99.988% ( 580, 870 ] 2 0.003% 99.991% ( 870, 1300 ] 3 0.005% 99.995% ( 1900, 2900 ] 3 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1550.4909 StdDev: 1442.52 Min: 62 Median: 1020.5000 Max: 5549 Percentiles: P50: 1020.50 P75: 1962.50 P99: 5549.00 P99.9: 5549.00 P99.99: 5549.00 ------------------------------------------------------ ( 51, 76 ] 2 3.636% 3.636% # ( 110, 170 ] 2 3.636% 7.273% # ( 170, 250 ] 2 3.636% 10.909% # ( 250, 380 ] 1 1.818% 12.727% ( 380, 580 ] 8 14.545% 27.273% ### ( 580, 870 ] 9 16.364% 43.636% ### ( 870, 1300 ] 10 18.182% 61.818% #### ( 1300, 1900 ] 7 12.727% 74.545% ### ( 1900, 2900 ] 4 7.273% 81.818% # ( 2900, 4400 ] 5 9.091% 90.909% ## ( 4400, 6600 ] 5 9.091% 100.000% ## ** Level 4 read latency histogram (micros): Count: 15 Average: 1418.2667 StdDev: 1267.64 Min: 149 Median: 1031.2500 Max: 4938 Percentiles: P50: 1031.25 P75: 1675.00 P99: 4938.00 P99.9: 4938.00 P99.99: 4938.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 1 6.667% 13.333% # ( 250, 380 ] 1 6.667% 20.000% # ( 580, 870 ] 3 20.000% 40.000% #### ( 870, 1300 ] 4 26.667% 66.667% ##### ( 1300, 1900 ] 2 13.333% 80.000% ### ( 2900, 4400 ] 2 13.333% 93.333% ### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 464.5000 StdDev: 595.14 Min: 76 Median: 140.0000 Max: 2114 Percentiles: P50: 140.00 P75: 513.33 P99: 2114.00 P99.9: 2114.00 P99.99: 2114.00 ------------------------------------------------------ ( 51, 76 ] 1 5.000% 5.000% # ( 76, 110 ] 8 40.000% 45.000% ######## ( 110, 170 ] 2 10.000% 55.000% ## ( 170, 250 ] 1 5.000% 60.000% # ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 3 15.000% 80.000% ### ( 870, 1300 ] 2 10.000% 90.000% ## ( 1300, 1900 ] 1 5.000% 95.000% # ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 306.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.424 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.424 H:M:S, 14.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-15:11:36 ... thread 0: (1000000,2000000) ops and (349044.3,342243.4) ops/second in (2.864966,5.843795) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.17 GB 62.9 0.6 0.0 0.6 2.3 1.8 0.0 1.3 77.3 326.1 7.34 6.75 28 0.262 575K 601 0.0 0.0 L1 1/0 2.91 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 246.6 246.1 1.53 1.49 1 1.533 383K 636 0.0 0.0 L2 2/0 54.72 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 253.1 252.9 1.49 1.45 2 0.747 383K 205 0.0 0.0 L3 42/0 998.75 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 205.0 204.8 3.88 3.43 3 1.294 808K 795 0.0 0.0 L4 144/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1240/8 97.92 GB 0.0 2.1 1.1 1.0 3.9 2.9 2.1 2.2 148.7 276.8 14.25 13.12 34 0.419 2151K 2237 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 1.1 1.0 3.9 2.9 2.0 2.2 148.7 276.8 14.25 13.12 34 0.419 2151K 2237 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 1.1 1.0 2.1 1.1 0.0 0.0 233.6 233.4 9.07 8.49 8 1.134 2151K 2237 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.7 5.18 4.63 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.85 GB write, 649.08 MB/s write, 2.07 GB read, 348.75 MB/s read, 14.2 seconds Interval compaction: 3.85 GB write, 674.58 MB/s write, 2.07 GB read, 362.46 MB/s read, 14.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389239 Average: 2.1555 StdDev: 13.95 Min: 0 Median: 1.4398 Max: 3688 Percentiles: P50: 1.44 P75: 1.84 P99: 5.65 P99.9: 10.66 P99.99: 18.21 ------------------------------------------------------ [ 0, 1 ] 88332 22.694% 22.694% ##### ( 1, 2 ] 241678 62.090% 84.783% ############ ( 2, 3 ] 34349 8.825% 93.608% ## ( 3, 4 ] 13213 3.395% 97.003% # ( 4, 6 ] 9411 2.418% 99.420% ( 6, 10 ] 1819 0.467% 99.888% ( 10, 15 ] 379 0.097% 99.985% ( 15, 22 ] 46 0.012% 99.997% ( 22, 34 ] 8 0.002% 99.999% ( 34, 51 ] 4 0.001% 100.000% ( 51, 76 ] 5 0.001% 100.001% ( 110, 170 ] 14 0.004% 100.005% ( 170, 250 ] 7 0.002% 100.007% ( 250, 380 ] 9 0.002% 100.009% ( 380, 580 ] 4 0.001% 100.010% ( 580, 870 ] 7 0.002% 100.012% ( 870, 1300 ] 7 0.002% 100.014% ( 1300, 1900 ] 2 0.001% 100.014% ( 1900, 2900 ] 2 0.001% 100.015% ( 2900, 4400 ] 4 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 81631 Average: 2.4445 StdDev: 5.68 Min: 1 Median: 1.6450 Max: 1172 Percentiles: P50: 1.65 P75: 2.11 P99: 5.97 P99.9: 11.75 P99.99: 14.64 ------------------------------------------------------ [ 0, 1 ] 6425 7.871% 7.871% ## ( 1, 2 ] 53315 65.312% 73.183% ############# ( 2, 3 ] 13004 15.930% 89.113% ### ( 3, 4 ] 4398 5.388% 94.501% # ( 4, 6 ] 3724 4.562% 99.063% # ( 6, 10 ] 639 0.783% 99.846% ( 10, 15 ] 127 0.156% 100.001% ( 15, 22 ] 9 0.011% 100.012% ( 22, 34 ] 2 0.002% 100.015% ( 110, 170 ] 1 0.001% 100.016% ( 170, 250 ] 2 0.002% 100.018% ( 250, 380 ] 4 0.005% 100.023% ( 580, 870 ] 1 0.001% 100.025% ( 870, 1300 ] 1 0.001% 100.026% ** Level 2 read latency histogram (micros): Count: 95435 Average: 2.1130 StdDev: 16.04 Min: 1 Median: 1.3810 Max: 2657 Percentiles: P50: 1.38 P75: 1.79 P99: 5.55 P99.9: 10.20 P99.99: 356.45 ------------------------------------------------------ [ 0, 1 ] 25718 26.948% 26.948% ##### ( 1, 2 ] 57749 60.511% 87.460% ############ ( 2, 3 ] 6815 7.141% 94.601% # ( 3, 4 ] 2779 2.912% 97.512% # ( 4, 6 ] 1830 1.918% 99.430% ( 6, 10 ] 446 0.467% 99.897% ( 10, 15 ] 64 0.067% 99.964% ( 15, 22 ] 12 0.013% 99.977% ( 22, 34 ] 2 0.002% 99.979% ( 34, 51 ] 1 0.001% 99.980% ( 51, 76 ] 3 0.003% 99.983% ( 76, 110 ] 1 0.001% 99.984% ( 110, 170 ] 1 0.001% 99.985% ( 170, 250 ] 2 0.002% 99.987% ( 250, 380 ] 3 0.003% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 57354 Average: 4.0083 StdDev: 65.98 Min: 0 Median: 1.6483 Max: 5549 Percentiles: P50: 1.65 P75: 2.14 P99: 6.95 P99.9: 200.24 P99.99: 2979.38 ------------------------------------------------------ [ 0, 1 ] 4616 8.048% 8.048% ## ( 1, 2 ] 37112 64.707% 72.755% ############# ( 2, 3 ] 9291 16.199% 88.955% ### ( 3, 4 ] 3102 5.409% 94.363% # ( 4, 6 ] 2553 4.451% 98.814% # ( 6, 10 ] 450 0.785% 99.599% ( 10, 15 ] 106 0.185% 99.784% ( 15, 22 ] 8 0.014% 99.798% ( 22, 34 ] 33 0.058% 99.855% ( 34, 51 ] 16 0.028% 99.883% ( 51, 76 ] 2 0.003% 99.887% ( 110, 170 ] 5 0.009% 99.895% ( 170, 250 ] 7 0.012% 99.908% ( 250, 380 ] 6 0.010% 99.918% ( 380, 580 ] 9 0.016% 99.934% ( 580, 870 ] 9 0.016% 99.949% ( 870, 1300 ] 12 0.021% 99.970% ( 1300, 1900 ] 7 0.012% 99.983% ( 1900, 2900 ] 4 0.007% 99.990% ( 2900, 4400 ] 5 0.009% 99.998% ( 4400, 6600 ] 5 0.009% 100.007% ** Level 4 read latency histogram (micros): Count: 15 Average: 1418.2667 StdDev: 1267.64 Min: 149 Median: 1031.2500 Max: 4938 Percentiles: P50: 1031.25 P75: 1675.00 P99: 4938.00 P99.9: 4938.00 P99.99: 4938.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 1 6.667% 13.333% # ( 250, 380 ] 1 6.667% 20.000% # ( 580, 870 ] 3 20.000% 40.000% #### ( 870, 1300 ] 4 26.667% 66.667% ##### ( 1300, 1900 ] 2 13.333% 80.000% ### ( 2900, 4400 ] 2 13.333% 93.333% ### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 600.5000 StdDev: 768.95 Min: 76 Median: 164.0000 Max: 3178 Percentiles: P50: 164.00 P75: 870.00 P99: 3178.00 P99.9: 3178.00 P99.99: 3178.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 10 25.000% 27.500% ##### ( 110, 170 ] 10 25.000% 52.500% ##### ( 170, 250 ] 2 5.000% 57.500% # ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 4 10.000% 72.500% ## ( 580, 870 ] 1 2.500% 75.000% # ( 870, 1300 ] 4 10.000% 85.000% ## ( 1300, 1900 ] 2 5.000% 90.000% # ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.656 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 343.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.231 H:M:S, 8.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-15:11:39 ... thread 0: (1000000,3000000) ops and (343760.9,342747.7) ops/second in (2.908999,8.752794) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 188.8 1.7 0.0 1.7 4.4 2.8 0.0 1.6 118.8 316.7 14.32 13.34 46 0.311 1727K 1781 0.0 0.0 L1 1/0 2.91 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 246.6 246.1 1.53 1.49 1 1.533 383K 636 0.0 0.0 L2 2/0 54.72 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 253.1 252.9 1.49 1.45 2 0.747 383K 205 0.0 0.0 L3 42/0 998.75 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 205.0 204.8 3.88 3.43 3 1.294 808K 795 0.0 0.0 L4 144/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/4 98.90 GB 0.0 3.2 1.1 2.1 5.9 3.9 2.1 2.1 153.2 286.6 21.23 19.71 52 0.408 3302K 3417 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.1 2.1 5.9 3.9 2.0 2.1 153.2 286.6 21.23 19.71 52 0.408 3302K 3417 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.1 2.1 3.2 1.1 0.0 0.0 243.8 243.5 13.34 12.65 12 1.112 3302K 3417 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.6 7.88 7.06 40 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.94 GB write, 677.18 MB/s write, 3.18 GB read, 362.04 MB/s read, 21.2 seconds Interval compaction: 5.94 GB write, 694.94 MB/s write, 3.18 GB read, 371.54 MB/s read, 21.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 633142 Average: 2.0518 StdDev: 13.01 Min: 0 Median: 1.3794 Max: 3688 Percentiles: P50: 1.38 P75: 1.79 P99: 5.43 P99.9: 10.57 P99.99: 19.79 ------------------------------------------------------ [ 0, 1 ] 170063 26.860% 26.860% ##### ( 1, 2 ] 386154 60.990% 87.850% ############ ( 2, 3 ] 45276 7.151% 95.001% # ( 3, 4 ] 17345 2.740% 97.741% # ( 4, 6 ] 11119 1.756% 99.497% ( 6, 10 ] 2486 0.393% 99.890% ( 10, 15 ] 584 0.092% 99.982% ( 15, 22 ] 77 0.012% 99.994% ( 22, 34 ] 11 0.002% 99.996% ( 34, 51 ] 5 0.001% 99.997% ( 51, 76 ] 6 0.001% 99.997% ( 110, 170 ] 23 0.004% 100.001% ( 170, 250 ] 11 0.002% 100.003% ( 250, 380 ] 16 0.003% 100.005% ( 380, 580 ] 6 0.001% 100.006% ( 580, 870 ] 13 0.002% 100.008% ( 870, 1300 ] 12 0.002% 100.010% ( 1300, 1900 ] 3 0.000% 100.011% ( 1900, 2900 ] 3 0.000% 100.011% ( 2900, 4400 ] 5 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 81631 Average: 2.4445 StdDev: 5.68 Min: 1 Median: 1.6450 Max: 1172 Percentiles: P50: 1.65 P75: 2.11 P99: 5.97 P99.9: 11.75 P99.99: 14.64 ------------------------------------------------------ [ 0, 1 ] 6425 7.871% 7.871% ## ( 1, 2 ] 53315 65.312% 73.183% ############# ( 2, 3 ] 13004 15.930% 89.113% ### ( 3, 4 ] 4398 5.388% 94.501% # ( 4, 6 ] 3724 4.562% 99.063% # ( 6, 10 ] 639 0.783% 99.846% ( 10, 15 ] 127 0.156% 100.001% ( 15, 22 ] 9 0.011% 100.012% ( 22, 34 ] 2 0.002% 100.015% ( 110, 170 ] 1 0.001% 100.016% ( 170, 250 ] 2 0.002% 100.018% ( 250, 380 ] 4 0.005% 100.023% ( 580, 870 ] 1 0.001% 100.025% ( 870, 1300 ] 1 0.001% 100.026% ** Level 2 read latency histogram (micros): Count: 95435 Average: 2.1130 StdDev: 16.04 Min: 1 Median: 1.3810 Max: 2657 Percentiles: P50: 1.38 P75: 1.79 P99: 5.55 P99.9: 10.20 P99.99: 356.45 ------------------------------------------------------ [ 0, 1 ] 25718 26.948% 26.948% ##### ( 1, 2 ] 57749 60.511% 87.460% ############ ( 2, 3 ] 6815 7.141% 94.601% # ( 3, 4 ] 2779 2.912% 97.512% # ( 4, 6 ] 1830 1.918% 99.430% ( 6, 10 ] 446 0.467% 99.897% ( 10, 15 ] 64 0.067% 99.964% ( 15, 22 ] 12 0.013% 99.977% ( 22, 34 ] 2 0.002% 99.979% ( 34, 51 ] 1 0.001% 99.980% ( 51, 76 ] 3 0.003% 99.983% ( 76, 110 ] 1 0.001% 99.984% ( 110, 170 ] 1 0.001% 99.985% ( 170, 250 ] 2 0.002% 99.987% ( 250, 380 ] 3 0.003% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 57354 Average: 4.0083 StdDev: 65.98 Min: 0 Median: 1.6483 Max: 5549 Percentiles: P50: 1.65 P75: 2.14 P99: 6.95 P99.9: 200.24 P99.99: 2979.38 ------------------------------------------------------ [ 0, 1 ] 4616 8.048% 8.048% ## ( 1, 2 ] 37112 64.707% 72.755% ############# ( 2, 3 ] 9291 16.199% 88.955% ### ( 3, 4 ] 3102 5.409% 94.363% # ( 4, 6 ] 2553 4.451% 98.814% # ( 6, 10 ] 450 0.785% 99.599% ( 10, 15 ] 106 0.185% 99.784% ( 15, 22 ] 8 0.014% 99.798% ( 22, 34 ] 33 0.058% 99.855% ( 34, 51 ] 16 0.028% 99.883% ( 51, 76 ] 2 0.003% 99.887% ( 110, 170 ] 5 0.009% 99.895% ( 170, 250 ] 7 0.012% 99.908% ( 250, 380 ] 6 0.010% 99.918% ( 380, 580 ] 9 0.016% 99.934% ( 580, 870 ] 9 0.016% 99.949% ( 870, 1300 ] 12 0.021% 99.970% ( 1300, 1900 ] 7 0.012% 99.983% ( 1900, 2900 ] 4 0.007% 99.990% ( 2900, 4400 ] 5 0.009% 99.998% ( 4400, 6600 ] 5 0.009% 100.007% ** Level 4 read latency histogram (micros): Count: 15 Average: 1418.2667 StdDev: 1267.64 Min: 149 Median: 1031.2500 Max: 4938 Percentiles: P50: 1031.25 P75: 1675.00 P99: 4938.00 P99.9: 4938.00 P99.99: 4938.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 1 6.667% 13.333% # ( 250, 380 ] 1 6.667% 20.000% # ( 580, 870 ] 3 20.000% 40.000% #### ( 870, 1300 ] 4 26.667% 66.667% ##### ( 1300, 1900 ] 2 13.333% 80.000% ### ( 2900, 4400 ] 2 13.333% 93.333% ### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 600.5000 StdDev: 768.95 Min: 76 Median: 164.0000 Max: 3178 Percentiles: P50: 164.00 P75: 870.00 P99: 3178.00 P99.9: 3178.00 P99.99: 3178.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 10 25.000% 27.500% ##### ( 110, 170 ] 10 25.000% 52.500% ##### ( 170, 250 ] 2 5.000% 57.500% # ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 4 10.000% 72.500% ## ( 580, 870 ] 1 2.500% 75.000% # ( 870, 1300 ] 4 10.000% 85.000% ## ( 1300, 1900 ] 2 5.000% 90.000% # ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 328.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.009 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 338.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.354 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/15-15:11:42 ... thread 0: (1000000,4000000) ops and (333180.2,340304.7) ops/second in (3.001379,11.754173) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 3.07 GB 31.5 2.5 0.0 2.5 6.1 3.7 0.0 1.7 126.5 316.1 19.92 18.61 62 0.321 2558K 2689 0.0 0.0 L1 1/1 2.91 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 246.6 246.1 1.53 1.49 1 1.533 383K 636 0.0 0.0 L2 2/0 54.72 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 253.1 252.9 1.49 1.45 2 0.747 383K 205 0.0 0.0 L3 42/0 998.75 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 205.0 204.8 3.88 3.43 3 1.294 808K 795 0.0 0.0 L4 144/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1246/16 99.82 GB 0.0 4.0 1.1 2.9 7.7 4.8 2.1 2.1 151.8 292.5 26.83 24.98 68 0.395 4134K 4325 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 1.1 2.9 7.7 4.8 2.0 2.1 151.8 292.5 26.83 24.98 68 0.395 4134K 4325 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 1.1 2.9 4.0 1.1 0.0 0.0 248.9 248.6 16.36 15.59 15 1.091 4134K 4325 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 360.9 10.47 9.39 53 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.66 GB write, 654.69 MB/s write, 3.98 GB read, 339.71 MB/s read, 26.8 seconds Interval compaction: 7.66 GB write, 667.48 MB/s write, 3.98 GB read, 346.35 MB/s read, 26.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 936502 Average: 2.0595 StdDev: 12.65 Min: 0 Median: 1.3904 Max: 3867 Percentiles: P50: 1.39 P75: 1.79 P99: 5.34 P99.9: 10.81 P99.99: 21.56 ------------------------------------------------------ [ 0, 1 ] 240682 25.700% 25.700% ##### ( 1, 2 ] 582932 62.246% 87.946% ############ ( 2, 3 ] 69163 7.385% 95.331% # ( 3, 4 ] 24629 2.630% 97.961% # ( 4, 6 ] 14501 1.548% 99.509% ( 6, 10 ] 3514 0.375% 99.885% ( 10, 15 ] 887 0.095% 99.979% ( 15, 22 ] 107 0.011% 99.991% ( 22, 34 ] 16 0.002% 99.992% ( 34, 51 ] 9 0.001% 99.993% ( 51, 76 ] 8 0.001% 99.994% ( 76, 110 ] 10 0.001% 99.995% ( 110, 170 ] 55 0.006% 100.001% ( 170, 250 ] 27 0.003% 100.004% ( 250, 380 ] 25 0.003% 100.007% ( 380, 580 ] 10 0.001% 100.008% ( 580, 870 ] 21 0.002% 100.010% ( 870, 1300 ] 13 0.001% 100.011% ( 1300, 1900 ] 8 0.001% 100.012% ( 1900, 2900 ] 4 0.000% 100.013% ( 2900, 4400 ] 6 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 81632 Average: 2.4445 StdDev: 5.68 Min: 1 Median: 1.6451 Max: 1172 Percentiles: P50: 1.65 P75: 2.11 P99: 5.97 P99.9: 11.75 P99.99: 14.64 ------------------------------------------------------ [ 0, 1 ] 6425 7.871% 7.871% ## ( 1, 2 ] 53315 65.311% 73.182% ############# ( 2, 3 ] 13005 15.931% 89.113% ### ( 3, 4 ] 4398 5.388% 94.501% # ( 4, 6 ] 3724 4.562% 99.063% # ( 6, 10 ] 639 0.783% 99.846% ( 10, 15 ] 127 0.156% 100.001% ( 15, 22 ] 9 0.011% 100.012% ( 22, 34 ] 2 0.002% 100.015% ( 110, 170 ] 1 0.001% 100.016% ( 170, 250 ] 2 0.002% 100.018% ( 250, 380 ] 4 0.005% 100.023% ( 580, 870 ] 1 0.001% 100.025% ( 870, 1300 ] 1 0.001% 100.026% ** Level 2 read latency histogram (micros): Count: 95435 Average: 2.1130 StdDev: 16.04 Min: 1 Median: 1.3810 Max: 2657 Percentiles: P50: 1.38 P75: 1.79 P99: 5.55 P99.9: 10.20 P99.99: 356.45 ------------------------------------------------------ [ 0, 1 ] 25718 26.948% 26.948% ##### ( 1, 2 ] 57749 60.511% 87.460% ############ ( 2, 3 ] 6815 7.141% 94.601% # ( 3, 4 ] 2779 2.912% 97.512% # ( 4, 6 ] 1830 1.918% 99.430% ( 6, 10 ] 446 0.467% 99.897% ( 10, 15 ] 64 0.067% 99.964% ( 15, 22 ] 12 0.013% 99.977% ( 22, 34 ] 2 0.002% 99.979% ( 34, 51 ] 1 0.001% 99.980% ( 51, 76 ] 3 0.003% 99.983% ( 76, 110 ] 1 0.001% 99.984% ( 110, 170 ] 1 0.001% 99.985% ( 170, 250 ] 2 0.002% 99.987% ( 250, 380 ] 3 0.003% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 57354 Average: 4.0083 StdDev: 65.98 Min: 0 Median: 1.6483 Max: 5549 Percentiles: P50: 1.65 P75: 2.14 P99: 6.95 P99.9: 200.24 P99.99: 2979.38 ------------------------------------------------------ [ 0, 1 ] 4616 8.048% 8.048% ## ( 1, 2 ] 37112 64.707% 72.755% ############# ( 2, 3 ] 9291 16.199% 88.955% ### ( 3, 4 ] 3102 5.409% 94.363% # ( 4, 6 ] 2553 4.451% 98.814% # ( 6, 10 ] 450 0.785% 99.599% ( 10, 15 ] 106 0.185% 99.784% ( 15, 22 ] 8 0.014% 99.798% ( 22, 34 ] 33 0.058% 99.855% ( 34, 51 ] 16 0.028% 99.883% ( 51, 76 ] 2 0.003% 99.887% ( 110, 170 ] 5 0.009% 99.895% ( 170, 250 ] 7 0.012% 99.908% ( 250, 380 ] 6 0.010% 99.918% ( 380, 580 ] 9 0.016% 99.934% ( 580, 870 ] 9 0.016% 99.949% ( 870, 1300 ] 12 0.021% 99.970% ( 1300, 1900 ] 7 0.012% 99.983% ( 1900, 2900 ] 4 0.007% 99.990% ( 2900, 4400 ] 5 0.009% 99.998% ( 4400, 6600 ] 5 0.009% 100.007% ** Level 4 read latency histogram (micros): Count: 15 Average: 1418.2667 StdDev: 1267.64 Min: 149 Median: 1031.2500 Max: 4938 Percentiles: P50: 1031.25 P75: 1675.00 P99: 4938.00 P99.9: 4938.00 P99.99: 4938.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 1 6.667% 13.333% # ( 250, 380 ] 1 6.667% 20.000% # ( 580, 870 ] 3 20.000% 40.000% #### ( 870, 1300 ] 4 26.667% 66.667% ##### ( 1300, 1900 ] 2 13.333% 80.000% ### ( 2900, 4400 ] 2 13.333% 93.333% ### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 600.5000 StdDev: 768.95 Min: 76 Median: 164.0000 Max: 3178 Percentiles: P50: 164.00 P75: 870.00 P99: 3178.00 P99.9: 3178.00 P99.99: 3178.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 10 25.000% 27.500% ##### ( 110, 170 ] 10 25.000% 52.500% ##### ( 170, 250 ] 2 5.000% 57.500% # ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 4 10.000% 72.500% ## ( 580, 870 ] 1 2.500% 75.000% # ( 870, 1300 ] 4 10.000% 85.000% ## ( 1300, 1900 ] 2 5.000% 90.000% # ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 328.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.420 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.411 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-15:11:47 ... thread 0: (1000000,5000000) ops and (191987.1,294761.7) ops/second in (5.208682,16.962855) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 4.06 GB 56.6 3.8 0.0 3.8 8.4 4.7 0.0 1.8 139.0 312.1 27.64 25.94 83 0.333 3901K 4064 0.0 0.0 L1 1/1 2.91 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 246.6 246.1 1.53 1.49 1 1.533 383K 636 0.0 0.0 L2 2/0 54.72 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 253.1 252.9 1.49 1.45 2 0.747 383K 205 0.0 0.0 L3 42/0 998.75 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 205.0 204.8 3.88 3.43 3 1.294 808K 795 0.0 0.0 L4 144/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/17 100.81 GB 0.0 5.3 1.1 4.2 9.9 5.8 2.1 2.1 156.1 294.5 34.55 32.31 89 0.388 5477K 5700 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 1.1 4.2 9.9 5.8 2.0 2.1 156.1 294.5 34.55 32.31 89 0.388 5477K 5700 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 1.1 4.2 5.3 1.1 0.0 0.0 254.5 254.2 21.20 20.36 20 1.060 5477K 5700 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 358.6 13.35 11.95 69 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.2 total, 17.0 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.94 GB write, 591.85 MB/s write, 5.27 GB read, 313.75 MB/s read, 34.6 seconds Interval compaction: 9.94 GB write, 599.86 MB/s write, 5.27 GB read, 317.99 MB/s read, 34.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 15, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1572425 Average: 2.1042 StdDev: 11.35 Min: 0 Median: 1.4198 Max: 3867 Percentiles: P50: 1.42 P75: 1.81 P99: 5.44 P99.9: 11.39 P99.99: 87.45 ------------------------------------------------------ [ 0, 1 ] 360859 22.949% 22.949% ##### ( 1, 2 ] 1013178 64.434% 87.383% ############# ( 2, 3 ] 122378 7.783% 95.166% ## ( 3, 4 ] 43671 2.777% 97.943% # ( 4, 6 ] 23124 1.471% 99.414% ( 6, 10 ] 7208 0.458% 99.872% ( 10, 15 ] 1567 0.100% 99.972% ( 15, 22 ] 195 0.012% 99.984% ( 22, 34 ] 23 0.001% 99.986% ( 34, 51 ] 13 0.001% 99.987% ( 51, 76 ] 10 0.001% 99.987% ( 76, 110 ] 124 0.008% 99.995% ( 110, 170 ] 160 0.010% 100.005% ( 170, 250 ] 57 0.004% 100.009% ( 250, 380 ] 49 0.003% 100.012% ( 380, 580 ] 30 0.002% 100.014% ( 580, 870 ] 42 0.003% 100.017% ( 870, 1300 ] 19 0.001% 100.018% ( 1300, 1900 ] 10 0.001% 100.019% ( 1900, 2900 ] 7 0.000% 100.019% ( 2900, 4400 ] 6 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 81632 Average: 2.4445 StdDev: 5.68 Min: 1 Median: 1.6451 Max: 1172 Percentiles: P50: 1.65 P75: 2.11 P99: 5.97 P99.9: 11.75 P99.99: 14.64 ------------------------------------------------------ [ 0, 1 ] 6425 7.871% 7.871% ## ( 1, 2 ] 53315 65.311% 73.182% ############# ( 2, 3 ] 13005 15.931% 89.113% ### ( 3, 4 ] 4398 5.388% 94.501% # ( 4, 6 ] 3724 4.562% 99.063% # ( 6, 10 ] 639 0.783% 99.846% ( 10, 15 ] 127 0.156% 100.001% ( 15, 22 ] 9 0.011% 100.012% ( 22, 34 ] 2 0.002% 100.015% ( 110, 170 ] 1 0.001% 100.016% ( 170, 250 ] 2 0.002% 100.018% ( 250, 380 ] 4 0.005% 100.023% ( 580, 870 ] 1 0.001% 100.025% ( 870, 1300 ] 1 0.001% 100.026% ** Level 2 read latency histogram (micros): Count: 95435 Average: 2.1130 StdDev: 16.04 Min: 1 Median: 1.3810 Max: 2657 Percentiles: P50: 1.38 P75: 1.79 P99: 5.55 P99.9: 10.20 P99.99: 356.45 ------------------------------------------------------ [ 0, 1 ] 25718 26.948% 26.948% ##### ( 1, 2 ] 57749 60.511% 87.460% ############ ( 2, 3 ] 6815 7.141% 94.601% # ( 3, 4 ] 2779 2.912% 97.512% # ( 4, 6 ] 1830 1.918% 99.430% ( 6, 10 ] 446 0.467% 99.897% ( 10, 15 ] 64 0.067% 99.964% ( 15, 22 ] 12 0.013% 99.977% ( 22, 34 ] 2 0.002% 99.979% ( 34, 51 ] 1 0.001% 99.980% ( 51, 76 ] 3 0.003% 99.983% ( 76, 110 ] 1 0.001% 99.984% ( 110, 170 ] 1 0.001% 99.985% ( 170, 250 ] 2 0.002% 99.987% ( 250, 380 ] 3 0.003% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 57354 Average: 4.0083 StdDev: 65.98 Min: 0 Median: 1.6483 Max: 5549 Percentiles: P50: 1.65 P75: 2.14 P99: 6.95 P99.9: 200.24 P99.99: 2979.38 ------------------------------------------------------ [ 0, 1 ] 4616 8.048% 8.048% ## ( 1, 2 ] 37112 64.707% 72.755% ############# ( 2, 3 ] 9291 16.199% 88.955% ### ( 3, 4 ] 3102 5.409% 94.363% # ( 4, 6 ] 2553 4.451% 98.814% # ( 6, 10 ] 450 0.785% 99.599% ( 10, 15 ] 106 0.185% 99.784% ( 15, 22 ] 8 0.014% 99.798% ( 22, 34 ] 33 0.058% 99.855% ( 34, 51 ] 16 0.028% 99.883% ( 51, 76 ] 2 0.003% 99.887% ( 110, 170 ] 5 0.009% 99.895% ( 170, 250 ] 7 0.012% 99.908% ( 250, 380 ] 6 0.010% 99.918% ( 380, 580 ] 9 0.016% 99.934% ( 580, 870 ] 9 0.016% 99.949% ( 870, 1300 ] 12 0.021% 99.970% ( 1300, 1900 ] 7 0.012% 99.983% ( 1900, 2900 ] 4 0.007% 99.990% ( 2900, 4400 ] 5 0.009% 99.998% ( 4400, 6600 ] 5 0.009% 100.007% ** Level 4 read latency histogram (micros): Count: 15 Average: 1418.2667 StdDev: 1267.64 Min: 149 Median: 1031.2500 Max: 4938 Percentiles: P50: 1031.25 P75: 1675.00 P99: 4938.00 P99.9: 4938.00 P99.99: 4938.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 1 6.667% 13.333% # ( 250, 380 ] 1 6.667% 20.000% # ( 580, 870 ] 3 20.000% 40.000% #### ( 870, 1300 ] 4 26.667% 66.667% ##### ( 1300, 1900 ] 2 13.333% 80.000% ### ( 2900, 4400 ] 2 13.333% 93.333% ### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 600.5000 StdDev: 768.95 Min: 76 Median: 164.0000 Max: 3178 Percentiles: P50: 164.00 P75: 870.00 P99: 3178.00 P99.9: 3178.00 P99.99: 3178.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 10 25.000% 27.500% ##### ( 110, 170 ] 10 25.000% 52.500% ##### ( 170, 250 ] 2 5.000% 57.500% # ( 250, 380 ] 2 5.000% 62.500% # ( 380, 580 ] 4 10.000% 72.500% ## ( 580, 870 ] 1 2.500% 75.000% # ( 870, 1300 ] 4 10.000% 85.000% ## ( 1300, 1900 ] 2 5.000% 90.000% # ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 17.2 total, 5.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 286.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.933 H:M:S, 22.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 188.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.513 H:M:S, 48.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-15:11:54 ... thread 0: (1000000,6000000) ops and (154429.8,255991.4) ops/second in (6.475435,23.438290) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.52 GB 50.4 5.0 0.0 5.0 10.6 5.6 0.0 1.9 146.1 308.0 35.36 33.15 99 0.357 5244K 8851 0.0 0.0 L1 13/13 1.43 GB 0.0 2.8 2.8 0.0 2.8 2.8 0.2 1.0 229.1 226.7 12.65 12.02 2 6.325 2942K 29K 0.0 0.0 L2 2/0 54.72 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.4 2.0 253.1 252.9 1.49 1.45 2 0.747 383K 205 0.0 0.0 L3 14/0 926.86 MB 0.9 0.8 0.6 0.2 0.8 0.6 1.1 1.4 205.0 204.8 3.88 3.43 3 1.294 808K 795 0.0 0.0 L4 167/0 9.75 GB 1.0 0.2 0.1 0.0 0.2 0.1 1.6 1.3 201.1 200.1 0.83 0.73 1 0.832 169K 851 0.0 0.0 L5 1052/0 87.05 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/23 101.70 GB 0.0 9.2 3.7 5.5 14.7 9.3 6.0 2.6 173.5 278.5 54.21 50.78 107 0.507 9548K 40K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.2 3.7 5.5 14.7 9.3 5.9 2.6 173.5 278.5 54.21 50.78 107 0.507 9548K 40K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.2 3.7 5.5 9.1 3.7 0.0 0.0 246.1 245.0 38.21 36.45 24 1.592 9548K 40K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 358.3 16.00 14.33 83 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.7 total, 23.4 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.74 GB write, 637.77 MB/s write, 9.18 GB read, 397.30 MB/s read, 54.2 seconds Interval compaction: 14.74 GB write, 644.02 MB/s write, 9.18 GB read, 401.20 MB/s read, 54.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 18, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2286292 Average: 2.3498 StdDev: 14.38 Min: 0 Median: 1.4398 Max: 4029 Percentiles: P50: 1.44 P75: 1.82 P99: 5.81 P99.9: 99.67 P99.99: 233.99 ------------------------------------------------------ [ 0, 1 ] 485307 21.227% 21.227% #### ( 1, 2 ] 1495937 65.431% 86.658% ############# ( 2, 3 ] 186816 8.171% 94.829% ## ( 3, 4 ] 64787 2.834% 97.662% # ( 4, 6 ] 33799 1.478% 99.141% ( 6, 10 ] 13477 0.589% 99.730% ( 10, 15 ] 2397 0.105% 99.835% ( 15, 22 ] 389 0.017% 99.852% ( 22, 34 ] 31 0.001% 99.853% ( 34, 51 ] 15 0.001% 99.854% ( 51, 76 ] 25 0.001% 99.855% ( 76, 110 ] 1475 0.065% 99.920% ( 110, 170 ] 1343 0.059% 99.978% ( 170, 250 ] 333 0.015% 99.993% ( 250, 380 ] 256 0.011% 100.004% ( 380, 580 ] 176 0.008% 100.012% ( 580, 870 ] 91 0.004% 100.016% ( 870, 1300 ] 35 0.002% 100.017% ( 1300, 1900 ] 14 0.001% 100.018% ( 1900, 2900 ] 13 0.001% 100.019% ( 2900, 4400 ] 14 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 115178 Average: 2.9971 StdDev: 22.75 Min: 1 Median: 1.6273 Max: 3037 Percentiles: P50: 1.63 P75: 2.05 P99: 7.59 P99.9: 142.24 P99.99: 659.49 ------------------------------------------------------ [ 0, 1 ] 10569 9.176% 9.176% ## ( 1, 2 ] 74961 65.083% 74.259% ############# ( 2, 3 ] 17465 15.163% 89.422% ### ( 3, 4 ] 6008 5.216% 94.639% # ( 4, 6 ] 4534 3.937% 98.575% # ( 6, 10 ] 1233 1.071% 99.646% ( 10, 15 ] 207 0.180% 99.825% ( 15, 22 ] 29 0.025% 99.851% ( 22, 34 ] 4 0.003% 99.854% ( 51, 76 ] 3 0.003% 99.857% ( 76, 110 ] 2 0.002% 99.858% ( 110, 170 ] 89 0.077% 99.936% ( 170, 250 ] 25 0.022% 99.957% ( 250, 380 ] 12 0.010% 99.968% ( 380, 580 ] 20 0.017% 99.985% ( 580, 870 ] 20 0.017% 100.003% ( 870, 1300 ] 11 0.010% 100.012% ( 1300, 1900 ] 5 0.004% 100.016% ( 1900, 2900 ] 1 0.001% 100.017% ( 2900, 4400 ] 1 0.001% 100.018% ** Level 2 read latency histogram (micros): Count: 95435 Average: 2.1130 StdDev: 16.04 Min: 1 Median: 1.3810 Max: 2657 Percentiles: P50: 1.38 P75: 1.79 P99: 5.55 P99.9: 10.20 P99.99: 356.45 ------------------------------------------------------ [ 0, 1 ] 25718 26.948% 26.948% ##### ( 1, 2 ] 57749 60.511% 87.460% ############ ( 2, 3 ] 6815 7.141% 94.601% # ( 3, 4 ] 2779 2.912% 97.512% # ( 4, 6 ] 1830 1.918% 99.430% ( 6, 10 ] 446 0.467% 99.897% ( 10, 15 ] 64 0.067% 99.964% ( 15, 22 ] 12 0.013% 99.977% ( 22, 34 ] 2 0.002% 99.979% ( 34, 51 ] 1 0.001% 99.980% ( 51, 76 ] 3 0.003% 99.983% ( 76, 110 ] 1 0.001% 99.984% ( 110, 170 ] 1 0.001% 99.985% ( 170, 250 ] 2 0.002% 99.987% ( 250, 380 ] 3 0.003% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 67121 Average: 4.4758 StdDev: 63.24 Min: 0 Median: 1.6283 Max: 5549 Percentiles: P50: 1.63 P75: 2.07 P99: 8.87 P99.9: 405.03 P99.99: 2757.58 ------------------------------------------------------ [ 0, 1 ] 6383 9.510% 9.510% ## ( 1, 2 ] 43258 64.448% 73.957% ############# ( 2, 3 ] 10207 15.207% 89.164% ### ( 3, 4 ] 3474 5.176% 94.340% # ( 4, 6 ] 2693 4.012% 98.352% # ( 6, 10 ] 605 0.901% 99.254% ( 10, 15 ] 118 0.176% 99.429% ( 15, 22 ] 11 0.016% 99.446% ( 22, 34 ] 33 0.049% 99.495% ( 34, 51 ] 16 0.024% 99.519% ( 51, 76 ] 2 0.003% 99.522% ( 76, 110 ] 54 0.080% 99.602% ( 110, 170 ] 127 0.189% 99.791% ( 170, 250 ] 42 0.063% 99.854% ( 250, 380 ] 28 0.042% 99.896% ( 380, 580 ] 23 0.034% 99.930% ( 580, 870 ] 17 0.025% 99.955% ( 870, 1300 ] 12 0.018% 99.973% ( 1300, 1900 ] 7 0.010% 99.984% ( 1900, 2900 ] 5 0.007% 99.991% ( 2900, 4400 ] 5 0.007% 99.999% ( 4400, 6600 ] 5 0.007% 100.006% ** Level 4 read latency histogram (micros): Count: 35 Average: 644.9143 StdDev: 1068.71 Min: 1 Median: 162.5000 Max: 4938 Percentiles: P50: 162.50 P75: 896.88 P99: 4938.00 P99.9: 4938.00 P99.99: 4938.00 ------------------------------------------------------ [ 0, 1 ] 4 11.429% 11.429% ## ( 1, 2 ] 6 17.143% 28.571% ### ( 2, 3 ] 1 2.857% 31.429% # ( 3, 4 ] 1 2.857% 34.286% # ( 6, 10 ] 1 2.857% 37.143% # ( 51, 76 ] 1 2.857% 40.000% # ( 110, 170 ] 4 11.429% 51.429% ## ( 170, 250 ] 3 8.571% 60.000% ## ( 250, 380 ] 2 5.714% 65.714% # ( 580, 870 ] 3 8.571% 74.286% ## ( 870, 1300 ] 4 11.429% 85.714% ## ( 1300, 1900 ] 2 5.714% 91.429% # ( 2900, 4400 ] 2 5.714% 97.143% # ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 100 Average: 601.8400 StdDev: 740.78 Min: 75 Median: 184.5455 Max: 3178 Percentiles: P50: 184.55 P75: 870.00 P99: 3178.00 P99.9: 3178.00 P99.99: 3178.00 ------------------------------------------------------ ( 51, 76 ] 2 2.000% 2.000% ( 76, 110 ] 20 20.000% 22.000% #### ( 110, 170 ] 26 26.000% 48.000% ##### ( 170, 250 ] 11 11.000% 59.000% ## ( 250, 380 ] 2 2.000% 61.000% ( 380, 580 ] 10 10.000% 71.000% ## ( 580, 870 ] 4 4.000% 75.000% # ( 870, 1300 ] 8 8.000% 83.000% ## ( 1300, 1900 ] 7 7.000% 90.000% # ( 1900, 2900 ] 8 8.000% 98.000% ## ( 2900, 4400 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 23.7 total, 6.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 249.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.712 H:M:S, 32.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 151.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.779 H:M:S, 58.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-15:11:57 ... thread 0: (1000000,7000000) ops and (309699.8,262494.5) ops/second in (3.228933,26.667223) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/10 3.56 GB 157.4 5.8 0.0 5.8 12.5 6.6 0.0 1.9 144.4 308.3 41.44 38.86 116 0.357 6075K 9717 0.0 0.0 L1 13/13 1.43 GB 0.0 2.8 2.8 0.0 2.8 2.8 0.2 1.0 229.1 226.7 12.65 12.02 2 6.325 2942K 29K 0.0 0.0 L2 2/0 54.72 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.4 2.0 253.1 252.9 1.49 1.45 2 0.747 383K 205 0.0 0.0 L3 14/0 926.86 MB 0.9 0.8 0.6 0.2 0.8 0.6 1.1 1.4 205.0 204.8 3.88 3.43 3 1.294 808K 795 0.0 0.0 L4 167/0 9.75 GB 1.0 0.2 0.1 0.0 0.2 0.1 1.6 1.3 201.1 200.1 0.83 0.73 1 0.832 169K 851 0.0 0.0 L5 1052/0 87.05 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/23 102.74 GB 0.0 10.0 3.7 6.3 16.6 10.3 6.0 2.5 169.5 281.7 60.30 56.49 124 0.486 10M 41K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.0 3.7 6.3 16.6 10.3 5.9 2.5 169.5 281.7 60.30 56.49 124 0.486 10M 41K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.0 3.7 6.3 9.9 3.7 0.0 0.0 247.7 246.7 41.27 39.45 27 1.529 10M 41K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 357.7 19.02 17.03 97 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.9 total, 26.7 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.59 GB write, 631.43 MB/s write, 9.98 GB read, 380.06 MB/s read, 60.3 seconds Interval compaction: 16.59 GB write, 636.87 MB/s write, 9.98 GB read, 383.33 MB/s read, 60.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 23, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2622648 Average: 2.3420 StdDev: 14.52 Min: 0 Median: 1.4502 Max: 4223 Percentiles: P50: 1.45 P75: 1.83 P99: 5.81 P99.9: 92.83 P99.99: 222.58 ------------------------------------------------------ [ 0, 1 ] 535936 20.435% 20.435% #### ( 1, 2 ] 1722437 65.675% 86.110% ############# ( 2, 3 ] 225357 8.593% 94.703% ## ( 3, 4 ] 75980 2.897% 97.600% # ( 4, 6 ] 40556 1.546% 99.147% ( 6, 10 ] 15702 0.599% 99.745% ( 10, 15 ] 2817 0.107% 99.853% ( 15, 22 ] 409 0.016% 99.868% ( 22, 34 ] 34 0.001% 99.870% ( 34, 51 ] 17 0.001% 99.870% ( 51, 76 ] 29 0.001% 99.871% ( 76, 110 ] 1522 0.058% 99.929% ( 110, 170 ] 1363 0.052% 99.981% ( 170, 250 ] 348 0.013% 99.995% ( 250, 380 ] 268 0.010% 100.005% ( 380, 580 ] 183 0.007% 100.012% ( 580, 870 ] 96 0.004% 100.015% ( 870, 1300 ] 41 0.002% 100.017% ( 1300, 1900 ] 14 0.001% 100.018% ( 1900, 2900 ] 16 0.001% 100.018% ( 2900, 4400 ] 18 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 195137 Average: 2.8126 StdDev: 18.39 Min: 1 Median: 1.5879 Max: 3037 Percentiles: P50: 1.59 P75: 1.97 P99: 8.07 P99.9: 125.18 P99.99: 576.33 ------------------------------------------------------ [ 0, 1 ] 21613 11.076% 11.076% ## ( 1, 2 ] 129208 66.214% 77.290% ############# ( 2, 3 ] 26282 13.468% 90.758% ### ( 3, 4 ] 8554 4.384% 95.142% # ( 4, 6 ] 6208 3.181% 98.323% # ( 6, 10 ] 2554 1.309% 99.632% ( 10, 15 ] 317 0.162% 99.795% ( 15, 22 ] 36 0.018% 99.813% ( 22, 34 ] 4 0.002% 99.815% ( 51, 76 ] 14 0.007% 99.822% ( 76, 110 ] 123 0.063% 99.885% ( 110, 170 ] 118 0.060% 99.946% ( 170, 250 ] 37 0.019% 99.965% ( 250, 380 ] 23 0.012% 99.976% ( 380, 580 ] 28 0.014% 99.991% ( 580, 870 ] 21 0.011% 100.002% ( 870, 1300 ] 12 0.006% 100.008% ( 1300, 1900 ] 5 0.003% 100.010% ( 1900, 2900 ] 1 0.001% 100.011% ( 2900, 4400 ] 1 0.001% 100.011% ** Level 2 read latency histogram (micros): Count: 95435 Average: 2.1130 StdDev: 16.04 Min: 1 Median: 1.3810 Max: 2657 Percentiles: P50: 1.38 P75: 1.79 P99: 5.55 P99.9: 10.20 P99.99: 356.45 ------------------------------------------------------ [ 0, 1 ] 25718 26.948% 26.948% ##### ( 1, 2 ] 57749 60.511% 87.460% ############ ( 2, 3 ] 6815 7.141% 94.601% # ( 3, 4 ] 2779 2.912% 97.512% # ( 4, 6 ] 1830 1.918% 99.430% ( 6, 10 ] 446 0.467% 99.897% ( 10, 15 ] 64 0.067% 99.964% ( 15, 22 ] 12 0.013% 99.977% ( 22, 34 ] 2 0.002% 99.979% ( 34, 51 ] 1 0.001% 99.980% ( 51, 76 ] 3 0.003% 99.983% ( 76, 110 ] 1 0.001% 99.984% ( 110, 170 ] 1 0.001% 99.985% ( 170, 250 ] 2 0.002% 99.987% ( 250, 380 ] 3 0.003% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 67121 Average: 4.4758 StdDev: 63.24 Min: 0 Median: 1.6283 Max: 5549 Percentiles: P50: 1.63 P75: 2.07 P99: 8.87 P99.9: 405.03 P99.99: 2757.58 ------------------------------------------------------ [ 0, 1 ] 6383 9.510% 9.510% ## ( 1, 2 ] 43258 64.448% 73.957% ############# ( 2, 3 ] 10207 15.207% 89.164% ### ( 3, 4 ] 3474 5.176% 94.340% # ( 4, 6 ] 2693 4.012% 98.352% # ( 6, 10 ] 605 0.901% 99.254% ( 10, 15 ] 118 0.176% 99.429% ( 15, 22 ] 11 0.016% 99.446% ( 22, 34 ] 33 0.049% 99.495% ( 34, 51 ] 16 0.024% 99.519% ( 51, 76 ] 2 0.003% 99.522% ( 76, 110 ] 54 0.080% 99.602% ( 110, 170 ] 127 0.189% 99.791% ( 170, 250 ] 42 0.063% 99.854% ( 250, 380 ] 28 0.042% 99.896% ( 380, 580 ] 23 0.034% 99.930% ( 580, 870 ] 17 0.025% 99.955% ( 870, 1300 ] 12 0.018% 99.973% ( 1300, 1900 ] 7 0.010% 99.984% ( 1900, 2900 ] 5 0.007% 99.991% ( 2900, 4400 ] 5 0.007% 99.999% ( 4400, 6600 ] 5 0.007% 100.006% ** Level 4 read latency histogram (micros): Count: 35 Average: 644.9143 StdDev: 1068.71 Min: 1 Median: 162.5000 Max: 4938 Percentiles: P50: 162.50 P75: 896.88 P99: 4938.00 P99.9: 4938.00 P99.99: 4938.00 ------------------------------------------------------ [ 0, 1 ] 4 11.429% 11.429% ## ( 1, 2 ] 6 17.143% 28.571% ### ( 2, 3 ] 1 2.857% 31.429% # ( 3, 4 ] 1 2.857% 34.286% # ( 6, 10 ] 1 2.857% 37.143% # ( 51, 76 ] 1 2.857% 40.000% # ( 110, 170 ] 4 11.429% 51.429% ## ( 170, 250 ] 3 8.571% 60.000% ## ( 250, 380 ] 2 5.714% 65.714% # ( 580, 870 ] 3 8.571% 74.286% ## ( 870, 1300 ] 4 11.429% 85.714% ## ( 1300, 1900 ] 2 5.714% 91.429% # ( 2900, 4400 ] 2 5.714% 97.143% # ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 100 Average: 601.8400 StdDev: 740.78 Min: 75 Median: 184.5455 Max: 3178 Percentiles: P50: 184.55 P75: 870.00 P99: 3178.00 P99.9: 3178.00 P99.99: 3178.00 ------------------------------------------------------ ( 51, 76 ] 2 2.000% 2.000% ( 76, 110 ] 20 20.000% 22.000% #### ( 110, 170 ] 26 26.000% 48.000% ##### ( 170, 250 ] 11 11.000% 59.000% ## ( 250, 380 ] 2 2.000% 61.000% ( 380, 580 ] 10 10.000% 71.000% ## ( 580, 870 ] 4 4.000% 75.000% # ( 870, 1300 ] 8 8.000% 83.000% ## ( 1300, 1900 ] 7 7.000% 90.000% # ( 1900, 2900 ] 8 8.000% 98.000% ## ( 2900, 4400 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 26.9 total, 3.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 256.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.329 H:M:S, 31.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 304.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.617 H:M:S, 19.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-15:12:10 ... thread 0: (1000000,8000000) ops and (78926.1,203369.3) ops/second in (12.670073,39.337296) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.70 GB 31.5 7.8 0.0 7.8 15.4 7.6 0.0 2.0 149.5 294.0 53.51 48.96 133 0.402 8121K 16K 0.0 0.0 L1 17/17 1.93 GB 0.0 6.0 4.6 1.4 6.0 4.5 0.2 1.3 227.0 224.5 27.22 25.57 3 9.074 6253K 45K 0.0 0.0 L2 1/0 93.16 MB 0.9 0.4 0.2 0.2 0.4 0.2 2.7 2.0 253.1 252.9 1.49 1.45 2 0.747 383K 205 0.0 0.0 L3 17/0 967.87 MB 1.0 2.2 1.2 1.0 2.1 1.1 1.7 1.8 156.9 155.8 14.09 10.03 10 1.409 2243K 15K 0.0 0.0 L4 168/0 9.53 GB 1.0 1.5 1.3 0.2 1.5 1.3 1.6 1.2 153.1 152.3 9.93 6.80 18 0.552 1524K 7653 0.0 0.0 L5 1068/0 88.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/26 103.60 GB 0.0 17.9 7.2 10.6 25.3 14.7 9.2 3.3 172.1 244.0 106.24 92.81 166 0.640 18M 85K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.9 7.2 10.6 25.3 14.7 9.1 3.3 172.1 244.0 106.24 92.81 166 0.640 18M 85K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.9 7.2 10.6 17.8 7.1 0.0 0.0 219.9 218.6 83.16 73.19 56 1.485 18M 85K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 335.8 23.08 19.62 110 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.6 total, 39.3 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.32 GB write, 655.22 MB/s write, 17.86 GB read, 462.14 MB/s read, 106.2 seconds Interval compaction: 25.32 GB write, 659.05 MB/s write, 17.86 GB read, 464.83 MB/s read, 106.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 31, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3525103 Average: 2.7022 StdDev: 24.66 Min: 0 Median: 1.4711 Max: 9311 Percentiles: P50: 1.47 P75: 1.85 P99: 6.92 P99.9: 142.18 P99.99: 385.45 ------------------------------------------------------ [ 0, 1 ] 678144 19.238% 19.238% #### ( 1, 2 ] 2301956 65.302% 84.539% ############# ( 2, 3 ] 324708 9.211% 93.751% ## ( 3, 4 ] 112852 3.201% 96.952% # ( 4, 6 ] 65963 1.871% 98.823% ( 6, 10 ] 27050 0.767% 99.591% ( 10, 15 ] 4294 0.122% 99.712% ( 15, 22 ] 606 0.017% 99.730% ( 22, 34 ] 48 0.001% 99.731% ( 34, 51 ] 24 0.001% 99.732% ( 51, 76 ] 57 0.002% 99.733% ( 76, 110 ] 3902 0.111% 99.844% ( 110, 170 ] 3684 0.105% 99.949% ( 170, 250 ] 834 0.024% 99.972% ( 250, 380 ] 617 0.018% 99.990% ( 380, 580 ] 495 0.014% 100.004% ( 580, 870 ] 253 0.007% 100.011% ( 870, 1300 ] 92 0.003% 100.014% ( 1300, 1900 ] 40 0.001% 100.015% ( 1900, 2900 ] 45 0.001% 100.016% ( 2900, 4400 ] 57 0.002% 100.018% ( 4400, 6600 ] 6 0.000% 100.018% ( 6600, 9900 ] 6 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 868796 Average: 3.9801 StdDev: 49.67 Min: 1 Median: 1.6707 Max: 8128 Percentiles: P50: 1.67 P75: 2.35 P99: 9.19 P99.9: 127.62 P99.99: 211.34 ------------------------------------------------------ [ 0, 1 ] 88642 10.203% 10.203% ## ( 1, 2 ] 515513 59.336% 69.539% ############ ( 2, 3 ] 135824 15.634% 85.173% ### ( 3, 4 ] 54556 6.279% 91.452% # ( 4, 6 ] 51460 5.923% 97.376% # ( 6, 10 ] 17720 2.040% 99.415% ( 10, 15 ] 2952 0.340% 99.755% ( 15, 22 ] 333 0.038% 99.793% ( 22, 34 ] 22 0.003% 99.796% ( 34, 51 ] 7 0.001% 99.797% ( 51, 76 ] 38 0.004% 99.801% ( 76, 110 ] 607 0.070% 99.871% ( 110, 170 ] 862 0.099% 99.970% ( 170, 250 ] 335 0.039% 100.009% ( 250, 380 ] 311 0.036% 100.044% ( 380, 580 ] 301 0.035% 100.079% ( 580, 870 ] 206 0.024% 100.103% ( 870, 1300 ] 125 0.014% 100.117% ( 1300, 1900 ] 61 0.007% 100.124% ( 1900, 2900 ] 41 0.005% 100.129% ( 2900, 4400 ] 58 0.007% 100.136% ( 4400, 6600 ] 14 0.002% 100.137% ( 6600, 9900 ] 4 0.000% 100.138% ** Level 2 read latency histogram (micros): Count: 95435 Average: 2.1130 StdDev: 16.04 Min: 1 Median: 1.3810 Max: 2657 Percentiles: P50: 1.38 P75: 1.79 P99: 5.55 P99.9: 10.20 P99.99: 356.45 ------------------------------------------------------ [ 0, 1 ] 25718 26.948% 26.948% ##### ( 1, 2 ] 57749 60.511% 87.460% ############ ( 2, 3 ] 6815 7.141% 94.601% # ( 3, 4 ] 2779 2.912% 97.512% # ( 4, 6 ] 1830 1.918% 99.430% ( 6, 10 ] 446 0.467% 99.897% ( 10, 15 ] 64 0.067% 99.964% ( 15, 22 ] 12 0.013% 99.977% ( 22, 34 ] 2 0.002% 99.979% ( 34, 51 ] 1 0.001% 99.980% ( 51, 76 ] 3 0.003% 99.983% ( 76, 110 ] 1 0.001% 99.984% ( 110, 170 ] 1 0.001% 99.985% ( 170, 250 ] 2 0.002% 99.987% ( 250, 380 ] 3 0.003% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 382301 Average: 6.9881 StdDev: 90.90 Min: 0 Median: 1.8869 Max: 7659 Percentiles: P50: 1.89 P75: 2.91 P99: 8.65 P99.9: 246.85 P99.99: 412.64 ------------------------------------------------------ [ 0, 1 ] 11766 3.078% 3.078% # ( 1, 2 ] 202268 52.908% 55.986% ########### ( 2, 3 ] 80055 20.940% 76.926% #### ( 3, 4 ] 41978 10.980% 87.906% ## ( 4, 6 ] 38837 10.159% 98.065% ## ( 6, 10 ] 5386 1.409% 99.474% ( 10, 15 ] 759 0.199% 99.673% ( 15, 22 ] 81 0.021% 99.694% ( 22, 34 ] 47 0.012% 99.706% ( 34, 51 ] 37 0.010% 99.716% ( 51, 76 ] 21 0.005% 99.721% ( 76, 110 ] 126 0.033% 99.754% ( 110, 170 ] 306 0.080% 99.834% ( 170, 250 ] 262 0.069% 99.903% ( 250, 380 ] 276 0.072% 99.975% ( 380, 580 ] 354 0.093% 100.067% ( 580, 870 ] 318 0.083% 100.151% ( 870, 1300 ] 204 0.053% 100.204% ( 1300, 1900 ] 85 0.022% 100.226% ( 1900, 2900 ] 66 0.017% 100.244% ( 2900, 4400 ] 96 0.025% 100.269% ( 4400, 6600 ] 28 0.007% 100.276% ( 6600, 9900 ] 1 0.000% 100.276% ** Level 4 read latency histogram (micros): Count: 215 Average: 233.5349 StdDev: 632.48 Min: 1 Median: 2.5250 Max: 4938 Percentiles: P50: 2.52 P75: 187.50 P99: 3968.75 P99.9: 4938.00 P99.99: 4938.00 ------------------------------------------------------ [ 0, 1 ] 31 14.419% 14.419% ### ( 1, 2 ] 66 30.698% 45.116% ###### ( 2, 3 ] 20 9.302% 54.419% ## ( 3, 4 ] 5 2.326% 56.744% ( 4, 6 ] 5 2.326% 59.070% ( 6, 10 ] 8 3.721% 62.791% # ( 22, 34 ] 10 4.651% 67.442% # ( 34, 51 ] 5 2.326% 69.767% ( 51, 76 ] 1 0.465% 70.233% ( 110, 170 ] 5 2.326% 72.558% ( 170, 250 ] 24 11.163% 83.721% ## ( 250, 380 ] 3 1.395% 85.116% ( 380, 580 ] 4 1.860% 86.977% ( 580, 870 ] 12 5.581% 92.558% # ( 870, 1300 ] 6 2.791% 95.349% # ( 1300, 1900 ] 5 2.326% 97.674% ( 2900, 4400 ] 4 1.860% 99.535% ( 4400, 6600 ] 1 0.465% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 858.1833 StdDev: 1069.36 Min: 75 Median: 380.0000 Max: 5211 Percentiles: P50: 380.00 P75: 1185.33 P99: 5211.00 P99.9: 5211.00 P99.99: 5211.00 ------------------------------------------------------ ( 51, 76 ] 2 1.111% 1.111% ( 76, 110 ] 23 12.778% 13.889% ### ( 110, 170 ] 35 19.444% 33.333% #### ( 170, 250 ] 17 9.444% 42.778% ## ( 250, 380 ] 13 7.222% 50.000% # ( 380, 580 ] 17 9.444% 59.444% ## ( 580, 870 ] 17 9.444% 68.889% ## ( 870, 1300 ] 15 8.333% 77.222% ## ( 1300, 1900 ] 12 6.667% 83.889% # ( 1900, 2900 ] 15 8.333% 92.222% ## ( 2900, 4400 ] 11 6.111% 98.333% # ( 4400, 6600 ] 3 1.667% 100.000% ** DB Stats ** Uptime(secs): 39.6 total, 12.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 198.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.857 H:M:S, 45.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 77.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.528 H:M:S, 75.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-15:12:27 ... thread 0: (1000000,9000000) ops and (57537.7,158682.0) ops/second in (17.379907,56.717203) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/3 1.53 GB 12.6 10.0 0.0 10.0 18.4 8.5 0.0 2.2 153.9 284.7 66.29 59.81 150 0.442 10M 22K 0.0 0.0 L1 1/1 109.60 MB 0.0 10.1 6.7 3.4 9.9 6.6 0.2 1.5 223.0 220.3 46.15 42.67 4 11.537 9467K 45K 0.0 0.0 L2 10/8 1.01 GB 2.4 0.4 0.2 0.2 0.4 0.2 6.5 2.0 253.1 252.9 1.49 1.45 2 0.747 383K 205 0.0 0.0 L3 46/11 3.87 GB 3.0 3.3 2.0 1.3 3.3 2.0 3.8 1.7 141.8 140.9 23.93 15.94 18 1.329 3316K 22K 0.0 0.0 L4 168/5 9.53 GB 1.0 1.5 1.3 0.2 1.5 1.3 1.6 1.2 153.1 152.3 9.93 6.80 18 0.552 1524K 7653 0.0 0.0 L5 1068/0 88.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/28 104.45 GB 0.0 25.2 10.1 15.1 33.5 18.4 15.2 3.9 174.5 232.1 147.79 126.68 192 0.770 25M 98K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.2 10.1 15.1 33.5 18.4 15.1 3.9 174.5 232.1 147.79 126.68 192 0.770 25M 98K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.2 10.1 15.1 25.0 9.9 0.0 0.0 212.9 211.4 121.13 104.58 70 1.730 25M 98K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 326.0 26.67 22.09 122 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.9 total, 56.7 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.50 GB write, 602.33 MB/s write, 25.18 GB read, 452.83 MB/s read, 147.8 seconds Interval compaction: 33.50 GB write, 604.77 MB/s write, 25.18 GB read, 454.67 MB/s read, 147.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 23, pending-compaction-bytes-stops: 0, total-delays: 35, total-stops: 45, interval: 80 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4435944 Average: 2.8936 StdDev: 35.71 Min: 0 Median: 1.4736 Max: 40775 Percentiles: P50: 1.47 P75: 1.86 P99: 7.69 P99.9: 156.57 P99.99: 453.32 ------------------------------------------------------ [ 0, 1 ] 852893 19.227% 19.227% #### ( 1, 2 ] 2882252 64.975% 84.202% ############# ( 2, 3 ] 409523 9.232% 93.434% ## ( 3, 4 ] 144772 3.264% 96.697% # ( 4, 6 ] 86247 1.944% 98.642% ( 6, 10 ] 37711 0.850% 99.492% ( 10, 15 ] 5672 0.128% 99.620% ( 15, 22 ] 891 0.020% 99.640% ( 22, 34 ] 61 0.001% 99.641% ( 34, 51 ] 27 0.001% 99.642% ( 51, 76 ] 83 0.002% 99.644% ( 76, 110 ] 6567 0.148% 99.792% ( 110, 170 ] 6196 0.140% 99.931% ( 170, 250 ] 1373 0.031% 99.962% ( 250, 380 ] 956 0.022% 99.984% ( 380, 580 ] 754 0.017% 100.001% ( 580, 870 ] 373 0.008% 100.009% ( 870, 1300 ] 132 0.003% 100.012% ( 1300, 1900 ] 64 0.001% 100.014% ( 1900, 2900 ] 63 0.001% 100.015% ( 2900, 4400 ] 85 0.002% 100.017% ( 4400, 6600 ] 14 0.000% 100.017% ( 6600, 9900 ] 8 0.000% 100.017% ( 14000, 22000 ] 2 0.000% 100.017% ( 33000, 50000 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 1783911 Average: 5.1031 StdDev: 113.16 Min: 1 Median: 1.6337 Max: 49751 Percentiles: P50: 1.63 P75: 2.31 P99: 9.25 P99.9: 136.28 P99.99: 268.17 ------------------------------------------------------ [ 0, 1 ] 257568 14.438% 14.438% ### ( 1, 2 ] 1001111 56.119% 70.557% ########### ( 2, 3 ] 258934 14.515% 85.072% ### ( 3, 4 ] 111852 6.270% 91.342% # ( 4, 6 ] 108802 6.099% 97.441% # ( 6, 10 ] 34212 1.918% 99.359% ( 10, 15 ] 6267 0.351% 99.710% ( 15, 22 ] 856 0.048% 99.758% ( 22, 34 ] 56 0.003% 99.762% ( 34, 51 ] 12 0.001% 99.762% ( 51, 76 ] 123 0.007% 99.769% ( 76, 110 ] 1547 0.087% 99.856% ( 110, 170 ] 1799 0.101% 99.957% ( 170, 250 ] 519 0.029% 99.986% ( 250, 380 ] 541 0.030% 100.016% ( 380, 580 ] 606 0.034% 100.050% ( 580, 870 ] 547 0.031% 100.081% ( 870, 1300 ] 356 0.020% 100.101% ( 1300, 1900 ] 184 0.010% 100.111% ( 1900, 2900 ] 181 0.010% 100.121% ( 2900, 4400 ] 312 0.017% 100.139% ( 4400, 6600 ] 111 0.006% 100.145% ( 6600, 9900 ] 35 0.002% 100.147% ( 9900, 14000 ] 2 0.000% 100.147% ( 14000, 22000 ] 4 0.000% 100.147% ( 22000, 33000 ] 1 0.000% 100.147% ( 33000, 50000 ] 4 0.000% 100.147% ** Level 2 read latency histogram (micros): Count: 95918 Average: 3.3795 StdDev: 61.43 Min: 1 Median: 1.3835 Max: 6687 Percentiles: P50: 1.38 P75: 1.80 P99: 5.64 P99.9: 16.66 P99.99: 3640.82 ------------------------------------------------------ [ 0, 1 ] 25730 26.825% 26.825% ##### ( 1, 2 ] 57966 60.433% 87.258% ############ ( 2, 3 ] 6921 7.216% 94.473% # ( 3, 4 ] 2822 2.942% 97.416% # ( 4, 6 ] 1855 1.934% 99.349% ( 6, 10 ] 458 0.477% 99.827% ( 10, 15 ] 67 0.070% 99.897% ( 15, 22 ] 13 0.014% 99.910% ( 22, 34 ] 2 0.002% 99.912% ( 34, 51 ] 1 0.001% 99.913% ( 51, 76 ] 3 0.003% 99.917% ( 76, 110 ] 1 0.001% 99.918% ( 110, 170 ] 1 0.001% 99.919% ( 170, 250 ] 3 0.003% 99.922% ( 250, 380 ] 6 0.006% 99.928% ( 380, 580 ] 6 0.006% 99.934% ( 580, 870 ] 6 0.006% 99.941% ( 870, 1300 ] 16 0.017% 99.957% ( 1300, 1900 ] 14 0.015% 99.972% ( 1900, 2900 ] 10 0.010% 99.982% ( 2900, 4400 ] 15 0.016% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 468134 Average: 9.4265 StdDev: 187.05 Min: 0 Median: 1.9107 Max: 52537 Percentiles: P50: 1.91 P75: 2.95 P99: 9.47 P99.9: 506.89 P99.99: 715.12 ------------------------------------------------------ [ 0, 1 ] 13158 2.811% 2.811% # ( 1, 2 ] 242559 51.814% 54.625% ########## ( 2, 3 ] 100512 21.471% 76.096% #### ( 3, 4 ] 51629 11.029% 87.124% ## ( 4, 6 ] 49053 10.478% 97.603% ## ( 6, 10 ] 7538 1.610% 99.213% ( 10, 15 ] 1406 0.300% 99.513% ( 15, 22 ] 141 0.030% 99.543% ( 22, 34 ] 52 0.011% 99.554% ( 34, 51 ] 38 0.008% 99.563% ( 51, 76 ] 22 0.005% 99.567% ( 76, 110 ] 126 0.027% 99.594% ( 110, 170 ] 331 0.071% 99.665% ( 170, 250 ] 346 0.074% 99.739% ( 250, 380 ] 411 0.088% 99.827% ( 380, 580 ] 542 0.116% 99.942% ( 580, 870 ] 479 0.102% 100.045% ( 870, 1300 ] 325 0.069% 100.114% ( 1300, 1900 ] 156 0.033% 100.147% ( 1900, 2900 ] 143 0.031% 100.178% ( 2900, 4400 ] 181 0.039% 100.217% ( 4400, 6600 ] 64 0.014% 100.230% ( 6600, 9900 ] 7 0.001% 100.232% ( 14000, 22000 ] 1 0.000% 100.232% ( 22000, 33000 ] 2 0.000% 100.232% ( 33000, 50000 ] 2 0.000% 100.233% ( 50000, 75000 ] 2 0.000% 100.233% ** Level 4 read latency histogram (micros): Count: 215 Average: 233.5349 StdDev: 632.48 Min: 1 Median: 2.5250 Max: 4938 Percentiles: P50: 2.52 P75: 187.50 P99: 3968.75 P99.9: 4938.00 P99.99: 4938.00 ------------------------------------------------------ [ 0, 1 ] 31 14.419% 14.419% ### ( 1, 2 ] 66 30.698% 45.116% ###### ( 2, 3 ] 20 9.302% 54.419% ## ( 3, 4 ] 5 2.326% 56.744% ( 4, 6 ] 5 2.326% 59.070% ( 6, 10 ] 8 3.721% 62.791% # ( 22, 34 ] 10 4.651% 67.442% # ( 34, 51 ] 5 2.326% 69.767% ( 51, 76 ] 1 0.465% 70.233% ( 110, 170 ] 5 2.326% 72.558% ( 170, 250 ] 24 11.163% 83.721% ## ( 250, 380 ] 3 1.395% 85.116% ( 380, 580 ] 4 1.860% 86.977% ( 580, 870 ] 12 5.581% 92.558% # ( 870, 1300 ] 6 2.791% 95.349% # ( 1300, 1900 ] 5 2.326% 97.674% ( 2900, 4400 ] 4 1.860% 99.535% ( 4400, 6600 ] 1 0.465% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 858.1833 StdDev: 1069.36 Min: 75 Median: 380.0000 Max: 5211 Percentiles: P50: 380.00 P75: 1185.33 P99: 5211.00 P99.9: 5211.00 P99.99: 5211.00 ------------------------------------------------------ ( 51, 76 ] 2 1.111% 1.111% ( 76, 110 ] 23 12.778% 13.889% ### ( 110, 170 ] 35 19.444% 33.333% #### ( 170, 250 ] 17 9.444% 42.778% ## ( 250, 380 ] 13 7.222% 50.000% # ( 380, 580 ] 17 9.444% 59.444% ## ( 580, 870 ] 17 9.444% 68.889% ## ( 870, 1300 ] 15 8.333% 77.222% ## ( 1300, 1900 ] 12 6.667% 83.889% # ( 1900, 2900 ] 15 8.333% 92.222% ## ( 2900, 4400 ] 11 6.111% 98.333% # ( 4400, 6600 ] 3 1.667% 100.000% ** DB Stats ** Uptime(secs): 56.9 total, 17.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 155.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.188 H:M:S, 56.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 56.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:14.331 H:M:S, 82.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.366 micros/op 157076 ops/sec 60.003 seconds 9424999 operations; 152.2 MB/s Microseconds per write: Count: 9424999 Average: 6.3663 StdDev: 535.25 Min: 1 Median: 1.7359 Max: 746791 Percentiles: P50: 1.74 P75: 2.70 P99: 9.31 P99.9: 1179.46 P99.99: 2720.70 ------------------------------------------------------ [ 0, 1 ] 1292912 13.718% 13.718% ### ( 1, 2 ] 4646872 49.304% 63.022% ########## ( 2, 3 ] 1611429 17.097% 80.119% ### ( 3, 4 ] 1238206 13.137% 93.256% ### ( 4, 6 ] 449449 4.769% 98.025% # ( 6, 10 ] 110915 1.177% 99.202% ( 10, 15 ] 34514 0.366% 99.568% ( 15, 22 ] 7813 0.083% 99.651% ( 22, 34 ] 1739 0.018% 99.669% ( 34, 51 ] 171 0.002% 99.671% ( 51, 76 ] 28 0.000% 99.672% ( 76, 110 ] 6773 0.072% 99.743% ( 110, 170 ] 2366 0.025% 99.769% ( 170, 250 ] 264 0.003% 99.771% ( 250, 380 ] 157 0.002% 99.773% ( 380, 580 ] 20 0.000% 99.773% ( 580, 870 ] 23 0.000% 99.773% ( 870, 1300 ] 16567 0.176% 99.949% ( 1300, 1900 ] 37 0.000% 99.950% ( 1900, 2900 ] 4632 0.049% 99.999% ( 2900, 4400 ] 59 0.001% 99.999% ( 4400, 6600 ] 10 0.000% 100.000% ( 6600, 9900 ] 8 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 5 0.000% 100.000% ( 22000, 33000 ] 5 0.000% 100.000% ( 110000, 170000 ] 4 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 209893 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9424999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9726598968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 530 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34147496 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32284955278 rocksdb.compact.write.bytes COUNT : 32065629620 rocksdb.flush.write.bytes COUNT : 9578219976 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 43 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 251 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9501128704 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3817472 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32374265985 rocksdb.non.last.level.read.count COUNT : 7823164 rocksdb.block.checksum.compute.count COUNT : 7822147 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.377329 P95 : 3.859271 P99 : 7.867524 P100 : 746782.000000 COUNT : 9424999 SUM : 55517623 rocksdb.compaction.times.micros P50 : 1053448.275862 P95 : 4575000.000000 P99 : 18200000.000000 P100 : 18924217.000000 COUNT : 95 SUM : 149362537 rocksdb.compaction.times.cpu_micros P50 : 880731.707317 P95 : 3775000.000000 P99 : 14400000.000000 P100 : 17102254.000000 COUNT : 95 SUM : 120747356 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 665.158730 P95 : 6215.000000 P99 : 19840.000000 P100 : 135481.000000 COUNT : 127 SUM : 281575 rocksdb.compaction.outfile.sync.micros P50 : 1167.416667 P95 : 91406.250000 P99 : 214666.666667 P100 : 283939.000000 COUNT : 365 SUM : 6339617 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 116.000000 P95 : 1787.500000 P99 : 4235.000000 P100 : 5209.000000 COUNT : 255 SUM : 90917 rocksdb.table.open.io.micros P50 : 1543.564356 P95 : 6325.000000 P99 : 10895.714286 P100 : 12646.000000 COUNT : 530 SUM : 1071115 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.616622 P95 : 7.930606 P99 : 12.523306 P100 : 52541.000000 COUNT : 7820831 SUM : 53965585 rocksdb.read.block.get.micros P50 : 483.225806 P95 : 3179.069767 P99 : 5485.333333 P100 : 10086.000000 COUNT : 1060 SUM : 904713 rocksdb.write.raw.block.micros P50 : 0.513337 P95 : 0.975340 P99 : 2.746448 P100 : 27782.000000 COUNT : 10091128 SUM : 22040857 rocksdb.numfiles.in.singlecompaction P50 : 3.086420 P95 : 4.280000 P99 : 16.190000 P100 : 22.000000 COUNT : 166 SUM : 574 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558637 P95 : 1157.828022 P99 : 2471.931917 P100 : 746615.000000 COUNT : 203325 SUM : 34165748 rocksdb.sst.read.micros P50 : 1.587799 P95 : 4.766156 P99 : 9.084240 P100 : 52537.000000 COUNT : 7823655 SUM : 37668187 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9424999 SUM : 9726598968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210526.315789 P95 : 556700.000000 P99 : 948659.000000 P100 : 948659.000000 COUNT : 127 SUM : 29970519 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 339 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0