[2024-11-28 13:37:03.168298] Starting SPDK v25.01-pre git sha1 35cd3e84d / DPDK 22.11.4 initialization... [2024-11-28 13:37:03.168595] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1718996 ] Set seed to 1732797423161714 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-28 13:37:03.275285] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-28 13:37:03.296952] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-28 13:37:03.296997] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1718996' to capture a snapshot of events at runtime. [2024-11-28 13:37:03.297007] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-28 13:37:03.297017] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-28 13:37:03.297025] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1718996 for offline analysis/debug. [2024-11-28 13:37:03.297579] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Nov 28 13:37:07 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/28-13:37:10 ... thread 0: (1000000,1000000) ops and (330911.5,330911.5) ops/second in (3.021956,3.021956) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 692.97 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 343.8 2.57 2.33 12 0.214 0 0 0.0 0.0 L2 3/2 237.17 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 247.0 246.8 1.41 1.36 2 0.706 354K 179 0.0 0.0 L3 9/0 755.92 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 87.7 309.4 3.98 3.69 14 0.284 354K 179 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 87.7 309.4 3.98 3.69 14 0.284 354K 179 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 247.0 246.8 1.41 1.36 2 0.706 354K 179 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 343.8 2.57 2.33 12 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 383.29 MB/s write, 0.34 GB read, 108.63 MB/s read, 4.0 seconds Interval compaction: 1.20 GB write, 407.00 MB/s write, 0.34 GB read, 115.34 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 134176 Average: 2.0415 StdDev: 16.68 Min: 0 Median: 1.3417 Max: 3297 Percentiles: P50: 1.34 P75: 1.76 P99: 5.30 P99.9: 10.45 P99.99: 19.12 ------------------------------------------------------ [ 0, 1 ] 39471 29.417% 29.417% ###### ( 1, 2 ] 80812 60.228% 89.646% ############ ( 2, 3 ] 8005 5.966% 95.612% # ( 3, 4 ] 3336 2.486% 98.098% ( 4, 6 ] 1857 1.384% 99.482% ( 6, 10 ] 550 0.410% 99.892% ( 10, 15 ] 121 0.090% 99.982% ( 15, 22 ] 18 0.013% 99.996% ( 34, 51 ] 1 0.001% 99.996% ( 110, 170 ] 9 0.007% 100.003% ( 170, 250 ] 1 0.001% 100.004% ( 250, 380 ] 4 0.003% 100.007% ( 580, 870 ] 1 0.001% 100.007% ( 870, 1300 ] 3 0.002% 100.010% ( 1300, 1900 ] 3 0.002% 100.012% ( 1900, 2900 ] 1 0.001% 100.013% ( 2900, 4400 ] 2 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 12294 Average: 3.3025 StdDev: 50.13 Min: 1 Median: 1.2552 Max: 3956 Percentiles: P50: 1.26 P75: 1.72 P99: 9.34 P99.9: 247.39 P99.99: 3477.95 ------------------------------------------------------ [ 0, 1 ] 4456 36.245% 36.245% ####### ( 1, 2 ] 6627 53.904% 90.150% ########### ( 2, 3 ] 725 5.897% 96.047% # ( 3, 4 ] 108 0.878% 96.925% ( 4, 6 ] 159 1.293% 98.219% ( 6, 10 ] 115 0.935% 99.154% ( 10, 15 ] 21 0.171% 99.325% ( 15, 22 ] 10 0.081% 99.406% ( 34, 51 ] 25 0.203% 99.610% ( 51, 76 ] 17 0.138% 99.748% ( 76, 110 ] 6 0.049% 99.797% ( 110, 170 ] 4 0.033% 99.829% ( 170, 250 ] 9 0.073% 99.902% ( 250, 380 ] 1 0.008% 99.911% ( 380, 580 ] 5 0.041% 99.951% ( 580, 870 ] 3 0.024% 99.976% ( 870, 1300 ] 1 0.008% 99.984% ( 2900, 4400 ] 2 0.016% 100.000% ** Level 2 read latency histogram (micros): Count: 69107 Average: 1.9751 StdDev: 6.55 Min: 0 Median: 1.3625 Max: 1258 Percentiles: P50: 1.36 P75: 1.77 P99: 5.31 P99.9: 10.75 P99.99: 199.05 ------------------------------------------------------ [ 0, 1 ] 19072 27.598% 27.598% ###### ( 1, 2 ] 42706 61.797% 89.395% ############ ( 2, 3 ] 4268 6.176% 95.571% # ( 3, 4 ] 1718 2.486% 98.057% ( 4, 6 ] 997 1.443% 99.499% ( 6, 10 ] 268 0.388% 99.887% ( 10, 15 ] 59 0.085% 99.973% ( 15, 22 ] 9 0.013% 99.986% ( 110, 170 ] 2 0.003% 99.988% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 45 Average: 1621.4889 StdDev: 1436.97 Min: 324 Median: 905.8333 Max: 5782 Percentiles: P50: 905.83 P75: 2358.33 P99: 5782.00 P99.9: 5782.00 P99.99: 5782.00 ------------------------------------------------------ ( 250, 380 ] 3 6.667% 6.667% # ( 380, 580 ] 7 15.556% 22.222% ### ( 580, 870 ] 12 26.667% 48.889% ##### ( 870, 1300 ] 6 13.333% 62.222% ### ( 1300, 1900 ] 3 6.667% 68.889% # ( 1900, 2900 ] 6 13.333% 82.222% ### ( 2900, 4400 ] 5 11.111% 93.333% ## ( 4400, 6600 ] 3 6.667% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1740.0667 StdDev: 1424.78 Min: 339 Median: 1054.2857 Max: 5563 Percentiles: P50: 1054.29 P75: 3181.25 P99: 5563.00 P99.9: 5563.00 P99.99: 5563.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 5 16.667% 20.000% ### ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 7 23.333% 63.333% ##### ( 1900, 2900 ] 2 6.667% 70.000% # ( 2900, 4400 ] 8 26.667% 96.667% ##### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 306.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.420 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.420 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/28-13:37:13 ... thread 0: (1000000,2000000) ops and (327561.6,329228.0) ops/second in (3.052861,6.074817) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 0.9 0.0 0.9 2.7 1.8 0.0 1.5 100.4 315.5 8.78 8.16 29 0.303 895K 972 0.0 0.0 L1 1/0 2.64 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 238.9 238.6 1.32 1.28 1 1.318 319K 395 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 247.0 246.8 1.41 1.36 2 0.706 354K 179 0.0 0.0 L3 25/0 972.25 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 197.4 197.2 3.48 3.03 3 1.159 697K 571 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1233/4 97.98 GB 0.0 2.2 1.0 1.2 4.0 2.8 0.8 2.2 148.9 274.8 14.99 13.84 35 0.428 2266K 2117 0.0 0.0 Int 0/0 0.00 KB 0.0 2.2 1.0 1.2 4.0 2.8 0.8 2.2 148.9 274.8 14.99 13.84 35 0.428 2266K 2117 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.2 1.0 1.2 2.2 1.0 0.0 0.0 233.9 233.7 9.54 8.94 9 1.060 2266K 2117 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 347.0 5.45 4.90 26 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.02 GB write, 657.80 MB/s write, 2.18 GB read, 356.40 MB/s read, 15.0 seconds Interval compaction: 4.02 GB write, 678.04 MB/s write, 2.18 GB read, 367.37 MB/s read, 15.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 404800 Average: 2.1033 StdDev: 12.14 Min: 0 Median: 1.4208 Max: 3297 Percentiles: P50: 1.42 P75: 1.82 P99: 5.53 P99.9: 10.82 P99.99: 15.19 ------------------------------------------------------ [ 0, 1 ] 95017 23.473% 23.473% ##### ( 1, 2 ] 255173 63.037% 86.509% ############# ( 2, 3 ] 31869 7.873% 94.382% ## ( 3, 4 ] 13000 3.211% 97.594% # ( 4, 6 ] 7447 1.840% 99.433% ( 6, 10 ] 1818 0.449% 99.882% ( 10, 15 ] 434 0.107% 99.990% ( 15, 22 ] 57 0.014% 100.004% ( 22, 34 ] 2 0.000% 100.004% ( 34, 51 ] 2 0.000% 100.005% ( 51, 76 ] 1 0.000% 100.005% ( 110, 170 ] 13 0.003% 100.008% ( 170, 250 ] 9 0.002% 100.010% ( 250, 380 ] 9 0.002% 100.013% ( 380, 580 ] 2 0.000% 100.013% ( 580, 870 ] 10 0.002% 100.016% ( 870, 1300 ] 7 0.002% 100.017% ( 1300, 1900 ] 4 0.001% 100.018% ( 1900, 2900 ] 1 0.000% 100.019% ( 2900, 4400 ] 3 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 91474 Average: 2.5305 StdDev: 19.40 Min: 1 Median: 1.5901 Max: 3956 Percentiles: P50: 1.59 P75: 1.98 P99: 6.21 P99.9: 14.89 P99.99: 152.79 ------------------------------------------------------ [ 0, 1 ] 11040 12.069% 12.069% ## ( 1, 2 ] 58798 64.278% 76.347% ############# ( 2, 3 ] 13418 14.669% 91.016% ### ( 3, 4 ] 4108 4.491% 95.507% # ( 4, 6 ] 3159 3.453% 98.960% # ( 6, 10 ] 704 0.770% 99.730% ( 10, 15 ] 159 0.174% 99.904% ( 15, 22 ] 27 0.030% 99.933% ( 34, 51 ] 26 0.028% 99.962% ( 51, 76 ] 17 0.019% 99.980% ( 76, 110 ] 6 0.007% 99.987% ( 110, 170 ] 4 0.004% 99.991% ( 170, 250 ] 9 0.010% 100.001% ( 250, 380 ] 4 0.004% 100.005% ( 380, 580 ] 6 0.007% 100.012% ( 580, 870 ] 4 0.004% 100.016% ( 870, 1300 ] 1 0.001% 100.017% ( 1300, 1900 ] 1 0.001% 100.019% ( 2900, 4400 ] 2 0.002% 100.021% ** Level 2 read latency histogram (micros): Count: 75839 Average: 2.0147 StdDev: 6.26 Min: 0 Median: 1.3913 Max: 1258 Percentiles: P50: 1.39 P75: 1.79 P99: 5.45 P99.9: 10.94 P99.99: 181.10 ------------------------------------------------------ [ 0, 1 ] 19496 25.707% 25.707% ##### ( 1, 2 ] 47079 62.078% 87.785% ############ ( 2, 3 ] 5489 7.238% 95.022% # ( 3, 4 ] 2082 2.745% 97.768% # ( 4, 6 ] 1288 1.698% 99.466% ( 6, 10 ] 316 0.417% 99.883% ( 10, 15 ] 70 0.092% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47883 Average: 3.9675 StdDev: 66.72 Min: 0 Median: 1.6193 Max: 5782 Percentiles: P50: 1.62 P75: 2.01 P99: 7.04 P99.9: 172.34 P99.99: 2601.95 ------------------------------------------------------ [ 0, 1 ] 4603 9.613% 9.613% ## ( 1, 2 ] 31224 65.209% 74.822% ############# ( 2, 3 ] 7418 15.492% 90.314% ### ( 3, 4 ] 2366 4.941% 95.255% # ( 4, 6 ] 1693 3.536% 98.791% # ( 6, 10 ] 387 0.808% 99.599% ( 10, 15 ] 84 0.175% 99.774% ( 15, 22 ] 17 0.036% 99.810% ( 22, 34 ] 34 0.071% 99.881% ( 34, 51 ] 4 0.008% 99.889% ( 51, 76 ] 1 0.002% 99.891% ( 110, 170 ] 4 0.008% 99.900% ( 170, 250 ] 4 0.008% 99.908% ( 250, 380 ] 4 0.008% 99.916% ( 380, 580 ] 8 0.017% 99.933% ( 580, 870 ] 13 0.027% 99.960% ( 870, 1300 ] 7 0.015% 99.975% ( 1300, 1900 ] 3 0.006% 99.981% ( 1900, 2900 ] 6 0.013% 99.994% ( 2900, 4400 ] 5 0.010% 100.004% ( 4400, 6600 ] 3 0.006% 100.010% ** Level 4 read latency histogram (micros): Count: 30 Average: 1740.0667 StdDev: 1424.78 Min: 339 Median: 1054.2857 Max: 5563 Percentiles: P50: 1054.29 P75: 3181.25 P99: 5563.00 P99.9: 5563.00 P99.99: 5563.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 5 16.667% 20.000% ### ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 7 23.333% 63.333% ##### ( 1900, 2900 ] 2 6.667% 70.000% # ( 2900, 4400 ] 8 26.667% 96.667% ##### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.3 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 314.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.809 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.389 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-13:37:16 ... thread 0: (1000000,3000000) ops and (359020.9,338594.0) ops/second in (2.785353,8.860170) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 2.21 GB 169.9 1.7 0.0 1.7 4.4 2.7 0.0 1.6 119.1 313.0 14.29 13.34 45 0.317 1727K 1781 0.0 0.0 L1 1/0 2.64 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 238.9 238.6 1.32 1.28 1 1.318 319K 395 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 247.0 246.8 1.41 1.36 2 0.706 354K 179 0.0 0.0 L3 25/0 972.25 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 197.4 197.2 3.48 3.03 3 1.159 697K 571 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1237/8 98.84 GB 0.0 3.0 1.0 2.0 5.7 3.7 0.8 2.1 148.9 284.0 20.49 19.02 51 0.402 3098K 2926 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 1.0 2.0 5.7 3.7 0.8 2.1 148.9 284.0 20.49 19.02 51 0.402 3098K 2926 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 1.0 2.0 3.0 1.0 0.0 0.0 242.2 241.9 12.60 11.93 12 1.050 3098K 2926 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 351.1 7.89 7.08 39 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.68 GB write, 643.19 MB/s write, 2.98 GB read, 337.20 MB/s read, 20.5 seconds Interval compaction: 5.68 GB write, 656.76 MB/s write, 2.98 GB read, 344.31 MB/s read, 20.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 635199 Average: 2.0254 StdDev: 12.95 Min: 0 Median: 1.3720 Max: 3906 Percentiles: P50: 1.37 P75: 1.77 P99: 5.24 P99.9: 10.24 P99.99: 16.65 ------------------------------------------------------ [ 0, 1 ] 170680 26.870% 26.870% ##### ( 1, 2 ] 394922 62.173% 89.043% ############ ( 2, 3 ] 41183 6.483% 95.527% # ( 3, 4 ] 16592 2.612% 98.139% # ( 4, 6 ] 8845 1.392% 99.531% ( 6, 10 ] 2316 0.365% 99.896% ( 10, 15 ] 582 0.092% 99.988% ( 15, 22 ] 74 0.012% 99.999% ( 22, 34 ] 6 0.001% 100.000% ( 34, 51 ] 3 0.000% 100.001% ( 51, 76 ] 3 0.000% 100.001% ( 110, 170 ] 18 0.003% 100.004% ( 170, 250 ] 17 0.003% 100.007% ( 250, 380 ] 13 0.002% 100.009% ( 380, 580 ] 2 0.000% 100.009% ( 580, 870 ] 19 0.003% 100.012% ( 870, 1300 ] 9 0.001% 100.013% ( 1300, 1900 ] 4 0.001% 100.014% ( 1900, 2900 ] 2 0.000% 100.014% ( 2900, 4400 ] 6 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 91474 Average: 2.5305 StdDev: 19.40 Min: 1 Median: 1.5901 Max: 3956 Percentiles: P50: 1.59 P75: 1.98 P99: 6.21 P99.9: 14.89 P99.99: 152.79 ------------------------------------------------------ [ 0, 1 ] 11040 12.069% 12.069% ## ( 1, 2 ] 58798 64.278% 76.347% ############# ( 2, 3 ] 13418 14.669% 91.016% ### ( 3, 4 ] 4108 4.491% 95.507% # ( 4, 6 ] 3159 3.453% 98.960% # ( 6, 10 ] 704 0.770% 99.730% ( 10, 15 ] 159 0.174% 99.904% ( 15, 22 ] 27 0.030% 99.933% ( 34, 51 ] 26 0.028% 99.962% ( 51, 76 ] 17 0.019% 99.980% ( 76, 110 ] 6 0.007% 99.987% ( 110, 170 ] 4 0.004% 99.991% ( 170, 250 ] 9 0.010% 100.001% ( 250, 380 ] 4 0.004% 100.005% ( 380, 580 ] 6 0.007% 100.012% ( 580, 870 ] 4 0.004% 100.016% ( 870, 1300 ] 1 0.001% 100.017% ( 1300, 1900 ] 1 0.001% 100.019% ( 2900, 4400 ] 2 0.002% 100.021% ** Level 2 read latency histogram (micros): Count: 75839 Average: 2.0147 StdDev: 6.26 Min: 0 Median: 1.3913 Max: 1258 Percentiles: P50: 1.39 P75: 1.79 P99: 5.45 P99.9: 10.94 P99.99: 181.10 ------------------------------------------------------ [ 0, 1 ] 19496 25.707% 25.707% ##### ( 1, 2 ] 47079 62.078% 87.785% ############ ( 2, 3 ] 5489 7.238% 95.022% # ( 3, 4 ] 2082 2.745% 97.768% # ( 4, 6 ] 1288 1.698% 99.466% ( 6, 10 ] 316 0.417% 99.883% ( 10, 15 ] 70 0.092% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47883 Average: 3.9675 StdDev: 66.72 Min: 0 Median: 1.6193 Max: 5782 Percentiles: P50: 1.62 P75: 2.01 P99: 7.04 P99.9: 172.34 P99.99: 2601.95 ------------------------------------------------------ [ 0, 1 ] 4603 9.613% 9.613% ## ( 1, 2 ] 31224 65.209% 74.822% ############# ( 2, 3 ] 7418 15.492% 90.314% ### ( 3, 4 ] 2366 4.941% 95.255% # ( 4, 6 ] 1693 3.536% 98.791% # ( 6, 10 ] 387 0.808% 99.599% ( 10, 15 ] 84 0.175% 99.774% ( 15, 22 ] 17 0.036% 99.810% ( 22, 34 ] 34 0.071% 99.881% ( 34, 51 ] 4 0.008% 99.889% ( 51, 76 ] 1 0.002% 99.891% ( 110, 170 ] 4 0.008% 99.900% ( 170, 250 ] 4 0.008% 99.908% ( 250, 380 ] 4 0.008% 99.916% ( 380, 580 ] 8 0.017% 99.933% ( 580, 870 ] 13 0.027% 99.960% ( 870, 1300 ] 7 0.015% 99.975% ( 1300, 1900 ] 3 0.006% 99.981% ( 1900, 2900 ] 6 0.013% 99.994% ( 2900, 4400 ] 5 0.010% 100.004% ( 4400, 6600 ] 3 0.006% 100.010% ** Level 4 read latency histogram (micros): Count: 30 Average: 1740.0667 StdDev: 1424.78 Min: 339 Median: 1054.2857 Max: 5563 Percentiles: P50: 1054.29 P75: 3181.25 P99: 5563.00 P99.9: 5563.00 P99.99: 5563.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 5 16.667% 20.000% ### ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 7 23.333% 63.333% ##### ( 1900, 2900 ] 2 6.667% 70.000% # ( 2900, 4400 ] 8 26.667% 96.667% ##### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.999 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 353.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.189 H:M:S, 6.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-13:37:19 ... thread 0: (1000000,4000000) ops and (333518.5,337310.7) ops/second in (2.998334,11.858504) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.20 GB 44.1 2.5 0.0 2.5 6.1 3.7 0.0 1.7 125.2 312.8 20.13 18.85 62 0.325 2558K 2667 0.0 0.0 L1 1/1 2.64 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 238.9 238.6 1.32 1.28 1 1.318 319K 395 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 247.0 246.8 1.41 1.36 2 0.706 354K 179 0.0 0.0 L3 25/0 972.25 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 197.4 197.2 3.48 3.03 3 1.159 697K 571 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/16 99.82 GB 0.0 3.8 1.0 2.8 7.5 4.7 0.8 2.0 146.9 290.3 26.34 24.52 68 0.387 3929K 3812 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 1.0 2.8 7.5 4.7 0.8 2.0 146.9 290.3 26.34 24.52 68 0.387 3929K 3812 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 1.0 2.8 3.8 1.0 0.0 0.0 247.7 247.5 15.62 14.90 15 1.042 3929K 3812 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 352.7 10.72 9.62 53 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.47 GB write, 634.68 MB/s write, 3.78 GB read, 321.25 MB/s read, 26.3 seconds Interval compaction: 7.47 GB write, 644.68 MB/s write, 3.78 GB read, 326.32 MB/s read, 26.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 948088 Average: 2.0367 StdDev: 11.78 Min: 0 Median: 1.3892 Max: 3906 Percentiles: P50: 1.39 P75: 1.78 P99: 5.15 P99.9: 10.07 P99.99: 17.21 ------------------------------------------------------ [ 0, 1 ] 238994 25.208% 25.208% ##### ( 1, 2 ] 603973 63.704% 88.912% ############# ( 2, 3 ] 64509 6.804% 95.716% # ( 3, 4 ] 24178 2.550% 98.267% # ( 4, 6 ] 12056 1.272% 99.538% ( 6, 10 ] 3419 0.361% 99.899% ( 10, 15 ] 833 0.088% 99.987% ( 15, 22 ] 102 0.011% 99.997% ( 22, 34 ] 11 0.001% 99.999% ( 34, 51 ] 5 0.001% 99.999% ( 51, 76 ] 5 0.001% 100.000% ( 76, 110 ] 35 0.004% 100.003% ( 110, 170 ] 37 0.004% 100.007% ( 170, 250 ] 29 0.003% 100.010% ( 250, 380 ] 22 0.002% 100.013% ( 380, 580 ] 9 0.001% 100.014% ( 580, 870 ] 23 0.002% 100.016% ( 870, 1300 ] 13 0.001% 100.017% ( 1300, 1900 ] 7 0.001% 100.018% ( 1900, 2900 ] 2 0.000% 100.018% ( 2900, 4400 ] 7 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 91475 Average: 2.5305 StdDev: 19.40 Min: 1 Median: 1.5901 Max: 3956 Percentiles: P50: 1.59 P75: 1.98 P99: 6.21 P99.9: 14.89 P99.99: 152.79 ------------------------------------------------------ [ 0, 1 ] 11040 12.069% 12.069% ## ( 1, 2 ] 58799 64.279% 76.348% ############# ( 2, 3 ] 13418 14.668% 91.016% ### ( 3, 4 ] 4108 4.491% 95.507% # ( 4, 6 ] 3159 3.453% 98.960% # ( 6, 10 ] 704 0.770% 99.730% ( 10, 15 ] 159 0.174% 99.904% ( 15, 22 ] 27 0.030% 99.933% ( 34, 51 ] 26 0.028% 99.962% ( 51, 76 ] 17 0.019% 99.980% ( 76, 110 ] 6 0.007% 99.987% ( 110, 170 ] 4 0.004% 99.991% ( 170, 250 ] 9 0.010% 100.001% ( 250, 380 ] 4 0.004% 100.005% ( 380, 580 ] 6 0.007% 100.012% ( 580, 870 ] 4 0.004% 100.016% ( 870, 1300 ] 1 0.001% 100.017% ( 1300, 1900 ] 1 0.001% 100.019% ( 2900, 4400 ] 2 0.002% 100.021% ** Level 2 read latency histogram (micros): Count: 75839 Average: 2.0147 StdDev: 6.26 Min: 0 Median: 1.3913 Max: 1258 Percentiles: P50: 1.39 P75: 1.79 P99: 5.45 P99.9: 10.94 P99.99: 181.10 ------------------------------------------------------ [ 0, 1 ] 19496 25.707% 25.707% ##### ( 1, 2 ] 47079 62.078% 87.785% ############ ( 2, 3 ] 5489 7.238% 95.022% # ( 3, 4 ] 2082 2.745% 97.768% # ( 4, 6 ] 1288 1.698% 99.466% ( 6, 10 ] 316 0.417% 99.883% ( 10, 15 ] 70 0.092% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47883 Average: 3.9675 StdDev: 66.72 Min: 0 Median: 1.6193 Max: 5782 Percentiles: P50: 1.62 P75: 2.01 P99: 7.04 P99.9: 172.34 P99.99: 2601.95 ------------------------------------------------------ [ 0, 1 ] 4603 9.613% 9.613% ## ( 1, 2 ] 31224 65.209% 74.822% ############# ( 2, 3 ] 7418 15.492% 90.314% ### ( 3, 4 ] 2366 4.941% 95.255% # ( 4, 6 ] 1693 3.536% 98.791% # ( 6, 10 ] 387 0.808% 99.599% ( 10, 15 ] 84 0.175% 99.774% ( 15, 22 ] 17 0.036% 99.810% ( 22, 34 ] 34 0.071% 99.881% ( 34, 51 ] 4 0.008% 99.889% ( 51, 76 ] 1 0.002% 99.891% ( 110, 170 ] 4 0.008% 99.900% ( 170, 250 ] 4 0.008% 99.908% ( 250, 380 ] 4 0.008% 99.916% ( 380, 580 ] 8 0.017% 99.933% ( 580, 870 ] 13 0.027% 99.960% ( 870, 1300 ] 7 0.015% 99.975% ( 1300, 1900 ] 3 0.006% 99.981% ( 1900, 2900 ] 6 0.013% 99.994% ( 2900, 4400 ] 5 0.010% 100.004% ( 4400, 6600 ] 3 0.006% 100.010% ** Level 4 read latency histogram (micros): Count: 30 Average: 1740.0667 StdDev: 1424.78 Min: 339 Median: 1054.2857 Max: 5563 Percentiles: P50: 1054.29 P75: 3181.25 P99: 5563.00 P99.9: 5563.00 P99.99: 5563.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 5 16.667% 20.000% ### ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 7 23.333% 63.333% ##### ( 1900, 2900 ] 2 6.667% 70.000% # ( 2900, 4400 ] 8 26.667% 96.667% ##### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 326.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.393 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.394 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-13:37:26 ... thread 0: (1000000,5000000) ops and (149587.9,269635.7) ops/second in (6.685034,18.543538) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 4.18 GB 150.9 4.2 0.0 4.2 8.9 4.7 0.0 1.9 144.9 306.7 29.55 27.86 82 0.360 4349K 5525 0.0 0.0 L1 1/1 2.64 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 238.9 238.6 1.32 1.28 1 1.318 319K 395 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 247.0 246.8 1.41 1.36 2 0.706 354K 179 0.0 0.0 L3 25/0 972.25 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 197.4 197.2 3.48 3.03 3 1.159 697K 571 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/16 100.81 GB 0.0 5.5 1.0 4.5 10.2 5.6 0.8 2.2 157.5 291.2 35.76 33.54 88 0.406 5720K 6670 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.0 4.5 10.2 5.6 0.8 2.2 157.5 291.2 35.76 33.54 88 0.406 5720K 6670 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.0 4.5 5.5 1.0 0.0 0.0 254.7 254.4 22.11 21.31 20 1.106 5720K 6670 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 350.9 13.65 12.23 68 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.7 total, 18.5 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.17 GB write, 555.97 MB/s write, 5.50 GB read, 300.75 MB/s read, 35.8 seconds Interval compaction: 10.17 GB write, 561.57 MB/s write, 5.50 GB read, 303.78 MB/s read, 35.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 15, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1752623 Average: 2.0836 StdDev: 10.69 Min: 0 Median: 1.4219 Max: 3959 Percentiles: P50: 1.42 P75: 1.80 P99: 5.32 P99.9: 9.83 P99.99: 14.89 ------------------------------------------------------ [ 0, 1 ] 389413 22.219% 22.219% #### ( 1, 2 ] 1154140 65.852% 88.071% ############# ( 2, 3 ] 128674 7.342% 95.413% # ( 3, 4 ] 46977 2.680% 98.093% # ( 4, 6 ] 24162 1.379% 99.472% ( 6, 10 ] 7833 0.447% 99.919% ( 10, 15 ] 1278 0.073% 99.992% ( 15, 22 ] 152 0.009% 100.000% ( 22, 34 ] 16 0.001% 100.001% ( 34, 51 ] 8 0.000% 100.002% ( 51, 76 ] 7 0.000% 100.002% ( 76, 110 ] 124 0.007% 100.009% ( 110, 170 ] 157 0.009% 100.018% ( 170, 250 ] 68 0.004% 100.022% ( 250, 380 ] 49 0.003% 100.025% ( 380, 580 ] 31 0.002% 100.027% ( 580, 870 ] 35 0.002% 100.029% ( 870, 1300 ] 21 0.001% 100.030% ( 1300, 1900 ] 10 0.001% 100.030% ( 1900, 2900 ] 6 0.000% 100.031% ( 2900, 4400 ] 8 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 91475 Average: 2.5305 StdDev: 19.40 Min: 1 Median: 1.5901 Max: 3956 Percentiles: P50: 1.59 P75: 1.98 P99: 6.21 P99.9: 14.89 P99.99: 152.79 ------------------------------------------------------ [ 0, 1 ] 11040 12.069% 12.069% ## ( 1, 2 ] 58799 64.279% 76.348% ############# ( 2, 3 ] 13418 14.668% 91.016% ### ( 3, 4 ] 4108 4.491% 95.507% # ( 4, 6 ] 3159 3.453% 98.960% # ( 6, 10 ] 704 0.770% 99.730% ( 10, 15 ] 159 0.174% 99.904% ( 15, 22 ] 27 0.030% 99.933% ( 34, 51 ] 26 0.028% 99.962% ( 51, 76 ] 17 0.019% 99.980% ( 76, 110 ] 6 0.007% 99.987% ( 110, 170 ] 4 0.004% 99.991% ( 170, 250 ] 9 0.010% 100.001% ( 250, 380 ] 4 0.004% 100.005% ( 380, 580 ] 6 0.007% 100.012% ( 580, 870 ] 4 0.004% 100.016% ( 870, 1300 ] 1 0.001% 100.017% ( 1300, 1900 ] 1 0.001% 100.019% ( 2900, 4400 ] 2 0.002% 100.021% ** Level 2 read latency histogram (micros): Count: 75839 Average: 2.0147 StdDev: 6.26 Min: 0 Median: 1.3913 Max: 1258 Percentiles: P50: 1.39 P75: 1.79 P99: 5.45 P99.9: 10.94 P99.99: 181.10 ------------------------------------------------------ [ 0, 1 ] 19496 25.707% 25.707% ##### ( 1, 2 ] 47079 62.078% 87.785% ############ ( 2, 3 ] 5489 7.238% 95.022% # ( 3, 4 ] 2082 2.745% 97.768% # ( 4, 6 ] 1288 1.698% 99.466% ( 6, 10 ] 316 0.417% 99.883% ( 10, 15 ] 70 0.092% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47883 Average: 3.9675 StdDev: 66.72 Min: 0 Median: 1.6193 Max: 5782 Percentiles: P50: 1.62 P75: 2.01 P99: 7.04 P99.9: 172.34 P99.99: 2601.95 ------------------------------------------------------ [ 0, 1 ] 4603 9.613% 9.613% ## ( 1, 2 ] 31224 65.209% 74.822% ############# ( 2, 3 ] 7418 15.492% 90.314% ### ( 3, 4 ] 2366 4.941% 95.255% # ( 4, 6 ] 1693 3.536% 98.791% # ( 6, 10 ] 387 0.808% 99.599% ( 10, 15 ] 84 0.175% 99.774% ( 15, 22 ] 17 0.036% 99.810% ( 22, 34 ] 34 0.071% 99.881% ( 34, 51 ] 4 0.008% 99.889% ( 51, 76 ] 1 0.002% 99.891% ( 110, 170 ] 4 0.008% 99.900% ( 170, 250 ] 4 0.008% 99.908% ( 250, 380 ] 4 0.008% 99.916% ( 380, 580 ] 8 0.017% 99.933% ( 580, 870 ] 13 0.027% 99.960% ( 870, 1300 ] 7 0.015% 99.975% ( 1300, 1900 ] 3 0.006% 99.981% ( 1900, 2900 ] 6 0.013% 99.994% ( 2900, 4400 ] 5 0.010% 100.004% ( 4400, 6600 ] 3 0.006% 100.010% ** Level 4 read latency histogram (micros): Count: 30 Average: 1740.0667 StdDev: 1424.78 Min: 339 Median: 1054.2857 Max: 5563 Percentiles: P50: 1054.29 P75: 3181.25 P99: 5563.00 P99.9: 5563.00 P99.99: 5563.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 5 16.667% 20.000% ### ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 7 23.333% 63.333% ##### ( 1900, 2900 ] 2 6.667% 70.000% # ( 2900, 4400 ] 8 26.667% 96.667% ##### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 18.7 total, 6.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 262.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.236 H:M:S, 28.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 147.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.843 H:M:S, 57.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-13:37:30 ... thread 0: (1000000,6000000) ops and (235868.1,263352.0) ops/second in (4.239657,22.783195) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.70 GB 37.8 4.9 0.0 4.9 10.6 5.7 0.0 1.9 142.9 307.2 35.25 33.19 100 0.353 5116K 6265 0.0 0.0 L1 12/12 1.43 GB 0.0 2.8 2.8 0.0 2.7 2.7 0.2 1.0 233.5 231.1 12.14 11.78 2 6.069 2878K 29K 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 1.4 1.8 247.0 246.8 1.41 1.36 2 0.706 354K 179 0.0 0.0 L3 14/0 951.22 MB 1.0 0.7 0.5 0.2 0.7 0.5 1.0 1.4 197.4 197.2 3.48 3.03 3 1.159 697K 571 0.0 0.0 L4 167/0 9.48 GB 1.0 0.3 0.2 0.0 0.3 0.2 1.1 1.1 180.9 180.4 1.47 1.25 2 0.736 247K 0 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/23 101.76 GB 0.0 9.0 3.7 5.3 14.6 9.3 4.9 2.6 170.7 277.8 53.75 50.61 109 0.493 9293K 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.0 3.7 5.3 14.6 9.3 4.9 2.6 170.7 277.8 53.75 50.61 109 0.493 9293K 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.0 3.7 5.3 8.9 3.6 0.0 0.0 246.7 245.7 37.19 35.78 26 1.430 9293K 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 349.9 16.57 14.83 83 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.0 total, 22.8 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.58 GB write, 650.08 MB/s write, 8.96 GB read, 399.44 MB/s read, 53.8 seconds Interval compaction: 14.58 GB write, 655.42 MB/s write, 8.96 GB read, 402.72 MB/s read, 53.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 17, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2187402 Average: 2.1355 StdDev: 11.67 Min: 0 Median: 1.4300 Max: 3959 Percentiles: P50: 1.43 P75: 1.81 P99: 5.42 P99.9: 10.19 P99.99: 83.76 ------------------------------------------------------ [ 0, 1 ] 470111 21.492% 21.492% #### ( 1, 2 ] 1450189 66.297% 87.789% ############# ( 2, 3 ] 164117 7.503% 95.292% ## ( 3, 4 ] 59715 2.730% 98.022% # ( 4, 6 ] 30203 1.381% 99.403% ( 6, 10 ] 10812 0.494% 99.897% ( 10, 15 ] 1747 0.080% 99.977% ( 15, 22 ] 204 0.009% 99.986% ( 22, 34 ] 17 0.001% 99.987% ( 34, 51 ] 10 0.000% 99.987% ( 51, 76 ] 11 0.001% 99.988% ( 76, 110 ] 207 0.009% 99.997% ( 110, 170 ] 312 0.014% 100.012% ( 170, 250 ] 125 0.006% 100.017% ( 250, 380 ] 94 0.004% 100.022% ( 380, 580 ] 64 0.003% 100.025% ( 580, 870 ] 68 0.003% 100.028% ( 870, 1300 ] 36 0.002% 100.029% ( 1300, 1900 ] 13 0.001% 100.030% ( 1900, 2900 ] 10 0.000% 100.030% ( 2900, 4400 ] 10 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 124947 Average: 2.8233 StdDev: 25.07 Min: 0 Median: 1.6015 Max: 3956 Percentiles: P50: 1.60 P75: 1.99 P99: 6.19 P99.9: 70.52 P99.99: 557.32 ------------------------------------------------------ [ 0, 1 ] 13899 11.124% 11.124% ## ( 1, 2 ] 80760 64.635% 75.759% ############# ( 2, 3 ] 19011 15.215% 90.975% ### ( 3, 4 ] 5856 4.687% 95.661% # ( 4, 6 ] 4130 3.305% 98.967% # ( 6, 10 ] 891 0.713% 99.680% ( 10, 15 ] 202 0.162% 99.842% ( 15, 22 ] 33 0.026% 99.868% ( 34, 51 ] 26 0.021% 99.889% ( 51, 76 ] 18 0.014% 99.903% ( 76, 110 ] 32 0.026% 99.929% ( 110, 170 ] 24 0.019% 99.948% ( 170, 250 ] 17 0.014% 99.962% ( 250, 380 ] 16 0.013% 99.974% ( 380, 580 ] 22 0.018% 99.992% ( 580, 870 ] 12 0.010% 100.002% ( 870, 1300 ] 8 0.006% 100.008% ( 1300, 1900 ] 5 0.004% 100.012% ( 1900, 2900 ] 1 0.001% 100.013% ( 2900, 4400 ] 3 0.002% 100.015% ** Level 2 read latency histogram (micros): Count: 75839 Average: 2.0147 StdDev: 6.26 Min: 0 Median: 1.3913 Max: 1258 Percentiles: P50: 1.39 P75: 1.79 P99: 5.45 P99.9: 10.94 P99.99: 181.10 ------------------------------------------------------ [ 0, 1 ] 19496 25.707% 25.707% ##### ( 1, 2 ] 47079 62.078% 87.785% ############ ( 2, 3 ] 5489 7.238% 95.022% # ( 3, 4 ] 2082 2.745% 97.768% # ( 4, 6 ] 1288 1.698% 99.466% ( 6, 10 ] 316 0.417% 99.883% ( 10, 15 ] 70 0.092% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 82780 Average: 4.2854 StdDev: 55.05 Min: 0 Median: 1.6245 Max: 5782 Percentiles: P50: 1.62 P75: 2.03 P99: 9.14 P99.9: 421.91 P99.99: 1506.64 ------------------------------------------------------ [ 0, 1 ] 7697 9.298% 9.298% ## ( 1, 2 ] 53948 65.170% 74.468% ############# ( 2, 3 ] 12906 15.591% 90.059% ### ( 3, 4 ] 3891 4.700% 94.760% # ( 4, 6 ] 2714 3.279% 98.038% # ( 6, 10 ] 1014 1.225% 99.263% ( 10, 15 ] 168 0.203% 99.466% ( 15, 22 ] 27 0.033% 99.499% ( 22, 34 ] 35 0.042% 99.541% ( 34, 51 ] 4 0.005% 99.546% ( 51, 76 ] 2 0.002% 99.548% ( 76, 110 ] 69 0.083% 99.632% ( 110, 170 ] 95 0.115% 99.746% ( 170, 250 ] 68 0.082% 99.828% ( 250, 380 ] 50 0.060% 99.889% ( 380, 580 ] 44 0.053% 99.942% ( 580, 870 ] 29 0.035% 99.977% ( 870, 1300 ] 9 0.011% 99.988% ( 1300, 1900 ] 5 0.006% 99.994% ( 1900, 2900 ] 7 0.008% 100.002% ( 2900, 4400 ] 5 0.006% 100.008% ( 4400, 6600 ] 3 0.004% 100.012% ** Level 4 read latency histogram (micros): Count: 120 Average: 457.4000 StdDev: 1030.67 Min: 1 Median: 4.5000 Max: 5563 Percentiles: P50: 4.50 P75: 413.33 P99: 4362.50 P99.9: 5563.00 P99.99: 5563.00 ------------------------------------------------------ [ 0, 1 ] 32 26.667% 26.667% ##### ( 1, 2 ] 20 16.667% 43.333% ### ( 2, 3 ] 6 5.000% 48.333% # ( 3, 4 ] 1 0.833% 49.167% ( 4, 6 ] 4 3.333% 52.500% # ( 6, 10 ] 4 3.333% 55.833% # ( 10, 15 ] 1 0.833% 56.667% ( 15, 22 ] 10 8.333% 65.000% ## ( 22, 34 ] 4 3.333% 68.333% # ( 110, 170 ] 4 3.333% 71.667% # ( 170, 250 ] 1 0.833% 72.500% ( 250, 380 ] 2 1.667% 74.167% ( 380, 580 ] 6 5.000% 79.167% # ( 580, 870 ] 7 5.833% 85.000% # ( 870, 1300 ] 7 5.833% 90.833% # ( 1900, 2900 ] 2 1.667% 92.500% ( 2900, 4400 ] 8 6.667% 99.167% # ( 4400, 6600 ] 1 0.833% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 741.9125 StdDev: 937.43 Min: 79 Median: 238.5714 Max: 3456 Percentiles: P50: 238.57 P75: 977.50 P99: 3456.00 P99.9: 3456.00 P99.99: 3456.00 ------------------------------------------------------ ( 76, 110 ] 14 17.500% 17.500% #### ( 110, 170 ] 20 25.000% 42.500% ##### ( 170, 250 ] 7 8.750% 51.250% ## ( 250, 380 ] 7 8.750% 60.000% ## ( 380, 580 ] 4 5.000% 65.000% # ( 580, 870 ] 7 8.750% 73.750% ## ( 870, 1300 ] 4 5.000% 78.750% # ( 1300, 1900 ] 4 5.000% 83.750% # ( 1900, 2900 ] 8 10.000% 93.750% ## ( 2900, 4400 ] 5 6.250% 100.000% # ** DB Stats ** Uptime(secs): 23.0 total, 4.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 257.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.809 H:M:S, 29.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 232.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.573 H:M:S, 37.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-13:37:33 ... thread 0: (1000000,7000000) ops and (325494.0,270736.0) ops/second in (3.072253,25.855448) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.62 GB 132.2 5.7 0.0 5.7 12.3 6.6 0.0 1.9 142.5 306.2 41.12 38.68 116 0.355 5948K 7145 0.0 0.0 L1 12/12 1.43 GB 0.0 2.8 2.8 0.0 2.7 2.7 0.2 1.0 233.5 231.1 12.14 11.78 2 6.069 2878K 29K 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 1.4 1.8 247.0 246.8 1.41 1.36 2 0.706 354K 179 0.0 0.0 L3 14/0 951.22 MB 1.0 0.7 0.5 0.2 0.7 0.5 1.0 1.4 197.4 197.2 3.48 3.03 3 1.159 697K 571 0.0 0.0 L4 167/0 9.48 GB 1.0 0.3 0.2 0.0 0.3 0.2 1.1 1.1 180.9 180.4 1.47 1.25 2 0.736 247K 0 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/23 102.68 GB 0.0 9.8 3.7 6.1 16.3 10.2 4.9 2.5 167.6 280.0 59.62 56.10 125 0.477 10M 37K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.8 3.7 6.1 16.3 10.2 4.9 2.5 167.6 280.0 59.62 56.10 125 0.477 10M 37K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.8 3.7 6.1 9.7 3.6 0.0 0.0 248.2 247.2 40.27 38.79 29 1.389 10M 37K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 348.2 19.36 17.31 96 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.0 total, 25.9 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.30 GB write, 641.08 MB/s write, 9.76 GB read, 383.76 MB/s read, 59.6 seconds Interval compaction: 16.30 GB write, 645.72 MB/s write, 9.76 GB read, 386.54 MB/s read, 59.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 22, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2536579 Average: 2.1515 StdDev: 11.76 Min: 0 Median: 1.4416 Max: 3959 Percentiles: P50: 1.44 P75: 1.82 P99: 5.48 P99.9: 10.35 P99.99: 20.95 ------------------------------------------------------ [ 0, 1 ] 521440 20.557% 20.557% #### ( 1, 2 ] 1691399 66.680% 87.237% ############# ( 2, 3 ] 199808 7.877% 95.114% ## ( 3, 4 ] 72073 2.841% 97.956% # ( 4, 6 ] 35837 1.413% 99.368% ( 6, 10 ] 13330 0.526% 99.894% ( 10, 15 ] 2249 0.089% 99.983% ( 15, 22 ] 225 0.009% 99.991% ( 22, 34 ] 21 0.001% 99.992% ( 34, 51 ] 12 0.000% 99.993% ( 51, 76 ] 16 0.001% 99.993% ( 76, 110 ] 224 0.009% 100.002% ( 110, 170 ] 331 0.013% 100.015% ( 170, 250 ] 146 0.006% 100.021% ( 250, 380 ] 107 0.004% 100.025% ( 380, 580 ] 73 0.003% 100.028% ( 580, 870 ] 77 0.003% 100.031% ( 870, 1300 ] 41 0.002% 100.033% ( 1300, 1900 ] 14 0.001% 100.033% ( 1900, 2900 ] 12 0.000% 100.034% ( 2900, 4400 ] 12 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 165949 Average: 2.8161 StdDev: 22.85 Min: 0 Median: 1.5841 Max: 3956 Percentiles: P50: 1.58 P75: 1.96 P99: 7.09 P99.9: 124.25 P99.99: 569.00 ------------------------------------------------------ [ 0, 1 ] 19073 11.493% 11.493% ## ( 1, 2 ] 109402 65.925% 77.418% ############# ( 2, 3 ] 23433 14.121% 91.539% ### ( 3, 4 ] 7132 4.298% 95.837% # ( 4, 6 ] 4842 2.918% 98.754% # ( 6, 10 ] 1494 0.900% 99.655% ( 10, 15 ] 242 0.146% 99.801% ( 15, 22 ] 39 0.024% 99.824% ( 34, 51 ] 26 0.016% 99.840% ( 51, 76 ] 18 0.011% 99.851% ( 76, 110 ] 64 0.039% 99.889% ( 110, 170 ] 76 0.046% 99.935% ( 170, 250 ] 42 0.025% 99.960% ( 250, 380 ] 22 0.013% 99.973% ( 380, 580 ] 29 0.017% 99.991% ( 580, 870 ] 15 0.009% 100.000% ( 870, 1300 ] 10 0.006% 100.006% ( 1300, 1900 ] 5 0.003% 100.009% ( 1900, 2900 ] 1 0.001% 100.010% ( 2900, 4400 ] 3 0.002% 100.011% ** Level 2 read latency histogram (micros): Count: 75839 Average: 2.0147 StdDev: 6.26 Min: 0 Median: 1.3913 Max: 1258 Percentiles: P50: 1.39 P75: 1.79 P99: 5.45 P99.9: 10.94 P99.99: 181.10 ------------------------------------------------------ [ 0, 1 ] 19496 25.707% 25.707% ##### ( 1, 2 ] 47079 62.078% 87.785% ############ ( 2, 3 ] 5489 7.238% 95.022% # ( 3, 4 ] 2082 2.745% 97.768% # ( 4, 6 ] 1288 1.698% 99.466% ( 6, 10 ] 316 0.417% 99.883% ( 10, 15 ] 70 0.092% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 82780 Average: 4.2854 StdDev: 55.05 Min: 0 Median: 1.6245 Max: 5782 Percentiles: P50: 1.62 P75: 2.03 P99: 9.14 P99.9: 421.91 P99.99: 1506.64 ------------------------------------------------------ [ 0, 1 ] 7697 9.298% 9.298% ## ( 1, 2 ] 53948 65.170% 74.468% ############# ( 2, 3 ] 12906 15.591% 90.059% ### ( 3, 4 ] 3891 4.700% 94.760% # ( 4, 6 ] 2714 3.279% 98.038% # ( 6, 10 ] 1014 1.225% 99.263% ( 10, 15 ] 168 0.203% 99.466% ( 15, 22 ] 27 0.033% 99.499% ( 22, 34 ] 35 0.042% 99.541% ( 34, 51 ] 4 0.005% 99.546% ( 51, 76 ] 2 0.002% 99.548% ( 76, 110 ] 69 0.083% 99.632% ( 110, 170 ] 95 0.115% 99.746% ( 170, 250 ] 68 0.082% 99.828% ( 250, 380 ] 50 0.060% 99.889% ( 380, 580 ] 44 0.053% 99.942% ( 580, 870 ] 29 0.035% 99.977% ( 870, 1300 ] 9 0.011% 99.988% ( 1300, 1900 ] 5 0.006% 99.994% ( 1900, 2900 ] 7 0.008% 100.002% ( 2900, 4400 ] 5 0.006% 100.008% ( 4400, 6600 ] 3 0.004% 100.012% ** Level 4 read latency histogram (micros): Count: 120 Average: 457.4000 StdDev: 1030.67 Min: 1 Median: 4.5000 Max: 5563 Percentiles: P50: 4.50 P75: 413.33 P99: 4362.50 P99.9: 5563.00 P99.99: 5563.00 ------------------------------------------------------ [ 0, 1 ] 32 26.667% 26.667% ##### ( 1, 2 ] 20 16.667% 43.333% ### ( 2, 3 ] 6 5.000% 48.333% # ( 3, 4 ] 1 0.833% 49.167% ( 4, 6 ] 4 3.333% 52.500% # ( 6, 10 ] 4 3.333% 55.833% # ( 10, 15 ] 1 0.833% 56.667% ( 15, 22 ] 10 8.333% 65.000% ## ( 22, 34 ] 4 3.333% 68.333% # ( 110, 170 ] 4 3.333% 71.667% # ( 170, 250 ] 1 0.833% 72.500% ( 250, 380 ] 2 1.667% 74.167% ( 380, 580 ] 6 5.000% 79.167% # ( 580, 870 ] 7 5.833% 85.000% # ( 870, 1300 ] 7 5.833% 90.833% # ( 1900, 2900 ] 2 1.667% 92.500% ( 2900, 4400 ] 8 6.667% 99.167% # ( 4400, 6600 ] 1 0.833% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 741.9125 StdDev: 937.43 Min: 79 Median: 238.5714 Max: 3456 Percentiles: P50: 238.57 P75: 977.50 P99: 3456.00 P99.9: 3456.00 P99.99: 3456.00 ------------------------------------------------------ ( 76, 110 ] 14 17.500% 17.500% #### ( 110, 170 ] 20 25.000% 42.500% ##### ( 170, 250 ] 7 8.750% 51.250% ## ( 250, 380 ] 7 8.750% 60.000% ## ( 380, 580 ] 4 5.000% 65.000% # ( 580, 870 ] 7 8.750% 73.750% ## ( 870, 1300 ] 4 5.000% 78.750% # ( 1300, 1900 ] 4 5.000% 83.750% # ( 1900, 2900 ] 8 10.000% 93.750% ## ( 2900, 4400 ] 5 6.250% 100.000% # ** DB Stats ** Uptime(secs): 26.0 total, 3.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 264.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.222 H:M:S, 27.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.413 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-13:37:47 ... thread 0: (1000000,8000000) ops and (70281.9,199581.6) ops/second in (14.228407,40.083855) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 2.57 GB 44.1 7.9 0.0 7.9 15.5 7.6 0.0 2.0 152.2 297.0 53.40 49.83 134 0.398 8249K 15K 0.0 0.0 L1 16/16 1.90 GB 0.0 6.2 4.8 1.4 6.1 4.7 0.2 1.3 229.9 227.0 27.71 26.53 3 9.238 6468K 78K 0.0 0.0 L2 2/2 257.55 MB 0.0 0.3 0.2 0.2 0.3 0.2 2.9 1.8 247.0 246.8 1.41 1.36 2 0.706 354K 179 0.0 0.0 L3 29/12 1.62 GB 1.0 2.1 1.0 1.1 2.1 1.0 1.8 2.1 200.8 199.6 10.87 9.64 7 1.553 2217K 13K 0.0 0.0 L4 167/4 9.41 GB 1.0 0.9 0.8 0.1 0.9 0.8 1.1 1.1 159.6 159.0 6.00 4.49 9 0.667 949K 3144 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/42 103.59 GB 0.0 17.6 6.8 10.8 25.0 14.3 7.9 3.3 180.9 257.8 99.40 91.86 155 0.641 18M 110K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.6 6.8 10.8 25.0 14.3 7.9 3.3 180.9 257.8 99.40 91.86 155 0.641 18M 110K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.6 6.8 10.8 17.5 6.7 0.0 0.0 234.6 233.2 76.66 71.87 45 1.704 18M 110K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 340.7 22.74 19.99 110 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.3 total, 40.1 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.02 GB write, 636.24 MB/s write, 17.56 GB read, 446.59 MB/s read, 99.4 seconds Interval compaction: 25.02 GB write, 639.20 MB/s write, 17.56 GB read, 448.68 MB/s read, 99.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 26, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3568885 Average: 2.4072 StdDev: 17.26 Min: 0 Median: 1.4692 Max: 6970 Percentiles: P50: 1.47 P75: 1.85 P99: 5.90 P99.9: 79.71 P99.99: 167.43 ------------------------------------------------------ [ 0, 1 ] 680294 19.062% 19.062% #### ( 1, 2 ] 2353204 65.937% 84.998% ############# ( 2, 3 ] 313775 8.792% 93.790% ## ( 3, 4 ] 117845 3.302% 97.092% # ( 4, 6 ] 71488 2.003% 99.096% ( 6, 10 ] 24063 0.674% 99.770% ( 10, 15 ] 3901 0.109% 99.879% ( 15, 22 ] 472 0.013% 99.892% ( 22, 34 ] 41 0.001% 99.893% ( 34, 51 ] 15 0.000% 99.894% ( 51, 76 ] 32 0.001% 99.895% ( 76, 110 ] 1704 0.048% 99.943% ( 110, 170 ] 1770 0.050% 99.992% ( 170, 250 ] 506 0.014% 100.006% ( 250, 380 ] 374 0.010% 100.017% ( 380, 580 ] 278 0.008% 100.025% ( 580, 870 ] 160 0.004% 100.029% ( 870, 1300 ] 77 0.002% 100.031% ( 1300, 1900 ] 30 0.001% 100.032% ( 1900, 2900 ] 22 0.001% 100.033% ( 2900, 4400 ] 34 0.001% 100.034% ( 4400, 6600 ] 3 0.000% 100.034% ( 6600, 9900 ] 1 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 951501 Average: 3.2325 StdDev: 28.35 Min: 0 Median: 1.6317 Max: 5012 Percentiles: P50: 1.63 P75: 2.17 P99: 8.44 P99.9: 89.84 P99.99: 160.48 ------------------------------------------------------ [ 0, 1 ] 108520 11.405% 11.405% ## ( 1, 2 ] 581325 61.096% 72.501% ############ ( 2, 3 ] 138789 14.586% 87.087% ### ( 3, 4 ] 57005 5.991% 93.078% # ( 4, 6 ] 47387 4.980% 98.058% # ( 6, 10 ] 14686 1.543% 99.602% ( 10, 15 ] 2137 0.225% 99.826% ( 15, 22 ] 344 0.036% 99.863% ( 22, 34 ] 11 0.001% 99.864% ( 34, 51 ] 28 0.003% 99.867% ( 51, 76 ] 94 0.010% 99.877% ( 76, 110 ] 549 0.058% 99.934% ( 110, 170 ] 631 0.066% 100.001% ( 170, 250 ] 256 0.027% 100.027% ( 250, 380 ] 263 0.028% 100.055% ( 380, 580 ] 219 0.023% 100.078% ( 580, 870 ] 168 0.018% 100.096% ( 870, 1300 ] 107 0.011% 100.107% ( 1300, 1900 ] 26 0.003% 100.110% ( 1900, 2900 ] 19 0.002% 100.112% ( 2900, 4400 ] 18 0.002% 100.114% ( 4400, 6600 ] 2 0.000% 100.114% ** Level 2 read latency histogram (micros): Count: 75839 Average: 2.0147 StdDev: 6.26 Min: 0 Median: 1.3913 Max: 1258 Percentiles: P50: 1.39 P75: 1.79 P99: 5.45 P99.9: 10.94 P99.99: 181.10 ------------------------------------------------------ [ 0, 1 ] 19496 25.707% 25.707% ##### ( 1, 2 ] 47079 62.078% 87.785% ############ ( 2, 3 ] 5489 7.238% 95.022% # ( 3, 4 ] 2082 2.745% 97.768% # ( 4, 6 ] 1288 1.698% 99.466% ( 6, 10 ] 316 0.417% 99.883% ( 10, 15 ] 70 0.092% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 276175 Average: 5.5243 StdDev: 62.33 Min: 0 Median: 1.8320 Max: 6012 Percentiles: P50: 1.83 P75: 2.77 P99: 9.18 P99.9: 212.19 P99.99: 325.81 ------------------------------------------------------ [ 0, 1 ] 11517 4.170% 4.170% # ( 1, 2 ] 152133 55.086% 59.256% ########### ( 2, 3 ] 56378 20.414% 79.670% #### ( 3, 4 ] 25998 9.414% 89.083% ## ( 4, 6 ] 23685 8.576% 97.659% ## ( 6, 10 ] 4666 1.690% 99.349% ( 10, 15 ] 940 0.340% 99.689% ( 15, 22 ] 96 0.035% 99.724% ( 22, 34 ] 37 0.013% 99.737% ( 34, 51 ] 6 0.002% 99.740% ( 51, 76 ] 19 0.007% 99.747% ( 76, 110 ] 103 0.037% 99.784% ( 110, 170 ] 202 0.073% 99.857% ( 170, 250 ] 231 0.084% 99.941% ( 250, 380 ] 239 0.087% 100.027% ( 380, 580 ] 263 0.095% 100.122% ( 580, 870 ] 203 0.074% 100.196% ( 870, 1300 ] 76 0.028% 100.223% ( 1300, 1900 ] 33 0.012% 100.235% ( 1900, 2900 ] 34 0.012% 100.248% ( 2900, 4400 ] 25 0.009% 100.257% ( 4400, 6600 ] 6 0.002% 100.259% ** Level 4 read latency histogram (micros): Count: 205 Average: 335.8195 StdDev: 835.38 Min: 1 Median: 2.9211 Max: 5563 Percentiles: P50: 2.92 P75: 212.22 P99: 4203.12 P99.9: 5563.00 P99.99: 5563.00 ------------------------------------------------------ [ 0, 1 ] 43 20.976% 20.976% #### ( 1, 2 ] 42 20.488% 41.463% #### ( 2, 3 ] 19 9.268% 50.732% ## ( 3, 4 ] 5 2.439% 53.171% ( 4, 6 ] 6 2.927% 56.098% # ( 6, 10 ] 6 2.927% 59.024% # ( 10, 15 ] 2 0.976% 60.000% ( 15, 22 ] 11 5.366% 65.366% # ( 22, 34 ] 5 2.439% 67.805% ( 34, 51 ] 2 0.976% 68.780% ( 51, 76 ] 2 0.976% 69.756% ( 76, 110 ] 2 0.976% 70.732% ( 110, 170 ] 4 1.951% 72.683% ( 170, 250 ] 9 4.390% 77.073% # ( 250, 380 ] 5 2.439% 79.512% ( 380, 580 ] 8 3.902% 83.415% # ( 580, 870 ] 13 6.341% 89.756% # ( 870, 1300 ] 7 3.415% 93.171% # ( 1300, 1900 ] 3 1.463% 94.634% ( 1900, 2900 ] 2 0.976% 95.610% ( 2900, 4400 ] 8 3.902% 99.512% # ( 4400, 6600 ] 1 0.488% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 864.0000 StdDev: 1094.02 Min: 79 Median: 340.0000 Max: 5161 Percentiles: P50: 340.00 P75: 1177.14 P99: 5161.00 P99.9: 5161.00 P99.99: 5161.00 ------------------------------------------------------ ( 76, 110 ] 14 11.667% 11.667% ## ( 110, 170 ] 24 20.000% 31.667% #### ( 170, 250 ] 13 10.833% 42.500% ## ( 250, 380 ] 13 10.833% 53.333% ## ( 380, 580 ] 8 6.667% 60.000% # ( 580, 870 ] 13 10.833% 70.833% ## ( 870, 1300 ] 7 5.833% 76.667% # ( 1300, 1900 ] 9 7.500% 84.167% ## ( 1900, 2900 ] 9 7.500% 91.667% ## ( 2900, 4400 ] 8 6.667% 98.333% # ( 4400, 6600 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 40.3 total, 14.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 195.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.144 H:M:S, 45.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 69.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.921 H:M:S, 76.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/11/28-13:37:51 ... thread 0: (1000000,9000000) ops and (262147.9,205018.4) ops/second in (3.814641,43.898496) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 3.56 GB 144.7 8.8 0.0 8.8 17.3 8.5 0.0 2.0 148.9 293.3 60.51 55.86 150 0.403 9145K 16K 0.0 0.0 L1 16/16 1.90 GB 0.0 6.2 4.8 1.4 6.1 4.7 0.2 1.3 229.9 227.0 27.71 26.53 3 9.238 6468K 78K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.9 1.8 247.0 246.8 1.41 1.36 2 0.706 354K 179 0.0 0.0 L3 17/0 996.18 MB 1.0 2.8 1.2 1.5 2.7 1.2 1.8 2.2 198.6 197.2 14.21 12.49 9 1.579 2866K 19K 0.0 0.0 L4 172/0 9.68 GB 1.0 1.9 1.7 0.2 1.9 1.7 1.1 1.1 154.2 153.6 12.77 9.17 22 0.580 1976K 7754 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/24 104.57 GB 0.0 20.0 7.9 12.1 28.5 16.4 8.5 3.3 175.9 250.0 116.61 105.41 186 0.627 20M 122K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.0 7.9 12.1 28.5 16.4 8.5 3.3 175.9 250.0 116.61 105.41 186 0.627 20M 122K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.0 7.9 12.1 19.9 7.8 0.0 0.0 226.8 225.5 90.46 82.79 63 1.436 20M 122K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 334.7 26.16 22.63 123 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.1 total, 43.9 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.47 GB write, 661.20 MB/s write, 20.04 GB read, 465.38 MB/s read, 116.6 seconds Interval compaction: 28.47 GB write, 664.01 MB/s write, 20.04 GB read, 467.36 MB/s read, 116.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 41, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3946929 Average: 2.4732 StdDev: 22.85 Min: 0 Median: 1.4861 Max: 11711 Percentiles: P50: 1.49 P75: 1.87 P99: 5.95 P99.9: 21.18 P99.99: 165.83 ------------------------------------------------------ [ 0, 1 ] 714677 18.107% 18.107% #### ( 1, 2 ] 2589483 65.608% 83.715% ############# ( 2, 3 ] 374551 9.490% 93.204% ## ( 3, 4 ] 140475 3.559% 96.763% # ( 4, 6 ] 90439 2.291% 99.055% ( 6, 10 ] 28355 0.718% 99.773% ( 10, 15 ] 4532 0.115% 99.888% ( 15, 22 ] 535 0.014% 99.902% ( 22, 34 ] 47 0.001% 99.903% ( 34, 51 ] 15 0.000% 99.903% ( 51, 76 ] 34 0.001% 99.904% ( 76, 110 ] 1725 0.044% 99.948% ( 110, 170 ] 1793 0.045% 99.993% ( 170, 250 ] 533 0.014% 100.007% ( 250, 380 ] 402 0.010% 100.017% ( 380, 580 ] 304 0.008% 100.025% ( 580, 870 ] 179 0.005% 100.029% ( 870, 1300 ] 100 0.003% 100.032% ( 1300, 1900 ] 38 0.001% 100.033% ( 1900, 2900 ] 33 0.001% 100.033% ( 2900, 4400 ] 52 0.001% 100.035% ( 4400, 6600 ] 5 0.000% 100.035% ( 6600, 9900 ] 6 0.000% 100.035% ( 9900, 14000 ] 2 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 1056555 Average: 3.2233 StdDev: 31.52 Min: 0 Median: 1.6332 Max: 11433 Percentiles: P50: 1.63 P75: 2.16 P99: 8.46 P99.9: 92.81 P99.99: 165.43 ------------------------------------------------------ [ 0, 1 ] 116351 11.012% 11.012% ## ( 1, 2 ] 650537 61.572% 72.584% ############ ( 2, 3 ] 154861 14.657% 87.241% ### ( 3, 4 ] 62489 5.914% 93.155% # ( 4, 6 ] 51562 4.880% 98.036% # ( 6, 10 ] 16566 1.568% 99.604% ( 10, 15 ] 2308 0.218% 99.822% ( 15, 22 ] 370 0.035% 99.857% ( 22, 34 ] 13 0.001% 99.858% ( 34, 51 ] 29 0.003% 99.861% ( 51, 76 ] 95 0.009% 99.870% ( 76, 110 ] 642 0.061% 99.931% ( 110, 170 ] 678 0.064% 99.995% ( 170, 250 ] 275 0.026% 100.021% ( 250, 380 ] 279 0.026% 100.047% ( 380, 580 ] 232 0.022% 100.069% ( 580, 870 ] 169 0.016% 100.085% ( 870, 1300 ] 109 0.010% 100.096% ( 1300, 1900 ] 26 0.002% 100.098% ( 1900, 2900 ] 21 0.002% 100.100% ( 2900, 4400 ] 20 0.002% 100.102% ( 4400, 6600 ] 4 0.000% 100.102% ( 6600, 9900 ] 1 0.000% 100.102% ( 9900, 14000 ] 1 0.000% 100.103% ** Level 2 read latency histogram (micros): Count: 75839 Average: 2.0147 StdDev: 6.26 Min: 0 Median: 1.3913 Max: 1258 Percentiles: P50: 1.39 P75: 1.79 P99: 5.45 P99.9: 10.94 P99.99: 181.10 ------------------------------------------------------ [ 0, 1 ] 19496 25.707% 25.707% ##### ( 1, 2 ] 47079 62.078% 87.785% ############ ( 2, 3 ] 5489 7.238% 95.022% # ( 3, 4 ] 2082 2.745% 97.768% # ( 4, 6 ] 1288 1.698% 99.466% ( 6, 10 ] 316 0.417% 99.883% ( 10, 15 ] 70 0.092% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 563692 Average: 5.0959 StdDev: 60.57 Min: 0 Median: 1.8718 Max: 7386 Percentiles: P50: 1.87 P75: 2.85 P99: 8.62 P99.9: 18.11 P99.99: 145.40 ------------------------------------------------------ [ 0, 1 ] 17221 3.055% 3.055% # ( 1, 2 ] 303551 53.851% 56.906% ########### ( 2, 3 ] 120306 21.343% 78.248% #### ( 3, 4 ] 57895 10.271% 88.519% ## ( 4, 6 ] 52889 9.383% 97.901% ## ( 6, 10 ] 9458 1.678% 99.579% ( 10, 15 ] 1724 0.306% 99.885% ( 15, 22 ] 190 0.034% 99.919% ( 22, 34 ] 44 0.008% 99.927% ( 34, 51 ] 8 0.001% 99.928% ( 51, 76 ] 23 0.004% 99.932% ( 76, 110 ] 139 0.025% 99.957% ( 110, 170 ] 318 0.056% 100.013% ( 170, 250 ] 356 0.063% 100.076% ( 250, 380 ] 355 0.063% 100.139% ( 380, 580 ] 403 0.071% 100.211% ( 580, 870 ] 325 0.058% 100.268% ( 870, 1300 ] 135 0.024% 100.292% ( 1300, 1900 ] 55 0.010% 100.302% ( 1900, 2900 ] 56 0.010% 100.312% ( 2900, 4400 ] 53 0.009% 100.321% ( 4400, 6600 ] 10 0.002% 100.323% ( 6600, 9900 ] 2 0.000% 100.324% ** Level 4 read latency histogram (micros): Count: 335 Average: 269.2179 StdDev: 739.47 Min: 1 Median: 2.8088 Max: 5563 Percentiles: P50: 2.81 P75: 170.95 P99: 4146.87 P99.9: 5563.00 P99.99: 5563.00 ------------------------------------------------------ [ 0, 1 ] 60 17.910% 17.910% #### ( 1, 2 ] 80 23.881% 41.791% ##### ( 2, 3 ] 34 10.149% 51.940% ## ( 3, 4 ] 12 3.582% 55.522% # ( 4, 6 ] 13 3.881% 59.403% # ( 6, 10 ] 8 2.388% 61.791% ( 10, 15 ] 4 1.194% 62.985% ( 15, 22 ] 14 4.179% 67.164% # ( 22, 34 ] 15 4.478% 71.642% # ( 34, 51 ] 3 0.896% 72.537% ( 51, 76 ] 2 0.597% 73.134% ( 76, 110 ] 2 0.597% 73.731% ( 110, 170 ] 4 1.194% 74.925% ( 170, 250 ] 21 6.269% 81.194% # ( 250, 380 ] 7 2.090% 83.284% ( 380, 580 ] 12 3.582% 86.866% # ( 580, 870 ] 15 4.478% 91.343% # ( 870, 1300 ] 12 3.582% 94.925% # ( 1300, 1900 ] 5 1.493% 96.418% ( 1900, 2900 ] 2 0.597% 97.015% ( 2900, 4400 ] 8 2.388% 99.403% ( 4400, 6600 ] 2 0.597% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 895.6063 StdDev: 1091.43 Min: 79 Median: 364.7059 Max: 5161 Percentiles: P50: 364.71 P75: 1233.85 P99: 4840.00 P99.9: 5161.00 P99.99: 5161.00 ------------------------------------------------------ ( 76, 110 ] 15 9.375% 9.375% ## ( 110, 170 ] 31 19.375% 28.750% #### ( 170, 250 ] 19 11.875% 40.625% ## ( 250, 380 ] 17 10.625% 51.250% ## ( 380, 580 ] 13 8.125% 59.375% ## ( 580, 870 ] 14 8.750% 68.125% ## ( 870, 1300 ] 13 8.125% 76.250% ## ( 1300, 1900 ] 12 7.500% 83.750% ## ( 1900, 2900 ] 13 8.125% 91.875% ## ( 2900, 4400 ] 11 6.875% 98.750% # ( 4400, 6600 ] 2 1.250% 100.000% ** DB Stats ** Uptime(secs): 44.1 total, 3.8 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 200.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.145 H:M:S, 43.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 258.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.002 H:M:S, 26.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-13:38:07 ... thread 0: (1000000,10000000) ops and (63609.9,167730.9) ops/second in (15.720828,59.619324) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 2.57 GB 12.6 11.2 0.0 11.2 20.6 9.4 0.0 2.2 156.5 288.6 73.23 67.50 167 0.439 11M 27K 0.0 0.0 L1 14/14 1.67 GB 0.0 10.0 6.7 3.3 9.9 6.6 0.2 1.5 224.1 221.3 45.76 43.06 4 11.440 9489K 78K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.9 1.8 247.0 246.8 1.41 1.36 2 0.706 354K 179 0.0 0.0 L3 21/0 931.88 MB 0.9 4.5 2.1 2.4 4.5 2.1 3.0 2.1 167.0 165.6 27.56 20.85 18 1.531 4674K 37K 0.0 0.0 L4 162/0 9.45 GB 1.0 4.7 3.8 0.9 4.7 3.8 1.1 1.2 150.0 149.2 32.14 22.24 43 0.748 4866K 23K 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1311/22 105.40 GB 0.0 30.8 12.8 18.0 40.0 22.1 14.2 4.2 174.8 227.5 180.11 155.00 234 0.770 31M 168K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.8 12.8 18.0 40.0 22.1 14.2 4.2 174.8 227.5 180.11 155.00 234 0.770 31M 168K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.8 12.8 18.0 30.5 12.6 0.0 0.0 208.6 207.2 150.95 129.91 98 1.540 31M 168K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 332.7 29.16 25.09 136 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.8 total, 59.6 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.01 GB write, 685.08 MB/s write, 30.75 GB read, 526.51 MB/s read, 180.1 seconds Interval compaction: 40.01 GB write, 687.23 MB/s write, 30.75 GB read, 528.16 MB/s read, 180.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 47, pending-compaction-bytes-stops: 0, total-delays: 60, total-stops: 51, interval: 111 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4938402 Average: 2.7181 StdDev: 28.25 Min: 0 Median: 1.4971 Max: 11711 Percentiles: P50: 1.50 P75: 1.88 P99: 6.70 P99.9: 114.13 P99.99: 260.77 ------------------------------------------------------ [ 0, 1 ] 868793 17.593% 17.593% #### ( 1, 2 ] 3219602 65.195% 82.788% ############# ( 2, 3 ] 486021 9.842% 92.629% ## ( 3, 4 ] 182315 3.692% 96.321% # ( 4, 6 ] 125279 2.537% 98.858% # ( 6, 10 ] 40152 0.813% 99.671% ( 10, 15 ] 6218 0.126% 99.797% ( 15, 22 ] 871 0.018% 99.815% ( 22, 34 ] 66 0.001% 99.816% ( 34, 51 ] 20 0.000% 99.816% ( 51, 76 ] 82 0.002% 99.818% ( 76, 110 ] 3795 0.077% 99.895% ( 110, 170 ] 3642 0.074% 99.969% ( 170, 250 ] 991 0.020% 99.989% ( 250, 380 ] 750 0.015% 100.004% ( 380, 580 ] 572 0.012% 100.016% ( 580, 870 ] 334 0.007% 100.022% ( 870, 1300 ] 182 0.004% 100.026% ( 1300, 1900 ] 92 0.002% 100.028% ( 1900, 2900 ] 86 0.002% 100.030% ( 2900, 4400 ] 95 0.002% 100.032% ( 4400, 6600 ] 27 0.001% 100.032% ( 6600, 9900 ] 7 0.000% 100.032% ( 9900, 14000 ] 2 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 2053523 Average: 4.2610 StdDev: 58.04 Min: 0 Median: 1.6789 Max: 11433 Percentiles: P50: 1.68 P75: 2.38 P99: 8.98 P99.9: 111.37 P99.99: 219.53 ------------------------------------------------------ [ 0, 1 ] 201748 9.824% 9.824% ## ( 1, 2 ] 1215304 59.181% 69.006% ############ ( 2, 3 ] 323517 15.754% 84.760% ### ( 3, 4 ] 138816 6.760% 91.520% # ( 4, 6 ] 124601 6.068% 97.588% # ( 6, 10 ] 38966 1.898% 99.485% ( 10, 15 ] 5881 0.286% 99.772% ( 15, 22 ] 907 0.044% 99.816% ( 22, 34 ] 50 0.002% 99.818% ( 34, 51 ] 38 0.002% 99.820% ( 51, 76 ] 188 0.009% 99.829% ( 76, 110 ] 1419 0.069% 99.898% ( 110, 170 ] 1513 0.074% 99.972% ( 170, 250 ] 597 0.029% 100.001% ( 250, 380 ] 627 0.031% 100.032% ( 380, 580 ] 673 0.033% 100.064% ( 580, 870 ] 661 0.032% 100.097% ( 870, 1300 ] 388 0.019% 100.115% ( 1300, 1900 ] 181 0.009% 100.124% ( 1900, 2900 ] 159 0.008% 100.132% ( 2900, 4400 ] 197 0.010% 100.142% ( 4400, 6600 ] 54 0.003% 100.144% ( 6600, 9900 ] 9 0.000% 100.145% ( 9900, 14000 ] 1 0.000% 100.145% ** Level 2 read latency histogram (micros): Count: 75839 Average: 2.0147 StdDev: 6.26 Min: 0 Median: 1.3913 Max: 1258 Percentiles: P50: 1.39 P75: 1.79 P99: 5.45 P99.9: 10.94 P99.99: 181.10 ------------------------------------------------------ [ 0, 1 ] 19496 25.707% 25.707% ##### ( 1, 2 ] 47079 62.078% 87.785% ############ ( 2, 3 ] 5489 7.238% 95.022% # ( 3, 4 ] 2082 2.745% 97.768% # ( 4, 6 ] 1288 1.698% 99.466% ( 6, 10 ] 316 0.417% 99.883% ( 10, 15 ] 70 0.092% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1015562 Average: 5.6501 StdDev: 69.87 Min: 0 Median: 1.9090 Max: 8833 Percentiles: P50: 1.91 P75: 2.93 P99: 8.86 P99.9: 21.93 P99.99: 213.76 ------------------------------------------------------ [ 0, 1 ] 25219 2.483% 2.483% ( 1, 2 ] 530870 52.274% 54.757% ########## ( 2, 3 ] 220606 21.723% 76.479% #### ( 3, 4 ] 112213 11.049% 87.529% ## ( 4, 6 ] 103129 10.155% 97.684% ## ( 6, 10 ] 18715 1.843% 99.526% ( 10, 15 ] 3418 0.337% 99.863% ( 15, 22 ] 380 0.037% 99.900% ( 22, 34 ] 58 0.006% 99.906% ( 34, 51 ] 12 0.001% 99.907% ( 51, 76 ] 31 0.003% 99.910% ( 76, 110 ] 159 0.016% 99.926% ( 110, 170 ] 401 0.039% 99.965% ( 170, 250 ] 456 0.045% 100.010% ( 250, 380 ] 583 0.057% 100.068% ( 380, 580 ] 732 0.072% 100.140% ( 580, 870 ] 668 0.066% 100.206% ( 870, 1300 ] 395 0.039% 100.244% ( 1300, 1900 ] 177 0.017% 100.262% ( 1900, 2900 ] 129 0.013% 100.275% ( 2900, 4400 ] 129 0.013% 100.287% ( 4400, 6600 ] 30 0.003% 100.290% ( 6600, 9900 ] 4 0.000% 100.291% ** Level 4 read latency histogram (micros): Count: 142989 Average: 11.8478 StdDev: 127.49 Min: 1 Median: 1.9388 Max: 6649 Percentiles: P50: 1.94 P75: 2.99 P99: 14.77 P99.9: 1392.36 P99.99: 2386.90 ------------------------------------------------------ [ 0, 1 ] 2728 1.908% 1.908% ( 1, 2 ] 73249 51.227% 53.135% ########## ( 2, 3 ] 31431 21.981% 75.116% #### ( 3, 4 ] 15746 11.012% 86.128% ## ( 4, 6 ] 14524 10.157% 96.286% ## ( 6, 10 ] 3298 2.306% 98.592% ( 10, 15 ] 611 0.427% 99.020% ( 15, 22 ] 81 0.057% 99.076% ( 22, 34 ] 19 0.013% 99.089% ( 34, 51 ] 6 0.004% 99.094% ( 51, 76 ] 8 0.006% 99.099% ( 76, 110 ] 29 0.020% 99.120% ( 110, 170 ] 78 0.055% 99.174% ( 170, 250 ] 122 0.085% 99.259% ( 250, 380 ] 155 0.108% 99.368% ( 380, 580 ] 227 0.159% 99.527% ( 580, 870 ] 263 0.184% 99.710% ( 870, 1300 ] 253 0.177% 99.887% ( 1300, 1900 ] 117 0.082% 99.969% ( 1900, 2900 ] 61 0.043% 100.012% ( 2900, 4400 ] 64 0.045% 100.057% ( 4400, 6600 ] 12 0.008% 100.065% ( 6600, 9900 ] 1 0.001% 100.066% ** Level 5 read latency histogram (micros): Count: 300 Average: 1206.7233 StdDev: 1403.72 Min: 79 Median: 547.7419 Max: 6779 Percentiles: P50: 547.74 P75: 1810.00 P99: 6285.71 P99.9: 6779.00 P99.99: 6779.00 ------------------------------------------------------ ( 76, 110 ] 15 5.000% 5.000% # ( 110, 170 ] 43 14.333% 19.333% ### ( 170, 250 ] 33 11.000% 30.333% ## ( 250, 380 ] 33 11.000% 41.333% ## ( 380, 580 ] 31 10.333% 51.667% ## ( 580, 870 ] 31 10.333% 62.000% ## ( 870, 1300 ] 22 7.333% 69.333% # ( 1300, 1900 ] 20 6.667% 76.000% # ( 1900, 2900 ] 26 8.667% 84.667% ## ( 2900, 4400 ] 37 12.333% 97.000% ## ( 4400, 6600 ] 7 2.333% 99.333% ( 6600, 9900 ] 2 0.667% 100.000% ** DB Stats ** Uptime(secs): 59.8 total, 15.7 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 164.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.968 H:M:S, 53.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 62.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.823 H:M:S, 81.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.953 micros/op 167971 ops/sec 60.195 seconds 10110999 operations; 162.8 MB/s Microseconds per write: Count: 10110999 Average: 5.9534 StdDev: 332.75 Min: 0 Median: 1.7491 Max: 530150 Percentiles: P50: 1.75 P75: 2.77 P99: 9.21 P99.9: 1157.37 P99.99: 2705.63 ------------------------------------------------------ [ 0, 1 ] 1306869 12.925% 12.925% ### ( 1, 2 ] 5004212 49.493% 62.418% ########## ( 2, 3 ] 1647121 16.290% 78.708% ### ( 3, 4 ] 1400112 13.847% 92.556% ### ( 4, 6 ] 558524 5.524% 98.080% # ( 6, 10 ] 115869 1.146% 99.226% ( 10, 15 ] 35832 0.354% 99.580% ( 15, 22 ] 8530 0.084% 99.664% ( 22, 34 ] 1591 0.016% 99.680% ( 34, 51 ] 201 0.002% 99.682% ( 51, 76 ] 30 0.000% 99.682% ( 76, 110 ] 6849 0.068% 99.750% ( 110, 170 ] 2989 0.030% 99.780% ( 170, 250 ] 298 0.003% 99.783% ( 250, 380 ] 158 0.002% 99.784% ( 380, 580 ] 27 0.000% 99.785% ( 580, 870 ] 18 0.000% 99.785% ( 870, 1300 ] 17444 0.173% 99.957% ( 1300, 1900 ] 64 0.001% 99.958% ( 1900, 2900 ] 4034 0.040% 99.998% ( 2900, 4400 ] 148 0.001% 99.999% ( 4400, 6600 ] 40 0.000% 100.000% ( 6600, 9900 ] 12 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 223414 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10110999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10434550968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 574 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32238392 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 34329415994 rocksdb.compact.write.bytes COUNT : 34098782109 rocksdb.flush.write.bytes COUNT : 10370790681 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 70 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 275 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10287393792 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4209664 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 34431790809 rocksdb.non.last.level.read.count COUNT : 8317017 rocksdb.block.checksum.compute.count COUNT : 8315939 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.387137 P95 : 3.920043 P99 : 7.772193 P100 : 530147.000000 COUNT : 10110999 SUM : 55377610 rocksdb.compaction.times.micros P50 : 1024848.484848 P95 : 4410000.000000 P99 : 18047556.000000 P100 : 18047556.000000 COUNT : 98 SUM : 150946012 rocksdb.compaction.times.cpu_micros P50 : 912307.692308 P95 : 4410000.000000 P99 : 16524732.000000 P100 : 16524732.000000 COUNT : 98 SUM : 129907237 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 701.486486 P95 : 1520.000000 P99 : 43540.000000 P100 : 50199.000000 COUNT : 138 SUM : 201201 rocksdb.compaction.outfile.sync.micros P50 : 1082.207792 P95 : 100846.153846 P99 : 219371.428571 P100 : 266576.000000 COUNT : 368 SUM : 6406139 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 105.824561 P95 : 1930.000000 P99 : 3372.500000 P100 : 3929.000000 COUNT : 274 SUM : 93108 rocksdb.table.open.io.micros P50 : 1504.000000 P95 : 7647.391304 P99 : 13207.333333 P100 : 18580.000000 COUNT : 574 SUM : 1248319 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.656731 P95 : 7.685379 P99 : 10.835249 P100 : 11717.000000 COUNT : 8314424 SUM : 47521284 rocksdb.read.block.get.micros P50 : 486.250000 P95 : 3577.142857 P99 : 5373.176471 P100 : 6861.000000 COUNT : 1148 SUM : 1025564 rocksdb.write.raw.block.micros P50 : 0.511914 P95 : 0.972636 P99 : 2.869904 P100 : 18941.000000 COUNT : 10771234 SUM : 20028401 rocksdb.numfiles.in.singlecompaction P50 : 3.185185 P95 : 5.200000 P99 : 18.360000 P100 : 20.000000 COUNT : 156 SUM : 568 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.557002 P95 : 1142.849639 P99 : 2419.738871 P100 : 529894.000000 COUNT : 212913 SUM : 32256292 rocksdb.sst.read.micros P50 : 1.589885 P95 : 4.548122 P99 : 8.384069 P100 : 11711.000000 COUNT : 8317427 SUM : 30406058 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10110999 SUM : 10434550968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 216037.735849 P95 : 355857.142857 P99 : 533900.000000 P100 : 764490.000000 COUNT : 138 SUM : 29736586 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 355 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0