[2024-07-14 03:45:11.215380] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... [2024-07-14 03:45:11.215649] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2738343 ] Set seed to 1720921511208935 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-14 03:45:11.324043] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-14 03:45:11.359878] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-14 03:45:11.359922] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2738343' to capture a snapshot of events at runtime. [2024-07-14 03:45:11.359934] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2738343 for offline analysis/debug. [2024-07-14 03:45:11.359975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Jul 14 03:45:15 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/14-03:45:18 ... thread 0: (1000000,1000000) ops and (341532.4,341532.4) ops/second in (2.927980,2.927980) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 629.98 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 357.4 2.47 2.25 12 0.206 0 0 0.0 0.0 L2 3/2 251.73 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 L3 9/0 741.41 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 97.00 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.8 1.4 95.1 316.8 3.98 3.71 14 0.284 383K 195 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.4 1.4 95.1 316.8 3.98 3.71 14 0.284 383K 195 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 357.4 2.47 2.25 12 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 403.52 MB/s write, 0.37 GB read, 121.06 MB/s read, 4.0 seconds Interval compaction: 1.23 GB write, 429.95 MB/s write, 0.37 GB read, 128.99 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 107866 Average: 1.8511 StdDev: 14.77 Min: 1 Median: 1.2175 Max: 2951 Percentiles: P50: 1.22 P75: 1.66 P99: 3.88 P99.9: 9.92 P99.99: 281.55 ------------------------------------------------------ [ 0, 1 ] 40534 37.578% 37.578% ######## ( 1, 2 ] 61616 57.123% 94.701% ########### ( 2, 3 ] 3466 3.213% 97.914% # ( 3, 4 ] 1331 1.234% 99.148% ( 4, 6 ] 632 0.586% 99.734% ( 6, 10 ] 183 0.170% 99.904% ( 10, 15 ] 66 0.061% 99.965% ( 15, 22 ] 10 0.009% 99.974% ( 22, 34 ] 3 0.003% 99.977% ( 34, 51 ] 1 0.001% 99.978% ( 110, 170 ] 8 0.007% 99.985% ( 170, 250 ] 4 0.004% 99.989% ( 250, 380 ] 5 0.005% 99.994% ( 380, 580 ] 1 0.001% 99.994% ( 580, 870 ] 2 0.002% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 60728 Average: 2.0227 StdDev: 22.35 Min: 1 Median: 1.2474 Max: 4256 Percentiles: P50: 1.25 P75: 1.69 P99: 5.02 P99.9: 11.25 P99.99: 719.72 ------------------------------------------------------ [ 0, 1 ] 21794 35.888% 35.888% ####### ( 1, 2 ] 34649 57.056% 92.944% ########### ( 2, 3 ] 2207 3.634% 96.578% # ( 3, 4 ] 1168 1.923% 98.502% ( 4, 6 ] 595 0.980% 99.481% ( 6, 10 ] 244 0.402% 99.883% ( 10, 15 ] 45 0.074% 99.957% ( 15, 22 ] 7 0.012% 99.969% ( 22, 34 ] 3 0.005% 99.974% ( 34, 51 ] 1 0.002% 99.975% ( 110, 170 ] 1 0.002% 99.977% ( 250, 380 ] 2 0.003% 99.980% ( 380, 580 ] 5 0.008% 99.988% ( 580, 870 ] 4 0.007% 99.995% ( 870, 1300 ] 2 0.003% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ( 2900, 4400 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 55 Average: 1557.3455 StdDev: 1100.28 Min: 89 Median: 1330.0000 Max: 4399 Percentiles: P50: 1330.00 P75: 2286.36 P99: 4282.14 P99.9: 4388.21 P99.99: 4398.82 ------------------------------------------------------ ( 76, 110 ] 1 1.818% 1.818% ( 170, 250 ] 1 1.818% 3.636% ( 250, 380 ] 3 5.455% 9.091% # ( 380, 580 ] 7 12.727% 21.818% ### ( 580, 870 ] 6 10.909% 32.727% ## ( 870, 1300 ] 9 16.364% 49.091% ### ( 1300, 1900 ] 10 18.182% 67.273% #### ( 1900, 2900 ] 11 20.000% 87.273% #### ( 2900, 4400 ] 7 12.727% 100.000% ### ** Level 4 read latency histogram (micros): Count: 15 Average: 1664.3333 StdDev: 947.54 Min: 409 Median: 1600.0000 Max: 3602 Percentiles: P50: 1600.00 P75: 2712.50 P99: 3602.00 P99.9: 3602.00 P99.99: 3602.00 ------------------------------------------------------ ( 380, 580 ] 1 6.667% 6.667% # ( 580, 870 ] 2 13.333% 20.000% ### ( 870, 1300 ] 4 26.667% 46.667% ##### ( 1300, 1900 ] 1 6.667% 53.333% # ( 1900, 2900 ] 4 26.667% 80.000% ##### ( 2900, 4400 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 571.8000 StdDev: 771.46 Min: 73 Median: 101.5000 Max: 2761 Percentiles: P50: 101.50 P75: 870.00 P99: 2761.00 P99.9: 2761.00 P99.99: 2761.00 ------------------------------------------------------ ( 51, 76 ] 4 20.000% 20.000% #### ( 76, 110 ] 8 40.000% 60.000% ######## ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 1 5.000% 70.000% # ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 315.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.395 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.395 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-03:45:21 ... thread 0: (1000000,2000000) ops and (325942.4,333555.3) ops/second in (3.068027,5.996007) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.23 GB 18.9 0.6 0.0 0.6 2.4 1.8 0.0 1.3 75.1 325.4 7.55 6.95 28 0.270 575K 625 0.0 0.0 L1 1/1 2.83 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 234.7 234.3 1.61 1.56 1 1.611 383K 623 0.0 0.0 L2 2/0 55.16 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.4 2.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 L3 42/0 999.49 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 204.9 204.7 3.88 3.43 3 1.295 808K 799 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/10 97.98 GB 0.0 2.1 1.1 1.0 3.9 3.0 2.1 2.1 145.6 275.4 14.55 13.40 34 0.428 2151K 2242 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 1.1 1.0 3.9 3.0 1.7 2.1 145.6 275.4 14.55 13.40 34 0.428 2151K 2242 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 1.1 1.0 2.1 1.1 0.0 0.0 230.4 230.2 9.20 8.60 8 1.149 2151K 2242 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.0 5.35 4.79 26 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.91 GB write, 647.28 MB/s write, 2.07 GB read, 342.33 MB/s read, 14.5 seconds Interval compaction: 3.91 GB write, 667.99 MB/s write, 2.07 GB read, 353.29 MB/s read, 14.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 421716 Average: 2.1174 StdDev: 10.85 Min: 1 Median: 1.4358 Max: 4161 Percentiles: P50: 1.44 P75: 1.83 P99: 5.67 P99.9: 11.47 P99.99: 14.93 ------------------------------------------------------ [ 0, 1 ] 93242 22.110% 22.110% #### ( 1, 2 ] 269913 64.003% 86.114% ############# ( 2, 3 ] 31181 7.394% 93.507% # ( 3, 4 ] 15132 3.588% 97.096% # ( 4, 6 ] 9640 2.286% 99.382% ( 6, 10 ] 2026 0.480% 99.862% ( 10, 15 ] 547 0.130% 99.992% ( 15, 22 ] 57 0.014% 100.005% ( 22, 34 ] 8 0.002% 100.007% ( 34, 51 ] 5 0.001% 100.008% ( 51, 76 ] 1 0.000% 100.009% ( 110, 170 ] 13 0.003% 100.012% ( 170, 250 ] 11 0.003% 100.014% ( 250, 380 ] 10 0.002% 100.017% ( 380, 580 ] 6 0.001% 100.018% ( 580, 870 ] 9 0.002% 100.020% ( 870, 1300 ] 2 0.000% 100.021% ( 1300, 1900 ] 1 0.000% 100.021% ( 1900, 2900 ] 2 0.000% 100.021% ( 2900, 4400 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 81517 Average: 2.4008 StdDev: 8.56 Min: 1 Median: 1.5933 Max: 2067 Percentiles: P50: 1.59 P75: 1.97 P99: 6.21 P99.9: 13.04 P99.99: 16.70 ------------------------------------------------------ [ 0, 1 ] 9075 11.133% 11.133% ## ( 1, 2 ] 53404 65.513% 76.645% ############# ( 2, 3 ] 10204 12.518% 89.163% ### ( 3, 4 ] 4348 5.334% 94.497% # ( 4, 6 ] 3636 4.460% 98.957% # ( 6, 10 ] 662 0.812% 99.769% ( 10, 15 ] 175 0.215% 99.984% ( 15, 22 ] 20 0.025% 100.009% ( 22, 34 ] 6 0.007% 100.016% ( 34, 51 ] 1 0.001% 100.017% ( 51, 76 ] 1 0.001% 100.018% ( 170, 250 ] 2 0.002% 100.021% ( 250, 380 ] 2 0.002% 100.023% ( 380, 580 ] 1 0.001% 100.025% ( 580, 870 ] 1 0.001% 100.026% ( 870, 1300 ] 1 0.001% 100.027% ( 1900, 2900 ] 1 0.001% 100.028% ** Level 2 read latency histogram (micros): Count: 95442 Average: 2.0685 StdDev: 17.84 Min: 1 Median: 1.3480 Max: 4256 Percentiles: P50: 1.35 P75: 1.76 P99: 5.48 P99.9: 11.07 P99.99: 518.23 ------------------------------------------------------ [ 0, 1 ] 27782 29.109% 29.109% ###### ( 1, 2 ] 57302 60.039% 89.147% ############ ( 2, 3 ] 5438 5.698% 94.845% # ( 3, 4 ] 2790 2.923% 97.768% # ( 4, 6 ] 1588 1.664% 99.432% ( 6, 10 ] 429 0.449% 99.882% ( 10, 15 ] 82 0.086% 99.968% ( 15, 22 ] 11 0.012% 99.979% ( 22, 34 ] 3 0.003% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 5 0.005% 99.992% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57460 Average: 3.9002 StdDev: 59.09 Min: 0 Median: 1.5893 Max: 4399 Percentiles: P50: 1.59 P75: 1.98 P99: 7.26 P99.9: 50.22 P99.99: 1923.09 ------------------------------------------------------ [ 0, 1 ] 6837 11.899% 11.899% ## ( 1, 2 ] 37151 64.655% 76.554% ############# ( 2, 3 ] 7055 12.278% 88.832% ## ( 3, 4 ] 3057 5.320% 94.152% # ( 4, 6 ] 2633 4.582% 98.735% # ( 6, 10 ] 482 0.839% 99.574% ( 10, 15 ] 131 0.228% 99.802% ( 15, 22 ] 21 0.037% 99.838% ( 22, 34 ] 26 0.045% 99.883% ( 34, 51 ] 10 0.017% 99.901% ( 51, 76 ] 1 0.002% 99.903% ( 76, 110 ] 1 0.002% 99.904% ( 110, 170 ] 4 0.007% 99.911% ( 170, 250 ] 6 0.010% 99.922% ( 250, 380 ] 6 0.010% 99.932% ( 380, 580 ] 7 0.012% 99.944% ( 580, 870 ] 7 0.012% 99.956% ( 870, 1300 ] 9 0.016% 99.972% ( 1300, 1900 ] 10 0.017% 99.990% ( 1900, 2900 ] 11 0.019% 100.009% ( 2900, 4400 ] 7 0.012% 100.021% ** Level 4 read latency histogram (micros): Count: 15 Average: 1664.3333 StdDev: 947.54 Min: 409 Median: 1600.0000 Max: 3602 Percentiles: P50: 1600.00 P75: 2712.50 P99: 3602.00 P99.9: 3602.00 P99.99: 3602.00 ------------------------------------------------------ ( 380, 580 ] 1 6.667% 6.667% # ( 580, 870 ] 2 13.333% 20.000% ### ( 870, 1300 ] 4 26.667% 46.667% ##### ( 1300, 1900 ] 1 6.667% 53.333% # ( 1900, 2900 ] 4 26.667% 80.000% ##### ( 2900, 4400 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 40 Average: 608.4250 StdDev: 819.51 Min: 73 Median: 155.0000 Max: 3556 Percentiles: P50: 155.00 P75: 956.00 P99: 3556.00 P99.9: 3556.00 P99.99: 3556.00 ------------------------------------------------------ ( 51, 76 ] 4 10.000% 10.000% ## ( 76, 110 ] 10 25.000% 35.000% ##### ( 110, 170 ] 8 20.000% 55.000% #### ( 170, 250 ] 1 2.500% 57.500% # ( 250, 380 ] 3 7.500% 65.000% ## ( 380, 580 ] 2 5.000% 70.000% # ( 580, 870 ] 1 2.500% 72.500% # ( 870, 1300 ] 5 12.500% 85.000% ### ( 1300, 1900 ] 2 5.000% 90.000% # ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.854 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.459 H:M:S, 15.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-03:45:24 ... thread 0: (1000000,3000000) ops and (336354.4,334483.1) ops/second in (2.973055,8.969062) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 1.4 0.0 1.4 4.2 2.8 0.0 1.5 107.0 316.3 13.54 12.58 44 0.308 1471K 1561 0.0 0.0 L1 4/0 303.32 MB 30.3 1.2 1.2 0.0 1.2 1.2 0.2 1.0 238.2 237.5 5.03 4.91 2 2.517 1217K 3171 0.0 0.0 L2 3/1 183.93 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 L3 24/9 861.59 MB 0.8 0.8 0.6 0.2 0.8 0.6 0.5 1.4 204.9 204.7 3.88 3.43 3 1.295 808K 799 0.0 0.0 L4 161/0 9.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/14 98.90 GB 0.0 3.7 1.9 1.8 6.5 4.7 3.8 2.3 159.5 277.5 23.97 22.38 51 0.470 3880K 5726 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.9 1.8 6.5 4.7 3.4 2.3 159.5 277.5 23.97 22.38 51 0.470 3880K 5726 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.9 1.8 3.7 1.9 0.0 0.0 239.5 239.1 15.96 15.21 12 1.330 3880K 5726 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 354.0 8.01 7.17 39 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.49 GB write, 725.85 MB/s write, 3.73 GB read, 417.12 MB/s read, 24.0 seconds Interval compaction: 6.49 GB write, 741.38 MB/s write, 3.73 GB read, 426.04 MB/s read, 24.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 794798 Average: 2.1158 StdDev: 9.60 Min: 1 Median: 1.4518 Max: 4161 Percentiles: P50: 1.45 P75: 1.83 P99: 5.58 P99.9: 10.84 P99.99: 14.55 ------------------------------------------------------ [ 0, 1 ] 159949 20.124% 20.124% #### ( 1, 2 ] 525563 66.125% 86.250% ############# ( 2, 3 ] 59433 7.478% 93.728% # ( 3, 4 ] 28503 3.586% 97.314% # ( 4, 6 ] 16928 2.130% 99.444% ( 6, 10 ] 3465 0.436% 99.880% ( 10, 15 ] 964 0.121% 100.001% ( 15, 22 ] 92 0.012% 100.012% ( 22, 34 ] 13 0.002% 100.014% ( 34, 51 ] 8 0.001% 100.015% ( 51, 76 ] 3 0.000% 100.015% ( 110, 170 ] 19 0.002% 100.018% ( 170, 250 ] 16 0.002% 100.020% ( 250, 380 ] 20 0.003% 100.022% ( 380, 580 ] 7 0.001% 100.023% ( 580, 870 ] 14 0.002% 100.025% ( 870, 1300 ] 4 0.001% 100.026% ( 1300, 1900 ] 2 0.000% 100.026% ( 1900, 2900 ] 3 0.000% 100.026% ( 2900, 4400 ] 3 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 111206 Average: 2.4380 StdDev: 11.38 Min: 1 Median: 1.5764 Max: 2067 Percentiles: P50: 1.58 P75: 1.95 P99: 6.39 P99.9: 13.37 P99.99: 21.52 ------------------------------------------------------ [ 0, 1 ] 13196 11.866% 11.866% ## ( 1, 2 ] 73573 66.159% 78.025% ############# ( 2, 3 ] 12889 11.590% 89.616% ## ( 3, 4 ] 5752 5.172% 94.788% # ( 4, 6 ] 4592 4.129% 98.917% # ( 6, 10 ] 946 0.851% 99.768% ( 10, 15 ] 218 0.196% 99.964% ( 15, 22 ] 31 0.028% 99.992% ( 22, 34 ] 6 0.005% 99.997% ( 34, 51 ] 2 0.002% 99.999% ( 51, 76 ] 2 0.002% 100.001% ( 170, 250 ] 3 0.003% 100.004% ( 250, 380 ] 8 0.007% 100.011% ( 380, 580 ] 2 0.002% 100.013% ( 580, 870 ] 3 0.003% 100.015% ( 870, 1300 ] 3 0.003% 100.018% ( 1300, 1900 ] 2 0.002% 100.020% ( 1900, 2900 ] 1 0.001% 100.021% ** Level 2 read latency histogram (micros): Count: 95442 Average: 2.0685 StdDev: 17.84 Min: 1 Median: 1.3480 Max: 4256 Percentiles: P50: 1.35 P75: 1.76 P99: 5.48 P99.9: 11.07 P99.99: 518.23 ------------------------------------------------------ [ 0, 1 ] 27782 29.109% 29.109% ###### ( 1, 2 ] 57302 60.039% 89.147% ############ ( 2, 3 ] 5438 5.698% 94.845% # ( 3, 4 ] 2790 2.923% 97.768% # ( 4, 6 ] 1588 1.664% 99.432% ( 6, 10 ] 429 0.449% 99.882% ( 10, 15 ] 82 0.086% 99.968% ( 15, 22 ] 11 0.012% 99.979% ( 22, 34 ] 3 0.003% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 5 0.005% 99.992% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 75922 Average: 3.4302 StdDev: 51.41 Min: 0 Median: 1.5425 Max: 4399 Percentiles: P50: 1.54 P75: 1.93 P99: 6.70 P99.9: 29.88 P99.99: 1804.47 ------------------------------------------------------ [ 0, 1 ] 11296 14.878% 14.878% ### ( 1, 2 ] 49152 64.740% 79.619% ############# ( 2, 3 ] 8088 10.653% 90.272% ## ( 3, 4 ] 3666 4.829% 95.100% # ( 4, 6 ] 2857 3.763% 98.863% # ( 6, 10 ] 597 0.786% 99.650% ( 10, 15 ] 151 0.199% 99.849% ( 15, 22 ] 22 0.029% 99.878% ( 22, 34 ] 26 0.034% 99.912% ( 34, 51 ] 10 0.013% 99.925% ( 51, 76 ] 1 0.001% 99.926% ( 76, 110 ] 1 0.001% 99.928% ( 110, 170 ] 4 0.005% 99.933% ( 170, 250 ] 6 0.008% 99.941% ( 250, 380 ] 6 0.008% 99.949% ( 380, 580 ] 7 0.009% 99.958% ( 580, 870 ] 7 0.009% 99.967% ( 870, 1300 ] 9 0.012% 99.979% ( 1300, 1900 ] 10 0.013% 99.992% ( 1900, 2900 ] 11 0.014% 100.007% ( 2900, 4400 ] 7 0.009% 100.016% ** Level 4 read latency histogram (micros): Count: 15 Average: 1664.3333 StdDev: 947.54 Min: 409 Median: 1600.0000 Max: 3602 Percentiles: P50: 1600.00 P75: 2712.50 P99: 3602.00 P99.9: 3602.00 P99.99: 3602.00 ------------------------------------------------------ ( 380, 580 ] 1 6.667% 6.667% # ( 580, 870 ] 2 13.333% 20.000% ### ( 870, 1300 ] 4 26.667% 46.667% ##### ( 1300, 1900 ] 1 6.667% 53.333% # ( 1900, 2900 ] 4 26.667% 80.000% ##### ( 2900, 4400 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 60 Average: 668.5167 StdDev: 888.25 Min: 73 Median: 160.0000 Max: 3556 Percentiles: P50: 160.00 P75: 956.00 P99: 3500.00 P99.9: 3556.00 P99.99: 3556.00 ------------------------------------------------------ ( 51, 76 ] 8 13.333% 13.333% ### ( 76, 110 ] 12 20.000% 33.333% #### ( 110, 170 ] 12 20.000% 53.333% #### ( 170, 250 ] 1 1.667% 55.000% ( 250, 380 ] 6 10.000% 65.000% ## ( 380, 580 ] 2 3.333% 68.333% # ( 580, 870 ] 3 5.000% 73.333% # ( 870, 1300 ] 5 8.333% 81.667% ## ( 1300, 1900 ] 2 3.333% 85.000% # ( 1900, 2900 ] 8 13.333% 98.333% ### ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.270 H:M:S, 13.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.416 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-03:45:27 ... thread 0: (1000000,4000000) ops and (342085.8,336352.0) ops/second in (2.923243,11.892305) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.34 GB 207.7 2.5 0.0 2.5 6.3 3.7 0.0 1.7 125.6 312.3 20.57 19.23 62 0.332 2622K 2797 0.0 0.0 L1 4/0 303.32 MB 30.3 1.2 1.2 0.0 1.2 1.2 0.2 1.0 238.2 237.5 5.03 4.91 2 2.517 1217K 3171 0.0 0.0 L2 2/0 55.16 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 L3 17/0 989.62 MB 1.0 1.0 0.7 0.3 1.0 0.7 0.5 1.4 210.7 210.4 4.80 4.32 4 1.200 1018K 799 0.0 0.0 L4 161/0 9.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/4 99.88 GB 0.0 5.1 2.0 3.0 8.8 5.8 3.8 2.3 162.1 282.3 31.91 29.92 70 0.456 5242K 6962 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 2.0 3.0 8.8 5.8 3.4 2.3 162.1 282.3 31.91 29.92 70 0.456 5242K 6962 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 2.0 3.0 5.0 2.0 0.0 0.0 244.7 244.3 21.13 20.28 17 1.243 5242K 6962 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 356.7 10.77 9.64 53 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.80 GB write, 745.18 MB/s write, 5.05 GB read, 427.89 MB/s read, 31.9 seconds Interval compaction: 8.80 GB write, 757.21 MB/s write, 5.05 GB read, 434.80 MB/s read, 31.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1038363 Average: 2.0702 StdDev: 11.29 Min: 1 Median: 1.4177 Max: 5824 Percentiles: P50: 1.42 P75: 1.80 P99: 5.46 P99.9: 10.93 P99.99: 14.71 ------------------------------------------------------ [ 0, 1 ] 236750 22.800% 22.800% ##### ( 1, 2 ] 676085 65.111% 87.911% ############# ( 2, 3 ] 68592 6.606% 94.517% # ( 3, 4 ] 32938 3.172% 97.689% # ( 4, 6 ] 18712 1.802% 99.491% ( 6, 10 ] 4020 0.387% 99.878% ( 10, 15 ] 1235 0.119% 99.997% ( 15, 22 ] 115 0.011% 100.008% ( 22, 34 ] 14 0.001% 100.009% ( 34, 51 ] 11 0.001% 100.010% ( 51, 76 ] 3 0.000% 100.011% ( 110, 170 ] 30 0.003% 100.014% ( 170, 250 ] 18 0.002% 100.015% ( 250, 380 ] 24 0.002% 100.018% ( 380, 580 ] 10 0.001% 100.019% ( 580, 870 ] 20 0.002% 100.021% ( 870, 1300 ] 10 0.001% 100.022% ( 1300, 1900 ] 3 0.000% 100.022% ( 1900, 2900 ] 5 0.000% 100.022% ( 2900, 4400 ] 3 0.000% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 114971 Average: 2.4242 StdDev: 11.19 Min: 1 Median: 1.5723 Max: 2067 Percentiles: P50: 1.57 P75: 1.95 P99: 6.26 P99.9: 13.28 P99.99: 21.44 ------------------------------------------------------ [ 0, 1 ] 13884 12.076% 12.076% ## ( 1, 2 ] 76181 66.261% 78.337% ############# ( 2, 3 ] 13179 11.463% 89.800% ## ( 3, 4 ] 5860 5.097% 94.897% # ( 4, 6 ] 4655 4.049% 98.946% # ( 6, 10 ] 954 0.830% 99.776% ( 10, 15 ] 218 0.190% 99.965% ( 15, 22 ] 31 0.027% 99.992% ( 22, 34 ] 6 0.005% 99.997% ( 34, 51 ] 2 0.002% 99.999% ( 51, 76 ] 2 0.002% 100.001% ( 170, 250 ] 3 0.003% 100.003% ( 250, 380 ] 8 0.007% 100.010% ( 380, 580 ] 2 0.002% 100.012% ( 580, 870 ] 3 0.003% 100.015% ( 870, 1300 ] 3 0.003% 100.017% ( 1300, 1900 ] 2 0.002% 100.019% ( 1900, 2900 ] 1 0.001% 100.020% ** Level 2 read latency histogram (micros): Count: 95442 Average: 2.0685 StdDev: 17.84 Min: 1 Median: 1.3480 Max: 4256 Percentiles: P50: 1.35 P75: 1.76 P99: 5.48 P99.9: 11.07 P99.99: 518.23 ------------------------------------------------------ [ 0, 1 ] 27782 29.109% 29.109% ###### ( 1, 2 ] 57302 60.039% 89.147% ############ ( 2, 3 ] 5438 5.698% 94.845% # ( 3, 4 ] 2790 2.923% 97.768% # ( 4, 6 ] 1588 1.664% 99.432% ( 6, 10 ] 429 0.449% 99.882% ( 10, 15 ] 82 0.086% 99.968% ( 15, 22 ] 11 0.012% 99.979% ( 22, 34 ] 3 0.003% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 5 0.005% 99.992% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 79518 Average: 3.3827 StdDev: 50.36 Min: 0 Median: 1.5346 Max: 4399 Percentiles: P50: 1.53 P75: 1.92 P99: 6.55 P99.9: 30.07 P99.99: 1782.89 ------------------------------------------------------ [ 0, 1 ] 12239 15.391% 15.391% ### ( 1, 2 ] 51480 64.740% 80.132% ############# ( 2, 3 ] 8280 10.413% 90.544% ## ( 3, 4 ] 3761 4.730% 95.274% # ( 4, 6 ] 2880 3.622% 98.896% # ( 6, 10 ] 607 0.763% 99.659% ( 10, 15 ] 151 0.190% 99.849% ( 15, 22 ] 23 0.029% 99.878% ( 22, 34 ] 26 0.033% 99.911% ( 34, 51 ] 10 0.013% 99.923% ( 51, 76 ] 1 0.001% 99.925% ( 76, 110 ] 1 0.001% 99.926% ( 110, 170 ] 4 0.005% 99.931% ( 170, 250 ] 7 0.009% 99.940% ( 250, 380 ] 7 0.009% 99.948% ( 380, 580 ] 8 0.010% 99.958% ( 580, 870 ] 8 0.010% 99.969% ( 870, 1300 ] 9 0.011% 99.980% ( 1300, 1900 ] 10 0.013% 99.992% ( 1900, 2900 ] 11 0.014% 100.006% ( 2900, 4400 ] 7 0.009% 100.015% ** Level 4 read latency histogram (micros): Count: 15 Average: 1664.3333 StdDev: 947.54 Min: 409 Median: 1600.0000 Max: 3602 Percentiles: P50: 1600.00 P75: 2712.50 P99: 3602.00 P99.9: 3602.00 P99.99: 3602.00 ------------------------------------------------------ ( 380, 580 ] 1 6.667% 6.667% # ( 580, 870 ] 2 13.333% 20.000% ### ( 870, 1300 ] 4 26.667% 46.667% ##### ( 1300, 1900 ] 1 6.667% 53.333% # ( 1900, 2900 ] 4 26.667% 80.000% ##### ( 2900, 4400 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 60 Average: 668.5167 StdDev: 888.25 Min: 73 Median: 160.0000 Max: 3556 Percentiles: P50: 160.00 P75: 956.00 P99: 3500.00 P99.9: 3556.00 P99.99: 3556.00 ------------------------------------------------------ ( 51, 76 ] 8 13.333% 13.333% ### ( 76, 110 ] 12 20.000% 33.333% #### ( 110, 170 ] 12 20.000% 53.333% #### ( 170, 250 ] 1 1.667% 55.000% ( 250, 380 ] 6 10.000% 65.000% ## ( 380, 580 ] 2 3.333% 68.333% # ( 580, 870 ] 3 5.000% 73.333% # ( 870, 1300 ] 5 8.333% 81.667% ## ( 1300, 1900 ] 2 3.333% 85.000% # ( 1900, 2900 ] 8 13.333% 98.333% ### ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 12.1 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.675 H:M:S, 13.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 336.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.404 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-03:45:30 ... thread 0: (1000000,5000000) ops and (341493.4,337367.8) ops/second in (2.928314,14.820619) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 3.26 GB 25.2 3.1 0.0 3.1 7.7 4.7 0.0 1.7 124.6 313.9 25.27 23.63 77 0.328 3198K 3454 0.0 0.0 L1 4/4 303.32 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 238.2 237.5 5.03 4.91 2 2.517 1217K 3171 0.0 0.0 L2 2/0 55.16 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 L3 17/0 989.62 MB 1.0 1.0 0.7 0.3 1.0 0.7 0.5 1.4 210.7 210.4 4.80 4.32 4 1.200 1018K 799 0.0 0.0 L4 161/0 9.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/20 100.80 GB 0.0 5.6 2.0 3.6 10.3 6.7 3.8 2.2 156.7 287.2 36.62 34.32 85 0.431 5818K 7619 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 2.0 3.6 10.3 6.7 3.4 2.2 156.7 287.2 36.62 34.32 85 0.431 5818K 7619 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 2.0 3.6 5.6 2.0 0.0 0.0 247.1 246.7 23.22 22.34 19 1.222 5818K 7619 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.5 13.39 11.98 66 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.0 total, 14.8 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.27 GB write, 700.49 MB/s write, 5.60 GB read, 382.20 MB/s read, 36.6 seconds Interval compaction: 10.27 GB write, 709.56 MB/s write, 5.60 GB read, 387.15 MB/s read, 36.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 20, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1315868 Average: 2.0628 StdDev: 11.40 Min: 1 Median: 1.4064 Max: 5824 Percentiles: P50: 1.41 P75: 1.79 P99: 5.38 P99.9: 11.11 P99.99: 16.91 ------------------------------------------------------ [ 0, 1 ] 309679 23.534% 23.534% ##### ( 1, 2 ] 856894 65.120% 88.654% ############# ( 2, 3 ] 82130 6.242% 94.896% # ( 3, 4 ] 39125 2.973% 97.869% # ( 4, 6 ] 21553 1.638% 99.507% ( 6, 10 ] 4847 0.368% 99.875% ( 10, 15 ] 1471 0.112% 99.987% ( 15, 22 ] 141 0.011% 99.998% ( 22, 34 ] 18 0.001% 99.999% ( 34, 51 ] 16 0.001% 100.000% ( 51, 76 ] 5 0.000% 100.001% ( 76, 110 ] 68 0.005% 100.006% ( 110, 170 ] 61 0.005% 100.011% ( 170, 250 ] 27 0.002% 100.013% ( 250, 380 ] 33 0.003% 100.015% ( 380, 580 ] 16 0.001% 100.016% ( 580, 870 ] 27 0.002% 100.018% ( 870, 1300 ] 14 0.001% 100.020% ( 1300, 1900 ] 7 0.001% 100.020% ( 1900, 2900 ] 8 0.001% 100.021% ( 2900, 4400 ] 3 0.000% 100.021% ( 4400, 6600 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 114972 Average: 2.4242 StdDev: 11.19 Min: 1 Median: 1.5723 Max: 2067 Percentiles: P50: 1.57 P75: 1.95 P99: 6.26 P99.9: 13.28 P99.99: 21.44 ------------------------------------------------------ [ 0, 1 ] 13884 12.076% 12.076% ## ( 1, 2 ] 76181 66.260% 78.336% ############# ( 2, 3 ] 13180 11.464% 89.800% ## ( 3, 4 ] 5860 5.097% 94.897% # ( 4, 6 ] 4655 4.049% 98.946% # ( 6, 10 ] 954 0.830% 99.776% ( 10, 15 ] 218 0.190% 99.965% ( 15, 22 ] 31 0.027% 99.992% ( 22, 34 ] 6 0.005% 99.997% ( 34, 51 ] 2 0.002% 99.999% ( 51, 76 ] 2 0.002% 100.001% ( 170, 250 ] 3 0.003% 100.003% ( 250, 380 ] 8 0.007% 100.010% ( 380, 580 ] 2 0.002% 100.012% ( 580, 870 ] 3 0.003% 100.015% ( 870, 1300 ] 3 0.003% 100.017% ( 1300, 1900 ] 2 0.002% 100.019% ( 1900, 2900 ] 1 0.001% 100.020% ** Level 2 read latency histogram (micros): Count: 95442 Average: 2.0685 StdDev: 17.84 Min: 1 Median: 1.3480 Max: 4256 Percentiles: P50: 1.35 P75: 1.76 P99: 5.48 P99.9: 11.07 P99.99: 518.23 ------------------------------------------------------ [ 0, 1 ] 27782 29.109% 29.109% ###### ( 1, 2 ] 57302 60.039% 89.147% ############ ( 2, 3 ] 5438 5.698% 94.845% # ( 3, 4 ] 2790 2.923% 97.768% # ( 4, 6 ] 1588 1.664% 99.432% ( 6, 10 ] 429 0.449% 99.882% ( 10, 15 ] 82 0.086% 99.968% ( 15, 22 ] 11 0.012% 99.979% ( 22, 34 ] 3 0.003% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 5 0.005% 99.992% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 79518 Average: 3.3827 StdDev: 50.36 Min: 0 Median: 1.5346 Max: 4399 Percentiles: P50: 1.53 P75: 1.92 P99: 6.55 P99.9: 30.07 P99.99: 1782.89 ------------------------------------------------------ [ 0, 1 ] 12239 15.391% 15.391% ### ( 1, 2 ] 51480 64.740% 80.132% ############# ( 2, 3 ] 8280 10.413% 90.544% ## ( 3, 4 ] 3761 4.730% 95.274% # ( 4, 6 ] 2880 3.622% 98.896% # ( 6, 10 ] 607 0.763% 99.659% ( 10, 15 ] 151 0.190% 99.849% ( 15, 22 ] 23 0.029% 99.878% ( 22, 34 ] 26 0.033% 99.911% ( 34, 51 ] 10 0.013% 99.923% ( 51, 76 ] 1 0.001% 99.925% ( 76, 110 ] 1 0.001% 99.926% ( 110, 170 ] 4 0.005% 99.931% ( 170, 250 ] 7 0.009% 99.940% ( 250, 380 ] 7 0.009% 99.948% ( 380, 580 ] 8 0.010% 99.958% ( 580, 870 ] 8 0.010% 99.969% ( 870, 1300 ] 9 0.011% 99.980% ( 1300, 1900 ] 10 0.013% 99.992% ( 1900, 2900 ] 11 0.014% 100.006% ( 2900, 4400 ] 7 0.009% 100.015% ** Level 4 read latency histogram (micros): Count: 15 Average: 1664.3333 StdDev: 947.54 Min: 409 Median: 1600.0000 Max: 3602 Percentiles: P50: 1600.00 P75: 2712.50 P99: 3602.00 P99.9: 3602.00 P99.99: 3602.00 ------------------------------------------------------ ( 380, 580 ] 1 6.667% 6.667% # ( 580, 870 ] 2 13.333% 20.000% ### ( 870, 1300 ] 4 26.667% 46.667% ##### ( 1300, 1900 ] 1 6.667% 53.333% # ( 1900, 2900 ] 4 26.667% 80.000% ##### ( 2900, 4400 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 60 Average: 668.5167 StdDev: 888.25 Min: 73 Median: 160.0000 Max: 3556 Percentiles: P50: 160.00 P75: 956.00 P99: 3500.00 P99.9: 3556.00 P99.99: 3556.00 ------------------------------------------------------ ( 51, 76 ] 8 13.333% 13.333% ### ( 76, 110 ] 12 20.000% 33.333% #### ( 110, 170 ] 12 20.000% 53.333% #### ( 170, 250 ] 1 1.667% 55.000% ( 250, 380 ] 6 10.000% 65.000% ## ( 380, 580 ] 2 3.333% 68.333% # ( 580, 870 ] 3 5.000% 73.333% # ( 870, 1300 ] 5 8.333% 81.667% ## ( 1300, 1900 ] 2 3.333% 85.000% # ( 1900, 2900 ] 8 13.333% 98.333% ### ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 15.0 total, 2.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 327.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.089 H:M:S, 13.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 336.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.415 H:M:S, 14.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-03:45:38 ... thread 0: (1000000,6000000) ops and (124396.1,262473.4) ops/second in (8.038840,22.859459) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 4.24 GB 125.5 5.1 0.0 5.1 10.8 5.7 0.0 1.9 146.3 308.3 35.73 33.66 97 0.368 5308K 8569 0.0 0.0 L1 4/4 303.32 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 238.2 237.5 5.03 4.91 2 2.517 1217K 3171 0.0 0.0 L2 2/0 55.16 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 L3 17/0 989.62 MB 1.0 1.0 0.7 0.3 1.0 0.7 0.5 1.4 210.7 210.4 4.80 4.32 4 1.200 1018K 799 0.0 0.0 L4 161/0 9.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/20 101.78 GB 0.0 7.6 2.0 5.6 13.3 7.7 3.8 2.3 166.1 288.9 47.07 44.35 105 0.448 7927K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.6 2.0 5.6 13.3 7.7 3.4 2.3 166.1 288.9 47.07 44.35 105 0.448 7927K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.6 2.0 5.6 7.6 2.0 0.0 0.0 253.9 253.4 30.79 29.79 24 1.283 7927K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 356.0 16.28 14.56 81 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.1 total, 22.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.28 GB write, 589.86 MB/s write, 7.63 GB read, 339.06 MB/s read, 47.1 seconds Interval compaction: 13.28 GB write, 594.81 MB/s write, 7.63 GB read, 341.91 MB/s read, 47.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 22, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2236941 Average: 2.0829 StdDev: 10.75 Min: 1 Median: 1.4103 Max: 5824 Percentiles: P50: 1.41 P75: 1.79 P99: 5.46 P99.9: 11.99 P99.99: 94.39 ------------------------------------------------------ [ 0, 1 ] 509608 22.781% 22.781% ##### ( 1, 2 ] 1483807 66.332% 89.113% ############# ( 2, 3 ] 131965 5.899% 95.013% # ( 3, 4 ] 64870 2.900% 97.913% # ( 4, 6 ] 33320 1.490% 99.402% ( 6, 10 ] 10213 0.457% 99.859% ( 10, 15 ] 2320 0.104% 99.963% ( 15, 22 ] 440 0.020% 99.982% ( 22, 34 ] 25 0.001% 99.983% ( 34, 51 ] 18 0.001% 99.984% ( 51, 76 ] 9 0.000% 99.985% ( 76, 110 ] 228 0.010% 99.995% ( 110, 170 ] 243 0.011% 100.006% ( 170, 250 ] 87 0.004% 100.009% ( 250, 380 ] 62 0.003% 100.012% ( 380, 580 ] 52 0.002% 100.015% ( 580, 870 ] 49 0.002% 100.017% ( 870, 1300 ] 21 0.001% 100.018% ( 1300, 1900 ] 10 0.000% 100.018% ( 1900, 2900 ] 9 0.000% 100.019% ( 2900, 4400 ] 7 0.000% 100.019% ( 4400, 6600 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 139769 Average: 2.4215 StdDev: 10.92 Min: 1 Median: 1.5451 Max: 2067 Percentiles: P50: 1.55 P75: 1.92 P99: 6.73 P99.9: 14.51 P99.99: 155.05 ------------------------------------------------------ [ 0, 1 ] 19080 13.651% 13.651% ### ( 1, 2 ] 93195 66.678% 80.329% ############# ( 2, 3 ] 14310 10.238% 90.567% ## ( 3, 4 ] 6524 4.668% 95.235% # ( 4, 6 ] 5033 3.601% 98.836% # ( 6, 10 ] 1261 0.902% 99.738% ( 10, 15 ] 251 0.180% 99.918% ( 15, 22 ] 43 0.031% 99.948% ( 22, 34 ] 6 0.004% 99.953% ( 34, 51 ] 2 0.001% 99.954% ( 51, 76 ] 2 0.001% 99.956% ( 76, 110 ] 27 0.019% 99.975% ( 110, 170 ] 28 0.020% 99.995% ( 170, 250 ] 6 0.004% 99.999% ( 250, 380 ] 10 0.007% 100.006% ( 380, 580 ] 3 0.002% 100.009% ( 580, 870 ] 5 0.004% 100.012% ( 870, 1300 ] 3 0.002% 100.014% ( 1300, 1900 ] 2 0.001% 100.016% ( 1900, 2900 ] 1 0.001% 100.016% ** Level 2 read latency histogram (micros): Count: 95442 Average: 2.0685 StdDev: 17.84 Min: 1 Median: 1.3480 Max: 4256 Percentiles: P50: 1.35 P75: 1.76 P99: 5.48 P99.9: 11.07 P99.99: 518.23 ------------------------------------------------------ [ 0, 1 ] 27782 29.109% 29.109% ###### ( 1, 2 ] 57302 60.039% 89.147% ############ ( 2, 3 ] 5438 5.698% 94.845% # ( 3, 4 ] 2790 2.923% 97.768% # ( 4, 6 ] 1588 1.664% 99.432% ( 6, 10 ] 429 0.449% 99.882% ( 10, 15 ] 82 0.086% 99.968% ( 15, 22 ] 11 0.012% 99.979% ( 22, 34 ] 3 0.003% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 5 0.005% 99.992% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 79518 Average: 3.3827 StdDev: 50.36 Min: 0 Median: 1.5346 Max: 4399 Percentiles: P50: 1.53 P75: 1.92 P99: 6.55 P99.9: 30.07 P99.99: 1782.89 ------------------------------------------------------ [ 0, 1 ] 12239 15.391% 15.391% ### ( 1, 2 ] 51480 64.740% 80.132% ############# ( 2, 3 ] 8280 10.413% 90.544% ## ( 3, 4 ] 3761 4.730% 95.274% # ( 4, 6 ] 2880 3.622% 98.896% # ( 6, 10 ] 607 0.763% 99.659% ( 10, 15 ] 151 0.190% 99.849% ( 15, 22 ] 23 0.029% 99.878% ( 22, 34 ] 26 0.033% 99.911% ( 34, 51 ] 10 0.013% 99.923% ( 51, 76 ] 1 0.001% 99.925% ( 76, 110 ] 1 0.001% 99.926% ( 110, 170 ] 4 0.005% 99.931% ( 170, 250 ] 7 0.009% 99.940% ( 250, 380 ] 7 0.009% 99.948% ( 380, 580 ] 8 0.010% 99.958% ( 580, 870 ] 8 0.010% 99.969% ( 870, 1300 ] 9 0.011% 99.980% ( 1300, 1900 ] 10 0.013% 99.992% ( 1900, 2900 ] 11 0.014% 100.006% ( 2900, 4400 ] 7 0.009% 100.015% ** Level 4 read latency histogram (micros): Count: 15 Average: 1664.3333 StdDev: 947.54 Min: 409 Median: 1600.0000 Max: 3602 Percentiles: P50: 1600.00 P75: 2712.50 P99: 3602.00 P99.9: 3602.00 P99.99: 3602.00 ------------------------------------------------------ ( 380, 580 ] 1 6.667% 6.667% # ( 580, 870 ] 2 13.333% 20.000% ### ( 870, 1300 ] 4 26.667% 46.667% ##### ( 1300, 1900 ] 1 6.667% 53.333% # ( 1900, 2900 ] 4 26.667% 80.000% ##### ( 2900, 4400 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 60 Average: 668.5167 StdDev: 888.25 Min: 73 Median: 160.0000 Max: 3556 Percentiles: P50: 160.00 P75: 956.00 P99: 3500.00 P99.9: 3556.00 P99.99: 3556.00 ------------------------------------------------------ ( 51, 76 ] 8 13.333% 13.333% ### ( 76, 110 ] 12 20.000% 33.333% #### ( 110, 170 ] 12 20.000% 53.333% #### ( 170, 250 ] 1 1.667% 55.000% ( 250, 380 ] 6 10.000% 65.000% ## ( 380, 580 ] 2 3.333% 68.333% # ( 580, 870 ] 3 5.000% 73.333% # ( 870, 1300 ] 5 8.333% 81.667% ## ( 1300, 1900 ] 2 3.333% 85.000% # ( 1900, 2900 ] 8 13.333% 98.333% ### ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 23.1 total, 8.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 256.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.513 H:M:S, 32.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 122.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.424 H:M:S, 67.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-03:45:44 ... thread 0: (1000000,7000000) ops and (160310.1,240571.6) ops/second in (6.237910,29.097369) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 2.39 GB 131.8 5.8 0.0 5.8 12.4 6.6 0.0 1.9 141.9 301.6 42.16 38.82 114 0.370 6075K 9365 0.0 0.0 L1 9/0 1.00 GB 102.9 4.2 3.9 0.3 4.2 3.9 0.2 1.1 231.6 229.0 18.71 18.04 3 6.237 4401K 48K 0.0 0.0 L2 13/10 1.51 GB 3.9 0.4 0.2 0.2 0.4 0.2 2.9 2.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 L3 21/10 1.52 GB 0.5 1.5 1.0 0.5 1.5 1.0 0.7 1.5 172.3 171.8 9.07 6.84 7 1.295 1578K 4223 0.0 0.0 L4 161/0 9.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/28 102.66 GB 0.0 12.0 5.1 6.9 18.5 11.6 6.0 2.8 171.6 265.0 71.44 65.15 126 0.567 12M 62K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.0 5.1 6.9 18.5 11.6 5.6 2.8 171.6 265.0 71.44 65.15 126 0.567 12M 62K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.0 5.1 6.9 11.9 5.0 0.0 0.0 237.8 236.6 51.54 48.20 31 1.663 12M 62K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 338.7 19.90 16.96 95 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.3 total, 29.1 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.49 GB write, 646.44 MB/s write, 11.97 GB read, 418.50 MB/s read, 71.4 seconds Interval compaction: 18.49 GB write, 650.70 MB/s write, 11.97 GB read, 421.26 MB/s read, 71.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 27, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2801296 Average: 2.1950 StdDev: 12.31 Min: 1 Median: 1.4294 Max: 5824 Percentiles: P50: 1.43 P75: 1.81 P99: 5.80 P99.9: 13.83 P99.99: 153.17 ------------------------------------------------------ [ 0, 1 ] 606830 21.662% 21.662% #### ( 1, 2 ] 1848593 65.991% 87.653% ############# ( 2, 3 ] 179952 6.424% 94.077% # ( 3, 4 ] 89219 3.185% 97.262% # ( 4, 6 ] 54114 1.932% 99.194% ( 6, 10 ] 17230 0.615% 99.809% ( 10, 15 ] 3337 0.119% 99.928% ( 15, 22 ] 552 0.020% 99.948% ( 22, 34 ] 37 0.001% 99.949% ( 34, 51 ] 35 0.001% 99.950% ( 51, 76 ] 26 0.001% 99.951% ( 76, 110 ] 621 0.022% 99.973% ( 110, 170 ] 653 0.023% 99.997% ( 170, 250 ] 201 0.007% 100.004% ( 250, 380 ] 119 0.004% 100.008% ( 380, 580 ] 128 0.005% 100.013% ( 580, 870 ] 79 0.003% 100.015% ( 870, 1300 ] 30 0.001% 100.016% ( 1300, 1900 ] 22 0.001% 100.017% ( 1900, 2900 ] 13 0.000% 100.018% ( 2900, 4400 ] 11 0.000% 100.018% ( 4400, 6600 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 499903 Average: 4.5621 StdDev: 62.73 Min: 0 Median: 1.7235 Max: 7318 Percentiles: P50: 1.72 P75: 2.60 P99: 9.29 P99.9: 84.91 P99.99: 283.07 ------------------------------------------------------ [ 0, 1 ] 39688 7.939% 7.939% ## ( 1, 2 ] 290626 58.136% 66.076% ############ ( 2, 3 ] 74672 14.937% 81.013% ### ( 3, 4 ] 39979 7.997% 89.010% ## ( 4, 6 ] 41255 8.253% 97.263% ## ( 6, 10 ] 10549 2.110% 99.373% ( 10, 15 ] 2219 0.444% 99.817% ( 15, 22 ] 330 0.066% 99.883% ( 22, 34 ] 38 0.008% 99.891% ( 34, 51 ] 7 0.001% 99.892% ( 51, 76 ] 11 0.002% 99.894% ( 76, 110 ] 111 0.022% 99.916% ( 110, 170 ] 213 0.043% 99.959% ( 170, 250 ] 111 0.022% 99.981% ( 250, 380 ] 173 0.035% 100.016% ( 380, 580 ] 199 0.040% 100.056% ( 580, 870 ] 156 0.031% 100.087% ( 870, 1300 ] 97 0.019% 100.106% ( 1300, 1900 ] 56 0.011% 100.117% ( 1900, 2900 ] 54 0.011% 100.128% ( 2900, 4400 ] 57 0.011% 100.140% ( 4400, 6600 ] 16 0.003% 100.143% ( 6600, 9900 ] 3 0.001% 100.143% ** Level 2 read latency histogram (micros): Count: 105082 Average: 3.5553 StdDev: 58.65 Min: 1 Median: 1.3946 Max: 6553 Percentiles: P50: 1.39 P75: 1.82 P99: 5.97 P99.9: 423.84 P99.99: 3005.39 ------------------------------------------------------ [ 0, 1 ] 27992 26.638% 26.638% ##### ( 1, 2 ] 62212 59.203% 85.842% ############ ( 2, 3 ] 7414 7.055% 92.897% # ( 3, 4 ] 3774 3.591% 96.488% # ( 4, 6 ] 2677 2.548% 99.036% # ( 6, 10 ] 678 0.645% 99.681% ( 10, 15 ] 148 0.141% 99.822% ( 15, 22 ] 21 0.020% 99.842% ( 22, 34 ] 3 0.003% 99.845% ( 34, 51 ] 2 0.002% 99.847% ( 110, 170 ] 14 0.013% 99.860% ( 170, 250 ] 12 0.011% 99.872% ( 250, 380 ] 24 0.023% 99.894% ( 380, 580 ] 27 0.026% 99.920% ( 580, 870 ] 25 0.024% 99.944% ( 870, 1300 ] 27 0.026% 99.970% ( 1300, 1900 ] 10 0.010% 99.979% ( 1900, 2900 ] 11 0.010% 99.990% ( 2900, 4400 ] 7 0.007% 99.996% ( 4400, 6600 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 219807 Average: 7.7203 StdDev: 107.47 Min: 0 Median: 1.7363 Max: 7888 Percentiles: P50: 1.74 P75: 2.63 P99: 10.11 P99.9: 1101.14 P99.99: 2749.67 ------------------------------------------------------ [ 0, 1 ] 16437 7.478% 7.478% # ( 1, 2 ] 126934 57.748% 65.226% ############ ( 2, 3 ] 34220 15.568% 80.794% ### ( 3, 4 ] 17902 8.144% 88.938% ## ( 4, 6 ] 17998 8.188% 97.127% ## ( 6, 10 ] 4094 1.863% 98.989% ( 10, 15 ] 1077 0.490% 99.479% ( 15, 22 ] 149 0.068% 99.547% ( 22, 34 ] 35 0.016% 99.563% ( 34, 51 ] 12 0.005% 99.568% ( 51, 76 ] 3 0.001% 99.570% ( 76, 110 ] 11 0.005% 99.575% ( 110, 170 ] 50 0.023% 99.597% ( 170, 250 ] 80 0.036% 99.634% ( 250, 380 ] 153 0.070% 99.703% ( 380, 580 ] 191 0.087% 99.790% ( 580, 870 ] 174 0.079% 99.869% ( 870, 1300 ] 125 0.057% 99.926% ( 1300, 1900 ] 61 0.028% 99.954% ( 1900, 2900 ] 93 0.042% 99.996% ( 2900, 4400 ] 74 0.034% 100.030% ( 4400, 6600 ] 18 0.008% 100.038% ( 6600, 9900 ] 2 0.001% 100.039% ** Level 4 read latency histogram (micros): Count: 15 Average: 1664.3333 StdDev: 947.54 Min: 409 Median: 1600.0000 Max: 3602 Percentiles: P50: 1600.00 P75: 2712.50 P99: 3602.00 P99.9: 3602.00 P99.99: 3602.00 ------------------------------------------------------ ( 380, 580 ] 1 6.667% 6.667% # ( 580, 870 ] 2 13.333% 20.000% ### ( 870, 1300 ] 4 26.667% 46.667% ##### ( 1300, 1900 ] 1 6.667% 53.333% # ( 1900, 2900 ] 4 26.667% 80.000% ##### ( 2900, 4400 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 60 Average: 668.5167 StdDev: 888.25 Min: 73 Median: 160.0000 Max: 3556 Percentiles: P50: 160.00 P75: 956.00 P99: 3500.00 P99.9: 3556.00 P99.99: 3556.00 ------------------------------------------------------ ( 51, 76 ] 8 13.333% 13.333% ### ( 76, 110 ] 12 20.000% 33.333% #### ( 110, 170 ] 12 20.000% 53.333% #### ( 170, 250 ] 1 1.667% 55.000% ( 250, 380 ] 6 10.000% 65.000% ## ( 380, 580 ] 2 3.333% 68.333% # ( 580, 870 ] 3 5.000% 73.333% # ( 870, 1300 ] 5 8.333% 81.667% ## ( 1300, 1900 ] 2 3.333% 85.000% # ( 1900, 2900 ] 8 13.333% 98.333% ### ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 29.3 total, 6.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 235.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.970 H:M:S, 37.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 157.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.457 H:M:S, 55.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/14-03:45:49 ... thread 0: (1000000,8000000) ops and (208598.1,236048.9) ops/second in (4.793907,33.891276) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 3.37 GB 50.4 7.3 0.0 7.3 14.8 7.6 0.0 2.0 139.5 284.6 53.29 47.30 130 0.410 7546K 12K 0.0 0.0 L1 9/9 1.00 GB 0.0 4.2 3.9 0.3 4.2 3.9 0.2 1.1 231.6 229.0 18.71 18.04 3 6.237 4401K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.9 2.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 L3 19/0 986.11 MB 1.0 4.5 2.5 2.0 4.5 2.5 0.7 1.8 163.5 162.8 28.05 20.53 15 1.870 4650K 19K 0.0 0.0 L4 170/0 9.44 GB 1.0 1.7 1.4 0.2 1.7 1.4 1.7 1.1 139.3 138.6 12.25 7.83 25 0.490 1703K 7103 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/20 103.62 GB 0.0 18.0 8.1 9.9 25.5 15.5 9.0 3.4 162.0 229.3 113.80 95.16 175 0.650 18M 87K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.0 8.1 9.9 25.5 15.5 8.6 3.4 162.0 229.3 113.80 95.16 175 0.650 18M 87K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.0 8.1 9.9 17.9 8.0 0.0 0.0 206.2 205.2 89.40 75.47 67 1.334 18M 87K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 317.5 24.41 19.69 108 0.226 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.1 total, 33.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.48 GB write, 765.60 MB/s write, 18.00 GB read, 540.91 MB/s read, 113.8 seconds Interval compaction: 25.48 GB write, 769.93 MB/s write, 18.00 GB read, 543.97 MB/s read, 113.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 62, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3187520 Average: 2.4115 StdDev: 20.96 Min: 1 Median: 1.4610 Max: 9924 Percentiles: P50: 1.46 P75: 1.85 P99: 6.01 P99.9: 14.55 P99.99: 235.75 ------------------------------------------------------ [ 0, 1 ] 637987 20.015% 20.015% #### ( 1, 2 ] 2073416 65.048% 85.063% ############# ( 2, 3 ] 237870 7.463% 92.526% # ( 3, 4 ] 119412 3.746% 96.272% # ( 4, 6 ] 86879 2.726% 98.997% # ( 6, 10 ] 24407 0.766% 99.763% ( 10, 15 ] 4796 0.150% 99.914% ( 15, 22 ] 688 0.022% 99.935% ( 22, 34 ] 44 0.001% 99.937% ( 34, 51 ] 39 0.001% 99.938% ( 51, 76 ] 31 0.001% 99.939% ( 76, 110 ] 653 0.020% 99.959% ( 110, 170 ] 747 0.023% 99.983% ( 170, 250 ] 285 0.009% 99.992% ( 250, 380 ] 215 0.007% 99.998% ( 380, 580 ] 256 0.008% 100.006% ( 580, 870 ] 228 0.007% 100.014% ( 870, 1300 ] 91 0.003% 100.016% ( 1300, 1900 ] 52 0.002% 100.018% ( 1900, 2900 ] 34 0.001% 100.019% ( 2900, 4400 ] 28 0.001% 100.020% ( 4400, 6600 ] 9 0.000% 100.020% ( 6600, 9900 ] 1 0.000% 100.020% ( 9900, 14000 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 759387 Average: 5.0120 StdDev: 77.50 Min: 0 Median: 1.7524 Max: 16811 Percentiles: P50: 1.75 P75: 2.67 P99: 9.49 P99.9: 99.02 P99.99: 396.37 ------------------------------------------------------ [ 0, 1 ] 50316 6.626% 6.626% # ( 1, 2 ] 437741 57.644% 64.270% ############ ( 2, 3 ] 121102 15.947% 80.217% ### ( 3, 4 ] 61846 8.144% 88.361% ## ( 4, 6 ] 65680 8.649% 97.010% ## ( 6, 10 ] 17301 2.278% 99.289% ( 10, 15 ] 3936 0.518% 99.807% ( 15, 22 ] 545 0.072% 99.879% ( 22, 34 ] 55 0.007% 99.886% ( 34, 51 ] 8 0.001% 99.887% ( 51, 76 ] 15 0.002% 99.889% ( 76, 110 ] 122 0.016% 99.905% ( 110, 170 ] 237 0.031% 99.936% ( 170, 250 ] 143 0.019% 99.955% ( 250, 380 ] 240 0.032% 99.987% ( 380, 580 ] 294 0.039% 100.026% ( 580, 870 ] 259 0.034% 100.060% ( 870, 1300 ] 164 0.022% 100.081% ( 1300, 1900 ] 99 0.013% 100.094% ( 1900, 2900 ] 103 0.014% 100.108% ( 2900, 4400 ] 110 0.014% 100.122% ( 4400, 6600 ] 39 0.005% 100.127% ( 6600, 9900 ] 7 0.001% 100.128% ( 9900, 14000 ] 2 0.000% 100.129% ( 14000, 22000 ] 1 0.000% 100.129% ** Level 2 read latency histogram (micros): Count: 124221 Average: 4.3995 StdDev: 70.07 Min: 1 Median: 1.4681 Max: 6553 Percentiles: P50: 1.47 P75: 1.90 P99: 8.20 P99.9: 677.41 P99.99: 3781.49 ------------------------------------------------------ [ 0, 1 ] 28432 22.888% 22.888% ##### ( 1, 2 ] 71941 57.914% 80.802% ############ ( 2, 3 ] 11090 8.928% 89.730% ## ( 3, 4 ] 5810 4.677% 94.407% # ( 4, 6 ] 4981 4.010% 98.417% # ( 6, 10 ] 1319 1.062% 99.478% ( 10, 15 ] 322 0.259% 99.738% ( 15, 22 ] 48 0.039% 99.776% ( 22, 34 ] 4 0.003% 99.779% ( 34, 51 ] 2 0.002% 99.781% ( 110, 170 ] 17 0.014% 99.795% ( 170, 250 ] 24 0.019% 99.814% ( 250, 380 ] 39 0.031% 99.845% ( 380, 580 ] 53 0.043% 99.888% ( 580, 870 ] 44 0.035% 99.924% ( 870, 1300 ] 39 0.031% 99.955% ( 1300, 1900 ] 15 0.012% 99.967% ( 1900, 2900 ] 18 0.014% 99.981% ( 2900, 4400 ] 18 0.014% 99.996% ( 4400, 6600 ] 5 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 818647 Average: 7.3262 StdDev: 110.17 Min: 0 Median: 1.8304 Max: 11731 Percentiles: P50: 1.83 P75: 2.87 P99: 9.40 P99.9: 309.88 P99.99: 549.07 ------------------------------------------------------ [ 0, 1 ] 36499 4.458% 4.458% # ( 1, 2 ] 448985 54.845% 59.303% ########### ( 2, 3 ] 147917 18.068% 77.372% #### ( 3, 4 ] 79335 9.691% 87.063% ## ( 4, 6 ] 84377 10.307% 97.370% ## ( 6, 10 ] 15702 1.918% 99.288% ( 10, 15 ] 3818 0.466% 99.754% ( 15, 22 ] 431 0.053% 99.807% ( 22, 34 ] 54 0.007% 99.813% ( 34, 51 ] 14 0.002% 99.815% ( 51, 76 ] 9 0.001% 99.816% ( 76, 110 ] 61 0.007% 99.823% ( 110, 170 ] 168 0.021% 99.844% ( 170, 250 ] 258 0.032% 99.876% ( 250, 380 ] 435 0.053% 99.929% ( 380, 580 ] 594 0.073% 100.001% ( 580, 870 ] 590 0.072% 100.073% ( 870, 1300 ] 391 0.048% 100.121% ( 1300, 1900 ] 178 0.022% 100.143% ( 1900, 2900 ] 214 0.026% 100.169% ( 2900, 4400 ] 269 0.033% 100.202% ( 4400, 6600 ] 82 0.010% 100.212% ( 6600, 9900 ] 24 0.003% 100.215% ( 9900, 14000 ] 2 0.000% 100.215% ** Level 4 read latency histogram (micros): Count: 270 Average: 265.5370 StdDev: 638.36 Min: 1 Median: 2.4516 Max: 3651 Percentiles: P50: 2.45 P75: 186.92 P99: 3590.00 P99.9: 3651.00 P99.99: 3651.00 ------------------------------------------------------ [ 0, 1 ] 42 15.556% 15.556% ### ( 1, 2 ] 79 29.259% 44.815% ###### ( 2, 3 ] 31 11.481% 56.296% ## ( 3, 4 ] 13 4.815% 61.111% # ( 4, 6 ] 5 1.852% 62.963% ( 6, 10 ] 13 4.815% 67.778% # ( 10, 15 ] 8 2.963% 70.741% # ( 15, 22 ] 3 1.111% 71.852% ( 22, 34 ] 2 0.741% 72.593% ( 34, 51 ] 1 0.370% 72.963% ( 170, 250 ] 26 9.630% 82.593% ## ( 250, 380 ] 3 1.111% 83.704% ( 380, 580 ] 5 1.852% 85.556% ( 580, 870 ] 8 2.963% 88.519% # ( 870, 1300 ] 8 2.963% 91.481% # ( 1300, 1900 ] 10 3.704% 95.185% # ( 1900, 2900 ] 8 2.963% 98.148% # ( 2900, 4400 ] 5 1.852% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1347.9300 StdDev: 1590.37 Min: 73 Median: 704.2857 Max: 12217 Percentiles: P50: 704.29 P75: 2169.23 P99: 6325.00 P99.9: 12217.00 P99.99: 12217.00 ------------------------------------------------------ ( 51, 76 ] 8 4.000% 4.000% # ( 76, 110 ] 16 8.000% 12.000% ## ( 110, 170 ] 23 11.500% 23.500% ## ( 170, 250 ] 15 7.500% 31.000% ## ( 250, 380 ] 22 11.000% 42.000% ## ( 380, 580 ] 10 5.000% 47.000% # ( 580, 870 ] 14 7.000% 54.000% # ( 870, 1300 ] 18 9.000% 63.000% ## ( 1300, 1900 ] 17 8.500% 71.500% ## ( 1900, 2900 ] 26 13.000% 84.500% ### ( 2900, 4400 ] 22 11.000% 95.500% ## ( 4400, 6600 ] 8 4.000% 99.500% # ( 9900, 14000 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 34.1 total, 4.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 231.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.993 H:M:S, 38.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 205.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.023 H:M:S, 42.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-03:45:52 ... thread 0: (1000000,9000000) ops and (313933.5,242740.3) ops/second in (3.185388,37.076664) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 4.36 GB 151.1 8.1 0.0 8.1 16.6 8.5 0.0 1.9 139.4 287.1 59.19 52.85 146 0.405 8377K 13K 0.0 0.0 L1 9/9 1.00 GB 0.0 4.2 3.9 0.3 4.2 3.9 0.2 1.1 231.6 229.0 18.71 18.04 3 6.237 4401K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.9 2.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 L3 19/0 986.11 MB 1.0 4.5 2.5 2.0 4.5 2.5 0.7 1.8 163.5 162.8 28.05 20.53 15 1.870 4650K 19K 0.0 0.0 L4 170/0 9.44 GB 1.0 1.7 1.4 0.2 1.7 1.4 1.7 1.1 139.3 138.6 12.25 7.83 25 0.490 1703K 7103 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/20 104.60 GB 0.0 18.8 8.1 10.7 27.3 16.5 9.0 3.2 160.9 233.2 119.71 100.71 191 0.627 19M 88K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.8 8.1 10.7 27.3 16.5 8.6 3.2 160.9 233.2 119.71 100.71 191 0.627 19M 88K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.8 8.1 10.7 18.7 8.0 0.0 0.0 208.3 207.3 92.46 78.46 70 1.321 19M 88K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 321.4 27.25 22.25 121 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.3 total, 37.1 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.27 GB write, 749.16 MB/s write, 18.80 GB read, 516.65 MB/s read, 119.7 seconds Interval compaction: 27.27 GB write, 753.03 MB/s write, 18.80 GB read, 519.33 MB/s read, 119.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 67, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 67, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3598838 Average: 2.3848 StdDev: 19.92 Min: 1 Median: 1.4625 Max: 9924 Percentiles: P50: 1.46 P75: 1.84 P99: 6.00 P99.9: 14.25 P99.99: 198.95 ------------------------------------------------------ [ 0, 1 ] 709165 19.705% 19.705% #### ( 1, 2 ] 2357158 65.498% 85.203% ############# ( 2, 3 ] 268858 7.471% 92.674% # ( 3, 4 ] 133149 3.700% 96.374% # ( 4, 6 ] 94624 2.629% 99.003% # ( 6, 10 ] 27910 0.776% 99.778% ( 10, 15 ] 5146 0.143% 99.921% ( 15, 22 ] 751 0.021% 99.942% ( 22, 34 ] 65 0.002% 99.944% ( 34, 51 ] 49 0.001% 99.945% ( 51, 76 ] 40 0.001% 99.947% ( 76, 110 ] 692 0.019% 99.966% ( 110, 170 ] 767 0.021% 99.987% ( 170, 250 ] 296 0.008% 99.995% ( 250, 380 ] 229 0.006% 100.002% ( 380, 580 ] 270 0.008% 100.009% ( 580, 870 ] 233 0.006% 100.016% ( 870, 1300 ] 94 0.003% 100.018% ( 1300, 1900 ] 56 0.002% 100.020% ( 1900, 2900 ] 35 0.001% 100.021% ( 2900, 4400 ] 28 0.001% 100.022% ( 4400, 6600 ] 9 0.000% 100.022% ( 6600, 9900 ] 1 0.000% 100.022% ( 9900, 14000 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 759387 Average: 5.0120 StdDev: 77.50 Min: 0 Median: 1.7524 Max: 16811 Percentiles: P50: 1.75 P75: 2.67 P99: 9.49 P99.9: 99.02 P99.99: 396.37 ------------------------------------------------------ [ 0, 1 ] 50316 6.626% 6.626% # ( 1, 2 ] 437741 57.644% 64.270% ############ ( 2, 3 ] 121102 15.947% 80.217% ### ( 3, 4 ] 61846 8.144% 88.361% ## ( 4, 6 ] 65680 8.649% 97.010% ## ( 6, 10 ] 17301 2.278% 99.289% ( 10, 15 ] 3936 0.518% 99.807% ( 15, 22 ] 545 0.072% 99.879% ( 22, 34 ] 55 0.007% 99.886% ( 34, 51 ] 8 0.001% 99.887% ( 51, 76 ] 15 0.002% 99.889% ( 76, 110 ] 122 0.016% 99.905% ( 110, 170 ] 237 0.031% 99.936% ( 170, 250 ] 143 0.019% 99.955% ( 250, 380 ] 240 0.032% 99.987% ( 380, 580 ] 294 0.039% 100.026% ( 580, 870 ] 259 0.034% 100.060% ( 870, 1300 ] 164 0.022% 100.081% ( 1300, 1900 ] 99 0.013% 100.094% ( 1900, 2900 ] 103 0.014% 100.108% ( 2900, 4400 ] 110 0.014% 100.122% ( 4400, 6600 ] 39 0.005% 100.127% ( 6600, 9900 ] 7 0.001% 100.128% ( 9900, 14000 ] 2 0.000% 100.129% ( 14000, 22000 ] 1 0.000% 100.129% ** Level 2 read latency histogram (micros): Count: 124221 Average: 4.3995 StdDev: 70.07 Min: 1 Median: 1.4681 Max: 6553 Percentiles: P50: 1.47 P75: 1.90 P99: 8.20 P99.9: 677.41 P99.99: 3781.49 ------------------------------------------------------ [ 0, 1 ] 28432 22.888% 22.888% ##### ( 1, 2 ] 71941 57.914% 80.802% ############ ( 2, 3 ] 11090 8.928% 89.730% ## ( 3, 4 ] 5810 4.677% 94.407% # ( 4, 6 ] 4981 4.010% 98.417% # ( 6, 10 ] 1319 1.062% 99.478% ( 10, 15 ] 322 0.259% 99.738% ( 15, 22 ] 48 0.039% 99.776% ( 22, 34 ] 4 0.003% 99.779% ( 34, 51 ] 2 0.002% 99.781% ( 110, 170 ] 17 0.014% 99.795% ( 170, 250 ] 24 0.019% 99.814% ( 250, 380 ] 39 0.031% 99.845% ( 380, 580 ] 53 0.043% 99.888% ( 580, 870 ] 44 0.035% 99.924% ( 870, 1300 ] 39 0.031% 99.955% ( 1300, 1900 ] 15 0.012% 99.967% ( 1900, 2900 ] 18 0.014% 99.981% ( 2900, 4400 ] 18 0.014% 99.996% ( 4400, 6600 ] 5 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 818647 Average: 7.3262 StdDev: 110.17 Min: 0 Median: 1.8304 Max: 11731 Percentiles: P50: 1.83 P75: 2.87 P99: 9.40 P99.9: 309.88 P99.99: 549.07 ------------------------------------------------------ [ 0, 1 ] 36499 4.458% 4.458% # ( 1, 2 ] 448985 54.845% 59.303% ########### ( 2, 3 ] 147917 18.068% 77.372% #### ( 3, 4 ] 79335 9.691% 87.063% ## ( 4, 6 ] 84377 10.307% 97.370% ## ( 6, 10 ] 15702 1.918% 99.288% ( 10, 15 ] 3818 0.466% 99.754% ( 15, 22 ] 431 0.053% 99.807% ( 22, 34 ] 54 0.007% 99.813% ( 34, 51 ] 14 0.002% 99.815% ( 51, 76 ] 9 0.001% 99.816% ( 76, 110 ] 61 0.007% 99.823% ( 110, 170 ] 168 0.021% 99.844% ( 170, 250 ] 258 0.032% 99.876% ( 250, 380 ] 435 0.053% 99.929% ( 380, 580 ] 594 0.073% 100.001% ( 580, 870 ] 590 0.072% 100.073% ( 870, 1300 ] 391 0.048% 100.121% ( 1300, 1900 ] 178 0.022% 100.143% ( 1900, 2900 ] 214 0.026% 100.169% ( 2900, 4400 ] 269 0.033% 100.202% ( 4400, 6600 ] 82 0.010% 100.212% ( 6600, 9900 ] 24 0.003% 100.215% ( 9900, 14000 ] 2 0.000% 100.215% ** Level 4 read latency histogram (micros): Count: 270 Average: 265.5370 StdDev: 638.36 Min: 1 Median: 2.4516 Max: 3651 Percentiles: P50: 2.45 P75: 186.92 P99: 3590.00 P99.9: 3651.00 P99.99: 3651.00 ------------------------------------------------------ [ 0, 1 ] 42 15.556% 15.556% ### ( 1, 2 ] 79 29.259% 44.815% ###### ( 2, 3 ] 31 11.481% 56.296% ## ( 3, 4 ] 13 4.815% 61.111% # ( 4, 6 ] 5 1.852% 62.963% ( 6, 10 ] 13 4.815% 67.778% # ( 10, 15 ] 8 2.963% 70.741% # ( 15, 22 ] 3 1.111% 71.852% ( 22, 34 ] 2 0.741% 72.593% ( 34, 51 ] 1 0.370% 72.963% ( 170, 250 ] 26 9.630% 82.593% ## ( 250, 380 ] 3 1.111% 83.704% ( 380, 580 ] 5 1.852% 85.556% ( 580, 870 ] 8 2.963% 88.519% # ( 870, 1300 ] 8 2.963% 91.481% # ( 1300, 1900 ] 10 3.704% 95.185% # ( 1900, 2900 ] 8 2.963% 98.148% # ( 2900, 4400 ] 5 1.852% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1347.9300 StdDev: 1590.37 Min: 73 Median: 704.2857 Max: 12217 Percentiles: P50: 704.29 P75: 2169.23 P99: 6325.00 P99.9: 12217.00 P99.99: 12217.00 ------------------------------------------------------ ( 51, 76 ] 8 4.000% 4.000% # ( 76, 110 ] 16 8.000% 12.000% ## ( 110, 170 ] 23 11.500% 23.500% ## ( 170, 250 ] 15 7.500% 31.000% ## ( 250, 380 ] 22 11.000% 42.000% ## ( 380, 580 ] 10 5.000% 47.000% # ( 580, 870 ] 14 7.000% 54.000% # ( 870, 1300 ] 18 9.000% 63.000% ## ( 1300, 1900 ] 17 8.500% 71.500% ## ( 1900, 2900 ] 26 13.000% 84.500% ### ( 2900, 4400 ] 22 11.000% 95.500% ## ( 4400, 6600 ] 8 4.000% 99.500% # ( 9900, 14000 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 37.3 total, 3.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 237.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.606 H:M:S, 36.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 308.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.613 H:M:S, 19.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-03:46:05 ... thread 0: (1000000,10000000) ops and (76682.5,199531.3) ops/second in (13.040785,50.117449) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.77 GB 25.2 9.2 0.0 9.2 18.7 9.5 0.0 2.0 141.4 288.2 66.39 59.57 165 0.402 9528K 14K 0.0 0.0 L1 17/17 2.12 GB 0.0 7.8 6.5 1.3 7.7 6.4 0.2 1.2 228.6 225.7 35.00 33.27 4 8.749 7583K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.4 2.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 L3 18/2 1.19 GB 1.0 5.7 3.3 2.4 5.7 3.3 1.3 1.7 163.9 163.1 35.78 26.48 22 1.626 5949K 28K 0.0 0.0 L4 171/11 9.98 GB 1.0 3.6 2.6 1.0 3.6 2.6 1.7 1.4 142.4 141.4 25.89 17.01 39 0.664 3706K 23K 0.0 0.0 L5 1088/0 89.45 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1309/42 105.50 GB 0.0 26.7 12.6 14.0 36.0 22.0 11.6 3.8 166.0 224.3 164.57 137.79 232 0.709 27M 115K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.7 12.6 14.0 36.0 22.0 11.2 3.8 166.0 224.3 164.57 137.79 232 0.709 27M 115K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.7 12.6 14.0 26.5 12.5 0.0 0.0 203.4 202.1 134.32 112.97 96 1.399 27M 115K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 322.9 30.24 24.82 136 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.3 total, 50.1 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.04 GB write, 733.59 MB/s write, 26.68 GB read, 542.95 MB/s read, 164.6 seconds Interval compaction: 36.04 GB write, 736.40 MB/s write, 26.68 GB read, 545.03 MB/s read, 164.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 71, pending-compaction-bytes-delays: 29, pending-compaction-bytes-stops: 0, total-delays: 52, total-stops: 71, interval: 123 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4287491 Average: 2.5227 StdDev: 23.11 Min: 1 Median: 1.4672 Max: 9924 Percentiles: P50: 1.47 P75: 1.85 P99: 6.49 P99.9: 15.22 P99.99: 387.36 ------------------------------------------------------ [ 0, 1 ] 838982 19.568% 19.568% #### ( 1, 2 ] 2792656 65.135% 84.703% ############# ( 2, 3 ] 326257 7.610% 92.313% ## ( 3, 4 ] 161906 3.776% 96.089% # ( 4, 6 ] 120383 2.808% 98.897% # ( 6, 10 ] 36380 0.849% 99.745% ( 10, 15 ] 6610 0.154% 99.899% ( 15, 22 ] 921 0.021% 99.921% ( 22, 34 ] 73 0.002% 99.922% ( 34, 51 ] 53 0.001% 99.924% ( 51, 76 ] 51 0.001% 99.925% ( 76, 110 ] 898 0.021% 99.946% ( 110, 170 ] 1023 0.024% 99.970% ( 170, 250 ] 466 0.011% 99.981% ( 250, 380 ] 385 0.009% 99.990% ( 380, 580 ] 496 0.012% 100.001% ( 580, 870 ] 431 0.010% 100.011% ( 870, 1300 ] 218 0.005% 100.016% ( 1300, 1900 ] 109 0.003% 100.019% ( 1900, 2900 ] 51 0.001% 100.020% ( 2900, 4400 ] 47 0.001% 100.021% ( 4400, 6600 ] 12 0.000% 100.021% ( 6600, 9900 ] 1 0.000% 100.021% ( 9900, 14000 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1322172 Average: 4.7678 StdDev: 73.07 Min: 0 Median: 1.6750 Max: 16811 Percentiles: P50: 1.67 P75: 2.49 P99: 9.41 P99.9: 115.69 P99.99: 431.05 ------------------------------------------------------ [ 0, 1 ] 158372 11.978% 11.978% ## ( 1, 2 ] 744795 56.331% 68.309% ########### ( 2, 3 ] 182183 13.779% 82.088% ### ( 3, 4 ] 96054 7.265% 89.353% # ( 4, 6 ] 103057 7.795% 97.148% ## ( 6, 10 ] 28742 2.174% 99.322% ( 10, 15 ] 6130 0.464% 99.785% ( 15, 22 ] 880 0.067% 99.852% ( 22, 34 ] 78 0.006% 99.858% ( 34, 51 ] 14 0.001% 99.859% ( 51, 76 ] 85 0.006% 99.865% ( 76, 110 ] 414 0.031% 99.897% ( 110, 170 ] 483 0.037% 99.933% ( 170, 250 ] 259 0.020% 99.953% ( 250, 380 ] 371 0.028% 99.981% ( 380, 580 ] 481 0.036% 100.017% ( 580, 870 ] 478 0.036% 100.053% ( 870, 1300 ] 301 0.023% 100.076% ( 1300, 1900 ] 175 0.013% 100.089% ( 1900, 2900 ] 150 0.011% 100.101% ( 2900, 4400 ] 180 0.014% 100.114% ( 4400, 6600 ] 63 0.005% 100.119% ( 6600, 9900 ] 11 0.001% 100.120% ( 9900, 14000 ] 2 0.000% 100.120% ( 14000, 22000 ] 1 0.000% 100.120% ** Level 2 read latency histogram (micros): Count: 124221 Average: 4.3995 StdDev: 70.07 Min: 1 Median: 1.4681 Max: 6553 Percentiles: P50: 1.47 P75: 1.90 P99: 8.20 P99.9: 677.41 P99.99: 3781.49 ------------------------------------------------------ [ 0, 1 ] 28432 22.888% 22.888% ##### ( 1, 2 ] 71941 57.914% 80.802% ############ ( 2, 3 ] 11090 8.928% 89.730% ## ( 3, 4 ] 5810 4.677% 94.407% # ( 4, 6 ] 4981 4.010% 98.417% # ( 6, 10 ] 1319 1.062% 99.478% ( 10, 15 ] 322 0.259% 99.738% ( 15, 22 ] 48 0.039% 99.776% ( 22, 34 ] 4 0.003% 99.779% ( 34, 51 ] 2 0.002% 99.781% ( 110, 170 ] 17 0.014% 99.795% ( 170, 250 ] 24 0.019% 99.814% ( 250, 380 ] 39 0.031% 99.845% ( 380, 580 ] 53 0.043% 99.888% ( 580, 870 ] 44 0.035% 99.924% ( 870, 1300 ] 39 0.031% 99.955% ( 1300, 1900 ] 15 0.012% 99.967% ( 1900, 2900 ] 18 0.014% 99.981% ( 2900, 4400 ] 18 0.014% 99.996% ( 4400, 6600 ] 5 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 1241577 Average: 7.3055 StdDev: 103.23 Min: 0 Median: 1.8582 Max: 11731 Percentiles: P50: 1.86 P75: 2.95 P99: 9.61 P99.9: 375.91 P99.99: 608.01 ------------------------------------------------------ [ 0, 1 ] 50259 4.048% 4.048% # ( 1, 2 ] 664798 53.545% 57.593% ########### ( 2, 3 ] 227357 18.312% 75.905% #### ( 3, 4 ] 125785 10.131% 86.036% ## ( 4, 6 ] 137478 11.073% 97.109% ## ( 6, 10 ] 26048 2.098% 99.206% ( 10, 15 ] 6236 0.502% 99.709% ( 15, 22 ] 703 0.057% 99.765% ( 22, 34 ] 72 0.006% 99.771% ( 34, 51 ] 21 0.002% 99.773% ( 51, 76 ] 42 0.003% 99.776% ( 76, 110 ] 85 0.007% 99.783% ( 110, 170 ] 275 0.022% 99.805% ( 170, 250 ] 451 0.036% 99.842% ( 250, 380 ] 749 0.060% 99.902% ( 380, 580 ] 996 0.080% 99.982% ( 580, 870 ] 1013 0.082% 100.064% ( 870, 1300 ] 683 0.055% 100.119% ( 1300, 1900 ] 332 0.027% 100.145% ( 1900, 2900 ] 288 0.023% 100.169% ( 2900, 4400 ] 361 0.029% 100.198% ( 4400, 6600 ] 103 0.008% 100.206% ( 6600, 9900 ] 27 0.002% 100.208% ( 9900, 14000 ] 2 0.000% 100.208% ** Level 4 read latency histogram (micros): Count: 223261 Average: 9.5398 StdDev: 119.10 Min: 1 Median: 1.8542 Max: 10014 Percentiles: P50: 1.85 P75: 2.98 P99: 12.39 P99.9: 949.99 P99.99: 1458.19 ------------------------------------------------------ [ 0, 1 ] 8831 3.955% 3.955% # ( 1, 2 ] 120340 53.901% 57.856% ########### ( 2, 3 ] 39170 17.544% 75.401% #### ( 3, 4 ] 22525 10.089% 85.490% ## ( 4, 6 ] 24116 10.802% 96.292% ## ( 6, 10 ] 5452 2.442% 98.734% ( 10, 15 ] 1241 0.556% 99.290% ( 15, 22 ] 110 0.049% 99.339% ( 22, 34 ] 9 0.004% 99.343% ( 34, 51 ] 8 0.004% 99.347% ( 51, 76 ] 21 0.009% 99.356% ( 76, 110 ] 47 0.021% 99.377% ( 110, 170 ] 116 0.052% 99.429% ( 170, 250 ] 222 0.099% 99.528% ( 250, 380 ] 239 0.107% 99.635% ( 380, 580 ] 287 0.129% 99.764% ( 580, 870 ] 263 0.118% 99.882% ( 870, 1300 ] 219 0.098% 99.980% ( 1300, 1900 ] 86 0.039% 100.018% ( 1900, 2900 ] 102 0.046% 100.064% ( 2900, 4400 ] 75 0.034% 100.098% ( 4400, 6600 ] 16 0.007% 100.105% ( 6600, 9900 ] 7 0.003% 100.108% ( 9900, 14000 ] 1 0.000% 100.108% ** Level 5 read latency histogram (micros): Count: 240 Average: 1276.5500 StdDev: 1510.41 Min: 73 Median: 644.4444 Max: 12217 Percentiles: P50: 644.44 P75: 1968.97 P99: 6215.00 P99.9: 12217.00 P99.99: 12217.00 ------------------------------------------------------ ( 51, 76 ] 8 3.333% 3.333% # ( 76, 110 ] 17 7.083% 10.417% # ( 110, 170 ] 31 12.917% 23.333% ### ( 170, 250 ] 17 7.083% 30.417% # ( 250, 380 ] 31 12.917% 43.333% ### ( 380, 580 ] 12 5.000% 48.333% # ( 580, 870 ] 18 7.500% 55.833% ## ( 870, 1300 ] 20 8.333% 64.167% ## ( 1300, 1900 ] 24 10.000% 74.167% ## ( 1900, 2900 ] 29 12.083% 86.250% ## ( 2900, 4400 ] 24 10.000% 96.250% ## ( 4400, 6600 ] 8 3.333% 99.583% # ( 9900, 14000 ] 1 0.417% 100.000% ** DB Stats ** Uptime(secs): 50.3 total, 13.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 195.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.681 H:M:S, 47.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 75.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.075 H:M:S, 77.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/14-03:46:09 ... thread 0: (1000000,11000000) ops and (269737.4,204366.9) ops/second in (3.707309,53.824758) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.69 GB 119.6 10.0 0.0 10.0 20.4 10.4 0.0 2.0 141.4 289.7 72.14 64.99 181 0.399 10M 15K 0.0 0.0 L1 17/17 2.12 GB 0.0 7.8 6.5 1.3 7.7 6.4 0.2 1.2 228.6 225.7 35.00 33.27 4 8.749 7583K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.4 2.0 250.6 250.5 1.51 1.46 2 0.754 383K 195 0.0 0.0 L3 16/0 969.84 MB 1.0 5.7 3.3 2.4 5.7 3.3 1.3 1.7 163.9 163.1 35.78 26.48 22 1.626 5949K 28K 0.0 0.0 L4 163/0 9.54 GB 1.0 4.1 2.9 1.3 4.1 2.8 1.7 1.4 147.2 146.1 28.73 19.36 41 0.701 4256K 29K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1311/29 106.42 GB 0.0 28.0 12.9 15.1 38.3 23.2 12.3 3.7 165.6 226.4 173.16 145.56 250 0.693 28M 122K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.0 12.9 15.1 38.3 23.2 11.9 3.7 165.6 226.4 173.16 145.56 250 0.693 28M 122K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.0 12.9 15.1 27.8 12.7 0.0 0.0 204.5 203.2 140.24 118.35 101 1.389 28M 122K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 325.3 32.92 27.21 149 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.0 total, 53.8 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.29 GB write, 725.80 MB/s write, 28.01 GB read, 530.89 MB/s read, 173.2 seconds Interval compaction: 38.29 GB write, 728.39 MB/s write, 28.01 GB read, 532.78 MB/s read, 173.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 28, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 28, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 29, pending-compaction-bytes-stops: 0, total-delays: 57, total-stops: 73, interval: 130 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4708527 Average: 2.4871 StdDev: 22.19 Min: 1 Median: 1.4665 Max: 9924 Percentiles: P50: 1.47 P75: 1.85 P99: 6.41 P99.9: 14.70 P99.99: 341.15 ------------------------------------------------------ [ 0, 1 ] 917361 19.483% 19.483% #### ( 1, 2 ] 3080309 65.420% 84.903% ############# ( 2, 3 ] 356652 7.575% 92.477% ## ( 3, 4 ] 174716 3.711% 96.188% # ( 4, 6 ] 128289 2.725% 98.913% # ( 6, 10 ] 39947 0.848% 99.761% ( 10, 15 ] 6960 0.148% 99.909% ( 15, 22 ] 948 0.020% 99.929% ( 22, 34 ] 75 0.002% 99.931% ( 34, 51 ] 57 0.001% 99.932% ( 51, 76 ] 53 0.001% 99.933% ( 76, 110 ] 905 0.019% 99.952% ( 110, 170 ] 1033 0.022% 99.974% ( 170, 250 ] 477 0.010% 99.984% ( 250, 380 ] 391 0.008% 99.992% ( 380, 580 ] 500 0.011% 100.003% ( 580, 870 ] 438 0.009% 100.012% ( 870, 1300 ] 219 0.005% 100.017% ( 1300, 1900 ] 112 0.002% 100.019% ( 1900, 2900 ] 52 0.001% 100.021% ( 2900, 4400 ] 48 0.001% 100.022% ( 4400, 6600 ] 12 0.000% 100.022% ( 6600, 9900 ] 1 0.000% 100.022% ( 9900, 14000 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1330237 Average: 4.7573 StdDev: 72.86 Min: 0 Median: 1.6734 Max: 16811 Percentiles: P50: 1.67 P75: 2.48 P99: 9.41 P99.9: 118.29 P99.99: 430.72 ------------------------------------------------------ [ 0, 1 ] 159880 12.019% 12.019% ## ( 1, 2 ] 750267 56.401% 68.420% ########### ( 2, 3 ] 182659 13.731% 82.151% ### ( 3, 4 ] 96278 7.238% 89.389% # ( 4, 6 ] 103239 7.761% 97.150% ## ( 6, 10 ] 28876 2.171% 99.321% ( 10, 15 ] 6135 0.461% 99.782% ( 15, 22 ] 881 0.066% 99.848% ( 22, 34 ] 78 0.006% 99.854% ( 34, 51 ] 14 0.001% 99.855% ( 51, 76 ] 85 0.006% 99.861% ( 76, 110 ] 444 0.033% 99.895% ( 110, 170 ] 512 0.038% 99.933% ( 170, 250 ] 261 0.020% 99.953% ( 250, 380 ] 373 0.028% 99.981% ( 380, 580 ] 481 0.036% 100.017% ( 580, 870 ] 478 0.036% 100.053% ( 870, 1300 ] 301 0.023% 100.076% ( 1300, 1900 ] 175 0.013% 100.089% ( 1900, 2900 ] 150 0.011% 100.100% ( 2900, 4400 ] 180 0.014% 100.114% ( 4400, 6600 ] 63 0.005% 100.118% ( 6600, 9900 ] 11 0.001% 100.119% ( 9900, 14000 ] 2 0.000% 100.119% ( 14000, 22000 ] 1 0.000% 100.119% ** Level 2 read latency histogram (micros): Count: 124221 Average: 4.3995 StdDev: 70.07 Min: 1 Median: 1.4681 Max: 6553 Percentiles: P50: 1.47 P75: 1.90 P99: 8.20 P99.9: 677.41 P99.99: 3781.49 ------------------------------------------------------ [ 0, 1 ] 28432 22.888% 22.888% ##### ( 1, 2 ] 71941 57.914% 80.802% ############ ( 2, 3 ] 11090 8.928% 89.730% ## ( 3, 4 ] 5810 4.677% 94.407% # ( 4, 6 ] 4981 4.010% 98.417% # ( 6, 10 ] 1319 1.062% 99.478% ( 10, 15 ] 322 0.259% 99.738% ( 15, 22 ] 48 0.039% 99.776% ( 22, 34 ] 4 0.003% 99.779% ( 34, 51 ] 2 0.002% 99.781% ( 110, 170 ] 17 0.014% 99.795% ( 170, 250 ] 24 0.019% 99.814% ( 250, 380 ] 39 0.031% 99.845% ( 380, 580 ] 53 0.043% 99.888% ( 580, 870 ] 44 0.035% 99.924% ( 870, 1300 ] 39 0.031% 99.955% ( 1300, 1900 ] 15 0.012% 99.967% ( 1900, 2900 ] 18 0.014% 99.981% ( 2900, 4400 ] 18 0.014% 99.996% ( 4400, 6600 ] 5 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 1244416 Average: 7.3054 StdDev: 103.13 Min: 0 Median: 1.8572 Max: 11731 Percentiles: P50: 1.86 P75: 2.95 P99: 9.61 P99.9: 377.35 P99.99: 608.99 ------------------------------------------------------ [ 0, 1 ] 50658 4.071% 4.071% # ( 1, 2 ] 666785 53.582% 57.653% ########### ( 2, 3 ] 227535 18.284% 75.937% #### ( 3, 4 ] 125904 10.118% 86.055% ## ( 4, 6 ] 137518 11.051% 97.106% ## ( 6, 10 ] 26093 2.097% 99.203% ( 10, 15 ] 6238 0.501% 99.704% ( 15, 22 ] 703 0.056% 99.760% ( 22, 34 ] 72 0.006% 99.766% ( 34, 51 ] 21 0.002% 99.768% ( 51, 76 ] 42 0.003% 99.771% ( 76, 110 ] 111 0.009% 99.780% ( 110, 170 ] 291 0.023% 99.804% ( 170, 250 ] 460 0.037% 99.840% ( 250, 380 ] 756 0.061% 99.901% ( 380, 580 ] 1003 0.081% 99.982% ( 580, 870 ] 1016 0.082% 100.063% ( 870, 1300 ] 684 0.055% 100.118% ( 1300, 1900 ] 332 0.027% 100.145% ( 1900, 2900 ] 288 0.023% 100.168% ( 2900, 4400 ] 361 0.029% 100.197% ( 4400, 6600 ] 103 0.008% 100.206% ( 6600, 9900 ] 27 0.002% 100.208% ( 9900, 14000 ] 2 0.000% 100.208% ** Level 4 read latency histogram (micros): Count: 230342 Average: 9.3350 StdDev: 117.30 Min: 0 Median: 1.8392 Max: 10014 Percentiles: P50: 1.84 P75: 2.94 P99: 12.20 P99.9: 936.09 P99.99: 1453.25 ------------------------------------------------------ [ 0, 1 ] 10013 4.347% 4.347% # ( 1, 2 ] 125306 54.400% 58.747% ########### ( 2, 3 ] 39694 17.233% 75.980% ### ( 3, 4 ] 22751 9.877% 85.857% ## ( 4, 6 ] 24258 10.531% 96.388% ## ( 6, 10 ] 5467 2.373% 98.761% ( 10, 15 ] 1247 0.541% 99.303% ( 15, 22 ] 111 0.048% 99.351% ( 22, 34 ] 9 0.004% 99.355% ( 34, 51 ] 8 0.003% 99.358% ( 51, 76 ] 21 0.009% 99.367% ( 76, 110 ] 47 0.020% 99.388% ( 110, 170 ] 117 0.051% 99.439% ( 170, 250 ] 232 0.101% 99.539% ( 250, 380 ] 243 0.105% 99.645% ( 380, 580 ] 288 0.125% 99.770% ( 580, 870 ] 266 0.115% 99.885% ( 870, 1300 ] 219 0.095% 99.980% ( 1300, 1900 ] 86 0.037% 100.018% ( 1900, 2900 ] 102 0.044% 100.062% ( 2900, 4400 ] 75 0.033% 100.095% ( 4400, 6600 ] 16 0.007% 100.102% ( 6600, 9900 ] 7 0.003% 100.105% ( 9900, 14000 ] 1 0.000% 100.105% ** Level 5 read latency histogram (micros): Count: 280 Average: 1194.4393 StdDev: 1447.33 Min: 73 Median: 553.3333 Max: 12217 Percentiles: P50: 553.33 P75: 1817.24 P99: 6105.00 P99.9: 12217.00 P99.99: 12217.00 ------------------------------------------------------ ( 51, 76 ] 8 2.857% 2.857% # ( 76, 110 ] 25 8.929% 11.786% ## ( 110, 170 ] 35 12.500% 24.286% ### ( 170, 250 ] 26 9.286% 33.571% ## ( 250, 380 ] 33 11.786% 45.357% ## ( 380, 580 ] 15 5.357% 50.714% # ( 580, 870 ] 19 6.786% 57.500% # ( 870, 1300 ] 24 8.571% 66.071% ## ( 1300, 1900 ] 29 10.357% 76.429% ## ( 1900, 2900 ] 31 11.071% 87.500% ## ( 2900, 4400 ] 26 9.286% 96.786% ## ( 4400, 6600 ] 8 2.857% 99.643% # ( 9900, 14000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 54.0 total, 3.7 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 200.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.779 H:M:S, 45.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 265.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.098 H:M:S, 29.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.419 micros/op 184541 ops/sec 60.014 seconds 11074999 operations; 178.8 MB/s Microseconds per write: Count: 11074999 Average: 5.4188 StdDev: 448.66 Min: 0 Median: 1.7083 Max: 669428 Percentiles: P50: 1.71 P75: 2.64 P99: 8.65 P99.9: 1095.33 P99.99: 2582.32 ------------------------------------------------------ [ 0, 1 ] 1682757 15.194% 15.194% ### ( 1, 2 ] 5442095 49.139% 64.333% ########## ( 2, 3 ] 1855928 16.758% 81.091% ### ( 3, 4 ] 1426413 12.880% 93.970% ### ( 4, 6 ] 484699 4.377% 98.347% # ( 6, 10 ] 109201 0.986% 99.333% ( 10, 15 ] 31920 0.288% 99.621% ( 15, 22 ] 8421 0.076% 99.697% ( 22, 34 ] 2179 0.020% 99.717% ( 34, 51 ] 247 0.002% 99.719% ( 51, 76 ] 52 0.000% 99.719% ( 76, 110 ] 7998 0.072% 99.792% ( 110, 170 ] 2791 0.025% 99.817% ( 170, 250 ] 321 0.003% 99.820% ( 250, 380 ] 126 0.001% 99.821% ( 380, 580 ] 17 0.000% 99.821% ( 580, 870 ] 19 0.000% 99.821% ( 870, 1300 ] 16679 0.151% 99.972% ( 1300, 1900 ] 60 0.001% 99.972% ( 1900, 2900 ] 2885 0.026% 99.998% ( 2900, 4400 ] 120 0.001% 99.999% ( 4400, 6600 ] 32 0.000% 100.000% ( 6600, 9900 ] 8 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 570000, 860000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 230678 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11074999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11429398968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 584 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30467762 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 34465118670 rocksdb.compact.write.bytes COUNT : 34239638964 rocksdb.flush.write.bytes COUNT : 11427743350 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 63 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 277 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11335839744 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4630528 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 34570804238 rocksdb.non.last.level.read.count COUNT : 8351967 rocksdb.block.checksum.compute.count COUNT : 8350862 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.338592 P95 : 3.792799 P99 : 6.955780 P100 : 669426.000000 COUNT : 11074999 SUM : 54981878 rocksdb.compaction.times.micros P50 : 1009761.904762 P95 : 3565000.000000 P99 : 13874000.000000 P100 : 16285874.000000 COUNT : 103 SUM : 145031429 rocksdb.compaction.times.cpu_micros P50 : 925384.615385 P95 : 3197500.000000 P99 : 13874000.000000 P100 : 15228516.000000 COUNT : 103 SUM : 123101789 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 682.903226 P95 : 1271.333333 P99 : 31093.333333 P100 : 383054.000000 COUNT : 152 SUM : 590932 rocksdb.compaction.outfile.sync.micros P50 : 1129.675325 P95 : 63465.909091 P99 : 136040.000000 P100 : 321637.000000 COUNT : 383 SUM : 4562726 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 102.465909 P95 : 1157.318182 P99 : 2935.000000 P100 : 3849.000000 COUNT : 293 SUM : 77145 rocksdb.table.open.io.micros P50 : 1448.672566 P95 : 7020.000000 P99 : 12742.666667 P100 : 26522.000000 COUNT : 584 SUM : 1198941 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.593777 P95 : 7.804891 P99 : 11.270072 P100 : 16817.000000 COUNT : 8349113 SUM : 48918470 rocksdb.read.block.get.micros P50 : 449.491525 P95 : 2952.173913 P99 : 4825.333333 P100 : 12317.000000 COUNT : 1168 SUM : 960052 rocksdb.write.raw.block.micros P50 : 0.512222 P95 : 0.973222 P99 : 2.882617 P100 : 19699.000000 COUNT : 11060055 SUM : 21930537 rocksdb.numfiles.in.singlecompaction P50 : 3.198718 P95 : 5.630000 P99 : 20.005000 P100 : 29.000000 COUNT : 157 SUM : 577 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559648 P95 : 1139.001259 P99 : 2306.587661 P100 : 669222.000000 COUNT : 186450 SUM : 30485247 rocksdb.sst.read.micros P50 : 1.552905 P95 : 4.694406 P99 : 8.414730 P100 : 16811.000000 COUNT : 8352074 SUM : 31847414 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11074999 SUM : 11429398968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 209595.959596 P95 : 369600.000000 P99 : 749800.000000 P100 : 822567.000000 COUNT : 152 SUM : 33455651 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 380 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0