[2024-11-17 13:28:20.797196] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-17 13:28:20.797337] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid950693 ] Set seed to 1731846500793775 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 13:28:20.898869] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 13:28:20.938858] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 13:28:20.938898] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 950693' to capture a snapshot of events at runtime. [2024-11-17 13:28:20.938910] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid950693 for offline analysis/debug. [2024-11-17 13:28:20.938933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 13:28:25 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-13:28:28 ... thread 0: (1000000,1000000) ops and (326151.7,326151.7) ops/second in (3.066058,3.066058) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/9 629.98 MB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 344.5 2.56 2.32 12 0.213 0 0 0.0 0.0 L2 3/2 251.72 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 255.4 255.3 1.48 1.43 2 0.740 383K 223 0.0 0.0 L3 11/0 867.58 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1183/11 97.00 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.4 93.6 311.8 4.04 3.74 14 0.289 383K 223 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.4 93.6 311.8 4.04 3.74 14 0.289 383K 223 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 255.4 255.3 1.48 1.43 2 0.740 383K 223 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 344.5 2.56 2.32 12 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 388.37 MB/s write, 0.37 GB read, 116.52 MB/s read, 4.0 seconds Interval compaction: 1.23 GB write, 410.58 MB/s write, 0.37 GB read, 123.19 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 128329 Average: 1.9069 StdDev: 17.29 Min: 1 Median: 1.2273 Max: 3348 Percentiles: P50: 1.23 P75: 1.68 P99: 4.75 P99.9: 9.35 P99.99: 126.25 ------------------------------------------------------ [ 0, 1 ] 47975 37.384% 37.384% ####### ( 1, 2 ] 71225 55.502% 92.886% ########### ( 2, 3 ] 5053 3.938% 96.824% # ( 3, 4 ] 2311 1.801% 98.625% ( 4, 6 ] 1286 1.002% 99.627% ( 6, 10 ] 422 0.329% 99.956% ( 10, 15 ] 34 0.026% 99.982% ( 15, 22 ] 8 0.006% 99.988% ( 22, 34 ] 2 0.002% 99.990% ( 51, 76 ] 1 0.001% 99.991% ( 110, 170 ] 8 0.006% 99.997% ( 170, 250 ] 2 0.002% 99.998% ( 250, 380 ] 6 0.005% 100.003% ( 380, 580 ] 1 0.001% 100.004% ( 870, 1300 ] 1 0.001% 100.005% ( 1300, 1900 ] 1 0.001% 100.005% ( 1900, 2900 ] 3 0.002% 100.008% ( 2900, 4400 ] 2 0.002% 100.009% ** Level 2 read latency histogram (micros): Count: 63380 Average: 2.0662 StdDev: 19.96 Min: 0 Median: 1.2642 Max: 2603 Percentiles: P50: 1.26 P75: 1.71 P99: 5.35 P99.9: 9.92 P99.99: 820.99 ------------------------------------------------------ [ 0, 1 ] 22246 35.099% 35.099% ####### ( 1, 2 ] 35753 56.411% 91.510% ########### ( 2, 3 ] 2678 4.225% 95.735% # ( 3, 4 ] 1454 2.294% 98.029% ( 4, 6 ] 912 1.439% 99.468% ( 6, 10 ] 280 0.442% 99.910% ( 10, 15 ] 33 0.052% 99.962% ( 15, 22 ] 7 0.011% 99.973% ( 22, 34 ] 1 0.002% 99.975% ( 51, 76 ] 1 0.002% 99.976% ( 170, 250 ] 1 0.002% 99.978% ( 250, 380 ] 3 0.005% 99.983% ( 380, 580 ] 4 0.006% 99.989% ( 580, 870 ] 2 0.003% 99.992% ( 870, 1300 ] 2 0.003% 99.995% ( 1900, 2900 ] 4 0.006% 100.002% ** Level 3 read latency histogram (micros): Count: 45 Average: 1592.6000 StdDev: 1122.27 Min: 147 Median: 1342.8571 Max: 4330 Percentiles: P50: 1342.86 P75: 2493.75 P99: 4315.62 P99.9: 4330.00 P99.99: 4330.00 ------------------------------------------------------ ( 110, 170 ] 1 2.222% 2.222% ( 170, 250 ] 1 2.222% 4.444% ( 250, 380 ] 1 2.222% 6.667% ( 380, 580 ] 6 13.333% 20.000% ### ( 580, 870 ] 9 20.000% 40.000% #### ( 870, 1300 ] 4 8.889% 48.889% ## ( 1300, 1900 ] 7 15.556% 64.444% ### ( 1900, 2900 ] 8 17.778% 82.222% #### ( 2900, 4400 ] 8 17.778% 100.000% #### ** Level 4 read latency histogram (micros): Count: 25 Average: 1617.4400 StdDev: 1119.37 Min: 323 Median: 1400.0000 Max: 3811 Percentiles: P50: 1400.00 P75: 2525.00 P99: 3811.00 P99.9: 3811.00 P99.99: 3811.00 ------------------------------------------------------ ( 250, 380 ] 1 4.000% 4.000% # ( 380, 580 ] 6 24.000% 28.000% ##### ( 580, 870 ] 4 16.000% 44.000% ### ( 870, 1300 ] 1 4.000% 48.000% # ( 1300, 1900 ] 3 12.000% 60.000% ## ( 1900, 2900 ] 6 24.000% 84.000% ##### ( 2900, 4400 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.2 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 303.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.410 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.410 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-13:28:31 ... thread 0: (1000000,2000000) ops and (341175.0,333494.2) ops/second in (2.931047,5.997105) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 1.23 GB 18.9 0.8 0.0 0.8 2.6 1.8 0.0 1.4 97.8 316.0 8.37 7.76 29 0.289 831K 915 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 242.2 241.9 1.30 1.26 1 1.301 319K 411 0.0 0.0 L2 2/1 59.25 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 253.4 253.2 1.51 1.45 3 0.504 388K 229 0.0 0.0 L3 20/11 1.12 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 220.9 221.0 1.13 1.04 1 1.129 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 150.3 150.3 1.49 1.12 1 1.495 228K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/18 97.92 GB 0.0 1.9 1.0 1.0 3.7 2.7 1.0 2.1 144.2 276.4 13.81 12.63 35 0.394 2021K 1555 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 1.0 1.0 3.7 2.7 1.0 2.1 144.2 276.4 13.81 12.63 35 0.394 2021K 1555 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 1.0 1.0 1.9 1.0 0.0 0.0 232.8 232.6 8.55 7.93 9 0.950 2021K 1555 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 347.7 5.25 4.70 26 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.73 GB write, 618.11 MB/s write, 1.94 GB read, 322.48 MB/s read, 13.8 seconds Interval compaction: 3.73 GB write, 636.19 MB/s write, 1.94 GB read, 331.91 MB/s read, 13.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 383314 Average: 2.1383 StdDev: 13.01 Min: 1 Median: 1.4235 Max: 3348 Percentiles: P50: 1.42 P75: 1.83 P99: 5.68 P99.9: 9.86 P99.99: 14.90 ------------------------------------------------------ [ 0, 1 ] 91586 23.893% 23.893% ##### ( 1, 2 ] 236275 61.640% 85.533% ############ ( 2, 3 ] 28511 7.438% 92.971% # ( 3, 4 ] 14896 3.886% 96.857% # ( 4, 6 ] 9769 2.549% 99.406% # ( 6, 10 ] 1964 0.512% 99.918% ( 10, 15 ] 280 0.073% 99.991% ( 15, 22 ] 29 0.008% 99.999% ( 22, 34 ] 5 0.001% 100.000% ( 34, 51 ] 1 0.000% 100.001% ( 51, 76 ] 2 0.001% 100.001% ( 110, 170 ] 12 0.003% 100.004% ( 170, 250 ] 11 0.003% 100.007% ( 250, 380 ] 13 0.003% 100.010% ( 380, 580 ] 3 0.001% 100.011% ( 580, 870 ] 3 0.001% 100.012% ( 870, 1300 ] 4 0.001% 100.013% ( 1300, 1900 ] 6 0.002% 100.015% ( 1900, 2900 ] 4 0.001% 100.016% ( 2900, 4400 ] 2 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 732 Average: 6.6762 StdDev: 55.94 Min: 1 Median: 1.4884 Max: 973 Percentiles: P50: 1.49 P75: 1.91 P99: 13.40 P99.9: 973.00 P99.99: 973.00 ------------------------------------------------------ [ 0, 1 ] 156 21.311% 21.311% #### ( 1, 2 ] 430 58.743% 80.055% ############ ( 2, 3 ] 72 9.836% 89.891% ## ( 3, 4 ] 41 5.601% 95.492% # ( 4, 6 ] 18 2.459% 97.951% ( 6, 10 ] 7 0.956% 98.907% ( 10, 15 ] 1 0.137% 99.044% ( 15, 22 ] 1 0.137% 99.180% ( 110, 170 ] 1 0.137% 99.317% ( 250, 380 ] 1 0.137% 99.454% ( 380, 580 ] 2 0.273% 99.727% ( 870, 1300 ] 2 0.273% 100.000% ** Level 2 read latency histogram (micros): Count: 96649 Average: 2.1239 StdDev: 16.20 Min: 0 Median: 1.3716 Max: 2603 Percentiles: P50: 1.37 P75: 1.79 P99: 5.59 P99.9: 10.37 P99.99: 496.75 ------------------------------------------------------ [ 0, 1 ] 27038 27.975% 27.975% ###### ( 1, 2 ] 57287 59.273% 87.249% ############ ( 2, 3 ] 6618 6.847% 94.096% # ( 3, 4 ] 3112 3.220% 97.316% # ( 4, 6 ] 2050 2.121% 99.437% ( 6, 10 ] 442 0.457% 99.894% ( 10, 15 ] 73 0.076% 99.970% ( 15, 22 ] 9 0.009% 99.979% ( 22, 34 ] 1 0.001% 99.980% ( 34, 51 ] 1 0.001% 99.981% ( 51, 76 ] 1 0.001% 99.982% ( 170, 250 ] 1 0.001% 99.983% ( 250, 380 ] 4 0.004% 99.988% ( 380, 580 ] 4 0.004% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1900, 2900 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 183555 Average: 3.3604 StdDev: 34.26 Min: 0 Median: 1.6313 Max: 4330 Percentiles: P50: 1.63 P75: 2.14 P99: 9.03 P99.9: 162.10 P99.99: 472.72 ------------------------------------------------------ [ 0, 1 ] 20004 10.898% 10.898% ## ( 1, 2 ] 113685 61.935% 72.833% ############ ( 2, 3 ] 27863 15.180% 88.013% ### ( 3, 4 ] 9484 5.167% 93.180% # ( 4, 6 ] 8439 4.598% 97.777% # ( 6, 10 ] 2965 1.615% 99.393% ( 10, 15 ] 579 0.315% 99.708% ( 15, 22 ] 110 0.060% 99.768% ( 22, 34 ] 23 0.013% 99.780% ( 34, 51 ] 4 0.002% 99.783% ( 51, 76 ] 3 0.002% 99.784% ( 76, 110 ] 58 0.032% 99.816% ( 110, 170 ] 179 0.098% 99.913% ( 170, 250 ] 74 0.040% 99.954% ( 250, 380 ] 44 0.024% 99.978% ( 380, 580 ] 51 0.028% 100.005% ( 580, 870 ] 25 0.014% 100.019% ( 870, 1300 ] 6 0.003% 100.022% ( 1300, 1900 ] 8 0.004% 100.027% ( 1900, 2900 ] 10 0.005% 100.032% ( 2900, 4400 ] 8 0.004% 100.037% ** Level 4 read latency histogram (micros): Count: 315 Average: 133.9238 StdDev: 537.96 Min: 0 Median: 2.0543 Max: 3811 Percentiles: P50: 2.05 P75: 7.55 P99: 3218.75 P99.9: 3811.00 P99.99: 3811.00 ------------------------------------------------------ [ 0, 1 ] 50 15.873% 15.873% ### ( 1, 2 ] 105 33.333% 49.206% ####### ( 2, 3 ] 46 14.603% 63.810% ### ( 3, 4 ] 24 7.619% 71.429% ## ( 4, 6 ] 7 2.222% 73.651% ( 6, 10 ] 11 3.492% 77.143% # ( 10, 15 ] 29 9.206% 86.349% ## ( 15, 22 ] 14 4.444% 90.794% # ( 22, 34 ] 1 0.317% 91.111% ( 110, 170 ] 3 0.952% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 6 1.905% 94.286% ( 580, 870 ] 4 1.270% 95.556% ( 870, 1300 ] 1 0.317% 95.873% ( 1300, 1900 ] 3 0.952% 96.825% ( 1900, 2900 ] 6 1.905% 98.730% ( 2900, 4400 ] 4 1.270% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.616 H:M:S, 10.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.205 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-13:28:34 ... thread 0: (1000000,3000000) ops and (316766.0,327725.3) ops/second in (3.156904,9.154009) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.21 GB 94.4 1.6 0.0 1.6 4.4 2.8 0.0 1.6 113.3 309.3 14.45 13.47 46 0.314 1663K 1803 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 242.2 241.9 1.30 1.26 1 1.301 319K 411 0.0 0.0 L2 1/0 54.23 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 253.4 253.2 1.51 1.45 3 0.504 388K 229 0.0 0.0 L3 12/0 634.83 MB 0.6 1.1 0.2 0.8 1.1 0.2 0.4 4.4 224.1 223.1 5.01 4.67 2 2.503 1139K 5097 0.0 0.0 L4 170/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 150.3 150.3 1.49 1.12 1 1.495 228K 0 0.0 0.0 L5 1052/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/10 98.90 GB 0.0 3.6 1.0 2.6 6.4 3.7 2.1 2.3 154.9 273.9 23.77 21.97 53 0.448 3739K 7540 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 1.0 2.6 6.4 3.7 2.1 2.3 154.9 273.9 23.77 21.97 53 0.448 3739K 7540 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 1.0 2.6 3.6 1.0 0.0 0.0 235.3 234.8 15.65 14.73 13 1.204 3739K 7540 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 349.3 8.12 7.25 40 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.2 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.36 GB write, 697.66 MB/s write, 3.60 GB read, 394.66 MB/s read, 23.8 seconds Interval compaction: 6.36 GB write, 711.02 MB/s write, 3.60 GB read, 402.22 MB/s read, 23.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 814936 Average: 2.2064 StdDev: 10.97 Min: 1 Median: 1.4847 Max: 3348 Percentiles: P50: 1.48 P75: 1.87 P99: 5.72 P99.9: 9.92 P99.99: 13.78 ------------------------------------------------------ [ 0, 1 ] 152131 18.668% 18.668% #### ( 1, 2 ] 526751 64.637% 83.305% ############# ( 2, 3 ] 72773 8.930% 92.235% ## ( 3, 4 ] 35262 4.327% 96.562% # ( 4, 6 ] 23132 2.839% 99.400% # ( 6, 10 ] 4152 0.509% 99.910% ( 10, 15 ] 865 0.106% 100.016% ( 15, 22 ] 52 0.006% 100.022% ( 22, 34 ] 6 0.001% 100.023% ( 34, 51 ] 5 0.001% 100.024% ( 51, 76 ] 5 0.001% 100.024% ( 76, 110 ] 34 0.004% 100.028% ( 110, 170 ] 23 0.003% 100.031% ( 170, 250 ] 18 0.002% 100.033% ( 250, 380 ] 22 0.003% 100.036% ( 380, 580 ] 6 0.001% 100.037% ( 580, 870 ] 9 0.001% 100.038% ( 870, 1300 ] 8 0.001% 100.039% ( 1300, 1900 ] 9 0.001% 100.040% ( 1900, 2900 ] 7 0.001% 100.041% ( 2900, 4400 ] 2 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 732 Average: 6.6762 StdDev: 55.94 Min: 1 Median: 1.4884 Max: 973 Percentiles: P50: 1.49 P75: 1.91 P99: 13.40 P99.9: 973.00 P99.99: 973.00 ------------------------------------------------------ [ 0, 1 ] 156 21.311% 21.311% #### ( 1, 2 ] 430 58.743% 80.055% ############ ( 2, 3 ] 72 9.836% 89.891% ## ( 3, 4 ] 41 5.601% 95.492% # ( 4, 6 ] 18 2.459% 97.951% ( 6, 10 ] 7 0.956% 98.907% ( 10, 15 ] 1 0.137% 99.044% ( 15, 22 ] 1 0.137% 99.180% ( 110, 170 ] 1 0.137% 99.317% ( 250, 380 ] 1 0.137% 99.454% ( 380, 580 ] 2 0.273% 99.727% ( 870, 1300 ] 2 0.273% 100.000% ** Level 2 read latency histogram (micros): Count: 125553 Average: 2.4138 StdDev: 16.57 Min: 0 Median: 1.4364 Max: 2603 Percentiles: P50: 1.44 P75: 1.85 P99: 6.11 P99.9: 117.84 P99.99: 601.49 ------------------------------------------------------ [ 0, 1 ] 29373 23.395% 23.395% ##### ( 1, 2 ] 76542 60.964% 84.359% ############ ( 2, 3 ] 10384 8.271% 92.629% ## ( 3, 4 ] 4781 3.808% 96.437% # ( 4, 6 ] 3191 2.542% 98.979% # ( 6, 10 ] 993 0.791% 99.770% ( 10, 15 ] 129 0.103% 99.873% ( 15, 22 ] 12 0.010% 99.882% ( 22, 34 ] 1 0.001% 99.883% ( 34, 51 ] 1 0.001% 99.884% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 11 0.009% 99.894% ( 110, 170 ] 57 0.045% 99.939% ( 170, 250 ] 31 0.025% 99.964% ( 250, 380 ] 16 0.013% 99.977% ( 380, 580 ] 16 0.013% 99.990% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1900, 2900 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 248958 Average: 3.2982 StdDev: 30.89 Min: 0 Median: 1.6214 Max: 4330 Percentiles: P50: 1.62 P75: 2.08 P99: 9.00 P99.9: 168.89 P99.99: 520.01 ------------------------------------------------------ [ 0, 1 ] 26943 10.822% 10.822% ## ( 1, 2 ] 156956 63.045% 73.867% ############# ( 2, 3 ] 35573 14.289% 88.156% ### ( 3, 4 ] 13058 5.245% 93.401% # ( 4, 6 ] 10785 4.332% 97.733% # ( 6, 10 ] 4206 1.689% 99.423% ( 10, 15 ] 686 0.276% 99.698% ( 15, 22 ] 116 0.047% 99.745% ( 22, 34 ] 23 0.009% 99.754% ( 34, 51 ] 5 0.002% 99.756% ( 51, 76 ] 7 0.003% 99.759% ( 76, 110 ] 88 0.035% 99.794% ( 110, 170 ] 268 0.108% 99.902% ( 170, 250 ] 104 0.042% 99.944% ( 250, 380 ] 64 0.026% 99.969% ( 380, 580 ] 73 0.029% 99.999% ( 580, 870 ] 31 0.012% 100.011% ( 870, 1300 ] 9 0.004% 100.015% ( 1300, 1900 ] 11 0.004% 100.019% ( 1900, 2900 ] 10 0.004% 100.023% ( 2900, 4400 ] 8 0.003% 100.027% ** Level 4 read latency histogram (micros): Count: 315 Average: 133.9238 StdDev: 537.96 Min: 0 Median: 2.0543 Max: 3811 Percentiles: P50: 2.05 P75: 7.55 P99: 3218.75 P99.9: 3811.00 P99.99: 3811.00 ------------------------------------------------------ [ 0, 1 ] 50 15.873% 15.873% ### ( 1, 2 ] 105 33.333% 49.206% ####### ( 2, 3 ] 46 14.603% 63.810% ### ( 3, 4 ] 24 7.619% 71.429% ## ( 4, 6 ] 7 2.222% 73.651% ( 6, 10 ] 11 3.492% 77.143% # ( 10, 15 ] 29 9.206% 86.349% ## ( 15, 22 ] 14 4.444% 90.794% # ( 22, 34 ] 1 0.317% 91.111% ( 110, 170 ] 3 0.952% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 6 1.905% 94.286% ( 580, 870 ] 4 1.270% 95.556% ( 870, 1300 ] 1 0.317% 95.873% ( 1300, 1900 ] 3 0.952% 96.825% ( 1900, 2900 ] 6 1.905% 98.730% ( 2900, 4400 ] 4 1.270% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 665.7000 StdDev: 781.61 Min: 75 Median: 282.5000 Max: 3267 Percentiles: P50: 282.50 P75: 1085.00 P99: 3267.00 P99.9: 3267.00 P99.99: 3267.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 4 10.000% 12.500% ## ( 110, 170 ] 12 30.000% 42.500% ###### ( 170, 250 ] 2 5.000% 47.500% # ( 250, 380 ] 4 10.000% 57.500% ## ( 380, 580 ] 3 7.500% 65.000% ## ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 2 5.000% 77.500% # ( 1300, 1900 ] 6 15.000% 92.500% ### ( 1900, 2900 ] 2 5.000% 97.500% # ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 9.3 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 316.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.029 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 311.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.413 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-13:28:37 ... thread 0: (1000000,4000000) ops and (353183.3,333739.4) ops/second in (2.831391,11.985400) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.09 GB 188.8 2.4 0.0 2.4 6.1 3.7 0.0 1.6 122.0 309.6 20.14 18.82 63 0.320 2494K 2668 0.0 0.0 L1 10/0 1.04 GB 106.5 1.4 1.4 0.0 1.3 1.3 0.2 1.0 234.0 233.1 5.92 5.71 2 2.959 1406K 5064 0.0 0.0 L2 1/0 54.23 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 253.4 253.2 1.51 1.45 3 0.504 388K 229 0.0 0.0 L3 12/0 634.83 MB 0.6 1.1 0.2 0.8 1.1 0.2 0.4 4.4 224.1 223.1 5.01 4.67 2 2.503 1139K 5097 0.0 0.0 L4 170/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 150.3 150.3 1.49 1.12 1 1.495 228K 0 0.0 0.0 L5 1052/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/4 99.81 GB 0.0 5.4 2.0 3.4 9.1 5.7 2.1 2.5 163.5 274.1 34.07 31.79 71 0.480 5657K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 2.0 3.4 9.1 5.7 2.1 2.5 163.5 274.1 34.07 31.79 71 0.480 5657K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 2.0 3.4 5.4 2.0 0.0 0.0 238.9 238.3 23.32 22.18 17 1.372 5657K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 351.8 10.74 9.60 54 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.12 GB write, 767.79 MB/s write, 5.44 GB read, 458.10 MB/s read, 34.1 seconds Interval compaction: 9.12 GB write, 779.02 MB/s write, 5.44 GB read, 464.80 MB/s read, 34.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1072970 Average: 2.1683 StdDev: 11.38 Min: 0 Median: 1.4526 Max: 3348 Percentiles: P50: 1.45 P75: 1.84 P99: 5.66 P99.9: 10.26 P99.99: 14.46 ------------------------------------------------------ [ 0, 1 ] 224770 20.948% 20.948% #### ( 1, 2 ] 688738 64.190% 85.138% ############# ( 2, 3 ] 86570 8.068% 93.207% ## ( 3, 4 ] 40695 3.793% 96.999% # ( 4, 6 ] 25800 2.405% 99.404% ( 6, 10 ] 5265 0.491% 99.894% ( 10, 15 ] 1152 0.107% 100.002% ( 15, 22 ] 74 0.007% 100.009% ( 22, 34 ] 8 0.001% 100.010% ( 34, 51 ] 7 0.001% 100.010% ( 51, 76 ] 7 0.001% 100.011% ( 76, 110 ] 49 0.005% 100.015% ( 110, 170 ] 54 0.005% 100.020% ( 170, 250 ] 45 0.004% 100.025% ( 250, 380 ] 44 0.004% 100.029% ( 380, 580 ] 17 0.002% 100.030% ( 580, 870 ] 17 0.002% 100.032% ( 870, 1300 ] 11 0.001% 100.033% ( 1300, 1900 ] 9 0.001% 100.034% ( 1900, 2900 ] 10 0.001% 100.035% ( 2900, 4400 ] 3 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 782 Average: 24.8018 StdDev: 156.67 Min: 1 Median: 1.5102 Max: 2148 Percentiles: P50: 1.51 P75: 1.95 P99: 694.07 P99.9: 2148.00 P99.99: 2148.00 ------------------------------------------------------ [ 0, 1 ] 165 21.100% 21.100% #### ( 1, 2 ] 443 56.650% 77.749% ########### ( 2, 3 ] 80 10.230% 87.980% ## ( 3, 4 ] 41 5.243% 93.223% # ( 4, 6 ] 18 2.302% 95.524% ( 6, 10 ] 7 0.895% 96.419% ( 10, 15 ] 1 0.128% 96.547% ( 15, 22 ] 1 0.128% 96.675% ( 22, 34 ] 1 0.128% 96.803% ( 110, 170 ] 1 0.128% 96.931% ( 170, 250 ] 1 0.128% 97.059% ( 250, 380 ] 5 0.639% 97.698% ( 380, 580 ] 9 1.151% 98.849% ( 580, 870 ] 3 0.384% 99.233% ( 870, 1300 ] 3 0.384% 99.616% ( 1300, 1900 ] 1 0.128% 99.744% ( 1900, 2900 ] 2 0.256% 100.000% ** Level 2 read latency histogram (micros): Count: 125553 Average: 2.4138 StdDev: 16.57 Min: 0 Median: 1.4364 Max: 2603 Percentiles: P50: 1.44 P75: 1.85 P99: 6.11 P99.9: 117.84 P99.99: 601.49 ------------------------------------------------------ [ 0, 1 ] 29373 23.395% 23.395% ##### ( 1, 2 ] 76542 60.964% 84.359% ############ ( 2, 3 ] 10384 8.271% 92.629% ## ( 3, 4 ] 4781 3.808% 96.437% # ( 4, 6 ] 3191 2.542% 98.979% # ( 6, 10 ] 993 0.791% 99.770% ( 10, 15 ] 129 0.103% 99.873% ( 15, 22 ] 12 0.010% 99.882% ( 22, 34 ] 1 0.001% 99.883% ( 34, 51 ] 1 0.001% 99.884% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 11 0.009% 99.894% ( 110, 170 ] 57 0.045% 99.939% ( 170, 250 ] 31 0.025% 99.964% ( 250, 380 ] 16 0.013% 99.977% ( 380, 580 ] 16 0.013% 99.990% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1900, 2900 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 248958 Average: 3.2982 StdDev: 30.89 Min: 0 Median: 1.6214 Max: 4330 Percentiles: P50: 1.62 P75: 2.08 P99: 9.00 P99.9: 168.89 P99.99: 520.01 ------------------------------------------------------ [ 0, 1 ] 26943 10.822% 10.822% ## ( 1, 2 ] 156956 63.045% 73.867% ############# ( 2, 3 ] 35573 14.289% 88.156% ### ( 3, 4 ] 13058 5.245% 93.401% # ( 4, 6 ] 10785 4.332% 97.733% # ( 6, 10 ] 4206 1.689% 99.423% ( 10, 15 ] 686 0.276% 99.698% ( 15, 22 ] 116 0.047% 99.745% ( 22, 34 ] 23 0.009% 99.754% ( 34, 51 ] 5 0.002% 99.756% ( 51, 76 ] 7 0.003% 99.759% ( 76, 110 ] 88 0.035% 99.794% ( 110, 170 ] 268 0.108% 99.902% ( 170, 250 ] 104 0.042% 99.944% ( 250, 380 ] 64 0.026% 99.969% ( 380, 580 ] 73 0.029% 99.999% ( 580, 870 ] 31 0.012% 100.011% ( 870, 1300 ] 9 0.004% 100.015% ( 1300, 1900 ] 11 0.004% 100.019% ( 1900, 2900 ] 10 0.004% 100.023% ( 2900, 4400 ] 8 0.003% 100.027% ** Level 4 read latency histogram (micros): Count: 315 Average: 133.9238 StdDev: 537.96 Min: 0 Median: 2.0543 Max: 3811 Percentiles: P50: 2.05 P75: 7.55 P99: 3218.75 P99.9: 3811.00 P99.99: 3811.00 ------------------------------------------------------ [ 0, 1 ] 50 15.873% 15.873% ### ( 1, 2 ] 105 33.333% 49.206% ####### ( 2, 3 ] 46 14.603% 63.810% ### ( 3, 4 ] 24 7.619% 71.429% ## ( 4, 6 ] 7 2.222% 73.651% ( 6, 10 ] 11 3.492% 77.143% # ( 10, 15 ] 29 9.206% 86.349% ## ( 15, 22 ] 14 4.444% 90.794% # ( 22, 34 ] 1 0.317% 91.111% ( 110, 170 ] 3 0.952% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 6 1.905% 94.286% ( 580, 870 ] 4 1.270% 95.556% ( 870, 1300 ] 1 0.317% 95.873% ( 1300, 1900 ] 3 0.952% 96.825% ( 1900, 2900 ] 6 1.905% 98.730% ( 2900, 4400 ] 4 1.270% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 665.7000 StdDev: 781.61 Min: 75 Median: 282.5000 Max: 3267 Percentiles: P50: 282.50 P75: 1085.00 P99: 3267.00 P99.9: 3267.00 P99.99: 3267.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 4 10.000% 12.500% ## ( 110, 170 ] 12 30.000% 42.500% ###### ( 170, 250 ] 2 5.000% 47.500% # ( 250, 380 ] 4 10.000% 57.500% ## ( 380, 580 ] 3 7.500% 65.000% ## ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 2 5.000% 77.500% # ( 1300, 1900 ] 6 15.000% 92.500% ### ( 1900, 2900 ] 2 5.000% 97.500% # ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 2.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.197 H:M:S, 9.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 347.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.168 H:M:S, 5.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-13:28:40 ... thread 0: (1000000,5000000) ops and (324198.4,331786.5) ops/second in (3.084531,15.069931) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 3.07 GB 31.5 3.1 0.0 3.1 7.8 4.7 0.0 1.7 124.7 310.4 25.76 24.11 80 0.322 3262K 3408 0.0 0.0 L1 10/10 1.04 GB 0.0 1.4 1.4 0.0 1.3 1.3 0.2 1.0 234.0 233.1 5.92 5.71 2 2.959 1406K 5064 0.0 0.0 L2 1/0 54.23 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 253.4 253.2 1.51 1.45 3 0.504 388K 229 0.0 0.0 L3 12/0 634.83 MB 0.6 1.1 0.2 0.8 1.1 0.2 0.4 4.4 224.1 223.1 5.01 4.67 2 2.503 1139K 5097 0.0 0.0 L4 170/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 150.3 150.3 1.49 1.12 1 1.495 228K 0 0.0 0.0 L5 1052/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/26 100.80 GB 0.0 6.2 2.0 4.2 10.8 6.7 2.1 2.3 159.4 279.7 39.70 37.07 88 0.451 6425K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 2.0 4.2 10.8 6.7 2.1 2.3 159.4 279.7 39.70 37.07 88 0.451 6425K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 2.0 4.2 6.2 2.0 0.0 0.0 242.2 241.7 26.12 24.93 20 1.306 6425K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 352.7 13.57 12.15 68 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.1 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.84 GB write, 728.10 MB/s write, 6.18 GB read, 415.01 MB/s read, 39.7 seconds Interval compaction: 10.84 GB write, 736.58 MB/s write, 6.18 GB read, 419.84 MB/s read, 39.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1329675 Average: 2.1450 StdDev: 11.58 Min: 0 Median: 1.4364 Max: 3348 Percentiles: P50: 1.44 P75: 1.83 P99: 5.60 P99.9: 10.38 P99.99: 14.77 ------------------------------------------------------ [ 0, 1 ] 292912 22.029% 22.029% #### ( 1, 2 ] 852355 64.103% 86.131% ############# ( 2, 3 ] 101600 7.641% 93.772% ## ( 3, 4 ] 46598 3.504% 97.277% # ( 4, 6 ] 28589 2.150% 99.427% ( 6, 10 ] 6190 0.466% 99.892% ( 10, 15 ] 1363 0.103% 99.995% ( 15, 22 ] 91 0.007% 100.002% ( 22, 34 ] 10 0.001% 100.002% ( 34, 51 ] 8 0.001% 100.003% ( 51, 76 ] 11 0.001% 100.004% ( 76, 110 ] 78 0.006% 100.010% ( 110, 170 ] 96 0.007% 100.017% ( 170, 250 ] 60 0.005% 100.022% ( 250, 380 ] 50 0.004% 100.025% ( 380, 580 ] 25 0.002% 100.027% ( 580, 870 ] 26 0.002% 100.029% ( 870, 1300 ] 13 0.001% 100.030% ( 1300, 1900 ] 10 0.001% 100.031% ( 1900, 2900 ] 14 0.001% 100.032% ( 2900, 4400 ] 3 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 33500 Average: 3.0498 StdDev: 26.25 Min: 1 Median: 1.4291 Max: 2148 Percentiles: P50: 1.43 P75: 1.82 P99: 9.24 P99.9: 275.00 P99.99: 1249.83 ------------------------------------------------------ [ 0, 1 ] 7562 22.573% 22.573% ##### ( 1, 2 ] 21414 63.922% 86.496% ############# ( 2, 3 ] 2414 7.206% 93.701% # ( 3, 4 ] 864 2.579% 96.281% # ( 4, 6 ] 492 1.469% 97.749% ( 6, 10 ] 517 1.543% 99.293% ( 10, 15 ] 114 0.340% 99.633% ( 15, 22 ] 13 0.039% 99.672% ( 22, 34 ] 1 0.003% 99.675% ( 76, 110 ] 18 0.054% 99.728% ( 110, 170 ] 42 0.125% 99.854% ( 170, 250 ] 13 0.039% 99.893% ( 250, 380 ] 13 0.039% 99.931% ( 380, 580 ] 13 0.039% 99.970% ( 580, 870 ] 4 0.012% 99.982% ( 870, 1300 ] 3 0.009% 99.991% ( 1300, 1900 ] 1 0.003% 99.994% ( 1900, 2900 ] 2 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 125553 Average: 2.4138 StdDev: 16.57 Min: 0 Median: 1.4364 Max: 2603 Percentiles: P50: 1.44 P75: 1.85 P99: 6.11 P99.9: 117.84 P99.99: 601.49 ------------------------------------------------------ [ 0, 1 ] 29373 23.395% 23.395% ##### ( 1, 2 ] 76542 60.964% 84.359% ############ ( 2, 3 ] 10384 8.271% 92.629% ## ( 3, 4 ] 4781 3.808% 96.437% # ( 4, 6 ] 3191 2.542% 98.979% # ( 6, 10 ] 993 0.791% 99.770% ( 10, 15 ] 129 0.103% 99.873% ( 15, 22 ] 12 0.010% 99.882% ( 22, 34 ] 1 0.001% 99.883% ( 34, 51 ] 1 0.001% 99.884% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 11 0.009% 99.894% ( 110, 170 ] 57 0.045% 99.939% ( 170, 250 ] 31 0.025% 99.964% ( 250, 380 ] 16 0.013% 99.977% ( 380, 580 ] 16 0.013% 99.990% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1900, 2900 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 248958 Average: 3.2982 StdDev: 30.89 Min: 0 Median: 1.6214 Max: 4330 Percentiles: P50: 1.62 P75: 2.08 P99: 9.00 P99.9: 168.89 P99.99: 520.01 ------------------------------------------------------ [ 0, 1 ] 26943 10.822% 10.822% ## ( 1, 2 ] 156956 63.045% 73.867% ############# ( 2, 3 ] 35573 14.289% 88.156% ### ( 3, 4 ] 13058 5.245% 93.401% # ( 4, 6 ] 10785 4.332% 97.733% # ( 6, 10 ] 4206 1.689% 99.423% ( 10, 15 ] 686 0.276% 99.698% ( 15, 22 ] 116 0.047% 99.745% ( 22, 34 ] 23 0.009% 99.754% ( 34, 51 ] 5 0.002% 99.756% ( 51, 76 ] 7 0.003% 99.759% ( 76, 110 ] 88 0.035% 99.794% ( 110, 170 ] 268 0.108% 99.902% ( 170, 250 ] 104 0.042% 99.944% ( 250, 380 ] 64 0.026% 99.969% ( 380, 580 ] 73 0.029% 99.999% ( 580, 870 ] 31 0.012% 100.011% ( 870, 1300 ] 9 0.004% 100.015% ( 1300, 1900 ] 11 0.004% 100.019% ( 1900, 2900 ] 10 0.004% 100.023% ( 2900, 4400 ] 8 0.003% 100.027% ** Level 4 read latency histogram (micros): Count: 315 Average: 133.9238 StdDev: 537.96 Min: 0 Median: 2.0543 Max: 3811 Percentiles: P50: 2.05 P75: 7.55 P99: 3218.75 P99.9: 3811.00 P99.99: 3811.00 ------------------------------------------------------ [ 0, 1 ] 50 15.873% 15.873% ### ( 1, 2 ] 105 33.333% 49.206% ####### ( 2, 3 ] 46 14.603% 63.810% ### ( 3, 4 ] 24 7.619% 71.429% ## ( 4, 6 ] 7 2.222% 73.651% ( 6, 10 ] 11 3.492% 77.143% # ( 10, 15 ] 29 9.206% 86.349% ## ( 15, 22 ] 14 4.444% 90.794% # ( 22, 34 ] 1 0.317% 91.111% ( 110, 170 ] 3 0.952% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 6 1.905% 94.286% ( 580, 870 ] 4 1.270% 95.556% ( 870, 1300 ] 1 0.317% 95.873% ( 1300, 1900 ] 3 0.952% 96.825% ( 1900, 2900 ] 6 1.905% 98.730% ( 2900, 4400 ] 4 1.270% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 665.7000 StdDev: 781.61 Min: 75 Median: 282.5000 Max: 3267 Percentiles: P50: 282.50 P75: 1085.00 P99: 3267.00 P99.9: 3267.00 P99.99: 3267.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 4 10.000% 12.500% ## ( 110, 170 ] 12 30.000% 42.500% ###### ( 170, 250 ] 2 5.000% 47.500% # ( 250, 380 ] 4 10.000% 57.500% ## ( 380, 580 ] 3 7.500% 65.000% ## ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 2 5.000% 77.500% # ( 1300, 1900 ] 6 15.000% 92.500% ### ( 1900, 2900 ] 2 5.000% 97.500% # ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 15.2 total, 3.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 322.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.603 H:M:S, 10.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-13:28:47 ... thread 0: (1000000,6000000) ops and (133515.0,265960.7) ops/second in (7.489794,22.559725) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 4.05 GB 138.2 5.0 0.0 5.0 10.6 5.7 0.0 1.9 143.0 305.2 35.68 33.62 101 0.353 5180K 6980 0.0 0.0 L1 10/10 1.04 GB 0.0 1.4 1.4 0.0 1.3 1.3 0.2 1.0 234.0 233.1 5.92 5.71 2 2.959 1406K 5064 0.0 0.0 L2 1/0 54.23 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 253.4 253.2 1.51 1.45 3 0.504 388K 229 0.0 0.0 L3 12/0 634.83 MB 0.6 1.1 0.2 0.8 1.1 0.2 0.4 4.4 224.1 223.1 5.01 4.67 2 2.503 1139K 5097 0.0 0.0 L4 170/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 150.3 150.3 1.49 1.12 1 1.495 228K 0 0.0 0.0 L5 1052/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1264/26 101.78 GB 0.0 8.0 2.0 6.0 13.7 7.7 2.1 2.4 165.6 282.1 49.61 46.58 109 0.455 8343K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.0 2.0 6.0 13.7 7.7 2.1 2.4 165.6 282.1 49.61 46.58 109 0.455 8343K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.0 2.0 6.0 8.0 2.0 0.0 0.0 248.0 247.4 33.14 31.84 25 1.326 8343K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 351.8 16.48 14.74 84 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.7 total, 22.6 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.67 GB write, 615.52 MB/s write, 8.02 GB read, 361.39 MB/s read, 49.6 seconds Interval compaction: 13.67 GB write, 620.31 MB/s write, 8.02 GB read, 364.20 MB/s read, 49.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 13, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2099401 Average: 2.1528 StdDev: 10.79 Min: 0 Median: 1.4380 Max: 3348 Percentiles: P50: 1.44 P75: 1.82 P99: 5.62 P99.9: 11.16 P99.99: 81.54 ------------------------------------------------------ [ 0, 1 ] 447797 21.330% 21.330% #### ( 1, 2 ] 1374184 65.456% 86.786% ############# ( 2, 3 ] 153736 7.323% 94.109% # ( 3, 4 ] 70401 3.353% 97.462% # ( 4, 6 ] 39965 1.904% 99.366% ( 6, 10 ] 10716 0.510% 99.876% ( 10, 15 ] 2166 0.103% 99.979% ( 15, 22 ] 153 0.007% 99.987% ( 22, 34 ] 12 0.001% 99.987% ( 34, 51 ] 9 0.000% 99.988% ( 51, 76 ] 11 0.001% 99.988% ( 76, 110 ] 258 0.012% 100.000% ( 110, 170 ] 250 0.012% 100.012% ( 170, 250 ] 124 0.006% 100.018% ( 250, 380 ] 86 0.004% 100.022% ( 380, 580 ] 56 0.003% 100.025% ( 580, 870 ] 41 0.002% 100.027% ( 870, 1300 ] 24 0.001% 100.028% ( 1300, 1900 ] 14 0.001% 100.029% ( 1900, 2900 ] 18 0.001% 100.030% ( 2900, 4400 ] 3 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 163470 Average: 2.5225 StdDev: 14.20 Min: 1 Median: 1.4495 Max: 2148 Percentiles: P50: 1.45 P75: 1.82 P99: 8.39 P99.9: 146.28 P99.99: 576.85 ------------------------------------------------------ [ 0, 1 ] 32390 19.814% 19.814% #### ( 1, 2 ] 109772 67.151% 86.965% ############# ( 2, 3 ] 10903 6.670% 93.635% # ( 3, 4 ] 4662 2.852% 96.487% # ( 4, 6 ] 2651 1.622% 98.109% ( 6, 10 ] 2439 1.492% 99.601% ( 10, 15 ] 277 0.169% 99.770% ( 15, 22 ] 30 0.018% 99.788% ( 22, 34 ] 1 0.001% 99.789% ( 51, 76 ] 7 0.004% 99.793% ( 76, 110 ] 79 0.048% 99.842% ( 110, 170 ] 158 0.097% 99.938% ( 170, 250 ] 35 0.021% 99.960% ( 250, 380 ] 28 0.017% 99.977% ( 380, 580 ] 22 0.013% 99.990% ( 580, 870 ] 10 0.006% 99.996% ( 870, 1300 ] 3 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 125553 Average: 2.4138 StdDev: 16.57 Min: 0 Median: 1.4364 Max: 2603 Percentiles: P50: 1.44 P75: 1.85 P99: 6.11 P99.9: 117.84 P99.99: 601.49 ------------------------------------------------------ [ 0, 1 ] 29373 23.395% 23.395% ##### ( 1, 2 ] 76542 60.964% 84.359% ############ ( 2, 3 ] 10384 8.271% 92.629% ## ( 3, 4 ] 4781 3.808% 96.437% # ( 4, 6 ] 3191 2.542% 98.979% # ( 6, 10 ] 993 0.791% 99.770% ( 10, 15 ] 129 0.103% 99.873% ( 15, 22 ] 12 0.010% 99.882% ( 22, 34 ] 1 0.001% 99.883% ( 34, 51 ] 1 0.001% 99.884% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 11 0.009% 99.894% ( 110, 170 ] 57 0.045% 99.939% ( 170, 250 ] 31 0.025% 99.964% ( 250, 380 ] 16 0.013% 99.977% ( 380, 580 ] 16 0.013% 99.990% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1900, 2900 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 248958 Average: 3.2982 StdDev: 30.89 Min: 0 Median: 1.6214 Max: 4330 Percentiles: P50: 1.62 P75: 2.08 P99: 9.00 P99.9: 168.89 P99.99: 520.01 ------------------------------------------------------ [ 0, 1 ] 26943 10.822% 10.822% ## ( 1, 2 ] 156956 63.045% 73.867% ############# ( 2, 3 ] 35573 14.289% 88.156% ### ( 3, 4 ] 13058 5.245% 93.401% # ( 4, 6 ] 10785 4.332% 97.733% # ( 6, 10 ] 4206 1.689% 99.423% ( 10, 15 ] 686 0.276% 99.698% ( 15, 22 ] 116 0.047% 99.745% ( 22, 34 ] 23 0.009% 99.754% ( 34, 51 ] 5 0.002% 99.756% ( 51, 76 ] 7 0.003% 99.759% ( 76, 110 ] 88 0.035% 99.794% ( 110, 170 ] 268 0.108% 99.902% ( 170, 250 ] 104 0.042% 99.944% ( 250, 380 ] 64 0.026% 99.969% ( 380, 580 ] 73 0.029% 99.999% ( 580, 870 ] 31 0.012% 100.011% ( 870, 1300 ] 9 0.004% 100.015% ( 1300, 1900 ] 11 0.004% 100.019% ( 1900, 2900 ] 10 0.004% 100.023% ( 2900, 4400 ] 8 0.003% 100.027% ** Level 4 read latency histogram (micros): Count: 315 Average: 133.9238 StdDev: 537.96 Min: 0 Median: 2.0543 Max: 3811 Percentiles: P50: 2.05 P75: 7.55 P99: 3218.75 P99.9: 3811.00 P99.99: 3811.00 ------------------------------------------------------ [ 0, 1 ] 50 15.873% 15.873% ### ( 1, 2 ] 105 33.333% 49.206% ####### ( 2, 3 ] 46 14.603% 63.810% ### ( 3, 4 ] 24 7.619% 71.429% ## ( 4, 6 ] 7 2.222% 73.651% ( 6, 10 ] 11 3.492% 77.143% # ( 10, 15 ] 29 9.206% 86.349% ## ( 15, 22 ] 14 4.444% 90.794% # ( 22, 34 ] 1 0.317% 91.111% ( 110, 170 ] 3 0.952% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 6 1.905% 94.286% ( 580, 870 ] 4 1.270% 95.556% ( 870, 1300 ] 1 0.317% 95.873% ( 1300, 1900 ] 3 0.952% 96.825% ( 1900, 2900 ] 6 1.905% 98.730% ( 2900, 4400 ] 4 1.270% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 665.7000 StdDev: 781.61 Min: 75 Median: 282.5000 Max: 3267 Percentiles: P50: 282.50 P75: 1085.00 P99: 3267.00 P99.9: 3267.00 P99.99: 3267.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 4 10.000% 12.500% ## ( 110, 170 ] 12 30.000% 42.500% ###### ( 170, 250 ] 2 5.000% 47.500% # ( 250, 380 ] 4 10.000% 57.500% ## ( 380, 580 ] 3 7.500% 65.000% ## ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 2 5.000% 77.500% # ( 1300, 1900 ] 6 15.000% 92.500% ### ( 1900, 2900 ] 2 5.000% 97.500% # ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 22.7 total, 7.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 259.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.151 H:M:S, 27.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 131.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.549 H:M:S, 60.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-13:28:59 ... thread 0: (1000000,7000000) ops and (83157.7,202399.5) ops/second in (12.025345,34.585070) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 2.58 GB 56.6 6.0 0.0 6.0 12.6 6.6 0.0 1.9 143.8 303.8 42.48 39.95 121 0.351 6204K 7982 0.0 0.0 L1 17/17 1.93 GB 0.0 4.9 3.8 1.0 4.8 3.8 0.2 1.3 229.8 226.9 21.62 20.70 3 7.206 5044K 61K 0.0 0.0 L2 2/2 257.56 MB 0.0 0.4 0.2 0.2 0.4 0.2 1.9 2.0 253.4 253.2 1.51 1.45 3 0.504 388K 229 0.0 0.0 L3 29/9 1.48 GB 1.0 2.7 1.6 1.1 2.7 1.6 0.4 1.7 217.8 217.0 12.52 11.61 6 2.087 2769K 9324 0.0 0.0 L4 172/4 9.72 GB 1.0 0.5 0.4 0.0 0.5 0.4 0.7 1.0 164.7 164.5 2.89 2.33 5 0.577 482K 585 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1287/40 102.70 GB 0.0 14.3 6.0 8.3 20.9 12.6 4.2 3.1 181.0 264.0 81.02 76.04 138 0.587 14M 79K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.3 6.0 8.3 20.9 12.6 4.2 3.1 181.0 264.0 81.02 76.04 138 0.587 14M 79K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.3 6.0 8.3 14.2 5.9 0.0 0.0 238.2 236.9 61.55 58.71 38 1.620 14M 79K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 349.5 19.47 17.34 100 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.8 total, 34.6 interval Flush(GB): cumulative 6.645, interval 6.645 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.89 GB write, 615.24 MB/s write, 14.32 GB read, 421.82 MB/s read, 81.0 seconds Interval compaction: 20.89 GB write, 618.36 MB/s write, 14.32 GB read, 423.96 MB/s read, 81.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 13, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2866386 Average: 2.2856 StdDev: 12.24 Min: 0 Median: 1.4445 Max: 3696 Percentiles: P50: 1.44 P75: 1.83 P99: 5.88 P99.9: 14.43 P99.99: 163.99 ------------------------------------------------------ [ 0, 1 ] 603201 21.044% 21.044% #### ( 1, 2 ] 1867154 65.140% 86.184% ############# ( 2, 3 ] 211378 7.374% 93.558% # ( 3, 4 ] 98949 3.452% 97.010% # ( 4, 6 ] 60841 2.123% 99.133% ( 6, 10 ] 19263 0.672% 99.805% ( 10, 15 ] 3086 0.108% 99.912% ( 15, 22 ] 311 0.011% 99.923% ( 22, 34 ] 22 0.001% 99.924% ( 34, 51 ] 13 0.000% 99.924% ( 51, 76 ] 16 0.001% 99.925% ( 76, 110 ] 952 0.033% 99.958% ( 110, 170 ] 1015 0.035% 99.994% ( 170, 250 ] 328 0.011% 100.005% ( 250, 380 ] 244 0.009% 100.014% ( 380, 580 ] 188 0.007% 100.020% ( 580, 870 ] 111 0.004% 100.024% ( 870, 1300 ] 42 0.001% 100.025% ( 1300, 1900 ] 18 0.001% 100.026% ( 1900, 2900 ] 23 0.001% 100.027% ( 2900, 4400 ] 5 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 698571 Average: 2.8363 StdDev: 17.64 Min: 1 Median: 1.5181 Max: 3177 Percentiles: P50: 1.52 P75: 1.90 P99: 8.77 P99.9: 150.60 P99.99: 495.50 ------------------------------------------------------ [ 0, 1 ] 113143 16.196% 16.196% ### ( 1, 2 ] 455799 65.247% 81.444% ############# ( 2, 3 ] 64733 9.266% 90.710% ## ( 3, 4 ] 28342 4.057% 94.767% # ( 4, 6 ] 21453 3.071% 97.838% # ( 6, 10 ] 11736 1.680% 99.518% ( 10, 15 ] 1410 0.202% 99.720% ( 15, 22 ] 160 0.023% 99.743% ( 22, 34 ] 8 0.001% 99.744% ( 51, 76 ] 26 0.004% 99.748% ( 76, 110 ] 608 0.087% 99.835% ( 110, 170 ] 673 0.096% 99.931% ( 170, 250 ] 193 0.028% 99.959% ( 250, 380 ] 150 0.021% 99.980% ( 380, 580 ] 118 0.017% 99.997% ( 580, 870 ] 68 0.010% 100.007% ( 870, 1300 ] 49 0.007% 100.014% ( 1300, 1900 ] 12 0.002% 100.016% ( 1900, 2900 ] 5 0.001% 100.016% ( 2900, 4400 ] 1 0.000% 100.017% ** Level 2 read latency histogram (micros): Count: 125553 Average: 2.4138 StdDev: 16.57 Min: 0 Median: 1.4364 Max: 2603 Percentiles: P50: 1.44 P75: 1.85 P99: 6.11 P99.9: 117.84 P99.99: 601.49 ------------------------------------------------------ [ 0, 1 ] 29373 23.395% 23.395% ##### ( 1, 2 ] 76542 60.964% 84.359% ############ ( 2, 3 ] 10384 8.271% 92.629% ## ( 3, 4 ] 4781 3.808% 96.437% # ( 4, 6 ] 3191 2.542% 98.979% # ( 6, 10 ] 993 0.791% 99.770% ( 10, 15 ] 129 0.103% 99.873% ( 15, 22 ] 12 0.010% 99.882% ( 22, 34 ] 1 0.001% 99.883% ( 34, 51 ] 1 0.001% 99.884% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 11 0.009% 99.894% ( 110, 170 ] 57 0.045% 99.939% ( 170, 250 ] 31 0.025% 99.964% ( 250, 380 ] 16 0.013% 99.977% ( 380, 580 ] 16 0.013% 99.990% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1900, 2900 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 355775 Average: 3.5109 StdDev: 28.36 Min: 0 Median: 1.6970 Max: 4330 Percentiles: P50: 1.70 P75: 2.44 P99: 9.15 P99.9: 160.52 P99.99: 305.57 ------------------------------------------------------ [ 0, 1 ] 31288 8.794% 8.794% ## ( 1, 2 ] 210331 59.119% 67.913% ############ ( 2, 3 ] 57650 16.204% 84.117% ### ( 3, 4 ] 24766 6.961% 91.079% # ( 4, 6 ] 23045 6.477% 97.556% # ( 6, 10 ] 6535 1.837% 99.393% ( 10, 15 ] 1032 0.290% 99.683% ( 15, 22 ] 154 0.043% 99.726% ( 22, 34 ] 30 0.008% 99.735% ( 34, 51 ] 5 0.001% 99.736% ( 51, 76 ] 23 0.006% 99.743% ( 76, 110 ] 216 0.061% 99.803% ( 110, 170 ] 410 0.115% 99.918% ( 170, 250 ] 199 0.056% 99.974% ( 250, 380 ] 132 0.037% 100.012% ( 380, 580 ] 124 0.035% 100.046% ( 580, 870 ] 47 0.013% 100.060% ( 870, 1300 ] 14 0.004% 100.064% ( 1300, 1900 ] 11 0.003% 100.067% ( 1900, 2900 ] 10 0.003% 100.069% ( 2900, 4400 ] 9 0.003% 100.072% ** Level 4 read latency histogram (micros): Count: 4617 Average: 60.1884 StdDev: 267.75 Min: 0 Median: 2.2464 Max: 4648 Percentiles: P50: 2.25 P75: 3.85 P99: 992.37 P99.9: 3982.65 P99.99: 4648.00 ------------------------------------------------------ [ 0, 1 ] 195 4.224% 4.224% # ( 1, 2 ] 1888 40.892% 45.116% ######## ( 2, 3 ] 915 19.818% 64.934% #### ( 3, 4 ] 545 11.804% 76.738% ## ( 4, 6 ] 355 7.689% 84.427% ## ( 6, 10 ] 94 2.036% 86.463% ( 10, 15 ] 58 1.256% 87.719% ( 15, 22 ] 19 0.412% 88.131% ( 22, 34 ] 1 0.022% 88.152% ( 76, 110 ] 25 0.541% 88.694% ( 110, 170 ] 113 2.447% 91.141% ( 170, 250 ] 94 2.036% 93.177% ( 250, 380 ] 96 2.079% 95.257% ( 380, 580 ] 109 2.361% 97.618% ( 580, 870 ] 57 1.235% 98.852% ( 870, 1300 ] 24 0.520% 99.372% ( 1300, 1900 ] 6 0.130% 99.502% ( 1900, 2900 ] 9 0.195% 99.697% ( 2900, 4400 ] 13 0.282% 99.978% ( 4400, 6600 ] 1 0.022% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 712.7167 StdDev: 893.45 Min: 75 Median: 210.0000 Max: 3576 Percentiles: P50: 210.00 P75: 1085.00 P99: 3576.00 P99.9: 3576.00 P99.99: 3576.00 ------------------------------------------------------ ( 51, 76 ] 1 1.667% 1.667% ( 76, 110 ] 10 16.667% 18.333% ### ( 110, 170 ] 18 30.000% 48.333% ###### ( 170, 250 ] 2 3.333% 51.667% # ( 250, 380 ] 4 6.667% 58.333% # ( 380, 580 ] 4 6.667% 65.000% # ( 580, 870 ] 5 8.333% 73.333% ## ( 870, 1300 ] 2 3.333% 76.667% # ( 1300, 1900 ] 7 11.667% 88.333% ## ( 1900, 2900 ] 5 8.333% 96.667% ## ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 34.8 total, 12.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 198.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.242 H:M:S, 43.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 81.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.091 H:M:S, 75.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/11/17-13:29:03 ... thread 0: (1000000,8000000) ops and (273043.1,209164.0) ops/second in (3.662425,38.247495) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.50 GB 119.6 6.5 0.0 6.5 14.0 7.6 0.0 1.9 139.0 301.6 47.60 44.39 136 0.350 6715K 8489 0.0 0.0 L1 17/17 1.93 GB 0.0 4.9 3.8 1.0 4.8 3.8 0.2 1.3 229.8 226.9 21.62 20.70 3 7.206 5044K 61K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.9 2.0 253.4 253.2 1.51 1.45 3 0.504 388K 229 0.0 0.0 L3 21/0 997.51 MB 1.0 3.2 1.8 1.4 3.2 1.8 0.4 1.8 213.7 213.0 15.36 14.04 8 1.920 3334K 10K 0.0 0.0 L4 173/0 9.49 GB 1.0 1.3 1.2 0.1 1.3 1.2 0.7 1.1 166.9 166.6 7.78 6.21 18 0.432 1295K 1652 0.0 0.0 L5 1068/0 87.72 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/29 103.62 GB 0.0 16.2 7.0 9.1 23.6 14.5 5.2 3.1 176.3 257.9 93.87 86.79 168 0.559 16M 82K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.2 7.0 9.1 23.6 14.5 5.2 3.1 176.3 257.9 93.87 86.79 168 0.559 16M 82K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.2 7.0 9.1 16.1 6.9 0.0 0.0 232.1 230.9 71.29 66.96 55 1.296 16M 82K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 343.2 22.58 19.83 113 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.4 total, 38.3 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.64 GB write, 630.06 MB/s write, 16.16 GB read, 430.59 MB/s read, 93.9 seconds Interval compaction: 23.64 GB write, 632.95 MB/s write, 16.16 GB read, 432.56 MB/s read, 93.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 22, pending-compaction-bytes-stops: 0, total-delays: 36, total-stops: 15, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3082463 Average: 2.3656 StdDev: 15.69 Min: 0 Median: 1.4534 Max: 5081 Percentiles: P50: 1.45 P75: 1.84 P99: 5.93 P99.9: 15.00 P99.99: 195.48 ------------------------------------------------------ [ 0, 1 ] 634187 20.574% 20.574% #### ( 1, 2 ] 2000466 64.898% 85.472% ############# ( 2, 3 ] 237522 7.706% 93.178% ## ( 3, 4 ] 110864 3.597% 96.775% # ( 4, 6 ] 71149 2.308% 99.083% ( 6, 10 ] 21572 0.700% 99.783% ( 10, 15 ] 3626 0.118% 99.900% ( 15, 22 ] 368 0.012% 99.912% ( 22, 34 ] 26 0.001% 99.913% ( 34, 51 ] 14 0.000% 99.913% ( 51, 76 ] 16 0.001% 99.914% ( 76, 110 ] 1078 0.035% 99.949% ( 110, 170 ] 1142 0.037% 99.986% ( 170, 250 ] 398 0.013% 99.999% ( 250, 380 ] 308 0.010% 100.009% ( 380, 580 ] 260 0.008% 100.017% ( 580, 870 ] 155 0.005% 100.022% ( 870, 1300 ] 67 0.002% 100.024% ( 1300, 1900 ] 21 0.001% 100.025% ( 1900, 2900 ] 37 0.001% 100.026% ( 2900, 4400 ] 16 0.001% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 911165 Average: 3.1477 StdDev: 31.73 Min: 1 Median: 1.5555 Max: 4791 Percentiles: P50: 1.56 P75: 1.94 P99: 8.96 P99.9: 154.46 P99.99: 536.33 ------------------------------------------------------ [ 0, 1 ] 130382 14.309% 14.309% ### ( 1, 2 ] 585440 64.252% 78.561% ############# ( 2, 3 ] 97627 10.715% 89.276% ## ( 3, 4 ] 42046 4.615% 93.890% # ( 4, 6 ] 34557 3.793% 97.683% # ( 6, 10 ] 16202 1.778% 99.461% ( 10, 15 ] 2394 0.263% 99.724% ( 15, 22 ] 269 0.030% 99.753% ( 22, 34 ] 9 0.001% 99.754% ( 34, 51 ] 7 0.001% 99.755% ( 51, 76 ] 38 0.004% 99.759% ( 76, 110 ] 691 0.076% 99.835% ( 110, 170 ] 800 0.088% 99.923% ( 170, 250 ] 256 0.028% 99.951% ( 250, 380 ] 224 0.025% 99.976% ( 380, 580 ] 170 0.019% 99.994% ( 580, 870 ] 104 0.011% 100.006% ( 870, 1300 ] 75 0.008% 100.014% ( 1300, 1900 ] 31 0.003% 100.017% ( 1900, 2900 ] 24 0.003% 100.020% ( 2900, 4400 ] 29 0.003% 100.023% ( 4400, 6600 ] 4 0.000% 100.023% ** Level 2 read latency histogram (micros): Count: 125553 Average: 2.4138 StdDev: 16.57 Min: 0 Median: 1.4364 Max: 2603 Percentiles: P50: 1.44 P75: 1.85 P99: 6.11 P99.9: 117.84 P99.99: 601.49 ------------------------------------------------------ [ 0, 1 ] 29373 23.395% 23.395% ##### ( 1, 2 ] 76542 60.964% 84.359% ############ ( 2, 3 ] 10384 8.271% 92.629% ## ( 3, 4 ] 4781 3.808% 96.437% # ( 4, 6 ] 3191 2.542% 98.979% # ( 6, 10 ] 993 0.791% 99.770% ( 10, 15 ] 129 0.103% 99.873% ( 15, 22 ] 12 0.010% 99.882% ( 22, 34 ] 1 0.001% 99.883% ( 34, 51 ] 1 0.001% 99.884% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 11 0.009% 99.894% ( 110, 170 ] 57 0.045% 99.939% ( 170, 250 ] 31 0.025% 99.964% ( 250, 380 ] 16 0.013% 99.977% ( 380, 580 ] 16 0.013% 99.990% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1900, 2900 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 580632 Average: 3.6154 StdDev: 33.21 Min: 0 Median: 1.7683 Max: 4598 Percentiles: P50: 1.77 P75: 2.66 P99: 9.05 P99.9: 113.51 P99.99: 170.28 ------------------------------------------------------ [ 0, 1 ] 36473 6.282% 6.282% # ( 1, 2 ] 330401 56.904% 63.185% ########### ( 2, 3 ] 103573 17.838% 81.023% #### ( 3, 4 ] 49116 8.459% 89.482% ## ( 4, 6 ] 47160 8.122% 97.605% ## ( 6, 10 ] 10628 1.830% 99.435% ( 10, 15 ] 2073 0.357% 99.792% ( 15, 22 ] 276 0.048% 99.839% ( 22, 34 ] 34 0.006% 99.845% ( 34, 51 ] 9 0.002% 99.847% ( 51, 76 ] 24 0.004% 99.851% ( 76, 110 ] 252 0.043% 99.894% ( 110, 170 ] 554 0.095% 99.990% ( 170, 250 ] 267 0.046% 100.036% ( 250, 380 ] 177 0.030% 100.066% ( 380, 580 ] 167 0.029% 100.095% ( 580, 870 ] 70 0.012% 100.107% ( 870, 1300 ] 25 0.004% 100.111% ( 1300, 1900 ] 19 0.003% 100.115% ( 1900, 2900 ] 23 0.004% 100.119% ( 2900, 4400 ] 23 0.004% 100.123% ( 4400, 6600 ] 1 0.000% 100.123% ** Level 4 read latency histogram (micros): Count: 17134 Average: 32.7531 StdDev: 175.42 Min: 0 Median: 1.9343 Max: 4675 Percentiles: P50: 1.93 P75: 3.28 P99: 700.99 P99.9: 2981.19 P99.99: 4675.00 ------------------------------------------------------ [ 0, 1 ] 835 4.873% 4.873% # ( 1, 2 ] 8276 48.302% 53.175% ########## ( 2, 3 ] 3197 18.659% 71.834% #### ( 3, 4 ] 1954 11.404% 83.238% ## ( 4, 6 ] 1234 7.202% 90.440% # ( 6, 10 ] 336 1.961% 92.401% ( 10, 15 ] 124 0.724% 93.125% ( 15, 22 ] 26 0.152% 93.277% ( 22, 34 ] 2 0.012% 93.288% ( 76, 110 ] 45 0.263% 93.551% ( 110, 170 ] 221 1.290% 94.841% ( 170, 250 ] 213 1.243% 96.084% ( 250, 380 ] 200 1.167% 97.251% ( 380, 580 ] 240 1.401% 98.652% ( 580, 870 ] 143 0.835% 99.486% ( 870, 1300 ] 49 0.286% 99.772% ( 1300, 1900 ] 10 0.058% 99.831% ( 1900, 2900 ] 11 0.064% 99.895% ( 2900, 4400 ] 16 0.093% 99.988% ( 4400, 6600 ] 2 0.012% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 773.1833 StdDev: 980.35 Min: 75 Median: 263.0000 Max: 4427 Percentiles: P50: 263.00 P75: 1192.50 P99: 4350.00 P99.9: 4427.00 P99.99: 4427.00 ------------------------------------------------------ ( 51, 76 ] 1 0.833% 0.833% ( 76, 110 ] 16 13.333% 14.167% ### ( 110, 170 ] 35 29.167% 43.333% ###### ( 170, 250 ] 7 5.833% 49.167% # ( 250, 380 ] 10 8.333% 57.500% ## ( 380, 580 ] 9 7.500% 65.000% ## ( 580, 870 ] 9 7.500% 72.500% ## ( 870, 1300 ] 4 3.333% 75.833% # ( 1300, 1900 ] 11 9.167% 85.000% ## ( 1900, 2900 ] 11 9.167% 94.167% ## ( 2900, 4400 ] 6 5.000% 99.167% # ( 4400, 6600 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 38.4 total, 3.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 204.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.163 H:M:S, 42.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 268.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.920 H:M:S, 25.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-13:29:17 ... thread 0: (1000000,9000000) ops and (71758.9,172469.8) ops/second in (13.935546,52.183041) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 2.40 GB 6.3 7.3 0.0 7.3 15.7 8.5 0.0 1.9 138.5 300.3 53.68 49.92 154 0.349 7547K 9354 0.0 0.0 L1 18/18 2.02 GB 0.0 8.8 5.8 3.0 8.7 5.7 0.2 1.5 223.9 220.9 40.30 37.93 4 10.076 8197K 61K 0.0 0.0 L2 2/1 203.49 MB 0.7 0.4 0.2 0.2 0.4 0.2 3.8 2.0 253.4 253.2 1.51 1.45 3 0.504 388K 229 0.0 0.0 L3 30/9 1.64 GB 1.0 5.5 3.3 2.2 5.4 3.3 0.6 1.7 193.1 192.3 28.97 24.62 18 1.609 5682K 23K 0.0 0.0 L4 172/7 9.51 GB 1.0 2.4 2.2 0.2 2.4 2.2 0.7 1.1 159.8 159.3 15.57 11.75 31 0.502 2433K 4612 0.0 0.0 L5 1080/0 88.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1318/50 104.47 GB 0.0 24.3 11.5 12.8 32.7 19.8 8.3 3.8 178.0 238.9 140.03 125.68 210 0.667 24M 99K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.3 11.5 12.8 32.7 19.8 8.3 3.8 178.0 238.9 140.03 125.68 210 0.667 24M 99K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.3 11.5 12.8 24.2 11.4 0.0 0.0 217.7 216.3 114.48 103.38 82 1.396 24M 99K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 340.3 25.55 22.29 128 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.4 total, 52.2 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.67 GB write, 638.92 MB/s write, 24.34 GB read, 475.95 MB/s read, 140.0 seconds Interval compaction: 32.67 GB write, 641.06 MB/s write, 24.34 GB read, 477.55 MB/s read, 140.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 50, pending-compaction-bytes-stops: 0, total-delays: 69, total-stops: 16, interval: 85 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3683906 Average: 2.6180 StdDev: 23.39 Min: 0 Median: 1.4658 Max: 6639 Percentiles: P50: 1.47 P75: 1.86 P99: 6.50 P99.9: 105.70 P99.99: 360.40 ------------------------------------------------------ [ 0, 1 ] 740670 20.106% 20.106% #### ( 1, 2 ] 2364205 64.177% 84.282% ############# ( 2, 3 ] 296846 8.058% 92.340% ## ( 3, 4 ] 142160 3.859% 96.199% # ( 4, 6 ] 99542 2.702% 98.901% # ( 6, 10 ] 29379 0.797% 99.699% ( 10, 15 ] 4918 0.133% 99.832% ( 15, 22 ] 533 0.014% 99.847% ( 22, 34 ] 37 0.001% 99.848% ( 34, 51 ] 15 0.000% 99.848% ( 51, 76 ] 25 0.001% 99.849% ( 76, 110 ] 2166 0.059% 99.907% ( 110, 170 ] 1934 0.052% 99.960% ( 170, 250 ] 666 0.018% 99.978% ( 250, 380 ] 520 0.014% 99.992% ( 380, 580 ] 503 0.014% 100.006% ( 580, 870 ] 329 0.009% 100.015% ( 870, 1300 ] 191 0.005% 100.020% ( 1300, 1900 ] 64 0.002% 100.022% ( 1900, 2900 ] 67 0.002% 100.023% ( 2900, 4400 ] 39 0.001% 100.025% ( 4400, 6600 ] 12 0.000% 100.025% ( 6600, 9900 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1628750 Average: 3.6485 StdDev: 42.83 Min: 1 Median: 1.5736 Max: 11382 Percentiles: P50: 1.57 P75: 1.99 P99: 9.25 P99.9: 162.72 P99.99: 549.88 ------------------------------------------------------ [ 0, 1 ] 254466 15.623% 15.623% ### ( 1, 2 ] 976119 59.931% 75.554% ############ ( 2, 3 ] 182581 11.210% 86.764% ## ( 3, 4 ] 91639 5.626% 92.390% # ( 4, 6 ] 82302 5.053% 97.443% # ( 6, 10 ] 31214 1.916% 99.360% ( 10, 15 ] 5068 0.311% 99.671% ( 15, 22 ] 672 0.041% 99.712% ( 22, 34 ] 41 0.003% 99.715% ( 34, 51 ] 10 0.001% 99.715% ( 51, 76 ] 108 0.007% 99.722% ( 76, 110 ] 1383 0.085% 99.807% ( 110, 170 ] 1728 0.106% 99.913% ( 170, 250 ] 423 0.026% 99.939% ( 250, 380 ] 439 0.027% 99.966% ( 380, 580 ] 464 0.028% 99.994% ( 580, 870 ] 421 0.026% 100.020% ( 870, 1300 ] 273 0.017% 100.037% ( 1300, 1900 ] 107 0.007% 100.043% ( 1900, 2900 ] 55 0.003% 100.047% ( 2900, 4400 ] 70 0.004% 100.051% ( 4400, 6600 ] 15 0.001% 100.052% ( 6600, 9900 ] 4 0.000% 100.052% ( 9900, 14000 ] 1 0.000% 100.052% ** Level 2 read latency histogram (micros): Count: 125553 Average: 2.4138 StdDev: 16.57 Min: 0 Median: 1.4364 Max: 2603 Percentiles: P50: 1.44 P75: 1.85 P99: 6.11 P99.9: 117.84 P99.99: 601.49 ------------------------------------------------------ [ 0, 1 ] 29373 23.395% 23.395% ##### ( 1, 2 ] 76542 60.964% 84.359% ############ ( 2, 3 ] 10384 8.271% 92.629% ## ( 3, 4 ] 4781 3.808% 96.437% # ( 4, 6 ] 3191 2.542% 98.979% # ( 6, 10 ] 993 0.791% 99.770% ( 10, 15 ] 129 0.103% 99.873% ( 15, 22 ] 12 0.010% 99.882% ( 22, 34 ] 1 0.001% 99.883% ( 34, 51 ] 1 0.001% 99.884% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 11 0.009% 99.894% ( 110, 170 ] 57 0.045% 99.939% ( 170, 250 ] 31 0.025% 99.964% ( 250, 380 ] 16 0.013% 99.977% ( 380, 580 ] 16 0.013% 99.990% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1900, 2900 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1186816 Average: 4.2756 StdDev: 52.41 Min: 0 Median: 1.8561 Max: 8083 Percentiles: P50: 1.86 P75: 2.90 P99: 9.02 P99.9: 20.26 P99.99: 159.54 ------------------------------------------------------ [ 0, 1 ] 51176 4.312% 4.312% # ( 1, 2 ] 633350 53.365% 57.678% ########### ( 2, 3 ] 228197 19.228% 76.905% #### ( 3, 4 ] 121823 10.265% 87.170% ## ( 4, 6 ] 122683 10.337% 97.507% ## ( 6, 10 ] 23451 1.976% 99.483% ( 10, 15 ] 4576 0.386% 99.869% ( 15, 22 ] 499 0.042% 99.911% ( 22, 34 ] 61 0.005% 99.916% ( 34, 51 ] 23 0.002% 99.918% ( 51, 76 ] 53 0.004% 99.922% ( 76, 110 ] 283 0.024% 99.946% ( 110, 170 ] 635 0.054% 99.999% ( 170, 250 ] 415 0.035% 100.034% ( 250, 380 ] 381 0.032% 100.067% ( 380, 580 ] 414 0.035% 100.101% ( 580, 870 ] 312 0.026% 100.128% ( 870, 1300 ] 188 0.016% 100.144% ( 1300, 1900 ] 93 0.008% 100.151% ( 1900, 2900 ] 62 0.005% 100.157% ( 2900, 4400 ] 96 0.008% 100.165% ( 4400, 6600 ] 7 0.001% 100.165% ( 6600, 9900 ] 12 0.001% 100.166% ** Level 4 read latency histogram (micros): Count: 63702 Average: 36.5524 StdDev: 219.30 Min: 0 Median: 1.9640 Max: 7765 Percentiles: P50: 1.96 P75: 3.30 P99: 885.72 P99.9: 3255.44 P99.99: 4599.20 ------------------------------------------------------ [ 0, 1 ] 2768 4.345% 4.345% # ( 1, 2 ] 30168 47.358% 51.703% ######### ( 2, 3 ] 12634 19.833% 71.536% #### ( 3, 4 ] 7356 11.548% 83.084% ## ( 4, 6 ] 5453 8.560% 91.644% ## ( 6, 10 ] 1442 2.264% 93.908% ( 10, 15 ] 375 0.589% 94.496% ( 15, 22 ] 56 0.088% 94.584% ( 22, 34 ] 16 0.025% 94.609% ( 34, 51 ] 1 0.002% 94.611% ( 51, 76 ] 2 0.003% 94.614% ( 76, 110 ] 159 0.250% 94.864% ( 110, 170 ] 473 0.743% 95.606% ( 170, 250 ] 457 0.717% 96.324% ( 250, 380 ] 491 0.771% 97.094% ( 380, 580 ] 650 1.020% 98.115% ( 580, 870 ] 551 0.865% 98.980% ( 870, 1300 ] 355 0.557% 99.537% ( 1300, 1900 ] 147 0.231% 99.768% ( 1900, 2900 ] 67 0.105% 99.873% ( 2900, 4400 ] 73 0.115% 99.987% ( 4400, 6600 ] 18 0.028% 100.016% ( 6600, 9900 ] 2 0.003% 100.019% ** Level 5 read latency histogram (micros): Count: 180 Average: 824.4500 StdDev: 979.77 Min: 75 Median: 343.8889 Max: 4427 Percentiles: P50: 343.89 P75: 1300.00 P99: 4266.67 P99.9: 4427.00 P99.99: 4427.00 ------------------------------------------------------ ( 51, 76 ] 1 0.556% 0.556% ( 76, 110 ] 24 13.333% 13.889% ### ( 110, 170 ] 45 25.000% 38.889% ##### ( 170, 250 ] 7 3.889% 42.778% # ( 250, 380 ] 18 10.000% 52.778% ## ( 380, 580 ] 17 9.444% 62.222% ## ( 580, 870 ] 12 6.667% 68.889% # ( 870, 1300 ] 11 6.111% 75.000% # ( 1300, 1900 ] 17 9.444% 84.444% ## ( 1900, 2900 ] 18 10.000% 94.444% ## ( 2900, 4400 ] 9 5.000% 99.444% # ( 4400, 6600 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 52.4 total, 13.9 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 169.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.116 H:M:S, 51.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 70.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.954 H:M:S, 78.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.219 micros/op 160795 ops/sec 60.039 seconds 9653999 operations; 155.8 MB/s Microseconds per write: Count: 9653999 Average: 6.2191 StdDev: 252.87 Min: 0 Median: 1.7860 Max: 297127 Percentiles: P50: 1.79 P75: 2.82 P99: 8.87 P99.9: 1190.49 P99.99: 2722.22 ------------------------------------------------------ [ 0, 1 ] 1017779 10.543% 10.543% ## ( 1, 2 ] 4846232 50.199% 60.742% ########## ( 2, 3 ] 1672994 17.330% 78.071% ### ( 3, 4 ] 1389685 14.395% 92.466% ### ( 4, 6 ] 556449 5.764% 98.230% # ( 6, 10 ] 103409 1.071% 99.301% ( 10, 15 ] 25292 0.262% 99.563% ( 15, 22 ] 6744 0.070% 99.633% ( 22, 34 ] 1518 0.016% 99.649% ( 34, 51 ] 192 0.002% 99.651% ( 51, 76 ] 41 0.000% 99.651% ( 76, 110 ] 6742 0.070% 99.721% ( 110, 170 ] 2683 0.028% 99.749% ( 170, 250 ] 292 0.003% 99.752% ( 250, 380 ] 101 0.001% 99.753% ( 380, 580 ] 12 0.000% 99.753% ( 580, 870 ] 19 0.000% 99.753% ( 870, 1300 ] 19000 0.197% 99.950% ( 1300, 1900 ] 83 0.001% 99.951% ( 1900, 2900 ] 4581 0.047% 99.998% ( 2900, 4400 ] 113 0.001% 100.000% ( 4400, 6600 ] 19 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 11 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 199761 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9653999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9962926968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 557 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33109972 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30806619868 rocksdb.compact.write.bytes COUNT : 30612147540 rocksdb.flush.write.bytes COUNT : 9909000225 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 53 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 248 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9828755456 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3497984 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30896250942 rocksdb.non.last.level.read.count COUNT : 7465708 rocksdb.block.checksum.compute.count COUNT : 7464647 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.398008 P95 : 3.886385 P99 : 7.237932 P100 : 297124.000000 COUNT : 9653999 SUM : 55005915 rocksdb.compaction.times.micros P50 : 921388.888889 P95 : 3687500.000000 P99 : 18200000.000000 P100 : 18685072.000000 COUNT : 95 SUM : 125333014 rocksdb.compaction.times.cpu_micros P50 : 864722.222222 P95 : 3483333.333333 P99 : 17237697.000000 P100 : 17237697.000000 COUNT : 95 SUM : 111567688 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 704.285714 P95 : 1240.619048 P99 : 4115.000000 P100 : 12966.000000 COUNT : 138 SUM : 114278 rocksdb.compaction.outfile.sync.micros P50 : 955.225225 P95 : 30600.000000 P99 : 111800.000000 P100 : 166220.000000 COUNT : 388 SUM : 2277720 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 100.427184 P95 : 667.000000 P99 : 1788.000000 P100 : 2554.000000 COUNT : 256 SUM : 51541 rocksdb.table.open.io.micros P50 : 1178.478261 P95 : 6015.000000 P99 : 9064.500000 P100 : 9551.000000 COUNT : 557 SUM : 970720 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.576533 P95 : 7.633785 P99 : 11.182636 P100 : 11388.000000 COUNT : 7462944 SUM : 40742856 rocksdb.read.block.get.micros P50 : 375.422535 P95 : 2707.575758 P99 : 4125.384615 P100 : 5725.000000 COUNT : 1114 SUM : 795610 rocksdb.write.raw.block.micros P50 : 0.513030 P95 : 0.974758 P99 : 2.984752 P100 : 10860.000000 COUNT : 9813942 SUM : 18359700 rocksdb.numfiles.in.singlecompaction P50 : 2.950000 P95 : 6.866667 P99 : 26.380000 P100 : 29.000000 COUNT : 127 SUM : 475 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.557013 P95 : 1144.328641 P99 : 2418.882083 P100 : 296933.000000 COUNT : 233119 SUM : 33125340 rocksdb.sst.read.micros P50 : 1.544337 P95 : 4.580602 P99 : 8.475394 P100 : 11382.000000 COUNT : 7465813 SUM : 25639911 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9653999 SUM : 9962926968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212522.522523 P95 : 343785.714286 P99 : 482600.000000 P100 : 543250.000000 COUNT : 138 SUM : 27912694 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 355 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0