[2024-12-15 00:46:18.043274] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-15 00:46:18.043527] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid961977 ] Set seed to 1734219978036608 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 00:46:18.155401] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 00:46:18.191470] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 00:46:18.191513] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 961977' to capture a snapshot of events at runtime. [2024-12-15 00:46:18.191526] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid961977 for offline analysis/debug. [2024-12-15 00:46:18.191568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 00:46:22 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-00:46:25 ... thread 0: (1000000,1000000) ops and (339988.5,339988.5) ops/second in (2.941276,2.941276) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.96 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 355.8 2.48 2.23 12 0.207 0 0 0.0 0.0 L1 3/3 251.74 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 255.1 254.8 0.99 0.96 1 0.988 255K 220 0.0 0.0 L2 1/0 48.88 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 32 0.0 0.0 L3 17/0 818.42 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 202.8 202.9 0.31 0.26 1 0.308 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 100.5 308.7 4.24 3.88 15 0.282 432K 252 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 100.5 308.7 4.24 3.88 15 0.282 432K 252 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 242.4 242.2 1.76 1.65 3 0.586 432K 252 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 355.8 2.48 2.23 12 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 419.76 MB/s write, 0.42 GB read, 136.71 MB/s read, 4.2 seconds Interval compaction: 1.28 GB write, 444.37 MB/s write, 0.42 GB read, 144.73 MB/s read, 4.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 104784 Average: 1.8117 StdDev: 19.86 Min: 0 Median: 1.1306 Max: 3811 Percentiles: P50: 1.13 P75: 1.59 P99: 3.30 P99.9: 9.52 P99.99: 364.45 ------------------------------------------------------ [ 0, 1 ] 45022 42.966% 42.966% ######### ( 1, 2 ] 56424 53.848% 96.814% ########### ( 2, 3 ] 2097 2.001% 98.816% ( 3, 4 ] 643 0.614% 99.429% ( 4, 6 ] 327 0.312% 99.741% ( 6, 10 ] 189 0.180% 99.922% ( 10, 15 ] 43 0.041% 99.963% ( 15, 22 ] 13 0.012% 99.975% ( 34, 51 ] 1 0.001% 99.976% ( 51, 76 ] 1 0.001% 99.977% ( 110, 170 ] 10 0.010% 99.987% ( 250, 380 ] 4 0.004% 99.990% ( 380, 580 ] 2 0.002% 99.992% ( 580, 870 ] 1 0.001% 99.993% ( 870, 1300 ] 3 0.003% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 1 read latency histogram (micros): Count: 32068 Average: 2.1585 StdDev: 16.23 Min: 1 Median: 1.1660 Max: 1851 Percentiles: P50: 1.17 P75: 1.63 P99: 5.68 P99.9: 97.90 P99.99: 810.03 ------------------------------------------------------ [ 0, 1 ] 13187 41.122% 41.122% ######## ( 1, 2 ] 17149 53.477% 94.599% ########### ( 2, 3 ] 1048 3.268% 97.867% # ( 3, 4 ] 254 0.792% 98.659% ( 4, 6 ] 130 0.405% 99.064% ( 6, 10 ] 163 0.508% 99.573% ( 10, 15 ] 45 0.140% 99.713% ( 15, 22 ] 7 0.022% 99.735% ( 22, 34 ] 2 0.006% 99.741% ( 34, 51 ] 38 0.118% 99.860% ( 51, 76 ] 11 0.034% 99.894% ( 76, 110 ] 3 0.009% 99.903% ( 170, 250 ] 15 0.047% 99.950% ( 250, 380 ] 7 0.022% 99.972% ( 380, 580 ] 5 0.016% 99.988% ( 580, 870 ] 1 0.003% 99.991% ( 870, 1300 ] 2 0.006% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 15871 Average: 1.7639 StdDev: 3.95 Min: 0 Median: 1.1654 Max: 367 Percentiles: P50: 1.17 P75: 1.63 P99: 5.05 P99.9: 10.07 P99.99: 226.52 ------------------------------------------------------ [ 0, 1 ] 6537 41.188% 41.188% ######## ( 1, 2 ] 8455 53.273% 94.462% ########### ( 2, 3 ] 426 2.684% 97.146% # ( 3, 4 ] 205 1.292% 98.437% ( 4, 6 ] 170 1.071% 99.509% ( 6, 10 ] 62 0.391% 99.899% ( 10, 15 ] 9 0.057% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 874.9765 StdDev: 1256.43 Min: 1 Median: 242.0000 Max: 5134 Percentiles: P50: 242.00 P75: 1475.00 P99: 5134.00 P99.9: 5134.00 P99.99: 5134.00 ------------------------------------------------------ [ 0, 1 ] 15 17.647% 17.647% #### ( 1, 2 ] 23 27.059% 44.706% ##### ( 170, 250 ] 5 5.882% 50.588% # ( 250, 380 ] 3 3.529% 54.118% # ( 380, 580 ] 6 7.059% 61.176% # ( 580, 870 ] 7 8.235% 69.412% ## ( 870, 1300 ] 3 3.529% 72.941% # ( 1300, 1900 ] 6 7.059% 80.000% # ( 1900, 2900 ] 9 10.588% 90.588% ## ( 2900, 4400 ] 6 7.059% 97.647% # ( 4400, 6600 ] 2 2.353% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1731.5667 StdDev: 1523.21 Min: 172 Median: 1300.0000 Max: 5640 Percentiles: P50: 1300.00 P75: 2150.00 P99: 5640.00 P99.9: 5640.00 P99.99: 5640.00 ------------------------------------------------------ ( 170, 250 ] 3 10.000% 10.000% ## ( 250, 380 ] 4 13.333% 23.333% ### ( 580, 870 ] 4 13.333% 36.667% ### ( 870, 1300 ] 4 13.333% 50.000% ### ( 1300, 1900 ] 7 23.333% 73.333% ##### ( 1900, 2900 ] 2 6.667% 80.000% # ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 315.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.368 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.368 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-00:46:28 ... thread 0: (1000000,2000000) ops and (331565.6,335724.2) ops/second in (3.015994,5.957270) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.23 GB 18.9 0.6 0.0 0.6 2.4 1.8 0.0 1.3 76.0 329.4 7.46 6.88 28 0.266 575K 631 0.0 0.0 L1 6/6 565.46 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 245.9 245.4 3.33 3.24 2 1.665 831K 1444 0.0 0.0 L2 1/0 48.88 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 32 0.0 0.0 L3 17/0 818.42 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 202.8 202.9 0.31 0.26 1 0.308 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1195/15 97.98 GB 0.0 1.5 0.6 0.9 3.4 2.5 0.2 1.8 135.0 298.3 11.56 10.81 32 0.361 1583K 2107 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.4 2.5 0.2 1.8 135.0 298.3 11.56 10.81 32 0.361 1583K 2107 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 249.8 249.5 6.24 6.04 6 1.040 1583K 2107 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 355.7 5.31 4.78 26 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.37 GB write, 562.27 MB/s write, 1.52 GB read, 254.38 MB/s read, 11.6 seconds Interval compaction: 3.37 GB write, 578.54 MB/s write, 1.52 GB read, 261.74 MB/s read, 11.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389914 Average: 2.0203 StdDev: 13.66 Min: 0 Median: 1.3594 Max: 3811 Percentiles: P50: 1.36 P75: 1.77 P99: 5.32 P99.9: 9.72 P99.99: 14.83 ------------------------------------------------------ [ 0, 1 ] 109126 27.987% 27.987% ###### ( 1, 2 ] 238803 61.245% 89.232% ############ ( 2, 3 ] 23628 6.060% 95.292% # ( 3, 4 ] 10269 2.634% 97.926% # ( 4, 6 ] 6354 1.630% 99.555% ( 6, 10 ] 1445 0.371% 99.926% ( 10, 15 ] 260 0.067% 99.993% ( 15, 22 ] 42 0.011% 100.003% ( 22, 34 ] 3 0.001% 100.004% ( 34, 51 ] 4 0.001% 100.005% ( 51, 76 ] 5 0.001% 100.006% ( 76, 110 ] 1 0.000% 100.007% ( 110, 170 ] 15 0.004% 100.011% ( 170, 250 ] 6 0.002% 100.012% ( 250, 380 ] 11 0.003% 100.015% ( 380, 580 ] 4 0.001% 100.016% ( 580, 870 ] 4 0.001% 100.017% ( 870, 1300 ] 8 0.002% 100.019% ( 1300, 1900 ] 2 0.001% 100.019% ( 1900, 2900 ] 4 0.001% 100.021% ( 2900, 4400 ] 2 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 106505 Average: 2.0870 StdDev: 11.13 Min: 1 Median: 1.3494 Max: 1851 Percentiles: P50: 1.35 P75: 1.76 P99: 5.30 P99.9: 17.42 P99.99: 504.27 ------------------------------------------------------ [ 0, 1 ] 30420 28.562% 28.562% ###### ( 1, 2 ] 65355 61.363% 89.925% ############ ( 2, 3 ] 6219 5.839% 95.765% # ( 3, 4 ] 2539 2.384% 98.148% ( 4, 6 ] 1396 1.311% 99.459% ( 6, 10 ] 390 0.366% 99.825% ( 10, 15 ] 75 0.070% 99.896% ( 15, 22 ] 13 0.012% 99.908% ( 22, 34 ] 3 0.003% 99.911% ( 34, 51 ] 40 0.038% 99.948% ( 51, 76 ] 11 0.010% 99.959% ( 76, 110 ] 3 0.003% 99.962% ( 110, 170 ] 1 0.001% 99.962% ( 170, 250 ] 16 0.015% 99.977% ( 250, 380 ] 9 0.008% 99.986% ( 380, 580 ] 7 0.007% 99.992% ( 580, 870 ] 1 0.001% 99.993% ( 870, 1300 ] 6 0.006% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15871 Average: 1.7639 StdDev: 3.95 Min: 0 Median: 1.1654 Max: 367 Percentiles: P50: 1.17 P75: 1.63 P99: 5.05 P99.9: 10.07 P99.99: 226.52 ------------------------------------------------------ [ 0, 1 ] 6537 41.188% 41.188% ######## ( 1, 2 ] 8455 53.273% 94.462% ########### ( 2, 3 ] 426 2.684% 97.146% # ( 3, 4 ] 205 1.292% 98.437% ( 4, 6 ] 170 1.071% 99.509% ( 6, 10 ] 62 0.391% 99.899% ( 10, 15 ] 9 0.057% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 874.9765 StdDev: 1256.43 Min: 1 Median: 242.0000 Max: 5134 Percentiles: P50: 242.00 P75: 1475.00 P99: 5134.00 P99.9: 5134.00 P99.99: 5134.00 ------------------------------------------------------ [ 0, 1 ] 15 17.647% 17.647% #### ( 1, 2 ] 23 27.059% 44.706% ##### ( 170, 250 ] 5 5.882% 50.588% # ( 250, 380 ] 3 3.529% 54.118% # ( 380, 580 ] 6 7.059% 61.176% # ( 580, 870 ] 7 8.235% 69.412% ## ( 870, 1300 ] 3 3.529% 72.941% # ( 1300, 1900 ] 6 7.059% 80.000% # ( 1900, 2900 ] 9 10.588% 90.588% ## ( 2900, 4400 ] 6 7.059% 97.647% # ( 4400, 6600 ] 2 2.353% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1731.5667 StdDev: 1523.21 Min: 172 Median: 1300.0000 Max: 5640 Percentiles: P50: 1300.00 P75: 2150.00 P99: 5640.00 P99.9: 5640.00 P99.99: 5640.00 ------------------------------------------------------ ( 170, 250 ] 3 10.000% 10.000% ## ( 250, 380 ] 4 13.333% 23.333% ### ( 580, 870 ] 4 13.333% 36.667% ### ( 870, 1300 ] 4 13.333% 50.000% ### ( 1300, 1900 ] 7 23.333% 73.333% ##### ( 1900, 2900 ] 2 6.667% 80.000% # ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.794 H:M:S, 13.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.426 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-00:46:31 ... thread 0: (1000000,3000000) ops and (355523.3,342074.3) ops/second in (2.812755,8.770025) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/13 2.15 GB 81.8 1.4 0.0 1.4 4.1 2.8 0.0 1.5 105.2 320.2 13.18 12.26 45 0.293 1407K 1463 0.0 0.0 L1 6/6 565.46 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 245.9 245.4 3.33 3.24 2 1.665 831K 1444 0.0 0.0 L2 1/0 48.88 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 32 0.0 0.0 L3 17/0 818.42 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 202.8 202.9 0.31 0.26 1 0.308 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1200/19 98.90 GB 0.0 2.3 0.6 1.7 5.1 3.4 0.2 1.8 137.7 301.6 17.28 16.19 49 0.353 2415K 2939 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 0.6 1.7 5.1 3.4 0.2 1.8 137.7 301.6 17.28 16.19 49 0.353 2415K 2939 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 0.6 1.7 2.3 0.6 0.0 0.0 254.4 254.1 9.35 9.08 9 1.039 2415K 2939 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 357.7 7.93 7.11 40 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.09 GB write, 582.56 MB/s write, 2.32 GB read, 265.94 MB/s read, 17.3 seconds Interval compaction: 5.09 GB write, 594.02 MB/s write, 2.32 GB read, 271.18 MB/s read, 17.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 707445 Average: 2.0594 StdDev: 11.03 Min: 0 Median: 1.4090 Max: 3811 Percentiles: P50: 1.41 P75: 1.80 P99: 5.38 P99.9: 9.76 P99.99: 14.39 ------------------------------------------------------ [ 0, 1 ] 168939 23.880% 23.880% ##### ( 1, 2 ] 451744 63.856% 87.736% ############# ( 2, 3 ] 49456 6.991% 94.727% # ( 3, 4 ] 21683 3.065% 97.792% # ( 4, 6 ] 12400 1.753% 99.544% ( 6, 10 ] 2679 0.379% 99.923% ( 10, 15 ] 541 0.076% 100.000% ( 15, 22 ] 70 0.010% 100.009% ( 22, 34 ] 6 0.001% 100.010% ( 34, 51 ] 6 0.001% 100.011% ( 51, 76 ] 8 0.001% 100.012% ( 76, 110 ] 1 0.000% 100.012% ( 110, 170 ] 22 0.003% 100.016% ( 170, 250 ] 14 0.002% 100.018% ( 250, 380 ] 18 0.003% 100.020% ( 380, 580 ] 6 0.001% 100.021% ( 580, 870 ] 12 0.002% 100.023% ( 870, 1300 ] 9 0.001% 100.024% ( 1300, 1900 ] 3 0.000% 100.024% ( 1900, 2900 ] 5 0.001% 100.025% ( 2900, 4400 ] 2 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 175866 Average: 2.0859 StdDev: 8.68 Min: 1 Median: 1.4094 Max: 1851 Percentiles: P50: 1.41 P75: 1.80 P99: 5.33 P99.9: 12.11 P99.99: 342.64 ------------------------------------------------------ [ 0, 1 ] 41454 23.571% 23.571% ##### ( 1, 2 ] 113531 64.555% 88.127% ############# ( 2, 3 ] 12402 7.052% 95.179% # ( 3, 4 ] 4936 2.807% 97.985% # ( 4, 6 ] 2687 1.528% 99.513% ( 6, 10 ] 637 0.362% 99.875% ( 10, 15 ] 102 0.058% 99.933% ( 15, 22 ] 16 0.009% 99.943% ( 22, 34 ] 5 0.003% 99.945% ( 34, 51 ] 41 0.023% 99.969% ( 51, 76 ] 11 0.006% 99.975% ( 76, 110 ] 3 0.002% 99.977% ( 110, 170 ] 1 0.001% 99.977% ( 170, 250 ] 16 0.009% 99.986% ( 250, 380 ] 9 0.005% 99.991% ( 380, 580 ] 7 0.004% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 6 0.003% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15871 Average: 1.7639 StdDev: 3.95 Min: 0 Median: 1.1654 Max: 367 Percentiles: P50: 1.17 P75: 1.63 P99: 5.05 P99.9: 10.07 P99.99: 226.52 ------------------------------------------------------ [ 0, 1 ] 6537 41.188% 41.188% ######## ( 1, 2 ] 8455 53.273% 94.462% ########### ( 2, 3 ] 426 2.684% 97.146% # ( 3, 4 ] 205 1.292% 98.437% ( 4, 6 ] 170 1.071% 99.509% ( 6, 10 ] 62 0.391% 99.899% ( 10, 15 ] 9 0.057% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 874.9765 StdDev: 1256.43 Min: 1 Median: 242.0000 Max: 5134 Percentiles: P50: 242.00 P75: 1475.00 P99: 5134.00 P99.9: 5134.00 P99.99: 5134.00 ------------------------------------------------------ [ 0, 1 ] 15 17.647% 17.647% #### ( 1, 2 ] 23 27.059% 44.706% ##### ( 170, 250 ] 5 5.882% 50.588% # ( 250, 380 ] 3 3.529% 54.118% # ( 380, 580 ] 6 7.059% 61.176% # ( 580, 870 ] 7 8.235% 69.412% ## ( 870, 1300 ] 3 3.529% 72.941% # ( 1300, 1900 ] 6 7.059% 80.000% # ( 1900, 2900 ] 9 10.588% 90.588% ## ( 2900, 4400 ] 6 7.059% 97.647% # ( 4400, 6600 ] 2 2.353% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1731.5667 StdDev: 1523.21 Min: 172 Median: 1300.0000 Max: 5640 Percentiles: P50: 1300.00 P75: 2150.00 P99: 5640.00 P99.9: 5640.00 P99.99: 5640.00 ------------------------------------------------------ ( 170, 250 ] 3 10.000% 10.000% ## ( 250, 380 ] 4 13.333% 23.333% ### ( 580, 870 ] 4 13.333% 36.667% ### ( 870, 1300 ] 4 13.333% 50.000% ### ( 1300, 1900 ] 7 23.333% 73.333% ##### ( 1900, 2900 ] 2 6.667% 80.000% # ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 8.9 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 330.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.003 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 349.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.209 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-00:46:34 ... thread 0: (1000000,4000000) ops and (331910.4,339475.4) ops/second in (3.012861,11.782886) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.27 GB 6.3 2.5 0.0 2.5 6.1 3.7 0.0 1.7 125.5 313.7 20.07 18.81 62 0.324 2558K 2635 0.0 0.0 L1 12/12 1.34 GB 0.0 2.2 1.3 0.9 2.1 1.3 0.1 1.7 237.9 237.0 9.26 8.99 3 3.085 2236K 8534 0.0 0.0 L2 1/0 48.88 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 32 0.0 0.0 L3 17/0 818.42 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 202.8 202.9 0.31 0.26 1 0.308 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1202/23 99.82 GB 0.0 4.8 1.4 3.4 8.5 5.1 0.2 2.3 162.7 287.9 30.10 28.49 67 0.449 4971K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 1.4 3.4 8.5 5.1 0.2 2.3 162.7 287.9 30.10 28.49 67 0.449 4971K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 1.4 3.4 4.8 1.4 0.0 0.0 250.7 250.1 19.53 19.00 14 1.395 4971K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 357.7 10.57 9.49 53 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.46 GB write, 724.66 MB/s write, 4.78 GB read, 409.50 MB/s read, 30.1 seconds Interval compaction: 8.46 GB write, 735.27 MB/s write, 4.78 GB read, 415.50 MB/s read, 30.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1016757 Average: 2.1070 StdDev: 11.19 Min: 0 Median: 1.4200 Max: 3811 Percentiles: P50: 1.42 P75: 1.81 P99: 5.45 P99.9: 9.96 P99.99: 17.36 ------------------------------------------------------ [ 0, 1 ] 234353 23.049% 23.049% ##### ( 1, 2 ] 652441 64.169% 87.218% ############# ( 2, 3 ] 73915 7.270% 94.488% # ( 3, 4 ] 32260 3.173% 97.660% # ( 4, 6 ] 18760 1.845% 99.505% ( 6, 10 ] 4047 0.398% 99.904% ( 10, 15 ] 849 0.084% 99.987% ( 15, 22 ] 90 0.009% 99.996% ( 22, 34 ] 10 0.001% 99.997% ( 34, 51 ] 8 0.001% 99.998% ( 51, 76 ] 10 0.001% 99.999% ( 76, 110 ] 60 0.006% 100.005% ( 110, 170 ] 75 0.007% 100.012% ( 170, 250 ] 42 0.004% 100.016% ( 250, 380 ] 42 0.004% 100.020% ( 380, 580 ] 20 0.002% 100.022% ( 580, 870 ] 23 0.002% 100.024% ( 870, 1300 ] 17 0.002% 100.026% ( 1300, 1900 ] 4 0.000% 100.026% ( 1900, 2900 ] 6 0.001% 100.027% ( 2900, 4400 ] 3 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 225944 Average: 2.3599 StdDev: 16.26 Min: 1 Median: 1.4272 Max: 2230 Percentiles: P50: 1.43 P75: 1.81 P99: 5.55 P99.9: 86.49 P99.99: 758.97 ------------------------------------------------------ [ 0, 1 ] 50226 22.229% 22.229% #### ( 1, 2 ] 146874 65.005% 87.234% ############# ( 2, 3 ] 16941 7.498% 94.732% # ( 3, 4 ] 6695 2.963% 97.695% # ( 4, 6 ] 3799 1.681% 99.376% ( 6, 10 ] 946 0.419% 99.795% ( 10, 15 ] 138 0.061% 99.856% ( 15, 22 ] 19 0.008% 99.865% ( 22, 34 ] 6 0.003% 99.867% ( 34, 51 ] 42 0.019% 99.886% ( 51, 76 ] 12 0.005% 99.891% ( 76, 110 ] 65 0.029% 99.920% ( 110, 170 ] 54 0.024% 99.944% ( 170, 250 ] 32 0.014% 99.958% ( 250, 380 ] 31 0.014% 99.972% ( 380, 580 ] 34 0.015% 99.987% ( 580, 870 ] 12 0.005% 99.992% ( 870, 1300 ] 9 0.004% 99.996% ( 1300, 1900 ] 7 0.003% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15871 Average: 1.7639 StdDev: 3.95 Min: 0 Median: 1.1654 Max: 367 Percentiles: P50: 1.17 P75: 1.63 P99: 5.05 P99.9: 10.07 P99.99: 226.52 ------------------------------------------------------ [ 0, 1 ] 6537 41.188% 41.188% ######## ( 1, 2 ] 8455 53.273% 94.462% ########### ( 2, 3 ] 426 2.684% 97.146% # ( 3, 4 ] 205 1.292% 98.437% ( 4, 6 ] 170 1.071% 99.509% ( 6, 10 ] 62 0.391% 99.899% ( 10, 15 ] 9 0.057% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 874.9765 StdDev: 1256.43 Min: 1 Median: 242.0000 Max: 5134 Percentiles: P50: 242.00 P75: 1475.00 P99: 5134.00 P99.9: 5134.00 P99.99: 5134.00 ------------------------------------------------------ [ 0, 1 ] 15 17.647% 17.647% #### ( 1, 2 ] 23 27.059% 44.706% ##### ( 170, 250 ] 5 5.882% 50.588% # ( 250, 380 ] 3 3.529% 54.118% # ( 380, 580 ] 6 7.059% 61.176% # ( 580, 870 ] 7 8.235% 69.412% ## ( 870, 1300 ] 3 3.529% 72.941% # ( 1300, 1900 ] 6 7.059% 80.000% # ( 1900, 2900 ] 9 10.588% 90.588% ## ( 2900, 4400 ] 6 7.059% 97.647% # ( 4400, 6600 ] 2 2.353% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1731.5667 StdDev: 1523.21 Min: 172 Median: 1300.0000 Max: 5640 Percentiles: P50: 1300.00 P75: 2150.00 P99: 5640.00 P99.9: 5640.00 P99.99: 5640.00 ------------------------------------------------------ ( 170, 250 ] 3 10.000% 10.000% ## ( 250, 380 ] 4 13.333% 23.333% ### ( 580, 870 ] 4 13.333% 36.667% ### ( 870, 1300 ] 4 13.333% 50.000% ### ( 1300, 1900 ] 7 23.333% 73.333% ##### ( 1900, 2900 ] 2 6.667% 80.000% # ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 329.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.396 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.393 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-00:46:38 ... thread 0: (1000000,5000000) ops and (260753.3,320144.9) ops/second in (3.835042,15.617928) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.32 GB 113.3 3.3 0.0 3.3 8.0 4.7 0.0 1.7 128.0 313.7 26.09 24.45 80 0.326 3390K 3537 0.0 0.0 L1 12/12 1.34 GB 0.0 2.2 1.3 0.9 2.1 1.3 0.1 1.7 237.9 237.0 9.26 8.99 3 3.085 2236K 8534 0.0 0.0 L2 1/0 48.88 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 32 0.0 0.0 L3 17/0 818.42 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 202.8 202.9 0.31 0.26 1 0.308 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1208/23 100.86 GB 0.0 5.6 1.4 4.2 10.3 6.1 0.2 2.2 158.2 292.2 36.12 34.13 85 0.425 5803K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 1.4 4.2 10.3 6.1 0.2 2.2 158.2 292.2 36.12 34.13 85 0.425 5803K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 1.4 4.2 5.6 1.4 0.0 0.0 253.5 253.0 22.54 21.95 17 1.326 5803K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.3 13.58 12.18 68 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.6 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.31 GB write, 668.29 MB/s write, 5.58 GB read, 361.92 MB/s read, 36.1 seconds Interval compaction: 10.31 GB write, 675.67 MB/s write, 5.58 GB read, 365.91 MB/s read, 36.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 19, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1364987 Average: 2.1166 StdDev: 11.83 Min: 0 Median: 1.4235 Max: 3811 Percentiles: P50: 1.42 P75: 1.81 P99: 5.42 P99.9: 9.99 P99.99: 21.97 ------------------------------------------------------ [ 0, 1 ] 307194 22.505% 22.505% ##### ( 1, 2 ] 886118 64.918% 87.423% ############# ( 2, 3 ] 99030 7.255% 94.678% # ( 3, 4 ] 42129 3.086% 97.764% # ( 4, 6 ] 23683 1.735% 99.499% ( 6, 10 ] 5480 0.401% 99.901% ( 10, 15 ] 1112 0.081% 99.982% ( 15, 22 ] 105 0.008% 99.990% ( 22, 34 ] 10 0.001% 99.991% ( 34, 51 ] 8 0.001% 99.991% ( 51, 76 ] 13 0.001% 99.992% ( 76, 110 ] 85 0.006% 99.999% ( 110, 170 ] 124 0.009% 100.008% ( 170, 250 ] 69 0.005% 100.013% ( 250, 380 ] 57 0.004% 100.017% ( 380, 580 ] 29 0.002% 100.019% ( 580, 870 ] 29 0.002% 100.021% ( 870, 1300 ] 19 0.001% 100.022% ( 1300, 1900 ] 10 0.001% 100.023% ( 1900, 2900 ] 10 0.001% 100.024% ( 2900, 4400 ] 4 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 311075 Average: 2.3666 StdDev: 15.57 Min: 1 Median: 1.4337 Max: 3063 Percentiles: P50: 1.43 P75: 1.81 P99: 5.95 P99.9: 94.77 P99.99: 650.55 ------------------------------------------------------ [ 0, 1 ] 67049 21.554% 21.554% #### ( 1, 2 ] 204036 65.591% 87.145% ############# ( 2, 3 ] 22952 7.378% 94.523% # ( 3, 4 ] 8949 2.877% 97.400% # ( 4, 6 ] 5103 1.640% 99.040% ( 6, 10 ] 2263 0.727% 99.768% ( 10, 15 ] 261 0.084% 99.851% ( 15, 22 ] 27 0.009% 99.860% ( 22, 34 ] 7 0.002% 99.862% ( 34, 51 ] 42 0.014% 99.876% ( 51, 76 ] 12 0.004% 99.880% ( 76, 110 ] 114 0.037% 99.916% ( 110, 170 ] 95 0.031% 99.947% ( 170, 250 ] 48 0.015% 99.962% ( 250, 380 ] 40 0.013% 99.975% ( 380, 580 ] 42 0.014% 99.989% ( 580, 870 ] 16 0.005% 99.994% ( 870, 1300 ] 9 0.003% 99.997% ( 1300, 1900 ] 7 0.002% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 15871 Average: 1.7639 StdDev: 3.95 Min: 0 Median: 1.1654 Max: 367 Percentiles: P50: 1.17 P75: 1.63 P99: 5.05 P99.9: 10.07 P99.99: 226.52 ------------------------------------------------------ [ 0, 1 ] 6537 41.188% 41.188% ######## ( 1, 2 ] 8455 53.273% 94.462% ########### ( 2, 3 ] 426 2.684% 97.146% # ( 3, 4 ] 205 1.292% 98.437% ( 4, 6 ] 170 1.071% 99.509% ( 6, 10 ] 62 0.391% 99.899% ( 10, 15 ] 9 0.057% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 874.9765 StdDev: 1256.43 Min: 1 Median: 242.0000 Max: 5134 Percentiles: P50: 242.00 P75: 1475.00 P99: 5134.00 P99.9: 5134.00 P99.99: 5134.00 ------------------------------------------------------ [ 0, 1 ] 15 17.647% 17.647% #### ( 1, 2 ] 23 27.059% 44.706% ##### ( 170, 250 ] 5 5.882% 50.588% # ( 250, 380 ] 3 3.529% 54.118% # ( 380, 580 ] 6 7.059% 61.176% # ( 580, 870 ] 7 8.235% 69.412% ## ( 870, 1300 ] 3 3.529% 72.941% # ( 1300, 1900 ] 6 7.059% 80.000% # ( 1900, 2900 ] 9 10.588% 90.588% ## ( 2900, 4400 ] 6 7.059% 97.647% # ( 4400, 6600 ] 2 2.353% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1731.5667 StdDev: 1523.21 Min: 172 Median: 1300.0000 Max: 5640 Percentiles: P50: 1300.00 P75: 2150.00 P99: 5640.00 P99.9: 5640.00 P99.99: 5640.00 ------------------------------------------------------ ( 170, 250 ] 3 10.000% 10.000% ## ( 250, 380 ] 4 13.333% 23.333% ### ( 580, 870 ] 4 13.333% 36.667% ### ( 870, 1300 ] 4 13.333% 50.000% ### ( 1300, 1900 ] 7 23.333% 73.333% ##### ( 1900, 2900 ] 2 6.667% 80.000% # ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 15.8 total, 3.8 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 311.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.576 H:M:S, 16.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 256.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.180 H:M:S, 30.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/15-00:46:51 ... thread 0: (1000000,6000000) ops and (76528.2,209168.5) ops/second in (13.067074,28.685002) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/4 2.02 GB 6.3 5.7 0.0 5.7 11.3 5.6 0.0 2.0 149.8 299.4 38.67 36.05 100 0.387 5883K 13K 0.0 0.0 L1 13/13 1.49 GB 0.0 5.7 3.5 2.2 5.6 3.4 0.1 1.6 225.1 222.7 25.96 24.29 4 6.490 5935K 64K 0.0 0.0 L2 17/5 2.06 GB 15.5 0.1 0.1 0.0 0.1 0.1 2.1 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 32 0.0 0.0 L3 17/10 818.42 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 202.8 202.9 0.31 0.26 1 0.308 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1212/32 101.72 GB 0.0 11.5 3.6 7.9 17.1 9.2 2.2 3.0 180.6 268.1 65.40 61.03 106 0.617 11M 77K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.5 3.6 7.9 17.1 9.2 2.2 3.0 180.6 268.1 65.40 61.03 106 0.617 11M 77K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.5 3.6 7.9 11.5 3.6 0.0 0.0 240.3 238.8 49.15 46.48 23 2.137 11M 77K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 356.7 16.25 14.55 83 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.9 total, 28.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.12 GB write, 607.46 MB/s write, 11.54 GB read, 409.33 MB/s read, 65.4 seconds Interval compaction: 17.12 GB write, 611.12 MB/s write, 11.54 GB read, 411.80 MB/s read, 65.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 19, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2433183 Average: 2.7262 StdDev: 16.80 Min: 0 Median: 1.4316 Max: 4397 Percentiles: P50: 1.43 P75: 1.82 P99: 7.09 P99.9: 156.79 P99.99: 364.26 ------------------------------------------------------ [ 0, 1 ] 533385 21.921% 21.921% #### ( 1, 2 ] 1583112 65.063% 86.985% ############# ( 2, 3 ] 172293 7.081% 94.066% # ( 3, 4 ] 74561 3.064% 97.130% # ( 4, 6 ] 40918 1.682% 98.812% ( 6, 10 ] 16807 0.691% 99.502% ( 10, 15 ] 1937 0.080% 99.582% ( 15, 22 ] 262 0.011% 99.593% ( 22, 34 ] 25 0.001% 99.594% ( 34, 51 ] 10 0.000% 99.594% ( 51, 76 ] 71 0.003% 99.597% ( 76, 110 ] 4238 0.174% 99.771% ( 110, 170 ] 4015 0.165% 99.936% ( 170, 250 ] 817 0.034% 99.970% ( 250, 380 ] 556 0.023% 99.993% ( 380, 580 ] 434 0.018% 100.011% ( 580, 870 ] 155 0.006% 100.017% ( 870, 1300 ] 45 0.002% 100.019% ( 1300, 1900 ] 16 0.001% 100.019% ( 1900, 2900 ] 19 0.001% 100.020% ( 2900, 4400 ] 9 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 590175 Average: 2.6840 StdDev: 17.92 Min: 1 Median: 1.4415 Max: 3063 Percentiles: P50: 1.44 P75: 1.82 P99: 7.78 P99.9: 159.15 P99.99: 851.38 ------------------------------------------------------ [ 0, 1 ] 124588 21.110% 21.110% #### ( 1, 2 ] 386223 65.442% 86.552% ############# ( 2, 3 ] 43988 7.453% 94.006% # ( 3, 4 ] 16706 2.831% 96.837% # ( 4, 6 ] 10022 1.698% 98.535% ( 6, 10 ] 6174 1.046% 99.581% ( 10, 15 ] 509 0.086% 99.667% ( 15, 22 ] 71 0.012% 99.679% ( 22, 34 ] 10 0.002% 99.681% ( 34, 51 ] 42 0.007% 99.688% ( 51, 76 ] 28 0.005% 99.693% ( 76, 110 ] 666 0.113% 99.805% ( 110, 170 ] 681 0.115% 99.921% ( 170, 250 ] 149 0.025% 99.946% ( 250, 380 ] 112 0.019% 99.965% ( 380, 580 ] 103 0.017% 99.983% ( 580, 870 ] 47 0.008% 99.991% ( 870, 1300 ] 36 0.006% 99.997% ( 1300, 1900 ] 16 0.003% 99.999% ( 1900, 2900 ] 2 0.000% 100.000% ( 2900, 4400 ] 2 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 15888 Average: 2.1402 StdDev: 13.82 Min: 0 Median: 1.1664 Max: 894 Percentiles: P50: 1.17 P75: 1.64 P99: 5.25 P99.9: 161.12 P99.99: 556.45 ------------------------------------------------------ [ 0, 1 ] 6537 41.144% 41.144% ######## ( 1, 2 ] 8455 53.216% 94.361% ########### ( 2, 3 ] 426 2.681% 97.042% # ( 3, 4 ] 205 1.290% 98.332% ( 4, 6 ] 170 1.070% 99.402% ( 6, 10 ] 62 0.390% 99.792% ( 10, 15 ] 9 0.057% 99.849% ( 15, 22 ] 3 0.019% 99.868% ( 110, 170 ] 6 0.038% 99.906% ( 170, 250 ] 2 0.013% 99.918% ( 250, 380 ] 7 0.044% 99.962% ( 380, 580 ] 5 0.031% 99.994% ( 870, 1300 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 23447 Average: 7.8540 StdDev: 101.45 Min: 1 Median: 1.5956 Max: 5134 Percentiles: P50: 1.60 P75: 1.99 P99: 12.97 P99.9: 1513.18 P99.99: 3813.82 ------------------------------------------------------ [ 0, 1 ] 2849 12.151% 12.151% ## ( 1, 2 ] 14901 63.552% 75.703% ############# ( 2, 3 ] 2653 11.315% 87.018% ## ( 3, 4 ] 1421 6.060% 93.078% # ( 4, 6 ] 940 4.009% 97.087% # ( 6, 10 ] 401 1.710% 98.797% ( 10, 15 ] 80 0.341% 99.138% ( 15, 22 ] 18 0.077% 99.215% ( 76, 110 ] 6 0.026% 99.241% ( 110, 170 ] 34 0.145% 99.386% ( 170, 250 ] 34 0.145% 99.531% ( 250, 380 ] 29 0.124% 99.655% ( 380, 580 ] 26 0.111% 99.765% ( 580, 870 ] 20 0.085% 99.851% ( 870, 1300 ] 8 0.034% 99.885% ( 1300, 1900 ] 10 0.043% 99.927% ( 1900, 2900 ] 11 0.047% 99.974% ( 2900, 4400 ] 6 0.026% 100.000% ( 4400, 6600 ] 2 0.009% 100.009% ** Level 4 read latency histogram (micros): Count: 30 Average: 1731.5667 StdDev: 1523.21 Min: 172 Median: 1300.0000 Max: 5640 Percentiles: P50: 1300.00 P75: 2150.00 P99: 5640.00 P99.9: 5640.00 P99.99: 5640.00 ------------------------------------------------------ ( 170, 250 ] 3 10.000% 10.000% ## ( 250, 380 ] 4 13.333% 23.333% ### ( 580, 870 ] 4 13.333% 36.667% ### ( 870, 1300 ] 4 13.333% 50.000% ### ( 1300, 1900 ] 7 23.333% 73.333% ##### ( 1900, 2900 ] 2 6.667% 80.000% # ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 28.9 total, 13.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 204.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.523 H:M:S, 43.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 75.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.947 H:M:S, 76.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-00:46:57 ... thread 0: (1000000,7000000) ops and (155857.8,199423.9) ops/second in (6.416104,35.101106) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.94 GB 37.8 5.9 0.0 5.9 12.5 6.6 0.0 1.9 140.2 296.3 43.11 39.44 114 0.378 6139K 13K 0.0 0.0 L1 13/13 1.49 GB 0.0 5.7 3.5 2.2 5.6 3.4 0.1 1.6 225.1 222.7 25.96 24.29 4 6.490 5935K 64K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.1 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 32 0.0 0.0 L3 20/0 835.27 MB 0.8 3.2 2.1 1.1 3.2 2.1 0.0 1.5 176.9 176.8 18.62 14.42 15 1.241 3329K 1073 0.0 0.0 L4 161/0 9.61 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.9 1.0 203.0 203.0 0.83 0.75 3 0.276 170K 0 0.0 0.0 L5 1068/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/25 102.64 GB 0.0 15.1 5.9 9.3 21.6 12.4 6.0 3.3 173.8 248.6 88.98 79.34 137 0.649 15M 78K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.1 5.9 9.3 21.6 12.4 6.0 3.3 173.8 248.6 88.98 79.34 137 0.649 15M 78K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.1 5.9 9.3 15.0 5.8 0.0 0.0 223.3 222.1 69.27 62.36 41 1.689 15M 78K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 341.9 19.71 16.98 96 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.3 total, 35.1 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.61 GB write, 627.22 MB/s write, 15.10 GB read, 438.39 MB/s read, 89.0 seconds Interval compaction: 21.61 GB write, 630.30 MB/s write, 15.10 GB read, 440.54 MB/s read, 89.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 25, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2906340 Average: 2.7507 StdDev: 18.06 Min: 0 Median: 1.4691 Max: 5127 Percentiles: P50: 1.47 P75: 1.86 P99: 7.31 P99.9: 151.14 P99.99: 363.09 ------------------------------------------------------ [ 0, 1 ] 571751 19.673% 19.673% #### ( 1, 2 ] 1878821 64.646% 84.318% ############# ( 2, 3 ] 246049 8.466% 92.784% ## ( 3, 4 ] 104563 3.598% 96.382% # ( 4, 6 ] 68375 2.353% 98.734% ( 6, 10 ] 23545 0.810% 99.545% ( 10, 15 ] 2869 0.099% 99.643% ( 15, 22 ] 335 0.012% 99.655% ( 22, 34 ] 32 0.001% 99.656% ( 34, 51 ] 14 0.000% 99.656% ( 51, 76 ] 73 0.003% 99.659% ( 76, 110 ] 4243 0.146% 99.805% ( 110, 170 ] 4032 0.139% 99.944% ( 170, 250 ] 836 0.029% 99.972% ( 250, 380 ] 589 0.020% 99.993% ( 380, 580 ] 472 0.016% 100.009% ( 580, 870 ] 213 0.007% 100.016% ( 870, 1300 ] 72 0.002% 100.019% ( 1300, 1900 ] 35 0.001% 100.020% ( 1900, 2900 ] 26 0.001% 100.021% ( 2900, 4400 ] 16 0.001% 100.021% ( 4400, 6600 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1135609 Average: 3.6645 StdDev: 40.58 Min: 1 Median: 1.6033 Max: 6746 Percentiles: P50: 1.60 P75: 2.05 P99: 8.90 P99.9: 145.85 P99.99: 347.14 ------------------------------------------------------ [ 0, 1 ] 146427 12.894% 12.894% ### ( 1, 2 ] 698451 61.505% 74.399% ############ ( 2, 3 ] 143181 12.608% 87.007% ### ( 3, 4 ] 66305 5.839% 92.846% # ( 4, 6 ] 55613 4.897% 97.743% # ( 6, 10 ] 19689 1.734% 99.477% ( 10, 15 ] 2920 0.257% 99.734% ( 15, 22 ] 387 0.034% 99.768% ( 22, 34 ] 43 0.004% 99.772% ( 34, 51 ] 46 0.004% 99.776% ( 51, 76 ] 36 0.003% 99.779% ( 76, 110 ] 812 0.072% 99.850% ( 110, 170 ] 943 0.083% 99.933% ( 170, 250 ] 360 0.032% 99.965% ( 250, 380 ] 378 0.033% 99.998% ( 380, 580 ] 390 0.034% 100.033% ( 580, 870 ] 249 0.022% 100.055% ( 870, 1300 ] 156 0.014% 100.068% ( 1300, 1900 ] 87 0.008% 100.076% ( 1900, 2900 ] 71 0.006% 100.082% ( 2900, 4400 ] 46 0.004% 100.086% ( 4400, 6600 ] 8 0.001% 100.087% ( 6600, 9900 ] 1 0.000% 100.087% ** Level 2 read latency histogram (micros): Count: 28285 Average: 3.6474 StdDev: 35.66 Min: 0 Median: 1.4909 Max: 3619 Percentiles: P50: 1.49 P75: 1.99 P99: 9.35 P99.9: 425.25 P99.99: 1402.90 ------------------------------------------------------ [ 0, 1 ] 7174 25.363% 25.363% ##### ( 1, 2 ] 14195 50.186% 75.549% ########## ( 2, 3 ] 2647 9.358% 84.907% ## ( 3, 4 ] 1571 5.554% 90.461% # ( 4, 6 ] 1956 6.915% 97.377% # ( 6, 10 ] 549 1.941% 99.318% ( 10, 15 ] 98 0.346% 99.664% ( 15, 22 ] 12 0.042% 99.707% ( 22, 34 ] 1 0.004% 99.710% ( 51, 76 ] 1 0.004% 99.714% ( 76, 110 ] 2 0.007% 99.721% ( 110, 170 ] 19 0.067% 99.788% ( 170, 250 ] 11 0.039% 99.827% ( 250, 380 ] 18 0.064% 99.890% ( 380, 580 ] 12 0.042% 99.933% ( 580, 870 ] 8 0.028% 99.961% ( 870, 1300 ] 8 0.028% 99.989% ( 1300, 1900 ] 1 0.004% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 327796 Average: 3.4806 StdDev: 32.89 Min: 0 Median: 1.6831 Max: 5134 Percentiles: P50: 1.68 P75: 2.38 P99: 8.67 P99.9: 161.07 P99.99: 352.24 ------------------------------------------------------ [ 0, 1 ] 28158 8.590% 8.590% ## ( 1, 2 ] 198725 60.625% 69.215% ############ ( 2, 3 ] 50495 15.404% 84.619% ### ( 3, 4 ] 24172 7.374% 91.993% # ( 4, 6 ] 19612 5.983% 97.976% # ( 6, 10 ] 5027 1.534% 99.510% ( 10, 15 ] 820 0.250% 99.760% ( 15, 22 ] 93 0.028% 99.788% ( 22, 34 ] 7 0.002% 99.790% ( 34, 51 ] 3 0.001% 99.791% ( 51, 76 ] 5 0.002% 99.793% ( 76, 110 ] 118 0.036% 99.829% ( 110, 170 ] 274 0.084% 99.912% ( 170, 250 ] 174 0.053% 99.966% ( 250, 380 ] 102 0.031% 99.997% ( 380, 580 ] 77 0.023% 100.020% ( 580, 870 ] 60 0.018% 100.038% ( 870, 1300 ] 22 0.007% 100.045% ( 1300, 1900 ] 17 0.005% 100.050% ( 1900, 2900 ] 16 0.005% 100.055% ( 2900, 4400 ] 6 0.002% 100.057% ( 4400, 6600 ] 2 0.001% 100.058% ** Level 4 read latency histogram (micros): Count: 60 Average: 924.4667 StdDev: 1366.12 Min: 1 Median: 250.0000 Max: 5640 Percentiles: P50: 250.00 P75: 1375.00 P99: 5640.00 P99.9: 5640.00 P99.99: 5640.00 ------------------------------------------------------ [ 0, 1 ] 8 13.333% 13.333% ### ( 1, 2 ] 7 11.667% 25.000% ## ( 2, 3 ] 6 10.000% 35.000% ## ( 3, 4 ] 2 3.333% 38.333% # ( 4, 6 ] 1 1.667% 40.000% ( 170, 250 ] 6 10.000% 50.000% ## ( 250, 380 ] 5 8.333% 58.333% ## ( 580, 870 ] 4 6.667% 65.000% # ( 870, 1300 ] 5 8.333% 73.333% ## ( 1300, 1900 ] 8 13.333% 86.667% ### ( 1900, 2900 ] 2 3.333% 90.000% # ( 2900, 4400 ] 4 6.667% 96.667% # ( 4400, 6600 ] 2 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 120 Average: 1048.0333 StdDev: 1150.80 Min: 77 Median: 513.3333 Max: 5167 Percentiles: P50: 513.33 P75: 1600.00 P99: 5167.00 P99.9: 5167.00 P99.99: 5167.00 ------------------------------------------------------ ( 76, 110 ] 8 6.667% 6.667% # ( 110, 170 ] 18 15.000% 21.667% ### ( 170, 250 ] 14 11.667% 33.333% ## ( 250, 380 ] 12 10.000% 43.333% ## ( 380, 580 ] 12 10.000% 53.333% ## ( 580, 870 ] 9 7.500% 60.833% ## ( 870, 1300 ] 10 8.333% 69.167% ## ( 1300, 1900 ] 14 11.667% 80.833% ## ( 1900, 2900 ] 11 9.167% 90.000% ## ( 2900, 4400 ] 10 8.333% 98.333% ## ( 4400, 6600 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 35.3 total, 6.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 195.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.067 H:M:S, 45.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 153.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.544 H:M:S, 55.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-00:47:00 ... thread 0: (1000000,8000000) ops and (302466.2,208294.0) ops/second in (3.306154,38.407260) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 3.92 GB 176.2 7.1 0.0 7.1 14.7 7.6 0.0 1.9 143.7 295.7 50.86 46.76 131 0.388 7418K 15K 0.0 0.0 L1 13/13 1.49 GB 0.0 5.7 3.5 2.2 5.6 3.4 0.1 1.6 225.1 222.7 25.96 24.29 4 6.490 5935K 64K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.1 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 32 0.0 0.0 L3 20/0 835.27 MB 0.8 3.2 2.1 1.1 3.2 2.1 0.0 1.5 176.9 176.8 18.62 14.42 15 1.241 3329K 1073 0.0 0.0 L4 161/0 9.61 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.9 1.0 203.0 203.0 0.83 0.75 3 0.276 170K 0 0.0 0.0 L5 1068/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1278/21 103.62 GB 0.0 16.3 5.9 10.5 23.8 13.3 6.0 3.1 172.9 252.2 96.73 86.65 154 0.628 16M 80K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.3 5.9 10.5 23.8 13.3 6.0 3.1 172.9 252.2 96.73 86.65 154 0.628 16M 80K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.3 5.9 10.5 16.3 5.8 0.0 0.0 225.7 224.6 74.10 67.09 45 1.647 16M 80K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 342.4 22.63 19.56 109 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.6 total, 38.4 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.82 GB write, 632.21 MB/s write, 16.33 GB read, 433.48 MB/s read, 96.7 seconds Interval compaction: 23.82 GB write, 635.05 MB/s write, 16.33 GB read, 435.42 MB/s read, 96.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 32, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3241297 Average: 2.7038 StdDev: 17.40 Min: 0 Median: 1.4730 Max: 5127 Percentiles: P50: 1.47 P75: 1.86 P99: 7.06 P99.9: 146.27 P99.99: 343.97 ------------------------------------------------------ [ 0, 1 ] 626160 19.318% 19.318% #### ( 1, 2 ] 2102319 64.860% 84.179% ############# ( 2, 3 ] 279329 8.618% 92.796% ## ( 3, 4 ] 117938 3.639% 96.435% # ( 4, 6 ] 76417 2.358% 98.793% ( 6, 10 ] 25481 0.786% 99.579% ( 10, 15 ] 3161 0.098% 99.676% ( 15, 22 ] 363 0.011% 99.688% ( 22, 34 ] 35 0.001% 99.689% ( 34, 51 ] 17 0.001% 99.689% ( 51, 76 ] 73 0.002% 99.691% ( 76, 110 ] 4302 0.133% 99.824% ( 110, 170 ] 4074 0.126% 99.950% ( 170, 250 ] 857 0.026% 99.976% ( 250, 380 ] 621 0.019% 99.995% ( 380, 580 ] 484 0.015% 100.010% ( 580, 870 ] 225 0.007% 100.017% ( 870, 1300 ] 78 0.002% 100.020% ( 1300, 1900 ] 39 0.001% 100.021% ( 1900, 2900 ] 27 0.001% 100.022% ( 2900, 4400 ] 16 0.000% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1256457 Average: 3.5699 StdDev: 38.80 Min: 1 Median: 1.5981 Max: 6746 Percentiles: P50: 1.60 P75: 2.00 P99: 8.86 P99.9: 146.24 P99.99: 352.68 ------------------------------------------------------ [ 0, 1 ] 160669 12.787% 12.787% ### ( 1, 2 ] 781679 62.213% 75.000% ############ ( 2, 3 ] 156492 12.455% 87.455% ## ( 3, 4 ] 70793 5.634% 93.090% # ( 4, 6 ] 58757 4.676% 97.766% # ( 6, 10 ] 21705 1.727% 99.494% ( 10, 15 ] 3065 0.244% 99.738% ( 15, 22 ] 401 0.032% 99.770% ( 22, 34 ] 45 0.004% 99.773% ( 34, 51 ] 46 0.004% 99.777% ( 51, 76 ] 45 0.004% 99.780% ( 76, 110 ] 867 0.069% 99.849% ( 110, 170 ] 1054 0.084% 99.933% ( 170, 250 ] 399 0.032% 99.965% ( 250, 380 ] 398 0.032% 99.997% ( 380, 580 ] 407 0.032% 100.029% ( 580, 870 ] 254 0.020% 100.049% ( 870, 1300 ] 156 0.012% 100.062% ( 1300, 1900 ] 88 0.007% 100.069% ( 1900, 2900 ] 72 0.006% 100.074% ( 2900, 4400 ] 46 0.004% 100.078% ( 4400, 6600 ] 8 0.001% 100.079% ( 6600, 9900 ] 1 0.000% 100.079% ** Level 2 read latency histogram (micros): Count: 28285 Average: 3.6474 StdDev: 35.66 Min: 0 Median: 1.4909 Max: 3619 Percentiles: P50: 1.49 P75: 1.99 P99: 9.35 P99.9: 425.25 P99.99: 1402.90 ------------------------------------------------------ [ 0, 1 ] 7174 25.363% 25.363% ##### ( 1, 2 ] 14195 50.186% 75.549% ########## ( 2, 3 ] 2647 9.358% 84.907% ## ( 3, 4 ] 1571 5.554% 90.461% # ( 4, 6 ] 1956 6.915% 97.377% # ( 6, 10 ] 549 1.941% 99.318% ( 10, 15 ] 98 0.346% 99.664% ( 15, 22 ] 12 0.042% 99.707% ( 22, 34 ] 1 0.004% 99.710% ( 51, 76 ] 1 0.004% 99.714% ( 76, 110 ] 2 0.007% 99.721% ( 110, 170 ] 19 0.067% 99.788% ( 170, 250 ] 11 0.039% 99.827% ( 250, 380 ] 18 0.064% 99.890% ( 380, 580 ] 12 0.042% 99.933% ( 580, 870 ] 8 0.028% 99.961% ( 870, 1300 ] 8 0.028% 99.989% ( 1300, 1900 ] 1 0.004% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 327796 Average: 3.4806 StdDev: 32.89 Min: 0 Median: 1.6831 Max: 5134 Percentiles: P50: 1.68 P75: 2.38 P99: 8.67 P99.9: 161.07 P99.99: 352.24 ------------------------------------------------------ [ 0, 1 ] 28158 8.590% 8.590% ## ( 1, 2 ] 198725 60.625% 69.215% ############ ( 2, 3 ] 50495 15.404% 84.619% ### ( 3, 4 ] 24172 7.374% 91.993% # ( 4, 6 ] 19612 5.983% 97.976% # ( 6, 10 ] 5027 1.534% 99.510% ( 10, 15 ] 820 0.250% 99.760% ( 15, 22 ] 93 0.028% 99.788% ( 22, 34 ] 7 0.002% 99.790% ( 34, 51 ] 3 0.001% 99.791% ( 51, 76 ] 5 0.002% 99.793% ( 76, 110 ] 118 0.036% 99.829% ( 110, 170 ] 274 0.084% 99.912% ( 170, 250 ] 174 0.053% 99.966% ( 250, 380 ] 102 0.031% 99.997% ( 380, 580 ] 77 0.023% 100.020% ( 580, 870 ] 60 0.018% 100.038% ( 870, 1300 ] 22 0.007% 100.045% ( 1300, 1900 ] 17 0.005% 100.050% ( 1900, 2900 ] 16 0.005% 100.055% ( 2900, 4400 ] 6 0.002% 100.057% ( 4400, 6600 ] 2 0.001% 100.058% ** Level 4 read latency histogram (micros): Count: 60 Average: 924.4667 StdDev: 1366.12 Min: 1 Median: 250.0000 Max: 5640 Percentiles: P50: 250.00 P75: 1375.00 P99: 5640.00 P99.9: 5640.00 P99.99: 5640.00 ------------------------------------------------------ [ 0, 1 ] 8 13.333% 13.333% ### ( 1, 2 ] 7 11.667% 25.000% ## ( 2, 3 ] 6 10.000% 35.000% ## ( 3, 4 ] 2 3.333% 38.333% # ( 4, 6 ] 1 1.667% 40.000% ( 170, 250 ] 6 10.000% 50.000% ## ( 250, 380 ] 5 8.333% 58.333% ## ( 580, 870 ] 4 6.667% 65.000% # ( 870, 1300 ] 5 8.333% 73.333% ## ( 1300, 1900 ] 8 13.333% 86.667% ### ( 1900, 2900 ] 2 3.333% 90.000% # ( 2900, 4400 ] 4 6.667% 96.667% # ( 4400, 6600 ] 2 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 120 Average: 1048.0333 StdDev: 1150.80 Min: 77 Median: 513.3333 Max: 5167 Percentiles: P50: 513.33 P75: 1600.00 P99: 5167.00 P99.9: 5167.00 P99.99: 5167.00 ------------------------------------------------------ ( 76, 110 ] 8 6.667% 6.667% # ( 110, 170 ] 18 15.000% 21.667% ### ( 170, 250 ] 14 11.667% 33.333% ## ( 250, 380 ] 12 10.000% 43.333% ## ( 380, 580 ] 12 10.000% 53.333% ## ( 580, 870 ] 9 7.500% 60.833% ## ( 870, 1300 ] 10 8.333% 69.167% ## ( 1300, 1900 ] 14 11.667% 80.833% ## ( 1900, 2900 ] 11 9.167% 90.000% ## ( 2900, 4400 ] 10 8.333% 98.333% ## ( 4400, 6600 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 38.6 total, 3.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 204.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.675 H:M:S, 43.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 297.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.608 H:M:S, 18.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-00:47:09 ... thread 0: (1000000,9000000) ops and (111192.2,189870.6) ops/second in (8.993434,47.400694) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 2.94 GB 25.2 9.4 0.0 9.4 17.9 8.5 0.0 2.1 151.6 289.1 63.55 58.14 150 0.424 9784K 21K 0.0 0.0 L1 11/11 1.28 GB 0.0 9.2 5.5 3.7 9.1 5.4 0.1 1.7 221.7 219.2 42.30 39.33 5 8.460 8494K 64K 0.0 0.0 L2 1/0 71.53 MB 0.7 0.1 0.1 0.0 0.1 0.1 4.2 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 32 0.0 0.0 L3 20/0 958.64 MB 1.0 3.5 2.3 1.3 3.5 2.3 1.9 1.6 174.2 173.9 20.69 15.82 17 1.217 3644K 4606 0.0 0.0 L4 161/4 9.87 GB 1.0 2.3 1.6 0.8 2.3 1.6 2.4 1.5 143.2 142.6 16.57 10.98 17 0.974 2409K 9955 0.0 0.0 L5 1088/0 89.45 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/22 104.55 GB 0.0 24.5 9.3 15.2 32.9 17.8 12.3 3.9 174.8 234.8 143.57 124.70 190 0.756 24M 100K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.5 9.3 15.2 32.9 17.8 12.3 3.9 174.8 234.8 143.57 124.70 190 0.756 24M 100K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.5 9.3 15.2 24.4 9.2 0.0 0.0 213.3 212.1 117.66 102.54 67 1.756 24M 100K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 338.0 25.90 22.16 123 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.6 total, 47.4 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.92 GB write, 708.64 MB/s write, 24.51 GB read, 527.57 MB/s read, 143.6 seconds Interval compaction: 32.92 GB write, 711.22 MB/s write, 24.51 GB read, 529.49 MB/s read, 143.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 29, pending-compaction-bytes-stops: 0, total-delays: 41, total-stops: 41, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3929306 Average: 2.8896 StdDev: 23.19 Min: 0 Median: 1.4817 Max: 6100 Percentiles: P50: 1.48 P75: 1.87 P99: 7.51 P99.9: 156.73 P99.99: 441.54 ------------------------------------------------------ [ 0, 1 ] 739310 18.815% 18.815% #### ( 1, 2 ] 2543772 64.738% 83.554% ############# ( 2, 3 ] 347573 8.846% 92.399% ## ( 3, 4 ] 147524 3.754% 96.154% # ( 4, 6 ] 99155 2.523% 98.677% # ( 6, 10 ] 33510 0.853% 99.530% ( 10, 15 ] 3986 0.101% 99.632% ( 15, 22 ] 442 0.011% 99.643% ( 22, 34 ] 46 0.001% 99.644% ( 34, 51 ] 20 0.001% 99.645% ( 51, 76 ] 86 0.002% 99.647% ( 76, 110 ] 5636 0.143% 99.790% ( 110, 170 ] 5542 0.141% 99.931% ( 170, 250 ] 1207 0.031% 99.962% ( 250, 380 ] 877 0.022% 99.984% ( 380, 580 ] 738 0.019% 100.003% ( 580, 870 ] 366 0.009% 100.012% ( 870, 1300 ] 161 0.004% 100.016% ( 1300, 1900 ] 78 0.002% 100.018% ( 1900, 2900 ] 71 0.002% 100.020% ( 2900, 4400 ] 48 0.001% 100.021% ( 4400, 6600 ] 6 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1797022 Average: 3.9987 StdDev: 46.87 Min: 1 Median: 1.6432 Max: 7309 Percentiles: P50: 1.64 P75: 2.25 P99: 9.07 P99.9: 157.26 P99.99: 453.10 ------------------------------------------------------ [ 0, 1 ] 197939 11.015% 11.015% ## ( 1, 2 ] 1089229 60.613% 71.628% ############ ( 2, 3 ] 246921 13.741% 85.368% ### ( 3, 4 ] 114646 6.380% 91.748% # ( 4, 6 ] 103959 5.785% 97.533% # ( 6, 10 ] 34294 1.908% 99.442% ( 10, 15 ] 5181 0.288% 99.730% ( 15, 22 ] 607 0.034% 99.764% ( 22, 34 ] 59 0.003% 99.767% ( 34, 51 ] 49 0.003% 99.770% ( 51, 76 ] 72 0.004% 99.774% ( 76, 110 ] 1134 0.063% 99.837% ( 110, 170 ] 1441 0.080% 99.917% ( 170, 250 ] 523 0.029% 99.946% ( 250, 380 ] 550 0.031% 99.977% ( 380, 580 ] 652 0.036% 100.013% ( 580, 870 ] 489 0.027% 100.040% ( 870, 1300 ] 358 0.020% 100.060% ( 1300, 1900 ] 205 0.011% 100.072% ( 1900, 2900 ] 144 0.008% 100.080% ( 2900, 4400 ] 95 0.005% 100.085% ( 4400, 6600 ] 18 0.001% 100.086% ( 6600, 9900 ] 2 0.000% 100.086% ** Level 2 read latency histogram (micros): Count: 28285 Average: 3.6474 StdDev: 35.66 Min: 0 Median: 1.4909 Max: 3619 Percentiles: P50: 1.49 P75: 1.99 P99: 9.35 P99.9: 425.25 P99.99: 1402.90 ------------------------------------------------------ [ 0, 1 ] 7174 25.363% 25.363% ##### ( 1, 2 ] 14195 50.186% 75.549% ########## ( 2, 3 ] 2647 9.358% 84.907% ## ( 3, 4 ] 1571 5.554% 90.461% # ( 4, 6 ] 1956 6.915% 97.377% # ( 6, 10 ] 549 1.941% 99.318% ( 10, 15 ] 98 0.346% 99.664% ( 15, 22 ] 12 0.042% 99.707% ( 22, 34 ] 1 0.004% 99.710% ( 51, 76 ] 1 0.004% 99.714% ( 76, 110 ] 2 0.007% 99.721% ( 110, 170 ] 19 0.067% 99.788% ( 170, 250 ] 11 0.039% 99.827% ( 250, 380 ] 18 0.064% 99.890% ( 380, 580 ] 12 0.042% 99.933% ( 580, 870 ] 8 0.028% 99.961% ( 870, 1300 ] 8 0.028% 99.989% ( 1300, 1900 ] 1 0.004% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 581345 Average: 7.4151 StdDev: 93.47 Min: 0 Median: 1.7811 Max: 7251 Percentiles: P50: 1.78 P75: 2.73 P99: 9.78 P99.9: 842.87 P99.99: 1400.53 ------------------------------------------------------ [ 0, 1 ] 35875 6.171% 6.171% # ( 1, 2 ] 326189 56.109% 62.280% ########### ( 2, 3 ] 101479 17.456% 79.736% ### ( 3, 4 ] 52047 8.953% 88.689% ## ( 4, 6 ] 49013 8.431% 97.120% ## ( 6, 10 ] 11570 1.990% 99.110% ( 10, 15 ] 2244 0.386% 99.496% ( 15, 22 ] 237 0.041% 99.537% ( 22, 34 ] 21 0.004% 99.541% ( 34, 51 ] 7 0.001% 99.542% ( 51, 76 ] 15 0.003% 99.545% ( 76, 110 ] 129 0.022% 99.567% ( 110, 170 ] 327 0.056% 99.623% ( 170, 250 ] 279 0.048% 99.671% ( 250, 380 ] 350 0.060% 99.731% ( 380, 580 ] 455 0.078% 99.809% ( 580, 870 ] 581 0.100% 99.909% ( 870, 1300 ] 431 0.074% 99.983% ( 1300, 1900 ] 226 0.039% 100.022% ( 1900, 2900 ] 172 0.030% 100.052% ( 2900, 4400 ] 144 0.025% 100.077% ( 4400, 6600 ] 26 0.004% 100.081% ( 6600, 9900 ] 3 0.001% 100.082% ** Level 4 read latency histogram (micros): Count: 64134 Average: 5.9458 StdDev: 75.10 Min: 1 Median: 1.8990 Max: 5640 Percentiles: P50: 1.90 P75: 2.94 P99: 9.16 P99.9: 778.91 P99.99: 1419.65 ------------------------------------------------------ [ 0, 1 ] 1664 2.595% 2.595% # ( 1, 2 ] 33818 52.730% 55.325% ########### ( 2, 3 ] 13484 21.025% 76.350% #### ( 3, 4 ] 6705 10.455% 86.804% ## ( 4, 6 ] 6935 10.813% 97.617% ## ( 6, 10 ] 1124 1.753% 99.370% ( 10, 15 ] 201 0.313% 99.683% ( 15, 22 ] 19 0.030% 99.713% ( 22, 34 ] 1 0.002% 99.715% ( 34, 51 ] 3 0.005% 99.719% ( 51, 76 ] 1 0.002% 99.721% ( 76, 110 ] 1 0.002% 99.722% ( 110, 170 ] 7 0.011% 99.733% ( 170, 250 ] 39 0.061% 99.794% ( 250, 380 ] 16 0.025% 99.819% ( 380, 580 ] 21 0.033% 99.852% ( 580, 870 ] 45 0.070% 99.922% ( 870, 1300 ] 39 0.061% 99.983% ( 1300, 1900 ] 23 0.036% 100.019% ( 1900, 2900 ] 9 0.014% 100.033% ( 2900, 4400 ] 9 0.014% 100.047% ( 4400, 6600 ] 2 0.003% 100.050% ** Level 5 read latency histogram (micros): Count: 240 Average: 1273.3958 StdDev: 1393.67 Min: 77 Median: 676.6667 Max: 6393 Percentiles: P50: 676.67 P75: 1852.00 P99: 6120.00 P99.9: 6393.00 P99.99: 6393.00 ------------------------------------------------------ ( 76, 110 ] 14 5.833% 5.833% # ( 110, 170 ] 26 10.833% 16.667% ## ( 170, 250 ] 25 10.417% 27.083% ## ( 250, 380 ] 22 9.167% 36.250% ## ( 380, 580 ] 25 10.417% 46.667% ## ( 580, 870 ] 24 10.000% 56.667% ## ( 870, 1300 ] 21 8.750% 65.417% ## ( 1300, 1900 ] 25 10.417% 75.833% ## ( 1900, 2900 ] 22 9.167% 85.000% ## ( 2900, 4400 ] 25 10.417% 95.417% ## ( 4400, 6600 ] 11 4.583% 100.000% # ** DB Stats ** Uptime(secs): 47.6 total, 9.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 186.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.731 H:M:S, 47.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 109.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.056 H:M:S, 67.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-00:47:19 ... thread 0: (1000000,10000000) ops and (98814.8,173850.6) ops/second in (10.119946,57.520640) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 3.98 GB 131.5 11.7 0.0 11.7 21.3 9.6 0.0 2.2 159.1 288.7 75.59 69.73 170 0.445 12M 29K 0.0 0.0 L1 11/11 1.28 GB 0.0 9.2 5.5 3.7 9.1 5.4 0.1 1.7 221.7 219.2 42.30 39.33 5 8.460 8494K 64K 0.0 0.0 L2 1/0 71.53 MB 0.7 0.1 0.1 0.0 0.1 0.1 4.2 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 32 0.0 0.0 L3 20/0 958.64 MB 1.0 3.5 2.3 1.3 3.5 2.3 1.9 1.6 174.2 173.9 20.69 15.82 17 1.217 3644K 4606 0.0 0.0 L4 157/0 9.56 GB 1.0 2.3 1.6 0.8 2.3 1.6 2.4 1.5 143.2 142.6 16.57 10.98 17 0.974 2409K 9955 0.0 0.0 L5 1092/0 89.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/18 105.59 GB 0.0 26.8 9.3 17.5 36.3 18.8 12.6 3.8 176.7 238.9 155.61 136.29 210 0.741 26M 108K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.8 9.3 17.5 36.3 18.8 12.6 3.8 176.7 238.9 155.61 136.29 210 0.741 26M 108K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.8 9.3 17.5 26.7 9.2 0.0 0.0 217.0 215.9 126.66 111.41 72 1.759 26M 108K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.6 9.6 0.0 0.0 0.0 339.5 28.95 24.88 138 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.7 total, 57.5 interval Flush(GB): cumulative 9.597, interval 9.597 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.30 GB write, 644.23 MB/s write, 26.85 GB read, 476.49 MB/s read, 155.6 seconds Interval compaction: 36.30 GB write, 646.16 MB/s write, 26.85 GB read, 477.92 MB/s read, 155.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 48, total-stops: 44, interval: 92 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5071647 Average: 2.7227 StdDev: 20.75 Min: 0 Median: 1.4791 Max: 6100 Percentiles: P50: 1.48 P75: 1.86 P99: 7.05 P99.9: 142.06 P99.99: 349.00 ------------------------------------------------------ [ 0, 1 ] 945186 18.637% 18.637% #### ( 1, 2 ] 3320033 65.463% 84.099% ############# ( 2, 3 ] 439928 8.674% 92.774% ## ( 3, 4 ] 184882 3.645% 96.419% # ( 4, 6 ] 119642 2.359% 98.778% ( 6, 10 ] 42766 0.843% 99.621% ( 10, 15 ] 4653 0.092% 99.713% ( 15, 22 ] 518 0.010% 99.723% ( 22, 34 ] 53 0.001% 99.724% ( 34, 51 ] 27 0.001% 99.725% ( 51, 76 ] 93 0.002% 99.727% ( 76, 110 ] 5760 0.114% 99.840% ( 110, 170 ] 5680 0.112% 99.952% ( 170, 250 ] 1239 0.024% 99.977% ( 250, 380 ] 894 0.018% 99.994% ( 380, 580 ] 756 0.015% 100.009% ( 580, 870 ] 380 0.007% 100.017% ( 870, 1300 ] 166 0.003% 100.020% ( 1300, 1900 ] 81 0.002% 100.021% ( 1900, 2900 ] 73 0.001% 100.023% ( 2900, 4400 ] 50 0.001% 100.024% ( 4400, 6600 ] 6 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1865584 Average: 3.9298 StdDev: 46.02 Min: 1 Median: 1.6285 Max: 7309 Percentiles: P50: 1.63 P75: 2.19 P99: 9.05 P99.9: 155.96 P99.99: 452.09 ------------------------------------------------------ [ 0, 1 ] 223518 11.981% 11.981% ## ( 1, 2 ] 1128478 60.489% 72.470% ############ ( 2, 3 ] 248206 13.304% 85.775% ### ( 3, 4 ] 115458 6.189% 91.964% # ( 4, 6 ] 104537 5.603% 97.567% # ( 6, 10 ] 35067 1.880% 99.447% ( 10, 15 ] 5249 0.281% 99.728% ( 15, 22 ] 632 0.034% 99.762% ( 22, 34 ] 60 0.003% 99.765% ( 34, 51 ] 50 0.003% 99.768% ( 51, 76 ] 87 0.005% 99.773% ( 76, 110 ] 1198 0.064% 99.837% ( 110, 170 ] 1541 0.083% 99.919% ( 170, 250 ] 528 0.028% 99.948% ( 250, 380 ] 554 0.030% 99.977% ( 380, 580 ] 656 0.035% 100.013% ( 580, 870 ] 490 0.026% 100.039% ( 870, 1300 ] 358 0.019% 100.058% ( 1300, 1900 ] 205 0.011% 100.069% ( 1900, 2900 ] 144 0.008% 100.077% ( 2900, 4400 ] 95 0.005% 100.082% ( 4400, 6600 ] 18 0.001% 100.083% ( 6600, 9900 ] 2 0.000% 100.083% ** Level 2 read latency histogram (micros): Count: 28285 Average: 3.6474 StdDev: 35.66 Min: 0 Median: 1.4909 Max: 3619 Percentiles: P50: 1.49 P75: 1.99 P99: 9.35 P99.9: 425.25 P99.99: 1402.90 ------------------------------------------------------ [ 0, 1 ] 7174 25.363% 25.363% ##### ( 1, 2 ] 14195 50.186% 75.549% ########## ( 2, 3 ] 2647 9.358% 84.907% ## ( 3, 4 ] 1571 5.554% 90.461% # ( 4, 6 ] 1956 6.915% 97.377% # ( 6, 10 ] 549 1.941% 99.318% ( 10, 15 ] 98 0.346% 99.664% ( 15, 22 ] 12 0.042% 99.707% ( 22, 34 ] 1 0.004% 99.710% ( 51, 76 ] 1 0.004% 99.714% ( 76, 110 ] 2 0.007% 99.721% ( 110, 170 ] 19 0.067% 99.788% ( 170, 250 ] 11 0.039% 99.827% ( 250, 380 ] 18 0.064% 99.890% ( 380, 580 ] 12 0.042% 99.933% ( 580, 870 ] 8 0.028% 99.961% ( 870, 1300 ] 8 0.028% 99.989% ( 1300, 1900 ] 1 0.004% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 581345 Average: 7.4151 StdDev: 93.47 Min: 0 Median: 1.7811 Max: 7251 Percentiles: P50: 1.78 P75: 2.73 P99: 9.78 P99.9: 842.87 P99.99: 1400.53 ------------------------------------------------------ [ 0, 1 ] 35875 6.171% 6.171% # ( 1, 2 ] 326189 56.109% 62.280% ########### ( 2, 3 ] 101479 17.456% 79.736% ### ( 3, 4 ] 52047 8.953% 88.689% ## ( 4, 6 ] 49013 8.431% 97.120% ## ( 6, 10 ] 11570 1.990% 99.110% ( 10, 15 ] 2244 0.386% 99.496% ( 15, 22 ] 237 0.041% 99.537% ( 22, 34 ] 21 0.004% 99.541% ( 34, 51 ] 7 0.001% 99.542% ( 51, 76 ] 15 0.003% 99.545% ( 76, 110 ] 129 0.022% 99.567% ( 110, 170 ] 327 0.056% 99.623% ( 170, 250 ] 279 0.048% 99.671% ( 250, 380 ] 350 0.060% 99.731% ( 380, 580 ] 455 0.078% 99.809% ( 580, 870 ] 581 0.100% 99.909% ( 870, 1300 ] 431 0.074% 99.983% ( 1300, 1900 ] 226 0.039% 100.022% ( 1900, 2900 ] 172 0.030% 100.052% ( 2900, 4400 ] 144 0.025% 100.077% ( 4400, 6600 ] 26 0.004% 100.081% ( 6600, 9900 ] 3 0.001% 100.082% ** Level 4 read latency histogram (micros): Count: 64134 Average: 5.9458 StdDev: 75.10 Min: 1 Median: 1.8990 Max: 5640 Percentiles: P50: 1.90 P75: 2.94 P99: 9.16 P99.9: 778.91 P99.99: 1419.65 ------------------------------------------------------ [ 0, 1 ] 1664 2.595% 2.595% # ( 1, 2 ] 33818 52.730% 55.325% ########### ( 2, 3 ] 13484 21.025% 76.350% #### ( 3, 4 ] 6705 10.455% 86.804% ## ( 4, 6 ] 6935 10.813% 97.617% ## ( 6, 10 ] 1124 1.753% 99.370% ( 10, 15 ] 201 0.313% 99.683% ( 15, 22 ] 19 0.030% 99.713% ( 22, 34 ] 1 0.002% 99.715% ( 34, 51 ] 3 0.005% 99.719% ( 51, 76 ] 1 0.002% 99.721% ( 76, 110 ] 1 0.002% 99.722% ( 110, 170 ] 7 0.011% 99.733% ( 170, 250 ] 39 0.061% 99.794% ( 250, 380 ] 16 0.025% 99.819% ( 380, 580 ] 21 0.033% 99.852% ( 580, 870 ] 45 0.070% 99.922% ( 870, 1300 ] 39 0.061% 99.983% ( 1300, 1900 ] 23 0.036% 100.019% ( 1900, 2900 ] 9 0.014% 100.033% ( 2900, 4400 ] 9 0.014% 100.047% ( 4400, 6600 ] 2 0.003% 100.050% ** Level 5 read latency histogram (micros): Count: 240 Average: 1273.3958 StdDev: 1393.67 Min: 77 Median: 676.6667 Max: 6393 Percentiles: P50: 676.67 P75: 1852.00 P99: 6120.00 P99.9: 6393.00 P99.99: 6393.00 ------------------------------------------------------ ( 76, 110 ] 14 5.833% 5.833% # ( 110, 170 ] 26 10.833% 16.667% ## ( 170, 250 ] 25 10.417% 27.083% ## ( 250, 380 ] 22 9.167% 36.250% ## ( 380, 580 ] 25 10.417% 46.667% ## ( 580, 870 ] 24 10.000% 56.667% ## ( 870, 1300 ] 21 8.750% 65.417% ## ( 1300, 1900 ] 25 10.417% 75.833% ## ( 1900, 2900 ] 22 9.167% 85.000% ## ( 2900, 4400 ] 25 10.417% 95.417% ## ( 4400, 6600 ] 11 4.583% 100.000% # ** DB Stats ** Uptime(secs): 57.7 total, 10.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 170.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.886 H:M:S, 51.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 97.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.155 H:M:S, 70.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.003 micros/op 166581 ops/sec 60.133 seconds 10016999 operations; 161.4 MB/s Microseconds per write: Count: 10016999 Average: 6.0030 StdDev: 347.86 Min: 0 Median: 1.7349 Max: 633620 Percentiles: P50: 1.73 P75: 2.75 P99: 10.00 P99.9: 1159.62 P99.99: 2666.54 ------------------------------------------------------ [ 0, 1 ] 1368799 13.665% 13.665% ### ( 1, 2 ] 4952391 49.440% 63.105% ########## ( 2, 3 ] 1581481 15.788% 78.893% ### ( 3, 4 ] 1341870 13.396% 92.289% ### ( 4, 6 ] 526335 5.254% 97.543% # ( 6, 10 ] 145993 1.457% 99.000% ( 10, 15 ] 53744 0.537% 99.537% ( 15, 22 ] 11717 0.117% 99.654% ( 22, 34 ] 1909 0.019% 99.673% ( 34, 51 ] 245 0.002% 99.675% ( 51, 76 ] 31 0.000% 99.676% ( 76, 110 ] 6981 0.070% 99.745% ( 110, 170 ] 2650 0.026% 99.772% ( 170, 250 ] 292 0.003% 99.775% ( 250, 380 ] 226 0.002% 99.777% ( 380, 580 ] 26 0.000% 99.777% ( 580, 870 ] 18 0.000% 99.777% ( 870, 1300 ] 18223 0.182% 99.959% ( 1300, 1900 ] 109 0.001% 99.960% ( 1900, 2900 ] 3858 0.039% 99.999% ( 2900, 4400 ] 57 0.001% 100.000% ( 4400, 6600 ] 16 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 195536 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10016999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10337542968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 499 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32336989 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32106062430 rocksdb.compact.write.bytes COUNT : 31918747253 rocksdb.flush.write.bytes COUNT : 10304879678 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 58 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 265 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10221884416 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4061184 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32200613516 rocksdb.non.last.level.read.count COUNT : 7780669 rocksdb.block.checksum.compute.count COUNT : 7779729 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.379979 P95 : 3.961889 P99 : 8.772456 P100 : 633619.000000 COUNT : 10016999 SUM : 55392911 rocksdb.compaction.times.micros P50 : 1065789.473684 P95 : 5620000.000000 P99 : 16704354.000000 P100 : 16704354.000000 COUNT : 72 SUM : 126662723 rocksdb.compaction.times.cpu_micros P50 : 950000.000000 P95 : 5620000.000000 P99 : 15308737.000000 P100 : 15308737.000000 COUNT : 72 SUM : 111410504 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 686.097561 P95 : 1264.818182 P99 : 65500.000000 P100 : 104927.000000 COUNT : 138 SUM : 284703 rocksdb.compaction.outfile.sync.micros P50 : 880.238095 P95 : 74895.833333 P99 : 151850.000000 P100 : 214350.000000 COUNT : 321 SUM : 4131917 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 95.397436 P95 : 496.666667 P99 : 1690.000000 P100 : 1791.000000 COUNT : 245 SUM : 43517 rocksdb.table.open.io.micros P50 : 1576.562500 P95 : 8041.956522 P99 : 13093.444444 P100 : 17763.000000 COUNT : 499 SUM : 1116333 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.572369 P95 : 7.121411 P99 : 10.824560 P100 : 18943.000000 COUNT : 7778280 SUM : 42081995 rocksdb.read.block.get.micros P50 : 516.363636 P95 : 3423.469388 P99 : 5380.222222 P100 : 6417.000000 COUNT : 998 SUM : 907125 rocksdb.write.raw.block.micros P50 : 0.510969 P95 : 0.970841 P99 : 2.807202 P100 : 8605.000000 COUNT : 10225886 SUM : 18761788 rocksdb.numfiles.in.singlecompaction P50 : 3.396341 P95 : 5.912500 P99 : 21.055000 P100 : 23.000000 COUNT : 127 SUM : 517 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560261 P95 : 1149.736963 P99 : 2383.381818 P100 : 633411.000000 COUNT : 207998 SUM : 32360926 rocksdb.sst.read.micros P50 : 1.531909 P95 : 4.202082 P99 : 8.335892 P100 : 7309.000000 COUNT : 7780833 SUM : 26600506 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10016999 SUM : 10337542968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 209569.892473 P95 : 359055.555556 P99 : 545933.333333 P100 : 783857.000000 COUNT : 138 SUM : 28946966 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 320 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0