[2024-12-16 08:36:00.726924] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 22.11.4 initialization... [2024-12-16 08:36:00.727193] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid181836 ] Set seed to 1734334560720255 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-16 08:36:00.843272] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-16 08:36:00.864904] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-16 08:36:00.864945] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 181836' to capture a snapshot of events at runtime. [2024-12-16 08:36:00.864955] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-16 08:36:00.864965] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-16 08:36:00.864973] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid181836 for offline analysis/debug. [2024-12-16 08:36:00.865522] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 16 08:36:05 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/16-08:36:08 ... thread 0: (1000000,1000000) ops and (323007.7,323007.7) ops/second in (3.095901,3.095901) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 503.97 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 333.4 2.64 2.38 12 0.220 0 0 0.0 0.0 L1 2/0 187.12 MB 18.7 0.2 0.2 0.0 0.2 0.2 0.2 1.0 242.8 242.6 0.78 0.75 1 0.778 191K 126 0.0 0.0 L2 3/2 190.61 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 248.5 248.4 0.77 0.75 2 0.387 195K 87 0.0 0.0 L3 10/0 866.96 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/6 97.00 GB 0.0 0.4 0.3 0.1 1.2 1.2 0.5 1.4 90.9 300.9 4.20 3.87 15 0.280 387K 213 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.2 0.5 1.4 90.9 300.9 4.20 3.87 15 0.280 387K 213 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 245.6 245.5 1.55 1.49 3 0.518 387K 213 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 333.4 2.64 2.38 12 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 380.53 MB/s write, 0.37 GB read, 114.91 MB/s read, 4.2 seconds Interval compaction: 1.23 GB write, 407.79 MB/s write, 0.37 GB read, 123.14 MB/s read, 4.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 154190 Average: 2.0225 StdDev: 21.50 Min: 1 Median: 1.3141 Max: 4203 Percentiles: P50: 1.31 P75: 1.73 P99: 5.21 P99.9: 9.93 P99.99: 21.00 ------------------------------------------------------ [ 0, 1 ] 48200 31.260% 31.260% ###### ( 1, 2 ] 92000 59.667% 90.927% ############ ( 2, 3 ] 8050 5.221% 96.148% # ( 3, 4 ] 3175 2.059% 98.207% ( 4, 6 ] 2016 1.307% 99.514% ( 6, 10 ] 605 0.392% 99.907% ( 10, 15 ] 114 0.074% 99.981% ( 15, 22 ] 17 0.011% 99.992% ( 22, 34 ] 2 0.001% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 51, 76 ] 1 0.001% 99.994% ( 110, 170 ] 8 0.005% 99.999% ( 170, 250 ] 1 0.001% 100.000% ( 250, 380 ] 3 0.002% 100.002% ( 380, 580 ] 1 0.001% 100.003% ( 580, 870 ] 4 0.003% 100.005% ( 870, 1300 ] 1 0.001% 100.006% ( 1300, 1900 ] 2 0.001% 100.007% ( 2900, 4400 ] 4 0.003% 100.010% ** Level 1 read latency histogram (micros): Count: 467 Average: 13.7323 StdDev: 95.72 Min: 1 Median: 2.7462 Max: 1559 Percentiles: P50: 2.75 P75: 3.67 P99: 413.00 P99.9: 1559.00 P99.99: 1559.00 ------------------------------------------------------ [ 0, 1 ] 8 1.713% 1.713% ( 1, 2 ] 80 17.131% 18.844% ### ( 2, 3 ] 195 41.756% 60.600% ######## ( 3, 4 ] 100 21.413% 82.013% #### ( 4, 6 ] 52 11.135% 93.148% ## ( 6, 10 ] 15 3.212% 96.360% # ( 10, 15 ] 5 1.071% 97.430% ( 15, 22 ] 1 0.214% 97.645% ( 22, 34 ] 1 0.214% 97.859% ( 51, 76 ] 2 0.428% 98.287% ( 110, 170 ] 1 0.214% 98.501% ( 170, 250 ] 2 0.428% 98.929% ( 380, 580 ] 2 0.428% 99.358% ( 580, 870 ] 2 0.428% 99.786% ( 1300, 1900 ] 1 0.214% 100.000% ** Level 2 read latency histogram (micros): Count: 47146 Average: 2.2270 StdDev: 4.39 Min: 0 Median: 1.5330 Max: 643 Percentiles: P50: 1.53 P75: 1.90 P99: 5.90 P99.9: 9.89 P99.99: 27.14 ------------------------------------------------------ [ 0, 1 ] 6498 13.783% 13.783% ### ( 1, 2 ] 32037 67.953% 81.735% ############## ( 2, 3 ] 5091 10.798% 92.534% ## ( 3, 4 ] 1833 3.888% 96.422% # ( 4, 6 ] 1279 2.713% 99.135% # ( 6, 10 ] 372 0.789% 99.924% ( 10, 15 ] 27 0.057% 99.981% ( 15, 22 ] 4 0.008% 99.989% ( 22, 34 ] 3 0.006% 99.996% ( 34, 51 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 380, 580 ] 1 0.002% 100.004% ( 580, 870 ] 1 0.002% 100.006% ** Level 3 read latency histogram (micros): Count: 45 Average: 1730.7556 StdDev: 1433.40 Min: 176 Median: 941.6667 Max: 5667 Percentiles: P50: 941.67 P75: 2864.29 P99: 5667.00 P99.9: 5667.00 P99.99: 5667.00 ------------------------------------------------------ ( 170, 250 ] 5 11.111% 11.111% ## ( 250, 380 ] 1 2.222% 13.333% ( 380, 580 ] 5 11.111% 24.444% ## ( 580, 870 ] 11 24.444% 48.889% ##### ( 870, 1300 ] 3 6.667% 55.556% # ( 1300, 1900 ] 2 4.444% 60.000% # ( 1900, 2900 ] 7 15.556% 75.556% ### ( 2900, 4400 ] 9 20.000% 95.556% #### ( 4400, 6600 ] 2 4.444% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1842.7000 StdDev: 1518.12 Min: 127 Median: 1600.0000 Max: 5000 Percentiles: P50: 1600.00 P75: 3221.43 P99: 5000.00 P99.9: 5000.00 P99.99: 5000.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 2 6.667% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 380, 580 ] 4 13.333% 33.333% ### ( 580, 870 ] 2 6.667% 40.000% # ( 870, 1300 ] 1 3.333% 43.333% # ( 1300, 1900 ] 4 13.333% 56.667% ### ( 1900, 2900 ] 4 13.333% 70.000% ### ( 2900, 4400 ] 7 23.333% 93.333% ##### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.3 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 296.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.435 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.435 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-08:36:11 ... thread 0: (1000000,2000000) ops and (324516.6,323760.4) ops/second in (3.081506,6.177407) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.48 GB 75.5 0.8 0.0 0.8 2.6 1.8 0.0 1.4 94.2 311.3 8.70 8.05 29 0.300 831K 834 0.0 0.0 L1 2/2 187.12 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 242.8 242.6 0.78 0.75 1 0.778 191K 126 0.0 0.0 L2 1/0 3.45 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 248.5 248.4 0.77 0.75 2 0.387 195K 87 0.0 0.0 L3 17/0 885.78 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 214.4 214.4 0.87 0.80 1 0.873 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 129.5 129.5 1.30 0.91 1 1.300 170K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/10 97.98 GB 0.0 1.5 0.7 0.9 3.4 2.5 0.5 1.8 125.2 277.3 12.42 11.25 34 0.365 1579K 1047 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.7 0.9 3.4 2.5 0.5 1.8 125.2 277.3 12.42 11.25 34 0.365 1579K 1047 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.7 0.9 1.5 0.7 0.0 0.0 225.1 225.0 6.91 6.31 8 0.864 1579K 1047 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 342.8 5.51 4.93 26 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.4 total, 6.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.36 GB write, 538.16 MB/s write, 1.52 GB read, 243.08 MB/s read, 12.4 seconds Interval compaction: 3.36 GB write, 557.49 MB/s write, 1.52 GB read, 251.81 MB/s read, 12.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 471916 Average: 2.1738 StdDev: 14.07 Min: 1 Median: 1.4698 Max: 4203 Percentiles: P50: 1.47 P75: 1.86 P99: 5.60 P99.9: 9.75 P99.99: 14.06 ------------------------------------------------------ [ 0, 1 ] 93662 19.847% 19.847% #### ( 1, 2 ] 302918 64.189% 84.036% ############# ( 2, 3 ] 46530 9.860% 93.896% ## ( 3, 4 ] 15888 3.367% 97.263% # ( 4, 6 ] 10260 2.174% 99.437% ( 6, 10 ] 2330 0.494% 99.930% ( 10, 15 ] 347 0.074% 100.004% ( 15, 22 ] 45 0.010% 100.014% ( 22, 34 ] 9 0.002% 100.015% ( 34, 51 ] 5 0.001% 100.017% ( 51, 76 ] 1 0.000% 100.017% ( 110, 170 ] 13 0.003% 100.019% ( 170, 250 ] 10 0.002% 100.022% ( 250, 380 ] 8 0.002% 100.023% ( 380, 580 ] 5 0.001% 100.024% ( 580, 870 ] 8 0.002% 100.026% ( 870, 1300 ] 4 0.001% 100.027% ( 1300, 1900 ] 8 0.002% 100.029% ( 2900, 4400 ] 4 0.001% 100.029% ** Level 1 read latency histogram (micros): Count: 47969 Average: 2.2501 StdDev: 9.56 Min: 1 Median: 1.5243 Max: 1559 Percentiles: P50: 1.52 P75: 1.90 P99: 5.59 P99.9: 11.48 P99.99: 400.31 ------------------------------------------------------ [ 0, 1 ] 7412 15.452% 15.452% ### ( 1, 2 ] 31608 65.893% 81.344% ############# ( 2, 3 ] 5747 11.981% 93.325% ## ( 3, 4 ] 1785 3.721% 97.046% # ( 4, 6 ] 1178 2.456% 99.502% ( 6, 10 ] 178 0.371% 99.873% ( 10, 15 ] 44 0.092% 99.965% ( 15, 22 ] 5 0.010% 99.975% ( 22, 34 ] 1 0.002% 99.977% ( 51, 76 ] 3 0.006% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 170, 250 ] 2 0.004% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 580, 870 ] 2 0.004% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47961 Average: 2.2301 StdDev: 4.35 Min: 0 Median: 1.5360 Max: 643 Percentiles: P50: 1.54 P75: 1.90 P99: 5.90 P99.9: 9.89 P99.99: 26.82 ------------------------------------------------------ [ 0, 1 ] 6527 13.609% 13.609% ### ( 1, 2 ] 32565 67.899% 81.508% ############## ( 2, 3 ] 5299 11.049% 92.556% ## ( 3, 4 ] 1845 3.847% 96.403% # ( 4, 6 ] 1313 2.738% 99.141% # ( 6, 10 ] 374 0.780% 99.921% ( 10, 15 ] 28 0.058% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 3 0.006% 99.994% ( 34, 51 ] 1 0.002% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 250, 380 ] 1 0.002% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 580, 870 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 42827 Average: 4.4424 StdDev: 73.01 Min: 1 Median: 1.7719 Max: 5667 Percentiles: P50: 1.77 P75: 2.48 P99: 7.40 P99.9: 238.97 P99.99: 4019.55 ------------------------------------------------------ [ 0, 1 ] 1603 3.743% 3.743% # ( 1, 2 ] 25666 59.929% 63.672% ############ ( 2, 3 ] 10138 23.672% 87.344% ##### ( 3, 4 ] 2507 5.854% 93.198% # ( 4, 6 ] 2334 5.450% 98.648% # ( 6, 10 ] 432 1.009% 99.657% ( 10, 15 ] 78 0.182% 99.839% ( 15, 22 ] 14 0.033% 99.872% ( 22, 34 ] 4 0.009% 99.881% ( 51, 76 ] 2 0.005% 99.886% ( 110, 170 ] 1 0.002% 99.888% ( 170, 250 ] 6 0.014% 99.902% ( 250, 380 ] 1 0.002% 99.904% ( 380, 580 ] 6 0.014% 99.918% ( 580, 870 ] 11 0.026% 99.944% ( 870, 1300 ] 4 0.009% 99.953% ( 1300, 1900 ] 2 0.005% 99.958% ( 1900, 2900 ] 7 0.016% 99.974% ( 2900, 4400 ] 9 0.021% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 181.2781 StdDev: 709.13 Min: 1 Median: 3.3220 Max: 5000 Percentiles: P50: 3.32 P75: 9.25 P99: 4142.86 P99.9: 5000.00 P99.99: 5000.00 ------------------------------------------------------ [ 0, 1 ] 12 3.750% 3.750% # ( 1, 2 ] 32 10.000% 13.750% ## ( 2, 3 ] 97 30.312% 44.062% ###### ( 3, 4 ] 59 18.438% 62.500% #### ( 4, 6 ] 27 8.438% 70.938% ## ( 6, 10 ] 16 5.000% 75.938% # ( 10, 15 ] 22 6.875% 82.812% # ( 15, 22 ] 16 5.000% 87.812% # ( 22, 34 ] 5 1.562% 89.375% ( 34, 51 ] 1 0.312% 89.688% ( 110, 170 ] 2 0.625% 90.312% ( 170, 250 ] 2 0.625% 90.938% ( 250, 380 ] 4 1.250% 92.188% ( 380, 580 ] 5 1.562% 93.750% ( 580, 870 ] 2 0.625% 94.375% ( 870, 1300 ] 1 0.312% 94.688% ( 1300, 1900 ] 4 1.250% 95.938% ( 1900, 2900 ] 4 1.250% 97.188% ( 2900, 4400 ] 7 2.188% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** DB Stats ** Uptime(secs): 6.4 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 307.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.810 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.375 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-08:36:14 ... thread 0: (1000000,3000000) ops and (361125.8,335325.7) ops/second in (2.769118,8.946525) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/8 1.91 GB 138.4 1.6 0.0 1.6 4.4 2.8 0.0 1.6 114.1 311.4 14.36 13.38 46 0.312 1663K 1679 0.0 0.0 L1 3/0 173.81 MB 17.4 0.9 0.7 0.2 0.9 0.7 0.2 1.3 233.7 233.1 3.77 3.65 2 1.883 893K 1981 0.0 0.0 L2 1/0 3.45 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 248.5 248.4 0.77 0.75 2 0.387 195K 87 0.0 0.0 L3 13/0 707.90 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.6 1.0 214.4 214.4 0.87 0.80 1 0.873 190K 0 0.0 0.0 L4 174/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 129.5 129.5 1.30 0.91 1 1.300 170K 0 0.0 0.0 L5 1052/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/8 98.90 GB 0.0 3.0 1.1 1.8 5.8 3.9 2.8 2.1 145.5 279.8 21.07 19.48 52 0.405 3112K 3747 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 1.1 1.8 5.8 3.9 2.8 2.1 145.5 279.8 21.07 19.48 52 0.405 3112K 3747 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 1.1 1.8 3.0 1.1 0.0 0.0 235.7 235.4 13.00 12.26 12 1.084 3112K 3747 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 351.4 8.07 7.22 40 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.76 GB write, 643.03 MB/s write, 2.99 GB read, 334.32 MB/s read, 21.1 seconds Interval compaction: 5.76 GB write, 658.97 MB/s write, 2.99 GB read, 342.61 MB/s read, 21.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 691351 Average: 2.0919 StdDev: 13.57 Min: 1 Median: 1.4171 Max: 4203 Percentiles: P50: 1.42 P75: 1.81 P99: 5.42 P99.9: 9.71 P99.99: 14.32 ------------------------------------------------------ [ 0, 1 ] 164155 23.744% 23.744% ##### ( 1, 2 ] 435243 62.955% 86.700% ############# ( 2, 3 ] 56652 8.194% 94.894% ## ( 3, 4 ] 19811 2.866% 97.759% # ( 4, 6 ] 12078 1.747% 99.506% ( 6, 10 ] 2935 0.425% 99.931% ( 10, 15 ] 474 0.069% 100.000% ( 15, 22 ] 61 0.009% 100.008% ( 22, 34 ] 11 0.002% 100.010% ( 34, 51 ] 8 0.001% 100.011% ( 51, 76 ] 3 0.000% 100.012% ( 110, 170 ] 22 0.003% 100.015% ( 170, 250 ] 15 0.002% 100.017% ( 250, 380 ] 12 0.002% 100.019% ( 380, 580 ] 8 0.001% 100.020% ( 580, 870 ] 11 0.002% 100.021% ( 870, 1300 ] 9 0.001% 100.023% ( 1300, 1900 ] 10 0.001% 100.024% ( 1900, 2900 ] 2 0.000% 100.024% ( 2900, 4400 ] 5 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 48004 Average: 2.4150 StdDev: 15.66 Min: 1 Median: 1.5243 Max: 1559 Percentiles: P50: 1.52 P75: 1.90 P99: 5.61 P99.9: 12.84 P99.99: 898.61 ------------------------------------------------------ [ 0, 1 ] 7425 15.467% 15.467% ### ( 1, 2 ] 31615 65.859% 81.327% ############# ( 2, 3 ] 5748 11.974% 93.301% ## ( 3, 4 ] 1785 3.718% 97.019% # ( 4, 6 ] 1180 2.458% 99.477% ( 6, 10 ] 178 0.371% 99.848% ( 10, 15 ] 44 0.092% 99.940% ( 15, 22 ] 5 0.010% 99.950% ( 22, 34 ] 1 0.002% 99.952% ( 51, 76 ] 3 0.006% 99.958% ( 110, 170 ] 2 0.004% 99.963% ( 170, 250 ] 3 0.006% 99.969% ( 250, 380 ] 3 0.006% 99.975% ( 380, 580 ] 4 0.008% 99.983% ( 580, 870 ] 3 0.006% 99.990% ( 870, 1300 ] 3 0.006% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 47961 Average: 2.2301 StdDev: 4.35 Min: 0 Median: 1.5360 Max: 643 Percentiles: P50: 1.54 P75: 1.90 P99: 5.90 P99.9: 9.89 P99.99: 26.82 ------------------------------------------------------ [ 0, 1 ] 6527 13.609% 13.609% ### ( 1, 2 ] 32565 67.899% 81.508% ############## ( 2, 3 ] 5299 11.049% 92.556% ## ( 3, 4 ] 1845 3.847% 96.403% # ( 4, 6 ] 1313 2.738% 99.141% # ( 6, 10 ] 374 0.780% 99.921% ( 10, 15 ] 28 0.058% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 3 0.006% 99.994% ( 34, 51 ] 1 0.002% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 250, 380 ] 1 0.002% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 580, 870 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 42827 Average: 4.4424 StdDev: 73.01 Min: 1 Median: 1.7719 Max: 5667 Percentiles: P50: 1.77 P75: 2.48 P99: 7.40 P99.9: 238.97 P99.99: 4019.55 ------------------------------------------------------ [ 0, 1 ] 1603 3.743% 3.743% # ( 1, 2 ] 25666 59.929% 63.672% ############ ( 2, 3 ] 10138 23.672% 87.344% ##### ( 3, 4 ] 2507 5.854% 93.198% # ( 4, 6 ] 2334 5.450% 98.648% # ( 6, 10 ] 432 1.009% 99.657% ( 10, 15 ] 78 0.182% 99.839% ( 15, 22 ] 14 0.033% 99.872% ( 22, 34 ] 4 0.009% 99.881% ( 51, 76 ] 2 0.005% 99.886% ( 110, 170 ] 1 0.002% 99.888% ( 170, 250 ] 6 0.014% 99.902% ( 250, 380 ] 1 0.002% 99.904% ( 380, 580 ] 6 0.014% 99.918% ( 580, 870 ] 11 0.026% 99.944% ( 870, 1300 ] 4 0.009% 99.953% ( 1300, 1900 ] 2 0.005% 99.958% ( 1900, 2900 ] 7 0.016% 99.974% ( 2900, 4400 ] 9 0.021% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 181.2781 StdDev: 709.13 Min: 1 Median: 3.3220 Max: 5000 Percentiles: P50: 3.32 P75: 9.25 P99: 4142.86 P99.9: 5000.00 P99.99: 5000.00 ------------------------------------------------------ [ 0, 1 ] 12 3.750% 3.750% # ( 1, 2 ] 32 10.000% 13.750% ## ( 2, 3 ] 97 30.312% 44.062% ###### ( 3, 4 ] 59 18.438% 62.500% #### ( 4, 6 ] 27 8.438% 70.938% ## ( 6, 10 ] 16 5.000% 75.938% # ( 10, 15 ] 22 6.875% 82.812% # ( 15, 22 ] 16 5.000% 87.812% # ( 22, 34 ] 5 1.562% 89.375% ( 34, 51 ] 1 0.312% 89.688% ( 110, 170 ] 2 0.625% 90.312% ( 170, 250 ] 2 0.625% 90.938% ( 250, 380 ] 4 1.250% 92.188% ( 380, 580 ] 5 1.562% 93.750% ( 580, 870 ] 2 0.625% 94.375% ( 870, 1300 ] 1 0.312% 94.688% ( 1300, 1900 ] 4 1.250% 95.938% ( 1900, 2900 ] 4 1.250% 97.188% ( 2900, 4400 ] 7 2.188% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 790.5750 StdDev: 979.44 Min: 87 Median: 276.0000 Max: 4109 Percentiles: P50: 276.00 P75: 1156.67 P99: 3800.00 P99.9: 4109.00 P99.99: 4109.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 11 27.500% 40.000% ###### ( 170, 250 ] 3 7.500% 47.500% ## ( 250, 380 ] 5 12.500% 60.000% ### ( 380, 580 ] 1 2.500% 62.500% # ( 580, 870 ] 3 7.500% 70.000% ## ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 6 15.000% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 321.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.993 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 355.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.182 H:M:S, 6.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-08:36:17 ... thread 0: (1000000,4000000) ops and (332677.8,334659.8) ops/second in (3.005911,11.952436) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.89 GB 264.3 2.7 0.0 2.7 6.5 3.7 0.0 1.7 128.9 307.4 21.51 20.18 64 0.336 2814K 2886 0.0 0.0 L1 3/0 173.81 MB 17.4 0.9 0.7 0.2 0.9 0.7 0.2 1.3 233.7 233.1 3.77 3.65 2 1.883 893K 1981 0.0 0.0 L2 1/0 3.45 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 248.5 248.4 0.77 0.75 2 0.387 195K 87 0.0 0.0 L3 13/0 707.90 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.6 1.0 214.4 214.4 0.87 0.80 1 0.873 190K 0 0.0 0.0 L4 174/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 129.5 129.5 1.30 0.91 1 1.300 170K 0 0.0 0.0 L5 1052/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/4 99.88 GB 0.0 4.1 1.1 3.0 7.8 4.9 2.8 2.1 148.8 284.8 28.22 26.28 70 0.403 4264K 4954 0.0 0.0 Int 0/0 0.00 KB 0.0 4.1 1.1 3.0 7.8 4.9 2.8 2.1 148.8 284.8 28.22 26.28 70 0.403 4264K 4954 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.1 1.1 3.0 4.1 1.1 0.0 0.0 241.6 241.3 17.38 16.56 16 1.086 4264K 4954 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 354.5 10.84 9.71 54 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.85 GB write, 660.09 MB/s write, 4.10 GB read, 344.91 MB/s read, 28.2 seconds Interval compaction: 7.85 GB write, 672.34 MB/s write, 4.10 GB read, 351.31 MB/s read, 28.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 954466 Average: 2.0582 StdDev: 13.18 Min: 1 Median: 1.3986 Max: 4203 Percentiles: P50: 1.40 P75: 1.80 P99: 5.32 P99.9: 9.67 P99.99: 14.52 ------------------------------------------------------ [ 0, 1 ] 238084 24.944% 24.944% ##### ( 1, 2 ] 599990 62.861% 87.806% ############# ( 2, 3 ] 72000 7.543% 95.349% ## ( 3, 4 ] 25033 2.623% 97.972% # ( 4, 6 ] 14904 1.562% 99.533% ( 6, 10 ] 3814 0.400% 99.933% ( 10, 15 ] 605 0.063% 99.996% ( 15, 22 ] 87 0.009% 100.005% ( 22, 34 ] 16 0.002% 100.007% ( 34, 51 ] 9 0.001% 100.008% ( 51, 76 ] 4 0.000% 100.008% ( 76, 110 ] 1 0.000% 100.008% ( 110, 170 ] 28 0.003% 100.011% ( 170, 250 ] 21 0.002% 100.014% ( 250, 380 ] 21 0.002% 100.016% ( 380, 580 ] 10 0.001% 100.017% ( 580, 870 ] 16 0.002% 100.019% ( 870, 1300 ] 13 0.001% 100.020% ( 1300, 1900 ] 10 0.001% 100.021% ( 1900, 2900 ] 4 0.000% 100.021% ( 2900, 4400 ] 7 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 48004 Average: 2.4150 StdDev: 15.66 Min: 1 Median: 1.5243 Max: 1559 Percentiles: P50: 1.52 P75: 1.90 P99: 5.61 P99.9: 12.84 P99.99: 898.61 ------------------------------------------------------ [ 0, 1 ] 7425 15.467% 15.467% ### ( 1, 2 ] 31615 65.859% 81.327% ############# ( 2, 3 ] 5748 11.974% 93.301% ## ( 3, 4 ] 1785 3.718% 97.019% # ( 4, 6 ] 1180 2.458% 99.477% ( 6, 10 ] 178 0.371% 99.848% ( 10, 15 ] 44 0.092% 99.940% ( 15, 22 ] 5 0.010% 99.950% ( 22, 34 ] 1 0.002% 99.952% ( 51, 76 ] 3 0.006% 99.958% ( 110, 170 ] 2 0.004% 99.963% ( 170, 250 ] 3 0.006% 99.969% ( 250, 380 ] 3 0.006% 99.975% ( 380, 580 ] 4 0.008% 99.983% ( 580, 870 ] 3 0.006% 99.990% ( 870, 1300 ] 3 0.006% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 47961 Average: 2.2301 StdDev: 4.35 Min: 0 Median: 1.5360 Max: 643 Percentiles: P50: 1.54 P75: 1.90 P99: 5.90 P99.9: 9.89 P99.99: 26.82 ------------------------------------------------------ [ 0, 1 ] 6527 13.609% 13.609% ### ( 1, 2 ] 32565 67.899% 81.508% ############## ( 2, 3 ] 5299 11.049% 92.556% ## ( 3, 4 ] 1845 3.847% 96.403% # ( 4, 6 ] 1313 2.738% 99.141% # ( 6, 10 ] 374 0.780% 99.921% ( 10, 15 ] 28 0.058% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 3 0.006% 99.994% ( 34, 51 ] 1 0.002% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 250, 380 ] 1 0.002% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 580, 870 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 42827 Average: 4.4424 StdDev: 73.01 Min: 1 Median: 1.7719 Max: 5667 Percentiles: P50: 1.77 P75: 2.48 P99: 7.40 P99.9: 238.97 P99.99: 4019.55 ------------------------------------------------------ [ 0, 1 ] 1603 3.743% 3.743% # ( 1, 2 ] 25666 59.929% 63.672% ############ ( 2, 3 ] 10138 23.672% 87.344% ##### ( 3, 4 ] 2507 5.854% 93.198% # ( 4, 6 ] 2334 5.450% 98.648% # ( 6, 10 ] 432 1.009% 99.657% ( 10, 15 ] 78 0.182% 99.839% ( 15, 22 ] 14 0.033% 99.872% ( 22, 34 ] 4 0.009% 99.881% ( 51, 76 ] 2 0.005% 99.886% ( 110, 170 ] 1 0.002% 99.888% ( 170, 250 ] 6 0.014% 99.902% ( 250, 380 ] 1 0.002% 99.904% ( 380, 580 ] 6 0.014% 99.918% ( 580, 870 ] 11 0.026% 99.944% ( 870, 1300 ] 4 0.009% 99.953% ( 1300, 1900 ] 2 0.005% 99.958% ( 1900, 2900 ] 7 0.016% 99.974% ( 2900, 4400 ] 9 0.021% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 181.2781 StdDev: 709.13 Min: 1 Median: 3.3220 Max: 5000 Percentiles: P50: 3.32 P75: 9.25 P99: 4142.86 P99.9: 5000.00 P99.99: 5000.00 ------------------------------------------------------ [ 0, 1 ] 12 3.750% 3.750% # ( 1, 2 ] 32 10.000% 13.750% ## ( 2, 3 ] 97 30.312% 44.062% ###### ( 3, 4 ] 59 18.438% 62.500% #### ( 4, 6 ] 27 8.438% 70.938% ## ( 6, 10 ] 16 5.000% 75.938% # ( 10, 15 ] 22 6.875% 82.812% # ( 15, 22 ] 16 5.000% 87.812% # ( 22, 34 ] 5 1.562% 89.375% ( 34, 51 ] 1 0.312% 89.688% ( 110, 170 ] 2 0.625% 90.312% ( 170, 250 ] 2 0.625% 90.938% ( 250, 380 ] 4 1.250% 92.188% ( 380, 580 ] 5 1.562% 93.750% ( 580, 870 ] 2 0.625% 94.375% ( 870, 1300 ] 1 0.312% 94.688% ( 1300, 1900 ] 4 1.250% 95.938% ( 1900, 2900 ] 4 1.250% 97.188% ( 2900, 4400 ] 7 2.188% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 790.5750 StdDev: 979.44 Min: 87 Median: 276.0000 Max: 4109 Percentiles: P50: 276.00 P75: 1156.67 P99: 3800.00 P99.9: 4109.00 P99.99: 4109.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 11 27.500% 40.000% ###### ( 170, 250 ] 3 7.500% 47.500% ## ( 250, 380 ] 5 12.500% 60.000% ### ( 380, 580 ] 1 2.500% 62.500% # ( 580, 870 ] 3 7.500% 70.000% ## ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 6 15.000% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.364 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.371 H:M:S, 12.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/16-08:36:21 ... thread 0: (1000000,5000000) ops and (220099.0,303106.6) ops/second in (4.543411,16.495847) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/18 3.87 GB 0.0 3.8 0.0 3.8 8.5 4.7 0.0 1.8 135.1 305.5 28.44 26.75 83 0.343 3901K 3996 0.0 0.0 L1 3/3 173.81 MB 0.0 0.9 0.7 0.2 0.9 0.7 0.2 1.3 233.7 233.1 3.77 3.65 2 1.883 893K 1981 0.0 0.0 L2 1/0 3.45 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 248.5 248.4 0.77 0.75 2 0.387 195K 87 0.0 0.0 L3 13/0 707.90 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.6 1.0 214.4 214.4 0.87 0.80 1 0.873 190K 0 0.0 0.0 L4 174/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 129.5 129.5 1.30 0.91 1 1.300 170K 0 0.0 0.0 L5 1052/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/21 100.87 GB 0.0 5.1 1.1 4.0 9.9 5.9 2.8 2.1 149.9 287.7 35.15 32.85 89 0.395 5351K 6064 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 1.1 4.0 9.9 5.9 2.8 2.1 149.9 287.7 35.15 32.85 89 0.395 5351K 6064 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 1.1 4.0 5.1 1.1 0.0 0.0 245.6 245.3 21.46 20.57 20 1.073 5351K 6064 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.2 13.69 12.27 69 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.7 total, 16.5 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.88 GB write, 604.99 MB/s write, 5.15 GB read, 315.24 MB/s read, 35.2 seconds Interval compaction: 9.88 GB write, 613.12 MB/s write, 5.15 GB read, 319.48 MB/s read, 35.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 14, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1397276 Average: 2.0645 StdDev: 11.57 Min: 0 Median: 1.4071 Max: 4203 Percentiles: P50: 1.41 P75: 1.80 P99: 5.23 P99.9: 9.74 P99.99: 18.92 ------------------------------------------------------ [ 0, 1 ] 334854 23.965% 23.965% ##### ( 1, 2 ] 893693 63.960% 87.924% ############# ( 2, 3 ] 106100 7.593% 95.518% ## ( 3, 4 ] 36590 2.619% 98.136% # ( 4, 6 ] 19654 1.407% 99.543% ( 6, 10 ] 5338 0.382% 99.925% ( 10, 15 ] 840 0.060% 99.985% ( 15, 22 ] 122 0.009% 99.994% ( 22, 34 ] 19 0.001% 99.995% ( 34, 51 ] 12 0.001% 99.996% ( 51, 76 ] 10 0.001% 99.997% ( 76, 110 ] 70 0.005% 100.002% ( 110, 170 ] 118 0.008% 100.010% ( 170, 250 ] 42 0.003% 100.013% ( 250, 380 ] 38 0.003% 100.016% ( 380, 580 ] 21 0.002% 100.018% ( 580, 870 ] 26 0.002% 100.019% ( 870, 1300 ] 18 0.001% 100.021% ( 1300, 1900 ] 12 0.001% 100.022% ( 1900, 2900 ] 4 0.000% 100.022% ( 2900, 4400 ] 7 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 48005 Average: 2.4150 StdDev: 15.66 Min: 1 Median: 1.5244 Max: 1559 Percentiles: P50: 1.52 P75: 1.90 P99: 5.61 P99.9: 12.84 P99.99: 898.59 ------------------------------------------------------ [ 0, 1 ] 7425 15.467% 15.467% ### ( 1, 2 ] 31615 65.858% 81.325% ############# ( 2, 3 ] 5748 11.974% 93.299% ## ( 3, 4 ] 1786 3.720% 97.019% # ( 4, 6 ] 1180 2.458% 99.477% ( 6, 10 ] 178 0.371% 99.848% ( 10, 15 ] 44 0.092% 99.940% ( 15, 22 ] 5 0.010% 99.950% ( 22, 34 ] 1 0.002% 99.952% ( 51, 76 ] 3 0.006% 99.958% ( 110, 170 ] 2 0.004% 99.963% ( 170, 250 ] 3 0.006% 99.969% ( 250, 380 ] 3 0.006% 99.975% ( 380, 580 ] 4 0.008% 99.983% ( 580, 870 ] 3 0.006% 99.990% ( 870, 1300 ] 3 0.006% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 47961 Average: 2.2301 StdDev: 4.35 Min: 0 Median: 1.5360 Max: 643 Percentiles: P50: 1.54 P75: 1.90 P99: 5.90 P99.9: 9.89 P99.99: 26.82 ------------------------------------------------------ [ 0, 1 ] 6527 13.609% 13.609% ### ( 1, 2 ] 32565 67.899% 81.508% ############## ( 2, 3 ] 5299 11.049% 92.556% ## ( 3, 4 ] 1845 3.847% 96.403% # ( 4, 6 ] 1313 2.738% 99.141% # ( 6, 10 ] 374 0.780% 99.921% ( 10, 15 ] 28 0.058% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 3 0.006% 99.994% ( 34, 51 ] 1 0.002% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 250, 380 ] 1 0.002% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 580, 870 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 42827 Average: 4.4424 StdDev: 73.01 Min: 1 Median: 1.7719 Max: 5667 Percentiles: P50: 1.77 P75: 2.48 P99: 7.40 P99.9: 238.97 P99.99: 4019.55 ------------------------------------------------------ [ 0, 1 ] 1603 3.743% 3.743% # ( 1, 2 ] 25666 59.929% 63.672% ############ ( 2, 3 ] 10138 23.672% 87.344% ##### ( 3, 4 ] 2507 5.854% 93.198% # ( 4, 6 ] 2334 5.450% 98.648% # ( 6, 10 ] 432 1.009% 99.657% ( 10, 15 ] 78 0.182% 99.839% ( 15, 22 ] 14 0.033% 99.872% ( 22, 34 ] 4 0.009% 99.881% ( 51, 76 ] 2 0.005% 99.886% ( 110, 170 ] 1 0.002% 99.888% ( 170, 250 ] 6 0.014% 99.902% ( 250, 380 ] 1 0.002% 99.904% ( 380, 580 ] 6 0.014% 99.918% ( 580, 870 ] 11 0.026% 99.944% ( 870, 1300 ] 4 0.009% 99.953% ( 1300, 1900 ] 2 0.005% 99.958% ( 1900, 2900 ] 7 0.016% 99.974% ( 2900, 4400 ] 9 0.021% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 181.2781 StdDev: 709.13 Min: 1 Median: 3.3220 Max: 5000 Percentiles: P50: 3.32 P75: 9.25 P99: 4142.86 P99.9: 5000.00 P99.99: 5000.00 ------------------------------------------------------ [ 0, 1 ] 12 3.750% 3.750% # ( 1, 2 ] 32 10.000% 13.750% ## ( 2, 3 ] 97 30.312% 44.062% ###### ( 3, 4 ] 59 18.438% 62.500% #### ( 4, 6 ] 27 8.438% 70.938% ## ( 6, 10 ] 16 5.000% 75.938% # ( 10, 15 ] 22 6.875% 82.812% # ( 15, 22 ] 16 5.000% 87.812% # ( 22, 34 ] 5 1.562% 89.375% ( 34, 51 ] 1 0.312% 89.688% ( 110, 170 ] 2 0.625% 90.312% ( 170, 250 ] 2 0.625% 90.938% ( 250, 380 ] 4 1.250% 92.188% ( 380, 580 ] 5 1.562% 93.750% ( 580, 870 ] 2 0.625% 94.375% ( 870, 1300 ] 1 0.312% 94.688% ( 1300, 1900 ] 4 1.250% 95.938% ( 1900, 2900 ] 4 1.250% 97.188% ( 2900, 4400 ] 7 2.188% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 790.5750 StdDev: 979.44 Min: 87 Median: 276.0000 Max: 4109 Percentiles: P50: 276.00 P75: 1156.67 P99: 3800.00 P99.9: 4109.00 P99.99: 4109.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 11 27.500% 40.000% ###### ( 170, 250 ] 3 7.500% 47.500% ## ( 250, 380 ] 5 12.500% 60.000% ### ( 380, 580 ] 1 2.500% 62.500% # ( 580, 870 ] 3 7.500% 70.000% ## ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 6 15.000% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 16.7 total, 4.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 294.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.193 H:M:S, 19.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 216.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.829 H:M:S, 40.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-08:36:32 ... thread 0: (1000000,6000000) ops and (96370.2,223276.6) ops/second in (10.376647,26.872494) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 4.79 GB 163.3 6.0 0.0 6.0 11.6 5.7 0.0 2.1 153.5 298.8 39.81 37.63 103 0.387 6203K 8933 0.0 0.0 L1 3/3 173.81 MB 0.0 0.9 0.7 0.2 0.9 0.7 0.2 1.3 233.7 233.1 3.77 3.65 2 1.883 893K 1981 0.0 0.0 L2 1/0 3.45 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 1.5 248.5 248.4 0.77 0.75 2 0.387 195K 87 0.0 0.0 L3 13/0 707.90 MB 0.7 0.2 0.2 0.0 0.2 0.2 0.6 1.0 214.4 214.4 0.87 0.80 1 0.873 190K 0 0.0 0.0 L4 174/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 129.5 129.5 1.30 0.91 1 1.300 170K 0 0.0 0.0 L5 1052/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/17 101.79 GB 0.0 7.4 1.1 6.2 13.0 6.8 2.8 2.3 162.0 286.3 46.52 43.74 109 0.427 7653K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.4 1.1 6.2 13.0 6.8 2.8 2.3 162.0 286.3 46.52 43.74 109 0.427 7653K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.4 1.1 6.2 7.3 1.1 0.0 0.0 250.8 250.5 30.05 28.98 25 1.202 7653K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 351.8 16.48 14.75 84 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.1 total, 26.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.01 GB write, 491.65 MB/s write, 7.36 GB read, 278.17 MB/s read, 46.5 seconds Interval compaction: 13.01 GB write, 495.71 MB/s write, 7.36 GB read, 280.47 MB/s read, 46.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 14, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2516508 Average: 2.2523 StdDev: 12.39 Min: 0 Median: 1.4371 Max: 4203 Percentiles: P50: 1.44 P75: 1.82 P99: 5.52 P99.9: 66.41 P99.99: 167.07 ------------------------------------------------------ [ 0, 1 ] 534202 21.228% 21.228% #### ( 1, 2 ] 1656554 65.827% 87.055% ############# ( 2, 3 ] 204725 8.135% 95.191% ## ( 3, 4 ] 68513 2.723% 97.913% # ( 4, 6 ] 36062 1.433% 99.346% ( 6, 10 ] 12382 0.492% 99.838% ( 10, 15 ] 1307 0.052% 99.890% ( 15, 22 ] 190 0.008% 99.898% ( 22, 34 ] 21 0.001% 99.899% ( 34, 51 ] 18 0.001% 99.899% ( 51, 76 ] 30 0.001% 99.900% ( 76, 110 ] 993 0.039% 99.940% ( 110, 170 ] 1325 0.053% 99.993% ( 170, 250 ] 322 0.013% 100.005% ( 250, 380 ] 173 0.007% 100.012% ( 380, 580 ] 143 0.006% 100.018% ( 580, 870 ] 77 0.003% 100.021% ( 870, 1300 ] 30 0.001% 100.022% ( 1300, 1900 ] 19 0.001% 100.023% ( 1900, 2900 ] 8 0.000% 100.023% ( 2900, 4400 ] 12 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 73957 Average: 2.6594 StdDev: 15.21 Min: 1 Median: 1.5280 Max: 1559 Percentiles: P50: 1.53 P75: 1.90 P99: 6.13 P99.9: 140.46 P99.99: 770.75 ------------------------------------------------------ [ 0, 1 ] 11055 14.948% 14.948% ### ( 1, 2 ] 49095 66.383% 81.331% ############# ( 2, 3 ] 8428 11.396% 92.727% ## ( 3, 4 ] 2748 3.716% 96.443% # ( 4, 6 ] 1875 2.535% 98.978% # ( 6, 10 ] 492 0.665% 99.643% ( 10, 15 ] 65 0.088% 99.731% ( 15, 22 ] 9 0.012% 99.743% ( 22, 34 ] 3 0.004% 99.747% ( 51, 76 ] 3 0.004% 99.751% ( 76, 110 ] 74 0.100% 99.851% ( 110, 170 ] 71 0.096% 99.947% ( 170, 250 ] 13 0.018% 99.965% ( 250, 380 ] 6 0.008% 99.973% ( 380, 580 ] 8 0.011% 99.984% ( 580, 870 ] 7 0.009% 99.993% ( 870, 1300 ] 3 0.004% 99.997% ( 1300, 1900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 47961 Average: 2.2301 StdDev: 4.35 Min: 0 Median: 1.5360 Max: 643 Percentiles: P50: 1.54 P75: 1.90 P99: 5.90 P99.9: 9.89 P99.99: 26.82 ------------------------------------------------------ [ 0, 1 ] 6527 13.609% 13.609% ### ( 1, 2 ] 32565 67.899% 81.508% ############## ( 2, 3 ] 5299 11.049% 92.556% ## ( 3, 4 ] 1845 3.847% 96.403% # ( 4, 6 ] 1313 2.738% 99.141% # ( 6, 10 ] 374 0.780% 99.921% ( 10, 15 ] 28 0.058% 99.979% ( 15, 22 ] 4 0.008% 99.987% ( 22, 34 ] 3 0.006% 99.994% ( 34, 51 ] 1 0.002% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 250, 380 ] 1 0.002% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 580, 870 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 42827 Average: 4.4424 StdDev: 73.01 Min: 1 Median: 1.7719 Max: 5667 Percentiles: P50: 1.77 P75: 2.48 P99: 7.40 P99.9: 238.97 P99.99: 4019.55 ------------------------------------------------------ [ 0, 1 ] 1603 3.743% 3.743% # ( 1, 2 ] 25666 59.929% 63.672% ############ ( 2, 3 ] 10138 23.672% 87.344% ##### ( 3, 4 ] 2507 5.854% 93.198% # ( 4, 6 ] 2334 5.450% 98.648% # ( 6, 10 ] 432 1.009% 99.657% ( 10, 15 ] 78 0.182% 99.839% ( 15, 22 ] 14 0.033% 99.872% ( 22, 34 ] 4 0.009% 99.881% ( 51, 76 ] 2 0.005% 99.886% ( 110, 170 ] 1 0.002% 99.888% ( 170, 250 ] 6 0.014% 99.902% ( 250, 380 ] 1 0.002% 99.904% ( 380, 580 ] 6 0.014% 99.918% ( 580, 870 ] 11 0.026% 99.944% ( 870, 1300 ] 4 0.009% 99.953% ( 1300, 1900 ] 2 0.005% 99.958% ( 1900, 2900 ] 7 0.016% 99.974% ( 2900, 4400 ] 9 0.021% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 181.2781 StdDev: 709.13 Min: 1 Median: 3.3220 Max: 5000 Percentiles: P50: 3.32 P75: 9.25 P99: 4142.86 P99.9: 5000.00 P99.99: 5000.00 ------------------------------------------------------ [ 0, 1 ] 12 3.750% 3.750% # ( 1, 2 ] 32 10.000% 13.750% ## ( 2, 3 ] 97 30.312% 44.062% ###### ( 3, 4 ] 59 18.438% 62.500% #### ( 4, 6 ] 27 8.438% 70.938% ## ( 6, 10 ] 16 5.000% 75.938% # ( 10, 15 ] 22 6.875% 82.812% # ( 15, 22 ] 16 5.000% 87.812% # ( 22, 34 ] 5 1.562% 89.375% ( 34, 51 ] 1 0.312% 89.688% ( 110, 170 ] 2 0.625% 90.312% ( 170, 250 ] 2 0.625% 90.938% ( 250, 380 ] 4 1.250% 92.188% ( 380, 580 ] 5 1.562% 93.750% ( 580, 870 ] 2 0.625% 94.375% ( 870, 1300 ] 1 0.312% 94.688% ( 1300, 1900 ] 4 1.250% 95.938% ( 1900, 2900 ] 4 1.250% 97.188% ( 2900, 4400 ] 7 2.188% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 790.5750 StdDev: 979.44 Min: 87 Median: 276.0000 Max: 4109 Percentiles: P50: 276.00 P75: 1156.67 P99: 3800.00 P99.9: 4109.00 P99.99: 4109.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 11 27.500% 40.000% ###### ( 170, 250 ] 3 7.500% 47.500% ## ( 250, 380 ] 5 12.500% 60.000% ### ( 380, 580 ] 1 2.500% 62.500% # ( 580, 870 ] 3 7.500% 70.000% ## ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 6 15.000% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 27.1 total, 10.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 217.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.557 H:M:S, 39.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 94.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.364 H:M:S, 71.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/16-08:36:38 ... thread 0: (1000000,7000000) ops and (145586.9,207461.2) ops/second in (6.868749,33.741243) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 2.58 GB 12.6 6.5 0.0 6.5 13.1 6.6 0.0 2.0 143.1 290.1 46.22 42.43 118 0.392 6715K 9431 0.0 0.0 L1 12/12 1.30 GB 0.0 4.2 3.9 0.4 4.2 3.8 0.2 1.1 223.5 220.5 19.36 18.46 3 6.452 4392K 58K 0.0 0.0 L2 3/3 386.34 MB 0.0 0.2 0.1 0.1 0.2 0.1 2.7 1.5 248.5 248.4 0.77 0.75 2 0.387 195K 87 0.0 0.0 L3 30/8 1.39 GB 1.0 2.5 1.8 0.7 2.5 1.8 0.6 1.4 198.8 197.9 12.84 11.51 6 2.141 2593K 12K 0.0 0.0 L4 178/2 9.71 GB 1.0 1.1 1.0 0.0 1.1 1.0 0.7 1.0 119.1 118.9 9.38 5.45 16 0.586 1126K 1463 0.0 0.0 L5 1064/0 87.35 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/35 102.70 GB 0.0 14.5 6.9 7.6 21.0 13.4 5.8 3.2 167.1 243.0 88.58 78.59 145 0.611 15M 81K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.5 6.9 7.6 21.0 13.4 5.8 3.2 167.1 243.0 88.58 78.59 145 0.611 15M 81K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.5 6.9 7.6 14.4 6.8 0.0 0.0 218.3 217.0 67.82 61.05 48 1.413 15M 81K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 327.7 20.76 17.54 97 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.0 total, 33.7 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.02 GB write, 633.73 MB/s write, 14.46 GB read, 435.84 MB/s read, 88.6 seconds Interval compaction: 21.02 GB write, 637.90 MB/s write, 14.46 GB read, 438.71 MB/s read, 88.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 34, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2934741 Average: 2.4686 StdDev: 23.75 Min: 0 Median: 1.4682 Max: 13609 Percentiles: P50: 1.47 P75: 1.85 P99: 5.85 P99.9: 93.95 P99.99: 243.65 ------------------------------------------------------ [ 0, 1 ] 574813 19.586% 19.586% #### ( 1, 2 ] 1906377 64.959% 84.545% ############# ( 2, 3 ] 270831 9.228% 93.774% ## ( 3, 4 ] 96802 3.298% 97.072% # ( 4, 6 ] 61295 2.089% 99.161% ( 6, 10 ] 18618 0.634% 99.795% ( 10, 15 ] 2071 0.071% 99.866% ( 15, 22 ] 273 0.009% 99.875% ( 22, 34 ] 29 0.001% 99.876% ( 34, 51 ] 20 0.001% 99.877% ( 51, 76 ] 38 0.001% 99.878% ( 76, 110 ] 1213 0.041% 99.920% ( 110, 170 ] 1657 0.056% 99.976% ( 170, 250 ] 447 0.015% 99.991% ( 250, 380 ] 265 0.009% 100.000% ( 380, 580 ] 267 0.009% 100.009% ( 580, 870 ] 171 0.006% 100.015% ( 870, 1300 ] 97 0.003% 100.019% ( 1300, 1900 ] 44 0.001% 100.020% ( 1900, 2900 ] 20 0.001% 100.021% ( 2900, 4400 ] 27 0.001% 100.022% ( 4400, 6600 ] 6 0.000% 100.022% ( 6600, 9900 ] 5 0.000% 100.022% ( 9900, 14000 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 748361 Average: 4.3333 StdDev: 68.12 Min: 1 Median: 1.8175 Max: 13838 Percentiles: P50: 1.82 P75: 2.69 P99: 8.80 P99.9: 21.51 P99.99: 167.84 ------------------------------------------------------ [ 0, 1 ] 28452 3.802% 3.802% # ( 1, 2 ] 422929 56.514% 60.316% ########### ( 2, 3 ] 158559 21.188% 81.503% #### ( 3, 4 ] 63153 8.439% 89.942% ## ( 4, 6 ] 57019 7.619% 97.561% ## ( 6, 10 ] 15397 2.057% 99.619% ( 10, 15 ] 1859 0.248% 99.867% ( 15, 22 ] 263 0.035% 99.902% ( 22, 34 ] 20 0.003% 99.905% ( 34, 51 ] 6 0.001% 99.906% ( 51, 76 ] 17 0.002% 99.908% ( 76, 110 ] 214 0.029% 99.937% ( 110, 170 ] 413 0.055% 99.992% ( 170, 250 ] 253 0.034% 100.026% ( 250, 380 ] 249 0.033% 100.059% ( 380, 580 ] 219 0.029% 100.088% ( 580, 870 ] 183 0.024% 100.113% ( 870, 1300 ] 110 0.015% 100.127% ( 1300, 1900 ] 58 0.008% 100.135% ( 1900, 2900 ] 48 0.006% 100.142% ( 2900, 4400 ] 47 0.006% 100.148% ( 4400, 6600 ] 21 0.003% 100.151% ( 6600, 9900 ] 14 0.002% 100.153% ( 9900, 14000 ] 5 0.001% 100.153% ** Level 2 read latency histogram (micros): Count: 48838 Average: 2.7098 StdDev: 16.52 Min: 0 Median: 1.5477 Max: 1308 Percentiles: P50: 1.55 P75: 1.92 P99: 6.67 P99.9: 138.81 P99.99: 878.33 ------------------------------------------------------ [ 0, 1 ] 6527 13.365% 13.365% ### ( 1, 2 ] 32667 66.888% 80.253% ############# ( 2, 3 ] 5585 11.436% 91.689% ## ( 3, 4 ] 2017 4.130% 95.819% # ( 4, 6 ] 1479 3.028% 98.847% # ( 6, 10 ] 443 0.907% 99.754% ( 10, 15 ] 41 0.084% 99.838% ( 15, 22 ] 8 0.016% 99.855% ( 22, 34 ] 4 0.008% 99.863% ( 34, 51 ] 1 0.002% 99.865% ( 76, 110 ] 9 0.018% 99.883% ( 110, 170 ] 17 0.035% 99.918% ( 170, 250 ] 9 0.018% 99.937% ( 250, 380 ] 10 0.020% 99.957% ( 380, 580 ] 12 0.025% 99.982% ( 580, 870 ] 4 0.008% 99.990% ( 870, 1300 ] 6 0.012% 100.002% ( 1300, 1900 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 365688 Average: 4.9398 StdDev: 76.86 Min: 0 Median: 2.0225 Max: 10244 Percentiles: P50: 2.02 P75: 3.00 P99: 8.30 P99.9: 11.64 P99.99: 12.90 ------------------------------------------------------ [ 0, 1 ] 4671 1.277% 1.277% ( 1, 2 ] 176063 48.146% 49.423% ########## ( 2, 3 ] 93758 25.639% 75.062% ##### ( 3, 4 ] 42346 11.580% 86.642% ## ( 4, 6 ] 41333 11.303% 97.944% ## ( 6, 10 ] 6726 1.839% 99.784% ( 10, 15 ] 1302 0.356% 100.140% ( 15, 22 ] 132 0.036% 100.176% ( 22, 34 ] 22 0.006% 100.182% ( 34, 51 ] 9 0.002% 100.184% ( 51, 76 ] 4 0.001% 100.185% ( 76, 110 ] 6 0.002% 100.187% ( 110, 170 ] 23 0.006% 100.193% ( 170, 250 ] 78 0.021% 100.215% ( 250, 380 ] 67 0.018% 100.233% ( 380, 580 ] 87 0.024% 100.257% ( 580, 870 ] 99 0.027% 100.284% ( 870, 1300 ] 56 0.015% 100.299% ( 1300, 1900 ] 31 0.008% 100.308% ( 1900, 2900 ] 37 0.010% 100.318% ( 2900, 4400 ] 66 0.018% 100.336% ( 4400, 6600 ] 14 0.004% 100.340% ( 6600, 9900 ] 6 0.002% 100.341% ( 9900, 14000 ] 1 0.000% 100.342% ** Level 4 read latency histogram (micros): Count: 12783 Average: 78.1327 StdDev: 338.13 Min: 1 Median: 2.1254 Max: 5403 Percentiles: P50: 2.13 P75: 3.46 P99: 1675.27 P99.9: 4157.75 P99.99: 5403.00 ------------------------------------------------------ [ 0, 1 ] 263 2.057% 2.057% ( 1, 2 ] 5765 45.099% 47.156% ######### ( 2, 3 ] 2899 22.679% 69.835% ##### ( 3, 4 ] 1431 11.195% 81.029% ## ( 4, 6 ] 878 6.868% 87.898% # ( 6, 10 ] 300 2.347% 90.245% ( 10, 15 ] 61 0.477% 90.722% ( 15, 22 ] 26 0.203% 90.925% ( 22, 34 ] 5 0.039% 90.965% ( 34, 51 ] 1 0.008% 90.972% ( 76, 110 ] 16 0.125% 91.098% ( 110, 170 ] 64 0.501% 91.598% ( 170, 250 ] 103 0.806% 92.404% ( 250, 380 ] 153 1.197% 93.601% ( 380, 580 ] 221 1.729% 95.330% ( 580, 870 ] 226 1.768% 97.098% ( 870, 1300 ] 180 1.408% 98.506% ( 1300, 1900 ] 101 0.790% 99.296% ( 1900, 2900 ] 42 0.329% 99.625% ( 2900, 4400 ] 42 0.329% 99.953% ( 4400, 6600 ] 6 0.047% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 966.9000 StdDev: 1058.60 Min: 87 Median: 540.0000 Max: 4109 Percentiles: P50: 540.00 P75: 1300.00 P99: 4109.00 P99.9: 4109.00 P99.99: 4109.00 ------------------------------------------------------ ( 76, 110 ] 7 7.000% 7.000% # ( 110, 170 ] 19 19.000% 26.000% #### ( 170, 250 ] 6 6.000% 32.000% # ( 250, 380 ] 14 14.000% 46.000% ### ( 380, 580 ] 5 5.000% 51.000% # ( 580, 870 ] 13 13.000% 64.000% ### ( 870, 1300 ] 11 11.000% 75.000% ## ( 1300, 1900 ] 6 6.000% 81.000% # ( 1900, 2900 ] 12 12.000% 93.000% ## ( 2900, 4400 ] 7 7.000% 100.000% # ** DB Stats ** Uptime(secs): 34.0 total, 6.9 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 202.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.321 H:M:S, 42.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 143.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.764 H:M:S, 54.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/12/16-08:36:42 ... thread 0: (1000000,8000000) ops and (267165.8,213423.0) ops/second in (3.742994,37.484237) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 3.50 GB 107.0 7.4 0.0 7.4 15.0 7.6 0.0 2.0 141.9 286.0 53.71 48.88 133 0.404 7738K 10K 0.0 0.0 L1 12/12 1.30 GB 0.0 4.2 3.9 0.4 4.2 3.8 0.2 1.1 223.5 220.5 19.36 18.46 3 6.452 4392K 58K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 2.7 1.5 248.5 248.4 0.77 0.75 2 0.387 195K 87 0.0 0.0 L3 21/0 954.18 MB 1.0 3.2 2.2 1.0 3.2 2.2 0.6 1.4 184.3 183.4 17.79 14.88 9 1.977 3330K 15K 0.0 0.0 L4 181/0 9.55 GB 1.0 2.0 1.9 0.1 2.0 1.9 0.7 1.0 124.3 124.1 16.12 9.70 30 0.537 1994K 1817 0.0 0.0 L5 1076/0 88.34 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/22 103.62 GB 0.0 17.0 8.1 8.9 24.5 15.6 6.8 3.2 161.7 232.8 107.75 92.66 177 0.609 17M 86K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.0 8.1 8.9 24.5 15.6 6.8 3.2 161.7 232.8 107.75 92.66 177 0.609 17M 86K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.0 8.1 8.9 16.9 8.0 0.0 0.0 208.0 206.9 83.76 72.58 68 1.232 17M 86K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 323.0 23.99 20.07 109 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.7 total, 37.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.50 GB write, 665.20 MB/s write, 17.01 GB read, 462.05 MB/s read, 107.8 seconds Interval compaction: 24.50 GB write, 669.13 MB/s write, 17.01 GB read, 464.78 MB/s read, 107.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 49, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3375686 Average: 2.5170 StdDev: 26.57 Min: 0 Median: 1.4905 Max: 13609 Percentiles: P50: 1.49 P75: 1.88 P99: 5.93 P99.9: 81.61 P99.99: 223.08 ------------------------------------------------------ [ 0, 1 ] 615734 18.240% 18.240% #### ( 1, 2 ] 2185922 64.755% 82.995% ############# ( 2, 3 ] 340949 10.100% 93.095% ## ( 3, 4 ] 120484 3.569% 96.664% # ( 4, 6 ] 81757 2.422% 99.086% ( 6, 10 ] 24132 0.715% 99.801% ( 10, 15 ] 2712 0.080% 99.882% ( 15, 22 ] 323 0.010% 99.891% ( 22, 34 ] 32 0.001% 99.892% ( 34, 51 ] 24 0.001% 99.893% ( 51, 76 ] 40 0.001% 99.894% ( 76, 110 ] 1226 0.036% 99.930% ( 110, 170 ] 1690 0.050% 99.980% ( 170, 250 ] 489 0.014% 99.995% ( 250, 380 ] 289 0.009% 100.003% ( 380, 580 ] 296 0.009% 100.012% ( 580, 870 ] 187 0.006% 100.018% ( 870, 1300 ] 108 0.003% 100.021% ( 1300, 1900 ] 49 0.001% 100.022% ( 1900, 2900 ] 27 0.001% 100.023% ( 2900, 4400 ] 38 0.001% 100.024% ( 4400, 6600 ] 9 0.000% 100.025% ( 6600, 9900 ] 11 0.000% 100.025% ( 9900, 14000 ] 2 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 784066 Average: 4.4136 StdDev: 73.19 Min: 1 Median: 1.8191 Max: 13838 Percentiles: P50: 1.82 P75: 2.70 P99: 8.83 P99.9: 76.26 P99.99: 179.00 ------------------------------------------------------ [ 0, 1 ] 29476 3.759% 3.759% # ( 1, 2 ] 442606 56.450% 60.209% ########### ( 2, 3 ] 166662 21.256% 81.466% #### ( 3, 4 ] 66052 8.424% 89.890% ## ( 4, 6 ] 59944 7.645% 97.535% ## ( 6, 10 ] 16251 2.073% 99.608% ( 10, 15 ] 1971 0.251% 99.859% ( 15, 22 ] 273 0.035% 99.894% ( 22, 34 ] 22 0.003% 99.897% ( 34, 51 ] 6 0.001% 99.898% ( 51, 76 ] 17 0.002% 99.900% ( 76, 110 ] 252 0.032% 99.932% ( 110, 170 ] 426 0.054% 99.986% ( 170, 250 ] 263 0.034% 100.020% ( 250, 380 ] 254 0.032% 100.052% ( 380, 580 ] 224 0.029% 100.081% ( 580, 870 ] 190 0.024% 100.105% ( 870, 1300 ] 110 0.014% 100.119% ( 1300, 1900 ] 61 0.008% 100.127% ( 1900, 2900 ] 54 0.007% 100.134% ( 2900, 4400 ] 51 0.007% 100.140% ( 4400, 6600 ] 23 0.003% 100.143% ( 6600, 9900 ] 17 0.002% 100.145% ( 9900, 14000 ] 8 0.001% 100.146% ** Level 2 read latency histogram (micros): Count: 48838 Average: 2.7098 StdDev: 16.52 Min: 0 Median: 1.5477 Max: 1308 Percentiles: P50: 1.55 P75: 1.92 P99: 6.67 P99.9: 138.81 P99.99: 878.33 ------------------------------------------------------ [ 0, 1 ] 6527 13.365% 13.365% ### ( 1, 2 ] 32667 66.888% 80.253% ############# ( 2, 3 ] 5585 11.436% 91.689% ## ( 3, 4 ] 2017 4.130% 95.819% # ( 4, 6 ] 1479 3.028% 98.847% # ( 6, 10 ] 443 0.907% 99.754% ( 10, 15 ] 41 0.084% 99.838% ( 15, 22 ] 8 0.016% 99.855% ( 22, 34 ] 4 0.008% 99.863% ( 34, 51 ] 1 0.002% 99.865% ( 76, 110 ] 9 0.018% 99.883% ( 110, 170 ] 17 0.035% 99.918% ( 170, 250 ] 9 0.018% 99.937% ( 250, 380 ] 10 0.020% 99.957% ( 380, 580 ] 12 0.025% 99.982% ( 580, 870 ] 4 0.008% 99.990% ( 870, 1300 ] 6 0.012% 100.002% ( 1300, 1900 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 585661 Average: 5.0001 StdDev: 83.19 Min: 0 Median: 2.0309 Max: 16351 Percentiles: P50: 2.03 P75: 3.01 P99: 8.50 P99.9: 12.11 P99.99: 13.33 ------------------------------------------------------ [ 0, 1 ] 6816 1.164% 1.164% ( 1, 2 ] 281361 48.042% 49.205% ########## ( 2, 3 ] 150682 25.729% 74.934% ##### ( 3, 4 ] 67874 11.589% 86.523% ## ( 4, 6 ] 65798 11.235% 97.758% ## ( 6, 10 ] 11626 1.985% 99.743% ( 10, 15 ] 2173 0.371% 100.114% ( 15, 22 ] 196 0.033% 100.148% ( 22, 34 ] 32 0.005% 100.153% ( 34, 51 ] 14 0.002% 100.156% ( 51, 76 ] 4 0.001% 100.156% ( 76, 110 ] 17 0.003% 100.159% ( 110, 170 ] 116 0.020% 100.179% ( 170, 250 ] 141 0.024% 100.203% ( 250, 380 ] 115 0.020% 100.223% ( 380, 580 ] 134 0.023% 100.246% ( 580, 870 ] 149 0.025% 100.271% ( 870, 1300 ] 88 0.015% 100.286% ( 1300, 1900 ] 52 0.009% 100.295% ( 1900, 2900 ] 60 0.010% 100.305% ( 2900, 4400 ] 86 0.015% 100.320% ( 4400, 6600 ] 28 0.005% 100.325% ( 6600, 9900 ] 14 0.002% 100.327% ( 9900, 14000 ] 1 0.000% 100.327% ( 14000, 22000 ] 2 0.000% 100.327% ** Level 4 read latency histogram (micros): Count: 22018 Average: 80.7218 StdDev: 372.99 Min: 1 Median: 2.1004 Max: 6323 Percentiles: P50: 2.10 P75: 3.42 P99: 1776.35 P99.9: 4736.94 P99.99: 6323.00 ------------------------------------------------------ [ 0, 1 ] 460 2.089% 2.089% ( 1, 2 ] 10048 45.635% 47.725% ######### ( 2, 3 ] 4989 22.659% 70.383% ##### ( 3, 4 ] 2417 10.977% 81.361% ## ( 4, 6 ] 1531 6.953% 88.314% # ( 6, 10 ] 490 2.225% 90.540% ( 10, 15 ] 95 0.431% 90.971% ( 15, 22 ] 32 0.145% 91.116% ( 22, 34 ] 5 0.023% 91.139% ( 34, 51 ] 1 0.005% 91.144% ( 76, 110 ] 36 0.164% 91.307% ( 110, 170 ] 150 0.681% 91.988% ( 170, 250 ] 192 0.872% 92.860% ( 250, 380 ] 231 1.049% 93.910% ( 380, 580 ] 333 1.512% 95.422% ( 580, 870 ] 372 1.690% 97.111% ( 870, 1300 ] 288 1.308% 98.419% ( 1300, 1900 ] 161 0.731% 99.151% ( 1900, 2900 ] 80 0.363% 99.514% ( 2900, 4400 ] 81 0.368% 99.882% ( 4400, 6600 ] 26 0.118% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1012.3875 StdDev: 1084.49 Min: 81 Median: 546.6667 Max: 4558 Percentiles: P50: 546.67 P75: 1550.00 P99: 4325.00 P99.9: 4558.00 P99.99: 4558.00 ------------------------------------------------------ ( 76, 110 ] 13 8.125% 8.125% ## ( 110, 170 ] 27 16.875% 25.000% ### ( 170, 250 ] 9 5.625% 30.625% # ( 250, 380 ] 21 13.125% 43.750% ### ( 380, 580 ] 12 7.500% 51.250% ## ( 580, 870 ] 19 11.875% 63.125% ## ( 870, 1300 ] 14 8.750% 71.875% ## ( 1300, 1900 ] 12 7.500% 79.375% ## ( 1900, 2900 ] 20 12.500% 91.875% ### ( 2900, 4400 ] 12 7.500% 99.375% ## ( 4400, 6600 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 37.7 total, 3.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 208.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.288 H:M:S, 40.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 262.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.967 H:M:S, 25.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/16-08:36:45 ... thread 0: (1000000,9000000) ops and (324919.1,221883.0) ops/second in (3.077689,40.561926) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/10 4.48 GB 207.6 8.3 0.0 8.3 16.8 8.5 0.0 2.0 141.6 287.3 60.03 54.85 150 0.400 8634K 11K 0.0 0.0 L1 12/12 1.30 GB 0.0 4.2 3.9 0.4 4.2 3.8 0.2 1.1 223.5 220.5 19.36 18.46 3 6.452 4392K 58K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 2.7 1.5 248.5 248.4 0.77 0.75 2 0.387 195K 87 0.0 0.0 L3 21/0 954.18 MB 1.0 3.2 2.2 1.0 3.2 2.2 0.6 1.4 184.3 183.4 17.79 14.88 9 1.977 3330K 15K 0.0 0.0 L4 181/0 9.55 GB 1.0 2.0 1.9 0.1 2.0 1.9 0.7 1.0 124.3 124.1 16.12 9.70 30 0.537 1994K 1817 0.0 0.0 L5 1076/0 88.34 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1309/22 104.60 GB 0.0 17.9 8.1 9.8 26.3 16.5 6.8 3.1 160.5 236.4 114.08 98.62 194 0.588 18M 87K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.9 8.1 9.8 26.3 16.5 6.8 3.1 160.5 236.4 114.08 98.62 194 0.588 18M 87K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.9 8.1 9.8 17.8 8.0 0.0 0.0 209.9 208.9 87.20 75.96 71 1.228 18M 87K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 325.7 26.88 22.67 123 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.8 total, 40.6 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.34 GB write, 661.31 MB/s write, 17.88 GB read, 448.80 MB/s read, 114.1 seconds Interval compaction: 26.34 GB write, 664.93 MB/s write, 17.88 GB read, 451.26 MB/s read, 114.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 53, interval: 76 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3687366 Average: 2.5074 StdDev: 25.67 Min: 0 Median: 1.4953 Max: 13609 Percentiles: P50: 1.50 P75: 1.88 P99: 5.91 P99.9: 76.41 P99.99: 212.94 ------------------------------------------------------ [ 0, 1 ] 656585 17.806% 17.806% #### ( 1, 2 ] 2396742 64.999% 82.805% ############# ( 2, 3 ] 380491 10.319% 93.124% ## ( 3, 4 ] 131347 3.562% 96.686% # ( 4, 6 ] 89133 2.417% 99.103% ( 6, 10 ] 26017 0.706% 99.809% ( 10, 15 ] 2898 0.079% 99.887% ( 15, 22 ] 347 0.009% 99.897% ( 22, 34 ] 36 0.001% 99.898% ( 34, 51 ] 26 0.001% 99.898% ( 51, 76 ] 42 0.001% 99.900% ( 76, 110 ] 1287 0.035% 99.935% ( 110, 170 ] 1759 0.048% 99.982% ( 170, 250 ] 537 0.015% 99.997% ( 250, 380 ] 311 0.008% 100.005% ( 380, 580 ] 322 0.009% 100.014% ( 580, 870 ] 205 0.006% 100.019% ( 870, 1300 ] 113 0.003% 100.023% ( 1300, 1900 ] 51 0.001% 100.024% ( 1900, 2900 ] 28 0.001% 100.025% ( 2900, 4400 ] 39 0.001% 100.026% ( 4400, 6600 ] 9 0.000% 100.026% ( 6600, 9900 ] 11 0.000% 100.026% ( 9900, 14000 ] 2 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 888981 Average: 4.2058 StdDev: 68.84 Min: 1 Median: 1.7900 Max: 13838 Percentiles: P50: 1.79 P75: 2.62 P99: 8.76 P99.9: 84.50 P99.99: 190.31 ------------------------------------------------------ [ 0, 1 ] 38532 4.334% 4.334% # ( 1, 2 ] 513890 57.807% 62.141% ############ ( 2, 3 ] 182928 20.577% 82.718% #### ( 3, 4 ] 69667 7.837% 90.555% ## ( 4, 6 ] 62683 7.051% 97.606% # ( 6, 10 ] 17934 2.017% 99.624% ( 10, 15 ] 2041 0.230% 99.853% ( 15, 22 ] 282 0.032% 99.885% ( 22, 34 ] 22 0.002% 99.887% ( 34, 51 ] 7 0.001% 99.888% ( 51, 76 ] 20 0.002% 99.890% ( 76, 110 ] 344 0.039% 99.929% ( 110, 170 ] 471 0.053% 99.982% ( 170, 250 ] 280 0.031% 100.013% ( 250, 380 ] 268 0.030% 100.044% ( 380, 580 ] 237 0.027% 100.070% ( 580, 870 ] 196 0.022% 100.092% ( 870, 1300 ] 111 0.012% 100.105% ( 1300, 1900 ] 62 0.007% 100.112% ( 1900, 2900 ] 54 0.006% 100.118% ( 2900, 4400 ] 51 0.006% 100.124% ( 4400, 6600 ] 23 0.003% 100.126% ( 6600, 9900 ] 17 0.002% 100.128% ( 9900, 14000 ] 8 0.001% 100.129% ** Level 2 read latency histogram (micros): Count: 48838 Average: 2.7098 StdDev: 16.52 Min: 0 Median: 1.5477 Max: 1308 Percentiles: P50: 1.55 P75: 1.92 P99: 6.67 P99.9: 138.81 P99.99: 878.33 ------------------------------------------------------ [ 0, 1 ] 6527 13.365% 13.365% ### ( 1, 2 ] 32667 66.888% 80.253% ############# ( 2, 3 ] 5585 11.436% 91.689% ## ( 3, 4 ] 2017 4.130% 95.819% # ( 4, 6 ] 1479 3.028% 98.847% # ( 6, 10 ] 443 0.907% 99.754% ( 10, 15 ] 41 0.084% 99.838% ( 15, 22 ] 8 0.016% 99.855% ( 22, 34 ] 4 0.008% 99.863% ( 34, 51 ] 1 0.002% 99.865% ( 76, 110 ] 9 0.018% 99.883% ( 110, 170 ] 17 0.035% 99.918% ( 170, 250 ] 9 0.018% 99.937% ( 250, 380 ] 10 0.020% 99.957% ( 380, 580 ] 12 0.025% 99.982% ( 580, 870 ] 4 0.008% 99.990% ( 870, 1300 ] 6 0.012% 100.002% ( 1300, 1900 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 585661 Average: 5.0001 StdDev: 83.19 Min: 0 Median: 2.0309 Max: 16351 Percentiles: P50: 2.03 P75: 3.01 P99: 8.50 P99.9: 12.11 P99.99: 13.33 ------------------------------------------------------ [ 0, 1 ] 6816 1.164% 1.164% ( 1, 2 ] 281361 48.042% 49.205% ########## ( 2, 3 ] 150682 25.729% 74.934% ##### ( 3, 4 ] 67874 11.589% 86.523% ## ( 4, 6 ] 65798 11.235% 97.758% ## ( 6, 10 ] 11626 1.985% 99.743% ( 10, 15 ] 2173 0.371% 100.114% ( 15, 22 ] 196 0.033% 100.148% ( 22, 34 ] 32 0.005% 100.153% ( 34, 51 ] 14 0.002% 100.156% ( 51, 76 ] 4 0.001% 100.156% ( 76, 110 ] 17 0.003% 100.159% ( 110, 170 ] 116 0.020% 100.179% ( 170, 250 ] 141 0.024% 100.203% ( 250, 380 ] 115 0.020% 100.223% ( 380, 580 ] 134 0.023% 100.246% ( 580, 870 ] 149 0.025% 100.271% ( 870, 1300 ] 88 0.015% 100.286% ( 1300, 1900 ] 52 0.009% 100.295% ( 1900, 2900 ] 60 0.010% 100.305% ( 2900, 4400 ] 86 0.015% 100.320% ( 4400, 6600 ] 28 0.005% 100.325% ( 6600, 9900 ] 14 0.002% 100.327% ( 9900, 14000 ] 1 0.000% 100.327% ( 14000, 22000 ] 2 0.000% 100.327% ** Level 4 read latency histogram (micros): Count: 22018 Average: 80.7218 StdDev: 372.99 Min: 1 Median: 2.1004 Max: 6323 Percentiles: P50: 2.10 P75: 3.42 P99: 1776.35 P99.9: 4736.94 P99.99: 6323.00 ------------------------------------------------------ [ 0, 1 ] 460 2.089% 2.089% ( 1, 2 ] 10048 45.635% 47.725% ######### ( 2, 3 ] 4989 22.659% 70.383% ##### ( 3, 4 ] 2417 10.977% 81.361% ## ( 4, 6 ] 1531 6.953% 88.314% # ( 6, 10 ] 490 2.225% 90.540% ( 10, 15 ] 95 0.431% 90.971% ( 15, 22 ] 32 0.145% 91.116% ( 22, 34 ] 5 0.023% 91.139% ( 34, 51 ] 1 0.005% 91.144% ( 76, 110 ] 36 0.164% 91.307% ( 110, 170 ] 150 0.681% 91.988% ( 170, 250 ] 192 0.872% 92.860% ( 250, 380 ] 231 1.049% 93.910% ( 380, 580 ] 333 1.512% 95.422% ( 580, 870 ] 372 1.690% 97.111% ( 870, 1300 ] 288 1.308% 98.419% ( 1300, 1900 ] 161 0.731% 99.151% ( 1900, 2900 ] 80 0.363% 99.514% ( 2900, 4400 ] 81 0.368% 99.882% ( 4400, 6600 ] 26 0.118% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1012.3875 StdDev: 1084.49 Min: 81 Median: 546.6667 Max: 4558 Percentiles: P50: 546.67 P75: 1550.00 P99: 4325.00 P99.9: 4558.00 P99.99: 4558.00 ------------------------------------------------------ ( 76, 110 ] 13 8.125% 8.125% ## ( 110, 170 ] 27 16.875% 25.000% ### ( 170, 250 ] 9 5.625% 30.625% # ( 250, 380 ] 21 13.125% 43.750% ### ( 380, 580 ] 12 7.500% 51.250% ## ( 580, 870 ] 19 11.875% 63.125% ## ( 870, 1300 ] 14 8.750% 71.875% ## ( 1300, 1900 ] 12 7.500% 79.375% ## ( 1900, 2900 ] 20 12.500% 91.875% ### ( 2900, 4400 ] 12 7.500% 99.375% ## ( 4400, 6600 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 40.8 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 217.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.696 H:M:S, 38.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.408 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.226 micros/op 160625 ops/sec 60.078 seconds 9649999 operations; 155.6 MB/s Microseconds per write: Count: 9649999 Average: 6.2257 StdDev: 350.67 Min: 1 Median: 1.7587 Max: 491775 Percentiles: P50: 1.76 P75: 2.81 P99: 10.28 P99.9: 1179.67 P99.99: 2713.99 ------------------------------------------------------ [ 0, 1 ] 1161316 12.034% 12.034% ## ( 1, 2 ] 4828876 50.040% 62.075% ########## ( 2, 3 ] 1531552 15.871% 77.946% ### ( 3, 4 ] 1339702 13.883% 91.828% ### ( 4, 6 ] 538501 5.580% 97.409% # ( 6, 10 ] 150533 1.560% 98.969% ( 10, 15 ] 53606 0.556% 99.524% ( 15, 22 ] 11856 0.123% 99.647% ( 22, 34 ] 1957 0.020% 99.667% ( 34, 51 ] 247 0.003% 99.670% ( 51, 76 ] 28 0.000% 99.670% ( 76, 110 ] 6550 0.068% 99.738% ( 110, 170 ] 2691 0.028% 99.766% ( 170, 250 ] 278 0.003% 99.769% ( 250, 380 ] 250 0.003% 99.771% ( 380, 580 ] 21 0.000% 99.772% ( 580, 870 ] 22 0.000% 99.772% ( 870, 1300 ] 17167 0.178% 99.950% ( 1300, 1900 ] 87 0.001% 99.951% ( 1900, 2900 ] 4661 0.048% 99.999% ( 2900, 4400 ] 53 0.001% 100.000% ( 4400, 6600 ] 10 0.000% 100.000% ( 6600, 9900 ] 11 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 200942 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9649999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9958798968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 524 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32657383 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30499450984 rocksdb.compact.write.bytes COUNT : 30305776944 rocksdb.flush.write.bytes COUNT : 9908573455 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 54 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 260 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9828695040 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3836928 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30590230620 rocksdb.non.last.level.read.count COUNT : 7391631 rocksdb.block.checksum.compute.count COUNT : 7390638 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.428279 P95 : 3.992658 P99 : 8.906139 P100 : 491773.000000 COUNT : 9649999 SUM : 55451442 rocksdb.compaction.times.micros P50 : 874166.666667 P95 : 3796000.000000 P99 : 16962597.000000 P100 : 16962597.000000 COUNT : 96 SUM : 125696806 rocksdb.compaction.times.cpu_micros P50 : 751250.000000 P95 : 3670000.000000 P99 : 15350216.000000 P100 : 15350216.000000 COUNT : 96 SUM : 109693207 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 668.933333 P95 : 1194.454545 P99 : 12606.000000 P100 : 45723.000000 COUNT : 134 SUM : 153813 rocksdb.compaction.outfile.sync.micros P50 : 996.611111 P95 : 45041.666667 P99 : 116750.000000 P100 : 130740.000000 COUNT : 355 SUM : 2639061 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 99.771186 P95 : 778.166667 P99 : 3105.000000 P100 : 3614.000000 COUNT : 259 SUM : 57786 rocksdb.table.open.io.micros P50 : 1245.396825 P95 : 6502.222222 P99 : 11516.571429 P100 : 14179.000000 COUNT : 524 SUM : 1000277 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.644248 P95 : 7.553116 P99 : 10.121332 P100 : 16357.000000 COUNT : 7389244 SUM : 41625681 rocksdb.read.block.get.micros P50 : 382.222222 P95 : 3257.894737 P99 : 4361.052632 P100 : 5810.000000 COUNT : 1048 SUM : 818141 rocksdb.write.raw.block.micros P50 : 0.514729 P95 : 0.977985 P99 : 2.979991 P100 : 19890.000000 COUNT : 9739709 SUM : 19520375 rocksdb.numfiles.in.singlecompaction P50 : 2.954545 P95 : 5.183333 P99 : 20.985000 P100 : 27.000000 COUNT : 129 SUM : 450 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561997 P95 : 1168.832343 P99 : 2482.358633 P100 : 491585.000000 COUNT : 200245 SUM : 32680324 rocksdb.sst.read.micros P50 : 1.582703 P95 : 4.384377 P99 : 7.993619 P100 : 16351.000000 COUNT : 7391978 SUM : 26233796 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9649999 SUM : 9958798968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213265.306122 P95 : 367000.000000 P99 : 665700.000000 P100 : 808208.000000 COUNT : 134 SUM : 28995639 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 330 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0